2024-09-21T03:21:29.226 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T03:21:29.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T03:21:29.348 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913468 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/fs/test_o_trunc}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913468' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPiBk4sEIzy5Wd71fJppCW6VO2M76g6s5VRvVAj1Vl83gi3JvJekXKfr0XWOpQzLz9r3E5f+faodxIbHJMUw4Lw= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK16gzEpTB+DMLDZEhSpwUDh33auXiBbNl00RIQrVRoCnHqAglg9aJPgN++JqrUyJNncXd85/bHtn89wiIGhJuE= smithi174.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKlGujOcMGKuTAm5QgXfR6/AuqtucRF8DlQIZTYIDVbLItAE/t+30kOgGJUO9HcuFvL7Der80HJ/rhN6uB0DLNQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - fs/test_o_trunc.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T03:21:29.348 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T03:21:29.349 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T03:21:29.349 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T03:21:29.351 INFO:teuthology.task.internal:Checking packages... 2024-09-21T03:21:29.371 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T03:21:29.371 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T03:21:29.371 INFO:teuthology.packaging:ref: None 2024-09-21T03:21:29.371 INFO:teuthology.packaging:tag: None 2024-09-21T03:21:29.371 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T03:21:29.371 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:21:29.372 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T03:21:29.516 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T03:21:29.517 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T03:21:29.530 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T03:21:29.530 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T03:21:29.602 INFO:teuthology.task.internal:Saving configuration 2024-09-21T03:21:29.624 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T03:21:29.630 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T03:21:29.655 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913468', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 03:16:30.144182', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPiBk4sEIzy5Wd71fJppCW6VO2M76g6s5VRvVAj1Vl83gi3JvJekXKfr0XWOpQzLz9r3E5f+faodxIbHJMUw4Lw='} 2024-09-21T03:21:29.678 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913468', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 03:16:30.143076', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK16gzEpTB+DMLDZEhSpwUDh33auXiBbNl00RIQrVRoCnHqAglg9aJPgN++JqrUyJNncXd85/bHtn89wiIGhJuE='} 2024-09-21T03:21:29.700 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913468', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 03:16:30.141746', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKlGujOcMGKuTAm5QgXfR6/AuqtucRF8DlQIZTYIDVbLItAE/t+30kOgGJUO9HcuFvL7Der80HJ/rhN6uB0DLNQ='} 2024-09-21T03:21:29.700 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T03:21:29.707 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T03:21:29.707 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T03:21:29.707 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T03:21:29.707 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T03:21:29.806 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6c9fefc160>, signals=[15]) 2024-09-21T03:21:29.806 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T03:21:29.812 INFO:teuthology.task.internal:Opening connections... 2024-09-21T03:21:29.812 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T03:21:29.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:21:29.889 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-09-21T03:21:29.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:21:29.962 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2024-09-21T03:21:29.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:21:30.035 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T03:21:30.042 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-09-21T03:21:30.060 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-09-21T03:21:30.060 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-09-21T03:21:30.117 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-09-21T03:21:30.117 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-09-21T03:21:30.117 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-09-21T03:21:30.117 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-09-21T03:21:30.118 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-09-21T03:21:30.118 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-09-21T03:21:30.118 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T03:21:30.118 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-09-21T03:21:30.118 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-09-21T03:21:30.118 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T03:21:30.118 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-09-21T03:21:30.118 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T03:21:30.118 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T03:21:30.118 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T03:21:30.119 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-09-21T03:21:30.140 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-09-21T03:21:30.158 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-09-21T03:21:30.158 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-09-21T03:21:30.217 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-09-21T03:21:30.217 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-09-21T03:21:30.217 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-09-21T03:21:30.217 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-09-21T03:21:30.217 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-09-21T03:21:30.218 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-09-21T03:21:30.218 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T03:21:30.218 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-09-21T03:21:30.218 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-09-21T03:21:30.218 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T03:21:30.218 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-09-21T03:21:30.218 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T03:21:30.218 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T03:21:30.218 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T03:21:30.218 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-09-21T03:21:30.282 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2024-09-21T03:21:30.301 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2024-09-21T03:21:30.301 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2024-09-21T03:21:30.359 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2024-09-21T03:21:30.360 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2024-09-21T03:21:30.360 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2024-09-21T03:21:30.360 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2024-09-21T03:21:30.360 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2024-09-21T03:21:30.360 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2024-09-21T03:21:30.360 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T03:21:30.360 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2024-09-21T03:21:30.360 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2024-09-21T03:21:30.360 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T03:21:30.360 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2024-09-21T03:21:30.360 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T03:21:30.360 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T03:21:30.361 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T03:21:30.361 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2024-09-21T03:21:30.382 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T03:21:30.400 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T03:21:30.469 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T03:21:30.469 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2024-09-21T03:21:30.471 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-09-21T03:21:30.473 DEBUG:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2024-09-21T03:21:30.490 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T03:21:30.496 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T03:21:30.496 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2024-09-21T03:21:30.529 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-09-21T03:21:30.531 DEBUG:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2024-09-21T03:21:30.633 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T03:21:30.734 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T03:21:30.749 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T03:21:30.749 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-21T03:21:30.749 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-21T03:21:30.749 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T03:21:30.766 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:21:30.767 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-09-21T03:21:30.824 INFO:teuthology.orchestra.run.smithi084.stdout:5.14.0-503.el9.x86_64 2024-09-21T03:21:30.825 INFO:teuthology.task.kernel:Running kernel on smithi084: 5.14.0-503.el9.x86_64 2024-09-21T03:21:30.825 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum install -y kernel 2024-09-21T03:21:33.278 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-21T03:21:38.769 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-21T03:21:44.744 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.5 MB 00:02 2024-09-21T03:21:46.220 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 19 kB 00:00 2024-09-21T03:21:46.982 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-21T03:21:52.521 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-09-21T03:21:54.402 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T03:21:54.402 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T03:21:54.492 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-21T03:21:54.499 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-21T03:21:54.499 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-09-21T03:21:54.499 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-21T03:21:54.499 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-21T03:21:54.499 INFO:teuthology.orchestra.run.smithi084.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T03:21:54.500 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-09-21T03:21:54.500 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T03:21:54.500 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T03:21:54.500 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T03:21:54.500 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:21:54.500 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-21T03:21:54.500 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-09-21T03:21:54.500 INFO:teuthology.orchestra.run.smithi084.stdout:Install 4 Packages 2024-09-21T03:21:54.500 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:21:54.501 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 79 M 2024-09-21T03:21:54.501 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 126 M 2024-09-21T03:21:54.501 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-21T03:21:54.897 INFO:teuthology.orchestra.run.smithi084.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 294 kB/s | 36 kB 00:00 2024-09-21T03:22:00.496 INFO:teuthology.orchestra.run.smithi084.stdout:(2/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 6.0 MB/s | 35 MB 00:05 2024-09-21T03:22:01.963 INFO:teuthology.orchestra.run.smithi084.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 2.2 MB/s | 16 MB 00:07 2024-09-21T03:22:08.031 INFO:teuthology.orchestra.run.smithi084.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 2.2 MB/s | 29 MB 00:13 2024-09-21T03:22:08.031 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:22:08.031 INFO:teuthology.orchestra.run.smithi084.stdout:Total 5.8 MB/s | 79 MB 00:13 2024-09-21T03:22:08.716 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-21T03:22:09.058 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-21T03:22:09.058 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-21T03:22:10.017 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-21T03:22:10.017 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-21T03:22:12.423 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-21T03:22:13.071 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T03:22:13.156 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:22:15.917 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:22:16.041 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:22:20.852 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:22:20.966 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:22:25.793 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:23:03.680 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:23:03.719 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:23:04.046 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:23:04.046 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T03:23:04.046 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:23:04.046 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:23:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:23:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:23:04.920 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-21T03:23:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T03:23:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T03:23:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T03:23:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T03:23:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:23:04.921 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-21T03:23:05.305 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T03:23:05.399 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T03:23:05.400 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T03:23:05.400 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T03:23:05.400 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T03:23:05.400 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T03:23:05.400 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T03:23:05.400 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi084.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T03:23:05.400 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T03:23:05.458 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T03:23:05.459 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T03:23:05.459 DEBUG:teuthology.orchestra.run.smithi084:> sudo rpm -qi grub2-tools 2024-09-21T03:23:05.490 INFO:teuthology.orchestra.run.smithi084.stdout:Name : grub2-tools 2024-09-21T03:23:05.490 INFO:teuthology.orchestra.run.smithi084.stdout:Epoch : 1 2024-09-21T03:23:05.491 INFO:teuthology.orchestra.run.smithi084.stdout:Version : 2.06 2024-09-21T03:23:05.491 INFO:teuthology.orchestra.run.smithi084.stdout:Release : 82.el9 2024-09-21T03:23:05.491 INFO:teuthology.orchestra.run.smithi084.stdout:Architecture: x86_64 2024-09-21T03:23:05.491 INFO:teuthology.orchestra.run.smithi084.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T03:23:05.491 INFO:teuthology.orchestra.run.smithi084.stdout:Group : Unspecified 2024-09-21T03:23:05.491 INFO:teuthology.orchestra.run.smithi084.stdout:Size : 8274670 2024-09-21T03:23:05.491 INFO:teuthology.orchestra.run.smithi084.stdout:License : GPLv3+ 2024-09-21T03:23:05.491 INFO:teuthology.orchestra.run.smithi084.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T03:23:05.491 INFO:teuthology.orchestra.run.smithi084.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T03:23:05.491 INFO:teuthology.orchestra.run.smithi084.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T03:23:05.491 INFO:teuthology.orchestra.run.smithi084.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T03:23:05.491 INFO:teuthology.orchestra.run.smithi084.stdout:Packager : builder@centos.org 2024-09-21T03:23:05.491 INFO:teuthology.orchestra.run.smithi084.stdout:Vendor : CentOS 2024-09-21T03:23:05.492 INFO:teuthology.orchestra.run.smithi084.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T03:23:05.492 INFO:teuthology.orchestra.run.smithi084.stdout:Summary : Support tools for GRUB. 2024-09-21T03:23:05.492 INFO:teuthology.orchestra.run.smithi084.stdout:Description : 2024-09-21T03:23:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:23:05.492 INFO:teuthology.orchestra.run.smithi084.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T03:23:05.492 INFO:teuthology.orchestra.run.smithi084.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T03:23:05.492 INFO:teuthology.orchestra.run.smithi084.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T03:23:05.492 INFO:teuthology.orchestra.run.smithi084.stdout:hardware devices. 2024-09-21T03:23:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:23:05.492 INFO:teuthology.orchestra.run.smithi084.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T03:23:05.493 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T03:23:05.493 INFO:teuthology.task.kernel:Updating grub on smithi084 to boot 5.14.0-508.el9.x86_64 2024-09-21T03:23:05.493 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T03:23:06.120 INFO:teuthology.orchestra.run.smithi084.stderr:Generating grub configuration file ... 2024-09-21T03:23:07.434 INFO:teuthology.orchestra.run.smithi084.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T03:23:07.471 INFO:teuthology.orchestra.run.smithi084.stderr:done 2024-09-21T03:23:07.474 DEBUG:teuthology.orchestra.run.smithi084:> mktemp 2024-09-21T03:23:07.489 INFO:teuthology.orchestra.run.smithi084.stdout:/tmp/tmp.hbF9n17RlL 2024-09-21T03:23:07.489 DEBUG:teuthology.orchestra.run.smithi084:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hbF9n17RlL 2024-09-21T03:23:07.567 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0666 /tmp/tmp.hbF9n17RlL 2024-09-21T03:23:07.712 DEBUG:teuthology.orchestra.remote:smithi084:/tmp/tmp.hbF9n17RlL is 6KB 2024-09-21T03:23:07.760 DEBUG:teuthology.orchestra.run.smithi084:> rm -fr /tmp/tmp.hbF9n17RlL 2024-09-21T03:23:07.775 DEBUG:teuthology.orchestra.run.smithi084:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T03:23:07.837 INFO:teuthology.orchestra.run.smithi084.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T03:23:07.837 INFO:teuthology.orchestra.run.smithi084.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T03:23:07.837 INFO:teuthology.orchestra.run.smithi084.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T03:23:07.837 INFO:teuthology.orchestra.run.smithi084.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T03:23:07.839 DEBUG:teuthology.orchestra.run.smithi084:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T03:23:07.971 DEBUG:teuthology.orchestra.run.smithi084:> sudo shutdown -r now 2024-09-21T03:23:37.974 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T03:23:37.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-21T03:23:37.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:24:37.977 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T03:24:46.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-21T03:24:46.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:24:47.381 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-09-21T03:24:47.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-21T03:24:47.784 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T03:24:47.784 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-09-21T03:24:47.799 INFO:teuthology.orchestra.run.smithi084.stdout:5.14.0-508.el9.x86_64 2024-09-21T03:24:47.799 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T03:24:47.800 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T03:24:47.800 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T03:24:48.800 DEBUG:teuthology.parallel:result is None 2024-09-21T03:24:48.801 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T03:24:48.809 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T03:24:48.809 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T03:24:48.811 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T03:24:48.814 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T03:24:48.832 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T03:24:48.838 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T03:24:48.881 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T03:24:48.881 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T03:24:48.883 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T03:24:48.886 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T03:24:49.011 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T03:24:49.019 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T03:24:49.019 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T03:24:49.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:24:49.036 DEBUG:teuthology.orchestra.run.smithi174:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T03:24:49.052 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:24:49.053 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T03:24:49.055 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T03:24:49.078 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T03:24:49.123 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:24:49.145 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:24:49.153 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:24:49.167 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:24:49.169 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:24:49.192 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:24:49.195 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T03:24:49.201 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T03:24:49.202 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T03:24:49.205 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T03:24:49.207 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T03:24:49.234 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T03:24:49.266 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T03:24:49.266 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T03:24:49.275 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T03:24:49.277 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T03:24:49.293 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:24:49.370 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:24:49.494 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:24:49.531 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:24:49.580 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T03:24:49.580 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T03:24:49.658 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:24:49.700 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:24:49.755 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:24:49.834 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:24:49.880 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T03:24:49.881 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T03:24:49.947 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:24:49.986 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:24:50.045 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:24:50.126 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:24:50.173 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T03:24:50.173 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T03:24:50.241 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2024-09-21T03:24:50.244 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-09-21T03:24:50.246 DEBUG:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2024-09-21T03:24:50.285 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:24:50.320 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:24:50.334 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:24:50.761 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T03:24:50.769 INFO:teuthology.task.internal:Starting timer... 2024-09-21T03:24:50.769 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T03:24:50.818 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T03:24:50.858 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T03:24:50.858 DEBUG:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2024-09-21T03:24:51.049 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: 2024-09-21T03:24:51.051 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2024-09-21T03:24:51.115 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2024-09-21T03:24:51.117 DEBUG:teuthology.orchestra.run.smithi174:> sudo service auditd rotate 2024-09-21T03:24:51.170 INFO:teuthology.orchestra.run.smithi174.stdout:Rotating logs: 2024-09-21T03:24:51.172 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T03:24:51.172 DEBUG:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2024-09-21T03:24:51.307 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2024-09-21T03:24:51.308 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2024-09-21T03:24:51.333 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2024-09-21T03:24:51.333 DEBUG:teuthology.orchestra.run.smithi174:> /usr/sbin/getenforce 2024-09-21T03:24:51.360 INFO:teuthology.orchestra.run.smithi174.stdout:Permissive 2024-09-21T03:24:51.360 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi084.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi174.front.sepia.ceph.com': 'permissive'} 2024-09-21T03:24:51.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:24:51.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:24:51.388 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:24:51.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:24:51.415 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:24:51.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:24:51.443 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T03:24:51.444 DEBUG:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2024-09-21T03:24:51.493 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2024-09-21T03:24:51.528 DEBUG:teuthology.orchestra.run.smithi174:> sudo /usr/sbin/setenforce permissive 2024-09-21T03:24:51.577 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T03:24:51.586 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T03:24:51.588 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T03:24:51.687 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T03:24:51.697 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T03:24:51.698 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi084.front.sepia.ceph.com,smithi172.front.sepia.ceph.com,smithi174.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T03:28:51.818 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi084.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com')] 2024-09-21T03:28:51.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-21T03:28:51.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:28:51.895 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-09-21T03:28:51.981 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-09-21T03:28:51.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-21T03:28:51.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:28:52.056 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-09-21T03:28:52.135 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-09-21T03:28:52.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-09-21T03:28:52.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:28:52.209 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-09-21T03:28:52.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-09-21T03:28:52.291 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T03:28:52.305 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T03:28:52.305 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T03:28:52.305 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:28:52.308 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T03:28:52.308 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:28:52.310 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T03:28:52.310 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:28:52.336 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T03:28:52.339 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T03:28:52.352 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T03:28:52.354 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T03:28:52.360 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T03:28:52.374 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T03:28:52.375 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2024-09-21T03:28:52.379 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2024-09-21T03:28:52.387 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2024-09-21T03:28:52.390 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2024-09-21T03:28:52.399 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: ntpd: command not found 2024-09-21T03:28:52.400 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T03:28:52.405 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T03:28:52.410 INFO:teuthology.orchestra.run.smithi174.stdout:506 Cannot talk to daemon 2024-09-21T03:28:52.415 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T03:28:52.420 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T03:28:52.424 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T03:28:52.438 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T03:28:52.471 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:28:52.474 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:28:52.474 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-09-21T03:28:52.475 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:28:52.475 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:28:52.475 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:28:52.475 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:28:52.481 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:28:52.484 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:28:52.484 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-09-21T03:28:52.484 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:28:52.484 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:28:52.484 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:28:52.484 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:28:52.495 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:28:52.499 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:28:52.499 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-09-21T03:28:52.499 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:28:52.499 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:28:52.499 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:28:52.499 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:28:52.500 INFO:teuthology.run_tasks:Running task install... 2024-09-21T03:28:52.507 DEBUG:teuthology.task.install:project ceph 2024-09-21T03:28:52.507 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T03:28:52.507 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T03:28:52.508 INFO:teuthology.task.install:Using flavor: default 2024-09-21T03:28:52.513 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T03:28:52.513 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T03:28:52.513 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T03:28:52.514 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:28:52.515 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T03:28:52.515 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:28:52.516 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T03:28:52.517 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:28:52.666 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T03:28:52.666 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T03:28:52.679 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T03:28:52.679 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T03:28:52.682 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T03:28:52.682 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T03:28:52.775 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T03:28:52.775 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T03:28:52.775 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T03:28:52.787 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T03:28:52.788 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T03:28:52.788 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T03:28:52.799 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T03:28:52.799 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T03:28:52.799 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T03:28:52.802 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T03:28:52.803 DEBUG:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T03:28:52.815 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T03:28:52.815 DEBUG:teuthology.orchestra.run.smithi174:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T03:28:52.825 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T03:28:52.825 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T03:28:52.869 DEBUG:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T03:28:52.880 DEBUG:teuthology.orchestra.run.smithi174:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T03:28:52.892 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T03:28:52.944 DEBUG:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T03:28:52.955 DEBUG:teuthology.orchestra.run.smithi174:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T03:28:52.967 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T03:28:53.008 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2024-09-21T03:28:53.011 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum clean all 2024-09-21T03:28:53.019 INFO:teuthology.orchestra.run.smithi174.stdout:check_obsoletes = 1 2024-09-21T03:28:53.020 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum clean all 2024-09-21T03:28:53.030 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2024-09-21T03:28:53.032 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2024-09-21T03:28:53.235 INFO:teuthology.orchestra.run.smithi084.stdout:45 files removed 2024-09-21T03:28:53.242 INFO:teuthology.orchestra.run.smithi174.stdout:45 files removed 2024-09-21T03:28:53.256 INFO:teuthology.orchestra.run.smithi172.stdout:45 files removed 2024-09-21T03:28:53.261 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T03:28:53.269 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T03:28:53.283 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T03:28:53.824 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 303 kB/s | 84 kB 00:00 2024-09-21T03:28:53.829 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-09-21T03:28:53.833 INFO:teuthology.orchestra.run.smithi174.stdout:ceph packages for x86_64 294 kB/s | 84 kB 00:00 2024-09-21T03:28:54.117 INFO:teuthology.orchestra.run.smithi174.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-09-21T03:28:54.121 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-21T03:28:54.133 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 91 kB/s | 24 kB 00:00 2024-09-21T03:28:54.377 INFO:teuthology.orchestra.run.smithi174.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-21T03:28:54.397 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-21T03:28:54.408 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-21T03:28:54.956 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-21T03:28:55.159 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-21T03:28:55.725 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 6.4 MB/s | 8.3 MB 00:01 2024-09-21T03:28:56.928 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-21T03:29:01.262 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-21T03:29:02.698 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 3.1 MB/s | 20 MB 00:06 2024-09-21T03:29:02.779 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 19 kB 00:00 2024-09-21T03:29:02.984 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 3.3 MB/s | 20 MB 00:06 2024-09-21T03:29:03.834 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-21T03:29:07.168 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-21T03:29:07.706 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 6.2 MB/s | 6.5 MB 00:01 2024-09-21T03:29:08.693 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-21T03:29:09.189 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T03:29:09.374 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 19 kB 00:00 2024-09-21T03:29:09.439 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-21T03:29:10.419 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-21T03:29:11.293 INFO:teuthology.orchestra.run.smithi174.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:29:11.294 INFO:teuthology.orchestra.run.smithi174.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:29:11.307 INFO:teuthology.orchestra.run.smithi174.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T03:29:11.308 INFO:teuthology.orchestra.run.smithi174.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T03:29:11.309 INFO:teuthology.orchestra.run.smithi174.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T03:29:11.310 INFO:teuthology.orchestra.run.smithi174.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T03:29:11.312 INFO:teuthology.orchestra.run.smithi174.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T03:29:11.314 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T03:29:11.315 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T03:29:11.377 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-09-21T03:29:11.394 INFO:teuthology.orchestra.run.smithi174.stdout:======================================================================================= 2024-09-21T03:29:11.394 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2024-09-21T03:29:11.394 INFO:teuthology.orchestra.run.smithi174.stdout:======================================================================================= 2024-09-21T03:29:11.394 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-09-21T03:29:11.394 INFO:teuthology.orchestra.run.smithi174.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T03:29:11.394 INFO:teuthology.orchestra.run.smithi174.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T03:29:11.394 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T03:29:11.394 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T03:29:11.394 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:29:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T03:29:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T03:29:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T03:29:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T03:29:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T03:29:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T03:29:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T03:29:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T03:29:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T03:29:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T03:29:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T03:29:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T03:29:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T03:29:11.395 INFO:teuthology.orchestra.run.smithi174.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T03:29:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T03:29:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T03:29:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T03:29:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T03:29:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T03:29:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T03:29:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T03:29:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T03:29:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T03:29:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T03:29:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T03:29:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T03:29:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T03:29:11.396 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T03:29:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T03:29:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T03:29:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T03:29:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T03:29:11.397 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrading: 2024-09-21T03:29:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T03:29:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T03:29:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T03:29:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T03:29:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T03:29:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T03:29:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T03:29:11.397 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T03:29:11.398 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-09-21T03:29:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T03:29:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T03:29:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T03:29:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T03:29:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T03:29:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T03:29:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T03:29:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T03:29:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T03:29:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T03:29:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T03:29:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T03:29:11.398 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T03:29:11.399 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T03:29:11.399 INFO:teuthology.orchestra.run.smithi174.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T03:29:11.399 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T03:29:11.399 INFO:teuthology.orchestra.run.smithi174.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T03:29:11.399 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T03:29:11.399 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T03:29:11.399 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T03:29:11.399 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T03:29:11.399 INFO:teuthology.orchestra.run.smithi174.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T03:29:11.399 INFO:teuthology.orchestra.run.smithi174.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T03:29:11.399 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T03:29:11.399 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T03:29:11.399 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T03:29:11.399 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T03:29:11.400 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T03:29:11.400 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T03:29:11.400 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T03:29:11.400 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T03:29:11.400 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T03:29:11.400 INFO:teuthology.orchestra.run.smithi174.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T03:29:11.400 INFO:teuthology.orchestra.run.smithi174.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T03:29:11.400 INFO:teuthology.orchestra.run.smithi174.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T03:29:11.400 INFO:teuthology.orchestra.run.smithi174.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T03:29:11.400 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T03:29:11.400 INFO:teuthology.orchestra.run.smithi174.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T03:29:11.400 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T03:29:11.400 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T03:29:11.400 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T03:29:11.401 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T03:29:11.401 INFO:teuthology.orchestra.run.smithi174.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T03:29:11.401 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T03:29:11.401 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T03:29:11.401 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T03:29:11.401 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T03:29:11.401 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:29:11.401 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T03:29:11.401 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T03:29:11.401 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T03:29:11.401 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T03:29:11.401 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T03:29:11.401 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T03:29:11.401 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T03:29:11.402 INFO:teuthology.orchestra.run.smithi174.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T03:29:11.402 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T03:29:11.402 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T03:29:11.402 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T03:29:11.402 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T03:29:11.402 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T03:29:11.402 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T03:29:11.402 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T03:29:11.402 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T03:29:11.402 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T03:29:11.402 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T03:29:11.402 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T03:29:11.402 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T03:29:11.403 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T03:29:11.403 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T03:29:11.403 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T03:29:11.403 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T03:29:11.403 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T03:29:11.403 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T03:29:11.403 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T03:29:11.403 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T03:29:11.403 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T03:29:11.403 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T03:29:11.403 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T03:29:11.403 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T03:29:11.403 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T03:29:11.404 INFO:teuthology.orchestra.run.smithi174.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T03:29:11.404 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T03:29:11.404 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T03:29:11.404 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T03:29:11.404 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T03:29:11.404 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T03:29:11.404 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T03:29:11.404 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T03:29:11.404 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T03:29:11.404 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T03:29:11.404 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T03:29:11.404 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T03:29:11.404 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T03:29:11.404 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T03:29:11.405 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T03:29:11.405 INFO:teuthology.orchestra.run.smithi174.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T03:29:11.405 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T03:29:11.405 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T03:29:11.405 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T03:29:11.405 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T03:29:11.405 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T03:29:11.405 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T03:29:11.405 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T03:29:11.405 INFO:teuthology.orchestra.run.smithi174.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T03:29:11.405 INFO:teuthology.orchestra.run.smithi174.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T03:29:11.405 INFO:teuthology.orchestra.run.smithi174.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T03:29:11.405 INFO:teuthology.orchestra.run.smithi174.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T03:29:11.405 INFO:teuthology.orchestra.run.smithi174.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T03:29:11.406 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T03:29:11.406 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T03:29:11.406 INFO:teuthology.orchestra.run.smithi174.stdout:Installing weak dependencies: 2024-09-21T03:29:11.406 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T03:29:11.406 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:29:11.406 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-09-21T03:29:11.406 INFO:teuthology.orchestra.run.smithi174.stdout:======================================================================================= 2024-09-21T03:29:11.406 INFO:teuthology.orchestra.run.smithi174.stdout:Install 149 Packages 2024-09-21T03:29:11.406 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrade 8 Packages 2024-09-21T03:29:11.406 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:29:11.407 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 228 M 2024-09-21T03:29:11.407 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-09-21T03:29:11.957 INFO:teuthology.orchestra.run.smithi174.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 52 kB/s | 6.6 kB 00:00 2024-09-21T03:29:12.158 INFO:teuthology.orchestra.run.smithi174.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.3 MB/s | 873 kB 00:00 2024-09-21T03:29:12.208 INFO:teuthology.orchestra.run.smithi174.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.9 MB/s | 148 kB 00:00 2024-09-21T03:29:12.417 INFO:teuthology.orchestra.run.smithi174.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 9.4 MB/s | 5.5 MB 00:00 2024-09-21T03:29:12.467 INFO:teuthology.orchestra.run.smithi174.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 8.8 MB/s | 2.3 MB 00:00 2024-09-21T03:29:12.567 INFO:teuthology.orchestra.run.smithi174.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 10 MB/s | 1.5 MB 00:00 2024-09-21T03:29:12.884 INFO:teuthology.orchestra.run.smithi174.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 12 MB/s | 5.0 MB 00:00 2024-09-21T03:29:13.251 INFO:teuthology.orchestra.run.smithi174.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 14 MB/s | 20 MB 00:01 2024-09-21T03:29:13.301 INFO:teuthology.orchestra.run.smithi174.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 507 kB/s | 25 kB 00:00 2024-09-21T03:29:13.618 INFO:teuthology.orchestra.run.smithi174.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 17 MB/s | 18 MB 00:01 2024-09-21T03:29:13.735 INFO:teuthology.orchestra.run.smithi174.stdout:(11/157): ceph-radosgw-19.3.0-5120.g18432218.el 12 MB/s | 10 MB 00:00 2024-09-21T03:29:13.760 INFO:teuthology.orchestra.run.smithi174.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.6 MB/s | 226 kB 00:00 2024-09-21T03:29:13.785 INFO:teuthology.orchestra.run.smithi174.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 540 kB/s | 27 kB 00:00 2024-09-21T03:29:13.811 INFO:teuthology.orchestra.run.smithi174.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 636 kB/s | 32 kB 00:00 2024-09-21T03:29:13.861 INFO:teuthology.orchestra.run.smithi174.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 9.9 MB/s | 766 kB 00:00 2024-09-21T03:29:13.895 INFO:teuthology.orchestra.run.smithi174.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 1.8 MB/s | 158 kB 00:00 2024-09-21T03:29:13.928 INFO:teuthology.orchestra.run.smithi174.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 1.9 MB/s | 127 kB 00:00 2024-09-21T03:29:13.953 INFO:teuthology.orchestra.run.smithi174.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 8.5 MB/s | 507 kB 00:00 2024-09-21T03:29:14.012 INFO:teuthology.orchestra.run.smithi174.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 772 kB/s | 45 kB 00:00 2024-09-21T03:29:14.096 INFO:teuthology.orchestra.run.smithi174.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.7 MB/s | 148 kB 00:00 2024-09-21T03:29:14.179 INFO:teuthology.orchestra.run.smithi174.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 1.9 MB/s | 161 kB 00:00 2024-09-21T03:29:14.271 INFO:teuthology.orchestra.run.smithi174.stdout:(22/157): librgw2-19.3.0-5120.g18432218.el9.x86 15 MB/s | 5.3 MB 00:00 2024-09-21T03:29:14.296 INFO:teuthology.orchestra.run.smithi174.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 2.7 MB/s | 321 kB 00:00 2024-09-21T03:29:14.322 INFO:teuthology.orchestra.run.smithi174.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 6.0 MB/s | 307 kB 00:00 2024-09-21T03:29:14.347 INFO:teuthology.orchestra.run.smithi174.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T03:29:14.372 INFO:teuthology.orchestra.run.smithi174.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T03:29:14.439 INFO:teuthology.orchestra.run.smithi174.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-21T03:29:14.506 INFO:teuthology.orchestra.run.smithi174.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 20 MB/s | 3.1 MB 00:00 2024-09-21T03:29:14.523 INFO:teuthology.orchestra.run.smithi174.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 410 kB/s | 34 kB 00:00 2024-09-21T03:29:14.557 INFO:teuthology.orchestra.run.smithi174.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T03:29:15.044 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T03:29:15.215 INFO:teuthology.orchestra.run.smithi174.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 21 MB/s | 40 MB 00:01 2024-09-21T03:29:15.324 INFO:teuthology.orchestra.run.smithi174.stdout:(32/157): ceph-mgr-diskprediction-local-19.3.0- 9.6 MB/s | 7.4 MB 00:00 2024-09-21T03:29:15.349 INFO:teuthology.orchestra.run.smithi174.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 2.1 MB/s | 292 kB 00:00 2024-09-21T03:29:15.374 INFO:teuthology.orchestra.run.smithi174.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 988 kB/s | 49 kB 00:00 2024-09-21T03:29:15.400 INFO:teuthology.orchestra.run.smithi174.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 328 kB/s | 16 kB 00:00 2024-09-21T03:29:15.425 INFO:teuthology.orchestra.run.smithi174.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T03:29:15.458 INFO:teuthology.orchestra.run.smithi174.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 13 MB/s | 784 kB 00:00 2024-09-21T03:29:15.484 INFO:teuthology.orchestra.run.smithi174.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 315 kB/s | 18 kB 00:00 2024-09-21T03:29:15.643 INFO:teuthology.orchestra.run.smithi174.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 13 MB/s | 14 MB 00:01 2024-09-21T03:29:15.668 INFO:teuthology.orchestra.run.smithi174.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 382 kB/s | 80 kB 00:00 2024-09-21T03:29:15.758 INFO:teuthology.orchestra.run.smithi174.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-21T03:29:15.808 INFO:teuthology.orchestra.run.smithi174.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-21T03:29:15.834 INFO:teuthology.orchestra.run.smithi174.stdout:(43/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-21T03:29:15.859 INFO:teuthology.orchestra.run.smithi174.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T03:29:15.884 INFO:teuthology.orchestra.run.smithi174.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T03:29:15.909 INFO:teuthology.orchestra.run.smithi174.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T03:29:15.935 INFO:teuthology.orchestra.run.smithi174.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T03:29:15.967 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-21T03:29:15.968 INFO:teuthology.orchestra.run.smithi174.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 5.8 MB/s | 1.2 MB 00:00 2024-09-21T03:29:16.119 INFO:teuthology.orchestra.run.smithi174.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 714 kB/s | 107 kB 00:00 2024-09-21T03:29:16.169 INFO:teuthology.orchestra.run.smithi174.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-09-21T03:29:16.202 INFO:teuthology.orchestra.run.smithi174.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2024-09-21T03:29:16.253 INFO:teuthology.orchestra.run.smithi174.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-09-21T03:29:16.278 INFO:teuthology.orchestra.run.smithi174.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-21T03:29:16.328 INFO:teuthology.orchestra.run.smithi174.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-09-21T03:29:16.354 INFO:teuthology.orchestra.run.smithi174.stdout:(55/157): bison-3.7.4-5.el9.x86_64.rpm 2.2 MB/s | 943 kB 00:00 2024-09-21T03:29:16.379 INFO:teuthology.orchestra.run.smithi174.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-21T03:29:16.438 INFO:teuthology.orchestra.run.smithi174.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2024-09-21T03:29:16.463 INFO:teuthology.orchestra.run.smithi174.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-21T03:29:16.605 INFO:teuthology.orchestra.run.smithi174.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 271 kB/s | 45 kB 00:00 2024-09-21T03:29:16.663 INFO:teuthology.orchestra.run.smithi174.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-09-21T03:29:16.713 INFO:teuthology.orchestra.run.smithi174.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 492 kB/s | 24 kB 00:00 2024-09-21T03:29:16.764 INFO:teuthology.orchestra.run.smithi174.stdout:(62/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-21T03:29:16.806 INFO:teuthology.orchestra.run.smithi174.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 2.8 MB/s | 581 kB 00:00 2024-09-21T03:29:16.914 INFO:teuthology.orchestra.run.smithi174.stdout:(64/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.5 MB/s | 3.0 MB 00:00 2024-09-21T03:29:16.940 INFO:teuthology.orchestra.run.smithi174.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-09-21T03:29:16.965 INFO:teuthology.orchestra.run.smithi174.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-21T03:29:16.990 INFO:teuthology.orchestra.run.smithi174.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 509 kB/s | 38 kB 00:00 2024-09-21T03:29:17.223 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:29:17.224 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:29:17.237 INFO:teuthology.orchestra.run.smithi084.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T03:29:17.238 INFO:teuthology.orchestra.run.smithi084.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T03:29:17.239 INFO:teuthology.orchestra.run.smithi084.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T03:29:17.240 INFO:teuthology.orchestra.run.smithi084.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T03:29:17.242 INFO:teuthology.orchestra.run.smithi084.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T03:29:17.245 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T03:29:17.246 INFO:teuthology.orchestra.run.smithi084.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T03:29:17.265 INFO:teuthology.orchestra.run.smithi174.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 5.8 MB/s | 1.6 MB 00:00 2024-09-21T03:29:17.309 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-09-21T03:29:17.328 INFO:teuthology.orchestra.run.smithi084.stdout:======================================================================================= 2024-09-21T03:29:17.328 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-09-21T03:29:17.328 INFO:teuthology.orchestra.run.smithi084.stdout:======================================================================================= 2024-09-21T03:29:17.329 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-09-21T03:29:17.329 INFO:teuthology.orchestra.run.smithi084.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T03:29:17.329 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T03:29:17.329 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T03:29:17.329 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T03:29:17.329 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:29:17.329 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T03:29:17.329 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T03:29:17.329 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T03:29:17.329 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T03:29:17.329 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T03:29:17.329 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T03:29:17.329 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T03:29:17.329 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T03:29:17.330 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T03:29:17.330 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T03:29:17.330 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T03:29:17.330 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T03:29:17.330 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T03:29:17.330 INFO:teuthology.orchestra.run.smithi084.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T03:29:17.331 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T03:29:17.331 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T03:29:17.331 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T03:29:17.331 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T03:29:17.331 INFO:teuthology.orchestra.run.smithi084.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T03:29:17.331 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T03:29:17.331 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T03:29:17.331 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T03:29:17.331 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T03:29:17.331 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T03:29:17.331 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T03:29:17.331 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T03:29:17.332 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T03:29:17.332 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T03:29:17.332 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T03:29:17.332 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T03:29:17.332 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T03:29:17.332 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T03:29:17.332 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2024-09-21T03:29:17.332 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T03:29:17.332 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T03:29:17.332 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T03:29:17.332 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T03:29:17.332 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T03:29:17.333 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T03:29:17.333 INFO:teuthology.orchestra.run.smithi084.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T03:29:17.333 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T03:29:17.333 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-09-21T03:29:17.333 INFO:teuthology.orchestra.run.smithi084.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T03:29:17.333 INFO:teuthology.orchestra.run.smithi084.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T03:29:17.333 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T03:29:17.333 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T03:29:17.333 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T03:29:17.333 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T03:29:17.333 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T03:29:17.333 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T03:29:17.333 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T03:29:17.334 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T03:29:17.334 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T03:29:17.334 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T03:29:17.334 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T03:29:17.334 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T03:29:17.334 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T03:29:17.334 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T03:29:17.334 INFO:teuthology.orchestra.run.smithi084.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T03:29:17.334 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T03:29:17.334 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T03:29:17.334 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T03:29:17.335 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T03:29:17.335 INFO:teuthology.orchestra.run.smithi084.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T03:29:17.335 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T03:29:17.335 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T03:29:17.335 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T03:29:17.335 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T03:29:17.335 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T03:29:17.335 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T03:29:17.335 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T03:29:17.335 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T03:29:17.335 INFO:teuthology.orchestra.run.smithi084.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T03:29:17.335 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T03:29:17.335 INFO:teuthology.orchestra.run.smithi084.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T03:29:17.335 INFO:teuthology.orchestra.run.smithi084.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T03:29:17.336 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T03:29:17.336 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T03:29:17.336 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T03:29:17.336 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T03:29:17.336 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T03:29:17.336 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T03:29:17.336 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T03:29:17.336 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T03:29:17.336 INFO:teuthology.orchestra.run.smithi084.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T03:29:17.336 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T03:29:17.336 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T03:29:17.336 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T03:29:17.336 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T03:29:17.337 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:29:17.337 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T03:29:17.337 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T03:29:17.337 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T03:29:17.337 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T03:29:17.337 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T03:29:17.337 INFO:teuthology.orchestra.run.smithi084.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T03:29:17.337 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T03:29:17.337 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T03:29:17.337 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T03:29:17.337 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T03:29:17.337 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T03:29:17.337 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T03:29:17.337 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T03:29:17.338 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T03:29:17.338 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T03:29:17.338 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T03:29:17.338 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T03:29:17.338 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T03:29:17.338 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T03:29:17.338 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T03:29:17.338 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T03:29:17.338 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T03:29:17.338 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T03:29:17.338 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T03:29:17.338 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T03:29:17.338 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T03:29:17.338 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T03:29:17.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T03:29:17.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T03:29:17.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T03:29:17.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T03:29:17.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T03:29:17.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T03:29:17.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T03:29:17.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T03:29:17.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T03:29:17.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T03:29:17.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T03:29:17.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T03:29:17.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T03:29:17.339 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T03:29:17.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T03:29:17.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T03:29:17.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T03:29:17.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T03:29:17.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T03:29:17.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T03:29:17.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T03:29:17.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T03:29:17.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T03:29:17.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T03:29:17.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T03:29:17.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T03:29:17.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T03:29:17.340 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T03:29:17.341 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T03:29:17.341 INFO:teuthology.orchestra.run.smithi084.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T03:29:17.341 INFO:teuthology.orchestra.run.smithi084.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T03:29:17.341 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T03:29:17.341 INFO:teuthology.orchestra.run.smithi084.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T03:29:17.341 INFO:teuthology.orchestra.run.smithi084.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T03:29:17.341 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T03:29:17.341 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T03:29:17.341 INFO:teuthology.orchestra.run.smithi084.stdout:Installing weak dependencies: 2024-09-21T03:29:17.341 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T03:29:17.341 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:29:17.341 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-09-21T03:29:17.341 INFO:teuthology.orchestra.run.smithi084.stdout:======================================================================================= 2024-09-21T03:29:17.341 INFO:teuthology.orchestra.run.smithi084.stdout:Install 149 Packages 2024-09-21T03:29:17.342 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 8 Packages 2024-09-21T03:29:17.342 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:29:17.342 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 228 M 2024-09-21T03:29:17.342 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-09-21T03:29:17.449 INFO:teuthology.orchestra.run.smithi174.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 4.9 MB/s | 910 kB 00:00 2024-09-21T03:29:17.508 INFO:teuthology.orchestra.run.smithi174.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-21T03:29:17.987 INFO:teuthology.orchestra.run.smithi084.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 44 kB/s | 6.6 kB 00:00 2024-09-21T03:29:18.008 INFO:teuthology.orchestra.run.smithi174.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.2 MB/s | 4.4 MB 00:01 2024-09-21T03:29:18.102 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:29:18.103 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:29:18.114 INFO:teuthology.orchestra.run.smithi172.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T03:29:18.115 INFO:teuthology.orchestra.run.smithi172.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T03:29:18.116 INFO:teuthology.orchestra.run.smithi172.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T03:29:18.117 INFO:teuthology.orchestra.run.smithi172.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T03:29:18.119 INFO:teuthology.orchestra.run.smithi172.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T03:29:18.121 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T03:29:18.122 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T03:29:18.185 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-09-21T03:29:18.195 INFO:teuthology.orchestra.run.smithi084.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.1 MB/s | 873 kB 00:00 2024-09-21T03:29:18.208 INFO:teuthology.orchestra.run.smithi174.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 3.9 MB/s | 4.9 MB 00:01 2024-09-21T03:29:18.210 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-09-21T03:29:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-09-21T03:29:18.210 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-09-21T03:29:18.210 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-09-21T03:29:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T03:29:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T03:29:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T03:29:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T03:29:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:29:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T03:29:18.210 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T03:29:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T03:29:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T03:29:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T03:29:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T03:29:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T03:29:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T03:29:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T03:29:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T03:29:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T03:29:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T03:29:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T03:29:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T03:29:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T03:29:18.211 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T03:29:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T03:29:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T03:29:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T03:29:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T03:29:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T03:29:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T03:29:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T03:29:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T03:29:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T03:29:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T03:29:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T03:29:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T03:29:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T03:29:18.212 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T03:29:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T03:29:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T03:29:18.213 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-09-21T03:29:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T03:29:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T03:29:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T03:29:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T03:29:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T03:29:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T03:29:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T03:29:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T03:29:18.213 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-09-21T03:29:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T03:29:18.213 INFO:teuthology.orchestra.run.smithi172.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T03:29:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T03:29:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T03:29:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T03:29:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T03:29:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T03:29:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T03:29:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T03:29:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T03:29:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T03:29:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T03:29:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T03:29:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T03:29:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T03:29:18.214 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T03:29:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T03:29:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T03:29:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T03:29:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T03:29:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T03:29:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T03:29:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T03:29:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T03:29:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T03:29:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T03:29:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T03:29:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T03:29:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T03:29:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T03:29:18.215 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T03:29:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T03:29:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T03:29:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T03:29:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T03:29:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T03:29:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T03:29:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T03:29:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T03:29:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T03:29:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T03:29:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T03:29:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T03:29:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T03:29:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T03:29:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T03:29:18.216 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T03:29:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:29:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T03:29:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T03:29:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T03:29:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T03:29:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T03:29:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T03:29:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T03:29:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T03:29:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T03:29:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T03:29:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T03:29:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T03:29:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T03:29:18.217 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T03:29:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T03:29:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T03:29:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T03:29:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T03:29:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T03:29:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T03:29:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T03:29:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T03:29:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T03:29:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T03:29:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T03:29:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T03:29:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T03:29:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T03:29:18.218 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T03:29:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T03:29:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T03:29:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T03:29:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T03:29:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T03:29:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T03:29:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T03:29:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T03:29:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T03:29:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T03:29:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T03:29:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T03:29:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T03:29:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T03:29:18.219 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T03:29:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T03:29:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T03:29:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T03:29:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T03:29:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T03:29:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T03:29:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T03:29:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T03:29:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T03:29:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T03:29:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T03:29:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T03:29:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T03:29:18.220 INFO:teuthology.orchestra.run.smithi172.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T03:29:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T03:29:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T03:29:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T03:29:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T03:29:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T03:29:18.221 INFO:teuthology.orchestra.run.smithi172.stdout:Installing weak dependencies: 2024-09-21T03:29:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T03:29:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T03:29:18.221 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-09-21T03:29:18.221 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-09-21T03:29:18.221 INFO:teuthology.orchestra.run.smithi172.stdout:Install 149 Packages 2024-09-21T03:29:18.221 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 8 Packages 2024-09-21T03:29:18.221 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T03:29:18.222 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 228 M 2024-09-21T03:29:18.222 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-09-21T03:29:18.245 INFO:teuthology.orchestra.run.smithi084.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.9 MB/s | 148 kB 00:00 2024-09-21T03:29:18.292 INFO:teuthology.orchestra.run.smithi174.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-21T03:29:18.375 INFO:teuthology.orchestra.run.smithi174.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 2.8 MB/s | 1.0 MB 00:00 2024-09-21T03:29:18.429 INFO:teuthology.orchestra.run.smithi084.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 9.3 MB/s | 5.5 MB 00:00 2024-09-21T03:29:18.434 INFO:teuthology.orchestra.run.smithi174.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-21T03:29:18.479 INFO:teuthology.orchestra.run.smithi084.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 9.8 MB/s | 2.3 MB 00:00 2024-09-21T03:29:18.525 INFO:teuthology.orchestra.run.smithi174.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-21T03:29:18.572 INFO:teuthology.orchestra.run.smithi084.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-21T03:29:18.626 INFO:teuthology.orchestra.run.smithi174.stdout:(77/157): postgresql-server-13.16-1.el9.x86_64. 5.2 MB/s | 5.8 MB 00:01 2024-09-21T03:29:18.651 INFO:teuthology.orchestra.run.smithi174.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-09-21T03:29:18.676 INFO:teuthology.orchestra.run.smithi174.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-21T03:29:18.702 INFO:teuthology.orchestra.run.smithi174.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-21T03:29:18.735 INFO:teuthology.orchestra.run.smithi174.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-21T03:29:18.760 INFO:teuthology.orchestra.run.smithi174.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 594 kB/s | 35 kB 00:00 2024-09-21T03:29:18.844 INFO:teuthology.orchestra.run.smithi174.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-21T03:29:18.913 INFO:teuthology.orchestra.run.smithi084.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 11 MB/s | 5.0 MB 00:00 2024-09-21T03:29:18.936 INFO:teuthology.orchestra.run.smithi174.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-21T03:29:18.995 INFO:teuthology.orchestra.run.smithi174.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-21T03:29:19.045 INFO:teuthology.orchestra.run.smithi174.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-21T03:29:19.129 INFO:teuthology.orchestra.run.smithi174.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-09-21T03:29:19.135 INFO:teuthology.orchestra.run.smithi172.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 40 kB/s | 6.6 kB 00:00 2024-09-21T03:29:19.187 INFO:teuthology.orchestra.run.smithi174.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-21T03:29:19.188 INFO:teuthology.orchestra.run.smithi084.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 15 MB/s | 20 MB 00:01 2024-09-21T03:29:19.231 INFO:teuthology.orchestra.run.smithi084.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 609 kB/s | 25 kB 00:00 2024-09-21T03:29:19.288 INFO:teuthology.orchestra.run.smithi174.stdout:(89/157): python3-babel-2.9.1-2.el9.noarch.rpm 6.0 MB/s | 6.0 MB 00:00 2024-09-21T03:29:19.313 INFO:teuthology.orchestra.run.smithi174.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-21T03:29:19.346 INFO:teuthology.orchestra.run.smithi174.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 876 kB/s | 51 kB 00:00 2024-09-21T03:29:19.372 INFO:teuthology.orchestra.run.smithi174.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 917 kB/s | 54 kB 00:00 2024-09-21T03:29:19.431 INFO:teuthology.orchestra.run.smithi174.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.3 MB/s | 5.1 MB 00:00 2024-09-21T03:29:19.455 INFO:teuthology.orchestra.run.smithi174.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 499 kB/s | 42 kB 00:00 2024-09-21T03:29:19.489 INFO:teuthology.orchestra.run.smithi174.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 759 kB/s | 44 kB 00:00 2024-09-21T03:29:19.515 INFO:teuthology.orchestra.run.smithi174.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-21T03:29:19.548 INFO:teuthology.orchestra.run.smithi174.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 612 kB/s | 36 kB 00:00 2024-09-21T03:29:19.573 INFO:teuthology.orchestra.run.smithi174.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-09-21T03:29:19.607 INFO:teuthology.orchestra.run.smithi174.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-21T03:29:19.632 INFO:teuthology.orchestra.run.smithi174.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 988 kB/s | 58 kB 00:00 2024-09-21T03:29:19.666 INFO:teuthology.orchestra.run.smithi174.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-21T03:29:19.676 INFO:teuthology.orchestra.run.smithi172.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 1.6 MB/s | 873 kB 00:00 2024-09-21T03:29:19.691 INFO:teuthology.orchestra.run.smithi174.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-21T03:29:19.725 INFO:teuthology.orchestra.run.smithi174.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 768 kB/s | 45 kB 00:00 2024-09-21T03:29:19.731 INFO:teuthology.orchestra.run.smithi084.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 15 MB/s | 18 MB 00:01 2024-09-21T03:29:19.744 INFO:teuthology.orchestra.run.smithi172.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.2 MB/s | 148 kB 00:00 2024-09-21T03:29:19.808 INFO:teuthology.orchestra.run.smithi174.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-21T03:29:19.848 INFO:teuthology.orchestra.run.smithi084.stdout:(11/157): ceph-radosgw-19.3.0-5120.g18432218.el 11 MB/s | 10 MB 00:00 2024-09-21T03:29:19.858 INFO:teuthology.orchestra.run.smithi174.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T03:29:19.873 INFO:teuthology.orchestra.run.smithi084.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.6 MB/s | 226 kB 00:00 2024-09-21T03:29:19.884 INFO:teuthology.orchestra.run.smithi174.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-21T03:29:19.898 INFO:teuthology.orchestra.run.smithi084.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 541 kB/s | 27 kB 00:00 2024-09-21T03:29:19.909 INFO:teuthology.orchestra.run.smithi174.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-09-21T03:29:19.923 INFO:teuthology.orchestra.run.smithi084.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 632 kB/s | 32 kB 00:00 2024-09-21T03:29:19.952 INFO:teuthology.orchestra.run.smithi172.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 5.6 MB/s | 5.5 MB 00:00 2024-09-21T03:29:19.982 INFO:teuthology.orchestra.run.smithi084.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 9.0 MB/s | 766 kB 00:00 2024-09-21T03:29:20.007 INFO:teuthology.orchestra.run.smithi084.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 1.9 MB/s | 158 kB 00:00 2024-09-21T03:29:20.017 INFO:teuthology.orchestra.run.smithi174.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-21T03:29:20.041 INFO:teuthology.orchestra.run.smithi084.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.1 MB/s | 127 kB 00:00 2024-09-21T03:29:20.043 INFO:teuthology.orchestra.run.smithi174.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T03:29:20.068 INFO:teuthology.orchestra.run.smithi174.stdout:(110/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-09-21T03:29:20.074 INFO:teuthology.orchestra.run.smithi084.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 7.4 MB/s | 507 kB 00:00 2024-09-21T03:29:20.102 INFO:teuthology.orchestra.run.smithi174.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 830 kB/s | 49 kB 00:00 2024-09-21T03:29:20.127 INFO:teuthology.orchestra.run.smithi174.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 6.4 MB/s | 151 kB 00:00 2024-09-21T03:29:20.150 INFO:teuthology.orchestra.run.smithi084.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 601 kB/s | 45 kB 00:00 2024-09-21T03:29:20.161 INFO:teuthology.orchestra.run.smithi174.stdout:(113/157): libunwind-1.6.2-1.el9.x86_64.rpm 731 kB/s | 67 kB 00:00 2024-09-21T03:29:20.194 INFO:teuthology.orchestra.run.smithi172.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 6.3 MB/s | 1.5 MB 00:00 2024-09-21T03:29:20.195 INFO:teuthology.orchestra.run.smithi174.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-21T03:29:20.211 INFO:teuthology.orchestra.run.smithi174.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-21T03:29:20.217 INFO:teuthology.orchestra.run.smithi084.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.2 MB/s | 148 kB 00:00 2024-09-21T03:29:20.237 INFO:teuthology.orchestra.run.smithi174.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T03:29:20.253 INFO:teuthology.orchestra.run.smithi174.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 847 kB/s | 14 kB 00:00 2024-09-21T03:29:20.287 INFO:teuthology.orchestra.run.smithi174.stdout:(118/157): python3-asyncssh-2.13.2-5.el9.noarch 4.2 MB/s | 548 kB 00:00 2024-09-21T03:29:20.292 INFO:teuthology.orchestra.run.smithi084.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.1 MB/s | 161 kB 00:00 2024-09-21T03:29:20.312 INFO:teuthology.orchestra.run.smithi174.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-21T03:29:20.346 INFO:teuthology.orchestra.run.smithi174.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-21T03:29:20.371 INFO:teuthology.orchestra.run.smithi174.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-21T03:29:20.375 INFO:teuthology.orchestra.run.smithi084.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 3.8 MB/s | 321 kB 00:00 2024-09-21T03:29:20.397 INFO:teuthology.orchestra.run.smithi174.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T03:29:20.422 INFO:teuthology.orchestra.run.smithi174.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T03:29:20.442 INFO:teuthology.orchestra.run.smithi084.stdout:(23/157): librgw2-19.3.0-5120.g18432218.el9.x86 13 MB/s | 5.3 MB 00:00 2024-09-21T03:29:20.447 INFO:teuthology.orchestra.run.smithi174.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-21T03:29:20.467 INFO:teuthology.orchestra.run.smithi084.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 3.3 MB/s | 307 kB 00:00 2024-09-21T03:29:20.472 INFO:teuthology.orchestra.run.smithi174.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 716 kB/s | 18 kB 00:00 2024-09-21T03:29:20.498 INFO:teuthology.orchestra.run.smithi174.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 926 kB/s | 23 kB 00:00 2024-09-21T03:29:20.501 INFO:teuthology.orchestra.run.smithi084.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T03:29:20.511 INFO:teuthology.orchestra.run.smithi172.stdout:(6/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 3.0 MB/s | 2.3 MB 00:00 2024-09-21T03:29:20.523 INFO:teuthology.orchestra.run.smithi174.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-21T03:29:20.526 INFO:teuthology.orchestra.run.smithi084.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.4 MB/s | 86 kB 00:00 2024-09-21T03:29:20.548 INFO:teuthology.orchestra.run.smithi174.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 784 kB/s | 20 kB 00:00 2024-09-21T03:29:20.599 INFO:teuthology.orchestra.run.smithi174.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-09-21T03:29:20.610 INFO:teuthology.orchestra.run.smithi084.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.0 MB/s | 170 kB 00:00 2024-09-21T03:29:20.624 INFO:teuthology.orchestra.run.smithi174.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T03:29:20.649 INFO:teuthology.orchestra.run.smithi174.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T03:29:20.675 INFO:teuthology.orchestra.run.smithi174.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T03:29:20.685 INFO:teuthology.orchestra.run.smithi084.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 456 kB/s | 34 kB 00:00 2024-09-21T03:29:20.708 INFO:teuthology.orchestra.run.smithi174.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-09-21T03:29:20.733 INFO:teuthology.orchestra.run.smithi174.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-21T03:29:20.752 INFO:teuthology.orchestra.run.smithi084.stdout:(29/157): rbd-mirror-19.3.0-5120.g18432218.el9. 12 MB/s | 3.1 MB 00:00 2024-09-21T03:29:20.758 INFO:teuthology.orchestra.run.smithi174.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-09-21T03:29:20.777 INFO:teuthology.orchestra.run.smithi084.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.6 MB/s | 154 kB 00:00 2024-09-21T03:29:20.784 INFO:teuthology.orchestra.run.smithi174.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T03:29:20.809 INFO:teuthology.orchestra.run.smithi174.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-21T03:29:20.835 INFO:teuthology.orchestra.run.smithi174.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-21T03:29:20.860 INFO:teuthology.orchestra.run.smithi174.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T03:29:20.885 INFO:teuthology.orchestra.run.smithi174.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T03:29:20.910 INFO:teuthology.orchestra.run.smithi174.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-21T03:29:20.928 INFO:teuthology.orchestra.run.smithi172.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 6.8 MB/s | 5.0 MB 00:00 2024-09-21T03:29:20.935 INFO:teuthology.orchestra.run.smithi174.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T03:29:20.961 INFO:teuthology.orchestra.run.smithi174.stdout:(143/157): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-21T03:29:20.986 INFO:teuthology.orchestra.run.smithi174.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-21T03:29:21.145 INFO:teuthology.orchestra.run.smithi174.stdout:(145/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.0 MB/s | 16 MB 00:01 2024-09-21T03:29:21.178 INFO:teuthology.orchestra.run.smithi174.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 104 kB/s | 20 kB 00:00 2024-09-21T03:29:21.212 INFO:teuthology.orchestra.run.smithi174.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 1.7 MB/s | 427 kB 00:00 2024-09-21T03:29:21.246 INFO:teuthology.orchestra.run.smithi174.stdout:(148/157): re2-20211101-20.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2024-09-21T03:29:21.288 INFO:teuthology.orchestra.run.smithi174.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T03:29:21.530 INFO:teuthology.orchestra.run.smithi174.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 11 MB/s | 3.4 MB 00:00 2024-09-21T03:29:21.536 INFO:teuthology.orchestra.run.smithi084.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 17 MB/s | 40 MB 00:02 2024-09-21T03:29:21.586 INFO:teuthology.orchestra.run.smithi084.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 5.7 MB/s | 292 kB 00:00 2024-09-21T03:29:21.653 INFO:teuthology.orchestra.run.smithi084.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 742 kB/s | 49 kB 00:00 2024-09-21T03:29:21.703 INFO:teuthology.orchestra.run.smithi172.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 7.3 MB/s | 20 MB 00:02 2024-09-21T03:29:21.730 INFO:teuthology.orchestra.run.smithi174.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 5.3 MB/s | 2.3 MB 00:00 2024-09-21T03:29:21.736 INFO:teuthology.orchestra.run.smithi084.stdout:(34/157): ceph-mgr-diskprediction-local-19.3.0- 7.7 MB/s | 7.4 MB 00:00 2024-09-21T03:29:21.753 INFO:teuthology.orchestra.run.smithi172.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 506 kB/s | 25 kB 00:00 2024-09-21T03:29:21.762 INFO:teuthology.orchestra.run.smithi084.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 151 kB/s | 16 kB 00:00 2024-09-21T03:29:21.787 INFO:teuthology.orchestra.run.smithi084.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T03:29:21.788 INFO:teuthology.orchestra.run.smithi174.stdout:(152/157): NetworkManager-libnm-1.51.0-1.el9.x8 7.0 MB/s | 1.8 MB 00:00 2024-09-21T03:29:21.805 INFO:teuthology.orchestra.run.smithi174.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 545 kB/s | 41 kB 00:00 2024-09-21T03:29:21.839 INFO:teuthology.orchestra.run.smithi174.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 4.8 MB/s | 249 kB 00:00 2024-09-21T03:29:21.938 INFO:teuthology.orchestra.run.smithi084.stdout:(37/157): ceph-mgr-dashboard-19.3.0-5120.g18432 12 MB/s | 14 MB 00:01 2024-09-21T03:29:21.963 INFO:teuthology.orchestra.run.smithi084.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 105 kB/s | 18 kB 00:00 2024-09-21T03:29:21.996 INFO:teuthology.orchestra.run.smithi084.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 3.3 MB/s | 784 kB 00:00 2024-09-21T03:29:22.006 INFO:teuthology.orchestra.run.smithi174.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-09-21T03:29:22.056 INFO:teuthology.orchestra.run.smithi174.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 5.4 MB/s | 1.4 MB 00:00 2024-09-21T03:29:22.079 INFO:teuthology.orchestra.run.smithi172.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 9.1 MB/s | 10 MB 00:01 2024-09-21T03:29:22.113 INFO:teuthology.orchestra.run.smithi084.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 456 kB/s | 80 kB 00:00 2024-09-21T03:29:22.129 INFO:teuthology.orchestra.run.smithi172.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.5 MB/s | 226 kB 00:00 2024-09-21T03:29:22.156 INFO:teuthology.orchestra.run.smithi174.stdout:(157/157): librbd1-19.3.0-5120.g18432218.el9.x8 3.5 MB/s | 3.2 MB 00:00 2024-09-21T03:29:22.163 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:29:22.163 INFO:teuthology.orchestra.run.smithi174.stdout:Total 21 MB/s | 228 MB 00:10 2024-09-21T03:29:22.164 INFO:teuthology.orchestra.run.smithi084.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-21T03:29:22.179 INFO:teuthology.orchestra.run.smithi172.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 542 kB/s | 27 kB 00:00 2024-09-21T03:29:22.229 INFO:teuthology.orchestra.run.smithi172.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 636 kB/s | 32 kB 00:00 2024-09-21T03:29:22.272 INFO:teuthology.orchestra.run.smithi084.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-21T03:29:22.297 INFO:teuthology.orchestra.run.smithi084.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-21T03:29:22.373 INFO:teuthology.orchestra.run.smithi084.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-21T03:29:22.379 INFO:teuthology.orchestra.run.smithi172.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 5.0 MB/s | 766 kB 00:00 2024-09-21T03:29:22.406 INFO:teuthology.orchestra.run.smithi084.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 5.1 MB/s | 1.2 MB 00:00 2024-09-21T03:29:22.430 INFO:teuthology.orchestra.run.smithi172.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 3.1 MB/s | 158 kB 00:00 2024-09-21T03:29:22.448 INFO:teuthology.orchestra.run.smithi084.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-21T03:29:22.473 INFO:teuthology.orchestra.run.smithi084.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-21T03:29:22.480 INFO:teuthology.orchestra.run.smithi172.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T03:29:22.565 INFO:teuthology.orchestra.run.smithi084.stdout:(48/157): python3-ply-3.11-14.el9.noarch.rpm 364 kB/s | 106 kB 00:00 2024-09-21T03:29:22.572 INFO:teuthology.orchestra.run.smithi172.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 5.4 MB/s | 507 kB 00:00 2024-09-21T03:29:22.682 INFO:teuthology.orchestra.run.smithi084.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-09-21T03:29:22.707 INFO:teuthology.orchestra.run.smithi084.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 753 kB/s | 107 kB 00:00 2024-09-21T03:29:22.732 INFO:teuthology.orchestra.run.smithi084.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-21T03:29:22.774 INFO:teuthology.orchestra.run.smithi084.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.1 MB/s | 943 kB 00:00 2024-09-21T03:29:22.800 INFO:teuthology.orchestra.run.smithi084.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-21T03:29:22.842 INFO:teuthology.orchestra.run.smithi084.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-09-21T03:29:22.867 INFO:teuthology.orchestra.run.smithi084.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-21T03:29:22.884 INFO:teuthology.orchestra.run.smithi084.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 266 kB/s | 11 kB 00:00 2024-09-21T03:29:22.943 INFO:teuthology.orchestra.run.smithi084.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-09-21T03:29:22.968 INFO:teuthology.orchestra.run.smithi084.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.7 MB/s | 171 kB 00:00 2024-09-21T03:29:23.001 INFO:teuthology.orchestra.run.smithi084.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 776 kB/s | 45 kB 00:00 2024-09-21T03:29:23.027 INFO:teuthology.orchestra.run.smithi084.stdout:(60/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-09-21T03:29:23.060 INFO:teuthology.orchestra.run.smithi084.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-21T03:29:23.085 INFO:teuthology.orchestra.run.smithi084.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-21T03:29:23.105 INFO:teuthology.orchestra.run.smithi172.stdout:(18/157): librgw2-19.3.0-5120.g18432218.el9.x86 9.9 MB/s | 5.3 MB 00:00 2024-09-21T03:29:23.111 INFO:teuthology.orchestra.run.smithi084.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-21T03:29:23.144 INFO:teuthology.orchestra.run.smithi084.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-09-21T03:29:23.155 INFO:teuthology.orchestra.run.smithi172.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 910 kB/s | 45 kB 00:00 2024-09-21T03:29:23.169 INFO:teuthology.orchestra.run.smithi084.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-21T03:29:23.194 INFO:teuthology.orchestra.run.smithi084.stdout:(66/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-21T03:29:23.206 INFO:teuthology.orchestra.run.smithi172.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.9 MB/s | 148 kB 00:00 2024-09-21T03:29:23.220 INFO:teuthology.orchestra.run.smithi084.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 511 kB/s | 38 kB 00:00 2024-09-21T03:29:23.256 INFO:teuthology.orchestra.run.smithi172.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 3.2 MB/s | 161 kB 00:00 2024-09-21T03:29:23.312 INFO:teuthology.orchestra.run.smithi084.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 35 MB/s | 4.9 MB 00:00 2024-09-21T03:29:23.323 INFO:teuthology.orchestra.run.smithi172.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 4.7 MB/s | 321 kB 00:00 2024-09-21T03:29:23.354 INFO:teuthology.orchestra.run.smithi084.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-21T03:29:23.388 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-09-21T03:29:23.399 INFO:teuthology.orchestra.run.smithi172.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 4.0 MB/s | 307 kB 00:00 2024-09-21T03:29:23.416 INFO:teuthology.orchestra.run.smithi084.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 8.6 MB/s | 910 kB 00:00 2024-09-21T03:29:23.446 INFO:teuthology.orchestra.run.smithi084.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-21T03:29:23.449 INFO:teuthology.orchestra.run.smithi172.stdout:(24/157): python3-rgw-19.3.0-5120.g18432218.el9 2.0 MB/s | 99 kB 00:00 2024-09-21T03:29:23.507 INFO:teuthology.orchestra.run.smithi172.stdout:(25/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.4 MB/s | 86 kB 00:00 2024-09-21T03:29:23.522 INFO:teuthology.orchestra.run.smithi084.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-09-21T03:29:23.544 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-09-21T03:29:23.544 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-09-21T03:29:23.555 INFO:teuthology.orchestra.run.smithi084.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-21T03:29:23.580 INFO:teuthology.orchestra.run.smithi084.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-21T03:29:23.622 INFO:teuthology.orchestra.run.smithi084.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-21T03:29:23.698 INFO:teuthology.orchestra.run.smithi084.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 21 MB/s | 5.8 MB 00:00 2024-09-21T03:29:23.723 INFO:teuthology.orchestra.run.smithi084.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-21T03:29:23.748 INFO:teuthology.orchestra.run.smithi084.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-21T03:29:23.773 INFO:teuthology.orchestra.run.smithi084.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-21T03:29:23.799 INFO:teuthology.orchestra.run.smithi084.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-21T03:29:23.816 INFO:teuthology.orchestra.run.smithi172.stdout:(26/157): rbd-mirror-19.3.0-5120.g18432218.el9. 10 MB/s | 3.1 MB 00:00 2024-09-21T03:29:23.824 INFO:teuthology.orchestra.run.smithi084.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-21T03:29:23.849 INFO:teuthology.orchestra.run.smithi084.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 695 kB/s | 35 kB 00:00 2024-09-21T03:29:23.866 INFO:teuthology.orchestra.run.smithi172.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T03:29:23.908 INFO:teuthology.orchestra.run.smithi172.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 827 kB/s | 34 kB 00:00 2024-09-21T03:29:23.941 INFO:teuthology.orchestra.run.smithi084.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-21T03:29:23.958 INFO:teuthology.orchestra.run.smithi172.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T03:29:23.966 INFO:teuthology.orchestra.run.smithi084.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-21T03:29:23.991 INFO:teuthology.orchestra.run.smithi084.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-21T03:29:24.017 INFO:teuthology.orchestra.run.smithi084.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T03:29:24.042 INFO:teuthology.orchestra.run.smithi084.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-21T03:29:24.067 INFO:teuthology.orchestra.run.smithi084.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-21T03:29:24.092 INFO:teuthology.orchestra.run.smithi084.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T03:29:24.118 INFO:teuthology.orchestra.run.smithi084.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-21T03:29:24.143 INFO:teuthology.orchestra.run.smithi084.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T03:29:24.168 INFO:teuthology.orchestra.run.smithi084.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T03:29:24.235 INFO:teuthology.orchestra.run.smithi084.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-21T03:29:24.260 INFO:teuthology.orchestra.run.smithi084.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 454 kB/s | 42 kB 00:00 2024-09-21T03:29:24.286 INFO:teuthology.orchestra.run.smithi084.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-09-21T03:29:24.311 INFO:teuthology.orchestra.run.smithi084.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T03:29:24.336 INFO:teuthology.orchestra.run.smithi084.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 718 kB/s | 36 kB 00:00 2024-09-21T03:29:24.362 INFO:teuthology.orchestra.run.smithi084.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-21T03:29:24.387 INFO:teuthology.orchestra.run.smithi084.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-21T03:29:24.412 INFO:teuthology.orchestra.run.smithi084.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T03:29:24.437 INFO:teuthology.orchestra.run.smithi084.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T03:29:24.463 INFO:teuthology.orchestra.run.smithi084.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T03:29:24.488 INFO:teuthology.orchestra.run.smithi084.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 891 kB/s | 45 kB 00:00 2024-09-21T03:29:24.522 INFO:teuthology.orchestra.run.smithi084.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 381 kB/s | 22 kB 00:00 2024-09-21T03:29:24.572 INFO:teuthology.orchestra.run.smithi084.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T03:29:24.605 INFO:teuthology.orchestra.run.smithi084.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T03:29:24.631 INFO:teuthology.orchestra.run.smithi084.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-21T03:29:24.672 INFO:teuthology.orchestra.run.smithi084.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.6 MB/s | 863 kB 00:00 2024-09-21T03:29:24.715 INFO:teuthology.orchestra.run.smithi084.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 625 kB/s | 26 kB 00:00 2024-09-21T03:29:24.740 INFO:teuthology.orchestra.run.smithi084.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T03:29:24.765 INFO:teuthology.orchestra.run.smithi084.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-21T03:29:24.791 INFO:teuthology.orchestra.run.smithi084.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-21T03:29:24.832 INFO:teuthology.orchestra.run.smithi084.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-21T03:29:24.874 INFO:teuthology.orchestra.run.smithi084.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-21T03:29:24.891 INFO:teuthology.orchestra.run.smithi084.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-21T03:29:24.908 INFO:teuthology.orchestra.run.smithi084.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-21T03:29:24.925 INFO:teuthology.orchestra.run.smithi084.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 844 kB/s | 14 kB 00:00 2024-09-21T03:29:24.950 INFO:teuthology.orchestra.run.smithi084.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-09-21T03:29:24.951 INFO:teuthology.orchestra.run.smithi172.stdout:(30/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 4.0 MB/s | 18 MB 00:04 2024-09-21T03:29:24.984 INFO:teuthology.orchestra.run.smithi084.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-21T03:29:25.143 INFO:teuthology.orchestra.run.smithi084.stdout:(120/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:00 2024-09-21T03:29:25.176 INFO:teuthology.orchestra.run.smithi084.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.5 MB/s | 303 kB 00:00 2024-09-21T03:29:25.235 INFO:teuthology.orchestra.run.smithi084.stdout:(122/157): libarrow-9.0.0-11.el9.x86_64.rpm 7.3 MB/s | 4.4 MB 00:00 2024-09-21T03:29:25.260 INFO:teuthology.orchestra.run.smithi084.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T03:29:25.285 INFO:teuthology.orchestra.run.smithi084.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 433 kB/s | 11 kB 00:00 2024-09-21T03:29:25.309 INFO:teuthology.orchestra.run.smithi172.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 11 MB/s | 40 MB 00:03 2024-09-21T03:29:25.310 INFO:teuthology.orchestra.run.smithi084.stdout:(125/157): python3-google-auth-2.34.0-1.el9.noa 1.3 MB/s | 220 kB 00:00 2024-09-21T03:29:25.336 INFO:teuthology.orchestra.run.smithi084.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-21T03:29:25.361 INFO:teuthology.orchestra.run.smithi084.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-21T03:29:25.363 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-09-21T03:29:25.363 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-09-21T03:29:25.386 INFO:teuthology.orchestra.run.smithi084.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-21T03:29:25.411 INFO:teuthology.orchestra.run.smithi084.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-21T03:29:25.445 INFO:teuthology.orchestra.run.smithi084.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-21T03:29:25.459 INFO:teuthology.orchestra.run.smithi172.stdout:(32/157): ceph-mgr-dashboard-19.3.0-5120.g18432 9.4 MB/s | 14 MB 00:01 2024-09-21T03:29:25.479 INFO:teuthology.orchestra.run.smithi084.stdout:(131/157): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-09-21T03:29:25.484 INFO:teuthology.orchestra.run.smithi172.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 1.6 MB/s | 292 kB 00:00 2024-09-21T03:29:25.504 INFO:teuthology.orchestra.run.smithi084.stdout:(132/157): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-09-21T03:29:25.509 INFO:teuthology.orchestra.run.smithi172.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 992 kB/s | 49 kB 00:00 2024-09-21T03:29:25.530 INFO:teuthology.orchestra.run.smithi084.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-21T03:29:25.536 INFO:teuthology.orchestra.run.smithi172.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 328 kB/s | 16 kB 00:00 2024-09-21T03:29:25.546 INFO:teuthology.orchestra.run.smithi084.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 1.0 MB/s | 16 kB 00:00 2024-09-21T03:29:25.560 INFO:teuthology.orchestra.run.smithi172.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T03:29:25.580 INFO:teuthology.orchestra.run.smithi084.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.6 MB/s | 90 kB 00:00 2024-09-21T03:29:25.605 INFO:teuthology.orchestra.run.smithi084.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-21T03:29:25.610 INFO:teuthology.orchestra.run.smithi172.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 370 kB/s | 18 kB 00:00 2024-09-21T03:29:25.630 INFO:teuthology.orchestra.run.smithi084.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-21T03:29:25.644 INFO:teuthology.orchestra.run.smithi172.stdout:(38/157): cephadm-19.3.0-5120.g18432218.el9.noa 7.1 MB/s | 784 kB 00:00 2024-09-21T03:29:25.656 INFO:teuthology.orchestra.run.smithi084.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-21T03:29:25.698 INFO:teuthology.orchestra.run.smithi084.stdout:(139/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.9 MB/s | 2.0 MB 00:00 2024-09-21T03:29:25.723 INFO:teuthology.orchestra.run.smithi084.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 885 kB/s | 59 kB 00:00 2024-09-21T03:29:25.748 INFO:teuthology.orchestra.run.smithi084.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-21T03:29:25.773 INFO:teuthology.orchestra.run.smithi172.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 563 kB/s | 80 kB 00:00 2024-09-21T03:29:25.774 INFO:teuthology.orchestra.run.smithi084.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-21T03:29:25.799 INFO:teuthology.orchestra.run.smithi084.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-09-21T03:29:25.825 INFO:teuthology.orchestra.run.smithi084.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-21T03:29:25.849 INFO:teuthology.orchestra.run.smithi084.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-21T03:29:25.853 INFO:teuthology.orchestra.run.smithi172.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2024-09-21T03:29:25.875 INFO:teuthology.orchestra.run.smithi084.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-21T03:29:25.878 INFO:teuthology.orchestra.run.smithi172.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.3 MB/s | 801 kB 00:00 2024-09-21T03:29:25.900 INFO:teuthology.orchestra.run.smithi084.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T03:29:25.920 INFO:teuthology.orchestra.run.smithi172.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-21T03:29:25.933 INFO:teuthology.orchestra.run.smithi084.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-21T03:29:25.983 INFO:teuthology.orchestra.run.smithi084.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T03:29:25.987 INFO:teuthology.orchestra.run.smithi172.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-21T03:29:26.012 INFO:teuthology.orchestra.run.smithi172.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-09-21T03:29:26.037 INFO:teuthology.orchestra.run.smithi172.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T03:29:26.127 INFO:teuthology.orchestra.run.smithi172.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-21T03:29:26.142 INFO:teuthology.orchestra.run.smithi084.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 14 MB/s | 3.4 MB 00:00 2024-09-21T03:29:26.155 INFO:teuthology.orchestra.run.smithi172.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-21T03:29:26.276 INFO:teuthology.orchestra.run.smithi084.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 9.3 MB/s | 3.2 MB 00:00 2024-09-21T03:29:26.376 INFO:teuthology.orchestra.run.smithi084.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 409 kB/s | 41 kB 00:00 2024-09-21T03:29:26.430 INFO:teuthology.orchestra.run.smithi172.stdout:(48/157): ceph-mgr-diskprediction-local-19.3.0- 5.0 MB/s | 7.4 MB 00:01 2024-09-21T03:29:26.476 INFO:teuthology.orchestra.run.smithi084.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.4 MB/s | 249 kB 00:00 2024-09-21T03:29:26.518 INFO:teuthology.orchestra.run.smithi084.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 4.8 MB/s | 1.8 MB 00:00 2024-09-21T03:29:26.562 INFO:teuthology.orchestra.run.smithi084.stdout:(155/157): NetworkManager-1.51.0-1.el9.x86_64.r 4.0 MB/s | 2.3 MB 00:00 2024-09-21T03:29:26.727 INFO:teuthology.orchestra.run.smithi084.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 5.4 MB/s | 1.4 MB 00:00 2024-09-21T03:29:26.844 INFO:teuthology.orchestra.run.smithi084.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 7.4 MB/s | 2.4 MB 00:00 2024-09-21T03:29:26.850 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:29:26.850 INFO:teuthology.orchestra.run.smithi084.stdout:Total 24 MB/s | 228 MB 00:09 2024-09-21T03:29:27.014 INFO:teuthology.orchestra.run.smithi172.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 777 kB/s | 689 kB 00:00 2024-09-21T03:29:27.164 INFO:teuthology.orchestra.run.smithi172.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 147 kB/s | 107 kB 00:00 2024-09-21T03:29:27.206 INFO:teuthology.orchestra.run.smithi172.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 897 kB/s | 943 kB 00:01 2024-09-21T03:29:27.556 INFO:teuthology.orchestra.run.smithi172.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 40 kB/s | 22 kB 00:00 2024-09-21T03:29:27.773 INFO:teuthology.orchestra.run.smithi172.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 58 kB/s | 33 kB 00:00 2024-09-21T03:29:27.973 INFO:teuthology.orchestra.run.smithi172.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 388 kB/s | 313 kB 00:00 2024-09-21T03:29:28.074 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-09-21T03:29:28.225 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-09-21T03:29:28.225 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-09-21T03:29:28.257 INFO:teuthology.orchestra.run.smithi172.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 38 kB/s | 18 kB 00:00 2024-09-21T03:29:28.473 INFO:teuthology.orchestra.run.smithi172.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 22 kB/s | 11 kB 00:00 2024-09-21T03:29:28.607 INFO:teuthology.orchestra.run.smithi172.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-09-21T03:29:28.983 INFO:teuthology.orchestra.run.smithi172.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 235 kB/s | 171 kB 00:00 2024-09-21T03:29:29.183 INFO:teuthology.orchestra.run.smithi172.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 229 kB/s | 160 kB 00:00 2024-09-21T03:29:29.208 INFO:teuthology.orchestra.run.smithi172.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 75 kB/s | 45 kB 00:00 2024-09-21T03:29:29.816 INFO:teuthology.orchestra.run.smithi172.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 41 kB/s | 24 kB 00:00 2024-09-21T03:29:29.858 INFO:teuthology.orchestra.run.smithi172.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 757 kB/s | 662 kB 00:00 2024-09-21T03:29:30.050 INFO:teuthology.orchestra.run.smithi172.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 671 kB/s | 581 kB 00:00 2024-09-21T03:29:30.435 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-09-21T03:29:30.435 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-09-21T03:29:30.442 INFO:teuthology.orchestra.run.smithi172.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 76 kB/s | 47 kB 00:00 2024-09-21T03:29:30.626 INFO:teuthology.orchestra.run.smithi172.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 381 kB/s | 292 kB 00:00 2024-09-21T03:29:30.801 INFO:teuthology.orchestra.run.smithi172.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 254 kB/s | 188 kB 00:00 2024-09-21T03:29:31.059 INFO:teuthology.orchestra.run.smithi172.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 62 kB/s | 38 kB 00:00 2024-09-21T03:29:31.641 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-09-21T03:29:31.768 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T03:29:31.835 INFO:teuthology.orchestra.run.smithi172.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 4.1 MB/s | 4.9 MB 00:01 2024-09-21T03:29:31.882 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T03:29:31.993 INFO:teuthology.orchestra.run.smithi172.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-09-21T03:29:32.070 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T03:29:32.111 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T03:29:32.136 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T03:29:32.152 INFO:teuthology.orchestra.run.smithi172.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-09-21T03:29:32.180 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T03:29:32.522 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T03:29:32.637 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:29:32.702 INFO:teuthology.orchestra.run.smithi172.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 194 kB/s | 137 kB 00:00 2024-09-21T03:29:32.746 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:29:32.752 INFO:teuthology.orchestra.run.smithi172.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 993 kB/s | 910 kB 00:00 2024-09-21T03:29:32.771 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:29:32.862 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:29:32.892 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:29:32.921 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T03:29:33.074 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T03:29:33.122 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T03:29:33.150 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:29:33.256 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:29:33.285 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:29:33.302 INFO:teuthology.orchestra.run.smithi172.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 5.0 MB/s | 5.8 MB 00:01 2024-09-21T03:29:33.348 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:29:33.378 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:29:33.400 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:29:33.436 INFO:teuthology.orchestra.run.smithi172.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 128 kB/s | 87 kB 00:00 2024-09-21T03:29:33.545 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:29:33.678 INFO:teuthology.orchestra.run.smithi172.stdout:(75/157): protobuf-3.14.0-13.el9.x86_64.rpm 1.0 MB/s | 1.0 MB 00:00 2024-09-21T03:29:33.686 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:29:33.835 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T03:29:33.937 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:29:34.018 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:29:34.086 INFO:teuthology.orchestra.run.smithi172.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 94 kB/s | 61 kB 00:00 2024-09-21T03:29:34.242 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:29:34.356 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T03:29:34.380 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T03:29:34.415 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T03:29:34.487 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T03:29:34.528 INFO:teuthology.orchestra.run.smithi172.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 4.9 MB/s | 6.0 MB 00:01 2024-09-21T03:29:34.540 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T03:29:34.553 INFO:teuthology.orchestra.run.smithi172.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 282 kB/s | 245 kB 00:00 2024-09-21T03:29:34.573 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T03:29:34.619 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T03:29:34.652 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T03:29:34.680 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T03:29:34.749 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T03:29:34.801 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T03:29:34.833 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T03:29:34.853 INFO:teuthology.orchestra.run.smithi172.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 324 kB/s | 248 kB 00:00 2024-09-21T03:29:34.868 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T03:29:34.948 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T03:29:34.979 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T03:29:35.013 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T03:29:35.042 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T03:29:35.062 INFO:teuthology.orchestra.run.smithi172.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 38 kB/s | 19 kB 00:00 2024-09-21T03:29:35.096 INFO:teuthology.orchestra.run.smithi172.stdout:(81/157): python3-jsonpatch-1.21-16.el9.noarch. 45 kB/s | 26 kB 00:00 2024-09-21T03:29:35.111 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T03:29:35.157 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T03:29:35.230 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T03:29:35.361 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T03:29:35.409 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T03:29:35.571 INFO:teuthology.orchestra.run.smithi172.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 241 kB/s | 172 kB 00:00 2024-09-21T03:29:35.613 INFO:teuthology.orchestra.run.smithi172.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 63 kB/s | 35 kB 00:00 2024-09-21T03:29:35.933 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T03:29:36.013 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T03:29:36.042 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T03:29:36.092 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T03:29:36.123 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T03:29:36.164 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T03:29:36.243 INFO:teuthology.orchestra.run.smithi172.stdout:(84/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.5 MB/s | 5.1 MB 00:01 2024-09-21T03:29:36.329 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T03:29:36.339 INFO:teuthology.orchestra.run.smithi172.stdout:(85/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 327 kB/s | 250 kB 00:00 2024-09-21T03:29:36.409 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T03:29:36.414 INFO:teuthology.orchestra.run.smithi172.stdout:(86/157): python3-oauthlib-3.1.1-5.el9.noarch.r 278 kB/s | 222 kB 00:00 2024-09-21T03:29:36.500 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T03:29:36.563 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T03:29:36.636 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T03:29:36.675 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T03:29:36.712 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T03:29:36.758 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T03:29:36.764 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-09-21T03:29:36.796 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T03:29:36.839 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T03:29:36.856 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T03:29:36.881 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T03:29:36.905 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T03:29:36.906 INFO:teuthology.orchestra.run.smithi172.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 75 kB/s | 42 kB 00:00 2024-09-21T03:29:36.931 INFO:teuthology.orchestra.run.smithi172.stdout:(88/157): python3-packaging-20.9-5.el9.noarch.r 112 kB/s | 77 kB 00:00 2024-09-21T03:29:36.964 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T03:29:37.004 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T03:29:37.018 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T03:29:37.058 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T03:29:37.088 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T03:29:37.099 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T03:29:37.189 INFO:teuthology.orchestra.run.smithi172.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 347 kB/s | 269 kB 00:00 2024-09-21T03:29:37.203 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T03:29:37.233 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T03:29:37.247 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T03:29:37.272 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T03:29:37.298 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T03:29:37.323 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T03:29:37.397 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T03:29:37.523 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T03:29:37.599 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T03:29:37.681 INFO:teuthology.orchestra.run.smithi172.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 205 kB/s | 159 kB 00:00 2024-09-21T03:29:37.705 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T03:29:37.706 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:29:37.706 INFO:teuthology.orchestra.run.smithi172.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 359 kB/s | 279 kB 00:00 2024-09-21T03:29:37.733 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T03:29:37.767 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T03:29:37.782 INFO:teuthology.orchestra.run.smithi172.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 86 kB/s | 51 kB 00:00 2024-09-21T03:29:37.807 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T03:29:37.832 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:29:37.846 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T03:29:37.873 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:29:37.876 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T03:29:37.910 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T03:29:37.944 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T03:29:37.965 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:29:37.976 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T03:29:37.995 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:29:38.011 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T03:29:38.024 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T03:29:38.098 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T03:29:38.141 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T03:29:38.172 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T03:29:38.191 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T03:29:38.241 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T03:29:38.269 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:29:38.274 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T03:29:38.282 INFO:teuthology.orchestra.run.smithi172.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 89 kB/s | 54 kB 00:00 2024-09-21T03:29:38.323 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T03:29:38.359 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:29:38.387 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:29:38.407 INFO:teuthology.orchestra.run.smithi172.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 67 kB/s | 42 kB 00:00 2024-09-21T03:29:38.454 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:29:38.480 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:29:38.500 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:29:38.681 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:29:38.849 INFO:teuthology.orchestra.run.smithi172.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 78 kB/s | 44 kB 00:00 2024-09-21T03:29:38.860 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:29:38.994 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T03:29:39.040 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T03:29:39.087 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T03:29:39.099 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:29:39.108 INFO:teuthology.orchestra.run.smithi172.stdout:(96/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-09-21T03:29:39.120 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T03:29:39.179 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:29:39.224 INFO:teuthology.orchestra.run.smithi172.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 270 kB/s | 221 kB 00:00 2024-09-21T03:29:39.227 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T03:29:39.275 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T03:29:39.320 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T03:29:39.408 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T03:29:39.414 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:29:39.439 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T03:29:39.525 INFO:teuthology.orchestra.run.smithi172.stdout:(98/157): qatlib-service-24.02.0-1.el9.x86_64.r 53 kB/s | 36 kB 00:00 2024-09-21T03:29:39.531 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T03:29:39.567 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T03:29:39.601 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T03:29:39.624 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T03:29:39.654 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T03:29:39.674 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T03:29:39.692 INFO:teuthology.orchestra.run.smithi172.stdout:(99/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 81 kB/s | 47 kB 00:00 2024-09-21T03:29:39.719 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T03:29:39.731 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T03:29:39.768 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T03:29:39.811 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T03:29:39.844 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T03:29:39.871 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T03:29:39.940 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T03:29:39.993 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T03:29:40.024 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T03:29:40.068 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T03:29:40.075 INFO:teuthology.orchestra.run.smithi172.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 358 kB/s | 304 kB 00:00 2024-09-21T03:29:40.149 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T03:29:40.167 INFO:teuthology.orchestra.run.smithi172.stdout:(101/157): uuid-1.6.2-55.el9.x86_64.rpm 90 kB/s | 58 kB 00:00 2024-09-21T03:29:40.178 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T03:29:40.214 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T03:29:40.242 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T03:29:40.310 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T03:29:40.356 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T03:29:40.366 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T03:29:40.376 INFO:teuthology.orchestra.run.smithi172.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 140 kB/s | 96 kB 00:00 2024-09-21T03:29:40.429 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T03:29:40.459 INFO:teuthology.orchestra.run.smithi172.stdout:(103/157): lua-devel-5.4.4-4.el9.x86_64.rpm 268 kB/s | 22 kB 00:00 2024-09-21T03:29:40.485 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T03:29:40.559 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T03:29:40.593 INFO:teuthology.orchestra.run.smithi172.stdout:(104/157): protobuf-compiler-3.14.0-13.el9.x86_ 6.3 MB/s | 863 kB 00:00 2024-09-21T03:29:40.607 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T03:29:40.643 INFO:teuthology.orchestra.run.smithi172.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T03:29:40.668 INFO:teuthology.orchestra.run.smithi172.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-21T03:29:40.694 INFO:teuthology.orchestra.run.smithi172.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-21T03:29:40.719 INFO:teuthology.orchestra.run.smithi172.stdout:(108/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 99 kB/s | 64 kB 00:00 2024-09-21T03:29:40.753 INFO:teuthology.orchestra.run.smithi172.stdout:(109/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 77 kB/s | 45 kB 00:00 2024-09-21T03:29:40.786 INFO:teuthology.orchestra.run.smithi172.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 390 kB/s | 26 kB 00:00 2024-09-21T03:29:40.811 INFO:teuthology.orchestra.run.smithi172.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.8 MB/s | 67 kB 00:00 2024-09-21T03:29:40.828 INFO:teuthology.orchestra.run.smithi172.stdout:(112/157): liboath-2.6.7-2.el9.x86_64.rpm 661 kB/s | 49 kB 00:00 2024-09-21T03:29:40.853 INFO:teuthology.orchestra.run.smithi172.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-09-21T03:29:40.904 INFO:teuthology.orchestra.run.smithi172.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-21T03:29:40.946 INFO:teuthology.orchestra.run.smithi172.stdout:(115/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-21T03:29:40.963 INFO:teuthology.orchestra.run.smithi172.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 743 kB/s | 43 kB 00:00 2024-09-21T03:29:40.979 INFO:teuthology.orchestra.run.smithi172.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 862 kB/s | 14 kB 00:00 2024-09-21T03:29:40.996 INFO:teuthology.orchestra.run.smithi172.stdout:(118/157): python3-cachetools-4.2.4-1.el9.noarc 967 kB/s | 32 kB 00:00 2024-09-21T03:29:41.022 INFO:teuthology.orchestra.run.smithi172.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-21T03:29:41.047 INFO:teuthology.orchestra.run.smithi172.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T03:29:41.072 INFO:teuthology.orchestra.run.smithi172.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T03:29:41.106 INFO:teuthology.orchestra.run.smithi172.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-21T03:29:41.119 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T03:29:41.173 INFO:teuthology.orchestra.run.smithi172.stdout:(123/157): libarrow-9.0.0-11.el9.x86_64.rpm 9.2 MB/s | 4.4 MB 00:00 2024-09-21T03:29:41.194 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T03:29:41.198 INFO:teuthology.orchestra.run.smithi172.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-21T03:29:41.224 INFO:teuthology.orchestra.run.smithi172.stdout:(125/157): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-09-21T03:29:41.224 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T03:29:41.249 INFO:teuthology.orchestra.run.smithi172.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-21T03:29:41.259 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T03:29:41.274 INFO:teuthology.orchestra.run.smithi172.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-09-21T03:29:41.297 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T03:29:41.299 INFO:teuthology.orchestra.run.smithi172.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-21T03:29:41.325 INFO:teuthology.orchestra.run.smithi172.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-21T03:29:41.339 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T03:29:41.350 INFO:teuthology.orchestra.run.smithi172.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T03:29:41.375 INFO:teuthology.orchestra.run.smithi172.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T03:29:41.410 INFO:teuthology.orchestra.run.smithi172.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-21T03:29:41.451 INFO:teuthology.orchestra.run.smithi172.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-21T03:29:41.476 INFO:teuthology.orchestra.run.smithi172.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-09-21T03:29:41.501 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T03:29:41.503 INFO:teuthology.orchestra.run.smithi172.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-09-21T03:29:41.527 INFO:teuthology.orchestra.run.smithi172.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T03:29:41.550 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T03:29:41.552 INFO:teuthology.orchestra.run.smithi172.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-21T03:29:41.577 INFO:teuthology.orchestra.run.smithi172.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-21T03:29:41.602 INFO:teuthology.orchestra.run.smithi172.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T03:29:41.628 INFO:teuthology.orchestra.run.smithi172.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T03:29:41.638 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T03:29:41.652 INFO:teuthology.orchestra.run.smithi172.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 716 kB/s | 36 kB 00:00 2024-09-21T03:29:41.678 INFO:teuthology.orchestra.run.smithi172.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-09-21T03:29:41.704 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T03:29:41.713 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T03:29:41.728 INFO:teuthology.orchestra.run.smithi172.stdout:(143/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-09-21T03:29:41.753 INFO:teuthology.orchestra.run.smithi172.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-21T03:29:41.776 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T03:29:41.779 INFO:teuthology.orchestra.run.smithi172.stdout:(145/157): python3-websocket-client-1.2.3-2.el9 893 kB/s | 90 kB 00:00 2024-09-21T03:29:41.789 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T03:29:41.804 INFO:teuthology.orchestra.run.smithi172.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 809 kB/s | 20 kB 00:00 2024-09-21T03:29:41.809 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T03:29:41.817 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T03:29:41.829 INFO:teuthology.orchestra.run.smithi172.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T03:29:41.845 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T03:29:41.850 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T03:29:41.854 INFO:teuthology.orchestra.run.smithi172.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-21T03:29:41.891 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T03:29:41.905 INFO:teuthology.orchestra.run.smithi172.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T03:29:41.928 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T03:29:41.971 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T03:29:42.013 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T03:29:42.145 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T03:29:42.163 INFO:teuthology.orchestra.run.smithi172.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 9.0 MB/s | 2.3 MB 00:00 2024-09-21T03:29:42.174 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T03:29:42.181 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T03:29:42.213 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:29:42.222 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T03:29:42.238 INFO:teuthology.orchestra.run.smithi172.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 24 MB/s | 1.8 MB 00:00 2024-09-21T03:29:42.280 INFO:teuthology.orchestra.run.smithi172.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 982 kB/s | 41 kB 00:00 2024-09-21T03:29:42.304 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:29:42.322 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T03:29:42.335 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T03:29:42.339 INFO:teuthology.orchestra.run.smithi172.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 4.2 MB/s | 249 kB 00:00 2024-09-21T03:29:42.365 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T03:29:42.371 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T03:29:42.405 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T03:29:42.406 INFO:teuthology.orchestra.run.smithi172.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 20 MB/s | 1.4 MB 00:00 2024-09-21T03:29:42.438 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T03:29:42.505 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T03:29:42.582 INFO:teuthology.orchestra.run.smithi172.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-09-21T03:29:42.640 INFO:teuthology.orchestra.run.smithi172.stdout:(156/157): librbd1-19.3.0-5120.g18432218.el9.x8 4.0 MB/s | 3.2 MB 00:00 2024-09-21T03:29:42.674 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T03:29:42.782 INFO:teuthology.orchestra.run.smithi172.stdout:(157/157): librados2-19.3.0-5120.g18432218.el9. 3.6 MB/s | 3.4 MB 00:00 2024-09-21T03:29:42.789 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:29:42.790 INFO:teuthology.orchestra.run.smithi172.stdout:Total 9.3 MB/s | 228 MB 00:24 2024-09-21T03:29:42.795 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T03:29:42.828 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T03:29:42.857 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T03:29:42.871 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T03:29:42.891 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T03:29:42.899 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:29:42.929 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T03:29:42.953 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:29:42.969 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T03:29:42.984 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T03:29:42.999 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T03:29:43.028 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T03:29:43.062 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T03:29:43.103 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T03:29:43.138 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T03:29:43.225 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T03:29:43.268 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T03:29:43.299 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T03:29:43.402 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T03:29:43.450 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T03:29:44.053 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-09-21T03:29:44.157 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T03:29:44.205 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T03:29:44.208 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-09-21T03:29:44.208 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-09-21T03:29:44.239 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T03:29:44.338 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T03:29:44.394 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T03:29:44.437 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T03:29:44.516 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T03:29:44.558 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T03:29:44.740 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T03:29:44.764 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T03:29:44.841 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T03:29:45.382 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:29:45.469 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T03:29:45.546 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:29:45.577 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T03:29:46.071 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-09-21T03:29:46.071 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-09-21T03:29:46.116 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:29:46.150 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:29:46.245 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:29:46.245 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T03:29:46.245 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T03:29:46.246 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:29:46.276 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:29:46.795 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T03:29:46.884 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T03:29:46.912 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T03:29:46.945 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T03:29:47.270 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T03:29:47.308 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:29:47.383 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:29:47.413 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T03:29:47.449 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T03:29:47.946 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T03:29:47.978 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:29:48.032 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:29:48.062 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T03:29:50.336 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:29:50.367 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:29:50.973 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:29:51.011 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:29:51.106 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:29:51.106 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T03:29:51.106 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T03:29:51.106 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:29:51.138 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:29:52.610 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-09-21T03:29:52.727 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T03:29:52.765 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T03:29:52.818 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T03:29:52.853 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T03:29:52.886 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T03:29:52.937 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T03:29:53.269 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T03:29:53.395 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:29:53.513 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:29:53.538 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:29:53.613 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:29:53.642 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:29:53.672 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T03:29:53.824 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T03:29:53.882 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T03:29:53.910 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:29:53.999 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:29:54.047 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:29:54.106 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:29:54.128 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:29:54.154 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:29:54.355 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:29:54.508 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:29:54.635 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T03:29:54.732 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:29:54.811 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:29:55.031 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:29:55.140 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T03:29:55.184 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T03:29:55.225 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T03:29:55.298 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T03:29:55.351 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T03:29:55.391 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T03:29:55.435 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T03:29:55.479 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T03:29:55.507 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T03:29:55.575 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T03:29:55.629 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T03:29:55.660 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T03:29:55.695 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T03:29:55.776 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T03:29:55.806 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T03:29:55.849 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T03:29:55.886 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T03:29:55.955 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T03:29:56.010 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T03:29:56.083 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T03:29:56.216 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T03:29:56.270 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T03:29:56.795 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T03:29:56.883 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T03:29:56.912 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T03:29:56.954 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T03:29:56.993 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T03:29:57.077 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T03:29:57.196 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T03:29:57.254 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T03:29:57.353 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T03:29:57.426 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T03:29:57.506 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T03:29:57.547 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T03:29:57.583 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T03:29:57.630 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T03:29:57.666 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T03:29:57.719 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T03:29:57.760 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T03:29:57.895 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T03:29:57.945 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T03:29:57.994 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T03:29:58.067 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:29:58.067 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /sys 2024-09-21T03:29:58.067 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /proc 2024-09-21T03:29:58.068 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /mnt 2024-09-21T03:29:58.068 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /var/tmp 2024-09-21T03:29:58.068 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /home 2024-09-21T03:29:58.068 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /root 2024-09-21T03:29:58.068 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /tmp 2024-09-21T03:29:58.068 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:29:58.097 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T03:29:58.137 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T03:29:58.176 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T03:29:58.202 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T03:29:58.227 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T03:29:58.252 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:29:58.268 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:29:58.268 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:29:58.268 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T03:29:58.268 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:29:58.300 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T03:29:58.429 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T03:29:58.475 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T03:29:58.503 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T03:29:58.538 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T03:29:58.587 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T03:29:58.627 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T03:29:58.657 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T03:29:58.692 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T03:29:58.725 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T03:29:58.783 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T03:29:58.817 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T03:29:58.904 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T03:29:58.948 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T03:29:58.987 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T03:29:59.090 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T03:29:59.146 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T03:29:59.854 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:29:59.863 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T03:29:59.881 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:29:59.881 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:29:59.881 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T03:29:59.882 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:29:59.882 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:29:59.882 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:29:59.910 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T03:29:59.944 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T03:30:00.053 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T03:30:00.105 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:30:00.115 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T03:30:00.142 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:30:00.143 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:00.143 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T03:30:00.143 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:30:00.143 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:30:00.143 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:30:00.160 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T03:30:00.248 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T03:30:00.288 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T03:30:00.473 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T03:30:00.511 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T03:30:00.588 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T03:30:00.606 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:30:00.630 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:30:00.630 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:00.630 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T03:30:00.630 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:30:00.630 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:30:00.630 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:30:00.736 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T03:30:00.792 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T03:30:00.848 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T03:30:01.041 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T03:30:01.089 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T03:30:01.158 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T03:30:01.222 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T03:30:01.247 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T03:30:01.332 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T03:30:01.403 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T03:30:01.448 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T03:30:01.480 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T03:30:01.507 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T03:30:01.950 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:30:01.980 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:30:02.012 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T03:30:02.078 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T03:30:02.103 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:30:02.545 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T03:30:02.639 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T03:30:02.667 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T03:30:02.709 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T03:30:03.036 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T03:30:03.080 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:30:03.171 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:30:03.201 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T03:30:03.237 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T03:30:03.287 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:30:03.287 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2024-09-21T03:30:03.287 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2024-09-21T03:30:03.287 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2024-09-21T03:30:03.287 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2024-09-21T03:30:03.287 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2024-09-21T03:30:03.287 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /root 2024-09-21T03:30:03.287 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2024-09-21T03:30:03.287 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:30:03.462 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:30:03.481 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:30:03.481 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:03.481 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T03:30:03.481 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:30:03.739 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T03:30:03.774 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:30:03.845 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:30:03.876 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T03:30:05.083 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:30:05.111 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:30:05.111 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:05.111 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T03:30:05.111 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:30:05.111 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:30:05.111 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:30:05.288 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:30:05.334 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:30:05.351 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:30:05.358 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:30:05.358 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:05.358 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T03:30:05.358 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:30:05.358 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:30:05.358 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:30:05.826 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:30:05.850 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:30:05.850 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:05.850 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T03:30:05.850 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:30:05.851 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:30:05.851 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:30:05.956 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T03:30:06.013 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T03:30:06.068 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T03:30:06.158 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:30:06.250 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T03:30:06.310 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T03:30:06.313 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:30:06.317 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:30:06.351 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:30:06.386 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T03:30:06.465 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:30:06.475 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T03:30:06.613 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T03:30:06.625 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T03:30:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T03:30:06.661 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:30:06.686 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:30:06.686 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:06.686 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T03:30:06.686 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:30:06.686 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:30:06.686 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:30:06.692 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T03:30:06.719 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T03:30:06.737 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:30:06.749 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:30:06.847 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T03:30:06.886 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:30:06.902 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T03:30:06.925 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:30:07.016 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:30:07.017 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T03:30:07.017 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T03:30:07.017 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T03:30:07.043 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:30:07.079 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:30:07.109 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:30:07.150 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T03:30:07.215 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T03:30:07.241 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:30:07.867 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T03:30:07.898 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:30:07.921 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:30:07.922 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:07.922 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T03:30:07.922 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:30:07.922 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:30:07.922 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:30:07.965 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:30:07.988 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:30:07.989 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:07.989 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T03:30:07.989 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:30:08.040 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:30:08.064 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:30:08.064 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:08.064 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T03:30:08.064 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:30:08.064 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:30:08.064 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:30:08.383 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:30:08.407 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:30:08.407 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:08.407 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T03:30:08.407 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:30:08.407 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:30:08.407 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:30:10.385 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:30:10.446 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:30:11.398 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:30:11.430 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:30:11.544 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:30:11.712 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T03:30:11.749 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:30:11.772 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:30:11.773 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:11.773 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T03:30:11.773 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:30:11.773 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:30:11.773 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:30:11.816 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:30:11.827 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:30:11.942 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T03:30:11.999 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T03:30:12.387 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T03:30:12.428 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T03:30:12.468 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T03:30:12.501 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T03:30:12.528 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T03:30:12.709 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T03:30:12.757 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T03:30:12.787 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T03:30:12.817 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T03:30:12.855 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T03:30:12.958 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T03:30:12.985 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:30:13.008 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:30:13.008 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:13.008 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T03:30:13.008 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:30:13.008 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:30:13.009 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:30:13.052 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:30:13.074 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:30:13.075 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:13.075 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T03:30:13.075 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:30:13.128 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:30:13.151 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:30:13.151 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:13.151 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T03:30:13.151 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:30:13.151 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:30:13.151 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:30:13.478 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:30:13.479 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:30:13.502 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:30:13.502 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:13.502 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T03:30:13.502 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:30:13.502 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:30:13.502 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:30:13.519 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:30:13.540 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:30:14.365 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T03:30:14.449 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T03:30:14.489 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T03:30:14.570 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T03:30:14.601 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T03:30:14.626 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T03:30:14.677 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T03:30:14.678 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:30:14.753 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:30:14.753 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:30:14.828 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:30:14.853 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T03:30:14.858 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:30:14.859 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:30:15.038 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:30:15.039 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:30:15.123 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:30:15.195 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:30:17.490 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T03:30:17.532 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T03:30:17.572 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T03:30:17.604 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T03:30:17.631 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T03:30:17.835 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T03:30:17.877 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T03:30:17.908 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T03:30:17.937 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T03:30:17.975 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T03:30:18.556 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:30:18.598 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:30:18.617 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:30:18.869 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:30:18.869 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2024-09-21T03:30:18.869 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2024-09-21T03:30:18.869 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2024-09-21T03:30:18.869 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2024-09-21T03:30:18.869 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2024-09-21T03:30:18.869 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /root 2024-09-21T03:30:18.869 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2024-09-21T03:30:18.869 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T03:30:19.043 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:30:19.060 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:30:19.060 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:19.060 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T03:30:19.060 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T03:30:19.431 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T03:30:19.518 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T03:30:19.564 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T03:30:19.650 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T03:30:19.679 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T03:30:19.705 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T03:30:19.731 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T03:30:19.731 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:30:19.815 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:30:19.815 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:30:19.917 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:30:19.949 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T03:30:19.954 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:30:19.954 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:30:20.152 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:30:20.152 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:30:20.235 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:30:20.299 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:30:20.647 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:30:20.674 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:30:20.674 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:20.674 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T03:30:20.675 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:30:20.675 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:30:20.675 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T03:30:20.898 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:30:20.922 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:30:20.922 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:20.922 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T03:30:20.922 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:30:20.922 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:30:20.922 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T03:30:21.187 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:30:21.187 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T03:30:21.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T03:30:21.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T03:30:21.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T03:30:21.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T03:30:21.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T03:30:21.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T03:30:21.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:30:21.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:30:21.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:30:21.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T03:30:21.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T03:30:21.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T03:30:21.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:30:21.188 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T03:30:21.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T03:30:21.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T03:30:21.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T03:30:21.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T03:30:21.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T03:30:21.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T03:30:21.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T03:30:21.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T03:30:21.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T03:30:21.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T03:30:21.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T03:30:21.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T03:30:21.189 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T03:30:21.200 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T03:30:21.200 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T03:30:21.200 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T03:30:21.200 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T03:30:21.200 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T03:30:21.200 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T03:30:21.200 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T03:30:21.200 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T03:30:21.201 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T03:30:21.201 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T03:30:21.201 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T03:30:21.201 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T03:30:21.201 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T03:30:21.201 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T03:30:21.201 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T03:30:21.201 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T03:30:21.201 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T03:30:21.201 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T03:30:21.201 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T03:30:21.201 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T03:30:21.201 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T03:30:21.201 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T03:30:21.201 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T03:30:21.202 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T03:30:21.202 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T03:30:21.202 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T03:30:21.202 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T03:30:21.202 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T03:30:21.202 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T03:30:21.202 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T03:30:21.202 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T03:30:21.202 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T03:30:21.202 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T03:30:21.202 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T03:30:21.202 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T03:30:21.202 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T03:30:21.203 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T03:30:21.203 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T03:30:21.203 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T03:30:21.203 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T03:30:21.203 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T03:30:21.203 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T03:30:21.203 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T03:30:21.203 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T03:30:21.203 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T03:30:21.203 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T03:30:21.203 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T03:30:21.203 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T03:30:21.203 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T03:30:21.203 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T03:30:21.203 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T03:30:21.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T03:30:21.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T03:30:21.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T03:30:21.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T03:30:21.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T03:30:21.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T03:30:21.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T03:30:21.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T03:30:21.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T03:30:21.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T03:30:21.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T03:30:21.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T03:30:21.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T03:30:21.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T03:30:21.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T03:30:21.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T03:30:21.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T03:30:21.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T03:30:21.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T03:30:21.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T03:30:21.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T03:30:21.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T03:30:21.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T03:30:21.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T03:30:21.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T03:30:21.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T03:30:21.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T03:30:21.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T03:30:21.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T03:30:21.206 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T03:30:21.206 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T03:30:21.206 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T03:30:21.206 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T03:30:21.206 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T03:30:21.206 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T03:30:21.206 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T03:30:21.206 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T03:30:21.206 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T03:30:21.206 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T03:30:21.206 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T03:30:21.206 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T03:30:21.207 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T03:30:21.207 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T03:30:21.207 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T03:30:21.207 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T03:30:21.207 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T03:30:21.207 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T03:30:21.207 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T03:30:21.207 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T03:30:21.207 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T03:30:21.207 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T03:30:21.207 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T03:30:21.207 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T03:30:21.207 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T03:30:21.208 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T03:30:21.208 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T03:30:21.208 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T03:30:21.208 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T03:30:21.208 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T03:30:21.208 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T03:30:21.208 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T03:30:21.208 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T03:30:21.208 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T03:30:21.208 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T03:30:21.208 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T03:30:21.208 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T03:30:21.208 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T03:30:21.208 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T03:30:21.208 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T03:30:21.209 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T03:30:21.209 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T03:30:21.209 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T03:30:21.209 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T03:30:21.209 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T03:30:21.209 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T03:30:21.209 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T03:30:21.209 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T03:30:21.209 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T03:30:21.209 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T03:30:21.209 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T03:30:21.209 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T03:30:21.209 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T03:30:21.210 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T03:30:21.210 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T03:30:21.210 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T03:30:21.391 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:30:21.415 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:30:21.415 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:21.415 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T03:30:21.415 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:30:21.415 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:30:21.415 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T03:30:21.521 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T03:30:21.577 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T03:30:21.632 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T03:30:21.818 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T03:30:21.874 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T03:30:21.961 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T03:30:22.048 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T03:30:22.198 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T03:30:22.233 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T03:30:22.265 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T03:30:22.301 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T03:30:22.694 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:30:22.724 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:30:22.757 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T03:30:22.822 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T03:30:22.847 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:30:23.946 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:30:23.946 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:30:23.947 INFO:teuthology.orchestra.run.smithi174.stdout:Upgraded: 2024-09-21T03:30:23.947 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T03:30:23.947 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T03:30:23.947 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T03:30:23.947 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T03:30:23.947 INFO:teuthology.orchestra.run.smithi174.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.947 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.947 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T03:30:23.947 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T03:30:23.947 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-09-21T03:30:23.947 INFO:teuthology.orchestra.run.smithi174.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T03:30:23.947 INFO:teuthology.orchestra.run.smithi174.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T03:30:23.947 INFO:teuthology.orchestra.run.smithi174.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T03:30:23.947 INFO:teuthology.orchestra.run.smithi174.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T03:30:23.948 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.948 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.948 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.948 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.948 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:23.948 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.948 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.948 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.948 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:23.948 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:23.948 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:23.948 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:23.948 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:23.948 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.948 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.949 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:23.949 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.949 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.949 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.949 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:23.949 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:23.949 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.949 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.949 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:23.949 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T03:30:23.949 INFO:teuthology.orchestra.run.smithi174.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T03:30:23.949 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T03:30:23.949 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T03:30:23.949 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T03:30:23.949 INFO:teuthology.orchestra.run.smithi174.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T03:30:23.950 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T03:30:23.950 INFO:teuthology.orchestra.run.smithi174.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T03:30:23.950 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T03:30:23.950 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T03:30:23.950 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T03:30:23.950 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.950 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.950 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.950 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T03:30:23.950 INFO:teuthology.orchestra.run.smithi174.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T03:30:23.950 INFO:teuthology.orchestra.run.smithi174.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T03:30:23.950 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T03:30:23.950 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T03:30:23.950 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T03:30:23.950 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.951 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.951 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T03:30:23.951 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.951 INFO:teuthology.orchestra.run.smithi174.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T03:30:23.951 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T03:30:23.951 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T03:30:23.951 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T03:30:23.951 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T03:30:23.951 INFO:teuthology.orchestra.run.smithi174.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T03:30:23.951 INFO:teuthology.orchestra.run.smithi174.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T03:30:23.951 INFO:teuthology.orchestra.run.smithi174.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T03:30:23.951 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T03:30:23.951 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T03:30:23.951 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T03:30:23.951 INFO:teuthology.orchestra.run.smithi174.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T03:30:23.952 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T03:30:23.952 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T03:30:23.952 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T03:30:23.952 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T03:30:23.952 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T03:30:23.952 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T03:30:23.952 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T03:30:23.952 INFO:teuthology.orchestra.run.smithi174.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T03:30:23.952 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T03:30:23.952 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T03:30:23.952 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T03:30:23.952 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.952 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.952 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.953 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T03:30:23.953 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T03:30:23.953 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T03:30:23.953 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T03:30:23.953 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T03:30:23.953 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T03:30:23.953 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T03:30:23.953 INFO:teuthology.orchestra.run.smithi174.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T03:30:23.953 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T03:30:23.953 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T03:30:23.953 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T03:30:23.953 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T03:30:23.953 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T03:30:23.953 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T03:30:23.953 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T03:30:23.953 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T03:30:23.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T03:30:23.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T03:30:23.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T03:30:23.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T03:30:23.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T03:30:23.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T03:30:23.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T03:30:23.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T03:30:23.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T03:30:23.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T03:30:23.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T03:30:23.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T03:30:23.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T03:30:23.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T03:30:23.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T03:30:23.954 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T03:30:23.955 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T03:30:23.955 INFO:teuthology.orchestra.run.smithi174.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T03:30:23.955 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T03:30:23.955 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T03:30:23.955 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T03:30:23.955 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T03:30:23.955 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T03:30:23.955 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T03:30:23.955 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.955 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.955 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T03:30:23.955 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T03:30:23.955 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T03:30:23.955 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.956 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T03:30:23.956 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T03:30:23.956 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T03:30:23.956 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T03:30:23.956 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T03:30:23.956 INFO:teuthology.orchestra.run.smithi174.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T03:30:23.956 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T03:30:23.956 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T03:30:23.956 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T03:30:23.956 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T03:30:23.956 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T03:30:23.956 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T03:30:23.956 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T03:30:23.956 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T03:30:23.957 INFO:teuthology.orchestra.run.smithi174.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T03:30:23.957 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.957 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.957 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:23.957 INFO:teuthology.orchestra.run.smithi174.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T03:30:23.957 INFO:teuthology.orchestra.run.smithi174.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T03:30:23.957 INFO:teuthology.orchestra.run.smithi174.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T03:30:23.957 INFO:teuthology.orchestra.run.smithi174.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T03:30:23.957 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T03:30:23.957 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T03:30:23.958 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T03:30:23.958 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:30:23.958 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-09-21T03:30:24.376 DEBUG:teuthology.parallel:result is None 2024-09-21T03:30:26.049 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:30:26.112 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:30:26.324 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:30:26.324 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T03:30:26.324 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T03:30:26.324 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T03:30:26.324 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T03:30:26.324 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T03:30:26.324 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T03:30:26.324 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T03:30:26.324 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:30:26.324 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:30:26.325 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:30:26.325 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T03:30:26.325 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T03:30:26.325 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T03:30:26.325 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:30:26.325 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T03:30:26.325 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T03:30:26.325 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T03:30:26.325 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T03:30:26.325 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T03:30:26.325 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T03:30:26.325 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T03:30:26.325 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T03:30:26.325 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T03:30:26.325 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T03:30:26.326 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T03:30:26.326 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T03:30:26.326 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T03:30:26.326 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T03:30:26.326 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T03:30:26.326 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T03:30:26.326 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T03:30:26.326 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T03:30:26.326 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T03:30:26.326 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T03:30:26.326 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T03:30:26.326 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T03:30:26.326 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T03:30:26.326 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T03:30:26.326 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T03:30:26.327 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T03:30:26.327 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T03:30:26.327 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T03:30:26.327 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T03:30:26.327 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T03:30:26.327 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T03:30:26.327 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T03:30:26.327 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T03:30:26.327 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T03:30:26.327 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T03:30:26.327 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T03:30:26.327 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T03:30:26.327 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T03:30:26.327 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T03:30:26.327 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T03:30:26.327 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T03:30:26.328 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T03:30:26.328 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T03:30:26.328 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T03:30:26.328 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T03:30:26.328 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T03:30:26.328 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T03:30:26.328 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T03:30:26.328 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T03:30:26.328 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T03:30:26.328 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T03:30:26.328 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T03:30:26.328 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T03:30:26.328 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T03:30:26.328 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T03:30:26.328 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T03:30:26.329 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T03:30:26.329 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T03:30:26.329 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T03:30:26.329 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T03:30:26.329 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T03:30:26.329 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T03:30:26.329 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T03:30:26.329 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T03:30:26.329 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T03:30:26.329 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T03:30:26.329 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T03:30:26.329 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T03:30:26.329 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T03:30:26.329 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T03:30:26.329 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T03:30:26.329 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T03:30:26.330 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T03:30:26.330 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T03:30:26.330 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T03:30:26.330 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T03:30:26.330 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T03:30:26.330 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T03:30:26.330 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T03:30:26.330 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T03:30:26.330 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T03:30:26.330 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T03:30:26.330 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T03:30:26.330 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T03:30:26.330 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T03:30:26.330 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T03:30:26.330 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T03:30:26.330 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T03:30:26.331 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T03:30:26.331 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T03:30:26.331 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T03:30:26.331 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T03:30:26.331 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T03:30:26.331 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T03:30:26.331 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T03:30:26.331 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T03:30:26.331 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T03:30:26.331 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T03:30:26.331 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T03:30:26.331 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T03:30:26.331 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T03:30:26.331 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T03:30:26.332 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T03:30:26.332 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T03:30:26.332 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T03:30:26.332 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T03:30:26.332 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T03:30:26.332 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T03:30:26.332 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T03:30:26.332 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T03:30:26.332 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T03:30:26.332 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T03:30:26.332 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T03:30:26.332 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T03:30:26.332 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T03:30:26.332 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T03:30:26.332 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T03:30:26.332 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T03:30:26.333 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T03:30:26.333 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T03:30:26.333 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T03:30:26.333 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T03:30:26.333 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T03:30:26.333 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T03:30:26.333 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T03:30:26.333 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T03:30:26.333 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T03:30:26.333 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T03:30:26.333 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T03:30:26.333 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T03:30:26.333 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T03:30:26.333 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T03:30:26.333 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T03:30:26.333 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T03:30:26.333 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T03:30:26.334 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T03:30:26.334 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T03:30:26.334 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T03:30:26.334 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T03:30:26.334 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T03:30:26.334 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T03:30:26.334 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T03:30:26.334 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T03:30:26.334 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T03:30:26.334 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T03:30:26.334 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T03:30:26.334 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T03:30:26.334 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T03:30:26.334 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T03:30:26.335 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T03:30:27.077 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:30:27.120 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:30:27.235 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:30:27.413 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T03:30:27.439 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:30:27.463 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:30:27.463 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:27.463 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T03:30:27.463 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:30:27.463 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:30:27.463 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T03:30:27.514 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:30:27.527 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:30:27.626 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T03:30:27.679 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T03:30:28.646 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T03:30:28.676 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:30:28.700 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:30:28.700 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:28.700 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T03:30:28.700 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:30:28.700 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:30:28.700 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T03:30:28.743 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:30:28.766 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:30:28.766 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:28.766 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T03:30:28.766 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T03:30:28.818 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:30:28.842 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:30:28.842 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:28.842 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T03:30:28.842 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:30:28.842 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:30:28.842 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T03:30:29.161 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:30:29.184 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:30:29.184 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:30:29.184 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T03:30:29.184 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:30:29.184 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:30:29.184 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T03:30:29.216 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:30:29.216 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:30:29.216 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2024-09-21T03:30:29.216 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T03:30:29.217 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T03:30:29.217 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T03:30:29.217 INFO:teuthology.orchestra.run.smithi084.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T03:30:29.217 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.217 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.217 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T03:30:29.217 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T03:30:29.217 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-09-21T03:30:29.217 INFO:teuthology.orchestra.run.smithi084.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T03:30:29.217 INFO:teuthology.orchestra.run.smithi084.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T03:30:29.217 INFO:teuthology.orchestra.run.smithi084.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T03:30:29.217 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T03:30:29.217 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.217 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.218 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.218 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.218 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:29.218 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.218 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.218 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.218 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:29.218 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:29.218 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:29.218 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:29.218 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:29.218 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.218 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.219 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:29.219 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.219 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.219 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.219 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:29.219 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:29.219 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.219 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.219 INFO:teuthology.orchestra.run.smithi084.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:29.219 INFO:teuthology.orchestra.run.smithi084.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T03:30:29.220 INFO:teuthology.orchestra.run.smithi084.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T03:30:29.220 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T03:30:29.220 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T03:30:29.220 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T03:30:29.220 INFO:teuthology.orchestra.run.smithi084.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T03:30:29.220 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T03:30:29.220 INFO:teuthology.orchestra.run.smithi084.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T03:30:29.220 INFO:teuthology.orchestra.run.smithi084.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T03:30:29.220 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T03:30:29.220 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T03:30:29.220 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.220 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.220 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.220 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T03:30:29.221 INFO:teuthology.orchestra.run.smithi084.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T03:30:29.221 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T03:30:29.221 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T03:30:29.221 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T03:30:29.221 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T03:30:29.221 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.221 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.221 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T03:30:29.221 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.221 INFO:teuthology.orchestra.run.smithi084.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T03:30:29.221 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T03:30:29.221 INFO:teuthology.orchestra.run.smithi084.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T03:30:29.221 INFO:teuthology.orchestra.run.smithi084.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T03:30:29.222 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T03:30:29.222 INFO:teuthology.orchestra.run.smithi084.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T03:30:29.222 INFO:teuthology.orchestra.run.smithi084.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T03:30:29.222 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T03:30:29.222 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T03:30:29.222 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T03:30:29.222 INFO:teuthology.orchestra.run.smithi084.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T03:30:29.222 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T03:30:29.222 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T03:30:29.222 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T03:30:29.222 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T03:30:29.222 INFO:teuthology.orchestra.run.smithi084.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T03:30:29.222 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T03:30:29.222 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T03:30:29.223 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T03:30:29.223 INFO:teuthology.orchestra.run.smithi084.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T03:30:29.223 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T03:30:29.223 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T03:30:29.223 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T03:30:29.223 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.223 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.223 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.223 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T03:30:29.223 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T03:30:29.223 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T03:30:29.223 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T03:30:29.223 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T03:30:29.224 INFO:teuthology.orchestra.run.smithi084.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T03:30:29.224 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T03:30:29.224 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T03:30:29.224 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T03:30:29.224 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T03:30:29.224 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T03:30:29.224 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T03:30:29.224 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T03:30:29.224 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T03:30:29.224 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T03:30:29.224 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T03:30:29.224 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T03:30:29.224 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T03:30:29.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T03:30:29.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T03:30:29.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T03:30:29.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T03:30:29.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T03:30:29.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T03:30:29.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T03:30:29.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T03:30:29.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T03:30:29.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T03:30:29.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T03:30:29.225 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T03:30:29.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T03:30:29.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T03:30:29.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T03:30:29.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T03:30:29.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T03:30:29.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T03:30:29.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T03:30:29.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T03:30:29.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T03:30:29.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T03:30:29.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.226 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T03:30:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T03:30:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T03:30:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T03:30:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T03:30:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T03:30:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T03:30:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T03:30:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T03:30:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T03:30:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T03:30:29.227 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T03:30:29.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T03:30:29.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T03:30:29.228 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T03:30:29.228 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T03:30:29.228 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T03:30:29.228 INFO:teuthology.orchestra.run.smithi084.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T03:30:29.228 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.228 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.228 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:29.228 INFO:teuthology.orchestra.run.smithi084.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T03:30:29.228 INFO:teuthology.orchestra.run.smithi084.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T03:30:29.228 INFO:teuthology.orchestra.run.smithi084.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T03:30:29.228 INFO:teuthology.orchestra.run.smithi084.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T03:30:29.228 INFO:teuthology.orchestra.run.smithi084.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T03:30:29.228 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T03:30:29.229 INFO:teuthology.orchestra.run.smithi084.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T03:30:29.229 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:30:29.229 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-09-21T03:30:29.632 DEBUG:teuthology.parallel:result is None 2024-09-21T03:30:33.182 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T03:30:33.223 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T03:30:33.263 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T03:30:33.304 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T03:30:33.331 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T03:30:33.513 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T03:30:33.561 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T03:30:33.599 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T03:30:33.629 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T03:30:33.675 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T03:30:34.231 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:30:34.273 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:30:34.293 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:30:35.125 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T03:30:35.228 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T03:30:35.268 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T03:30:35.358 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T03:30:35.397 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T03:30:35.422 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T03:30:35.448 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T03:30:35.449 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:30:35.532 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:30:35.532 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:30:35.625 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:30:35.650 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T03:30:35.655 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:30:35.656 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:30:35.843 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:30:35.843 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:30:35.936 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:30:35.998 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:30:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:30:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T03:30:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T03:30:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T03:30:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T03:30:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T03:30:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T03:30:42.365 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T03:30:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:30:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:30:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:30:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T03:30:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T03:30:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T03:30:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:30:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T03:30:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T03:30:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T03:30:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T03:30:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T03:30:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T03:30:42.366 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T03:30:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T03:30:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T03:30:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T03:30:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T03:30:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T03:30:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T03:30:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T03:30:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T03:30:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T03:30:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T03:30:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T03:30:42.367 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T03:30:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T03:30:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T03:30:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T03:30:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T03:30:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T03:30:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T03:30:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T03:30:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T03:30:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T03:30:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T03:30:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T03:30:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T03:30:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T03:30:42.368 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T03:30:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T03:30:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T03:30:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T03:30:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T03:30:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T03:30:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T03:30:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T03:30:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T03:30:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T03:30:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T03:30:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T03:30:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T03:30:42.369 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T03:30:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T03:30:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T03:30:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T03:30:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T03:30:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T03:30:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T03:30:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T03:30:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T03:30:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T03:30:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T03:30:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T03:30:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T03:30:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T03:30:42.370 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T03:30:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T03:30:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T03:30:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T03:30:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T03:30:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T03:30:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T03:30:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T03:30:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T03:30:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T03:30:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T03:30:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T03:30:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T03:30:42.371 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T03:30:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T03:30:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T03:30:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T03:30:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T03:30:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T03:30:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T03:30:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T03:30:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T03:30:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T03:30:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T03:30:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T03:30:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T03:30:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T03:30:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T03:30:42.372 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T03:30:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T03:30:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T03:30:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T03:30:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T03:30:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T03:30:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T03:30:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T03:30:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T03:30:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T03:30:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T03:30:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T03:30:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T03:30:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T03:30:42.373 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T03:30:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T03:30:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T03:30:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T03:30:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T03:30:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T03:30:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T03:30:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T03:30:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T03:30:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T03:30:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T03:30:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T03:30:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T03:30:42.374 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T03:30:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T03:30:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T03:30:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T03:30:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T03:30:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T03:30:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T03:30:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T03:30:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T03:30:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T03:30:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T03:30:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T03:30:42.375 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T03:30:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T03:30:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T03:30:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T03:30:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T03:30:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T03:30:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T03:30:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T03:30:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T03:30:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T03:30:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T03:30:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T03:30:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T03:30:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T03:30:42.376 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T03:30:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T03:30:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T03:30:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T03:30:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T03:30:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T03:30:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T03:30:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T03:30:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T03:30:42.377 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T03:30:44.927 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:30:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T03:30:44.928 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-09-21T03:30:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T03:30:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T03:30:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T03:30:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T03:30:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T03:30:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T03:30:44.928 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-09-21T03:30:44.928 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T03:30:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T03:30:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T03:30:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T03:30:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:44.929 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:30:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T03:30:44.930 INFO:teuthology.orchestra.run.smithi172.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T03:30:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T03:30:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T03:30:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T03:30:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T03:30:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T03:30:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T03:30:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T03:30:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T03:30:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T03:30:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T03:30:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T03:30:44.931 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T03:30:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T03:30:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T03:30:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T03:30:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T03:30:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T03:30:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T03:30:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T03:30:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T03:30:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T03:30:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T03:30:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T03:30:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T03:30:44.932 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T03:30:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T03:30:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T03:30:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T03:30:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T03:30:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T03:30:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T03:30:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T03:30:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T03:30:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T03:30:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T03:30:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T03:30:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T03:30:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T03:30:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T03:30:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.933 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T03:30:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T03:30:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T03:30:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T03:30:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T03:30:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T03:30:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T03:30:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T03:30:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T03:30:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T03:30:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T03:30:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T03:30:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T03:30:44.934 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T03:30:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T03:30:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T03:30:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T03:30:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T03:30:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T03:30:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T03:30:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T03:30:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T03:30:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T03:30:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T03:30:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T03:30:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T03:30:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T03:30:44.935 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T03:30:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T03:30:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T03:30:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T03:30:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T03:30:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T03:30:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T03:30:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T03:30:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T03:30:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T03:30:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T03:30:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T03:30:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T03:30:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.936 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T03:30:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T03:30:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T03:30:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T03:30:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T03:30:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T03:30:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T03:30:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T03:30:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T03:30:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T03:30:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T03:30:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T03:30:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T03:30:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T03:30:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T03:30:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T03:30:44.937 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T03:30:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T03:30:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:30:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T03:30:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T03:30:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T03:30:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T03:30:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T03:30:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T03:30:44.938 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T03:30:44.939 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T03:30:44.939 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-09-21T03:30:45.357 DEBUG:teuthology.parallel:result is None 2024-09-21T03:30:45.358 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:30:45.501 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T03:30:45.528 INFO:teuthology.orchestra.run.smithi084.stdout:19.3.0-5120.g18432218.el9 2024-09-21T03:30:45.528 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T03:30:45.529 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T03:30:45.530 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:30:45.665 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T03:30:45.687 INFO:teuthology.orchestra.run.smithi172.stdout:19.3.0-5120.g18432218.el9 2024-09-21T03:30:45.688 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T03:30:45.688 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T03:30:45.689 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:30:45.826 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T03:30:45.853 INFO:teuthology.orchestra.run.smithi174.stdout:19.3.0-5120.g18432218.el9 2024-09-21T03:30:45.853 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T03:30:45.853 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T03:30:45.855 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T03:30:45.855 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T03:30:45.855 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T03:30:45.887 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T03:30:45.887 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T03:30:45.914 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T03:30:45.914 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T03:30:45.946 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T03:30:45.946 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T03:30:45.947 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T03:30:45.974 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T03:30:46.042 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T03:30:46.042 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T03:30:46.068 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T03:30:46.133 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T03:30:46.133 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T03:30:46.163 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T03:30:46.232 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T03:30:46.232 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T03:30:46.232 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T03:30:46.262 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T03:30:46.331 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T03:30:46.331 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T03:30:46.356 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T03:30:46.421 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T03:30:46.421 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T03:30:46.447 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T03:30:46.512 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T03:30:46.513 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T03:30:46.513 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T03:30:46.537 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T03:30:46.602 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T03:30:46.602 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T03:30:46.627 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T03:30:46.691 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T03:30:46.691 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T03:30:46.716 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T03:30:46.782 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T03:30:46.863 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug', 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-21T03:30:46.863 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:30:46.863 INFO:tasks.cephadm:Cluster fsid is e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:30:46.863 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T03:30:46.864 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.84', 'mon.b': '172.21.15.172', 'mon.c': '172.21.15.174'} 2024-09-21T03:30:46.864 INFO:tasks.cephadm:First mon is mon.a on smithi084 2024-09-21T03:30:46.864 INFO:tasks.cephadm:First mgr is x 2024-09-21T03:30:46.864 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T03:30:46.864 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname $(hostname -s) 2024-09-21T03:30:46.890 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname $(hostname -s) 2024-09-21T03:30:46.915 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname $(hostname -s) 2024-09-21T03:30:46.942 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T03:30:46.942 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:30:47.093 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T03:30:47.247 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:30:47.248 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T03:30:47.248 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T03:30:47.248 DEBUG:teuthology.orchestra.run.smithi084:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T03:30:47.810 INFO:teuthology.orchestra.run.smithi084.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 03:30 /home/ubuntu/cephtest/cephadm 2024-09-21T03:30:47.810 DEBUG:teuthology.orchestra.run.smithi172:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T03:30:48.376 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 03:30 /home/ubuntu/cephtest/cephadm 2024-09-21T03:30:48.377 DEBUG:teuthology.orchestra.run.smithi174:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T03:30:48.980 INFO:teuthology.orchestra.run.smithi174.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 03:30 /home/ubuntu/cephtest/cephadm 2024-09-21T03:30:48.981 DEBUG:teuthology.orchestra.run.smithi084:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T03:30:49.001 DEBUG:teuthology.orchestra.run.smithi172:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T03:30:49.020 DEBUG:teuthology.orchestra.run.smithi174:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T03:30:49.054 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T03:30:49.054 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T03:30:49.056 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T03:30:49.063 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T03:30:50.551 INFO:teuthology.orchestra.run.smithi174.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T03:30:50.568 INFO:teuthology.orchestra.run.smithi084.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T03:30:50.677 INFO:teuthology.orchestra.run.smithi172.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T03:31:26.986 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-09-21T03:31:26.986 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T03:31:26.986 INFO:teuthology.orchestra.run.smithi174.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T03:31:26.986 INFO:teuthology.orchestra.run.smithi174.stdout: "repo_digests": [ 2024-09-21T03:31:26.986 INFO:teuthology.orchestra.run.smithi174.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T03:31:26.987 INFO:teuthology.orchestra.run.smithi174.stdout: ] 2024-09-21T03:31:26.987 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-09-21T03:31:44.495 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:31:44.495 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T03:31:44.495 INFO:teuthology.orchestra.run.smithi084.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T03:31:44.495 INFO:teuthology.orchestra.run.smithi084.stdout: "repo_digests": [ 2024-09-21T03:31:44.495 INFO:teuthology.orchestra.run.smithi084.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T03:31:44.495 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T03:31:44.495 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:31:46.597 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-21T03:31:46.597 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T03:31:46.597 INFO:teuthology.orchestra.run.smithi172.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T03:31:46.597 INFO:teuthology.orchestra.run.smithi172.stdout: "repo_digests": [ 2024-09-21T03:31:46.597 INFO:teuthology.orchestra.run.smithi172.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T03:31:46.597 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-09-21T03:31:46.597 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-21T03:31:46.624 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph 2024-09-21T03:31:46.657 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph 2024-09-21T03:31:46.684 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph 2024-09-21T03:31:46.716 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /etc/ceph 2024-09-21T03:31:46.744 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /etc/ceph 2024-09-21T03:31:46.768 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 777 /etc/ceph 2024-09-21T03:31:46.796 INFO:tasks.cephadm:Writing seed config... 2024-09-21T03:31:46.797 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-21T03:31:46.798 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-21T03:31:46.798 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-21T03:31:46.798 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T03:31:46.798 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T03:31:46.798 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T03:31:46.798 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T03:31:46.798 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T03:31:46.798 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T03:31:46.798 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T03:31:46.798 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T03:31:46.798 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-21T03:31:46.798 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T03:31:46.798 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-21T03:31:46.799 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-21T03:31:46.799 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T03:31:46.799 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T03:31:46.799 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-21T03:31:46.799 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T03:31:46.799 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T03:31:46.799 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T03:31:46.799 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T03:31:46.799 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T03:31:46.799 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T03:31:46.799 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-21T03:31:46.800 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T03:31:46.800 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T03:31:46.817 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = e3f8c18e-77c9-11ef-baf5-efdc52797490 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 2024-09-21T03:31:46.817 DEBUG:teuthology.orchestra.run.smithi084:mon.a> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T03:31:46.860 DEBUG:teuthology.orchestra.run.smithi084:mgr.x> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T03:31:46.902 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T03:31:46.903 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.84 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:31:47.107 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:31:47.107 INFO:teuthology.orchestra.run.smithi084.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.84', '--skip-admin-label'] 2024-09-21T03:31:47.107 INFO:teuthology.orchestra.run.smithi084.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T03:31:47.107 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying podman|docker is present... 2024-09-21T03:31:47.145 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout 5.2.2 2024-09-21T03:31:47.145 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying lvm2 is present... 2024-09-21T03:31:47.146 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying time synchronization is in place... 2024-09-21T03:31:47.153 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T03:31:47.153 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T03:31:47.159 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T03:31:47.160 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-09-21T03:31:47.166 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout enabled 2024-09-21T03:31:47.173 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout active 2024-09-21T03:31:47.173 INFO:teuthology.orchestra.run.smithi084.stdout:Unit chronyd.service is enabled and running 2024-09-21T03:31:47.173 INFO:teuthology.orchestra.run.smithi084.stdout:Repeating the final host check... 2024-09-21T03:31:47.194 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout 5.2.2 2024-09-21T03:31:47.195 INFO:teuthology.orchestra.run.smithi084.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T03:31:47.195 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl is present 2024-09-21T03:31:47.195 INFO:teuthology.orchestra.run.smithi084.stdout:lvcreate is present 2024-09-21T03:31:47.201 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T03:31:47.201 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T03:31:47.207 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T03:31:47.207 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-09-21T03:31:47.214 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout enabled 2024-09-21T03:31:47.220 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout active 2024-09-21T03:31:47.220 INFO:teuthology.orchestra.run.smithi084.stdout:Unit chronyd.service is enabled and running 2024-09-21T03:31:47.220 INFO:teuthology.orchestra.run.smithi084.stdout:Host looks OK 2024-09-21T03:31:47.220 INFO:teuthology.orchestra.run.smithi084.stdout:Cluster fsid: e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:31:47.220 INFO:teuthology.orchestra.run.smithi084.stdout:Acquiring lock 140702490447488 on /run/cephadm/e3f8c18e-77c9-11ef-baf5-efdc52797490.lock 2024-09-21T03:31:47.221 INFO:teuthology.orchestra.run.smithi084.stdout:Lock 140702490447488 acquired on /run/cephadm/e3f8c18e-77c9-11ef-baf5-efdc52797490.lock 2024-09-21T03:31:47.221 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying IP 172.21.15.84 port 3300 ... 2024-09-21T03:31:47.222 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying IP 172.21.15.84 port 6789 ... 2024-09-21T03:31:47.222 INFO:teuthology.orchestra.run.smithi084.stdout:Base mon IP(s) is [172.21.15.84:3300, 172.21.15.84:6789], mon addrv is [v2:172.21.15.84:3300,v1:172.21.15.84:6789] 2024-09-21T03:31:47.225 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.84 metric 100 2024-09-21T03:31:47.225 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.84 metric 100 2024-09-21T03:31:47.227 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T03:31:47.227 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-21T03:31:47.228 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-21T03:31:47.230 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T03:31:47.230 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T03:31:47.230 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T03:31:47.230 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-21T03:31:47.230 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d751/64 scope link noprefixroute 2024-09-21T03:31:47.230 INFO:teuthology.orchestra.run.smithi084.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T03:31:47.231 INFO:teuthology.orchestra.run.smithi084.stdout:Mon IP `172.21.15.84` is in CIDR network `172.21.0.0/20` 2024-09-21T03:31:47.231 INFO:teuthology.orchestra.run.smithi084.stdout:Mon IP `172.21.15.84` is in CIDR network `172.21.0.0/20` 2024-09-21T03:31:47.231 INFO:teuthology.orchestra.run.smithi084.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T03:31:47.231 INFO:teuthology.orchestra.run.smithi084.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T03:31:47.232 INFO:teuthology.orchestra.run.smithi084.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T03:31:47.688 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T03:31:47.688 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T03:31:47.688 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T03:31:47.688 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T03:31:47.688 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T03:31:47.688 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T03:31:47.688 INFO:teuthology.orchestra.run.smithi084.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T03:31:48.576 INFO:teuthology.orchestra.run.smithi084.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T03:31:48.577 INFO:teuthology.orchestra.run.smithi084.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T03:31:48.577 INFO:teuthology.orchestra.run.smithi084.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T03:31:49.500 INFO:teuthology.orchestra.run.smithi084.stdout:stat: stdout 167 167 2024-09-21T03:31:49.500 INFO:teuthology.orchestra.run.smithi084.stdout:Creating initial keys... 2024-09-21T03:31:50.431 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph-authtool: stdout AQAlPu5mIjZzMRAAmOW46FbxxnKqJUsGsbiZBQ== 2024-09-21T03:31:51.261 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph-authtool: stdout AQAmPu5mpFOoKhAAzvJVkuZr1Ot6mfDFs0wEGw== 2024-09-21T03:31:51.992 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph-authtool: stdout AQAnPu5mCnOjIhAAgrouwaqpa/AuXa8DZ4pB+Q== 2024-09-21T03:31:51.993 INFO:teuthology.orchestra.run.smithi084.stdout:Creating initial monmap... 2024-09-21T03:31:52.898 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T03:31:52.898 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T03:31:52.898 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:31:52.898 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T03:31:52.898 INFO:teuthology.orchestra.run.smithi084.stdout:monmaptool for a [v2:172.21.15.84:3300,v1:172.21.15.84:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T03:31:52.898 INFO:teuthology.orchestra.run.smithi084.stdout:setting min_mon_release = quincy 2024-09-21T03:31:52.898 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: set fsid to e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:31:52.899 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T03:31:52.899 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:31:52.899 INFO:teuthology.orchestra.run.smithi084.stdout:Creating mon... 2024-09-21T03:31:53.828 INFO:teuthology.orchestra.run.smithi084.stdout:create mon.a on 2024-09-21T03:31:54.024 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T03:31:54.177 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T03:31:54.356 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490.target. 2024-09-21T03:31:54.356 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490.target. 2024-09-21T03:31:54.626 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mon.a 2024-09-21T03:31:54.626 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to reset failed state of unit ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T03:31:54.803 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490.target.wants/ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@.service. 2024-09-21T03:31:55.339 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T03:31:55.339 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-09-21T03:31:55.347 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T03:31:55.347 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-09-21T03:31:55.347 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-09-21T03:31:55.348 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T03:31:55.348 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mon to start... 2024-09-21T03:31:55.348 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mon... 2024-09-21T03:31:55.415 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:55 smithi084 systemd[1]: Started Ceph mon.a for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:31:56.417 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T03:31:56.417 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout id: e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:31:56.417 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T03:31:56.417 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T03:31:56.417 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout services: 2024-09-21T03:31:56.417 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.56538s) 2024-09-21T03:31:56.418 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T03:31:56.418 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T03:31:56.418 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T03:31:56.418 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout data: 2024-09-21T03:31:56.418 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T03:31:56.418 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T03:31:56.418 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T03:31:56.418 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T03:31:56.418 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T03:31:56.418 INFO:teuthology.orchestra.run.smithi084.stdout:mon is available 2024-09-21T03:31:56.418 INFO:teuthology.orchestra.run.smithi084.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T03:31:56.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:56 smithi084 ceph-mon[30574]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T03:31:56.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:56 smithi084 ceph-mon[30574]: monmap epoch 1 2024-09-21T03:31:56.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:56 smithi084 ceph-mon[30574]: fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:31:56.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:56 smithi084 ceph-mon[30574]: last_changed 2024-09-21T03:31:52.325800+0000 2024-09-21T03:31:56.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:56 smithi084 ceph-mon[30574]: created 2024-09-21T03:31:52.325800+0000 2024-09-21T03:31:56.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:56 smithi084 ceph-mon[30574]: min_mon_release 19 (squid) 2024-09-21T03:31:56.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:56 smithi084 ceph-mon[30574]: election_strategy: 1 2024-09-21T03:31:56.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:56 smithi084 ceph-mon[30574]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T03:31:56.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:56 smithi084 ceph-mon[30574]: fsmap 2024-09-21T03:31:56.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:56 smithi084 ceph-mon[30574]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T03:31:56.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:56 smithi084 ceph-mon[30574]: mgrmap e1: no daemons active 2024-09-21T03:31:56.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:56 smithi084 ceph-mon[30574]: from='client.? 172.21.15.84:0/326364306' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T03:31:57.495 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:57 smithi084 ceph-mon[30574]: from='client.? 172.21.15.84:0/842818571' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T03:31:57.495 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:57 smithi084 ceph-mon[30574]: from='client.? 172.21.15.84:0/842818571' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T03:31:57.498 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T03:31:57.498 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T03:31:57.499 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout fsid = e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:31:57.499 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T03:31:57.499 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.84:3300,v1:172.21.15.84:6789] 2024-09-21T03:31:57.499 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T03:31:57.499 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T03:31:57.499 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T03:31:57.499 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T03:31:57.499 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T03:31:57.499 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T03:31:57.499 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T03:31:57.499 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T03:31:57.499 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T03:31:57.499 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T03:31:57.499 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T03:31:57.499 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T03:31:57.500 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T03:31:57.500 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T03:31:57.500 INFO:teuthology.orchestra.run.smithi084.stdout:Generating new minimal ceph.conf... 2024-09-21T03:31:58.496 INFO:teuthology.orchestra.run.smithi084.stdout:Restarting the monitor... 2024-09-21T03:31:58.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:58 smithi084 ceph-mon[30574]: from='client.? 172.21.15.84:0/1961099282' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:58.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:58 smithi084 systemd[1]: Stopping Ceph mon.a for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:31:58.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:58 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-a[30570]: 2024-09-21T03:31:58.737+0000 7f870dac1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:31:58.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:58 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-a[30570]: 2024-09-21T03:31:58.737+0000 7f870dac1640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T03:31:59.105 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:58 smithi084 podman[30816]: 2024-09-21 03:31:58.829800315 +0000 UTC m=+0.176492182 container died 64722774aa5ef2f8b8e122cc00544393d7b728ab9917e16c11ac455146a5f295 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T03:31:59.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:59 smithi084 podman[30816]: 2024-09-21 03:31:59.203791145 +0000 UTC m=+0.550483055 container cleanup 64722774aa5ef2f8b8e122cc00544393d7b728ab9917e16c11ac455146a5f295 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:31:59.447 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:59 smithi084 bash[30816]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-a 2024-09-21T03:31:59.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:59 smithi084 podman[30828]: 2024-09-21 03:31:59.446071987 +0000 UTC m=+0.616613273 container remove 64722774aa5ef2f8b8e122cc00544393d7b728ab9917e16c11ac455146a5f295 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-a, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:31:59.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:59 smithi084 systemd[1]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T03:31:59.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:59 smithi084 systemd[1]: Stopped Ceph mon.a for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:31:59.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:59 smithi084 systemd[1]: Starting Ceph mon.a for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:32:00.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:59 smithi084 podman[30922]: 2024-09-21 03:31:59.763814586 +0000 UTC m=+0.108654335 container create 6bb4acbb08a56817c2614637ddcc1c6af8930fe20b1b5ba6feb29db5face4a25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-a, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:32:00.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:59 smithi084 podman[30922]: 2024-09-21 03:31:59.670622245 +0000 UTC m=+0.015461955 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:32:00.015 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:59 smithi084 podman[30922]: 2024-09-21 03:31:59.974286776 +0000 UTC m=+0.319126484 container init 6bb4acbb08a56817c2614637ddcc1c6af8930fe20b1b5ba6feb29db5face4a25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T03:32:00.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:31:59 smithi084 podman[30922]: 2024-09-21 03:31:59.977379513 +0000 UTC m=+0.322219219 container start 6bb4acbb08a56817c2614637ddcc1c6af8930fe20b1b5ba6feb29db5face4a25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T03:32:00.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T03:32:00.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T03:32:00.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: pidfile_write: ignore empty --pid-file 2024-09-21T03:32:00.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: load: jerasure load: lrc 2024-09-21T03:32:00.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: RocksDB version: 7.9.2 2024-09-21T03:32:00.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Git sha 0 2024-09-21T03:32:00.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T03:32:00.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: DB SUMMARY 2024-09-21T03:32:00.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: DB Session ID: 6C12CTIXJRQZ6CFJJH3E 2024-09-21T03:32:00.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: CURRENT file: CURRENT 2024-09-21T03:32:00.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T03:32:00.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T03:32:00.016 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T03:32:00.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95388 ; 2024-09-21T03:32:00.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.error_if_exists: 0 2024-09-21T03:32:00.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.create_if_missing: 0 2024-09-21T03:32:00.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.paranoid_checks: 1 2024-09-21T03:32:00.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T03:32:00.017 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T03:32:00.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T03:32:00.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.env: 0x5623d27e0d60 2024-09-21T03:32:00.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T03:32:00.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.info_log: 0x5623d7d11360 2024-09-21T03:32:00.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T03:32:00.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.statistics: (nil) 2024-09-21T03:32:00.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.use_fsync: 0 2024-09-21T03:32:00.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_log_file_size: 0 2024-09-21T03:32:00.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T03:32:00.018 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T03:32:00.019 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T03:32:00.019 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T03:32:00.019 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.allow_fallocate: 1 2024-09-21T03:32:00.019 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T03:32:00.019 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T03:32:00.019 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.use_direct_reads: 0 2024-09-21T03:32:00.019 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T03:32:00.019 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T03:32:00.019 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.db_log_dir: 2024-09-21T03:32:00.019 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.wal_dir: 2024-09-21T03:32:00.019 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T03:32:00.019 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T03:32:00.019 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T03:32:00.020 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T03:32:00.020 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T03:32:00.020 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T03:32:00.020 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T03:32:00.020 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T03:32:00.020 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.write_buffer_manager: 0x5623d7d15d60 2024-09-21T03:32:00.020 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T03:32:00.020 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T03:32:00.020 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T03:32:00.020 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T03:32:00.020 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T03:32:00.020 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T03:32:00.020 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T03:32:00.020 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T03:32:00.020 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.unordered_write: 0 2024-09-21T03:32:00.021 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T03:32:00.021 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T03:32:00.021 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T03:32:00.021 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T03:32:00.021 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.row_cache: None 2024-09-21T03:32:00.021 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.wal_filter: None 2024-09-21T03:32:00.021 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T03:32:00.021 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T03:32:00.021 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.two_write_queues: 0 2024-09-21T03:32:00.021 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T03:32:00.021 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.wal_compression: 0 2024-09-21T03:32:00.021 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.atomic_flush: 0 2024-09-21T03:32:00.021 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T03:32:00.021 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T03:32:00.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T03:32:00.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.log_readahead_size: 0 2024-09-21T03:32:00.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T03:32:00.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T03:32:00.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T03:32:00.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T03:32:00.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T03:32:00.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T03:32:00.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T03:32:00.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_background_jobs: 2 2024-09-21T03:32:00.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_background_compactions: -1 2024-09-21T03:32:00.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_subcompactions: 1 2024-09-21T03:32:00.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T03:32:00.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T03:32:00.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T03:32:00.022 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T03:32:00.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T03:32:00.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T03:32:00.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T03:32:00.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T03:32:00.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_open_files: -1 2024-09-21T03:32:00.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T03:32:00.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T03:32:00.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T03:32:00.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T03:32:00.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_background_flushes: -1 2024-09-21T03:32:00.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Compression algorithms supported: 2024-09-21T03:32:00.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: kZSTD supported: 0 2024-09-21T03:32:00.023 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: kXpressCompression supported: 0 2024-09-21T03:32:00.024 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: kBZip2Compression supported: 0 2024-09-21T03:32:00.024 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T03:32:00.024 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: kLZ4Compression supported: 1 2024-09-21T03:32:00.024 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: kZlibCompression supported: 1 2024-09-21T03:32:00.024 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T03:32:00.024 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: kSnappyCompression supported: 1 2024-09-21T03:32:00.024 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T03:32:00.024 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T03:32:00.024 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T03:32:00.024 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T03:32:00.024 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T03:32:00.024 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.merge_operator: 2024-09-21T03:32:00.024 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compaction_filter: None 2024-09-21T03:32:00.024 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T03:32:00.025 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T03:32:00.025 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T03:32:00.025 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T03:32:00.025 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5623d7d10fa0) 2024-09-21T03:32:00.025 INFO:journalctl@ceph.mon.a.smithi084.stdout: cache_index_and_filter_blocks: 1 2024-09-21T03:32:00.025 INFO:journalctl@ceph.mon.a.smithi084.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T03:32:00.025 INFO:journalctl@ceph.mon.a.smithi084.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T03:32:00.025 INFO:journalctl@ceph.mon.a.smithi084.stdout: pin_top_level_index_and_filter: 1 2024-09-21T03:32:00.025 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_type: 0 2024-09-21T03:32:00.025 INFO:journalctl@ceph.mon.a.smithi084.stdout: data_block_index_type: 0 2024-09-21T03:32:00.025 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_shortening: 1 2024-09-21T03:32:00.025 INFO:journalctl@ceph.mon.a.smithi084.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T03:32:00.025 INFO:journalctl@ceph.mon.a.smithi084.stdout: checksum: 4 2024-09-21T03:32:00.025 INFO:journalctl@ceph.mon.a.smithi084.stdout: no_block_cache: 0 2024-09-21T03:32:00.025 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache: 0x5623d3cd5610 2024-09-21T03:32:00.026 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_name: BinnedLRUCache 2024-09-21T03:32:00.026 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_options: 2024-09-21T03:32:00.026 INFO:journalctl@ceph.mon.a.smithi084.stdout: capacity : 536870912 2024-09-21T03:32:00.026 INFO:journalctl@ceph.mon.a.smithi084.stdout: num_shard_bits : 4 2024-09-21T03:32:00.026 INFO:journalctl@ceph.mon.a.smithi084.stdout: strict_capacity_limit : 0 2024-09-21T03:32:00.026 INFO:journalctl@ceph.mon.a.smithi084.stdout: high_pri_pool_ratio: 0.000 2024-09-21T03:32:00.026 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_cache_compressed: (nil) 2024-09-21T03:32:00.026 INFO:journalctl@ceph.mon.a.smithi084.stdout: persistent_cache: (nil) 2024-09-21T03:32:00.026 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_size: 4096 2024-09-21T03:32:00.026 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_size_deviation: 10 2024-09-21T03:32:00.027 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_restart_interval: 16 2024-09-21T03:32:00.027 INFO:journalctl@ceph.mon.a.smithi084.stdout: index_block_restart_interval: 1 2024-09-21T03:32:00.027 INFO:journalctl@ceph.mon.a.smithi084.stdout: metadata_block_size: 4096 2024-09-21T03:32:00.027 INFO:journalctl@ceph.mon.a.smithi084.stdout: partition_filters: 0 2024-09-21T03:32:00.027 INFO:journalctl@ceph.mon.a.smithi084.stdout: use_delta_encoding: 1 2024-09-21T03:32:00.027 INFO:journalctl@ceph.mon.a.smithi084.stdout: filter_policy: bloomfilter 2024-09-21T03:32:00.027 INFO:journalctl@ceph.mon.a.smithi084.stdout: whole_key_filtering: 1 2024-09-21T03:32:00.027 INFO:journalctl@ceph.mon.a.smithi084.stdout: verify_compression: 0 2024-09-21T03:32:00.027 INFO:journalctl@ceph.mon.a.smithi084.stdout: read_amp_bytes_per_bit: 0 2024-09-21T03:32:00.027 INFO:journalctl@ceph.mon.a.smithi084.stdout: format_version: 5 2024-09-21T03:32:00.028 INFO:journalctl@ceph.mon.a.smithi084.stdout: enable_index_compression: 1 2024-09-21T03:32:00.028 INFO:journalctl@ceph.mon.a.smithi084.stdout: block_align: 0 2024-09-21T03:32:00.028 INFO:journalctl@ceph.mon.a.smithi084.stdout: max_auto_readahead_size: 262144 2024-09-21T03:32:00.028 INFO:journalctl@ceph.mon.a.smithi084.stdout: prepopulate_block_cache: 0 2024-09-21T03:32:00.028 INFO:journalctl@ceph.mon.a.smithi084.stdout: initial_auto_readahead_size: 8192 2024-09-21T03:32:00.028 INFO:journalctl@ceph.mon.a.smithi084.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T03:32:00.028 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T03:32:00.028 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T03:32:00.028 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compression: NoCompression 2024-09-21T03:32:00.028 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T03:32:00.028 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T03:32:00.028 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T03:32:00.028 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.num_levels: 7 2024-09-21T03:32:00.028 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T03:32:00.028 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T03:32:00.028 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T03:32:00.029 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T03:32:00.029 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T03:32:00.029 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T03:32:00.029 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T03:32:00.029 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T03:32:00.029 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T03:32:00.029 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T03:32:00.029 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T03:32:00.029 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T03:32:00.029 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T03:32:00.029 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T03:32:00.029 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T03:32:00.029 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T03:32:00.029 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T03:32:00.029 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T03:32:00.029 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T03:32:00.030 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T03:32:00.030 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T03:32:00.030 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T03:32:00.030 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T03:32:00.030 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T03:32:00.030 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T03:32:00.030 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T03:32:00.030 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T03:32:00.030 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T03:32:00.030 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T03:32:00.031 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T03:32:00.031 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T03:32:00.031 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T03:32:00.031 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T03:32:00.031 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T03:32:00.031 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T03:32:00.031 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T03:32:00.031 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T03:32:00.031 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T03:32:00.031 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T03:32:00.031 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T03:32:00.031 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T03:32:00.031 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T03:32:00.031 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T03:32:00.031 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T03:32:00.031 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T03:32:00.032 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T03:32:00.032 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T03:32:00.032 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T03:32:00.032 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T03:32:00.032 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T03:32:00.032 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T03:32:00.032 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T03:32:00.032 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T03:32:00.032 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T03:32:00.032 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.inplace_update_support: 0 2024-09-21T03:32:00.032 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T03:32:00.032 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T03:32:00.032 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T03:32:00.032 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T03:32:00.032 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.bloom_locality: 0 2024-09-21T03:32:00.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.max_successive_merges: 0 2024-09-21T03:32:00.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T03:32:00.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T03:32:00.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T03:32:00.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T03:32:00.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.ttl: 2592000 2024-09-21T03:32:00.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T03:32:00.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T03:32:00.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T03:32:00.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.enable_blob_files: false 2024-09-21T03:32:00.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.min_blob_size: 0 2024-09-21T03:32:00.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T03:32:00.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T03:32:00.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T03:32:00.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T03:32:00.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T03:32:00.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T03:32:00.034 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T03:32:00.034 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T03:32:00.034 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T03:32:00.034 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T03:32:00.034 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ef3f254f-294e-4651-8988-162ab84085a1 2024-09-21T03:32:00.034 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726889520013360, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T03:32:00.034 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T03:32:00.034 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726889520014537, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91575, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 285, "table_properties": {"data_size": 89616, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11738, "raw_average_key_size": 48, "raw_value_size": 82957, "raw_average_value_size": 339, "num_data_blocks": 12, "num_entries": 244, "num_filter_entries": 244, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726889520, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ef3f254f-294e-4651-8988-162ab84085a1", "db_session_id": "6C12CTIXJRQZ6CFJJH3E", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T03:32:00.034 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726889520014671, "job": 1, "event": "recovery_finished"} 2024-09-21T03:32:00.034 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T03:32:00.034 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T03:32:00.034 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5623d7d34a80 2024-09-21T03:32:00.034 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: DB pointer 0x5623d8ada000 2024-09-21T03:32:00.035 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T03:32:00.035 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T03:32:00.035 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** DB Stats ** 2024-09-21T03:32:00.035 INFO:journalctl@ceph.mon.a.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T03:32:00.035 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T03:32:00.035 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T03:32:00.035 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T03:32:00.035 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T03:32:00.035 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T03:32:00.035 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T03:32:00.035 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-09-21T03:32:00.035 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** Compaction Stats [default] ** 2024-09-21T03:32:00.035 INFO:journalctl@ceph.mon.a.smithi084.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T03:32:00.035 INFO:journalctl@ceph.mon.a.smithi084.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T03:32:00.035 INFO:journalctl@ceph.mon.a.smithi084.stdout: L0 2/0 91.29 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 112.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T03:32:00.035 INFO:journalctl@ceph.mon.a.smithi084.stdout: Sum 2/0 91.29 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 112.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T03:32:00.036 INFO:journalctl@ceph.mon.a.smithi084.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 112.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T03:32:00.036 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-09-21T03:32:00.036 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** Compaction Stats [default] ** 2024-09-21T03:32:00.036 INFO:journalctl@ceph.mon.a.smithi084.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T03:32:00.036 INFO:journalctl@ceph.mon.a.smithi084.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T03:32:00.036 INFO:journalctl@ceph.mon.a.smithi084.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 112.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T03:32:00.036 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-09-21T03:32:00.036 INFO:journalctl@ceph.mon.a.smithi084.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T03:32:00.036 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-09-21T03:32:00.036 INFO:journalctl@ceph.mon.a.smithi084.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T03:32:00.036 INFO:journalctl@ceph.mon.a.smithi084.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T03:32:00.036 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T03:32:00.036 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T03:32:00.036 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T03:32:00.036 INFO:journalctl@ceph.mon.a.smithi084.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T03:32:00.036 INFO:journalctl@ceph.mon.a.smithi084.stdout: Cumulative compaction: 0.00 GB write, 21.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T03:32:00.037 INFO:journalctl@ceph.mon.a.smithi084.stdout: Interval compaction: 0.00 GB write, 21.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T03:32:00.037 INFO:journalctl@ceph.mon.a.smithi084.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T03:32:00.037 INFO:journalctl@ceph.mon.a.smithi084.stdout: Block cache BinnedLRUCache@0x5623d3cd5610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T03:32:00.037 INFO:journalctl@ceph.mon.a.smithi084.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T03:32:00.037 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-09-21T03:32:00.037 INFO:journalctl@ceph.mon.a.smithi084.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T03:32:00.037 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: starting mon.a rank 0 at public addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] at bind addrs [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:32:00.056 INFO:teuthology.orchestra.run.smithi084.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T03:32:00.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: mon.a@-1(???) e1 preinit fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:32:00.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: mon.a@-1(???).mds e1 new map 2024-09-21T03:32:00.307 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: mon.a@-1(???).mds e1 print_map 2024-09-21T03:32:00.307 INFO:journalctl@ceph.mon.a.smithi084.stdout: e1 2024-09-21T03:32:00.307 INFO:journalctl@ceph.mon.a.smithi084.stdout: btime 2024-09-21T03:31:55:306808+0000 2024-09-21T03:32:00.307 INFO:journalctl@ceph.mon.a.smithi084.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T03:32:00.307 INFO:journalctl@ceph.mon.a.smithi084.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T03:32:00.307 INFO:journalctl@ceph.mon.a.smithi084.stdout: legacy client fscid: -1 2024-09-21T03:32:00.308 INFO:journalctl@ceph.mon.a.smithi084.stdout: 2024-09-21T03:32:00.308 INFO:journalctl@ceph.mon.a.smithi084.stdout: No filesystems configured 2024-09-21T03:32:00.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T03:32:00.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:32:00.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:32:00.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:32:00.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T03:32:00.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 bash[30922]: 6bb4acbb08a56817c2614637ddcc1c6af8930fe20b1b5ba6feb29db5face4a25 2024-09-21T03:32:00.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 systemd[1]: Started Ceph mon.a for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:32:00.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T03:32:00.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: monmap epoch 1 2024-09-21T03:32:00.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:32:00.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: last_changed 2024-09-21T03:31:52.325800+0000 2024-09-21T03:32:00.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: created 2024-09-21T03:31:52.325800+0000 2024-09-21T03:32:00.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: min_mon_release 19 (squid) 2024-09-21T03:32:00.308 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: election_strategy: 1 2024-09-21T03:32:00.309 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T03:32:00.309 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: fsmap 2024-09-21T03:32:00.309 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T03:32:00.309 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:00 smithi084 ceph-mon[30941]: mgrmap e1: no daemons active 2024-09-21T03:32:01.102 INFO:teuthology.orchestra.run.smithi084.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T03:32:01.123 INFO:teuthology.orchestra.run.smithi084.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:32:01.123 INFO:teuthology.orchestra.run.smithi084.stdout:Creating mgr... 2024-09-21T03:32:01.124 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T03:32:01.124 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T03:32:01.376 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mgr.x 2024-09-21T03:32:01.376 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Failed to reset failed state of unit ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T03:32:01.525 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490.target.wants/ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@.service. 2024-09-21T03:32:01.751 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:01 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/4023476052' entity='client.admin' 2024-09-21T03:32:01.751 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:01 smithi084 systemd[1]: Starting Ceph mgr.x for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:32:02.028 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:01 smithi084 podman[31151]: 2024-09-21 03:32:01.651726072 +0000 UTC m=+0.015648044 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:32:02.028 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:01 smithi084 podman[31151]: 2024-09-21 03:32:01.749788259 +0000 UTC m=+0.113710217 container create 705c1c35a60d5a39ac1f7b97192922c4fc74b11e6a76bb2a6f010ae95fe54443 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:32:02.028 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:01 smithi084 podman[31151]: 2024-09-21 03:32:01.952091952 +0000 UTC m=+0.316013915 container init 705c1c35a60d5a39ac1f7b97192922c4fc74b11e6a76bb2a6f010ae95fe54443 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T03:32:02.028 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:01 smithi084 podman[31151]: 2024-09-21 03:32:01.954629669 +0000 UTC m=+0.318551628 container start 705c1c35a60d5a39ac1f7b97192922c4fc74b11e6a76bb2a6f010ae95fe54443 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T03:32:02.029 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:02 smithi084 bash[31151]: 705c1c35a60d5a39ac1f7b97192922c4fc74b11e6a76bb2a6f010ae95fe54443 2024-09-21T03:32:02.042 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T03:32:02.042 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-09-21T03:32:02.049 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T03:32:02.049 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-09-21T03:32:02.049 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-09-21T03:32:02.049 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T03:32:02.058 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T03:32:02.058 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-09-21T03:32:02.065 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T03:32:02.065 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-09-21T03:32:02.065 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-09-21T03:32:02.065 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T03:32:02.065 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr to start... 2024-09-21T03:32:02.065 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr... 2024-09-21T03:32:02.318 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:02 smithi084 systemd[1]: Started Ceph mgr.x for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:32:02.784 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:02 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2622751209' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T03:32:03.078 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T03:32:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:32:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "e3f8c18e-77c9-11ef-baf5-efdc52797490", 2024-09-21T03:32:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T03:32:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T03:32:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T03:32:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T03:32:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T03:32:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T03:32:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-09-21T03:32:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:32:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T03:32:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T03:32:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:32:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T03:32:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T03:32:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:32:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T03:32:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T03:32:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T03:32:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:32:03.082 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T03:32:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T03:32:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T03:32:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T03:32:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T03:32:03.083 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T03:32:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T03:32:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T03:32:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T03:32:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T03:32:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T03:32:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T03:32:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T03:32:03.086 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T03:32:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T03:32:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T03:32:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:32:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T03:31:55:306808+0000", 2024-09-21T03:32:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T03:32:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T03:32:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T03:32:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T03:32:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T03:32:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T03:32:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T03:32:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T03:32:03.087 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T03:32:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:32:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:32:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T03:32:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:32:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T03:31:55.307631+0000", 2024-09-21T03:32:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:32:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T03:32:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:32:03.088 INFO:teuthology.orchestra.run.smithi084.stdout:mgr not available, waiting (1/15)... 2024-09-21T03:32:05.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:05 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1143360607' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T03:32:06.195 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T03:32:06.195 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:32:06.195 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "e3f8c18e-77c9-11ef-baf5-efdc52797490", 2024-09-21T03:32:06.195 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T03:32:06.195 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T03:32:06.196 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T03:32:06.196 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T03:32:06.196 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:06.196 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T03:32:06.196 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T03:32:06.196 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-09-21T03:32:06.196 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:32:06.196 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T03:32:06.196 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T03:32:06.196 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:32:06.196 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-21T03:32:06.196 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T03:32:06.196 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:32:06.196 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T03:32:06.196 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T03:32:06.196 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:06.197 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T03:32:06.197 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:32:06.197 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T03:32:06.197 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T03:32:06.197 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T03:32:06.197 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T03:32:06.197 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T03:32:06.197 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T03:32:06.200 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:06.200 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T03:32:06.200 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T03:32:06.200 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T03:32:06.200 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T03:32:06.200 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T03:32:06.200 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T03:32:06.200 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T03:32:06.200 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T03:32:06.200 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T03:32:06.200 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:06.201 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T03:32:06.201 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:32:06.201 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T03:31:55:306808+0000", 2024-09-21T03:32:06.201 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T03:32:06.201 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T03:32:06.201 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:06.201 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T03:32:06.201 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T03:32:06.201 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T03:32:06.201 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T03:32:06.201 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T03:32:06.201 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T03:32:06.201 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T03:32:06.201 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:32:06.202 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:32:06.202 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:06.202 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T03:32:06.202 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:32:06.202 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T03:31:55.307631+0000", 2024-09-21T03:32:06.202 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:32:06.202 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:06.202 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T03:32:06.202 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:32:06.202 INFO:teuthology.orchestra.run.smithi084.stdout:mgr not available, waiting (2/15)... 2024-09-21T03:32:07.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:06 smithi084 ceph-mon[30941]: Activating manager daemon x 2024-09-21T03:32:07.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:06 smithi084 ceph-mon[30941]: mgrmap e2: x(active, starting, since 0.00350742s) 2024-09-21T03:32:07.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:06 smithi084 ceph-mon[30941]: from='mgr.14100 172.21.15.84:0/4194581079' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:32:07.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:06 smithi084 ceph-mon[30941]: from='mgr.14100 172.21.15.84:0/4194581079' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:32:07.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:06 smithi084 ceph-mon[30941]: from='mgr.14100 172.21.15.84:0/4194581079' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:32:07.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:06 smithi084 ceph-mon[30941]: from='mgr.14100 172.21.15.84:0/4194581079' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:32:07.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:06 smithi084 ceph-mon[30941]: from='mgr.14100 172.21.15.84:0/4194581079' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:32:07.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:06 smithi084 ceph-mon[30941]: Manager daemon x is now available 2024-09-21T03:32:07.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:06 smithi084 ceph-mon[30941]: from='mgr.14100 172.21.15.84:0/4194581079' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:32:07.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:06 smithi084 ceph-mon[30941]: from='mgr.14100 172.21.15.84:0/4194581079' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:32:07.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:06 smithi084 ceph-mon[30941]: from='mgr.14100 172.21.15.84:0/4194581079' entity='mgr.x' 2024-09-21T03:32:07.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:06 smithi084 ceph-mon[30941]: from='mgr.14100 172.21.15.84:0/4194581079' entity='mgr.x' 2024-09-21T03:32:07.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:06 smithi084 ceph-mon[30941]: from='mgr.14100 172.21.15.84:0/4194581079' entity='mgr.x' 2024-09-21T03:32:09.129 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:08 smithi084 ceph-mon[30941]: mgrmap e3: x(active, since 1.00735s) 2024-09-21T03:32:09.130 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:08 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3271429082' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T03:32:09.476 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T03:32:09.476 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:32:09.476 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsid": "e3f8c18e-77c9-11ef-baf5-efdc52797490", 2024-09-21T03:32:09.477 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T03:32:09.477 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T03:32:09.477 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T03:32:09.477 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T03:32:09.477 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:09.477 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T03:32:09.477 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T03:32:09.477 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 0 2024-09-21T03:32:09.477 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:32:09.477 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T03:32:09.477 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T03:32:09.477 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:32:09.477 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-21T03:32:09.477 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T03:32:09.478 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:32:09.478 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T03:32:09.478 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T03:32:09.478 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:09.478 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T03:32:09.478 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:32:09.478 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T03:32:09.478 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T03:32:09.478 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T03:32:09.481 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T03:32:09.481 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T03:32:09.481 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T03:32:09.481 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:09.482 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T03:32:09.482 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T03:32:09.482 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T03:32:09.482 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T03:32:09.482 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T03:32:09.482 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T03:32:09.482 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T03:32:09.482 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T03:32:09.482 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T03:32:09.482 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:09.482 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T03:32:09.482 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:32:09.482 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T03:31:55:306808+0000", 2024-09-21T03:32:09.482 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T03:32:09.482 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T03:32:09.483 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:09.483 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T03:32:09.483 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T03:32:09.483 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T03:32:09.483 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T03:32:09.483 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T03:32:09.483 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T03:32:09.483 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T03:32:09.483 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:32:09.483 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:32:09.483 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:09.483 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T03:32:09.483 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:32:09.483 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T03:31:55.307631+0000", 2024-09-21T03:32:09.483 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:32:09.484 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:32:09.484 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T03:32:09.484 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:32:09.484 INFO:teuthology.orchestra.run.smithi084.stdout:mgr is available 2024-09-21T03:32:10.039 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:09 smithi084 ceph-mon[30941]: mgrmap e4: x(active, since 2s) 2024-09-21T03:32:10.565 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T03:32:10.565 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T03:32:10.565 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout fsid = e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:32:10.566 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T03:32:10.566 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.84:3300,v1:172.21.15.84:6789] 2024-09-21T03:32:10.566 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T03:32:10.566 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T03:32:10.566 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T03:32:10.566 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T03:32:10.566 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T03:32:10.566 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T03:32:10.566 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T03:32:10.566 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 2024-09-21T03:32:10.566 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T03:32:10.566 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T03:32:10.566 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T03:32:10.566 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T03:32:10.566 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T03:32:10.567 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T03:32:10.567 INFO:teuthology.orchestra.run.smithi084.stdout:Enabling cephadm module... 2024-09-21T03:32:11.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:10 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3252401803' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T03:32:12.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:11 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/181275829' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T03:32:12.318 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:12 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: ignoring --setuser ceph since I am not root 2024-09-21T03:32:12.318 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:12 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: ignoring --setgroup ceph since I am not root 2024-09-21T03:32:13.219 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:12 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/181275829' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T03:32:13.219 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:12 smithi084 ceph-mon[30941]: mgrmap e5: x(active, since 5s) 2024-09-21T03:32:17.470 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:17 smithi084 ceph-mon[30941]: Active manager daemon x restarted 2024-09-21T03:32:17.470 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:17 smithi084 ceph-mon[30941]: Activating manager daemon x 2024-09-21T03:32:17.470 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:17 smithi084 ceph-mon[30941]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T03:32:17.470 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:17 smithi084 ceph-mon[30941]: mgrmap e6: x(active, starting, since 0.00344348s) 2024-09-21T03:32:17.470 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:17 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:32:17.470 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:17 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:32:17.471 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:17 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:32:17.471 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:17 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:32:17.471 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:17 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:32:17.471 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:17 smithi084 ceph-mon[30941]: Manager daemon x is now available 2024-09-21T03:32:18.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' 2024-09-21T03:32:18.767 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' 2024-09-21T03:32:18.767 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-mon[30941]: Found migration_current of "None". Setting to last migration. 2024-09-21T03:32:18.767 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' 2024-09-21T03:32:18.767 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' 2024-09-21T03:32:18.767 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:32:18.767 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:32:18.767 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:32:18.767 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:32:18.767 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-mon[30941]: mgrmap e7: x(active, since 1.00594s) 2024-09-21T03:32:19.068 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:32:18.764+0000 7f93b35b4640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:03:32:18] ENGINE Error in HTTPServer.serve 2024-09-21T03:32:19.068 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: Traceback (most recent call last): 2024-09-21T03:32:19.069 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:32:19.069 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: self._connections.run(self.expiration_interval) 2024-09-21T03:32:19.069 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:32:19.069 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: self._run(expiration_interval) 2024-09-21T03:32:19.069 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:32:19.069 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:32:19.069 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:32:19.069 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:32:19.069 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:32:19.069 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: s = self.context.wrap_socket( 2024-09-21T03:32:19.069 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:32:19.069 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: return self.sslsocket_class._create( 2024-09-21T03:32:19.069 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:32:19.070 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: self.do_handshake() 2024-09-21T03:32:19.070 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:32:19.070 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: self._sslobj.do_handshake() 2024-09-21T03:32:19.070 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:32:19.070 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:32:19.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:19 smithi084 ceph-mon[30941]: [21/Sep/2024:03:32:18] ENGINE Bus STARTING 2024-09-21T03:32:19.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:19 smithi084 ceph-mon[30941]: [21/Sep/2024:03:32:18] ENGINE Serving on http://172.21.15.84:8765 2024-09-21T03:32:19.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:19 smithi084 ceph-mon[30941]: [21/Sep/2024:03:32:18] ENGINE Serving on https://172.21.15.84:7150 2024-09-21T03:32:19.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:19 smithi084 ceph-mon[30941]: [21/Sep/2024:03:32:18] ENGINE Bus STARTED 2024-09-21T03:32:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:19 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:32:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:19 smithi084 ceph-mon[30941]: [21/Sep/2024:03:32:18] ENGINE Error in HTTPServer.serve 2024-09-21T03:32:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout: Traceback (most recent call last): 2024-09-21T03:32:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:32:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._connections.run(self.expiration_interval) 2024-09-21T03:32:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:32:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._run(expiration_interval) 2024-09-21T03:32:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:32:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:32:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:32:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:32:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:32:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout: s = self.context.wrap_socket( 2024-09-21T03:32:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:32:19.820 INFO:journalctl@ceph.mon.a.smithi084.stdout: return self.sslsocket_class._create( 2024-09-21T03:32:19.820 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:32:19.820 INFO:journalctl@ceph.mon.a.smithi084.stdout: self.do_handshake() 2024-09-21T03:32:19.820 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:32:19.820 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._sslobj.do_handshake() 2024-09-21T03:32:19.820 INFO:journalctl@ceph.mon.a.smithi084.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:32:20.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:20 smithi084 ceph-mon[30941]: mgrmap e8: x(active, since 2s) 2024-09-21T03:32:21.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:21 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/4083763867' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T03:32:25.023 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:32:25.024 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 8, 2024-09-21T03:32:25.024 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T03:32:25.024 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T03:32:25.025 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T03:32:25.025 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:32:25.025 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for the mgr to restart... 2024-09-21T03:32:25.025 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr epoch 8... 2024-09-21T03:32:25.990 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:32:25.990 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 8, 2024-09-21T03:32:25.990 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T03:32:25.990 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:32:25.990 INFO:teuthology.orchestra.run.smithi084.stdout:mgr epoch 8 is available 2024-09-21T03:32:25.990 INFO:teuthology.orchestra.run.smithi084.stdout:Verifying orchestrator module is enabled... 2024-09-21T03:32:26.264 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:26 smithi084 ceph-mon[30941]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T03:32:26.264 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:26 smithi084 ceph-mon[30941]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T03:32:27.375 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:27 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/391874496' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T03:32:27.629 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T03:32:27.629 INFO:teuthology.orchestra.run.smithi084.stdout:Setting orchestrator backend to cephadm... 2024-09-21T03:32:28.211 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:28 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/391874496' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T03:32:28.211 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:28 smithi084 ceph-mon[30941]: mgrmap e9: x(active, since 10s) 2024-09-21T03:32:29.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:29 smithi084 ceph-mon[30941]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:29.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:29 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' 2024-09-21T03:32:29.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:29 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:32:30.434 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T03:32:30.434 INFO:teuthology.orchestra.run.smithi084.stdout:Generating ssh key... 2024-09-21T03:32:30.558 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:30 smithi084 ceph-mon[30941]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:31.567 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: Generating public/private rsa key pair. 2024-09-21T03:32:31.567 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: Your identification has been saved in /tmp/tmpre1chtu7/key 2024-09-21T03:32:31.567 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: Your public key has been saved in /tmp/tmpre1chtu7/key.pub 2024-09-21T03:32:31.567 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: The key fingerprint is: 2024-09-21T03:32:31.567 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: SHA256:lMtXy3L8I0bhbwzWvU1+1Jx9u9yB7K/B8jpLdmQznsk ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:32:31.567 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: The key's randomart image is: 2024-09-21T03:32:31.567 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: +---[RSA 3072]----+ 2024-09-21T03:32:31.567 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: | | 2024-09-21T03:32:31.567 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: | . | 2024-09-21T03:32:31.568 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: | o o | 2024-09-21T03:32:31.568 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: | o . = + o+| 2024-09-21T03:32:31.568 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: | S o X=..O| 2024-09-21T03:32:31.568 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: | . =B=*+=| 2024-09-21T03:32:31.568 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: | +oE*++| 2024-09-21T03:32:31.568 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: | oo=oo.=| 2024-09-21T03:32:31.568 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: | o++o+.| 2024-09-21T03:32:31.568 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: +----[SHA256]-----+ 2024-09-21T03:32:32.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:32 smithi084 ceph-mon[30941]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:32.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:32 smithi084 ceph-mon[30941]: Generating ssh key... 2024-09-21T03:32:32.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:32 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' 2024-09-21T03:32:32.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:32 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' 2024-09-21T03:32:32.887 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2oCaMQWTn8K/RTJLbDcukC1cZdPGSkYrseG6+3pNjyVVaR0LQIWU28/SLdduNork89V+2RVrsRa0AaZAMMhAB35D1nsq1TOru+OpT8qaWhHu6nE7bSrirVuVbButqxQjsr0bh10kvWEeec0lDa8Z9KmXrBsenoRncLg6d5+dpYhaREehJiuf8+NOo/Zw9vdUYVU1UElVn9XR8lFheV8CbxW8Xzkag7gbdux7PwtcuuVtgUFDR0AgBa4sEELxyUjGAxgYrNnLAwoCrn1oxJvY01HEhmeTddxQoBlNEN60gLFsipyCNi6vCoWGu/zBLB4Jw9OQ8IckRdBve9RCsgWvVA/wenM81UjzA707zjvZlLd0y6gTn/63+apDb87qxD56S/Gc2SfFtH7IuHy3c6S2k8SwW+2vzK8JKFFniZHBPQfDkFd37ARGhdP8GloxPrm9jWhNQY2WL7aJGxJ7yCXZEfwrfgPDq2rMSgRlJ8rRuD2DnbpA/C5h5Z1JAI+YY3PE= ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:32:32.887 INFO:teuthology.orchestra.run.smithi084.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T03:32:32.888 INFO:teuthology.orchestra.run.smithi084.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T03:32:32.895 INFO:teuthology.orchestra.run.smithi084.stdout:Adding host smithi084... 2024-09-21T03:32:33.271 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:33 smithi084 ceph-mon[30941]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:34.234 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:34 smithi084 ceph-mon[30941]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi084", "addr": "172.21.15.84", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:35.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:35 smithi084 ceph-mon[30941]: Deploying cephadm binary to smithi084 2024-09-21T03:32:37.161 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Added host 'smithi084' with addr '172.21.15.84' 2024-09-21T03:32:37.162 INFO:teuthology.orchestra.run.smithi084.stdout:Deploying unmanaged mon service... 2024-09-21T03:32:37.793 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:37 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' 2024-09-21T03:32:37.794 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:37 smithi084 ceph-mon[30941]: Added host smithi084 2024-09-21T03:32:37.794 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:37 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:32:38.397 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T03:32:38.398 INFO:teuthology.orchestra.run.smithi084.stdout:Deploying unmanaged mgr service... 2024-09-21T03:32:38.968 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:38 smithi084 ceph-mon[30941]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:32:38.968 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:38 smithi084 ceph-mon[30941]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:38.968 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:38 smithi084 ceph-mon[30941]: Saving service mon spec with placement count:5 2024-09-21T03:32:38.969 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:38 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' 2024-09-21T03:32:40.138 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:39 smithi084 ceph-mon[30941]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:40.139 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:39 smithi084 ceph-mon[30941]: Saving service mgr spec with placement count:2 2024-09-21T03:32:40.139 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:39 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' 2024-09-21T03:32:40.139 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:39 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' 2024-09-21T03:32:40.141 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T03:32:41.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:40 smithi084 ceph-mon[30941]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:32:41.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:40 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' 2024-09-21T03:32:41.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:40 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/602461296' entity='client.admin' 2024-09-21T03:32:42.840 INFO:teuthology.orchestra.run.smithi084.stdout:Enabling the dashboard module... 2024-09-21T03:32:43.224 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:43 smithi084 ceph-mon[30941]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:32:43.224 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:43 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2929500762' entity='client.admin' 2024-09-21T03:32:44.568 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:44 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: ignoring --setuser ceph since I am not root 2024-09-21T03:32:44.568 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:44 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: ignoring --setgroup ceph since I am not root 2024-09-21T03:32:44.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:44 smithi084 ceph-mon[30941]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:32:44.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:44 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' 2024-09-21T03:32:44.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:44 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1196391661' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T03:32:44.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:44 smithi084 ceph-mon[30941]: from='mgr.14118 172.21.15.84:0/4088080562' entity='mgr.x' 2024-09-21T03:32:45.670 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:45 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1196391661' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T03:32:45.670 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:45 smithi084 ceph-mon[30941]: mgrmap e10: x(active, since 27s) 2024-09-21T03:32:46.865 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:46 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1121547125' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T03:32:47.136 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:32:47.136 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "epoch": 10, 2024-09-21T03:32:47.136 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T03:32:47.136 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T03:32:47.136 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T03:32:47.136 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:32:47.136 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for the mgr to restart... 2024-09-21T03:32:47.136 INFO:teuthology.orchestra.run.smithi084.stdout:Waiting for mgr epoch 10... 2024-09-21T03:32:49.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:49 smithi084 ceph-mon[30941]: Active manager daemon x restarted 2024-09-21T03:32:49.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:49 smithi084 ceph-mon[30941]: Activating manager daemon x 2024-09-21T03:32:49.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:49 smithi084 ceph-mon[30941]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T03:32:49.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:49 smithi084 ceph-mon[30941]: mgrmap e11: x(active, starting, since 0.00346913s) 2024-09-21T03:32:49.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:49 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:32:49.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:49 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:32:49.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:49 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:32:49.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:49 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:32:49.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:49 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:32:49.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:49 smithi084 ceph-mon[30941]: Manager daemon x is now available 2024-09-21T03:32:50.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:32:50.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:32:50.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:32:50.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-mon[30941]: mgrmap e12: x(active, since 1.00654s) 2024-09-21T03:32:50.819 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:32:50.689+0000 7f2f82d50640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:03:32:50] ENGINE Error in HTTPServer.serve 2024-09-21T03:32:50.819 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: Traceback (most recent call last): 2024-09-21T03:32:50.819 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:32:50.819 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: self._connections.run(self.expiration_interval) 2024-09-21T03:32:50.819 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:32:50.819 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: self._run(expiration_interval) 2024-09-21T03:32:50.819 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:32:50.819 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:32:50.819 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:32:50.819 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:32:50.820 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:32:50.820 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: s = self.context.wrap_socket( 2024-09-21T03:32:50.820 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:32:50.820 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: return self.sslsocket_class._create( 2024-09-21T03:32:50.820 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:32:50.820 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: self.do_handshake() 2024-09-21T03:32:50.820 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:32:50.820 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: self._sslobj.do_handshake() 2024-09-21T03:32:50.820 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:32:50.820 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:32:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:32:51.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:51 smithi084 ceph-mon[30941]: [21/Sep/2024:03:32:50] ENGINE Bus STARTING 2024-09-21T03:32:51.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:51 smithi084 ceph-mon[30941]: [21/Sep/2024:03:32:50] ENGINE Serving on https://172.21.15.84:7150 2024-09-21T03:32:51.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:51 smithi084 ceph-mon[30941]: [21/Sep/2024:03:32:50] ENGINE Error in HTTPServer.serve 2024-09-21T03:32:51.570 INFO:journalctl@ceph.mon.a.smithi084.stdout: Traceback (most recent call last): 2024-09-21T03:32:51.570 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:32:51.570 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._connections.run(self.expiration_interval) 2024-09-21T03:32:51.570 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:32:51.570 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._run(expiration_interval) 2024-09-21T03:32:51.570 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:32:51.570 INFO:journalctl@ceph.mon.a.smithi084.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:32:51.570 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:32:51.570 INFO:journalctl@ceph.mon.a.smithi084.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:32:51.571 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:32:51.571 INFO:journalctl@ceph.mon.a.smithi084.stdout: s = self.context.wrap_socket( 2024-09-21T03:32:51.571 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:32:51.571 INFO:journalctl@ceph.mon.a.smithi084.stdout: return self.sslsocket_class._create( 2024-09-21T03:32:51.571 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:32:51.571 INFO:journalctl@ceph.mon.a.smithi084.stdout: self.do_handshake() 2024-09-21T03:32:51.571 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:32:51.571 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._sslobj.do_handshake() 2024-09-21T03:32:51.571 INFO:journalctl@ceph.mon.a.smithi084.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:32:51.571 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:51 smithi084 ceph-mon[30941]: [21/Sep/2024:03:32:50] ENGINE Serving on http://172.21.15.84:8765 2024-09-21T03:32:51.571 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:51 smithi084 ceph-mon[30941]: [21/Sep/2024:03:32:50] ENGINE Bus STARTED 2024-09-21T03:32:51.612 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:32:51.612 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 12, 2024-09-21T03:32:51.612 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T03:32:51.612 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:32:51.612 INFO:teuthology.orchestra.run.smithi084.stdout:mgr epoch 10 is available 2024-09-21T03:32:51.612 INFO:teuthology.orchestra.run.smithi084.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T03:32:52.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:52 smithi084 ceph-mon[30941]: mgrmap e13: x(active, since 2s) 2024-09-21T03:32:52.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:52 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:32:52.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:52 smithi084 ceph-mon[30941]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:53.201 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUVSGueW/HpDFlNv99iOXLBkv8VV0wDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTAzMzI1MloXDTM0\nMDkyMjAzMzI1MlowFzEVMBMGA1UEAwwMMTcyLjIxLjE1Ljg0MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAwwuUdudVIkW4Y4hiv4+8kth9tGxy002ZDD9n\nL5uq+yYw5PbCPT8DWLuj7ES6bt6OoiIHBE+BCnb+Fp/ee3TcC6VhhOdR+AzzeUV3\nEbGTSIow8TEvsXCjNFdKEU7uRE06W3mRvRbI+g6BVW1Ddt5t5/d+wUWQpqNLM34o\nN3GO1lsBUV1FLEvsAC2SenuyJ/Fa3bMxilduD5NX7eW5HLjtoNCpll+tptgcZMCP\nR9XtCFMuTt4qpKYK8ucQHl60iUwg6vhKzWjReb2dbm11VlhQsZVrf2YNL7Wl4nuM\nnO5rD2tKixzvt9d409glEKto9hiOEPg78W0+OgIq7UAqd27X2npjPzxvOPgbUo8n\nAptJybirgFoJ5ILv42cF5eEYGDPxTrBVd5miQmcWTR4zd7HCV/HUcXDQTLXZ0/Hw\nkslkv8EW6hW4zkBwV3T+o4LxtkOUTJnAXDNuRxmXlAI7DWdZd9PRbi2ksSuOnAEN\nDY+mPSA+U/45NGhCweeROEj94WLMPbdnV0u8V/aqA2JSvsu9/fMkgI2qX8cgLVwk\na/DmE5sj0pX1V4EGewYNjmEjk9SKgOLlpIqqNM1x6Apacb0yhKogEI15aruo2D0E\nndYipTVPc8JVhoooskqvWBg4avxtYKEf74Xf2H7EVJzAKjC+cHL4Vco/N2XRObg8\ncT3L9zsCAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDg0ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPVDAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQBB\nfrPyfgjAZl923898db9s5zwJ1Xe5sFKI/dPWOoGnTqF/As/khoWziQ2XQyD+9ut6\n2w6ssQkgMYpvhNl0Bcg+tev7BdyvNhOPiJkeS1RtOgpQz9yqHoZ3RSeCu6xlcdvD\nvwrQL65CRE2Lyi5CJlRZulZqPo5HAMAEOg8CQRjW5ROnC0T97UzofUWomW+o0J8F\nLqi1TWUqczH2Uoze1dQNzeQNsZnTNYn8bmoNeuiGCcLdNAX4V8nx9ZeTLARVd0yE\nC32wqHuG/Zb6TuKYDeDXlrPp0y3j5kyZ7Ysqyg2irs9Ec+BbGhrJfuknQfCTyfru\nlPEyHm9z/14VwRSsqBqgDC8a16TItM+rRCEWZYzA93DkZOoPw09Gd4rqgbIubT/G\nE7yDzYCHf4uVgPR1TbwIMTtsOcctP9aeeo8ptPiX8IiXamvwVClRPGFgihOP4kZO\npy3Yt33eVDO3VMBxBTDvKOauBpdhOInD+O8VMB40fmnSag9bMwsosh4xrw1fo9ry\nlGia0GilCFUAEVnxSDSjGxdqC5kRI2OXmoqPtar5dJh8ZakhncLucEcBJ5CDEhhz\nXBZAnWzOFsFSN/FEsKQgAzq8+hgByLYgB3MpmTgA/0dN2Y84noJ7BAe1UR2vyAxD\ntSjPbsdbIpmNFov0TWcpoFOhtGSnIeFKeGKZXc5F/A==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKQIBAAKCAgEAwwuUdudVIkW4Y4hiv4+8kth9tGxy002ZDD9nL5uq+yYw5PbC\nPT8DWLuj7ES6bt6OoiIHBE+BCnb+Fp/ee3TcC6VhhOdR+AzzeUV3EbGTSIow8TEv\nsXCjNFdKEU7uRE06W3mRvRbI+g6BVW1Ddt5t5/d+wUWQpqNLM34oN3GO1lsBUV1F\nLEvsAC2SenuyJ/Fa3bMxilduD5NX7eW5HLjtoNCpll+tptgcZMCPR9XtCFMuTt4q\npKYK8ucQHl60iUwg6vhKzWjReb2dbm11VlhQsZVrf2YNL7Wl4nuMnO5rD2tKixzv\nt9d409glEKto9hiOEPg78W0+OgIq7UAqd27X2npjPzxvOPgbUo8nAptJybirgFoJ\n5ILv42cF5eEYGDPxTrBVd5miQmcWTR4zd7HCV/HUcXDQTLXZ0/Hwkslkv8EW6hW4\nzkBwV3T+o4LxtkOUTJnAXDNuRxmXlAI7DWdZd9PRbi2ksSuOnAENDY+mPSA+U/45\nNGhCweeROEj94WLMPbdnV0u8V/aqA2JSvsu9/fMkgI2qX8cgLVwka/DmE5sj0pX1\nV4EGewYNjmEjk9SKgOLlpIqqNM1x6Apacb0yhKogEI15aruo2D0EndYipTVPc8JV\nhoooskqvWBg4avxtYKEf74Xf2H7EVJzAKjC+cHL4Vco/N2XRObg8cT3L9zsCAwEA\nAQKCAgA5jnO/yNE3HWLlwEv/on9vyAIEWZJi5323/wfIpUPF/EWmc2jrYOpwZ2Le\nqINpjzSBBNCURY/bUjT14TRqsxfyOdn2ubpXHB9HFKgn6QKBAAKkUjL0RjxrCC07\nwVKPhkin0M6ggZZKMDibSHSFoerF7qORjiE7A2oAJoTgo5qWh+FyLLdqdHcOsGQO\nz+zJW7BIRwZiAB3i68ShV86R+sJo19qLnO1mFFUAqFA/zxG1CLLcJDRqRPNrLaN0\nitb0wyndnOqaBgn2xm0sNpHPKp2ZYfIIdMmEYDK1DGd4seSW9r7XIXFeC3BE934s\nlqCRKrrVqCMsQeQAgz4+p9ZAS03Xz4mxRvA+JHXwoL3qQFoL6cXdfUNKW+K2ehI1\nXQXxQRvLP35WAtheePIPu/KVywVHu18M+W5oUqmOFznnQ2k4oZaLTPLfheiebOqL\nT+/ULhzT1W8m/qubSTr1SbVH01sX/c2e1iQ/znWNpa6DB54uv4E0neDhSMtrlZS0\nJcCBF5H+qP+CMWkeOzil3EefiKsIW4WIR/DMMPlcMiHvJGfGC/hhbJsbC43jC8j7\nw+JJZAfvQd/5rjwoHlRToZrG8RtCJk9U6nKCYP2h9N38BKPjaZGFv2N8RcNCdN1v\nj+UvQYBc29V7tFLFFEen2uU68fBaZt6cOaBs3J/SNtAiLRVaiQKCAQEA6kMXj7gI\n/RPsPpvKpjC8U01iIxN/Ce0BTT3Bhfitqo8UFBC0QLsvNDgQWEHGfeT/bEgcAzot\nvMTmaqVa1VVaOiXPfOJkT8MhXbLtGjbJ3BFg3itwWHHDKMuvxrhaFCOxnauOP1ax\ncaFlM8/ljsNZ5QObQr5NFCA1kSSZAKoE8YES0T56OBBfq+cm4zdC2ZuQaz2kBnW0\nb16ZGkegV938lu0HNFEhWtQwXMuE/sKOraj3lAf2P4NAYQToLtt7gvJRuBtQBWRP\n+XNAcO/n5zUAKVi8zb9uZOpmEPF5IkxMHqfSFMyKcSvX/ClLaj9+11JP+eTloR3x\nBwLfe96ETd4N+QKCAQEA1STjxC2c0gaVm8vm7DEiQpcHGCSGuNwX8hnZZ3L3Jc56\nSmOZVjXg0g7Gkmhaf3DzMiMZsGOoVzTHm1/qPY9GCdd8HzLy1BbOaRarEKsJjad4\nJid9nLKWIXCU1XN/RlTUpeNPUW4Ucj/QAWXWfnN9+lW3mXXsnwcwR58Q5Bm2W7dF\nuxqBXvKFpatAc4S41usCmbNbt70dvcfnfGpSxxrJvBXypk1cS+xaD3EZx7+aQ6XM\nxGOS7fiql+4wIKr87VVofSDKwOrLVD3TwUDxtDxpZpKrsRf0j4s+EReALZ78U/2+\naT4mEWTpSPECbQDLPEHIhbeeCZqMGK4HjFJDhMLL0wKCAQEAhShFyEePtGsSqjPb\n6MNjCOa/lbiLSZUSXFlyGzjTXlOd0hn8m57KoiAMCl64+O6l0WLbqWn0fYxefNgo\n3YJ6mvrLCe2Vn1EHMj92TqQ98X1fVmnSnjNr/1BoRcicSz5Ow5S0coRQsIpRADZ4\nAcJA4tA9/J43Ke11BV+MKLh7vtrjW1TsG9oSx5/IlvbeZNrsKEkNZy6YtYVL+Ygl\nOEzSOufYZICJORvLsbNtkXH9r/CPafFso4VznrIvWBMiDbi3grLjtWzjmKNOSePU\nKbQSt23dRAZANdSW16KqfDhqPDKgU3pAZzvItWizmV0mODZth1n4vLBMRPP5HGvL\nQIer4QKCAQBWfAFvOJLJJaLO9I1eiRE9s8pNIYUIvUV6FsMAFsXxsTYtuPwe3v26\nPgSUo4MU8t+7GEL0L3u+5suXX/PLxrbEh4r1ndap+BcIzQncWYom0C0QTjXJvyzr\npKK/eX3LK+Cc7v7gK6pgMURVTN0bsgEL8nvs6Mx6OpB8fy57X3N/A35nzPlxbTaN\nYk9kkBXwHquPchdlFnda6iIjeYDdCSGSD9XFZN5ucBia62lqg3Q0vrG3fi/AH4YY\n36znlHnMUztyiju6y4p1RCEH6TIpz9l0pU7FLNMu63DjvoVj/X6lFfCNA4quxCNk\nVWaGlCvi505V84tMmkj+Op8VcMu0stXBAoIBAQDSo0CkGFCeaFjjvpctqp5/oGsl\n+RZ+c8uSNfpfCrrHIDb1rO/Uff5K4MGEefitT1epd2beROgFK0BQl0AiGGbv3SHZ\nnX8U9jIHubdvz4YqcJCHeCOAO4vUu8k2eczdm36u+dwLjjRVjrLhlmqlg3IkMvug\nmUYxOa/mQXMrp9KZtTCsZ6/7cmSRwxGORZPRq4NaIobY8BKon/8rxaZwCgiboL7v\n93+pAHF6WR1oZxjE6YBc71cD1QaV/JlY3PbnT2gcZSTn8w/UeKJOt6rFP0+mtqP0\nK5sF+vxMbtZIjlnBq+dZ+2puM7sRPaRoUTRzJpXQSc6LlpJZN3QzyRpgMK5H\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T03:32:53.813 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:53 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:32:54.493 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T03:32:55.119 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:54 smithi084 ceph-mon[30941]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:55.119 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:54 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:32:56.237 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T03:32:56.238 INFO:teuthology.orchestra.run.smithi084.stdout:Creating initial admin user... 2024-09-21T03:32:56.433 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:56 smithi084 ceph-mon[30941]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:56.433 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:56 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:32:57.619 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$3hZh5hZ6nWYsAXU92jYefuuBUDwo6Gj3nn5oLlhbxkB.1yqQsUBDS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726889577, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T03:32:57.619 INFO:teuthology.orchestra.run.smithi084.stdout:Fetching dashboard port number... 2024-09-21T03:32:58.217 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:58 smithi084 ceph-mon[30941]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:58.217 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:58 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:32:58.758 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T03:32:58.769 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T03:32:58.769 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout disabled 2024-09-21T03:32:58.776 INFO:teuthology.orchestra.run.smithi084.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T03:32:58.776 INFO:teuthology.orchestra.run.smithi084.stdout:systemctl: stdout inactive 2024-09-21T03:32:58.776 INFO:teuthology.orchestra.run.smithi084.stdout:firewalld.service is not enabled 2024-09-21T03:32:58.776 INFO:teuthology.orchestra.run.smithi084.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T03:32:58.778 INFO:teuthology.orchestra.run.smithi084.stdout:Ceph Dashboard is now available at: 2024-09-21T03:32:58.778 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:32:58.778 INFO:teuthology.orchestra.run.smithi084.stdout: URL: https://smithi084.front.sepia.ceph.com:8443/ 2024-09-21T03:32:58.778 INFO:teuthology.orchestra.run.smithi084.stdout: User: admin 2024-09-21T03:32:58.778 INFO:teuthology.orchestra.run.smithi084.stdout: Password: zhpv375sqx 2024-09-21T03:32:58.779 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:32:58.779 INFO:teuthology.orchestra.run.smithi084.stdout:Saving cluster configuration to /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config directory 2024-09-21T03:32:59.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:32:59 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3202308105' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T03:33:00.031 INFO:teuthology.orchestra.run.smithi084.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T03:33:00.031 INFO:teuthology.orchestra.run.smithi084.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T03:33:00.031 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:33:00.031 INFO:teuthology.orchestra.run.smithi084.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:00.032 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:33:00.032 INFO:teuthology.orchestra.run.smithi084.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T03:33:00.032 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:33:00.032 INFO:teuthology.orchestra.run.smithi084.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T03:33:00.032 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:33:00.032 INFO:teuthology.orchestra.run.smithi084.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T03:33:00.032 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:33:00.032 INFO:teuthology.orchestra.run.smithi084.stdout: ceph telemetry on 2024-09-21T03:33:00.032 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:33:00.032 INFO:teuthology.orchestra.run.smithi084.stdout:For more information see: 2024-09-21T03:33:00.032 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:33:00.032 INFO:teuthology.orchestra.run.smithi084.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T03:33:00.032 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:33:00.032 INFO:teuthology.orchestra.run.smithi084.stdout:Bootstrap complete. 2024-09-21T03:33:00.075 INFO:tasks.cephadm:Fetching config... 2024-09-21T03:33:00.075 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T03:33:00.075 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T03:33:00.091 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T03:33:00.091 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T03:33:00.091 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T03:33:00.148 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T03:33:00.148 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T03:33:00.148 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T03:33:00.212 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T03:33:00.212 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T03:33:00.212 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T03:33:00.267 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T03:33:00.268 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2oCaMQWTn8K/RTJLbDcukC1cZdPGSkYrseG6+3pNjyVVaR0LQIWU28/SLdduNork89V+2RVrsRa0AaZAMMhAB35D1nsq1TOru+OpT8qaWhHu6nE7bSrirVuVbButqxQjsr0bh10kvWEeec0lDa8Z9KmXrBsenoRncLg6d5+dpYhaREehJiuf8+NOo/Zw9vdUYVU1UElVn9XR8lFheV8CbxW8Xzkag7gbdux7PwtcuuVtgUFDR0AgBa4sEELxyUjGAxgYrNnLAwoCrn1oxJvY01HEhmeTddxQoBlNEN60gLFsipyCNi6vCoWGu/zBLB4Jw9OQ8IckRdBve9RCsgWvVA/wenM81UjzA707zjvZlLd0y6gTn/63+apDb87qxD56S/Gc2SfFtH7IuHy3c6S2k8SwW+2vzK8JKFFniZHBPQfDkFd37ARGhdP8GloxPrm9jWhNQY2WL7aJGxJ7yCXZEfwrfgPDq2rMSgRlJ8rRuD2DnbpA/C5h5Z1JAI+YY3PE= ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T03:33:00.341 INFO:teuthology.orchestra.run.smithi084.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2oCaMQWTn8K/RTJLbDcukC1cZdPGSkYrseG6+3pNjyVVaR0LQIWU28/SLdduNork89V+2RVrsRa0AaZAMMhAB35D1nsq1TOru+OpT8qaWhHu6nE7bSrirVuVbButqxQjsr0bh10kvWEeec0lDa8Z9KmXrBsenoRncLg6d5+dpYhaREehJiuf8+NOo/Zw9vdUYVU1UElVn9XR8lFheV8CbxW8Xzkag7gbdux7PwtcuuVtgUFDR0AgBa4sEELxyUjGAxgYrNnLAwoCrn1oxJvY01HEhmeTddxQoBlNEN60gLFsipyCNi6vCoWGu/zBLB4Jw9OQ8IckRdBve9RCsgWvVA/wenM81UjzA707zjvZlLd0y6gTn/63+apDb87qxD56S/Gc2SfFtH7IuHy3c6S2k8SwW+2vzK8JKFFniZHBPQfDkFd37ARGhdP8GloxPrm9jWhNQY2WL7aJGxJ7yCXZEfwrfgPDq2rMSgRlJ8rRuD2DnbpA/C5h5Z1JAI+YY3PE= ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:33:00.352 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2oCaMQWTn8K/RTJLbDcukC1cZdPGSkYrseG6+3pNjyVVaR0LQIWU28/SLdduNork89V+2RVrsRa0AaZAMMhAB35D1nsq1TOru+OpT8qaWhHu6nE7bSrirVuVbButqxQjsr0bh10kvWEeec0lDa8Z9KmXrBsenoRncLg6d5+dpYhaREehJiuf8+NOo/Zw9vdUYVU1UElVn9XR8lFheV8CbxW8Xzkag7gbdux7PwtcuuVtgUFDR0AgBa4sEELxyUjGAxgYrNnLAwoCrn1oxJvY01HEhmeTddxQoBlNEN60gLFsipyCNi6vCoWGu/zBLB4Jw9OQ8IckRdBve9RCsgWvVA/wenM81UjzA707zjvZlLd0y6gTn/63+apDb87qxD56S/Gc2SfFtH7IuHy3c6S2k8SwW+2vzK8JKFFniZHBPQfDkFd37ARGhdP8GloxPrm9jWhNQY2WL7aJGxJ7yCXZEfwrfgPDq2rMSgRlJ8rRuD2DnbpA/C5h5Z1JAI+YY3PE= ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T03:33:00.393 INFO:teuthology.orchestra.run.smithi172.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2oCaMQWTn8K/RTJLbDcukC1cZdPGSkYrseG6+3pNjyVVaR0LQIWU28/SLdduNork89V+2RVrsRa0AaZAMMhAB35D1nsq1TOru+OpT8qaWhHu6nE7bSrirVuVbButqxQjsr0bh10kvWEeec0lDa8Z9KmXrBsenoRncLg6d5+dpYhaREehJiuf8+NOo/Zw9vdUYVU1UElVn9XR8lFheV8CbxW8Xzkag7gbdux7PwtcuuVtgUFDR0AgBa4sEELxyUjGAxgYrNnLAwoCrn1oxJvY01HEhmeTddxQoBlNEN60gLFsipyCNi6vCoWGu/zBLB4Jw9OQ8IckRdBve9RCsgWvVA/wenM81UjzA707zjvZlLd0y6gTn/63+apDb87qxD56S/Gc2SfFtH7IuHy3c6S2k8SwW+2vzK8JKFFniZHBPQfDkFd37ARGhdP8GloxPrm9jWhNQY2WL7aJGxJ7yCXZEfwrfgPDq2rMSgRlJ8rRuD2DnbpA/C5h5Z1JAI+YY3PE= ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:33:00.406 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2oCaMQWTn8K/RTJLbDcukC1cZdPGSkYrseG6+3pNjyVVaR0LQIWU28/SLdduNork89V+2RVrsRa0AaZAMMhAB35D1nsq1TOru+OpT8qaWhHu6nE7bSrirVuVbButqxQjsr0bh10kvWEeec0lDa8Z9KmXrBsenoRncLg6d5+dpYhaREehJiuf8+NOo/Zw9vdUYVU1UElVn9XR8lFheV8CbxW8Xzkag7gbdux7PwtcuuVtgUFDR0AgBa4sEELxyUjGAxgYrNnLAwoCrn1oxJvY01HEhmeTddxQoBlNEN60gLFsipyCNi6vCoWGu/zBLB4Jw9OQ8IckRdBve9RCsgWvVA/wenM81UjzA707zjvZlLd0y6gTn/63+apDb87qxD56S/Gc2SfFtH7IuHy3c6S2k8SwW+2vzK8JKFFniZHBPQfDkFd37ARGhdP8GloxPrm9jWhNQY2WL7aJGxJ7yCXZEfwrfgPDq2rMSgRlJ8rRuD2DnbpA/C5h5Z1JAI+YY3PE= ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T03:33:00.447 INFO:teuthology.orchestra.run.smithi174.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2oCaMQWTn8K/RTJLbDcukC1cZdPGSkYrseG6+3pNjyVVaR0LQIWU28/SLdduNork89V+2RVrsRa0AaZAMMhAB35D1nsq1TOru+OpT8qaWhHu6nE7bSrirVuVbButqxQjsr0bh10kvWEeec0lDa8Z9KmXrBsenoRncLg6d5+dpYhaREehJiuf8+NOo/Zw9vdUYVU1UElVn9XR8lFheV8CbxW8Xzkag7gbdux7PwtcuuVtgUFDR0AgBa4sEELxyUjGAxgYrNnLAwoCrn1oxJvY01HEhmeTddxQoBlNEN60gLFsipyCNi6vCoWGu/zBLB4Jw9OQ8IckRdBve9RCsgWvVA/wenM81UjzA707zjvZlLd0y6gTn/63+apDb87qxD56S/Gc2SfFtH7IuHy3c6S2k8SwW+2vzK8JKFFniZHBPQfDkFd37ARGhdP8GloxPrm9jWhNQY2WL7aJGxJ7yCXZEfwrfgPDq2rMSgRlJ8rRuD2DnbpA/C5h5Z1JAI+YY3PE= ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:33:00.460 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T03:33:00.707 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:00.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:00 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/4099616592' entity='client.admin' 2024-09-21T03:33:02.413 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T03:33:02.414 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T03:33:02.501 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:02 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3236720990' entity='client.admin' 2024-09-21T03:33:02.501 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:02 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:02.501 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:02 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:02.502 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:02 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi084", "name": "osd_memory_target"} : dispatch 2024-09-21T03:33:02.502 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:02 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:02.502 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:02 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:02.502 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:02 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:02.848 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:03.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:03 smithi084 ceph-mon[30941]: mgrmap e14: x(active, since 13s) 2024-09-21T03:33:04.217 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi172 2024-09-21T03:33:04.217 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T03:33:04.217 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.conf 2024-09-21T03:33:04.237 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T03:33:04.237 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:04.295 INFO:tasks.cephadm:Adding host smithi172 to orchestrator... 2024-09-21T03:33:04.295 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph orch host add smithi172 2024-09-21T03:33:04.614 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:04.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:04 smithi084 ceph-mon[30941]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:04.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:04 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:04.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:04 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:04.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:04 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:04.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:04 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:04.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:04 smithi084 ceph-mon[30941]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-21T03:33:04.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:04 smithi084 ceph-mon[30941]: Updating smithi084:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:04.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:04 smithi084 ceph-mon[30941]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:04.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:04 smithi084 ceph-mon[30941]: Updating smithi084:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:33:04.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:04 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:04.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:04 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:04.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:04 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:05.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:05 smithi084 ceph-mon[30941]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:06.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:06 smithi084 ceph-mon[30941]: Deploying cephadm binary to smithi172 2024-09-21T03:33:08.239 INFO:teuthology.orchestra.run.smithi084.stdout:Added host 'smithi172' with addr '172.21.15.172' 2024-09-21T03:33:08.803 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T03:33:09.041 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:09.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:09 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:09.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:09 smithi084 ceph-mon[30941]: Added host smithi172 2024-09-21T03:33:09.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:09 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:09.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:09 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:09.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:09 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:09.704 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:33:09.704 INFO:teuthology.orchestra.run.smithi084.stdout:[{"addr": "172.21.15.84", "hostname": "smithi084", "labels": [], "status": ""}, {"addr": "172.21.15.172", "hostname": "smithi172", "labels": [], "status": ""}] 2024-09-21T03:33:10.317 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi174 2024-09-21T03:33:10.318 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T03:33:10.318 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/etc/ceph/ceph.conf 2024-09-21T03:33:10.337 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T03:33:10.338 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:10.396 INFO:tasks.cephadm:Adding host smithi174 to orchestrator... 2024-09-21T03:33:10.396 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph orch host add smithi174 2024-09-21T03:33:10.633 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:10.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:10 smithi084 ceph-mon[30941]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:10.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:10 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:10.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:10 smithi084 ceph-mon[30941]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:33:11.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:11 smithi084 ceph-mon[30941]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi174", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:13.719 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:13 smithi084 ceph-mon[30941]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:13 smithi084 ceph-mon[30941]: Deploying cephadm binary to smithi174 2024-09-21T03:33:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:13 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:13 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:13 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:13 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:13 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"} : dispatch 2024-09-21T03:33:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:13 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:13 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:13 smithi084 ceph-mon[30941]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-21T03:33:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:13 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:13 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:13 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:14.558 INFO:teuthology.orchestra.run.smithi084.stdout:Added host 'smithi174' with addr '172.21.15.174' 2024-09-21T03:33:14.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:14 smithi084 ceph-mon[30941]: Updating smithi172:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:14.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:14 smithi084 ceph-mon[30941]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:14.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:14 smithi084 ceph-mon[30941]: Updating smithi172:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:33:15.158 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T03:33:15.408 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:15.661 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:15 smithi084 ceph-mon[30941]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:15.661 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:15 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:15.661 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:15 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:15.661 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:15 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:15.661 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:15 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:16.056 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:33:16.056 INFO:teuthology.orchestra.run.smithi084.stdout:[{"addr": "172.21.15.84", "hostname": "smithi084", "labels": [], "status": ""}, {"addr": "172.21.15.172", "hostname": "smithi172", "labels": [], "status": ""}, {"addr": "172.21.15.174", "hostname": "smithi174", "labels": [], "status": ""}] 2024-09-21T03:33:16.635 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:16 smithi084 ceph-mon[30941]: Added host smithi174 2024-09-21T03:33:16.635 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:16 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:16.661 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T03:33:16.712 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T03:33:16.952 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:17.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:17 smithi084 ceph-mon[30941]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:17.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:17 smithi084 ceph-mon[30941]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:33:18.412 INFO:teuthology.orchestra.run.smithi084.stderr:adjusted tunables profile to default 2024-09-21T03:33:18.716 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:18 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1707042142' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T03:33:19.050 INFO:tasks.cephadm:Adding mon.a on smithi084 2024-09-21T03:33:19.050 INFO:tasks.cephadm:Adding mon.b on smithi172 2024-09-21T03:33:19.050 INFO:tasks.cephadm:Adding mon.c on smithi174 2024-09-21T03:33:19.051 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi084:172.21.15.84=a;smithi172:172.21.15.172=b;smithi174:172.21.15.174=c' 2024-09-21T03:33:19.302 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:19.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:19 smithi084 ceph-mon[30941]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:19.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:19 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1707042142' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T03:33:19.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:19 smithi084 ceph-mon[30941]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:33:19.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:19 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:19 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:19 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:19 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:19 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi174", "name": "osd_memory_target"} : dispatch 2024-09-21T03:33:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:19 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:19 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:19 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:19 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:19.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:19 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:19.927 INFO:teuthology.orchestra.run.smithi174.stdout:Scheduled mon update... 2024-09-21T03:33:20.500 DEBUG:teuthology.orchestra.run.smithi172:mon.b> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T03:33:20.503 DEBUG:teuthology.orchestra.run.smithi174:mon.c> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T03:33:20.505 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T03:33:20.506 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T03:33:20.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:20 smithi084 ceph-mon[30941]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-21T03:33:20.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:20 smithi084 ceph-mon[30941]: Updating smithi174:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:20.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:20 smithi084 ceph-mon[30941]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:20.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:20 smithi084 ceph-mon[30941]: Updating smithi174:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:33:20.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:20 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:20.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:20 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:20.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:20 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:20.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:20 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:20.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:20 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:20.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:20 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:33:20.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:20 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:21.168 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:21.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:21 smithi084 ceph-mon[30941]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:21.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:21 smithi084 ceph-mon[30941]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi084:172.21.15.84=a;smithi172:172.21.15.172=b;smithi174:172.21.15.174=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:21.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:21 smithi084 ceph-mon[30941]: Saving service mon spec with placement smithi084:172.21.15.84=a;smithi172:172.21.15.172=b;smithi174:172.21.15.174=c;count:3 2024-09-21T03:33:21.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:21 smithi084 ceph-mon[30941]: Deploying daemon mon.c on smithi174 2024-09-21T03:33:21.941 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:33:21.941 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"e3f8c18e-77c9-11ef-baf5-efdc52797490","modified":"2024-09-21T03:31:52.325800Z","created":"2024-09-21T03:31:52.325800Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T03:33:21.942 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-09-21T03:33:22.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:22 smithi084 ceph-mon[30941]: from='client.? 172.21.15.174:0/4294597320' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:33:23.618 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T03:33:23.618 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T03:33:23.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:23 smithi084 ceph-mon[30941]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:24.018 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:33:24.868 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:24 smithi174 systemd[1]: Starting Ceph mon.c for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:33:24.869 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:24 smithi174 podman[34370]: 2024-09-21 03:33:24.769866695 +0000 UTC m=+0.015935631 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:33:24.898 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:33:24.899 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":1,"fsid":"e3f8c18e-77c9-11ef-baf5-efdc52797490","modified":"2024-09-21T03:31:52.325800Z","created":"2024-09-21T03:31:52.325800Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T03:33:24.899 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 1 2024-09-21T03:33:25.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:24 smithi174 podman[34370]: 2024-09-21 03:33:24.89283765 +0000 UTC m=+0.138906586 container create f32840962726ac1d7d9f7f3eef945593da04ef2be41a5bff425dee13764b6642 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:33:25.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 podman[34370]: 2024-09-21 03:33:25.270411848 +0000 UTC m=+0.516480783 container init f32840962726ac1d7d9f7f3eef945593da04ef2be41a5bff425dee13764b6642 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-c, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T03:33:25.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 podman[34370]: 2024-09-21 03:33:25.273549558 +0000 UTC m=+0.519618493 container start f32840962726ac1d7d9f7f3eef945593da04ef2be41a5bff425dee13764b6642 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-c, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:33:25.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T03:33:25.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T03:33:25.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: pidfile_write: ignore empty --pid-file 2024-09-21T03:33:25.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: load: jerasure load: lrc 2024-09-21T03:33:25.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: RocksDB version: 7.9.2 2024-09-21T03:33:25.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Git sha 0 2024-09-21T03:33:25.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T03:33:25.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: DB SUMMARY 2024-09-21T03:33:25.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: DB Session ID: CBS9YMWNVMZUJIRL6S16 2024-09-21T03:33:25.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: CURRENT file: CURRENT 2024-09-21T03:33:25.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T03:33:25.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T03:33:25.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T03:33:25.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-21T03:33:25.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.error_if_exists: 0 2024-09-21T03:33:25.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.create_if_missing: 0 2024-09-21T03:33:25.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.paranoid_checks: 1 2024-09-21T03:33:25.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T03:33:25.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T03:33:25.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T03:33:25.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.env: 0x5596e2904d60 2024-09-21T03:33:25.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T03:33:25.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.info_log: 0x5596e7cd1360 2024-09-21T03:33:25.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T03:33:25.632 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.statistics: (nil) 2024-09-21T03:33:25.632 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.use_fsync: 0 2024-09-21T03:33:25.632 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_log_file_size: 0 2024-09-21T03:33:25.632 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T03:33:25.632 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T03:33:25.632 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T03:33:25.633 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T03:33:25.633 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.allow_fallocate: 1 2024-09-21T03:33:25.633 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T03:33:25.633 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T03:33:25.633 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.use_direct_reads: 0 2024-09-21T03:33:25.633 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T03:33:25.633 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T03:33:25.633 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.db_log_dir: 2024-09-21T03:33:25.633 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.wal_dir: 2024-09-21T03:33:25.633 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T03:33:25.633 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T03:33:25.633 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T03:33:25.633 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T03:33:25.633 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T03:33:25.634 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T03:33:25.634 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T03:33:25.634 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T03:33:25.634 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.write_buffer_manager: 0x5596e7cd5d60 2024-09-21T03:33:25.634 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T03:33:25.634 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T03:33:25.634 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T03:33:25.634 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T03:33:25.634 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T03:33:25.634 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T03:33:25.634 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T03:33:25.634 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T03:33:25.634 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.unordered_write: 0 2024-09-21T03:33:25.635 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T03:33:25.635 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T03:33:25.635 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T03:33:25.635 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T03:33:25.635 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.row_cache: None 2024-09-21T03:33:25.635 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.wal_filter: None 2024-09-21T03:33:25.635 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T03:33:25.635 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T03:33:25.635 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.two_write_queues: 0 2024-09-21T03:33:25.635 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T03:33:25.635 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.wal_compression: 0 2024-09-21T03:33:25.635 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.atomic_flush: 0 2024-09-21T03:33:25.635 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T03:33:25.635 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T03:33:25.636 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T03:33:25.636 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.log_readahead_size: 0 2024-09-21T03:33:25.636 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T03:33:25.636 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T03:33:25.636 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T03:33:25.636 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T03:33:25.636 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T03:33:25.636 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T03:33:25.636 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T03:33:25.636 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_background_jobs: 2 2024-09-21T03:33:25.636 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_background_compactions: -1 2024-09-21T03:33:25.636 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_subcompactions: 1 2024-09-21T03:33:25.636 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T03:33:25.636 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T03:33:25.637 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T03:33:25.637 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T03:33:25.637 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T03:33:25.637 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T03:33:25.637 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T03:33:25.637 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T03:33:25.637 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_open_files: -1 2024-09-21T03:33:25.637 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T03:33:25.637 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T03:33:25.637 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T03:33:25.637 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T03:33:25.637 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_background_flushes: -1 2024-09-21T03:33:25.637 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Compression algorithms supported: 2024-09-21T03:33:25.637 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: kZSTD supported: 0 2024-09-21T03:33:25.637 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: kXpressCompression supported: 0 2024-09-21T03:33:25.638 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: kBZip2Compression supported: 0 2024-09-21T03:33:25.638 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T03:33:25.638 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: kLZ4Compression supported: 1 2024-09-21T03:33:25.638 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: kZlibCompression supported: 1 2024-09-21T03:33:25.638 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T03:33:25.638 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: kSnappyCompression supported: 1 2024-09-21T03:33:25.638 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T03:33:25.638 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T03:33:25.638 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T03:33:25.638 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T03:33:25.638 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T03:33:25.638 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.merge_operator: 2024-09-21T03:33:25.638 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compaction_filter: None 2024-09-21T03:33:25.639 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T03:33:25.639 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T03:33:25.639 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T03:33:25.639 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T03:33:25.639 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5596e7cd0fa0) 2024-09-21T03:33:25.639 INFO:journalctl@ceph.mon.c.smithi174.stdout: cache_index_and_filter_blocks: 1 2024-09-21T03:33:25.639 INFO:journalctl@ceph.mon.c.smithi174.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T03:33:25.639 INFO:journalctl@ceph.mon.c.smithi174.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T03:33:25.639 INFO:journalctl@ceph.mon.c.smithi174.stdout: pin_top_level_index_and_filter: 1 2024-09-21T03:33:25.639 INFO:journalctl@ceph.mon.c.smithi174.stdout: index_type: 0 2024-09-21T03:33:25.639 INFO:journalctl@ceph.mon.c.smithi174.stdout: data_block_index_type: 0 2024-09-21T03:33:25.639 INFO:journalctl@ceph.mon.c.smithi174.stdout: index_shortening: 1 2024-09-21T03:33:25.639 INFO:journalctl@ceph.mon.c.smithi174.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T03:33:25.639 INFO:journalctl@ceph.mon.c.smithi174.stdout: checksum: 4 2024-09-21T03:33:25.640 INFO:journalctl@ceph.mon.c.smithi174.stdout: no_block_cache: 0 2024-09-21T03:33:25.640 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_cache: 0x5596e3c95610 2024-09-21T03:33:25.640 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_cache_name: BinnedLRUCache 2024-09-21T03:33:25.640 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_cache_options: 2024-09-21T03:33:25.640 INFO:journalctl@ceph.mon.c.smithi174.stdout: capacity : 536870912 2024-09-21T03:33:25.640 INFO:journalctl@ceph.mon.c.smithi174.stdout: num_shard_bits : 4 2024-09-21T03:33:25.640 INFO:journalctl@ceph.mon.c.smithi174.stdout: strict_capacity_limit : 0 2024-09-21T03:33:25.640 INFO:journalctl@ceph.mon.c.smithi174.stdout: high_pri_pool_ratio: 0.000 2024-09-21T03:33:25.640 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_cache_compressed: (nil) 2024-09-21T03:33:25.640 INFO:journalctl@ceph.mon.c.smithi174.stdout: persistent_cache: (nil) 2024-09-21T03:33:25.640 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_size: 4096 2024-09-21T03:33:25.640 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_size_deviation: 10 2024-09-21T03:33:25.641 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_restart_interval: 16 2024-09-21T03:33:25.641 INFO:journalctl@ceph.mon.c.smithi174.stdout: index_block_restart_interval: 1 2024-09-21T03:33:25.641 INFO:journalctl@ceph.mon.c.smithi174.stdout: metadata_block_size: 4096 2024-09-21T03:33:25.641 INFO:journalctl@ceph.mon.c.smithi174.stdout: partition_filters: 0 2024-09-21T03:33:25.641 INFO:journalctl@ceph.mon.c.smithi174.stdout: use_delta_encoding: 1 2024-09-21T03:33:25.641 INFO:journalctl@ceph.mon.c.smithi174.stdout: filter_policy: bloomfilter 2024-09-21T03:33:25.641 INFO:journalctl@ceph.mon.c.smithi174.stdout: whole_key_filtering: 1 2024-09-21T03:33:25.641 INFO:journalctl@ceph.mon.c.smithi174.stdout: verify_compression: 0 2024-09-21T03:33:25.641 INFO:journalctl@ceph.mon.c.smithi174.stdout: read_amp_bytes_per_bit: 0 2024-09-21T03:33:25.641 INFO:journalctl@ceph.mon.c.smithi174.stdout: format_version: 5 2024-09-21T03:33:25.641 INFO:journalctl@ceph.mon.c.smithi174.stdout: enable_index_compression: 1 2024-09-21T03:33:25.641 INFO:journalctl@ceph.mon.c.smithi174.stdout: block_align: 0 2024-09-21T03:33:25.641 INFO:journalctl@ceph.mon.c.smithi174.stdout: max_auto_readahead_size: 262144 2024-09-21T03:33:25.641 INFO:journalctl@ceph.mon.c.smithi174.stdout: prepopulate_block_cache: 0 2024-09-21T03:33:25.641 INFO:journalctl@ceph.mon.c.smithi174.stdout: initial_auto_readahead_size: 8192 2024-09-21T03:33:25.642 INFO:journalctl@ceph.mon.c.smithi174.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T03:33:25.642 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T03:33:25.642 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T03:33:25.642 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compression: NoCompression 2024-09-21T03:33:25.642 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T03:33:25.642 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T03:33:25.642 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T03:33:25.642 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.num_levels: 7 2024-09-21T03:33:25.642 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T03:33:25.642 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T03:33:25.642 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T03:33:25.642 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T03:33:25.642 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T03:33:25.642 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T03:33:25.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T03:33:25.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T03:33:25.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T03:33:25.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T03:33:25.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T03:33:25.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T03:33:25.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T03:33:25.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T03:33:25.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T03:33:25.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T03:33:25.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T03:33:25.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T03:33:25.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T03:33:25.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T03:33:25.643 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T03:33:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T03:33:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T03:33:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T03:33:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T03:33:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T03:33:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T03:33:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T03:33:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T03:33:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T03:33:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T03:33:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T03:33:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T03:33:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T03:33:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T03:33:25.644 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T03:33:25.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T03:33:25.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T03:33:25.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T03:33:25.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T03:33:25.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T03:33:25.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T03:33:25.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T03:33:25.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T03:33:25.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T03:33:25.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T03:33:25.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T03:33:25.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T03:33:25.645 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T03:33:25.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T03:33:25.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T03:33:25.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T03:33:25.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T03:33:25.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T03:33:25.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.inplace_update_support: 0 2024-09-21T03:33:25.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T03:33:25.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T03:33:25.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T03:33:25.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T03:33:25.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.bloom_locality: 0 2024-09-21T03:33:25.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.max_successive_merges: 0 2024-09-21T03:33:25.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T03:33:25.646 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T03:33:25.647 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T03:33:25.647 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T03:33:25.647 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.ttl: 2592000 2024-09-21T03:33:25.647 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T03:33:25.647 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T03:33:25.647 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T03:33:25.647 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.enable_blob_files: false 2024-09-21T03:33:25.647 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.min_blob_size: 0 2024-09-21T03:33:25.647 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T03:33:25.647 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T03:33:25.647 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T03:33:25.647 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T03:33:25.647 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T03:33:25.647 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T03:33:25.648 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T03:33:25.648 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T03:33:25.648 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T03:33:25.648 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T03:33:25.648 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b93aff60-5b94-4c35-ab38-bd5e1db64e17 2024-09-21T03:33:25.648 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726889605311232, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T03:33:25.648 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T03:33:25.648 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726889605311664, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726889605, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b93aff60-5b94-4c35-ab38-bd5e1db64e17", "db_session_id": "CBS9YMWNVMZUJIRL6S16", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T03:33:25.648 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726889605311758, "job": 1, "event": "recovery_finished"} 2024-09-21T03:33:25.648 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T03:33:25.648 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T03:33:25.648 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5596e7cf4a80 2024-09-21T03:33:25.648 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: DB pointer 0x5596e8a9a000 2024-09-21T03:33:25.648 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T03:33:25.649 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T03:33:25.649 INFO:journalctl@ceph.mon.c.smithi174.stdout: ** DB Stats ** 2024-09-21T03:33:25.649 INFO:journalctl@ceph.mon.c.smithi174.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T03:33:25.649 INFO:journalctl@ceph.mon.c.smithi174.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T03:33:25.649 INFO:journalctl@ceph.mon.c.smithi174.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T03:33:25.649 INFO:journalctl@ceph.mon.c.smithi174.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T03:33:25.649 INFO:journalctl@ceph.mon.c.smithi174.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T03:33:25.649 INFO:journalctl@ceph.mon.c.smithi174.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T03:33:25.649 INFO:journalctl@ceph.mon.c.smithi174.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T03:33:25.649 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-09-21T03:33:25.649 INFO:journalctl@ceph.mon.c.smithi174.stdout: ** Compaction Stats [default] ** 2024-09-21T03:33:25.649 INFO:journalctl@ceph.mon.c.smithi174.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T03:33:25.649 INFO:journalctl@ceph.mon.c.smithi174.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T03:33:25.650 INFO:journalctl@ceph.mon.c.smithi174.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:33:25.650 INFO:journalctl@ceph.mon.c.smithi174.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:33:25.650 INFO:journalctl@ceph.mon.c.smithi174.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:33:25.650 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-09-21T03:33:25.650 INFO:journalctl@ceph.mon.c.smithi174.stdout: ** Compaction Stats [default] ** 2024-09-21T03:33:25.650 INFO:journalctl@ceph.mon.c.smithi174.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T03:33:25.650 INFO:journalctl@ceph.mon.c.smithi174.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T03:33:25.650 INFO:journalctl@ceph.mon.c.smithi174.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:33:25.650 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-09-21T03:33:25.650 INFO:journalctl@ceph.mon.c.smithi174.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T03:33:25.650 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-09-21T03:33:25.650 INFO:journalctl@ceph.mon.c.smithi174.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T03:33:25.650 INFO:journalctl@ceph.mon.c.smithi174.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T03:33:25.650 INFO:journalctl@ceph.mon.c.smithi174.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T03:33:25.651 INFO:journalctl@ceph.mon.c.smithi174.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T03:33:25.651 INFO:journalctl@ceph.mon.c.smithi174.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T03:33:25.651 INFO:journalctl@ceph.mon.c.smithi174.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T03:33:25.651 INFO:journalctl@ceph.mon.c.smithi174.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T03:33:25.651 INFO:journalctl@ceph.mon.c.smithi174.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T03:33:25.651 INFO:journalctl@ceph.mon.c.smithi174.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T03:33:25.651 INFO:journalctl@ceph.mon.c.smithi174.stdout: Block cache BinnedLRUCache@0x5596e3c95610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T03:33:25.651 INFO:journalctl@ceph.mon.c.smithi174.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T03:33:25.651 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-09-21T03:33:25.651 INFO:journalctl@ceph.mon.c.smithi174.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T03:33:25.651 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T03:33:25.651 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: using public_addr v2:172.21.15.174:0/0 -> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] 2024-09-21T03:33:25.651 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: starting mon.c rank -1 at public addrs [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] at bind addrs [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:33:25.651 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: mon.c@-1(???) e0 preinit fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:33:25.652 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T03:33:25.652 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T03:33:25.652 INFO:journalctl@ceph.mon.c.smithi174.stdout: e1 2024-09-21T03:33:25.652 INFO:journalctl@ceph.mon.c.smithi174.stdout: btime 2024-09-21T03:31:55:306808+0000 2024-09-21T03:33:25.652 INFO:journalctl@ceph.mon.c.smithi174.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T03:33:25.652 INFO:journalctl@ceph.mon.c.smithi174.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T03:33:25.652 INFO:journalctl@ceph.mon.c.smithi174.stdout: legacy client fscid: -1 2024-09-21T03:33:25.652 INFO:journalctl@ceph.mon.c.smithi174.stdout: 2024-09-21T03:33:25.652 INFO:journalctl@ceph.mon.c.smithi174.stdout: No filesystems configured 2024-09-21T03:33:25.652 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T03:33:25.652 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T03:33:25.652 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T03:33:25.652 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T03:33:25.652 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T03:33:25.652 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T03:33:25.653 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T03:33:25.653 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:33:25.653 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:33:25.653 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:33:25.653 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: Deploying cephadm binary to smithi172 2024-09-21T03:33:25.653 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.653 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: Added host smithi172 2024-09-21T03:33:25.653 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:25.653 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.653 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.653 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:25.653 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.653 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:33:25.653 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi174", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:25.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:25.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: Deploying cephadm binary to smithi174 2024-09-21T03:33:25.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"} : dispatch 2024-09-21T03:33:25.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:25.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:25.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-21T03:33:25.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.654 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: Updating smithi172:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:25.655 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:25.655 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: Updating smithi172:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:33:25.655 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:25.655 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.655 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:25.655 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.655 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.655 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: Added host smithi174 2024-09-21T03:33:25.655 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.655 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:25.655 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:33:25.655 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1707042142' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T03:33:25.655 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:25.655 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1707042142' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T03:33:25.655 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:33:25.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi174", "name": "osd_memory_target"} : dispatch 2024-09-21T03:33:25.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:25.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:25.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-21T03:33:25.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: Updating smithi174:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:25.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:25.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: Updating smithi174:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:33:25.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:25.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:25.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:25.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:25.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:33:25.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:25.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:25.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi084:172.21.15.84=a;smithi172:172.21.15.172=b;smithi174:172.21.15.174=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:25.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: Saving service mon spec with placement smithi084:172.21.15.84=a;smithi172:172.21.15.172=b;smithi174:172.21.15.174=c;count:3 2024-09-21T03:33:25.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: Deploying daemon mon.c on smithi174 2024-09-21T03:33:25.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: from='client.? 172.21.15.174:0/4294597320' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:33:25.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:25.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 ceph-mon[34403]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T03:33:25.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 bash[34370]: f32840962726ac1d7d9f7f3eef945593da04ef2be41a5bff425dee13764b6642 2024-09-21T03:33:25.658 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:25 smithi174 systemd[1]: Started Ceph mon.c for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:33:26.770 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T03:33:26.770 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T03:33:27.036 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:33:30.695 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:33:30.695 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":2,"fsid":"e3f8c18e-77c9-11ef-baf5-efdc52797490","modified":"2024-09-21T03:33:25.339093Z","created":"2024-09-21T03:31:52.325800Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T03:33:30.695 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 2 2024-09-21T03:33:30.696 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:33:30.696 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:30.696 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: mon.a calling monitor election 2024-09-21T03:33:30.696 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:30.696 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:30.696 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:30.696 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: mon.c calling monitor election 2024-09-21T03:33:30.696 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:30.696 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:30.696 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:30.696 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:30.696 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T03:33:30.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: monmap epoch 2 2024-09-21T03:33:30.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:33:30.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: last_changed 2024-09-21T03:33:25.339093+0000 2024-09-21T03:33:30.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: created 2024-09-21T03:31:52.325800+0000 2024-09-21T03:33:30.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: min_mon_release 19 (squid) 2024-09-21T03:33:30.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: election_strategy: 1 2024-09-21T03:33:30.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T03:33:30.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-21T03:33:30.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: fsmap 2024-09-21T03:33:30.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:33:30.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: mgrmap e14: x(active, since 40s) 2024-09-21T03:33:30.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: overall HEALTH_OK 2024-09-21T03:33:30.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:30.697 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:30.698 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:30.698 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:33:30.698 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:30 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:30.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:33:30.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:30.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: mon.a calling monitor election 2024-09-21T03:33:30.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:30.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:30.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:30.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: mon.c calling monitor election 2024-09-21T03:33:30.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:30.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:30.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:30.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:30.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T03:33:30.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: monmap epoch 2 2024-09-21T03:33:30.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:33:30.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: last_changed 2024-09-21T03:33:25.339093+0000 2024-09-21T03:33:30.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: created 2024-09-21T03:31:52.325800+0000 2024-09-21T03:33:30.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: min_mon_release 19 (squid) 2024-09-21T03:33:30.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: election_strategy: 1 2024-09-21T03:33:30.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T03:33:30.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-21T03:33:30.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: fsmap 2024-09-21T03:33:30.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:33:30.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: mgrmap e14: x(active, since 40s) 2024-09-21T03:33:30.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: overall HEALTH_OK 2024-09-21T03:33:30.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:30.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:30.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:30.821 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:33:30.821 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:30 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:31.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:31 smithi174 ceph-mon[34403]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:31.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:31 smithi174 ceph-mon[34403]: Deploying daemon mon.b on smithi172 2024-09-21T03:33:31.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:31 smithi174 ceph-mon[34403]: from='client.? 172.21.15.174:0/1578093916' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:33:31.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:31 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:31.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:31 smithi084 ceph-mon[30941]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:31.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:31 smithi084 ceph-mon[30941]: Deploying daemon mon.b on smithi172 2024-09-21T03:33:31.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:31 smithi084 ceph-mon[30941]: from='client.? 172.21.15.174:0/1578093916' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:33:31.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:31 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:32.276 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T03:33:32.276 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T03:33:32.530 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:33:33.202 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:33:33.202 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":2,"fsid":"e3f8c18e-77c9-11ef-baf5-efdc52797490","modified":"2024-09-21T03:33:25.339093Z","created":"2024-09-21T03:31:52.325800Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T03:33:33.202 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 2 2024-09-21T03:33:33.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:33 smithi174 ceph-mon[34403]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:33.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:33 smithi174 ceph-mon[34403]: from='client.? 172.21.15.174:0/167772688' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:33:33.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:33 smithi084 ceph-mon[30941]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:33.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:33 smithi084 ceph-mon[30941]: from='client.? 172.21.15.174:0/167772688' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:33:34.072 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 podman[34802]: 2024-09-21 03:33:34.038243222 +0000 UTC m=+0.337466806 container start c615e4b57be25a74f5c460a4ba4f5a89a9d9b694d1fe08a409830f2fd2b81c4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-b, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:33:34.072 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T03:33:34.072 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T03:33:34.072 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: pidfile_write: ignore empty --pid-file 2024-09-21T03:33:34.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: load: jerasure load: lrc 2024-09-21T03:33:34.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: RocksDB version: 7.9.2 2024-09-21T03:33:34.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Git sha 0 2024-09-21T03:33:34.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T03:33:34.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: DB SUMMARY 2024-09-21T03:33:34.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: DB Session ID: LP2IYHIF7J1P3N38IOCI 2024-09-21T03:33:34.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: CURRENT file: CURRENT 2024-09-21T03:33:34.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T03:33:34.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T03:33:34.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-21T03:33:34.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-21T03:33:34.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.error_if_exists: 0 2024-09-21T03:33:34.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.create_if_missing: 0 2024-09-21T03:33:34.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.paranoid_checks: 1 2024-09-21T03:33:34.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T03:33:34.403 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T03:33:34.403 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T03:33:34.403 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.env: 0x55b13336ed60 2024-09-21T03:33:34.403 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T03:33:34.403 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.info_log: 0x55b139357360 2024-09-21T03:33:34.403 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T03:33:34.403 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.statistics: (nil) 2024-09-21T03:33:34.403 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.use_fsync: 0 2024-09-21T03:33:34.403 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_log_file_size: 0 2024-09-21T03:33:34.403 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T03:33:34.403 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T03:33:34.403 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T03:33:34.403 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T03:33:34.403 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.allow_fallocate: 1 2024-09-21T03:33:34.404 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T03:33:34.404 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T03:33:34.404 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.use_direct_reads: 0 2024-09-21T03:33:34.404 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T03:33:34.404 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T03:33:34.404 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.db_log_dir: 2024-09-21T03:33:34.404 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.wal_dir: 2024-09-21T03:33:34.404 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T03:33:34.404 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T03:33:34.404 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T03:33:34.404 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T03:33:34.405 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T03:33:34.405 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T03:33:34.405 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T03:33:34.406 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T03:33:34.406 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.write_buffer_manager: 0x55b13935bd60 2024-09-21T03:33:34.406 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T03:33:34.406 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T03:33:34.406 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T03:33:34.406 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T03:33:34.406 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T03:33:34.406 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T03:33:34.406 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T03:33:34.406 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T03:33:34.406 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.unordered_write: 0 2024-09-21T03:33:34.406 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T03:33:34.406 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T03:33:34.407 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T03:33:34.407 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T03:33:34.407 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.row_cache: None 2024-09-21T03:33:34.407 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.wal_filter: None 2024-09-21T03:33:34.407 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T03:33:34.407 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T03:33:34.407 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.two_write_queues: 0 2024-09-21T03:33:34.407 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T03:33:34.407 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.wal_compression: 0 2024-09-21T03:33:34.407 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.atomic_flush: 0 2024-09-21T03:33:34.407 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T03:33:34.407 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T03:33:34.407 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T03:33:34.407 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.log_readahead_size: 0 2024-09-21T03:33:34.407 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T03:33:34.408 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T03:33:34.408 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T03:33:34.408 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T03:33:34.408 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T03:33:34.408 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T03:33:34.408 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T03:33:34.408 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_background_jobs: 2 2024-09-21T03:33:34.408 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_background_compactions: -1 2024-09-21T03:33:34.408 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_subcompactions: 1 2024-09-21T03:33:34.408 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T03:33:34.408 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T03:33:34.408 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T03:33:34.408 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T03:33:34.408 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T03:33:34.408 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T03:33:34.409 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T03:33:34.409 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T03:33:34.409 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_open_files: -1 2024-09-21T03:33:34.409 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T03:33:34.409 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T03:33:34.409 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T03:33:34.409 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T03:33:34.409 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_background_flushes: -1 2024-09-21T03:33:34.409 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Compression algorithms supported: 2024-09-21T03:33:34.409 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: kZSTD supported: 0 2024-09-21T03:33:34.409 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: kXpressCompression supported: 0 2024-09-21T03:33:34.409 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: kBZip2Compression supported: 0 2024-09-21T03:33:34.409 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T03:33:34.409 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: kLZ4Compression supported: 1 2024-09-21T03:33:34.410 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: kZlibCompression supported: 1 2024-09-21T03:33:34.410 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T03:33:34.410 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: kSnappyCompression supported: 1 2024-09-21T03:33:34.410 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T03:33:34.410 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T03:33:34.410 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-21T03:33:34.410 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T03:33:34.410 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T03:33:34.410 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.merge_operator: 2024-09-21T03:33:34.410 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compaction_filter: None 2024-09-21T03:33:34.410 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T03:33:34.410 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T03:33:34.410 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T03:33:34.410 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T03:33:34.411 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b139356fa0) 2024-09-21T03:33:34.411 INFO:journalctl@ceph.mon.b.smithi172.stdout: cache_index_and_filter_blocks: 1 2024-09-21T03:33:34.411 INFO:journalctl@ceph.mon.b.smithi172.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T03:33:34.411 INFO:journalctl@ceph.mon.b.smithi172.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T03:33:34.411 INFO:journalctl@ceph.mon.b.smithi172.stdout: pin_top_level_index_and_filter: 1 2024-09-21T03:33:34.411 INFO:journalctl@ceph.mon.b.smithi172.stdout: index_type: 0 2024-09-21T03:33:34.411 INFO:journalctl@ceph.mon.b.smithi172.stdout: data_block_index_type: 0 2024-09-21T03:33:34.411 INFO:journalctl@ceph.mon.b.smithi172.stdout: index_shortening: 1 2024-09-21T03:33:34.411 INFO:journalctl@ceph.mon.b.smithi172.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T03:33:34.411 INFO:journalctl@ceph.mon.b.smithi172.stdout: checksum: 4 2024-09-21T03:33:34.411 INFO:journalctl@ceph.mon.b.smithi172.stdout: no_block_cache: 0 2024-09-21T03:33:34.411 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_cache: 0x55b13531b610 2024-09-21T03:33:34.411 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_cache_name: BinnedLRUCache 2024-09-21T03:33:34.411 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_cache_options: 2024-09-21T03:33:34.411 INFO:journalctl@ceph.mon.b.smithi172.stdout: capacity : 536870912 2024-09-21T03:33:34.412 INFO:journalctl@ceph.mon.b.smithi172.stdout: num_shard_bits : 4 2024-09-21T03:33:34.412 INFO:journalctl@ceph.mon.b.smithi172.stdout: strict_capacity_limit : 0 2024-09-21T03:33:34.412 INFO:journalctl@ceph.mon.b.smithi172.stdout: high_pri_pool_ratio: 0.000 2024-09-21T03:33:34.412 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_cache_compressed: (nil) 2024-09-21T03:33:34.412 INFO:journalctl@ceph.mon.b.smithi172.stdout: persistent_cache: (nil) 2024-09-21T03:33:34.412 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_size: 4096 2024-09-21T03:33:34.412 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_size_deviation: 10 2024-09-21T03:33:34.412 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_restart_interval: 16 2024-09-21T03:33:34.412 INFO:journalctl@ceph.mon.b.smithi172.stdout: index_block_restart_interval: 1 2024-09-21T03:33:34.412 INFO:journalctl@ceph.mon.b.smithi172.stdout: metadata_block_size: 4096 2024-09-21T03:33:34.412 INFO:journalctl@ceph.mon.b.smithi172.stdout: partition_filters: 0 2024-09-21T03:33:34.412 INFO:journalctl@ceph.mon.b.smithi172.stdout: use_delta_encoding: 1 2024-09-21T03:33:34.412 INFO:journalctl@ceph.mon.b.smithi172.stdout: filter_policy: bloomfilter 2024-09-21T03:33:34.412 INFO:journalctl@ceph.mon.b.smithi172.stdout: whole_key_filtering: 1 2024-09-21T03:33:34.413 INFO:journalctl@ceph.mon.b.smithi172.stdout: verify_compression: 0 2024-09-21T03:33:34.413 INFO:journalctl@ceph.mon.b.smithi172.stdout: read_amp_bytes_per_bit: 0 2024-09-21T03:33:34.413 INFO:journalctl@ceph.mon.b.smithi172.stdout: format_version: 5 2024-09-21T03:33:34.413 INFO:journalctl@ceph.mon.b.smithi172.stdout: enable_index_compression: 1 2024-09-21T03:33:34.413 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_align: 0 2024-09-21T03:33:34.413 INFO:journalctl@ceph.mon.b.smithi172.stdout: max_auto_readahead_size: 262144 2024-09-21T03:33:34.413 INFO:journalctl@ceph.mon.b.smithi172.stdout: prepopulate_block_cache: 0 2024-09-21T03:33:34.413 INFO:journalctl@ceph.mon.b.smithi172.stdout: initial_auto_readahead_size: 8192 2024-09-21T03:33:34.413 INFO:journalctl@ceph.mon.b.smithi172.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T03:33:34.413 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T03:33:34.413 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T03:33:34.413 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compression: NoCompression 2024-09-21T03:33:34.413 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T03:33:34.413 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T03:33:34.413 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T03:33:34.414 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.num_levels: 7 2024-09-21T03:33:34.414 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T03:33:34.414 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T03:33:34.414 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T03:33:34.414 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T03:33:34.414 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T03:33:34.414 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T03:33:34.414 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T03:33:34.414 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T03:33:34.414 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T03:33:34.414 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T03:33:34.414 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T03:33:34.414 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T03:33:34.415 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T03:33:34.415 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T03:33:34.415 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T03:33:34.415 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T03:33:34.415 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T03:33:34.415 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T03:33:34.415 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T03:33:34.415 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T03:33:34.415 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T03:33:34.415 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T03:33:34.415 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T03:33:34.415 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T03:33:34.415 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T03:33:34.415 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T03:33:34.415 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T03:33:34.416 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T03:33:34.416 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T03:33:34.416 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T03:33:34.416 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T03:33:34.416 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T03:33:34.416 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T03:33:34.416 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T03:33:34.416 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T03:33:34.416 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T03:33:34.416 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T03:33:34.416 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T03:33:34.416 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T03:33:34.416 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T03:33:34.416 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T03:33:34.417 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T03:33:34.417 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T03:33:34.417 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T03:33:34.417 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T03:33:34.417 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T03:33:34.417 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T03:33:34.417 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T03:33:34.417 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T03:33:34.417 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T03:33:34.417 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T03:33:34.417 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T03:33:34.417 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T03:33:34.417 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T03:33:34.417 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.inplace_update_support: 0 2024-09-21T03:33:34.417 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T03:33:34.418 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T03:33:34.418 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T03:33:34.418 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T03:33:34.418 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.bloom_locality: 0 2024-09-21T03:33:34.418 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.max_successive_merges: 0 2024-09-21T03:33:34.418 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T03:33:34.418 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T03:33:34.418 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T03:33:34.418 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T03:33:34.418 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.ttl: 2592000 2024-09-21T03:33:34.418 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T03:33:34.418 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T03:33:34.418 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T03:33:34.419 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.enable_blob_files: false 2024-09-21T03:33:34.419 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.min_blob_size: 0 2024-09-21T03:33:34.419 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T03:33:34.419 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T03:33:34.419 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T03:33:34.419 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T03:33:34.419 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T03:33:34.419 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T03:33:34.419 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T03:33:34.419 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T03:33:34.419 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T03:33:34.419 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T03:33:34.419 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f719bbc3-e621-4fa8-a295-521358822e63 2024-09-21T03:33:34.419 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726889614075575, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T03:33:34.419 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T03:33:34.420 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726889614075996, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726889614, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f719bbc3-e621-4fa8-a295-521358822e63", "db_session_id": "LP2IYHIF7J1P3N38IOCI", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T03:33:34.420 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726889614076092, "job": 1, "event": "recovery_finished"} 2024-09-21T03:33:34.420 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T03:33:34.420 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T03:33:34.420 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55b13937aa80 2024-09-21T03:33:34.420 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: DB pointer 0x55b13a120000 2024-09-21T03:33:34.420 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T03:33:34.420 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T03:33:34.420 INFO:journalctl@ceph.mon.b.smithi172.stdout: ** DB Stats ** 2024-09-21T03:33:34.420 INFO:journalctl@ceph.mon.b.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T03:33:34.420 INFO:journalctl@ceph.mon.b.smithi172.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T03:33:34.420 INFO:journalctl@ceph.mon.b.smithi172.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T03:33:34.420 INFO:journalctl@ceph.mon.b.smithi172.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T03:33:34.420 INFO:journalctl@ceph.mon.b.smithi172.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T03:33:34.420 INFO:journalctl@ceph.mon.b.smithi172.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T03:33:34.421 INFO:journalctl@ceph.mon.b.smithi172.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T03:33:34.421 INFO:journalctl@ceph.mon.b.smithi172.stdout: 2024-09-21T03:33:34.421 INFO:journalctl@ceph.mon.b.smithi172.stdout: ** Compaction Stats [default] ** 2024-09-21T03:33:34.421 INFO:journalctl@ceph.mon.b.smithi172.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T03:33:34.421 INFO:journalctl@ceph.mon.b.smithi172.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T03:33:34.421 INFO:journalctl@ceph.mon.b.smithi172.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:33:34.421 INFO:journalctl@ceph.mon.b.smithi172.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:33:34.421 INFO:journalctl@ceph.mon.b.smithi172.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:33:34.421 INFO:journalctl@ceph.mon.b.smithi172.stdout: 2024-09-21T03:33:34.421 INFO:journalctl@ceph.mon.b.smithi172.stdout: ** Compaction Stats [default] ** 2024-09-21T03:33:34.421 INFO:journalctl@ceph.mon.b.smithi172.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T03:33:34.421 INFO:journalctl@ceph.mon.b.smithi172.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T03:33:34.421 INFO:journalctl@ceph.mon.b.smithi172.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:33:34.421 INFO:journalctl@ceph.mon.b.smithi172.stdout: 2024-09-21T03:33:34.421 INFO:journalctl@ceph.mon.b.smithi172.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T03:33:34.422 INFO:journalctl@ceph.mon.b.smithi172.stdout: 2024-09-21T03:33:34.422 INFO:journalctl@ceph.mon.b.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T03:33:34.422 INFO:journalctl@ceph.mon.b.smithi172.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T03:33:34.422 INFO:journalctl@ceph.mon.b.smithi172.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T03:33:34.422 INFO:journalctl@ceph.mon.b.smithi172.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T03:33:34.422 INFO:journalctl@ceph.mon.b.smithi172.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T03:33:34.422 INFO:journalctl@ceph.mon.b.smithi172.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T03:33:34.422 INFO:journalctl@ceph.mon.b.smithi172.stdout: Cumulative compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T03:33:34.422 INFO:journalctl@ceph.mon.b.smithi172.stdout: Interval compaction: 0.00 GB write, 0.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T03:33:34.422 INFO:journalctl@ceph.mon.b.smithi172.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T03:33:34.422 INFO:journalctl@ceph.mon.b.smithi172.stdout: Block cache BinnedLRUCache@0x55b13531b610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T03:33:34.422 INFO:journalctl@ceph.mon.b.smithi172.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T03:33:34.422 INFO:journalctl@ceph.mon.b.smithi172.stdout: 2024-09-21T03:33:34.423 INFO:journalctl@ceph.mon.b.smithi172.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T03:33:34.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-21T03:33:34.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: using public_addr v2:172.21.15.172:0/0 -> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-09-21T03:33:34.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: starting mon.b rank -1 at public addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] at bind addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:33:34.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: mon.b@-1(???) e0 preinit fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:33:34.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: mon.b@-1(synchronizing).mds e1 new map 2024-09-21T03:33:34.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-21T03:33:34.423 INFO:journalctl@ceph.mon.b.smithi172.stdout: e1 2024-09-21T03:33:34.423 INFO:journalctl@ceph.mon.b.smithi172.stdout: btime 2024-09-21T03:31:55:306808+0000 2024-09-21T03:33:34.423 INFO:journalctl@ceph.mon.b.smithi172.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T03:33:34.423 INFO:journalctl@ceph.mon.b.smithi172.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T03:33:34.423 INFO:journalctl@ceph.mon.b.smithi172.stdout: legacy client fscid: -1 2024-09-21T03:33:34.423 INFO:journalctl@ceph.mon.b.smithi172.stdout: 2024-09-21T03:33:34.423 INFO:journalctl@ceph.mon.b.smithi172.stdout: No filesystems configured 2024-09-21T03:33:34.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T03:33:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T03:33:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T03:33:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T03:33:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T03:33:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T03:33:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T03:33:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:33:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:33:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:33:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: Deploying cephadm binary to smithi172 2024-09-21T03:33:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: Added host smithi172 2024-09-21T03:33:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:34.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:33:34.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi174", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:34.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:34.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: Deploying cephadm binary to smithi174 2024-09-21T03:33:34.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"} : dispatch 2024-09-21T03:33:34.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:34.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:34.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-21T03:33:34.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: Updating smithi172:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:34.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:34.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: Updating smithi172:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:33:34.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:34.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:34.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: Added host smithi174 2024-09-21T03:33:34.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:34.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:33:34.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1707042142' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T03:33:34.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:34.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1707042142' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T03:33:34.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:33:34.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi174", "name": "osd_memory_target"} : dispatch 2024-09-21T03:33:34.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:34.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:34.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-21T03:33:34.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: Updating smithi174:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:34.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:34.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: Updating smithi174:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:33:34.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:33:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi084:172.21.15.84=a;smithi172:172.21.15.172=b;smithi174:172.21.15.174=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: Saving service mon spec with placement smithi084:172.21.15.84=a;smithi172:172.21.15.172=b;smithi174:172.21.15.174=c;count:3 2024-09-21T03:33:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: Deploying daemon mon.c on smithi174 2024-09-21T03:33:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='client.? 172.21.15.174:0/4294597320' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:33:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:33:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: mon.a calling monitor election 2024-09-21T03:33:34.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:34.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:34.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:34.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: mon.c calling monitor election 2024-09-21T03:33:34.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:34.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:34.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:34.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:34.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T03:33:34.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: monmap epoch 2 2024-09-21T03:33:34.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:33:34.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: last_changed 2024-09-21T03:33:25.339093+0000 2024-09-21T03:33:34.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: created 2024-09-21T03:31:52.325800+0000 2024-09-21T03:33:34.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: min_mon_release 19 (squid) 2024-09-21T03:33:34.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: election_strategy: 1 2024-09-21T03:33:34.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T03:33:34.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-21T03:33:34.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: fsmap 2024-09-21T03:33:34.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:33:34.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: mgrmap e14: x(active, since 40s) 2024-09-21T03:33:34.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: overall HEALTH_OK 2024-09-21T03:33:34.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:34.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:33:34.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:34.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:34.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: Deploying daemon mon.b on smithi172 2024-09-21T03:33:34.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='client.? 172.21.15.174:0/1578093916' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:33:34.432 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:34.432 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:34.432 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: from='client.? 172.21.15.174:0/167772688' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:33:34.432 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 ceph-mon[34821]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T03:33:34.432 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 bash[34802]: c615e4b57be25a74f5c460a4ba4f5a89a9d9b694d1fe08a409830f2fd2b81c4e 2024-09-21T03:33:34.432 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:34 smithi172 systemd[1]: Started Ceph mon.b for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:33:34.731 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T03:33:34.731 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T03:33:34.979 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:33:39.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:39.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:33:39.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:39.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: mon.a calling monitor election 2024-09-21T03:33:39.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: mon.c calling monitor election 2024-09-21T03:33:39.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:39.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:39.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:39.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:39.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: mon.b calling monitor election 2024-09-21T03:33:39.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:39.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:39.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:39.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:39.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T03:33:39.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: monmap epoch 3 2024-09-21T03:33:39.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:33:39.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: last_changed 2024-09-21T03:33:34.104217+0000 2024-09-21T03:33:39.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: created 2024-09-21T03:31:52.325800+0000 2024-09-21T03:33:39.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: min_mon_release 19 (squid) 2024-09-21T03:33:39.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: election_strategy: 1 2024-09-21T03:33:39.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T03:33:39.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-21T03:33:39.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: 2: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-09-21T03:33:39.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: fsmap 2024-09-21T03:33:39.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:33:39.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: mgrmap e14: x(active, since 49s) 2024-09-21T03:33:39.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: overall HEALTH_OK 2024-09-21T03:33:39.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:39.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:39.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:39.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:39 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:39.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:39.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:33:39.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:39.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: mon.a calling monitor election 2024-09-21T03:33:39.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: mon.c calling monitor election 2024-09-21T03:33:39.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:39.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:39.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:39.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:39.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: mon.b calling monitor election 2024-09-21T03:33:39.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:39.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:39.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:39.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:39.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T03:33:39.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: monmap epoch 3 2024-09-21T03:33:39.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:33:39.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: last_changed 2024-09-21T03:33:34.104217+0000 2024-09-21T03:33:39.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: created 2024-09-21T03:31:52.325800+0000 2024-09-21T03:33:39.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: min_mon_release 19 (squid) 2024-09-21T03:33:39.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: election_strategy: 1 2024-09-21T03:33:39.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T03:33:39.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-21T03:33:39.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: 2: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-09-21T03:33:39.631 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: fsmap 2024-09-21T03:33:39.631 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:33:39.631 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: mgrmap e14: x(active, since 49s) 2024-09-21T03:33:39.631 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: overall HEALTH_OK 2024-09-21T03:33:39.631 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:39.631 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:39.631 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:39.631 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:39 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:33:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: mon.a calling monitor election 2024-09-21T03:33:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: mon.c calling monitor election 2024-09-21T03:33:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: mon.b calling monitor election 2024-09-21T03:33:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:39.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T03:33:39.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: monmap epoch 3 2024-09-21T03:33:39.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:33:39.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: last_changed 2024-09-21T03:33:34.104217+0000 2024-09-21T03:33:39.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: created 2024-09-21T03:31:52.325800+0000 2024-09-21T03:33:39.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: min_mon_release 19 (squid) 2024-09-21T03:33:39.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: election_strategy: 1 2024-09-21T03:33:39.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: 0: [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] mon.a 2024-09-21T03:33:39.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: 1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.c 2024-09-21T03:33:39.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: 2: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-09-21T03:33:39.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: fsmap 2024-09-21T03:33:39.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:33:39.654 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: mgrmap e14: x(active, since 49s) 2024-09-21T03:33:39.654 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: overall HEALTH_OK 2024-09-21T03:33:39.654 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:39.654 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:39.654 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:39.654 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:39 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:40.104 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:33:40.104 INFO:teuthology.orchestra.run.smithi174.stdout:{"epoch":3,"fsid":"e3f8c18e-77c9-11ef-baf5-efdc52797490","modified":"2024-09-21T03:33:34.104217Z","created":"2024-09-21T03:31:52.325800Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:3300","nonce":0},{"type":"v1","addr":"172.21.15.84:6789","nonce":0}]},"addr":"172.21.15.84:6789/0","public_addr":"172.21.15.84:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:3300","nonce":0},{"type":"v1","addr":"172.21.15.174:6789","nonce":0}]},"addr":"172.21.15.174:6789/0","public_addr":"172.21.15.174:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T03:33:40.104 INFO:teuthology.orchestra.run.smithi174.stderr:dumped monmap epoch 3 2024-09-21T03:33:40.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:40 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:40.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:40 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:40.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:40 smithi174 ceph-mon[34403]: from='client.? 172.21.15.174:0/343271333' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:33:40.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:40 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:40.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:40 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:40.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:40 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:40.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:40 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:40.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:40 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:40.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:40 smithi084 ceph-mon[30941]: from='client.? 172.21.15.174:0/343271333' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:33:40.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:40 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:40.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:40 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:40.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:40 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:40 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:40 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:40 smithi172 ceph-mon[34821]: from='client.? 172.21.15.174:0/343271333' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:33:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:40 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:40 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:40 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:40.847 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T03:33:40.847 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T03:33:41.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:41.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:41.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:41.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-21T03:33:41.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-21T03:33:41.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-21T03:33:41.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: Updating smithi172:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:41.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: Updating smithi174:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:41.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: Updating smithi084:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:41.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:33:41.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:33:41.570 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:41 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:41.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:41.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:41.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:41.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-21T03:33:41.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-21T03:33:41.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-21T03:33:41.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: Updating smithi172:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:41.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: Updating smithi174:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:41.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: Updating smithi084:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:41.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:33:41.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:33:41.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:41 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-21T03:33:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-21T03:33:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-21T03:33:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: Updating smithi172:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: Updating smithi174:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: Updating smithi084:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:41.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:33:41.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:33:41.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:41 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:41.905 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:42.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:42 smithi172 ceph-mon[34821]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T03:33:42.480 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:42 smithi172 ceph-mon[34821]: Reconfiguring daemon mon.a on smithi084 2024-09-21T03:33:42.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:42 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:42.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:42 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:42.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:42 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:33:42.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:42 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:33:42.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:42 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:42.521 INFO:teuthology.orchestra.run.smithi084.stdout:# minimal ceph.conf for e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:33:42.521 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2024-09-21T03:33:42.521 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:33:42.521 INFO:teuthology.orchestra.run.smithi084.stdout: mon_host = [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] 2024-09-21T03:33:42.521 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:42 smithi084 ceph-mon[30941]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T03:33:42.521 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:42 smithi084 ceph-mon[30941]: Reconfiguring daemon mon.a on smithi084 2024-09-21T03:33:42.521 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:42 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:42.521 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:42 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:42.521 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:42 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:33:42.522 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:42 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:33:42.522 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:42 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:42.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:42 smithi174 ceph-mon[34403]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T03:33:42.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:42 smithi174 ceph-mon[34403]: Reconfiguring daemon mon.a on smithi084 2024-09-21T03:33:42.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:42 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:42.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:42 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:42.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:42 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:33:42.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:42 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:33:42.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:42 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:43.106 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T03:33:43.106 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T03:33:43.106 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T03:33:43.134 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T03:33:43.134 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:43.200 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T03:33:43.200 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T03:33:43.229 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T03:33:43.229 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:43.293 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T03:33:43.294 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T03:33:43.321 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T03:33:43.321 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:43.387 INFO:tasks.cephadm:enabling module snap_schedule 2024-09-21T03:33:43.387 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-09-21T03:33:43.503 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:43 smithi174 ceph-mon[34403]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:43.503 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:43 smithi174 ceph-mon[34403]: Reconfiguring mon.b (monmap changed)... 2024-09-21T03:33:43.504 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:43 smithi174 ceph-mon[34403]: Reconfiguring daemon mon.b on smithi172 2024-09-21T03:33:43.504 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:43 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2448522908' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:43.504 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:43 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:43.504 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:43 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:43.504 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:43 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:33:43.504 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:43 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:33:43.504 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:43 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:43.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:43 smithi084 ceph-mon[30941]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:43.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:43 smithi084 ceph-mon[30941]: Reconfiguring mon.b (monmap changed)... 2024-09-21T03:33:43.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:43 smithi084 ceph-mon[30941]: Reconfiguring daemon mon.b on smithi172 2024-09-21T03:33:43.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:43 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2448522908' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:43.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:43 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:43.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:43 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:43.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:43 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:33:43.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:43 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:33:43.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:43 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:43.639 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:43 smithi172 ceph-mon[34821]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:43 smithi172 ceph-mon[34821]: Reconfiguring mon.b (monmap changed)... 2024-09-21T03:33:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:43 smithi172 ceph-mon[34821]: Reconfiguring daemon mon.b on smithi172 2024-09-21T03:33:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:43 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2448522908' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:43 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:43 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:43 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:33:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:43 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:33:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:43 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:44.443 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:44 smithi174 ceph-mon[34403]: Reconfiguring mon.c (monmap changed)... 2024-09-21T03:33:44.443 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:44 smithi174 ceph-mon[34403]: Reconfiguring daemon mon.c on smithi174 2024-09-21T03:33:44.515 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:44 smithi084 ceph-mon[30941]: Reconfiguring mon.c (monmap changed)... 2024-09-21T03:33:44.515 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:44 smithi084 ceph-mon[30941]: Reconfiguring daemon mon.c on smithi174 2024-09-21T03:33:44.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:44 smithi172 ceph-mon[34821]: Reconfiguring mon.c (monmap changed)... 2024-09-21T03:33:44.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:44 smithi172 ceph-mon[34821]: Reconfiguring daemon mon.c on smithi174 2024-09-21T03:33:45.568 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:45 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: ignoring --setuser ceph since I am not root 2024-09-21T03:33:45.568 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:45 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: ignoring --setgroup ceph since I am not root 2024-09-21T03:33:45.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:45 smithi084 ceph-mon[30941]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:45.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:45 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2522321477' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T03:33:45.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:45 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:45.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:45 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:45.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:45 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:45.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:45 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:45.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:45 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:45.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:45 smithi084 ceph-mon[30941]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:45 smithi174 ceph-mon[34403]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:45 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2522321477' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T03:33:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:45 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:45 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:45 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:45 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:45 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:45.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:45 smithi174 ceph-mon[34403]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:45.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:45 smithi172 ceph-mon[34821]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:33:45.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:45 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2522321477' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T03:33:45.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:45 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:45.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:45 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:45.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:45 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:45.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:45 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:45.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:45 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:45.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:45 smithi172 ceph-mon[34821]: from='mgr.14152 172.21.15.84:0/1636912140' entity='mgr.x' 2024-09-21T03:33:45.963 INFO:tasks.cephadm:Adding mgr.x on smithi084 2024-09-21T03:33:45.963 INFO:tasks.cephadm:Adding mgr.y on smithi172 2024-09-21T03:33:45.963 INFO:tasks.cephadm:Adding mgr.z on smithi174 2024-09-21T03:33:45.963 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi084=x;smithi172=y;smithi174=z' 2024-09-21T03:33:46.215 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:33:46.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:46 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2522321477' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T03:33:46.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:46 smithi084 ceph-mon[30941]: mgrmap e15: x(active, since 55s) 2024-09-21T03:33:46.570 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:46 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2522321477' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T03:33:46.571 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:46 smithi174 ceph-mon[34403]: mgrmap e15: x(active, since 55s) 2024-09-21T03:33:46.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:46 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2522321477' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T03:33:46.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:46 smithi172 ceph-mon[34821]: mgrmap e15: x(active, since 55s) 2024-09-21T03:33:50.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:50 smithi084 ceph-mon[30941]: Active manager daemon x restarted 2024-09-21T03:33:50.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:50 smithi084 ceph-mon[30941]: Activating manager daemon x 2024-09-21T03:33:50.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:50 smithi084 ceph-mon[30941]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T03:33:50.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:50 smithi084 ceph-mon[30941]: mgrmap e16: x(active, starting, since 0.00500107s) 2024-09-21T03:33:50.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:50 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:33:50.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:50 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:50.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:50 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:50.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:50 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:33:50.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:50 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:33:50.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:50 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:33:50.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:50 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:33:50.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:50 smithi084 ceph-mon[30941]: Manager daemon x is now available 2024-09-21T03:33:50.583 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:50 smithi174 ceph-mon[34403]: Active manager daemon x restarted 2024-09-21T03:33:50.583 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:50 smithi174 ceph-mon[34403]: Activating manager daemon x 2024-09-21T03:33:50.583 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:50 smithi174 ceph-mon[34403]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T03:33:50.583 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:50 smithi174 ceph-mon[34403]: mgrmap e16: x(active, starting, since 0.00500107s) 2024-09-21T03:33:50.583 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:50 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:33:50.583 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:50 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:50.584 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:50 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:50.584 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:50 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:33:50.584 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:50 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:33:50.584 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:50 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:33:50.584 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:50 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:33:50.584 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:50 smithi174 ceph-mon[34403]: Manager daemon x is now available 2024-09-21T03:33:50.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:50 smithi172 ceph-mon[34821]: Active manager daemon x restarted 2024-09-21T03:33:50.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:50 smithi172 ceph-mon[34821]: Activating manager daemon x 2024-09-21T03:33:50.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:50 smithi172 ceph-mon[34821]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T03:33:50.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:50 smithi172 ceph-mon[34821]: mgrmap e16: x(active, starting, since 0.00500107s) 2024-09-21T03:33:50.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:50 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:33:50.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:50 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:33:50.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:50 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:33:50.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:50 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:33:50.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:50 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:33:50.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:50 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:33:50.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:50 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:33:50.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:50 smithi172 ceph-mon[34821]: Manager daemon x is now available 2024-09-21T03:33:51.205 INFO:teuthology.orchestra.run.smithi174.stdout:Scheduled mgr update... 2024-09-21T03:33:51.505 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:51.506 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:33:51.506 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:33:51.506 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:51 smithi172 ceph-mon[34821]: mgrmap e17: x(active, since 1.00905s) 2024-09-21T03:33:51.506 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:51.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:51.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:33:51.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:33:51.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-mon[30941]: mgrmap e17: x(active, since 1.00905s) 2024-09-21T03:33:51.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:51.592 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:51.592 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:33:51.592 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:33:51.592 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:51 smithi174 ceph-mon[34403]: mgrmap e17: x(active, since 1.00905s) 2024-09-21T03:33:51.592 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:51.913 DEBUG:teuthology.orchestra.run.smithi172:mgr.y> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T03:33:51.916 DEBUG:teuthology.orchestra.run.smithi174:mgr.z> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T03:33:51.918 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T03:33:51.918 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T03:33:51.921 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T03:33:51.921 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T03:33:51.964 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T03:33:51.964 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T03:33:52.007 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T03:33:52.007 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T03:33:52.050 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T03:33:52.051 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T03:33:52.093 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T03:33:52.094 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T03:33:52.136 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T03:33:52.137 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T03:33:52.166 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:33:51.904+0000 7fa4c05ab640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:03:33:51] ENGINE Error in HTTPServer.serve 2024-09-21T03:33:52.167 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: Traceback (most recent call last): 2024-09-21T03:33:52.167 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:33:52.167 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: self._connections.run(self.expiration_interval) 2024-09-21T03:33:52.167 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:33:52.167 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: self._run(expiration_interval) 2024-09-21T03:33:52.167 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:33:52.167 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:33:52.167 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:33:52.167 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:33:52.167 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:33:52.167 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: s = self.context.wrap_socket( 2024-09-21T03:33:52.167 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:33:52.168 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: return self.sslsocket_class._create( 2024-09-21T03:33:52.168 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:33:52.168 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: self.do_handshake() 2024-09-21T03:33:52.168 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:33:52.168 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: self._sslobj.do_handshake() 2024-09-21T03:33:52.168 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:33:52.168 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:33:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:33:52.168 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T03:33:52.169 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T03:33:52.217 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T03:33:52.218 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T03:33:52.263 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T03:33:52.263 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T03:33:52.317 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T03:33:52.317 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T03:33:52.318 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:52.360 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T03:33:52.360 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T03:33:52.386 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:52.392 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T03:33:52.392 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T03:33:52.424 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:52 smithi084 ceph-mon[30941]: Saving service mgr spec with placement smithi084=x;smithi172=y;smithi174=z;count:3 2024-09-21T03:33:52.424 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:52 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:52.424 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:52 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:52.424 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:52 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:52.424 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:52 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:52.432 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T03:33:52.432 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T03:33:52.484 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T03:33:52.484 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T03:33:52.531 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T03:33:52.532 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T03:33:52.611 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T03:33:52.611 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T03:33:52.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:52 smithi174 ceph-mon[34403]: Saving service mgr spec with placement smithi084=x;smithi172=y;smithi174=z;count:3 2024-09-21T03:33:52.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:52 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:52.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:52 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:52.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:52 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:52.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:52 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:52.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:52 smithi172 ceph-mon[34821]: Saving service mgr spec with placement smithi084=x;smithi172=y;smithi174=z;count:3 2024-09-21T03:33:52.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:52 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:52.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:52 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:52.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:52 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:52.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:52 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:52.674 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T03:33:52.674 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T03:33:52.726 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T03:33:52.726 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T03:33:52.808 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T03:33:52.808 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T03:33:52.856 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-09-21T03:33:52.857 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mgr debug_cephsqlite 20 2024-09-21T03:33:52.903 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T03:33:52.903 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T03:33:52.949 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T03:33:52.949 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T03:33:52.992 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T03:33:52.993 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T03:33:53.054 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-09-21T03:33:53.054 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-09-21T03:33:53.104 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-09-21T03:33:53.104 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-09-21T03:33:53.145 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:53.150 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-09-21T03:33:53.150 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-09-21T03:33:53.208 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T03:33:53.208 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T03:33:53.265 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T03:33:53.265 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T03:33:53.310 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T03:33:53.310 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T03:33:53.355 DEBUG:tasks.cephadm:set 30 configs 2024-09-21T03:33:53.355 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi084') 2024-09-21T03:33:53.512 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:53 smithi084 ceph-mon[30941]: [21/Sep/2024:03:33:51] ENGINE Bus STARTING 2024-09-21T03:33:53.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:53 smithi084 ceph-mon[30941]: [21/Sep/2024:03:33:51] ENGINE Serving on http://172.21.15.84:8765 2024-09-21T03:33:53.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:53 smithi084 ceph-mon[30941]: [21/Sep/2024:03:33:51] ENGINE Serving on https://172.21.15.84:7150 2024-09-21T03:33:53.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:53 smithi084 ceph-mon[30941]: [21/Sep/2024:03:33:51] ENGINE Bus STARTED 2024-09-21T03:33:53.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:53 smithi084 ceph-mon[30941]: [21/Sep/2024:03:33:51] ENGINE Error in HTTPServer.serve 2024-09-21T03:33:53.513 INFO:journalctl@ceph.mon.a.smithi084.stdout: Traceback (most recent call last): 2024-09-21T03:33:53.513 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:33:53.513 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._connections.run(self.expiration_interval) 2024-09-21T03:33:53.513 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:33:53.513 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._run(expiration_interval) 2024-09-21T03:33:53.513 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:33:53.513 INFO:journalctl@ceph.mon.a.smithi084.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:33:53.513 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:33:53.513 INFO:journalctl@ceph.mon.a.smithi084.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:33:53.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:33:53.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: s = self.context.wrap_socket( 2024-09-21T03:33:53.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:33:53.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: return self.sslsocket_class._create( 2024-09-21T03:33:53.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:33:53.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: self.do_handshake() 2024-09-21T03:33:53.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:33:53.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: self._sslobj.do_handshake() 2024-09-21T03:33:53.514 INFO:journalctl@ceph.mon.a.smithi084.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:33:53.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:53.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:53.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:53.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:53.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"} : dispatch 2024-09-21T03:33:53.514 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:53 smithi084 ceph-mon[30941]: mgrmap e18: x(active, since 2s) 2024-09-21T03:33:53.515 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:53.515 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:53.515 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi174", "name": "osd_memory_target"} : dispatch 2024-09-21T03:33:53.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:53 smithi174 ceph-mon[34403]: [21/Sep/2024:03:33:51] ENGINE Bus STARTING 2024-09-21T03:33:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:53 smithi174 ceph-mon[34403]: [21/Sep/2024:03:33:51] ENGINE Serving on http://172.21.15.84:8765 2024-09-21T03:33:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:53 smithi174 ceph-mon[34403]: [21/Sep/2024:03:33:51] ENGINE Serving on https://172.21.15.84:7150 2024-09-21T03:33:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:53 smithi174 ceph-mon[34403]: [21/Sep/2024:03:33:51] ENGINE Bus STARTED 2024-09-21T03:33:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:53 smithi174 ceph-mon[34403]: [21/Sep/2024:03:33:51] ENGINE Error in HTTPServer.serve 2024-09-21T03:33:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout: Traceback (most recent call last): 2024-09-21T03:33:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:33:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout: self._connections.run(self.expiration_interval) 2024-09-21T03:33:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:33:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout: self._run(expiration_interval) 2024-09-21T03:33:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:33:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:33:53.630 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:33:53.630 INFO:journalctl@ceph.mon.c.smithi174.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:33:53.630 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:33:53.630 INFO:journalctl@ceph.mon.c.smithi174.stdout: s = self.context.wrap_socket( 2024-09-21T03:33:53.630 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:33:53.630 INFO:journalctl@ceph.mon.c.smithi174.stdout: return self.sslsocket_class._create( 2024-09-21T03:33:53.630 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:33:53.630 INFO:journalctl@ceph.mon.c.smithi174.stdout: self.do_handshake() 2024-09-21T03:33:53.630 INFO:journalctl@ceph.mon.c.smithi174.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:33:53.630 INFO:journalctl@ceph.mon.c.smithi174.stdout: self._sslobj.do_handshake() 2024-09-21T03:33:53.630 INFO:journalctl@ceph.mon.c.smithi174.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:33:53.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:53.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:53.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:53.631 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:53.631 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"} : dispatch 2024-09-21T03:33:53.631 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:53 smithi174 ceph-mon[34403]: mgrmap e18: x(active, since 2s) 2024-09-21T03:33:53.631 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:53.631 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:53.631 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi174", "name": "osd_memory_target"} : dispatch 2024-09-21T03:33:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:53 smithi172 ceph-mon[34821]: [21/Sep/2024:03:33:51] ENGINE Bus STARTING 2024-09-21T03:33:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:53 smithi172 ceph-mon[34821]: [21/Sep/2024:03:33:51] ENGINE Serving on http://172.21.15.84:8765 2024-09-21T03:33:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:53 smithi172 ceph-mon[34821]: [21/Sep/2024:03:33:51] ENGINE Serving on https://172.21.15.84:7150 2024-09-21T03:33:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:53 smithi172 ceph-mon[34821]: [21/Sep/2024:03:33:51] ENGINE Bus STARTED 2024-09-21T03:33:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:53 smithi172 ceph-mon[34821]: [21/Sep/2024:03:33:51] ENGINE Error in HTTPServer.serve 2024-09-21T03:33:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout: Traceback (most recent call last): 2024-09-21T03:33:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:33:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout: self._connections.run(self.expiration_interval) 2024-09-21T03:33:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:33:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout: self._run(expiration_interval) 2024-09-21T03:33:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:33:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:33:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:33:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:33:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:33:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout: s = self.context.wrap_socket( 2024-09-21T03:33:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:33:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout: return self.sslsocket_class._create( 2024-09-21T03:33:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:33:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout: self.do_handshake() 2024-09-21T03:33:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:33:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout: self._sslobj.do_handshake() 2024-09-21T03:33:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:33:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:53.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:53.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:53.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"} : dispatch 2024-09-21T03:33:53.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:53 smithi172 ceph-mon[34821]: mgrmap e18: x(active, since 2s) 2024-09-21T03:33:53.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:53.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:53.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi174", "name": "osd_memory_target"} : dispatch 2024-09-21T03:33:54.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi084", "name": "osd_memory_target"} : dispatch 2024-09-21T03:33:54.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:54.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:54.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-21T03:33:54.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-21T03:33:54.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-21T03:33:54.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3978234910' entity='client.admin' 2024-09-21T03:33:54.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: Updating smithi174:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:54.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: Updating smithi172:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:54.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:54.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:54.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: Updating smithi084:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:54.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: Updating smithi174:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:33:54.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: Updating smithi172:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:33:54.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:54.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: from='client.? ' entity='client.admin' 2024-09-21T03:33:54.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: Updating smithi084:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:33:54.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:33:54.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:33:54.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:33:54.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:54.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:54 smithi172 ceph-mon[34821]: Deploying daemon mgr.z on smithi174 2024-09-21T03:33:54.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi084", "name": "osd_memory_target"} : dispatch 2024-09-21T03:33:54.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:54.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:54.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-21T03:33:54.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-21T03:33:54.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-21T03:33:54.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3978234910' entity='client.admin' 2024-09-21T03:33:54.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: Updating smithi174:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:54.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: Updating smithi172:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:54.656 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:54.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:54.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: Updating smithi084:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:54.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: Updating smithi174:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:33:54.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: Updating smithi172:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:33:54.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:54.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: from='client.? ' entity='client.admin' 2024-09-21T03:33:54.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: Updating smithi084:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:33:54.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.657 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:33:54.658 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:33:54.658 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:33:54.658 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:54.658 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:54 smithi174 ceph-mon[34403]: Deploying daemon mgr.z on smithi174 2024-09-21T03:33:54.666 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:54.666 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:54.671 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:54.674 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:54.674 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:54.677 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:54.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi084", "name": "osd_memory_target"} : dispatch 2024-09-21T03:33:54.764 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:54.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:54.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: Updating smithi084:/etc/ceph/ceph.conf 2024-09-21T03:33:54.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: Updating smithi172:/etc/ceph/ceph.conf 2024-09-21T03:33:54.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: Updating smithi174:/etc/ceph/ceph.conf 2024-09-21T03:33:54.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3978234910' entity='client.admin' 2024-09-21T03:33:54.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: Updating smithi174:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:54.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: Updating smithi172:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:54.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: Updating smithi174:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:54.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:54.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: Updating smithi084:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:33:54.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: Updating smithi174:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:33:54.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: Updating smithi172:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:33:54.765 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: Updating smithi084:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:33:54.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: from='client.? ' entity='client.admin' 2024-09-21T03:33:54.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: Updating smithi084:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:33:54.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:54.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:33:54.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:33:54.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:33:54.767 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:54.767 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:54 smithi084 ceph-mon[30941]: Deploying daemon mgr.z on smithi174 2024-09-21T03:33:55.087 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi084') 2024-09-21T03:33:55.634 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:55.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:55.775+0000 7f70f88ba640 1 -- 172.21.15.84:0/2517757935 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f70dc03fb70 msgr2=0x7f70dc042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:55.775+0000 7f70f88ba640 1 --2- 172.21.15.84:0/2517757935 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f70dc03fb70 0x7f70dc042080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f70e802a930 tx=0x7f70e8005fd0 comp rx=0 tx=0).stop 2024-09-21T03:33:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:55.775+0000 7f70f88ba640 1 -- 172.21.15.84:0/2517757935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70f41049d0 msgr2=0x7f70f419a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:55.775+0000 7f70f88ba640 1 --2- 172.21.15.84:0/2517757935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70f41049d0 0x7f70f419a250 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f70e400c970 tx=0x7f70e400ce30 comp rx=0 tx=0).stop 2024-09-21T03:33:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:55.775+0000 7f70f88ba640 1 -- 172.21.15.84:0/2517757935 shutdown_connections 2024-09-21T03:33:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:55.775+0000 7f70f88ba640 1 --2- 172.21.15.84:0/2517757935 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f70dc03fb70 0x7f70dc042080 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:55.775+0000 7f70f88ba640 1 --2- 172.21.15.84:0/2517757935 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f70f410de30 0x7f70f419fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:55.775+0000 7f70f88ba640 1 --2- 172.21.15.84:0/2517757935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70f4105320 0x7f70f419a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:55.775+0000 7f70f88ba640 1 --2- 172.21.15.84:0/2517757935 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f70f41049d0 0x7f70f419a250 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:55.775+0000 7f70f88ba640 1 -- 172.21.15.84:0/2517757935 >> 172.21.15.84:0/2517757935 conn(0x7f70f4079740 msgr2=0x7f70f4100a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:55.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:55.775+0000 7f70f88ba640 1 -- 172.21.15.84:0/2517757935 shutdown_connections 2024-09-21T03:33:55.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:55.776+0000 7f70f88ba640 1 -- 172.21.15.84:0/2517757935 wait complete. 2024-09-21T03:33:56.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.000+0000 7f719ed37640 1 -- 172.21.15.84:0/3700693973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7198108cf0 msgr2=0x7f719810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:56.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.000+0000 7f719ed37640 1 --2- 172.21.15.84:0/3700693973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7198108cf0 0x7f719810f520 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7190009ca0 tx=0x7f719002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:33:56.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.000+0000 7f719ed37640 1 -- 172.21.15.84:0/3700693973 shutdown_connections 2024-09-21T03:33:56.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.000+0000 7f719ed37640 1 --2- 172.21.15.84:0/3700693973 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7198108cf0 0x7f719810f520 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:56.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.000+0000 7f719ed37640 1 --2- 172.21.15.84:0/3700693973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71981083a0 0x7f71981087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:56.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.000+0000 7f719ed37640 1 --2- 172.21.15.84:0/3700693973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7198102a60 0x7f7198102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:56.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.000+0000 7f719ed37640 1 -- 172.21.15.84:0/3700693973 >> 172.21.15.84:0/3700693973 conn(0x7f7198079730 msgr2=0x7f7198079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:56.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.000+0000 7f719ed37640 1 -- 172.21.15.84:0/3700693973 shutdown_connections 2024-09-21T03:33:56.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.000+0000 7f719ed37640 1 -- 172.21.15.84:0/3700693973 wait complete. 2024-09-21T03:33:56.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.001+0000 7f719ed37640 1 Processor -- start 2024-09-21T03:33:56.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.001+0000 7f719ed37640 1 -- start start 2024-09-21T03:33:56.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.001+0000 7f719ed37640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7198102a60 0x7f719819b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:56.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.001+0000 7f719ed37640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71981083a0 0x7f719819b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:56.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.001+0000 7f719ed37640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7198108cf0 0x7f719819bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:56.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.001+0000 7f719ed37640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f71981126f0 con 0x7f7198108cf0 2024-09-21T03:33:56.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.001+0000 7f719ed37640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7198112570 con 0x7f71981083a0 2024-09-21T03:33:56.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.001+0000 7f719ed37640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7198112870 con 0x7f7198102a60 2024-09-21T03:33:56.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.001+0000 7f719d2d4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7198108cf0 0x7f719819bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:56.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.001+0000 7f719d2d4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7198108cf0 0x7f719819bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58444/0 (socket says 172.21.15.84:58444) 2024-09-21T03:33:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.001+0000 7f719d2d4640 1 -- 172.21.15.84:0/1651500866 learned_addr learned my addr 172.21.15.84:0/1651500866 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:33:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.001+0000 7f719cad3640 1 --2- 172.21.15.84:0/1651500866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7198102a60 0x7f719819b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.001+0000 7f7197fff640 1 --2- 172.21.15.84:0/1651500866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71981083a0 0x7f719819b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.002+0000 7f719d2d4640 1 -- 172.21.15.84:0/1651500866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7198102a60 msgr2=0x7f719819b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.002+0000 7f719d2d4640 1 --2- 172.21.15.84:0/1651500866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7198102a60 0x7f719819b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.002+0000 7f719d2d4640 1 -- 172.21.15.84:0/1651500866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71981083a0 msgr2=0x7f719819b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.002+0000 7f719d2d4640 1 --2- 172.21.15.84:0/1651500866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71981083a0 0x7f719819b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.002+0000 7f719d2d4640 1 -- 172.21.15.84:0/1651500866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71981a63d0 con 0x7f7198108cf0 2024-09-21T03:33:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.002+0000 7f7197fff640 1 --2- 172.21.15.84:0/1651500866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71981083a0 0x7f719819b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.002+0000 7f719d2d4640 1 --2- 172.21.15.84:0/1651500866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7198108cf0 0x7f719819bb40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7190006010 tx=0x7f7190003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.002+0000 7f7195ffb640 1 -- 172.21.15.84:0/1651500866 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7190003e10 con 0x7f7198108cf0 2024-09-21T03:33:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.002+0000 7f7195ffb640 1 -- 172.21.15.84:0/1651500866 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f71900044b0 con 0x7f7198108cf0 2024-09-21T03:33:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.002+0000 7f719ed37640 1 -- 172.21.15.84:0/1651500866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71981a6660 con 0x7f7198108cf0 2024-09-21T03:33:56.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.002+0000 7f7195ffb640 1 -- 172.21.15.84:0/1651500866 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7190030b70 con 0x7f7198108cf0 2024-09-21T03:33:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.002+0000 7f719ed37640 1 -- 172.21.15.84:0/1651500866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71981a6bf0 con 0x7f7198108cf0 2024-09-21T03:33:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.003+0000 7f7195ffb640 1 -- 172.21.15.84:0/1651500866 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f7190030d30 con 0x7f7198108cf0 2024-09-21T03:33:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.003+0000 7f719ed37640 1 -- 172.21.15.84:0/1651500866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7198102e70 con 0x7f7198108cf0 2024-09-21T03:33:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.004+0000 7f7195ffb640 1 --2- 172.21.15.84:0/1651500866 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f718803fb70 0x7f7188042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.004+0000 7f7195ffb640 1 -- 172.21.15.84:0/1651500866 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7190075e30 con 0x7f7198108cf0 2024-09-21T03:33:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.004+0000 7f719cad3640 1 --2- 172.21.15.84:0/1651500866 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f718803fb70 0x7f7188042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.004+0000 7f719cad3640 1 --2- 172.21.15.84:0/1651500866 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f718803fb70 0x7f7188042080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f719806ba20 tx=0x7f718c009110 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:56.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.008+0000 7f7195ffb640 1 -- 172.21.15.84:0/1651500866 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f719003a390 con 0x7f7198108cf0 2024-09-21T03:33:56.128 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 03:33:56 smithi174 systemd[1]: Starting Ceph mgr.z for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:33:56.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.195+0000 7f719ed37640 1 -- 172.21.15.84:0/1651500866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f719810aae0 con 0x7f7198108cf0 2024-09-21T03:33:56.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.198+0000 7f7195ffb640 1 -- 172.21.15.84:0/1651500866 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v13)=0 v13) ==== 116+0+0 (secure 0 0 0) 0x7f719004bd70 con 0x7f7198108cf0 2024-09-21T03:33:56.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.201+0000 7f719ed37640 1 -- 172.21.15.84:0/1651500866 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f718803fb70 msgr2=0x7f7188042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:56.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.201+0000 7f719ed37640 1 --2- 172.21.15.84:0/1651500866 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f718803fb70 0x7f7188042080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f719806ba20 tx=0x7f718c009110 comp rx=0 tx=0).stop 2024-09-21T03:33:56.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.201+0000 7f719ed37640 1 -- 172.21.15.84:0/1651500866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7198108cf0 msgr2=0x7f719819bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:56.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.201+0000 7f719ed37640 1 --2- 172.21.15.84:0/1651500866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7198108cf0 0x7f719819bb40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7190006010 tx=0x7f7190003c20 comp rx=0 tx=0).stop 2024-09-21T03:33:56.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.201+0000 7f719ed37640 1 -- 172.21.15.84:0/1651500866 shutdown_connections 2024-09-21T03:33:56.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.201+0000 7f719ed37640 1 --2- 172.21.15.84:0/1651500866 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f718803fb70 0x7f7188042080 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:56.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.201+0000 7f719ed37640 1 --2- 172.21.15.84:0/1651500866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7198108cf0 0x7f719819bb40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:56.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.201+0000 7f719ed37640 1 --2- 172.21.15.84:0/1651500866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71981083a0 0x7f719819b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:56.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.201+0000 7f719ed37640 1 --2- 172.21.15.84:0/1651500866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7198102a60 0x7f719819b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:56.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.201+0000 7f719ed37640 1 -- 172.21.15.84:0/1651500866 >> 172.21.15.84:0/1651500866 conn(0x7f7198079730 msgr2=0x7f71981044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:56.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.201+0000 7f719ed37640 1 -- 172.21.15.84:0/1651500866 shutdown_connections 2024-09-21T03:33:56.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:56.201+0000 7f719ed37640 1 -- 172.21.15.84:0/1651500866 wait complete. 2024-09-21T03:33:56.458 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:56.458 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:56.515 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 03:33:56 smithi174 podman[36359]: 2024-09-21 03:33:56.136433076 +0000 UTC m=+0.015819581 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:33:56.515 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 03:33:56 smithi174 podman[36359]: 2024-09-21 03:33:56.236603192 +0000 UTC m=+0.115989689 container create 213a207115e61e8071c8890e1c4824c56210c1a3cf69bb4bbfea0c34dedf5f16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-z, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:33:56.516 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 03:33:56 smithi174 podman[36359]: 2024-09-21 03:33:56.430565337 +0000 UTC m=+0.309951835 container init 213a207115e61e8071c8890e1c4824c56210c1a3cf69bb4bbfea0c34dedf5f16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-z, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T03:33:56.516 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 03:33:56 smithi174 podman[36359]: 2024-09-21 03:33:56.433353712 +0000 UTC m=+0.312740219 container start 213a207115e61e8071c8890e1c4824c56210c1a3cf69bb4bbfea0c34dedf5f16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-z, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:33:56.516 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 03:33:56 smithi174 ceph-mgr[36378]: -- 172.21.15.174:0/94842061 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5585dad370e0 con 0x5585dad55a80 2024-09-21T03:33:56.777 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 03:33:56 smithi174 bash[36359]: 213a207115e61e8071c8890e1c4824c56210c1a3cf69bb4bbfea0c34dedf5f16 2024-09-21T03:33:56.777 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 03:33:56 smithi174 systemd[1]: Started Ceph mgr.z for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:33:57.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:56 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2517757935' entity='client.admin' 2024-09-21T03:33:57.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:56 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1651500866' entity='client.admin' 2024-09-21T03:33:57.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:56 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:57.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:56 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:57.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:56 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:57.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:56 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:33:57.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:56 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:33:57.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:56 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:33:57.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:56 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:57.077 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:56 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2517757935' entity='client.admin' 2024-09-21T03:33:57.077 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:56 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1651500866' entity='client.admin' 2024-09-21T03:33:57.078 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:56 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:57.078 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:56 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:57.078 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:56 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:57.078 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:56 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:33:57.078 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:56 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:33:57.078 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:56 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:33:57.078 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:56 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:57.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:56 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2517757935' entity='client.admin' 2024-09-21T03:33:57.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:56 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1651500866' entity='client.admin' 2024-09-21T03:33:57.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:56 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:57.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:56 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:57.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:56 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:57.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:56 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:33:57.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:56 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:33:57.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:56 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:33:57.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:56 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:57.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.627+0000 7fb66a487640 1 -- 172.21.15.84:0/54154531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb664102a60 msgr2=0x7fb664102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.627+0000 7fb66a487640 1 --2- 172.21.15.84:0/54154531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb664102a60 0x7fb664102e70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb654009900 tx=0x7fb65402a410 comp rx=0 tx=0).stop 2024-09-21T03:33:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.627+0000 7fb66a487640 1 -- 172.21.15.84:0/54154531 shutdown_connections 2024-09-21T03:33:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.627+0000 7fb66a487640 1 --2- 172.21.15.84:0/54154531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb664108cf0 0x7fb66410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.627+0000 7fb66a487640 1 --2- 172.21.15.84:0/54154531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6641083a0 0x7fb6641087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.627+0000 7fb66a487640 1 --2- 172.21.15.84:0/54154531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb664102a60 0x7fb664102e70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.627+0000 7fb66a487640 1 -- 172.21.15.84:0/54154531 >> 172.21.15.84:0/54154531 conn(0x7fb664079730 msgr2=0x7fb664079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.627+0000 7fb66a487640 1 -- 172.21.15.84:0/54154531 shutdown_connections 2024-09-21T03:33:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.627+0000 7fb66a487640 1 -- 172.21.15.84:0/54154531 wait complete. 2024-09-21T03:33:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.628+0000 7fb66a487640 1 Processor -- start 2024-09-21T03:33:57.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.628+0000 7fb66a487640 1 -- start start 2024-09-21T03:33:57.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.628+0000 7fb66a487640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb664102a60 0x7fb66419b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:57.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.628+0000 7fb66a487640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb6641083a0 0x7fb66419b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:57.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.628+0000 7fb66a487640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb664108cf0 0x7fb66419bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:57.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.628+0000 7fb66a487640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb664112760 con 0x7fb664108cf0 2024-09-21T03:33:57.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.628+0000 7fb66a487640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb6641125e0 con 0x7fb664102a60 2024-09-21T03:33:57.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.628+0000 7fb66a487640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb6641128e0 con 0x7fb6641083a0 2024-09-21T03:33:57.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.628+0000 7fb668a24640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb664108cf0 0x7fb66419bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:57.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.628+0000 7fb668a24640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb664108cf0 0x7fb66419bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58450/0 (socket says 172.21.15.84:58450) 2024-09-21T03:33:57.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.628+0000 7fb668a24640 1 -- 172.21.15.84:0/667747126 learned_addr learned my addr 172.21.15.84:0/667747126 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:33:57.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.628+0000 7fb6637fe640 1 --2- 172.21.15.84:0/667747126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb6641083a0 0x7fb66419b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:57.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.629+0000 7fb663fff640 1 --2- 172.21.15.84:0/667747126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb664102a60 0x7fb66419b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:57.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.629+0000 7fb668a24640 1 -- 172.21.15.84:0/667747126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb6641083a0 msgr2=0x7fb66419b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:57.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.629+0000 7fb668a24640 1 --2- 172.21.15.84:0/667747126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb6641083a0 0x7fb66419b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:57.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.629+0000 7fb668a24640 1 -- 172.21.15.84:0/667747126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb664102a60 msgr2=0x7fb66419b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:57.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.629+0000 7fb668a24640 1 --2- 172.21.15.84:0/667747126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb664102a60 0x7fb66419b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:57.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.629+0000 7fb668a24640 1 -- 172.21.15.84:0/667747126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6641a6440 con 0x7fb664108cf0 2024-09-21T03:33:57.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.629+0000 7fb663fff640 1 --2- 172.21.15.84:0/667747126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb664102a60 0x7fb66419b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:57.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.629+0000 7fb668a24640 1 --2- 172.21.15.84:0/667747126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb664108cf0 0x7fb66419bc30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00eaa0 tx=0x7fb65c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:57.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.629+0000 7fb6617fa640 1 -- 172.21.15.84:0/667747126 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c004d20 con 0x7fb664108cf0 2024-09-21T03:33:57.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.629+0000 7fb6617fa640 1 -- 172.21.15.84:0/667747126 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7fb65c005020 con 0x7fb664108cf0 2024-09-21T03:33:57.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.629+0000 7fb6617fa640 1 -- 172.21.15.84:0/667747126 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb65c0116d0 con 0x7fb664108cf0 2024-09-21T03:33:57.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.629+0000 7fb66a487640 1 -- 172.21.15.84:0/667747126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6641a6730 con 0x7fb664108cf0 2024-09-21T03:33:57.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.629+0000 7fb66a487640 1 -- 172.21.15.84:0/667747126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6641a6cc0 con 0x7fb664108cf0 2024-09-21T03:33:57.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.630+0000 7fb6617fa640 1 -- 172.21.15.84:0/667747126 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7fb65c011870 con 0x7fb664108cf0 2024-09-21T03:33:57.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.630+0000 7fb66a487640 1 -- 172.21.15.84:0/667747126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb664102e70 con 0x7fb664108cf0 2024-09-21T03:33:57.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.631+0000 7fb6617fa640 1 --2- 172.21.15.84:0/667747126 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb64c03fba0 0x7fb64c0420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:57.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.631+0000 7fb6617fa640 1 -- 172.21.15.84:0/667747126 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb65c054650 con 0x7fb664108cf0 2024-09-21T03:33:57.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.631+0000 7fb663fff640 1 --2- 172.21.15.84:0/667747126 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb64c03fba0 0x7fb64c0420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:57.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.631+0000 7fb663fff640 1 --2- 172.21.15.84:0/667747126 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb64c03fba0 0x7fb64c0420b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb654000c00 tx=0x7fb654009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:57.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.635+0000 7fb6617fa640 1 -- 172.21.15.84:0/667747126 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb65c016030 con 0x7fb664108cf0 2024-09-21T03:33:57.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.804+0000 7f7ceec78640 1 -- 172.21.15.84:0/284490174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ce810de10 msgr2=0x7f7ce8110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:57.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.804+0000 7f7ceec78640 1 --2- 172.21.15.84:0/284490174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ce810de10 0x7f7ce8110300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0009ca0 tx=0x7f7ce002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:33:57.813 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.804+0000 7f7ceec78640 1 -- 172.21.15.84:0/284490174 shutdown_connections 2024-09-21T03:33:57.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.804+0000 7f7ceec78640 1 --2- 172.21.15.84:0/284490174 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ce810de10 0x7f7ce8110300 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:57.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.804+0000 7f7ceec78640 1 --2- 172.21.15.84:0/284490174 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ce8105300 0x7f7ce810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:57.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.804+0000 7f7ceec78640 1 --2- 172.21.15.84:0/284490174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ce81049b0 0x7f7ce8104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:57.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.804+0000 7f7ceec78640 1 -- 172.21.15.84:0/284490174 >> 172.21.15.84:0/284490174 conn(0x7f7ce8079730 msgr2=0x7f7ce8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:57.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.804+0000 7f7ceec78640 1 -- 172.21.15.84:0/284490174 shutdown_connections 2024-09-21T03:33:57.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.804+0000 7f7ceec78640 1 -- 172.21.15.84:0/284490174 wait complete. 2024-09-21T03:33:57.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.805+0000 7f7ceec78640 1 Processor -- start 2024-09-21T03:33:57.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.805+0000 7f7ceec78640 1 -- start start 2024-09-21T03:33:57.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ceec78640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ce81049b0 0x7f7ce819a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:57.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ceec78640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ce8105300 0x7f7ce819a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:57.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ceec78640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ce810de10 0x7f7ce819faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:57.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ceec78640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce81137e0 con 0x7f7ce81049b0 2024-09-21T03:33:57.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ceec78640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce8113660 con 0x7f7ce810de10 2024-09-21T03:33:57.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ceec78640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce8113960 con 0x7f7ce8105300 2024-09-21T03:33:57.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ceca14640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ce81049b0 0x7f7ce819a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:57.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ceca14640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ce81049b0 0x7f7ce819a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:58462/0 (socket says 172.21.15.84:58462) 2024-09-21T03:33:57.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ceca14640 1 -- 172.21.15.84:0/2163273793 learned_addr learned my addr 172.21.15.84:0/2163273793 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:33:57.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ce7fff640 1 --2- 172.21.15.84:0/2163273793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ce8105300 0x7f7ce819a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:57.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ced215640 1 --2- 172.21.15.84:0/2163273793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ce810de10 0x7f7ce819faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:57.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ceca14640 1 -- 172.21.15.84:0/2163273793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ce8105300 msgr2=0x7f7ce819a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:57.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ceca14640 1 --2- 172.21.15.84:0/2163273793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ce8105300 0x7f7ce819a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:57.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ceca14640 1 -- 172.21.15.84:0/2163273793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ce810de10 msgr2=0x7f7ce819faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:57.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ceca14640 1 --2- 172.21.15.84:0/2163273793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ce810de10 0x7f7ce819faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:57.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ceca14640 1 -- 172.21.15.84:0/2163273793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce81a0220 con 0x7f7ce81049b0 2024-09-21T03:33:57.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ceca14640 1 --2- 172.21.15.84:0/2163273793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ce81049b0 0x7f7ce819a2b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800c970 tx=0x7f7cd800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:57.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ce5ffb640 1 -- 172.21.15.84:0/2163273793 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8004220 con 0x7f7ce81049b0 2024-09-21T03:33:57.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ce5ffb640 1 -- 172.21.15.84:0/2163273793 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f7cd8007e20 con 0x7f7ce81049b0 2024-09-21T03:33:57.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ce5ffb640 1 -- 172.21.15.84:0/2163273793 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8003dc0 con 0x7f7ce81049b0 2024-09-21T03:33:57.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.806+0000 7f7ceec78640 1 -- 172.21.15.84:0/2163273793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce81a0510 con 0x7f7ce81049b0 2024-09-21T03:33:57.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.807+0000 7f7ceec78640 1 -- 172.21.15.84:0/2163273793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ce81a6c70 con 0x7f7ce81049b0 2024-09-21T03:33:57.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.808+0000 7f7ceec78640 1 -- 172.21.15.84:0/2163273793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ce8104dc0 con 0x7f7ce81049b0 2024-09-21T03:33:57.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.808+0000 7f7ce5ffb640 1 -- 172.21.15.84:0/2163273793 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f7cd800f450 con 0x7f7ce81049b0 2024-09-21T03:33:57.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.808+0000 7f7ce5ffb640 1 --2- 172.21.15.84:0/2163273793 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7cd403fb70 0x7f7cd4042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:57.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.808+0000 7f7ce5ffb640 1 -- 172.21.15.84:0/2163273793 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7cd80542a0 con 0x7f7ce81049b0 2024-09-21T03:33:57.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.808+0000 7f7ce7fff640 1 --2- 172.21.15.84:0/2163273793 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7cd403fb70 0x7f7cd4042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:57.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.809+0000 7f7ce7fff640 1 --2- 172.21.15.84:0/2163273793 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7cd403fb70 0x7f7cd4042080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7ce807a130 tx=0x7f7cd0005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:57.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.813+0000 7f7ce5ffb640 1 -- 172.21.15.84:0/2163273793 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7cd8014030 con 0x7f7ce81049b0 2024-09-21T03:33:57.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.827+0000 7fb66a487640 1 -- 172.21.15.84:0/667747126 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fb66410aac0 con 0x7fb664108cf0 2024-09-21T03:33:57.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.832+0000 7fb6617fa640 1 -- 172.21.15.84:0/667747126 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v14)=0 v14) ==== 116+0+0 (secure 0 0 0) 0x7fb65c00f360 con 0x7fb664108cf0 2024-09-21T03:33:57.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.835+0000 7fb66a487640 1 -- 172.21.15.84:0/667747126 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb64c03fba0 msgr2=0x7fb64c0420b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:57.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.835+0000 7fb66a487640 1 --2- 172.21.15.84:0/667747126 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb64c03fba0 0x7fb64c0420b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb654000c00 tx=0x7fb654009680 comp rx=0 tx=0).stop 2024-09-21T03:33:57.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.835+0000 7fb66a487640 1 -- 172.21.15.84:0/667747126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb664108cf0 msgr2=0x7fb66419bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:57.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.835+0000 7fb66a487640 1 --2- 172.21.15.84:0/667747126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb664108cf0 0x7fb66419bc30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00eaa0 tx=0x7fb65c00eea0 comp rx=0 tx=0).stop 2024-09-21T03:33:57.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.835+0000 7fb66a487640 1 -- 172.21.15.84:0/667747126 shutdown_connections 2024-09-21T03:33:57.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.835+0000 7fb66a487640 1 --2- 172.21.15.84:0/667747126 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb64c03fba0 0x7fb64c0420b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:57.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.835+0000 7fb66a487640 1 --2- 172.21.15.84:0/667747126 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb664108cf0 0x7fb66419bc30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:57.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.835+0000 7fb66a487640 1 --2- 172.21.15.84:0/667747126 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb6641083a0 0x7fb66419b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:57.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.835+0000 7fb66a487640 1 --2- 172.21.15.84:0/667747126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb664102a60 0x7fb66419b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:57.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.835+0000 7fb66a487640 1 -- 172.21.15.84:0/667747126 >> 172.21.15.84:0/667747126 conn(0x7fb664079730 msgr2=0x7fb664101650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:57.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.835+0000 7fb66a487640 1 -- 172.21.15.84:0/667747126 shutdown_connections 2024-09-21T03:33:57.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:57.836+0000 7fb66a487640 1 -- 172.21.15.84:0/667747126 wait complete. 2024-09-21T03:33:57.848 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:57 smithi174 ceph-mon[34403]: Deploying daemon mgr.y on smithi172 2024-09-21T03:33:58.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.001+0000 7f7ceec78640 1 -- 172.21.15.84:0/2163273793 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f7ce8108f10 con 0x7f7ce81049b0 2024-09-21T03:33:58.003 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:57 smithi084 ceph-mon[30941]: Deploying daemon mgr.y on smithi172 2024-09-21T03:33:58.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.005+0000 7f7ce5ffb640 1 -- 172.21.15.84:0/2163273793 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v15)=0 v15) ==== 108+0+0 (secure 0 0 0) 0x7f7cd8012110 con 0x7f7ce81049b0 2024-09-21T03:33:58.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.007+0000 7f7ceec78640 1 -- 172.21.15.84:0/2163273793 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7cd403fb70 msgr2=0x7f7cd4042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:58.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.007+0000 7f7ceec78640 1 --2- 172.21.15.84:0/2163273793 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7cd403fb70 0x7f7cd4042080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7ce807a130 tx=0x7f7cd0005f90 comp rx=0 tx=0).stop 2024-09-21T03:33:58.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.007+0000 7f7ceec78640 1 -- 172.21.15.84:0/2163273793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ce81049b0 msgr2=0x7f7ce819a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:58.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.007+0000 7f7ceec78640 1 --2- 172.21.15.84:0/2163273793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ce81049b0 0x7f7ce819a2b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7cd800c970 tx=0x7f7cd800ce30 comp rx=0 tx=0).stop 2024-09-21T03:33:58.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.007+0000 7f7ceec78640 1 -- 172.21.15.84:0/2163273793 shutdown_connections 2024-09-21T03:33:58.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.007+0000 7f7ceec78640 1 --2- 172.21.15.84:0/2163273793 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7cd403fb70 0x7f7cd4042080 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:58.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.007+0000 7f7ceec78640 1 --2- 172.21.15.84:0/2163273793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ce810de10 0x7f7ce819faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:58.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.007+0000 7f7ceec78640 1 --2- 172.21.15.84:0/2163273793 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ce8105300 0x7f7ce819a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:58.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.007+0000 7f7ceec78640 1 --2- 172.21.15.84:0/2163273793 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ce81049b0 0x7f7ce819a2b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:58.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.007+0000 7f7ceec78640 1 -- 172.21.15.84:0/2163273793 >> 172.21.15.84:0/2163273793 conn(0x7f7ce8079730 msgr2=0x7f7ce8100990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:58.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.007+0000 7f7ceec78640 1 -- 172.21.15.84:0/2163273793 shutdown_connections 2024-09-21T03:33:58.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.007+0000 7f7ceec78640 1 -- 172.21.15.84:0/2163273793 wait complete. 2024-09-21T03:33:58.021 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:57 smithi172 ceph-mon[34821]: Deploying daemon mgr.y on smithi172 2024-09-21T03:33:58.395 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Sep 21 03:33:58 smithi172 systemd[1]: Starting Ceph mgr.y for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:33:58.646 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Sep 21 03:33:58 smithi172 podman[36340]: 2024-09-21 03:33:58.29654453 +0000 UTC m=+0.016008008 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:33:58.646 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Sep 21 03:33:58 smithi172 podman[36340]: 2024-09-21 03:33:58.396431829 +0000 UTC m=+0.115895336 container create 67575135f97099d9ecc2da3a8dcb4ebffb5281e58746699ef63dae4b2ed186d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-y, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T03:33:58.647 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Sep 21 03:33:58 smithi172 podman[36340]: 2024-09-21 03:33:58.607358234 +0000 UTC m=+0.326821698 container init 67575135f97099d9ecc2da3a8dcb4ebffb5281e58746699ef63dae4b2ed186d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-y, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:33:58.647 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Sep 21 03:33:58 smithi172 podman[36340]: 2024-09-21 03:33:58.610720252 +0000 UTC m=+0.330183719 container start 67575135f97099d9ecc2da3a8dcb4ebffb5281e58746699ef63dae4b2ed186d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-y, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:33:58.901 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Sep 21 03:33:58 smithi172 ceph-mgr[36359]: -- 172.21.15.172:0/1457003928 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e921d9b0e0 con 0x55e921db9a80 2024-09-21T03:33:58.901 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Sep 21 03:33:58 smithi172 bash[36340]: 67575135f97099d9ecc2da3a8dcb4ebffb5281e58746699ef63dae4b2ed186d6 2024-09-21T03:33:58.901 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Sep 21 03:33:58 smithi172 systemd[1]: Started Ceph mgr.y for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:33:58.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:58 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/667747126' entity='client.admin' 2024-09-21T03:33:58.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:58 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2163273793' entity='client.admin' 2024-09-21T03:33:58.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:58 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:58.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:58 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:58.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:58 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:58.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:58 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2393439170' entity='client.admin' 2024-09-21T03:33:58.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:58 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:59.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:58 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/667747126' entity='client.admin' 2024-09-21T03:33:59.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:58 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2163273793' entity='client.admin' 2024-09-21T03:33:59.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:58 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:59.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:58 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:59.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:58 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:59.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:58 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2393439170' entity='client.admin' 2024-09-21T03:33:59.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:58 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:59.099 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi084') 2024-09-21T03:33:59.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:58 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/667747126' entity='client.admin' 2024-09-21T03:33:59.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:58 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2163273793' entity='client.admin' 2024-09-21T03:33:59.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:58 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:59.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:58 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:59.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:58 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:59.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:58 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2393439170' entity='client.admin' 2024-09-21T03:33:59.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:58 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:33:59.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.887+0000 7f7b5f7e1640 1 -- 172.21.15.84:0/1845419153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b581049d0 msgr2=0x7f7b58104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.887+0000 7f7b5f7e1640 1 --2- 172.21.15.84:0/1845419153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b581049d0 0x7f7b58104de0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7b54009900 tx=0x7f7b5402a410 comp rx=0 tx=0).stop 2024-09-21T03:33:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.887+0000 7f7b5f7e1640 1 -- 172.21.15.84:0/1845419153 shutdown_connections 2024-09-21T03:33:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.887+0000 7f7b5f7e1640 1 --2- 172.21.15.84:0/1845419153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b5810de30 0x7f7b58110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.887+0000 7f7b5f7e1640 1 --2- 172.21.15.84:0/1845419153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b58105320 0x7f7b5810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.887+0000 7f7b5f7e1640 1 --2- 172.21.15.84:0/1845419153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b581049d0 0x7f7b58104de0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.887+0000 7f7b5f7e1640 1 -- 172.21.15.84:0/1845419153 >> 172.21.15.84:0/1845419153 conn(0x7f7b58079740 msgr2=0x7f7b58079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.887+0000 7f7b5f7e1640 1 -- 172.21.15.84:0/1845419153 shutdown_connections 2024-09-21T03:33:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.887+0000 7f7b5f7e1640 1 -- 172.21.15.84:0/1845419153 wait complete. 2024-09-21T03:33:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.888+0000 7f7b5f7e1640 1 Processor -- start 2024-09-21T03:33:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.888+0000 7f7b5f7e1640 1 -- start start 2024-09-21T03:33:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.888+0000 7f7b5f7e1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b581049d0 0x7f7b5819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:59.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.888+0000 7f7b5f7e1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b58105320 0x7f7b5819a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:59.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.888+0000 7f7b5f7e1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b5810de30 0x7f7b5819fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:59.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.888+0000 7f7b5f7e1640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7b58113850 con 0x7f7b58105320 2024-09-21T03:33:59.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.888+0000 7f7b5f7e1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7b581136d0 con 0x7f7b5810de30 2024-09-21T03:33:59.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.888+0000 7f7b5f7e1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7b581139d0 con 0x7f7b581049d0 2024-09-21T03:33:59.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.888+0000 7f7b5cd7c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b58105320 0x7f7b5819a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:59.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.888+0000 7f7b5cd7c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b58105320 0x7f7b5819a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32910/0 (socket says 172.21.15.84:32910) 2024-09-21T03:33:59.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.888+0000 7f7b5cd7c640 1 -- 172.21.15.84:0/330322474 learned_addr learned my addr 172.21.15.84:0/330322474 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:33:59.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.888+0000 7f7b5d57d640 1 --2- 172.21.15.84:0/330322474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b581049d0 0x7f7b5819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:59.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.888+0000 7f7b5dd7e640 1 --2- 172.21.15.84:0/330322474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b5810de30 0x7f7b5819fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:59.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.889+0000 7f7b5d57d640 1 -- 172.21.15.84:0/330322474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b5810de30 msgr2=0x7f7b5819fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:59.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.889+0000 7f7b5d57d640 1 --2- 172.21.15.84:0/330322474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b5810de30 0x7f7b5819fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:59.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.889+0000 7f7b5d57d640 1 -- 172.21.15.84:0/330322474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b58105320 msgr2=0x7f7b5819a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:59.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.889+0000 7f7b5d57d640 1 --2- 172.21.15.84:0/330322474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b58105320 0x7f7b5819a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:59.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.889+0000 7f7b5d57d640 1 -- 172.21.15.84:0/330322474 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b581a02f0 con 0x7f7b581049d0 2024-09-21T03:33:59.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.889+0000 7f7b5cd7c640 1 --2- 172.21.15.84:0/330322474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b58105320 0x7f7b5819a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:33:59.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.889+0000 7f7b5d57d640 1 --2- 172.21.15.84:0/330322474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b581049d0 0x7f7b5819a380 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7b5402a930 tx=0x7f7b54003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:59.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.889+0000 7f7b4e7fc640 1 -- 172.21.15.84:0/330322474 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5403f070 con 0x7f7b581049d0 2024-09-21T03:33:59.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.889+0000 7f7b5f7e1640 1 -- 172.21.15.84:0/330322474 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b581a0580 con 0x7f7b581049d0 2024-09-21T03:33:59.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.889+0000 7f7b4e7fc640 1 -- 172.21.15.84:0/330322474 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f7b54031b10 con 0x7f7b581049d0 2024-09-21T03:33:59.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.889+0000 7f7b4e7fc640 1 -- 172.21.15.84:0/330322474 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b54035030 con 0x7f7b581049d0 2024-09-21T03:33:59.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.889+0000 7f7b5f7e1640 1 -- 172.21.15.84:0/330322474 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b581a6d40 con 0x7f7b581049d0 2024-09-21T03:33:59.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.890+0000 7f7b4e7fc640 1 -- 172.21.15.84:0/330322474 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f7b54042070 con 0x7f7b581049d0 2024-09-21T03:33:59.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.890+0000 7f7b4e7fc640 1 --2- 172.21.15.84:0/330322474 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7b4403fb70 0x7f7b44042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:59.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.890+0000 7f7b5f7e1640 1 -- 172.21.15.84:0/330322474 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b58104de0 con 0x7f7b581049d0 2024-09-21T03:33:59.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.890+0000 7f7b4e7fc640 1 -- 172.21.15.84:0/330322474 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7b54075ac0 con 0x7f7b581049d0 2024-09-21T03:33:59.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.890+0000 7f7b5cd7c640 1 --2- 172.21.15.84:0/330322474 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7b4403fb70 0x7f7b44042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:59.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.891+0000 7f7b5cd7c640 1 --2- 172.21.15.84:0/330322474 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7b4403fb70 0x7f7b44042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7b58102520 tx=0x7f7b48005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:59.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:59.896+0000 7f7b4e7fc640 1 -- 172.21.15.84:0/330322474 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7b5404c350 con 0x7f7b581049d0 2024-09-21T03:34:00.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:59 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:00.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:59 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:00.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:59 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:00.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:59 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:00.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:59 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:00.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:59 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:00.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:59 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:00.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:33:59 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:00.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:00.081+0000 7f7b5f7e1640 1 -- 172.21.15.84:0/330322474 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f7b58108f30 con 0x7f7b581049d0 2024-09-21T03:34:00.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:00.086+0000 7f7b4e7fc640 1 -- 172.21.15.84:0/330322474 <== mon.1 v2:172.21.15.174:3300/0 7 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f7b54031cc0 con 0x7f7b581049d0 2024-09-21T03:34:00.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:00.086+0000 7f7b4e7fc640 1 -- 172.21.15.84:0/330322474 <== mon.1 v2:172.21.15.174:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v17)=0 v17) ==== 123+0+0 (secure 0 0 0) 0x7f7b5403ae70 con 0x7f7b581049d0 2024-09-21T03:34:00.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:00.089+0000 7f7b5f7e1640 1 -- 172.21.15.84:0/330322474 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7b4403fb70 msgr2=0x7f7b44042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:00.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:00.089+0000 7f7b5f7e1640 1 --2- 172.21.15.84:0/330322474 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7b4403fb70 0x7f7b44042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7b58102520 tx=0x7f7b48005f90 comp rx=0 tx=0).stop 2024-09-21T03:34:00.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:00.089+0000 7f7b5f7e1640 1 -- 172.21.15.84:0/330322474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b581049d0 msgr2=0x7f7b5819a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:00.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:00.089+0000 7f7b5f7e1640 1 --2- 172.21.15.84:0/330322474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b581049d0 0x7f7b5819a380 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7b5402a930 tx=0x7f7b54003b20 comp rx=0 tx=0).stop 2024-09-21T03:34:00.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:00.089+0000 7f7b5f7e1640 1 -- 172.21.15.84:0/330322474 shutdown_connections 2024-09-21T03:34:00.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:00.089+0000 7f7b5f7e1640 1 --2- 172.21.15.84:0/330322474 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7b4403fb70 0x7f7b44042080 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:00.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:00.089+0000 7f7b5f7e1640 1 --2- 172.21.15.84:0/330322474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7b5810de30 0x7f7b5819fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:00.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:00.089+0000 7f7b5f7e1640 1 --2- 172.21.15.84:0/330322474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7b58105320 0x7f7b5819a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:00.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:00.089+0000 7f7b5f7e1640 1 --2- 172.21.15.84:0/330322474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7b581049d0 0x7f7b5819a380 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:00.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:00.089+0000 7f7b5f7e1640 1 -- 172.21.15.84:0/330322474 >> 172.21.15.84:0/330322474 conn(0x7f7b58079740 msgr2=0x7f7b580ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:00.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:00.089+0000 7f7b5f7e1640 1 -- 172.21.15.84:0/330322474 shutdown_connections 2024-09-21T03:34:00.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:00.089+0000 7f7b5f7e1640 1 -- 172.21.15.84:0/330322474 wait complete. 2024-09-21T03:34:00.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.567+0000 7f33b4b35640 1 -- 172.21.15.84:0/1459474733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33b01083a0 msgr2=0x7f33b01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:00.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.567+0000 7f33b4b35640 1 --2- 172.21.15.84:0/1459474733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33b01083a0 0x7f33b01087b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f33a4009900 tx=0x7f33a402a410 comp rx=0 tx=0).stop 2024-09-21T03:34:00.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.567+0000 7f33b4b35640 1 -- 172.21.15.84:0/1459474733 shutdown_connections 2024-09-21T03:34:00.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.567+0000 7f33b4b35640 1 --2- 172.21.15.84:0/1459474733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33b0108cf0 0x7f33b010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:00.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.567+0000 7f33b4b35640 1 --2- 172.21.15.84:0/1459474733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33b01083a0 0x7f33b01087b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:00.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.567+0000 7f33b4b35640 1 --2- 172.21.15.84:0/1459474733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33b0102a60 0x7f33b0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:00.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.567+0000 7f33b4b35640 1 -- 172.21.15.84:0/1459474733 >> 172.21.15.84:0/1459474733 conn(0x7f33b0079730 msgr2=0x7f33b0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:00.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.568+0000 7f33b4b35640 1 -- 172.21.15.84:0/1459474733 shutdown_connections 2024-09-21T03:34:00.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.568+0000 7f33b4b35640 1 -- 172.21.15.84:0/1459474733 wait complete. 2024-09-21T03:34:00.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.568+0000 7f33b4b35640 1 Processor -- start 2024-09-21T03:34:00.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.568+0000 7f33b4b35640 1 -- start start 2024-09-21T03:34:00.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f33b4b35640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33b0102a60 0x7f33b019a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:00.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f33b4b35640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33b01083a0 0x7f33b019a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:00.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f33b4b35640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33b0108cf0 0x7f33b019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:00.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f33b4b35640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f33b0112790 con 0x7f33b0102a60 2024-09-21T03:34:00.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f33b4b35640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f33b0112610 con 0x7f33b0108cf0 2024-09-21T03:34:00.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f33b4b35640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f33b0112910 con 0x7f33b01083a0 2024-09-21T03:34:00.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f33ae59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33b0102a60 0x7f33b019a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:00.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f33ae59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33b0102a60 0x7f33b019a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32898/0 (socket says 172.21.15.84:32898) 2024-09-21T03:34:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f33ae59c640 1 -- 172.21.15.84:0/2393439170 learned_addr learned my addr 172.21.15.84:0/2393439170 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f33add9b640 1 --2- 172.21.15.84:0/2393439170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33b01083a0 0x7f33b019a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f33aed9d640 1 --2- 172.21.15.84:0/2393439170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33b0108cf0 0x7f33b019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f33ae59c640 1 -- 172.21.15.84:0/2393439170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33b01083a0 msgr2=0x7f33b019a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f33ae59c640 1 --2- 172.21.15.84:0/2393439170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33b01083a0 0x7f33b019a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f33ae59c640 1 -- 172.21.15.84:0/2393439170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33b0108cf0 msgr2=0x7f33b019fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f33ae59c640 1 --2- 172.21.15.84:0/2393439170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33b0108cf0 0x7f33b019fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f33ae59c640 1 -- 172.21.15.84:0/2393439170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b01a0360 con 0x7f33b0102a60 2024-09-21T03:34:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f33aed9d640 1 --2- 172.21.15.84:0/2393439170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33b0108cf0 0x7f33b019fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:34:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f33ae59c640 1 --2- 172.21.15.84:0/2393439170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33b0102a60 0x7f33b019a3f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f33a000d770 tx=0x7f33a000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f339f7fe640 1 -- 172.21.15.84:0/2393439170 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a0017070 con 0x7f33b0102a60 2024-09-21T03:34:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f339f7fe640 1 -- 172.21.15.84:0/2393439170 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f33a0005490 con 0x7f33b0102a60 2024-09-21T03:34:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f33b4b35640 1 -- 172.21.15.84:0/2393439170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b01a0650 con 0x7f33b0102a60 2024-09-21T03:34:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.569+0000 7f339f7fe640 1 -- 172.21.15.84:0/2393439170 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a0004b10 con 0x7f33b0102a60 2024-09-21T03:34:00.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.570+0000 7f33b4b35640 1 -- 172.21.15.84:0/2393439170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b01a6db0 con 0x7f33b0102a60 2024-09-21T03:34:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.570+0000 7f33b4b35640 1 -- 172.21.15.84:0/2393439170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33b0102e70 con 0x7f33b0102a60 2024-09-21T03:34:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.571+0000 7f339f7fe640 1 -- 172.21.15.84:0/2393439170 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 18) ==== 51915+0+0 (secure 0 0 0) 0x7f33a0004cb0 con 0x7f33b0102a60 2024-09-21T03:34:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.571+0000 7f339f7fe640 1 --2- 172.21.15.84:0/2393439170 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f339803fb70 0x7f3398042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.571+0000 7f339f7fe640 1 -- 172.21.15.84:0/2393439170 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f33a0054090 con 0x7f33b0102a60 2024-09-21T03:34:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.571+0000 7f33add9b640 1 --2- 172.21.15.84:0/2393439170 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f339803fb70 0x7f3398042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.571+0000 7f33add9b640 1 --2- 172.21.15.84:0/2393439170 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f339803fb70 0x7f3398042080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f33a4031440 tx=0x7f33a4005a20 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.576+0000 7f339f7fe640 1 -- 172.21.15.84:0/2393439170 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f33a0009c30 con 0x7f33b0102a60 2024-09-21T03:34:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.757+0000 7f33b4b35640 1 -- 172.21.15.84:0/2393439170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f33b01a6f80 con 0x7f33b0102a60 2024-09-21T03:34:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.765+0000 7f339f7fe640 1 -- 172.21.15.84:0/2393439170 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v16)=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f33a0010da0 con 0x7f33b0102a60 2024-09-21T03:34:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.767+0000 7f33b4b35640 1 -- 172.21.15.84:0/2393439170 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f339803fb70 msgr2=0x7f3398042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.767+0000 7f33b4b35640 1 --2- 172.21.15.84:0/2393439170 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f339803fb70 0x7f3398042080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f33a4031440 tx=0x7f33a4005a20 comp rx=0 tx=0).stop 2024-09-21T03:34:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.767+0000 7f33b4b35640 1 -- 172.21.15.84:0/2393439170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33b0102a60 msgr2=0x7f33b019a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:00.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.767+0000 7f33b4b35640 1 --2- 172.21.15.84:0/2393439170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33b0102a60 0x7f33b019a3f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f33a000d770 tx=0x7f33a000dc30 comp rx=0 tx=0).stop 2024-09-21T03:34:00.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.767+0000 7f33b4b35640 1 -- 172.21.15.84:0/2393439170 shutdown_connections 2024-09-21T03:34:00.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.767+0000 7f33b4b35640 1 --2- 172.21.15.84:0/2393439170 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f339803fb70 0x7f3398042080 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:00.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.767+0000 7f33b4b35640 1 --2- 172.21.15.84:0/2393439170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33b0108cf0 0x7f33b019fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:00.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.767+0000 7f33b4b35640 1 --2- 172.21.15.84:0/2393439170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33b01083a0 0x7f33b019a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:00.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.767+0000 7f33b4b35640 1 --2- 172.21.15.84:0/2393439170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f33b0102a60 0x7f33b019a3f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:00.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.767+0000 7f33b4b35640 1 -- 172.21.15.84:0/2393439170 >> 172.21.15.84:0/2393439170 conn(0x7f33b0079730 msgr2=0x7f33b0101aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:00.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.767+0000 7f33b4b35640 1 -- 172.21.15.84:0/2393439170 shutdown_connections 2024-09-21T03:34:00.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:33:58.767+0000 7f33b4b35640 1 -- 172.21.15.84:0/2393439170 wait complete. 2024-09-21T03:34:00.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:59 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:00.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:59 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:00.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:59 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:00.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:59 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:00.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:59 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:00.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:59 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:00.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:59 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:00.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:33:59 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:00.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:59 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:00.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:59 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:00.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:59 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:00.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:59 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:00.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:59 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:00.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:59 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:00.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:59 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:00.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:33:59 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:01.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:00 smithi084 ceph-mon[30941]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T03:34:01.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:00 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:34:01.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:00 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:34:01.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:00 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:01.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:00 smithi084 ceph-mon[30941]: Reconfiguring daemon mgr.x on smithi084 2024-09-21T03:34:01.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:00 smithi084 ceph-mon[30941]: from='client.? ' entity='client.admin' 2024-09-21T03:34:01.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:00 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:01.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:00 smithi174 ceph-mon[34403]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T03:34:01.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:00 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:34:01.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:00 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:34:01.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:00 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:01.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:00 smithi174 ceph-mon[34403]: Reconfiguring daemon mgr.x on smithi084 2024-09-21T03:34:01.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:00 smithi174 ceph-mon[34403]: from='client.? ' entity='client.admin' 2024-09-21T03:34:01.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:00 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:01.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:00 smithi172 ceph-mon[34821]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T03:34:01.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:00 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:34:01.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:00 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:34:01.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:00 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:01.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:00 smithi172 ceph-mon[34821]: Reconfiguring daemon mgr.x on smithi084 2024-09-21T03:34:01.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:00 smithi172 ceph-mon[34821]: from='client.? ' entity='client.admin' 2024-09-21T03:34:01.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:00 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:01.948 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:01 smithi084 ceph-mon[30941]: Standby manager daemon z started 2024-09-21T03:34:01.948 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:01 smithi084 ceph-mon[30941]: from='mgr.? 172.21.15.174:0/1177541202' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T03:34:01.948 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:01 smithi084 ceph-mon[30941]: from='mgr.? 172.21.15.174:0/1177541202' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:34:01.949 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:01 smithi084 ceph-mon[30941]: from='mgr.? 172.21.15.174:0/1177541202' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T03:34:01.949 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:01 smithi084 ceph-mon[30941]: from='mgr.? 172.21.15.174:0/1177541202' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:34:02.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:01 smithi174 ceph-mon[34403]: Standby manager daemon z started 2024-09-21T03:34:02.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:01 smithi174 ceph-mon[34403]: from='mgr.? 172.21.15.174:0/1177541202' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T03:34:02.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:01 smithi174 ceph-mon[34403]: from='mgr.? 172.21.15.174:0/1177541202' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:34:02.130 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:01 smithi174 ceph-mon[34403]: from='mgr.? 172.21.15.174:0/1177541202' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T03:34:02.130 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:01 smithi174 ceph-mon[34403]: from='mgr.? 172.21.15.174:0/1177541202' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:34:02.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:01 smithi172 ceph-mon[34821]: Standby manager daemon z started 2024-09-21T03:34:02.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:01 smithi172 ceph-mon[34821]: from='mgr.? 172.21.15.174:0/1177541202' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T03:34:02.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:01 smithi172 ceph-mon[34821]: from='mgr.? 172.21.15.174:0/1177541202' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:34:02.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:01 smithi172 ceph-mon[34821]: from='mgr.? 172.21.15.174:0/1177541202' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T03:34:02.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:01 smithi172 ceph-mon[34821]: from='mgr.? 172.21.15.174:0/1177541202' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:34:02.449 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:02.451 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:02.451 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:02.451 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:02.455 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:02.456 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:02.458 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:02.582 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:02.857 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:02.857 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:03.122 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:02 smithi084 ceph-mon[30941]: mgrmap e19: x(active, since 11s), standbys: z 2024-09-21T03:34:03.122 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:02 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T03:34:03.122 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:02 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:03.122 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:02 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:03.122 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:02 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:03.122 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:02 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:03.123 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:02 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:03.123 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:02 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:03.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:02 smithi174 ceph-mon[34403]: mgrmap e19: x(active, since 11s), standbys: z 2024-09-21T03:34:03.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:02 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T03:34:03.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:02 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:03.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:02 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:03.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:02 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:03.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:02 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:03.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:02 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:03.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:02 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:03.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:02 smithi172 ceph-mon[34821]: mgrmap e19: x(active, since 11s), standbys: z 2024-09-21T03:34:03.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:02 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T03:34:03.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:02 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:03.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:02 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:03.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:02 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:03.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:02 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:03.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:02 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:03.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:02 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:04.047 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:03 smithi084 ceph-mon[30941]: Standby manager daemon y started 2024-09-21T03:34:04.047 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:03 smithi084 ceph-mon[30941]: from='mgr.? 172.21.15.172:0/3267760476' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T03:34:04.047 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:03 smithi084 ceph-mon[30941]: from='mgr.? 172.21.15.172:0/3267760476' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:34:04.047 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:03 smithi084 ceph-mon[30941]: from='mgr.? 172.21.15.172:0/3267760476' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T03:34:04.047 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:03 smithi084 ceph-mon[30941]: from='mgr.? 172.21.15.172:0/3267760476' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:34:04.074 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi084') 2024-09-21T03:34:04.074 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi084') 2024-09-21T03:34:04.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:03 smithi174 ceph-mon[34403]: Standby manager daemon y started 2024-09-21T03:34:04.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:03 smithi174 ceph-mon[34403]: from='mgr.? 172.21.15.172:0/3267760476' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T03:34:04.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:03 smithi174 ceph-mon[34403]: from='mgr.? 172.21.15.172:0/3267760476' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:34:04.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:03 smithi174 ceph-mon[34403]: from='mgr.? 172.21.15.172:0/3267760476' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T03:34:04.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:03 smithi174 ceph-mon[34403]: from='mgr.? 172.21.15.172:0/3267760476' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:34:04.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:03 smithi172 ceph-mon[34821]: Standby manager daemon y started 2024-09-21T03:34:04.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:03 smithi172 ceph-mon[34821]: from='mgr.? 172.21.15.172:0/3267760476' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T03:34:04.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:03 smithi172 ceph-mon[34821]: from='mgr.? 172.21.15.172:0/3267760476' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:34:04.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:03 smithi172 ceph-mon[34821]: from='mgr.? 172.21.15.172:0/3267760476' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T03:34:04.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:03 smithi172 ceph-mon[34821]: from='mgr.? 172.21.15.172:0/3267760476' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:34:04.878 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:04 smithi084 ceph-mon[30941]: mgrmap e20: x(active, since 13s), standbys: z, y 2024-09-21T03:34:04.878 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:04 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T03:34:04.879 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:04 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3587386851' entity='client.admin' 2024-09-21T03:34:04.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.887+0000 7f4b44f4f640 1 -- 172.21.15.84:0/2472867618 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b40108d10 msgr2=0x7f4b4010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:04.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.887+0000 7f4b44f4f640 1 --2- 172.21.15.84:0/2472867618 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b40108d10 0x7f4b4010f540 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009ca0 tx=0x7f4b3802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:34:04.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.887+0000 7f4b44f4f640 1 -- 172.21.15.84:0/2472867618 shutdown_connections 2024-09-21T03:34:04.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.887+0000 7f4b44f4f640 1 --2- 172.21.15.84:0/2472867618 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b40108d10 0x7f4b4010f540 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:04.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.887+0000 7f4b44f4f640 1 --2- 172.21.15.84:0/2472867618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b401083c0 0x7f4b401087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:04.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.887+0000 7f4b44f4f640 1 --2- 172.21.15.84:0/2472867618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b40102a80 0x7f4b40102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:04.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.887+0000 7f4b44f4f640 1 -- 172.21.15.84:0/2472867618 >> 172.21.15.84:0/2472867618 conn(0x7f4b40079740 msgr2=0x7f4b40079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:04.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.887+0000 7f4b44f4f640 1 -- 172.21.15.84:0/2472867618 shutdown_connections 2024-09-21T03:34:04.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.887+0000 7f4b44f4f640 1 -- 172.21.15.84:0/2472867618 wait complete. 2024-09-21T03:34:04.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.888+0000 7f4b44f4f640 1 Processor -- start 2024-09-21T03:34:04.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.888+0000 7f4b44f4f640 1 -- start start 2024-09-21T03:34:04.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.888+0000 7f4b44f4f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b40102a80 0x7f4b4019b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:04.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.888+0000 7f4b44f4f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b401083c0 0x7f4b4019b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:04.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.888+0000 7f4b44f4f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b40108d10 0x7f4b4019bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:04.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.888+0000 7f4b44f4f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4b40112860 con 0x7f4b40102a80 2024-09-21T03:34:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.888+0000 7f4b44f4f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b401126e0 con 0x7f4b40108d10 2024-09-21T03:34:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.888+0000 7f4b44f4f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4b401129e0 con 0x7f4b401083c0 2024-09-21T03:34:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.888+0000 7f4b3e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b40102a80 0x7f4b4019b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.888+0000 7f4b3e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b40102a80 0x7f4b4019b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32976/0 (socket says 172.21.15.84:32976) 2024-09-21T03:34:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.888+0000 7f4b3e59c640 1 -- 172.21.15.84:0/2099677192 learned_addr learned my addr 172.21.15.84:0/2099677192 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.888+0000 7f4b3ed9d640 1 --2- 172.21.15.84:0/2099677192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b40108d10 0x7f4b4019bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.888+0000 7f4b3dd9b640 1 --2- 172.21.15.84:0/2099677192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b401083c0 0x7f4b4019b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.888+0000 7f4b3e59c640 1 -- 172.21.15.84:0/2099677192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b401083c0 msgr2=0x7f4b4019b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.888+0000 7f4b3e59c640 1 --2- 172.21.15.84:0/2099677192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b401083c0 0x7f4b4019b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.888+0000 7f4b3e59c640 1 -- 172.21.15.84:0/2099677192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b40108d10 msgr2=0x7f4b4019bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.888+0000 7f4b3e59c640 1 --2- 172.21.15.84:0/2099677192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b40108d10 0x7f4b4019bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.888+0000 7f4b3e59c640 1 -- 172.21.15.84:0/2099677192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b401a63c0 con 0x7f4b40102a80 2024-09-21T03:34:04.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.889+0000 7f4b3dd9b640 1 --2- 172.21.15.84:0/2099677192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b401083c0 0x7f4b4019b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:34:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.889+0000 7f4b3e59c640 1 --2- 172.21.15.84:0/2099677192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b40102a80 0x7f4b4019b130 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000e9f0 tx=0x7f4b3000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.889+0000 7f4b2f7fe640 1 -- 172.21.15.84:0/2099677192 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3000cd80 con 0x7f4b40102a80 2024-09-21T03:34:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.889+0000 7f4b2f7fe640 1 -- 172.21.15.84:0/2099677192 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f4b300054b0 con 0x7f4b40102a80 2024-09-21T03:34:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.889+0000 7f4b2f7fe640 1 -- 172.21.15.84:0/2099677192 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b30010430 con 0x7f4b40102a80 2024-09-21T03:34:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.889+0000 7f4b44f4f640 1 -- 172.21.15.84:0/2099677192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b401a66b0 con 0x7f4b40102a80 2024-09-21T03:34:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.889+0000 7f4b44f4f640 1 -- 172.21.15.84:0/2099677192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b401a6ba0 con 0x7f4b40102a80 2024-09-21T03:34:04.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.890+0000 7f4b44f4f640 1 -- 172.21.15.84:0/2099677192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b40102e90 con 0x7f4b40102a80 2024-09-21T03:34:04.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.893+0000 7f4b2f7fe640 1 -- 172.21.15.84:0/2099677192 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f4b300046c0 con 0x7f4b40102a80 2024-09-21T03:34:04.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.894+0000 7f4b2f7fe640 1 --2- 172.21.15.84:0/2099677192 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b280b6500 0x7f4b280b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:04.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.894+0000 7f4b3dd9b640 1 --2- 172.21.15.84:0/2099677192 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b280b6500 0x7f4b280b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:04.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.894+0000 7f4b2f7fe640 1 -- 172.21.15.84:0/2099677192 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4b300e5e60 con 0x7f4b40102a80 2024-09-21T03:34:04.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.894+0000 7f4b3dd9b640 1 --2- 172.21.15.84:0/2099677192 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b280b6500 0x7f4b280b8a10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4b4006a3f0 tx=0x7f4b34005d30 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:04.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.896+0000 7f4b2f7fe640 1 -- 172.21.15.84:0/2099677192 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4b30056710 con 0x7f4b40102a80 2024-09-21T03:34:05.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.744+0000 7f36e3a20640 1 -- 172.21.15.84:0/2292685417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36dc102a60 msgr2=0x7f36dc102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:05.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.744+0000 7f36e3a20640 1 --2- 172.21.15.84:0/2292685417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36dc102a60 0x7f36dc102e70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f36cc009ca0 tx=0x7f36cc02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.744+0000 7f36e3a20640 1 -- 172.21.15.84:0/2292685417 shutdown_connections 2024-09-21T03:34:05.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.744+0000 7f36e3a20640 1 --2- 172.21.15.84:0/2292685417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f36dc108cf0 0x7f36dc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.744+0000 7f36e3a20640 1 --2- 172.21.15.84:0/2292685417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36dc1083a0 0x7f36dc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.744+0000 7f36e3a20640 1 --2- 172.21.15.84:0/2292685417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36dc102a60 0x7f36dc102e70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.744+0000 7f36e3a20640 1 -- 172.21.15.84:0/2292685417 >> 172.21.15.84:0/2292685417 conn(0x7f36dc079730 msgr2=0x7f36dc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:05.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.744+0000 7f36e3a20640 1 -- 172.21.15.84:0/2292685417 shutdown_connections 2024-09-21T03:34:05.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.744+0000 7f36e3a20640 1 -- 172.21.15.84:0/2292685417 wait complete. 2024-09-21T03:34:05.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.745+0000 7f36e3a20640 1 Processor -- start 2024-09-21T03:34:05.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.745+0000 7f36e3a20640 1 -- start start 2024-09-21T03:34:05.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.746+0000 7f36e3a20640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36dc102a60 0x7f36dc1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.746+0000 7f36e3a20640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f36dc1083a0 0x7f36dc199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.746+0000 7f36e3a20640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36dc108cf0 0x7f36dc19eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.746+0000 7f36e3a20640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f36dc112840 con 0x7f36dc108cf0 2024-09-21T03:34:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.746+0000 7f36e3a20640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f36dc1126c0 con 0x7f36dc102a60 2024-09-21T03:34:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.746+0000 7f36e3a20640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f36dc1129c0 con 0x7f36dc1083a0 2024-09-21T03:34:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.746+0000 7f36e1fbd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36dc108cf0 0x7f36dc19eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.746+0000 7f36e17bc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36dc102a60 0x7f36dc1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.746+0000 7f36e1fbd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36dc108cf0 0x7f36dc19eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32938/0 (socket says 172.21.15.84:32938) 2024-09-21T03:34:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.746+0000 7f36e1fbd640 1 -- 172.21.15.84:0/3587386851 learned_addr learned my addr 172.21.15.84:0/3587386851 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.746+0000 7f36e0fbb640 1 --2- 172.21.15.84:0/3587386851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f36dc1083a0 0x7f36dc199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.746+0000 7f36e1fbd640 1 -- 172.21.15.84:0/3587386851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f36dc1083a0 msgr2=0x7f36dc199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.746+0000 7f36e1fbd640 1 --2- 172.21.15.84:0/3587386851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f36dc1083a0 0x7f36dc199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.746+0000 7f36e1fbd640 1 -- 172.21.15.84:0/3587386851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36dc102a60 msgr2=0x7f36dc1992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.746+0000 7f36e1fbd640 1 --2- 172.21.15.84:0/3587386851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36dc102a60 0x7f36dc1992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.746+0000 7f36e1fbd640 1 -- 172.21.15.84:0/3587386851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36dc19f260 con 0x7f36dc108cf0 2024-09-21T03:34:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.746+0000 7f36e17bc640 1 --2- 172.21.15.84:0/3587386851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36dc102a60 0x7f36dc1992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:34:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.746+0000 7f36e1fbd640 1 --2- 172.21.15.84:0/3587386851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36dc108cf0 0x7f36dc19eb30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f36d400d750 tx=0x7f36d400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.746+0000 7f36da7fc640 1 -- 172.21.15.84:0/3587386851 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d4017070 con 0x7f36dc108cf0 2024-09-21T03:34:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.747+0000 7f36e3a20640 1 -- 172.21.15.84:0/3587386851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36dc19f550 con 0x7f36dc108cf0 2024-09-21T03:34:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.747+0000 7f36da7fc640 1 -- 172.21.15.84:0/3587386851 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f36d40054b0 con 0x7f36dc108cf0 2024-09-21T03:34:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.747+0000 7f36e3a20640 1 -- 172.21.15.84:0/3587386851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36dc1a5cb0 con 0x7f36dc108cf0 2024-09-21T03:34:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.747+0000 7f36da7fc640 1 -- 172.21.15.84:0/3587386851 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36d4004ba0 con 0x7f36dc108cf0 2024-09-21T03:34:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.748+0000 7f36e3a20640 1 -- 172.21.15.84:0/3587386851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36dc102e70 con 0x7f36dc108cf0 2024-09-21T03:34:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.748+0000 7f36da7fc640 1 -- 172.21.15.84:0/3587386851 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 19) ==== 103194+0+0 (secure 0 0 0) 0x7f36d4010460 con 0x7f36dc108cf0 2024-09-21T03:34:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.749+0000 7f36da7fc640 1 --2- 172.21.15.84:0/3587386851 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f36c407b020 0x7f36c407d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.749+0000 7f36e17bc640 1 --2- 172.21.15.84:0/3587386851 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f36c407b020 0x7f36c407d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.749+0000 7f36da7fc640 1 -- 172.21.15.84:0/3587386851 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f36d409c820 con 0x7f36dc108cf0 2024-09-21T03:34:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.749+0000 7f36e17bc640 1 --2- 172.21.15.84:0/3587386851 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f36c407b020 0x7f36c407d530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f36cc0094e0 tx=0x7f36cc031000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.754+0000 7f36da7fc640 1 -- 172.21.15.84:0/3587386851 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f36d40691b0 con 0x7f36dc108cf0 2024-09-21T03:34:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.856+0000 7f36da7fc640 1 -- 172.21.15.84:0/3587386851 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f36d40609f0 con 0x7f36dc108cf0 2024-09-21T03:34:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.943+0000 7f36e3a20640 1 -- 172.21.15.84:0/3587386851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f36dc10aac0 con 0x7f36dc108cf0 2024-09-21T03:34:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.947+0000 7f36da7fc640 1 -- 172.21.15.84:0/3587386851 <== mon.0 v2:172.21.15.84:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v18)=0 v18) ==== 117+0+0 (secure 0 0 0) 0x7f36d40b6840 con 0x7f36dc108cf0 2024-09-21T03:34:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.950+0000 7f36e3a20640 1 -- 172.21.15.84:0/3587386851 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f36c407b020 msgr2=0x7f36c407d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.950+0000 7f36e3a20640 1 --2- 172.21.15.84:0/3587386851 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f36c407b020 0x7f36c407d530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f36cc0094e0 tx=0x7f36cc031000 comp rx=0 tx=0).stop 2024-09-21T03:34:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.950+0000 7f36e3a20640 1 -- 172.21.15.84:0/3587386851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36dc108cf0 msgr2=0x7f36dc19eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.950+0000 7f36e3a20640 1 --2- 172.21.15.84:0/3587386851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36dc108cf0 0x7f36dc19eb30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f36d400d750 tx=0x7f36d400dc10 comp rx=0 tx=0).stop 2024-09-21T03:34:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.950+0000 7f36e3a20640 1 -- 172.21.15.84:0/3587386851 shutdown_connections 2024-09-21T03:34:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.950+0000 7f36e3a20640 1 --2- 172.21.15.84:0/3587386851 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f36c407b020 0x7f36c407d530 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.950+0000 7f36e3a20640 1 --2- 172.21.15.84:0/3587386851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f36dc108cf0 0x7f36dc19eb30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.950+0000 7f36e3a20640 1 --2- 172.21.15.84:0/3587386851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f36dc1083a0 0x7f36dc199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.950+0000 7f36e3a20640 1 --2- 172.21.15.84:0/3587386851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f36dc102a60 0x7f36dc1992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.950+0000 7f36e3a20640 1 -- 172.21.15.84:0/3587386851 >> 172.21.15.84:0/3587386851 conn(0x7f36dc079730 msgr2=0x7f36dc1014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:05.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.950+0000 7f36e3a20640 1 -- 172.21.15.84:0/3587386851 shutdown_connections 2024-09-21T03:34:05.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:03.950+0000 7f36e3a20640 1 -- 172.21.15.84:0/3587386851 wait complete. 2024-09-21T03:34:05.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.086+0000 7f4b44f4f640 1 -- 172.21.15.84:0/2099677192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f4b4006bc30 con 0x7f4b40102a80 2024-09-21T03:34:05.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.090+0000 7f4b2f7fe640 1 -- 172.21.15.84:0/2099677192 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v20)=0 v20) ==== 127+0+0 (secure 0 0 0) 0x7f4b300ae250 con 0x7f4b40102a80 2024-09-21T03:34:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.093+0000 7f4b44f4f640 1 -- 172.21.15.84:0/2099677192 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b280b6500 msgr2=0x7f4b280b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.093+0000 7f4b44f4f640 1 --2- 172.21.15.84:0/2099677192 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b280b6500 0x7f4b280b8a10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4b4006a3f0 tx=0x7f4b34005d30 comp rx=0 tx=0).stop 2024-09-21T03:34:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.093+0000 7f4b44f4f640 1 -- 172.21.15.84:0/2099677192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b40102a80 msgr2=0x7f4b4019b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.093+0000 7f4b44f4f640 1 --2- 172.21.15.84:0/2099677192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b40102a80 0x7f4b4019b130 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4b3000e9f0 tx=0x7f4b3000edf0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.093+0000 7f4b44f4f640 1 -- 172.21.15.84:0/2099677192 shutdown_connections 2024-09-21T03:34:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.093+0000 7f4b44f4f640 1 --2- 172.21.15.84:0/2099677192 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b280b6500 0x7f4b280b8a10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.093+0000 7f4b44f4f640 1 --2- 172.21.15.84:0/2099677192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b40108d10 0x7f4b4019bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.093+0000 7f4b44f4f640 1 --2- 172.21.15.84:0/2099677192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b401083c0 0x7f4b4019b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.093+0000 7f4b44f4f640 1 --2- 172.21.15.84:0/2099677192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b40102a80 0x7f4b4019b130 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.093+0000 7f4b44f4f640 1 -- 172.21.15.84:0/2099677192 >> 172.21.15.84:0/2099677192 conn(0x7f4b40079740 msgr2=0x7f4b401043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.093+0000 7f4b44f4f640 1 -- 172.21.15.84:0/2099677192 shutdown_connections 2024-09-21T03:34:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.093+0000 7f4b44f4f640 1 -- 172.21.15.84:0/2099677192 wait complete. 2024-09-21T03:34:05.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:04 smithi174 ceph-mon[34403]: mgrmap e20: x(active, since 13s), standbys: z, y 2024-09-21T03:34:05.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:04 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T03:34:05.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:04 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3587386851' entity='client.admin' 2024-09-21T03:34:05.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:04 smithi172 ceph-mon[34821]: mgrmap e20: x(active, since 13s), standbys: z, y 2024-09-21T03:34:05.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:04 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T03:34:05.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:04 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3587386851' entity='client.admin' 2024-09-21T03:34:05.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.784+0000 7f3daf25d640 1 -- 172.21.15.84:0/1226737276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3da8103b90 msgr2=0x7f3da8103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.784+0000 7f3daf25d640 1 --2- 172.21.15.84:0/1226737276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3da8103b90 0x7f3da8103fa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009900 tx=0x7f3d9802a410 comp rx=0 tx=0).stop 2024-09-21T03:34:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.784+0000 7f3daf25d640 1 -- 172.21.15.84:0/1226737276 shutdown_connections 2024-09-21T03:34:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.784+0000 7f3daf25d640 1 --2- 172.21.15.84:0/1226737276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3da8109e20 0x7f3da8110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.784+0000 7f3daf25d640 1 --2- 172.21.15.84:0/1226737276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3da81094d0 0x7f3da81098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.784+0000 7f3daf25d640 1 --2- 172.21.15.84:0/1226737276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3da8103b90 0x7f3da8103fa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.784+0000 7f3daf25d640 1 -- 172.21.15.84:0/1226737276 >> 172.21.15.84:0/1226737276 conn(0x7f3da80ff600 msgr2=0x7f3da8101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.784+0000 7f3daf25d640 1 -- 172.21.15.84:0/1226737276 shutdown_connections 2024-09-21T03:34:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.784+0000 7f3daf25d640 1 -- 172.21.15.84:0/1226737276 wait complete. 2024-09-21T03:34:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.785+0000 7f3daf25d640 1 Processor -- start 2024-09-21T03:34:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.785+0000 7f3daf25d640 1 -- start start 2024-09-21T03:34:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.785+0000 7f3daf25d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3da8103b90 0x7f3da819a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.785+0000 7f3daf25d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3da81094d0 0x7f3da819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:05.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.785+0000 7f3daf25d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3da8109e20 0x7f3da819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.785+0000 7f3daf25d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3da81139c0 con 0x7f3da8103b90 2024-09-21T03:34:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.785+0000 7f3daf25d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3da8113840 con 0x7f3da8109e20 2024-09-21T03:34:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.785+0000 7f3daf25d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3da8113b40 con 0x7f3da81094d0 2024-09-21T03:34:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.785+0000 7f3dacff9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3da8103b90 0x7f3da819a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.785+0000 7f3dacff9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3da8103b90 0x7f3da819a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32950/0 (socket says 172.21.15.84:32950) 2024-09-21T03:34:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.786+0000 7f3dacff9640 1 -- 172.21.15.84:0/509764053 learned_addr learned my addr 172.21.15.84:0/509764053 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.786+0000 7f3da7fff640 1 --2- 172.21.15.84:0/509764053 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3da81094d0 0x7f3da819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.786+0000 7f3dad7fa640 1 --2- 172.21.15.84:0/509764053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3da8109e20 0x7f3da819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.786+0000 7f3dacff9640 1 -- 172.21.15.84:0/509764053 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3da81094d0 msgr2=0x7f3da819a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.786+0000 7f3dacff9640 1 --2- 172.21.15.84:0/509764053 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3da81094d0 0x7f3da819a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.786+0000 7f3dacff9640 1 -- 172.21.15.84:0/509764053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3da8109e20 msgr2=0x7f3da819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.786+0000 7f3dacff9640 1 --2- 172.21.15.84:0/509764053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3da8109e20 0x7f3da819fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.786+0000 7f3dacff9640 1 -- 172.21.15.84:0/509764053 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da81a0360 con 0x7f3da8103b90 2024-09-21T03:34:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.786+0000 7f3da7fff640 1 --2- 172.21.15.84:0/509764053 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3da81094d0 0x7f3da819a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:34:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.786+0000 7f3dacff9640 1 --2- 172.21.15.84:0/509764053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3da8103b90 0x7f3da819a3f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3d98006010 tx=0x7f3d980040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.786+0000 7f3da5ffb640 1 -- 172.21.15.84:0/509764053 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9803f030 con 0x7f3da8103b90 2024-09-21T03:34:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.786+0000 7f3da5ffb640 1 -- 172.21.15.84:0/509764053 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3d98003a80 con 0x7f3da8103b90 2024-09-21T03:34:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.786+0000 7f3daf25d640 1 -- 172.21.15.84:0/509764053 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da81a05f0 con 0x7f3da8103b90 2024-09-21T03:34:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.786+0000 7f3da5ffb640 1 -- 172.21.15.84:0/509764053 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d98035070 con 0x7f3da8103b90 2024-09-21T03:34:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.786+0000 7f3daf25d640 1 -- 172.21.15.84:0/509764053 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da81a6db0 con 0x7f3da8103b90 2024-09-21T03:34:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.788+0000 7f3daf25d640 1 -- 172.21.15.84:0/509764053 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3da8103fa0 con 0x7f3da8103b90 2024-09-21T03:34:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.789+0000 7f3da5ffb640 1 -- 172.21.15.84:0/509764053 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f3d98042030 con 0x7f3da8103b90 2024-09-21T03:34:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.790+0000 7f3da5ffb640 1 --2- 172.21.15.84:0/509764053 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f3d900b64d0 0x7f3d900b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.790+0000 7f3da7fff640 1 --2- 172.21.15.84:0/509764053 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f3d900b64d0 0x7f3d900b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.790+0000 7f3da5ffb640 1 -- 172.21.15.84:0/509764053 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f3d98105ee0 con 0x7f3da8103b90 2024-09-21T03:34:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.791+0000 7f3da7fff640 1 --2- 172.21.15.84:0/509764053 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f3d900b64d0 0x7f3d900b89e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3da8108f20 tx=0x7f3d9c005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:05.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.794+0000 7f3da5ffb640 1 -- 172.21.15.84:0/509764053 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3d980ce2d0 con 0x7f3da8103b90 2024-09-21T03:34:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.983+0000 7f3daf25d640 1 -- 172.21.15.84:0/509764053 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f3da802e640 con 0x7f3da8103b90 2024-09-21T03:34:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.989+0000 7f3da5ffb640 1 -- 172.21.15.84:0/509764053 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v19)=0 v19) ==== 106+0+0 (secure 0 0 0) 0x7f3d980d26b0 con 0x7f3da8103b90 2024-09-21T03:34:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.991+0000 7f3daf25d640 1 -- 172.21.15.84:0/509764053 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f3d900b64d0 msgr2=0x7f3d900b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.991+0000 7f3daf25d640 1 --2- 172.21.15.84:0/509764053 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f3d900b64d0 0x7f3d900b89e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3da8108f20 tx=0x7f3d9c005f90 comp rx=0 tx=0).stop 2024-09-21T03:34:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.991+0000 7f3daf25d640 1 -- 172.21.15.84:0/509764053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3da8103b90 msgr2=0x7f3da819a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.991+0000 7f3daf25d640 1 --2- 172.21.15.84:0/509764053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3da8103b90 0x7f3da819a3f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3d98006010 tx=0x7f3d980040c0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.991+0000 7f3daf25d640 1 -- 172.21.15.84:0/509764053 shutdown_connections 2024-09-21T03:34:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.991+0000 7f3daf25d640 1 --2- 172.21.15.84:0/509764053 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f3d900b64d0 0x7f3d900b89e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.991+0000 7f3daf25d640 1 --2- 172.21.15.84:0/509764053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3da8109e20 0x7f3da819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.991+0000 7f3daf25d640 1 --2- 172.21.15.84:0/509764053 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3da81094d0 0x7f3da819a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.991+0000 7f3daf25d640 1 --2- 172.21.15.84:0/509764053 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3da8103b90 0x7f3da819a3f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.991+0000 7f3daf25d640 1 -- 172.21.15.84:0/509764053 >> 172.21.15.84:0/509764053 conn(0x7f3da80ff600 msgr2=0x7f3da8101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.992+0000 7f3daf25d640 1 -- 172.21.15.84:0/509764053 shutdown_connections 2024-09-21T03:34:05.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:04.992+0000 7f3daf25d640 1 -- 172.21.15.84:0/509764053 wait complete. 2024-09-21T03:34:05.971 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:06.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:05 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/509764053' entity='client.admin' 2024-09-21T03:34:06.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:05 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2099677192' entity='client.admin' 2024-09-21T03:34:06.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:05 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/509764053' entity='client.admin' 2024-09-21T03:34:06.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:05 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2099677192' entity='client.admin' 2024-09-21T03:34:06.400 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:05 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/509764053' entity='client.admin' 2024-09-21T03:34:06.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:05 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2099677192' entity='client.admin' 2024-09-21T03:34:06.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.638+0000 7fd932672640 1 -- 172.21.15.84:0/1512697948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd92c102a60 msgr2=0x7fd92c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:06.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.638+0000 7fd932672640 1 --2- 172.21.15.84:0/1512697948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd92c102a60 0x7fd92c102e70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd91c009900 tx=0x7fd91c02a410 comp rx=0 tx=0).stop 2024-09-21T03:34:06.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.638+0000 7fd932672640 1 -- 172.21.15.84:0/1512697948 shutdown_connections 2024-09-21T03:34:06.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.638+0000 7fd932672640 1 --2- 172.21.15.84:0/1512697948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd92c108cf0 0x7fd92c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:06.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.638+0000 7fd932672640 1 --2- 172.21.15.84:0/1512697948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd92c1083a0 0x7fd92c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:06.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.638+0000 7fd932672640 1 --2- 172.21.15.84:0/1512697948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd92c102a60 0x7fd92c102e70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:06.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.638+0000 7fd932672640 1 -- 172.21.15.84:0/1512697948 >> 172.21.15.84:0/1512697948 conn(0x7fd92c079730 msgr2=0x7fd92c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:06.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.638+0000 7fd932672640 1 -- 172.21.15.84:0/1512697948 shutdown_connections 2024-09-21T03:34:06.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.638+0000 7fd932672640 1 -- 172.21.15.84:0/1512697948 wait complete. 2024-09-21T03:34:06.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.639+0000 7fd932672640 1 Processor -- start 2024-09-21T03:34:06.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.639+0000 7fd932672640 1 -- start start 2024-09-21T03:34:06.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.640+0000 7fd932672640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd92c102a60 0x7fd92c19a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:06.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.640+0000 7fd932672640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd92c1083a0 0x7fd92c19a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:06.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.640+0000 7fd932672640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd92c108cf0 0x7fd92c19fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:06.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.640+0000 7fd932672640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c112840 con 0x7fd92c108cf0 2024-09-21T03:34:06.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.640+0000 7fd932672640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c1126c0 con 0x7fd92c1083a0 2024-09-21T03:34:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.640+0000 7fd932672640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c1129c0 con 0x7fd92c102a60 2024-09-21T03:34:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.640+0000 7fd930c0f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd92c108cf0 0x7fd92c19fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.640+0000 7fd930c0f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd92c108cf0 0x7fd92c19fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33038/0 (socket says 172.21.15.84:33038) 2024-09-21T03:34:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.640+0000 7fd930c0f640 1 -- 172.21.15.84:0/3445162948 learned_addr learned my addr 172.21.15.84:0/3445162948 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.640+0000 7fd92bfff640 1 --2- 172.21.15.84:0/3445162948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd92c102a60 0x7fd92c19a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.640+0000 7fd92b7fe640 1 --2- 172.21.15.84:0/3445162948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd92c1083a0 0x7fd92c19a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.640+0000 7fd930c0f640 1 -- 172.21.15.84:0/3445162948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd92c102a60 msgr2=0x7fd92c19a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.640+0000 7fd930c0f640 1 --2- 172.21.15.84:0/3445162948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd92c102a60 0x7fd92c19a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.640+0000 7fd930c0f640 1 -- 172.21.15.84:0/3445162948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd92c1083a0 msgr2=0x7fd92c19a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.640+0000 7fd930c0f640 1 --2- 172.21.15.84:0/3445162948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd92c1083a0 0x7fd92c19a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.640+0000 7fd930c0f640 1 -- 172.21.15.84:0/3445162948 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92c1a02d0 con 0x7fd92c108cf0 2024-09-21T03:34:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.640+0000 7fd92b7fe640 1 --2- 172.21.15.84:0/3445162948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd92c1083a0 0x7fd92c19a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:34:06.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.640+0000 7fd930c0f640 1 --2- 172.21.15.84:0/3445162948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd92c108cf0 0x7fd92c19fba0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd92400eb10 tx=0x7fd92400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:06.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.640+0000 7fd9297fa640 1 -- 172.21.15.84:0/3445162948 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd924004b20 con 0x7fd92c108cf0 2024-09-21T03:34:06.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.641+0000 7fd932672640 1 -- 172.21.15.84:0/3445162948 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd92c1a05c0 con 0x7fd92c108cf0 2024-09-21T03:34:06.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.641+0000 7fd9297fa640 1 -- 172.21.15.84:0/3445162948 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd924004cc0 con 0x7fd92c108cf0 2024-09-21T03:34:06.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.641+0000 7fd9297fa640 1 -- 172.21.15.84:0/3445162948 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd924010690 con 0x7fd92c108cf0 2024-09-21T03:34:06.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.641+0000 7fd932672640 1 -- 172.21.15.84:0/3445162948 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd92c1a6d20 con 0x7fd92c108cf0 2024-09-21T03:34:06.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.642+0000 7fd932672640 1 -- 172.21.15.84:0/3445162948 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd92c102e70 con 0x7fd92c108cf0 2024-09-21T03:34:06.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.643+0000 7fd9297fa640 1 -- 172.21.15.84:0/3445162948 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fd924005020 con 0x7fd92c108cf0 2024-09-21T03:34:06.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.644+0000 7fd9297fa640 1 --2- 172.21.15.84:0/3445162948 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd9140b64d0 0x7fd9140b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:06.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.644+0000 7fd92bfff640 1 --2- 172.21.15.84:0/3445162948 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd9140b64d0 0x7fd9140b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:06.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.644+0000 7fd9297fa640 1 -- 172.21.15.84:0/3445162948 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd9240e5d90 con 0x7fd92c108cf0 2024-09-21T03:34:06.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.645+0000 7fd92bfff640 1 --2- 172.21.15.84:0/3445162948 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd9140b64d0 0x7fd9140b89e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd91c009230 tx=0x7fd91c0058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:06.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.648+0000 7fd9297fa640 1 -- 172.21.15.84:0/3445162948 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd9240e9030 con 0x7fd92c108cf0 2024-09-21T03:34:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.864+0000 7fd932672640 1 -- 172.21.15.84:0/3445162948 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fd92c1a7020 con 0x7fd92c108cf0 2024-09-21T03:34:06.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.870+0000 7fd9297fa640 1 -- 172.21.15.84:0/3445162948 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v23)=0 v23) ==== 119+0+0 (secure 0 0 0) 0x7fd9240ae220 con 0x7fd92c108cf0 2024-09-21T03:34:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.873+0000 7fd932672640 1 -- 172.21.15.84:0/3445162948 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd9140b64d0 msgr2=0x7fd9140b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.873+0000 7fd932672640 1 --2- 172.21.15.84:0/3445162948 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd9140b64d0 0x7fd9140b89e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd91c009230 tx=0x7fd91c0058d0 comp rx=0 tx=0).stop 2024-09-21T03:34:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.873+0000 7fd932672640 1 -- 172.21.15.84:0/3445162948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd92c108cf0 msgr2=0x7fd92c19fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.873+0000 7fd932672640 1 --2- 172.21.15.84:0/3445162948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd92c108cf0 0x7fd92c19fba0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd92400eb10 tx=0x7fd92400c2d0 comp rx=0 tx=0).stop 2024-09-21T03:34:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.874+0000 7fd932672640 1 -- 172.21.15.84:0/3445162948 shutdown_connections 2024-09-21T03:34:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.874+0000 7fd932672640 1 --2- 172.21.15.84:0/3445162948 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd9140b64d0 0x7fd9140b89e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.874+0000 7fd932672640 1 --2- 172.21.15.84:0/3445162948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd92c108cf0 0x7fd92c19fba0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.874+0000 7fd932672640 1 --2- 172.21.15.84:0/3445162948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd92c1083a0 0x7fd92c19a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.874+0000 7fd932672640 1 --2- 172.21.15.84:0/3445162948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd92c102a60 0x7fd92c19a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.874+0000 7fd932672640 1 -- 172.21.15.84:0/3445162948 >> 172.21.15.84:0/3445162948 conn(0x7fd92c079730 msgr2=0x7fd92c101ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.874+0000 7fd932672640 1 -- 172.21.15.84:0/3445162948 shutdown_connections 2024-09-21T03:34:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.874+0000 7fd932672640 1 -- 172.21.15.84:0/3445162948 wait complete. 2024-09-21T03:34:07.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:07 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1115895037' entity='client.admin' 2024-09-21T03:34:07.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:07 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:07.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:07 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:07.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:07 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:07.178 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:07 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:07.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:07 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2905895261' entity='client.admin' 2024-09-21T03:34:07.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:07 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3445162948' entity='client.admin' 2024-09-21T03:34:07.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:07 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:07.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:07 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:07.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:07 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:07.179 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:07 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:07.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:07 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1115895037' entity='client.admin' 2024-09-21T03:34:07.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:07 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:07.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:07 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:07.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:07 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:07.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:07 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:07.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:07 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2905895261' entity='client.admin' 2024-09-21T03:34:07.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:07 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3445162948' entity='client.admin' 2024-09-21T03:34:07.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:07 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:07.379 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:07 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:07.379 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:07 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:07.379 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:07 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:07.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:07 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1115895037' entity='client.admin' 2024-09-21T03:34:07.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:07 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:07.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:07 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:07.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:07 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:07.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:07 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:07.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:07 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2905895261' entity='client.admin' 2024-09-21T03:34:07.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:07 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3445162948' entity='client.admin' 2024-09-21T03:34:07.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:07 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:07.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:07 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:07.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:07 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:07.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:07 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:08.613 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:08 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/233193153' entity='client.admin' 2024-09-21T03:34:08.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.615+0000 7f26e5e5c640 1 -- 172.21.15.84:0/4271952401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e01094d0 msgr2=0x7f26e01098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:08.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.615+0000 7f26e5e5c640 1 --2- 172.21.15.84:0/4271952401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e01094d0 0x7f26e01098e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f26d4009900 tx=0x7f26d402a410 comp rx=0 tx=0).stop 2024-09-21T03:34:08.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.615+0000 7f26e5e5c640 1 -- 172.21.15.84:0/4271952401 shutdown_connections 2024-09-21T03:34:08.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.615+0000 7f26e5e5c640 1 --2- 172.21.15.84:0/4271952401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26e0109e20 0x7f26e0110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:08.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.615+0000 7f26e5e5c640 1 --2- 172.21.15.84:0/4271952401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e01094d0 0x7f26e01098e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:08.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.615+0000 7f26e5e5c640 1 --2- 172.21.15.84:0/4271952401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26e0103b90 0x7f26e0103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:08.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.615+0000 7f26e5e5c640 1 -- 172.21.15.84:0/4271952401 >> 172.21.15.84:0/4271952401 conn(0x7f26e00ff600 msgr2=0x7f26e0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:08.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.615+0000 7f26e5e5c640 1 -- 172.21.15.84:0/4271952401 shutdown_connections 2024-09-21T03:34:08.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.615+0000 7f26e5e5c640 1 -- 172.21.15.84:0/4271952401 wait complete. 2024-09-21T03:34:08.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.616+0000 7f26e5e5c640 1 Processor -- start 2024-09-21T03:34:08.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.617+0000 7f26e5e5c640 1 -- start start 2024-09-21T03:34:08.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.617+0000 7f26e5e5c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26e0103b90 0x7f26e019a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:08.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.617+0000 7f26e5e5c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e01094d0 0x7f26e019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:08.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.617+0000 7f26e5e5c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26e0109e20 0x7f26e019fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:08.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.617+0000 7f26e5e5c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f26e01139c0 con 0x7f26e01094d0 2024-09-21T03:34:08.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.617+0000 7f26e5e5c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f26e0113840 con 0x7f26e0103b90 2024-09-21T03:34:08.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.617+0000 7f26e5e5c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f26e0113b40 con 0x7f26e0109e20 2024-09-21T03:34:08.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.617+0000 7f26deffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e01094d0 0x7f26e019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:08.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.617+0000 7f26deffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e01094d0 0x7f26e019a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49564/0 (socket says 172.21.15.84:49564) 2024-09-21T03:34:08.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.617+0000 7f26deffd640 1 -- 172.21.15.84:0/2726800933 learned_addr learned my addr 172.21.15.84:0/2726800933 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:08.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.617+0000 7f26df7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26e0103b90 0x7f26e019a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:08.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.617+0000 7f26dffff640 1 --2- 172.21.15.84:0/2726800933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26e0109e20 0x7f26e019fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:08.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.618+0000 7f26deffd640 1 -- 172.21.15.84:0/2726800933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26e0109e20 msgr2=0x7f26e019fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:08.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.618+0000 7f26deffd640 1 --2- 172.21.15.84:0/2726800933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26e0109e20 0x7f26e019fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:08.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.618+0000 7f26deffd640 1 -- 172.21.15.84:0/2726800933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26e0103b90 msgr2=0x7f26e019a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:08.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.618+0000 7f26deffd640 1 --2- 172.21.15.84:0/2726800933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26e0103b90 0x7f26e019a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:08.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.618+0000 7f26deffd640 1 -- 172.21.15.84:0/2726800933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e01a0320 con 0x7f26e01094d0 2024-09-21T03:34:08.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.618+0000 7f26dffff640 1 --2- 172.21.15.84:0/2726800933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26e0109e20 0x7f26e019fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:34:08.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.618+0000 7f26df7fe640 1 --2- 172.21.15.84:0/2726800933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26e0103b90 0x7f26e019a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:34:08.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.618+0000 7f26deffd640 1 --2- 172.21.15.84:0/2726800933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e01094d0 0x7f26e019a950 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f26d4005940 tx=0x7f26d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:08.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.618+0000 7f26dcff9640 1 -- 172.21.15.84:0/2726800933 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d403f030 con 0x7f26e01094d0 2024-09-21T03:34:08.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.618+0000 7f26e5e5c640 1 -- 172.21.15.84:0/2726800933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e01a05b0 con 0x7f26e01094d0 2024-09-21T03:34:08.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.618+0000 7f26dcff9640 1 -- 172.21.15.84:0/2726800933 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f26d4031800 con 0x7f26e01094d0 2024-09-21T03:34:08.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.618+0000 7f26dcff9640 1 -- 172.21.15.84:0/2726800933 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d4035070 con 0x7f26e01094d0 2024-09-21T03:34:08.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.619+0000 7f26e5e5c640 1 -- 172.21.15.84:0/2726800933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e01a6d70 con 0x7f26e01094d0 2024-09-21T03:34:08.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.620+0000 7f26e5e5c640 1 -- 172.21.15.84:0/2726800933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e0104e10 con 0x7f26e01094d0 2024-09-21T03:34:08.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.621+0000 7f26dcff9640 1 -- 172.21.15.84:0/2726800933 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f26d4042030 con 0x7f26e01094d0 2024-09-21T03:34:08.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.622+0000 7f26dcff9640 1 --2- 172.21.15.84:0/2726800933 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f26c80b6550 0x7f26c80b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:08.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.622+0000 7f26df7fe640 1 --2- 172.21.15.84:0/2726800933 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f26c80b6550 0x7f26c80b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:08.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.622+0000 7f26dcff9640 1 -- 172.21.15.84:0/2726800933 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f26d4105bf0 con 0x7f26e01094d0 2024-09-21T03:34:08.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.622+0000 7f26df7fe640 1 --2- 172.21.15.84:0/2726800933 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f26c80b6550 0x7f26c80b8a60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f26d0005d00 tx=0x7f26d000b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:08.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.626+0000 7f26dcff9640 1 -- 172.21.15.84:0/2726800933 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26d40ce020 con 0x7f26e01094d0 2024-09-21T03:34:08.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.814+0000 7f26e5e5c640 1 -- 172.21.15.84:0/2726800933 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f26e010bc10 con 0x7f26e01094d0 2024-09-21T03:34:08.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.819+0000 7f26dcff9640 1 -- 172.21.15.84:0/2726800933 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f26d40d2400 con 0x7f26e01094d0 2024-09-21T03:34:08.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.821+0000 7f26e5e5c640 1 -- 172.21.15.84:0/2726800933 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f26c80b6550 msgr2=0x7f26c80b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:08.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.821+0000 7f26e5e5c640 1 --2- 172.21.15.84:0/2726800933 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f26c80b6550 0x7f26c80b8a60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f26d0005d00 tx=0x7f26d000b410 comp rx=0 tx=0).stop 2024-09-21T03:34:08.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.821+0000 7f26e5e5c640 1 -- 172.21.15.84:0/2726800933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e01094d0 msgr2=0x7f26e019a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:08.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.821+0000 7f26e5e5c640 1 --2- 172.21.15.84:0/2726800933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e01094d0 0x7f26e019a950 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f26d4005940 tx=0x7f26d40042f0 comp rx=0 tx=0).stop 2024-09-21T03:34:08.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.821+0000 7f26e5e5c640 1 -- 172.21.15.84:0/2726800933 shutdown_connections 2024-09-21T03:34:08.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.821+0000 7f26e5e5c640 1 --2- 172.21.15.84:0/2726800933 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f26c80b6550 0x7f26c80b8a60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:08.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.821+0000 7f26e5e5c640 1 --2- 172.21.15.84:0/2726800933 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26e0109e20 0x7f26e019fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:08.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.821+0000 7f26e5e5c640 1 --2- 172.21.15.84:0/2726800933 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f26e01094d0 0x7f26e019a950 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:08.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.821+0000 7f26e5e5c640 1 --2- 172.21.15.84:0/2726800933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f26e0103b90 0x7f26e019a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:08.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.821+0000 7f26e5e5c640 1 -- 172.21.15.84:0/2726800933 >> 172.21.15.84:0/2726800933 conn(0x7f26e00ff600 msgr2=0x7f26e0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:08.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.821+0000 7f26e5e5c640 1 -- 172.21.15.84:0/2726800933 shutdown_connections 2024-09-21T03:34:08.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.822+0000 7f26e5e5c640 1 -- 172.21.15.84:0/2726800933 wait complete. 2024-09-21T03:34:08.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:08 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/233193153' entity='client.admin' 2024-09-21T03:34:08.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:08 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/233193153' entity='client.admin' 2024-09-21T03:34:09.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.817+0000 7f982a43e640 1 -- 172.21.15.84:0/1226463901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f982410de50 msgr2=0x7f9824110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:09.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.817+0000 7f982a43e640 1 --2- 172.21.15.84:0/1226463901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f982410de50 0x7f9824110340 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f981c009ca0 tx=0x7f981c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:34:09.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.817+0000 7f982a43e640 1 -- 172.21.15.84:0/1226463901 shutdown_connections 2024-09-21T03:34:09.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.817+0000 7f982a43e640 1 --2- 172.21.15.84:0/1226463901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f982410de50 0x7f9824110340 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:09.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.817+0000 7f982a43e640 1 --2- 172.21.15.84:0/1226463901 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9824105340 0x7f982410d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:09.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.818+0000 7f982a43e640 1 --2- 172.21.15.84:0/1226463901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f98241049f0 0x7f9824104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:09.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.818+0000 7f982a43e640 1 -- 172.21.15.84:0/1226463901 >> 172.21.15.84:0/1226463901 conn(0x7f9824079750 msgr2=0x7f9824079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:09.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.818+0000 7f982a43e640 1 -- 172.21.15.84:0/1226463901 shutdown_connections 2024-09-21T03:34:09.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.818+0000 7f982a43e640 1 -- 172.21.15.84:0/1226463901 wait complete. 2024-09-21T03:34:09.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.818+0000 7f982a43e640 1 Processor -- start 2024-09-21T03:34:09.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.818+0000 7f982a43e640 1 -- start start 2024-09-21T03:34:09.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.819+0000 7f982a43e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98241049f0 0x7f982419a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:09.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.819+0000 7f982a43e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9824105340 0x7f982419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:09.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.819+0000 7f982a43e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f982410de50 0x7f982419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:09.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.819+0000 7f982a43e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9824113990 con 0x7f9824105340 2024-09-21T03:34:09.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.819+0000 7f982a43e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9824113810 con 0x7f982410de50 2024-09-21T03:34:09.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.819+0000 7f982a43e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9824113b10 con 0x7f98241049f0 2024-09-21T03:34:09.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.819+0000 7f98237fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9824105340 0x7f982419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:09.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.819+0000 7f98237fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9824105340 0x7f982419a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33008/0 (socket says 172.21.15.84:33008) 2024-09-21T03:34:09.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.819+0000 7f98237fe640 1 -- 172.21.15.84:0/1115895037 learned_addr learned my addr 172.21.15.84:0/1115895037 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:09.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.819+0000 7f9823fff640 1 --2- 172.21.15.84:0/1115895037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98241049f0 0x7f982419a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:09.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.819+0000 7f98289db640 1 --2- 172.21.15.84:0/1115895037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f982410de50 0x7f982419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:09.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.819+0000 7f98237fe640 1 -- 172.21.15.84:0/1115895037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98241049f0 msgr2=0x7f982419a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:09.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.819+0000 7f98237fe640 1 --2- 172.21.15.84:0/1115895037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98241049f0 0x7f982419a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:09.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.819+0000 7f98237fe640 1 -- 172.21.15.84:0/1115895037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f982410de50 msgr2=0x7f982419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:09.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.819+0000 7f98237fe640 1 --2- 172.21.15.84:0/1115895037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f982410de50 0x7f982419fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:09.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.819+0000 7f98237fe640 1 -- 172.21.15.84:0/1115895037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98241a0370 con 0x7f9824105340 2024-09-21T03:34:09.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.819+0000 7f98289db640 1 --2- 172.21.15.84:0/1115895037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f982410de50 0x7f982419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:34:09.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.819+0000 7f98237fe640 1 --2- 172.21.15.84:0/1115895037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9824105340 0x7f982419a9a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f981800d750 tx=0x7f981800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:09.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.819+0000 7f98217fa640 1 -- 172.21.15.84:0/1115895037 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9818017070 con 0x7f9824105340 2024-09-21T03:34:09.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.820+0000 7f98217fa640 1 -- 172.21.15.84:0/1115895037 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f98180054b0 con 0x7f9824105340 2024-09-21T03:34:09.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.820+0000 7f982a43e640 1 -- 172.21.15.84:0/1115895037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98241a0660 con 0x7f9824105340 2024-09-21T03:34:09.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.820+0000 7f98217fa640 1 -- 172.21.15.84:0/1115895037 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9818004bd0 con 0x7f9824105340 2024-09-21T03:34:09.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.820+0000 7f982a43e640 1 -- 172.21.15.84:0/1115895037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98241a6dc0 con 0x7f9824105340 2024-09-21T03:34:09.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.821+0000 7f982a43e640 1 -- 172.21.15.84:0/1115895037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9824104e00 con 0x7f9824105340 2024-09-21T03:34:09.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.823+0000 7f98217fa640 1 -- 172.21.15.84:0/1115895037 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f9818009c30 con 0x7f9824105340 2024-09-21T03:34:09.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.824+0000 7f98217fa640 1 --2- 172.21.15.84:0/1115895037 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f980c0b64d0 0x7f980c0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:09.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.824+0000 7f9823fff640 1 --2- 172.21.15.84:0/1115895037 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f980c0b64d0 0x7f980c0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:09.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.824+0000 7f98217fa640 1 -- 172.21.15.84:0/1115895037 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f98180e54b0 con 0x7f9824105340 2024-09-21T03:34:09.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.824+0000 7f9823fff640 1 --2- 172.21.15.84:0/1115895037 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f980c0b64d0 0x7f980c0b89e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f981400bbe0 tx=0x7f981400b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:09.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:05.827+0000 7f98217fa640 1 -- 172.21.15.84:0/1115895037 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f98180ad940 con 0x7f9824105340 2024-09-21T03:34:09.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.019+0000 7f982a43e640 1 -- 172.21.15.84:0/1115895037 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f98241a6ff0 con 0x7f9824105340 2024-09-21T03:34:09.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.023+0000 7f98217fa640 1 -- 172.21.15.84:0/1115895037 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v21)=0 v21) ==== 111+0+0 (secure 0 0 0) 0x7f98180b1d20 con 0x7f9824105340 2024-09-21T03:34:09.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.025+0000 7f982a43e640 1 -- 172.21.15.84:0/1115895037 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f980c0b64d0 msgr2=0x7f980c0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:09.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.025+0000 7f982a43e640 1 --2- 172.21.15.84:0/1115895037 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f980c0b64d0 0x7f980c0b89e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f981400bbe0 tx=0x7f981400b390 comp rx=0 tx=0).stop 2024-09-21T03:34:09.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.025+0000 7f982a43e640 1 -- 172.21.15.84:0/1115895037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9824105340 msgr2=0x7f982419a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:09.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.025+0000 7f982a43e640 1 --2- 172.21.15.84:0/1115895037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9824105340 0x7f982419a9a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f981800d750 tx=0x7f981800dc10 comp rx=0 tx=0).stop 2024-09-21T03:34:09.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.026+0000 7f982a43e640 1 -- 172.21.15.84:0/1115895037 shutdown_connections 2024-09-21T03:34:09.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.026+0000 7f982a43e640 1 --2- 172.21.15.84:0/1115895037 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f980c0b64d0 0x7f980c0b89e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:09.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.026+0000 7f982a43e640 1 --2- 172.21.15.84:0/1115895037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f982410de50 0x7f982419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:09.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.026+0000 7f982a43e640 1 --2- 172.21.15.84:0/1115895037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9824105340 0x7f982419a9a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:09.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.026+0000 7f982a43e640 1 --2- 172.21.15.84:0/1115895037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98241049f0 0x7f982419a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:09.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.026+0000 7f982a43e640 1 -- 172.21.15.84:0/1115895037 >> 172.21.15.84:0/1115895037 conn(0x7f9824079750 msgr2=0x7f98240ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:09.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.026+0000 7f982a43e640 1 -- 172.21.15.84:0/1115895037 shutdown_connections 2024-09-21T03:34:09.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.026+0000 7f982a43e640 1 -- 172.21.15.84:0/1115895037 wait complete. 2024-09-21T03:34:09.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.519+0000 7f9011925640 1 -- 172.21.15.84:0/938130224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f900c1083a0 msgr2=0x7f900c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:09.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.519+0000 7f9011925640 1 --2- 172.21.15.84:0/938130224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f900c1083a0 0x7f900c1087b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4009900 tx=0x7f8ff402a410 comp rx=0 tx=0).stop 2024-09-21T03:34:09.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.519+0000 7f9011925640 1 -- 172.21.15.84:0/938130224 shutdown_connections 2024-09-21T03:34:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.519+0000 7f9011925640 1 --2- 172.21.15.84:0/938130224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f900c108cf0 0x7f900c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.519+0000 7f9011925640 1 --2- 172.21.15.84:0/938130224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f900c1083a0 0x7f900c1087b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.519+0000 7f9011925640 1 --2- 172.21.15.84:0/938130224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f900c102a60 0x7f900c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.519+0000 7f9011925640 1 -- 172.21.15.84:0/938130224 >> 172.21.15.84:0/938130224 conn(0x7f900c079730 msgr2=0x7f900c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.519+0000 7f9011925640 1 -- 172.21.15.84:0/938130224 shutdown_connections 2024-09-21T03:34:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.519+0000 7f9011925640 1 -- 172.21.15.84:0/938130224 wait complete. 2024-09-21T03:34:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.520+0000 7f9011925640 1 Processor -- start 2024-09-21T03:34:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.520+0000 7f9011925640 1 -- start start 2024-09-21T03:34:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.520+0000 7f9011925640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f900c102a60 0x7f900c19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.520+0000 7f9011925640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f900c1083a0 0x7f900c19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.520+0000 7f9011925640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f900c108cf0 0x7f900c19fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.520+0000 7f9011925640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f900c112860 con 0x7f900c1083a0 2024-09-21T03:34:09.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.520+0000 7f9011925640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f900c1126e0 con 0x7f900c108cf0 2024-09-21T03:34:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.520+0000 7f9011925640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f900c1129e0 con 0x7f900c102a60 2024-09-21T03:34:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.520+0000 7f900a7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f900c1083a0 0x7f900c19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.520+0000 7f900a7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f900c1083a0 0x7f900c19a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49544/0 (socket says 172.21.15.84:49544) 2024-09-21T03:34:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.520+0000 7f900a7fc640 1 -- 172.21.15.84:0/2981549299 learned_addr learned my addr 172.21.15.84:0/2981549299 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.521+0000 7f900affd640 1 --2- 172.21.15.84:0/2981549299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f900c102a60 0x7f900c19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.521+0000 7f900b7fe640 1 --2- 172.21.15.84:0/2981549299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f900c108cf0 0x7f900c19fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.521+0000 7f900a7fc640 1 -- 172.21.15.84:0/2981549299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f900c102a60 msgr2=0x7f900c19a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.521+0000 7f900a7fc640 1 --2- 172.21.15.84:0/2981549299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f900c102a60 0x7f900c19a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.521+0000 7f900a7fc640 1 -- 172.21.15.84:0/2981549299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f900c108cf0 msgr2=0x7f900c19fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.521+0000 7f900a7fc640 1 --2- 172.21.15.84:0/2981549299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f900c108cf0 0x7f900c19fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.521+0000 7f900a7fc640 1 -- 172.21.15.84:0/2981549299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f900c1a03b0 con 0x7f900c1083a0 2024-09-21T03:34:09.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.521+0000 7f900a7fc640 1 --2- 172.21.15.84:0/2981549299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f900c1083a0 0x7f900c19a9e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4005940 tx=0x7f8ff40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.521+0000 7f9010923640 1 -- 172.21.15.84:0/2981549299 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff403f030 con 0x7f900c1083a0 2024-09-21T03:34:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.521+0000 7f9010923640 1 -- 172.21.15.84:0/2981549299 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8ff4003c90 con 0x7f900c1083a0 2024-09-21T03:34:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.522+0000 7f9010923640 1 -- 172.21.15.84:0/2981549299 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4035070 con 0x7f900c1083a0 2024-09-21T03:34:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.522+0000 7f9011925640 1 -- 172.21.15.84:0/2981549299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f900c1a0640 con 0x7f900c1083a0 2024-09-21T03:34:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.522+0000 7f9011925640 1 -- 172.21.15.84:0/2981549299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f900c1a6e00 con 0x7f900c1083a0 2024-09-21T03:34:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.523+0000 7f9011925640 1 -- 172.21.15.84:0/2981549299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f900c102e70 con 0x7f900c1083a0 2024-09-21T03:34:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.524+0000 7f9010923640 1 -- 172.21.15.84:0/2981549299 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f8ff4042030 con 0x7f900c1083a0 2024-09-21T03:34:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.526+0000 7f9010923640 1 --2- 172.21.15.84:0/2981549299 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8ff80b6550 0x7f8ff80b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.526+0000 7f900affd640 1 --2- 172.21.15.84:0/2981549299 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8ff80b6550 0x7f8ff80b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.526+0000 7f9010923640 1 -- 172.21.15.84:0/2981549299 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8ff4105f40 con 0x7f900c1083a0 2024-09-21T03:34:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.526+0000 7f900affd640 1 --2- 172.21.15.84:0/2981549299 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8ff80b6550 0x7f8ff80b8a60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009990 tx=0x7f8ffc009110 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.529+0000 7f9010923640 1 -- 172.21.15.84:0/2981549299 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8ff40ce3d0 con 0x7f900c1083a0 2024-09-21T03:34:09.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.719+0000 7f9011925640 1 -- 172.21.15.84:0/2981549299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f900c19b570 con 0x7f900c1083a0 2024-09-21T03:34:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.719+0000 7f9010923640 1 -- 172.21.15.84:0/2981549299 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v24)=0 v24) ==== 106+0+0 (secure 0 0 0) 0x7f900c19b570 con 0x7f900c1083a0 2024-09-21T03:34:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.721+0000 7f9011925640 1 -- 172.21.15.84:0/2981549299 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8ff80b6550 msgr2=0x7f8ff80b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.721+0000 7f9011925640 1 --2- 172.21.15.84:0/2981549299 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8ff80b6550 0x7f8ff80b8a60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009990 tx=0x7f8ffc009110 comp rx=0 tx=0).stop 2024-09-21T03:34:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.721+0000 7f9011925640 1 -- 172.21.15.84:0/2981549299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f900c1083a0 msgr2=0x7f900c19a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.721+0000 7f9011925640 1 --2- 172.21.15.84:0/2981549299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f900c1083a0 0x7f900c19a9e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4005940 tx=0x7f8ff40042f0 comp rx=0 tx=0).stop 2024-09-21T03:34:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.721+0000 7f9011925640 1 -- 172.21.15.84:0/2981549299 shutdown_connections 2024-09-21T03:34:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.721+0000 7f9011925640 1 --2- 172.21.15.84:0/2981549299 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8ff80b6550 0x7f8ff80b8a60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.721+0000 7f9011925640 1 --2- 172.21.15.84:0/2981549299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f900c108cf0 0x7f900c19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.721+0000 7f9011925640 1 --2- 172.21.15.84:0/2981549299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f900c1083a0 0x7f900c19a9e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.721+0000 7f9011925640 1 --2- 172.21.15.84:0/2981549299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f900c102a60 0x7f900c19a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.721+0000 7f9011925640 1 -- 172.21.15.84:0/2981549299 >> 172.21.15.84:0/2981549299 conn(0x7f900c079730 msgr2=0x7f900c06b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.721+0000 7f9011925640 1 -- 172.21.15.84:0/2981549299 shutdown_connections 2024-09-21T03:34:09.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:08.721+0000 7f9011925640 1 -- 172.21.15.84:0/2981549299 wait complete. 2024-09-21T03:34:10.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.519+0000 7f24ef33d640 1 -- 172.21.15.84:0/1027811641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8102a70 msgr2=0x7f24e8102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.519+0000 7f24ef33d640 1 --2- 172.21.15.84:0/1027811641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8102a70 0x7f24e8102e80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f24d8009ca0 tx=0x7f24d802a8e0 comp rx=0 tx=0).stop 2024-09-21T03:34:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.519+0000 7f24ef33d640 1 -- 172.21.15.84:0/1027811641 shutdown_connections 2024-09-21T03:34:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.519+0000 7f24ef33d640 1 --2- 172.21.15.84:0/1027811641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24e8108d00 0x7f24e810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.519+0000 7f24ef33d640 1 --2- 172.21.15.84:0/1027811641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24e81083b0 0x7f24e81087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.519+0000 7f24ef33d640 1 --2- 172.21.15.84:0/1027811641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8102a70 0x7f24e8102e80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.519+0000 7f24ef33d640 1 -- 172.21.15.84:0/1027811641 >> 172.21.15.84:0/1027811641 conn(0x7f24e8079710 msgr2=0x7f24e8079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.519+0000 7f24ef33d640 1 -- 172.21.15.84:0/1027811641 shutdown_connections 2024-09-21T03:34:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.519+0000 7f24ef33d640 1 -- 172.21.15.84:0/1027811641 wait complete. 2024-09-21T03:34:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.520+0000 7f24ef33d640 1 Processor -- start 2024-09-21T03:34:10.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.520+0000 7f24ef33d640 1 -- start start 2024-09-21T03:34:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.520+0000 7f24ef33d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8102a70 0x7f24e819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24ef33d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24e81083b0 0x7f24e819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24ef33d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24e8108d00 0x7f24e819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24ef33d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f24e81139c0 con 0x7f24e8102a70 2024-09-21T03:34:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24ef33d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f24e8113840 con 0x7f24e81083b0 2024-09-21T03:34:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24ef33d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f24e8113b40 con 0x7f24e8108d00 2024-09-21T03:34:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24ed0d9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8102a70 0x7f24e819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24ed0d9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8102a70 0x7f24e819a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33028/0 (socket says 172.21.15.84:33028) 2024-09-21T03:34:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24ed0d9640 1 -- 172.21.15.84:0/2905895261 learned_addr learned my addr 172.21.15.84:0/2905895261 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24ed8da640 1 --2- 172.21.15.84:0/2905895261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24e8108d00 0x7f24e819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24ec8d8640 1 --2- 172.21.15.84:0/2905895261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24e81083b0 0x7f24e819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24ed0d9640 1 -- 172.21.15.84:0/2905895261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24e8108d00 msgr2=0x7f24e819fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:10.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24ed0d9640 1 --2- 172.21.15.84:0/2905895261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24e8108d00 0x7f24e819fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:10.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24ed0d9640 1 -- 172.21.15.84:0/2905895261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24e81083b0 msgr2=0x7f24e819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:10.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24ed0d9640 1 --2- 172.21.15.84:0/2905895261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24e81083b0 0x7f24e819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:10.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24ed0d9640 1 -- 172.21.15.84:0/2905895261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e81a0400 con 0x7f24e8102a70 2024-09-21T03:34:10.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24ed0d9640 1 --2- 172.21.15.84:0/2905895261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8102a70 0x7f24e819a490 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f24d8006010 tx=0x7f24d8030810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:10.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24e67fc640 1 -- 172.21.15.84:0/2905895261 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d8030e10 con 0x7f24e8102a70 2024-09-21T03:34:10.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24e67fc640 1 -- 172.21.15.84:0/2905895261 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f24d80458a0 con 0x7f24e8102a70 2024-09-21T03:34:10.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24ef33d640 1 -- 172.21.15.84:0/2905895261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e81a0690 con 0x7f24e8102a70 2024-09-21T03:34:10.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24e67fc640 1 -- 172.21.15.84:0/2905895261 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d803b750 con 0x7f24e8102a70 2024-09-21T03:34:10.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.521+0000 7f24ef33d640 1 -- 172.21.15.84:0/2905895261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e81a6e50 con 0x7f24e8102a70 2024-09-21T03:34:10.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.523+0000 7f24ef33d640 1 -- 172.21.15.84:0/2905895261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e8103cf0 con 0x7f24e8102a70 2024-09-21T03:34:10.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.524+0000 7f24e67fc640 1 -- 172.21.15.84:0/2905895261 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f24d8043020 con 0x7f24e8102a70 2024-09-21T03:34:10.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.525+0000 7f24e67fc640 1 --2- 172.21.15.84:0/2905895261 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f24d00b6550 0x7f24d00b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:10.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.525+0000 7f24ec8d8640 1 --2- 172.21.15.84:0/2905895261 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f24d00b6550 0x7f24d00b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:10.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.525+0000 7f24e67fc640 1 -- 172.21.15.84:0/2905895261 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f24d8106980 con 0x7f24e8102a70 2024-09-21T03:34:10.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.525+0000 7f24ec8d8640 1 --2- 172.21.15.84:0/2905895261 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f24d00b6550 0x7f24d00b8a60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f24e8079b60 tx=0x7f24dc008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:10.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.528+0000 7f24e67fc640 1 -- 172.21.15.84:0/2905895261 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24d80cee10 con 0x7f24e8102a70 2024-09-21T03:34:10.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.738+0000 7f24ef33d640 1 -- 172.21.15.84:0/2905895261 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f24e8102e80 con 0x7f24e8102a70 2024-09-21T03:34:10.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.744+0000 7f24e67fc640 1 -- 172.21.15.84:0/2905895261 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f24e8102e80 con 0x7f24e8102a70 2024-09-21T03:34:10.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.747+0000 7f24ef33d640 1 -- 172.21.15.84:0/2905895261 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f24d00b6550 msgr2=0x7f24d00b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:10.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.747+0000 7f24ef33d640 1 --2- 172.21.15.84:0/2905895261 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f24d00b6550 0x7f24d00b8a60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f24e8079b60 tx=0x7f24dc008040 comp rx=0 tx=0).stop 2024-09-21T03:34:10.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.747+0000 7f24ef33d640 1 -- 172.21.15.84:0/2905895261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8102a70 msgr2=0x7f24e819a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:10.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.747+0000 7f24ef33d640 1 --2- 172.21.15.84:0/2905895261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8102a70 0x7f24e819a490 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f24d8006010 tx=0x7f24d8030810 comp rx=0 tx=0).stop 2024-09-21T03:34:10.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.747+0000 7f24ef33d640 1 -- 172.21.15.84:0/2905895261 shutdown_connections 2024-09-21T03:34:10.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.747+0000 7f24ef33d640 1 --2- 172.21.15.84:0/2905895261 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f24d00b6550 0x7f24d00b8a60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:10.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.747+0000 7f24ef33d640 1 --2- 172.21.15.84:0/2905895261 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24e8108d00 0x7f24e819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:10.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.747+0000 7f24ef33d640 1 --2- 172.21.15.84:0/2905895261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24e81083b0 0x7f24e819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:10.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.747+0000 7f24ef33d640 1 --2- 172.21.15.84:0/2905895261 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f24e8102a70 0x7f24e819a490 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:10.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.747+0000 7f24ef33d640 1 -- 172.21.15.84:0/2905895261 >> 172.21.15.84:0/2905895261 conn(0x7f24e8079710 msgr2=0x7f24e8106550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:10.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.747+0000 7f24ef33d640 1 -- 172.21.15.84:0/2905895261 shutdown_connections 2024-09-21T03:34:10.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:06.747+0000 7f24ef33d640 1 -- 172.21.15.84:0/2905895261 wait complete. 2024-09-21T03:34:10.050 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:09 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2726800933' entity='client.admin' 2024-09-21T03:34:10.050 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:09 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1271837015' entity='client.admin' 2024-09-21T03:34:10.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:09 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2726800933' entity='client.admin' 2024-09-21T03:34:10.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:09 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1271837015' entity='client.admin' 2024-09-21T03:34:10.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:09 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2726800933' entity='client.admin' 2024-09-21T03:34:10.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:09 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1271837015' entity='client.admin' 2024-09-21T03:34:11.002 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:10 smithi084 ceph-mon[30941]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:11.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.248+0000 7ff009946640 1 -- 172.21.15.84:0/3158009622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff004108cf0 msgr2=0x7ff00410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.248+0000 7ff009946640 1 --2- 172.21.15.84:0/3158009622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff004108cf0 0x7ff00410f520 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feffc009ca0 tx=0x7feffc02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:34:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.248+0000 7ff009946640 1 -- 172.21.15.84:0/3158009622 shutdown_connections 2024-09-21T03:34:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.248+0000 7ff009946640 1 --2- 172.21.15.84:0/3158009622 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff004108cf0 0x7ff00410f520 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.248+0000 7ff009946640 1 --2- 172.21.15.84:0/3158009622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0041083a0 0x7ff0041087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.248+0000 7ff009946640 1 --2- 172.21.15.84:0/3158009622 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff004102a60 0x7ff004102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.248+0000 7ff009946640 1 -- 172.21.15.84:0/3158009622 >> 172.21.15.84:0/3158009622 conn(0x7ff004079730 msgr2=0x7ff004079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.248+0000 7ff009946640 1 -- 172.21.15.84:0/3158009622 shutdown_connections 2024-09-21T03:34:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.248+0000 7ff009946640 1 -- 172.21.15.84:0/3158009622 wait complete. 2024-09-21T03:34:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.249+0000 7ff009946640 1 Processor -- start 2024-09-21T03:34:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.249+0000 7ff009946640 1 -- start start 2024-09-21T03:34:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.249+0000 7ff009946640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff004102a60 0x7ff00419c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:11.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.249+0000 7ff009946640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0041083a0 0x7ff00419cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.249+0000 7ff009946640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff004108cf0 0x7ff0041a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.249+0000 7ff009946640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff004112880 con 0x7ff0041083a0 2024-09-21T03:34:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.249+0000 7ff009946640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff004112700 con 0x7ff004102a60 2024-09-21T03:34:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.249+0000 7ff009946640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff004112a00 con 0x7ff004108cf0 2024-09-21T03:34:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.249+0000 7feffbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0041083a0 0x7ff00419cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.249+0000 7feffbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0041083a0 0x7ff00419cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49576/0 (socket says 172.21.15.84:49576) 2024-09-21T03:34:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.249+0000 7feffbfff640 1 -- 172.21.15.84:0/1271837015 learned_addr learned my addr 172.21.15.84:0/1271837015 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.250+0000 7ff002ffd640 1 --2- 172.21.15.84:0/1271837015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff004102a60 0x7ff00419c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.250+0000 7ff0037fe640 1 --2- 172.21.15.84:0/1271837015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff004108cf0 0x7ff0041a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.250+0000 7feffbfff640 1 -- 172.21.15.84:0/1271837015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff004108cf0 msgr2=0x7ff0041a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.250+0000 7feffbfff640 1 --2- 172.21.15.84:0/1271837015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff004108cf0 0x7ff0041a1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.250+0000 7feffbfff640 1 -- 172.21.15.84:0/1271837015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff004102a60 msgr2=0x7ff00419c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.250+0000 7feffbfff640 1 --2- 172.21.15.84:0/1271837015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff004102a60 0x7ff00419c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:11.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.250+0000 7feffbfff640 1 -- 172.21.15.84:0/1271837015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0041a2420 con 0x7ff0041083a0 2024-09-21T03:34:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.250+0000 7ff002ffd640 1 --2- 172.21.15.84:0/1271837015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff004102a60 0x7ff00419c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:34:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.250+0000 7feffbfff640 1 --2- 172.21.15.84:0/1271837015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0041083a0 0x7ff00419cb10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fefec00c970 tx=0x7fefec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.250+0000 7ff008944640 1 -- 172.21.15.84:0/1271837015 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec014070 con 0x7ff0041083a0 2024-09-21T03:34:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.250+0000 7ff008944640 1 -- 172.21.15.84:0/1271837015 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fefec004440 con 0x7ff0041083a0 2024-09-21T03:34:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.250+0000 7ff009946640 1 -- 172.21.15.84:0/1271837015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0041a2710 con 0x7ff0041083a0 2024-09-21T03:34:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.250+0000 7ff008944640 1 -- 172.21.15.84:0/1271837015 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec003d50 con 0x7ff0041083a0 2024-09-21T03:34:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.250+0000 7ff009946640 1 -- 172.21.15.84:0/1271837015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0041a8f30 con 0x7ff0041083a0 2024-09-21T03:34:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.251+0000 7ff009946640 1 -- 172.21.15.84:0/1271837015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff004102e70 con 0x7ff0041083a0 2024-09-21T03:34:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.253+0000 7ff008944640 1 -- 172.21.15.84:0/1271837015 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fefec017070 con 0x7ff0041083a0 2024-09-21T03:34:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.253+0000 7ff008944640 1 --2- 172.21.15.84:0/1271837015 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7feff00b6580 0x7feff00b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.253+0000 7ff002ffd640 1 --2- 172.21.15.84:0/1271837015 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7feff00b6580 0x7feff00b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.254+0000 7ff008944640 1 -- 172.21.15.84:0/1271837015 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fefec0e5aa0 con 0x7ff0041083a0 2024-09-21T03:34:11.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.254+0000 7ff002ffd640 1 --2- 172.21.15.84:0/1271837015 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7feff00b6580 0x7feff00b8a90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feff4006fd0 tx=0x7feff4008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.256+0000 7ff008944640 1 -- 172.21.15.84:0/1271837015 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fefec01e030 con 0x7ff0041083a0 2024-09-21T03:34:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.438+0000 7ff009946640 1 -- 172.21.15.84:0/1271837015 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7ff00419d6a0 con 0x7ff0041083a0 2024-09-21T03:34:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.442+0000 7ff008944640 1 -- 172.21.15.84:0/1271837015 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v26)=0 v26) ==== 120+0+0 (secure 0 0 0) 0x7fefec0adfb0 con 0x7ff0041083a0 2024-09-21T03:34:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.445+0000 7ff009946640 1 -- 172.21.15.84:0/1271837015 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7feff00b6580 msgr2=0x7feff00b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.445+0000 7ff009946640 1 --2- 172.21.15.84:0/1271837015 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7feff00b6580 0x7feff00b8a90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feff4006fd0 tx=0x7feff4008040 comp rx=0 tx=0).stop 2024-09-21T03:34:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.445+0000 7ff009946640 1 -- 172.21.15.84:0/1271837015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0041083a0 msgr2=0x7ff00419cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.445+0000 7ff009946640 1 --2- 172.21.15.84:0/1271837015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0041083a0 0x7ff00419cb10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fefec00c970 tx=0x7fefec00ce30 comp rx=0 tx=0).stop 2024-09-21T03:34:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.445+0000 7ff009946640 1 -- 172.21.15.84:0/1271837015 shutdown_connections 2024-09-21T03:34:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.445+0000 7ff009946640 1 --2- 172.21.15.84:0/1271837015 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7feff00b6580 0x7feff00b8a90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.445+0000 7ff009946640 1 --2- 172.21.15.84:0/1271837015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff004108cf0 0x7ff0041a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.445+0000 7ff009946640 1 --2- 172.21.15.84:0/1271837015 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff0041083a0 0x7ff00419cb10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.445+0000 7ff009946640 1 --2- 172.21.15.84:0/1271837015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff004102a60 0x7ff00419c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.445+0000 7ff009946640 1 -- 172.21.15.84:0/1271837015 >> 172.21.15.84:0/1271837015 conn(0x7ff004079730 msgr2=0x7ff00406af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.445+0000 7ff009946640 1 -- 172.21.15.84:0/1271837015 shutdown_connections 2024-09-21T03:34:11.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:09.445+0000 7ff009946640 1 -- 172.21.15.84:0/1271837015 wait complete. 2024-09-21T03:34:11.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:10 smithi174 ceph-mon[34403]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:11.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:10 smithi172 ceph-mon[34821]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:11.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.894+0000 7f5a4f2e5640 1 -- 172.21.15.84:0/1700378146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a48103200 msgr2=0x7f5a48103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:11.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.894+0000 7f5a4f2e5640 1 --2- 172.21.15.84:0/1700378146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a48103200 0x7f5a48103610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009900 tx=0x7f5a4402a410 comp rx=0 tx=0).stop 2024-09-21T03:34:11.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.894+0000 7f5a4f2e5640 1 -- 172.21.15.84:0/1700378146 shutdown_connections 2024-09-21T03:34:11.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.894+0000 7f5a4f2e5640 1 --2- 172.21.15.84:0/1700378146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a48105b20 0x7f5a4810f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:11.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.894+0000 7f5a4f2e5640 1 --2- 172.21.15.84:0/1700378146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a481051d0 0x7f5a481055e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:11.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.894+0000 7f5a4f2e5640 1 --2- 172.21.15.84:0/1700378146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a48103200 0x7f5a48103610 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:11.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.894+0000 7f5a4f2e5640 1 -- 172.21.15.84:0/1700378146 >> 172.21.15.84:0/1700378146 conn(0x7f5a48079e10 msgr2=0x7f5a4807a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:11.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.895+0000 7f5a4f2e5640 1 -- 172.21.15.84:0/1700378146 shutdown_connections 2024-09-21T03:34:11.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.895+0000 7f5a4f2e5640 1 -- 172.21.15.84:0/1700378146 wait complete. 2024-09-21T03:34:11.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.895+0000 7f5a4f2e5640 1 Processor -- start 2024-09-21T03:34:11.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.895+0000 7f5a4f2e5640 1 -- start start 2024-09-21T03:34:11.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.896+0000 7f5a4f2e5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a48103200 0x7f5a4819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:11.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.896+0000 7f5a4f2e5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a481051d0 0x7f5a4819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:11.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.896+0000 7f5a4f2e5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a48105b20 0x7f5a4819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:11.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.896+0000 7f5a4f2e5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5a481128a0 con 0x7f5a481051d0 2024-09-21T03:34:11.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.896+0000 7f5a4f2e5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5a48112720 con 0x7f5a48103200 2024-09-21T03:34:11.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.896+0000 7f5a4f2e5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5a48112a20 con 0x7f5a48105b20 2024-09-21T03:34:11.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.896+0000 7f5a4c880640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a481051d0 0x7f5a4819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:11.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.896+0000 7f5a4c880640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a481051d0 0x7f5a4819a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49610/0 (socket says 172.21.15.84:49610) 2024-09-21T03:34:11.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.896+0000 7f5a4c880640 1 -- 172.21.15.84:0/608272036 learned_addr learned my addr 172.21.15.84:0/608272036 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:11.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.896+0000 7f5a4d081640 1 --2- 172.21.15.84:0/608272036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a48103200 0x7f5a4819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:11.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.896+0000 7f5a4d882640 1 --2- 172.21.15.84:0/608272036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a48105b20 0x7f5a4819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:11.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.896+0000 7f5a4c880640 1 -- 172.21.15.84:0/608272036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a48105b20 msgr2=0x7f5a4819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:11.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.896+0000 7f5a4c880640 1 --2- 172.21.15.84:0/608272036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a48105b20 0x7f5a4819fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:11.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.896+0000 7f5a4c880640 1 -- 172.21.15.84:0/608272036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a48103200 msgr2=0x7f5a4819a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:11.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.896+0000 7f5a4c880640 1 --2- 172.21.15.84:0/608272036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a48103200 0x7f5a4819a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:11.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.896+0000 7f5a4c880640 1 -- 172.21.15.84:0/608272036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a481a0370 con 0x7f5a481051d0 2024-09-21T03:34:11.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.896+0000 7f5a4d882640 1 --2- 172.21.15.84:0/608272036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a48105b20 0x7f5a4819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:34:11.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.896+0000 7f5a4d081640 1 --2- 172.21.15.84:0/608272036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a48103200 0x7f5a4819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:34:11.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.896+0000 7f5a4c880640 1 --2- 172.21.15.84:0/608272036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a481051d0 0x7f5a4819a9a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800d770 tx=0x7f5a3800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:11.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.897+0000 7f5a3e7fc640 1 -- 172.21.15.84:0/608272036 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a38017070 con 0x7f5a481051d0 2024-09-21T03:34:11.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.897+0000 7f5a3e7fc640 1 -- 172.21.15.84:0/608272036 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5a38009c30 con 0x7f5a481051d0 2024-09-21T03:34:11.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.897+0000 7f5a4f2e5640 1 -- 172.21.15.84:0/608272036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a481a0660 con 0x7f5a481051d0 2024-09-21T03:34:11.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.897+0000 7f5a3e7fc640 1 -- 172.21.15.84:0/608272036 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3800f620 con 0x7f5a481051d0 2024-09-21T03:34:11.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.897+0000 7f5a4f2e5640 1 -- 172.21.15.84:0/608272036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a481a6dc0 con 0x7f5a481051d0 2024-09-21T03:34:11.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.898+0000 7f5a4f2e5640 1 -- 172.21.15.84:0/608272036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a4819b530 con 0x7f5a481051d0 2024-09-21T03:34:11.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.900+0000 7f5a3e7fc640 1 -- 172.21.15.84:0/608272036 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f5a3801a070 con 0x7f5a481051d0 2024-09-21T03:34:11.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.901+0000 7f5a3e7fc640 1 --2- 172.21.15.84:0/608272036 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5a340b6550 0x7f5a340b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:11.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.901+0000 7f5a4d081640 1 --2- 172.21.15.84:0/608272036 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5a340b6550 0x7f5a340b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:11.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.901+0000 7f5a3e7fc640 1 -- 172.21.15.84:0/608272036 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5a380e51b0 con 0x7f5a481051d0 2024-09-21T03:34:11.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.902+0000 7f5a4d081640 1 --2- 172.21.15.84:0/608272036 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5a340b6550 0x7f5a340b8a60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009230 tx=0x7f5a440058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:11.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.904+0000 7f5a3e7fc640 1 -- 172.21.15.84:0/608272036 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5a38009de0 con 0x7f5a481051d0 2024-09-21T03:34:11.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.100+0000 7f5a4f2e5640 1 -- 172.21.15.84:0/608272036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f5a4806b890 con 0x7f5a481051d0 2024-09-21T03:34:11.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.104+0000 7f5a3e7fc640 1 -- 172.21.15.84:0/608272036 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v28)=0 v28) ==== 120+0+0 (secure 0 0 0) 0x7f5a4806b890 con 0x7f5a481051d0 2024-09-21T03:34:11.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.106+0000 7f5a4f2e5640 1 -- 172.21.15.84:0/608272036 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5a340b6550 msgr2=0x7f5a340b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:11.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.106+0000 7f5a4f2e5640 1 --2- 172.21.15.84:0/608272036 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5a340b6550 0x7f5a340b8a60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009230 tx=0x7f5a440058d0 comp rx=0 tx=0).stop 2024-09-21T03:34:11.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.106+0000 7f5a4f2e5640 1 -- 172.21.15.84:0/608272036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a481051d0 msgr2=0x7f5a4819a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:11.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.106+0000 7f5a4f2e5640 1 --2- 172.21.15.84:0/608272036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a481051d0 0x7f5a4819a9a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800d770 tx=0x7f5a3800dc30 comp rx=0 tx=0).stop 2024-09-21T03:34:11.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.107+0000 7f5a4f2e5640 1 -- 172.21.15.84:0/608272036 shutdown_connections 2024-09-21T03:34:11.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.107+0000 7f5a4f2e5640 1 --2- 172.21.15.84:0/608272036 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5a340b6550 0x7f5a340b8a60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:11.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.107+0000 7f5a4f2e5640 1 --2- 172.21.15.84:0/608272036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a48105b20 0x7f5a4819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:11.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.107+0000 7f5a4f2e5640 1 --2- 172.21.15.84:0/608272036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a481051d0 0x7f5a4819a9a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:11.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.107+0000 7f5a4f2e5640 1 --2- 172.21.15.84:0/608272036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a48103200 0x7f5a4819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:11.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.107+0000 7f5a4f2e5640 1 -- 172.21.15.84:0/608272036 >> 172.21.15.84:0/608272036 conn(0x7f5a48079e10 msgr2=0x7f5a48106300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:11.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.107+0000 7f5a4f2e5640 1 -- 172.21.15.84:0/608272036 shutdown_connections 2024-09-21T03:34:11.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.107+0000 7f5a4f2e5640 1 -- 172.21.15.84:0/608272036 wait complete. 2024-09-21T03:34:12.285 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:12 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3967025164' entity='client.admin' 2024-09-21T03:34:12.285 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:12 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:12.285 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:12 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:12.285 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:12 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:12.285 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:12 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:12.286 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:12 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/608272036' entity='client.admin' 2024-09-21T03:34:12.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.290+0000 7f4d195af640 1 -- 172.21.15.84:0/3950012829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d14109e00 msgr2=0x7f4d14110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:12.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.290+0000 7f4d195af640 1 --2- 172.21.15.84:0/3950012829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d14109e00 0x7f4d14110630 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c009900 tx=0x7f4d0c02a410 comp rx=0 tx=0).stop 2024-09-21T03:34:12.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.290+0000 7f4d195af640 1 -- 172.21.15.84:0/3950012829 shutdown_connections 2024-09-21T03:34:12.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.290+0000 7f4d195af640 1 --2- 172.21.15.84:0/3950012829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d14109e00 0x7f4d14110630 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:12.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.290+0000 7f4d195af640 1 --2- 172.21.15.84:0/3950012829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d141094b0 0x7f4d141098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:12.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.290+0000 7f4d195af640 1 --2- 172.21.15.84:0/3950012829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d14101f70 0x7f4d14102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:12.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.290+0000 7f4d195af640 1 -- 172.21.15.84:0/3950012829 >> 172.21.15.84:0/3950012829 conn(0x7f4d14077c60 msgr2=0x7f4d140780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:12.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.291+0000 7f4d195af640 1 -- 172.21.15.84:0/3950012829 shutdown_connections 2024-09-21T03:34:12.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.291+0000 7f4d195af640 1 -- 172.21.15.84:0/3950012829 wait complete. 2024-09-21T03:34:12.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.291+0000 7f4d195af640 1 Processor -- start 2024-09-21T03:34:12.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.291+0000 7f4d195af640 1 -- start start 2024-09-21T03:34:12.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.292+0000 7f4d195af640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d14101f70 0x7f4d1419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:12.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.292+0000 7f4d195af640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d141094b0 0x7f4d1419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:12.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.292+0000 7f4d195af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d14109e00 0x7f4d1419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:12.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.292+0000 7f4d195af640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4d141139a0 con 0x7f4d14101f70 2024-09-21T03:34:12.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.292+0000 7f4d195af640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4d14113820 con 0x7f4d14109e00 2024-09-21T03:34:12.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.292+0000 7f4d195af640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d14113b20 con 0x7f4d141094b0 2024-09-21T03:34:12.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.292+0000 7f4d12ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d14101f70 0x7f4d1419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:12.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.292+0000 7f4d12ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d14101f70 0x7f4d1419a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49624/0 (socket says 172.21.15.84:49624) 2024-09-21T03:34:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.292+0000 7f4d12ffd640 1 -- 172.21.15.84:0/2665831524 learned_addr learned my addr 172.21.15.84:0/2665831524 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.292+0000 7f4d127fc640 1 --2- 172.21.15.84:0/2665831524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d141094b0 0x7f4d1419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.292+0000 7f4d137fe640 1 --2- 172.21.15.84:0/2665831524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d14109e00 0x7f4d1419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.292+0000 7f4d12ffd640 1 -- 172.21.15.84:0/2665831524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d141094b0 msgr2=0x7f4d1419a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.292+0000 7f4d12ffd640 1 --2- 172.21.15.84:0/2665831524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d141094b0 0x7f4d1419a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.292+0000 7f4d12ffd640 1 -- 172.21.15.84:0/2665831524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d14109e00 msgr2=0x7f4d1419fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.292+0000 7f4d12ffd640 1 --2- 172.21.15.84:0/2665831524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d14109e00 0x7f4d1419fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.292+0000 7f4d12ffd640 1 -- 172.21.15.84:0/2665831524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d141a02e0 con 0x7f4d14101f70 2024-09-21T03:34:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.292+0000 7f4d12ffd640 1 --2- 172.21.15.84:0/2665831524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d14101f70 0x7f4d1419a370 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4d0400eab0 tx=0x7f4d0400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.292+0000 7f4d0bfff640 1 -- 172.21.15.84:0/2665831524 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0400ce40 con 0x7f4d14101f70 2024-09-21T03:34:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.292+0000 7f4d0bfff640 1 -- 172.21.15.84:0/2665831524 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f4d04011900 con 0x7f4d14101f70 2024-09-21T03:34:12.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.293+0000 7f4d195af640 1 -- 172.21.15.84:0/2665831524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d141a05d0 con 0x7f4d14101f70 2024-09-21T03:34:12.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.293+0000 7f4d0bfff640 1 -- 172.21.15.84:0/2665831524 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d040109a0 con 0x7f4d14101f70 2024-09-21T03:34:12.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.293+0000 7f4d195af640 1 -- 172.21.15.84:0/2665831524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d141a6d30 con 0x7f4d14101f70 2024-09-21T03:34:12.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.294+0000 7f4d195af640 1 -- 172.21.15.84:0/2665831524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d14102380 con 0x7f4d14101f70 2024-09-21T03:34:12.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.295+0000 7f4d0bfff640 1 -- 172.21.15.84:0/2665831524 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f4d04011470 con 0x7f4d14101f70 2024-09-21T03:34:12.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.296+0000 7f4d0bfff640 1 --2- 172.21.15.84:0/2665831524 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4d000b6550 0x7f4d000b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:12.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.296+0000 7f4d127fc640 1 --2- 172.21.15.84:0/2665831524 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4d000b6550 0x7f4d000b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:12.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.296+0000 7f4d0bfff640 1 -- 172.21.15.84:0/2665831524 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4d040e5d80 con 0x7f4d14101f70 2024-09-21T03:34:12.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.296+0000 7f4d127fc640 1 --2- 172.21.15.84:0/2665831524 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4d000b6550 0x7f4d000b8a60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc005fd0 tx=0x7f4cfc005e20 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:12.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.299+0000 7f4d0bfff640 1 -- 172.21.15.84:0/2665831524 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4d04016030 con 0x7f4d14101f70 2024-09-21T03:34:12.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:12 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3967025164' entity='client.admin' 2024-09-21T03:34:12.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:12 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:12.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:12 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:12.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:12 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:12.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:12 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:12.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:12 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/608272036' entity='client.admin' 2024-09-21T03:34:12.400 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:12 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3967025164' entity='client.admin' 2024-09-21T03:34:12.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:12 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:12.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:12 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:12.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:12 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:12.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:12 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:12.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:12 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/608272036' entity='client.admin' 2024-09-21T03:34:12.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.488+0000 7f4d195af640 1 -- 172.21.15.84:0/2665831524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f4d1402e640 con 0x7f4d14101f70 2024-09-21T03:34:12.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.492+0000 7f4d0bfff640 1 -- 172.21.15.84:0/2665831524 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v29)=0 v29) ==== 115+0+0 (secure 0 0 0) 0x7f4d040ae290 con 0x7f4d14101f70 2024-09-21T03:34:12.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.494+0000 7f4d195af640 1 -- 172.21.15.84:0/2665831524 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4d000b6550 msgr2=0x7f4d000b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:12.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.494+0000 7f4d195af640 1 --2- 172.21.15.84:0/2665831524 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4d000b6550 0x7f4d000b8a60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc005fd0 tx=0x7f4cfc005e20 comp rx=0 tx=0).stop 2024-09-21T03:34:12.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.494+0000 7f4d195af640 1 -- 172.21.15.84:0/2665831524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d14101f70 msgr2=0x7f4d1419a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:12.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.494+0000 7f4d195af640 1 --2- 172.21.15.84:0/2665831524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d14101f70 0x7f4d1419a370 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4d0400eab0 tx=0x7f4d0400ef70 comp rx=0 tx=0).stop 2024-09-21T03:34:12.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.495+0000 7f4d195af640 1 -- 172.21.15.84:0/2665831524 shutdown_connections 2024-09-21T03:34:12.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.495+0000 7f4d195af640 1 --2- 172.21.15.84:0/2665831524 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4d000b6550 0x7f4d000b8a60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:12.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.495+0000 7f4d195af640 1 --2- 172.21.15.84:0/2665831524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d14109e00 0x7f4d1419fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:12.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.495+0000 7f4d195af640 1 --2- 172.21.15.84:0/2665831524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d141094b0 0x7f4d1419a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:12.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.495+0000 7f4d195af640 1 --2- 172.21.15.84:0/2665831524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d14101f70 0x7f4d1419a370 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:12.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.495+0000 7f4d195af640 1 -- 172.21.15.84:0/2665831524 >> 172.21.15.84:0/2665831524 conn(0x7f4d14077c60 msgr2=0x7f4d14107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:12.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.495+0000 7f4d195af640 1 -- 172.21.15.84:0/2665831524 shutdown_connections 2024-09-21T03:34:12.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:12.495+0000 7f4d195af640 1 -- 172.21.15.84:0/2665831524 wait complete. 2024-09-21T03:34:12.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.268+0000 7f0b04a94640 1 -- 172.21.15.84:0/1501218467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b00107b30 msgr2=0x7f0b00107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:12.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.268+0000 7f0b04a94640 1 --2- 172.21.15.84:0/1501218467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b00107b30 0x7f0b00107f40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009900 tx=0x7f0ae802a410 comp rx=0 tx=0).stop 2024-09-21T03:34:12.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.268+0000 7f0b04a94640 1 -- 172.21.15.84:0/1501218467 shutdown_connections 2024-09-21T03:34:12.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.268+0000 7f0b04a94640 1 --2- 172.21.15.84:0/1501218467 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b00108480 0x7f0b0010ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:12.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.268+0000 7f0b04a94640 1 --2- 172.21.15.84:0/1501218467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b00107b30 0x7f0b00107f40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:12.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.268+0000 7f0b04a94640 1 --2- 172.21.15.84:0/1501218467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b001021f0 0x7f0b00102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:12.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.268+0000 7f0b04a94640 1 -- 172.21.15.84:0/1501218467 >> 172.21.15.84:0/1501218467 conn(0x7f0b00077c60 msgr2=0x7f0b000780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:12.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.269+0000 7f0b04a94640 1 -- 172.21.15.84:0/1501218467 shutdown_connections 2024-09-21T03:34:12.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.269+0000 7f0b04a94640 1 -- 172.21.15.84:0/1501218467 wait complete. 2024-09-21T03:34:12.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.269+0000 7f0b04a94640 1 Processor -- start 2024-09-21T03:34:12.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.269+0000 7f0b04a94640 1 -- start start 2024-09-21T03:34:12.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.270+0000 7f0b04a94640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b001021f0 0x7f0b0019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:12.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.270+0000 7f0b04a94640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b00107b30 0x7f0b0019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:12.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.270+0000 7f0b04a94640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b00108480 0x7f0b0019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:12.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.270+0000 7f0b04a94640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0b00111fb0 con 0x7f0b00108480 2024-09-21T03:34:12.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.270+0000 7f0b04a94640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0b00111e30 con 0x7f0b001021f0 2024-09-21T03:34:12.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.270+0000 7f0b04a94640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0b00112130 con 0x7f0b00107b30 2024-09-21T03:34:12.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.270+0000 7f0afed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b00108480 0x7f0b0019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:12.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.270+0000 7f0afed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b00108480 0x7f0b0019fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33048/0 (socket says 172.21.15.84:33048) 2024-09-21T03:34:12.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.270+0000 7f0afed9d640 1 -- 172.21.15.84:0/233193153 learned_addr learned my addr 172.21.15.84:0/233193153 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:12.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.270+0000 7f0afe59c640 1 --2- 172.21.15.84:0/233193153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b001021f0 0x7f0b0019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:12.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.270+0000 7f0af5d9b640 1 --2- 172.21.15.84:0/233193153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b00107b30 0x7f0b0019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:12.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.270+0000 7f0afed9d640 1 -- 172.21.15.84:0/233193153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b00107b30 msgr2=0x7f0b0019a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:12.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.270+0000 7f0afed9d640 1 --2- 172.21.15.84:0/233193153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b00107b30 0x7f0b0019a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:12.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.270+0000 7f0afed9d640 1 -- 172.21.15.84:0/233193153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b001021f0 msgr2=0x7f0b0019a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:12.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.270+0000 7f0afed9d640 1 --2- 172.21.15.84:0/233193153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b001021f0 0x7f0b0019a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:12.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.270+0000 7f0afed9d640 1 -- 172.21.15.84:0/233193153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b001a0290 con 0x7f0b00108480 2024-09-21T03:34:12.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.270+0000 7f0af5d9b640 1 --2- 172.21.15.84:0/233193153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b00107b30 0x7f0b0019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:34:12.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.270+0000 7f0afed9d640 1 --2- 172.21.15.84:0/233193153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b00108480 0x7f0b0019fc20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0af8009fd0 tx=0x7f0af800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:12.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.271+0000 7f0af7fff640 1 -- 172.21.15.84:0/233193153 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af8017070 con 0x7f0b00108480 2024-09-21T03:34:12.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.271+0000 7f0b04a94640 1 -- 172.21.15.84:0/233193153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b001a0580 con 0x7f0b00108480 2024-09-21T03:34:12.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.271+0000 7f0af7fff640 1 -- 172.21.15.84:0/233193153 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0af8003e00 con 0x7f0b00108480 2024-09-21T03:34:12.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.271+0000 7f0af7fff640 1 -- 172.21.15.84:0/233193153 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af8010460 con 0x7f0b00108480 2024-09-21T03:34:12.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.271+0000 7f0b04a94640 1 -- 172.21.15.84:0/233193153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b001a6da0 con 0x7f0b00108480 2024-09-21T03:34:12.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.272+0000 7f0b04a94640 1 -- 172.21.15.84:0/233193153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b00103470 con 0x7f0b00108480 2024-09-21T03:34:12.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.273+0000 7f0af7fff640 1 -- 172.21.15.84:0/233193153 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f0af8003970 con 0x7f0b00108480 2024-09-21T03:34:12.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.274+0000 7f0af7fff640 1 --2- 172.21.15.84:0/233193153 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0aec0b6500 0x7f0aec0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:12.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.274+0000 7f0afe59c640 1 --2- 172.21.15.84:0/233193153 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0aec0b6500 0x7f0aec0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:12.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.274+0000 7f0af7fff640 1 -- 172.21.15.84:0/233193153 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0af80e5590 con 0x7f0b00108480 2024-09-21T03:34:12.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.274+0000 7f0afe59c640 1 --2- 172.21.15.84:0/233193153 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0aec0b6500 0x7f0aec0b8a10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0af0005e10 tx=0x7f0af0005da0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:12.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.277+0000 7f0af7fff640 1 -- 172.21.15.84:0/233193153 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0af80ada20 con 0x7f0b00108480 2024-09-21T03:34:12.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.460+0000 7f0b04a94640 1 -- 172.21.15.84:0/233193153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f0b00102600 con 0x7f0b00108480 2024-09-21T03:34:12.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.465+0000 7f0af7fff640 1 -- 172.21.15.84:0/233193153 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v24)=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7f0af80b1e00 con 0x7f0b00108480 2024-09-21T03:34:12.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.467+0000 7f0b04a94640 1 -- 172.21.15.84:0/233193153 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0aec0b6500 msgr2=0x7f0aec0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:12.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.467+0000 7f0b04a94640 1 --2- 172.21.15.84:0/233193153 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0aec0b6500 0x7f0aec0b8a10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0af0005e10 tx=0x7f0af0005da0 comp rx=0 tx=0).stop 2024-09-21T03:34:12.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.467+0000 7f0b04a94640 1 -- 172.21.15.84:0/233193153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b00108480 msgr2=0x7f0b0019fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:12.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.467+0000 7f0b04a94640 1 --2- 172.21.15.84:0/233193153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b00108480 0x7f0b0019fc20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0af8009fd0 tx=0x7f0af800b260 comp rx=0 tx=0).stop 2024-09-21T03:34:12.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.467+0000 7f0b04a94640 1 -- 172.21.15.84:0/233193153 shutdown_connections 2024-09-21T03:34:12.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.467+0000 7f0b04a94640 1 --2- 172.21.15.84:0/233193153 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0aec0b6500 0x7f0aec0b8a10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:12.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.467+0000 7f0b04a94640 1 --2- 172.21.15.84:0/233193153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0b00108480 0x7f0b0019fc20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:12.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.467+0000 7f0b04a94640 1 --2- 172.21.15.84:0/233193153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b00107b30 0x7f0b0019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:12.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.467+0000 7f0b04a94640 1 --2- 172.21.15.84:0/233193153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0b001021f0 0x7f0b0019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:12.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.467+0000 7f0b04a94640 1 -- 172.21.15.84:0/233193153 >> 172.21.15.84:0/233193153 conn(0x7f0b00077c60 msgr2=0x7f0b00108b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:12.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.467+0000 7f0b04a94640 1 -- 172.21.15.84:0/233193153 shutdown_connections 2024-09-21T03:34:12.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:07.467+0000 7f0b04a94640 1 -- 172.21.15.84:0/233193153 wait complete. 2024-09-21T03:34:13.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:13 smithi084 ceph-mon[30941]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:13.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:13 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2665831524' entity='client.admin' 2024-09-21T03:34:13.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.798+0000 7fbbf1c11640 1 -- 172.21.15.84:0/1384842377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbec107690 msgr2=0x7fbbec107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:13.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.799+0000 7fbbf1c11640 1 --2- 172.21.15.84:0/1384842377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbec107690 0x7fbbec107aa0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009900 tx=0x7fbbd402a410 comp rx=0 tx=0).stop 2024-09-21T03:34:13.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.799+0000 7fbbf1c11640 1 -- 172.21.15.84:0/1384842377 shutdown_connections 2024-09-21T03:34:13.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.799+0000 7fbbf1c11640 1 --2- 172.21.15.84:0/1384842377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbec103950 0x7fbbec10f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:13.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.799+0000 7fbbf1c11640 1 --2- 172.21.15.84:0/1384842377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec103000 0x7fbbec103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:13.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.799+0000 7fbbf1c11640 1 --2- 172.21.15.84:0/1384842377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbec107690 0x7fbbec107aa0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:13.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.799+0000 7fbbf1c11640 1 -- 172.21.15.84:0/1384842377 >> 172.21.15.84:0/1384842377 conn(0x7fbbec079ea0 msgr2=0x7fbbec07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:13.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.799+0000 7fbbf1c11640 1 -- 172.21.15.84:0/1384842377 shutdown_connections 2024-09-21T03:34:13.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.799+0000 7fbbf1c11640 1 -- 172.21.15.84:0/1384842377 wait complete. 2024-09-21T03:34:13.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.799+0000 7fbbf1c11640 1 Processor -- start 2024-09-21T03:34:13.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.800+0000 7fbbf1c11640 1 -- start start 2024-09-21T03:34:13.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.800+0000 7fbbf1c11640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbec103000 0x7fbbec0feed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:13.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.800+0000 7fbbf1c11640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec103950 0x7fbbec0ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:13.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.800+0000 7fbbf1c11640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbec107690 0x7fbbec0ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:13.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.800+0000 7fbbf1c11640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec112920 con 0x7fbbec103000 2024-09-21T03:34:13.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.800+0000 7fbbf1c11640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec1127a0 con 0x7fbbec103950 2024-09-21T03:34:13.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.800+0000 7fbbf1c11640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec112aa0 con 0x7fbbec107690 2024-09-21T03:34:13.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.800+0000 7fbbeb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbec103000 0x7fbbec0feed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:13.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.800+0000 7fbbeb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbec103000 0x7fbbec0feed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49590/0 (socket says 172.21.15.84:49590) 2024-09-21T03:34:13.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.800+0000 7fbbeb7fe640 1 -- 172.21.15.84:0/3967025164 learned_addr learned my addr 172.21.15.84:0/3967025164 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:13.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.800+0000 7fbbeaffd640 1 --2- 172.21.15.84:0/3967025164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec103950 0x7fbbec0ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:13.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.800+0000 7fbbebfff640 1 --2- 172.21.15.84:0/3967025164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbec107690 0x7fbbec0ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:13.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.800+0000 7fbbeb7fe640 1 -- 172.21.15.84:0/3967025164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbec107690 msgr2=0x7fbbec0ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:13.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.800+0000 7fbbeb7fe640 1 --2- 172.21.15.84:0/3967025164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbec107690 0x7fbbec0ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:13.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.800+0000 7fbbeb7fe640 1 -- 172.21.15.84:0/3967025164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec103950 msgr2=0x7fbbec0ff410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:13.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.800+0000 7fbbeb7fe640 1 --2- 172.21.15.84:0/3967025164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec103950 0x7fbbec0ff410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:13.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.800+0000 7fbbeb7fe640 1 -- 172.21.15.84:0/3967025164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbec1a8720 con 0x7fbbec103000 2024-09-21T03:34:13.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.800+0000 7fbbeaffd640 1 --2- 172.21.15.84:0/3967025164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec103950 0x7fbbec0ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:34:13.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.801+0000 7fbbeb7fe640 1 --2- 172.21.15.84:0/3967025164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbec103000 0x7fbbec0feed0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4006010 tx=0x7fbbd40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:13.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.801+0000 7fbbe8ff9640 1 -- 172.21.15.84:0/3967025164 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd403f030 con 0x7fbbec103000 2024-09-21T03:34:13.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.801+0000 7fbbe8ff9640 1 -- 172.21.15.84:0/3967025164 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fbbd4003c90 con 0x7fbbec103000 2024-09-21T03:34:13.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.801+0000 7fbbf1c11640 1 -- 172.21.15.84:0/3967025164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbec1a89b0 con 0x7fbbec103000 2024-09-21T03:34:13.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.801+0000 7fbbe8ff9640 1 -- 172.21.15.84:0/3967025164 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4035070 con 0x7fbbec103000 2024-09-21T03:34:13.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.801+0000 7fbbf1c11640 1 -- 172.21.15.84:0/3967025164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbec1a8ee0 con 0x7fbbec103000 2024-09-21T03:34:13.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.802+0000 7fbbf1c11640 1 -- 172.21.15.84:0/3967025164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbec103410 con 0x7fbbec103000 2024-09-21T03:34:13.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.805+0000 7fbbe8ff9640 1 -- 172.21.15.84:0/3967025164 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fbbd4042030 con 0x7fbbec103000 2024-09-21T03:34:13.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.805+0000 7fbbe8ff9640 1 --2- 172.21.15.84:0/3967025164 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbbd80b6550 0x7fbbd80b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:13.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.806+0000 7fbbe8ff9640 1 -- 172.21.15.84:0/3967025164 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fbbd41060f0 con 0x7fbbec103000 2024-09-21T03:34:13.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.806+0000 7fbbeaffd640 1 --2- 172.21.15.84:0/3967025164 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbbd80b6550 0x7fbbd80b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:13.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.806+0000 7fbbeaffd640 1 --2- 172.21.15.84:0/3967025164 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbbd80b6550 0x7fbbd80b8a60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbbec105480 tx=0x7fbbdc00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:13.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:10.809+0000 7fbbe8ff9640 1 -- 172.21.15.84:0/3967025164 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbbd40d2960 con 0x7fbbec103000 2024-09-21T03:34:13.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.000+0000 7fbbf1c11640 1 -- 172.21.15.84:0/3967025164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fbbec1001d0 con 0x7fbbec103000 2024-09-21T03:34:13.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.005+0000 7fbbe8ff9640 1 -- 172.21.15.84:0/3967025164 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v27)=0 v27) ==== 133+0+0 (secure 0 0 0) 0x7fbbec1001d0 con 0x7fbbec103000 2024-09-21T03:34:13.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.007+0000 7fbbf1c11640 1 -- 172.21.15.84:0/3967025164 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbbd80b6550 msgr2=0x7fbbd80b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:13.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.007+0000 7fbbf1c11640 1 --2- 172.21.15.84:0/3967025164 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbbd80b6550 0x7fbbd80b8a60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbbec105480 tx=0x7fbbdc00b390 comp rx=0 tx=0).stop 2024-09-21T03:34:13.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.007+0000 7fbbf1c11640 1 -- 172.21.15.84:0/3967025164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbec103000 msgr2=0x7fbbec0feed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:13.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.007+0000 7fbbf1c11640 1 --2- 172.21.15.84:0/3967025164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbec103000 0x7fbbec0feed0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4006010 tx=0x7fbbd40042f0 comp rx=0 tx=0).stop 2024-09-21T03:34:13.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.007+0000 7fbbf1c11640 1 -- 172.21.15.84:0/3967025164 shutdown_connections 2024-09-21T03:34:13.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.007+0000 7fbbf1c11640 1 --2- 172.21.15.84:0/3967025164 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbbd80b6550 0x7fbbd80b8a60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:13.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.007+0000 7fbbf1c11640 1 --2- 172.21.15.84:0/3967025164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbbec107690 0x7fbbec0ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:13.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.007+0000 7fbbf1c11640 1 --2- 172.21.15.84:0/3967025164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbec103950 0x7fbbec0ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:13.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.007+0000 7fbbf1c11640 1 --2- 172.21.15.84:0/3967025164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbbec103000 0x7fbbec0feed0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:13.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.007+0000 7fbbf1c11640 1 -- 172.21.15.84:0/3967025164 >> 172.21.15.84:0/3967025164 conn(0x7fbbec079ea0 msgr2=0x7fbbec106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:13.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.007+0000 7fbbf1c11640 1 -- 172.21.15.84:0/3967025164 shutdown_connections 2024-09-21T03:34:13.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:11.007+0000 7fbbf1c11640 1 -- 172.21.15.84:0/3967025164 wait complete. 2024-09-21T03:34:13.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:13 smithi174 ceph-mon[34403]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:13.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:13 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2665831524' entity='client.admin' 2024-09-21T03:34:13.400 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:13 smithi172 ceph-mon[34821]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:13.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:13 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2665831524' entity='client.admin' 2024-09-21T03:34:15.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.164+0000 7fcf94bb9640 1 -- 172.21.15.84:0/2571323577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf9010de10 msgr2=0x7fcf901102f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:15.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.164+0000 7fcf94bb9640 1 --2- 172.21.15.84:0/2571323577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf9010de10 0x7fcf901102f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009ca0 tx=0x7fcf8802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:34:15.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.164+0000 7fcf94bb9640 1 -- 172.21.15.84:0/2571323577 shutdown_connections 2024-09-21T03:34:15.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.164+0000 7fcf94bb9640 1 --2- 172.21.15.84:0/2571323577 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf9010de10 0x7fcf901102f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:15.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.164+0000 7fcf94bb9640 1 --2- 172.21.15.84:0/2571323577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf90105290 0x7fcf9010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:15.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.164+0000 7fcf94bb9640 1 --2- 172.21.15.84:0/2571323577 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf90104860 0x7fcf90104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:15.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.164+0000 7fcf94bb9640 1 -- 172.21.15.84:0/2571323577 >> 172.21.15.84:0/2571323577 conn(0x7fcf90079730 msgr2=0x7fcf90079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:15.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.164+0000 7fcf94bb9640 1 -- 172.21.15.84:0/2571323577 shutdown_connections 2024-09-21T03:34:15.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.164+0000 7fcf94bb9640 1 -- 172.21.15.84:0/2571323577 wait complete. 2024-09-21T03:34:15.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.165+0000 7fcf94bb9640 1 Processor -- start 2024-09-21T03:34:15.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.165+0000 7fcf94bb9640 1 -- start start 2024-09-21T03:34:15.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.165+0000 7fcf94bb9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf90104860 0x7fcf9019a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:15.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.165+0000 7fcf94bb9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf90105290 0x7fcf9019a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:15.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.165+0000 7fcf94bb9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf9010de10 0x7fcf9019fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:15.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.165+0000 7fcf94bb9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcf90113940 con 0x7fcf90105290 2024-09-21T03:34:15.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.165+0000 7fcf94bb9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcf901137c0 con 0x7fcf9010de10 2024-09-21T03:34:15.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.165+0000 7fcf94bb9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcf90113ac0 con 0x7fcf90104860 2024-09-21T03:34:15.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.165+0000 7fcf8dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf90105290 0x7fcf9019a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:15.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.165+0000 7fcf8dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf90105290 0x7fcf9019a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49654/0 (socket says 172.21.15.84:49654) 2024-09-21T03:34:15.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.165+0000 7fcf8dd9b640 1 -- 172.21.15.84:0/1330492024 learned_addr learned my addr 172.21.15.84:0/1330492024 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:15.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.166+0000 7fcf8ed9d640 1 --2- 172.21.15.84:0/1330492024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf9010de10 0x7fcf9019fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:15.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.166+0000 7fcf8e59c640 1 --2- 172.21.15.84:0/1330492024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf90104860 0x7fcf9019a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:15.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.166+0000 7fcf8dd9b640 1 -- 172.21.15.84:0/1330492024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf90104860 msgr2=0x7fcf9019a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:15.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.166+0000 7fcf8dd9b640 1 --2- 172.21.15.84:0/1330492024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf90104860 0x7fcf9019a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:15.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.166+0000 7fcf8dd9b640 1 -- 172.21.15.84:0/1330492024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf9010de10 msgr2=0x7fcf9019fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:15.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.166+0000 7fcf8dd9b640 1 --2- 172.21.15.84:0/1330492024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf9010de10 0x7fcf9019fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:15.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.166+0000 7fcf8dd9b640 1 -- 172.21.15.84:0/1330492024 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf901a02c0 con 0x7fcf90105290 2024-09-21T03:34:15.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.166+0000 7fcf8ed9d640 1 --2- 172.21.15.84:0/1330492024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf9010de10 0x7fcf9019fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:34:15.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.166+0000 7fcf8dd9b640 1 --2- 172.21.15.84:0/1330492024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf90105290 0x7fcf9019a8f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400d740 tx=0x7fcf8400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:15.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.166+0000 7fcf7f7fe640 1 -- 172.21.15.84:0/1330492024 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf84017070 con 0x7fcf90105290 2024-09-21T03:34:15.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.166+0000 7fcf94bb9640 1 -- 172.21.15.84:0/1330492024 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf901a05b0 con 0x7fcf90105290 2024-09-21T03:34:15.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.166+0000 7fcf94bb9640 1 -- 172.21.15.84:0/1330492024 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf901a6d10 con 0x7fcf90105290 2024-09-21T03:34:15.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.166+0000 7fcf7f7fe640 1 -- 172.21.15.84:0/1330492024 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fcf8400de50 con 0x7fcf90105290 2024-09-21T03:34:15.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.166+0000 7fcf7f7fe640 1 -- 172.21.15.84:0/1330492024 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8400f620 con 0x7fcf90105290 2024-09-21T03:34:15.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.167+0000 7fcf94bb9640 1 -- 172.21.15.84:0/1330492024 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf700052c0 con 0x7fcf90105290 2024-09-21T03:34:15.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.169+0000 7fcf7f7fe640 1 -- 172.21.15.84:0/1330492024 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fcf8401a070 con 0x7fcf90105290 2024-09-21T03:34:15.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.170+0000 7fcf7f7fe640 1 --2- 172.21.15.84:0/1330492024 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcf780b6550 0x7fcf780b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:15.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.170+0000 7fcf8e59c640 1 --2- 172.21.15.84:0/1330492024 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcf780b6550 0x7fcf780b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:15.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.170+0000 7fcf7f7fe640 1 -- 172.21.15.84:0/1330492024 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fcf840e4f20 con 0x7fcf90105290 2024-09-21T03:34:15.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.170+0000 7fcf8e59c640 1 --2- 172.21.15.84:0/1330492024 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcf780b6550 0x7fcf780b8a60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcf80005fd0 tx=0x7fcf80005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:15.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.177+0000 7fcf7f7fe640 1 -- 172.21.15.84:0/1330492024 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcf840ad430 con 0x7fcf90105290 2024-09-21T03:34:15.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.388+0000 7fcf94bb9640 1 -- 172.21.15.84:0/1330492024 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fcf700055b0 con 0x7fcf90105290 2024-09-21T03:34:15.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.394+0000 7fcf7f7fe640 1 -- 172.21.15.84:0/1330492024 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v30)=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7fcf840b1810 con 0x7fcf90105290 2024-09-21T03:34:15.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.398+0000 7fcf94bb9640 1 -- 172.21.15.84:0/1330492024 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcf780b6550 msgr2=0x7fcf780b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:15.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.398+0000 7fcf94bb9640 1 --2- 172.21.15.84:0/1330492024 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcf780b6550 0x7fcf780b8a60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcf80005fd0 tx=0x7fcf80005850 comp rx=0 tx=0).stop 2024-09-21T03:34:15.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.398+0000 7fcf94bb9640 1 -- 172.21.15.84:0/1330492024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf90105290 msgr2=0x7fcf9019a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:15.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.398+0000 7fcf94bb9640 1 --2- 172.21.15.84:0/1330492024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf90105290 0x7fcf9019a8f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400d740 tx=0x7fcf8400dc00 comp rx=0 tx=0).stop 2024-09-21T03:34:15.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.398+0000 7fcf94bb9640 1 -- 172.21.15.84:0/1330492024 shutdown_connections 2024-09-21T03:34:15.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.398+0000 7fcf94bb9640 1 --2- 172.21.15.84:0/1330492024 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcf780b6550 0x7fcf780b8a60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:15.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.398+0000 7fcf94bb9640 1 --2- 172.21.15.84:0/1330492024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf9010de10 0x7fcf9019fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:15.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.398+0000 7fcf94bb9640 1 --2- 172.21.15.84:0/1330492024 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf90105290 0x7fcf9019a8f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:15.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.398+0000 7fcf94bb9640 1 --2- 172.21.15.84:0/1330492024 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf90104860 0x7fcf9019a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:15.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.398+0000 7fcf94bb9640 1 -- 172.21.15.84:0/1330492024 >> 172.21.15.84:0/1330492024 conn(0x7fcf90079730 msgr2=0x7fcf901008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:15.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.398+0000 7fcf94bb9640 1 -- 172.21.15.84:0/1330492024 shutdown_connections 2024-09-21T03:34:15.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.398+0000 7fcf94bb9640 1 -- 172.21.15.84:0/1330492024 wait complete. 2024-09-21T03:34:15.522 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:15 smithi084 ceph-mon[30941]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:15.522 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:15 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1330492024' entity='client.admin' 2024-09-21T03:34:15.522 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:15 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/4132564268' entity='client.admin' 2024-09-21T03:34:15.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:15 smithi174 ceph-mon[34403]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:15.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:15 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1330492024' entity='client.admin' 2024-09-21T03:34:15.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:15 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/4132564268' entity='client.admin' 2024-09-21T03:34:15.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:15 smithi172 ceph-mon[34821]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:15.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:15 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1330492024' entity='client.admin' 2024-09-21T03:34:15.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:15 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/4132564268' entity='client.admin' 2024-09-21T03:34:16.046 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:16.069 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:16.072 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:16.073 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:17.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.254+0000 7f4188f29640 1 -- 172.21.15.84:0/1770909922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4184109e00 msgr2=0x7f4184110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:17.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.254+0000 7f4188f29640 1 --2- 172.21.15.84:0/1770909922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4184109e00 0x7f4184110630 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f417c009ca0 tx=0x7f417c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:34:17.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.254+0000 7f4188f29640 1 -- 172.21.15.84:0/1770909922 shutdown_connections 2024-09-21T03:34:17.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.254+0000 7f4188f29640 1 --2- 172.21.15.84:0/1770909922 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4184109e00 0x7f4184110630 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:17.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.254+0000 7f4188f29640 1 --2- 172.21.15.84:0/1770909922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41841094b0 0x7f41841098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:17.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.254+0000 7f4188f29640 1 --2- 172.21.15.84:0/1770909922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4184101f70 0x7f4184102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:17.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.254+0000 7f4188f29640 1 -- 172.21.15.84:0/1770909922 >> 172.21.15.84:0/1770909922 conn(0x7f4184077c60 msgr2=0x7f41840780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:17.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.254+0000 7f4188f29640 1 -- 172.21.15.84:0/1770909922 shutdown_connections 2024-09-21T03:34:17.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.254+0000 7f4188f29640 1 -- 172.21.15.84:0/1770909922 wait complete. 2024-09-21T03:34:17.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.255+0000 7f4188f29640 1 Processor -- start 2024-09-21T03:34:17.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.256+0000 7f4188f29640 1 -- start start 2024-09-21T03:34:17.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.256+0000 7f4188f29640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4184101f70 0x7f418419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:17.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.256+0000 7f4188f29640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41841094b0 0x7f418419a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:17.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.256+0000 7f4188f29640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4184109e00 0x7f418419fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:17.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.256+0000 7f4188f29640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f41841139a0 con 0x7f4184109e00 2024-09-21T03:34:17.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.256+0000 7f4188f29640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4184113820 con 0x7f41841094b0 2024-09-21T03:34:17.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.256+0000 7f4188f29640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4184113b20 con 0x7f4184101f70 2024-09-21T03:34:17.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.256+0000 7f4182d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4184109e00 0x7f418419fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:17.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.256+0000 7f4182d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4184109e00 0x7f418419fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49682/0 (socket says 172.21.15.84:49682) 2024-09-21T03:34:17.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.256+0000 7f4182d9d640 1 -- 172.21.15.84:0/4132564268 learned_addr learned my addr 172.21.15.84:0/4132564268 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.256+0000 7f4181d9b640 1 --2- 172.21.15.84:0/4132564268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41841094b0 0x7f418419a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.256+0000 7f418259c640 1 --2- 172.21.15.84:0/4132564268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4184101f70 0x7f418419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.256+0000 7f4182d9d640 1 -- 172.21.15.84:0/4132564268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4184101f70 msgr2=0x7f418419a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.256+0000 7f4182d9d640 1 --2- 172.21.15.84:0/4132564268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4184101f70 0x7f418419a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.257+0000 7f4182d9d640 1 -- 172.21.15.84:0/4132564268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41841094b0 msgr2=0x7f418419a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.257+0000 7f4182d9d640 1 --2- 172.21.15.84:0/4132564268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41841094b0 0x7f418419a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.257+0000 7f4182d9d640 1 -- 172.21.15.84:0/4132564268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41841a02a0 con 0x7f4184109e00 2024-09-21T03:34:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.257+0000 7f4182d9d640 1 --2- 172.21.15.84:0/4132564268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4184109e00 0x7f418419fb70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f417c031040 tx=0x7f417c032fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.257+0000 7f41737fe640 1 -- 172.21.15.84:0/4132564268 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c003bf0 con 0x7f4184109e00 2024-09-21T03:34:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.257+0000 7f41737fe640 1 -- 172.21.15.84:0/4132564268 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f417c003d90 con 0x7f4184109e00 2024-09-21T03:34:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.257+0000 7f41737fe640 1 -- 172.21.15.84:0/4132564268 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417c030b90 con 0x7f4184109e00 2024-09-21T03:34:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.257+0000 7f4188f29640 1 -- 172.21.15.84:0/4132564268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41841a0530 con 0x7f4184109e00 2024-09-21T03:34:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.257+0000 7f4188f29640 1 -- 172.21.15.84:0/4132564268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4184102df0 con 0x7f4184109e00 2024-09-21T03:34:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.258+0000 7f4188f29640 1 -- 172.21.15.84:0/4132564268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f418406ac50 con 0x7f4184109e00 2024-09-21T03:34:17.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.260+0000 7f41737fe640 1 -- 172.21.15.84:0/4132564268 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f417c004b40 con 0x7f4184109e00 2024-09-21T03:34:17.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.261+0000 7f41737fe640 1 --2- 172.21.15.84:0/4132564268 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f416c0ba8e0 0x7f416c0bcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:17.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.261+0000 7f41737fe640 1 -- 172.21.15.84:0/4132564268 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f417c1069a0 con 0x7f4184109e00 2024-09-21T03:34:17.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.263+0000 7f418259c640 1 --2- 172.21.15.84:0/4132564268 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f416c0ba8e0 0x7f416c0bcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:17.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.264+0000 7f418259c640 1 --2- 172.21.15.84:0/4132564268 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f416c0ba8e0 0x7f416c0bcdf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4174005d00 tx=0x7f417400b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:17.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.265+0000 7f41737fe640 1 -- 172.21.15.84:0/4132564268 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f417c0ceec0 con 0x7f4184109e00 2024-09-21T03:34:17.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.475+0000 7f4188f29640 1 -- 172.21.15.84:0/4132564268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f4184102380 con 0x7f4184109e00 2024-09-21T03:34:17.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.481+0000 7f41737fe640 1 -- 172.21.15.84:0/4132564268 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v31)=0 v31) ==== 123+0+0 (secure 0 0 0) 0x7f4184102380 con 0x7f4184109e00 2024-09-21T03:34:17.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.483+0000 7f41737fe640 1 -- 172.21.15.84:0/4132564268 <== mon.0 v2:172.21.15.84:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f417c036020 con 0x7f4184109e00 2024-09-21T03:34:17.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.484+0000 7f4188f29640 1 -- 172.21.15.84:0/4132564268 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f416c0ba8e0 msgr2=0x7f416c0bcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:17.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.484+0000 7f4188f29640 1 --2- 172.21.15.84:0/4132564268 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f416c0ba8e0 0x7f416c0bcdf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4174005d00 tx=0x7f417400b410 comp rx=0 tx=0).stop 2024-09-21T03:34:17.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.484+0000 7f4188f29640 1 -- 172.21.15.84:0/4132564268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4184109e00 msgr2=0x7f418419fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:17.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.484+0000 7f4188f29640 1 --2- 172.21.15.84:0/4132564268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4184109e00 0x7f418419fb70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f417c031040 tx=0x7f417c032fb0 comp rx=0 tx=0).stop 2024-09-21T03:34:17.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.484+0000 7f4188f29640 1 -- 172.21.15.84:0/4132564268 shutdown_connections 2024-09-21T03:34:17.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.484+0000 7f4188f29640 1 --2- 172.21.15.84:0/4132564268 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f416c0ba8e0 0x7f416c0bcdf0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:17.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.484+0000 7f4188f29640 1 --2- 172.21.15.84:0/4132564268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4184109e00 0x7f418419fb70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:17.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.484+0000 7f4188f29640 1 --2- 172.21.15.84:0/4132564268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41841094b0 0x7f418419a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:17.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.484+0000 7f4188f29640 1 --2- 172.21.15.84:0/4132564268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4184101f70 0x7f418419a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:17.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.484+0000 7f4188f29640 1 -- 172.21.15.84:0/4132564268 >> 172.21.15.84:0/4132564268 conn(0x7f4184077c60 msgr2=0x7f4184107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:17.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.484+0000 7f4188f29640 1 -- 172.21.15.84:0/4132564268 shutdown_connections 2024-09-21T03:34:17.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:14.484+0000 7f4188f29640 1 -- 172.21.15.84:0/4132564268 wait complete. 2024-09-21T03:34:17.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:17 smithi084 ceph-mon[30941]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:17.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:17 smithi174 ceph-mon[34403]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:17.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:17 smithi172 ceph-mon[34821]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:17.846 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi084') 2024-09-21T03:34:17.846 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi084') 2024-09-21T03:34:17.846 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi084') 2024-09-21T03:34:17.846 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi084') 2024-09-21T03:34:17.847 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi084') 2024-09-21T03:34:17.847 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi084') 2024-09-21T03:34:17.847 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi084') 2024-09-21T03:34:17.847 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi084') 2024-09-21T03:34:18.448 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi084') 2024-09-21T03:34:18.448 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi084') 2024-09-21T03:34:19.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.062+0000 7f31f70a8640 1 -- 172.21.15.84:0/1630395708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31f01083a0 msgr2=0x7f31f01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:19.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.062+0000 7f31f70a8640 1 --2- 172.21.15.84:0/1630395708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31f01083a0 0x7f31f01087b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009900 tx=0x7f31e402a410 comp rx=0 tx=0).stop 2024-09-21T03:34:19.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.062+0000 7f31f70a8640 1 -- 172.21.15.84:0/1630395708 shutdown_connections 2024-09-21T03:34:19.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.062+0000 7f31f70a8640 1 --2- 172.21.15.84:0/1630395708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31f0108cf0 0x7f31f010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.062+0000 7f31f70a8640 1 --2- 172.21.15.84:0/1630395708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31f01083a0 0x7f31f01087b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.062+0000 7f31f70a8640 1 --2- 172.21.15.84:0/1630395708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31f0102a60 0x7f31f0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.062+0000 7f31f70a8640 1 -- 172.21.15.84:0/1630395708 >> 172.21.15.84:0/1630395708 conn(0x7f31f0079730 msgr2=0x7f31f0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:19.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.062+0000 7f31f70a8640 1 -- 172.21.15.84:0/1630395708 shutdown_connections 2024-09-21T03:34:19.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.062+0000 7f31f70a8640 1 -- 172.21.15.84:0/1630395708 wait complete. 2024-09-21T03:34:19.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.063+0000 7f31f70a8640 1 Processor -- start 2024-09-21T03:34:19.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.063+0000 7f31f70a8640 1 -- start start 2024-09-21T03:34:19.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.063+0000 7f31f70a8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31f0102a60 0x7f31f00ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.063+0000 7f31f70a8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31f01083a0 0x7f31f00ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.063+0000 7f31f70a8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31f0108cf0 0x7f31f01000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.063+0000 7f31f70a8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f31f0112960 con 0x7f31f0102a60 2024-09-21T03:34:19.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.063+0000 7f31f70a8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f31f01127e0 con 0x7f31f0108cf0 2024-09-21T03:34:19.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.063+0000 7f31f70a8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f31f0112ae0 con 0x7f31f01083a0 2024-09-21T03:34:19.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.063+0000 7f31f4e44640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31f0102a60 0x7f31f00ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.063+0000 7f31f4e44640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31f0102a60 0x7f31f00ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49310/0 (socket says 172.21.15.84:49310) 2024-09-21T03:34:19.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.063+0000 7f31f4e44640 1 -- 172.21.15.84:0/814708296 learned_addr learned my addr 172.21.15.84:0/814708296 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:19.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.063+0000 7f31f5645640 1 --2- 172.21.15.84:0/814708296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31f0108cf0 0x7f31f01000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.063+0000 7f31effff640 1 --2- 172.21.15.84:0/814708296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31f01083a0 0x7f31f00ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.064+0000 7f31f4e44640 1 -- 172.21.15.84:0/814708296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31f01083a0 msgr2=0x7f31f00ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:19.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.064+0000 7f31f4e44640 1 --2- 172.21.15.84:0/814708296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31f01083a0 0x7f31f00ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.064+0000 7f31f4e44640 1 -- 172.21.15.84:0/814708296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31f0108cf0 msgr2=0x7f31f01000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:19.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.064+0000 7f31f4e44640 1 --2- 172.21.15.84:0/814708296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31f0108cf0 0x7f31f01000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.064+0000 7f31f4e44640 1 -- 172.21.15.84:0/814708296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f01a8860 con 0x7f31f0102a60 2024-09-21T03:34:19.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.064+0000 7f31f4e44640 1 --2- 172.21.15.84:0/814708296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31f0102a60 0x7f31f00ff670 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f31e000d770 tx=0x7f31e000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:19.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.064+0000 7f31edffb640 1 -- 172.21.15.84:0/814708296 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e0017070 con 0x7f31f0102a60 2024-09-21T03:34:19.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.064+0000 7f31f70a8640 1 -- 172.21.15.84:0/814708296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31f01a8b50 con 0x7f31f0102a60 2024-09-21T03:34:19.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.064+0000 7f31edffb640 1 -- 172.21.15.84:0/814708296 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31e00054d0 con 0x7f31f0102a60 2024-09-21T03:34:19.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.064+0000 7f31edffb640 1 -- 172.21.15.84:0/814708296 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e0004c30 con 0x7f31f0102a60 2024-09-21T03:34:19.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.064+0000 7f31f70a8640 1 -- 172.21.15.84:0/814708296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31f01a9010 con 0x7f31f0102a60 2024-09-21T03:34:19.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.065+0000 7f31f70a8640 1 -- 172.21.15.84:0/814708296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31f0102e70 con 0x7f31f0102a60 2024-09-21T03:34:19.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.067+0000 7f31edffb640 1 -- 172.21.15.84:0/814708296 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f31e0004dd0 con 0x7f31f0102a60 2024-09-21T03:34:19.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.067+0000 7f31edffb640 1 --2- 172.21.15.84:0/814708296 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f31d80b64d0 0x7f31d80b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.068+0000 7f31effff640 1 --2- 172.21.15.84:0/814708296 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f31d80b64d0 0x7f31d80b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.068+0000 7f31edffb640 1 -- 172.21.15.84:0/814708296 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f31e00e5520 con 0x7f31f0102a60 2024-09-21T03:34:19.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.068+0000 7f31effff640 1 --2- 172.21.15.84:0/814708296 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f31d80b64d0 0x7f31d80b89e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f31e4000c00 tx=0x7f31e4031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:19.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.071+0000 7f31edffb640 1 -- 172.21.15.84:0/814708296 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f31e00b1d90 con 0x7f31f0102a60 2024-09-21T03:34:19.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.237+0000 7ff039cd0640 1 -- 172.21.15.84:0/2716949646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff034108cf0 msgr2=0x7ff03410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:19.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.237+0000 7ff039cd0640 1 --2- 172.21.15.84:0/2716949646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff034108cf0 0x7ff03410f520 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff02c009ca0 tx=0x7ff02c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.237+0000 7ff039cd0640 1 -- 172.21.15.84:0/2716949646 shutdown_connections 2024-09-21T03:34:19.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.237+0000 7ff039cd0640 1 --2- 172.21.15.84:0/2716949646 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff034108cf0 0x7ff03410f520 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.237+0000 7ff039cd0640 1 --2- 172.21.15.84:0/2716949646 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0341083a0 0x7ff0341087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.237+0000 7ff039cd0640 1 --2- 172.21.15.84:0/2716949646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff034102a60 0x7ff034102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.237+0000 7ff039cd0640 1 -- 172.21.15.84:0/2716949646 >> 172.21.15.84:0/2716949646 conn(0x7ff034079730 msgr2=0x7ff034079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:19.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.237+0000 7ff039cd0640 1 -- 172.21.15.84:0/2716949646 shutdown_connections 2024-09-21T03:34:19.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.237+0000 7ff039cd0640 1 -- 172.21.15.84:0/2716949646 wait complete. 2024-09-21T03:34:19.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.238+0000 7ff039cd0640 1 Processor -- start 2024-09-21T03:34:19.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.238+0000 7ff039cd0640 1 -- start start 2024-09-21T03:34:19.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.238+0000 7ff039cd0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff034102a60 0x7ff034199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.238+0000 7ff039cd0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0341083a0 0x7ff0341998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.238+0000 7ff039cd0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff034108cf0 0x7ff03419eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.238+0000 7ff039cd0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff034112960 con 0x7ff034108cf0 2024-09-21T03:34:19.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.238+0000 7ff039cd0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff0341127e0 con 0x7ff034102a60 2024-09-21T03:34:19.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.238+0000 7ff039cd0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff034112ae0 con 0x7ff0341083a0 2024-09-21T03:34:19.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.238+0000 7ff033fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff034108cf0 0x7ff03419eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.239+0000 7ff033fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff034108cf0 0x7ff03419eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49324/0 (socket says 172.21.15.84:49324) 2024-09-21T03:34:19.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.239+0000 7ff033fff640 1 -- 172.21.15.84:0/685974229 learned_addr learned my addr 172.21.15.84:0/685974229 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:19.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.239+0000 7ff032ffd640 1 --2- 172.21.15.84:0/685974229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0341083a0 0x7ff0341998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.239+0000 7ff0337fe640 1 --2- 172.21.15.84:0/685974229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff034102a60 0x7ff034199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.239+0000 7ff033fff640 1 -- 172.21.15.84:0/685974229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0341083a0 msgr2=0x7ff0341998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:19.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.239+0000 7ff033fff640 1 --2- 172.21.15.84:0/685974229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0341083a0 0x7ff0341998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.239+0000 7ff033fff640 1 -- 172.21.15.84:0/685974229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff034102a60 msgr2=0x7ff034199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:19.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.239+0000 7ff033fff640 1 --2- 172.21.15.84:0/685974229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff034102a60 0x7ff034199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.239+0000 7ff033fff640 1 -- 172.21.15.84:0/685974229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff03419f2c0 con 0x7ff034108cf0 2024-09-21T03:34:19.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.239+0000 7ff033fff640 1 --2- 172.21.15.84:0/685974229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff034108cf0 0x7ff03419eb90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0098d0 tx=0x7ff02c0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:19.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.239+0000 7ff030ff9640 1 -- 172.21.15.84:0/685974229 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02c003b70 con 0x7ff034108cf0 2024-09-21T03:34:19.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.239+0000 7ff030ff9640 1 -- 172.21.15.84:0/685974229 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff02c003d10 con 0x7ff034108cf0 2024-09-21T03:34:19.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.239+0000 7ff039cd0640 1 -- 172.21.15.84:0/685974229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff03419f550 con 0x7ff034108cf0 2024-09-21T03:34:19.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.239+0000 7ff030ff9640 1 -- 172.21.15.84:0/685974229 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff02c02fa20 con 0x7ff034108cf0 2024-09-21T03:34:19.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.239+0000 7ff039cd0640 1 -- 172.21.15.84:0/685974229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff03406ae60 con 0x7ff034108cf0 2024-09-21T03:34:19.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.240+0000 7ff039cd0640 1 -- 172.21.15.84:0/685974229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff034103ce0 con 0x7ff034108cf0 2024-09-21T03:34:19.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.243+0000 7ff030ff9640 1 -- 172.21.15.84:0/685974229 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7ff02c02fbc0 con 0x7ff034108cf0 2024-09-21T03:34:19.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.244+0000 7ff030ff9640 1 --2- 172.21.15.84:0/685974229 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff0200ba8e0 0x7ff0200bcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.244+0000 7ff0337fe640 1 --2- 172.21.15.84:0/685974229 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff0200ba8e0 0x7ff0200bcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.244+0000 7ff030ff9640 1 -- 172.21.15.84:0/685974229 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff02c106b20 con 0x7ff034108cf0 2024-09-21T03:34:19.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.245+0000 7ff0337fe640 1 --2- 172.21.15.84:0/685974229 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff0200ba8e0 0x7ff0200bcdf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00bbe0 tx=0x7ff01c00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:19.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.246+0000 7ff030ff9640 1 -- 172.21.15.84:0/685974229 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff02c0cefb0 con 0x7ff034108cf0 2024-09-21T03:34:19.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.262+0000 7f31f70a8640 1 -- 172.21.15.84:0/814708296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f31f01a92b0 con 0x7f31f0102a60 2024-09-21T03:34:19.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.268+0000 7f31edffb640 1 -- 172.21.15.84:0/814708296 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v32)=0 v32) ==== 125+0+0 (secure 0 0 0) 0x7f31e00b6cd0 con 0x7f31f0102a60 2024-09-21T03:34:19.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.270+0000 7f31f70a8640 1 -- 172.21.15.84:0/814708296 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f31d80b64d0 msgr2=0x7f31d80b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:19.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.270+0000 7f31f70a8640 1 --2- 172.21.15.84:0/814708296 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f31d80b64d0 0x7f31d80b89e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f31e4000c00 tx=0x7f31e4031400 comp rx=0 tx=0).stop 2024-09-21T03:34:19.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.270+0000 7f31f70a8640 1 -- 172.21.15.84:0/814708296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31f0102a60 msgr2=0x7f31f00ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:19.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.270+0000 7f31f70a8640 1 --2- 172.21.15.84:0/814708296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31f0102a60 0x7f31f00ff670 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f31e000d770 tx=0x7f31e000dc30 comp rx=0 tx=0).stop 2024-09-21T03:34:19.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.271+0000 7f31f70a8640 1 -- 172.21.15.84:0/814708296 shutdown_connections 2024-09-21T03:34:19.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.271+0000 7f31f70a8640 1 --2- 172.21.15.84:0/814708296 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f31d80b64d0 0x7f31d80b89e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.271+0000 7f31f70a8640 1 --2- 172.21.15.84:0/814708296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31f0108cf0 0x7f31f01000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.271+0000 7f31f70a8640 1 --2- 172.21.15.84:0/814708296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f31f01083a0 0x7f31f00ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.271+0000 7f31f70a8640 1 --2- 172.21.15.84:0/814708296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f31f0102a60 0x7f31f00ff670 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.271+0000 7f31f70a8640 1 -- 172.21.15.84:0/814708296 >> 172.21.15.84:0/814708296 conn(0x7f31f0079730 msgr2=0x7f31f01019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:19.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.271+0000 7f31f70a8640 1 -- 172.21.15.84:0/814708296 shutdown_connections 2024-09-21T03:34:19.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.271+0000 7f31f70a8640 1 -- 172.21.15.84:0/814708296 wait complete. 2024-09-21T03:34:19.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.439+0000 7ff039cd0640 1 -- 172.21.15.84:0/685974229 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7ff034102e70 con 0x7ff034108cf0 2024-09-21T03:34:19.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.445+0000 7ff030ff9640 1 -- 172.21.15.84:0/685974229 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v33)=0 v33) ==== 138+0+0 (secure 0 0 0) 0x7ff034102e70 con 0x7ff034108cf0 2024-09-21T03:34:19.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.447+0000 7ff039cd0640 1 -- 172.21.15.84:0/685974229 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff0200ba8e0 msgr2=0x7ff0200bcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:19.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.447+0000 7ff039cd0640 1 --2- 172.21.15.84:0/685974229 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff0200ba8e0 0x7ff0200bcdf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00bbe0 tx=0x7ff01c00b390 comp rx=0 tx=0).stop 2024-09-21T03:34:19.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.447+0000 7ff039cd0640 1 -- 172.21.15.84:0/685974229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff034108cf0 msgr2=0x7ff03419eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:19.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.447+0000 7ff039cd0640 1 --2- 172.21.15.84:0/685974229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff034108cf0 0x7ff03419eb90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0098d0 tx=0x7ff02c0317b0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.447+0000 7ff039cd0640 1 -- 172.21.15.84:0/685974229 shutdown_connections 2024-09-21T03:34:19.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.447+0000 7ff039cd0640 1 --2- 172.21.15.84:0/685974229 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff0200ba8e0 0x7ff0200bcdf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.447+0000 7ff039cd0640 1 --2- 172.21.15.84:0/685974229 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff034108cf0 0x7ff03419eb90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.447+0000 7ff039cd0640 1 --2- 172.21.15.84:0/685974229 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff0341083a0 0x7ff0341998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.447+0000 7ff039cd0640 1 --2- 172.21.15.84:0/685974229 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff034102a60 0x7ff034199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.447+0000 7ff039cd0640 1 -- 172.21.15.84:0/685974229 >> 172.21.15.84:0/685974229 conn(0x7ff034079730 msgr2=0x7ff0341043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:19.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.447+0000 7ff039cd0640 1 -- 172.21.15.84:0/685974229 shutdown_connections 2024-09-21T03:34:19.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:19.447+0000 7ff039cd0640 1 -- 172.21.15.84:0/685974229 wait complete. 2024-09-21T03:34:19.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:19 smithi084 ceph-mon[30941]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:19.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:19 smithi174 ceph-mon[34403]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:19.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:19 smithi172 ceph-mon[34821]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:20.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:20 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/814708296' entity='client.admin' 2024-09-21T03:34:20.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:20 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:20.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:20 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:20.429 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:20 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:20.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:20 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:20.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:20 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/685974229' entity='client.admin' 2024-09-21T03:34:20.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:20 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:20.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:20 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:20.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:20 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:20.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:20 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:20.518 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:20.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:20 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/814708296' entity='client.admin' 2024-09-21T03:34:20.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:20 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:20.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:20 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:20.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:20 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:20.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:20 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:20.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:20 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/685974229' entity='client.admin' 2024-09-21T03:34:20.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:20 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:20.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:20 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:20.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:20 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:20.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:20 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:20.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:20 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/814708296' entity='client.admin' 2024-09-21T03:34:20.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:20 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:20.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:20 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:20.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:20 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:20.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:20 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:20.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:20 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/685974229' entity='client.admin' 2024-09-21T03:34:20.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:20 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:20.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:20 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:20.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:20 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:20.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:20 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.800+0000 7f0d1d933640 1 -- 172.21.15.84:0/1940696156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d1810de10 msgr2=0x7f0d18110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.800+0000 7f0d1d933640 1 --2- 172.21.15.84:0/1940696156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d1810de10 0x7f0d18110300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009900 tx=0x7f0d1002a410 comp rx=0 tx=0).stop 2024-09-21T03:34:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.800+0000 7f0d1d933640 1 -- 172.21.15.84:0/1940696156 shutdown_connections 2024-09-21T03:34:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.800+0000 7f0d1d933640 1 --2- 172.21.15.84:0/1940696156 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d1810de10 0x7f0d18110300 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.800+0000 7f0d1d933640 1 --2- 172.21.15.84:0/1940696156 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d18105300 0x7f0d1810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.800+0000 7f0d1d933640 1 --2- 172.21.15.84:0/1940696156 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d181049b0 0x7f0d18104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.800+0000 7f0d1d933640 1 -- 172.21.15.84:0/1940696156 >> 172.21.15.84:0/1940696156 conn(0x7f0d18079730 msgr2=0x7f0d18079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.800+0000 7f0d1d933640 1 -- 172.21.15.84:0/1940696156 shutdown_connections 2024-09-21T03:34:20.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.800+0000 7f0d1d933640 1 -- 172.21.15.84:0/1940696156 wait complete. 2024-09-21T03:34:20.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.800+0000 7f0d1d933640 1 Processor -- start 2024-09-21T03:34:20.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.801+0000 7f0d1d933640 1 -- start start 2024-09-21T03:34:20.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.801+0000 7f0d1d933640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d181049b0 0x7f0d1819c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:20.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.801+0000 7f0d1d933640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d18105300 0x7f0d1819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:20.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.801+0000 7f0d1d933640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d1810de10 0x7f0d181a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:20.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.801+0000 7f0d1d933640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0d18113ac0 con 0x7f0d1810de10 2024-09-21T03:34:20.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.801+0000 7f0d1d933640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0d18113940 con 0x7f0d18105300 2024-09-21T03:34:20.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.801+0000 7f0d1d933640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0d18113c40 con 0x7f0d181049b0 2024-09-21T03:34:20.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.801+0000 7f0d177fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d1810de10 0x7f0d181a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.801+0000 7f0d177fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d1810de10 0x7f0d181a1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49354/0 (socket says 172.21.15.84:49354) 2024-09-21T03:34:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.801+0000 7f0d177fe640 1 -- 172.21.15.84:0/4086581143 learned_addr learned my addr 172.21.15.84:0/4086581143 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.801+0000 7f0d167fc640 1 --2- 172.21.15.84:0/4086581143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d18105300 0x7f0d1819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.801+0000 7f0d16ffd640 1 --2- 172.21.15.84:0/4086581143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d181049b0 0x7f0d1819c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.801+0000 7f0d177fe640 1 -- 172.21.15.84:0/4086581143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d181049b0 msgr2=0x7f0d1819c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.801+0000 7f0d177fe640 1 --2- 172.21.15.84:0/4086581143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d181049b0 0x7f0d1819c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.801+0000 7f0d177fe640 1 -- 172.21.15.84:0/4086581143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d18105300 msgr2=0x7f0d1819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.801+0000 7f0d177fe640 1 --2- 172.21.15.84:0/4086581143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d18105300 0x7f0d1819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.801+0000 7f0d177fe640 1 -- 172.21.15.84:0/4086581143 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d181a2500 con 0x7f0d1810de10 2024-09-21T03:34:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.801+0000 7f0d16ffd640 1 --2- 172.21.15.84:0/4086581143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d181049b0 0x7f0d1819c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:34:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.802+0000 7f0d177fe640 1 --2- 172.21.15.84:0/4086581143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d1810de10 0x7f0d181a1e90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0d1002a930 tx=0x7f0d10003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.802+0000 7f0d1c931640 1 -- 172.21.15.84:0/4086581143 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1003f070 con 0x7f0d1810de10 2024-09-21T03:34:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.802+0000 7f0d1d933640 1 -- 172.21.15.84:0/4086581143 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d181a2790 con 0x7f0d1810de10 2024-09-21T03:34:20.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.802+0000 7f0d1c931640 1 -- 172.21.15.84:0/4086581143 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d10031d60 con 0x7f0d1810de10 2024-09-21T03:34:20.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.802+0000 7f0d1c931640 1 -- 172.21.15.84:0/4086581143 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d10035030 con 0x7f0d1810de10 2024-09-21T03:34:20.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.802+0000 7f0d1d933640 1 -- 172.21.15.84:0/4086581143 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d181a2c70 con 0x7f0d1810de10 2024-09-21T03:34:20.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.803+0000 7f0d1d933640 1 -- 172.21.15.84:0/4086581143 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d18104dc0 con 0x7f0d1810de10 2024-09-21T03:34:20.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.804+0000 7f0d1c931640 1 -- 172.21.15.84:0/4086581143 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f0d10042070 con 0x7f0d1810de10 2024-09-21T03:34:20.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.805+0000 7f0d1c931640 1 --2- 172.21.15.84:0/4086581143 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0d000b6500 0x7f0d000b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:20.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.805+0000 7f0d16ffd640 1 --2- 172.21.15.84:0/4086581143 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0d000b6500 0x7f0d000b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:20.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.805+0000 7f0d1c931640 1 -- 172.21.15.84:0/4086581143 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0d10106610 con 0x7f0d1810de10 2024-09-21T03:34:20.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.806+0000 7f0d16ffd640 1 --2- 172.21.15.84:0/4086581143 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0d000b6500 0x7f0d000b8a10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0d1806bc60 tx=0x7f0d08007870 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:20.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.808+0000 7f0d1c931640 1 -- 172.21.15.84:0/4086581143 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0d100ceaa0 con 0x7f0d1810de10 2024-09-21T03:34:20.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.990+0000 7f0d1d933640 1 -- 172.21.15.84:0/4086581143 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f0d181a9140 con 0x7f0d1810de10 2024-09-21T03:34:20.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.995+0000 7f0d1c931640 1 -- 172.21.15.84:0/4086581143 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v34)=0 v34) ==== 121+0+0 (secure 0 0 0) 0x7f0d100d2e80 con 0x7f0d1810de10 2024-09-21T03:34:20.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.997+0000 7f0d1d933640 1 -- 172.21.15.84:0/4086581143 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0d000b6500 msgr2=0x7f0d000b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:20.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.997+0000 7f0d1d933640 1 --2- 172.21.15.84:0/4086581143 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0d000b6500 0x7f0d000b8a10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0d1806bc60 tx=0x7f0d08007870 comp rx=0 tx=0).stop 2024-09-21T03:34:20.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.997+0000 7f0d1d933640 1 -- 172.21.15.84:0/4086581143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d1810de10 msgr2=0x7f0d181a1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:20.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.997+0000 7f0d1d933640 1 --2- 172.21.15.84:0/4086581143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d1810de10 0x7f0d181a1e90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0d1002a930 tx=0x7f0d10003cd0 comp rx=0 tx=0).stop 2024-09-21T03:34:20.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.997+0000 7f0d1d933640 1 -- 172.21.15.84:0/4086581143 shutdown_connections 2024-09-21T03:34:20.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.997+0000 7f0d1d933640 1 --2- 172.21.15.84:0/4086581143 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0d000b6500 0x7f0d000b8a10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:20.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.997+0000 7f0d1d933640 1 --2- 172.21.15.84:0/4086581143 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d1810de10 0x7f0d181a1e90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:20.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.997+0000 7f0d1d933640 1 --2- 172.21.15.84:0/4086581143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d18105300 0x7f0d1819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:21.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.997+0000 7f0d1d933640 1 --2- 172.21.15.84:0/4086581143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d181049b0 0x7f0d1819c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:21.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.997+0000 7f0d1d933640 1 -- 172.21.15.84:0/4086581143 >> 172.21.15.84:0/4086581143 conn(0x7f0d18079730 msgr2=0x7f0d181036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:21.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.997+0000 7f0d1d933640 1 -- 172.21.15.84:0/4086581143 shutdown_connections 2024-09-21T03:34:21.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:20.997+0000 7f0d1d933640 1 -- 172.21.15.84:0/4086581143 wait complete. 2024-09-21T03:34:21.404 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:21.404 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:21.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:21 smithi084 ceph-mon[30941]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:21.518 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:21 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/4086581143' entity='client.admin' 2024-09-21T03:34:21.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:21 smithi174 ceph-mon[34403]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:21.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:21 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/4086581143' entity='client.admin' 2024-09-21T03:34:21.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:21 smithi172 ceph-mon[34821]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:21.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:21 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/4086581143' entity='client.admin' 2024-09-21T03:34:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.020+0000 7fddf5a16640 1 -- 172.21.15.84:0/912476881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf0104860 msgr2=0x7fddf0104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.020+0000 7fddf5a16640 1 --2- 172.21.15.84:0/912476881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf0104860 0x7fddf0104c70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdde0009900 tx=0x7fdde002a410 comp rx=0 tx=0).stop 2024-09-21T03:34:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.020+0000 7fddf5a16640 1 -- 172.21.15.84:0/912476881 shutdown_connections 2024-09-21T03:34:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.020+0000 7fddf5a16640 1 --2- 172.21.15.84:0/912476881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddf010de10 0x7fddf01102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.020+0000 7fddf5a16640 1 --2- 172.21.15.84:0/912476881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddf0105290 0x7fddf010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:22.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.020+0000 7fddf5a16640 1 --2- 172.21.15.84:0/912476881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf0104860 0x7fddf0104c70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.020+0000 7fddf5a16640 1 -- 172.21.15.84:0/912476881 >> 172.21.15.84:0/912476881 conn(0x7fddf0079730 msgr2=0x7fddf0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.020+0000 7fddf5a16640 1 -- 172.21.15.84:0/912476881 shutdown_connections 2024-09-21T03:34:22.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.020+0000 7fddf5a16640 1 -- 172.21.15.84:0/912476881 wait complete. 2024-09-21T03:34:22.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.021+0000 7fddf5a16640 1 Processor -- start 2024-09-21T03:34:22.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.021+0000 7fddf5a16640 1 -- start start 2024-09-21T03:34:22.024 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.021+0000 7fddf5a16640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddf0104860 0x7fddf019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.021+0000 7fddf5a16640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf0105290 0x7fddf019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.021+0000 7fddf5a16640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddf010de10 0x7fddf019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.021+0000 7fddf5a16640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fddf0113a80 con 0x7fddf0105290 2024-09-21T03:34:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.021+0000 7fddf5a16640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fddf0113900 con 0x7fddf010de10 2024-09-21T03:34:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.021+0000 7fddf5a16640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fddf0113c00 con 0x7fddf0104860 2024-09-21T03:34:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.021+0000 7fddee7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf0105290 0x7fddf019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.021+0000 7fddee7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf0105290 0x7fddf019aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49378/0 (socket says 172.21.15.84:49378) 2024-09-21T03:34:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.021+0000 7fddee7fc640 1 -- 172.21.15.84:0/2426424735 learned_addr learned my addr 172.21.15.84:0/2426424735 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.021+0000 7fddef7fe640 1 --2- 172.21.15.84:0/2426424735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddf010de10 0x7fddf019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.021+0000 7fddeeffd640 1 --2- 172.21.15.84:0/2426424735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddf0104860 0x7fddf019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.022+0000 7fddee7fc640 1 -- 172.21.15.84:0/2426424735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddf0104860 msgr2=0x7fddf019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.022+0000 7fddee7fc640 1 --2- 172.21.15.84:0/2426424735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddf0104860 0x7fddf019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:22.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.022+0000 7fddee7fc640 1 -- 172.21.15.84:0/2426424735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddf010de10 msgr2=0x7fddf019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:22.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.022+0000 7fddee7fc640 1 --2- 172.21.15.84:0/2426424735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddf010de10 0x7fddf019fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:22.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.022+0000 7fddee7fc640 1 -- 172.21.15.84:0/2426424735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf01a0400 con 0x7fddf0105290 2024-09-21T03:34:22.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.022+0000 7fddee7fc640 1 --2- 172.21.15.84:0/2426424735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf0105290 0x7fddf019aa30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdde400d750 tx=0x7fdde400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:22.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.022+0000 7fddf4a14640 1 -- 172.21.15.84:0/2426424735 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde4017070 con 0x7fddf0105290 2024-09-21T03:34:22.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.022+0000 7fddf4a14640 1 -- 172.21.15.84:0/2426424735 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdde40054d0 con 0x7fddf0105290 2024-09-21T03:34:22.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.022+0000 7fddf5a16640 1 -- 172.21.15.84:0/2426424735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf01a06f0 con 0x7fddf0105290 2024-09-21T03:34:22.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.022+0000 7fddf4a14640 1 -- 172.21.15.84:0/2426424735 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde4004c30 con 0x7fddf0105290 2024-09-21T03:34:22.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.022+0000 7fddf5a16640 1 -- 172.21.15.84:0/2426424735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf01a6e50 con 0x7fddf0105290 2024-09-21T03:34:22.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.023+0000 7fddf5a16640 1 -- 172.21.15.84:0/2426424735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf0104c70 con 0x7fddf0105290 2024-09-21T03:34:22.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.025+0000 7fddf4a14640 1 -- 172.21.15.84:0/2426424735 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fdde4004dd0 con 0x7fddf0105290 2024-09-21T03:34:22.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.025+0000 7fddf4a14640 1 --2- 172.21.15.84:0/2426424735 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fddd80b6550 0x7fddd80b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:22.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.025+0000 7fddeeffd640 1 --2- 172.21.15.84:0/2426424735 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fddd80b6550 0x7fddd80b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:22.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.025+0000 7fddf4a14640 1 -- 172.21.15.84:0/2426424735 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fdde40e53d0 con 0x7fddf0105290 2024-09-21T03:34:22.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.026+0000 7fddeeffd640 1 --2- 172.21.15.84:0/2426424735 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fddd80b6550 0x7fddd80b8a60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdde0031440 tx=0x7fdde0009560 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:22.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.029+0000 7fddf4a14640 1 -- 172.21.15.84:0/2426424735 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdde40b1cc0 con 0x7fddf0105290 2024-09-21T03:34:22.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.211+0000 7fddf5a16640 1 -- 172.21.15.84:0/2426424735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7fddf019b5c0 con 0x7fddf0105290 2024-09-21T03:34:22.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.216+0000 7fddf4a14640 1 -- 172.21.15.84:0/2426424735 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v35)=0 v35) ==== 115+0+0 (secure 0 0 0) 0x7fddf019b5c0 con 0x7fddf0105290 2024-09-21T03:34:22.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.219+0000 7fddf5a16640 1 -- 172.21.15.84:0/2426424735 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fddd80b6550 msgr2=0x7fddd80b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:22.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.219+0000 7fddf5a16640 1 --2- 172.21.15.84:0/2426424735 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fddd80b6550 0x7fddd80b8a60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdde0031440 tx=0x7fdde0009560 comp rx=0 tx=0).stop 2024-09-21T03:34:22.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.219+0000 7fddf5a16640 1 -- 172.21.15.84:0/2426424735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf0105290 msgr2=0x7fddf019aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:22.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.219+0000 7fddf5a16640 1 --2- 172.21.15.84:0/2426424735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf0105290 0x7fddf019aa30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdde400d750 tx=0x7fdde400dc10 comp rx=0 tx=0).stop 2024-09-21T03:34:22.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.219+0000 7fddf5a16640 1 -- 172.21.15.84:0/2426424735 shutdown_connections 2024-09-21T03:34:22.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.219+0000 7fddf5a16640 1 --2- 172.21.15.84:0/2426424735 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fddd80b6550 0x7fddd80b8a60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:22.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.219+0000 7fddf5a16640 1 --2- 172.21.15.84:0/2426424735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddf010de10 0x7fddf019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:22.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.219+0000 7fddf5a16640 1 --2- 172.21.15.84:0/2426424735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddf0105290 0x7fddf019aa30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:22.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.219+0000 7fddf5a16640 1 --2- 172.21.15.84:0/2426424735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddf0104860 0x7fddf019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:22.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.219+0000 7fddf5a16640 1 -- 172.21.15.84:0/2426424735 >> 172.21.15.84:0/2426424735 conn(0x7fddf0079730 msgr2=0x7fddf0100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:22.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.219+0000 7fddf5a16640 1 -- 172.21.15.84:0/2426424735 shutdown_connections 2024-09-21T03:34:22.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.219+0000 7fddf5a16640 1 -- 172.21.15.84:0/2426424735 wait complete. 2024-09-21T03:34:22.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.265+0000 7f4729836640 1 -- 172.21.15.84:0/2061834867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724106bd0 msgr2=0x7f4724110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:22.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.265+0000 7f4729836640 1 --2- 172.21.15.84:0/2061834867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724106bd0 0x7f4724110660 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f471c009ca0 tx=0x7f471c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:34:22.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.265+0000 7f4729836640 1 -- 172.21.15.84:0/2061834867 shutdown_connections 2024-09-21T03:34:22.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.265+0000 7f4729836640 1 --2- 172.21.15.84:0/2061834867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724106bd0 0x7f4724110660 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:22.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.265+0000 7f4729836640 1 --2- 172.21.15.84:0/2061834867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4724106280 0x7f4724106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:22.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.265+0000 7f4729836640 1 --2- 172.21.15.84:0/2061834867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4724102030 0x7f4724102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:22.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.265+0000 7f4729836640 1 -- 172.21.15.84:0/2061834867 >> 172.21.15.84:0/2061834867 conn(0x7f4724077c60 msgr2=0x7f47240780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:22.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.265+0000 7f4729836640 1 -- 172.21.15.84:0/2061834867 shutdown_connections 2024-09-21T03:34:22.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.265+0000 7f4729836640 1 -- 172.21.15.84:0/2061834867 wait complete. 2024-09-21T03:34:22.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.266+0000 7f4729836640 1 Processor -- start 2024-09-21T03:34:22.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.266+0000 7f4729836640 1 -- start start 2024-09-21T03:34:22.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f4729836640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724102030 0x7f4724102fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:22.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f4729836640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4724106280 0x7f4724103510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:22.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f4729836640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4724106bd0 0x7f4724103a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:22.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f4729836640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4724113b40 con 0x7f4724102030 2024-09-21T03:34:22.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f4729836640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f47241139c0 con 0x7f4724106280 2024-09-21T03:34:22.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f4729836640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4724113cc0 con 0x7f4724106bd0 2024-09-21T03:34:22.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f4722ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724102030 0x7f4724102fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:22.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f4722ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724102030 0x7f4724102fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49386/0 (socket says 172.21.15.84:49386) 2024-09-21T03:34:22.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f4722ffd640 1 -- 172.21.15.84:0/1510220520 learned_addr learned my addr 172.21.15.84:0/1510220520 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:22.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f47227fc640 1 --2- 172.21.15.84:0/1510220520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4724106280 0x7f4724103510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:22.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f47237fe640 1 --2- 172.21.15.84:0/1510220520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4724106bd0 0x7f4724103a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:22.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f4722ffd640 1 -- 172.21.15.84:0/1510220520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4724106bd0 msgr2=0x7f4724103a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:22.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f4722ffd640 1 --2- 172.21.15.84:0/1510220520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4724106bd0 0x7f4724103a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:22.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f4722ffd640 1 -- 172.21.15.84:0/1510220520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4724106280 msgr2=0x7f4724103510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:22.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f4722ffd640 1 --2- 172.21.15.84:0/1510220520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4724106280 0x7f4724103510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:22.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f4722ffd640 1 -- 172.21.15.84:0/1510220520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47241a8750 con 0x7f4724102030 2024-09-21T03:34:22.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f4722ffd640 1 --2- 172.21.15.84:0/1510220520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724102030 0x7f4724102fd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f471400b450 tx=0x7f471400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:22.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f4728834640 1 -- 172.21.15.84:0/1510220520 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4714015020 con 0x7f4724102030 2024-09-21T03:34:22.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f4728834640 1 -- 172.21.15.84:0/1510220520 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4714011d40 con 0x7f4724102030 2024-09-21T03:34:22.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f4728834640 1 -- 172.21.15.84:0/1510220520 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f471400f340 con 0x7f4724102030 2024-09-21T03:34:22.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.267+0000 7f4729836640 1 -- 172.21.15.84:0/1510220520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47241a8a40 con 0x7f4724102030 2024-09-21T03:34:22.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.268+0000 7f4729836640 1 -- 172.21.15.84:0/1510220520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47241a8f80 con 0x7f4724102030 2024-09-21T03:34:22.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.268+0000 7f4729836640 1 -- 172.21.15.84:0/1510220520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4724102440 con 0x7f4724102030 2024-09-21T03:34:22.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.270+0000 7f4728834640 1 -- 172.21.15.84:0/1510220520 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f4714018020 con 0x7f4724102030 2024-09-21T03:34:22.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.271+0000 7f4728834640 1 --2- 172.21.15.84:0/1510220520 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f470c0b6550 0x7f470c0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:22.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.271+0000 7f47227fc640 1 --2- 172.21.15.84:0/1510220520 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f470c0b6550 0x7f470c0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:22.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.271+0000 7f4728834640 1 -- 172.21.15.84:0/1510220520 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f47140e5630 con 0x7f4724102030 2024-09-21T03:34:22.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.271+0000 7f47227fc640 1 --2- 172.21.15.84:0/1510220520 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f470c0b6550 0x7f470c0b8a60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f472410a280 tx=0x7f471800b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:22.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.274+0000 7f4728834640 1 -- 172.21.15.84:0/1510220520 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f471401f020 con 0x7f4724102030 2024-09-21T03:34:22.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.458+0000 7f4729836640 1 -- 172.21.15.84:0/1510220520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f47241042d0 con 0x7f4724102030 2024-09-21T03:34:22.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.459+0000 7f4728834640 1 -- 172.21.15.84:0/1510220520 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v35)=0 v35) ==== 108+0+0 (secure 0 0 0) 0x7f47241042d0 con 0x7f4724102030 2024-09-21T03:34:22.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.461+0000 7f4729836640 1 -- 172.21.15.84:0/1510220520 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f470c0b6550 msgr2=0x7f470c0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:22.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.461+0000 7f4729836640 1 --2- 172.21.15.84:0/1510220520 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f470c0b6550 0x7f470c0b8a60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f472410a280 tx=0x7f471800b410 comp rx=0 tx=0).stop 2024-09-21T03:34:22.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.461+0000 7f4729836640 1 -- 172.21.15.84:0/1510220520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724102030 msgr2=0x7f4724102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:22.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.461+0000 7f4729836640 1 --2- 172.21.15.84:0/1510220520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724102030 0x7f4724102fd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f471400b450 tx=0x7f471400b910 comp rx=0 tx=0).stop 2024-09-21T03:34:22.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.461+0000 7f4729836640 1 -- 172.21.15.84:0/1510220520 shutdown_connections 2024-09-21T03:34:22.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.461+0000 7f4729836640 1 --2- 172.21.15.84:0/1510220520 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f470c0b6550 0x7f470c0b8a60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:22.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.461+0000 7f4729836640 1 --2- 172.21.15.84:0/1510220520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4724106bd0 0x7f4724103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:22.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.461+0000 7f4729836640 1 --2- 172.21.15.84:0/1510220520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4724106280 0x7f4724103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:22.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.461+0000 7f4729836640 1 --2- 172.21.15.84:0/1510220520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4724102030 0x7f4724102fd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:22.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.461+0000 7f4729836640 1 -- 172.21.15.84:0/1510220520 >> 172.21.15.84:0/1510220520 conn(0x7f4724077c60 msgr2=0x7f4724107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:22.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.461+0000 7f4729836640 1 -- 172.21.15.84:0/1510220520 shutdown_connections 2024-09-21T03:34:22.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:22.461+0000 7f4729836640 1 -- 172.21.15.84:0/1510220520 wait complete. 2024-09-21T03:34:23.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.328+0000 7fabf86f3640 1 -- 172.21.15.84:0/3081458384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf0102a60 msgr2=0x7fabf0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:23.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.328+0000 7fabf86f3640 1 --2- 172.21.15.84:0/3081458384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf0102a60 0x7fabf0102e70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009900 tx=0x7fabe002a410 comp rx=0 tx=0).stop 2024-09-21T03:34:23.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.328+0000 7fabf86f3640 1 -- 172.21.15.84:0/3081458384 shutdown_connections 2024-09-21T03:34:23.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.328+0000 7fabf86f3640 1 --2- 172.21.15.84:0/3081458384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabf0108cf0 0x7fabf010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.328+0000 7fabf86f3640 1 --2- 172.21.15.84:0/3081458384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabf01083a0 0x7fabf01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.328+0000 7fabf86f3640 1 --2- 172.21.15.84:0/3081458384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf0102a60 0x7fabf0102e70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.328+0000 7fabf86f3640 1 -- 172.21.15.84:0/3081458384 >> 172.21.15.84:0/3081458384 conn(0x7fabf0079730 msgr2=0x7fabf0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:23.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.328+0000 7fabf86f3640 1 -- 172.21.15.84:0/3081458384 shutdown_connections 2024-09-21T03:34:23.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.328+0000 7fabf86f3640 1 -- 172.21.15.84:0/3081458384 wait complete. 2024-09-21T03:34:23.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.329+0000 7fabf86f3640 1 Processor -- start 2024-09-21T03:34:23.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.329+0000 7fabf86f3640 1 -- start start 2024-09-21T03:34:23.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.329+0000 7fabf86f3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabf0102a60 0x7fabf019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.329+0000 7fabf86f3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabf01083a0 0x7fabf019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.329+0000 7fabf86f3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf0108cf0 0x7fabf019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.329+0000 7fabf86f3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fabf0113a80 con 0x7fabf0108cf0 2024-09-21T03:34:23.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.329+0000 7fabf86f3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fabf0113900 con 0x7fabf0102a60 2024-09-21T03:34:23.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.329+0000 7fabf86f3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fabf0113c00 con 0x7fabf01083a0 2024-09-21T03:34:23.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.329+0000 7fabf6c90640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf0108cf0 0x7fabf019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.329+0000 7fabf6c90640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf0108cf0 0x7fabf019fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49404/0 (socket says 172.21.15.84:49404) 2024-09-21T03:34:23.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.329+0000 7fabf6c90640 1 -- 172.21.15.84:0/1535185915 learned_addr learned my addr 172.21.15.84:0/1535185915 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:23.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.329+0000 7fabf5c8e640 1 --2- 172.21.15.84:0/1535185915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabf01083a0 0x7fabf019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.329+0000 7fabf648f640 1 --2- 172.21.15.84:0/1535185915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabf0102a60 0x7fabf019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.329+0000 7fabf6c90640 1 -- 172.21.15.84:0/1535185915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabf01083a0 msgr2=0x7fabf019a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:23.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.329+0000 7fabf6c90640 1 --2- 172.21.15.84:0/1535185915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabf01083a0 0x7fabf019a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.329+0000 7fabf6c90640 1 -- 172.21.15.84:0/1535185915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabf0102a60 msgr2=0x7fabf019a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:23.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.329+0000 7fabf6c90640 1 --2- 172.21.15.84:0/1535185915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabf0102a60 0x7fabf019a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.329+0000 7fabf6c90640 1 -- 172.21.15.84:0/1535185915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf01a03c0 con 0x7fabf0108cf0 2024-09-21T03:34:23.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.329+0000 7fabf648f640 1 --2- 172.21.15.84:0/1535185915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabf0102a60 0x7fabf019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:34:23.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.330+0000 7fabf6c90640 1 --2- 172.21.15.84:0/1535185915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf0108cf0 0x7fabf019fc90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fabe800eaa0 tx=0x7fabe800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:23.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.330+0000 7fabef7fe640 1 -- 172.21.15.84:0/1535185915 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe800cdb0 con 0x7fabf0108cf0 2024-09-21T03:34:23.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.330+0000 7fabf86f3640 1 -- 172.21.15.84:0/1535185915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabf01a06b0 con 0x7fabf0108cf0 2024-09-21T03:34:23.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.330+0000 7fabef7fe640 1 -- 172.21.15.84:0/1535185915 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabe8005020 con 0x7fabf0108cf0 2024-09-21T03:34:23.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.330+0000 7fabef7fe640 1 -- 172.21.15.84:0/1535185915 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe80116d0 con 0x7fabf0108cf0 2024-09-21T03:34:23.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.330+0000 7fabf86f3640 1 -- 172.21.15.84:0/1535185915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabf01a6e10 con 0x7fabf0108cf0 2024-09-21T03:34:23.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.331+0000 7fabf86f3640 1 -- 172.21.15.84:0/1535185915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabf0102e70 con 0x7fabf0108cf0 2024-09-21T03:34:23.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.332+0000 7fabef7fe640 1 -- 172.21.15.84:0/1535185915 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fabe80051d0 con 0x7fabf0108cf0 2024-09-21T03:34:23.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.333+0000 7fabef7fe640 1 --2- 172.21.15.84:0/1535185915 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fabd80b64d0 0x7fabd80b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.333+0000 7fabf648f640 1 --2- 172.21.15.84:0/1535185915 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fabd80b64d0 0x7fabd80b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.333+0000 7fabef7fe640 1 -- 172.21.15.84:0/1535185915 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fabe80e5cf0 con 0x7fabf0108cf0 2024-09-21T03:34:23.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.333+0000 7fabf648f640 1 --2- 172.21.15.84:0/1535185915 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fabd80b64d0 0x7fabd80b89e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fabe0031440 tx=0x7fabe0009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:23.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.336+0000 7fabef7fe640 1 -- 172.21.15.84:0/1535185915 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fabe8016030 con 0x7fabf0108cf0 2024-09-21T03:34:23.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.519+0000 7fabf86f3640 1 -- 172.21.15.84:0/1535185915 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fabf019b580 con 0x7fabf0108cf0 2024-09-21T03:34:23.523 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:23 smithi084 ceph-mon[30941]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:23.523 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:23 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2426424735' entity='client.admin' 2024-09-21T03:34:23.523 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:23.523 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:23.523 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:23.523 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:23.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.523+0000 7fabef7fe640 1 -- 172.21.15.84:0/1535185915 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v36)=0 v36) ==== 119+0+0 (secure 0 0 0) 0x7fabf019b580 con 0x7fabf0108cf0 2024-09-21T03:34:23.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.526+0000 7fabf86f3640 1 -- 172.21.15.84:0/1535185915 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fabd80b64d0 msgr2=0x7fabd80b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:23.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.526+0000 7fabf86f3640 1 --2- 172.21.15.84:0/1535185915 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fabd80b64d0 0x7fabd80b89e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fabe0031440 tx=0x7fabe0009680 comp rx=0 tx=0).stop 2024-09-21T03:34:23.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.526+0000 7fabf86f3640 1 -- 172.21.15.84:0/1535185915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf0108cf0 msgr2=0x7fabf019fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:23.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.526+0000 7fabf86f3640 1 --2- 172.21.15.84:0/1535185915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf0108cf0 0x7fabf019fc90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fabe800eaa0 tx=0x7fabe800ef60 comp rx=0 tx=0).stop 2024-09-21T03:34:23.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.526+0000 7fabf86f3640 1 -- 172.21.15.84:0/1535185915 shutdown_connections 2024-09-21T03:34:23.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.526+0000 7fabf86f3640 1 --2- 172.21.15.84:0/1535185915 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fabd80b64d0 0x7fabd80b89e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.526+0000 7fabf86f3640 1 --2- 172.21.15.84:0/1535185915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fabf0108cf0 0x7fabf019fc90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.526+0000 7fabf86f3640 1 --2- 172.21.15.84:0/1535185915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fabf01083a0 0x7fabf019a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.526+0000 7fabf86f3640 1 --2- 172.21.15.84:0/1535185915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabf0102a60 0x7fabf019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.526+0000 7fabf86f3640 1 -- 172.21.15.84:0/1535185915 >> 172.21.15.84:0/1535185915 conn(0x7fabf0079730 msgr2=0x7fabf0101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.526+0000 7fabf86f3640 1 -- 172.21.15.84:0/1535185915 shutdown_connections 2024-09-21T03:34:23.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:23.526+0000 7fabf86f3640 1 -- 172.21.15.84:0/1535185915 wait complete. 2024-09-21T03:34:23.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:23 smithi174 ceph-mon[34403]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:23.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:23 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2426424735' entity='client.admin' 2024-09-21T03:34:23.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:23.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:23.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:23.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:23 smithi172 ceph-mon[34821]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:23 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2426424735' entity='client.admin' 2024-09-21T03:34:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:24.475 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi084') 2024-09-21T03:34:24.699 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:24 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1535185915' entity='client.admin' 2024-09-21T03:34:24.699 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:24 smithi084 ceph-mon[30941]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:24.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:24 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1535185915' entity='client.admin' 2024-09-21T03:34:24.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:24 smithi174 ceph-mon[34403]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:24.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:24 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1535185915' entity='client.admin' 2024-09-21T03:34:24.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:24 smithi172 ceph-mon[34821]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.905+0000 7f8fe7c4e640 1 -- 172.21.15.84:0/3383833510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe0103b60 msgr2=0x7f8fe0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.905+0000 7f8fe7c4e640 1 --2- 172.21.15.84:0/3383833510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe0103b60 0x7f8fe0103f70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009900 tx=0x7f8fd402a410 comp rx=0 tx=0).stop 2024-09-21T03:34:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.905+0000 7f8fe7c4e640 1 -- 172.21.15.84:0/3383833510 shutdown_connections 2024-09-21T03:34:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.905+0000 7f8fe7c4e640 1 --2- 172.21.15.84:0/3383833510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fe0109df0 0x7f8fe0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.905+0000 7f8fe7c4e640 1 --2- 172.21.15.84:0/3383833510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fe01094a0 0x7f8fe01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.905+0000 7f8fe7c4e640 1 --2- 172.21.15.84:0/3383833510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe0103b60 0x7f8fe0103f70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.905+0000 7f8fe7c4e640 1 -- 172.21.15.84:0/3383833510 >> 172.21.15.84:0/3383833510 conn(0x7f8fe007b850 msgr2=0x7f8fe007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.905+0000 7f8fe7c4e640 1 -- 172.21.15.84:0/3383833510 shutdown_connections 2024-09-21T03:34:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.905+0000 7f8fe7c4e640 1 -- 172.21.15.84:0/3383833510 wait complete. 2024-09-21T03:34:24.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.906+0000 7f8fe7c4e640 1 Processor -- start 2024-09-21T03:34:24.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.906+0000 7f8fe7c4e640 1 -- start start 2024-09-21T03:34:24.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.906+0000 7f8fe7c4e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fe0103b60 0x7f8fe0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:24.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.906+0000 7f8fe7c4e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe01094a0 0x7f8fe0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:24.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.906+0000 7f8fe7c4e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fe0109df0 0x7f8fe0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:24.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.906+0000 7f8fe7c4e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe0113ab0 con 0x7f8fe01094a0 2024-09-21T03:34:24.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.906+0000 7f8fe7c4e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe0113930 con 0x7f8fe0109df0 2024-09-21T03:34:24.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.906+0000 7f8fe7c4e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe0113c30 con 0x7f8fe0103b60 2024-09-21T03:34:24.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.906+0000 7f8fe51e9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe01094a0 0x7f8fe0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:24.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.906+0000 7f8fe51e9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe01094a0 0x7f8fe0075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49424/0 (socket says 172.21.15.84:49424) 2024-09-21T03:34:24.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.906+0000 7f8fe51e9640 1 -- 172.21.15.84:0/2978822209 learned_addr learned my addr 172.21.15.84:0/2978822209 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:24.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.906+0000 7f8fe61eb640 1 --2- 172.21.15.84:0/2978822209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fe0109df0 0x7f8fe0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:24.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.906+0000 7f8fe59ea640 1 --2- 172.21.15.84:0/2978822209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fe0103b60 0x7f8fe0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:24.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.906+0000 7f8fe51e9640 1 -- 172.21.15.84:0/2978822209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fe0103b60 msgr2=0x7f8fe0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:24.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.906+0000 7f8fe51e9640 1 --2- 172.21.15.84:0/2978822209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fe0103b60 0x7f8fe0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:24.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.906+0000 7f8fe51e9640 1 -- 172.21.15.84:0/2978822209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fe0109df0 msgr2=0x7f8fe0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:24.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.907+0000 7f8fe51e9640 1 --2- 172.21.15.84:0/2978822209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fe0109df0 0x7f8fe0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:24.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.907+0000 7f8fe51e9640 1 -- 172.21.15.84:0/2978822209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe01a8740 con 0x7f8fe01094a0 2024-09-21T03:34:24.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.907+0000 7f8fe51e9640 1 --2- 172.21.15.84:0/2978822209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe01094a0 0x7f8fe0075c50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00d740 tx=0x7f8fdc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:24.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.907+0000 7f8fd2ffd640 1 -- 172.21.15.84:0/2978822209 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc017070 con 0x7f8fe01094a0 2024-09-21T03:34:24.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.907+0000 7f8fe7c4e640 1 -- 172.21.15.84:0/2978822209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe01a8a30 con 0x7f8fe01094a0 2024-09-21T03:34:24.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.907+0000 7f8fd2ffd640 1 -- 172.21.15.84:0/2978822209 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fdc00de50 con 0x7f8fe01094a0 2024-09-21T03:34:24.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.907+0000 7f8fd2ffd640 1 -- 172.21.15.84:0/2978822209 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc00f620 con 0x7f8fe01094a0 2024-09-21T03:34:24.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.907+0000 7f8fe7c4e640 1 -- 172.21.15.84:0/2978822209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fe01a8f70 con 0x7f8fe01094a0 2024-09-21T03:34:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.908+0000 7f8fe7c4e640 1 -- 172.21.15.84:0/2978822209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fe0103f70 con 0x7f8fe01094a0 2024-09-21T03:34:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.909+0000 7f8fd2ffd640 1 -- 172.21.15.84:0/2978822209 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f8fdc01a070 con 0x7f8fe01094a0 2024-09-21T03:34:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.910+0000 7f8fd2ffd640 1 --2- 172.21.15.84:0/2978822209 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8fcc0b64d0 0x7f8fcc0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.910+0000 7f8fe59ea640 1 --2- 172.21.15.84:0/2978822209 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8fcc0b64d0 0x7f8fcc0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.910+0000 7f8fd2ffd640 1 -- 172.21.15.84:0/2978822209 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8fdc0e50b0 con 0x7f8fe01094a0 2024-09-21T03:34:24.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.911+0000 7f8fe59ea640 1 --2- 172.21.15.84:0/2978822209 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8fcc0b64d0 0x7f8fcc0b89e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4000c00 tx=0x7f8fd4031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:24.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:24.914+0000 7f8fd2ffd640 1 -- 172.21.15.84:0/2978822209 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8fdc0b1920 con 0x7f8fe01094a0 2024-09-21T03:34:25.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:25.096+0000 7f8fe7c4e640 1 -- 172.21.15.84:0/2978822209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f8fe002e640 con 0x7f8fe01094a0 2024-09-21T03:34:25.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:25.100+0000 7f8fd2ffd640 1 -- 172.21.15.84:0/2978822209 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v37)=0 v37) ==== 129+0+0 (secure 0 0 0) 0x7f8fdc0b6860 con 0x7f8fe01094a0 2024-09-21T03:34:25.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:25.102+0000 7f8fe7c4e640 1 -- 172.21.15.84:0/2978822209 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8fcc0b64d0 msgr2=0x7f8fcc0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:25.102+0000 7f8fe7c4e640 1 --2- 172.21.15.84:0/2978822209 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8fcc0b64d0 0x7f8fcc0b89e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4000c00 tx=0x7f8fd4031400 comp rx=0 tx=0).stop 2024-09-21T03:34:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:25.102+0000 7f8fe7c4e640 1 -- 172.21.15.84:0/2978822209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe01094a0 msgr2=0x7f8fe0075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:25.102+0000 7f8fe7c4e640 1 --2- 172.21.15.84:0/2978822209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe01094a0 0x7f8fe0075c50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00d740 tx=0x7f8fdc00dc00 comp rx=0 tx=0).stop 2024-09-21T03:34:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:25.102+0000 7f8fe7c4e640 1 -- 172.21.15.84:0/2978822209 shutdown_connections 2024-09-21T03:34:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:25.103+0000 7f8fe7c4e640 1 --2- 172.21.15.84:0/2978822209 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8fcc0b64d0 0x7f8fcc0b89e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:25.103+0000 7f8fe7c4e640 1 --2- 172.21.15.84:0/2978822209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fe0109df0 0x7f8fe0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:25.103+0000 7f8fe7c4e640 1 --2- 172.21.15.84:0/2978822209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fe01094a0 0x7f8fe0075c50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:25.103+0000 7f8fe7c4e640 1 --2- 172.21.15.84:0/2978822209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fe0103b60 0x7f8fe0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:25.103+0000 7f8fe7c4e640 1 -- 172.21.15.84:0/2978822209 >> 172.21.15.84:0/2978822209 conn(0x7f8fe007b850 msgr2=0x7f8fe0107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:25.103+0000 7f8fe7c4e640 1 -- 172.21.15.84:0/2978822209 shutdown_connections 2024-09-21T03:34:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:25.103+0000 7f8fe7c4e640 1 -- 172.21.15.84:0/2978822209 wait complete. 2024-09-21T03:34:25.320 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi084') 2024-09-21T03:34:25.320 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi084') 2024-09-21T03:34:25.320 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi084') 2024-09-21T03:34:25.320 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi084') 2024-09-21T03:34:25.320 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi084') 2024-09-21T03:34:25.321 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi084') 2024-09-21T03:34:25.321 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi084') 2024-09-21T03:34:25.321 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi084') 2024-09-21T03:34:25.321 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi084') 2024-09-21T03:34:25.321 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi084') 2024-09-21T03:34:25.321 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi084') 2024-09-21T03:34:25.941 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi084') 2024-09-21T03:34:25.941 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi084') 2024-09-21T03:34:25.941 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'e3f8c18e-77c9-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi084') 2024-09-21T03:34:25.942 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T03:34:26.181 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:26.301 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:26 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2978822209' entity='client.admin' 2024-09-21T03:34:26.301 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:26 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:26.301 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:26 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:26.301 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:26 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:26.302 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:26 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:26.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:26 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2978822209' entity='client.admin' 2024-09-21T03:34:26.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:26 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:26.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:26 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:26.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:26 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:26.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:26 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:26.400 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:26 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2978822209' entity='client.admin' 2024-09-21T03:34:26.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:26 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:26.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:26 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:26.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:26 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:26.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:26 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:26.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.712+0000 7f5607b84640 1 -- 172.21.15.84:0/816464460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5600106c20 msgr2=0x7f56001106b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:26.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.712+0000 7f5607b84640 1 --2- 172.21.15.84:0/816464460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5600106c20 0x7f56001106b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f55f8009ca0 tx=0x7f55f802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.712+0000 7f5607b84640 1 -- 172.21.15.84:0/816464460 shutdown_connections 2024-09-21T03:34:26.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.712+0000 7f5607b84640 1 --2- 172.21.15.84:0/816464460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5600106c20 0x7f56001106b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.712+0000 7f5607b84640 1 --2- 172.21.15.84:0/816464460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56001062d0 0x7f56001066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.712+0000 7f5607b84640 1 --2- 172.21.15.84:0/816464460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5600102080 0x7f5600102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.712+0000 7f5607b84640 1 -- 172.21.15.84:0/816464460 >> 172.21.15.84:0/816464460 conn(0x7f5600079f90 msgr2=0x7f560007a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:26.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.712+0000 7f5607b84640 1 -- 172.21.15.84:0/816464460 shutdown_connections 2024-09-21T03:34:26.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.712+0000 7f5607b84640 1 -- 172.21.15.84:0/816464460 wait complete. 2024-09-21T03:34:26.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.713+0000 7f5607b84640 1 Processor -- start 2024-09-21T03:34:26.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.713+0000 7f5607b84640 1 -- start start 2024-09-21T03:34:26.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.713+0000 7f5607b84640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5600102080 0x7f560019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.713+0000 7f5607b84640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56001062d0 0x7f560019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.713+0000 7f5607b84640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5600106c20 0x7f560019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.713+0000 7f5607b84640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5600113b10 con 0x7f56001062d0 2024-09-21T03:34:26.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.713+0000 7f5607b84640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5600113990 con 0x7f5600106c20 2024-09-21T03:34:26.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.713+0000 7f5607b84640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5600113c90 con 0x7f5600102080 2024-09-21T03:34:26.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.713+0000 7f560511f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56001062d0 0x7f560019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.713+0000 7f560511f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56001062d0 0x7f560019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49438/0 (socket says 172.21.15.84:49438) 2024-09-21T03:34:26.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.713+0000 7f560511f640 1 -- 172.21.15.84:0/3823850861 learned_addr learned my addr 172.21.15.84:0/3823850861 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:26.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.713+0000 7f5605920640 1 --2- 172.21.15.84:0/3823850861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5600102080 0x7f560019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.713+0000 7f5606121640 1 --2- 172.21.15.84:0/3823850861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5600106c20 0x7f560019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.713+0000 7f560511f640 1 -- 172.21.15.84:0/3823850861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5600102080 msgr2=0x7f560019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:26.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.713+0000 7f560511f640 1 --2- 172.21.15.84:0/3823850861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5600102080 0x7f560019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.713+0000 7f560511f640 1 -- 172.21.15.84:0/3823850861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5600106c20 msgr2=0x7f560019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:26.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.713+0000 7f560511f640 1 --2- 172.21.15.84:0/3823850861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5600106c20 0x7f560019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.713+0000 7f560511f640 1 -- 172.21.15.84:0/3823850861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56001a0450 con 0x7f56001062d0 2024-09-21T03:34:26.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.714+0000 7f560511f640 1 --2- 172.21.15.84:0/3823850861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56001062d0 0x7f560019aa80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f55f400d750 tx=0x7f55f400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:26.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.714+0000 7f55f2ffd640 1 -- 172.21.15.84:0/3823850861 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4017070 con 0x7f56001062d0 2024-09-21T03:34:26.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.714+0000 7f55f2ffd640 1 -- 172.21.15.84:0/3823850861 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55f40054d0 con 0x7f56001062d0 2024-09-21T03:34:26.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.714+0000 7f5607b84640 1 -- 172.21.15.84:0/3823850861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56001a0740 con 0x7f56001062d0 2024-09-21T03:34:26.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.714+0000 7f55f2ffd640 1 -- 172.21.15.84:0/3823850861 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f4004c30 con 0x7f56001062d0 2024-09-21T03:34:26.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.714+0000 7f5607b84640 1 -- 172.21.15.84:0/3823850861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56001a6ea0 con 0x7f56001062d0 2024-09-21T03:34:26.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.715+0000 7f5607b84640 1 -- 172.21.15.84:0/3823850861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5600102490 con 0x7f56001062d0 2024-09-21T03:34:26.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.717+0000 7f55f2ffd640 1 -- 172.21.15.84:0/3823850861 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f55f4004dd0 con 0x7f56001062d0 2024-09-21T03:34:26.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.718+0000 7f55f2ffd640 1 --2- 172.21.15.84:0/3823850861 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f55ec0b64d0 0x7f55ec0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.718+0000 7f5605920640 1 --2- 172.21.15.84:0/3823850861 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f55ec0b64d0 0x7f55ec0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.718+0000 7f55f2ffd640 1 -- 172.21.15.84:0/3823850861 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f55f40e53b0 con 0x7f56001062d0 2024-09-21T03:34:26.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.718+0000 7f5605920640 1 --2- 172.21.15.84:0/3823850861 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f55ec0b64d0 0x7f55ec0b89e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f560006bb10 tx=0x7f55fc00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:26.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.721+0000 7f55f2ffd640 1 -- 172.21.15.84:0/3823850861 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f55f40b1c20 con 0x7f56001062d0 2024-09-21T03:34:26.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.898+0000 7f5607b84640 1 -- 172.21.15.84:0/3823850861 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f560019b610 con 0x7f56001062d0 2024-09-21T03:34:26.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.899+0000 7f55f2ffd640 1 -- 172.21.15.84:0/3823850861 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+22330 (secure 0 0 0) 0x7f560019b610 con 0x7f56001062d0 2024-09-21T03:34:26.901 INFO:teuthology.orchestra.run.smithi084.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T03:34:26.902 INFO:teuthology.orchestra.run.smithi084.stdout:global dev auth_debug true 2024-09-21T03:34:26.902 INFO:teuthology.orchestra.run.smithi084.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T03:34:26.902 INFO:teuthology.orchestra.run.smithi084.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T03:34:26.902 INFO:teuthology.orchestra.run.smithi084.stdout:global basic log_to_file true 2024-09-21T03:34:26.902 INFO:teuthology.orchestra.run.smithi084.stdout:global basic log_to_journald false 2024-09-21T03:34:26.902 INFO:teuthology.orchestra.run.smithi084.stdout:global basic log_to_stderr false 2024-09-21T03:34:26.902 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_allow_pool_delete true 2024-09-21T03:34:26.902 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T03:34:26.902 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T03:34:26.902 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T03:34:26.903 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T03:34:26.903 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T03:34:26.903 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T03:34:26.903 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T03:34:26.903 INFO:teuthology.orchestra.run.smithi084.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T03:34:26.903 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T03:34:26.903 INFO:teuthology.orchestra.run.smithi084.stdout:global dev ms_die_on_bug true 2024-09-21T03:34:26.903 INFO:teuthology.orchestra.run.smithi084.stdout:global dev ms_die_on_old_message true 2024-09-21T03:34:26.903 INFO:teuthology.orchestra.run.smithi084.stdout:global dev ms_die_on_skipped_message false 2024-09-21T03:34:26.903 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T03:34:26.903 INFO:teuthology.orchestra.run.smithi084.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T03:34:26.904 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T03:34:26.904 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T03:34:26.904 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T03:34:26.904 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced debug_mon 20/20 2024-09-21T03:34:26.904 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced debug_ms 1/1 2024-09-21T03:34:26.904 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced debug_paxos 20/20 2024-09-21T03:34:26.904 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T03:34:26.904 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T03:34:26.904 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T03:34:26.904 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T03:34:26.904 INFO:teuthology.orchestra.run.smithi084.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T03:34:26.904 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T03:34:26.905 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T03:34:26.905 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T03:34:26.905 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T03:34:26.905 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T03:34:26.905 INFO:teuthology.orchestra.run.smithi084.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T03:34:26.905 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T03:34:26.905 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced client_mount_timeout 30 2024-09-21T03:34:26.905 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced debug_cephsqlite 20/20 2024-09-21T03:34:26.905 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced debug_client 20/20 2024-09-21T03:34:26.905 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced debug_mgr 20/20 2024-09-21T03:34:26.906 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced debug_ms 1/1 2024-09-21T03:34:26.906 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T03:34:26.906 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T03:34:26.906 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T03:34:26.906 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T03:34:26.906 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T03:34:26.906 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/snap_schedule/allow_m_granularity true 2024-09-21T03:34:26.906 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/snap_schedule/dump_on_update true 2024-09-21T03:34:26.906 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mgr/snap_schedule/log_level debug 2024-09-21T03:34:26.906 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T03:34:26.906 INFO:teuthology.orchestra.run.smithi084.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T03:34:26.906 INFO:teuthology.orchestra.run.smithi084.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T03:34:26.906 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev bdev_debug_aio true 2024-09-21T03:34:26.907 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T03:34:26.907 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced bluestore_compression_mode aggressive 2024-09-21T03:34:26.907 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T03:34:26.907 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced debug_bluefs 20/20 2024-09-21T03:34:26.907 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced debug_bluestore 20/20 2024-09-21T03:34:26.907 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced debug_ms 1/1 2024-09-21T03:34:26.907 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced debug_osd 20/20 2024-09-21T03:34:26.907 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced debug_rocksdb 10/10 2024-09-21T03:34:26.907 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T03:34:26.907 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_op_order true 2024-09-21T03:34:26.907 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T03:34:26.907 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_shutdown true 2024-09-21T03:34:26.907 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T03:34:26.908 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T03:34:26.908 INFO:teuthology.orchestra.run.smithi084.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T03:34:26.908 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T03:34:26.908 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T03:34:26.908 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_max_omap_entries_per_request 10 2024-09-21T03:34:26.908 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T03:34:26.908 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T03:34:26.908 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T03:34:26.908 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T03:34:26.908 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T03:34:26.908 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T03:34:26.908 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T03:34:26.909 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T03:34:26.909 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T03:34:26.909 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T03:34:26.909 INFO:teuthology.orchestra.run.smithi084.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T03:34:26.909 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced debug_mds 20/20 2024-09-21T03:34:26.909 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T03:34:26.909 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced debug_ms 2/2 2024-09-21T03:34:26.909 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T03:34:26.909 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T03:34:26.909 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2024-09-21T03:34:26.909 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T03:34:26.909 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_bal_split_size 100 2024-09-21T03:34:26.909 INFO:teuthology.orchestra.run.smithi084.stdout:mds dev mds_debug_frag true 2024-09-21T03:34:26.910 INFO:teuthology.orchestra.run.smithi084.stdout:mds dev mds_debug_scatterstat true 2024-09-21T03:34:26.910 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_export_ephemeral_random_max 0.100000 2024-09-21T03:34:26.910 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T03:34:26.910 INFO:teuthology.orchestra.run.smithi084.stdout:mds dev mds_verify_scatter true 2024-09-21T03:34:26.910 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T03:34:26.910 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T03:34:26.910 INFO:teuthology.orchestra.run.smithi084.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T03:34:26.910 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced client_mount_timeout 600 2024-09-21T03:34:26.910 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced debug_client 20/20 2024-09-21T03:34:26.910 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced debug_ms 1/1 2024-09-21T03:34:26.910 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T03:34:26.910 INFO:teuthology.orchestra.run.smithi084.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T03:34:26.911 INFO:teuthology.orchestra.run.smithi084.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T03:34:26.911 INFO:teuthology.orchestra.run.smithi084.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T03:34:26.911 INFO:teuthology.orchestra.run.smithi084.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T03:34:26.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.902+0000 7f5607b84640 1 -- 172.21.15.84:0/3823850861 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f55ec0b64d0 msgr2=0x7f55ec0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:26.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.902+0000 7f5607b84640 1 --2- 172.21.15.84:0/3823850861 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f55ec0b64d0 0x7f55ec0b89e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f560006bb10 tx=0x7f55fc00b390 comp rx=0 tx=0).stop 2024-09-21T03:34:26.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.902+0000 7f5607b84640 1 -- 172.21.15.84:0/3823850861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56001062d0 msgr2=0x7f560019aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:26.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.902+0000 7f5607b84640 1 --2- 172.21.15.84:0/3823850861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56001062d0 0x7f560019aa80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f55f400d750 tx=0x7f55f400dc10 comp rx=0 tx=0).stop 2024-09-21T03:34:26.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.903+0000 7f5607b84640 1 -- 172.21.15.84:0/3823850861 shutdown_connections 2024-09-21T03:34:26.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.903+0000 7f5607b84640 1 --2- 172.21.15.84:0/3823850861 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f55ec0b64d0 0x7f55ec0b89e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.903+0000 7f5607b84640 1 --2- 172.21.15.84:0/3823850861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5600106c20 0x7f560019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.903+0000 7f5607b84640 1 --2- 172.21.15.84:0/3823850861 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56001062d0 0x7f560019aa80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.903+0000 7f5607b84640 1 --2- 172.21.15.84:0/3823850861 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5600102080 0x7f560019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.903+0000 7f5607b84640 1 -- 172.21.15.84:0/3823850861 >> 172.21.15.84:0/3823850861 conn(0x7f5600079f90 msgr2=0x7f5600107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:26.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.903+0000 7f5607b84640 1 -- 172.21.15.84:0/3823850861 shutdown_connections 2024-09-21T03:34:26.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:26.903+0000 7f5607b84640 1 -- 172.21.15.84:0/3823850861 wait complete. 2024-09-21T03:34:27.316 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:27 smithi084 ceph-mon[30941]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:27.316 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:27 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3823850861' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T03:34:27.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:27 smithi174 ceph-mon[34403]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:27.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:27 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3823850861' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T03:34:27.400 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:27 smithi172 ceph-mon[34821]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:27.400 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:27 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3823850861' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T03:34:27.529 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T03:34:27.530 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T03:34:27.530 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T03:34:27.545 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T03:34:27.545 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2024-09-21T03:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T03:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T03:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-21 03:33:03.162717781 +0000 2024-09-21T03:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-21 03:28:12.308537902 +0000 2024-09-21T03:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-21 03:28:12.308537902 +0000 2024-09-21T03:34:27.601 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-21 03:28:12.308537902 +0000 2024-09-21T03:34:27.602 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T03:34:27.665 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-21T03:34:27.665 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-21T03:34:27.665 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000213778 s, 2.4 MB/s 2024-09-21T03:34:27.666 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T03:34:27.722 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2024-09-21T03:34:27.778 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T03:34:27.778 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:34:27.778 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T03:34:27.778 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:34:27.778 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:34:27.778 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-21 03:33:03.194717220 +0000 2024-09-21T03:34:27.778 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-21 03:28:12.629532121 +0000 2024-09-21T03:34:27.778 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-21 03:28:12.629532121 +0000 2024-09-21T03:34:27.778 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-21 03:28:12.629532121 +0000 2024-09-21T03:34:27.779 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T03:34:27.840 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-21T03:34:27.840 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-21T03:34:27.840 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000186517 s, 2.7 MB/s 2024-09-21T03:34:27.842 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T03:34:27.897 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2024-09-21T03:34:27.952 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T03:34:27.952 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:34:27.952 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T03:34:27.953 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:34:27.953 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:34:27.953 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-21 03:33:03.226716658 +0000 2024-09-21T03:34:27.953 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-21 03:28:12.957526215 +0000 2024-09-21T03:34:27.953 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-21 03:28:12.957526215 +0000 2024-09-21T03:34:27.953 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-21 03:28:12.957526215 +0000 2024-09-21T03:34:27.953 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T03:34:28.015 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-21T03:34:28.015 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-21T03:34:28.016 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.00016931 s, 3.0 MB/s 2024-09-21T03:34:28.017 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T03:34:28.072 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2024-09-21T03:34:28.127 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T03:34:28.127 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:34:28.127 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T03:34:28.128 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:34:28.128 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:34:28.128 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-21 03:33:03.259716079 +0000 2024-09-21T03:34:28.128 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-21 03:28:13.271520560 +0000 2024-09-21T03:34:28.128 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-21 03:28:13.271520560 +0000 2024-09-21T03:34:28.128 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-21 03:28:13.271520560 +0000 2024-09-21T03:34:28.128 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T03:34:28.190 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-09-21T03:34:28.190 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-09-21T03:34:28.190 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000172085 s, 3.0 MB/s 2024-09-21T03:34:28.192 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T03:34:28.248 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-09-21T03:34:28.248 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T03:34:28.268 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T03:34:28.268 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-09-21T03:34:28.326 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T03:34:28.326 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:34:28.326 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T03:34:28.326 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:34:28.326 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:34:28.326 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-21 03:33:58.123085029 +0000 2024-09-21T03:34:28.326 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-21 03:28:31.234359528 +0000 2024-09-21T03:34:28.326 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-21 03:28:31.234359528 +0000 2024-09-21T03:34:28.326 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-21 03:28:31.234359528 +0000 2024-09-21T03:34:28.327 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T03:34:28.395 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-21T03:34:28.396 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-21T03:34:28.396 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000285184 s, 1.8 MB/s 2024-09-21T03:34:28.397 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T03:34:28.455 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-09-21T03:34:28.512 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T03:34:28.513 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:34:28.513 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-21T03:34:28.513 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:34:28.513 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:34:28.513 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-21 03:33:58.124085005 +0000 2024-09-21T03:34:28.513 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-21 03:28:31.562351402 +0000 2024-09-21T03:34:28.513 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-21 03:28:31.562351402 +0000 2024-09-21T03:34:28.513 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-21 03:28:31.562351402 +0000 2024-09-21T03:34:28.513 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T03:34:28.578 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-21T03:34:28.578 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-21T03:34:28.578 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000226631 s, 2.3 MB/s 2024-09-21T03:34:28.579 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T03:34:28.637 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-09-21T03:34:28.693 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T03:34:28.693 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:34:28.693 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-21T03:34:28.693 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:34:28.693 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:34:28.693 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-21 03:33:58.124085005 +0000 2024-09-21T03:34:28.693 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-21 03:28:31.883343449 +0000 2024-09-21T03:34:28.693 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-21 03:28:31.883343449 +0000 2024-09-21T03:34:28.693 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-21 03:28:31.883343449 +0000 2024-09-21T03:34:28.694 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T03:34:28.756 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-21T03:34:28.757 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-21T03:34:28.757 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000215626 s, 2.4 MB/s 2024-09-21T03:34:28.758 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T03:34:28.814 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-09-21T03:34:28.869 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T03:34:28.869 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:34:28.869 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T03:34:28.869 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:34:28.869 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:34:28.870 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-09-21 03:33:58.124085005 +0000 2024-09-21T03:34:28.870 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-09-21 03:28:32.224335000 +0000 2024-09-21T03:34:28.870 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-09-21 03:28:32.224335000 +0000 2024-09-21T03:34:28.870 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-09-21 03:28:32.224335000 +0000 2024-09-21T03:34:28.870 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T03:34:28.933 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-09-21T03:34:28.933 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-09-21T03:34:28.933 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000215901 s, 2.4 MB/s 2024-09-21T03:34:28.935 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T03:34:28.991 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-09-21T03:34:28.991 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T03:34:29.011 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T03:34:29.011 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_1 2024-09-21T03:34:29.068 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T03:34:29.069 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:34:29.069 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T03:34:29.069 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:34:29.069 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:34:29.069 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-09-21 03:33:55.961007079 +0000 2024-09-21T03:34:29.069 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-09-21 03:28:31.124771938 +0000 2024-09-21T03:34:29.069 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-09-21 03:28:31.124771938 +0000 2024-09-21T03:34:29.069 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-09-21 03:28:31.124771938 +0000 2024-09-21T03:34:29.069 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T03:34:29.138 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-09-21T03:34:29.139 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-09-21T03:34:29.139 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000267033 s, 1.9 MB/s 2024-09-21T03:34:29.140 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T03:34:29.199 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_2 2024-09-21T03:34:29.256 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T03:34:29.256 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:34:29.256 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T03:34:29.256 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:34:29.256 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:34:29.256 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-09-21 03:33:55.962007066 +0000 2024-09-21T03:34:29.256 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-09-21 03:28:31.447767540 +0000 2024-09-21T03:34:29.257 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-09-21 03:28:31.447767540 +0000 2024-09-21T03:34:29.257 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-09-21 03:28:31.447767540 +0000 2024-09-21T03:34:29.257 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T03:34:29.323 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-09-21T03:34:29.323 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-09-21T03:34:29.323 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000286856 s, 1.8 MB/s 2024-09-21T03:34:29.324 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T03:34:29.382 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_3 2024-09-21T03:34:29.439 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T03:34:29.439 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:34:29.439 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T03:34:29.439 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:34:29.439 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:34:29.440 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-09-21 03:33:55.962007066 +0000 2024-09-21T03:34:29.440 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-09-21 03:28:31.780763005 +0000 2024-09-21T03:34:29.440 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-09-21 03:28:31.780763005 +0000 2024-09-21T03:34:29.440 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-09-21 03:28:31.780763005 +0000 2024-09-21T03:34:29.440 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T03:34:29.502 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:29 smithi174 ceph-mon[34403]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:29.504 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-09-21T03:34:29.504 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-09-21T03:34:29.504 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000248492 s, 2.1 MB/s 2024-09-21T03:34:29.505 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T03:34:29.563 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_4 2024-09-21T03:34:29.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:29 smithi084 ceph-mon[30941]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:29.619 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T03:34:29.619 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:34:29.619 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T03:34:29.619 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:34:29.619 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:34:29.619 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-09-21 03:33:55.962007066 +0000 2024-09-21T03:34:29.619 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-09-21 03:28:32.090758783 +0000 2024-09-21T03:34:29.619 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-09-21 03:28:32.090758783 +0000 2024-09-21T03:34:29.619 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-09-21 03:28:32.090758783 +0000 2024-09-21T03:34:29.620 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T03:34:29.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:29 smithi172 ceph-mon[34821]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:29.684 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-09-21T03:34:29.684 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-09-21T03:34:29.684 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000240196 s, 2.1 MB/s 2024-09-21T03:34:29.685 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T03:34:29.742 INFO:tasks.cephadm:Deploying osd.0 on smithi084 with /dev/vg_nvme/lv_4... 2024-09-21T03:34:29.742 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T03:34:29.992 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:31.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:31 smithi084 ceph-mon[30941]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:31.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:31 smithi174 ceph-mon[34403]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:31.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:31 smithi172 ceph-mon[34821]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:32.230 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:34:32.260 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi084:vg_nvme/lv_4 2024-09-21T03:34:32.507 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:32.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.927+0000 7f85936d0640 1 -- 172.21.15.84:0/2857203958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f858c102a60 msgr2=0x7f858c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:32.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.927+0000 7f85936d0640 1 --2- 172.21.15.84:0/2857203958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f858c102a60 0x7f858c102e70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8580009900 tx=0x7f858002a410 comp rx=0 tx=0).stop 2024-09-21T03:34:32.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.927+0000 7f85936d0640 1 -- 172.21.15.84:0/2857203958 shutdown_connections 2024-09-21T03:34:32.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.927+0000 7f85936d0640 1 --2- 172.21.15.84:0/2857203958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f858c108cf0 0x7f858c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:32.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.927+0000 7f85936d0640 1 --2- 172.21.15.84:0/2857203958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f858c1083a0 0x7f858c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:32.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.927+0000 7f85936d0640 1 --2- 172.21.15.84:0/2857203958 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f858c102a60 0x7f858c102e70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:32.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.927+0000 7f85936d0640 1 -- 172.21.15.84:0/2857203958 >> 172.21.15.84:0/2857203958 conn(0x7f858c079730 msgr2=0x7f858c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:32.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.927+0000 7f85936d0640 1 -- 172.21.15.84:0/2857203958 shutdown_connections 2024-09-21T03:34:32.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.927+0000 7f85936d0640 1 -- 172.21.15.84:0/2857203958 wait complete. 2024-09-21T03:34:32.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.928+0000 7f85936d0640 1 Processor -- start 2024-09-21T03:34:32.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.928+0000 7f85936d0640 1 -- start start 2024-09-21T03:34:32.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.928+0000 7f85936d0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f858c102a60 0x7f858c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:32.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.928+0000 7f85936d0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f858c1083a0 0x7f858c199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:32.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.928+0000 7f85936d0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f858c108cf0 0x7f858c19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:32.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.928+0000 7f85936d0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f858c112960 con 0x7f858c1083a0 2024-09-21T03:34:32.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.928+0000 7f85936d0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f858c1127e0 con 0x7f858c108cf0 2024-09-21T03:34:32.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.928+0000 7f85936d0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f858c112ae0 con 0x7f858c102a60 2024-09-21T03:34:32.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.928+0000 7f8590c6b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f858c1083a0 0x7f858c199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:32.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.928+0000 7f8590c6b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f858c1083a0 0x7f858c199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50006/0 (socket says 172.21.15.84:50006) 2024-09-21T03:34:32.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.928+0000 7f8590c6b640 1 -- 172.21.15.84:0/3710598890 learned_addr learned my addr 172.21.15.84:0/3710598890 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:34:32.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.929+0000 7f8591c6d640 1 --2- 172.21.15.84:0/3710598890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f858c108cf0 0x7f858c19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:32.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.929+0000 7f859146c640 1 --2- 172.21.15.84:0/3710598890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f858c102a60 0x7f858c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:32.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.929+0000 7f8590c6b640 1 -- 172.21.15.84:0/3710598890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f858c102a60 msgr2=0x7f858c199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:32.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.929+0000 7f8590c6b640 1 --2- 172.21.15.84:0/3710598890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f858c102a60 0x7f858c199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:32.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.929+0000 7f8590c6b640 1 -- 172.21.15.84:0/3710598890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f858c108cf0 msgr2=0x7f858c19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:32.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.929+0000 7f8590c6b640 1 --2- 172.21.15.84:0/3710598890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f858c108cf0 0x7f858c19ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:32.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.929+0000 7f8590c6b640 1 -- 172.21.15.84:0/3710598890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858c19f2e0 con 0x7f858c1083a0 2024-09-21T03:34:32.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.929+0000 7f8590c6b640 1 --2- 172.21.15.84:0/3710598890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f858c1083a0 0x7f858c199910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f858800d770 tx=0x7f858800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:32.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.929+0000 7f857e7fc640 1 -- 172.21.15.84:0/3710598890 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8588017070 con 0x7f858c1083a0 2024-09-21T03:34:32.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.929+0000 7f85936d0640 1 -- 172.21.15.84:0/3710598890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f858c19f5d0 con 0x7f858c1083a0 2024-09-21T03:34:32.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.929+0000 7f857e7fc640 1 -- 172.21.15.84:0/3710598890 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8588009c30 con 0x7f858c1083a0 2024-09-21T03:34:32.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.929+0000 7f857e7fc640 1 -- 172.21.15.84:0/3710598890 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858800f620 con 0x7f858c1083a0 2024-09-21T03:34:32.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.929+0000 7f85936d0640 1 -- 172.21.15.84:0/3710598890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f858c1a5d30 con 0x7f858c1083a0 2024-09-21T03:34:32.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.930+0000 7f85936d0640 1 -- 172.21.15.84:0/3710598890 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f858c102e70 con 0x7f858c1083a0 2024-09-21T03:34:32.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.932+0000 7f857e7fc640 1 -- 172.21.15.84:0/3710598890 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f858801a070 con 0x7f858c1083a0 2024-09-21T03:34:32.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.933+0000 7f857e7fc640 1 --2- 172.21.15.84:0/3710598890 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f85780b6550 0x7f85780b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:32.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.933+0000 7f859146c640 1 --2- 172.21.15.84:0/3710598890 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f85780b6550 0x7f85780b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:32.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.933+0000 7f857e7fc640 1 -- 172.21.15.84:0/3710598890 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f85880e5230 con 0x7f858c1083a0 2024-09-21T03:34:32.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.933+0000 7f859146c640 1 --2- 172.21.15.84:0/3710598890 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f85780b6550 0x7f85780b8a60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8580031440 tx=0x7f8580009560 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:32.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:32.936+0000 7f857e7fc640 1 -- 172.21.15.84:0/3710598890 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8588009de0 con 0x7f858c1083a0 2024-09-21T03:34:33.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:33.122+0000 7f85936d0640 1 -- 172.21.15.84:0/3710598890 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f858c063800 con 0x7f85780b6550 2024-09-21T03:34:33.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:33 smithi084 ceph-mon[30941]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:33.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:33 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:34:33.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:33 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:34:33.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:33 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:33.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:33 smithi174 ceph-mon[34403]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:33.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:33 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:34:33.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:33 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:34:33.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:33 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:33.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:33 smithi172 ceph-mon[34821]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:33.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:33 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:34:33.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:33 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:34:33.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:33 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:34.516 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:34 smithi084 ceph-mon[30941]: from='client.14451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:34.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:34 smithi174 ceph-mon[34403]: from='client.14451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:34.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:34 smithi172 ceph-mon[34821]: from='client.14451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:34:35.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:35 smithi084 ceph-mon[30941]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:35.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:35 smithi174 ceph-mon[34403]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:35.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:35 smithi172 ceph-mon[34821]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:36.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:36 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2683442547' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9d283ba0-18f3-4668-90c4-884e9e957a88"} : dispatch 2024-09-21T03:34:36.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:36 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2683442547' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d283ba0-18f3-4668-90c4-884e9e957a88"}]': finished 2024-09-21T03:34:36.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:36 smithi084 ceph-mon[30941]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T03:34:36.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:36 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:34:36.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:36 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1546814714' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:34:36.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:36 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2683442547' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9d283ba0-18f3-4668-90c4-884e9e957a88"} : dispatch 2024-09-21T03:34:36.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:36 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2683442547' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d283ba0-18f3-4668-90c4-884e9e957a88"}]': finished 2024-09-21T03:34:36.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:36 smithi174 ceph-mon[34403]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T03:34:36.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:36 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:34:36.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:36 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1546814714' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:34:36.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:36 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2683442547' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9d283ba0-18f3-4668-90c4-884e9e957a88"} : dispatch 2024-09-21T03:34:36.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:36 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2683442547' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d283ba0-18f3-4668-90c4-884e9e957a88"}]': finished 2024-09-21T03:34:36.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:36 smithi172 ceph-mon[34821]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T03:34:36.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:36 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:34:36.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:36 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1546814714' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:34:37.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:37 smithi084 ceph-mon[30941]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:37.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:37 smithi174 ceph-mon[34403]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:37.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:37 smithi172 ceph-mon[34821]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:39.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:39 smithi084 ceph-mon[30941]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:39.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:39 smithi174 ceph-mon[34403]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:39.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:39 smithi172 ceph-mon[34821]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:41.535 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:41 smithi084 ceph-mon[30941]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:41.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:41 smithi174 ceph-mon[34403]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:41.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:41 smithi172 ceph-mon[34821]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:43.334 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:43 smithi084 ceph-mon[30941]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:43.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:43 smithi174 ceph-mon[34403]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:43.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:43 smithi172 ceph-mon[34821]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:44.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:44 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T03:34:44.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:44 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:44.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:44 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T03:34:44.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:44 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:44.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:44 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T03:34:44.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:44 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:45.511 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:45 smithi084 ceph-mon[30941]: Deploying daemon osd.0 on smithi084 2024-09-21T03:34:45.511 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:45 smithi084 ceph-mon[30941]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:45 smithi174 ceph-mon[34403]: Deploying daemon osd.0 on smithi084 2024-09-21T03:34:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:45 smithi174 ceph-mon[34403]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:45.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:45 smithi172 ceph-mon[34821]: Deploying daemon osd.0 on smithi084 2024-09-21T03:34:45.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:45 smithi172 ceph-mon[34821]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:47.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:47 smithi084 ceph-mon[30941]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:47.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:47 smithi174 ceph-mon[34403]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:47.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:47 smithi172 ceph-mon[34821]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:49.542 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:49 smithi084 ceph-mon[30941]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:49.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:49 smithi174 ceph-mon[34403]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:49.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:49 smithi172 ceph-mon[34821]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:50.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:50 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:50.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:50 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:50.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:50 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:50.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:50 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:50.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:50 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:50.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:50 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:50.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:50 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:50.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:50 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:50.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:50 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:51.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:51 smithi084 ceph-mon[30941]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:51 smithi174 ceph-mon[34403]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:51.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:51 smithi172 ceph-mon[34821]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:52.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:52 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:52.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:52 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:52.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:52 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:52.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:52 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:52.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:52 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:52.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:52 smithi174 ceph-mon[34403]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:52.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:52 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:52.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:52 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:52.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:52 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:52.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:52 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:52.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:52 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:52.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:52 smithi172 ceph-mon[34821]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:53.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:52 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:53.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:52 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:53.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:52 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:53.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:52 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:53.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:52 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:53.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:52 smithi084 ceph-mon[30941]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:54.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:54.107+0000 7f857e7fc640 1 -- 172.21.15.84:0/3710598890 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f858c063800 con 0x7f85780b6550 2024-09-21T03:34:54.109 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 0 on host 'smithi084' 2024-09-21T03:34:54.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:54.109+0000 7f85936d0640 1 -- 172.21.15.84:0/3710598890 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f85780b6550 msgr2=0x7f85780b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:54.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:54.109+0000 7f85936d0640 1 --2- 172.21.15.84:0/3710598890 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f85780b6550 0x7f85780b8a60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8580031440 tx=0x7f8580009560 comp rx=0 tx=0).stop 2024-09-21T03:34:54.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:54.109+0000 7f85936d0640 1 -- 172.21.15.84:0/3710598890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f858c1083a0 msgr2=0x7f858c199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:54.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:54.109+0000 7f85936d0640 1 --2- 172.21.15.84:0/3710598890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f858c1083a0 0x7f858c199910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f858800d770 tx=0x7f858800dc30 comp rx=0 tx=0).stop 2024-09-21T03:34:54.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:54.109+0000 7f85936d0640 1 -- 172.21.15.84:0/3710598890 shutdown_connections 2024-09-21T03:34:54.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:54.109+0000 7f85936d0640 1 --2- 172.21.15.84:0/3710598890 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f85780b6550 0x7f85780b8a60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:54.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:54.109+0000 7f85936d0640 1 --2- 172.21.15.84:0/3710598890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f858c108cf0 0x7f858c19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:54.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:54.109+0000 7f85936d0640 1 --2- 172.21.15.84:0/3710598890 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f858c1083a0 0x7f858c199910 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:54.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:54.109+0000 7f85936d0640 1 --2- 172.21.15.84:0/3710598890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f858c102a60 0x7f858c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:54.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:54.109+0000 7f85936d0640 1 -- 172.21.15.84:0/3710598890 >> 172.21.15.84:0/3710598890 conn(0x7f858c079730 msgr2=0x7f858c101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:54.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:54.109+0000 7f85936d0640 1 -- 172.21.15.84:0/3710598890 shutdown_connections 2024-09-21T03:34:54.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:34:54.109+0000 7f85936d0640 1 -- 172.21.15.84:0/3710598890 wait complete. 2024-09-21T03:34:54.404 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:54 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:54.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:54 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:54.405 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:54 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:54.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:54 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:54.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:54 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:54.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:54 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:54.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:54 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:54.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:54 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:54.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:54 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:54.837 DEBUG:teuthology.orchestra.run.smithi084:osd.0> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T03:34:54.839 INFO:tasks.cephadm:Deploying osd.1 on smithi172 with /dev/vg_nvme/lv_4... 2024-09-21T03:34:54.839 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T03:34:55.078 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:34:55.442 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:55 smithi172 ceph-mon[34821]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:55.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:55 smithi084 ceph-mon[30941]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:55.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:55 smithi174 ceph-mon[34403]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:56.569 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:34:56 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-0[48037]: 2024-09-21T03:34:56.381+0000 7fdd3cbbf640 -1 osd.0 0 log_to_monitors true 2024-09-21T03:34:57.430 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T03:34:57.458 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi172:vg_nvme/lv_4 2024-09-21T03:34:57.483 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:57 smithi172 ceph-mon[34821]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:57.483 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:57 smithi172 ceph-mon[34821]: from='osd.0 [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T03:34:57.528 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:57 smithi084 ceph-mon[30941]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:57.528 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:57 smithi084 ceph-mon[30941]: from='osd.0 [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T03:34:57.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:57 smithi174 ceph-mon[34403]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:57.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:57 smithi174 ceph-mon[34403]: from='osd.0 [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T03:34:57.720 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:34:58.179 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.175+0000 7f7d0dc42640 1 -- 172.21.15.172:0/2849413504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d081083e0 msgr2=0x7f7d081087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:58.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.175+0000 7f7d0dc42640 1 --2- 172.21.15.172:0/2849413504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d081083e0 0x7f7d081087f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009900 tx=0x7f7cf002a410 comp rx=0 tx=0).stop 2024-09-21T03:34:58.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.175+0000 7f7d0dc42640 1 -- 172.21.15.172:0/2849413504 shutdown_connections 2024-09-21T03:34:58.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.175+0000 7f7d0dc42640 1 --2- 172.21.15.172:0/2849413504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d08108d30 0x7f7d0810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:58.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.175+0000 7f7d0dc42640 1 --2- 172.21.15.172:0/2849413504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d081083e0 0x7f7d081087f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:58.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.175+0000 7f7d0dc42640 1 --2- 172.21.15.172:0/2849413504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d08102aa0 0x7f7d08102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:58.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.175+0000 7f7d0dc42640 1 -- 172.21.15.172:0/2849413504 >> 172.21.15.172:0/2849413504 conn(0x7f7d080797e0 msgr2=0x7f7d08079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:58.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.175+0000 7f7d0dc42640 1 -- 172.21.15.172:0/2849413504 shutdown_connections 2024-09-21T03:34:58.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.175+0000 7f7d0dc42640 1 -- 172.21.15.172:0/2849413504 wait complete. 2024-09-21T03:34:58.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.176+0000 7f7d0dc42640 1 Processor -- start 2024-09-21T03:34:58.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.176+0000 7f7d0dc42640 1 -- start start 2024-09-21T03:34:58.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.176+0000 7f7d0dc42640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d08102aa0 0x7f7d0819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:58.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.176+0000 7f7d0dc42640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d081083e0 0x7f7d0819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:58.180 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.176+0000 7f7d0dc42640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d08108d30 0x7f7d0819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:58.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.176+0000 7f7d0dc42640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7d08113ac0 con 0x7f7d081083e0 2024-09-21T03:34:58.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.176+0000 7f7d0dc42640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7d08113940 con 0x7f7d08108d30 2024-09-21T03:34:58.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.176+0000 7f7d0dc42640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7d08113c40 con 0x7f7d08102aa0 2024-09-21T03:34:58.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.176+0000 7f7d077fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d08102aa0 0x7f7d0819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:58.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.176+0000 7f7d07fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d08108d30 0x7f7d0819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:58.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.176+0000 7f7d07fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d08108d30 0x7f7d0819fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53934/0 (socket says 172.21.15.172:53934) 2024-09-21T03:34:58.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.176+0000 7f7d077fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d08102aa0 0x7f7d0819a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.172:58328/0 (socket says 172.21.15.172:58328) 2024-09-21T03:34:58.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.176+0000 7f7d07fff640 1 -- 172.21.15.172:0/1528913915 learned_addr learned my addr 172.21.15.172:0/1528913915 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-21T03:34:58.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.177+0000 7f7d06ffd640 1 --2- 172.21.15.172:0/1528913915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d081083e0 0x7f7d0819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:58.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.177+0000 7f7d07fff640 1 -- 172.21.15.172:0/1528913915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d08102aa0 msgr2=0x7f7d0819a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:58.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.177+0000 7f7d07fff640 1 --2- 172.21.15.172:0/1528913915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d08102aa0 0x7f7d0819a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:58.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.177+0000 7f7d07fff640 1 -- 172.21.15.172:0/1528913915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d081083e0 msgr2=0x7f7d0819aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:58.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.177+0000 7f7d07fff640 1 --2- 172.21.15.172:0/1528913915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d081083e0 0x7f7d0819aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:58.181 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.177+0000 7f7d07fff640 1 -- 172.21.15.172:0/1528913915 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d081a03a0 con 0x7f7d08108d30 2024-09-21T03:34:58.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.177+0000 7f7d06ffd640 1 --2- 172.21.15.172:0/1528913915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d081083e0 0x7f7d0819aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:34:58.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.177+0000 7f7d07fff640 1 --2- 172.21.15.172:0/1528913915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d08108d30 0x7f7d0819fd30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800d750 tx=0x7f7cf800dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:58.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.177+0000 7f7d04ff9640 1 -- 172.21.15.172:0/1528913915 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8017070 con 0x7f7d08108d30 2024-09-21T03:34:58.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.177+0000 7f7d04ff9640 1 -- 172.21.15.172:0/1528913915 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cf80054d0 con 0x7f7d08108d30 2024-09-21T03:34:58.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.177+0000 7f7d04ff9640 1 -- 172.21.15.172:0/1528913915 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8004c60 con 0x7f7d08108d30 2024-09-21T03:34:58.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.177+0000 7f7d0dc42640 1 -- 172.21.15.172:0/1528913915 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d081a0690 con 0x7f7d08108d30 2024-09-21T03:34:58.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.177+0000 7f7d0dc42640 1 -- 172.21.15.172:0/1528913915 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d081a6eb0 con 0x7f7d08108d30 2024-09-21T03:34:58.182 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.179+0000 7f7d0dc42640 1 -- 172.21.15.172:0/1528913915 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d08103d20 con 0x7f7d08108d30 2024-09-21T03:34:58.183 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.181+0000 7f7d04ff9640 1 -- 172.21.15.172:0/1528913915 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f7cf8009bd0 con 0x7f7d08108d30 2024-09-21T03:34:58.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.182+0000 7f7d04ff9640 1 --2- 172.21.15.172:0/1528913915 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7cf40b6580 0x7f7cf40b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:58.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.182+0000 7f7d04ff9640 1 -- 172.21.15.172:0/1528913915 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1576+0+0 (secure 0 0 0) 0x7f7cf80e53c0 con 0x7f7d08108d30 2024-09-21T03:34:58.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.182+0000 7f7d077fe640 1 --2- 172.21.15.172:0/1528913915 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7cf40b6580 0x7f7cf40b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:58.184 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.183+0000 7f7d077fe640 1 --2- 172.21.15.172:0/1528913915 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7cf40b6580 0x7f7cf40b8a90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7d00007ec0 tx=0x7f7d000075b0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:58.186 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.184+0000 7f7d04ff9640 1 -- 172.21.15.172:0/1528913915 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7cf80b1be0 con 0x7f7d08108d30 2024-09-21T03:34:58.381 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:34:58.379+0000 7f7d0dc42640 1 -- 172.21.15.172:0/1528913915 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7d08063800 con 0x7f7cf40b6580 2024-09-21T03:34:58.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:58 smithi172 ceph-mon[34821]: from='osd.0 [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T03:34:58.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:58 smithi172 ceph-mon[34821]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T03:34:58.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:58 smithi172 ceph-mon[34821]: from='osd.0 [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T03:34:58.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:58 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:34:58.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:58 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:58.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:58 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:58.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:58 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:34:58.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:58 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:58.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:58 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:58.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:58 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:58.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:58 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:58.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:58 smithi172 ceph-mon[34821]: from='osd.0 [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T03:34:58.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:58 smithi084 ceph-mon[30941]: from='osd.0 [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T03:34:58.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:58 smithi084 ceph-mon[30941]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T03:34:58.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:58 smithi084 ceph-mon[30941]: from='osd.0 [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T03:34:58.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:58 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:34:58.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:58 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:58.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:58 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:58.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:58 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:34:58.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:58 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:58.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:58 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:58.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:58 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:58.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:58 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:58.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:58 smithi084 ceph-mon[30941]: from='osd.0 [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T03:34:58.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:58 smithi174 ceph-mon[34403]: from='osd.0 [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T03:34:58.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:58 smithi174 ceph-mon[34403]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T03:34:58.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:58 smithi174 ceph-mon[34403]: from='osd.0 [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T03:34:58.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:58 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:34:58.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:58 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:58.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:58 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:58.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:58 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:34:58.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:58 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:58.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:58 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:58.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:58 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:58.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:58 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:34:58.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:58 smithi174 ceph-mon[34403]: from='osd.0 [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T03:34:59.068 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:34:58 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-0[48037]: 2024-09-21T03:34:58.688+0000 7fdd38b41640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T03:34:59.068 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:34:58 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-0[48037]: 2024-09-21T03:34:58.692+0000 7fdd30937640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:34:59.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:59 smithi172 ceph-mon[34821]: Detected new or changed devices on smithi084 2024-09-21T03:34:59.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:59 smithi172 ceph-mon[34821]: Adjusting osd_memory_target on smithi084 to 17088M 2024-09-21T03:34:59.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:59 smithi172 ceph-mon[34821]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:59.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:59 smithi172 ceph-mon[34821]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T03:34:59.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:59 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:34:59.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:59 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:34:59.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:59 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:34:59.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:59 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:34:59.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:59 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:59.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:34:59 smithi172 ceph-mon[34821]: from='osd.0 [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562]' entity='osd.0' 2024-09-21T03:34:59.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:59 smithi084 ceph-mon[30941]: Detected new or changed devices on smithi084 2024-09-21T03:34:59.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:59 smithi084 ceph-mon[30941]: Adjusting osd_memory_target on smithi084 to 17088M 2024-09-21T03:34:59.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:59 smithi084 ceph-mon[30941]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:59.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:59 smithi084 ceph-mon[30941]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T03:34:59.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:59 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:34:59.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:59 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:34:59.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:59 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:34:59.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:59 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:34:59.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:59 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:59.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:34:59 smithi084 ceph-mon[30941]: from='osd.0 [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562]' entity='osd.0' 2024-09-21T03:34:59.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:59 smithi174 ceph-mon[34403]: Detected new or changed devices on smithi084 2024-09-21T03:34:59.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:59 smithi174 ceph-mon[34403]: Adjusting osd_memory_target on smithi084 to 17088M 2024-09-21T03:34:59.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:59 smithi174 ceph-mon[34403]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:34:59.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:59 smithi174 ceph-mon[34403]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T03:34:59.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:59 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:34:59.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:59 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:34:59.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:59 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:34:59.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:59 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:34:59.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:59 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:59.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:34:59 smithi174 ceph-mon[34403]: from='osd.0 [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562]' entity='osd.0' 2024-09-21T03:35:00.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:00 smithi084 ceph-mon[30941]: purged_snaps scrub starts 2024-09-21T03:35:00.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:00 smithi084 ceph-mon[30941]: purged_snaps scrub ok 2024-09-21T03:35:00.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:00 smithi084 ceph-mon[30941]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:00.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:00 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:35:00.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:00 smithi084 ceph-mon[30941]: osd.0 [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562] boot 2024-09-21T03:35:00.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:00 smithi084 ceph-mon[30941]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T03:35:00.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:00 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:35:00.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:00 smithi174 ceph-mon[34403]: purged_snaps scrub starts 2024-09-21T03:35:00.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:00 smithi174 ceph-mon[34403]: purged_snaps scrub ok 2024-09-21T03:35:00.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:00 smithi174 ceph-mon[34403]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:00.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:00 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:35:00.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:00 smithi174 ceph-mon[34403]: osd.0 [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562] boot 2024-09-21T03:35:00.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:00 smithi174 ceph-mon[34403]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T03:35:00.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:00 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:35:00.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:00 smithi172 ceph-mon[34821]: purged_snaps scrub starts 2024-09-21T03:35:00.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:00 smithi172 ceph-mon[34821]: purged_snaps scrub ok 2024-09-21T03:35:00.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:00 smithi172 ceph-mon[34821]: from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:00.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:00 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:35:00.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:00 smithi172 ceph-mon[34821]: osd.0 [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562] boot 2024-09-21T03:35:00.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:00 smithi172 ceph-mon[34821]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T03:35:00.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:00 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:35:01.529 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:01 smithi174 ceph-mon[34403]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:35:01.530 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:01 smithi174 ceph-mon[34403]: from='client.? 172.21.15.172:0/3497335671' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f115c5b6-812d-430f-9f0e-cb5311b7581e"} : dispatch 2024-09-21T03:35:01.530 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:01 smithi174 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f115c5b6-812d-430f-9f0e-cb5311b7581e"} : dispatch 2024-09-21T03:35:01.530 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:01 smithi174 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f115c5b6-812d-430f-9f0e-cb5311b7581e"}]': finished 2024-09-21T03:35:01.530 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:01 smithi174 ceph-mon[34403]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T03:35:01.530 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:01 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:35:01.530 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:01 smithi174 ceph-mon[34403]: from='client.? 172.21.15.172:0/4278415097' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:35:01.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:01 smithi084 ceph-mon[30941]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:35:01.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:01 smithi084 ceph-mon[30941]: from='client.? 172.21.15.172:0/3497335671' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f115c5b6-812d-430f-9f0e-cb5311b7581e"} : dispatch 2024-09-21T03:35:01.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:01 smithi084 ceph-mon[30941]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f115c5b6-812d-430f-9f0e-cb5311b7581e"} : dispatch 2024-09-21T03:35:01.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:01 smithi084 ceph-mon[30941]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f115c5b6-812d-430f-9f0e-cb5311b7581e"}]': finished 2024-09-21T03:35:01.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:01 smithi084 ceph-mon[30941]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T03:35:01.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:01 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:35:01.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:01 smithi084 ceph-mon[30941]: from='client.? 172.21.15.172:0/4278415097' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:35:01.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:01 smithi172 ceph-mon[34821]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:35:01.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:01 smithi172 ceph-mon[34821]: from='client.? 172.21.15.172:0/3497335671' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f115c5b6-812d-430f-9f0e-cb5311b7581e"} : dispatch 2024-09-21T03:35:01.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:01 smithi172 ceph-mon[34821]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f115c5b6-812d-430f-9f0e-cb5311b7581e"} : dispatch 2024-09-21T03:35:01.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:01 smithi172 ceph-mon[34821]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f115c5b6-812d-430f-9f0e-cb5311b7581e"}]': finished 2024-09-21T03:35:01.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:01 smithi172 ceph-mon[34821]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T03:35:01.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:01 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:35:01.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:01 smithi172 ceph-mon[34821]: from='client.? 172.21.15.172:0/4278415097' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:35:03.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:03 smithi084 ceph-mon[30941]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:03.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:03 smithi174 ceph-mon[34403]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:03.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:03 smithi172 ceph-mon[34821]: pgmap v34: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:05.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:05 smithi084 ceph-mon[30941]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:05.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:05 smithi174 ceph-mon[34403]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:05.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:05 smithi172 ceph-mon[34821]: pgmap v35: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:07.400 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:07 smithi172 ceph-mon[34821]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:07.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:07 smithi084 ceph-mon[30941]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:07.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:07 smithi174 ceph-mon[34403]: pgmap v36: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:09.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:09 smithi084 ceph-mon[30941]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:09.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:09 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T03:35:09.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:09 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:09.578 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:09 smithi172 ceph-mon[34821]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:09.578 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:09 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T03:35:09.578 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:09 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:09.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:09 smithi174 ceph-mon[34403]: pgmap v37: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:09.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:09 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T03:35:09.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:09 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:10.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:10 smithi084 ceph-mon[30941]: Deploying daemon osd.1 on smithi172 2024-09-21T03:35:10.600 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:10 smithi172 ceph-mon[34821]: Deploying daemon osd.1 on smithi172 2024-09-21T03:35:10.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:10 smithi174 ceph-mon[34403]: Deploying daemon osd.1 on smithi172 2024-09-21T03:35:11.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:11 smithi084 ceph-mon[30941]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:11.580 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:11 smithi172 ceph-mon[34821]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:11.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:11 smithi174 ceph-mon[34403]: pgmap v38: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:13.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:13 smithi084 ceph-mon[30941]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:13.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:13 smithi174 ceph-mon[34403]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:13.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:13 smithi172 ceph-mon[34821]: pgmap v39: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:15.393 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:15 smithi172 ceph-mon[34821]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:15.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:15 smithi084 ceph-mon[30941]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:15.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:15 smithi174 ceph-mon[34403]: pgmap v40: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:16.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:16 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:35:16.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:16 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:16.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:16 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:16.593 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:16 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:35:16.593 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:16 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:16.593 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:16 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:16.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:16 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:35:16.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:16 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:16.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:16 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:17.358 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:17 smithi172 ceph-mon[34821]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:17.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:17 smithi084 ceph-mon[30941]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:17.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:17 smithi174 ceph-mon[34403]: pgmap v41: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:19.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:19 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:19.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:19 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:19.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:19 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:19.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:19 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:35:19.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:19 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:19.216 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:19 smithi172 ceph-mon[34821]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:19.257 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:35:19.255+0000 7f7d04ff9640 1 -- 172.21.15.172:0/1528913915 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7d08063800 con 0x7f7cf40b6580 2024-09-21T03:35:19.257 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 1 on host 'smithi172' 2024-09-21T03:35:19.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:35:19.258+0000 7f7d0dc42640 1 -- 172.21.15.172:0/1528913915 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7cf40b6580 msgr2=0x7f7cf40b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:19.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:35:19.258+0000 7f7d0dc42640 1 --2- 172.21.15.172:0/1528913915 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7cf40b6580 0x7f7cf40b8a90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7d00007ec0 tx=0x7f7d000075b0 comp rx=0 tx=0).stop 2024-09-21T03:35:19.259 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:35:19.258+0000 7f7d0dc42640 1 -- 172.21.15.172:0/1528913915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d08108d30 msgr2=0x7f7d0819fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:19.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:35:19.258+0000 7f7d0dc42640 1 --2- 172.21.15.172:0/1528913915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d08108d30 0x7f7d0819fd30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800d750 tx=0x7f7cf800dc10 comp rx=0 tx=0).stop 2024-09-21T03:35:19.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:35:19.258+0000 7f7d0dc42640 1 -- 172.21.15.172:0/1528913915 shutdown_connections 2024-09-21T03:35:19.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:35:19.258+0000 7f7d0dc42640 1 --2- 172.21.15.172:0/1528913915 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7cf40b6580 0x7f7cf40b8a90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:19.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:35:19.258+0000 7f7d0dc42640 1 --2- 172.21.15.172:0/1528913915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d08108d30 0x7f7d0819fd30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:19.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:35:19.258+0000 7f7d0dc42640 1 --2- 172.21.15.172:0/1528913915 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7d081083e0 0x7f7d0819aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:19.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:35:19.258+0000 7f7d0dc42640 1 --2- 172.21.15.172:0/1528913915 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7d08102aa0 0x7f7d0819a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:19.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:35:19.258+0000 7f7d0dc42640 1 -- 172.21.15.172:0/1528913915 >> 172.21.15.172:0/1528913915 conn(0x7f7d080797e0 msgr2=0x7f7d08105340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:19.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:35:19.258+0000 7f7d0dc42640 1 -- 172.21.15.172:0/1528913915 shutdown_connections 2024-09-21T03:35:19.260 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:35:19.258+0000 7f7d0dc42640 1 -- 172.21.15.172:0/1528913915 wait complete. 2024-09-21T03:35:19.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:19 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:19.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:19 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:19.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:19 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:19.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:19 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:35:19.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:19 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:19.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:19 smithi084 ceph-mon[30941]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:19.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:19 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:19.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:19 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:19.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:19 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:19.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:19 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:35:19.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:19 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:19.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:19 smithi174 ceph-mon[34403]: pgmap v42: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:19.914 DEBUG:teuthology.orchestra.run.smithi172:osd.1> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T03:35:19.957 INFO:tasks.cephadm:Deploying osd.2 on smithi174 with /dev/vg_nvme/lv_4... 2024-09-21T03:35:19.957 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T03:35:20.206 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:35:20.311 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:20 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:35:20.312 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:20 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:20.312 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:20 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:20.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:20 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:35:20.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:20 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:20.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:20 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:20.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:20 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:35:20.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:20 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:20.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:20 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:21.279 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:21 smithi172 ceph-mon[34821]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:21.421 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:21 smithi174 ceph-mon[34403]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:21.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:21 smithi084 ceph-mon[30941]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:22.151 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:35:21 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-1[39557]: 2024-09-21T03:35:21.850+0000 7f6779796640 -1 osd.1 0 log_to_monitors true 2024-09-21T03:35:22.343 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:22 smithi174 ceph-mon[34403]: from='osd.1 [v2:172.21.15.172:6800/2931872350,v1:172.21.15.172:6801/2931872350]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:35:22.343 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:22 smithi174 ceph-mon[34403]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:35:22.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:22 smithi084 ceph-mon[30941]: from='osd.1 [v2:172.21.15.172:6800/2931872350,v1:172.21.15.172:6801/2931872350]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:35:22.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:22 smithi084 ceph-mon[30941]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:35:22.627 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:35:22.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:22 smithi172 ceph-mon[34821]: from='osd.1 [v2:172.21.15.172:6800/2931872350,v1:172.21.15.172:6801/2931872350]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:35:22.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:22 smithi172 ceph-mon[34821]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:35:22.653 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi174:vg_nvme/lv_4 2024-09-21T03:35:22.900 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:35:23.285 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:23 smithi174 ceph-mon[34403]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T03:35:23.285 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:23 smithi174 ceph-mon[34403]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T03:35:23.285 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:35:23.285 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:23 smithi174 ceph-mon[34403]: from='osd.1 [v2:172.21.15.172:6800/2931872350,v1:172.21.15.172:6801/2931872350]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:35:23.285 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:23 smithi174 ceph-mon[34403]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:35:23.285 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:23 smithi174 ceph-mon[34403]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:23.285 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:23.285 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:23.286 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:35:23.286 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:23.286 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:23.286 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:35:23.286 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:23.304 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.301+0000 7fb5f592e640 1 -- 172.21.15.174:0/1932746968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5f0108450 msgr2=0x7fb5f0108860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:23.304 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.301+0000 7fb5f592e640 1 --2- 172.21.15.174:0/1932746968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5f0108450 0x7fb5f0108860 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009900 tx=0x7fb5e402a410 comp rx=0 tx=0).stop 2024-09-21T03:35:23.304 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.301+0000 7fb5f592e640 1 -- 172.21.15.174:0/1932746968 shutdown_connections 2024-09-21T03:35:23.304 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.301+0000 7fb5f592e640 1 --2- 172.21.15.174:0/1932746968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5f0108da0 0x7fb5f010f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:23.304 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.301+0000 7fb5f592e640 1 --2- 172.21.15.174:0/1932746968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5f0108450 0x7fb5f0108860 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:23.304 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.301+0000 7fb5f592e640 1 --2- 172.21.15.174:0/1932746968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f0102b10 0x7fb5f0102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:23.304 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.301+0000 7fb5f592e640 1 -- 172.21.15.174:0/1932746968 >> 172.21.15.174:0/1932746968 conn(0x7fb5f00796d0 msgr2=0x7fb5f0079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:23.305 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.301+0000 7fb5f592e640 1 -- 172.21.15.174:0/1932746968 shutdown_connections 2024-09-21T03:35:23.305 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.301+0000 7fb5f592e640 1 -- 172.21.15.174:0/1932746968 wait complete. 2024-09-21T03:35:23.306 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.302+0000 7fb5f592e640 1 Processor -- start 2024-09-21T03:35:23.306 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.302+0000 7fb5f592e640 1 -- start start 2024-09-21T03:35:23.307 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.302+0000 7fb5f592e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5f0102b10 0x7fb5f019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:23.307 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.302+0000 7fb5f592e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5f0108450 0x7fb5f019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:23.307 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.302+0000 7fb5f592e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f0108da0 0x7fb5f019fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:23.307 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.302+0000 7fb5f592e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f0112a80 con 0x7fb5f0108da0 2024-09-21T03:35:23.307 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.302+0000 7fb5f592e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f0112900 con 0x7fb5f0102b10 2024-09-21T03:35:23.307 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.302+0000 7fb5f592e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f0112c00 con 0x7fb5f0108450 2024-09-21T03:35:23.307 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.302+0000 7fb5ee7fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5f0108450 0x7fb5f019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:23.307 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.303+0000 7fb5ee7fc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5f0108450 0x7fb5f019ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:47256/0 (socket says 172.21.15.174:47256) 2024-09-21T03:35:23.307 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.303+0000 7fb5ee7fc640 1 -- 172.21.15.174:0/4173595047 learned_addr learned my addr 172.21.15.174:0/4173595047 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-21T03:35:23.307 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.303+0000 7fb5eeffd640 1 --2- 172.21.15.174:0/4173595047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5f0102b10 0x7fb5f019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:23.307 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.303+0000 7fb5ef7fe640 1 --2- 172.21.15.174:0/4173595047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f0108da0 0x7fb5f019fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:23.307 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.303+0000 7fb5ee7fc640 1 -- 172.21.15.174:0/4173595047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5f0102b10 msgr2=0x7fb5f019a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:23.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.303+0000 7fb5ee7fc640 1 --2- 172.21.15.174:0/4173595047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5f0102b10 0x7fb5f019a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:23.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.303+0000 7fb5ee7fc640 1 -- 172.21.15.174:0/4173595047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f0108da0 msgr2=0x7fb5f019fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:23.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.303+0000 7fb5ee7fc640 1 --2- 172.21.15.174:0/4173595047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f0108da0 0x7fb5f019fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:23.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.303+0000 7fb5ee7fc640 1 -- 172.21.15.174:0/4173595047 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f01a0510 con 0x7fb5f0108450 2024-09-21T03:35:23.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.303+0000 7fb5ef7fe640 1 --2- 172.21.15.174:0/4173595047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f0108da0 0x7fb5f019fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:35:23.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.303+0000 7fb5ee7fc640 1 --2- 172.21.15.174:0/4173595047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5f0108450 0x7fb5f019ab40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb5e402a930 tx=0x7fb5e4004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:23.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.303+0000 7fb5f492c640 1 -- 172.21.15.174:0/4173595047 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e403f030 con 0x7fb5f0108450 2024-09-21T03:35:23.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.303+0000 7fb5f592e640 1 -- 172.21.15.174:0/4173595047 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f01a07a0 con 0x7fb5f0108450 2024-09-21T03:35:23.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.303+0000 7fb5f492c640 1 -- 172.21.15.174:0/4173595047 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5e4003aa0 con 0x7fb5f0108450 2024-09-21T03:35:23.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.303+0000 7fb5f492c640 1 -- 172.21.15.174:0/4173595047 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4035070 con 0x7fb5f0108450 2024-09-21T03:35:23.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.303+0000 7fb5f592e640 1 -- 172.21.15.174:0/4173595047 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f01a6f60 con 0x7fb5f0108450 2024-09-21T03:35:23.309 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.305+0000 7fb5f592e640 1 -- 172.21.15.174:0/4173595047 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5f0102f20 con 0x7fb5f0108450 2024-09-21T03:35:23.309 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.306+0000 7fb5f492c640 1 -- 172.21.15.174:0/4173595047 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7fb5e4042030 con 0x7fb5f0108450 2024-09-21T03:35:23.309 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.306+0000 7fb5f492c640 1 --2- 172.21.15.174:0/4173595047 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb5d80b6550 0x7fb5d80b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:23.309 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.307+0000 7fb5f492c640 1 -- 172.21.15.174:0/4173595047 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2244+0+0 (secure 0 0 0) 0x7fb5e4106130 con 0x7fb5f0108450 2024-09-21T03:35:23.310 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.307+0000 7fb5eeffd640 1 --2- 172.21.15.174:0/4173595047 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb5d80b6550 0x7fb5d80b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:23.310 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.307+0000 7fb5eeffd640 1 --2- 172.21.15.174:0/4173595047 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb5d80b6550 0x7fb5d80b8a60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000bbe0 tx=0x7fb5e000b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:23.314 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.311+0000 7fb5f492c640 1 -- 172.21.15.174:0/4173595047 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5e40ce250 con 0x7fb5f0108450 2024-09-21T03:35:23.504 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:23.501+0000 7fb5f592e640 1 -- 172.21.15.174:0/4173595047 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb5f0106220 con 0x7fb5d80b6550 2024-09-21T03:35:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:23 smithi084 ceph-mon[30941]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T03:35:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:23 smithi084 ceph-mon[30941]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T03:35:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:35:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:23 smithi084 ceph-mon[30941]: from='osd.1 [v2:172.21.15.172:6800/2931872350,v1:172.21.15.172:6801/2931872350]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:35:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:23 smithi084 ceph-mon[30941]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:35:23.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:23 smithi084 ceph-mon[30941]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:23.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:23.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:23.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:35:23.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:23.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:23.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:35:23.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:23.650 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:35:23 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-1[39557]: 2024-09-21T03:35:23.176+0000 7f6775718640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T03:35:23.651 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:35:23 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-1[39557]: 2024-09-21T03:35:23.180+0000 7f6771516640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:35:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:23 smithi172 ceph-mon[34821]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T03:35:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:23 smithi172 ceph-mon[34821]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T03:35:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:35:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:23 smithi172 ceph-mon[34821]: from='osd.1 [v2:172.21.15.172:6800/2931872350,v1:172.21.15.172:6801/2931872350]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:35:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:23 smithi172 ceph-mon[34821]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:35:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:23 smithi172 ceph-mon[34821]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:35:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:23.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:23.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:35:23.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:24.540 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:24 smithi174 ceph-mon[34403]: Detected new or changed devices on smithi172 2024-09-21T03:35:24.541 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:24 smithi174 ceph-mon[34403]: Adjusting osd_memory_target on smithi172 to 17088M 2024-09-21T03:35:24.541 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:24 smithi174 ceph-mon[34403]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T03:35:24.541 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:24 smithi174 ceph-mon[34403]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T03:35:24.541 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:24 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:35:24.541 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:24 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:35:24.541 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:24 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:35:24.541 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:24 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:35:24.541 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:24 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:24.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:24 smithi084 ceph-mon[30941]: Detected new or changed devices on smithi172 2024-09-21T03:35:24.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:24 smithi084 ceph-mon[30941]: Adjusting osd_memory_target on smithi172 to 17088M 2024-09-21T03:35:24.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:24 smithi084 ceph-mon[30941]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T03:35:24.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:24 smithi084 ceph-mon[30941]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T03:35:24.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:24 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:35:24.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:24 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:35:24.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:24 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:35:24.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:24 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:35:24.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:24 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:24.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:24 smithi172 ceph-mon[34821]: Detected new or changed devices on smithi172 2024-09-21T03:35:24.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:24 smithi172 ceph-mon[34821]: Adjusting osd_memory_target on smithi172 to 17088M 2024-09-21T03:35:24.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:24 smithi172 ceph-mon[34821]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T03:35:24.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:24 smithi172 ceph-mon[34821]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T03:35:24.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:24 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:35:24.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:24 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:35:24.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:24 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:35:24.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:24 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:35:24.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:24 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:25.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:25 smithi174 ceph-mon[34403]: purged_snaps scrub starts 2024-09-21T03:35:25.493 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:25 smithi174 ceph-mon[34403]: purged_snaps scrub ok 2024-09-21T03:35:25.493 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:25 smithi174 ceph-mon[34403]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:25.493 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:25 smithi174 ceph-mon[34403]: osd.1 [v2:172.21.15.172:6800/2931872350,v1:172.21.15.172:6801/2931872350] boot 2024-09-21T03:35:25.493 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:25 smithi174 ceph-mon[34403]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T03:35:25.493 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:25 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:35:25.493 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:25 smithi174 ceph-mon[34403]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:25.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:25 smithi084 ceph-mon[30941]: purged_snaps scrub starts 2024-09-21T03:35:25.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:25 smithi084 ceph-mon[30941]: purged_snaps scrub ok 2024-09-21T03:35:25.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:25 smithi084 ceph-mon[30941]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:25.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:25 smithi084 ceph-mon[30941]: osd.1 [v2:172.21.15.172:6800/2931872350,v1:172.21.15.172:6801/2931872350] boot 2024-09-21T03:35:25.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:25 smithi084 ceph-mon[30941]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T03:35:25.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:25 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:35:25.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:25 smithi084 ceph-mon[30941]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:25.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:25 smithi172 ceph-mon[34821]: purged_snaps scrub starts 2024-09-21T03:35:25.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:25 smithi172 ceph-mon[34821]: purged_snaps scrub ok 2024-09-21T03:35:25.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:25 smithi172 ceph-mon[34821]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:25.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:25 smithi172 ceph-mon[34821]: osd.1 [v2:172.21.15.172:6800/2931872350,v1:172.21.15.172:6801/2931872350] boot 2024-09-21T03:35:25.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:25 smithi172 ceph-mon[34821]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T03:35:25.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:25 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:35:25.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:25 smithi172 ceph-mon[34821]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:35:26.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:26 smithi174 ceph-mon[34403]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T03:35:26.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:26 smithi174 ceph-mon[34403]: from='client.? 172.21.15.174:0/117134313' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "36489240-e233-4aa7-ae9c-089d76683172"} : dispatch 2024-09-21T03:35:26.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:26 smithi174 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "36489240-e233-4aa7-ae9c-089d76683172"} : dispatch 2024-09-21T03:35:26.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:26 smithi174 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36489240-e233-4aa7-ae9c-089d76683172"}]': finished 2024-09-21T03:35:26.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:26 smithi174 ceph-mon[34403]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T03:35:26.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:26 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:35:26.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:26 smithi084 ceph-mon[30941]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T03:35:26.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:26 smithi084 ceph-mon[30941]: from='client.? 172.21.15.174:0/117134313' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "36489240-e233-4aa7-ae9c-089d76683172"} : dispatch 2024-09-21T03:35:26.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:26 smithi084 ceph-mon[30941]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "36489240-e233-4aa7-ae9c-089d76683172"} : dispatch 2024-09-21T03:35:26.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:26 smithi084 ceph-mon[30941]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36489240-e233-4aa7-ae9c-089d76683172"}]': finished 2024-09-21T03:35:26.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:26 smithi084 ceph-mon[30941]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T03:35:26.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:26 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:35:26.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:26 smithi172 ceph-mon[34821]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T03:35:26.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:26 smithi172 ceph-mon[34821]: from='client.? 172.21.15.174:0/117134313' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "36489240-e233-4aa7-ae9c-089d76683172"} : dispatch 2024-09-21T03:35:26.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:26 smithi172 ceph-mon[34821]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "36489240-e233-4aa7-ae9c-089d76683172"} : dispatch 2024-09-21T03:35:26.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:26 smithi172 ceph-mon[34821]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "36489240-e233-4aa7-ae9c-089d76683172"}]': finished 2024-09-21T03:35:26.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:26 smithi172 ceph-mon[34821]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T03:35:26.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:26 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:35:27.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:27 smithi084 ceph-mon[30941]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:27.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:27 smithi084 ceph-mon[30941]: from='client.? 172.21.15.174:0/1956917774' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:35:27.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:27 smithi174 ceph-mon[34403]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:27.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:27 smithi174 ceph-mon[34403]: from='client.? 172.21.15.174:0/1956917774' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:35:27.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:27 smithi172 ceph-mon[34821]: pgmap v51: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:27.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:27 smithi172 ceph-mon[34821]: from='client.? 172.21.15.174:0/1956917774' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:35:29.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:29 smithi084 ceph-mon[30941]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:29.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:29 smithi174 ceph-mon[34403]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:29.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:29 smithi172 ceph-mon[34821]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:31.556 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:31 smithi174 ceph-mon[34403]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:31.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:31 smithi084 ceph-mon[30941]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:31.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:31 smithi172 ceph-mon[34821]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:33.458 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:33 smithi174 ceph-mon[34403]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:33.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:33 smithi084 ceph-mon[30941]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:33.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:33 smithi172 ceph-mon[34821]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:34.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:34 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T03:35:34.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:34 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:34.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:34 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T03:35:34.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:34 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:34.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:34 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T03:35:34.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:34 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:35.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:35 smithi174 ceph-mon[34403]: Deploying daemon osd.2 on smithi174 2024-09-21T03:35:35.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:35 smithi174 ceph-mon[34403]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:35.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:35 smithi084 ceph-mon[30941]: Deploying daemon osd.2 on smithi174 2024-09-21T03:35:35.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:35 smithi084 ceph-mon[30941]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:35.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:35 smithi172 ceph-mon[34821]: Deploying daemon osd.2 on smithi174 2024-09-21T03:35:35.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:35 smithi172 ceph-mon[34821]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:37.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:37 smithi174 ceph-mon[34403]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:37.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:37 smithi084 ceph-mon[30941]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:37.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:37 smithi172 ceph-mon[34821]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:39.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:39 smithi174 ceph-mon[34403]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:39.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:39 smithi084 ceph-mon[30941]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:39.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:39 smithi172 ceph-mon[34821]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:41.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:41 smithi084 ceph-mon[30941]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:41.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:41 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:35:41.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:41 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:41.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:41 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:41.613 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:41 smithi174 ceph-mon[34403]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:41.613 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:41 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:35:41.613 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:41 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:41.613 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:41 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:41 smithi172 ceph-mon[34821]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:41 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:35:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:41 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:41 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:43.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:43 smithi084 ceph-mon[30941]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:43.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:43 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:43.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:43 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:43.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:43 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:43.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:43 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:35:43.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:43 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:43.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:43 smithi174 ceph-mon[34403]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:43.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:43 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:43.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:43 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:43.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:43 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:43.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:43 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:35:43.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:43 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:43.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:43 smithi172 ceph-mon[34821]: pgmap v59: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:43 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:43 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:43 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:43 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:35:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:43 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:44.452 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:44.450+0000 7fb5f492c640 1 -- 172.21.15.174:0/4173595047 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb5f0106220 con 0x7fb5d80b6550 2024-09-21T03:35:44.452 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 2 on host 'smithi174' 2024-09-21T03:35:44.454 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:44.452+0000 7fb5f592e640 1 -- 172.21.15.174:0/4173595047 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb5d80b6550 msgr2=0x7fb5d80b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:44.454 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:44.452+0000 7fb5f592e640 1 --2- 172.21.15.174:0/4173595047 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb5d80b6550 0x7fb5d80b8a60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000bbe0 tx=0x7fb5e000b390 comp rx=0 tx=0).stop 2024-09-21T03:35:44.454 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:44.452+0000 7fb5f592e640 1 -- 172.21.15.174:0/4173595047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5f0108450 msgr2=0x7fb5f019ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:44.455 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:44.452+0000 7fb5f592e640 1 --2- 172.21.15.174:0/4173595047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5f0108450 0x7fb5f019ab40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb5e402a930 tx=0x7fb5e4004270 comp rx=0 tx=0).stop 2024-09-21T03:35:44.455 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:44.452+0000 7fb5f592e640 1 -- 172.21.15.174:0/4173595047 shutdown_connections 2024-09-21T03:35:44.455 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:44.452+0000 7fb5f592e640 1 --2- 172.21.15.174:0/4173595047 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb5d80b6550 0x7fb5d80b8a60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:44.455 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:44.452+0000 7fb5f592e640 1 --2- 172.21.15.174:0/4173595047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb5f0108da0 0x7fb5f019fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:44.455 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:44.452+0000 7fb5f592e640 1 --2- 172.21.15.174:0/4173595047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5f0108450 0x7fb5f019ab40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:44.455 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:44.452+0000 7fb5f592e640 1 --2- 172.21.15.174:0/4173595047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5f0102b10 0x7fb5f019a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:44.455 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:44.452+0000 7fb5f592e640 1 -- 172.21.15.174:0/4173595047 >> 172.21.15.174:0/4173595047 conn(0x7fb5f00796d0 msgr2=0x7fb5f006bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:44.455 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:44.453+0000 7fb5f592e640 1 -- 172.21.15.174:0/4173595047 shutdown_connections 2024-09-21T03:35:44.455 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:35:44.453+0000 7fb5f592e640 1 -- 172.21.15.174:0/4173595047 wait complete. 2024-09-21T03:35:45.084 DEBUG:teuthology.orchestra.run.smithi174:osd.2> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T03:35:45.087 INFO:tasks.cephadm:Deploying osd.3 on smithi084 with /dev/vg_nvme/lv_3... 2024-09-21T03:35:45.087 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T03:35:45.332 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:35:45.344 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:45 smithi174 ceph-mon[34403]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:45.344 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:45 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:35:45.344 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:45 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:45.344 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:45 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:45.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:45 smithi084 ceph-mon[30941]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:45.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:45 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:35:45.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:45 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:45.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:45 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:45.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:45 smithi172 ceph-mon[34821]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:45.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:45 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:35:45.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:45 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:45.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:45 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:46.351 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:46 smithi174 ceph-mon[34403]: from='osd.2 [v2:172.21.15.174:6800/1847612335,v1:172.21.15.174:6801/1847612335]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:35:46.351 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:46 smithi174 ceph-mon[34403]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:35:46.351 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:35:46 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-2[39616]: 2024-09-21T03:35:46.087+0000 7fad5e9e6640 -1 osd.2 0 log_to_monitors true 2024-09-21T03:35:46.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:46 smithi084 ceph-mon[30941]: from='osd.2 [v2:172.21.15.174:6800/1847612335,v1:172.21.15.174:6801/1847612335]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:35:46.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:46 smithi084 ceph-mon[30941]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:35:46.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:46 smithi172 ceph-mon[34821]: from='osd.2 [v2:172.21.15.174:6800/1847612335,v1:172.21.15.174:6801/1847612335]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:35:46.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:46 smithi172 ceph-mon[34821]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:35:47.480 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:47 smithi174 ceph-mon[34403]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:47.480 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:47 smithi174 ceph-mon[34403]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T03:35:47.480 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:47 smithi174 ceph-mon[34403]: from='osd.2 [v2:172.21.15.174:6800/1847612335,v1:172.21.15.174:6801/1847612335]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:35:47.480 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:47 smithi174 ceph-mon[34403]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T03:35:47.480 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:35:47.480 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:47 smithi174 ceph-mon[34403]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:35:47.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:47 smithi084 ceph-mon[30941]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:47.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:47 smithi084 ceph-mon[30941]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T03:35:47.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:47 smithi084 ceph-mon[30941]: from='osd.2 [v2:172.21.15.174:6800/1847612335,v1:172.21.15.174:6801/1847612335]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:35:47.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:47 smithi084 ceph-mon[30941]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T03:35:47.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:35:47.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:47 smithi084 ceph-mon[30941]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:35:47.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:47 smithi172 ceph-mon[34821]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:47.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:47 smithi172 ceph-mon[34821]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T03:35:47.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:47 smithi172 ceph-mon[34821]: from='osd.2 [v2:172.21.15.174:6800/1847612335,v1:172.21.15.174:6801/1847612335]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:35:47.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:47 smithi172 ceph-mon[34821]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T03:35:47.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:35:47.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:47 smithi172 ceph-mon[34821]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:35:47.863 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:35:47.894 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi084:vg_nvme/lv_3 2024-09-21T03:35:48.128 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:35:47 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-2[39616]: 2024-09-21T03:35:47.749+0000 7fad5a968640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T03:35:48.128 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:35:47 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-2[39616]: 2024-09-21T03:35:47.753+0000 7fad5275e640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:35:48.132 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:35:48.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:48 smithi084 ceph-mon[30941]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T03:35:48.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:48 smithi084 ceph-mon[30941]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T03:35:48.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:48 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:35:48.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:48 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:35:48.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:48 smithi084 ceph-mon[30941]: from='osd.2 ' entity='osd.2' 2024-09-21T03:35:48.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:48 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:48.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:48 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:48.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:48 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:35:48.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:48 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:48.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:48 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:48.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:48 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:35:48.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:48 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:48.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.571+0000 7f89bd560640 1 -- 172.21.15.84:0/2012081860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89b8108d00 msgr2=0x7f89b810f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:48.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.571+0000 7f89bd560640 1 --2- 172.21.15.84:0/2012081860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89b8108d00 0x7f89b810f530 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009ca0 tx=0x7f89b002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:35:48.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.571+0000 7f89bd560640 1 -- 172.21.15.84:0/2012081860 shutdown_connections 2024-09-21T03:35:48.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.571+0000 7f89bd560640 1 --2- 172.21.15.84:0/2012081860 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89b8108d00 0x7f89b810f530 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:48.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.572+0000 7f89bd560640 1 --2- 172.21.15.84:0/2012081860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89b81083b0 0x7f89b81087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:48.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.572+0000 7f89bd560640 1 --2- 172.21.15.84:0/2012081860 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89b8103140 0x7f89b8103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:48.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.572+0000 7f89bd560640 1 -- 172.21.15.84:0/2012081860 >> 172.21.15.84:0/2012081860 conn(0x7f89b8077c60 msgr2=0x7f89b80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:48.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.572+0000 7f89bd560640 1 -- 172.21.15.84:0/2012081860 shutdown_connections 2024-09-21T03:35:48.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.572+0000 7f89bd560640 1 -- 172.21.15.84:0/2012081860 wait complete. 2024-09-21T03:35:48.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.572+0000 7f89bd560640 1 Processor -- start 2024-09-21T03:35:48.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.572+0000 7f89bd560640 1 -- start start 2024-09-21T03:35:48.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89bd560640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89b8103140 0x7f89b819b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:48.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89bd560640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89b81083b0 0x7f89b819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:48.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89bd560640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89b8108d00 0x7f89b819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:48.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89bd560640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f89b8112a20 con 0x7f89b81083b0 2024-09-21T03:35:48.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89bd560640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f89b81128a0 con 0x7f89b8108d00 2024-09-21T03:35:48.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89bd560640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f89b8112ba0 con 0x7f89b8103140 2024-09-21T03:35:48.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89ae7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89b81083b0 0x7f89b819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:48.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89ae7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89b81083b0 0x7f89b819b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53154/0 (socket says 172.21.15.84:53154) 2024-09-21T03:35:48.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89ae7fc640 1 -- 172.21.15.84:0/16815822 learned_addr learned my addr 172.21.15.84:0/16815822 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:35:48.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89b6ffd640 1 --2- 172.21.15.84:0/16815822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89b8103140 0x7f89b819b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:48.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89ae7fc640 1 -- 172.21.15.84:0/16815822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89b8103140 msgr2=0x7f89b819b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:48.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89ae7fc640 1 --2- 172.21.15.84:0/16815822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89b8103140 0x7f89b819b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:48.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89b77fe640 1 --2- 172.21.15.84:0/16815822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89b8108d00 0x7f89b819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:48.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89ae7fc640 1 -- 172.21.15.84:0/16815822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89b8108d00 msgr2=0x7f89b819bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:48.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89ae7fc640 1 --2- 172.21.15.84:0/16815822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89b8108d00 0x7f89b819bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:48.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89ae7fc640 1 -- 172.21.15.84:0/16815822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89b81a65b0 con 0x7f89b81083b0 2024-09-21T03:35:48.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89b6ffd640 1 --2- 172.21.15.84:0/16815822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89b8103140 0x7f89b819b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:35:48.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89b77fe640 1 --2- 172.21.15.84:0/16815822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89b8108d00 0x7f89b819bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:35:48.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89ae7fc640 1 --2- 172.21.15.84:0/16815822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89b81083b0 0x7f89b819b830 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f89a000e9f0 tx=0x7f89a000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:48.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89b4ff9640 1 -- 172.21.15.84:0/16815822 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a000ccc0 con 0x7f89b81083b0 2024-09-21T03:35:48.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.573+0000 7f89bd560640 1 -- 172.21.15.84:0/16815822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89b81a68a0 con 0x7f89b81083b0 2024-09-21T03:35:48.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.574+0000 7f89b4ff9640 1 -- 172.21.15.84:0/16815822 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89a00108e0 con 0x7f89b81083b0 2024-09-21T03:35:48.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.574+0000 7f89b4ff9640 1 -- 172.21.15.84:0/16815822 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a0018860 con 0x7f89b81083b0 2024-09-21T03:35:48.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.574+0000 7f89bd560640 1 -- 172.21.15.84:0/16815822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89b81a6eb0 con 0x7f89b81083b0 2024-09-21T03:35:48.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.575+0000 7f89bd560640 1 -- 172.21.15.84:0/16815822 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89b8103550 con 0x7f89b81083b0 2024-09-21T03:35:48.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.576+0000 7f89b4ff9640 1 -- 172.21.15.84:0/16815822 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 20) ==== 154473+0+0 (secure 0 0 0) 0x7f89a0010430 con 0x7f89b81083b0 2024-09-21T03:35:48.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.577+0000 7f89b4ff9640 1 --2- 172.21.15.84:0/16815822 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f89a40b64d0 0x7f89a40b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:48.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.577+0000 7f89b6ffd640 1 --2- 172.21.15.84:0/16815822 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f89a40b64d0 0x7f89a40b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:48.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.577+0000 7f89b4ff9640 1 -- 172.21.15.84:0/16815822 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2786+0+0 (secure 0 0 0) 0x7f89a00e6590 con 0x7f89b81083b0 2024-09-21T03:35:48.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.577+0000 7f89b6ffd640 1 --2- 172.21.15.84:0/16815822 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f89a40b64d0 0x7f89a40b89e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f89a8006fd0 tx=0x7f89a8008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:48.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.580+0000 7f89b4ff9640 1 -- 172.21.15.84:0/16815822 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f89a00ae490 con 0x7f89b81083b0 2024-09-21T03:35:48.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:48 smithi174 ceph-mon[34403]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T03:35:48.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:48 smithi174 ceph-mon[34403]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T03:35:48.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:48 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:35:48.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:48 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:35:48.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:48 smithi174 ceph-mon[34403]: from='osd.2 ' entity='osd.2' 2024-09-21T03:35:48.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:48 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:48.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:48 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:48.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:48 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:35:48.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:48 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:48.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:48 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:48.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:48 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:35:48.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:48 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:48.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:48 smithi172 ceph-mon[34821]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T03:35:48.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:48 smithi172 ceph-mon[34821]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T03:35:48.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:48 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:35:48.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:48 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:35:48.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:48 smithi172 ceph-mon[34821]: from='osd.2 ' entity='osd.2' 2024-09-21T03:35:48.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:48 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:48.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:48 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:48.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:48 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:35:48.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:48 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:48.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:48 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:48.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:48 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:35:48.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:48 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:48.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:48.766+0000 7f89bd560640 1 -- 172.21.15.84:0/16815822 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f89b8063800 con 0x7f89a40b64d0 2024-09-21T03:35:49.468 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:49 smithi084 ceph-mon[30941]: purged_snaps scrub starts 2024-09-21T03:35:49.468 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:49 smithi084 ceph-mon[30941]: purged_snaps scrub ok 2024-09-21T03:35:49.468 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:49 smithi084 ceph-mon[30941]: Detected new or changed devices on smithi174 2024-09-21T03:35:49.468 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:49 smithi084 ceph-mon[30941]: Adjusting osd_memory_target on smithi174 to 17088M 2024-09-21T03:35:49.468 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:49 smithi084 ceph-mon[30941]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:49.468 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:49 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:35:49.468 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:49 smithi084 ceph-mon[30941]: osd.2 [v2:172.21.15.174:6800/1847612335,v1:172.21.15.174:6801/1847612335] boot 2024-09-21T03:35:49.468 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:49 smithi084 ceph-mon[30941]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T03:35:49.468 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:49 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:35:49.468 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:49 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:35:49.469 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:49 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:35:49.469 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:49 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:49.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:49 smithi174 ceph-mon[34403]: purged_snaps scrub starts 2024-09-21T03:35:49.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:49 smithi174 ceph-mon[34403]: purged_snaps scrub ok 2024-09-21T03:35:49.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:49 smithi174 ceph-mon[34403]: Detected new or changed devices on smithi174 2024-09-21T03:35:49.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:49 smithi174 ceph-mon[34403]: Adjusting osd_memory_target on smithi174 to 17088M 2024-09-21T03:35:49.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:49 smithi174 ceph-mon[34403]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:49.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:49 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:35:49.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:49 smithi174 ceph-mon[34403]: osd.2 [v2:172.21.15.174:6800/1847612335,v1:172.21.15.174:6801/1847612335] boot 2024-09-21T03:35:49.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:49 smithi174 ceph-mon[34403]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T03:35:49.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:49 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:35:49.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:49 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:35:49.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:49 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:35:49.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:49 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:49.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:49 smithi172 ceph-mon[34821]: purged_snaps scrub starts 2024-09-21T03:35:49.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:49 smithi172 ceph-mon[34821]: purged_snaps scrub ok 2024-09-21T03:35:49.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:49 smithi172 ceph-mon[34821]: Detected new or changed devices on smithi174 2024-09-21T03:35:49.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:49 smithi172 ceph-mon[34821]: Adjusting osd_memory_target on smithi174 to 17088M 2024-09-21T03:35:49.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:49 smithi172 ceph-mon[34821]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:35:49.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:49 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:35:49.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:49 smithi172 ceph-mon[34821]: osd.2 [v2:172.21.15.174:6800/1847612335,v1:172.21.15.174:6801/1847612335] boot 2024-09-21T03:35:49.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:49 smithi172 ceph-mon[34821]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T03:35:49.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:49 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:35:49.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:49 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:35:49.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:49 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:35:49.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:49 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:50.481 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:50 smithi084 ceph-mon[30941]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:50.481 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:50 smithi084 ceph-mon[30941]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T03:35:50.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:50 smithi174 ceph-mon[34403]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:50.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:50 smithi174 ceph-mon[34403]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T03:35:50.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:50 smithi172 ceph-mon[34821]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:35:50.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:50 smithi172 ceph-mon[34821]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T03:35:51.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:51 smithi084 ceph-mon[30941]: pgmap v67: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:35:51.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:35:51.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:51 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/167838248' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1f35b404-b658-4e94-a5f4-74a6431a6a8c"} : dispatch 2024-09-21T03:35:51.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T03:35:51.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:51 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/167838248' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f35b404-b658-4e94-a5f4-74a6431a6a8c"}]': finished 2024-09-21T03:35:51.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:51 smithi084 ceph-mon[30941]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T03:35:51.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:35:51.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:35:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:51 smithi174 ceph-mon[34403]: pgmap v67: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:35:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:35:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:51 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/167838248' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1f35b404-b658-4e94-a5f4-74a6431a6a8c"} : dispatch 2024-09-21T03:35:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T03:35:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:51 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/167838248' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f35b404-b658-4e94-a5f4-74a6431a6a8c"}]': finished 2024-09-21T03:35:51.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:51 smithi174 ceph-mon[34403]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T03:35:51.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:35:51.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:35:51.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:51 smithi172 ceph-mon[34821]: pgmap v67: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:35:51.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:35:51.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:51 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/167838248' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1f35b404-b658-4e94-a5f4-74a6431a6a8c"} : dispatch 2024-09-21T03:35:51.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T03:35:51.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:51 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/167838248' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f35b404-b658-4e94-a5f4-74a6431a6a8c"}]': finished 2024-09-21T03:35:51.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:51 smithi172 ceph-mon[34821]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T03:35:51.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:35:51.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:35:52.573 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:35:52 smithi084 sudo[52655]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:35:52.573 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:35:52 smithi084 sudo[52655]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:35:52.573 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:35:52 smithi084 sudo[52655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:35:52.573 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:35:52 smithi084 sudo[52655]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:35:52.573 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:35:52 smithi084 sudo[52658]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:35:52.573 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:35:52 smithi084 sudo[52658]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:35:52.574 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:35:52 smithi084 sudo[52658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:35:52.574 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:35:52 smithi084 sudo[52658]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:35:52.574 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:52 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/108612292' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:35:52.574 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:52 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:35:52.574 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:52 smithi084 ceph-mon[30941]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T03:35:52.574 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:52 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:35:52.574 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:52 smithi084 sudo[52661]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:35:52.574 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:52 smithi084 sudo[52661]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:35:52.574 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:52 smithi084 sudo[52661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:35:52.575 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:52 smithi084 sudo[52661]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:35:52.575 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:52 smithi084 sudo[52664]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:35:52.575 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:52 smithi084 sudo[52664]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:35:52.575 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:52 smithi084 sudo[52664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:35:52.575 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:52 smithi084 sudo[52664]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:35:52.576 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:35:52 smithi174 sudo[43109]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:35:52.576 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:35:52 smithi174 sudo[43109]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:35:52.576 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:35:52 smithi174 sudo[43109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:35:52.576 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:35:52 smithi174 sudo[43109]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:35:52.576 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:35:52 smithi174 sudo[43112]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:35:52.576 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:35:52 smithi174 sudo[43112]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:35:52.576 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:35:52 smithi174 sudo[43112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:35:52.576 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:35:52 smithi174 sudo[43112]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:35:52.576 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:52 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/108612292' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:35:52.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:52 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:35:52.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:52 smithi174 ceph-mon[34403]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T03:35:52.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:52 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:35:52.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:52 smithi174 sudo[43115]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:35:52.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:52 smithi174 sudo[43115]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:35:52.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:52 smithi174 sudo[43115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:35:52.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:52 smithi174 sudo[43115]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:35:52.591 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:52 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/108612292' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:35:52.591 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:52 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:35:52.591 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:52 smithi172 ceph-mon[34821]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T03:35:52.591 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:52 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:35:52.591 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:35:52 smithi172 sudo[43400]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:35:52.592 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:35:52 smithi172 sudo[43400]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:35:52.592 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:35:52 smithi172 sudo[43400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:35:52.592 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:35:52 smithi172 sudo[43400]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:35:52.592 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:35:52 smithi172 sudo[43403]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:35:52.592 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:35:52 smithi172 sudo[43403]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:35:52.592 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:35:52 smithi172 sudo[43403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:35:52.592 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:35:52 smithi172 sudo[43403]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:35:52.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:52 smithi174 sudo[43118]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:35:52.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:52 smithi174 sudo[43118]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:35:52.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:52 smithi174 sudo[43118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:35:52.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:52 smithi174 sudo[43118]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:35:52.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:52 smithi172 sudo[43406]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:35:52.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:52 smithi172 sudo[43406]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:35:52.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:52 smithi172 sudo[43406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:35:52.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:52 smithi172 sudo[43406]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:35:52.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:52 smithi172 sudo[43409]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:35:52.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:52 smithi172 sudo[43409]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:35:52.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:52 smithi172 sudo[43409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:35:52.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:52 smithi172 sudo[43409]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:35:53.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:35:53.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:53.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:53.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:53.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:35:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:35:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:35:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:35:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:35:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:35:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:35:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:35:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:35:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:35:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:35:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:35:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:35:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:35:53.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:35:53.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T03:35:53.630 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:35:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:35:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:35:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:35:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:35:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:35:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:35:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:35:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:35:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:35:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:35:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:35:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:35:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:35:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:35:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:35:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:35:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T03:35:53.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:35:53.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:35:53.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:53.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:53.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:35:53.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:35:53.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:35:53.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:35:53.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:35:53.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:35:53.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:35:53.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:35:53.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:35:53.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:35:53.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:35:53.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:35:53.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:35:53.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:35:53.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:35:53.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:35:53.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T03:35:53.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:35:54.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:35:54.332+0000 7f89b4ff9640 1 -- 172.21.15.84:0/16815822 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f89a00aa000 con 0x7f89b81083b0 2024-09-21T03:35:55.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:55 smithi174 ceph-mon[34403]: pgmap v72: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:35:55.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:55 smithi174 ceph-mon[34403]: mgrmap e21: x(active, since 2m), standbys: z, y 2024-09-21T03:35:55.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:55 smithi172 ceph-mon[34821]: pgmap v72: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:35:55.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:55 smithi172 ceph-mon[34821]: mgrmap e21: x(active, since 2m), standbys: z, y 2024-09-21T03:35:55.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:55 smithi084 ceph-mon[30941]: pgmap v72: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:35:55.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:55 smithi084 ceph-mon[30941]: mgrmap e21: x(active, since 2m), standbys: z, y 2024-09-21T03:35:57.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:57 smithi084 ceph-mon[30941]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:35:57.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:57 smithi174 ceph-mon[34403]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:35:57.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:57 smithi172 ceph-mon[34821]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:35:59.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:35:59 smithi174 ceph-mon[34403]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:35:59.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:35:59 smithi172 ceph-mon[34821]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:35:59.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:35:59 smithi084 ceph-mon[30941]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:00.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:00 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T03:36:00.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:00 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:00.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:00 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T03:36:00.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:00 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:00.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:00 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T03:36:00.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:00 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:01.542 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:01 smithi084 ceph-mon[30941]: Deploying daemon osd.3 on smithi084 2024-09-21T03:36:01.542 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:01 smithi084 ceph-mon[30941]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:01.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:01 smithi174 ceph-mon[34403]: Deploying daemon osd.3 on smithi084 2024-09-21T03:36:01.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:01 smithi174 ceph-mon[34403]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:01.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:01 smithi172 ceph-mon[34821]: Deploying daemon osd.3 on smithi084 2024-09-21T03:36:01.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:01 smithi172 ceph-mon[34821]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:03.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:03 smithi084 ceph-mon[30941]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:03.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:03 smithi174 ceph-mon[34403]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:03.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:03 smithi172 ceph-mon[34821]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:05.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:05 smithi084 ceph-mon[30941]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:05.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:05 smithi174 ceph-mon[34403]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:05.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:05 smithi172 ceph-mon[34821]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:06.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:06 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:36:06.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:06 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:06.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:06 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:06.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:06 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:36:06.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:06 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:06.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:06 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:06.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:06 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:36:06.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:06 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:06.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:06 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:07.482 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:07 smithi084 ceph-mon[30941]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:07.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:07 smithi174 ceph-mon[34403]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:07.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:07 smithi172 ceph-mon[34821]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:09.459 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:09 smithi084 ceph-mon[30941]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:09.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:09 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:09.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:09 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:09.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:09 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:09.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:09 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:36:09.460 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:09 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:09.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:09 smithi174 ceph-mon[34403]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:09.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:09 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:09.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:09 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:09.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:09 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:09.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:09 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:36:09.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:09 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:09.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:09 smithi172 ceph-mon[34821]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:09.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:09 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:09.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:09 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:09.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:09 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:09.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:09 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:36:09.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:09 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:09.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:36:09.790+0000 7f89b4ff9640 1 -- 172.21.15.84:0/16815822 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f89b8063800 con 0x7f89a40b64d0 2024-09-21T03:36:09.792 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 3 on host 'smithi084' 2024-09-21T03:36:09.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:36:09.792+0000 7f89bd560640 1 -- 172.21.15.84:0/16815822 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f89a40b64d0 msgr2=0x7f89a40b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:09.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:36:09.792+0000 7f89bd560640 1 --2- 172.21.15.84:0/16815822 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f89a40b64d0 0x7f89a40b89e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f89a8006fd0 tx=0x7f89a8008040 comp rx=0 tx=0).stop 2024-09-21T03:36:09.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:36:09.792+0000 7f89bd560640 1 -- 172.21.15.84:0/16815822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89b81083b0 msgr2=0x7f89b819b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:09.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:36:09.792+0000 7f89bd560640 1 --2- 172.21.15.84:0/16815822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89b81083b0 0x7f89b819b830 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f89a000e9f0 tx=0x7f89a000eeb0 comp rx=0 tx=0).stop 2024-09-21T03:36:09.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:36:09.792+0000 7f89bd560640 1 -- 172.21.15.84:0/16815822 shutdown_connections 2024-09-21T03:36:09.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:36:09.792+0000 7f89bd560640 1 --2- 172.21.15.84:0/16815822 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f89a40b64d0 0x7f89a40b89e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:09.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:36:09.792+0000 7f89bd560640 1 --2- 172.21.15.84:0/16815822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89b8108d00 0x7f89b819bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:09.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:36:09.792+0000 7f89bd560640 1 --2- 172.21.15.84:0/16815822 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89b81083b0 0x7f89b819b830 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:09.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:36:09.793+0000 7f89bd560640 1 --2- 172.21.15.84:0/16815822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89b8103140 0x7f89b819b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:09.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:36:09.793+0000 7f89bd560640 1 -- 172.21.15.84:0/16815822 >> 172.21.15.84:0/16815822 conn(0x7f89b8077c60 msgr2=0x7f89b8106400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:09.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:36:09.793+0000 7f89bd560640 1 -- 172.21.15.84:0/16815822 shutdown_connections 2024-09-21T03:36:09.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:36:09.793+0000 7f89bd560640 1 -- 172.21.15.84:0/16815822 wait complete. 2024-09-21T03:36:10.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:10 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:36:10.430 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:10 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:10.431 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:10 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:10.464 DEBUG:teuthology.orchestra.run.smithi084:osd.3> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T03:36:10.466 INFO:tasks.cephadm:Deploying osd.4 on smithi172 with /dev/vg_nvme/lv_3... 2024-09-21T03:36:10.466 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T03:36:10.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:10 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:36:10.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:10 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:10.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:10 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:10.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:10 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:36:10.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:10 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:10.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:10 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:10.721 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:36:11.400 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:11 smithi172 ceph-mon[34821]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:11.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:11 smithi174 ceph-mon[34403]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:11.712 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:11 smithi084 ceph-mon[30941]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:11.973 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 03:36:11 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-3[54560]: 2024-09-21T03:36:11.897+0000 7f1afe160640 -1 osd.3 0 log_to_monitors true 2024-09-21T03:36:12.400 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:12 smithi172 ceph-mon[34821]: from='osd.3 [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T03:36:12.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:12 smithi172 ceph-mon[34821]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:12.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:12 smithi174 ceph-mon[34403]: from='osd.3 [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T03:36:12.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:12 smithi174 ceph-mon[34403]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:12.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:12 smithi084 ceph-mon[30941]: from='osd.3 [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T03:36:12.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:12 smithi084 ceph-mon[30941]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:13.238 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T03:36:13.273 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi172:vg_nvme/lv_3 2024-09-21T03:36:13.528 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:36:13.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:13 smithi084 ceph-mon[30941]: from='osd.3 [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T03:36:13.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:13 smithi084 ceph-mon[30941]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T03:36:13.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:13 smithi084 ceph-mon[30941]: from='osd.3 [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T03:36:13.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:13 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:36:13.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:13 smithi084 ceph-mon[30941]: Detected new or changed devices on smithi084 2024-09-21T03:36:13.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:13 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:13.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:13 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:13.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:13 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:36:13.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:13 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:36:13.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:13 smithi084 ceph-mon[30941]: Adjusting osd_memory_target on smithi084 to 8544M 2024-09-21T03:36:13.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:13 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:13.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:13 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:13.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:13 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:36:13.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:13 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:13.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:13 smithi174 ceph-mon[34403]: from='osd.3 [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T03:36:13.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:13 smithi174 ceph-mon[34403]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T03:36:13.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:13 smithi174 ceph-mon[34403]: from='osd.3 [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T03:36:13.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:13 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:36:13.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:13 smithi174 ceph-mon[34403]: Detected new or changed devices on smithi084 2024-09-21T03:36:13.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:13 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:13.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:13 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:13.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:13 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:36:13.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:13 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:36:13.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:13 smithi174 ceph-mon[34403]: Adjusting osd_memory_target on smithi084 to 8544M 2024-09-21T03:36:13.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:13 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:13.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:13 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:13.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:13 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:36:13.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:13 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:13.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:13 smithi172 ceph-mon[34821]: from='osd.3 [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T03:36:13.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:13 smithi172 ceph-mon[34821]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T03:36:13.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:13 smithi172 ceph-mon[34821]: from='osd.3 [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T03:36:13.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:13 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:36:13.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:13 smithi172 ceph-mon[34821]: Detected new or changed devices on smithi084 2024-09-21T03:36:13.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:13 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:13.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:13 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:13.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:13 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:36:13.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:13 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:36:13.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:13 smithi172 ceph-mon[34821]: Adjusting osd_memory_target on smithi084 to 8544M 2024-09-21T03:36:13.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:13 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:13.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:13 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:13.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:13 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:36:13.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:13 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:14.068 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 03:36:13 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-3[54560]: 2024-09-21T03:36:13.809+0000 7f1afa8f7640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T03:36:14.068 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 03:36:13 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-3[54560]: 2024-09-21T03:36:13.816+0000 7f1af1ed8640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:36:14.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.128+0000 7f22992c7640 1 -- 172.21.15.172:0/2669363633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2294102ab0 msgr2=0x7f2294102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:14.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.128+0000 7f22992c7640 1 --2- 172.21.15.172:0/2669363633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2294102ab0 0x7f2294102ec0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2284009ca0 tx=0x7f228402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:36:14.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.128+0000 7f22992c7640 1 -- 172.21.15.172:0/2669363633 shutdown_connections 2024-09-21T03:36:14.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.128+0000 7f22992c7640 1 --2- 172.21.15.172:0/2669363633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2294108d40 0x7f229410f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:14.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.128+0000 7f22992c7640 1 --2- 172.21.15.172:0/2669363633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22941083f0 0x7f2294108800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:14.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.128+0000 7f22992c7640 1 --2- 172.21.15.172:0/2669363633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2294102ab0 0x7f2294102ec0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:14.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.128+0000 7f22992c7640 1 -- 172.21.15.172:0/2669363633 >> 172.21.15.172:0/2669363633 conn(0x7f22940797c0 msgr2=0x7f2294079bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:14.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.128+0000 7f22992c7640 1 -- 172.21.15.172:0/2669363633 shutdown_connections 2024-09-21T03:36:14.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.128+0000 7f22992c7640 1 -- 172.21.15.172:0/2669363633 wait complete. 2024-09-21T03:36:14.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.129+0000 7f22992c7640 1 Processor -- start 2024-09-21T03:36:14.151 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.129+0000 7f22992c7640 1 -- start start 2024-09-21T03:36:14.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.129+0000 7f22992c7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2294102ab0 0x7f229419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:14.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.129+0000 7f22992c7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22941083f0 0x7f229419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:14.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.129+0000 7f22992c7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2294108d40 0x7f229419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:14.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.129+0000 7f22992c7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2294112a00 con 0x7f2294108d40 2024-09-21T03:36:14.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.129+0000 7f22992c7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2294112880 con 0x7f2294102ab0 2024-09-21T03:36:14.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.129+0000 7f22992c7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2294112b80 con 0x7f22941083f0 2024-09-21T03:36:14.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.129+0000 7f2292ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2294102ab0 0x7f229419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:14.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.129+0000 7f2292ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2294102ab0 0x7f229419a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43732/0 (socket says 172.21.15.172:43732) 2024-09-21T03:36:14.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.129+0000 7f2292ffd640 1 -- 172.21.15.172:0/3510254444 learned_addr learned my addr 172.21.15.172:0/3510254444 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-21T03:36:14.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.129+0000 7f22937fe640 1 --2- 172.21.15.172:0/3510254444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2294108d40 0x7f229419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:14.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.129+0000 7f22927fc640 1 --2- 172.21.15.172:0/3510254444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22941083f0 0x7f229419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:14.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.130+0000 7f2292ffd640 1 -- 172.21.15.172:0/3510254444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22941083f0 msgr2=0x7f229419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:14.152 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.130+0000 7f2292ffd640 1 --2- 172.21.15.172:0/3510254444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22941083f0 0x7f229419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.130+0000 7f2292ffd640 1 -- 172.21.15.172:0/3510254444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2294108d40 msgr2=0x7f229419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.130+0000 7f2292ffd640 1 --2- 172.21.15.172:0/3510254444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2294108d40 0x7f229419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.130+0000 7f2292ffd640 1 -- 172.21.15.172:0/3510254444 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22941a0430 con 0x7f2294102ab0 2024-09-21T03:36:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.130+0000 7f22937fe640 1 --2- 172.21.15.172:0/3510254444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2294108d40 0x7f229419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:36:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.130+0000 7f2292ffd640 1 --2- 172.21.15.172:0/3510254444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2294102ab0 0x7f229419a4c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f228402ade0 tx=0x7f2284031770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.130+0000 7f227bfff640 1 -- 172.21.15.172:0/3510254444 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284003b70 con 0x7f2294102ab0 2024-09-21T03:36:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.130+0000 7f227bfff640 1 -- 172.21.15.172:0/3510254444 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2284003d10 con 0x7f2294102ab0 2024-09-21T03:36:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.130+0000 7f22992c7640 1 -- 172.21.15.172:0/3510254444 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22941a06c0 con 0x7f2294102ab0 2024-09-21T03:36:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.130+0000 7f227bfff640 1 -- 172.21.15.172:0/3510254444 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228402fa50 con 0x7f2294102ab0 2024-09-21T03:36:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.130+0000 7f22992c7640 1 -- 172.21.15.172:0/3510254444 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22941a6e80 con 0x7f2294102ab0 2024-09-21T03:36:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.131+0000 7f22992c7640 1 -- 172.21.15.172:0/3510254444 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2294103d30 con 0x7f2294102ab0 2024-09-21T03:36:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.133+0000 7f227bfff640 1 -- 172.21.15.172:0/3510254444 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f2284004580 con 0x7f2294102ab0 2024-09-21T03:36:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.134+0000 7f227bfff640 1 --2- 172.21.15.172:0/3510254444 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f227c0b6560 0x7f227c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:14.153 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.134+0000 7f227bfff640 1 -- 172.21.15.172:0/3510254444 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3604+0+0 (secure 0 0 0) 0x7f2284107520 con 0x7f2294102ab0 2024-09-21T03:36:14.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.134+0000 7f22927fc640 1 --2- 172.21.15.172:0/3510254444 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f227c0b6560 0x7f227c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:14.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.134+0000 7f22927fc640 1 --2- 172.21.15.172:0/3510254444 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f227c0b6560 0x7f227c0b8a70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f229406b280 tx=0x7f228800b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:14.154 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.137+0000 7f227bfff640 1 -- 172.21.15.172:0/3510254444 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f22840cefb0 con 0x7f2294102ab0 2024-09-21T03:36:14.327 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:14.324+0000 7f22992c7640 1 -- 172.21.15.172:0/3510254444 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f229410bb50 con 0x7f227c0b6560 2024-09-21T03:36:14.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:14 smithi084 ceph-mon[30941]: from='osd.3 [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T03:36:14.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:14 smithi084 ceph-mon[30941]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T03:36:14.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:14 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:36:14.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:14 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:36:14.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:14 smithi084 ceph-mon[30941]: from='osd.3 [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863]' entity='osd.3' 2024-09-21T03:36:14.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:14 smithi084 ceph-mon[30941]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:14.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:14 smithi084 ceph-mon[30941]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:14.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:14 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:36:14.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:14 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:36:14.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:14 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:14.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:14 smithi084 ceph-mon[30941]: osd.3 [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863] boot 2024-09-21T03:36:14.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:14 smithi084 ceph-mon[30941]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T03:36:14.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:14 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:36:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:14 smithi172 ceph-mon[34821]: from='osd.3 [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T03:36:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:14 smithi172 ceph-mon[34821]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T03:36:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:14 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:36:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:14 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:36:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:14 smithi172 ceph-mon[34821]: from='osd.3 [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863]' entity='osd.3' 2024-09-21T03:36:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:14 smithi172 ceph-mon[34821]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:14 smithi172 ceph-mon[34821]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:14 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:36:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:14 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:36:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:14 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:14 smithi172 ceph-mon[34821]: osd.3 [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863] boot 2024-09-21T03:36:14.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:14 smithi172 ceph-mon[34821]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T03:36:14.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:14 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:36:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:14 smithi174 ceph-mon[34403]: from='osd.3 [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T03:36:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:14 smithi174 ceph-mon[34403]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T03:36:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:14 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:36:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:14 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:36:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:14 smithi174 ceph-mon[34403]: from='osd.3 [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863]' entity='osd.3' 2024-09-21T03:36:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:14 smithi174 ceph-mon[34403]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:36:14.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:14 smithi174 ceph-mon[34403]: from='client.24377 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:14.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:14 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:36:14.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:14 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:36:14.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:14 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:14.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:14 smithi174 ceph-mon[34403]: osd.3 [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863] boot 2024-09-21T03:36:14.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:14 smithi174 ceph-mon[34403]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T03:36:14.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:14 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:36:15.947 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:15 smithi172 ceph-mon[34821]: purged_snaps scrub starts 2024-09-21T03:36:15.947 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:15 smithi172 ceph-mon[34821]: purged_snaps scrub ok 2024-09-21T03:36:15.947 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:15 smithi172 ceph-mon[34821]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T03:36:16.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:15 smithi084 ceph-mon[30941]: purged_snaps scrub starts 2024-09-21T03:36:16.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:15 smithi084 ceph-mon[30941]: purged_snaps scrub ok 2024-09-21T03:36:16.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:15 smithi084 ceph-mon[30941]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T03:36:16.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:15 smithi174 ceph-mon[34403]: purged_snaps scrub starts 2024-09-21T03:36:16.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:15 smithi174 ceph-mon[34403]: purged_snaps scrub ok 2024-09-21T03:36:16.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:15 smithi174 ceph-mon[34403]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T03:36:17.255 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:17 smithi172 ceph-mon[34821]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T03:36:17.255 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:17 smithi172 ceph-mon[34821]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:17.255 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:17 smithi172 ceph-mon[34821]: from='client.? 172.21.15.172:0/492165888' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91a2f83b-4c7d-4661-86a1-63a09888939d"} : dispatch 2024-09-21T03:36:17.255 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:17 smithi172 ceph-mon[34821]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91a2f83b-4c7d-4661-86a1-63a09888939d"} : dispatch 2024-09-21T03:36:17.255 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:17 smithi172 ceph-mon[34821]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91a2f83b-4c7d-4661-86a1-63a09888939d"}]': finished 2024-09-21T03:36:17.255 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:17 smithi172 ceph-mon[34821]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T03:36:17.255 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:17 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:36:17.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:17 smithi174 ceph-mon[34403]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T03:36:17.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:17 smithi174 ceph-mon[34403]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:17.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:17 smithi174 ceph-mon[34403]: from='client.? 172.21.15.172:0/492165888' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91a2f83b-4c7d-4661-86a1-63a09888939d"} : dispatch 2024-09-21T03:36:17.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:17 smithi174 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91a2f83b-4c7d-4661-86a1-63a09888939d"} : dispatch 2024-09-21T03:36:17.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:17 smithi174 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91a2f83b-4c7d-4661-86a1-63a09888939d"}]': finished 2024-09-21T03:36:17.379 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:17 smithi174 ceph-mon[34403]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T03:36:17.379 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:17 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:36:17.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:17 smithi084 ceph-mon[30941]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T03:36:17.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:17 smithi084 ceph-mon[30941]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:17.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:17 smithi084 ceph-mon[30941]: from='client.? 172.21.15.172:0/492165888' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91a2f83b-4c7d-4661-86a1-63a09888939d"} : dispatch 2024-09-21T03:36:17.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:17 smithi084 ceph-mon[30941]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91a2f83b-4c7d-4661-86a1-63a09888939d"} : dispatch 2024-09-21T03:36:17.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:17 smithi084 ceph-mon[30941]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91a2f83b-4c7d-4661-86a1-63a09888939d"}]': finished 2024-09-21T03:36:17.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:17 smithi084 ceph-mon[30941]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T03:36:17.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:17 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:36:18.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:18 smithi174 ceph-mon[34403]: from='client.? 172.21.15.172:0/1956948176' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:36:18.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:18 smithi172 ceph-mon[34821]: from='client.? 172.21.15.172:0/1956948176' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:36:18.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:18 smithi084 ceph-mon[30941]: from='client.? 172.21.15.172:0/1956948176' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:36:19.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:19 smithi174 ceph-mon[34403]: pgmap v90: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:19.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:19 smithi172 ceph-mon[34821]: pgmap v90: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:19.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:19 smithi084 ceph-mon[30941]: pgmap v90: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:21.567 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:21 smithi172 ceph-mon[34821]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-21T03:36:21.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:21 smithi084 ceph-mon[30941]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-21T03:36:21.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:21 smithi174 ceph-mon[34403]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-09-21T03:36:23.478 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:23 smithi172 ceph-mon[34821]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-21T03:36:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:23 smithi084 ceph-mon[30941]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-21T03:36:23.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:23 smithi174 ceph-mon[34403]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-21T03:36:25.400 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:25 smithi172 ceph-mon[34821]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-21T03:36:25.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:25 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T03:36:25.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:25 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:25.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:25 smithi084 ceph-mon[30941]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-21T03:36:25.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:25 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T03:36:25.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:25 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:25.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:25 smithi174 ceph-mon[34403]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-21T03:36:25.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:25 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T03:36:25.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:25 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:26.562 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:26 smithi172 ceph-mon[34821]: Deploying daemon osd.4 on smithi172 2024-09-21T03:36:26.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:26 smithi084 ceph-mon[30941]: Deploying daemon osd.4 on smithi172 2024-09-21T03:36:26.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:26 smithi174 ceph-mon[34403]: Deploying daemon osd.4 on smithi172 2024-09-21T03:36:27.562 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:27 smithi172 ceph-mon[34821]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T03:36:27.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:27 smithi084 ceph-mon[30941]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T03:36:27.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:27 smithi174 ceph-mon[34403]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T03:36:29.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:29 smithi084 ceph-mon[30941]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T03:36:29.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:29 smithi174 ceph-mon[34403]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T03:36:29.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:29 smithi172 ceph-mon[34821]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T03:36:31.545 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:31 smithi172 ceph-mon[34821]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:36:31.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:31 smithi084 ceph-mon[30941]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:36:31.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:31 smithi174 ceph-mon[34403]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:36:32.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:32 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:36:32.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:32 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:32.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:32 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:32.581 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:32 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:36:32.581 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:32 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:32.581 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:32 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:32.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:32 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:36:32.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:32 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:32.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:32 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:33.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:33 smithi084 ceph-mon[30941]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:33.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:33 smithi174 ceph-mon[34403]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:33.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:33 smithi172 ceph-mon[34821]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:35.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:35 smithi084 ceph-mon[30941]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:35.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:35 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:35.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:35 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:35.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:35 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:35.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:35 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:36:35.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:35 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:35.595 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:35 smithi172 ceph-mon[34821]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:35.595 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:35 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:35.595 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:35 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:35.595 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:35 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:35.596 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:35 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:36:35.596 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:35 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:35.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:35 smithi174 ceph-mon[34403]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:35.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:35 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:35.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:35 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:35.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:35 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:35.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:35 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:36:35.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:35 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:35.638 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 4 on host 'smithi172' 2024-09-21T03:36:35.638 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:35.636+0000 7f227bfff640 1 -- 172.21.15.172:0/3510254444 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f229410bb50 con 0x7f227c0b6560 2024-09-21T03:36:35.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:35.638+0000 7f22992c7640 1 -- 172.21.15.172:0/3510254444 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f227c0b6560 msgr2=0x7f227c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:35.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:35.638+0000 7f22992c7640 1 --2- 172.21.15.172:0/3510254444 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f227c0b6560 0x7f227c0b8a70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f229406b280 tx=0x7f228800b410 comp rx=0 tx=0).stop 2024-09-21T03:36:35.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:35.638+0000 7f22992c7640 1 -- 172.21.15.172:0/3510254444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2294102ab0 msgr2=0x7f229419a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:35.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:35.638+0000 7f22992c7640 1 --2- 172.21.15.172:0/3510254444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2294102ab0 0x7f229419a4c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f228402ade0 tx=0x7f2284031770 comp rx=0 tx=0).stop 2024-09-21T03:36:35.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:35.638+0000 7f22992c7640 1 -- 172.21.15.172:0/3510254444 shutdown_connections 2024-09-21T03:36:35.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:35.638+0000 7f22992c7640 1 --2- 172.21.15.172:0/3510254444 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f227c0b6560 0x7f227c0b8a70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:35.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:35.638+0000 7f22992c7640 1 --2- 172.21.15.172:0/3510254444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2294108d40 0x7f229419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:35.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:35.638+0000 7f22992c7640 1 --2- 172.21.15.172:0/3510254444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22941083f0 0x7f229419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:35.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:35.638+0000 7f22992c7640 1 --2- 172.21.15.172:0/3510254444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2294102ab0 0x7f229419a4c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:35.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:35.638+0000 7f22992c7640 1 -- 172.21.15.172:0/3510254444 >> 172.21.15.172:0/3510254444 conn(0x7f22940797c0 msgr2=0x7f229406bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:35.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:35.638+0000 7f22992c7640 1 -- 172.21.15.172:0/3510254444 shutdown_connections 2024-09-21T03:36:35.641 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:36:35.639+0000 7f22992c7640 1 -- 172.21.15.172:0/3510254444 wait complete. 2024-09-21T03:36:36.336 DEBUG:teuthology.orchestra.run.smithi172:osd.4> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T03:36:36.338 INFO:tasks.cephadm:Deploying osd.5 on smithi174 with /dev/vg_nvme/lv_3... 2024-09-21T03:36:36.338 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T03:36:36.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:36 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:36:36.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:36 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:36.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:36 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:36.592 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:36:36.614 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:36 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:36:36.614 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:36 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:36.614 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:36 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:36.627 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:36 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:36:36.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:36 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:36.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:36 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:37.498 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:37 smithi172 ceph-mon[34821]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:37.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:37 smithi084 ceph-mon[30941]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:37.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:37 smithi174 ceph-mon[34403]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:37.830 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 21 03:36:37 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-4[45992]: 2024-09-21T03:36:37.682+0000 7ff31ca88640 -1 osd.4 0 log_to_monitors true 2024-09-21T03:36:38.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:38 smithi084 ceph-mon[30941]: from='osd.4 [v2:172.21.15.172:6808/3069862739,v1:172.21.15.172:6809/3069862739]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:36:38.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:38 smithi084 ceph-mon[30941]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:36:38.586 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:38 smithi174 ceph-mon[34403]: from='osd.4 [v2:172.21.15.172:6808/3069862739,v1:172.21.15.172:6809/3069862739]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:36:38.587 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:38 smithi174 ceph-mon[34403]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:36:38.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:38 smithi172 ceph-mon[34821]: from='osd.4 [v2:172.21.15.172:6808/3069862739,v1:172.21.15.172:6809/3069862739]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:36:38.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:38 smithi172 ceph-mon[34821]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:36:39.119 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:36:39.153 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi174:vg_nvme/lv_3 2024-09-21T03:36:39.379 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:39 smithi174 ceph-mon[34403]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:39.382 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:39 smithi174 ceph-mon[34403]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T03:36:39.382 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:39 smithi174 ceph-mon[34403]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T03:36:39.382 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:39 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:36:39.382 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:39 smithi174 ceph-mon[34403]: from='osd.4 [v2:172.21.15.172:6808/3069862739,v1:172.21.15.172:6809/3069862739]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:36:39.382 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:39 smithi174 ceph-mon[34403]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:36:39.383 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:39 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:39.383 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:39 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:39.383 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:39 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:36:39.383 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:39 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:36:39.383 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:39 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:39.383 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:39 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:39.383 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:39 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:36:39.384 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:39 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:39.402 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:36:39.651 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 21 03:36:39 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-4[45992]: 2024-09-21T03:36:39.319+0000 7ff318a0a640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T03:36:39.651 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 21 03:36:39 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-4[45992]: 2024-09-21T03:36:39.327+0000 7ff314808640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:36:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:39 smithi172 ceph-mon[34821]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:39 smithi172 ceph-mon[34821]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T03:36:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:39 smithi172 ceph-mon[34821]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T03:36:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:39 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:36:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:39 smithi172 ceph-mon[34821]: from='osd.4 [v2:172.21.15.172:6808/3069862739,v1:172.21.15.172:6809/3069862739]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:36:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:39 smithi172 ceph-mon[34821]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:36:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:39 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:39 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:39 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:36:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:39 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:36:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:39 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:39 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:39.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:39 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:36:39.653 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:39 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:39.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:39 smithi084 ceph-mon[30941]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:39.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:39 smithi084 ceph-mon[30941]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T03:36:39.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:39 smithi084 ceph-mon[30941]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T03:36:39.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:39 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:36:39.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:39 smithi084 ceph-mon[30941]: from='osd.4 [v2:172.21.15.172:6808/3069862739,v1:172.21.15.172:6809/3069862739]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:36:39.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:39 smithi084 ceph-mon[30941]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:36:39.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:39 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:39.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:39 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:39.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:39 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:36:39.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:39 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:36:39.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:39 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:39.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:39 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:39.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:39 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:36:39.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:39 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:39.878 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.868+0000 7faf404dc640 1 -- 172.21.15.174:0/2808921348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf38109500 msgr2=0x7faf38109910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:39.878 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.868+0000 7faf404dc640 1 --2- 172.21.15.174:0/2808921348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf38109500 0x7faf38109910 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faf28009900 tx=0x7faf2802a3f0 comp rx=0 tx=0).stop 2024-09-21T03:36:39.878 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.868+0000 7faf404dc640 1 -- 172.21.15.174:0/2808921348 shutdown_connections 2024-09-21T03:36:39.878 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.868+0000 7faf404dc640 1 --2- 172.21.15.174:0/2808921348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf38109e50 0x7faf38110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:39.878 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.868+0000 7faf404dc640 1 --2- 172.21.15.174:0/2808921348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf38109500 0x7faf38109910 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:39.878 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.868+0000 7faf404dc640 1 --2- 172.21.15.174:0/2808921348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf38101fc0 0x7faf381023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:39.878 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.868+0000 7faf404dc640 1 -- 172.21.15.174:0/2808921348 >> 172.21.15.174:0/2808921348 conn(0x7faf38079f90 msgr2=0x7faf3807a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:39.878 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.868+0000 7faf404dc640 1 -- 172.21.15.174:0/2808921348 shutdown_connections 2024-09-21T03:36:39.878 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.868+0000 7faf404dc640 1 -- 172.21.15.174:0/2808921348 wait complete. 2024-09-21T03:36:39.878 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.869+0000 7faf404dc640 1 Processor -- start 2024-09-21T03:36:39.878 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.869+0000 7faf404dc640 1 -- start start 2024-09-21T03:36:39.879 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.869+0000 7faf404dc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf38101fc0 0x7faf38102f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:39.879 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.869+0000 7faf404dc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf38109500 0x7faf381034a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:39.879 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.869+0000 7faf404dc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf38109e50 0x7faf381039e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:39.879 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.869+0000 7faf404dc640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faf38113b10 con 0x7faf38109e50 2024-09-21T03:36:39.879 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.869+0000 7faf404dc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faf38113990 con 0x7faf38101fc0 2024-09-21T03:36:39.879 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.869+0000 7faf404dc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7faf38113c90 con 0x7faf38109500 2024-09-21T03:36:39.879 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.869+0000 7faf3da77640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf38109500 0x7faf381034a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:39.879 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.869+0000 7faf3da77640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf38109500 0x7faf381034a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:43670/0 (socket says 172.21.15.174:43670) 2024-09-21T03:36:39.879 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.869+0000 7faf3da77640 1 -- 172.21.15.174:0/1856260195 learned_addr learned my addr 172.21.15.174:0/1856260195 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-21T03:36:39.879 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.869+0000 7faf3e278640 1 --2- 172.21.15.174:0/1856260195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf38101fc0 0x7faf38102f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:39.879 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.869+0000 7faf3ea79640 1 --2- 172.21.15.174:0/1856260195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf38109e50 0x7faf381039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:39.879 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.869+0000 7faf3da77640 1 -- 172.21.15.174:0/1856260195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf38101fc0 msgr2=0x7faf38102f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:39.879 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.869+0000 7faf3da77640 1 --2- 172.21.15.174:0/1856260195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf38101fc0 0x7faf38102f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:39.880 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.869+0000 7faf3da77640 1 -- 172.21.15.174:0/1856260195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf38109e50 msgr2=0x7faf381039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:39.880 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.869+0000 7faf3da77640 1 --2- 172.21.15.174:0/1856260195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf38109e50 0x7faf381039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:39.880 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.869+0000 7faf3da77640 1 -- 172.21.15.174:0/1856260195 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf381a8710 con 0x7faf38109500 2024-09-21T03:36:39.880 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.869+0000 7faf3ea79640 1 --2- 172.21.15.174:0/1856260195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf38109e50 0x7faf381039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:36:39.880 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.870+0000 7faf3da77640 1 --2- 172.21.15.174:0/1856260195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf38109500 0x7faf381034a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faf2802a910 tx=0x7faf28004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:39.880 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.870+0000 7faf2f7fe640 1 -- 172.21.15.174:0/1856260195 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2803f030 con 0x7faf38109500 2024-09-21T03:36:39.880 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.870+0000 7faf2f7fe640 1 -- 172.21.15.174:0/1856260195 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf28003aa0 con 0x7faf38109500 2024-09-21T03:36:39.880 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.870+0000 7faf2f7fe640 1 -- 172.21.15.174:0/1856260195 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28035070 con 0x7faf38109500 2024-09-21T03:36:39.880 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.870+0000 7faf404dc640 1 -- 172.21.15.174:0/1856260195 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf381a89a0 con 0x7faf38109500 2024-09-21T03:36:39.880 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.870+0000 7faf404dc640 1 -- 172.21.15.174:0/1856260195 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf381a8ed0 con 0x7faf38109500 2024-09-21T03:36:39.880 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.871+0000 7faf404dc640 1 -- 172.21.15.174:0/1856260195 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf3806b910 con 0x7faf38109500 2024-09-21T03:36:39.880 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.873+0000 7faf2f7fe640 1 -- 172.21.15.174:0/1856260195 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7faf28042030 con 0x7faf38109500 2024-09-21T03:36:39.880 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.873+0000 7faf2f7fe640 1 --2- 172.21.15.174:0/1856260195 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7faf240b65e0 0x7faf240b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:39.880 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.873+0000 7faf2f7fe640 1 -- 172.21.15.174:0/1856260195 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4036+0+0 (secure 0 0 0) 0x7faf28106d70 con 0x7faf38109500 2024-09-21T03:36:39.881 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.874+0000 7faf3e278640 1 --2- 172.21.15.174:0/1856260195 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7faf240b65e0 0x7faf240b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:39.881 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.874+0000 7faf3e278640 1 --2- 172.21.15.174:0/1856260195 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7faf240b65e0 0x7faf240b8af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faf381049b0 tx=0x7faf3400b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:39.881 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:39.877+0000 7faf2f7fe640 1 -- 172.21.15.174:0/1856260195 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faf280ce6b0 con 0x7faf38109500 2024-09-21T03:36:40.065 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:36:40.064+0000 7faf404dc640 1 -- 172.21.15.174:0/1856260195 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7faf38063800 con 0x7faf240b65e0 2024-09-21T03:36:40.599 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:40 smithi174 ceph-mon[34403]: Detected new or changed devices on smithi172 2024-09-21T03:36:40.599 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:40 smithi174 ceph-mon[34403]: Adjusting osd_memory_target on smithi172 to 8544M 2024-09-21T03:36:40.599 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:40 smithi174 ceph-mon[34403]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T03:36:40.599 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:40 smithi174 ceph-mon[34403]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T03:36:40.599 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:40 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:36:40.599 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:40 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:36:40.599 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:40 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:36:40.599 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:40 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:36:40.600 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:40 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:40.600 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:40 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:36:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:40 smithi172 ceph-mon[34821]: Detected new or changed devices on smithi172 2024-09-21T03:36:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:40 smithi172 ceph-mon[34821]: Adjusting osd_memory_target on smithi172 to 8544M 2024-09-21T03:36:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:40 smithi172 ceph-mon[34821]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T03:36:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:40 smithi172 ceph-mon[34821]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T03:36:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:40 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:36:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:40 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:36:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:40 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:36:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:40 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:36:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:40 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:40.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:40 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:36:40.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:40 smithi084 ceph-mon[30941]: Detected new or changed devices on smithi172 2024-09-21T03:36:40.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:40 smithi084 ceph-mon[30941]: Adjusting osd_memory_target on smithi172 to 8544M 2024-09-21T03:36:40.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:40 smithi084 ceph-mon[30941]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T03:36:40.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:40 smithi084 ceph-mon[30941]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T03:36:40.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:40 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:36:40.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:40 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:36:40.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:40 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:36:40.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:40 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:36:40.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:40 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:40.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:40 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:36:41.476 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:41 smithi174 ceph-mon[34403]: purged_snaps scrub starts 2024-09-21T03:36:41.476 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:41 smithi174 ceph-mon[34403]: purged_snaps scrub ok 2024-09-21T03:36:41.476 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:41 smithi174 ceph-mon[34403]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:41.476 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:41 smithi174 ceph-mon[34403]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:41.476 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:41 smithi174 ceph-mon[34403]: osd.4 [v2:172.21.15.172:6808/3069862739,v1:172.21.15.172:6809/3069862739] boot 2024-09-21T03:36:41.476 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:41 smithi174 ceph-mon[34403]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T03:36:41.476 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:41 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:36:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:41 smithi172 ceph-mon[34821]: purged_snaps scrub starts 2024-09-21T03:36:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:41 smithi172 ceph-mon[34821]: purged_snaps scrub ok 2024-09-21T03:36:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:41 smithi172 ceph-mon[34821]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:41 smithi172 ceph-mon[34821]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:41 smithi172 ceph-mon[34821]: osd.4 [v2:172.21.15.172:6808/3069862739,v1:172.21.15.172:6809/3069862739] boot 2024-09-21T03:36:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:41 smithi172 ceph-mon[34821]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T03:36:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:41 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:36:41.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:41 smithi084 ceph-mon[30941]: purged_snaps scrub starts 2024-09-21T03:36:41.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:41 smithi084 ceph-mon[30941]: purged_snaps scrub ok 2024-09-21T03:36:41.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:41 smithi084 ceph-mon[30941]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:36:41.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:41 smithi084 ceph-mon[30941]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:36:41.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:41 smithi084 ceph-mon[30941]: osd.4 [v2:172.21.15.172:6808/3069862739,v1:172.21.15.172:6809/3069862739] boot 2024-09-21T03:36:41.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:41 smithi084 ceph-mon[30941]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T03:36:41.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:41 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:36:42.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:42 smithi174 ceph-mon[34403]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T03:36:42.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:42 smithi172 ceph-mon[34821]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T03:36:42.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:42 smithi084 ceph-mon[30941]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T03:36:43.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:43 smithi174 ceph-mon[34403]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:43.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:43 smithi174 ceph-mon[34403]: from='client.? 172.21.15.174:0/171271879' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e8f06b34-3956-499f-8073-09011cf1ce0a"} : dispatch 2024-09-21T03:36:43.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:43 smithi174 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e8f06b34-3956-499f-8073-09011cf1ce0a"} : dispatch 2024-09-21T03:36:43.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:43 smithi174 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e8f06b34-3956-499f-8073-09011cf1ce0a"}]': finished 2024-09-21T03:36:43.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:43 smithi174 ceph-mon[34403]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T03:36:43.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:43 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:36:43.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:43 smithi174 ceph-mon[34403]: from='client.? 172.21.15.174:0/2809435416' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:36:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:43 smithi172 ceph-mon[34821]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:43 smithi172 ceph-mon[34821]: from='client.? 172.21.15.174:0/171271879' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e8f06b34-3956-499f-8073-09011cf1ce0a"} : dispatch 2024-09-21T03:36:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:43 smithi172 ceph-mon[34821]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e8f06b34-3956-499f-8073-09011cf1ce0a"} : dispatch 2024-09-21T03:36:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:43 smithi172 ceph-mon[34821]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e8f06b34-3956-499f-8073-09011cf1ce0a"}]': finished 2024-09-21T03:36:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:43 smithi172 ceph-mon[34821]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T03:36:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:43 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:36:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:43 smithi172 ceph-mon[34821]: from='client.? 172.21.15.174:0/2809435416' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:36:43.719 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:43 smithi084 ceph-mon[30941]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:43.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:43 smithi084 ceph-mon[30941]: from='client.? 172.21.15.174:0/171271879' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e8f06b34-3956-499f-8073-09011cf1ce0a"} : dispatch 2024-09-21T03:36:43.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:43 smithi084 ceph-mon[30941]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e8f06b34-3956-499f-8073-09011cf1ce0a"} : dispatch 2024-09-21T03:36:43.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:43 smithi084 ceph-mon[30941]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e8f06b34-3956-499f-8073-09011cf1ce0a"}]': finished 2024-09-21T03:36:43.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:43 smithi084 ceph-mon[30941]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T03:36:43.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:43 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:36:43.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:43 smithi084 ceph-mon[30941]: from='client.? 172.21.15.174:0/2809435416' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:36:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:45 smithi174 ceph-mon[34403]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:45.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:45 smithi172 ceph-mon[34821]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:45.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:45 smithi084 ceph-mon[30941]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:47.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:47 smithi174 ceph-mon[34403]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:47.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:47 smithi172 ceph-mon[34821]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:47.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:47 smithi084 ceph-mon[30941]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:49.624 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:49 smithi174 ceph-mon[34403]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:49.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:49 smithi172 ceph-mon[34821]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:49.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:49 smithi084 ceph-mon[30941]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:51.616 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:51 smithi174 ceph-mon[34403]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:51.616 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T03:36:51.616 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:51.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:51 smithi172 ceph-mon[34821]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:51.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T03:36:51.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:51.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:51 smithi084 ceph-mon[30941]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:51.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T03:36:51.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:52.596 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:52 smithi174 ceph-mon[34403]: Deploying daemon osd.5 on smithi174 2024-09-21T03:36:52.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:52 smithi172 ceph-mon[34821]: Deploying daemon osd.5 on smithi174 2024-09-21T03:36:52.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:52 smithi084 ceph-mon[30941]: Deploying daemon osd.5 on smithi174 2024-09-21T03:36:53.476 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:53 smithi174 ceph-mon[34403]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:53.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:53 smithi172 ceph-mon[34821]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:53.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:53 smithi084 ceph-mon[30941]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:54.481 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:54 smithi174 ceph-mon[34403]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:54.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:54 smithi084 ceph-mon[30941]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:54.999 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:54 smithi172 ceph-mon[34821]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:57.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:57 smithi174 ceph-mon[34403]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:57.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:57 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:36:57.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:57 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:57.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:57 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:57.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:57 smithi084 ceph-mon[30941]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:57.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:57 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:36:57.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:57 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:57.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:57 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:57.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:57 smithi172 ceph-mon[34821]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:57.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:57 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:36:57.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:57 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:57.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:57 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:36:59.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:36:59 smithi084 ceph-mon[30941]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:59.618 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:36:59 smithi174 ceph-mon[34403]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:36:59.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:36:59 smithi172 ceph-mon[34821]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:37:01.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:00 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:01.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:00 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:01.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:00 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:01.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:00 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:01.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:00 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:01.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:00 smithi084 ceph-mon[30941]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:37:01.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:00 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:01.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:00 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:01.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:00 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:01.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:00 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:01.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:00 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:01.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:00 smithi174 ceph-mon[34403]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:37:01.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:00 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:01.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:00 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:01.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:00 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:01.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:00 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:01.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:00 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:01.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:00 smithi172 ceph-mon[34821]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:37:01.187 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:01.185+0000 7faf2f7fe640 1 -- 172.21.15.174:0/1856260195 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7faf38063800 con 0x7faf240b65e0 2024-09-21T03:37:01.187 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 5 on host 'smithi174' 2024-09-21T03:37:01.189 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:01.187+0000 7faf404dc640 1 -- 172.21.15.174:0/1856260195 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7faf240b65e0 msgr2=0x7faf240b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:01.189 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:01.187+0000 7faf404dc640 1 --2- 172.21.15.174:0/1856260195 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7faf240b65e0 0x7faf240b8af0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faf381049b0 tx=0x7faf3400b410 comp rx=0 tx=0).stop 2024-09-21T03:37:01.189 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:01.187+0000 7faf404dc640 1 -- 172.21.15.174:0/1856260195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf38109500 msgr2=0x7faf381034a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:01.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:01.187+0000 7faf404dc640 1 --2- 172.21.15.174:0/1856260195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf38109500 0x7faf381034a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faf2802a910 tx=0x7faf28004270 comp rx=0 tx=0).stop 2024-09-21T03:37:01.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:01.188+0000 7faf404dc640 1 -- 172.21.15.174:0/1856260195 shutdown_connections 2024-09-21T03:37:01.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:01.188+0000 7faf404dc640 1 --2- 172.21.15.174:0/1856260195 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7faf240b65e0 0x7faf240b8af0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:01.188+0000 7faf404dc640 1 --2- 172.21.15.174:0/1856260195 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf38109e50 0x7faf381039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:01.188+0000 7faf404dc640 1 --2- 172.21.15.174:0/1856260195 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf38109500 0x7faf381034a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:01.188+0000 7faf404dc640 1 --2- 172.21.15.174:0/1856260195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf38101fc0 0x7faf38102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:01.188+0000 7faf404dc640 1 -- 172.21.15.174:0/1856260195 >> 172.21.15.174:0/1856260195 conn(0x7faf38079f90 msgr2=0x7faf381075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:01.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:01.188+0000 7faf404dc640 1 -- 172.21.15.174:0/1856260195 shutdown_connections 2024-09-21T03:37:01.190 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:01.188+0000 7faf404dc640 1 -- 172.21.15.174:0/1856260195 wait complete. 2024-09-21T03:37:01.811 DEBUG:teuthology.orchestra.run.smithi174:osd.5> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T03:37:01.813 INFO:tasks.cephadm:Deploying osd.6 on smithi084 with /dev/vg_nvme/lv_2... 2024-09-21T03:37:01.813 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T03:37:02.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:01 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:37:02.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:01 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:02.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:01 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:02.069 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:37:02.106 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:01 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:37:02.106 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:01 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:02.106 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:01 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:02.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:01 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:37:02.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:01 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:02.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:01 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:03.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:02 smithi084 ceph-mon[30941]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:37:03.121 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:02 smithi174 ceph-mon[34403]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:37:03.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:02 smithi172 ceph-mon[34821]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:37:03.379 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:37:03 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:37:03.304+0000 7fba9ec20640 -1 osd.5 0 log_to_monitors true 2024-09-21T03:37:04.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:03 smithi084 ceph-mon[30941]: from='osd.5 [v2:172.21.15.174:6808/1987010600,v1:172.21.15.174:6809/1987010600]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:37:04.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:03 smithi084 ceph-mon[30941]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:37:04.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:03 smithi174 ceph-mon[34403]: from='osd.5 [v2:172.21.15.174:6808/1987010600,v1:172.21.15.174:6809/1987010600]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:37:04.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:03 smithi174 ceph-mon[34403]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:37:04.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:03 smithi172 ceph-mon[34821]: from='osd.5 [v2:172.21.15.174:6808/1987010600,v1:172.21.15.174:6809/1987010600]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:37:04.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:03 smithi172 ceph-mon[34821]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:37:04.681 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:37:04.708 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi084:vg_nvme/lv_2 2024-09-21T03:37:04.957 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:37:05.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:04 smithi084 ceph-mon[30941]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T03:37:05.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:04 smithi084 ceph-mon[30941]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T03:37:05.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:04 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:37:05.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:04 smithi084 ceph-mon[30941]: from='osd.5 [v2:172.21.15.174:6808/1987010600,v1:172.21.15.174:6809/1987010600]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:37:05.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:04 smithi084 ceph-mon[30941]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:37:05.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:04 smithi084 ceph-mon[30941]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:37:05.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:04 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:05.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:04 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:05.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:04 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:05.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:04 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:05.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:04 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:05.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:04 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:05.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:04 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:05.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:04 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:05.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:04 smithi174 ceph-mon[34403]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T03:37:05.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:04 smithi174 ceph-mon[34403]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T03:37:05.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:04 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:37:05.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:04 smithi174 ceph-mon[34403]: from='osd.5 [v2:172.21.15.174:6808/1987010600,v1:172.21.15.174:6809/1987010600]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:37:05.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:04 smithi174 ceph-mon[34403]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:37:05.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:04 smithi174 ceph-mon[34403]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:37:05.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:04 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:05.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:04 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:05.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:04 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:05.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:04 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:05.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:04 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:05.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:04 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:05.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:04 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:05.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:04 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:05.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:04 smithi172 ceph-mon[34821]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T03:37:05.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:04 smithi172 ceph-mon[34821]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T03:37:05.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:04 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:37:05.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:04 smithi172 ceph-mon[34821]: from='osd.5 [v2:172.21.15.174:6808/1987010600,v1:172.21.15.174:6809/1987010600]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:37:05.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:04 smithi172 ceph-mon[34821]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:37:05.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:04 smithi172 ceph-mon[34821]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:37:05.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:04 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:05.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:04 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:05.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:04 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:05.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:04 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:05.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:04 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:05.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:04 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:05.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:04 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:05.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:04 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:05.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.463+0000 7f51d5a8b640 1 -- 172.21.15.84:0/2287338561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51d01094b0 msgr2=0x7f51d01098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:05.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.463+0000 7f51d5a8b640 1 --2- 172.21.15.84:0/2287338561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51d01094b0 0x7f51d01098c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009900 tx=0x7f51b802a410 comp rx=0 tx=0).stop 2024-09-21T03:37:05.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.463+0000 7f51d5a8b640 1 -- 172.21.15.84:0/2287338561 shutdown_connections 2024-09-21T03:37:05.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.463+0000 7f51d5a8b640 1 --2- 172.21.15.84:0/2287338561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51d0109e00 0x7f51d0110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:05.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.463+0000 7f51d5a8b640 1 --2- 172.21.15.84:0/2287338561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51d01094b0 0x7f51d01098c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:05.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.463+0000 7f51d5a8b640 1 --2- 172.21.15.84:0/2287338561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51d0103b70 0x7f51d0103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:05.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.463+0000 7f51d5a8b640 1 -- 172.21.15.84:0/2287338561 >> 172.21.15.84:0/2287338561 conn(0x7f51d00ff5e0 msgr2=0x7f51d0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:05.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.463+0000 7f51d5a8b640 1 -- 172.21.15.84:0/2287338561 shutdown_connections 2024-09-21T03:37:05.468 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.463+0000 7f51d5a8b640 1 -- 172.21.15.84:0/2287338561 wait complete. 2024-09-21T03:37:05.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.464+0000 7f51d5a8b640 1 Processor -- start 2024-09-21T03:37:05.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.464+0000 7f51d5a8b640 1 -- start start 2024-09-21T03:37:05.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.464+0000 7f51d5a8b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51d0103b70 0x7f51d019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:05.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.464+0000 7f51d5a8b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51d01094b0 0x7f51d019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:05.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.464+0000 7f51d5a8b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51d0109e00 0x7f51d019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:05.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.465+0000 7f51d5a8b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f51d0113ac0 con 0x7f51d01094b0 2024-09-21T03:37:05.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.465+0000 7f51d5a8b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f51d0113940 con 0x7f51d0103b70 2024-09-21T03:37:05.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.465+0000 7f51d5a8b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f51d0113c40 con 0x7f51d0109e00 2024-09-21T03:37:05.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.465+0000 7f51ceffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51d01094b0 0x7f51d019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:05.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.465+0000 7f51ceffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51d01094b0 0x7f51d019aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40412/0 (socket says 172.21.15.84:40412) 2024-09-21T03:37:05.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.465+0000 7f51ceffd640 1 -- 172.21.15.84:0/2237399049 learned_addr learned my addr 172.21.15.84:0/2237399049 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:37:05.469 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.465+0000 7f51cffff640 1 --2- 172.21.15.84:0/2237399049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51d0109e00 0x7f51d019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:05.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.465+0000 7f51cf7fe640 1 --2- 172.21.15.84:0/2237399049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51d0103b70 0x7f51d019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:05.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.465+0000 7f51ceffd640 1 -- 172.21.15.84:0/2237399049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51d0109e00 msgr2=0x7f51d019fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:05.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.465+0000 7f51ceffd640 1 --2- 172.21.15.84:0/2237399049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51d0109e00 0x7f51d019fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:05.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.465+0000 7f51ceffd640 1 -- 172.21.15.84:0/2237399049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51d0103b70 msgr2=0x7f51d019a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:05.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.465+0000 7f51ceffd640 1 --2- 172.21.15.84:0/2237399049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51d0103b70 0x7f51d019a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:05.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.465+0000 7f51ceffd640 1 -- 172.21.15.84:0/2237399049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d01a0380 con 0x7f51d01094b0 2024-09-21T03:37:05.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.465+0000 7f51ceffd640 1 --2- 172.21.15.84:0/2237399049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51d01094b0 0x7f51d019aa70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f51b802a930 tx=0x7f51b8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:05.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.465+0000 7f51ccff9640 1 -- 172.21.15.84:0/2237399049 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b803f030 con 0x7f51d01094b0 2024-09-21T03:37:05.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.465+0000 7f51ccff9640 1 -- 172.21.15.84:0/2237399049 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51b8003aa0 con 0x7f51d01094b0 2024-09-21T03:37:05.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.465+0000 7f51d5a8b640 1 -- 172.21.15.84:0/2237399049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d01a0610 con 0x7f51d01094b0 2024-09-21T03:37:05.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.465+0000 7f51ccff9640 1 -- 172.21.15.84:0/2237399049 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b8035070 con 0x7f51d01094b0 2024-09-21T03:37:05.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.466+0000 7f51d5a8b640 1 -- 172.21.15.84:0/2237399049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d01a0af0 con 0x7f51d01094b0 2024-09-21T03:37:05.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.466+0000 7f51d5a8b640 1 -- 172.21.15.84:0/2237399049 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51d0103f80 con 0x7f51d01094b0 2024-09-21T03:37:05.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.469+0000 7f51ccff9640 1 -- 172.21.15.84:0/2237399049 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f51b8042030 con 0x7f51d01094b0 2024-09-21T03:37:05.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.470+0000 7f51ccff9640 1 --2- 172.21.15.84:0/2237399049 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f51bc0b6590 0x7f51bc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:05.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.470+0000 7f51cf7fe640 1 --2- 172.21.15.84:0/2237399049 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f51bc0b6590 0x7f51bc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:05.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.470+0000 7f51ccff9640 1 -- 172.21.15.84:0/2237399049 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4501+0+0 (secure 0 0 0) 0x7f51b8106e80 con 0x7f51d01094b0 2024-09-21T03:37:05.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.470+0000 7f51cf7fe640 1 --2- 172.21.15.84:0/2237399049 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f51bc0b6590 0x7f51bc0b8aa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f51c000abe0 tx=0x7f51c000a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:05.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.473+0000 7f51ccff9640 1 -- 172.21.15.84:0/2237399049 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f51b80ce5f0 con 0x7f51d01094b0 2024-09-21T03:37:05.628 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:37:05 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:37:05.207+0000 7fba9b3b7640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T03:37:05.628 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:37:05 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:37:05.214+0000 7fba92998640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:37:05.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:05.659+0000 7f51d5a8b640 1 -- 172.21.15.84:0/2237399049 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f51d0063800 con 0x7f51bc0b6590 2024-09-21T03:37:06.032 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:05 smithi084 ceph-mon[30941]: Detected new or changed devices on smithi174 2024-09-21T03:37:06.032 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:05 smithi084 ceph-mon[30941]: Adjusting osd_memory_target on smithi174 to 8544M 2024-09-21T03:37:06.032 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:05 smithi084 ceph-mon[30941]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T03:37:06.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:05 smithi084 ceph-mon[30941]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T03:37:06.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:05 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:37:06.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:05 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:37:06.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:05 smithi084 ceph-mon[30941]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T03:37:06.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:05 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:37:06.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:05 smithi084 ceph-mon[30941]: from='osd.5 ' entity='osd.5' 2024-09-21T03:37:06.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:05 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:37:06.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:05 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:37:06.033 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:05 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:06.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:05 smithi174 ceph-mon[34403]: Detected new or changed devices on smithi174 2024-09-21T03:37:06.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:05 smithi174 ceph-mon[34403]: Adjusting osd_memory_target on smithi174 to 8544M 2024-09-21T03:37:06.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:05 smithi174 ceph-mon[34403]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T03:37:06.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:05 smithi174 ceph-mon[34403]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T03:37:06.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:05 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:37:06.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:05 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:37:06.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:05 smithi174 ceph-mon[34403]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T03:37:06.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:05 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:37:06.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:05 smithi174 ceph-mon[34403]: from='osd.5 ' entity='osd.5' 2024-09-21T03:37:06.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:05 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:37:06.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:05 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:37:06.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:05 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:06.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:05 smithi172 ceph-mon[34821]: Detected new or changed devices on smithi174 2024-09-21T03:37:06.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:05 smithi172 ceph-mon[34821]: Adjusting osd_memory_target on smithi174 to 8544M 2024-09-21T03:37:06.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:05 smithi172 ceph-mon[34821]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T03:37:06.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:05 smithi172 ceph-mon[34821]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T03:37:06.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:05 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:37:06.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:05 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:37:06.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:05 smithi172 ceph-mon[34821]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T03:37:06.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:05 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:37:06.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:05 smithi172 ceph-mon[34821]: from='osd.5 ' entity='osd.5' 2024-09-21T03:37:06.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:05 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:37:06.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:05 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:37:06.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:05 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:07.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:06 smithi084 ceph-mon[30941]: purged_snaps scrub starts 2024-09-21T03:37:07.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:06 smithi084 ceph-mon[30941]: purged_snaps scrub ok 2024-09-21T03:37:07.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:06 smithi084 ceph-mon[30941]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:07.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:06 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:37:07.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:06 smithi084 ceph-mon[30941]: osd.5 [v2:172.21.15.174:6808/1987010600,v1:172.21.15.174:6809/1987010600] boot 2024-09-21T03:37:07.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:06 smithi084 ceph-mon[30941]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T03:37:07.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:06 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:37:07.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:06 smithi084 ceph-mon[30941]: pgmap v123: 1 pgs: 1 remapped+peering; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:37:07.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:06 smithi174 ceph-mon[34403]: purged_snaps scrub starts 2024-09-21T03:37:07.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:06 smithi174 ceph-mon[34403]: purged_snaps scrub ok 2024-09-21T03:37:07.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:06 smithi174 ceph-mon[34403]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:07.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:06 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:37:07.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:06 smithi174 ceph-mon[34403]: osd.5 [v2:172.21.15.174:6808/1987010600,v1:172.21.15.174:6809/1987010600] boot 2024-09-21T03:37:07.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:06 smithi174 ceph-mon[34403]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T03:37:07.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:06 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:37:07.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:06 smithi174 ceph-mon[34403]: pgmap v123: 1 pgs: 1 remapped+peering; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:37:07.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:06 smithi172 ceph-mon[34821]: purged_snaps scrub starts 2024-09-21T03:37:07.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:06 smithi172 ceph-mon[34821]: purged_snaps scrub ok 2024-09-21T03:37:07.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:06 smithi172 ceph-mon[34821]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:07.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:06 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:37:07.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:06 smithi172 ceph-mon[34821]: osd.5 [v2:172.21.15.174:6808/1987010600,v1:172.21.15.174:6809/1987010600] boot 2024-09-21T03:37:07.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:06 smithi172 ceph-mon[34821]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T03:37:07.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:06 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:37:07.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:06 smithi172 ceph-mon[34821]: pgmap v123: 1 pgs: 1 remapped+peering; 577 KiB data, 146 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:37:08.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:08 smithi174 ceph-mon[34403]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T03:37:08.387 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:08 smithi084 ceph-mon[30941]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T03:37:08.400 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:08 smithi172 ceph-mon[34821]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T03:37:09.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:09 smithi174 ceph-mon[34403]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T03:37:09.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:09 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1370378743' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23d55e96-4987-4cbe-8c6b-cece4de9269b"} : dispatch 2024-09-21T03:37:09.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:09 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1370378743' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23d55e96-4987-4cbe-8c6b-cece4de9269b"}]': finished 2024-09-21T03:37:09.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:09 smithi174 ceph-mon[34403]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T03:37:09.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:09 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:37:09.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:09 smithi174 ceph-mon[34403]: pgmap v127: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:37:09.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:09 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/4031359004' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:37:09.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:09 smithi172 ceph-mon[34821]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T03:37:09.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:09 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1370378743' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23d55e96-4987-4cbe-8c6b-cece4de9269b"} : dispatch 2024-09-21T03:37:09.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:09 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1370378743' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23d55e96-4987-4cbe-8c6b-cece4de9269b"}]': finished 2024-09-21T03:37:09.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:09 smithi172 ceph-mon[34821]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T03:37:09.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:09 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:37:09.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:09 smithi172 ceph-mon[34821]: pgmap v127: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:37:09.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:09 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/4031359004' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:37:09.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:09 smithi084 ceph-mon[30941]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T03:37:09.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:09 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1370378743' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "23d55e96-4987-4cbe-8c6b-cece4de9269b"} : dispatch 2024-09-21T03:37:09.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:09 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1370378743' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23d55e96-4987-4cbe-8c6b-cece4de9269b"}]': finished 2024-09-21T03:37:09.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:09 smithi084 ceph-mon[30941]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T03:37:09.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:09 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:37:09.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:09 smithi084 ceph-mon[30941]: pgmap v127: 1 pgs: 1 remapped+peering; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:37:09.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:09 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/4031359004' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:37:11.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:11 smithi084 ceph-mon[30941]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-09-21T03:37:11.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:11 smithi174 ceph-mon[34403]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-09-21T03:37:11.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:11 smithi172 ceph-mon[34821]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-09-21T03:37:13.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:13 smithi084 ceph-mon[30941]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:37:13.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:13 smithi174 ceph-mon[34403]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:37:13.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:13 smithi172 ceph-mon[34821]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:37:15.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:15 smithi084 ceph-mon[30941]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-21T03:37:15.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:15 smithi174 ceph-mon[34403]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-21T03:37:15.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:15 smithi172 ceph-mon[34821]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-09-21T03:37:17.440 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:17 smithi084 ceph-mon[30941]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-21T03:37:17.441 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:17 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T03:37:17.441 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:17 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:17.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:17 smithi174 ceph-mon[34403]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-21T03:37:17.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:17 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T03:37:17.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:17 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:17.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:17 smithi172 ceph-mon[34821]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-09-21T03:37:17.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:17 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T03:37:17.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:17 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:18.420 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:18 smithi084 ceph-mon[30941]: Deploying daemon osd.6 on smithi084 2024-09-21T03:37:18.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:18 smithi174 ceph-mon[34403]: Deploying daemon osd.6 on smithi084 2024-09-21T03:37:18.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:18 smithi172 ceph-mon[34821]: Deploying daemon osd.6 on smithi084 2024-09-21T03:37:19.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:19 smithi084 ceph-mon[30941]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T03:37:19.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:19 smithi174 ceph-mon[34403]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T03:37:19.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:19 smithi172 ceph-mon[34821]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2024-09-21T03:37:21.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:21 smithi084 ceph-mon[30941]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:37:21.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:21 smithi174 ceph-mon[34403]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:37:21.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:21 smithi172 ceph-mon[34821]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:37:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:23 smithi084 ceph-mon[30941]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:37:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:37:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:23.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:23 smithi174 ceph-mon[34403]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:37:23.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:37:23.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:23.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:23.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:23 smithi172 ceph-mon[34821]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:37:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:37:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:25.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:25 smithi084 ceph-mon[30941]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:37:25.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:25 smithi174 ceph-mon[34403]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:37:25.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:25 smithi172 ceph-mon[34821]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:37:26.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:26 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:26.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:26 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:26.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:26 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:26.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:26 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:26.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:26 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:26.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:26 smithi084 ceph-mon[30941]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:37:26.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:26.978+0000 7f51ccff9640 1 -- 172.21.15.84:0/2237399049 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f51d0063800 con 0x7f51bc0b6590 2024-09-21T03:37:26.980 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 6 on host 'smithi084' 2024-09-21T03:37:26.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:26.980+0000 7f51d5a8b640 1 -- 172.21.15.84:0/2237399049 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f51bc0b6590 msgr2=0x7f51bc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:26.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:26.980+0000 7f51d5a8b640 1 --2- 172.21.15.84:0/2237399049 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f51bc0b6590 0x7f51bc0b8aa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f51c000abe0 tx=0x7f51c000a2d0 comp rx=0 tx=0).stop 2024-09-21T03:37:26.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:26.980+0000 7f51d5a8b640 1 -- 172.21.15.84:0/2237399049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51d01094b0 msgr2=0x7f51d019aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:26.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:26.980+0000 7f51d5a8b640 1 --2- 172.21.15.84:0/2237399049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51d01094b0 0x7f51d019aa70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f51b802a930 tx=0x7f51b8004270 comp rx=0 tx=0).stop 2024-09-21T03:37:26.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:26.980+0000 7f51d5a8b640 1 -- 172.21.15.84:0/2237399049 shutdown_connections 2024-09-21T03:37:26.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:26.980+0000 7f51d5a8b640 1 --2- 172.21.15.84:0/2237399049 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f51bc0b6590 0x7f51bc0b8aa0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:26.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:26.980+0000 7f51d5a8b640 1 --2- 172.21.15.84:0/2237399049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51d0109e00 0x7f51d019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:26.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:26.980+0000 7f51d5a8b640 1 --2- 172.21.15.84:0/2237399049 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51d01094b0 0x7f51d019aa70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:26.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:26.980+0000 7f51d5a8b640 1 --2- 172.21.15.84:0/2237399049 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51d0103b70 0x7f51d019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:26.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:26.980+0000 7f51d5a8b640 1 -- 172.21.15.84:0/2237399049 >> 172.21.15.84:0/2237399049 conn(0x7f51d00ff5e0 msgr2=0x7f51d0101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:26.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:26.980+0000 7f51d5a8b640 1 -- 172.21.15.84:0/2237399049 shutdown_connections 2024-09-21T03:37:26.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:37:26.980+0000 7f51d5a8b640 1 -- 172.21.15.84:0/2237399049 wait complete. 2024-09-21T03:37:27.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:26 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:27.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:26 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:27.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:26 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:27.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:26 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:27.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:26 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:27.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:26 smithi174 ceph-mon[34403]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:37:27.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:26 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:27.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:26 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:27.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:26 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:27.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:26 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:27.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:26 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:27.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:26 smithi172 ceph-mon[34821]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:37:27.819 DEBUG:teuthology.orchestra.run.smithi084:osd.6> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T03:37:27.822 INFO:tasks.cephadm:Deploying osd.7 on smithi172 with /dev/vg_nvme/lv_2... 2024-09-21T03:37:27.822 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T03:37:28.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:27 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:37:28.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:27 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:28.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:27 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:28.076 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:37:28.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:27 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:37:28.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:27 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:28.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:27 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:28.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:27 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:37:28.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:27 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:28.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:27 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:29.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:28 smithi084 ceph-mon[30941]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:37:29.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:28 smithi084 ceph-mon[30941]: from='osd.6 [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T03:37:29.068 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:37:28 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:37:28.652+0000 7fd9ea5a7640 -1 osd.6 0 log_to_monitors true 2024-09-21T03:37:29.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:28 smithi174 ceph-mon[34403]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:37:29.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:28 smithi174 ceph-mon[34403]: from='osd.6 [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T03:37:29.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:28 smithi172 ceph-mon[34821]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:37:29.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:28 smithi172 ceph-mon[34821]: from='osd.6 [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T03:37:30.068 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:37:29 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:37:29.807+0000 7fd9e6529640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T03:37:30.068 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:37:29 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:37:29.816+0000 7fd9e2327640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:37:30.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:29 smithi084 ceph-mon[30941]: from='osd.6 [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T03:37:30.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:29 smithi084 ceph-mon[30941]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T03:37:30.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:29 smithi084 ceph-mon[30941]: from='osd.6 [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T03:37:30.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:29 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:37:30.081 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:29 smithi172 ceph-mon[34821]: from='osd.6 [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T03:37:30.081 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:29 smithi172 ceph-mon[34821]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T03:37:30.082 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:29 smithi172 ceph-mon[34821]: from='osd.6 [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T03:37:30.082 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:29 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:37:30.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:29 smithi174 ceph-mon[34403]: from='osd.6 [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T03:37:30.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:29 smithi174 ceph-mon[34403]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T03:37:30.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:29 smithi174 ceph-mon[34403]: from='osd.6 [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T03:37:30.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:29 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:37:30.721 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T03:37:30.747 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi172:vg_nvme/lv_2 2024-09-21T03:37:31.004 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:37:31.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:30 smithi084 ceph-mon[30941]: from='osd.6 [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T03:37:31.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:30 smithi084 ceph-mon[30941]: osdmap e42: 7 total, 6 up, 7 in 2024-09-21T03:37:31.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:30 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:37:31.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:30 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:37:31.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:30 smithi084 ceph-mon[30941]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:37:31.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:30 smithi174 ceph-mon[34403]: from='osd.6 [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T03:37:31.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:30 smithi174 ceph-mon[34403]: osdmap e42: 7 total, 6 up, 7 in 2024-09-21T03:37:31.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:30 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:37:31.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:30 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:37:31.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:30 smithi174 ceph-mon[34403]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:37:31.129 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:30 smithi172 ceph-mon[34821]: from='osd.6 [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T03:37:31.129 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:30 smithi172 ceph-mon[34821]: osdmap e42: 7 total, 6 up, 7 in 2024-09-21T03:37:31.129 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:30 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:37:31.129 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:30 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:37:31.129 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:30 smithi172 ceph-mon[34821]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 177 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:37:31.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.504+0000 7fa65f69d640 1 -- 172.21.15.172:0/3957120311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa658109df0 msgr2=0x7fa658110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:31.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.504+0000 7fa65f69d640 1 --2- 172.21.15.172:0/3957120311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa658109df0 0x7fa658110620 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa650009900 tx=0x7fa65002a410 comp rx=0 tx=0).stop 2024-09-21T03:37:31.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.504+0000 7fa65f69d640 1 -- 172.21.15.172:0/3957120311 shutdown_connections 2024-09-21T03:37:31.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.504+0000 7fa65f69d640 1 --2- 172.21.15.172:0/3957120311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa658109df0 0x7fa658110620 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:31.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.504+0000 7fa65f69d640 1 --2- 172.21.15.172:0/3957120311 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6581094a0 0x7fa6581098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:31.530 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.504+0000 7fa65f69d640 1 --2- 172.21.15.172:0/3957120311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa658103b60 0x7fa658103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:31.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.504+0000 7fa65f69d640 1 -- 172.21.15.172:0/3957120311 >> 172.21.15.172:0/3957120311 conn(0x7fa65807b850 msgr2=0x7fa65807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:31.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.504+0000 7fa65f69d640 1 -- 172.21.15.172:0/3957120311 shutdown_connections 2024-09-21T03:37:31.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.504+0000 7fa65f69d640 1 -- 172.21.15.172:0/3957120311 wait complete. 2024-09-21T03:37:31.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.505+0000 7fa65f69d640 1 Processor -- start 2024-09-21T03:37:31.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.505+0000 7fa65f69d640 1 -- start start 2024-09-21T03:37:31.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.505+0000 7fa65f69d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa658103b60 0x7fa65819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:31.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.505+0000 7fa65f69d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6581094a0 0x7fa65819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:31.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.505+0000 7fa65f69d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa658109df0 0x7fa65819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:31.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.505+0000 7fa65f69d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa658113ab0 con 0x7fa6581094a0 2024-09-21T03:37:31.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.505+0000 7fa65f69d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa658113930 con 0x7fa658109df0 2024-09-21T03:37:31.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.505+0000 7fa65f69d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa658113c30 con 0x7fa658103b60 2024-09-21T03:37:31.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.505+0000 7fa65dc3a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa658109df0 0x7fa65819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:31.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.505+0000 7fa65dc3a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa658109df0 0x7fa65819fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:43420/0 (socket says 172.21.15.172:43420) 2024-09-21T03:37:31.531 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.505+0000 7fa65dc3a640 1 -- 172.21.15.172:0/2152746009 learned_addr learned my addr 172.21.15.172:0/2152746009 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-21T03:37:31.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.505+0000 7fa65cc38640 1 --2- 172.21.15.172:0/2152746009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6581094a0 0x7fa65819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:31.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.505+0000 7fa65d439640 1 --2- 172.21.15.172:0/2152746009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa658103b60 0x7fa65819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:31.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.505+0000 7fa65dc3a640 1 -- 172.21.15.172:0/2152746009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa658103b60 msgr2=0x7fa65819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:31.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.505+0000 7fa65dc3a640 1 --2- 172.21.15.172:0/2152746009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa658103b60 0x7fa65819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:31.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.505+0000 7fa65dc3a640 1 -- 172.21.15.172:0/2152746009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6581094a0 msgr2=0x7fa65819aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:31.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.505+0000 7fa65dc3a640 1 --2- 172.21.15.172:0/2152746009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6581094a0 0x7fa65819aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:31.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.505+0000 7fa65dc3a640 1 -- 172.21.15.172:0/2152746009 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6581a0450 con 0x7fa658109df0 2024-09-21T03:37:31.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.506+0000 7fa65dc3a640 1 --2- 172.21.15.172:0/2152746009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa658109df0 0x7fa65819fd20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa650004770 tx=0x7fa650004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:31.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.506+0000 7fa6567fc640 1 -- 172.21.15.172:0/2152746009 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65003f030 con 0x7fa658109df0 2024-09-21T03:37:31.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.506+0000 7fa6567fc640 1 -- 172.21.15.172:0/2152746009 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa650003aa0 con 0x7fa658109df0 2024-09-21T03:37:31.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.506+0000 7fa65f69d640 1 -- 172.21.15.172:0/2152746009 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6581a06e0 con 0x7fa658109df0 2024-09-21T03:37:31.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.506+0000 7fa6567fc640 1 -- 172.21.15.172:0/2152746009 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa650035070 con 0x7fa658109df0 2024-09-21T03:37:31.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.506+0000 7fa65f69d640 1 -- 172.21.15.172:0/2152746009 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6581a6ea0 con 0x7fa658109df0 2024-09-21T03:37:31.532 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.507+0000 7fa65f69d640 1 -- 172.21.15.172:0/2152746009 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa658104de0 con 0x7fa658109df0 2024-09-21T03:37:31.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.508+0000 7fa6567fc640 1 -- 172.21.15.172:0/2152746009 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fa650042030 con 0x7fa658109df0 2024-09-21T03:37:31.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.509+0000 7fa6567fc640 1 --2- 172.21.15.172:0/2152746009 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa6400b6560 0x7fa6400b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:31.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.509+0000 7fa6567fc640 1 -- 172.21.15.172:0/2152746009 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5180+0+0 (secure 0 0 0) 0x7fa650106d10 con 0x7fa658109df0 2024-09-21T03:37:31.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.509+0000 7fa65d439640 1 --2- 172.21.15.172:0/2152746009 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa6400b6560 0x7fa6400b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:31.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.510+0000 7fa65d439640 1 --2- 172.21.15.172:0/2152746009 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa6400b6560 0x7fa6400b8a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa648005fd0 tx=0x7fa648009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:31.533 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.514+0000 7fa6567fc640 1 -- 172.21.15.172:0/2152746009 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6500d25c0 con 0x7fa658109df0 2024-09-21T03:37:31.703 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:31.701+0000 7fa65f69d640 1 -- 172.21.15.172:0/2152746009 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fa65810bc50 con 0x7fa6400b6560 2024-09-21T03:37:32.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:31 smithi084 ceph-mon[30941]: purged_snaps scrub starts 2024-09-21T03:37:32.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:31 smithi084 ceph-mon[30941]: purged_snaps scrub ok 2024-09-21T03:37:32.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:31 smithi084 ceph-mon[30941]: osd.6 [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345] boot 2024-09-21T03:37:32.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:31 smithi084 ceph-mon[30941]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T03:37:32.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:31 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:37:32.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:31 smithi084 ceph-mon[30941]: Detected new or changed devices on smithi084 2024-09-21T03:37:32.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:31 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:32.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:31 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:32.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:31 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:32.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:31 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:32.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:31 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:32.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:31 smithi084 ceph-mon[30941]: Adjusting osd_memory_target on smithi084 to 5696M 2024-09-21T03:37:32.070 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:31 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:32.070 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:31 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:32.070 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:31 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:32.070 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:31 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:32.070 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:31 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:37:32.070 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:31 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:37:32.070 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:31 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:32.084 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:31 smithi172 ceph-mon[34821]: purged_snaps scrub starts 2024-09-21T03:37:32.084 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:31 smithi172 ceph-mon[34821]: purged_snaps scrub ok 2024-09-21T03:37:32.084 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:31 smithi172 ceph-mon[34821]: osd.6 [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345] boot 2024-09-21T03:37:32.084 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:31 smithi172 ceph-mon[34821]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T03:37:32.084 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:31 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:37:32.085 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:31 smithi172 ceph-mon[34821]: Detected new or changed devices on smithi084 2024-09-21T03:37:32.085 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:31 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:32.085 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:31 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:32.085 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:31 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:32.085 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:31 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:32.085 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:31 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:32.085 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:31 smithi172 ceph-mon[34821]: Adjusting osd_memory_target on smithi084 to 5696M 2024-09-21T03:37:32.085 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:31 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:32.085 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:31 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:32.085 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:31 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:32.085 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:31 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:32.085 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:31 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:37:32.085 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:31 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:37:32.085 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:31 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:32.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:31 smithi174 ceph-mon[34403]: purged_snaps scrub starts 2024-09-21T03:37:32.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:31 smithi174 ceph-mon[34403]: purged_snaps scrub ok 2024-09-21T03:37:32.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:31 smithi174 ceph-mon[34403]: osd.6 [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345] boot 2024-09-21T03:37:32.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:31 smithi174 ceph-mon[34403]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T03:37:32.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:31 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:37:32.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:31 smithi174 ceph-mon[34403]: Detected new or changed devices on smithi084 2024-09-21T03:37:32.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:31 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:32.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:31 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:32.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:31 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:32.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:31 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:32.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:31 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:32.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:31 smithi174 ceph-mon[34403]: Adjusting osd_memory_target on smithi084 to 5696M 2024-09-21T03:37:32.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:31 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:32.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:31 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:32.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:31 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:32.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:31 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:32.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:31 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:37:32.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:31 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:37:32.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:31 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:33.121 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:32 smithi172 ceph-mon[34821]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:33.121 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:32 smithi172 ceph-mon[34821]: osdmap e44: 7 total, 7 up, 7 in 2024-09-21T03:37:33.121 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:32 smithi172 ceph-mon[34821]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:33.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:32 smithi084 ceph-mon[30941]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:33.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:32 smithi084 ceph-mon[30941]: osdmap e44: 7 total, 7 up, 7 in 2024-09-21T03:37:33.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:32 smithi084 ceph-mon[30941]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:33.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:32 smithi174 ceph-mon[34403]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:33.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:32 smithi174 ceph-mon[34403]: osdmap e44: 7 total, 7 up, 7 in 2024-09-21T03:37:33.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:32 smithi174 ceph-mon[34403]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:34.535 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:34 smithi172 ceph-mon[34821]: from='client.? 172.21.15.172:0/3541914194' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ca91a34c-d8b1-48b8-93f4-72a5c15939d0"} : dispatch 2024-09-21T03:37:34.535 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:34 smithi172 ceph-mon[34821]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ca91a34c-d8b1-48b8-93f4-72a5c15939d0"} : dispatch 2024-09-21T03:37:34.535 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:34 smithi172 ceph-mon[34821]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca91a34c-d8b1-48b8-93f4-72a5c15939d0"}]': finished 2024-09-21T03:37:34.535 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:34 smithi172 ceph-mon[34821]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T03:37:34.535 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:34 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:37:34.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:34 smithi084 ceph-mon[30941]: from='client.? 172.21.15.172:0/3541914194' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ca91a34c-d8b1-48b8-93f4-72a5c15939d0"} : dispatch 2024-09-21T03:37:34.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:34 smithi084 ceph-mon[30941]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ca91a34c-d8b1-48b8-93f4-72a5c15939d0"} : dispatch 2024-09-21T03:37:34.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:34 smithi084 ceph-mon[30941]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca91a34c-d8b1-48b8-93f4-72a5c15939d0"}]': finished 2024-09-21T03:37:34.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:34 smithi084 ceph-mon[30941]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T03:37:34.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:34 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:37:34.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:34 smithi174 ceph-mon[34403]: from='client.? 172.21.15.172:0/3541914194' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ca91a34c-d8b1-48b8-93f4-72a5c15939d0"} : dispatch 2024-09-21T03:37:34.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:34 smithi174 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ca91a34c-d8b1-48b8-93f4-72a5c15939d0"} : dispatch 2024-09-21T03:37:34.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:34 smithi174 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca91a34c-d8b1-48b8-93f4-72a5c15939d0"}]': finished 2024-09-21T03:37:34.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:34 smithi174 ceph-mon[34403]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T03:37:34.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:34 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:37:35.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:35 smithi084 ceph-mon[30941]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:35.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:35 smithi084 ceph-mon[30941]: from='client.? 172.21.15.172:0/412092211' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:37:35.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:35 smithi174 ceph-mon[34403]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:35.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:35 smithi174 ceph-mon[34403]: from='client.? 172.21.15.172:0/412092211' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:37:35.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:35 smithi172 ceph-mon[34821]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:35.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:35 smithi172 ceph-mon[34821]: from='client.? 172.21.15.172:0/412092211' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:37:37.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:37 smithi084 ceph-mon[30941]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:37.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:37 smithi174 ceph-mon[34403]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:37.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:37 smithi172 ceph-mon[34821]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:39.364 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:39 smithi172 ceph-mon[34821]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:39.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:39 smithi084 ceph-mon[30941]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:39.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:39 smithi174 ceph-mon[34403]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:41.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:41 smithi172 ceph-mon[34821]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:41.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:41 smithi084 ceph-mon[30941]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:41.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:41 smithi174 ceph-mon[34403]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:42.528 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T03:37:42.528 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:42.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T03:37:42.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:42.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T03:37:42.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:43.552 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:43 smithi172 ceph-mon[34821]: Deploying daemon osd.7 on smithi172 2024-09-21T03:37:43.552 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:43 smithi172 ceph-mon[34821]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:43.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:43 smithi084 ceph-mon[30941]: Deploying daemon osd.7 on smithi172 2024-09-21T03:37:43.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:43 smithi084 ceph-mon[30941]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:43.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:43 smithi174 ceph-mon[34403]: Deploying daemon osd.7 on smithi172 2024-09-21T03:37:43.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:43 smithi174 ceph-mon[34403]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:45.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:45 smithi084 ceph-mon[30941]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:45.578 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:45 smithi172 ceph-mon[34821]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:45 smithi174 ceph-mon[34403]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:47.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:47 smithi172 ceph-mon[34821]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:47.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:47 smithi084 ceph-mon[30941]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:47.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:47 smithi174 ceph-mon[34403]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:49.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:49 smithi172 ceph-mon[34821]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:49.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:49 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:37:49.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:49 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:49.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:49 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:49.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:49 smithi084 ceph-mon[30941]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:49.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:49 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:37:49.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:49 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:49.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:49 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:49.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:49 smithi174 ceph-mon[34403]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:49.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:49 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:37:49.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:49 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:49.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:49 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:51.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:51 smithi084 ceph-mon[30941]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:51.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:51.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:51.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:51.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:51.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:51 smithi174 ceph-mon[34403]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:51.648 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:51 smithi172 ceph-mon[34821]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:51.648 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:51.648 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:51.648 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:51.648 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:51.648 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:52.337 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:52.335+0000 7fa6567fc640 1 -- 172.21.15.172:0/2152746009 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa64801b410 con 0x7fa6400b6560 2024-09-21T03:37:52.337 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 7 on host 'smithi172' 2024-09-21T03:37:52.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:52.337+0000 7fa65f69d640 1 -- 172.21.15.172:0/2152746009 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa6400b6560 msgr2=0x7fa6400b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:52.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:52.337+0000 7fa65f69d640 1 --2- 172.21.15.172:0/2152746009 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa6400b6560 0x7fa6400b8a70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa648005fd0 tx=0x7fa648009500 comp rx=0 tx=0).stop 2024-09-21T03:37:52.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:52.337+0000 7fa65f69d640 1 -- 172.21.15.172:0/2152746009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa658109df0 msgr2=0x7fa65819fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:52.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:52.337+0000 7fa65f69d640 1 --2- 172.21.15.172:0/2152746009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa658109df0 0x7fa65819fd20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa650004770 tx=0x7fa650004270 comp rx=0 tx=0).stop 2024-09-21T03:37:52.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:52.337+0000 7fa65f69d640 1 -- 172.21.15.172:0/2152746009 shutdown_connections 2024-09-21T03:37:52.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:52.337+0000 7fa65f69d640 1 --2- 172.21.15.172:0/2152746009 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa6400b6560 0x7fa6400b8a70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:52.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:52.337+0000 7fa65f69d640 1 --2- 172.21.15.172:0/2152746009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa658109df0 0x7fa65819fd20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:52.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:52.337+0000 7fa65f69d640 1 --2- 172.21.15.172:0/2152746009 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6581094a0 0x7fa65819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:52.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:52.337+0000 7fa65f69d640 1 --2- 172.21.15.172:0/2152746009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa658103b60 0x7fa65819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:52.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:52.337+0000 7fa65f69d640 1 -- 172.21.15.172:0/2152746009 >> 172.21.15.172:0/2152746009 conn(0x7fa65807b850 msgr2=0x7fa658105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:52.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:52.337+0000 7fa65f69d640 1 -- 172.21.15.172:0/2152746009 shutdown_connections 2024-09-21T03:37:52.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:37:52.337+0000 7fa65f69d640 1 -- 172.21.15.172:0/2152746009 wait complete. 2024-09-21T03:37:53.061 DEBUG:teuthology.orchestra.run.smithi172:osd.7> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T03:37:53.064 INFO:tasks.cephadm:Deploying osd.8 on smithi174 with /dev/vg_nvme/lv_2... 2024-09-21T03:37:53.064 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T03:37:53.317 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:37:53.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:53 smithi174 ceph-mon[34403]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:53.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:37:53.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:53.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:53 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:53.552 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:53 smithi172 ceph-mon[34821]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:53.552 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:37:53.552 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:53.552 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:53 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:53.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:53 smithi084 ceph-mon[30941]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:53.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:37:53.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:53.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:53 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:54.576 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:37:54 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:37:54.444+0000 7fc44176e640 -1 osd.7 0 log_to_monitors true 2024-09-21T03:37:55.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:55 smithi174 ceph-mon[34403]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:55.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:55 smithi174 ceph-mon[34403]: from='osd.7 [v2:172.21.15.172:6816/4056019738,v1:172.21.15.172:6817/4056019738]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:37:55.379 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:55 smithi174 ceph-mon[34403]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:37:55.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:55 smithi084 ceph-mon[30941]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:55.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:55 smithi084 ceph-mon[30941]: from='osd.7 [v2:172.21.15.172:6816/4056019738,v1:172.21.15.172:6817/4056019738]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:37:55.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:55 smithi084 ceph-mon[30941]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:37:55.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:55 smithi172 ceph-mon[34821]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:55.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:55 smithi172 ceph-mon[34821]: from='osd.7 [v2:172.21.15.172:6816/4056019738,v1:172.21.15.172:6817/4056019738]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:37:55.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:55 smithi172 ceph-mon[34821]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:37:55.878 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:37:55.904 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi174:vg_nvme/lv_2 2024-09-21T03:37:56.164 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:37:56.553 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:56 smithi174 ceph-mon[34403]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T03:37:56.554 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:56 smithi174 ceph-mon[34403]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T03:37:56.554 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:56 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:37:56.554 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:56 smithi174 ceph-mon[34403]: from='osd.7 [v2:172.21.15.172:6816/4056019738,v1:172.21.15.172:6817/4056019738]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:37:56.554 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:56 smithi174 ceph-mon[34403]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:37:56.554 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:56 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:56.554 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:56 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:56.554 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:56 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:56.554 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:56 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:56.554 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:56 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:56.554 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:56 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:56.554 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:56 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:56.555 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:56 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:56.555 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:56 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:56.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:56 smithi084 ceph-mon[30941]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T03:37:56.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:56 smithi084 ceph-mon[30941]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T03:37:56.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:56 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:37:56.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:56 smithi084 ceph-mon[30941]: from='osd.7 [v2:172.21.15.172:6816/4056019738,v1:172.21.15.172:6817/4056019738]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:37:56.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:56 smithi084 ceph-mon[30941]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:37:56.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:56 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:56.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:56 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:56.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:56 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:56.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:56 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:56.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:56 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:56.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:56 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:56.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:56 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:56.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:56 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:56.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:56 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:56.646 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.644+0000 7f876b4b0640 1 -- 172.21.15.174:0/62196912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8764108d00 msgr2=0x7f876410f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:56.647 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.644+0000 7f876b4b0640 1 --2- 172.21.15.174:0/62196912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8764108d00 0x7f876410f530 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f875c009900 tx=0x7f875c02a410 comp rx=0 tx=0).stop 2024-09-21T03:37:56.647 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.644+0000 7f876b4b0640 1 -- 172.21.15.174:0/62196912 shutdown_connections 2024-09-21T03:37:56.647 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.644+0000 7f876b4b0640 1 --2- 172.21.15.174:0/62196912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8764108d00 0x7f876410f530 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:56.647 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.644+0000 7f876b4b0640 1 --2- 172.21.15.174:0/62196912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87641083b0 0x7f87641087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:56.647 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.644+0000 7f876b4b0640 1 --2- 172.21.15.174:0/62196912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8764102a70 0x7f8764102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:56.647 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.644+0000 7f876b4b0640 1 -- 172.21.15.174:0/62196912 >> 172.21.15.174:0/62196912 conn(0x7f8764079730 msgr2=0x7f8764079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:56.647 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.645+0000 7f876b4b0640 1 -- 172.21.15.174:0/62196912 shutdown_connections 2024-09-21T03:37:56.647 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.645+0000 7f876b4b0640 1 -- 172.21.15.174:0/62196912 wait complete. 2024-09-21T03:37:56.649 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.645+0000 7f876b4b0640 1 Processor -- start 2024-09-21T03:37:56.649 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.645+0000 7f876b4b0640 1 -- start start 2024-09-21T03:37:56.649 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.646+0000 7f876b4b0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8764102a70 0x7f8764199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:56.649 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.646+0000 7f876b4b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87641083b0 0x7f8764199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:56.649 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.646+0000 7f876b4b0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8764108d00 0x7f876419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:56.649 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.646+0000 7f876b4b0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8764112970 con 0x7f87641083b0 2024-09-21T03:37:56.649 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.646+0000 7f876b4b0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f87641127f0 con 0x7f8764102a70 2024-09-21T03:37:56.649 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.646+0000 7f876b4b0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8764112af0 con 0x7f8764108d00 2024-09-21T03:37:56.649 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.646+0000 7f8769a4d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8764108d00 0x7f876419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:56.649 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.646+0000 7f876924c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8764102a70 0x7f8764199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:56.650 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.646+0000 7f8769a4d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8764108d00 0x7f876419eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:56610/0 (socket says 172.21.15.174:56610) 2024-09-21T03:37:56.650 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.646+0000 7f8769a4d640 1 -- 172.21.15.174:0/4098315657 learned_addr learned my addr 172.21.15.174:0/4098315657 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-21T03:37:56.650 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.646+0000 7f876924c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8764102a70 0x7f8764199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.174:60364/0 (socket says 172.21.15.174:60364) 2024-09-21T03:37:56.650 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.646+0000 7f8768a4b640 1 --2- 172.21.15.174:0/4098315657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87641083b0 0x7f8764199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:56.650 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.646+0000 7f8769a4d640 1 -- 172.21.15.174:0/4098315657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8764102a70 msgr2=0x7f8764199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:56.650 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.646+0000 7f8769a4d640 1 --2- 172.21.15.174:0/4098315657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8764102a70 0x7f8764199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:56.650 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.646+0000 7f8769a4d640 1 -- 172.21.15.174:0/4098315657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87641083b0 msgr2=0x7f8764199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:56.650 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.646+0000 7f8769a4d640 1 --2- 172.21.15.174:0/4098315657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87641083b0 0x7f8764199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:56.650 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.646+0000 7f8769a4d640 1 -- 172.21.15.174:0/4098315657 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876419f2d0 con 0x7f8764108d00 2024-09-21T03:37:56.650 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.646+0000 7f8769a4d640 1 --2- 172.21.15.174:0/4098315657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8764108d00 0x7f876419eba0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f875c004770 tx=0x7f875c004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:56.650 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.646+0000 7f87627fc640 1 -- 172.21.15.174:0/4098315657 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c046070 con 0x7f8764108d00 2024-09-21T03:37:56.650 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.647+0000 7f876b4b0640 1 -- 172.21.15.174:0/4098315657 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f876419f560 con 0x7f8764108d00 2024-09-21T03:37:56.650 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.647+0000 7f87627fc640 1 -- 172.21.15.174:0/4098315657 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f875c003aa0 con 0x7f8764108d00 2024-09-21T03:37:56.651 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.647+0000 7f87627fc640 1 -- 172.21.15.174:0/4098315657 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c035050 con 0x7f8764108d00 2024-09-21T03:37:56.651 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.647+0000 7f876b4b0640 1 -- 172.21.15.174:0/4098315657 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f876406bae0 con 0x7f8764108d00 2024-09-21T03:37:56.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:56 smithi172 ceph-mon[34821]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T03:37:56.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:56 smithi172 ceph-mon[34821]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T03:37:56.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:56 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:37:56.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:56 smithi172 ceph-mon[34821]: from='osd.7 [v2:172.21.15.172:6816/4056019738,v1:172.21.15.172:6817/4056019738]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:37:56.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:56 smithi172 ceph-mon[34821]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:37:56.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:56 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:56.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:56 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:56.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:56 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:56.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:56 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:56.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:56 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:37:56.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:56 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:56.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:56 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:56.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:56 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:56.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:56 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:37:56.653 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.648+0000 7f876b4b0640 1 -- 172.21.15.174:0/4098315657 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8764103cf0 con 0x7f8764108d00 2024-09-21T03:37:56.653 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.649+0000 7f87627fc640 1 -- 172.21.15.174:0/4098315657 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f875c049070 con 0x7f8764108d00 2024-09-21T03:37:56.653 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.650+0000 7f87627fc640 1 --2- 172.21.15.174:0/4098315657 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f874c0b6560 0x7f874c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:56.653 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.650+0000 7f87627fc640 1 -- 172.21.15.174:0/4098315657 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5332+0+0 (secure 0 0 0) 0x7f875c108330 con 0x7f8764108d00 2024-09-21T03:37:56.653 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.650+0000 7f876924c640 1 --2- 172.21.15.174:0/4098315657 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f874c0b6560 0x7f874c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:56.653 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.650+0000 7f876924c640 1 --2- 172.21.15.174:0/4098315657 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f874c0b6560 0x7f874c0b8a70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8754005fd0 tx=0x7f8754009760 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:56.656 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.654+0000 7f87627fc640 1 -- 172.21.15.174:0/4098315657 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f875c0d3b40 con 0x7f8764108d00 2024-09-21T03:37:56.843 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:37:56.841+0000 7f876b4b0640 1 -- 172.21.15.174:0/4098315657 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f876406bd40 con 0x7f874c0b6560 2024-09-21T03:37:57.150 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:37:56 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:37:56.767+0000 7fc43d6f0640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T03:37:57.151 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:37:56 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:37:56.777+0000 7fc4354e6640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:37:57.533 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:57 smithi174 ceph-mon[34403]: Detected new or changed devices on smithi172 2024-09-21T03:37:57.533 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:57 smithi174 ceph-mon[34403]: Adjusting osd_memory_target on smithi172 to 5696M 2024-09-21T03:37:57.533 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:57 smithi174 ceph-mon[34403]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:57.533 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:57 smithi174 ceph-mon[34403]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T03:37:57.534 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:57 smithi174 ceph-mon[34403]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T03:37:57.534 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:57 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:37:57.534 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:57 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:37:57.534 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:57 smithi174 ceph-mon[34403]: from='osd.7 ' entity='osd.7' 2024-09-21T03:37:57.534 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:57 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:37:57.534 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:57 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:37:57.534 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:57 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:57.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:57 smithi172 ceph-mon[34821]: Detected new or changed devices on smithi172 2024-09-21T03:37:57.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:57 smithi172 ceph-mon[34821]: Adjusting osd_memory_target on smithi172 to 5696M 2024-09-21T03:37:57.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:57 smithi172 ceph-mon[34821]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:57.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:57 smithi172 ceph-mon[34821]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T03:37:57.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:57 smithi172 ceph-mon[34821]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T03:37:57.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:57 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:37:57.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:57 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:37:57.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:57 smithi172 ceph-mon[34821]: from='osd.7 ' entity='osd.7' 2024-09-21T03:37:57.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:57 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:37:57.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:57 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:37:57.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:57 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:57.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:57 smithi084 ceph-mon[30941]: Detected new or changed devices on smithi172 2024-09-21T03:37:57.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:57 smithi084 ceph-mon[30941]: Adjusting osd_memory_target on smithi172 to 5696M 2024-09-21T03:37:57.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:57 smithi084 ceph-mon[30941]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 204 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:37:57.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:57 smithi084 ceph-mon[30941]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T03:37:57.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:57 smithi084 ceph-mon[30941]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T03:37:57.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:57 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:37:57.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:57 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:37:57.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:57 smithi084 ceph-mon[30941]: from='osd.7 ' entity='osd.7' 2024-09-21T03:37:57.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:57 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:37:57.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:57 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:37:57.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:57 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:58.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:58 smithi174 ceph-mon[34403]: purged_snaps scrub starts 2024-09-21T03:37:58.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:58 smithi174 ceph-mon[34403]: purged_snaps scrub ok 2024-09-21T03:37:58.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:58 smithi174 ceph-mon[34403]: from='client.24463 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:58.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:58 smithi174 ceph-mon[34403]: osd.7 [v2:172.21.15.172:6816/4056019738,v1:172.21.15.172:6817/4056019738] boot 2024-09-21T03:37:58.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:58 smithi174 ceph-mon[34403]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T03:37:58.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:58 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:37:58.511 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:58 smithi174 ceph-mon[34403]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T03:37:58.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:58 smithi172 ceph-mon[34821]: purged_snaps scrub starts 2024-09-21T03:37:58.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:58 smithi172 ceph-mon[34821]: purged_snaps scrub ok 2024-09-21T03:37:58.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:58 smithi172 ceph-mon[34821]: from='client.24463 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:58.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:58 smithi172 ceph-mon[34821]: osd.7 [v2:172.21.15.172:6816/4056019738,v1:172.21.15.172:6817/4056019738] boot 2024-09-21T03:37:58.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:58 smithi172 ceph-mon[34821]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T03:37:58.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:58 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:37:58.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:58 smithi172 ceph-mon[34821]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T03:37:58.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:58 smithi084 ceph-mon[30941]: purged_snaps scrub starts 2024-09-21T03:37:58.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:58 smithi084 ceph-mon[30941]: purged_snaps scrub ok 2024-09-21T03:37:58.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:58 smithi084 ceph-mon[30941]: from='client.24463 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:37:58.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:58 smithi084 ceph-mon[30941]: osd.7 [v2:172.21.15.172:6816/4056019738,v1:172.21.15.172:6817/4056019738] boot 2024-09-21T03:37:58.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:58 smithi084 ceph-mon[30941]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T03:37:58.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:58 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:37:58.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:58 smithi084 ceph-mon[30941]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T03:37:59.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:59 smithi174 ceph-mon[34403]: pgmap v160: 1 pgs: 1 unknown; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:37:59.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:59 smithi174 ceph-mon[34403]: from='client.? 172.21.15.174:0/619668732' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "37da8c61-d72f-4b58-b10c-7c7539ecffd0"} : dispatch 2024-09-21T03:37:59.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:59 smithi174 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "37da8c61-d72f-4b58-b10c-7c7539ecffd0"} : dispatch 2024-09-21T03:37:59.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:59 smithi174 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37da8c61-d72f-4b58-b10c-7c7539ecffd0"}]': finished 2024-09-21T03:37:59.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:59 smithi174 ceph-mon[34403]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T03:37:59.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:37:59 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:37:59.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:59 smithi172 ceph-mon[34821]: pgmap v160: 1 pgs: 1 unknown; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:37:59.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:59 smithi172 ceph-mon[34821]: from='client.? 172.21.15.174:0/619668732' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "37da8c61-d72f-4b58-b10c-7c7539ecffd0"} : dispatch 2024-09-21T03:37:59.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:59 smithi172 ceph-mon[34821]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "37da8c61-d72f-4b58-b10c-7c7539ecffd0"} : dispatch 2024-09-21T03:37:59.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:59 smithi172 ceph-mon[34821]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37da8c61-d72f-4b58-b10c-7c7539ecffd0"}]': finished 2024-09-21T03:37:59.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:59 smithi172 ceph-mon[34821]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T03:37:59.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:37:59 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:37:59.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:59 smithi084 ceph-mon[30941]: pgmap v160: 1 pgs: 1 unknown; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:37:59.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:59 smithi084 ceph-mon[30941]: from='client.? 172.21.15.174:0/619668732' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "37da8c61-d72f-4b58-b10c-7c7539ecffd0"} : dispatch 2024-09-21T03:37:59.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:59 smithi084 ceph-mon[30941]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "37da8c61-d72f-4b58-b10c-7c7539ecffd0"} : dispatch 2024-09-21T03:37:59.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:59 smithi084 ceph-mon[30941]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "37da8c61-d72f-4b58-b10c-7c7539ecffd0"}]': finished 2024-09-21T03:37:59.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:59 smithi084 ceph-mon[30941]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T03:37:59.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:37:59 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:38:00.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:00 smithi174 ceph-mon[34403]: from='client.? 172.21.15.174:0/2187733798' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:38:00.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:00 smithi172 ceph-mon[34821]: from='client.? 172.21.15.174:0/2187733798' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:38:00.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:00 smithi084 ceph-mon[30941]: from='client.? 172.21.15.174:0/2187733798' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:38:01.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:01 smithi174 ceph-mon[34403]: pgmap v163: 1 pgs: 1 unknown; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:38:01.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:01 smithi172 ceph-mon[34821]: pgmap v163: 1 pgs: 1 unknown; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:38:01.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:01 smithi084 ceph-mon[30941]: pgmap v163: 1 pgs: 1 unknown; 577 KiB data, 250 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:38:03.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:03 smithi174 ceph-mon[34403]: pgmap v164: 1 pgs: 1 unknown; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:38:03.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:03 smithi172 ceph-mon[34821]: pgmap v164: 1 pgs: 1 unknown; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:38:03.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:03 smithi084 ceph-mon[30941]: pgmap v164: 1 pgs: 1 unknown; 577 KiB data, 251 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:38:05.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:05 smithi174 ceph-mon[34403]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 166 KiB/s, 0 objects/s recovering 2024-09-21T03:38:05.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:05 smithi172 ceph-mon[34821]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 166 KiB/s, 0 objects/s recovering 2024-09-21T03:38:05.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:05 smithi084 ceph-mon[30941]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 166 KiB/s, 0 objects/s recovering 2024-09-21T03:38:07.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:07 smithi174 ceph-mon[34403]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T03:38:07.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:07 smithi172 ceph-mon[34821]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T03:38:07.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:07 smithi084 ceph-mon[30941]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T03:38:08.471 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:08 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T03:38:08.471 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:08 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:08.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:08 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T03:38:08.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:08 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:08.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:08 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T03:38:08.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:08 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:09.469 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:09 smithi174 ceph-mon[34403]: Deploying daemon osd.8 on smithi174 2024-09-21T03:38:09.470 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:09 smithi174 ceph-mon[34403]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-21T03:38:09.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:09 smithi172 ceph-mon[34821]: Deploying daemon osd.8 on smithi174 2024-09-21T03:38:09.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:09 smithi172 ceph-mon[34821]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-21T03:38:09.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:09 smithi084 ceph-mon[30941]: Deploying daemon osd.8 on smithi174 2024-09-21T03:38:09.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:09 smithi084 ceph-mon[30941]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-21T03:38:11.418 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:11 smithi174 ceph-mon[34403]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-21T03:38:11.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:11 smithi172 ceph-mon[34821]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-21T03:38:11.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:11 smithi084 ceph-mon[30941]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-09-21T03:38:13.514 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:13 smithi174 ceph-mon[34403]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:38:13.620 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:13 smithi084 ceph-mon[30941]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:38:13.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:13 smithi172 ceph-mon[34821]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:38:14.522 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:14 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:38:14.522 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:14 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:14.522 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:14 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:14 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:38:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:14 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:14 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:14.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:14 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:38:14.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:14 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:14.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:14 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:15.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:15 smithi174 ceph-mon[34403]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:38:15.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:15 smithi172 ceph-mon[34821]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:38:15.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:15 smithi084 ceph-mon[30941]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:38:17.586 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:17 smithi174 ceph-mon[34403]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:38:17.587 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:17 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:17.587 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:17 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:17.587 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:17 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:17.587 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:17 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:38:17.587 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:17 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:17.630 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:38:17.628+0000 7f87627fc640 1 -- 172.21.15.174:0/4098315657 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f876406bd40 con 0x7f874c0b6560 2024-09-21T03:38:17.630 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 8 on host 'smithi174' 2024-09-21T03:38:17.632 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:38:17.630+0000 7f876b4b0640 1 -- 172.21.15.174:0/4098315657 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f874c0b6560 msgr2=0x7f874c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:17.632 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:38:17.630+0000 7f876b4b0640 1 --2- 172.21.15.174:0/4098315657 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f874c0b6560 0x7f874c0b8a70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8754005fd0 tx=0x7f8754009760 comp rx=0 tx=0).stop 2024-09-21T03:38:17.632 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:38:17.630+0000 7f876b4b0640 1 -- 172.21.15.174:0/4098315657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8764108d00 msgr2=0x7f876419eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:17.632 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:38:17.630+0000 7f876b4b0640 1 --2- 172.21.15.174:0/4098315657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8764108d00 0x7f876419eba0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f875c004770 tx=0x7f875c004270 comp rx=0 tx=0).stop 2024-09-21T03:38:17.633 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:38:17.630+0000 7f876b4b0640 1 -- 172.21.15.174:0/4098315657 shutdown_connections 2024-09-21T03:38:17.633 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:38:17.630+0000 7f876b4b0640 1 --2- 172.21.15.174:0/4098315657 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f874c0b6560 0x7f874c0b8a70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.633 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:38:17.630+0000 7f876b4b0640 1 --2- 172.21.15.174:0/4098315657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8764108d00 0x7f876419eba0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.633 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:38:17.630+0000 7f876b4b0640 1 --2- 172.21.15.174:0/4098315657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87641083b0 0x7f8764199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.633 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:38:17.630+0000 7f876b4b0640 1 --2- 172.21.15.174:0/4098315657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8764102a70 0x7f8764199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.633 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:38:17.631+0000 7f876b4b0640 1 -- 172.21.15.174:0/4098315657 >> 172.21.15.174:0/4098315657 conn(0x7f8764079730 msgr2=0x7f8764104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:17.633 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:38:17.631+0000 7f876b4b0640 1 -- 172.21.15.174:0/4098315657 shutdown_connections 2024-09-21T03:38:17.633 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:38:17.631+0000 7f876b4b0640 1 -- 172.21.15.174:0/4098315657 wait complete. 2024-09-21T03:38:17.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:17 smithi172 ceph-mon[34821]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:38:17.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:17 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:17.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:17 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:17.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:17 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:17.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:17 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:38:17.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:17 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:17.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:17 smithi084 ceph-mon[30941]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:38:17.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:17 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:17.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:17 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:17.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:17 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:17.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:17 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:38:17.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:17 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:18.401 DEBUG:teuthology.orchestra.run.smithi174:osd.8> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T03:38:18.404 INFO:tasks.cephadm:Deploying osd.9 on smithi084 with /dev/vg_nvme/lv_1... 2024-09-21T03:38:18.404 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T03:38:18.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:18 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:38:18.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:18 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:18.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:18 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:18.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:18 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:38:18.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:18 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:18.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:18 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:18.661 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:38:18.782 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:18 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:38:18.782 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:18 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:18.782 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:18 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:19.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:19 smithi174 ceph-mon[34403]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:38:19.628 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:38:19 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:38:19.615+0000 7fd5db3dd640 -1 osd.8 0 log_to_monitors true 2024-09-21T03:38:19.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:19 smithi172 ceph-mon[34821]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:38:19.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:19 smithi084 ceph-mon[30941]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:38:20.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:20 smithi174 ceph-mon[34403]: from='osd.8 [v2:172.21.15.174:6816/2162992546,v1:172.21.15.174:6817/2162992546]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:38:20.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:20 smithi174 ceph-mon[34403]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:38:20.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:20 smithi172 ceph-mon[34821]: from='osd.8 [v2:172.21.15.174:6816/2162992546,v1:172.21.15.174:6817/2162992546]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:38:20.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:20 smithi172 ceph-mon[34821]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:38:20.706 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:20 smithi084 ceph-mon[30941]: from='osd.8 [v2:172.21.15.174:6816/2162992546,v1:172.21.15.174:6817/2162992546]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:38:20.706 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:20 smithi084 ceph-mon[30941]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:38:21.625 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:21 smithi084 ceph-mon[30941]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:38:21.625 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:21 smithi084 ceph-mon[30941]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T03:38:21.625 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:21 smithi084 ceph-mon[30941]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T03:38:21.625 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:21 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:38:21.625 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:21 smithi084 ceph-mon[30941]: from='osd.8 [v2:172.21.15.174:6816/2162992546,v1:172.21.15.174:6817/2162992546]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:38:21.625 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:21 smithi084 ceph-mon[30941]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:38:21.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:21 smithi174 ceph-mon[34403]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:38:21.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:21 smithi174 ceph-mon[34403]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T03:38:21.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:21 smithi174 ceph-mon[34403]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T03:38:21.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:21 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:38:21.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:21 smithi174 ceph-mon[34403]: from='osd.8 [v2:172.21.15.174:6816/2162992546,v1:172.21.15.174:6817/2162992546]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:38:21.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:21 smithi174 ceph-mon[34403]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:38:21.648 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:38:21.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:21 smithi172 ceph-mon[34821]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 235 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:38:21.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:21 smithi172 ceph-mon[34821]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T03:38:21.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:21 smithi172 ceph-mon[34821]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T03:38:21.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:21 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:38:21.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:21 smithi172 ceph-mon[34821]: from='osd.8 [v2:172.21.15.174:6816/2162992546,v1:172.21.15.174:6817/2162992546]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:38:21.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:21 smithi172 ceph-mon[34821]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:38:21.676 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi084:vg_nvme/lv_1 2024-09-21T03:38:21.930 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:38:22.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:38:21 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:38:21.864+0000 7fd5d735f640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T03:38:22.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:38:21 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:38:21.876+0000 7fd5cf155640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:38:22.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.367+0000 7f5afd653640 1 -- 172.21.15.84:0/2849257184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5af8104880 msgr2=0x7f5af8104c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:22.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.367+0000 7f5afd653640 1 --2- 172.21.15.84:0/2849257184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5af8104880 0x7f5af8104c90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5af0009ca0 tx=0x7f5af002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.367+0000 7f5afd653640 1 -- 172.21.15.84:0/2849257184 shutdown_connections 2024-09-21T03:38:22.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.367+0000 7f5afd653640 1 --2- 172.21.15.84:0/2849257184 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5af810de30 0x7f5af8110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.367+0000 7f5afd653640 1 --2- 172.21.15.84:0/2849257184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5af81052b0 0x7f5af810d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.367+0000 7f5afd653640 1 --2- 172.21.15.84:0/2849257184 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5af8104880 0x7f5af8104c90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.367+0000 7f5afd653640 1 -- 172.21.15.84:0/2849257184 >> 172.21.15.84:0/2849257184 conn(0x7f5af8079740 msgr2=0x7f5af8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:22.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.367+0000 7f5afd653640 1 -- 172.21.15.84:0/2849257184 shutdown_connections 2024-09-21T03:38:22.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.367+0000 7f5afd653640 1 -- 172.21.15.84:0/2849257184 wait complete. 2024-09-21T03:38:22.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.368+0000 7f5afd653640 1 Processor -- start 2024-09-21T03:38:22.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.368+0000 7f5afd653640 1 -- start start 2024-09-21T03:38:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.368+0000 7f5afd653640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5af8104880 0x7f5af819c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.368+0000 7f5afd653640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5af81052b0 0x7f5af819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.368+0000 7f5afd653640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5af810de30 0x7f5af81a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.368+0000 7f5afd653640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5af8113aa0 con 0x7f5af8104880 2024-09-21T03:38:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.368+0000 7f5afd653640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5af8113920 con 0x7f5af81052b0 2024-09-21T03:38:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.368+0000 7f5afd653640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5af8113c20 con 0x7f5af810de30 2024-09-21T03:38:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.369+0000 7f5af6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5af8104880 0x7f5af819c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.369+0000 7f5af6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5af8104880 0x7f5af819c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39236/0 (socket says 172.21.15.84:39236) 2024-09-21T03:38:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.369+0000 7f5af6ffd640 1 -- 172.21.15.84:0/3147285910 learned_addr learned my addr 172.21.15.84:0/3147285910 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:38:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.369+0000 7f5af67fc640 1 --2- 172.21.15.84:0/3147285910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5af81052b0 0x7f5af819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.369+0000 7f5af77fe640 1 --2- 172.21.15.84:0/3147285910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5af810de30 0x7f5af81a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.369+0000 7f5af6ffd640 1 -- 172.21.15.84:0/3147285910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5af810de30 msgr2=0x7f5af81a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:22.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.369+0000 7f5af6ffd640 1 --2- 172.21.15.84:0/3147285910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5af810de30 0x7f5af81a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.369+0000 7f5af6ffd640 1 -- 172.21.15.84:0/3147285910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5af81052b0 msgr2=0x7f5af819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.369+0000 7f5af6ffd640 1 --2- 172.21.15.84:0/3147285910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5af81052b0 0x7f5af819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.369+0000 7f5af6ffd640 1 -- 172.21.15.84:0/3147285910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af81a2580 con 0x7f5af8104880 2024-09-21T03:38:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.369+0000 7f5af67fc640 1 --2- 172.21.15.84:0/3147285910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5af81052b0 0x7f5af819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:38:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.369+0000 7f5af6ffd640 1 --2- 172.21.15.84:0/3147285910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5af8104880 0x7f5af819c6d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5af0006010 tx=0x7f5af00319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.369+0000 7f5adffff640 1 -- 172.21.15.84:0/3147285910 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0003bf0 con 0x7f5af8104880 2024-09-21T03:38:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.369+0000 7f5adffff640 1 -- 172.21.15.84:0/3147285910 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5af0003d90 con 0x7f5af8104880 2024-09-21T03:38:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.369+0000 7f5afd653640 1 -- 172.21.15.84:0/3147285910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af81a2810 con 0x7f5af8104880 2024-09-21T03:38:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.369+0000 7f5adffff640 1 -- 172.21.15.84:0/3147285910 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af002fc20 con 0x7f5af8104880 2024-09-21T03:38:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.369+0000 7f5afd653640 1 -- 172.21.15.84:0/3147285910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af81a9090 con 0x7f5af8104880 2024-09-21T03:38:22.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.370+0000 7f5afd653640 1 -- 172.21.15.84:0/3147285910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af806bea0 con 0x7f5af8104880 2024-09-21T03:38:22.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.373+0000 7f5adffff640 1 -- 172.21.15.84:0/3147285910 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f5af00046a0 con 0x7f5af8104880 2024-09-21T03:38:22.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.374+0000 7f5adffff640 1 --2- 172.21.15.84:0/3147285910 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5ae00b6610 0x7f5ae00b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.374+0000 7f5af67fc640 1 --2- 172.21.15.84:0/3147285910 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5ae00b6610 0x7f5ae00b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:22.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.374+0000 7f5adffff640 1 -- 172.21.15.84:0/3147285910 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5764+0+0 (secure 0 0 0) 0x7f5af0107ec0 con 0x7f5af8104880 2024-09-21T03:38:22.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.374+0000 7f5af67fc640 1 --2- 172.21.15.84:0/3147285910 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5ae00b6610 0x7f5ae00b8b20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5af810fc00 tx=0x7f5aec00a5c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:22.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.377+0000 7f5adffff640 1 -- 172.21.15.84:0/3147285910 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5af00cf140 con 0x7f5af8104880 2024-09-21T03:38:22.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:22 smithi084 ceph-mon[30941]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T03:38:22.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:22 smithi084 ceph-mon[30941]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T03:38:22.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:38:22.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:38:22.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:22 smithi084 ceph-mon[30941]: Detected new or changed devices on smithi174 2024-09-21T03:38:22.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:22.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:22.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:22.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:22.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:22.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:22 smithi084 ceph-mon[30941]: Adjusting osd_memory_target on smithi174 to 5696M 2024-09-21T03:38:22.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:22.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:22.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:38:22.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:22.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:22 smithi084 ceph-mon[30941]: from='osd.8 ' entity='osd.8' 2024-09-21T03:38:22.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:22 smithi084 ceph-mon[30941]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:38:22.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:22.569+0000 7f5afd653640 1 -- 172.21.15.84:0/3147285910 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5af8063800 con 0x7f5ae00b6610 2024-09-21T03:38:22.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:22 smithi172 ceph-mon[34821]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T03:38:22.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:22 smithi172 ceph-mon[34821]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T03:38:22.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:38:22.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:38:22.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:22 smithi172 ceph-mon[34821]: Detected new or changed devices on smithi174 2024-09-21T03:38:22.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:22.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:22.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:22.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:22.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:22.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:22 smithi172 ceph-mon[34821]: Adjusting osd_memory_target on smithi174 to 5696M 2024-09-21T03:38:22.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:22.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:22.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:38:22.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:22.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:22 smithi172 ceph-mon[34821]: from='osd.8 ' entity='osd.8' 2024-09-21T03:38:22.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:22 smithi172 ceph-mon[34821]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:38:22.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:22 smithi174 ceph-mon[34403]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T03:38:22.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:22 smithi174 ceph-mon[34403]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T03:38:22.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:38:22.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:38:22.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:22 smithi174 ceph-mon[34403]: Detected new or changed devices on smithi174 2024-09-21T03:38:22.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:22.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:22.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:22.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:22.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:22.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:22 smithi174 ceph-mon[34403]: Adjusting osd_memory_target on smithi174 to 5696M 2024-09-21T03:38:22.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:22.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:22.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:38:22.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:22.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:22 smithi174 ceph-mon[34403]: from='osd.8 ' entity='osd.8' 2024-09-21T03:38:22.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:22 smithi174 ceph-mon[34403]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:38:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:23 smithi084 ceph-mon[30941]: purged_snaps scrub starts 2024-09-21T03:38:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:23 smithi084 ceph-mon[30941]: purged_snaps scrub ok 2024-09-21T03:38:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:23 smithi084 ceph-mon[30941]: osd.8 [v2:172.21.15.174:6816/2162992546,v1:172.21.15.174:6817/2162992546] boot 2024-09-21T03:38:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:23 smithi084 ceph-mon[30941]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T03:38:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:38:23.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:23 smithi084 ceph-mon[30941]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:23.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:38:23.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:38:23.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:23 smithi172 ceph-mon[34821]: purged_snaps scrub starts 2024-09-21T03:38:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:23 smithi172 ceph-mon[34821]: purged_snaps scrub ok 2024-09-21T03:38:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:23 smithi172 ceph-mon[34821]: osd.8 [v2:172.21.15.174:6816/2162992546,v1:172.21.15.174:6817/2162992546] boot 2024-09-21T03:38:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:23 smithi172 ceph-mon[34821]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T03:38:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:38:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:23 smithi172 ceph-mon[34821]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:38:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:38:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:23.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:23 smithi174 ceph-mon[34403]: purged_snaps scrub starts 2024-09-21T03:38:23.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:23 smithi174 ceph-mon[34403]: purged_snaps scrub ok 2024-09-21T03:38:23.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:23 smithi174 ceph-mon[34403]: osd.8 [v2:172.21.15.174:6816/2162992546,v1:172.21.15.174:6817/2162992546] boot 2024-09-21T03:38:23.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:23 smithi174 ceph-mon[34403]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T03:38:23.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:38:23.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:23 smithi174 ceph-mon[34403]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi084:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:23.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:38:23.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:38:23.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:24.735 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:24 smithi084 ceph-mon[30941]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T03:38:24.735 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:24 smithi084 ceph-mon[30941]: pgmap v179: 1 pgs: 1 peering; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:24.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:24 smithi174 ceph-mon[34403]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T03:38:24.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:24 smithi174 ceph-mon[34403]: pgmap v179: 1 pgs: 1 peering; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:24.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:24 smithi172 ceph-mon[34821]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T03:38:24.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:24 smithi172 ceph-mon[34821]: pgmap v179: 1 pgs: 1 peering; 577 KiB data, 288 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:25.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:25 smithi084 ceph-mon[30941]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T03:38:25.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:25 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/111390892' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c9179f33-622d-44bd-9d8a-c92951afb1e4"} : dispatch 2024-09-21T03:38:25.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:25 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/111390892' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9179f33-622d-44bd-9d8a-c92951afb1e4"}]': finished 2024-09-21T03:38:25.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:25 smithi084 ceph-mon[30941]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T03:38:25.449 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:25 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:38:25.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:25 smithi174 ceph-mon[34403]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T03:38:25.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:25 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/111390892' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c9179f33-622d-44bd-9d8a-c92951afb1e4"} : dispatch 2024-09-21T03:38:25.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:25 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/111390892' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9179f33-622d-44bd-9d8a-c92951afb1e4"}]': finished 2024-09-21T03:38:25.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:25 smithi174 ceph-mon[34403]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T03:38:25.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:25 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:38:25.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:25 smithi172 ceph-mon[34821]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T03:38:25.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:25 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/111390892' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c9179f33-622d-44bd-9d8a-c92951afb1e4"} : dispatch 2024-09-21T03:38:25.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:25 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/111390892' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c9179f33-622d-44bd-9d8a-c92951afb1e4"}]': finished 2024-09-21T03:38:25.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:25 smithi172 ceph-mon[34821]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T03:38:25.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:25 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:38:26.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:26 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/791672119' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:38:26.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:26 smithi084 ceph-mon[30941]: pgmap v182: 1 pgs: 1 peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:26.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:26 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/791672119' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:38:26.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:26 smithi174 ceph-mon[34403]: pgmap v182: 1 pgs: 1 peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:26.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:26 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/791672119' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:38:26.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:26 smithi172 ceph-mon[34821]: pgmap v182: 1 pgs: 1 peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:29.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:29 smithi084 ceph-mon[30941]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-21T03:38:29.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:29 smithi174 ceph-mon[34403]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-21T03:38:29.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:29 smithi172 ceph-mon[34821]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-21T03:38:31.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:31 smithi084 ceph-mon[30941]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-21T03:38:31.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:31 smithi174 ceph-mon[34403]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-21T03:38:31.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:31 smithi172 ceph-mon[34821]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-21T03:38:33.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:33 smithi084 ceph-mon[30941]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:38:33.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:33 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T03:38:33.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:33 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:33.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:33 smithi174 ceph-mon[34403]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:38:33.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:33 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T03:38:33.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:33 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:33.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:33 smithi172 ceph-mon[34821]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:38:33.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:33 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T03:38:33.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:33 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:34.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:34 smithi084 ceph-mon[30941]: Deploying daemon osd.9 on smithi084 2024-09-21T03:38:34.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:34 smithi174 ceph-mon[34403]: Deploying daemon osd.9 on smithi084 2024-09-21T03:38:34.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:34 smithi172 ceph-mon[34821]: Deploying daemon osd.9 on smithi084 2024-09-21T03:38:35.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:35 smithi084 ceph-mon[30941]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T03:38:35.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:35 smithi174 ceph-mon[34403]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T03:38:35.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:35 smithi172 ceph-mon[34821]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-21T03:38:37.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:37 smithi084 ceph-mon[30941]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T03:38:37.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:37 smithi174 ceph-mon[34403]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T03:38:37.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:37 smithi172 ceph-mon[34821]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T03:38:39.601 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:39 smithi084 ceph-mon[30941]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:38:39.601 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:39 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:38:39.601 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:39 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:39.601 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:39 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:39.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:39 smithi174 ceph-mon[34403]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:38:39.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:39 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:38:39.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:39 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:39.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:39 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:39.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:39 smithi172 ceph-mon[34821]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:38:39.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:39 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:38:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:39 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:39 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:41.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:41 smithi084 ceph-mon[30941]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:41.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:41 smithi174 ceph-mon[34403]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:41 smithi172 ceph-mon[34821]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:42.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:42.779+0000 7f5adffff640 1 -- 172.21.15.84:0/3147285910 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5af8063800 con 0x7f5ae00b6610 2024-09-21T03:38:42.782 INFO:teuthology.orchestra.run.smithi084.stdout:Created osd(s) 9 on host 'smithi084' 2024-09-21T03:38:42.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:42.782+0000 7f5afd653640 1 -- 172.21.15.84:0/3147285910 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5ae00b6610 msgr2=0x7f5ae00b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:42.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:42.782+0000 7f5afd653640 1 --2- 172.21.15.84:0/3147285910 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5ae00b6610 0x7f5ae00b8b20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5af810fc00 tx=0x7f5aec00a5c0 comp rx=0 tx=0).stop 2024-09-21T03:38:42.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:42.782+0000 7f5afd653640 1 -- 172.21.15.84:0/3147285910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5af8104880 msgr2=0x7f5af819c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:42.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:42.782+0000 7f5afd653640 1 --2- 172.21.15.84:0/3147285910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5af8104880 0x7f5af819c6d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5af0006010 tx=0x7f5af00319f0 comp rx=0 tx=0).stop 2024-09-21T03:38:42.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:42.782+0000 7f5afd653640 1 -- 172.21.15.84:0/3147285910 shutdown_connections 2024-09-21T03:38:42.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:42.782+0000 7f5afd653640 1 --2- 172.21.15.84:0/3147285910 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5ae00b6610 0x7f5ae00b8b20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:42.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:42.782+0000 7f5afd653640 1 --2- 172.21.15.84:0/3147285910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5af810de30 0x7f5af81a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:42.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:42.782+0000 7f5afd653640 1 --2- 172.21.15.84:0/3147285910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5af81052b0 0x7f5af819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:42.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:42.782+0000 7f5afd653640 1 --2- 172.21.15.84:0/3147285910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5af8104880 0x7f5af819c6d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:42.782+0000 7f5afd653640 1 -- 172.21.15.84:0/3147285910 >> 172.21.15.84:0/3147285910 conn(0x7f5af8079740 msgr2=0x7f5af80ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:42.782+0000 7f5afd653640 1 -- 172.21.15.84:0/3147285910 shutdown_connections 2024-09-21T03:38:42.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:38:42.782+0000 7f5afd653640 1 -- 172.21.15.84:0/3147285910 wait complete. 2024-09-21T03:38:43.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:43.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:43.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:42 smithi084 ceph-mon[30941]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:43.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:43.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:38:43.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:43.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:38:43.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:43.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:43.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:43.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:43.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:42 smithi174 ceph-mon[34403]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:43.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:43.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:38:43.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:43.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:38:43.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:43.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:43.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:43.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:43.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:42 smithi172 ceph-mon[34821]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:43.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:43.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:38:43.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:43.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:38:43.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:43.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:43.534 DEBUG:teuthology.orchestra.run.smithi084:osd.9> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T03:38:43.537 INFO:tasks.cephadm:Deploying osd.10 on smithi172 with /dev/vg_nvme/lv_1... 2024-09-21T03:38:43.537 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T03:38:43.794 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:38:45.195 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:38:45 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:38:45.152+0000 7f5a5ed27640 -1 osd.9 0 log_to_monitors true 2024-09-21T03:38:45.507 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:45 smithi172 ceph-mon[34821]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:45.507 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:45 smithi172 ceph-mon[34821]: from='osd.9 [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T03:38:45.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:45 smithi084 ceph-mon[30941]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:45.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:45 smithi084 ceph-mon[30941]: from='osd.9 [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T03:38:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:45 smithi174 ceph-mon[34403]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:45 smithi174 ceph-mon[34403]: from='osd.9 [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T03:38:46.545 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:46 smithi172 ceph-mon[34821]: from='osd.9 [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T03:38:46.545 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:46 smithi172 ceph-mon[34821]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T03:38:46.545 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:46 smithi172 ceph-mon[34821]: from='osd.9 [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T03:38:46.545 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:46 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:38:46.546 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:46 smithi172 ceph-mon[34821]: from='osd.9 [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T03:38:46.548 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-09-21T03:38:46.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:46 smithi084 ceph-mon[30941]: from='osd.9 [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T03:38:46.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:46 smithi084 ceph-mon[30941]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T03:38:46.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:46 smithi084 ceph-mon[30941]: from='osd.9 [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T03:38:46.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:46 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:38:46.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:46 smithi084 ceph-mon[30941]: from='osd.9 [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T03:38:46.581 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi172:vg_nvme/lv_1 2024-09-21T03:38:46.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:46 smithi174 ceph-mon[34403]: from='osd.9 [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T03:38:46.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:46 smithi174 ceph-mon[34403]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T03:38:46.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:46 smithi174 ceph-mon[34403]: from='osd.9 [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]} : dispatch 2024-09-21T03:38:46.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:46 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:38:46.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:46 smithi174 ceph-mon[34403]: from='osd.9 [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi084", "root=default"]}]': finished 2024-09-21T03:38:46.839 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:38:47.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:38:46 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:38:46.740+0000 7f5a5aca9640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T03:38:47.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:38:46 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:38:46.754+0000 7f5a52a9f640 -1 osd.9 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:38:47.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.353+0000 7efc1c16d640 1 -- 172.21.15.172:0/2066805846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc14108cf0 msgr2=0x7efc1410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:47.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.353+0000 7efc1c16d640 1 --2- 172.21.15.172:0/2066805846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc14108cf0 0x7efc1410f520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009ca0 tx=0x7efc0c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:38:47.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.353+0000 7efc1c16d640 1 -- 172.21.15.172:0/2066805846 shutdown_connections 2024-09-21T03:38:47.374 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.353+0000 7efc1c16d640 1 --2- 172.21.15.172:0/2066805846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc14108cf0 0x7efc1410f520 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:47.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.353+0000 7efc1c16d640 1 --2- 172.21.15.172:0/2066805846 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc141083a0 0x7efc141087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:47.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.353+0000 7efc1c16d640 1 --2- 172.21.15.172:0/2066805846 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc14102a60 0x7efc14102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:47.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.353+0000 7efc1c16d640 1 -- 172.21.15.172:0/2066805846 >> 172.21.15.172:0/2066805846 conn(0x7efc14079730 msgr2=0x7efc14079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:47.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.353+0000 7efc1c16d640 1 -- 172.21.15.172:0/2066805846 shutdown_connections 2024-09-21T03:38:47.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.353+0000 7efc1c16d640 1 -- 172.21.15.172:0/2066805846 wait complete. 2024-09-21T03:38:47.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.354+0000 7efc1c16d640 1 Processor -- start 2024-09-21T03:38:47.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.354+0000 7efc1c16d640 1 -- start start 2024-09-21T03:38:47.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.354+0000 7efc1c16d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc14102a60 0x7efc1419b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:47.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.354+0000 7efc1c16d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc141083a0 0x7efc1419b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:47.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.354+0000 7efc1c16d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc14108cf0 0x7efc1419bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:47.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.354+0000 7efc1c16d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efc14112960 con 0x7efc14108cf0 2024-09-21T03:38:47.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.354+0000 7efc1c16d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efc141127e0 con 0x7efc14102a60 2024-09-21T03:38:47.375 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.354+0000 7efc1c16d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efc14112ae0 con 0x7efc141083a0 2024-09-21T03:38:47.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.354+0000 7efc19f09640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc14102a60 0x7efc1419b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:47.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.354+0000 7efc19f09640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc14102a60 0x7efc1419b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:60664/0 (socket says 172.21.15.172:60664) 2024-09-21T03:38:47.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.354+0000 7efc19f09640 1 -- 172.21.15.172:0/3442273957 learned_addr learned my addr 172.21.15.172:0/3442273957 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-09-21T03:38:47.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.354+0000 7efc19708640 1 --2- 172.21.15.172:0/3442273957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc141083a0 0x7efc1419b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:47.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.354+0000 7efc1a70a640 1 --2- 172.21.15.172:0/3442273957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc14108cf0 0x7efc1419bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:47.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.355+0000 7efc19f09640 1 -- 172.21.15.172:0/3442273957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc141083a0 msgr2=0x7efc1419b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:47.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.355+0000 7efc19f09640 1 --2- 172.21.15.172:0/3442273957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc141083a0 0x7efc1419b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:47.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.355+0000 7efc19f09640 1 -- 172.21.15.172:0/3442273957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc14108cf0 msgr2=0x7efc1419bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:47.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.355+0000 7efc19f09640 1 --2- 172.21.15.172:0/3442273957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc14108cf0 0x7efc1419bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:47.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.355+0000 7efc19f09640 1 -- 172.21.15.172:0/3442273957 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc141a6500 con 0x7efc14102a60 2024-09-21T03:38:47.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.355+0000 7efc19f09640 1 --2- 172.21.15.172:0/3442273957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc14102a60 0x7efc1419b270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efc1000d950 tx=0x7efc1000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:47.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.355+0000 7efc0affd640 1 -- 172.21.15.172:0/3442273957 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc10017070 con 0x7efc14102a60 2024-09-21T03:38:47.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.355+0000 7efc0affd640 1 -- 172.21.15.172:0/3442273957 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc10009c30 con 0x7efc14102a60 2024-09-21T03:38:47.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.355+0000 7efc1c16d640 1 -- 172.21.15.172:0/3442273957 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc141a67f0 con 0x7efc14102a60 2024-09-21T03:38:47.376 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.355+0000 7efc0affd640 1 -- 172.21.15.172:0/3442273957 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1000f620 con 0x7efc14102a60 2024-09-21T03:38:47.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.355+0000 7efc1c16d640 1 -- 172.21.15.172:0/3442273957 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc141a6d30 con 0x7efc14102a60 2024-09-21T03:38:47.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.356+0000 7efc1c16d640 1 -- 172.21.15.172:0/3442273957 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc14102e70 con 0x7efc14102a60 2024-09-21T03:38:47.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.358+0000 7efc0affd640 1 -- 172.21.15.172:0/3442273957 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7efc10010460 con 0x7efc14102a60 2024-09-21T03:38:47.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.359+0000 7efc0affd640 1 --2- 172.21.15.172:0/3442273957 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efc000b6590 0x7efc000b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:47.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.359+0000 7efc0affd640 1 -- 172.21.15.172:0/3442273957 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6196+0+0 (secure 0 0 0) 0x7efc100e67b0 con 0x7efc14102a60 2024-09-21T03:38:47.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.359+0000 7efc19708640 1 --2- 172.21.15.172:0/3442273957 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efc000b6590 0x7efc000b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:47.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.360+0000 7efc19708640 1 --2- 172.21.15.172:0/3442273957 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efc000b6590 0x7efc000b8aa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efc14105f80 tx=0x7efc04005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:47.377 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.362+0000 7efc0affd640 1 -- 172.21.15.172:0/3442273957 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efc100ad880 con 0x7efc14102a60 2024-09-21T03:38:47.400 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:47 smithi172 ceph-mon[34821]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:47.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:47 smithi172 ceph-mon[34821]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T03:38:47.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:38:47.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:38:47.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:47.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:47.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:47.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:47.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:47.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:47.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:47.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:47.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:38:47.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:47.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:47 smithi172 ceph-mon[34821]: from='osd.9 [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673]' entity='osd.9' 2024-09-21T03:38:47.558 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:38:47.557+0000 7efc1c16d640 1 -- 172.21.15.172:0/3442273957 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7efc14063800 con 0x7efc000b6590 2024-09-21T03:38:47.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:47 smithi084 ceph-mon[30941]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:47.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:47 smithi084 ceph-mon[30941]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T03:38:47.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:38:47.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:38:47.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:47.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:47.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:47.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:47.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:47.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:47.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:47.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:47.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:38:47.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:47.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:47 smithi084 ceph-mon[30941]: from='osd.9 [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673]' entity='osd.9' 2024-09-21T03:38:47.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:47 smithi174 ceph-mon[34403]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:47.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:47 smithi174 ceph-mon[34403]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T03:38:47.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:38:47.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:38:47.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:47.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:47.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:47.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:47.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:47.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T03:38:47.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:47.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:47.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:38:47.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:38:47.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:47 smithi174 ceph-mon[34403]: from='osd.9 [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673]' entity='osd.9' 2024-09-21T03:38:48.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:48 smithi172 ceph-mon[34821]: purged_snaps scrub starts 2024-09-21T03:38:48.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:48 smithi172 ceph-mon[34821]: purged_snaps scrub ok 2024-09-21T03:38:48.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:48 smithi172 ceph-mon[34821]: Detected new or changed devices on smithi084 2024-09-21T03:38:48.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:48 smithi172 ceph-mon[34821]: Adjusting osd_memory_target on smithi084 to 4272M 2024-09-21T03:38:48.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:48 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:38:48.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:48 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:38:48.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:48 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:38:48.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:48 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:48.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:48 smithi172 ceph-mon[34821]: osd.9 [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673] boot 2024-09-21T03:38:48.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:48 smithi172 ceph-mon[34821]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T03:38:48.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:48 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:38:48.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:48 smithi174 ceph-mon[34403]: purged_snaps scrub starts 2024-09-21T03:38:48.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:48 smithi174 ceph-mon[34403]: purged_snaps scrub ok 2024-09-21T03:38:48.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:48 smithi174 ceph-mon[34403]: Detected new or changed devices on smithi084 2024-09-21T03:38:48.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:48 smithi174 ceph-mon[34403]: Adjusting osd_memory_target on smithi084 to 4272M 2024-09-21T03:38:48.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:48 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:38:48.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:48 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:38:48.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:48 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:38:48.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:48 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:48.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:48 smithi174 ceph-mon[34403]: osd.9 [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673] boot 2024-09-21T03:38:48.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:48 smithi174 ceph-mon[34403]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T03:38:48.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:48 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:38:48.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:48 smithi084 ceph-mon[30941]: purged_snaps scrub starts 2024-09-21T03:38:48.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:48 smithi084 ceph-mon[30941]: purged_snaps scrub ok 2024-09-21T03:38:48.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:48 smithi084 ceph-mon[30941]: Detected new or changed devices on smithi084 2024-09-21T03:38:48.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:48 smithi084 ceph-mon[30941]: Adjusting osd_memory_target on smithi084 to 4272M 2024-09-21T03:38:48.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:48 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:38:48.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:48 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:38:48.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:48 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:38:48.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:48 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:48.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:48 smithi084 ceph-mon[30941]: osd.9 [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673] boot 2024-09-21T03:38:48.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:48 smithi084 ceph-mon[30941]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T03:38:48.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:48 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:38:49.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:49 smithi174 ceph-mon[34403]: from='client.24506 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:49.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:49 smithi174 ceph-mon[34403]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:49.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:49 smithi174 ceph-mon[34403]: osdmap e60: 10 total, 10 up, 10 in 2024-09-21T03:38:49.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:49 smithi172 ceph-mon[34821]: from='client.24506 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:49.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:49 smithi172 ceph-mon[34821]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:49.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:49 smithi172 ceph-mon[34821]: osdmap e60: 10 total, 10 up, 10 in 2024-09-21T03:38:49.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:49 smithi084 ceph-mon[30941]: from='client.24506 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:38:49.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:49 smithi084 ceph-mon[30941]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 267 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:38:49.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:49 smithi084 ceph-mon[30941]: osdmap e60: 10 total, 10 up, 10 in 2024-09-21T03:38:50.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:50 smithi174 ceph-mon[34403]: from='client.? 172.21.15.172:0/1778424377' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9788fa2d-49fb-431b-a0e3-62d6e421e11e"} : dispatch 2024-09-21T03:38:50.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:50 smithi174 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9788fa2d-49fb-431b-a0e3-62d6e421e11e"} : dispatch 2024-09-21T03:38:50.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:50 smithi174 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9788fa2d-49fb-431b-a0e3-62d6e421e11e"}]': finished 2024-09-21T03:38:50.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:50 smithi174 ceph-mon[34403]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T03:38:50.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:50 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:38:50.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:50 smithi172 ceph-mon[34821]: from='client.? 172.21.15.172:0/1778424377' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9788fa2d-49fb-431b-a0e3-62d6e421e11e"} : dispatch 2024-09-21T03:38:50.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:50 smithi172 ceph-mon[34821]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9788fa2d-49fb-431b-a0e3-62d6e421e11e"} : dispatch 2024-09-21T03:38:50.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:50 smithi172 ceph-mon[34821]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9788fa2d-49fb-431b-a0e3-62d6e421e11e"}]': finished 2024-09-21T03:38:50.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:50 smithi172 ceph-mon[34821]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T03:38:50.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:50 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:38:50.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:50 smithi084 ceph-mon[30941]: from='client.? 172.21.15.172:0/1778424377' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9788fa2d-49fb-431b-a0e3-62d6e421e11e"} : dispatch 2024-09-21T03:38:50.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:50 smithi084 ceph-mon[30941]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9788fa2d-49fb-431b-a0e3-62d6e421e11e"} : dispatch 2024-09-21T03:38:50.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:50 smithi084 ceph-mon[30941]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9788fa2d-49fb-431b-a0e3-62d6e421e11e"}]': finished 2024-09-21T03:38:50.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:50 smithi084 ceph-mon[30941]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T03:38:50.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:50 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:38:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:51 smithi174 ceph-mon[34403]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:38:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:51 smithi174 ceph-mon[34403]: from='client.? 172.21.15.172:0/2217195018' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:38:51.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:51 smithi172 ceph-mon[34821]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:38:51.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:51 smithi172 ceph-mon[34821]: from='client.? 172.21.15.172:0/2217195018' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:38:51.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:51 smithi084 ceph-mon[30941]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:38:51.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:51 smithi084 ceph-mon[30941]: from='client.? 172.21.15.172:0/2217195018' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:38:53.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:53 smithi174 ceph-mon[34403]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:38:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:53 smithi172 ceph-mon[34821]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:38:53.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:53 smithi084 ceph-mon[30941]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:38:55.509 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:55 smithi172 ceph-mon[34821]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:38:55.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:55 smithi174 ceph-mon[34403]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:38:55.737 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:55 smithi084 ceph-mon[30941]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:38:57.537 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:57 smithi172 ceph-mon[34821]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:38:57.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:57 smithi174 ceph-mon[34403]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:38:57.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:57 smithi084 ceph-mon[30941]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:38:59.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:59 smithi172 ceph-mon[34821]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:38:59.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:59 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T03:38:59.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:38:59 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:59.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:59 smithi174 ceph-mon[34403]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:38:59.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:59 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T03:38:59.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:38:59 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:59.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:59 smithi084 ceph-mon[30941]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:38:59.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:59 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T03:38:59.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:38:59 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:00.487 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:00 smithi172 ceph-mon[34821]: Deploying daemon osd.10 on smithi172 2024-09-21T03:39:00.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:00 smithi174 ceph-mon[34403]: Deploying daemon osd.10 on smithi172 2024-09-21T03:39:00.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:00 smithi084 ceph-mon[30941]: Deploying daemon osd.10 on smithi172 2024-09-21T03:39:01.549 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:01 smithi172 ceph-mon[34821]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:01.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:01 smithi174 ceph-mon[34403]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:01.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:01 smithi084 ceph-mon[30941]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:03.597 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:03 smithi172 ceph-mon[34821]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:03.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:03 smithi174 ceph-mon[34403]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:03.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:03 smithi084 ceph-mon[30941]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:05.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:05 smithi174 ceph-mon[34403]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:05.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:05 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:39:05.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:05 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:05.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:05 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:05.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:05 smithi172 ceph-mon[34821]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:05.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:05 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:39:05.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:05 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:05.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:05 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:05.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:05 smithi084 ceph-mon[30941]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:05.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:05 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:39:05.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:05 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:05.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:05 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:07.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:07 smithi174 ceph-mon[34403]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:07.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:07 smithi172 ceph-mon[34821]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:07.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:07 smithi084 ceph-mon[30941]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:08.282 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 10 on host 'smithi172' 2024-09-21T03:39:08.282 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:39:08.278+0000 7efc0affd640 1 -- 172.21.15.172:0/3442273957 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7efc14063800 con 0x7efc000b6590 2024-09-21T03:39:08.283 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:39:08.281+0000 7efc1c16d640 1 -- 172.21.15.172:0/3442273957 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efc000b6590 msgr2=0x7efc000b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:08.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:39:08.281+0000 7efc1c16d640 1 --2- 172.21.15.172:0/3442273957 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efc000b6590 0x7efc000b8aa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efc14105f80 tx=0x7efc04005f90 comp rx=0 tx=0).stop 2024-09-21T03:39:08.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:39:08.281+0000 7efc1c16d640 1 -- 172.21.15.172:0/3442273957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc14102a60 msgr2=0x7efc1419b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:08.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:39:08.281+0000 7efc1c16d640 1 --2- 172.21.15.172:0/3442273957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc14102a60 0x7efc1419b270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efc1000d950 tx=0x7efc1000de10 comp rx=0 tx=0).stop 2024-09-21T03:39:08.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:39:08.281+0000 7efc1c16d640 1 -- 172.21.15.172:0/3442273957 shutdown_connections 2024-09-21T03:39:08.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:39:08.281+0000 7efc1c16d640 1 --2- 172.21.15.172:0/3442273957 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efc000b6590 0x7efc000b8aa0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:08.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:39:08.281+0000 7efc1c16d640 1 --2- 172.21.15.172:0/3442273957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efc14108cf0 0x7efc1419bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:08.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:39:08.281+0000 7efc1c16d640 1 --2- 172.21.15.172:0/3442273957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc141083a0 0x7efc1419b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:08.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:39:08.281+0000 7efc1c16d640 1 --2- 172.21.15.172:0/3442273957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc14102a60 0x7efc1419b270 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:08.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:39:08.281+0000 7efc1c16d640 1 -- 172.21.15.172:0/3442273957 >> 172.21.15.172:0/3442273957 conn(0x7efc14079730 msgr2=0x7efc14104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:08.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:39:08.281+0000 7efc1c16d640 1 -- 172.21.15.172:0/3442273957 shutdown_connections 2024-09-21T03:39:08.284 INFO:teuthology.orchestra.run.smithi172.stderr:2024-09-21T03:39:08.281+0000 7efc1c16d640 1 -- 172.21.15.172:0/3442273957 wait complete. 2024-09-21T03:39:08.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:08 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:08.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:08 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:08.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:08 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:08.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:08 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:39:08.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:08 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:08.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:08 smithi084 ceph-mon[30941]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:08.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:08 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:39:08.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:08 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:08.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:08 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:08.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:08 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:08.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:08 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:08.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:08 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:08.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:08 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:39:08.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:08 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:08.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:08 smithi174 ceph-mon[34403]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:08.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:08 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:39:08.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:08 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:08.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:08 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:08.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:08 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:08.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:08 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:08.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:08 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:08.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:08 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:39:08.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:08 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:08.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:08 smithi172 ceph-mon[34821]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:08.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:08 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:39:08.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:08 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:08.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:08 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:08.978 DEBUG:teuthology.orchestra.run.smithi172:osd.10> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T03:39:08.980 INFO:tasks.cephadm:Deploying osd.11 on smithi174 with /dev/vg_nvme/lv_1... 2024-09-21T03:39:08.980 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T03:39:09.237 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:39:10.901 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:39:10 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:39:10.498+0000 7fe5cec58640 -1 osd.10 0 log_to_monitors true 2024-09-21T03:39:11.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:11 smithi172 ceph-mon[34821]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:11.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:11 smithi172 ceph-mon[34821]: from='osd.10 [v2:172.21.15.172:6824/2667099391,v1:172.21.15.172:6825/2667099391]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:39:11.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:11 smithi172 ceph-mon[34821]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:39:11.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:11 smithi084 ceph-mon[30941]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:11.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:11 smithi084 ceph-mon[30941]: from='osd.10 [v2:172.21.15.172:6824/2667099391,v1:172.21.15.172:6825/2667099391]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:39:11.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:11 smithi084 ceph-mon[30941]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:39:11.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:11 smithi174 ceph-mon[34403]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:11.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:11 smithi174 ceph-mon[34403]: from='osd.10 [v2:172.21.15.172:6824/2667099391,v1:172.21.15.172:6825/2667099391]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:39:11.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:11 smithi174 ceph-mon[34403]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:39:11.939 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-09-21T03:39:11.967 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi174:vg_nvme/lv_1 2024-09-21T03:39:12.213 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:39:12.599 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:12 smithi174 ceph-mon[34403]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T03:39:12.599 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:12 smithi174 ceph-mon[34403]: from='osd.10 [v2:172.21.15.172:6824/2667099391,v1:172.21.15.172:6825/2667099391]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:39:12.599 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:12 smithi174 ceph-mon[34403]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T03:39:12.599 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:12 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:39:12.599 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:12 smithi174 ceph-mon[34403]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:39:12.599 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:12 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:12.600 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:12 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:12.600 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:12 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:12.600 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:12 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:12.600 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:12 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:12.600 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:12 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:12.600 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:12 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:12.600 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:12 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:12.600 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:12 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:39:12.600 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:12 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:12.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:12 smithi172 ceph-mon[34821]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T03:39:12.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:12 smithi172 ceph-mon[34821]: from='osd.10 [v2:172.21.15.172:6824/2667099391,v1:172.21.15.172:6825/2667099391]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:39:12.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:12 smithi172 ceph-mon[34821]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T03:39:12.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:12 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:39:12.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:12 smithi172 ceph-mon[34821]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:39:12.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:12 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:12.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:12 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:12.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:12 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:12.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:12 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:12.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:12 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:12.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:12 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:12.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:12 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:12.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:12 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:12.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:12 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:39:12.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:12 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:12.707 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.690+0000 7f59a7d50640 1 -- 172.21.15.174:0/984644971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59a01049d0 msgr2=0x7f59a0104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:12.707 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.690+0000 7f59a7d50640 1 --2- 172.21.15.174:0/984644971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59a01049d0 0x7f59a0104de0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f599c009900 tx=0x7f599c02a410 comp rx=0 tx=0).stop 2024-09-21T03:39:12.707 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.690+0000 7f59a7d50640 1 -- 172.21.15.174:0/984644971 shutdown_connections 2024-09-21T03:39:12.707 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.690+0000 7f59a7d50640 1 --2- 172.21.15.174:0/984644971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59a010de30 0x7f59a0110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:12.707 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.690+0000 7f59a7d50640 1 --2- 172.21.15.174:0/984644971 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59a0105320 0x7f59a010d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:12.707 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.690+0000 7f59a7d50640 1 --2- 172.21.15.174:0/984644971 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59a01049d0 0x7f59a0104de0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:12.707 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.690+0000 7f59a7d50640 1 -- 172.21.15.174:0/984644971 >> 172.21.15.174:0/984644971 conn(0x7f59a0079740 msgr2=0x7f59a0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:12.707 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.690+0000 7f59a7d50640 1 -- 172.21.15.174:0/984644971 shutdown_connections 2024-09-21T03:39:12.707 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.690+0000 7f59a7d50640 1 -- 172.21.15.174:0/984644971 wait complete. 2024-09-21T03:39:12.707 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.690+0000 7f59a7d50640 1 Processor -- start 2024-09-21T03:39:12.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.690+0000 7f59a7d50640 1 -- start start 2024-09-21T03:39:12.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f59a7d50640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59a01049d0 0x7f59a0102710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:12.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f59a7d50640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59a0105320 0x7f59a0102c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:12.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f59a7d50640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59a010de30 0x7f59a0103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:12.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f59a7d50640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f59a0113ab0 con 0x7f59a010de30 2024-09-21T03:39:12.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f59a7d50640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f59a0113930 con 0x7f59a01049d0 2024-09-21T03:39:12.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f59a7d50640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f59a0113c30 con 0x7f59a0105320 2024-09-21T03:39:12.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f59a52eb640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59a0105320 0x7f59a0102c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:12.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f59a52eb640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59a0105320 0x7f59a0102c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:50472/0 (socket says 172.21.15.174:50472) 2024-09-21T03:39:12.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f59a52eb640 1 -- 172.21.15.174:0/1583350350 learned_addr learned my addr 172.21.15.174:0/1583350350 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-21T03:39:12.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f59a5aec640 1 --2- 172.21.15.174:0/1583350350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59a01049d0 0x7f59a0102710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:12.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f59a62ed640 1 --2- 172.21.15.174:0/1583350350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59a010de30 0x7f59a0103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:12.708 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f59a52eb640 1 -- 172.21.15.174:0/1583350350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59a01049d0 msgr2=0x7f59a0102710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:12.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f59a52eb640 1 --2- 172.21.15.174:0/1583350350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59a01049d0 0x7f59a0102710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:12.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f59a52eb640 1 -- 172.21.15.174:0/1583350350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59a010de30 msgr2=0x7f59a0103190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:12.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f59a52eb640 1 --2- 172.21.15.174:0/1583350350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59a010de30 0x7f59a0103190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:12.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f59a52eb640 1 -- 172.21.15.174:0/1583350350 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a01a8820 con 0x7f59a0105320 2024-09-21T03:39:12.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f59a52eb640 1 --2- 172.21.15.174:0/1583350350 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59a0105320 0x7f59a0102c50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f599000d740 tx=0x7f599000dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:12.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f5996ffd640 1 -- 172.21.15.174:0/1583350350 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5990017070 con 0x7f59a0105320 2024-09-21T03:39:12.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f59a7d50640 1 -- 172.21.15.174:0/1583350350 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a01a8b10 con 0x7f59a0105320 2024-09-21T03:39:12.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f5996ffd640 1 -- 172.21.15.174:0/1583350350 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f599000de50 con 0x7f59a0105320 2024-09-21T03:39:12.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f5996ffd640 1 -- 172.21.15.174:0/1583350350 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599000f620 con 0x7f59a0105320 2024-09-21T03:39:12.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.691+0000 7f59a7d50640 1 -- 172.21.15.174:0/1583350350 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a01a9050 con 0x7f59a0105320 2024-09-21T03:39:12.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.693+0000 7f59a7d50640 1 -- 172.21.15.174:0/1583350350 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a006c240 con 0x7f59a0105320 2024-09-21T03:39:12.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.694+0000 7f5996ffd640 1 -- 172.21.15.174:0/1583350350 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f599001a070 con 0x7f59a0105320 2024-09-21T03:39:12.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.695+0000 7f5996ffd640 1 --2- 172.21.15.174:0/1583350350 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f598c0b6560 0x7f598c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:12.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.695+0000 7f5996ffd640 1 -- 172.21.15.174:0/1583350350 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6629+0+0 (secure 0 0 0) 0x7f59900e6630 con 0x7f59a0105320 2024-09-21T03:39:12.709 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.695+0000 7f59a5aec640 1 --2- 172.21.15.174:0/1583350350 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f598c0b6560 0x7f598c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:12.710 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.695+0000 7f59a5aec640 1 --2- 172.21.15.174:0/1583350350 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f598c0b6560 0x7f598c0b8a70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f599c009230 tx=0x7f599c031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:12.710 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.699+0000 7f5996ffd640 1 -- 172.21.15.174:0/1583350350 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f59900b1930 con 0x7f59a0105320 2024-09-21T03:39:12.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:12 smithi084 ceph-mon[30941]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T03:39:12.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:12 smithi084 ceph-mon[30941]: from='osd.10 [v2:172.21.15.172:6824/2667099391,v1:172.21.15.172:6825/2667099391]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:39:12.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:12 smithi084 ceph-mon[30941]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T03:39:12.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:12 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:39:12.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:12 smithi084 ceph-mon[30941]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]} : dispatch 2024-09-21T03:39:12.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:12 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:12.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:12 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:12.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:12 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:12.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:12 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:12.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:12 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:12.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:12 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:12.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:12 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:12.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:12 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:12.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:12 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:39:12.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:12 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:12.888 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:12.887+0000 7f59a7d50640 1 -- 172.21.15.174:0/1583350350 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f59a0106fc0 con 0x7f598c0b6560 2024-09-21T03:39:13.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:39:12 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:39:12.740+0000 7fe5cabda640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T03:39:13.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:39:12 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:39:12.753+0000 7fe5c29d0640 -1 osd.10 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:39:13.552 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:13 smithi174 ceph-mon[34403]: Detected new or changed devices on smithi172 2024-09-21T03:39:13.552 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:13 smithi174 ceph-mon[34403]: Adjusting osd_memory_target on smithi172 to 4272M 2024-09-21T03:39:13.552 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:13 smithi174 ceph-mon[34403]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:13.552 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:13 smithi174 ceph-mon[34403]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T03:39:13.552 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:13 smithi174 ceph-mon[34403]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T03:39:13.552 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:13 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:39:13.553 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:13 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:39:13.553 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:13 smithi174 ceph-mon[34403]: from='osd.10 ' entity='osd.10' 2024-09-21T03:39:13.553 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:13 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:39:13.553 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:13 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:39:13.553 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:13 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:13.553 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:13 smithi174 ceph-mon[34403]: osd.10 [v2:172.21.15.172:6824/2667099391,v1:172.21.15.172:6825/2667099391] boot 2024-09-21T03:39:13.553 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:13 smithi174 ceph-mon[34403]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T03:39:13.553 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:13 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:39:13.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:13 smithi172 ceph-mon[34821]: Detected new or changed devices on smithi172 2024-09-21T03:39:13.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:13 smithi172 ceph-mon[34821]: Adjusting osd_memory_target on smithi172 to 4272M 2024-09-21T03:39:13.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:13 smithi172 ceph-mon[34821]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:13.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:13 smithi172 ceph-mon[34821]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T03:39:13.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:13 smithi172 ceph-mon[34821]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T03:39:13.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:13 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:39:13.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:13 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:39:13.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:13 smithi172 ceph-mon[34821]: from='osd.10 ' entity='osd.10' 2024-09-21T03:39:13.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:13 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:39:13.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:13 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:39:13.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:13 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:13.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:13 smithi172 ceph-mon[34821]: osd.10 [v2:172.21.15.172:6824/2667099391,v1:172.21.15.172:6825/2667099391] boot 2024-09-21T03:39:13.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:13 smithi172 ceph-mon[34821]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T03:39:13.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:13 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:39:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:13 smithi084 ceph-mon[30941]: Detected new or changed devices on smithi172 2024-09-21T03:39:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:13 smithi084 ceph-mon[30941]: Adjusting osd_memory_target on smithi172 to 4272M 2024-09-21T03:39:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:13 smithi084 ceph-mon[30941]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:39:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:13 smithi084 ceph-mon[30941]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-09-21T03:39:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:13 smithi084 ceph-mon[30941]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T03:39:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:13 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:39:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:13 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:39:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:13 smithi084 ceph-mon[30941]: from='osd.10 ' entity='osd.10' 2024-09-21T03:39:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:13 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:39:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:13 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:39:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:13 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:13.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:13 smithi084 ceph-mon[30941]: osd.10 [v2:172.21.15.172:6824/2667099391,v1:172.21.15.172:6825/2667099391] boot 2024-09-21T03:39:13.721 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:13 smithi084 ceph-mon[30941]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T03:39:13.721 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:13 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:39:14.464 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:14 smithi174 ceph-mon[34403]: purged_snaps scrub starts 2024-09-21T03:39:14.464 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:14 smithi174 ceph-mon[34403]: purged_snaps scrub ok 2024-09-21T03:39:14.464 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:14 smithi174 ceph-mon[34403]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:14.464 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:14 smithi174 ceph-mon[34403]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T03:39:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:14 smithi172 ceph-mon[34821]: purged_snaps scrub starts 2024-09-21T03:39:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:14 smithi172 ceph-mon[34821]: purged_snaps scrub ok 2024-09-21T03:39:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:14 smithi172 ceph-mon[34821]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:14 smithi172 ceph-mon[34821]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T03:39:14.738 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:14 smithi084 ceph-mon[30941]: purged_snaps scrub starts 2024-09-21T03:39:14.738 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:14 smithi084 ceph-mon[30941]: purged_snaps scrub ok 2024-09-21T03:39:14.739 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:14 smithi084 ceph-mon[30941]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi174:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:14.739 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:14 smithi084 ceph-mon[30941]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T03:39:15.611 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:15 smithi174 ceph-mon[34403]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:15.611 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:15 smithi174 ceph-mon[34403]: from='client.? 172.21.15.174:0/3599275314' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69"} : dispatch 2024-09-21T03:39:15.611 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:15 smithi174 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69"} : dispatch 2024-09-21T03:39:15.611 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:15 smithi174 ceph-mon[34403]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69"}]': finished 2024-09-21T03:39:15.611 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:15 smithi174 ceph-mon[34403]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T03:39:15.611 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:15 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:39:15.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:15 smithi172 ceph-mon[34821]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:15.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:15 smithi172 ceph-mon[34821]: from='client.? 172.21.15.174:0/3599275314' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69"} : dispatch 2024-09-21T03:39:15.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:15 smithi172 ceph-mon[34821]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69"} : dispatch 2024-09-21T03:39:15.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:15 smithi172 ceph-mon[34821]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69"}]': finished 2024-09-21T03:39:15.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:15 smithi172 ceph-mon[34821]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T03:39:15.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:15 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:39:15.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:15 smithi084 ceph-mon[30941]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 341 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:15.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:15 smithi084 ceph-mon[30941]: from='client.? 172.21.15.174:0/3599275314' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69"} : dispatch 2024-09-21T03:39:15.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:15 smithi084 ceph-mon[30941]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69"} : dispatch 2024-09-21T03:39:15.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:15 smithi084 ceph-mon[30941]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69"}]': finished 2024-09-21T03:39:15.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:15 smithi084 ceph-mon[30941]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T03:39:15.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:15 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:39:16.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:16 smithi174 ceph-mon[34403]: from='client.? 172.21.15.174:0/3085349954' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:39:16.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:16 smithi172 ceph-mon[34821]: from='client.? 172.21.15.174:0/3085349954' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:39:16.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:16 smithi084 ceph-mon[30941]: from='client.? 172.21.15.174:0/3085349954' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:39:17.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:17 smithi174 ceph-mon[34403]: pgmap v217: 1 pgs: 1 peering; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:17.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:17 smithi172 ceph-mon[34821]: pgmap v217: 1 pgs: 1 peering; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:17.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:17 smithi084 ceph-mon[30941]: pgmap v217: 1 pgs: 1 peering; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:19.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:19 smithi174 ceph-mon[34403]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T03:39:19.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:19 smithi172 ceph-mon[34821]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T03:39:19.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:19 smithi084 ceph-mon[30941]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-21T03:39:21.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:21 smithi174 ceph-mon[34403]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T03:39:21.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:21 smithi172 ceph-mon[34821]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T03:39:21.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:21 smithi084 ceph-mon[30941]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T03:39:23.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:23 smithi174 ceph-mon[34403]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:39:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:23 smithi172 ceph-mon[34821]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:39:23.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:23 smithi084 ceph-mon[30941]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:39:24.468 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:24 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T03:39:24.468 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:24 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:24.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:24 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T03:39:24.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:24 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:24.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:24 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T03:39:24.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:24 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:25.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:25 smithi174 ceph-mon[34403]: Deploying daemon osd.11 on smithi174 2024-09-21T03:39:25.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:25 smithi174 ceph-mon[34403]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T03:39:25.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:25 smithi172 ceph-mon[34821]: Deploying daemon osd.11 on smithi174 2024-09-21T03:39:25.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:25 smithi172 ceph-mon[34821]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T03:39:25.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:25 smithi084 ceph-mon[30941]: Deploying daemon osd.11 on smithi174 2024-09-21T03:39:25.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:25 smithi084 ceph-mon[30941]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T03:39:27.492 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:27 smithi174 ceph-mon[34403]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T03:39:27.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:27 smithi172 ceph-mon[34821]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T03:39:27.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:27 smithi084 ceph-mon[30941]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T03:39:29.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:29 smithi174 ceph-mon[34403]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:39:29.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:29 smithi172 ceph-mon[34821]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:39:29.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:29 smithi084 ceph-mon[30941]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:39:30.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:30 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:39:30.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:30 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:30.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:30 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:30.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:30 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:39:30.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:30 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:30.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:30 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:30.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:30 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:39:30.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:30 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:30.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:30 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:31.452 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:31 smithi174 ceph-mon[34403]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:31.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:31 smithi172 ceph-mon[34821]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:31.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:31 smithi084 ceph-mon[30941]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:33.130 INFO:teuthology.orchestra.run.smithi174.stdout:Created osd(s) 11 on host 'smithi174' 2024-09-21T03:39:33.130 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:33.128+0000 7f5996ffd640 1 -- 172.21.15.174:0/1583350350 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f59a0106fc0 con 0x7f598c0b6560 2024-09-21T03:39:33.133 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:33.131+0000 7f59a7d50640 1 -- 172.21.15.174:0/1583350350 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f598c0b6560 msgr2=0x7f598c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:33.133 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:33.131+0000 7f59a7d50640 1 --2- 172.21.15.174:0/1583350350 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f598c0b6560 0x7f598c0b8a70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f599c009230 tx=0x7f599c031400 comp rx=0 tx=0).stop 2024-09-21T03:39:33.133 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:33.131+0000 7f59a7d50640 1 -- 172.21.15.174:0/1583350350 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59a0105320 msgr2=0x7f59a0102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:33.133 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:33.131+0000 7f59a7d50640 1 --2- 172.21.15.174:0/1583350350 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59a0105320 0x7f59a0102c50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f599000d740 tx=0x7f599000dc00 comp rx=0 tx=0).stop 2024-09-21T03:39:33.133 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:33.131+0000 7f59a7d50640 1 -- 172.21.15.174:0/1583350350 shutdown_connections 2024-09-21T03:39:33.133 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:33.131+0000 7f59a7d50640 1 --2- 172.21.15.174:0/1583350350 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f598c0b6560 0x7f598c0b8a70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:33.133 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:33.131+0000 7f59a7d50640 1 --2- 172.21.15.174:0/1583350350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f59a010de30 0x7f59a0103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:33.133 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:33.131+0000 7f59a7d50640 1 --2- 172.21.15.174:0/1583350350 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f59a0105320 0x7f59a0102c50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:33.133 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:33.131+0000 7f59a7d50640 1 --2- 172.21.15.174:0/1583350350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59a01049d0 0x7f59a0102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:33.133 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:33.131+0000 7f59a7d50640 1 -- 172.21.15.174:0/1583350350 >> 172.21.15.174:0/1583350350 conn(0x7f59a0079740 msgr2=0x7f59a01068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:33.133 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:33.131+0000 7f59a7d50640 1 -- 172.21.15.174:0/1583350350 shutdown_connections 2024-09-21T03:39:33.133 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:33.131+0000 7f59a7d50640 1 -- 172.21.15.174:0/1583350350 wait complete. 2024-09-21T03:39:33.613 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:33 smithi174 ceph-mon[34403]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:33.613 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:33 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:33.613 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:33 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:33.613 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:33 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:33.614 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:33 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:39:33.614 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:33 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:33.614 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:33 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:39:33.614 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:33 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:33.614 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:33 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:33.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:33 smithi172 ceph-mon[34821]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:33.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:33 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:33.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:33 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:33.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:33 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:33.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:33 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:39:33.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:33 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:33.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:33 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:39:33.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:33 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:33.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:33 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:33.793 DEBUG:teuthology.orchestra.run.smithi174:osd.11> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T03:39:33.795 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T03:39:33.796 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T03:39:33.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:33 smithi084 ceph-mon[30941]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:33.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:33 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:33.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:33 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:33.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:33 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:33.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:33 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:39:33.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:33 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:33.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:33 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:39:33.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:33 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:33.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:33 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:34.054 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:34.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.528+0000 7f30b26e1640 1 -- 172.21.15.84:0/2344964274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30ac1094c0 msgr2=0x7f30ac1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:34.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.528+0000 7f30b26e1640 1 --2- 172.21.15.84:0/2344964274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30ac1094c0 0x7f30ac1098d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3094009900 tx=0x7f309402a410 comp rx=0 tx=0).stop 2024-09-21T03:39:34.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.528+0000 7f30b26e1640 1 -- 172.21.15.84:0/2344964274 shutdown_connections 2024-09-21T03:39:34.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.528+0000 7f30b26e1640 1 --2- 172.21.15.84:0/2344964274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30ac109e10 0x7f30ac110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:34.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.528+0000 7f30b26e1640 1 --2- 172.21.15.84:0/2344964274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30ac1094c0 0x7f30ac1098d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:34.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.528+0000 7f30b26e1640 1 --2- 172.21.15.84:0/2344964274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30ac103b80 0x7f30ac103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:34.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.528+0000 7f30b26e1640 1 -- 172.21.15.84:0/2344964274 >> 172.21.15.84:0/2344964274 conn(0x7f30ac0ff610 msgr2=0x7f30ac101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:34.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.528+0000 7f30b26e1640 1 -- 172.21.15.84:0/2344964274 shutdown_connections 2024-09-21T03:39:34.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.528+0000 7f30b26e1640 1 -- 172.21.15.84:0/2344964274 wait complete. 2024-09-21T03:39:34.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.529+0000 7f30b26e1640 1 Processor -- start 2024-09-21T03:39:34.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.529+0000 7f30b26e1640 1 -- start start 2024-09-21T03:39:34.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.529+0000 7f30b26e1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30ac103b80 0x7f30ac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:34.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.529+0000 7f30b26e1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30ac1094c0 0x7f30ac075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:34.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.529+0000 7f30b26e1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30ac109e10 0x7f30ac076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:34.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.529+0000 7f30b26e1640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac113ad0 con 0x7f30ac1094c0 2024-09-21T03:39:34.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.529+0000 7f30b26e1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac113950 con 0x7f30ac103b80 2024-09-21T03:39:34.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.529+0000 7f30b26e1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac113c50 con 0x7f30ac109e10 2024-09-21T03:39:34.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.529+0000 7f30a3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30ac1094c0 0x7f30ac075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:34.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.529+0000 7f30a3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30ac1094c0 0x7f30ac075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44006/0 (socket says 172.21.15.84:44006) 2024-09-21T03:39:34.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.529+0000 7f30a3fff640 1 -- 172.21.15.84:0/2605193304 learned_addr learned my addr 172.21.15.84:0/2605193304 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:39:34.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.530+0000 7f30abfff640 1 --2- 172.21.15.84:0/2605193304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30ac103b80 0x7f30ac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:34.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.530+0000 7f30b0c7e640 1 --2- 172.21.15.84:0/2605193304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30ac109e10 0x7f30ac076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:34.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.530+0000 7f30a3fff640 1 -- 172.21.15.84:0/2605193304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30ac109e10 msgr2=0x7f30ac076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:34.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.530+0000 7f30a3fff640 1 --2- 172.21.15.84:0/2605193304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30ac109e10 0x7f30ac076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:34.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.530+0000 7f30a3fff640 1 -- 172.21.15.84:0/2605193304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30ac103b80 msgr2=0x7f30ac075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:34.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.530+0000 7f30a3fff640 1 --2- 172.21.15.84:0/2605193304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30ac103b80 0x7f30ac075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:34.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.530+0000 7f30a3fff640 1 -- 172.21.15.84:0/2605193304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ac1a86f0 con 0x7f30ac1094c0 2024-09-21T03:39:34.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.530+0000 7f30b0c7e640 1 --2- 172.21.15.84:0/2605193304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30ac109e10 0x7f30ac076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:34.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.530+0000 7f30a3fff640 1 --2- 172.21.15.84:0/2605193304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30ac1094c0 0x7f30ac075c50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f309402a930 tx=0x7f3094004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:34.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.530+0000 7f30a9ffb640 1 -- 172.21.15.84:0/2605193304 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309403f030 con 0x7f30ac1094c0 2024-09-21T03:39:34.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.530+0000 7f30b26e1640 1 -- 172.21.15.84:0/2605193304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30ac1a8980 con 0x7f30ac1094c0 2024-09-21T03:39:34.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.530+0000 7f30a9ffb640 1 -- 172.21.15.84:0/2605193304 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3094003aa0 con 0x7f30ac1094c0 2024-09-21T03:39:34.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.530+0000 7f30a9ffb640 1 -- 172.21.15.84:0/2605193304 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3094035070 con 0x7f30ac1094c0 2024-09-21T03:39:34.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.530+0000 7f30b26e1640 1 -- 172.21.15.84:0/2605193304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30ac1a8e60 con 0x7f30ac1094c0 2024-09-21T03:39:34.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.531+0000 7f30b26e1640 1 -- 172.21.15.84:0/2605193304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30ac103f90 con 0x7f30ac1094c0 2024-09-21T03:39:34.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.533+0000 7f30a9ffb640 1 -- 172.21.15.84:0/2605193304 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f3094042030 con 0x7f30ac1094c0 2024-09-21T03:39:34.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.533+0000 7f30a9ffb640 1 --2- 172.21.15.84:0/2605193304 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f30980b6560 0x7f30980b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:34.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.533+0000 7f30abfff640 1 --2- 172.21.15.84:0/2605193304 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f30980b6560 0x7f30980b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:34.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.534+0000 7f30a9ffb640 1 -- 172.21.15.84:0/2605193304 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7024+0+0 (secure 0 0 0) 0x7f3094107a20 con 0x7f30ac1094c0 2024-09-21T03:39:34.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.534+0000 7f30abfff640 1 --2- 172.21.15.84:0/2605193304 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f30980b6560 0x7f30980b8a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f309c005e10 tx=0x7f309c005da0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:34.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.537+0000 7f30a9ffb640 1 -- 172.21.15.84:0/2605193304 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f30940ce7c0 con 0x7f30ac1094c0 2024-09-21T03:39:34.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.713+0000 7f30b26e1640 1 -- 172.21.15.84:0/2605193304 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f30ac02e640 con 0x7f30ac1094c0 2024-09-21T03:39:34.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.714+0000 7f30a9ffb640 1 -- 172.21.15.84:0/2605193304 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7f30940d2ba0 con 0x7f30ac1094c0 2024-09-21T03:39:34.716 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:39:34.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.716+0000 7f30b26e1640 1 -- 172.21.15.84:0/2605193304 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f30980b6560 msgr2=0x7f30980b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.716+0000 7f30b26e1640 1 --2- 172.21.15.84:0/2605193304 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f30980b6560 0x7f30980b8a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f309c005e10 tx=0x7f309c005da0 comp rx=0 tx=0).stop 2024-09-21T03:39:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.716+0000 7f30b26e1640 1 -- 172.21.15.84:0/2605193304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30ac1094c0 msgr2=0x7f30ac075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.716+0000 7f30b26e1640 1 --2- 172.21.15.84:0/2605193304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30ac1094c0 0x7f30ac075c50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f309402a930 tx=0x7f3094004270 comp rx=0 tx=0).stop 2024-09-21T03:39:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.717+0000 7f30b26e1640 1 -- 172.21.15.84:0/2605193304 shutdown_connections 2024-09-21T03:39:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.717+0000 7f30b26e1640 1 --2- 172.21.15.84:0/2605193304 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f30980b6560 0x7f30980b8a70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.717+0000 7f30b26e1640 1 --2- 172.21.15.84:0/2605193304 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30ac109e10 0x7f30ac076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.717+0000 7f30b26e1640 1 --2- 172.21.15.84:0/2605193304 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f30ac1094c0 0x7f30ac075c50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.717+0000 7f30b26e1640 1 --2- 172.21.15.84:0/2605193304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30ac103b80 0x7f30ac075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.717+0000 7f30b26e1640 1 -- 172.21.15.84:0/2605193304 >> 172.21.15.84:0/2605193304 conn(0x7f30ac0ff610 msgr2=0x7f30ac101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.717+0000 7f30b26e1640 1 -- 172.21.15.84:0/2605193304 shutdown_connections 2024-09-21T03:39:34.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:34.717+0000 7f30b26e1640 1 -- 172.21.15.84:0/2605193304 wait complete. 2024-09-21T03:39:35.498 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1726889953,"num_in_osds":12,"osd_in_since":1726889955,"num_remapped_pgs":0} 2024-09-21T03:39:35.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:35 smithi174 ceph-mon[34403]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:35.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:35 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2605193304' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:39:35.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:35 smithi172 ceph-mon[34821]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:35.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:35 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2605193304' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:39:35.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:35 smithi084 ceph-mon[30941]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:35.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:35 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2605193304' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:39:36.002 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:39:35 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:39:35.712+0000 7f1d2bf9e640 -1 osd.11 0 log_to_monitors true 2024-09-21T03:39:36.499 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T03:39:36.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:36 smithi174 ceph-mon[34403]: from='osd.11 [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:39:36.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:36 smithi172 ceph-mon[34821]: from='osd.11 [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:39:36.743 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:36.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:36 smithi084 ceph-mon[30941]: from='osd.11 [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:39:37.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.311+0000 7f1040722640 1 -- 172.21.15.84:0/1956802726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103810ddf0 msgr2=0x7f1038110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:37.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.311+0000 7f1040722640 1 --2- 172.21.15.84:0/1956802726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103810ddf0 0x7f1038110300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1028009900 tx=0x7f102802a410 comp rx=0 tx=0).stop 2024-09-21T03:39:37.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.311+0000 7f1040722640 1 -- 172.21.15.84:0/1956802726 shutdown_connections 2024-09-21T03:39:37.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.311+0000 7f1040722640 1 --2- 172.21.15.84:0/1956802726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f103810ddf0 0x7f1038110300 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.311+0000 7f1040722640 1 --2- 172.21.15.84:0/1956802726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1038105270 0x7f103810d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.311+0000 7f1040722640 1 --2- 172.21.15.84:0/1956802726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1038104840 0x7f1038104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.311+0000 7f1040722640 1 -- 172.21.15.84:0/1956802726 >> 172.21.15.84:0/1956802726 conn(0x7f1038079730 msgr2=0x7f1038079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.311+0000 7f1040722640 1 -- 172.21.15.84:0/1956802726 shutdown_connections 2024-09-21T03:39:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.311+0000 7f1040722640 1 -- 172.21.15.84:0/1956802726 wait complete. 2024-09-21T03:39:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.312+0000 7f1040722640 1 Processor -- start 2024-09-21T03:39:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.312+0000 7f1040722640 1 -- start start 2024-09-21T03:39:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.312+0000 7f1040722640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1038104840 0x7f103819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.312+0000 7f1040722640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1038105270 0x7f103819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.312+0000 7f1040722640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f103810ddf0 0x7f103819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.312+0000 7f1040722640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1038113a90 con 0x7f1038104840 2024-09-21T03:39:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.312+0000 7f1040722640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1038113910 con 0x7f103810ddf0 2024-09-21T03:39:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.312+0000 7f1040722640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1038113c10 con 0x7f1038105270 2024-09-21T03:39:37.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.312+0000 7f103e4be640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1038104840 0x7f103819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.312+0000 7f103e4be640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1038104840 0x7f103819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44032/0 (socket says 172.21.15.84:44032) 2024-09-21T03:39:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.312+0000 7f103e4be640 1 -- 172.21.15.84:0/1493137013 learned_addr learned my addr 172.21.15.84:0/1493137013 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:39:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.312+0000 7f103dcbd640 1 --2- 172.21.15.84:0/1493137013 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1038105270 0x7f103819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.312+0000 7f103ecbf640 1 --2- 172.21.15.84:0/1493137013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f103810ddf0 0x7f103819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.312+0000 7f103e4be640 1 -- 172.21.15.84:0/1493137013 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1038105270 msgr2=0x7f103819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.312+0000 7f103e4be640 1 --2- 172.21.15.84:0/1493137013 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1038105270 0x7f103819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.312+0000 7f103e4be640 1 -- 172.21.15.84:0/1493137013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f103810ddf0 msgr2=0x7f103819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.312+0000 7f103e4be640 1 --2- 172.21.15.84:0/1493137013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f103810ddf0 0x7f103819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.312+0000 7f103e4be640 1 -- 172.21.15.84:0/1493137013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10381a0430 con 0x7f1038104840 2024-09-21T03:39:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.312+0000 7f103ecbf640 1 --2- 172.21.15.84:0/1493137013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f103810ddf0 0x7f103819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:39:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.313+0000 7f103e4be640 1 --2- 172.21.15.84:0/1493137013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1038104840 0x7f103819a4c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f103000ccb0 tx=0x7f103000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.313+0000 7f10377fe640 1 -- 172.21.15.84:0/1493137013 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1030003990 con 0x7f1038104840 2024-09-21T03:39:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.313+0000 7f10377fe640 1 -- 172.21.15.84:0/1493137013 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1030004020 con 0x7f1038104840 2024-09-21T03:39:37.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.313+0000 7f1040722640 1 -- 172.21.15.84:0/1493137013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10381a0720 con 0x7f1038104840 2024-09-21T03:39:37.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.313+0000 7f10377fe640 1 -- 172.21.15.84:0/1493137013 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103000f6b0 con 0x7f1038104840 2024-09-21T03:39:37.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.313+0000 7f1040722640 1 -- 172.21.15.84:0/1493137013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10381a6e80 con 0x7f1038104840 2024-09-21T03:39:37.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.314+0000 7f1040722640 1 -- 172.21.15.84:0/1493137013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1038104c50 con 0x7f1038104840 2024-09-21T03:39:37.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.315+0000 7f10377fe640 1 -- 172.21.15.84:0/1493137013 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f10300044b0 con 0x7f1038104840 2024-09-21T03:39:37.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.316+0000 7f10377fe640 1 --2- 172.21.15.84:0/1493137013 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f10200b6560 0x7f10200b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:37.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.316+0000 7f103dcbd640 1 --2- 172.21.15.84:0/1493137013 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f10200b6560 0x7f10200b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:37.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.316+0000 7f10377fe640 1 -- 172.21.15.84:0/1493137013 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 7046+0+0 (secure 0 0 0) 0x7f10300e7250 con 0x7f1038104840 2024-09-21T03:39:37.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.317+0000 7f103dcbd640 1 --2- 172.21.15.84:0/1493137013 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f10200b6560 0x7f10200b8a70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f103810fa70 tx=0x7f102c00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:37.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.319+0000 7f10377fe640 1 -- 172.21.15.84:0/1493137013 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1030014030 con 0x7f1038104840 2024-09-21T03:39:37.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.501+0000 7f1040722640 1 -- 172.21.15.84:0/1493137013 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f103819b5f0 con 0x7f1038104840 2024-09-21T03:39:37.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.501+0000 7f10377fe640 1 -- 172.21.15.84:0/1493137013 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f10300adfd0 con 0x7f1038104840 2024-09-21T03:39:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:37 smithi084 ceph-mon[30941]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:37 smithi084 ceph-mon[30941]: from='osd.11 [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T03:39:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:37 smithi084 ceph-mon[30941]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T03:39:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:37 smithi084 ceph-mon[30941]: from='osd.11 [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:39:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:37 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:39:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:37 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:37 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:37 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:37 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:37.504 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:37 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:37.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:37 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:37.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:37 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:37.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:37 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:37.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:37 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:39:37.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:37 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:37.505 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:39:37.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.504+0000 7f1040722640 1 -- 172.21.15.84:0/1493137013 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f10200b6560 msgr2=0x7f10200b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:37.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.504+0000 7f1040722640 1 --2- 172.21.15.84:0/1493137013 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f10200b6560 0x7f10200b8a70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f103810fa70 tx=0x7f102c00b390 comp rx=0 tx=0).stop 2024-09-21T03:39:37.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.504+0000 7f1040722640 1 -- 172.21.15.84:0/1493137013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1038104840 msgr2=0x7f103819a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:37.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.504+0000 7f1040722640 1 --2- 172.21.15.84:0/1493137013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1038104840 0x7f103819a4c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f103000ccb0 tx=0x7f103000a620 comp rx=0 tx=0).stop 2024-09-21T03:39:37.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.504+0000 7f1040722640 1 -- 172.21.15.84:0/1493137013 shutdown_connections 2024-09-21T03:39:37.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.504+0000 7f1040722640 1 --2- 172.21.15.84:0/1493137013 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f10200b6560 0x7f10200b8a70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:37.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.504+0000 7f1040722640 1 --2- 172.21.15.84:0/1493137013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f103810ddf0 0x7f103819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:37.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.504+0000 7f1040722640 1 --2- 172.21.15.84:0/1493137013 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1038105270 0x7f103819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:37.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.504+0000 7f1040722640 1 --2- 172.21.15.84:0/1493137013 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1038104840 0x7f103819a4c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:37.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.504+0000 7f1040722640 1 -- 172.21.15.84:0/1493137013 >> 172.21.15.84:0/1493137013 conn(0x7f1038079730 msgr2=0x7f1038107990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:37.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.504+0000 7f1040722640 1 -- 172.21.15.84:0/1493137013 shutdown_connections 2024-09-21T03:39:37.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:37.504+0000 7f1040722640 1 -- 172.21.15.84:0/1493137013 wait complete. 2024-09-21T03:39:37.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:37 smithi174 ceph-mon[34403]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:37.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:37 smithi174 ceph-mon[34403]: from='osd.11 [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T03:39:37.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:37 smithi174 ceph-mon[34403]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T03:39:37.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:37 smithi174 ceph-mon[34403]: from='osd.11 [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:39:37.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:37 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:39:37.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:37 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:37.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:37 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:37.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:37 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:37.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:37 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:37.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:37 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:37.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:37 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:37.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:37 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:37.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:37 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:37.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:37 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:39:37.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:37 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:37.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:37 smithi172 ceph-mon[34821]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:37.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:37 smithi172 ceph-mon[34821]: from='osd.11 [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T03:39:37.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:37 smithi172 ceph-mon[34821]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T03:39:37.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:37 smithi172 ceph-mon[34821]: from='osd.11 [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]} : dispatch 2024-09-21T03:39:37.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:37 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:39:37.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:37 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:37.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:37 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:37.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:37 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:37.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:37 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:37.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:37 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:37.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:37 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T03:39:37.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:37 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:37.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:37 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:37.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:37 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:39:37.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:37 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:38.128 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:39:37 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:39:37.781+0000 7f1d28735640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T03:39:38.128 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:39:37 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:39:37.794+0000 7f1d1fd16640 -1 osd.11 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:39:38.182 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1726889953,"num_in_osds":12,"osd_in_since":1726889955,"num_remapped_pgs":0} 2024-09-21T03:39:38.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:38 smithi174 ceph-mon[34403]: Detected new or changed devices on smithi174 2024-09-21T03:39:38.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:38 smithi174 ceph-mon[34403]: Adjusting osd_memory_target on smithi174 to 4272M 2024-09-21T03:39:38.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:38 smithi174 ceph-mon[34403]: from='osd.11 [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T03:39:38.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:38 smithi174 ceph-mon[34403]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T03:39:38.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:38 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:39:38.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:38 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:39:38.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:38 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1493137013' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:39:38.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:38 smithi174 ceph-mon[34403]: from='osd.11 [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924]' entity='osd.11' 2024-09-21T03:39:38.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:38 smithi172 ceph-mon[34821]: Detected new or changed devices on smithi174 2024-09-21T03:39:38.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:38 smithi172 ceph-mon[34821]: Adjusting osd_memory_target on smithi174 to 4272M 2024-09-21T03:39:38.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:38 smithi172 ceph-mon[34821]: from='osd.11 [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T03:39:38.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:38 smithi172 ceph-mon[34821]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T03:39:38.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:38 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:39:38.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:38 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:39:38.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:38 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1493137013' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:39:38.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:38 smithi172 ceph-mon[34821]: from='osd.11 [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924]' entity='osd.11' 2024-09-21T03:39:38.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:38 smithi084 ceph-mon[30941]: Detected new or changed devices on smithi174 2024-09-21T03:39:38.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:38 smithi084 ceph-mon[30941]: Adjusting osd_memory_target on smithi174 to 4272M 2024-09-21T03:39:38.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:38 smithi084 ceph-mon[30941]: from='osd.11 [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi174", "root=default"]}]': finished 2024-09-21T03:39:38.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:38 smithi084 ceph-mon[30941]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T03:39:38.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:38 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:39:38.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:38 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:39:38.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:38 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1493137013' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:39:38.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:38 smithi084 ceph-mon[30941]: from='osd.11 [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924]' entity='osd.11' 2024-09-21T03:39:39.183 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T03:39:39.440 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:39.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:39 smithi084 ceph-mon[30941]: purged_snaps scrub starts 2024-09-21T03:39:39.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:39 smithi084 ceph-mon[30941]: purged_snaps scrub ok 2024-09-21T03:39:39.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:39 smithi084 ceph-mon[30941]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:39.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:39 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:39:39.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:39 smithi084 ceph-mon[30941]: osd.11 [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924] boot 2024-09-21T03:39:39.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:39 smithi084 ceph-mon[30941]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T03:39:39.561 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:39 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:39:39.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:39 smithi174 ceph-mon[34403]: purged_snaps scrub starts 2024-09-21T03:39:39.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:39 smithi174 ceph-mon[34403]: purged_snaps scrub ok 2024-09-21T03:39:39.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:39 smithi174 ceph-mon[34403]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:39.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:39 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:39:39.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:39 smithi174 ceph-mon[34403]: osd.11 [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924] boot 2024-09-21T03:39:39.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:39 smithi174 ceph-mon[34403]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T03:39:39.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:39 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:39:39.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:39 smithi172 ceph-mon[34821]: purged_snaps scrub starts 2024-09-21T03:39:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:39 smithi172 ceph-mon[34821]: purged_snaps scrub ok 2024-09-21T03:39:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:39 smithi172 ceph-mon[34821]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 334 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:39:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:39 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:39:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:39 smithi172 ceph-mon[34821]: osd.11 [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924] boot 2024-09-21T03:39:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:39 smithi172 ceph-mon[34821]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T03:39:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:39 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:39:39.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.935+0000 7f5023be2640 1 -- 172.21.15.84:0/961860992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501c108cf0 msgr2=0x7f501c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.935+0000 7f5023be2640 1 --2- 172.21.15.84:0/961860992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501c108cf0 0x7f501c10f520 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5014009ca0 tx=0x7f501402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:39:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.935+0000 7f5023be2640 1 -- 172.21.15.84:0/961860992 shutdown_connections 2024-09-21T03:39:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.935+0000 7f5023be2640 1 --2- 172.21.15.84:0/961860992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501c108cf0 0x7f501c10f520 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.935+0000 7f5023be2640 1 --2- 172.21.15.84:0/961860992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f501c1083a0 0x7f501c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.935+0000 7f5023be2640 1 --2- 172.21.15.84:0/961860992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f501c102a60 0x7f501c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.935+0000 7f5023be2640 1 -- 172.21.15.84:0/961860992 >> 172.21.15.84:0/961860992 conn(0x7f501c079730 msgr2=0x7f501c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.935+0000 7f5023be2640 1 -- 172.21.15.84:0/961860992 shutdown_connections 2024-09-21T03:39:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.935+0000 7f5023be2640 1 -- 172.21.15.84:0/961860992 wait complete. 2024-09-21T03:39:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.936+0000 7f5023be2640 1 Processor -- start 2024-09-21T03:39:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.936+0000 7f5023be2640 1 -- start start 2024-09-21T03:39:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.936+0000 7f5023be2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f501c102a60 0x7f501c199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.936+0000 7f5023be2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f501c1083a0 0x7f501c1999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:39.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.936+0000 7f5023be2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501c108cf0 0x7f501c19ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:39.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.936+0000 7f5023be2640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f501c1129c0 con 0x7f501c108cf0 2024-09-21T03:39:39.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.936+0000 7f5023be2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f501c112840 con 0x7f501c1083a0 2024-09-21T03:39:39.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.936+0000 7f5023be2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f501c112b40 con 0x7f501c102a60 2024-09-21T03:39:39.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.936+0000 7f502217f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501c108cf0 0x7f501c19ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:39.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.936+0000 7f502217f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501c108cf0 0x7f501c19ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52944/0 (socket says 172.21.15.84:52944) 2024-09-21T03:39:39.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.936+0000 7f502217f640 1 -- 172.21.15.84:0/3077160352 learned_addr learned my addr 172.21.15.84:0/3077160352 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:39:39.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.936+0000 7f502117d640 1 --2- 172.21.15.84:0/3077160352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f501c1083a0 0x7f501c1999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:39.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.936+0000 7f502197e640 1 --2- 172.21.15.84:0/3077160352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f501c102a60 0x7f501c199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:39.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.936+0000 7f502217f640 1 -- 172.21.15.84:0/3077160352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f501c102a60 msgr2=0x7f501c199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:39.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.936+0000 7f502217f640 1 --2- 172.21.15.84:0/3077160352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f501c102a60 0x7f501c199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:39.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.936+0000 7f502217f640 1 -- 172.21.15.84:0/3077160352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f501c1083a0 msgr2=0x7f501c1999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:39.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.936+0000 7f502217f640 1 --2- 172.21.15.84:0/3077160352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f501c1083a0 0x7f501c1999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:39.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.936+0000 7f502217f640 1 -- 172.21.15.84:0/3077160352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501c19f380 con 0x7f501c108cf0 2024-09-21T03:39:39.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.936+0000 7f502117d640 1 --2- 172.21.15.84:0/3077160352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f501c1083a0 0x7f501c1999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:39:39.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.937+0000 7f502217f640 1 --2- 172.21.15.84:0/3077160352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501c108cf0 0x7f501c19ec50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5014005cc0 tx=0x7f501402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:39.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.937+0000 7f5012ffd640 1 -- 172.21.15.84:0/3077160352 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5014003bf0 con 0x7f501c108cf0 2024-09-21T03:39:39.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.937+0000 7f5023be2640 1 -- 172.21.15.84:0/3077160352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f501c19f610 con 0x7f501c108cf0 2024-09-21T03:39:39.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.937+0000 7f5012ffd640 1 -- 172.21.15.84:0/3077160352 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5014003d90 con 0x7f501c108cf0 2024-09-21T03:39:39.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.937+0000 7f5012ffd640 1 -- 172.21.15.84:0/3077160352 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501402fbc0 con 0x7f501c108cf0 2024-09-21T03:39:39.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.937+0000 7f5023be2640 1 -- 172.21.15.84:0/3077160352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f501c1a5dd0 con 0x7f501c108cf0 2024-09-21T03:39:39.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.938+0000 7f5023be2640 1 -- 172.21.15.84:0/3077160352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f501c102e70 con 0x7f501c108cf0 2024-09-21T03:39:39.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.939+0000 7f5012ffd640 1 -- 172.21.15.84:0/3077160352 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f501402fd60 con 0x7f501c108cf0 2024-09-21T03:39:39.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.940+0000 7f5012ffd640 1 --2- 172.21.15.84:0/3077160352 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f50080b6560 0x7f50080b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:39.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.940+0000 7f502197e640 1 --2- 172.21.15.84:0/3077160352 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f50080b6560 0x7f50080b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:39.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.940+0000 7f5012ffd640 1 -- 172.21.15.84:0/3077160352 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f50141085f0 con 0x7f501c108cf0 2024-09-21T03:39:39.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.940+0000 7f502197e640 1 --2- 172.21.15.84:0/3077160352 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f50080b6560 0x7f50080b8a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f500c005fd0 tx=0x7f500c005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:39.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:39.944+0000 7f5012ffd640 1 -- 172.21.15.84:0/3077160352 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f50140cf250 con 0x7f501c108cf0 2024-09-21T03:39:40.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:40.123+0000 7f5023be2640 1 -- 172.21.15.84:0/3077160352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f501c10ab40 con 0x7f501c108cf0 2024-09-21T03:39:40.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:40.124+0000 7f5012ffd640 1 -- 172.21.15.84:0/3077160352 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7f50140098b0 con 0x7f501c108cf0 2024-09-21T03:39:40.126 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:39:40.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:40.126+0000 7f5023be2640 1 -- 172.21.15.84:0/3077160352 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f50080b6560 msgr2=0x7f50080b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:40.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:40.126+0000 7f5023be2640 1 --2- 172.21.15.84:0/3077160352 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f50080b6560 0x7f50080b8a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f500c005fd0 tx=0x7f500c005850 comp rx=0 tx=0).stop 2024-09-21T03:39:40.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:40.126+0000 7f5023be2640 1 -- 172.21.15.84:0/3077160352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501c108cf0 msgr2=0x7f501c19ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:40.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:40.126+0000 7f5023be2640 1 --2- 172.21.15.84:0/3077160352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501c108cf0 0x7f501c19ec50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5014005cc0 tx=0x7f501402f380 comp rx=0 tx=0).stop 2024-09-21T03:39:40.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:40.126+0000 7f5023be2640 1 -- 172.21.15.84:0/3077160352 shutdown_connections 2024-09-21T03:39:40.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:40.126+0000 7f5023be2640 1 --2- 172.21.15.84:0/3077160352 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f50080b6560 0x7f50080b8a70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:40.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:40.126+0000 7f5023be2640 1 --2- 172.21.15.84:0/3077160352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f501c108cf0 0x7f501c19ec50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:40.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:40.126+0000 7f5023be2640 1 --2- 172.21.15.84:0/3077160352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f501c1083a0 0x7f501c1999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:40.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:40.126+0000 7f5023be2640 1 --2- 172.21.15.84:0/3077160352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f501c102a60 0x7f501c199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:40.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:40.126+0000 7f5023be2640 1 -- 172.21.15.84:0/3077160352 >> 172.21.15.84:0/3077160352 conn(0x7f501c079730 msgr2=0x7f501c1052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:40.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:40.126+0000 7f5023be2640 1 -- 172.21.15.84:0/3077160352 shutdown_connections 2024-09-21T03:39:40.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:40.126+0000 7f5023be2640 1 -- 172.21.15.84:0/3077160352 wait complete. 2024-09-21T03:39:40.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:40 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3077160352' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:39:40.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:40 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3077160352' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:39:40.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:40 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3077160352' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:39:40.900 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":69,"num_osds":12,"num_up_osds":12,"osd_up_since":1726889978,"num_in_osds":12,"osd_in_since":1726889955,"num_remapped_pgs":0} 2024-09-21T03:39:40.900 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:39:41.146 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:41.546 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:41 smithi084 ceph-mon[30941]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:41.546 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:41 smithi084 ceph-mon[30941]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T03:39:41.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.633+0000 7fd000f39640 1 -- 172.21.15.84:0/3912667580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcffc1083b0 msgr2=0x7fcffc1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:41.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.633+0000 7fd000f39640 1 --2- 172.21.15.84:0/3912667580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcffc1083b0 0x7fcffc1087c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009900 tx=0x7fcfe402a410 comp rx=0 tx=0).stop 2024-09-21T03:39:41.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.633+0000 7fd000f39640 1 -- 172.21.15.84:0/3912667580 shutdown_connections 2024-09-21T03:39:41.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.633+0000 7fd000f39640 1 --2- 172.21.15.84:0/3912667580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcffc108d00 0x7fcffc10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:41.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.633+0000 7fd000f39640 1 --2- 172.21.15.84:0/3912667580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcffc1083b0 0x7fcffc1087c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:41.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.633+0000 7fd000f39640 1 --2- 172.21.15.84:0/3912667580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcffc102ac0 0x7fcffc102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:41.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.633+0000 7fd000f39640 1 -- 172.21.15.84:0/3912667580 >> 172.21.15.84:0/3912667580 conn(0x7fcffc079790 msgr2=0x7fcffc079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:41.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.633+0000 7fd000f39640 1 -- 172.21.15.84:0/3912667580 shutdown_connections 2024-09-21T03:39:41.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.633+0000 7fd000f39640 1 -- 172.21.15.84:0/3912667580 wait complete. 2024-09-21T03:39:41.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.634+0000 7fd000f39640 1 Processor -- start 2024-09-21T03:39:41.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.634+0000 7fd000f39640 1 -- start start 2024-09-21T03:39:41.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.635+0000 7fd000f39640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcffc102ac0 0x7fcffc19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:41.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.635+0000 7fd000f39640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcffc1083b0 0x7fcffc19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:41.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.635+0000 7fd000f39640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcffc108d00 0x7fcffc19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:41.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.635+0000 7fd000f39640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc113ae0 con 0x7fcffc108d00 2024-09-21T03:39:41.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.635+0000 7fd000f39640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc113960 con 0x7fcffc1083b0 2024-09-21T03:39:41.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.635+0000 7fd000f39640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcffc113c60 con 0x7fcffc102ac0 2024-09-21T03:39:41.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.635+0000 7fcffad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcffc108d00 0x7fcffc19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:41.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.635+0000 7fcffad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcffc108d00 0x7fcffc19fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52968/0 (socket says 172.21.15.84:52968) 2024-09-21T03:39:41.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.635+0000 7fcffad9d640 1 -- 172.21.15.84:0/2873925384 learned_addr learned my addr 172.21.15.84:0/2873925384 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:39:41.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.635+0000 7fcffa59c640 1 --2- 172.21.15.84:0/2873925384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcffc102ac0 0x7fcffc19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:41.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.635+0000 7fcff1d9b640 1 --2- 172.21.15.84:0/2873925384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcffc1083b0 0x7fcffc19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:41.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.635+0000 7fcffad9d640 1 -- 172.21.15.84:0/2873925384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcffc102ac0 msgr2=0x7fcffc19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:41.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.635+0000 7fcffad9d640 1 --2- 172.21.15.84:0/2873925384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcffc102ac0 0x7fcffc19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:41.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.635+0000 7fcffad9d640 1 -- 172.21.15.84:0/2873925384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcffc1083b0 msgr2=0x7fcffc19aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:41.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.635+0000 7fcffad9d640 1 --2- 172.21.15.84:0/2873925384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcffc1083b0 0x7fcffc19aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:41.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.635+0000 7fcffad9d640 1 -- 172.21.15.84:0/2873925384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcffc1a0400 con 0x7fcffc108d00 2024-09-21T03:39:41.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.635+0000 7fcff1d9b640 1 --2- 172.21.15.84:0/2873925384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcffc1083b0 0x7fcffc19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:39:41.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.635+0000 7fcffad9d640 1 --2- 172.21.15.84:0/2873925384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcffc108d00 0x7fcffc19fcd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcff400eaa0 tx=0x7fcff400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:41.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.635+0000 7fcff3fff640 1 -- 172.21.15.84:0/2873925384 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff400cdb0 con 0x7fcffc108d00 2024-09-21T03:39:41.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.635+0000 7fd000f39640 1 -- 172.21.15.84:0/2873925384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcffc1a06f0 con 0x7fcffc108d00 2024-09-21T03:39:41.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.636+0000 7fd000f39640 1 -- 172.21.15.84:0/2873925384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcffc1a6e50 con 0x7fcffc108d00 2024-09-21T03:39:41.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.636+0000 7fcff3fff640 1 -- 172.21.15.84:0/2873925384 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcff4005020 con 0x7fcffc108d00 2024-09-21T03:39:41.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.636+0000 7fcff3fff640 1 -- 172.21.15.84:0/2873925384 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff40116d0 con 0x7fcffc108d00 2024-09-21T03:39:41.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.637+0000 7fd000f39640 1 -- 172.21.15.84:0/2873925384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcffc103cf0 con 0x7fcffc108d00 2024-09-21T03:39:41.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.638+0000 7fcff3fff640 1 -- 172.21.15.84:0/2873925384 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fcff4011870 con 0x7fcffc108d00 2024-09-21T03:39:41.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.639+0000 7fcff3fff640 1 --2- 172.21.15.84:0/2873925384 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcfe80b6560 0x7fcfe80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:41.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.639+0000 7fcffa59c640 1 --2- 172.21.15.84:0/2873925384 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcfe80b6560 0x7fcfe80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:41.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.639+0000 7fcff3fff640 1 -- 172.21.15.84:0/2873925384 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fcff40e71a0 con 0x7fcffc108d00 2024-09-21T03:39:41.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.639+0000 7fcffa59c640 1 --2- 172.21.15.84:0/2873925384 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcfe80b6560 0x7fcfe80b8a70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0058c0 tx=0x7fcfec00a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:41.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.643+0000 7fcff3fff640 1 -- 172.21.15.84:0/2873925384 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcff4016030 con 0x7fcffc108d00 2024-09-21T03:39:41.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:41 smithi172 ceph-mon[34821]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:41 smithi172 ceph-mon[34821]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T03:39:41.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.821+0000 7fd000f39640 1 -- 172.21.15.84:0/2873925384 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcffc10aaf0 con 0x7fcffc108d00 2024-09-21T03:39:41.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.822+0000 7fcff3fff640 1 -- 172.21.15.84:0/2873925384 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+18821 (secure 0 0 0) 0x7fcff40ade00 con 0x7fcffc108d00 2024-09-21T03:39:41.824 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:39:41.824 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":70,"fsid":"e3f8c18e-77c9-11ef-baf5-efdc52797490","created":"2024-09-21T03:31:55.307035+0000","modified":"2024-09-21T03:39:40.375281+0000","last_up_change":"2024-09-21T03:39:38.786385+0000","last_in_change":"2024-09-21T03:39:15.267368+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:35:50.488653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d283ba0-18f3-4668-90c4-884e9e957a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6803","nonce":508132562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6805","nonce":508132562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6809","nonce":508132562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6807","nonce":508132562}]},"public_addr":"172.21.15.84:6803/508132562","cluster_addr":"172.21.15.84:6805/508132562","heartbeat_back_addr":"172.21.15.84:6809/508132562","heartbeat_front_addr":"172.21.15.84:6807/508132562","state":["exists","up"]},{"osd":1,"uuid":"f115c5b6-812d-430f-9f0e-cb5311b7581e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6801","nonce":2931872350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6803","nonce":2931872350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6807","nonce":2931872350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6805","nonce":2931872350}]},"public_addr":"172.21.15.172:6801/2931872350","cluster_addr":"172.21.15.172:6803/2931872350","heartbeat_back_addr":"172.21.15.172:6807/2931872350","heartbeat_front_addr":"172.21.15.172:6805/2931872350","state":["exists","up"]},{"osd":2,"uuid":"36489240-e233-4aa7-ae9c-089d76683172","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6801","nonce":1847612335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6803","nonce":1847612335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6807","nonce":1847612335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6805","nonce":1847612335}]},"public_addr":"172.21.15.174:6801/1847612335","cluster_addr":"172.21.15.174:6803/1847612335","heartbeat_back_addr":"172.21.15.174:6807/1847612335","heartbeat_front_addr":"172.21.15.174:6805/1847612335","state":["exists","up"]},{"osd":3,"uuid":"1f35b404-b658-4e94-a5f4-74a6431a6a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6811","nonce":2230529863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6813","nonce":2230529863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6817","nonce":2230529863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6815","nonce":2230529863}]},"public_addr":"172.21.15.84:6811/2230529863","cluster_addr":"172.21.15.84:6813/2230529863","heartbeat_back_addr":"172.21.15.84:6817/2230529863","heartbeat_front_addr":"172.21.15.84:6815/2230529863","state":["exists","up"]},{"osd":4,"uuid":"91a2f83b-4c7d-4661-86a1-63a09888939d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6809","nonce":3069862739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6811","nonce":3069862739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6815","nonce":3069862739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6813","nonce":3069862739}]},"public_addr":"172.21.15.172:6809/3069862739","cluster_addr":"172.21.15.172:6811/3069862739","heartbeat_back_addr":"172.21.15.172:6815/3069862739","heartbeat_front_addr":"172.21.15.172:6813/3069862739","state":["exists","up"]},{"osd":5,"uuid":"e8f06b34-3956-499f-8073-09011cf1ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6809","nonce":1987010600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6811","nonce":1987010600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6815","nonce":1987010600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6813","nonce":1987010600}]},"public_addr":"172.21.15.174:6809/1987010600","cluster_addr":"172.21.15.174:6811/1987010600","heartbeat_back_addr":"172.21.15.174:6815/1987010600","heartbeat_front_addr":"172.21.15.174:6813/1987010600","state":["exists","up"]},{"osd":6,"uuid":"23d55e96-4987-4cbe-8c6b-cece4de9269b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6819","nonce":3418459345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6821","nonce":3418459345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6825","nonce":3418459345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6823","nonce":3418459345}]},"public_addr":"172.21.15.84:6819/3418459345","cluster_addr":"172.21.15.84:6821/3418459345","heartbeat_back_addr":"172.21.15.84:6825/3418459345","heartbeat_front_addr":"172.21.15.84:6823/3418459345","state":["exists","up"]},{"osd":7,"uuid":"ca91a34c-d8b1-48b8-93f4-72a5c15939d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6817","nonce":4056019738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6819","nonce":4056019738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6823","nonce":4056019738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6821","nonce":4056019738}]},"public_addr":"172.21.15.172:6817/4056019738","cluster_addr":"172.21.15.172:6819/4056019738","heartbeat_back_addr":"172.21.15.172:6823/4056019738","heartbeat_front_addr":"172.21.15.172:6821/4056019738","state":["exists","up"]},{"osd":8,"uuid":"37da8c61-d72f-4b58-b10c-7c7539ecffd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6817","nonce":2162992546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6819","nonce":2162992546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6823","nonce":2162992546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6821","nonce":2162992546}]},"public_addr":"172.21.15.174:6817/2162992546","cluster_addr":"172.21.15.174:6819/2162992546","heartbeat_back_addr":"172.21.15.174:6823/2162992546","heartbeat_front_addr":"172.21.15.174:6821/2162992546","state":["exists","up"]},{"osd":9,"uuid":"c9179f33-622d-44bd-9d8a-c92951afb1e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6827","nonce":3230873673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6829","nonce":3230873673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6833","nonce":3230873673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6831","nonce":3230873673}]},"public_addr":"172.21.15.84:6827/3230873673","cluster_addr":"172.21.15.84:6829/3230873673","heartbeat_back_addr":"172.21.15.84:6833/3230873673","heartbeat_front_addr":"172.21.15.84:6831/3230873673","state":["exists","up"]},{"osd":10,"uuid":"9788fa2d-49fb-431b-a0e3-62d6e421e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6825","nonce":2667099391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6827","nonce":2667099391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6831","nonce":2667099391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6829","nonce":2667099391}]},"public_addr":"172.21.15.172:6825/2667099391","cluster_addr":"172.21.15.172:6827/2667099391","heartbeat_back_addr":"172.21.15.172:6831/2667099391","heartbeat_front_addr":"172.21.15.172:6829/2667099391","state":["exists","up"]},{"osd":11,"uuid":"a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6825","nonce":3452825924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6827","nonce":3452825924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6831","nonce":3452825924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6829","nonce":3452825924}]},"public_addr":"172.21.15.174:6825/3452825924","cluster_addr":"172.21.15.174:6827/3452825924","heartbeat_back_addr":"172.21.15.174:6831/3452825924","heartbeat_front_addr":"172.21.15.174:6829/3452825924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:34:57.413946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:22.813846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:47.074625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:12.871112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:38.705563+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:04.277966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:29.661290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:55.475432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:20.644247+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:46.151594+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:11.499623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:36.688459+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6800/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3308084314":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3663660709":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/1794153935":"2024-09-22T03:32:49.459372+0000","172.21.15.84:6800/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6800/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1874814897":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6801/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/390051797":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/2148206075":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1916019809":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6801/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3491731835":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3418048965":"2024-09-22T03:33:50.188998+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:39:41.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.824+0000 7fd000f39640 1 -- 172.21.15.84:0/2873925384 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcfe80b6560 msgr2=0x7fcfe80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:41.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.824+0000 7fd000f39640 1 --2- 172.21.15.84:0/2873925384 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcfe80b6560 0x7fcfe80b8a70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0058c0 tx=0x7fcfec00a2d0 comp rx=0 tx=0).stop 2024-09-21T03:39:41.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.824+0000 7fd000f39640 1 -- 172.21.15.84:0/2873925384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcffc108d00 msgr2=0x7fcffc19fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:41.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.824+0000 7fd000f39640 1 --2- 172.21.15.84:0/2873925384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcffc108d00 0x7fcffc19fcd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcff400eaa0 tx=0x7fcff400ef60 comp rx=0 tx=0).stop 2024-09-21T03:39:41.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.824+0000 7fd000f39640 1 -- 172.21.15.84:0/2873925384 shutdown_connections 2024-09-21T03:39:41.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.824+0000 7fd000f39640 1 --2- 172.21.15.84:0/2873925384 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcfe80b6560 0x7fcfe80b8a70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:41.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.824+0000 7fd000f39640 1 --2- 172.21.15.84:0/2873925384 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcffc108d00 0x7fcffc19fcd0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:41.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.824+0000 7fd000f39640 1 --2- 172.21.15.84:0/2873925384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcffc1083b0 0x7fcffc19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:41.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.824+0000 7fd000f39640 1 --2- 172.21.15.84:0/2873925384 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcffc102ac0 0x7fcffc19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:41.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.824+0000 7fd000f39640 1 -- 172.21.15.84:0/2873925384 >> 172.21.15.84:0/2873925384 conn(0x7fcffc079790 msgr2=0x7fcffc1064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:41.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.824+0000 7fd000f39640 1 -- 172.21.15.84:0/2873925384 shutdown_connections 2024-09-21T03:39:41.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:41.824+0000 7fd000f39640 1 -- 172.21.15.84:0/2873925384 wait complete. 2024-09-21T03:39:41.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:41 smithi174 ceph-mon[34403]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:41.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:41 smithi174 ceph-mon[34403]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T03:39:42.596 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:35:50.488653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T03:39:42.596 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T03:39:42.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:42 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2873925384' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:39:42.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:42 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2873925384' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:39:42.836 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:42.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:42 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2873925384' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:39:43.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.352+0000 7fb1803ec640 1 -- 172.21.15.84:0/1625677708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb178108420 msgr2=0x7fb178108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:43.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.352+0000 7fb1803ec640 1 --2- 172.21.15.84:0/1625677708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb178108420 0x7fb178108830 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb16c009900 tx=0x7fb16c02a410 comp rx=0 tx=0).stop 2024-09-21T03:39:43.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.352+0000 7fb1803ec640 1 -- 172.21.15.84:0/1625677708 shutdown_connections 2024-09-21T03:39:43.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.352+0000 7fb1803ec640 1 --2- 172.21.15.84:0/1625677708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb178108d70 0x7fb17810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:43.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.352+0000 7fb1803ec640 1 --2- 172.21.15.84:0/1625677708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb178108420 0x7fb178108830 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:43.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.352+0000 7fb1803ec640 1 --2- 172.21.15.84:0/1625677708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb178102ae0 0x7fb178102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:43.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.352+0000 7fb1803ec640 1 -- 172.21.15.84:0/1625677708 >> 172.21.15.84:0/1625677708 conn(0x7fb178079770 msgr2=0x7fb178079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:43.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.352+0000 7fb1803ec640 1 -- 172.21.15.84:0/1625677708 shutdown_connections 2024-09-21T03:39:43.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.352+0000 7fb1803ec640 1 -- 172.21.15.84:0/1625677708 wait complete. 2024-09-21T03:39:43.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.352+0000 7fb1803ec640 1 Processor -- start 2024-09-21T03:39:43.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.352+0000 7fb1803ec640 1 -- start start 2024-09-21T03:39:43.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.353+0000 7fb1803ec640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb178102ae0 0x7fb17819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:43.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.353+0000 7fb1803ec640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb178108420 0x7fb17819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.353+0000 7fb1803ec640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb178108d70 0x7fb17819fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.353+0000 7fb1803ec640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb178113b50 con 0x7fb178108420 2024-09-21T03:39:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.353+0000 7fb1803ec640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb1781139d0 con 0x7fb178108d70 2024-09-21T03:39:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.353+0000 7fb1803ec640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb178113cd0 con 0x7fb178102ae0 2024-09-21T03:39:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.353+0000 7fb17d987640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb178108420 0x7fb17819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.353+0000 7fb17d987640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb178108420 0x7fb17819ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52984/0 (socket says 172.21.15.84:52984) 2024-09-21T03:39:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.353+0000 7fb17d987640 1 -- 172.21.15.84:0/2205389698 learned_addr learned my addr 172.21.15.84:0/2205389698 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:39:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.353+0000 7fb17e188640 1 --2- 172.21.15.84:0/2205389698 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb178102ae0 0x7fb17819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.353+0000 7fb17e989640 1 --2- 172.21.15.84:0/2205389698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb178108d70 0x7fb17819fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.353+0000 7fb17d987640 1 -- 172.21.15.84:0/2205389698 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb178102ae0 msgr2=0x7fb17819a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.353+0000 7fb17d987640 1 --2- 172.21.15.84:0/2205389698 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb178102ae0 0x7fb17819a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.353+0000 7fb17d987640 1 -- 172.21.15.84:0/2205389698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb178108d70 msgr2=0x7fb17819fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.353+0000 7fb17d987640 1 --2- 172.21.15.84:0/2205389698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb178108d70 0x7fb17819fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:43.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.353+0000 7fb17d987640 1 -- 172.21.15.84:0/2205389698 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1781a04f0 con 0x7fb178108420 2024-09-21T03:39:43.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.353+0000 7fb17e989640 1 --2- 172.21.15.84:0/2205389698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb178108d70 0x7fb17819fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:43.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.353+0000 7fb17d987640 1 --2- 172.21.15.84:0/2205389698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb178108420 0x7fb17819ab20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb16c02a930 tx=0x7fb16c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:43.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.354+0000 7fb1777fe640 1 -- 172.21.15.84:0/2205389698 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c03f030 con 0x7fb178108420 2024-09-21T03:39:43.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.354+0000 7fb1803ec640 1 -- 172.21.15.84:0/2205389698 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1781a0780 con 0x7fb178108420 2024-09-21T03:39:43.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.354+0000 7fb1777fe640 1 -- 172.21.15.84:0/2205389698 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb16c003cb0 con 0x7fb178108420 2024-09-21T03:39:43.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.354+0000 7fb1777fe640 1 -- 172.21.15.84:0/2205389698 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c035070 con 0x7fb178108420 2024-09-21T03:39:43.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.354+0000 7fb1803ec640 1 -- 172.21.15.84:0/2205389698 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1781a6f40 con 0x7fb178108420 2024-09-21T03:39:43.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.355+0000 7fb1803ec640 1 -- 172.21.15.84:0/2205389698 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb178103d60 con 0x7fb178108420 2024-09-21T03:39:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.356+0000 7fb1777fe640 1 -- 172.21.15.84:0/2205389698 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fb16c042030 con 0x7fb178108420 2024-09-21T03:39:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.357+0000 7fb1777fe640 1 --2- 172.21.15.84:0/2205389698 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb1600b6560 0x7fb1600b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.357+0000 7fb17e188640 1 --2- 172.21.15.84:0/2205389698 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb1600b6560 0x7fb1600b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.357+0000 7fb1777fe640 1 -- 172.21.15.84:0/2205389698 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fb16c1079f0 con 0x7fb178108420 2024-09-21T03:39:43.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.357+0000 7fb17e188640 1 --2- 172.21.15.84:0/2205389698 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb1600b6560 0x7fb1600b8a70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb168005c40 tx=0x7fb16800a590 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:43.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.360+0000 7fb1777fe640 1 -- 172.21.15.84:0/2205389698 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb16c0ce650 con 0x7fb178108420 2024-09-21T03:39:43.542 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:43 smithi084 ceph-mon[30941]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:43.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.539+0000 7fb1803ec640 1 -- 172.21.15.84:0/2205389698 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb17810ab60 con 0x7fb178108420 2024-09-21T03:39:43.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.540+0000 7fb1777fe640 1 -- 172.21.15.84:0/2205389698 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7fb16c0d2a30 con 0x7fb178108420 2024-09-21T03:39:43.543 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-09-21T03:39:43.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.542+0000 7fb1803ec640 1 -- 172.21.15.84:0/2205389698 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb1600b6560 msgr2=0x7fb1600b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:43.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.542+0000 7fb1803ec640 1 --2- 172.21.15.84:0/2205389698 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb1600b6560 0x7fb1600b8a70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb168005c40 tx=0x7fb16800a590 comp rx=0 tx=0).stop 2024-09-21T03:39:43.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.542+0000 7fb1803ec640 1 -- 172.21.15.84:0/2205389698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb178108420 msgr2=0x7fb17819ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:43.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.542+0000 7fb1803ec640 1 --2- 172.21.15.84:0/2205389698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb178108420 0x7fb17819ab20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb16c02a930 tx=0x7fb16c004270 comp rx=0 tx=0).stop 2024-09-21T03:39:43.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.542+0000 7fb1803ec640 1 -- 172.21.15.84:0/2205389698 shutdown_connections 2024-09-21T03:39:43.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.542+0000 7fb1803ec640 1 --2- 172.21.15.84:0/2205389698 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb1600b6560 0x7fb1600b8a70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:43.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.542+0000 7fb1803ec640 1 --2- 172.21.15.84:0/2205389698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb178108d70 0x7fb17819fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:43.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.542+0000 7fb1803ec640 1 --2- 172.21.15.84:0/2205389698 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb178108420 0x7fb17819ab20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:43.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.542+0000 7fb1803ec640 1 --2- 172.21.15.84:0/2205389698 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb178102ae0 0x7fb17819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:43.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.542+0000 7fb1803ec640 1 -- 172.21.15.84:0/2205389698 >> 172.21.15.84:0/2205389698 conn(0x7fb178079770 msgr2=0x7fb1781064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:43.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.542+0000 7fb1803ec640 1 -- 172.21.15.84:0/2205389698 shutdown_connections 2024-09-21T03:39:43.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:43.542+0000 7fb1803ec640 1 -- 172.21.15.84:0/2205389698 wait complete. 2024-09-21T03:39:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:43 smithi172 ceph-mon[34821]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:43.685 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:43 smithi174 ceph-mon[34403]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:44.345 INFO:tasks.cephadm:Adding mds.a on smithi084 2024-09-21T03:39:44.345 INFO:tasks.cephadm:Adding mds.d on smithi084 2024-09-21T03:39:44.345 INFO:tasks.cephadm:Adding mds.g on smithi084 2024-09-21T03:39:44.345 INFO:tasks.cephadm:Adding mds.j on smithi084 2024-09-21T03:39:44.345 INFO:tasks.cephadm:Adding mds.b on smithi172 2024-09-21T03:39:44.345 INFO:tasks.cephadm:Adding mds.e on smithi172 2024-09-21T03:39:44.345 INFO:tasks.cephadm:Adding mds.h on smithi172 2024-09-21T03:39:44.345 INFO:tasks.cephadm:Adding mds.k on smithi172 2024-09-21T03:39:44.346 INFO:tasks.cephadm:Adding mds.c on smithi174 2024-09-21T03:39:44.346 INFO:tasks.cephadm:Adding mds.f on smithi174 2024-09-21T03:39:44.346 INFO:tasks.cephadm:Adding mds.i on smithi174 2024-09-21T03:39:44.346 INFO:tasks.cephadm:Adding mds.l on smithi174 2024-09-21T03:39:44.346 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l' 2024-09-21T03:39:44.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:44 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2205389698' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:39:44.606 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:39:44.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:44 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2205389698' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:39:44.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:44 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2205389698' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:39:45.083 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.070+0000 7f2759284640 1 -- 172.21.15.174:0/2713662881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2754102a60 msgr2=0x7f2754102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:45.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.070+0000 7f2759284640 1 --2- 172.21.15.174:0/2713662881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2754102a60 0x7f2754102e70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2748009ca0 tx=0x7f274802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:39:45.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.070+0000 7f2759284640 1 -- 172.21.15.174:0/2713662881 shutdown_connections 2024-09-21T03:39:45.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.070+0000 7f2759284640 1 --2- 172.21.15.174:0/2713662881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2754108cf0 0x7f275410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:45.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.070+0000 7f2759284640 1 --2- 172.21.15.174:0/2713662881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f27541083a0 0x7f27541087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:45.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.070+0000 7f2759284640 1 --2- 172.21.15.174:0/2713662881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2754102a60 0x7f2754102e70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:45.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.070+0000 7f2759284640 1 -- 172.21.15.174:0/2713662881 >> 172.21.15.174:0/2713662881 conn(0x7f2754079730 msgr2=0x7f2754079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:45.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.070+0000 7f2759284640 1 -- 172.21.15.174:0/2713662881 shutdown_connections 2024-09-21T03:39:45.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.070+0000 7f2759284640 1 -- 172.21.15.174:0/2713662881 wait complete. 2024-09-21T03:39:45.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.071+0000 7f2759284640 1 Processor -- start 2024-09-21T03:39:45.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.071+0000 7f2759284640 1 -- start start 2024-09-21T03:39:45.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.072+0000 7f2759284640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2754102a60 0x7f275419c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:45.084 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.072+0000 7f2759284640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27541083a0 0x7f275419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:45.085 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.072+0000 7f2759284640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2754108cf0 0x7f27541a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:45.085 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.072+0000 7f2759284640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2754112960 con 0x7f2754108cf0 2024-09-21T03:39:45.085 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.072+0000 7f2759284640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f27541127e0 con 0x7f27541083a0 2024-09-21T03:39:45.085 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.072+0000 7f2759284640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2754112ae0 con 0x7f2754102a60 2024-09-21T03:39:45.085 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.072+0000 7f2752ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2754102a60 0x7f275419c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:45.085 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.072+0000 7f2752ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2754102a60 0x7f275419c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.174:59240/0 (socket says 172.21.15.174:59240) 2024-09-21T03:39:45.085 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.072+0000 7f2752ffd640 1 -- 172.21.15.174:0/2705595641 learned_addr learned my addr 172.21.15.174:0/2705595641 (peer_addr_for_me v2:172.21.15.174:0/0) 2024-09-21T03:39:45.085 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.072+0000 7f27537fe640 1 --2- 172.21.15.174:0/2705595641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2754108cf0 0x7f27541a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:45.085 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.072+0000 7f27527fc640 1 --2- 172.21.15.174:0/2705595641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27541083a0 0x7f275419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:45.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.072+0000 7f2752ffd640 1 -- 172.21.15.174:0/2705595641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27541083a0 msgr2=0x7f275419cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:45.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.072+0000 7f2752ffd640 1 --2- 172.21.15.174:0/2705595641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27541083a0 0x7f275419cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:45.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.072+0000 7f2752ffd640 1 -- 172.21.15.174:0/2705595641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2754108cf0 msgr2=0x7f27541a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:45.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.072+0000 7f2752ffd640 1 --2- 172.21.15.174:0/2705595641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2754108cf0 0x7f27541a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:45.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.072+0000 7f2752ffd640 1 -- 172.21.15.174:0/2705595641 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27541a25e0 con 0x7f2754102a60 2024-09-21T03:39:45.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.072+0000 7f2752ffd640 1 --2- 172.21.15.174:0/2705595641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2754102a60 0x7f275419c670 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2748006010 tx=0x7f27480319f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:45.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.072+0000 7f273bfff640 1 -- 172.21.15.174:0/2705595641 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2748003bf0 con 0x7f2754102a60 2024-09-21T03:39:45.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.073+0000 7f2759284640 1 -- 172.21.15.174:0/2705595641 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27541a2870 con 0x7f2754102a60 2024-09-21T03:39:45.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.073+0000 7f273bfff640 1 -- 172.21.15.174:0/2705595641 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2748003d90 con 0x7f2754102a60 2024-09-21T03:39:45.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.073+0000 7f273bfff640 1 -- 172.21.15.174:0/2705595641 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274802fc20 con 0x7f2754102a60 2024-09-21T03:39:45.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.073+0000 7f2759284640 1 -- 172.21.15.174:0/2705595641 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27541a9030 con 0x7f2754102a60 2024-09-21T03:39:45.086 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.074+0000 7f2759284640 1 -- 172.21.15.174:0/2705595641 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2754102e70 con 0x7f2754102a60 2024-09-21T03:39:45.087 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.075+0000 7f273bfff640 1 -- 172.21.15.174:0/2705595641 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f27480046a0 con 0x7f2754102a60 2024-09-21T03:39:45.087 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.076+0000 7f273bfff640 1 --2- 172.21.15.174:0/2705595641 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f273c0b6560 0x7f273c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:45.087 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.076+0000 7f273bfff640 1 -- 172.21.15.174:0/2705595641 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f2748108430 con 0x7f2754102a60 2024-09-21T03:39:45.087 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.076+0000 7f27527fc640 1 --2- 172.21.15.174:0/2705595641 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f273c0b6560 0x7f273c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:45.087 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.077+0000 7f27527fc640 1 --2- 172.21.15.174:0/2705595641 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f273c0b6560 0x7f273c0b8a70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2754100c50 tx=0x7f274400b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:45.087 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.079+0000 7f273bfff640 1 -- 172.21.15.174:0/2705595641 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f27480cf090 con 0x7f2754102a60 2024-09-21T03:39:45.273 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.271+0000 7f2759284640 1 -- 172.21.15.174:0/2705595641 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l", "target": ["mon-mgr", ""]}) -- 0x7f2754105aa0 con 0x7f273c0b6560 2024-09-21T03:39:45.282 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.280+0000 7f273bfff640 1 -- 172.21.15.174:0/2705595641 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f2754105aa0 con 0x7f273c0b6560 2024-09-21T03:39:45.282 INFO:teuthology.orchestra.run.smithi174.stdout:Scheduled mds.all update... 2024-09-21T03:39:45.285 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.282+0000 7f2759284640 1 -- 172.21.15.174:0/2705595641 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f273c0b6560 msgr2=0x7f273c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:45.285 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.282+0000 7f2759284640 1 --2- 172.21.15.174:0/2705595641 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f273c0b6560 0x7f273c0b8a70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2754100c50 tx=0x7f274400b390 comp rx=0 tx=0).stop 2024-09-21T03:39:45.285 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.282+0000 7f2759284640 1 -- 172.21.15.174:0/2705595641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2754102a60 msgr2=0x7f275419c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:45.285 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.282+0000 7f2759284640 1 --2- 172.21.15.174:0/2705595641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2754102a60 0x7f275419c670 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2748006010 tx=0x7f27480319f0 comp rx=0 tx=0).stop 2024-09-21T03:39:45.285 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.283+0000 7f2759284640 1 -- 172.21.15.174:0/2705595641 shutdown_connections 2024-09-21T03:39:45.285 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.283+0000 7f2759284640 1 --2- 172.21.15.174:0/2705595641 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f273c0b6560 0x7f273c0b8a70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:45.285 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.283+0000 7f2759284640 1 --2- 172.21.15.174:0/2705595641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2754108cf0 0x7f27541a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:45.285 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.283+0000 7f2759284640 1 --2- 172.21.15.174:0/2705595641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27541083a0 0x7f275419cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:45.285 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.283+0000 7f2759284640 1 --2- 172.21.15.174:0/2705595641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2754102a60 0x7f275419c670 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:45.285 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.283+0000 7f2759284640 1 -- 172.21.15.174:0/2705595641 >> 172.21.15.174:0/2705595641 conn(0x7f2754079730 msgr2=0x7f275406b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:45.285 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.283+0000 7f2759284640 1 -- 172.21.15.174:0/2705595641 shutdown_connections 2024-09-21T03:39:45.285 INFO:teuthology.orchestra.run.smithi174.stderr:2024-09-21T03:39:45.283+0000 7f2759284640 1 -- 172.21.15.174:0/2705595641 wait complete. 2024-09-21T03:39:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:45 smithi174 ceph-mon[34403]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:45 smithi174 ceph-mon[34403]: from='client.24571 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:45 smithi174 ceph-mon[34403]: Saving service mds.all spec with placement smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l;count:12 2024-09-21T03:39:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:45 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:45 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:39:45.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:45 smithi172 ceph-mon[34821]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:45.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:45 smithi172 ceph-mon[34821]: from='client.24571 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:45.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:45 smithi172 ceph-mon[34821]: Saving service mds.all spec with placement smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l;count:12 2024-09-21T03:39:45.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:45 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:45.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:45 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:39:45.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:45 smithi084 ceph-mon[30941]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:45.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:45 smithi084 ceph-mon[30941]: from='client.24571 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:39:45.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:45 smithi084 ceph-mon[30941]: Saving service mds.all spec with placement smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l;count:12 2024-09-21T03:39:45.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:45 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:45.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:45 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:39:46.066 DEBUG:teuthology.orchestra.run.smithi084:mds.a> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T03:39:46.068 DEBUG:teuthology.orchestra.run.smithi084:mds.d> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T03:39:46.112 DEBUG:teuthology.orchestra.run.smithi084:mds.g> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T03:39:46.154 DEBUG:teuthology.orchestra.run.smithi084:mds.j> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T03:39:46.198 DEBUG:teuthology.orchestra.run.smithi172:mds.b> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T03:39:46.201 DEBUG:teuthology.orchestra.run.smithi172:mds.e> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T03:39:46.244 DEBUG:teuthology.orchestra.run.smithi172:mds.h> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T03:39:46.287 DEBUG:teuthology.orchestra.run.smithi172:mds.k> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T03:39:46.330 DEBUG:teuthology.orchestra.run.smithi174:mds.c> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T03:39:46.332 DEBUG:teuthology.orchestra.run.smithi174:mds.f> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T03:39:46.376 DEBUG:teuthology.orchestra.run.smithi174:mds.i> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T03:39:46.418 DEBUG:teuthology.orchestra.run.smithi174:mds.l> sudo journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T03:39:46.461 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T03:39:46.462 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:39:46.610 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:46 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:46.611 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:46 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:39:46.611 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:46 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:46.611 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:46 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:39:46.611 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:46 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:39:46.611 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:46 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:46.611 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:46 smithi174 ceph-mon[34403]: Deploying daemon mds.l on smithi174 2024-09-21T03:39:46.611 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:46 smithi174 ceph-mon[34403]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:46.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:46 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:46.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:46 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:39:46.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:46 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:46.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:46 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:39:46.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:46 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:39:46.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:46 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:46.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:46 smithi172 ceph-mon[34821]: Deploying daemon mds.l on smithi174 2024-09-21T03:39:46.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:46 smithi172 ceph-mon[34821]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:46.702 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:46.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:46 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:46.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:46 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:39:46.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:46 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:46.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:46 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:39:46.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:46 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:39:46.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:46 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:46.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:46 smithi084 ceph-mon[30941]: Deploying daemon mds.l on smithi174 2024-09-21T03:39:46.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:46 smithi084 ceph-mon[30941]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:47.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.207+0000 7fa4967a5640 1 -- 172.21.15.84:0/2595792405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa490108420 msgr2=0x7fa490108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:47.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.207+0000 7fa4967a5640 1 --2- 172.21.15.84:0/2595792405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa490108420 0x7fa490108830 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa484009900 tx=0x7fa48402a410 comp rx=0 tx=0).stop 2024-09-21T03:39:47.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.207+0000 7fa4967a5640 1 -- 172.21.15.84:0/2595792405 shutdown_connections 2024-09-21T03:39:47.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.207+0000 7fa4967a5640 1 --2- 172.21.15.84:0/2595792405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa490108d70 0x7fa49010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.207+0000 7fa4967a5640 1 --2- 172.21.15.84:0/2595792405 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa490108420 0x7fa490108830 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.207+0000 7fa4967a5640 1 --2- 172.21.15.84:0/2595792405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa490102ae0 0x7fa490102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.207+0000 7fa4967a5640 1 -- 172.21.15.84:0/2595792405 >> 172.21.15.84:0/2595792405 conn(0x7fa490079770 msgr2=0x7fa490079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:47.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.207+0000 7fa4967a5640 1 -- 172.21.15.84:0/2595792405 shutdown_connections 2024-09-21T03:39:47.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.207+0000 7fa4967a5640 1 -- 172.21.15.84:0/2595792405 wait complete. 2024-09-21T03:39:47.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.208+0000 7fa4967a5640 1 Processor -- start 2024-09-21T03:39:47.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.208+0000 7fa4967a5640 1 -- start start 2024-09-21T03:39:47.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.208+0000 7fa4967a5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa490102ae0 0x7fa49019b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.208+0000 7fa4967a5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa490108420 0x7fa49019b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.208+0000 7fa4967a5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa490108d70 0x7fa49019be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.208+0000 7fa4967a5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa490112a30 con 0x7fa490108d70 2024-09-21T03:39:47.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.208+0000 7fa4967a5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa4901128b0 con 0x7fa490108420 2024-09-21T03:39:47.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.208+0000 7fa4967a5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa490112bb0 con 0x7fa490102ae0 2024-09-21T03:39:47.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.208+0000 7fa494d42640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa490108d70 0x7fa49019be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:47.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.208+0000 7fa494d42640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa490108d70 0x7fa49019be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53010/0 (socket says 172.21.15.84:53010) 2024-09-21T03:39:47.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.208+0000 7fa494d42640 1 -- 172.21.15.84:0/520137572 learned_addr learned my addr 172.21.15.84:0/520137572 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:39:47.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.208+0000 7fa48f7fe640 1 --2- 172.21.15.84:0/520137572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa490108420 0x7fa49019b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:47.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.208+0000 7fa48ffff640 1 --2- 172.21.15.84:0/520137572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa490102ae0 0x7fa49019b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:47.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.209+0000 7fa494d42640 1 -- 172.21.15.84:0/520137572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa490102ae0 msgr2=0x7fa49019b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:47.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.209+0000 7fa494d42640 1 --2- 172.21.15.84:0/520137572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa490102ae0 0x7fa49019b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.209+0000 7fa494d42640 1 -- 172.21.15.84:0/520137572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa490108420 msgr2=0x7fa49019b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:47.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.209+0000 7fa494d42640 1 --2- 172.21.15.84:0/520137572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa490108420 0x7fa49019b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.209+0000 7fa494d42640 1 -- 172.21.15.84:0/520137572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4901a6640 con 0x7fa490108d70 2024-09-21T03:39:47.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.209+0000 7fa48ffff640 1 --2- 172.21.15.84:0/520137572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa490102ae0 0x7fa49019b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:47.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.209+0000 7fa494d42640 1 --2- 172.21.15.84:0/520137572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa490108d70 0x7fa49019be00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa48800cad0 tx=0x7fa48800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:47.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.209+0000 7fa48d7fa640 1 -- 172.21.15.84:0/520137572 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48800ae20 con 0x7fa490108d70 2024-09-21T03:39:47.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.209+0000 7fa4967a5640 1 -- 172.21.15.84:0/520137572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4901a6930 con 0x7fa490108d70 2024-09-21T03:39:47.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.209+0000 7fa48d7fa640 1 -- 172.21.15.84:0/520137572 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa488005020 con 0x7fa490108d70 2024-09-21T03:39:47.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.209+0000 7fa48d7fa640 1 -- 172.21.15.84:0/520137572 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48800f6b0 con 0x7fa490108d70 2024-09-21T03:39:47.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.209+0000 7fa4967a5640 1 -- 172.21.15.84:0/520137572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4901a6e40 con 0x7fa490108d70 2024-09-21T03:39:47.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.210+0000 7fa4967a5640 1 -- 172.21.15.84:0/520137572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa490103d60 con 0x7fa490108d70 2024-09-21T03:39:47.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.212+0000 7fa48d7fa640 1 -- 172.21.15.84:0/520137572 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fa4880051d0 con 0x7fa490108d70 2024-09-21T03:39:47.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.213+0000 7fa48d7fa640 1 --2- 172.21.15.84:0/520137572 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4780b6560 0x7fa4780b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.213+0000 7fa48ffff640 1 --2- 172.21.15.84:0/520137572 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4780b6560 0x7fa4780b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:47.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.213+0000 7fa48d7fa640 1 -- 172.21.15.84:0/520137572 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fa4880e73d0 con 0x7fa490108d70 2024-09-21T03:39:47.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.213+0000 7fa48ffff640 1 --2- 172.21.15.84:0/520137572 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4780b6560 0x7fa4780b8a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa49006c6e0 tx=0x7fa480005e70 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:47.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.216+0000 7fa48d7fa640 1 -- 172.21.15.84:0/520137572 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa488014030 con 0x7fa490108d70 2024-09-21T03:39:47.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.429+0000 7fa4967a5640 1 -- 172.21.15.84:0/520137572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa490102ef0 con 0x7fa490108d70 2024-09-21T03:39:47.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.430+0000 7fa48d7fa640 1 -- 172.21.15.84:0/520137572 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fa4880ae030 con 0x7fa490108d70 2024-09-21T03:39:47.432 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:39:47.432 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":1,"btime":"2024-09-21T03:31:55:306808+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T03:39:47.432 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 1 2024-09-21T03:39:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.432+0000 7fa4967a5640 1 -- 172.21.15.84:0/520137572 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4780b6560 msgr2=0x7fa4780b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.432+0000 7fa4967a5640 1 --2- 172.21.15.84:0/520137572 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4780b6560 0x7fa4780b8a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa49006c6e0 tx=0x7fa480005e70 comp rx=0 tx=0).stop 2024-09-21T03:39:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.432+0000 7fa4967a5640 1 -- 172.21.15.84:0/520137572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa490108d70 msgr2=0x7fa49019be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.432+0000 7fa4967a5640 1 --2- 172.21.15.84:0/520137572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa490108d70 0x7fa49019be00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa48800cad0 tx=0x7fa48800cf90 comp rx=0 tx=0).stop 2024-09-21T03:39:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.432+0000 7fa4967a5640 1 -- 172.21.15.84:0/520137572 shutdown_connections 2024-09-21T03:39:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.432+0000 7fa4967a5640 1 --2- 172.21.15.84:0/520137572 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4780b6560 0x7fa4780b8a70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.432+0000 7fa4967a5640 1 --2- 172.21.15.84:0/520137572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa490108d70 0x7fa49019be00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.432+0000 7fa4967a5640 1 --2- 172.21.15.84:0/520137572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa490108420 0x7fa49019b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.432+0000 7fa4967a5640 1 --2- 172.21.15.84:0/520137572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa490102ae0 0x7fa49019b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.432+0000 7fa4967a5640 1 -- 172.21.15.84:0/520137572 >> 172.21.15.84:0/520137572 conn(0x7fa490079770 msgr2=0x7fa4901044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:47.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.432+0000 7fa4967a5640 1 -- 172.21.15.84:0/520137572 shutdown_connections 2024-09-21T03:39:47.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:47.432+0000 7fa4967a5640 1 -- 172.21.15.84:0/520137572 wait complete. 2024-09-21T03:39:47.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:47 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/520137572' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:39:47.878 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 03:39:47 smithi174 systemd[1]: Starting Ceph mds.l for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:39:48.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:47 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/520137572' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:39:48.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:47 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/520137572' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:39:48.219 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 03:39:47 smithi174 podman[62457]: 2024-09-21 03:39:47.844429921 +0000 UTC m=+0.016073288 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:39:48.220 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 03:39:47 smithi174 podman[62457]: 2024-09-21 03:39:47.966109562 +0000 UTC m=+0.137752917 container create dc699578d1c82ba63c76eca5a294a297c16fea37e3963880742709c861aad541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-l, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T03:39:48.220 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 03:39:48 smithi174 podman[62457]: 2024-09-21 03:39:48.218709487 +0000 UTC m=+0.390352841 container init dc699578d1c82ba63c76eca5a294a297c16fea37e3963880742709c861aad541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-l, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T03:39:48.628 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 03:39:48 smithi174 podman[62457]: 2024-09-21 03:39:48.221514489 +0000 UTC m=+0.393157846 container start dc699578d1c82ba63c76eca5a294a297c16fea37e3963880742709c861aad541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-l, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:39:48.628 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 03:39:48 smithi174 ceph-mds[62477]: -- 172.21.15.174:0/2037860280 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555f1134b860 con 0x555f154f3180 2024-09-21T03:39:48.628 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 03:39:48 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-l[62473]: starting mds.l at 2024-09-21T03:39:48.628 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 03:39:48 smithi174 bash[62457]: dc699578d1c82ba63c76eca5a294a297c16fea37e3963880742709c861aad541 2024-09-21T03:39:48.628 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 03:39:48 smithi174 systemd[1]: Started Ceph mds.l for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:39:49.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:49 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.174:6832/4033444564,v1:172.21.15.174:6833/4033444564] up:boot 2024-09-21T03:39:49.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:49 smithi172 ceph-mon[34821]: fsmap 1 up:standby 2024-09-21T03:39:49.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:49 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T03:39:49.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:49 smithi172 ceph-mon[34821]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:49.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:49 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:49.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:49 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:49.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:49 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:49.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:49 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:39:49.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:49 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:39:49.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:49 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:49.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:49 smithi172 ceph-mon[34821]: Deploying daemon mds.k on smithi172 2024-09-21T03:39:49.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:49 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.174:6832/4033444564,v1:172.21.15.174:6833/4033444564] up:boot 2024-09-21T03:39:49.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:49 smithi084 ceph-mon[30941]: fsmap 1 up:standby 2024-09-21T03:39:49.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:49 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T03:39:49.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:49 smithi084 ceph-mon[30941]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:49.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:49 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:49.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:49 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:49.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:49 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:49.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:49 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:39:49.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:49 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:39:49.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:49 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:49.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:49 smithi084 ceph-mon[30941]: Deploying daemon mds.k on smithi172 2024-09-21T03:39:49.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:49 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.174:6832/4033444564,v1:172.21.15.174:6833/4033444564] up:boot 2024-09-21T03:39:49.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:49 smithi174 ceph-mon[34403]: fsmap 1 up:standby 2024-09-21T03:39:49.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:49 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T03:39:49.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:49 smithi174 ceph-mon[34403]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:49.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:49 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:49.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:49 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:49.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:49 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:49.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:49 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:39:49.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:49 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:39:49.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:49 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:49.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:49 smithi174 ceph-mon[34403]: Deploying daemon mds.k on smithi172 2024-09-21T03:39:50.188 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:39:50.401 INFO:journalctl@ceph.mds.k.smithi172.stdout:Sep 21 03:39:50 smithi172 systemd[1]: Starting Ceph mds.k for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:39:50.446 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:50.751 INFO:journalctl@ceph.mds.k.smithi172.stdout:Sep 21 03:39:50 smithi172 podman[62703]: 2024-09-21 03:39:50.385042732 +0000 UTC m=+0.015791409 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:39:50.752 INFO:journalctl@ceph.mds.k.smithi172.stdout:Sep 21 03:39:50 smithi172 podman[62703]: 2024-09-21 03:39:50.505983523 +0000 UTC m=+0.136732197 container create 819ba9e6e9347b8ef3219e7fafc5683108e83ca03acab0cdba4d12cc85e180f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-k, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T03:39:50.752 INFO:journalctl@ceph.mds.k.smithi172.stdout:Sep 21 03:39:50 smithi172 podman[62703]: 2024-09-21 03:39:50.750383323 +0000 UTC m=+0.381131996 container init 819ba9e6e9347b8ef3219e7fafc5683108e83ca03acab0cdba4d12cc85e180f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-k, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T03:39:50.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.943+0000 7f5bffe36640 1 -- 172.21.15.84:0/1409909344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf810de60 msgr2=0x7f5bf8110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:50.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.943+0000 7f5bffe36640 1 --2- 172.21.15.84:0/1409909344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf810de60 0x7f5bf8110330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009ca0 tx=0x7f5bf002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:39:50.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.943+0000 7f5bffe36640 1 -- 172.21.15.84:0/1409909344 shutdown_connections 2024-09-21T03:39:50.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.943+0000 7f5bffe36640 1 --2- 172.21.15.84:0/1409909344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf810de60 0x7f5bf8110330 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:50.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.943+0000 7f5bffe36640 1 --2- 172.21.15.84:0/1409909344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5bf8105380 0x7f5bf810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:50.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.943+0000 7f5bffe36640 1 --2- 172.21.15.84:0/1409909344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf8104a30 0x7f5bf8104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:50.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.943+0000 7f5bffe36640 1 -- 172.21.15.84:0/1409909344 >> 172.21.15.84:0/1409909344 conn(0x7f5bf8079760 msgr2=0x7f5bf8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:50.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.944+0000 7f5bffe36640 1 -- 172.21.15.84:0/1409909344 shutdown_connections 2024-09-21T03:39:50.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.944+0000 7f5bffe36640 1 -- 172.21.15.84:0/1409909344 wait complete. 2024-09-21T03:39:50.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.944+0000 7f5bffe36640 1 Processor -- start 2024-09-21T03:39:50.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.945+0000 7f5bffe36640 1 -- start start 2024-09-21T03:39:50.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.945+0000 7f5bffe36640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf8104a30 0x7f5bf819a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:50.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.945+0000 7f5bffe36640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf8105380 0x7f5bf819a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:50.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.945+0000 7f5bffe36640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5bf810de60 0x7f5bf819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:50.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.945+0000 7f5bffe36640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf8113ac0 con 0x7f5bf8104a30 2024-09-21T03:39:50.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.945+0000 7f5bffe36640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf8113940 con 0x7f5bf8105380 2024-09-21T03:39:50.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.945+0000 7f5bffe36640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf8113c40 con 0x7f5bf810de60 2024-09-21T03:39:50.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.945+0000 7f5bfdbd2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf8104a30 0x7f5bf819a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:50.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.945+0000 7f5bfdbd2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf8104a30 0x7f5bf819a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45520/0 (socket says 172.21.15.84:45520) 2024-09-21T03:39:50.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.945+0000 7f5bfdbd2640 1 -- 172.21.15.84:0/1872803253 learned_addr learned my addr 172.21.15.84:0/1872803253 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:39:50.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.945+0000 7f5bfd3d1640 1 --2- 172.21.15.84:0/1872803253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf8105380 0x7f5bf819a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:50.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.945+0000 7f5bfe3d3640 1 --2- 172.21.15.84:0/1872803253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5bf810de60 0x7f5bf819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:50.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.945+0000 7f5bfdbd2640 1 -- 172.21.15.84:0/1872803253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5bf810de60 msgr2=0x7f5bf819fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:50.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.945+0000 7f5bfdbd2640 1 --2- 172.21.15.84:0/1872803253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5bf810de60 0x7f5bf819fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:50.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.945+0000 7f5bfdbd2640 1 -- 172.21.15.84:0/1872803253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf8105380 msgr2=0x7f5bf819a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:50.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.945+0000 7f5bfdbd2640 1 --2- 172.21.15.84:0/1872803253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf8105380 0x7f5bf819a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:50.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.945+0000 7f5bfdbd2640 1 -- 172.21.15.84:0/1872803253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf81a03c0 con 0x7f5bf8104a30 2024-09-21T03:39:50.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.945+0000 7f5bfe3d3640 1 --2- 172.21.15.84:0/1872803253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5bf810de60 0x7f5bf819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:50.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.946+0000 7f5bfdbd2640 1 --2- 172.21.15.84:0/1872803253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf8104a30 0x7f5bf819a450 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400e9c0 tx=0x7f5bf400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:50.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.946+0000 7f5beeffd640 1 -- 172.21.15.84:0/1872803253 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf400cd80 con 0x7f5bf8104a30 2024-09-21T03:39:50.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.946+0000 7f5bffe36640 1 -- 172.21.15.84:0/1872803253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf81a06b0 con 0x7f5bf8104a30 2024-09-21T03:39:50.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.946+0000 7f5beeffd640 1 -- 172.21.15.84:0/1872803253 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bf40035f0 con 0x7f5bf8104a30 2024-09-21T03:39:50.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.946+0000 7f5beeffd640 1 -- 172.21.15.84:0/1872803253 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4010690 con 0x7f5bf8104a30 2024-09-21T03:39:50.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.946+0000 7f5bffe36640 1 -- 172.21.15.84:0/1872803253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf81a6e10 con 0x7f5bf8104a30 2024-09-21T03:39:50.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.947+0000 7f5bffe36640 1 -- 172.21.15.84:0/1872803253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bf8104e40 con 0x7f5bf8104a30 2024-09-21T03:39:50.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.949+0000 7f5beeffd640 1 -- 172.21.15.84:0/1872803253 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f5bf40037a0 con 0x7f5bf8104a30 2024-09-21T03:39:50.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.949+0000 7f5beeffd640 1 --2- 172.21.15.84:0/1872803253 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5be40b6560 0x7f5be40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:50.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.950+0000 7f5bfd3d1640 1 --2- 172.21.15.84:0/1872803253 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5be40b6560 0x7f5be40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:50.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.950+0000 7f5beeffd640 1 -- 172.21.15.84:0/1872803253 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f5bf40e75b0 con 0x7f5bf8104a30 2024-09-21T03:39:50.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.950+0000 7f5bfd3d1640 1 --2- 172.21.15.84:0/1872803253 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5be40b6560 0x7f5be40b8a70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5bf810fb70 tx=0x7f5be8005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:50.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:50.953+0000 7f5beeffd640 1 -- 172.21.15.84:0/1872803253 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5bf4056710 con 0x7f5bf8104a30 2024-09-21T03:39:51.151 INFO:journalctl@ceph.mds.k.smithi172.stdout:Sep 21 03:39:50 smithi172 podman[62703]: 2024-09-21 03:39:50.753477043 +0000 UTC m=+0.384225715 container start 819ba9e6e9347b8ef3219e7fafc5683108e83ca03acab0cdba4d12cc85e180f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-k, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T03:39:51.151 INFO:journalctl@ceph.mds.k.smithi172.stdout:Sep 21 03:39:50 smithi172 ceph-mds[62724]: -- 172.21.15.172:0/3745152356 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ee889b5860 con 0x55ee8cb5d180 2024-09-21T03:39:51.151 INFO:journalctl@ceph.mds.k.smithi172.stdout:Sep 21 03:39:50 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-k[62720]: starting mds.k at 2024-09-21T03:39:51.151 INFO:journalctl@ceph.mds.k.smithi172.stdout:Sep 21 03:39:50 smithi172 bash[62703]: 819ba9e6e9347b8ef3219e7fafc5683108e83ca03acab0cdba4d12cc85e180f4 2024-09-21T03:39:51.151 INFO:journalctl@ceph.mds.k.smithi172.stdout:Sep 21 03:39:50 smithi172 systemd[1]: Started Ceph mds.k for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:39:51.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:51.183+0000 7f5bffe36640 1 -- 172.21.15.84:0/1872803253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5bf819b580 con 0x7f5bf8104a30 2024-09-21T03:39:51.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:51.183+0000 7f5beeffd640 1 -- 172.21.15.84:0/1872803253 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f5bf40ae210 con 0x7f5bf8104a30 2024-09-21T03:39:51.185 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:39:51.186 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":2,"btime":"2024-09-21T03:39:48:260138+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T03:39:51.186 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 2 2024-09-21T03:39:51.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:51.186+0000 7f5bffe36640 1 -- 172.21.15.84:0/1872803253 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5be40b6560 msgr2=0x7f5be40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:51.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:51.186+0000 7f5bffe36640 1 --2- 172.21.15.84:0/1872803253 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5be40b6560 0x7f5be40b8a70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5bf810fb70 tx=0x7f5be8005f90 comp rx=0 tx=0).stop 2024-09-21T03:39:51.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:51.186+0000 7f5bffe36640 1 -- 172.21.15.84:0/1872803253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf8104a30 msgr2=0x7f5bf819a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:51.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:51.186+0000 7f5bffe36640 1 --2- 172.21.15.84:0/1872803253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf8104a30 0x7f5bf819a450 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400e9c0 tx=0x7f5bf400ee80 comp rx=0 tx=0).stop 2024-09-21T03:39:51.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:51.186+0000 7f5bffe36640 1 -- 172.21.15.84:0/1872803253 shutdown_connections 2024-09-21T03:39:51.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:51.186+0000 7f5bffe36640 1 --2- 172.21.15.84:0/1872803253 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5be40b6560 0x7f5be40b8a70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:51.186+0000 7f5bffe36640 1 --2- 172.21.15.84:0/1872803253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5bf810de60 0x7f5bf819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:51.186+0000 7f5bffe36640 1 --2- 172.21.15.84:0/1872803253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf8105380 0x7f5bf819a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:51.186+0000 7f5bffe36640 1 --2- 172.21.15.84:0/1872803253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5bf8104a30 0x7f5bf819a450 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:51.186+0000 7f5bffe36640 1 -- 172.21.15.84:0/1872803253 >> 172.21.15.84:0/1872803253 conn(0x7f5bf8079760 msgr2=0x7f5bf8105820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:51.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:51.186+0000 7f5bffe36640 1 -- 172.21.15.84:0/1872803253 shutdown_connections 2024-09-21T03:39:51.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:51.186+0000 7f5bffe36640 1 -- 172.21.15.84:0/1872803253 wait complete. 2024-09-21T03:39:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:51 smithi084 ceph-mon[30941]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:51.505 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:51.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:51.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:39:51.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:39:51.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:51.506 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:51 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1872803253' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:39:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:51 smithi174 ceph-mon[34403]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:39:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:39:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:51.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:51 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1872803253' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:39:51.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:51 smithi172 ceph-mon[34821]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:51.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:51.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:51.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:51.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:39:51.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:39:51.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:51.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:51 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1872803253' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:39:52.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:52 smithi084 ceph-mon[30941]: Deploying daemon mds.j on smithi084 2024-09-21T03:39:52.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:52 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.172:6832/3292859704,v1:172.21.15.172:6833/3292859704] up:boot 2024-09-21T03:39:52.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:52 smithi084 ceph-mon[30941]: fsmap 2 up:standby 2024-09-21T03:39:52.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:52 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T03:39:52.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:52 smithi174 ceph-mon[34403]: Deploying daemon mds.j on smithi084 2024-09-21T03:39:52.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:52 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.172:6832/3292859704,v1:172.21.15.172:6833/3292859704] up:boot 2024-09-21T03:39:52.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:52 smithi174 ceph-mon[34403]: fsmap 2 up:standby 2024-09-21T03:39:52.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:52 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T03:39:52.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:52 smithi172 ceph-mon[34821]: Deploying daemon mds.j on smithi084 2024-09-21T03:39:52.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:52 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.172:6832/3292859704,v1:172.21.15.172:6833/3292859704] up:boot 2024-09-21T03:39:52.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:52 smithi172 ceph-mon[34821]: fsmap 2 up:standby 2024-09-21T03:39:52.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:52 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T03:39:53.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:53 smithi084 ceph-mon[30941]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:53.611 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 03:39:53 smithi084 systemd[1]: Starting Ceph mds.j for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:39:53.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:53 smithi174 ceph-mon[34403]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:53 smithi172 ceph-mon[34821]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:53.912 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 03:39:53 smithi084 podman[72385]: 2024-09-21 03:39:53.657269163 +0000 UTC m=+0.018176924 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:39:53.912 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 03:39:53 smithi084 podman[72385]: 2024-09-21 03:39:53.80349579 +0000 UTC m=+0.164403601 container create 933e7baa77b26ee8c9912457923ff0f3e1cf19543345ddb5beb60a84d8e3eb85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-j, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2) 2024-09-21T03:39:53.954 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:39:54.212 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:54.318 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 03:39:54 smithi084 podman[72385]: 2024-09-21 03:39:54.018157806 +0000 UTC m=+0.379065571 container init 933e7baa77b26ee8c9912457923ff0f3e1cf19543345ddb5beb60a84d8e3eb85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-j, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:39:54.318 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 03:39:54 smithi084 podman[72385]: 2024-09-21 03:39:54.02121654 +0000 UTC m=+0.382124292 container start 933e7baa77b26ee8c9912457923ff0f3e1cf19543345ddb5beb60a84d8e3eb85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-j, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:39:54.319 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 03:39:54 smithi084 ceph-mds[72423]: -- 172.21.15.84:0/1133474942 <== mon.0 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56386631d860 con 0x56386a4c5180 2024-09-21T03:39:54.319 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 03:39:54 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-j[72401]: starting mds.j at 2024-09-21T03:39:54.319 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 03:39:54 smithi084 bash[72385]: 933e7baa77b26ee8c9912457923ff0f3e1cf19543345ddb5beb60a84d8e3eb85 2024-09-21T03:39:54.319 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 03:39:54 smithi084 systemd[1]: Started Ceph mds.j for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:39:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.694+0000 7f6460154640 1 -- 172.21.15.84:0/278516680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64581084e0 msgr2=0x7f64581088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.694+0000 7f6460154640 1 --2- 172.21.15.84:0/278516680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64581084e0 0x7f64581088f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6448009900 tx=0x7f644802a410 comp rx=0 tx=0).stop 2024-09-21T03:39:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.694+0000 7f6460154640 1 -- 172.21.15.84:0/278516680 shutdown_connections 2024-09-21T03:39:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.694+0000 7f6460154640 1 --2- 172.21.15.84:0/278516680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6458108e30 0x7f645810f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:54.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.694+0000 7f6460154640 1 --2- 172.21.15.84:0/278516680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f64581084e0 0x7f64581088f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.694+0000 7f6460154640 1 --2- 172.21.15.84:0/278516680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6458103190 0x7f64581035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.694+0000 7f6460154640 1 -- 172.21.15.84:0/278516680 >> 172.21.15.84:0/278516680 conn(0x7f6458079ec0 msgr2=0x7f645807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.694+0000 7f6460154640 1 -- 172.21.15.84:0/278516680 shutdown_connections 2024-09-21T03:39:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.694+0000 7f6460154640 1 -- 172.21.15.84:0/278516680 wait complete. 2024-09-21T03:39:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.695+0000 7f6460154640 1 Processor -- start 2024-09-21T03:39:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.695+0000 7f6460154640 1 -- start start 2024-09-21T03:39:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.695+0000 7f6460154640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6458103190 0x7f645819b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.695+0000 7f6460154640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64581084e0 0x7f645819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.695+0000 7f6460154640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6458108e30 0x7f645819bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.695+0000 7f6460154640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6458112b30 con 0x7f6458103190 2024-09-21T03:39:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.695+0000 7f6460154640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f64581129b0 con 0x7f64581084e0 2024-09-21T03:39:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.695+0000 7f6460154640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6458112cb0 con 0x7f6458108e30 2024-09-21T03:39:54.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.695+0000 7f645def0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6458103190 0x7f645819b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:54.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.695+0000 7f645def0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6458103190 0x7f645819b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45562/0 (socket says 172.21.15.84:45562) 2024-09-21T03:39:54.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.695+0000 7f645def0640 1 -- 172.21.15.84:0/4091432616 learned_addr learned my addr 172.21.15.84:0/4091432616 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:39:54.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.695+0000 7f645d6ef640 1 --2- 172.21.15.84:0/4091432616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64581084e0 0x7f645819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:54.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.695+0000 7f645e6f1640 1 --2- 172.21.15.84:0/4091432616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6458108e30 0x7f645819bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:54.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.696+0000 7f645def0640 1 -- 172.21.15.84:0/4091432616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6458108e30 msgr2=0x7f645819bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:54.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.696+0000 7f645def0640 1 --2- 172.21.15.84:0/4091432616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6458108e30 0x7f645819bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:54.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.696+0000 7f645def0640 1 -- 172.21.15.84:0/4091432616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64581084e0 msgr2=0x7f645819b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:54.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.696+0000 7f645def0640 1 --2- 172.21.15.84:0/4091432616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64581084e0 0x7f645819b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:54.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.696+0000 7f645def0640 1 -- 172.21.15.84:0/4091432616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64581a6720 con 0x7f6458103190 2024-09-21T03:39:54.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.696+0000 7f645e6f1640 1 --2- 172.21.15.84:0/4091432616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6458108e30 0x7f645819bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:54.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.696+0000 7f645def0640 1 --2- 172.21.15.84:0/4091432616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6458103190 0x7f645819b460 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f644c00b4a0 tx=0x7f644c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:54.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.696+0000 7f6456ffd640 1 -- 172.21.15.84:0/4091432616 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c014070 con 0x7f6458103190 2024-09-21T03:39:54.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.696+0000 7f6460154640 1 -- 172.21.15.84:0/4091432616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64581a6a10 con 0x7f6458103190 2024-09-21T03:39:54.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.696+0000 7f6456ffd640 1 -- 172.21.15.84:0/4091432616 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f644c010ac0 con 0x7f6458103190 2024-09-21T03:39:54.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.696+0000 7f6456ffd640 1 -- 172.21.15.84:0/4091432616 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c017c30 con 0x7f6458103190 2024-09-21T03:39:54.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.696+0000 7f6460154640 1 -- 172.21.15.84:0/4091432616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64581a6f70 con 0x7f6458103190 2024-09-21T03:39:54.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.697+0000 7f6460154640 1 -- 172.21.15.84:0/4091432616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64581035a0 con 0x7f6458103190 2024-09-21T03:39:54.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.698+0000 7f6456ffd640 1 -- 172.21.15.84:0/4091432616 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f644c017070 con 0x7f6458103190 2024-09-21T03:39:54.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.699+0000 7f6456ffd640 1 --2- 172.21.15.84:0/4091432616 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f64400b6560 0x7f64400b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:54.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.699+0000 7f645d6ef640 1 --2- 172.21.15.84:0/4091432616 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f64400b6560 0x7f64400b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:54.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.699+0000 7f6456ffd640 1 -- 172.21.15.84:0/4091432616 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f644c0e6500 con 0x7f6458103190 2024-09-21T03:39:54.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.700+0000 7f645d6ef640 1 --2- 172.21.15.84:0/4091432616 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f64400b6560 0x7f64400b8a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6448009230 tx=0x7f6448031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:54.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.702+0000 7f6456ffd640 1 -- 172.21.15.84:0/4091432616 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f644c0ad160 con 0x7f6458103190 2024-09-21T03:39:54.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.925+0000 7f6460154640 1 -- 172.21.15.84:0/4091432616 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6458102220 con 0x7f6458103190 2024-09-21T03:39:54.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.925+0000 7f6456ffd640 1 -- 172.21.15.84:0/4091432616 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7f6458102220 con 0x7f6458103190 2024-09-21T03:39:54.928 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:39:54.928 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":4,"btime":"2024-09-21T03:39:54:285745+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T03:39:54.928 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 4 2024-09-21T03:39:54.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.928+0000 7f6460154640 1 -- 172.21.15.84:0/4091432616 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f64400b6560 msgr2=0x7f64400b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:54.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.928+0000 7f6460154640 1 --2- 172.21.15.84:0/4091432616 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f64400b6560 0x7f64400b8a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6448009230 tx=0x7f6448031400 comp rx=0 tx=0).stop 2024-09-21T03:39:54.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.928+0000 7f6460154640 1 -- 172.21.15.84:0/4091432616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6458103190 msgr2=0x7f645819b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:54.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.928+0000 7f6460154640 1 --2- 172.21.15.84:0/4091432616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6458103190 0x7f645819b460 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f644c00b4a0 tx=0x7f644c00b960 comp rx=0 tx=0).stop 2024-09-21T03:39:54.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.928+0000 7f6460154640 1 -- 172.21.15.84:0/4091432616 shutdown_connections 2024-09-21T03:39:54.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.928+0000 7f6460154640 1 --2- 172.21.15.84:0/4091432616 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f64400b6560 0x7f64400b8a70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:54.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.928+0000 7f6460154640 1 --2- 172.21.15.84:0/4091432616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6458108e30 0x7f645819bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:54.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.928+0000 7f6460154640 1 --2- 172.21.15.84:0/4091432616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64581084e0 0x7f645819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:54.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.928+0000 7f6460154640 1 --2- 172.21.15.84:0/4091432616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6458103190 0x7f645819b460 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:54.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.928+0000 7f6460154640 1 -- 172.21.15.84:0/4091432616 >> 172.21.15.84:0/4091432616 conn(0x7f6458079ec0 msgr2=0x7f6458106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:54.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.928+0000 7f6460154640 1 -- 172.21.15.84:0/4091432616 shutdown_connections 2024-09-21T03:39:54.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:54.928+0000 7f6460154640 1 -- 172.21.15.84:0/4091432616 wait complete. 2024-09-21T03:39:55.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:55 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:55.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:55 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:55.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:55 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:55.453 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:55 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:39:55.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:55 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:39:55.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:55 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:55.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:55 smithi084 ceph-mon[30941]: Deploying daemon mds.d on smithi084 2024-09-21T03:39:55.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:55 smithi084 ceph-mon[30941]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:55.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:55 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.84:6834/416296973,v1:172.21.15.84:6835/416296973] up:boot 2024-09-21T03:39:55.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:55 smithi084 ceph-mon[30941]: fsmap 3 up:standby 2024-09-21T03:39:55.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:55 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T03:39:55.454 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:55 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/4091432616' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:39:55.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:55 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:55.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:55 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:55.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:55 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:55.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:55 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:39:55.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:55 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:39:55.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:55 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:55.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:55 smithi174 ceph-mon[34403]: Deploying daemon mds.d on smithi084 2024-09-21T03:39:55.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:55 smithi174 ceph-mon[34403]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:55.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:55 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.84:6834/416296973,v1:172.21.15.84:6835/416296973] up:boot 2024-09-21T03:39:55.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:55 smithi174 ceph-mon[34403]: fsmap 3 up:standby 2024-09-21T03:39:55.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:55 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T03:39:55.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:55 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/4091432616' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:39:55.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:55 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:55.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:55 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:55.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:55 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:55.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:55 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:39:55.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:55 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:39:55.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:55 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:55.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:55 smithi172 ceph-mon[34821]: Deploying daemon mds.d on smithi084 2024-09-21T03:39:55.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:55 smithi172 ceph-mon[34821]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:55.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:55 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.84:6834/416296973,v1:172.21.15.84:6835/416296973] up:boot 2024-09-21T03:39:55.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:55 smithi172 ceph-mon[34821]: fsmap 3 up:standby 2024-09-21T03:39:55.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:55 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T03:39:55.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:55 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/4091432616' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:39:57.523 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:57 smithi084 ceph-mon[30941]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:57.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:57 smithi174 ceph-mon[34403]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:57.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:57 smithi172 ceph-mon[34821]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:58.068 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 03:39:57 smithi084 systemd[1]: Started Ceph mds.d for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:39:58.252 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:39:58.503 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:59.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.008+0000 7f6774bf6640 1 -- 172.21.15.84:0/4100336692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6770103b60 msgr2=0x7f6770103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:59.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.008+0000 7f6774bf6640 1 --2- 172.21.15.84:0/4100336692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6770103b60 0x7f6770103f70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6760009900 tx=0x7f676002a410 comp rx=0 tx=0).stop 2024-09-21T03:39:59.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.008+0000 7f6774bf6640 1 -- 172.21.15.84:0/4100336692 shutdown_connections 2024-09-21T03:39:59.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.008+0000 7f6774bf6640 1 --2- 172.21.15.84:0/4100336692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6770109df0 0x7f6770110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:59.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.008+0000 7f6774bf6640 1 --2- 172.21.15.84:0/4100336692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67701094a0 0x7f67701098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:59.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.008+0000 7f6774bf6640 1 --2- 172.21.15.84:0/4100336692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6770103b60 0x7f6770103f70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:59.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.008+0000 7f6774bf6640 1 -- 172.21.15.84:0/4100336692 >> 172.21.15.84:0/4100336692 conn(0x7f677007b850 msgr2=0x7f677007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:59.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.008+0000 7f6774bf6640 1 -- 172.21.15.84:0/4100336692 shutdown_connections 2024-09-21T03:39:59.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.008+0000 7f6774bf6640 1 -- 172.21.15.84:0/4100336692 wait complete. 2024-09-21T03:39:59.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.009+0000 7f6774bf6640 1 Processor -- start 2024-09-21T03:39:59.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.009+0000 7f6774bf6640 1 -- start start 2024-09-21T03:39:59.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.009+0000 7f6774bf6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6770103b60 0x7f677019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:59.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.009+0000 7f6774bf6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67701094a0 0x7f677019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:59.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.009+0000 7f6774bf6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6770109df0 0x7f677019fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:59.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.009+0000 7f6774bf6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6770113ab0 con 0x7f6770109df0 2024-09-21T03:39:59.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.009+0000 7f6774bf6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6770113930 con 0x7f67701094a0 2024-09-21T03:39:59.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.009+0000 7f6774bf6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6770113c30 con 0x7f6770103b60 2024-09-21T03:39:59.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.009+0000 7f676ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6770109df0 0x7f677019fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:59.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.009+0000 7f676ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6770109df0 0x7f677019fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56692/0 (socket says 172.21.15.84:56692) 2024-09-21T03:39:59.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.009+0000 7f676ed9d640 1 -- 172.21.15.84:0/2624083604 learned_addr learned my addr 172.21.15.84:0/2624083604 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:39:59.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.009+0000 7f676dd9b640 1 --2- 172.21.15.84:0/2624083604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67701094a0 0x7f677019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:59.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.010+0000 7f676e59c640 1 --2- 172.21.15.84:0/2624083604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6770103b60 0x7f677019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:59.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.010+0000 7f676ed9d640 1 -- 172.21.15.84:0/2624083604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6770103b60 msgr2=0x7f677019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:59.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.010+0000 7f676ed9d640 1 --2- 172.21.15.84:0/2624083604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6770103b60 0x7f677019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:59.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.010+0000 7f676ed9d640 1 -- 172.21.15.84:0/2624083604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67701094a0 msgr2=0x7f677019aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:59.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.010+0000 7f676ed9d640 1 --2- 172.21.15.84:0/2624083604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67701094a0 0x7f677019aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:59.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.010+0000 7f676ed9d640 1 -- 172.21.15.84:0/2624083604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67701a03f0 con 0x7f6770109df0 2024-09-21T03:39:59.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.010+0000 7f676e59c640 1 --2- 172.21.15.84:0/2624083604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6770103b60 0x7f677019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:39:59.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.010+0000 7f676ed9d640 1 --2- 172.21.15.84:0/2624083604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6770109df0 0x7f677019fcc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f676800d750 tx=0x7f676800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:59.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.010+0000 7f675f7fe640 1 -- 172.21.15.84:0/2624083604 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6768017070 con 0x7f6770109df0 2024-09-21T03:39:59.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.010+0000 7f675f7fe640 1 -- 172.21.15.84:0/2624083604 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67680054d0 con 0x7f6770109df0 2024-09-21T03:39:59.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.010+0000 7f6774bf6640 1 -- 172.21.15.84:0/2624083604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67701a06e0 con 0x7f6770109df0 2024-09-21T03:39:59.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.010+0000 7f675f7fe640 1 -- 172.21.15.84:0/2624083604 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6768004c60 con 0x7f6770109df0 2024-09-21T03:39:59.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.010+0000 7f6774bf6640 1 -- 172.21.15.84:0/2624083604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67701a6e40 con 0x7f6770109df0 2024-09-21T03:39:59.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.011+0000 7f6774bf6640 1 -- 172.21.15.84:0/2624083604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6770103f70 con 0x7f6770109df0 2024-09-21T03:39:59.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.013+0000 7f675f7fe640 1 -- 172.21.15.84:0/2624083604 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f6768009bd0 con 0x7f6770109df0 2024-09-21T03:39:59.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.013+0000 7f675f7fe640 1 --2- 172.21.15.84:0/2624083604 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f67580b65e0 0x7f67580b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:59.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.014+0000 7f676e59c640 1 --2- 172.21.15.84:0/2624083604 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f67580b65e0 0x7f67580b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:59.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.014+0000 7f675f7fe640 1 -- 172.21.15.84:0/2624083604 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f67680e6ce0 con 0x7f6770109df0 2024-09-21T03:39:59.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.014+0000 7f676e59c640 1 --2- 172.21.15.84:0/2624083604 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f67580b65e0 0x7f67580b8af0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6760031440 tx=0x7f6760009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:59.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.017+0000 7f675f7fe640 1 -- 172.21.15.84:0/2624083604 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f67680ad9c0 con 0x7f6770109df0 2024-09-21T03:39:59.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.228+0000 7f6774bf6640 1 -- 172.21.15.84:0/2624083604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f677019b5b0 con 0x7f6770109df0 2024-09-21T03:39:59.231 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:58 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:59.231 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:58 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:59.231 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:58 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:59.231 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:58 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:39:59.231 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:58 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:39:59.231 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:58 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:59.231 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:58 smithi084 ceph-mon[30941]: Deploying daemon mds.e on smithi172 2024-09-21T03:39:59.231 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:58 smithi084 ceph-mon[30941]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:59.231 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:58 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.84:6836/1339085683,v1:172.21.15.84:6837/1339085683] up:boot 2024-09-21T03:39:59.232 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:58 smithi084 ceph-mon[30941]: fsmap 4 up:standby 2024-09-21T03:39:59.232 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:58 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T03:39:59.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.229+0000 7f675f7fe640 1 -- 172.21.15.84:0/2624083604 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f677019b5b0 con 0x7f6770109df0 2024-09-21T03:39:59.232 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:39:59.232 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":5,"btime":"2024-09-21T03:39:58:321307+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-21T03:39:59.232 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 5 2024-09-21T03:39:59.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.231+0000 7f6774bf6640 1 -- 172.21.15.84:0/2624083604 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f67580b65e0 msgr2=0x7f67580b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:59.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.231+0000 7f6774bf6640 1 --2- 172.21.15.84:0/2624083604 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f67580b65e0 0x7f67580b8af0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6760031440 tx=0x7f6760009680 comp rx=0 tx=0).stop 2024-09-21T03:39:59.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.231+0000 7f6774bf6640 1 -- 172.21.15.84:0/2624083604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6770109df0 msgr2=0x7f677019fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:59.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.231+0000 7f6774bf6640 1 --2- 172.21.15.84:0/2624083604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6770109df0 0x7f677019fcc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f676800d750 tx=0x7f676800dc10 comp rx=0 tx=0).stop 2024-09-21T03:39:59.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.231+0000 7f6774bf6640 1 -- 172.21.15.84:0/2624083604 shutdown_connections 2024-09-21T03:39:59.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.231+0000 7f6774bf6640 1 --2- 172.21.15.84:0/2624083604 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f67580b65e0 0x7f67580b8af0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:59.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.231+0000 7f6774bf6640 1 --2- 172.21.15.84:0/2624083604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6770109df0 0x7f677019fcc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:59.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.231+0000 7f6774bf6640 1 --2- 172.21.15.84:0/2624083604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67701094a0 0x7f677019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:59.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.231+0000 7f6774bf6640 1 --2- 172.21.15.84:0/2624083604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6770103b60 0x7f677019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:59.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.231+0000 7f6774bf6640 1 -- 172.21.15.84:0/2624083604 >> 172.21.15.84:0/2624083604 conn(0x7f677007b850 msgr2=0x7f6770107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:59.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.231+0000 7f6774bf6640 1 -- 172.21.15.84:0/2624083604 shutdown_connections 2024-09-21T03:39:59.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:39:59.231+0000 7f6774bf6640 1 -- 172.21.15.84:0/2624083604 wait complete. 2024-09-21T03:39:59.379 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:58 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:59.380 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:58 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:59.380 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:58 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:59.380 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:58 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:39:59.381 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:58 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:39:59.381 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:58 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:59.381 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:58 smithi174 ceph-mon[34403]: Deploying daemon mds.e on smithi172 2024-09-21T03:39:59.381 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:58 smithi174 ceph-mon[34403]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:59.381 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:58 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.84:6836/1339085683,v1:172.21.15.84:6837/1339085683] up:boot 2024-09-21T03:39:59.382 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:58 smithi174 ceph-mon[34403]: fsmap 4 up:standby 2024-09-21T03:39:59.382 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:58 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T03:39:59.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:58 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:59.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:58 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:59.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:58 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:39:59.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:58 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:39:59.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:58 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:39:59.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:58 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:59.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:58 smithi172 ceph-mon[34821]: Deploying daemon mds.e on smithi172 2024-09-21T03:39:59.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:58 smithi172 ceph-mon[34821]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:39:59.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:58 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.84:6836/1339085683,v1:172.21.15.84:6837/1339085683] up:boot 2024-09-21T03:39:59.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:58 smithi172 ceph-mon[34821]: fsmap 4 up:standby 2024-09-21T03:39:59.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:58 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T03:40:00.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:39:59 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2624083604' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:00.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:39:59 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2624083604' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:00.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:39:59 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2624083604' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:00.901 INFO:journalctl@ceph.mds.e.smithi172.stdout:Sep 21 03:40:00 smithi172 systemd[1]: Started Ceph mds.e for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:40:01.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:00 smithi174 ceph-mon[34403]: overall HEALTH_OK 2024-09-21T03:40:01.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:00 smithi174 ceph-mon[34403]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:01.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:00 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:01.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:00 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:01.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:00 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:01.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:00 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:01.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:00 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:01.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:00 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:01.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:00 smithi084 ceph-mon[30941]: overall HEALTH_OK 2024-09-21T03:40:01.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:00 smithi084 ceph-mon[30941]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:01.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:00 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:01.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:00 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:01.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:00 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:01.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:00 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:01.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:00 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:01.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:00 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:01.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:00 smithi172 ceph-mon[34821]: overall HEALTH_OK 2024-09-21T03:40:01.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:00 smithi172 ceph-mon[34821]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:01.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:00 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:01.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:00 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:01.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:00 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:01.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:00 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:01.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:00 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:01.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:00 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:01.949 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:40:02.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:01 smithi174 ceph-mon[34403]: Deploying daemon mds.f on smithi174 2024-09-21T03:40:02.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:01 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.172:6834/1309799170,v1:172.21.15.172:6835/1309799170] up:boot 2024-09-21T03:40:02.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:01 smithi174 ceph-mon[34403]: fsmap 5 up:standby 2024-09-21T03:40:02.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:01 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:40:02.210 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:02.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:01 smithi084 ceph-mon[30941]: Deploying daemon mds.f on smithi174 2024-09-21T03:40:02.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:01 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.172:6834/1309799170,v1:172.21.15.172:6835/1309799170] up:boot 2024-09-21T03:40:02.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:01 smithi084 ceph-mon[30941]: fsmap 5 up:standby 2024-09-21T03:40:02.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:01 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:40:02.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:01 smithi172 ceph-mon[34821]: Deploying daemon mds.f on smithi174 2024-09-21T03:40:02.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:01 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.172:6834/1309799170,v1:172.21.15.172:6835/1309799170] up:boot 2024-09-21T03:40:02.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:01 smithi172 ceph-mon[34821]: fsmap 5 up:standby 2024-09-21T03:40:02.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:01 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:40:02.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.771+0000 7fcf8d1a1640 1 -- 172.21.15.84:0/1312446142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf881081c0 msgr2=0x7fcf881085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:02.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.771+0000 7fcf8d1a1640 1 --2- 172.21.15.84:0/1312446142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf881081c0 0x7fcf881085d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009900 tx=0x7fcf7c02a410 comp rx=0 tx=0).stop 2024-09-21T03:40:02.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.771+0000 7fcf8d1a1640 1 -- 172.21.15.84:0/1312446142 shutdown_connections 2024-09-21T03:40:02.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.771+0000 7fcf8d1a1640 1 --2- 172.21.15.84:0/1312446142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf88108b10 0x7fcf8810f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.771+0000 7fcf8d1a1640 1 --2- 172.21.15.84:0/1312446142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf881081c0 0x7fcf881085d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.771+0000 7fcf8d1a1640 1 --2- 172.21.15.84:0/1312446142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf88102880 0x7fcf88102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.771+0000 7fcf8d1a1640 1 -- 172.21.15.84:0/1312446142 >> 172.21.15.84:0/1312446142 conn(0x7fcf880fe2d0 msgr2=0x7fcf88100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.771+0000 7fcf8d1a1640 1 -- 172.21.15.84:0/1312446142 shutdown_connections 2024-09-21T03:40:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.771+0000 7fcf8d1a1640 1 -- 172.21.15.84:0/1312446142 wait complete. 2024-09-21T03:40:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.771+0000 7fcf8d1a1640 1 Processor -- start 2024-09-21T03:40:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.771+0000 7fcf8d1a1640 1 -- start start 2024-09-21T03:40:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.772+0000 7fcf8d1a1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf88102880 0x7fcf8819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.772+0000 7fcf8d1a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf881081c0 0x7fcf8819b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.772+0000 7fcf8d1a1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf88108b10 0x7fcf8819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.772+0000 7fcf8d1a1640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcf881127a0 con 0x7fcf881081c0 2024-09-21T03:40:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.772+0000 7fcf8d1a1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcf88112620 con 0x7fcf88108b10 2024-09-21T03:40:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.772+0000 7fcf8d1a1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcf88112920 con 0x7fcf88102880 2024-09-21T03:40:02.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.772+0000 7fcf877fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf881081c0 0x7fcf8819b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:02.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.772+0000 7fcf877fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf881081c0 0x7fcf8819b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56700/0 (socket says 172.21.15.84:56700) 2024-09-21T03:40:02.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.772+0000 7fcf877fe640 1 -- 172.21.15.84:0/3126535196 learned_addr learned my addr 172.21.15.84:0/3126535196 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:02.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.772+0000 7fcf8c9a0640 1 --2- 172.21.15.84:0/3126535196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf88108b10 0x7fcf8819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:02.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.772+0000 7fcf87fff640 1 --2- 172.21.15.84:0/3126535196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf88102880 0x7fcf8819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:02.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.772+0000 7fcf877fe640 1 -- 172.21.15.84:0/3126535196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf88102880 msgr2=0x7fcf8819b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:02.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.772+0000 7fcf877fe640 1 --2- 172.21.15.84:0/3126535196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf88102880 0x7fcf8819b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:02.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.772+0000 7fcf877fe640 1 -- 172.21.15.84:0/3126535196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf88108b10 msgr2=0x7fcf8819bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:02.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.772+0000 7fcf877fe640 1 --2- 172.21.15.84:0/3126535196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf88108b10 0x7fcf8819bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:02.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.772+0000 7fcf877fe640 1 -- 172.21.15.84:0/3126535196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf881a6370 con 0x7fcf881081c0 2024-09-21T03:40:02.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.772+0000 7fcf87fff640 1 --2- 172.21.15.84:0/3126535196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf88102880 0x7fcf8819b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:40:02.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.773+0000 7fcf877fe640 1 --2- 172.21.15.84:0/3126535196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf881081c0 0x7fcf8819b6b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c02a930 tx=0x7fcf7c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:02.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.773+0000 7fcf857fa640 1 -- 172.21.15.84:0/3126535196 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c03f030 con 0x7fcf881081c0 2024-09-21T03:40:02.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.773+0000 7fcf8d1a1640 1 -- 172.21.15.84:0/3126535196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf881a6600 con 0x7fcf881081c0 2024-09-21T03:40:02.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.773+0000 7fcf857fa640 1 -- 172.21.15.84:0/3126535196 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf7c003cb0 con 0x7fcf881081c0 2024-09-21T03:40:02.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.773+0000 7fcf857fa640 1 -- 172.21.15.84:0/3126535196 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c035070 con 0x7fcf881081c0 2024-09-21T03:40:02.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.773+0000 7fcf8d1a1640 1 -- 172.21.15.84:0/3126535196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf881a6ae0 con 0x7fcf881081c0 2024-09-21T03:40:02.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.774+0000 7fcf8d1a1640 1 -- 172.21.15.84:0/3126535196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf88102c90 con 0x7fcf881081c0 2024-09-21T03:40:02.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.776+0000 7fcf857fa640 1 -- 172.21.15.84:0/3126535196 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fcf7c042030 con 0x7fcf881081c0 2024-09-21T03:40:02.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.776+0000 7fcf857fa640 1 --2- 172.21.15.84:0/3126535196 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcf700b6590 0x7fcf700b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:02.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.777+0000 7fcf87fff640 1 --2- 172.21.15.84:0/3126535196 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcf700b6590 0x7fcf700b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:02.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.777+0000 7fcf857fa640 1 -- 172.21.15.84:0/3126535196 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fcf7c1076f0 con 0x7fcf881081c0 2024-09-21T03:40:02.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.777+0000 7fcf87fff640 1 --2- 172.21.15.84:0/3126535196 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcf700b6590 0x7fcf700b8aa0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcf780058c0 tx=0x7fcf78005d50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:02.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.781+0000 7fcf857fa640 1 -- 172.21.15.84:0/3126535196 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcf7c0ce2b0 con 0x7fcf881081c0 2024-09-21T03:40:02.821 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 03:40:02 smithi174 systemd[1]: Starting Ceph mds.f for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:40:03.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.998+0000 7fcf8d1a1640 1 -- 172.21.15.84:0/3126535196 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf8802e640 con 0x7fcf881081c0 2024-09-21T03:40:03.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:02.999+0000 7fcf857fa640 1 -- 172.21.15.84:0/3126535196 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4741 (secure 0 0 0) 0x7fcf7c0d2690 con 0x7fcf881081c0 2024-09-21T03:40:03.001 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:40:03.001 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":6,"btime":"2024-09-21T03:40:00:968853+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24614,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T03:40:03.001 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 6 2024-09-21T03:40:03.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:03.001+0000 7fcf8d1a1640 1 -- 172.21.15.84:0/3126535196 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcf700b6590 msgr2=0x7fcf700b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:03.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:03.001+0000 7fcf8d1a1640 1 --2- 172.21.15.84:0/3126535196 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcf700b6590 0x7fcf700b8aa0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcf780058c0 tx=0x7fcf78005d50 comp rx=0 tx=0).stop 2024-09-21T03:40:03.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:03.001+0000 7fcf8d1a1640 1 -- 172.21.15.84:0/3126535196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf881081c0 msgr2=0x7fcf8819b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:03.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:03.001+0000 7fcf8d1a1640 1 --2- 172.21.15.84:0/3126535196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf881081c0 0x7fcf8819b6b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c02a930 tx=0x7fcf7c004270 comp rx=0 tx=0).stop 2024-09-21T03:40:03.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:03.001+0000 7fcf8d1a1640 1 -- 172.21.15.84:0/3126535196 shutdown_connections 2024-09-21T03:40:03.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:03.001+0000 7fcf8d1a1640 1 --2- 172.21.15.84:0/3126535196 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcf700b6590 0x7fcf700b8aa0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:03.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:03.001+0000 7fcf8d1a1640 1 --2- 172.21.15.84:0/3126535196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf88108b10 0x7fcf8819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:03.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:03.001+0000 7fcf8d1a1640 1 --2- 172.21.15.84:0/3126535196 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf881081c0 0x7fcf8819b6b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:03.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:03.001+0000 7fcf8d1a1640 1 --2- 172.21.15.84:0/3126535196 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf88102880 0x7fcf8819b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:03.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:03.001+0000 7fcf8d1a1640 1 -- 172.21.15.84:0/3126535196 >> 172.21.15.84:0/3126535196 conn(0x7fcf880fe2d0 msgr2=0x7fcf881006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:03.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:03.002+0000 7fcf8d1a1640 1 -- 172.21.15.84:0/3126535196 shutdown_connections 2024-09-21T03:40:03.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:03.002+0000 7fcf8d1a1640 1 -- 172.21.15.84:0/3126535196 wait complete. 2024-09-21T03:40:03.117 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:02 smithi174 ceph-mon[34403]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:03.117 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 03:40:02 smithi174 podman[62739]: 2024-09-21 03:40:02.722742112 +0000 UTC m=+0.016090344 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:40:03.117 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 03:40:02 smithi174 podman[62739]: 2024-09-21 03:40:02.857653035 +0000 UTC m=+0.151001306 container create 5dac4b014c19473ff3001ca0277ccacbcc2dd1b789e7ef67600568fa589b5039 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-f, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T03:40:03.117 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 03:40:03 smithi174 podman[62739]: 2024-09-21 03:40:03.115648539 +0000 UTC m=+0.408996773 container init 5dac4b014c19473ff3001ca0277ccacbcc2dd1b789e7ef67600568fa589b5039 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-f, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T03:40:03.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:02 smithi084 ceph-mon[30941]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:03.378 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 03:40:03 smithi174 podman[62739]: 2024-09-21 03:40:03.118676764 +0000 UTC m=+0.412024998 container start 5dac4b014c19473ff3001ca0277ccacbcc2dd1b789e7ef67600568fa589b5039 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-f, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T03:40:03.378 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 03:40:03 smithi174 ceph-mds[62758]: -- 172.21.15.174:0/533402879 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a4b135b860 con 0x55a4b5503a80 2024-09-21T03:40:03.378 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 03:40:03 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-f[62754]: starting mds.f at 2024-09-21T03:40:03.378 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 03:40:03 smithi174 bash[62739]: 5dac4b014c19473ff3001ca0277ccacbcc2dd1b789e7ef67600568fa589b5039 2024-09-21T03:40:03.378 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 03:40:03 smithi174 systemd[1]: Started Ceph mds.f for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:40:03.400 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:02 smithi172 ceph-mon[34821]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:04.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:03 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3126535196' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:04.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:03 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:04.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:03 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:04.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:03 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:04.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:03 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:04.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:03 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:04.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:03 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:04.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:03 smithi084 ceph-mon[30941]: Deploying daemon mds.c on smithi174 2024-09-21T03:40:04.357 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:03 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3126535196' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:04.357 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:03 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:04.357 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:03 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:04.357 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:03 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:04.357 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:03 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:04.358 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:03 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:04.358 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:03 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:04.358 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:03 smithi174 ceph-mon[34403]: Deploying daemon mds.c on smithi174 2024-09-21T03:40:04.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:03 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3126535196' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:04.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:03 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:04.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:03 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:04.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:03 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:04.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:03 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:04.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:03 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:04.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:03 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:04.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:03 smithi172 ceph-mon[34821]: Deploying daemon mds.c on smithi174 2024-09-21T03:40:05.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:04 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.174:6834/3726620036,v1:172.21.15.174:6835/3726620036] up:boot 2024-09-21T03:40:05.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:04 smithi084 ceph-mon[30941]: fsmap 6 up:standby 2024-09-21T03:40:05.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:04 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:40:05.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:04 smithi084 ceph-mon[30941]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:05.377 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:04 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.174:6834/3726620036,v1:172.21.15.174:6835/3726620036] up:boot 2024-09-21T03:40:05.377 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:04 smithi174 ceph-mon[34403]: fsmap 6 up:standby 2024-09-21T03:40:05.377 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:04 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:40:05.377 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:04 smithi174 ceph-mon[34403]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:05.377 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 03:40:05 smithi174 systemd[1]: Starting Ceph mds.c for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:40:05.400 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:04 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.174:6834/3726620036,v1:172.21.15.174:6835/3726620036] up:boot 2024-09-21T03:40:05.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:04 smithi172 ceph-mon[34821]: fsmap 6 up:standby 2024-09-21T03:40:05.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:04 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:40:05.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:04 smithi172 ceph-mon[34821]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:05.628 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 03:40:05 smithi174 podman[63009]: 2024-09-21 03:40:05.277706044 +0000 UTC m=+0.016001038 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:40:05.628 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 03:40:05 smithi174 podman[63009]: 2024-09-21 03:40:05.405860597 +0000 UTC m=+0.144155569 container create 35e798ffbeb4481b69d33b22c5ed9e573fff28f9c6f2b3956890313d539e0c33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-c, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:40:05.699 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:40:05.960 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:06.128 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 03:40:05 smithi174 podman[63009]: 2024-09-21 03:40:05.628292702 +0000 UTC m=+0.366587674 container init 35e798ffbeb4481b69d33b22c5ed9e573fff28f9c6f2b3956890313d539e0c33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T03:40:06.128 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 03:40:05 smithi174 podman[63009]: 2024-09-21 03:40:05.63129736 +0000 UTC m=+0.369592333 container start 35e798ffbeb4481b69d33b22c5ed9e573fff28f9c6f2b3956890313d539e0c33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-c, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T03:40:06.128 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 03:40:05 smithi174 ceph-mds[63029]: -- 172.21.15.174:0/2727283563 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557f6ff89860 con 0x557f74131a80 2024-09-21T03:40:06.128 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 03:40:05 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-c[63025]: starting mds.c at 2024-09-21T03:40:06.129 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 03:40:05 smithi174 bash[63009]: 35e798ffbeb4481b69d33b22c5ed9e573fff28f9c6f2b3956890313d539e0c33 2024-09-21T03:40:06.129 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 03:40:05 smithi174 systemd[1]: Started Ceph mds.c for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:40:06.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.471+0000 7fcf9b35d640 1 -- 172.21.15.84:0/79488335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf94108cf0 msgr2=0x7fcf9410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:06.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.471+0000 7fcf9b35d640 1 --2- 172.21.15.84:0/79488335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf94108cf0 0x7fcf9410f520 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c009ca0 tx=0x7fcf8c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:40:06.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.471+0000 7fcf9b35d640 1 -- 172.21.15.84:0/79488335 shutdown_connections 2024-09-21T03:40:06.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.471+0000 7fcf9b35d640 1 --2- 172.21.15.84:0/79488335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf94108cf0 0x7fcf9410f520 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:06.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.471+0000 7fcf9b35d640 1 --2- 172.21.15.84:0/79488335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf941083a0 0x7fcf941087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:06.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.471+0000 7fcf9b35d640 1 --2- 172.21.15.84:0/79488335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf94102a60 0x7fcf94102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:06.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.471+0000 7fcf9b35d640 1 -- 172.21.15.84:0/79488335 >> 172.21.15.84:0/79488335 conn(0x7fcf94079730 msgr2=0x7fcf94079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:06.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.471+0000 7fcf9b35d640 1 -- 172.21.15.84:0/79488335 shutdown_connections 2024-09-21T03:40:06.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.471+0000 7fcf9b35d640 1 -- 172.21.15.84:0/79488335 wait complete. 2024-09-21T03:40:06.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.472+0000 7fcf9b35d640 1 Processor -- start 2024-09-21T03:40:06.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.472+0000 7fcf9b35d640 1 -- start start 2024-09-21T03:40:06.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.472+0000 7fcf9b35d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf94102a60 0x7fcf9419b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:06.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.472+0000 7fcf9b35d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf941083a0 0x7fcf9419b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:06.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.472+0000 7fcf9b35d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf94108cf0 0x7fcf9419bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:06.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.472+0000 7fcf9b35d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcf94112960 con 0x7fcf94102a60 2024-09-21T03:40:06.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.472+0000 7fcf9b35d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcf941127e0 con 0x7fcf94108cf0 2024-09-21T03:40:06.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.472+0000 7fcf9b35d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcf94112ae0 con 0x7fcf941083a0 2024-09-21T03:40:06.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.472+0000 7fcf990f9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf94102a60 0x7fcf9419b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:06.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.472+0000 7fcf990f9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf94102a60 0x7fcf9419b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56730/0 (socket says 172.21.15.84:56730) 2024-09-21T03:40:06.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.472+0000 7fcf990f9640 1 -- 172.21.15.84:0/430345256 learned_addr learned my addr 172.21.15.84:0/430345256 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:06.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.472+0000 7fcf998fa640 1 --2- 172.21.15.84:0/430345256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf94108cf0 0x7fcf9419bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:06.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.473+0000 7fcf988f8640 1 --2- 172.21.15.84:0/430345256 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf941083a0 0x7fcf9419b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:06.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.473+0000 7fcf990f9640 1 -- 172.21.15.84:0/430345256 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf941083a0 msgr2=0x7fcf9419b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:06.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.473+0000 7fcf990f9640 1 --2- 172.21.15.84:0/430345256 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf941083a0 0x7fcf9419b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:06.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.473+0000 7fcf990f9640 1 -- 172.21.15.84:0/430345256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf94108cf0 msgr2=0x7fcf9419bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:06.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.473+0000 7fcf990f9640 1 --2- 172.21.15.84:0/430345256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf94108cf0 0x7fcf9419bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:06.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.473+0000 7fcf990f9640 1 -- 172.21.15.84:0/430345256 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf941a64a0 con 0x7fcf94102a60 2024-09-21T03:40:06.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.473+0000 7fcf990f9640 1 --2- 172.21.15.84:0/430345256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf94102a60 0x7fcf9419b210 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000d950 tx=0x7fcf9000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:06.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.473+0000 7fcf8a7fc640 1 -- 172.21.15.84:0/430345256 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf90017070 con 0x7fcf94102a60 2024-09-21T03:40:06.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.473+0000 7fcf8a7fc640 1 -- 172.21.15.84:0/430345256 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf90009c30 con 0x7fcf94102a60 2024-09-21T03:40:06.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.473+0000 7fcf8a7fc640 1 -- 172.21.15.84:0/430345256 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9000f620 con 0x7fcf94102a60 2024-09-21T03:40:06.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.473+0000 7fcf9b35d640 1 -- 172.21.15.84:0/430345256 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf941a6790 con 0x7fcf94102a60 2024-09-21T03:40:06.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.473+0000 7fcf9b35d640 1 -- 172.21.15.84:0/430345256 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf941a6cd0 con 0x7fcf94102a60 2024-09-21T03:40:06.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.474+0000 7fcf9b35d640 1 -- 172.21.15.84:0/430345256 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf94102e70 con 0x7fcf94102a60 2024-09-21T03:40:06.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.476+0000 7fcf8a7fc640 1 -- 172.21.15.84:0/430345256 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fcf90010460 con 0x7fcf94102a60 2024-09-21T03:40:06.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.477+0000 7fcf8a7fc640 1 --2- 172.21.15.84:0/430345256 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcf800b6590 0x7fcf800b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:06.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.477+0000 7fcf988f8640 1 --2- 172.21.15.84:0/430345256 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcf800b6590 0x7fcf800b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:06.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.477+0000 7fcf8a7fc640 1 -- 172.21.15.84:0/430345256 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fcf900e6b30 con 0x7fcf94102a60 2024-09-21T03:40:06.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.477+0000 7fcf988f8640 1 --2- 172.21.15.84:0/430345256 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcf800b6590 0x7fcf800b8aa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcf9406a2b0 tx=0x7fcf8400b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:06.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.481+0000 7fcf8a7fc640 1 -- 172.21.15.84:0/430345256 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcf900b1b70 con 0x7fcf94102a60 2024-09-21T03:40:06.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.703+0000 7fcf9b35d640 1 -- 172.21.15.84:0/430345256 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf9402e640 con 0x7fcf94102a60 2024-09-21T03:40:06.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.704+0000 7fcf8a7fc640 1 -- 172.21.15.84:0/430345256 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6394 (secure 0 0 0) 0x7fcf900b6ab0 con 0x7fcf94102a60 2024-09-21T03:40:06.707 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:40:06.707 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":8,"btime":"2024-09-21T03:40:05:998431+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24614,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T03:40:06.707 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 8 2024-09-21T03:40:06.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.706+0000 7fcf9b35d640 1 -- 172.21.15.84:0/430345256 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcf800b6590 msgr2=0x7fcf800b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:06.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.706+0000 7fcf9b35d640 1 --2- 172.21.15.84:0/430345256 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcf800b6590 0x7fcf800b8aa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcf9406a2b0 tx=0x7fcf8400b390 comp rx=0 tx=0).stop 2024-09-21T03:40:06.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.706+0000 7fcf9b35d640 1 -- 172.21.15.84:0/430345256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf94102a60 msgr2=0x7fcf9419b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.706+0000 7fcf9b35d640 1 --2- 172.21.15.84:0/430345256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf94102a60 0x7fcf9419b210 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000d950 tx=0x7fcf9000de10 comp rx=0 tx=0).stop 2024-09-21T03:40:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.706+0000 7fcf9b35d640 1 -- 172.21.15.84:0/430345256 shutdown_connections 2024-09-21T03:40:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.706+0000 7fcf9b35d640 1 --2- 172.21.15.84:0/430345256 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcf800b6590 0x7fcf800b8aa0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.706+0000 7fcf9b35d640 1 --2- 172.21.15.84:0/430345256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf94108cf0 0x7fcf9419bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.706+0000 7fcf9b35d640 1 --2- 172.21.15.84:0/430345256 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf941083a0 0x7fcf9419b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.706+0000 7fcf9b35d640 1 --2- 172.21.15.84:0/430345256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcf94102a60 0x7fcf9419b210 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.706+0000 7fcf9b35d640 1 -- 172.21.15.84:0/430345256 >> 172.21.15.84:0/430345256 conn(0x7fcf94079730 msgr2=0x7fcf941043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.707+0000 7fcf9b35d640 1 -- 172.21.15.84:0/430345256 shutdown_connections 2024-09-21T03:40:06.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:06.707+0000 7fcf9b35d640 1 -- 172.21.15.84:0/430345256 wait complete. 2024-09-21T03:40:07.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:06 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:07.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:06 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:07.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:06 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:07.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:06 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:07.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:06 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:07.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:06 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:07.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:06 smithi084 ceph-mon[30941]: Deploying daemon mds.h on smithi172 2024-09-21T03:40:07.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:06 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.174:6836/152508350,v1:172.21.15.174:6837/152508350] up:boot 2024-09-21T03:40:07.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:06 smithi084 ceph-mon[30941]: fsmap 7 up:standby 2024-09-21T03:40:07.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:06 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:40:07.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:06 smithi084 ceph-mon[30941]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:07.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:06 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/430345256' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:07.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:06 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:07.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:06 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:07.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:06 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:07.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:06 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:07.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:06 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:07.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:06 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:07.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:06 smithi174 ceph-mon[34403]: Deploying daemon mds.h on smithi172 2024-09-21T03:40:07.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:06 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.174:6836/152508350,v1:172.21.15.174:6837/152508350] up:boot 2024-09-21T03:40:07.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:06 smithi174 ceph-mon[34403]: fsmap 7 up:standby 2024-09-21T03:40:07.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:06 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:40:07.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:06 smithi174 ceph-mon[34403]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:07.130 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:06 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/430345256' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:07.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:06 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:07.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:06 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:07.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:06 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:07.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:06 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:07.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:06 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:07.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:06 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:07.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:06 smithi172 ceph-mon[34821]: Deploying daemon mds.h on smithi172 2024-09-21T03:40:07.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:06 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.174:6836/152508350,v1:172.21.15.174:6837/152508350] up:boot 2024-09-21T03:40:07.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:06 smithi172 ceph-mon[34821]: fsmap 7 up:standby 2024-09-21T03:40:07.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:06 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:40:07.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:06 smithi172 ceph-mon[34821]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:07.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:06 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/430345256' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:08.151 INFO:journalctl@ceph.mds.h.smithi172.stdout:Sep 21 03:40:08 smithi172 podman[63260]: 2024-09-21 03:40:08.092445 +0000 UTC m=+0.136268641 container create 8508fbba1072002e9e668363f1887ee160cdf500b829e39a33948c7541bcbf29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-h, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T03:40:08.651 INFO:journalctl@ceph.mds.h.smithi172.stdout:Sep 21 03:40:08 smithi172 podman[63260]: 2024-09-21 03:40:08.362318013 +0000 UTC m=+0.406141627 container init 8508fbba1072002e9e668363f1887ee160cdf500b829e39a33948c7541bcbf29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-h, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T03:40:08.651 INFO:journalctl@ceph.mds.h.smithi172.stdout:Sep 21 03:40:08 smithi172 podman[63260]: 2024-09-21 03:40:08.36517358 +0000 UTC m=+0.408997180 container start 8508fbba1072002e9e668363f1887ee160cdf500b829e39a33948c7541bcbf29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-h, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T03:40:08.651 INFO:journalctl@ceph.mds.h.smithi172.stdout:Sep 21 03:40:08 smithi172 ceph-mds[63279]: -- 172.21.15.172:0/2227500097 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559af8f9d860 con 0x559afd145a80 2024-09-21T03:40:08.651 INFO:journalctl@ceph.mds.h.smithi172.stdout:Sep 21 03:40:08 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-h[63275]: starting mds.h at 2024-09-21T03:40:08.651 INFO:journalctl@ceph.mds.h.smithi172.stdout:Sep 21 03:40:08 smithi172 bash[63260]: 8508fbba1072002e9e668363f1887ee160cdf500b829e39a33948c7541bcbf29 2024-09-21T03:40:08.651 INFO:journalctl@ceph.mds.h.smithi172.stdout:Sep 21 03:40:08 smithi172 systemd[1]: Started Ceph mds.h for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:40:09.358 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:40:09.616 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:09.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:09 smithi172 ceph-mon[34821]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:09.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:09 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:09.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:09 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:09.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:09 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:09.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:09 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:09.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:09 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:09.723 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:09 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:09.723 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:09 smithi174 ceph-mon[34403]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:09.724 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:09 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:09.724 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:09 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:09.724 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:09 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:09.724 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:09 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:09.724 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:09 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:09.724 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:09 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:09.736 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:09 smithi084 ceph-mon[30941]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:09.736 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:09 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:09.736 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:09 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:09.736 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:09 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:09.737 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:09 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:09.737 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:09 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:09.737 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:09 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:10.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.144+0000 7f4d798a0640 1 -- 172.21.15.84:0/2899225361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d74109e00 msgr2=0x7f4d74110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:10.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.144+0000 7f4d798a0640 1 --2- 172.21.15.84:0/2899225361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d74109e00 0x7f4d74110630 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009ca0 tx=0x7f4d6c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:40:10.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.144+0000 7f4d798a0640 1 -- 172.21.15.84:0/2899225361 shutdown_connections 2024-09-21T03:40:10.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.144+0000 7f4d798a0640 1 --2- 172.21.15.84:0/2899225361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d74109e00 0x7f4d74110630 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:10.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.144+0000 7f4d798a0640 1 --2- 172.21.15.84:0/2899225361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d741094b0 0x7f4d741098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:10.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.144+0000 7f4d798a0640 1 --2- 172.21.15.84:0/2899225361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d74103b70 0x7f4d74103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:10.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.144+0000 7f4d798a0640 1 -- 172.21.15.84:0/2899225361 >> 172.21.15.84:0/2899225361 conn(0x7f4d740ff5e0 msgr2=0x7f4d74101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:10.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.144+0000 7f4d798a0640 1 -- 172.21.15.84:0/2899225361 shutdown_connections 2024-09-21T03:40:10.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.144+0000 7f4d798a0640 1 -- 172.21.15.84:0/2899225361 wait complete. 2024-09-21T03:40:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.145+0000 7f4d798a0640 1 Processor -- start 2024-09-21T03:40:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.145+0000 7f4d798a0640 1 -- start start 2024-09-21T03:40:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.145+0000 7f4d798a0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d74103b70 0x7f4d7419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.145+0000 7f4d798a0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d741094b0 0x7f4d7419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.145+0000 7f4d798a0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d74109e00 0x7f4d7419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.145+0000 7f4d798a0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4d74113ac0 con 0x7f4d74109e00 2024-09-21T03:40:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.145+0000 7f4d798a0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4d74113940 con 0x7f4d741094b0 2024-09-21T03:40:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.145+0000 7f4d798a0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d74113c40 con 0x7f4d74103b70 2024-09-21T03:40:10.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.146+0000 7f4d737fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d74109e00 0x7f4d7419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.146+0000 7f4d737fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d74109e00 0x7f4d7419fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42632/0 (socket says 172.21.15.84:42632) 2024-09-21T03:40:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.146+0000 7f4d72ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d74103b70 0x7f4d7419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.146+0000 7f4d737fe640 1 -- 172.21.15.84:0/1509161268 learned_addr learned my addr 172.21.15.84:0/1509161268 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.146+0000 7f4d727fc640 1 --2- 172.21.15.84:0/1509161268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d741094b0 0x7f4d7419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.146+0000 7f4d737fe640 1 -- 172.21.15.84:0/1509161268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d74103b70 msgr2=0x7f4d7419a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.146+0000 7f4d737fe640 1 --2- 172.21.15.84:0/1509161268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d74103b70 0x7f4d7419a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.146+0000 7f4d737fe640 1 -- 172.21.15.84:0/1509161268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d741094b0 msgr2=0x7f4d7419aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.146+0000 7f4d737fe640 1 --2- 172.21.15.84:0/1509161268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d741094b0 0x7f4d7419aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.146+0000 7f4d737fe640 1 -- 172.21.15.84:0/1509161268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d741a0420 con 0x7f4d74109e00 2024-09-21T03:40:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.146+0000 7f4d727fc640 1 --2- 172.21.15.84:0/1509161268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d741094b0 0x7f4d7419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:40:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.146+0000 7f4d737fe640 1 --2- 172.21.15.84:0/1509161268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d74109e00 0x7f4d7419fcf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c005cc0 tx=0x7f4d6c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.146+0000 7f4d7889e640 1 -- 172.21.15.84:0/1509161268 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c003bf0 con 0x7f4d74109e00 2024-09-21T03:40:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.146+0000 7f4d798a0640 1 -- 172.21.15.84:0/1509161268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d741a06b0 con 0x7f4d74109e00 2024-09-21T03:40:10.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.146+0000 7f4d7889e640 1 -- 172.21.15.84:0/1509161268 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d6c003d90 con 0x7f4d74109e00 2024-09-21T03:40:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.146+0000 7f4d7889e640 1 -- 172.21.15.84:0/1509161268 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c02fbc0 con 0x7f4d74109e00 2024-09-21T03:40:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.146+0000 7f4d798a0640 1 -- 172.21.15.84:0/1509161268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d741a6e70 con 0x7f4d74109e00 2024-09-21T03:40:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.147+0000 7f4d798a0640 1 -- 172.21.15.84:0/1509161268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d74103f80 con 0x7f4d74109e00 2024-09-21T03:40:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.149+0000 7f4d7889e640 1 -- 172.21.15.84:0/1509161268 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f4d6c02fd60 con 0x7f4d74109e00 2024-09-21T03:40:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.149+0000 7f4d7889e640 1 --2- 172.21.15.84:0/1509161268 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4d5c0b6560 0x7f4d5c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.150+0000 7f4d72ffd640 1 --2- 172.21.15.84:0/1509161268 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4d5c0b6560 0x7f4d5c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.150+0000 7f4d7889e640 1 -- 172.21.15.84:0/1509161268 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f4d6c108630 con 0x7f4d74109e00 2024-09-21T03:40:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.150+0000 7f4d72ffd640 1 --2- 172.21.15.84:0/1509161268 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4d5c0b6560 0x7f4d5c0b8a70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4d64005d00 tx=0x7f4d6400b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:10.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.153+0000 7f4d7889e640 1 -- 172.21.15.84:0/1509161268 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4d6c0cf290 con 0x7f4d74109e00 2024-09-21T03:40:10.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.368+0000 7f4d798a0640 1 -- 172.21.15.84:0/1509161268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d7419b5e0 con 0x7f4d74109e00 2024-09-21T03:40:10.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.368+0000 7f4d7889e640 1 -- 172.21.15.84:0/1509161268 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7222 (secure 0 0 0) 0x7f4d6c0d3670 con 0x7f4d74109e00 2024-09-21T03:40:10.370 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:40:10.371 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":9,"btime":"2024-09-21T03:40:09:322718+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24614,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24638,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T03:40:10.371 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 9 2024-09-21T03:40:10.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.370+0000 7f4d798a0640 1 -- 172.21.15.84:0/1509161268 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4d5c0b6560 msgr2=0x7f4d5c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:10.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.370+0000 7f4d798a0640 1 --2- 172.21.15.84:0/1509161268 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4d5c0b6560 0x7f4d5c0b8a70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4d64005d00 tx=0x7f4d6400b410 comp rx=0 tx=0).stop 2024-09-21T03:40:10.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.370+0000 7f4d798a0640 1 -- 172.21.15.84:0/1509161268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d74109e00 msgr2=0x7f4d7419fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:10.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.370+0000 7f4d798a0640 1 --2- 172.21.15.84:0/1509161268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d74109e00 0x7f4d7419fcf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c005cc0 tx=0x7f4d6c02f380 comp rx=0 tx=0).stop 2024-09-21T03:40:10.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.370+0000 7f4d798a0640 1 -- 172.21.15.84:0/1509161268 shutdown_connections 2024-09-21T03:40:10.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.370+0000 7f4d798a0640 1 --2- 172.21.15.84:0/1509161268 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4d5c0b6560 0x7f4d5c0b8a70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:10.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.370+0000 7f4d798a0640 1 --2- 172.21.15.84:0/1509161268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d74109e00 0x7f4d7419fcf0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:10.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.370+0000 7f4d798a0640 1 --2- 172.21.15.84:0/1509161268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d741094b0 0x7f4d7419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:10.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.370+0000 7f4d798a0640 1 --2- 172.21.15.84:0/1509161268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d74103b70 0x7f4d7419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:10.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.371+0000 7f4d798a0640 1 -- 172.21.15.84:0/1509161268 >> 172.21.15.84:0/1509161268 conn(0x7f4d740ff5e0 msgr2=0x7f4d74101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:10.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.371+0000 7f4d798a0640 1 -- 172.21.15.84:0/1509161268 shutdown_connections 2024-09-21T03:40:10.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:10.371+0000 7f4d798a0640 1 -- 172.21.15.84:0/1509161268 wait complete. 2024-09-21T03:40:10.608 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:10 smithi174 ceph-mon[34403]: Deploying daemon mds.i on smithi174 2024-09-21T03:40:10.608 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:10 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] up:boot 2024-09-21T03:40:10.608 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:10 smithi174 ceph-mon[34403]: fsmap 8 up:standby 2024-09-21T03:40:10.609 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:10 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:40:10.609 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 03:40:10 smithi174 systemd[1]: Starting Ceph mds.i for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:40:10.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:10 smithi172 ceph-mon[34821]: Deploying daemon mds.i on smithi174 2024-09-21T03:40:10.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:10 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] up:boot 2024-09-21T03:40:10.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:10 smithi172 ceph-mon[34821]: fsmap 8 up:standby 2024-09-21T03:40:10.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:10 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:40:10.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:10 smithi084 ceph-mon[30941]: Deploying daemon mds.i on smithi174 2024-09-21T03:40:10.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:10 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] up:boot 2024-09-21T03:40:10.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:10 smithi084 ceph-mon[30941]: fsmap 8 up:standby 2024-09-21T03:40:10.808 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:10 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:40:10.878 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 03:40:10 smithi174 podman[63279]: 2024-09-21 03:40:10.509184111 +0000 UTC m=+0.015664099 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:40:10.879 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 03:40:10 smithi174 podman[63279]: 2024-09-21 03:40:10.625967106 +0000 UTC m=+0.132447149 container create ca5ebcfead0d99ecd094603c289892359bf1e70d6fb169353f83c066fb469696 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T03:40:11.340 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 03:40:10 smithi174 podman[63279]: 2024-09-21 03:40:10.908529525 +0000 UTC m=+0.415009507 container init ca5ebcfead0d99ecd094603c289892359bf1e70d6fb169353f83c066fb469696 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-i, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T03:40:11.340 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 03:40:10 smithi174 podman[63279]: 2024-09-21 03:40:10.911570086 +0000 UTC m=+0.418050064 container start ca5ebcfead0d99ecd094603c289892359bf1e70d6fb169353f83c066fb469696 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-i, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T03:40:11.340 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 03:40:10 smithi174 ceph-mds[63298]: -- 172.21.15.174:0/2440500607 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e327303860 con 0x55e32b4ab600 2024-09-21T03:40:11.340 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 03:40:10 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-i[63294]: starting mds.i at 2024-09-21T03:40:11.340 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 03:40:11 smithi174 bash[63279]: ca5ebcfead0d99ecd094603c289892359bf1e70d6fb169353f83c066fb469696 2024-09-21T03:40:11.340 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 03:40:11 smithi174 systemd[1]: Started Ceph mds.i for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:40:11.598 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:11 smithi084 ceph-mon[30941]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:11.598 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:11 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1509161268' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:11.598 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:11 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:11.598 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:11 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:11.598 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:11 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:11.598 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:11 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:11.598 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:11 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:11.598 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:11 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:11.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:11 smithi174 ceph-mon[34403]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:11.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:11 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1509161268' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:11.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:11 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:11.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:11 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:11.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:11 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:11.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:11 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:11.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:11 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:11.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:11 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:11.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:11 smithi172 ceph-mon[34821]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:11.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:11 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1509161268' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:11.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:11 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:11.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:11 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:11.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:11 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:11.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:11 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:11.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:11 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:11.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:11 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:12.484 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:12 smithi084 ceph-mon[30941]: Deploying daemon mds.g on smithi084 2024-09-21T03:40:12.484 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:12 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] up:boot 2024-09-21T03:40:12.485 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:12 smithi084 ceph-mon[30941]: fsmap 9 up:standby 2024-09-21T03:40:12.485 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:12 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:40:12.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:12 smithi174 ceph-mon[34403]: Deploying daemon mds.g on smithi084 2024-09-21T03:40:12.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:12 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] up:boot 2024-09-21T03:40:12.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:12 smithi174 ceph-mon[34403]: fsmap 9 up:standby 2024-09-21T03:40:12.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:12 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:40:12.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:12 smithi172 ceph-mon[34821]: Deploying daemon mds.g on smithi084 2024-09-21T03:40:12.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:12 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] up:boot 2024-09-21T03:40:12.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:12 smithi172 ceph-mon[34821]: fsmap 9 up:standby 2024-09-21T03:40:12.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:12 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:40:13.049 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:40:13.068 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 03:40:12 smithi084 systemd[1]: Starting Ceph mds.g for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:40:13.335 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 03:40:13 smithi084 podman[73508]: 2024-09-21 03:40:13.060560623 +0000 UTC m=+0.015667959 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:40:13.335 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 03:40:13 smithi084 podman[73508]: 2024-09-21 03:40:13.185296013 +0000 UTC m=+0.140403343 container create 4583dc2e82bd1ed5808eff8c86d0e4cfb8d3be857509b375e06dadd4d35a5071 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-g, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True) 2024-09-21T03:40:13.585 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:13.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:13 smithi174 ceph-mon[34403]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:13.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:13 smithi172 ceph-mon[34821]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:13.708 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:13 smithi084 ceph-mon[30941]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:13.709 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 03:40:13 smithi084 podman[73508]: 2024-09-21 03:40:13.455020963 +0000 UTC m=+0.410128293 container init 4583dc2e82bd1ed5808eff8c86d0e4cfb8d3be857509b375e06dadd4d35a5071 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T03:40:13.709 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 03:40:13 smithi084 podman[73508]: 2024-09-21 03:40:13.458050554 +0000 UTC m=+0.413157886 container start 4583dc2e82bd1ed5808eff8c86d0e4cfb8d3be857509b375e06dadd4d35a5071 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-g, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:40:13.709 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 03:40:13 smithi084 ceph-mds[73573]: -- 172.21.15.84:0/2513794185 <== mon.0 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558d43963860 con 0x558d47b0b180 2024-09-21T03:40:13.709 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 03:40:13 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-g[73561]: starting mds.g at 2024-09-21T03:40:13.709 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 03:40:13 smithi084 bash[73508]: 4583dc2e82bd1ed5808eff8c86d0e4cfb8d3be857509b375e06dadd4d35a5071 2024-09-21T03:40:13.709 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 03:40:13 smithi084 systemd[1]: Started Ceph mds.g for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:40:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.122+0000 7f51704f0640 1 -- 172.21.15.84:0/3381024210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5168103b80 msgr2=0x7f5168103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.122+0000 7f51704f0640 1 --2- 172.21.15.84:0/3381024210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5168103b80 0x7f5168103f90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5158009900 tx=0x7f515802a410 comp rx=0 tx=0).stop 2024-09-21T03:40:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.122+0000 7f51704f0640 1 -- 172.21.15.84:0/3381024210 shutdown_connections 2024-09-21T03:40:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.122+0000 7f51704f0640 1 --2- 172.21.15.84:0/3381024210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5168109e10 0x7f5168110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.122+0000 7f51704f0640 1 --2- 172.21.15.84:0/3381024210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51681094c0 0x7f51681098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.122+0000 7f51704f0640 1 --2- 172.21.15.84:0/3381024210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5168103b80 0x7f5168103f90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.122+0000 7f51704f0640 1 -- 172.21.15.84:0/3381024210 >> 172.21.15.84:0/3381024210 conn(0x7f51680ff610 msgr2=0x7f5168101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.122+0000 7f51704f0640 1 -- 172.21.15.84:0/3381024210 shutdown_connections 2024-09-21T03:40:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.122+0000 7f51704f0640 1 -- 172.21.15.84:0/3381024210 wait complete. 2024-09-21T03:40:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.123+0000 7f51704f0640 1 Processor -- start 2024-09-21T03:40:14.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.123+0000 7f51704f0640 1 -- start start 2024-09-21T03:40:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.123+0000 7f51704f0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5168103b80 0x7f516819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.123+0000 7f51704f0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51681094c0 0x7f516819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.123+0000 7f51704f0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5168109e10 0x7f516819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.123+0000 7f51704f0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5168113ad0 con 0x7f5168109e10 2024-09-21T03:40:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.123+0000 7f51704f0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5168113950 con 0x7f51681094c0 2024-09-21T03:40:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.123+0000 7f51704f0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5168113c50 con 0x7f5168103b80 2024-09-21T03:40:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.123+0000 7f516ea8d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5168109e10 0x7f516819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.123+0000 7f516ea8d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5168109e10 0x7f516819fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42690/0 (socket says 172.21.15.84:42690) 2024-09-21T03:40:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.123+0000 7f516ea8d640 1 -- 172.21.15.84:0/600096521 learned_addr learned my addr 172.21.15.84:0/600096521 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.124+0000 7f516e28c640 1 --2- 172.21.15.84:0/600096521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5168103b80 0x7f516819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.124+0000 7f516da8b640 1 --2- 172.21.15.84:0/600096521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51681094c0 0x7f516819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.124+0000 7f516ea8d640 1 -- 172.21.15.84:0/600096521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5168103b80 msgr2=0x7f516819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.124+0000 7f516ea8d640 1 --2- 172.21.15.84:0/600096521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5168103b80 0x7f516819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:14.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.124+0000 7f516ea8d640 1 -- 172.21.15.84:0/600096521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51681094c0 msgr2=0x7f516819aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:14.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.124+0000 7f516ea8d640 1 --2- 172.21.15.84:0/600096521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51681094c0 0x7f516819aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:14.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.124+0000 7f516ea8d640 1 -- 172.21.15.84:0/600096521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51681a0450 con 0x7f5168109e10 2024-09-21T03:40:14.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.124+0000 7f516da8b640 1 --2- 172.21.15.84:0/600096521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51681094c0 0x7f516819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:40:14.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.124+0000 7f516ea8d640 1 --2- 172.21.15.84:0/600096521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5168109e10 0x7f516819fd20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5160009fd0 tx=0x7f516000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:14.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.124+0000 7f515f7fe640 1 -- 172.21.15.84:0/600096521 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5160017070 con 0x7f5168109e10 2024-09-21T03:40:14.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.124+0000 7f515f7fe640 1 -- 172.21.15.84:0/600096521 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5160003e20 con 0x7f5168109e10 2024-09-21T03:40:14.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.124+0000 7f51704f0640 1 -- 172.21.15.84:0/600096521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51681a0740 con 0x7f5168109e10 2024-09-21T03:40:14.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.124+0000 7f515f7fe640 1 -- 172.21.15.84:0/600096521 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5160010460 con 0x7f5168109e10 2024-09-21T03:40:14.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.124+0000 7f51704f0640 1 -- 172.21.15.84:0/600096521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51681a6ea0 con 0x7f5168109e10 2024-09-21T03:40:14.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.125+0000 7f51704f0640 1 -- 172.21.15.84:0/600096521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5168104e00 con 0x7f5168109e10 2024-09-21T03:40:14.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.127+0000 7f515f7fe640 1 -- 172.21.15.84:0/600096521 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f5160003970 con 0x7f5168109e10 2024-09-21T03:40:14.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.127+0000 7f515f7fe640 1 --2- 172.21.15.84:0/600096521 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f51540b6560 0x7f51540b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:14.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.127+0000 7f516e28c640 1 --2- 172.21.15.84:0/600096521 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f51540b6560 0x7f51540b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:14.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.127+0000 7f515f7fe640 1 -- 172.21.15.84:0/600096521 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f51600e6d50 con 0x7f5168109e10 2024-09-21T03:40:14.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.128+0000 7f516e28c640 1 --2- 172.21.15.84:0/600096521 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f51540b6560 0x7f51540b8a70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5158031440 tx=0x7f5158009560 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:14.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.130+0000 7f515f7fe640 1 -- 172.21.15.84:0/600096521 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f51600ad9b0 con 0x7f5168109e10 2024-09-21T03:40:14.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.354+0000 7f51704f0640 1 -- 172.21.15.84:0/600096521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5168103f90 con 0x7f5168109e10 2024-09-21T03:40:14.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.358+0000 7f515f7fe640 1 -- 172.21.15.84:0/600096521 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8875 (secure 0 0 0) 0x7f5168103f90 con 0x7f5168109e10 2024-09-21T03:40:14.360 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:40:14.361 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":11,"btime":"2024-09-21T03:40:14:354139+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24614,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24634,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24638,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T03:40:14.361 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 11 2024-09-21T03:40:14.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.360+0000 7f51704f0640 1 -- 172.21.15.84:0/600096521 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f51540b6560 msgr2=0x7f51540b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:14.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.360+0000 7f51704f0640 1 --2- 172.21.15.84:0/600096521 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f51540b6560 0x7f51540b8a70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5158031440 tx=0x7f5158009560 comp rx=0 tx=0).stop 2024-09-21T03:40:14.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.360+0000 7f51704f0640 1 -- 172.21.15.84:0/600096521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5168109e10 msgr2=0x7f516819fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:14.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.360+0000 7f51704f0640 1 --2- 172.21.15.84:0/600096521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5168109e10 0x7f516819fd20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5160009fd0 tx=0x7f516000b260 comp rx=0 tx=0).stop 2024-09-21T03:40:14.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.360+0000 7f51704f0640 1 -- 172.21.15.84:0/600096521 shutdown_connections 2024-09-21T03:40:14.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.360+0000 7f51704f0640 1 --2- 172.21.15.84:0/600096521 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f51540b6560 0x7f51540b8a70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:14.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.360+0000 7f51704f0640 1 --2- 172.21.15.84:0/600096521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5168109e10 0x7f516819fd20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:14.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.360+0000 7f51704f0640 1 --2- 172.21.15.84:0/600096521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51681094c0 0x7f516819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:14.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.360+0000 7f51704f0640 1 --2- 172.21.15.84:0/600096521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5168103b80 0x7f516819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:14.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.360+0000 7f51704f0640 1 -- 172.21.15.84:0/600096521 >> 172.21.15.84:0/600096521 conn(0x7f51680ff610 msgr2=0x7f5168101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:14.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.361+0000 7f51704f0640 1 -- 172.21.15.84:0/600096521 shutdown_connections 2024-09-21T03:40:14.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:14.361+0000 7f51704f0640 1 -- 172.21.15.84:0/600096521 wait complete. 2024-09-21T03:40:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:14 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:14 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:14 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:14 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:14 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:14.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:14 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:14.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:14 smithi174 ceph-mon[34403]: Deploying daemon mds.a on smithi084 2024-09-21T03:40:14.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:14 smithi174 ceph-mon[34403]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:14.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:14 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.84:6838/3243669807,v1:172.21.15.84:6839/3243669807] up:boot 2024-09-21T03:40:14.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:14 smithi174 ceph-mon[34403]: fsmap 10 up:standby 2024-09-21T03:40:14.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:14 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/600096521' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:14.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:14 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T03:40:14.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:14 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:14.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:14 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:14.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:14 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:14.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:14 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:14.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:14 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:14.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:14 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:14.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:14 smithi172 ceph-mon[34821]: Deploying daemon mds.a on smithi084 2024-09-21T03:40:14.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:14 smithi172 ceph-mon[34821]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:14.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:14 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.84:6838/3243669807,v1:172.21.15.84:6839/3243669807] up:boot 2024-09-21T03:40:14.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:14 smithi172 ceph-mon[34821]: fsmap 10 up:standby 2024-09-21T03:40:14.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:14 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/600096521' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:14.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:14 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T03:40:15.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:14 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:15.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:14 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:15.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:14 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:15.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:14 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:15.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:14 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:15.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:14 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:15.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:14 smithi084 ceph-mon[30941]: Deploying daemon mds.a on smithi084 2024-09-21T03:40:15.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:14 smithi084 ceph-mon[30941]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:15.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:14 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.84:6838/3243669807,v1:172.21.15.84:6839/3243669807] up:boot 2024-09-21T03:40:15.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:14 smithi084 ceph-mon[30941]: fsmap 10 up:standby 2024-09-21T03:40:15.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:14 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/600096521' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:15.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:14 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T03:40:16.568 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 03:40:16 smithi084 systemd[1]: Starting Ceph mds.a for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:40:16.916 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 03:40:16 smithi084 podman[73892]: 2024-09-21 03:40:16.541628556 +0000 UTC m=+0.015854968 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:40:16.916 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 03:40:16 smithi084 podman[73892]: 2024-09-21 03:40:16.666217375 +0000 UTC m=+0.140443771 container create 4f26f85aa857e598c86cfa815279ff1ab9ffad1256dbec0354fbfa3410008dcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:40:17.118 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:40:17.318 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 03:40:16 smithi084 podman[73892]: 2024-09-21 03:40:16.915348606 +0000 UTC m=+0.389575013 container init 4f26f85aa857e598c86cfa815279ff1ab9ffad1256dbec0354fbfa3410008dcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T03:40:17.318 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 03:40:16 smithi084 podman[73892]: 2024-09-21 03:40:16.918217445 +0000 UTC m=+0.392443845 container start 4f26f85aa857e598c86cfa815279ff1ab9ffad1256dbec0354fbfa3410008dcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-a, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T03:40:17.319 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 03:40:16 smithi084 ceph-mds[73911]: -- 172.21.15.84:0/2028893641 <== mon.0 v2:172.21.15.84:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5605a0d0d860 con 0x5605a4eb5180 2024-09-21T03:40:17.319 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 03:40:16 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-a[73907]: starting mds.a at 2024-09-21T03:40:17.319 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 03:40:17 smithi084 bash[73892]: 4f26f85aa857e598c86cfa815279ff1ab9ffad1256dbec0354fbfa3410008dcc 2024-09-21T03:40:17.319 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 03:40:17 smithi084 systemd[1]: Started Ceph mds.a for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:40:17.369 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:17.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:17 smithi174 ceph-mon[34403]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:17.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:17 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:17.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:17 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:17.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:17 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:17.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:17 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:17.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:17 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:17.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:17 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:17.637 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:17 smithi084 ceph-mon[30941]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:17.637 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:17 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:17.637 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:17 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:17.638 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:17 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:17.638 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:17 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:17.638 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:17 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:17.638 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:17 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:17.641 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:17 smithi172 ceph-mon[34821]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:17.641 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:17 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:17.641 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:17 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:17.641 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:17 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:17.641 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:17 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:40:17.641 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:17 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:40:17.642 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:17 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.902+0000 7f3ac2a0c640 1 -- 172.21.15.84:0/371160293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3abc102a80 msgr2=0x7f3abc102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.902+0000 7f3ac2a0c640 1 --2- 172.21.15.84:0/371160293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3abc102a80 0x7f3abc102e90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009900 tx=0x7f3aac02a410 comp rx=0 tx=0).stop 2024-09-21T03:40:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.902+0000 7f3ac2a0c640 1 -- 172.21.15.84:0/371160293 shutdown_connections 2024-09-21T03:40:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.902+0000 7f3ac2a0c640 1 --2- 172.21.15.84:0/371160293 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3abc108d10 0x7f3abc10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.902+0000 7f3ac2a0c640 1 --2- 172.21.15.84:0/371160293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3abc1083c0 0x7f3abc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.902+0000 7f3ac2a0c640 1 --2- 172.21.15.84:0/371160293 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3abc102a80 0x7f3abc102e90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.902+0000 7f3ac2a0c640 1 -- 172.21.15.84:0/371160293 >> 172.21.15.84:0/371160293 conn(0x7f3abc079740 msgr2=0x7f3abc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.902+0000 7f3ac2a0c640 1 -- 172.21.15.84:0/371160293 shutdown_connections 2024-09-21T03:40:17.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.902+0000 7f3ac2a0c640 1 -- 172.21.15.84:0/371160293 wait complete. 2024-09-21T03:40:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.903+0000 7f3ac2a0c640 1 Processor -- start 2024-09-21T03:40:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.903+0000 7f3ac2a0c640 1 -- start start 2024-09-21T03:40:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.904+0000 7f3ac2a0c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3abc102a80 0x7f3abc19b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.904+0000 7f3ac2a0c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3abc1083c0 0x7f3abc19b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.904+0000 7f3ac2a0c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3abc108d10 0x7f3abc19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.904+0000 7f3ac2a0c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3abc112980 con 0x7f3abc1083c0 2024-09-21T03:40:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.904+0000 7f3ac2a0c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3abc112800 con 0x7f3abc108d10 2024-09-21T03:40:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.904+0000 7f3ac2a0c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3abc112b00 con 0x7f3abc102a80 2024-09-21T03:40:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.904+0000 7f3abb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3abc1083c0 0x7f3abc19b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.904+0000 7f3abb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3abc1083c0 0x7f3abc19b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42726/0 (socket says 172.21.15.84:42726) 2024-09-21T03:40:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.904+0000 7f3abb7fe640 1 -- 172.21.15.84:0/477202470 learned_addr learned my addr 172.21.15.84:0/477202470 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.904+0000 7f3ac0fa9640 1 --2- 172.21.15.84:0/477202470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3abc108d10 0x7f3abc19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:17.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.904+0000 7f3abbfff640 1 --2- 172.21.15.84:0/477202470 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3abc102a80 0x7f3abc19b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.904+0000 7f3abb7fe640 1 -- 172.21.15.84:0/477202470 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3abc102a80 msgr2=0x7f3abc19b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.904+0000 7f3abb7fe640 1 --2- 172.21.15.84:0/477202470 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3abc102a80 0x7f3abc19b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.904+0000 7f3abb7fe640 1 -- 172.21.15.84:0/477202470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3abc108d10 msgr2=0x7f3abc19bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.904+0000 7f3abb7fe640 1 --2- 172.21.15.84:0/477202470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3abc108d10 0x7f3abc19bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.904+0000 7f3abb7fe640 1 -- 172.21.15.84:0/477202470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3abc1a6590 con 0x7f3abc1083c0 2024-09-21T03:40:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.904+0000 7f3ac0fa9640 1 --2- 172.21.15.84:0/477202470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3abc108d10 0x7f3abc19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:40:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.904+0000 7f3abb7fe640 1 --2- 172.21.15.84:0/477202470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3abc1083c0 0x7f3abc19b810 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000e9c0 tx=0x7f3ab000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.904+0000 7f3ab97fa640 1 -- 172.21.15.84:0/477202470 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab000cd80 con 0x7f3abc1083c0 2024-09-21T03:40:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.905+0000 7f3ab97fa640 1 -- 172.21.15.84:0/477202470 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ab00054d0 con 0x7f3abc1083c0 2024-09-21T03:40:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.905+0000 7f3ab97fa640 1 -- 172.21.15.84:0/477202470 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0010430 con 0x7f3abc1083c0 2024-09-21T03:40:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.905+0000 7f3ac2a0c640 1 -- 172.21.15.84:0/477202470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3abc1a6880 con 0x7f3abc1083c0 2024-09-21T03:40:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.905+0000 7f3ac2a0c640 1 -- 172.21.15.84:0/477202470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3abc1a6d70 con 0x7f3abc1083c0 2024-09-21T03:40:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.906+0000 7f3ac2a0c640 1 -- 172.21.15.84:0/477202470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3abc103d00 con 0x7f3abc1083c0 2024-09-21T03:40:17.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.907+0000 7f3ab97fa640 1 -- 172.21.15.84:0/477202470 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f3ab0004fb0 con 0x7f3abc1083c0 2024-09-21T03:40:17.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.908+0000 7f3ab97fa640 1 --2- 172.21.15.84:0/477202470 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f3aa40b6560 0x7f3aa40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:17.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.908+0000 7f3abbfff640 1 --2- 172.21.15.84:0/477202470 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f3aa40b6560 0x7f3aa40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:17.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.908+0000 7f3ab97fa640 1 -- 172.21.15.84:0/477202470 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f3ab00e75a0 con 0x7f3abc1083c0 2024-09-21T03:40:17.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.908+0000 7f3abbfff640 1 --2- 172.21.15.84:0/477202470 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f3aa40b6560 0x7f3aa40b8a70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3aac000c00 tx=0x7f3aac031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:17.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:17.911+0000 7f3ab97fa640 1 -- 172.21.15.84:0/477202470 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3ab0056710 con 0x7f3abc1083c0 2024-09-21T03:40:18.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:18.125+0000 7f3ac2a0c640 1 -- 172.21.15.84:0/477202470 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3abc06bf70 con 0x7f3abc1083c0 2024-09-21T03:40:18.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:18.125+0000 7f3ab97fa640 1 -- 172.21.15.84:0/477202470 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9701 (secure 0 0 0) 0x7f3ab00ae200 con 0x7f3abc1083c0 2024-09-21T03:40:18.127 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:40:18.127 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":12,"btime":"2024-09-21T03:40:17:324805+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24614,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24634,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24638,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T03:40:18.128 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 12 2024-09-21T03:40:18.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:18.128+0000 7f3ac2a0c640 1 -- 172.21.15.84:0/477202470 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f3aa40b6560 msgr2=0x7f3aa40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:18.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:18.128+0000 7f3ac2a0c640 1 --2- 172.21.15.84:0/477202470 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f3aa40b6560 0x7f3aa40b8a70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3aac000c00 tx=0x7f3aac031400 comp rx=0 tx=0).stop 2024-09-21T03:40:18.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:18.128+0000 7f3ac2a0c640 1 -- 172.21.15.84:0/477202470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3abc1083c0 msgr2=0x7f3abc19b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:18.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:18.128+0000 7f3ac2a0c640 1 --2- 172.21.15.84:0/477202470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3abc1083c0 0x7f3abc19b810 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000e9c0 tx=0x7f3ab000ee80 comp rx=0 tx=0).stop 2024-09-21T03:40:18.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:18.128+0000 7f3ac2a0c640 1 -- 172.21.15.84:0/477202470 shutdown_connections 2024-09-21T03:40:18.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:18.128+0000 7f3ac2a0c640 1 --2- 172.21.15.84:0/477202470 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f3aa40b6560 0x7f3aa40b8a70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:18.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:18.128+0000 7f3ac2a0c640 1 --2- 172.21.15.84:0/477202470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3abc108d10 0x7f3abc19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:18.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:18.128+0000 7f3ac2a0c640 1 --2- 172.21.15.84:0/477202470 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3abc1083c0 0x7f3abc19b810 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:18.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:18.128+0000 7f3ac2a0c640 1 --2- 172.21.15.84:0/477202470 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3abc102a80 0x7f3abc19b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:18.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:18.128+0000 7f3ac2a0c640 1 -- 172.21.15.84:0/477202470 >> 172.21.15.84:0/477202470 conn(0x7f3abc079740 msgr2=0x7f3abc101470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:18.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:18.128+0000 7f3ac2a0c640 1 -- 172.21.15.84:0/477202470 shutdown_connections 2024-09-21T03:40:18.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:18.128+0000 7f3ac2a0c640 1 -- 172.21.15.84:0/477202470 wait complete. 2024-09-21T03:40:18.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:18 smithi174 ceph-mon[34403]: Deploying daemon mds.b on smithi172 2024-09-21T03:40:18.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:18 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.84:6840/4285519513,v1:172.21.15.84:6841/4285519513] up:boot 2024-09-21T03:40:18.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:18 smithi174 ceph-mon[34403]: fsmap 11 up:standby 2024-09-21T03:40:18.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:18 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T03:40:18.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:18 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/477202470' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:18.638 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:18 smithi172 ceph-mon[34821]: Deploying daemon mds.b on smithi172 2024-09-21T03:40:18.638 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:18 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.84:6840/4285519513,v1:172.21.15.84:6841/4285519513] up:boot 2024-09-21T03:40:18.638 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:18 smithi172 ceph-mon[34821]: fsmap 11 up:standby 2024-09-21T03:40:18.639 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:18 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T03:40:18.639 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:18 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/477202470' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:18.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:18 smithi084 ceph-mon[30941]: Deploying daemon mds.b on smithi172 2024-09-21T03:40:18.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:18 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.84:6840/4285519513,v1:172.21.15.84:6841/4285519513] up:boot 2024-09-21T03:40:18.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:18 smithi084 ceph-mon[30941]: fsmap 11 up:standby 2024-09-21T03:40:18.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:18 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T03:40:18.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:18 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/477202470' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:19.332 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:40:19 smithi172 systemd[1]: Starting Ceph mds.b for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:40:19.610 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:19 smithi172 ceph-mon[34821]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:19.610 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:40:19 smithi172 podman[63526]: 2024-09-21 03:40:19.232551436 +0000 UTC m=+0.016227385 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:40:19.611 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:40:19 smithi172 podman[63526]: 2024-09-21 03:40:19.367315513 +0000 UTC m=+0.150991458 container create da1787d847c2b86071092ddf0a2939173207350840ba2341eec3195318a62f78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T03:40:19.611 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:40:19 smithi172 podman[63526]: 2024-09-21 03:40:19.609336881 +0000 UTC m=+0.393012826 container init da1787d847c2b86071092ddf0a2939173207350840ba2341eec3195318a62f78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T03:40:19.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:19 smithi174 ceph-mon[34403]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:19.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:19 smithi084 ceph-mon[30941]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:19.901 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:40:19 smithi172 podman[63526]: 2024-09-21 03:40:19.612487441 +0000 UTC m=+0.396163384 container start da1787d847c2b86071092ddf0a2939173207350840ba2341eec3195318a62f78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T03:40:19.901 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:40:19 smithi172 ceph-mds[63545]: -- 172.21.15.172:0/1846205493 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564bf2dd3860 con 0x564bf6f7b600 2024-09-21T03:40:19.901 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:40:19 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-b[63541]: starting mds.b at 2024-09-21T03:40:19.901 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:40:19 smithi172 bash[63526]: da1787d847c2b86071092ddf0a2939173207350840ba2341eec3195318a62f78 2024-09-21T03:40:19.901 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:40:19 smithi172 systemd[1]: Started Ceph mds.b for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:40:20.861 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:40:21.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:20 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:21.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:20 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:21.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:20 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:21.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:20 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:21.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:20 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:21.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:20 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:40:21.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:20 smithi084 ceph-mon[30941]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:21.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:20 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] up:boot 2024-09-21T03:40:21.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:20 smithi084 ceph-mon[30941]: fsmap 12 up:standby 2024-09-21T03:40:21.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:20 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:40:21.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:20 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:21.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:20 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:21.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:20 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:21.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:20 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:21.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:20 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:21.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:20 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:21.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:20 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:40:21.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:20 smithi174 ceph-mon[34403]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:21.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:20 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] up:boot 2024-09-21T03:40:21.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:20 smithi174 ceph-mon[34403]: fsmap 12 up:standby 2024-09-21T03:40:21.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:20 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:40:21.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:20 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:21.129 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:21.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:20 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:21.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:20 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:21.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:20 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:21.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:20 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:21.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:20 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:21.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:20 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:40:21.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:20 smithi172 ceph-mon[34821]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:21.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:20 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] up:boot 2024-09-21T03:40:21.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:20 smithi172 ceph-mon[34821]: fsmap 12 up:standby 2024-09-21T03:40:21.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:20 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:40:21.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:20 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:21.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.632+0000 7fb216c6a640 1 -- 172.21.15.84:0/430223374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210103b80 msgr2=0x7fb210103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:21.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.632+0000 7fb216c6a640 1 --2- 172.21.15.84:0/430223374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210103b80 0x7fb210103f90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009900 tx=0x7fb20c02a410 comp rx=0 tx=0).stop 2024-09-21T03:40:21.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.632+0000 7fb216c6a640 1 -- 172.21.15.84:0/430223374 shutdown_connections 2024-09-21T03:40:21.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.632+0000 7fb216c6a640 1 --2- 172.21.15.84:0/430223374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb210109e10 0x7fb210110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:21.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.632+0000 7fb216c6a640 1 --2- 172.21.15.84:0/430223374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2101094c0 0x7fb2101098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:21.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.632+0000 7fb216c6a640 1 --2- 172.21.15.84:0/430223374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210103b80 0x7fb210103f90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:21.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.632+0000 7fb216c6a640 1 -- 172.21.15.84:0/430223374 >> 172.21.15.84:0/430223374 conn(0x7fb2100ff590 msgr2=0x7fb2101019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:21.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.632+0000 7fb216c6a640 1 -- 172.21.15.84:0/430223374 shutdown_connections 2024-09-21T03:40:21.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.632+0000 7fb216c6a640 1 -- 172.21.15.84:0/430223374 wait complete. 2024-09-21T03:40:21.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.632+0000 7fb216c6a640 1 Processor -- start 2024-09-21T03:40:21.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.632+0000 7fb216c6a640 1 -- start start 2024-09-21T03:40:21.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb216c6a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb210103b80 0x7fb21019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:21.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb216c6a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2101094c0 0x7fb21019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:21.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb216c6a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210109e10 0x7fb21019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:21.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb216c6a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb210113ad0 con 0x7fb210109e10 2024-09-21T03:40:21.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb216c6a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb210113950 con 0x7fb210103b80 2024-09-21T03:40:21.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb216c6a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb210113c50 con 0x7fb2101094c0 2024-09-21T03:40:21.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb215207640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210109e10 0x7fb21019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:21.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb215207640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210109e10 0x7fb21019fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34544/0 (socket says 172.21.15.84:34544) 2024-09-21T03:40:21.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb215207640 1 -- 172.21.15.84:0/1274472164 learned_addr learned my addr 172.21.15.84:0/1274472164 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:21.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb207fff640 1 --2- 172.21.15.84:0/1274472164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2101094c0 0x7fb21019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:21.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb214a06640 1 --2- 172.21.15.84:0/1274472164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb210103b80 0x7fb21019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:21.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb215207640 1 -- 172.21.15.84:0/1274472164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2101094c0 msgr2=0x7fb21019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:21.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb215207640 1 --2- 172.21.15.84:0/1274472164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2101094c0 0x7fb21019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:21.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb215207640 1 -- 172.21.15.84:0/1274472164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb210103b80 msgr2=0x7fb21019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:21.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb215207640 1 --2- 172.21.15.84:0/1274472164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb210103b80 0x7fb21019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:21.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb215207640 1 -- 172.21.15.84:0/1274472164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2101a0430 con 0x7fb210109e10 2024-09-21T03:40:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb215207640 1 --2- 172.21.15.84:0/1274472164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210109e10 0x7fb21019fd00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb20800eaa0 tx=0x7fb20800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb205ffb640 1 -- 172.21.15.84:0/1274472164 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20800cdb0 con 0x7fb210109e10 2024-09-21T03:40:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb205ffb640 1 -- 172.21.15.84:0/1274472164 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb208005020 con 0x7fb210109e10 2024-09-21T03:40:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb205ffb640 1 -- 172.21.15.84:0/1274472164 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2080116d0 con 0x7fb210109e10 2024-09-21T03:40:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.633+0000 7fb216c6a640 1 -- 172.21.15.84:0/1274472164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2101a0720 con 0x7fb210109e10 2024-09-21T03:40:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.634+0000 7fb216c6a640 1 -- 172.21.15.84:0/1274472164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2101a6e80 con 0x7fb210109e10 2024-09-21T03:40:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.635+0000 7fb216c6a640 1 -- 172.21.15.84:0/1274472164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb210103f90 con 0x7fb210109e10 2024-09-21T03:40:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.636+0000 7fb205ffb640 1 -- 172.21.15.84:0/1274472164 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fb2080051d0 con 0x7fb210109e10 2024-09-21T03:40:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.637+0000 7fb205ffb640 1 --2- 172.21.15.84:0/1274472164 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb1f80b65e0 0x7fb1f80b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.637+0000 7fb214a06640 1 --2- 172.21.15.84:0/1274472164 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb1f80b65e0 0x7fb1f80b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.637+0000 7fb205ffb640 1 -- 172.21.15.84:0/1274472164 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fb2080e7350 con 0x7fb210109e10 2024-09-21T03:40:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.637+0000 7fb214a06640 1 --2- 172.21.15.84:0/1274472164 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb1f80b65e0 0x7fb1f80b8af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb20c031440 tx=0x7fb20c009560 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:21.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.640+0000 7fb205ffb640 1 -- 172.21.15.84:0/1274472164 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb208016030 con 0x7fb210109e10 2024-09-21T03:40:21.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.867+0000 7fb216c6a640 1 -- 172.21.15.84:0/1274472164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb21019b5f0 con 0x7fb210109e10 2024-09-21T03:40:21.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.868+0000 7fb205ffb640 1 -- 172.21.15.84:0/1274472164 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10530 (secure 0 0 0) 0x7fb21019b5f0 con 0x7fb210109e10 2024-09-21T03:40:21.871 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:40:21.871 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":13,"btime":"2024-09-21T03:40:20:342800+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24607,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24614,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24634,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24638,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24668,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T03:40:21.871 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 13 2024-09-21T03:40:21.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.870+0000 7fb216c6a640 1 -- 172.21.15.84:0/1274472164 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb1f80b65e0 msgr2=0x7fb1f80b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:21.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.870+0000 7fb216c6a640 1 --2- 172.21.15.84:0/1274472164 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb1f80b65e0 0x7fb1f80b8af0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb20c031440 tx=0x7fb20c009560 comp rx=0 tx=0).stop 2024-09-21T03:40:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.870+0000 7fb216c6a640 1 -- 172.21.15.84:0/1274472164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210109e10 msgr2=0x7fb21019fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.870+0000 7fb216c6a640 1 --2- 172.21.15.84:0/1274472164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210109e10 0x7fb21019fd00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb20800eaa0 tx=0x7fb20800ef60 comp rx=0 tx=0).stop 2024-09-21T03:40:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.871+0000 7fb216c6a640 1 -- 172.21.15.84:0/1274472164 shutdown_connections 2024-09-21T03:40:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.871+0000 7fb216c6a640 1 --2- 172.21.15.84:0/1274472164 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb1f80b65e0 0x7fb1f80b8af0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.871+0000 7fb216c6a640 1 --2- 172.21.15.84:0/1274472164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb210109e10 0x7fb21019fd00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.871+0000 7fb216c6a640 1 --2- 172.21.15.84:0/1274472164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2101094c0 0x7fb21019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.871+0000 7fb216c6a640 1 --2- 172.21.15.84:0/1274472164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb210103b80 0x7fb21019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.871+0000 7fb216c6a640 1 -- 172.21.15.84:0/1274472164 >> 172.21.15.84:0/1274472164 conn(0x7fb2100ff590 msgr2=0x7fb210102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.871+0000 7fb216c6a640 1 -- 172.21.15.84:0/1274472164 shutdown_connections 2024-09-21T03:40:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:21.871+0000 7fb216c6a640 1 -- 172.21.15.84:0/1274472164 wait complete. 2024-09-21T03:40:22.533 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.533 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.533 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.533 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.533 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.533 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.533 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:22.534 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:40:22.534 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.534 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:22 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:40:22.534 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:22 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1274472164' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:22.560 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T03:40:22.570 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.571 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.571 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.571 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.571 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.571 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.571 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:22.571 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:40:22.571 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.571 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:22 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:40:22.571 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:22 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1274472164' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:22.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.577 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:22.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:40:22.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:22.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:22 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:40:22.578 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:22 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1274472164' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:23.452 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:23 smithi084 ceph-mon[30941]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:23 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:23.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:23 smithi174 ceph-mon[34403]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:23.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:23.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:23.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:23.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:23 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:23 smithi172 ceph-mon[34821]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:23 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:23.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.977+0000 7f5548f3d640 1 -- 172.21.15.84:0/2603402319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5544105ae0 msgr2=0x7f554410f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:23.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.977+0000 7f5548f3d640 1 --2- 172.21.15.84:0/2603402319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5544105ae0 0x7f554410f530 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f553c009ca0 tx=0x7f553c02a8e0 comp rx=0 tx=0).stop 2024-09-21T03:40:23.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.978+0000 7f5548f3d640 1 -- 172.21.15.84:0/2603402319 shutdown_connections 2024-09-21T03:40:23.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.978+0000 7f5548f3d640 1 --2- 172.21.15.84:0/2603402319 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5544105ae0 0x7f554410f530 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:23.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.978+0000 7f5548f3d640 1 --2- 172.21.15.84:0/2603402319 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5544105190 0x7f55441055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:23.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.978+0000 7f5548f3d640 1 --2- 172.21.15.84:0/2603402319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55441031c0 0x7f55441035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:23.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.978+0000 7f5548f3d640 1 -- 172.21.15.84:0/2603402319 >> 172.21.15.84:0/2603402319 conn(0x7f5544077c60 msgr2=0x7f55440780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:23.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.978+0000 7f5548f3d640 1 -- 172.21.15.84:0/2603402319 shutdown_connections 2024-09-21T03:40:23.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.978+0000 7f5548f3d640 1 -- 172.21.15.84:0/2603402319 wait complete. 2024-09-21T03:40:23.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.979+0000 7f5548f3d640 1 Processor -- start 2024-09-21T03:40:23.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.979+0000 7f5548f3d640 1 -- start start 2024-09-21T03:40:23.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.979+0000 7f5548f3d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55441031c0 0x7f554419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:23.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.979+0000 7f5548f3d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5544105190 0x7f554419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:23.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.979+0000 7f5548f3d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5544105ae0 0x7f554419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:23.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.979+0000 7f5548f3d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5544112a50 con 0x7f5544105ae0 2024-09-21T03:40:23.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.979+0000 7f5548f3d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f55441128d0 con 0x7f55441031c0 2024-09-21T03:40:23.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.979+0000 7f5548f3d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5544112bd0 con 0x7f5544105190 2024-09-21T03:40:23.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.979+0000 7f5542d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5544105ae0 0x7f554419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:23.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.979+0000 7f5542d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5544105ae0 0x7f554419fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34556/0 (socket says 172.21.15.84:34556) 2024-09-21T03:40:23.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.979+0000 7f5542d9d640 1 -- 172.21.15.84:0/1159815193 learned_addr learned my addr 172.21.15.84:0/1159815193 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:23.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.979+0000 7f5541d9b640 1 --2- 172.21.15.84:0/1159815193 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5544105190 0x7f554419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:23.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.979+0000 7f554259c640 1 --2- 172.21.15.84:0/1159815193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55441031c0 0x7f554419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:23.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.979+0000 7f5542d9d640 1 -- 172.21.15.84:0/1159815193 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5544105190 msgr2=0x7f554419aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:23.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.979+0000 7f5542d9d640 1 --2- 172.21.15.84:0/1159815193 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5544105190 0x7f554419aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:23.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.979+0000 7f5542d9d640 1 -- 172.21.15.84:0/1159815193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55441031c0 msgr2=0x7f554419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:23.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.979+0000 7f5542d9d640 1 --2- 172.21.15.84:0/1159815193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55441031c0 0x7f554419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:23.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.979+0000 7f5542d9d640 1 -- 172.21.15.84:0/1159815193 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55441a0440 con 0x7f5544105ae0 2024-09-21T03:40:23.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.980+0000 7f5542d9d640 1 --2- 172.21.15.84:0/1159815193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5544105ae0 0x7f554419fd10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f553c003bd0 tx=0x7f553c003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:23.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.980+0000 7f55337fe640 1 -- 172.21.15.84:0/1159815193 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c004240 con 0x7f5544105ae0 2024-09-21T03:40:23.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.980+0000 7f5548f3d640 1 -- 172.21.15.84:0/1159815193 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55441a06d0 con 0x7f5544105ae0 2024-09-21T03:40:23.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.980+0000 7f55337fe640 1 -- 172.21.15.84:0/1159815193 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f553c003e20 con 0x7f5544105ae0 2024-09-21T03:40:23.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.980+0000 7f55337fe640 1 -- 172.21.15.84:0/1159815193 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c03a400 con 0x7f5544105ae0 2024-09-21T03:40:23.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.981+0000 7f5548f3d640 1 -- 172.21.15.84:0/1159815193 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55441a6e90 con 0x7f5544105ae0 2024-09-21T03:40:23.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.982+0000 7f5548f3d640 1 -- 172.21.15.84:0/1159815193 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f554419b600 con 0x7f5544105ae0 2024-09-21T03:40:23.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.983+0000 7f55337fe640 1 -- 172.21.15.84:0/1159815193 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f553c030700 con 0x7f5544105ae0 2024-09-21T03:40:23.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.983+0000 7f55337fe640 1 --2- 172.21.15.84:0/1159815193 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f552c0b6560 0x7f552c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:23.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.984+0000 7f554259c640 1 --2- 172.21.15.84:0/1159815193 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f552c0b6560 0x7f552c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:23.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.984+0000 7f55337fe640 1 -- 172.21.15.84:0/1159815193 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f553c108300 con 0x7f5544105ae0 2024-09-21T03:40:23.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.984+0000 7f554259c640 1 --2- 172.21.15.84:0/1159815193 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f552c0b6560 0x7f552c0b8a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5534006fd0 tx=0x7f55340090e0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:23.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:23.988+0000 7f55337fe640 1 -- 172.21.15.84:0/1159815193 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f553c0cef40 con 0x7f5544105ae0 2024-09-21T03:40:24.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:24.189+0000 7f5548f3d640 1 -- 172.21.15.84:0/1159815193 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f554402e640 con 0x7f5544105ae0 2024-09-21T03:40:24.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:24.190+0000 7f55337fe640 1 -- 172.21.15.84:0/1159815193 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) ==== 84+0+65 (secure 0 0 0) 0x7f553c0d3320 con 0x7f5544105ae0 2024-09-21T03:40:24.193 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:40:24.193 INFO:teuthology.orchestra.run.smithi084.stdout:[ 2024-09-21T03:40:24.193 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:40:24.193 INFO:teuthology.orchestra.run.smithi084.stdout: "poolnum": 1, 2024-09-21T03:40:24.194 INFO:teuthology.orchestra.run.smithi084.stdout: "poolname": ".mgr" 2024-09-21T03:40:24.194 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:40:24.194 INFO:teuthology.orchestra.run.smithi084.stdout:] 2024-09-21T03:40:24.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:24.193+0000 7f5548f3d640 1 -- 172.21.15.84:0/1159815193 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f552c0b6560 msgr2=0x7f552c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:24.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:24.193+0000 7f5548f3d640 1 --2- 172.21.15.84:0/1159815193 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f552c0b6560 0x7f552c0b8a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5534006fd0 tx=0x7f55340090e0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:24.193+0000 7f5548f3d640 1 -- 172.21.15.84:0/1159815193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5544105ae0 msgr2=0x7f554419fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:24.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:24.193+0000 7f5548f3d640 1 --2- 172.21.15.84:0/1159815193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5544105ae0 0x7f554419fd10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f553c003bd0 tx=0x7f553c003c00 comp rx=0 tx=0).stop 2024-09-21T03:40:24.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:24.193+0000 7f5548f3d640 1 -- 172.21.15.84:0/1159815193 shutdown_connections 2024-09-21T03:40:24.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:24.193+0000 7f5548f3d640 1 --2- 172.21.15.84:0/1159815193 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f552c0b6560 0x7f552c0b8a70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:24.193+0000 7f5548f3d640 1 --2- 172.21.15.84:0/1159815193 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5544105ae0 0x7f554419fd10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:24.193+0000 7f5548f3d640 1 --2- 172.21.15.84:0/1159815193 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5544105190 0x7f554419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:24.193+0000 7f5548f3d640 1 --2- 172.21.15.84:0/1159815193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f55441031c0 0x7f554419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:24.193+0000 7f5548f3d640 1 -- 172.21.15.84:0/1159815193 >> 172.21.15.84:0/1159815193 conn(0x7f5544077c60 msgr2=0x7f55441064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:24.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:24.193+0000 7f5548f3d640 1 -- 172.21.15.84:0/1159815193 shutdown_connections 2024-09-21T03:40:24.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:24.193+0000 7f5548f3d640 1 -- 172.21.15.84:0/1159815193 wait complete. 2024-09-21T03:40:24.462 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:24 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1159815193' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T03:40:24.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:24 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1159815193' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T03:40:24.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:24 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1159815193' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T03:40:24.930 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T03:40:24.930 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T03:40:25.192 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:25.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:25 smithi084 ceph-mon[30941]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:25.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:25 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:25.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:25 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:25.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:25 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:25.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:25 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:40:25.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:25 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:25.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:25 smithi174 ceph-mon[34403]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:25.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:25 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:25.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:25 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:25.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:25 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:25.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:25 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:40:25.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:25 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:25.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:25 smithi172 ceph-mon[34821]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:25.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:25 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:25.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:25 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:25.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:25 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:25.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:25 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:40:25.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:25 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:40:25.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.739+0000 7f629f552640 1 -- 172.21.15.84:0/2569049897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6298109df0 msgr2=0x7f6298110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:25.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.739+0000 7f629f552640 1 --2- 172.21.15.84:0/2569049897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6298109df0 0x7f6298110620 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6290009ca0 tx=0x7f629002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:40:25.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.739+0000 7f629f552640 1 -- 172.21.15.84:0/2569049897 shutdown_connections 2024-09-21T03:40:25.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.739+0000 7f629f552640 1 --2- 172.21.15.84:0/2569049897 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6298109df0 0x7f6298110620 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:25.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.739+0000 7f629f552640 1 --2- 172.21.15.84:0/2569049897 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f62981094a0 0x7f62981098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:25.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.739+0000 7f629f552640 1 --2- 172.21.15.84:0/2569049897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6298103b60 0x7f6298103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:25.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.739+0000 7f629f552640 1 -- 172.21.15.84:0/2569049897 >> 172.21.15.84:0/2569049897 conn(0x7f629807b850 msgr2=0x7f629807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:25.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.739+0000 7f629f552640 1 -- 172.21.15.84:0/2569049897 shutdown_connections 2024-09-21T03:40:25.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.739+0000 7f629f552640 1 -- 172.21.15.84:0/2569049897 wait complete. 2024-09-21T03:40:25.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.740+0000 7f629f552640 1 Processor -- start 2024-09-21T03:40:25.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.740+0000 7f629f552640 1 -- start start 2024-09-21T03:40:25.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.740+0000 7f629f552640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6298103b60 0x7f629819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:25.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.740+0000 7f629f552640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62981094a0 0x7f629819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:25.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.740+0000 7f629f552640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6298109df0 0x7f629819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:25.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.740+0000 7f629f552640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6298113ab0 con 0x7f6298103b60 2024-09-21T03:40:25.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.740+0000 7f629f552640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6298113930 con 0x7f62981094a0 2024-09-21T03:40:25.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.740+0000 7f629f552640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6298113c30 con 0x7f6298109df0 2024-09-21T03:40:25.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.740+0000 7f629d2ee640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6298103b60 0x7f629819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:25.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.740+0000 7f629d2ee640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6298103b60 0x7f629819a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34572/0 (socket says 172.21.15.84:34572) 2024-09-21T03:40:25.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.740+0000 7f629d2ee640 1 -- 172.21.15.84:0/3536027866 learned_addr learned my addr 172.21.15.84:0/3536027866 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:25.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.741+0000 7f629daef640 1 --2- 172.21.15.84:0/3536027866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6298109df0 0x7f629819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:25.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.741+0000 7f629caed640 1 --2- 172.21.15.84:0/3536027866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62981094a0 0x7f629819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:25.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.741+0000 7f629d2ee640 1 -- 172.21.15.84:0/3536027866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6298109df0 msgr2=0x7f629819fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:25.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.741+0000 7f629d2ee640 1 --2- 172.21.15.84:0/3536027866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6298109df0 0x7f629819fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:25.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.741+0000 7f629d2ee640 1 -- 172.21.15.84:0/3536027866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62981094a0 msgr2=0x7f629819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:25.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.741+0000 7f629d2ee640 1 --2- 172.21.15.84:0/3536027866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62981094a0 0x7f629819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:25.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.741+0000 7f629d2ee640 1 -- 172.21.15.84:0/3536027866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62981a03d0 con 0x7f6298103b60 2024-09-21T03:40:25.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.741+0000 7f629caed640 1 --2- 172.21.15.84:0/3536027866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62981094a0 0x7f629819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:40:25.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.741+0000 7f629d2ee640 1 --2- 172.21.15.84:0/3536027866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6298103b60 0x7f629819a460 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f628c00d950 tx=0x7f628c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:25.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.741+0000 7f628a7fc640 1 -- 172.21.15.84:0/3536027866 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c017070 con 0x7f6298103b60 2024-09-21T03:40:25.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.741+0000 7f629f552640 1 -- 172.21.15.84:0/3536027866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62981a06c0 con 0x7f6298103b60 2024-09-21T03:40:25.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.741+0000 7f628a7fc640 1 -- 172.21.15.84:0/3536027866 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f628c009c30 con 0x7f6298103b60 2024-09-21T03:40:25.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.741+0000 7f628a7fc640 1 -- 172.21.15.84:0/3536027866 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c00f620 con 0x7f6298103b60 2024-09-21T03:40:25.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.741+0000 7f629f552640 1 -- 172.21.15.84:0/3536027866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62981a6e20 con 0x7f6298103b60 2024-09-21T03:40:25.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.742+0000 7f629f552640 1 -- 172.21.15.84:0/3536027866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6298103f70 con 0x7f6298103b60 2024-09-21T03:40:25.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.745+0000 7f628a7fc640 1 -- 172.21.15.84:0/3536027866 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f628c005030 con 0x7f6298103b60 2024-09-21T03:40:25.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.745+0000 7f628a7fc640 1 --2- 172.21.15.84:0/3536027866 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f62840b6560 0x7f62840b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:25.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.745+0000 7f629caed640 1 --2- 172.21.15.84:0/3536027866 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f62840b6560 0x7f62840b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:25.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.745+0000 7f628a7fc640 1 -- 172.21.15.84:0/3536027866 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f628c0e6b90 con 0x7f6298103b60 2024-09-21T03:40:25.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.746+0000 7f629caed640 1 --2- 172.21.15.84:0/3536027866 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f62840b6560 0x7f62840b8a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6294005fd0 tx=0x7f6294005ea0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:25.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.749+0000 7f628a7fc640 1 -- 172.21.15.84:0/3536027866 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f628c0ad7f0 con 0x7f6298103b60 2024-09-21T03:40:25.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:25.928+0000 7f629f552640 1 -- 172.21.15.84:0/3536027866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f629819b590 con 0x7f6298103b60 2024-09-21T03:40:26.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:26.295+0000 7f628a7fc640 1 -- 172.21.15.84:0/3536027866 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) ==== 138+0+0 (secure 0 0 0) 0x7f629819b590 con 0x7f6298103b60 2024-09-21T03:40:26.298 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' created 2024-09-21T03:40:26.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:26.297+0000 7f629f552640 1 -- 172.21.15.84:0/3536027866 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f62840b6560 msgr2=0x7f62840b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:26.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:26.297+0000 7f629f552640 1 --2- 172.21.15.84:0/3536027866 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f62840b6560 0x7f62840b8a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6294005fd0 tx=0x7f6294005ea0 comp rx=0 tx=0).stop 2024-09-21T03:40:26.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:26.297+0000 7f629f552640 1 -- 172.21.15.84:0/3536027866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6298103b60 msgr2=0x7f629819a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:26.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:26.297+0000 7f629f552640 1 --2- 172.21.15.84:0/3536027866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6298103b60 0x7f629819a460 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f628c00d950 tx=0x7f628c00de10 comp rx=0 tx=0).stop 2024-09-21T03:40:26.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:26.297+0000 7f629f552640 1 -- 172.21.15.84:0/3536027866 shutdown_connections 2024-09-21T03:40:26.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:26.297+0000 7f629f552640 1 --2- 172.21.15.84:0/3536027866 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f62840b6560 0x7f62840b8a70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:26.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:26.297+0000 7f629f552640 1 --2- 172.21.15.84:0/3536027866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6298109df0 0x7f629819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:26.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:26.297+0000 7f629f552640 1 --2- 172.21.15.84:0/3536027866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62981094a0 0x7f629819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:26.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:26.297+0000 7f629f552640 1 --2- 172.21.15.84:0/3536027866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6298103b60 0x7f629819a460 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:26.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:26.297+0000 7f629f552640 1 -- 172.21.15.84:0/3536027866 >> 172.21.15.84:0/3536027866 conn(0x7f629807b850 msgr2=0x7f62981074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:26.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:26.297+0000 7f629f552640 1 -- 172.21.15.84:0/3536027866 shutdown_connections 2024-09-21T03:40:26.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:26.297+0000 7f629f552640 1 -- 172.21.15.84:0/3536027866 wait complete. 2024-09-21T03:40:26.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:26 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3536027866' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T03:40:26.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:26 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3536027866' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T03:40:26.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:26 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3536027866' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T03:40:27.016 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T03:40:27.260 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:27.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:27 smithi084 ceph-mon[30941]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:27.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:27 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3536027866' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T03:40:27.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:27 smithi084 ceph-mon[30941]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T03:40:27.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:27 smithi174 ceph-mon[34403]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:27.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:27 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3536027866' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T03:40:27.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:27 smithi174 ceph-mon[34403]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T03:40:27.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:27 smithi172 ceph-mon[34821]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:27.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:27 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3536027866' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T03:40:27.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:27 smithi172 ceph-mon[34821]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T03:40:27.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.788+0000 7ff49142a640 1 -- 172.21.15.84:0/4185235502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff48c10de20 msgr2=0x7ff48c110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:27.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.788+0000 7ff49142a640 1 --2- 172.21.15.84:0/4185235502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff48c10de20 0x7ff48c110310 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff484009900 tx=0x7ff48402a410 comp rx=0 tx=0).stop 2024-09-21T03:40:27.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.788+0000 7ff49142a640 1 -- 172.21.15.84:0/4185235502 shutdown_connections 2024-09-21T03:40:27.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.788+0000 7ff49142a640 1 --2- 172.21.15.84:0/4185235502 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff48c10de20 0x7ff48c110310 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:27.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.788+0000 7ff49142a640 1 --2- 172.21.15.84:0/4185235502 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff48c105310 0x7ff48c10d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:27.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.788+0000 7ff49142a640 1 --2- 172.21.15.84:0/4185235502 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff48c1049c0 0x7ff48c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:27.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.788+0000 7ff49142a640 1 -- 172.21.15.84:0/4185235502 >> 172.21.15.84:0/4185235502 conn(0x7ff48c079730 msgr2=0x7ff48c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:27.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.788+0000 7ff49142a640 1 -- 172.21.15.84:0/4185235502 shutdown_connections 2024-09-21T03:40:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.788+0000 7ff49142a640 1 -- 172.21.15.84:0/4185235502 wait complete. 2024-09-21T03:40:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.788+0000 7ff49142a640 1 Processor -- start 2024-09-21T03:40:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.789+0000 7ff49142a640 1 -- start start 2024-09-21T03:40:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.789+0000 7ff49142a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff48c1049c0 0x7ff48c102700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.789+0000 7ff49142a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff48c105310 0x7ff48c102c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.789+0000 7ff49142a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff48c10de20 0x7ff48c103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.789+0000 7ff49142a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c113b80 con 0x7ff48c10de20 2024-09-21T03:40:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.789+0000 7ff49142a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c113a00 con 0x7ff48c1049c0 2024-09-21T03:40:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.789+0000 7ff49142a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c113d00 con 0x7ff48c105310 2024-09-21T03:40:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.789+0000 7ff48b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff48c10de20 0x7ff48c103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.789+0000 7ff48b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff48c10de20 0x7ff48c103180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34588/0 (socket says 172.21.15.84:34588) 2024-09-21T03:40:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.789+0000 7ff48b7fe640 1 -- 172.21.15.84:0/3568182328 learned_addr learned my addr 172.21.15.84:0/3568182328 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:27.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.789+0000 7ff48a7fc640 1 --2- 172.21.15.84:0/3568182328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff48c105310 0x7ff48c102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.789+0000 7ff48affd640 1 --2- 172.21.15.84:0/3568182328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff48c1049c0 0x7ff48c102700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.789+0000 7ff48b7fe640 1 -- 172.21.15.84:0/3568182328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff48c105310 msgr2=0x7ff48c102c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.789+0000 7ff48b7fe640 1 --2- 172.21.15.84:0/3568182328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff48c105310 0x7ff48c102c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.789+0000 7ff48b7fe640 1 -- 172.21.15.84:0/3568182328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff48c1049c0 msgr2=0x7ff48c102700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.789+0000 7ff48b7fe640 1 --2- 172.21.15.84:0/3568182328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff48c1049c0 0x7ff48c102700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.789+0000 7ff48b7fe640 1 -- 172.21.15.84:0/3568182328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c1a8890 con 0x7ff48c10de20 2024-09-21T03:40:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.789+0000 7ff48affd640 1 --2- 172.21.15.84:0/3568182328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff48c1049c0 0x7ff48c102700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:40:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.789+0000 7ff48b7fe640 1 --2- 172.21.15.84:0/3568182328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff48c10de20 0x7ff48c103180 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff484009a20 tx=0x7ff484004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.790+0000 7ff483fff640 1 -- 172.21.15.84:0/3568182328 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff48403f030 con 0x7ff48c10de20 2024-09-21T03:40:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.790+0000 7ff49142a640 1 -- 172.21.15.84:0/3568182328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff48c1a8b20 con 0x7ff48c10de20 2024-09-21T03:40:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.790+0000 7ff483fff640 1 -- 172.21.15.84:0/3568182328 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff484003aa0 con 0x7ff48c10de20 2024-09-21T03:40:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.790+0000 7ff483fff640 1 -- 172.21.15.84:0/3568182328 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff484035070 con 0x7ff48c10de20 2024-09-21T03:40:27.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.790+0000 7ff49142a640 1 -- 172.21.15.84:0/3568182328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff48c1a9050 con 0x7ff48c10de20 2024-09-21T03:40:27.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.791+0000 7ff49142a640 1 -- 172.21.15.84:0/3568182328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff48c06c1e0 con 0x7ff48c10de20 2024-09-21T03:40:27.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.793+0000 7ff483fff640 1 -- 172.21.15.84:0/3568182328 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7ff484042030 con 0x7ff48c10de20 2024-09-21T03:40:27.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.794+0000 7ff483fff640 1 --2- 172.21.15.84:0/3568182328 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff4780b65e0 0x7ff4780b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:27.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.794+0000 7ff48affd640 1 --2- 172.21.15.84:0/3568182328 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff4780b65e0 0x7ff4780b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:27.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.794+0000 7ff483fff640 1 -- 172.21.15.84:0/3568182328 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7712+0+0 (secure 0 0 0) 0x7ff484107af0 con 0x7ff48c10de20 2024-09-21T03:40:27.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.795+0000 7ff48affd640 1 --2- 172.21.15.84:0/3568182328 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff4780b65e0 0x7ff4780b8af0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff48c104150 tx=0x7ff47c009570 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:27.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.798+0000 7ff483fff640 1 -- 172.21.15.84:0/3568182328 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff4840ce5e0 con 0x7ff48c10de20 2024-09-21T03:40:27.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:27.976+0000 7ff49142a640 1 -- 172.21.15.84:0/3568182328 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ff48c108990 con 0x7ff48c10de20 2024-09-21T03:40:28.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:28.310+0000 7ff483fff640 1 -- 172.21.15.84:0/3568182328 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7ff4840d29c0 con 0x7ff48c10de20 2024-09-21T03:40:28.313 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' created 2024-09-21T03:40:28.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:28.314+0000 7ff49142a640 1 -- 172.21.15.84:0/3568182328 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff4780b65e0 msgr2=0x7ff4780b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:28.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:28.314+0000 7ff49142a640 1 --2- 172.21.15.84:0/3568182328 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff4780b65e0 0x7ff4780b8af0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff48c104150 tx=0x7ff47c009570 comp rx=0 tx=0).stop 2024-09-21T03:40:28.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:28.314+0000 7ff49142a640 1 -- 172.21.15.84:0/3568182328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff48c10de20 msgr2=0x7ff48c103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:28.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:28.314+0000 7ff49142a640 1 --2- 172.21.15.84:0/3568182328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff48c10de20 0x7ff48c103180 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff484009a20 tx=0x7ff484004270 comp rx=0 tx=0).stop 2024-09-21T03:40:28.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:28.314+0000 7ff49142a640 1 -- 172.21.15.84:0/3568182328 shutdown_connections 2024-09-21T03:40:28.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:28.314+0000 7ff49142a640 1 --2- 172.21.15.84:0/3568182328 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff4780b65e0 0x7ff4780b8af0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:28.314+0000 7ff49142a640 1 --2- 172.21.15.84:0/3568182328 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff48c10de20 0x7ff48c103180 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:28.314+0000 7ff49142a640 1 --2- 172.21.15.84:0/3568182328 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff48c105310 0x7ff48c102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:28.314+0000 7ff49142a640 1 --2- 172.21.15.84:0/3568182328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff48c1049c0 0x7ff48c102700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:28.314+0000 7ff49142a640 1 -- 172.21.15.84:0/3568182328 >> 172.21.15.84:0/3568182328 conn(0x7ff48c079730 msgr2=0x7ff48c100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:28.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:28.314+0000 7ff49142a640 1 -- 172.21.15.84:0/3568182328 shutdown_connections 2024-09-21T03:40:28.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:28.314+0000 7ff49142a640 1 -- 172.21.15.84:0/3568182328 wait complete. 2024-09-21T03:40:28.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:28 smithi084 ceph-mon[30941]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T03:40:28.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:28 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3568182328' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T03:40:28.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:28 smithi174 ceph-mon[34403]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T03:40:28.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:28 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3568182328' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T03:40:28.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:28 smithi172 ceph-mon[34821]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T03:40:28.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:28 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3568182328' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T03:40:28.975 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T03:40:29.220 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:29.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:29 smithi174 ceph-mon[34403]: pgmap v259: 33 pgs: 8 active+clean, 2 creating+activating, 11 creating+peering, 12 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:29.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:29 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3568182328' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T03:40:29.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:29 smithi174 ceph-mon[34403]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T03:40:29.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:29 smithi172 ceph-mon[34821]: pgmap v259: 33 pgs: 8 active+clean, 2 creating+activating, 11 creating+peering, 12 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:29.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:29 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3568182328' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T03:40:29.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:29 smithi172 ceph-mon[34821]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T03:40:29.661 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:29 smithi084 ceph-mon[30941]: pgmap v259: 33 pgs: 8 active+clean, 2 creating+activating, 11 creating+peering, 12 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:29.661 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:29 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3568182328' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T03:40:29.661 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:29 smithi084 ceph-mon[30941]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T03:40:29.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.751+0000 7fa095f2e640 1 -- 172.21.15.84:0/709550832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa090102ae0 msgr2=0x7fa090102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:29.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.751+0000 7fa095f2e640 1 --2- 172.21.15.84:0/709550832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa090102ae0 0x7fa090102ef0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa080009900 tx=0x7fa08002a410 comp rx=0 tx=0).stop 2024-09-21T03:40:29.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.751+0000 7fa095f2e640 1 -- 172.21.15.84:0/709550832 shutdown_connections 2024-09-21T03:40:29.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.751+0000 7fa095f2e640 1 --2- 172.21.15.84:0/709550832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa090108d70 0x7fa09010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.751+0000 7fa095f2e640 1 --2- 172.21.15.84:0/709550832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa090108420 0x7fa090108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.751+0000 7fa095f2e640 1 --2- 172.21.15.84:0/709550832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa090102ae0 0x7fa090102ef0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.751+0000 7fa095f2e640 1 -- 172.21.15.84:0/709550832 >> 172.21.15.84:0/709550832 conn(0x7fa0900796b0 msgr2=0x7fa090079ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:29.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.751+0000 7fa095f2e640 1 -- 172.21.15.84:0/709550832 shutdown_connections 2024-09-21T03:40:29.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.751+0000 7fa095f2e640 1 -- 172.21.15.84:0/709550832 wait complete. 2024-09-21T03:40:29.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.751+0000 7fa095f2e640 1 Processor -- start 2024-09-21T03:40:29.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.752+0000 7fa095f2e640 1 -- start start 2024-09-21T03:40:29.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.752+0000 7fa095f2e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa090102ae0 0x7fa09019a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.752+0000 7fa095f2e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa090108420 0x7fa09019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.752+0000 7fa095f2e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa090108d70 0x7fa09019fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.752+0000 7fa095f2e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa090112af0 con 0x7fa090108d70 2024-09-21T03:40:29.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.752+0000 7fa095f2e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa090112970 con 0x7fa090108420 2024-09-21T03:40:29.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.752+0000 7fa095f2e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa090112c70 con 0x7fa090102ae0 2024-09-21T03:40:29.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.752+0000 7fa08ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa090108d70 0x7fa09019fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.752+0000 7fa08ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa090108d70 0x7fa09019fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43348/0 (socket says 172.21.15.84:43348) 2024-09-21T03:40:29.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.752+0000 7fa08ffff640 1 -- 172.21.15.84:0/327937455 learned_addr learned my addr 172.21.15.84:0/327937455 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:29.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.752+0000 7fa08f7fe640 1 --2- 172.21.15.84:0/327937455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa090102ae0 0x7fa09019a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.752+0000 7fa08effd640 1 --2- 172.21.15.84:0/327937455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa090108420 0x7fa09019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.752+0000 7fa08ffff640 1 -- 172.21.15.84:0/327937455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa090102ae0 msgr2=0x7fa09019a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:29.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.752+0000 7fa08ffff640 1 --2- 172.21.15.84:0/327937455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa090102ae0 0x7fa09019a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.752+0000 7fa08ffff640 1 -- 172.21.15.84:0/327937455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa090108420 msgr2=0x7fa09019abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:29.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.752+0000 7fa08ffff640 1 --2- 172.21.15.84:0/327937455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa090108420 0x7fa09019abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.752+0000 7fa08ffff640 1 -- 172.21.15.84:0/327937455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0901a05a0 con 0x7fa090108d70 2024-09-21T03:40:29.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.752+0000 7fa08effd640 1 --2- 172.21.15.84:0/327937455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa090108420 0x7fa09019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:40:29.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.752+0000 7fa08ffff640 1 --2- 172.21.15.84:0/327937455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa090108d70 0x7fa09019fe70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa08800b970 tx=0x7fa08800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:29.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.753+0000 7fa08cff9640 1 -- 172.21.15.84:0/327937455 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa088019070 con 0x7fa090108d70 2024-09-21T03:40:29.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.753+0000 7fa08cff9640 1 -- 172.21.15.84:0/327937455 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa088014440 con 0x7fa090108d70 2024-09-21T03:40:29.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.753+0000 7fa08cff9640 1 -- 172.21.15.84:0/327937455 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0880075d0 con 0x7fa090108d70 2024-09-21T03:40:29.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.753+0000 7fa095f2e640 1 -- 172.21.15.84:0/327937455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0901a0890 con 0x7fa090108d70 2024-09-21T03:40:29.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.753+0000 7fa095f2e640 1 -- 172.21.15.84:0/327937455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0901a6ff0 con 0x7fa090108d70 2024-09-21T03:40:29.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.754+0000 7fa095f2e640 1 -- 172.21.15.84:0/327937455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa090103d60 con 0x7fa090108d70 2024-09-21T03:40:29.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.756+0000 7fa08cff9640 1 -- 172.21.15.84:0/327937455 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fa08801c070 con 0x7fa090108d70 2024-09-21T03:40:29.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.757+0000 7fa08cff9640 1 --2- 172.21.15.84:0/327937455 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa0780b65e0 0x7fa0780b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.757+0000 7fa08f7fe640 1 --2- 172.21.15.84:0/327937455 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa0780b65e0 0x7fa0780b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.757+0000 7fa08cff9640 1 -- 172.21.15.84:0/327937455 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8094+0+0 (secure 0 0 0) 0x7fa0880e6c20 con 0x7fa090108d70 2024-09-21T03:40:29.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.757+0000 7fa08f7fe640 1 --2- 172.21.15.84:0/327937455 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa0780b65e0 0x7fa0780b8af0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa080031440 tx=0x7fa080031c90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:29.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.760+0000 7fa08cff9640 1 -- 172.21.15.84:0/327937455 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa0880ad590 con 0x7fa090108d70 2024-09-21T03:40:29.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:29.978+0000 7fa095f2e640 1 -- 172.21.15.84:0/327937455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa090102ef0 con 0x7fa090108d70 2024-09-21T03:40:30.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:30.331+0000 7fa08cff9640 1 -- 172.21.15.84:0/327937455 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fa090102ef0 con 0x7fa090108d70 2024-09-21T03:40:30.333 INFO:teuthology.orchestra.run.smithi084.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T03:40:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:30.334+0000 7fa095f2e640 1 -- 172.21.15.84:0/327937455 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa0780b65e0 msgr2=0x7fa0780b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:30.334+0000 7fa095f2e640 1 --2- 172.21.15.84:0/327937455 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa0780b65e0 0x7fa0780b8af0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa080031440 tx=0x7fa080031c90 comp rx=0 tx=0).stop 2024-09-21T03:40:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:30.334+0000 7fa095f2e640 1 -- 172.21.15.84:0/327937455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa090108d70 msgr2=0x7fa09019fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:30.334+0000 7fa095f2e640 1 --2- 172.21.15.84:0/327937455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa090108d70 0x7fa09019fe70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa08800b970 tx=0x7fa08800be30 comp rx=0 tx=0).stop 2024-09-21T03:40:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:30.334+0000 7fa095f2e640 1 -- 172.21.15.84:0/327937455 shutdown_connections 2024-09-21T03:40:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:30.334+0000 7fa095f2e640 1 --2- 172.21.15.84:0/327937455 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa0780b65e0 0x7fa0780b8af0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:30.334+0000 7fa095f2e640 1 --2- 172.21.15.84:0/327937455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa090108d70 0x7fa09019fe70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:30.334+0000 7fa095f2e640 1 --2- 172.21.15.84:0/327937455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa090108420 0x7fa09019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:30.334+0000 7fa095f2e640 1 --2- 172.21.15.84:0/327937455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa090102ae0 0x7fa09019a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:30.334+0000 7fa095f2e640 1 -- 172.21.15.84:0/327937455 >> 172.21.15.84:0/327937455 conn(0x7fa0900796b0 msgr2=0x7fa090101bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:30.334+0000 7fa095f2e640 1 -- 172.21.15.84:0/327937455 shutdown_connections 2024-09-21T03:40:30.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:30.334+0000 7fa095f2e640 1 -- 172.21.15.84:0/327937455 wait complete. 2024-09-21T03:40:30.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:30 smithi174 ceph-mon[34403]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T03:40:30.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:30 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/327937455' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T03:40:30.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:30 smithi174 ceph-mon[34403]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T03:40:30.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:30 smithi172 ceph-mon[34821]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T03:40:30.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:30 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/327937455' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T03:40:30.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:30 smithi172 ceph-mon[34821]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T03:40:30.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:30 smithi084 ceph-mon[30941]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T03:40:30.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:30 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/327937455' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T03:40:30.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:30 smithi084 ceph-mon[30941]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T03:40:31.009 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:40:31.255 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:31.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:31 smithi174 ceph-mon[34403]: pgmap v262: 97 pgs: 44 active+clean, 3 creating+activating, 17 creating+peering, 33 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:31.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:31 smithi174 ceph-mon[34403]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T03:40:31.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:31 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/327937455' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T03:40:31.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:31 smithi174 ceph-mon[34403]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T03:40:31.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:31 smithi174 ceph-mon[34403]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T03:40:31.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:31 smithi172 ceph-mon[34821]: pgmap v262: 97 pgs: 44 active+clean, 3 creating+activating, 17 creating+peering, 33 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:31.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:31 smithi172 ceph-mon[34821]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T03:40:31.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:31 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/327937455' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T03:40:31.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:31 smithi172 ceph-mon[34821]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T03:40:31.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:31 smithi172 ceph-mon[34821]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T03:40:31.682 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:31 smithi084 ceph-mon[30941]: pgmap v262: 97 pgs: 44 active+clean, 3 creating+activating, 17 creating+peering, 33 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:40:31.682 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:31 smithi084 ceph-mon[30941]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T03:40:31.682 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:31 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/327937455' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T03:40:31.682 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:31 smithi084 ceph-mon[30941]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T03:40:31.682 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:31 smithi084 ceph-mon[30941]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T03:40:31.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.767+0000 7fefb7b10640 1 -- 172.21.15.84:0/713450905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb010de50 msgr2=0x7fefb0110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:31.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.767+0000 7fefb7b10640 1 --2- 172.21.15.84:0/713450905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb010de50 0x7fefb0110340 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fefa8009ca0 tx=0x7fefa802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.767+0000 7fefb7b10640 1 -- 172.21.15.84:0/713450905 shutdown_connections 2024-09-21T03:40:31.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.767+0000 7fefb7b10640 1 --2- 172.21.15.84:0/713450905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb010de50 0x7fefb0110340 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.767+0000 7fefb7b10640 1 --2- 172.21.15.84:0/713450905 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefb0105340 0x7fefb010d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.767+0000 7fefb7b10640 1 --2- 172.21.15.84:0/713450905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefb01049f0 0x7fefb0104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.768+0000 7fefb7b10640 1 -- 172.21.15.84:0/713450905 >> 172.21.15.84:0/713450905 conn(0x7fefb00797e0 msgr2=0x7fefb0079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:31.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.768+0000 7fefb7b10640 1 -- 172.21.15.84:0/713450905 shutdown_connections 2024-09-21T03:40:31.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.768+0000 7fefb7b10640 1 -- 172.21.15.84:0/713450905 wait complete. 2024-09-21T03:40:31.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.768+0000 7fefb7b10640 1 Processor -- start 2024-09-21T03:40:31.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.768+0000 7fefb7b10640 1 -- start start 2024-09-21T03:40:31.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.768+0000 7fefb7b10640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefb01049f0 0x7fefb019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefb7b10640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefb0105340 0x7fefb019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefb7b10640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb010de50 0x7fefb019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefb7b10640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fefb0113ad0 con 0x7fefb010de50 2024-09-21T03:40:31.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefb7b10640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fefb0113950 con 0x7fefb01049f0 2024-09-21T03:40:31.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefb7b10640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fefb0113c50 con 0x7fefb0105340 2024-09-21T03:40:31.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefb60ad640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb010de50 0x7fefb019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefb58ac640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefb01049f0 0x7fefb019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefb60ad640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb010de50 0x7fefb019fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43368/0 (socket says 172.21.15.84:43368) 2024-09-21T03:40:31.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefb60ad640 1 -- 172.21.15.84:0/2405168501 learned_addr learned my addr 172.21.15.84:0/2405168501 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:31.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefb50ab640 1 --2- 172.21.15.84:0/2405168501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefb0105340 0x7fefb019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefb60ad640 1 -- 172.21.15.84:0/2405168501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefb0105340 msgr2=0x7fefb019aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:31.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefb60ad640 1 --2- 172.21.15.84:0/2405168501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefb0105340 0x7fefb019aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefb60ad640 1 -- 172.21.15.84:0/2405168501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefb01049f0 msgr2=0x7fefb019a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:31.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefb60ad640 1 --2- 172.21.15.84:0/2405168501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefb01049f0 0x7fefb019a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefb60ad640 1 -- 172.21.15.84:0/2405168501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb01a0490 con 0x7fefb010de50 2024-09-21T03:40:31.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefb58ac640 1 --2- 172.21.15.84:0/2405168501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefb01049f0 0x7fefb019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:40:31.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefb60ad640 1 --2- 172.21.15.84:0/2405168501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb010de50 0x7fefb019fd60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fefa8005cc0 tx=0x7fefa802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:31.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefa6ffd640 1 -- 172.21.15.84:0/2405168501 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa8003bf0 con 0x7fefb010de50 2024-09-21T03:40:31.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefb7b10640 1 -- 172.21.15.84:0/2405168501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb01a0720 con 0x7fefb010de50 2024-09-21T03:40:31.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefa6ffd640 1 -- 172.21.15.84:0/2405168501 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefa8003d90 con 0x7fefb010de50 2024-09-21T03:40:31.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefa6ffd640 1 -- 172.21.15.84:0/2405168501 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa802fbc0 con 0x7fefb010de50 2024-09-21T03:40:31.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.769+0000 7fefb7b10640 1 -- 172.21.15.84:0/2405168501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb01a6ee0 con 0x7fefb010de50 2024-09-21T03:40:31.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.771+0000 7fefb7b10640 1 -- 172.21.15.84:0/2405168501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefb006bf20 con 0x7fefb010de50 2024-09-21T03:40:31.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.772+0000 7fefa6ffd640 1 -- 172.21.15.84:0/2405168501 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fefa802fd60 con 0x7fefb010de50 2024-09-21T03:40:31.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.772+0000 7fefa6ffd640 1 --2- 172.21.15.84:0/2405168501 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fef9c0b6560 0x7fef9c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.773+0000 7fefb58ac640 1 --2- 172.21.15.84:0/2405168501 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fef9c0b6560 0x7fef9c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.773+0000 7fefa6ffd640 1 -- 172.21.15.84:0/2405168501 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fefa8108820 con 0x7fefb010de50 2024-09-21T03:40:31.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.773+0000 7fefb58ac640 1 --2- 172.21.15.84:0/2405168501 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fef9c0b6560 0x7fef9c0b8a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fefb006c620 tx=0x7fefac00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:31.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.777+0000 7fefa6ffd640 1 -- 172.21.15.84:0/2405168501 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fefa80cf0d0 con 0x7fefb010de50 2024-09-21T03:40:31.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.954+0000 7fefb7b10640 1 -- 172.21.15.84:0/2405168501 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fefb01a70b0 con 0x7fefb010de50 2024-09-21T03:40:31.958 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.955+0000 7fefa6ffd640 1 -- 172.21.15.84:0/2405168501 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22632 (secure 0 0 0) 0x7fefa80098b0 con 0x7fefb010de50 2024-09-21T03:40:31.958 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:40:31.958 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":75,"fsid":"e3f8c18e-77c9-11ef-baf5-efdc52797490","created":"2024-09-21T03:31:55.307035+0000","modified":"2024-09-21T03:40:29.979785+0000","last_up_change":"2024-09-21T03:39:38.786385+0000","last_in_change":"2024-09-21T03:39:15.267368+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:35:50.488653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:40:25.934375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:40:27.981681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d283ba0-18f3-4668-90c4-884e9e957a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6803","nonce":508132562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6805","nonce":508132562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6809","nonce":508132562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6807","nonce":508132562}]},"public_addr":"172.21.15.84:6803/508132562","cluster_addr":"172.21.15.84:6805/508132562","heartbeat_back_addr":"172.21.15.84:6809/508132562","heartbeat_front_addr":"172.21.15.84:6807/508132562","state":["exists","up"]},{"osd":1,"uuid":"f115c5b6-812d-430f-9f0e-cb5311b7581e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6801","nonce":2931872350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6803","nonce":2931872350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6807","nonce":2931872350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6805","nonce":2931872350}]},"public_addr":"172.21.15.172:6801/2931872350","cluster_addr":"172.21.15.172:6803/2931872350","heartbeat_back_addr":"172.21.15.172:6807/2931872350","heartbeat_front_addr":"172.21.15.172:6805/2931872350","state":["exists","up"]},{"osd":2,"uuid":"36489240-e233-4aa7-ae9c-089d76683172","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6801","nonce":1847612335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6803","nonce":1847612335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6807","nonce":1847612335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6805","nonce":1847612335}]},"public_addr":"172.21.15.174:6801/1847612335","cluster_addr":"172.21.15.174:6803/1847612335","heartbeat_back_addr":"172.21.15.174:6807/1847612335","heartbeat_front_addr":"172.21.15.174:6805/1847612335","state":["exists","up"]},{"osd":3,"uuid":"1f35b404-b658-4e94-a5f4-74a6431a6a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6811","nonce":2230529863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6813","nonce":2230529863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6817","nonce":2230529863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6815","nonce":2230529863}]},"public_addr":"172.21.15.84:6811/2230529863","cluster_addr":"172.21.15.84:6813/2230529863","heartbeat_back_addr":"172.21.15.84:6817/2230529863","heartbeat_front_addr":"172.21.15.84:6815/2230529863","state":["exists","up"]},{"osd":4,"uuid":"91a2f83b-4c7d-4661-86a1-63a09888939d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6809","nonce":3069862739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6811","nonce":3069862739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6815","nonce":3069862739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6813","nonce":3069862739}]},"public_addr":"172.21.15.172:6809/3069862739","cluster_addr":"172.21.15.172:6811/3069862739","heartbeat_back_addr":"172.21.15.172:6815/3069862739","heartbeat_front_addr":"172.21.15.172:6813/3069862739","state":["exists","up"]},{"osd":5,"uuid":"e8f06b34-3956-499f-8073-09011cf1ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6809","nonce":1987010600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6811","nonce":1987010600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6815","nonce":1987010600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6813","nonce":1987010600}]},"public_addr":"172.21.15.174:6809/1987010600","cluster_addr":"172.21.15.174:6811/1987010600","heartbeat_back_addr":"172.21.15.174:6815/1987010600","heartbeat_front_addr":"172.21.15.174:6813/1987010600","state":["exists","up"]},{"osd":6,"uuid":"23d55e96-4987-4cbe-8c6b-cece4de9269b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6819","nonce":3418459345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6821","nonce":3418459345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6825","nonce":3418459345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6823","nonce":3418459345}]},"public_addr":"172.21.15.84:6819/3418459345","cluster_addr":"172.21.15.84:6821/3418459345","heartbeat_back_addr":"172.21.15.84:6825/3418459345","heartbeat_front_addr":"172.21.15.84:6823/3418459345","state":["exists","up"]},{"osd":7,"uuid":"ca91a34c-d8b1-48b8-93f4-72a5c15939d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6817","nonce":4056019738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6819","nonce":4056019738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6823","nonce":4056019738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6821","nonce":4056019738}]},"public_addr":"172.21.15.172:6817/4056019738","cluster_addr":"172.21.15.172:6819/4056019738","heartbeat_back_addr":"172.21.15.172:6823/4056019738","heartbeat_front_addr":"172.21.15.172:6821/4056019738","state":["exists","up"]},{"osd":8,"uuid":"37da8c61-d72f-4b58-b10c-7c7539ecffd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6817","nonce":2162992546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6819","nonce":2162992546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6823","nonce":2162992546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6821","nonce":2162992546}]},"public_addr":"172.21.15.174:6817/2162992546","cluster_addr":"172.21.15.174:6819/2162992546","heartbeat_back_addr":"172.21.15.174:6823/2162992546","heartbeat_front_addr":"172.21.15.174:6821/2162992546","state":["exists","up"]},{"osd":9,"uuid":"c9179f33-622d-44bd-9d8a-c92951afb1e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6827","nonce":3230873673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6829","nonce":3230873673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6833","nonce":3230873673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6831","nonce":3230873673}]},"public_addr":"172.21.15.84:6827/3230873673","cluster_addr":"172.21.15.84:6829/3230873673","heartbeat_back_addr":"172.21.15.84:6833/3230873673","heartbeat_front_addr":"172.21.15.84:6831/3230873673","state":["exists","up"]},{"osd":10,"uuid":"9788fa2d-49fb-431b-a0e3-62d6e421e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6825","nonce":2667099391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6827","nonce":2667099391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6831","nonce":2667099391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6829","nonce":2667099391}]},"public_addr":"172.21.15.172:6825/2667099391","cluster_addr":"172.21.15.172:6827/2667099391","heartbeat_back_addr":"172.21.15.172:6831/2667099391","heartbeat_front_addr":"172.21.15.172:6829/2667099391","state":["exists","up"]},{"osd":11,"uuid":"a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6825","nonce":3452825924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6827","nonce":3452825924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6831","nonce":3452825924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6829","nonce":3452825924}]},"public_addr":"172.21.15.174:6825/3452825924","cluster_addr":"172.21.15.174:6827/3452825924","heartbeat_back_addr":"172.21.15.174:6831/3452825924","heartbeat_front_addr":"172.21.15.174:6829/3452825924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:34:57.413946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:22.813846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:47.074625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:12.871112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:38.705563+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:04.277966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:29.661290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:55.475432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:20.644247+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:46.151594+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:11.499623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:36.688459+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6800/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3308084314":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3663660709":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/1794153935":"2024-09-22T03:32:49.459372+0000","172.21.15.84:6800/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6800/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1874814897":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6801/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/390051797":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/2148206075":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1916019809":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6801/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3491731835":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3418048965":"2024-09-22T03:33:50.188998+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:40:31.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.958+0000 7fefb7b10640 1 -- 172.21.15.84:0/2405168501 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fef9c0b6560 msgr2=0x7fef9c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:31.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.958+0000 7fefb7b10640 1 --2- 172.21.15.84:0/2405168501 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fef9c0b6560 0x7fef9c0b8a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fefb006c620 tx=0x7fefac00b390 comp rx=0 tx=0).stop 2024-09-21T03:40:31.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.958+0000 7fefb7b10640 1 -- 172.21.15.84:0/2405168501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb010de50 msgr2=0x7fefb019fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:31.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.958+0000 7fefb7b10640 1 --2- 172.21.15.84:0/2405168501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb010de50 0x7fefb019fd60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fefa8005cc0 tx=0x7fefa802f380 comp rx=0 tx=0).stop 2024-09-21T03:40:31.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.958+0000 7fefb7b10640 1 -- 172.21.15.84:0/2405168501 shutdown_connections 2024-09-21T03:40:31.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.958+0000 7fefb7b10640 1 --2- 172.21.15.84:0/2405168501 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fef9c0b6560 0x7fef9c0b8a70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.958+0000 7fefb7b10640 1 --2- 172.21.15.84:0/2405168501 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefb010de50 0x7fefb019fd60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.958+0000 7fefb7b10640 1 --2- 172.21.15.84:0/2405168501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefb0105340 0x7fefb019aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.958+0000 7fefb7b10640 1 --2- 172.21.15.84:0/2405168501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefb01049f0 0x7fefb019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.958+0000 7fefb7b10640 1 -- 172.21.15.84:0/2405168501 >> 172.21.15.84:0/2405168501 conn(0x7fefb00797e0 msgr2=0x7fefb00ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:31.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.958+0000 7fefb7b10640 1 -- 172.21.15.84:0/2405168501 shutdown_connections 2024-09-21T03:40:31.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:31.958+0000 7fefb7b10640 1 -- 172.21.15.84:0/2405168501 wait complete. 2024-09-21T03:40:32.628 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:32 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] up:active 2024-09-21T03:40:32.628 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:32 smithi084 ceph-mon[30941]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:40:32.628 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:32 smithi084 ceph-mon[30941]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:40:32.628 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:32 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2405168501' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:40:32.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:32 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] up:active 2024-09-21T03:40:32.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:32 smithi174 ceph-mon[34403]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:40:32.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:32 smithi174 ceph-mon[34403]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:40:32.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:32 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2405168501' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:40:32.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:32 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] up:active 2024-09-21T03:40:32.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:32 smithi172 ceph-mon[34821]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:40:32.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:32 smithi172 ceph-mon[34821]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:40:32.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:32 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2405168501' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:40:32.658 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:40:32.903 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:33.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.492+0000 7f2f2f15a640 1 -- 172.21.15.84:0/2104577995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f28108d70 msgr2=0x7f2f2810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:33.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.492+0000 7f2f2f15a640 1 --2- 172.21.15.84:0/2104577995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f28108d70 0x7f2f2810f5a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2f20009ca0 tx=0x7f2f2002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.492+0000 7f2f2f15a640 1 -- 172.21.15.84:0/2104577995 shutdown_connections 2024-09-21T03:40:33.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.492+0000 7f2f2f15a640 1 --2- 172.21.15.84:0/2104577995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f28108d70 0x7f2f2810f5a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.492+0000 7f2f2f15a640 1 --2- 172.21.15.84:0/2104577995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f28108420 0x7f2f28108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.492+0000 7f2f2f15a640 1 --2- 172.21.15.84:0/2104577995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f28102ae0 0x7f2f28102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.492+0000 7f2f2f15a640 1 -- 172.21.15.84:0/2104577995 >> 172.21.15.84:0/2104577995 conn(0x7f2f28079770 msgr2=0x7f2f28079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:33.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.492+0000 7f2f2f15a640 1 -- 172.21.15.84:0/2104577995 shutdown_connections 2024-09-21T03:40:33.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.492+0000 7f2f2f15a640 1 -- 172.21.15.84:0/2104577995 wait complete. 2024-09-21T03:40:33.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.493+0000 7f2f2f15a640 1 Processor -- start 2024-09-21T03:40:33.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.493+0000 7f2f2f15a640 1 -- start start 2024-09-21T03:40:33.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.493+0000 7f2f2f15a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f28102ae0 0x7f2f2819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.493+0000 7f2f2f15a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f28108420 0x7f2f2819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.493+0000 7f2f2f15a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f28108d70 0x7f2f2819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.493+0000 7f2f2f15a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2f28112a30 con 0x7f2f28108d70 2024-09-21T03:40:33.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.493+0000 7f2f2f15a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2f281128b0 con 0x7f2f28102ae0 2024-09-21T03:40:33.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.493+0000 7f2f2f15a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2f28112bb0 con 0x7f2f28108420 2024-09-21T03:40:33.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.493+0000 7f2f2d6f7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f28108d70 0x7f2f2819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.493+0000 7f2f2d6f7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f28108d70 0x7f2f2819fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43382/0 (socket says 172.21.15.84:43382) 2024-09-21T03:40:33.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.493+0000 7f2f2d6f7640 1 -- 172.21.15.84:0/1470797558 learned_addr learned my addr 172.21.15.84:0/1470797558 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:33.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.493+0000 7f2f2cef6640 1 --2- 172.21.15.84:0/1470797558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f28102ae0 0x7f2f2819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.494+0000 7f2f27fff640 1 --2- 172.21.15.84:0/1470797558 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f28108420 0x7f2f2819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.494+0000 7f2f2d6f7640 1 -- 172.21.15.84:0/1470797558 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f28108420 msgr2=0x7f2f2819aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:33.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.494+0000 7f2f2d6f7640 1 --2- 172.21.15.84:0/1470797558 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f28108420 0x7f2f2819aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.494+0000 7f2f2d6f7640 1 -- 172.21.15.84:0/1470797558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f28102ae0 msgr2=0x7f2f2819a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:33.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.494+0000 7f2f2d6f7640 1 --2- 172.21.15.84:0/1470797558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f28102ae0 0x7f2f2819a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.494+0000 7f2f2d6f7640 1 -- 172.21.15.84:0/1470797558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f281a0420 con 0x7f2f28108d70 2024-09-21T03:40:33.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.494+0000 7f2f2cef6640 1 --2- 172.21.15.84:0/1470797558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f28102ae0 0x7f2f2819a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:40:33.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.494+0000 7f2f2d6f7640 1 --2- 172.21.15.84:0/1470797558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f28108d70 0x7f2f2819fcf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2f20005cc0 tx=0x7f2f2002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:33.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.494+0000 7f2f25ffb640 1 -- 172.21.15.84:0/1470797558 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f20003bf0 con 0x7f2f28108d70 2024-09-21T03:40:33.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.494+0000 7f2f2f15a640 1 -- 172.21.15.84:0/1470797558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f281a06b0 con 0x7f2f28108d70 2024-09-21T03:40:33.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.494+0000 7f2f25ffb640 1 -- 172.21.15.84:0/1470797558 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f20003d90 con 0x7f2f28108d70 2024-09-21T03:40:33.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.494+0000 7f2f25ffb640 1 -- 172.21.15.84:0/1470797558 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2002fbc0 con 0x7f2f28108d70 2024-09-21T03:40:33.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.494+0000 7f2f2f15a640 1 -- 172.21.15.84:0/1470797558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f281a6e70 con 0x7f2f28108d70 2024-09-21T03:40:33.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.495+0000 7f2f2f15a640 1 -- 172.21.15.84:0/1470797558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f28103d60 con 0x7f2f28108d70 2024-09-21T03:40:33.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.497+0000 7f2f25ffb640 1 -- 172.21.15.84:0/1470797558 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f2f2002fd60 con 0x7f2f28108d70 2024-09-21T03:40:33.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.498+0000 7f2f25ffb640 1 --2- 172.21.15.84:0/1470797558 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2f180b6560 0x7f2f180b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.498+0000 7f2f2cef6640 1 --2- 172.21.15.84:0/1470797558 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2f180b6560 0x7f2f180b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.498+0000 7f2f25ffb640 1 -- 172.21.15.84:0/1470797558 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f2f20108940 con 0x7f2f28108d70 2024-09-21T03:40:33.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.498+0000 7f2f2cef6640 1 --2- 172.21.15.84:0/1470797558 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2f180b6560 0x7f2f180b8a70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00bfd0 tx=0x7f2f1c00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:33.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.501+0000 7f2f25ffb640 1 -- 172.21.15.84:0/1470797558 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2f200cf1f0 con 0x7f2f28108d70 2024-09-21T03:40:33.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:33 smithi174 ceph-mon[34403]: pgmap v264: 97 pgs: 76 active+clean, 3 creating+activating, 6 creating+peering, 12 unknown; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 411 B/s wr, 2 op/s 2024-09-21T03:40:33.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:33 smithi172 ceph-mon[34821]: pgmap v264: 97 pgs: 76 active+clean, 3 creating+activating, 6 creating+peering, 12 unknown; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 411 B/s wr, 2 op/s 2024-09-21T03:40:33.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.679+0000 7f2f2f15a640 1 -- 172.21.15.84:0/1470797558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2f28102ef0 con 0x7f2f28108d70 2024-09-21T03:40:33.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:33 smithi084 ceph-mon[30941]: pgmap v264: 97 pgs: 76 active+clean, 3 creating+activating, 6 creating+peering, 12 unknown; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 411 B/s wr, 2 op/s 2024-09-21T03:40:33.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.681+0000 7f2f25ffb640 1 -- 172.21.15.84:0/1470797558 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22632 (secure 0 0 0) 0x7f2f28102ef0 con 0x7f2f28108d70 2024-09-21T03:40:33.683 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:40:33.683 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":75,"fsid":"e3f8c18e-77c9-11ef-baf5-efdc52797490","created":"2024-09-21T03:31:55.307035+0000","modified":"2024-09-21T03:40:29.979785+0000","last_up_change":"2024-09-21T03:39:38.786385+0000","last_in_change":"2024-09-21T03:39:15.267368+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:35:50.488653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:40:25.934375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:40:27.981681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d283ba0-18f3-4668-90c4-884e9e957a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6803","nonce":508132562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6805","nonce":508132562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6809","nonce":508132562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6807","nonce":508132562}]},"public_addr":"172.21.15.84:6803/508132562","cluster_addr":"172.21.15.84:6805/508132562","heartbeat_back_addr":"172.21.15.84:6809/508132562","heartbeat_front_addr":"172.21.15.84:6807/508132562","state":["exists","up"]},{"osd":1,"uuid":"f115c5b6-812d-430f-9f0e-cb5311b7581e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6801","nonce":2931872350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6803","nonce":2931872350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6807","nonce":2931872350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6805","nonce":2931872350}]},"public_addr":"172.21.15.172:6801/2931872350","cluster_addr":"172.21.15.172:6803/2931872350","heartbeat_back_addr":"172.21.15.172:6807/2931872350","heartbeat_front_addr":"172.21.15.172:6805/2931872350","state":["exists","up"]},{"osd":2,"uuid":"36489240-e233-4aa7-ae9c-089d76683172","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6801","nonce":1847612335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6803","nonce":1847612335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6807","nonce":1847612335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6805","nonce":1847612335}]},"public_addr":"172.21.15.174:6801/1847612335","cluster_addr":"172.21.15.174:6803/1847612335","heartbeat_back_addr":"172.21.15.174:6807/1847612335","heartbeat_front_addr":"172.21.15.174:6805/1847612335","state":["exists","up"]},{"osd":3,"uuid":"1f35b404-b658-4e94-a5f4-74a6431a6a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6811","nonce":2230529863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6813","nonce":2230529863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6817","nonce":2230529863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6815","nonce":2230529863}]},"public_addr":"172.21.15.84:6811/2230529863","cluster_addr":"172.21.15.84:6813/2230529863","heartbeat_back_addr":"172.21.15.84:6817/2230529863","heartbeat_front_addr":"172.21.15.84:6815/2230529863","state":["exists","up"]},{"osd":4,"uuid":"91a2f83b-4c7d-4661-86a1-63a09888939d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6809","nonce":3069862739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6811","nonce":3069862739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6815","nonce":3069862739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6813","nonce":3069862739}]},"public_addr":"172.21.15.172:6809/3069862739","cluster_addr":"172.21.15.172:6811/3069862739","heartbeat_back_addr":"172.21.15.172:6815/3069862739","heartbeat_front_addr":"172.21.15.172:6813/3069862739","state":["exists","up"]},{"osd":5,"uuid":"e8f06b34-3956-499f-8073-09011cf1ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6809","nonce":1987010600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6811","nonce":1987010600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6815","nonce":1987010600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6813","nonce":1987010600}]},"public_addr":"172.21.15.174:6809/1987010600","cluster_addr":"172.21.15.174:6811/1987010600","heartbeat_back_addr":"172.21.15.174:6815/1987010600","heartbeat_front_addr":"172.21.15.174:6813/1987010600","state":["exists","up"]},{"osd":6,"uuid":"23d55e96-4987-4cbe-8c6b-cece4de9269b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6819","nonce":3418459345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6821","nonce":3418459345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6825","nonce":3418459345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6823","nonce":3418459345}]},"public_addr":"172.21.15.84:6819/3418459345","cluster_addr":"172.21.15.84:6821/3418459345","heartbeat_back_addr":"172.21.15.84:6825/3418459345","heartbeat_front_addr":"172.21.15.84:6823/3418459345","state":["exists","up"]},{"osd":7,"uuid":"ca91a34c-d8b1-48b8-93f4-72a5c15939d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6817","nonce":4056019738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6819","nonce":4056019738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6823","nonce":4056019738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6821","nonce":4056019738}]},"public_addr":"172.21.15.172:6817/4056019738","cluster_addr":"172.21.15.172:6819/4056019738","heartbeat_back_addr":"172.21.15.172:6823/4056019738","heartbeat_front_addr":"172.21.15.172:6821/4056019738","state":["exists","up"]},{"osd":8,"uuid":"37da8c61-d72f-4b58-b10c-7c7539ecffd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6817","nonce":2162992546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6819","nonce":2162992546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6823","nonce":2162992546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6821","nonce":2162992546}]},"public_addr":"172.21.15.174:6817/2162992546","cluster_addr":"172.21.15.174:6819/2162992546","heartbeat_back_addr":"172.21.15.174:6823/2162992546","heartbeat_front_addr":"172.21.15.174:6821/2162992546","state":["exists","up"]},{"osd":9,"uuid":"c9179f33-622d-44bd-9d8a-c92951afb1e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6827","nonce":3230873673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6829","nonce":3230873673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6833","nonce":3230873673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6831","nonce":3230873673}]},"public_addr":"172.21.15.84:6827/3230873673","cluster_addr":"172.21.15.84:6829/3230873673","heartbeat_back_addr":"172.21.15.84:6833/3230873673","heartbeat_front_addr":"172.21.15.84:6831/3230873673","state":["exists","up"]},{"osd":10,"uuid":"9788fa2d-49fb-431b-a0e3-62d6e421e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6825","nonce":2667099391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6827","nonce":2667099391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6831","nonce":2667099391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6829","nonce":2667099391}]},"public_addr":"172.21.15.172:6825/2667099391","cluster_addr":"172.21.15.172:6827/2667099391","heartbeat_back_addr":"172.21.15.172:6831/2667099391","heartbeat_front_addr":"172.21.15.172:6829/2667099391","state":["exists","up"]},{"osd":11,"uuid":"a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6825","nonce":3452825924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6827","nonce":3452825924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6831","nonce":3452825924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6829","nonce":3452825924}]},"public_addr":"172.21.15.174:6825/3452825924","cluster_addr":"172.21.15.174:6827/3452825924","heartbeat_back_addr":"172.21.15.174:6831/3452825924","heartbeat_front_addr":"172.21.15.174:6829/3452825924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:34:57.413946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:22.813846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:47.074625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:12.871112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:38.705563+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:04.277966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:29.661290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:55.475432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:20.644247+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:46.151594+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:11.499623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:36.688459+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6800/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3308084314":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3663660709":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/1794153935":"2024-09-22T03:32:49.459372+0000","172.21.15.84:6800/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6800/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1874814897":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6801/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/390051797":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/2148206075":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1916019809":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6801/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3491731835":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3418048965":"2024-09-22T03:33:50.188998+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:40:33.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.683+0000 7f2f2f15a640 1 -- 172.21.15.84:0/1470797558 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2f180b6560 msgr2=0x7f2f180b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:33.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.683+0000 7f2f2f15a640 1 --2- 172.21.15.84:0/1470797558 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2f180b6560 0x7f2f180b8a70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00bfd0 tx=0x7f2f1c00b390 comp rx=0 tx=0).stop 2024-09-21T03:40:33.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.683+0000 7f2f2f15a640 1 -- 172.21.15.84:0/1470797558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f28108d70 msgr2=0x7f2f2819fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:33.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.683+0000 7f2f2f15a640 1 --2- 172.21.15.84:0/1470797558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f28108d70 0x7f2f2819fcf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2f20005cc0 tx=0x7f2f2002f380 comp rx=0 tx=0).stop 2024-09-21T03:40:33.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.683+0000 7f2f2f15a640 1 -- 172.21.15.84:0/1470797558 shutdown_connections 2024-09-21T03:40:33.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.683+0000 7f2f2f15a640 1 --2- 172.21.15.84:0/1470797558 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2f180b6560 0x7f2f180b8a70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.683+0000 7f2f2f15a640 1 --2- 172.21.15.84:0/1470797558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2f28108d70 0x7f2f2819fcf0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.683+0000 7f2f2f15a640 1 --2- 172.21.15.84:0/1470797558 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f28108420 0x7f2f2819aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.683+0000 7f2f2f15a640 1 --2- 172.21.15.84:0/1470797558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f28102ae0 0x7f2f2819a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.683+0000 7f2f2f15a640 1 -- 172.21.15.84:0/1470797558 >> 172.21.15.84:0/1470797558 conn(0x7f2f28079770 msgr2=0x7f2f28101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:33.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.683+0000 7f2f2f15a640 1 -- 172.21.15.84:0/1470797558 shutdown_connections 2024-09-21T03:40:33.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:33.683+0000 7f2f2f15a640 1 -- 172.21.15.84:0/1470797558 wait complete. 2024-09-21T03:40:34.365 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T03:40:34.609 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:34.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:34 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1470797558' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:40:34.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:34 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1470797558' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:40:34.729 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:34 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1470797558' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:40:35.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.097+0000 7f29b1a0e640 1 -- 172.21.15.84:0/761689490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac102a70 msgr2=0x7f29ac102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:35.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.097+0000 7f29b1a0e640 1 --2- 172.21.15.84:0/761689490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac102a70 0x7f29ac102e80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f299c009900 tx=0x7f299c02a410 comp rx=0 tx=0).stop 2024-09-21T03:40:35.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.097+0000 7f29b1a0e640 1 -- 172.21.15.84:0/761689490 shutdown_connections 2024-09-21T03:40:35.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.097+0000 7f29b1a0e640 1 --2- 172.21.15.84:0/761689490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29ac108d00 0x7f29ac10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.097+0000 7f29b1a0e640 1 --2- 172.21.15.84:0/761689490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac1083b0 0x7f29ac1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.097+0000 7f29b1a0e640 1 --2- 172.21.15.84:0/761689490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac102a70 0x7f29ac102e80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.097+0000 7f29b1a0e640 1 -- 172.21.15.84:0/761689490 >> 172.21.15.84:0/761689490 conn(0x7f29ac079730 msgr2=0x7f29ac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:35.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.097+0000 7f29b1a0e640 1 -- 172.21.15.84:0/761689490 shutdown_connections 2024-09-21T03:40:35.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.097+0000 7f29b1a0e640 1 -- 172.21.15.84:0/761689490 wait complete. 2024-09-21T03:40:35.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.098+0000 7f29b1a0e640 1 Processor -- start 2024-09-21T03:40:35.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.098+0000 7f29b1a0e640 1 -- start start 2024-09-21T03:40:35.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.098+0000 7f29b1a0e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac102a70 0x7f29ac19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.098+0000 7f29b1a0e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29ac1083b0 0x7f29ac19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.098+0000 7f29b1a0e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac108d00 0x7f29ac19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.098+0000 7f29b1a0e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac112970 con 0x7f29ac108d00 2024-09-21T03:40:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.098+0000 7f29b1a0e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac1127f0 con 0x7f29ac102a70 2024-09-21T03:40:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.098+0000 7f29b1a0e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac112af0 con 0x7f29ac1083b0 2024-09-21T03:40:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.098+0000 7f29ab7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac108d00 0x7f29ac19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.098+0000 7f29ab7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac108d00 0x7f29ac19fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43402/0 (socket says 172.21.15.84:43402) 2024-09-21T03:40:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.098+0000 7f29ab7fe640 1 -- 172.21.15.84:0/3658394396 learned_addr learned my addr 172.21.15.84:0/3658394396 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.098+0000 7f29aaffd640 1 --2- 172.21.15.84:0/3658394396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac102a70 0x7f29ac19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.098+0000 7f29a3fff640 1 --2- 172.21.15.84:0/3658394396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29ac1083b0 0x7f29ac19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.098+0000 7f29ab7fe640 1 -- 172.21.15.84:0/3658394396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29ac1083b0 msgr2=0x7f29ac19aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.098+0000 7f29ab7fe640 1 --2- 172.21.15.84:0/3658394396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29ac1083b0 0x7f29ac19aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.098+0000 7f29ab7fe640 1 -- 172.21.15.84:0/3658394396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac102a70 msgr2=0x7f29ac19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.098+0000 7f29ab7fe640 1 --2- 172.21.15.84:0/3658394396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac102a70 0x7f29ac19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.098+0000 7f29ab7fe640 1 -- 172.21.15.84:0/3658394396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ac1a0340 con 0x7f29ac108d00 2024-09-21T03:40:35.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.099+0000 7f29aaffd640 1 --2- 172.21.15.84:0/3658394396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac102a70 0x7f29ac19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:40:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.099+0000 7f29ab7fe640 1 --2- 172.21.15.84:0/3658394396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac108d00 0x7f29ac19fcd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f29a400cce0 tx=0x7f29a400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.099+0000 7f29b0a0c640 1 -- 172.21.15.84:0/3658394396 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a400f450 con 0x7f29ac108d00 2024-09-21T03:40:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.099+0000 7f29b0a0c640 1 -- 172.21.15.84:0/3658394396 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29a400faa0 con 0x7f29ac108d00 2024-09-21T03:40:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.099+0000 7f29b1a0e640 1 -- 172.21.15.84:0/3658394396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29ac1a0630 con 0x7f29ac108d00 2024-09-21T03:40:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.099+0000 7f29b0a0c640 1 -- 172.21.15.84:0/3658394396 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a4018b70 con 0x7f29ac108d00 2024-09-21T03:40:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.099+0000 7f29b1a0e640 1 -- 172.21.15.84:0/3658394396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29ac1a6e50 con 0x7f29ac108d00 2024-09-21T03:40:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.100+0000 7f29b1a0e640 1 -- 172.21.15.84:0/3658394396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29ac103cf0 con 0x7f29ac108d00 2024-09-21T03:40:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.102+0000 7f29b0a0c640 1 -- 172.21.15.84:0/3658394396 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f29a4018d10 con 0x7f29ac108d00 2024-09-21T03:40:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.102+0000 7f29b0a0c640 1 --2- 172.21.15.84:0/3658394396 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29980b6610 0x7f29980b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.102+0000 7f29aaffd640 1 --2- 172.21.15.84:0/3658394396 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29980b6610 0x7f29980b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.102+0000 7f29b0a0c640 1 -- 172.21.15.84:0/3658394396 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f29a40e7870 con 0x7f29ac108d00 2024-09-21T03:40:35.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.103+0000 7f29aaffd640 1 --2- 172.21.15.84:0/3658394396 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29980b6610 0x7f29980b8b20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f299c031440 tx=0x7f299c009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:35.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.105+0000 7f29b0a0c640 1 -- 172.21.15.84:0/3658394396 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f29a4014030 con 0x7f29ac108d00 2024-09-21T03:40:35.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.322+0000 7f29b1a0e640 1 -- 172.21.15.84:0/3658394396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f29ac102e80 con 0x7f29ac108d00 2024-09-21T03:40:35.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.360+0000 7f29b0a0c640 1 -- 172.21.15.84:0/3658394396 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f29a40ae230 con 0x7f29ac108d00 2024-09-21T03:40:35.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.362+0000 7f29b1a0e640 1 -- 172.21.15.84:0/3658394396 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29980b6610 msgr2=0x7f29980b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:35.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.362+0000 7f29b1a0e640 1 --2- 172.21.15.84:0/3658394396 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29980b6610 0x7f29980b8b20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f299c031440 tx=0x7f299c009680 comp rx=0 tx=0).stop 2024-09-21T03:40:35.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.362+0000 7f29b1a0e640 1 -- 172.21.15.84:0/3658394396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac108d00 msgr2=0x7f29ac19fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:35.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.362+0000 7f29b1a0e640 1 --2- 172.21.15.84:0/3658394396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac108d00 0x7f29ac19fcd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f29a400cce0 tx=0x7f29a400a620 comp rx=0 tx=0).stop 2024-09-21T03:40:35.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.362+0000 7f29b1a0e640 1 -- 172.21.15.84:0/3658394396 shutdown_connections 2024-09-21T03:40:35.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.362+0000 7f29b1a0e640 1 --2- 172.21.15.84:0/3658394396 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29980b6610 0x7f29980b8b20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.362+0000 7f29b1a0e640 1 --2- 172.21.15.84:0/3658394396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac108d00 0x7f29ac19fcd0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.362+0000 7f29b1a0e640 1 --2- 172.21.15.84:0/3658394396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29ac1083b0 0x7f29ac19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.362+0000 7f29b1a0e640 1 --2- 172.21.15.84:0/3658394396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac102a70 0x7f29ac19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.362+0000 7f29b1a0e640 1 -- 172.21.15.84:0/3658394396 >> 172.21.15.84:0/3658394396 conn(0x7f29ac079730 msgr2=0x7f29ac101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:35.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.362+0000 7f29b1a0e640 1 -- 172.21.15.84:0/3658394396 shutdown_connections 2024-09-21T03:40:35.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:35.362+0000 7f29b1a0e640 1 -- 172.21.15.84:0/3658394396 wait complete. 2024-09-21T03:40:35.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:35 smithi174 ceph-mon[34403]: pgmap v265: 97 pgs: 96 active+clean, 1 creating+activating; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 6 op/s 2024-09-21T03:40:35.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:35 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3658394396' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T03:40:35.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:35 smithi172 ceph-mon[34821]: pgmap v265: 97 pgs: 96 active+clean, 1 creating+activating; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 6 op/s 2024-09-21T03:40:35.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:35 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3658394396' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T03:40:35.651 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:40:35 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-b[63541]: 2024-09-21T03:40:35.351+0000 7fcc19a7d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:40:35.735 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:35 smithi084 ceph-mon[30941]: pgmap v265: 97 pgs: 96 active+clean, 1 creating+activating; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 6 op/s 2024-09-21T03:40:35.735 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:35 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3658394396' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T03:40:36.066 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-21T03:40:36.067 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 3 2024-09-21T03:40:36.316 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:36.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:36 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3658394396' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T03:40:36.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:36 smithi174 ceph-mon[34403]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:40:36.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:36 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3658394396' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T03:40:36.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:36 smithi172 ceph-mon[34821]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:40:36.733 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:36 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3658394396' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T03:40:36.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:36 smithi084 ceph-mon[30941]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:40:36.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.824+0000 7fc15f45b640 1 -- 172.21.15.84:0/1439443250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1581094a0 msgr2=0x7fc1581098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:36.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.824+0000 7fc15f45b640 1 --2- 172.21.15.84:0/1439443250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1581094a0 0x7fc1581098b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc148009900 tx=0x7fc14802a410 comp rx=0 tx=0).stop 2024-09-21T03:40:36.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.824+0000 7fc15f45b640 1 -- 172.21.15.84:0/1439443250 shutdown_connections 2024-09-21T03:40:36.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.824+0000 7fc15f45b640 1 --2- 172.21.15.84:0/1439443250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc158109df0 0x7fc158110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:36.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.824+0000 7fc15f45b640 1 --2- 172.21.15.84:0/1439443250 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1581094a0 0x7fc1581098b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:36.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.824+0000 7fc15f45b640 1 --2- 172.21.15.84:0/1439443250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc158103b60 0x7fc158103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:36.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.824+0000 7fc15f45b640 1 -- 172.21.15.84:0/1439443250 >> 172.21.15.84:0/1439443250 conn(0x7fc15807b850 msgr2=0x7fc15807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:36.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.824+0000 7fc15f45b640 1 -- 172.21.15.84:0/1439443250 shutdown_connections 2024-09-21T03:40:36.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.824+0000 7fc15f45b640 1 -- 172.21.15.84:0/1439443250 wait complete. 2024-09-21T03:40:36.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.825+0000 7fc15f45b640 1 Processor -- start 2024-09-21T03:40:36.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.825+0000 7fc15f45b640 1 -- start start 2024-09-21T03:40:36.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.825+0000 7fc15f45b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc158103b60 0x7fc15819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:36.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.825+0000 7fc15f45b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1581094a0 0x7fc15819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:36.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.825+0000 7fc15f45b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc158109df0 0x7fc15819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:36.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.825+0000 7fc15f45b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc158113af0 con 0x7fc1581094a0 2024-09-21T03:40:36.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.825+0000 7fc15f45b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc158113970 con 0x7fc158109df0 2024-09-21T03:40:36.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.825+0000 7fc15f45b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc158113c70 con 0x7fc158103b60 2024-09-21T03:40:36.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.825+0000 7fc15c9f6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1581094a0 0x7fc15819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:36.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.825+0000 7fc15c9f6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1581094a0 0x7fc15819aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43420/0 (socket says 172.21.15.84:43420) 2024-09-21T03:40:36.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.825+0000 7fc15c9f6640 1 -- 172.21.15.84:0/2023166766 learned_addr learned my addr 172.21.15.84:0/2023166766 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:36.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.825+0000 7fc15d9f8640 1 --2- 172.21.15.84:0/2023166766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc158109df0 0x7fc15819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:36.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.826+0000 7fc15c9f6640 1 -- 172.21.15.84:0/2023166766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc158103b60 msgr2=0x7fc15819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:36.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.826+0000 7fc15d1f7640 1 --2- 172.21.15.84:0/2023166766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc158103b60 0x7fc15819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:36.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.826+0000 7fc15c9f6640 1 --2- 172.21.15.84:0/2023166766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc158103b60 0x7fc15819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:36.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.826+0000 7fc15c9f6640 1 -- 172.21.15.84:0/2023166766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc158109df0 msgr2=0x7fc15819fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:36.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.826+0000 7fc15c9f6640 1 --2- 172.21.15.84:0/2023166766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc158109df0 0x7fc15819fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:36.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.826+0000 7fc15c9f6640 1 -- 172.21.15.84:0/2023166766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1581a0450 con 0x7fc1581094a0 2024-09-21T03:40:36.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.826+0000 7fc15d1f7640 1 --2- 172.21.15.84:0/2023166766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc158103b60 0x7fc15819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:40:36.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.826+0000 7fc15c9f6640 1 --2- 172.21.15.84:0/2023166766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1581094a0 0x7fc15819aa80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc14802a930 tx=0x7fc148004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:36.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.826+0000 7fc14e7fc640 1 -- 172.21.15.84:0/2023166766 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14803f030 con 0x7fc1581094a0 2024-09-21T03:40:36.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.826+0000 7fc14e7fc640 1 -- 172.21.15.84:0/2023166766 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc148003cb0 con 0x7fc1581094a0 2024-09-21T03:40:36.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.826+0000 7fc15f45b640 1 -- 172.21.15.84:0/2023166766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1581a06e0 con 0x7fc1581094a0 2024-09-21T03:40:36.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.826+0000 7fc14e7fc640 1 -- 172.21.15.84:0/2023166766 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc148035070 con 0x7fc1581094a0 2024-09-21T03:40:36.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.826+0000 7fc15f45b640 1 -- 172.21.15.84:0/2023166766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1581a6ea0 con 0x7fc1581094a0 2024-09-21T03:40:36.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.827+0000 7fc15f45b640 1 -- 172.21.15.84:0/2023166766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc158103f70 con 0x7fc1581094a0 2024-09-21T03:40:36.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.828+0000 7fc14e7fc640 1 -- 172.21.15.84:0/2023166766 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fc148042030 con 0x7fc1581094a0 2024-09-21T03:40:36.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.829+0000 7fc14e7fc640 1 --2- 172.21.15.84:0/2023166766 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc1440b6560 0x7fc1440b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:36.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.829+0000 7fc15d1f7640 1 --2- 172.21.15.84:0/2023166766 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc1440b6560 0x7fc1440b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:36.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.829+0000 7fc14e7fc640 1 -- 172.21.15.84:0/2023166766 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fc148107da0 con 0x7fc1581094a0 2024-09-21T03:40:36.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.830+0000 7fc15d1f7640 1 --2- 172.21.15.84:0/2023166766 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc1440b6560 0x7fc1440b8a70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc1540058c0 tx=0x7fc154005d30 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:36.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:36.832+0000 7fc14e7fc640 1 -- 172.21.15.84:0/2023166766 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc1480ce650 con 0x7fc1581094a0 2024-09-21T03:40:37.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:37.047+0000 7fc15f45b640 1 -- 172.21.15.84:0/2023166766 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fc15810bbe0 con 0x7fc1581094a0 2024-09-21T03:40:37.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:37.380+0000 7fc14e7fc640 1 -- 172.21.15.84:0/2023166766 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fc1480d2a30 con 0x7fc1581094a0 2024-09-21T03:40:37.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:37.384+0000 7fc15f45b640 1 -- 172.21.15.84:0/2023166766 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc1440b6560 msgr2=0x7fc1440b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:37.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:37.384+0000 7fc15f45b640 1 --2- 172.21.15.84:0/2023166766 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc1440b6560 0x7fc1440b8a70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc1540058c0 tx=0x7fc154005d30 comp rx=0 tx=0).stop 2024-09-21T03:40:37.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:37.384+0000 7fc15f45b640 1 -- 172.21.15.84:0/2023166766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1581094a0 msgr2=0x7fc15819aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:37.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:37.384+0000 7fc15f45b640 1 --2- 172.21.15.84:0/2023166766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1581094a0 0x7fc15819aa80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc14802a930 tx=0x7fc148004270 comp rx=0 tx=0).stop 2024-09-21T03:40:37.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:37.384+0000 7fc15f45b640 1 -- 172.21.15.84:0/2023166766 shutdown_connections 2024-09-21T03:40:37.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:37.384+0000 7fc15f45b640 1 --2- 172.21.15.84:0/2023166766 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc1440b6560 0x7fc1440b8a70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:37.384+0000 7fc15f45b640 1 --2- 172.21.15.84:0/2023166766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc158109df0 0x7fc15819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:37.384+0000 7fc15f45b640 1 --2- 172.21.15.84:0/2023166766 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1581094a0 0x7fc15819aa80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:37.384+0000 7fc15f45b640 1 --2- 172.21.15.84:0/2023166766 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc158103b60 0x7fc15819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:37.384+0000 7fc15f45b640 1 -- 172.21.15.84:0/2023166766 >> 172.21.15.84:0/2023166766 conn(0x7fc15807b850 msgr2=0x7fc1581054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:37.384+0000 7fc15f45b640 1 -- 172.21.15.84:0/2023166766 shutdown_connections 2024-09-21T03:40:37.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:37.384+0000 7fc15f45b640 1 -- 172.21.15.84:0/2023166766 wait complete. 2024-09-21T03:40:37.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:37 smithi174 ceph-mon[34403]: pgmap v266: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-21T03:40:37.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:37 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2023166766' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T03:40:37.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:37 smithi172 ceph-mon[34821]: pgmap v266: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-21T03:40:37.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:37 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2023166766' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T03:40:37.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:37 smithi084 ceph-mon[30941]: pgmap v266: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-21T03:40:37.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:37 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2023166766' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T03:40:38.128 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T03:40:38.380 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:38.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:38 smithi172 ceph-mon[34821]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T03:40:38.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:38 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2023166766' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T03:40:38.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:38 smithi172 ceph-mon[34821]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T03:40:38.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:38 smithi172 ceph-mon[34821]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:40:38.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:38 smithi172 ceph-mon[34821]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-21T03:40:38.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:38 smithi172 ceph-mon[34821]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-21T03:40:38.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:38 smithi084 ceph-mon[30941]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T03:40:38.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:38 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2023166766' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T03:40:38.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:38 smithi084 ceph-mon[30941]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T03:40:38.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:38 smithi084 ceph-mon[30941]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:40:38.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:38 smithi084 ceph-mon[30941]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-21T03:40:38.660 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:38 smithi084 ceph-mon[30941]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-21T03:40:38.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:38 smithi174 ceph-mon[34403]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T03:40:38.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:38 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2023166766' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T03:40:38.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:38 smithi174 ceph-mon[34403]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T03:40:38.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:38 smithi174 ceph-mon[34403]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T03:40:38.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:38 smithi174 ceph-mon[34403]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-21T03:40:38.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:38 smithi174 ceph-mon[34403]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-21T03:40:38.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.885+0000 7fe72ed39640 1 -- 172.21.15.84:0/1269551025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7281094a0 msgr2=0x7fe7281098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:38.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.885+0000 7fe72ed39640 1 --2- 172.21.15.84:0/1269551025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7281094a0 0x7fe7281098b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe71c009900 tx=0x7fe71c02a410 comp rx=0 tx=0).stop 2024-09-21T03:40:38.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.885+0000 7fe72ed39640 1 -- 172.21.15.84:0/1269551025 shutdown_connections 2024-09-21T03:40:38.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.885+0000 7fe72ed39640 1 --2- 172.21.15.84:0/1269551025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe728109df0 0x7fe728110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:38.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.885+0000 7fe72ed39640 1 --2- 172.21.15.84:0/1269551025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7281094a0 0x7fe7281098b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:38.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.885+0000 7fe72ed39640 1 --2- 172.21.15.84:0/1269551025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe728103b60 0x7fe728103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:38.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.885+0000 7fe72ed39640 1 -- 172.21.15.84:0/1269551025 >> 172.21.15.84:0/1269551025 conn(0x7fe72807b850 msgr2=0x7fe72807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:38.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.885+0000 7fe72ed39640 1 -- 172.21.15.84:0/1269551025 shutdown_connections 2024-09-21T03:40:38.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.885+0000 7fe72ed39640 1 -- 172.21.15.84:0/1269551025 wait complete. 2024-09-21T03:40:38.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.885+0000 7fe72ed39640 1 Processor -- start 2024-09-21T03:40:38.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.886+0000 7fe72ed39640 1 -- start start 2024-09-21T03:40:38.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.886+0000 7fe72ed39640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe728103b60 0x7fe72819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:38.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.886+0000 7fe72ed39640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7281094a0 0x7fe72819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:38.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.886+0000 7fe72ed39640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe728109df0 0x7fe72819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:38.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.886+0000 7fe72ed39640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe728113ab0 con 0x7fe7281094a0 2024-09-21T03:40:38.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.886+0000 7fe72ed39640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe728113930 con 0x7fe728103b60 2024-09-21T03:40:38.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.886+0000 7fe72ed39640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe728113c30 con 0x7fe728109df0 2024-09-21T03:40:38.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.886+0000 7fe727fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7281094a0 0x7fe72819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:38.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.886+0000 7fe727fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7281094a0 0x7fe72819aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47702/0 (socket says 172.21.15.84:47702) 2024-09-21T03:40:38.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.886+0000 7fe727fff640 1 -- 172.21.15.84:0/3291135445 learned_addr learned my addr 172.21.15.84:0/3291135445 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:38.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.886+0000 7fe72d2d6640 1 --2- 172.21.15.84:0/3291135445 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe728109df0 0x7fe72819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:38.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.886+0000 7fe72cad5640 1 --2- 172.21.15.84:0/3291135445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe728103b60 0x7fe72819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:38.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.886+0000 7fe727fff640 1 -- 172.21.15.84:0/3291135445 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe728109df0 msgr2=0x7fe72819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:38.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.886+0000 7fe727fff640 1 --2- 172.21.15.84:0/3291135445 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe728109df0 0x7fe72819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:38.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.886+0000 7fe727fff640 1 -- 172.21.15.84:0/3291135445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe728103b60 msgr2=0x7fe72819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:38.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.886+0000 7fe727fff640 1 --2- 172.21.15.84:0/3291135445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe728103b60 0x7fe72819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:38.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.886+0000 7fe727fff640 1 -- 172.21.15.84:0/3291135445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7281a03f0 con 0x7fe7281094a0 2024-09-21T03:40:38.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.886+0000 7fe72cad5640 1 --2- 172.21.15.84:0/3291135445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe728103b60 0x7fe72819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:40:38.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.886+0000 7fe727fff640 1 --2- 172.21.15.84:0/3291135445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7281094a0 0x7fe72819aa20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe71c006010 tx=0x7fe71c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:38.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.887+0000 7fe725ffb640 1 -- 172.21.15.84:0/3291135445 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c03f030 con 0x7fe7281094a0 2024-09-21T03:40:38.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.887+0000 7fe725ffb640 1 -- 172.21.15.84:0/3291135445 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe71c003aa0 con 0x7fe7281094a0 2024-09-21T03:40:38.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.887+0000 7fe72ed39640 1 -- 172.21.15.84:0/3291135445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7281a0680 con 0x7fe7281094a0 2024-09-21T03:40:38.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.887+0000 7fe725ffb640 1 -- 172.21.15.84:0/3291135445 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c035070 con 0x7fe7281094a0 2024-09-21T03:40:38.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.887+0000 7fe72ed39640 1 -- 172.21.15.84:0/3291135445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7281a6e40 con 0x7fe7281094a0 2024-09-21T03:40:38.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.888+0000 7fe72ed39640 1 -- 172.21.15.84:0/3291135445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe728104de0 con 0x7fe7281094a0 2024-09-21T03:40:38.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.889+0000 7fe725ffb640 1 -- 172.21.15.84:0/3291135445 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fe71c042030 con 0x7fe7281094a0 2024-09-21T03:40:38.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.890+0000 7fe725ffb640 1 --2- 172.21.15.84:0/3291135445 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe7100b65e0 0x7fe7100b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:38.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.890+0000 7fe72cad5640 1 --2- 172.21.15.84:0/3291135445 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe7100b65e0 0x7fe7100b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:38.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.890+0000 7fe725ffb640 1 -- 172.21.15.84:0/3291135445 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fe71c107850 con 0x7fe7281094a0 2024-09-21T03:40:38.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.891+0000 7fe72cad5640 1 --2- 172.21.15.84:0/3291135445 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe7100b65e0 0x7fe7100b8af0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe718009b40 tx=0x7fe718005e50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:38.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:38.895+0000 7fe725ffb640 1 -- 172.21.15.84:0/3291135445 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe71c0ce100 con 0x7fe7281094a0 2024-09-21T03:40:39.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:39.110+0000 7fe72ed39640 1 -- 172.21.15.84:0/3291135445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fe72810bc40 con 0x7fe7281094a0 2024-09-21T03:40:39.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:39.400+0000 7fe725ffb640 1 -- 172.21.15.84:0/3291135445 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fe71c0d24e0 con 0x7fe7281094a0 2024-09-21T03:40:39.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:39.402+0000 7fe72ed39640 1 -- 172.21.15.84:0/3291135445 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe7100b65e0 msgr2=0x7fe7100b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:39.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:39.402+0000 7fe72ed39640 1 --2- 172.21.15.84:0/3291135445 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe7100b65e0 0x7fe7100b8af0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe718009b40 tx=0x7fe718005e50 comp rx=0 tx=0).stop 2024-09-21T03:40:39.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:39.402+0000 7fe72ed39640 1 -- 172.21.15.84:0/3291135445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7281094a0 msgr2=0x7fe72819aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:39.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:39.402+0000 7fe72ed39640 1 --2- 172.21.15.84:0/3291135445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7281094a0 0x7fe72819aa20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe71c006010 tx=0x7fe71c004060 comp rx=0 tx=0).stop 2024-09-21T03:40:39.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:39.402+0000 7fe72ed39640 1 -- 172.21.15.84:0/3291135445 shutdown_connections 2024-09-21T03:40:39.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:39.402+0000 7fe72ed39640 1 --2- 172.21.15.84:0/3291135445 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe7100b65e0 0x7fe7100b8af0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:39.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:39.402+0000 7fe72ed39640 1 --2- 172.21.15.84:0/3291135445 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe728109df0 0x7fe72819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:39.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:39.402+0000 7fe72ed39640 1 --2- 172.21.15.84:0/3291135445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe7281094a0 0x7fe72819aa20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:39.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:39.402+0000 7fe72ed39640 1 --2- 172.21.15.84:0/3291135445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe728103b60 0x7fe72819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:39.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:39.402+0000 7fe72ed39640 1 -- 172.21.15.84:0/3291135445 >> 172.21.15.84:0/3291135445 conn(0x7fe72807b850 msgr2=0x7fe728107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:39.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:39.403+0000 7fe72ed39640 1 -- 172.21.15.84:0/3291135445 shutdown_connections 2024-09-21T03:40:39.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:39.403+0000 7fe72ed39640 1 -- 172.21.15.84:0/3291135445 wait complete. 2024-09-21T03:40:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:39 smithi172 ceph-mon[34821]: pgmap v267: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T03:40:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:39 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] up:active 2024-09-21T03:40:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:39 smithi172 ceph-mon[34821]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T03:40:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:39 smithi172 ceph-mon[34821]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T03:40:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:39 smithi172 ceph-mon[34821]: Cluster is now healthy 2024-09-21T03:40:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:39 smithi172 ceph-mon[34821]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-21T03:40:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:39 smithi172 ceph-mon[34821]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-21T03:40:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:39 smithi172 ceph-mon[34821]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-21T03:40:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:39 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3291135445' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T03:40:39.797 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:39 smithi084 ceph-mon[30941]: pgmap v267: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T03:40:39.797 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:39 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] up:active 2024-09-21T03:40:39.797 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:39 smithi084 ceph-mon[30941]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T03:40:39.797 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:39 smithi084 ceph-mon[30941]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T03:40:39.797 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:39 smithi084 ceph-mon[30941]: Cluster is now healthy 2024-09-21T03:40:39.797 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:39 smithi084 ceph-mon[30941]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-21T03:40:39.797 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:39 smithi084 ceph-mon[30941]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-21T03:40:39.797 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:39 smithi084 ceph-mon[30941]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-21T03:40:39.798 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:39 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3291135445' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T03:40:39.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:39 smithi174 ceph-mon[34403]: pgmap v267: 97 pgs: 97 active+clean; 579 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T03:40:39.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:39 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] up:active 2024-09-21T03:40:39.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:39 smithi174 ceph-mon[34403]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T03:40:39.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:39 smithi174 ceph-mon[34403]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T03:40:39.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:39 smithi174 ceph-mon[34403]: Cluster is now healthy 2024-09-21T03:40:39.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:39 smithi174 ceph-mon[34403]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-21T03:40:39.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:39 smithi174 ceph-mon[34403]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-21T03:40:39.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:39 smithi174 ceph-mon[34403]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-21T03:40:39.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:39 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3291135445' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T03:40:40.154 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T03:40:40.405 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:40 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3291135445' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T03:40:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:40 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] up:active 2024-09-21T03:40:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:40 smithi172 ceph-mon[34821]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-21T03:40:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:40 smithi172 ceph-mon[34821]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:40:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:40 smithi172 ceph-mon[34821]: pgmap v268: 97 pgs: 97 active+clean; 580 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 7 op/s 2024-09-21T03:40:40.651 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:40:40 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-b[63541]: 2024-09-21T03:40:40.352+0000 7fcc19a7d640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-21T03:40:40.651 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:40:40 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-b[63541]: 2024-09-21T03:40:40.352+0000 7fcc19a7d640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-21T03:40:40.665 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:40 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3291135445' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T03:40:40.665 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:40 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] up:active 2024-09-21T03:40:40.665 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:40 smithi084 ceph-mon[30941]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-21T03:40:40.665 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:40 smithi084 ceph-mon[30941]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:40:40.665 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:40 smithi084 ceph-mon[30941]: pgmap v268: 97 pgs: 97 active+clean; 580 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 7 op/s 2024-09-21T03:40:40.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:40 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3291135445' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T03:40:40.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:40 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] up:active 2024-09-21T03:40:40.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:40 smithi174 ceph-mon[34403]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-21T03:40:40.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:40 smithi174 ceph-mon[34403]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:40:40.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:40 smithi174 ceph-mon[34403]: pgmap v268: 97 pgs: 97 active+clean; 580 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 7 op/s 2024-09-21T03:40:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.908+0000 7f36328f5640 1 -- 172.21.15.84:0/1031362667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f362c109df0 msgr2=0x7f362c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.908+0000 7f36328f5640 1 --2- 172.21.15.84:0/1031362667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f362c109df0 0x7f362c110620 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3624009ca0 tx=0x7f362402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:40:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.908+0000 7f36328f5640 1 -- 172.21.15.84:0/1031362667 shutdown_connections 2024-09-21T03:40:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.908+0000 7f36328f5640 1 --2- 172.21.15.84:0/1031362667 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f362c109df0 0x7f362c110620 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.908+0000 7f36328f5640 1 --2- 172.21.15.84:0/1031362667 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f362c1094a0 0x7f362c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.908+0000 7f36328f5640 1 --2- 172.21.15.84:0/1031362667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f362c103b60 0x7f362c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.909+0000 7f36328f5640 1 -- 172.21.15.84:0/1031362667 >> 172.21.15.84:0/1031362667 conn(0x7f362c07b850 msgr2=0x7f362c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.909+0000 7f36328f5640 1 -- 172.21.15.84:0/1031362667 shutdown_connections 2024-09-21T03:40:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.909+0000 7f36328f5640 1 -- 172.21.15.84:0/1031362667 wait complete. 2024-09-21T03:40:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.909+0000 7f36328f5640 1 Processor -- start 2024-09-21T03:40:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.909+0000 7f36328f5640 1 -- start start 2024-09-21T03:40:40.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.910+0000 7f36328f5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f362c103b60 0x7f362c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.910+0000 7f36328f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f362c1094a0 0x7f362c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.910+0000 7f36328f5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f362c109df0 0x7f362c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.910+0000 7f36328f5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f362c113ab0 con 0x7f362c103b60 2024-09-21T03:40:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.910+0000 7f36328f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f362c113930 con 0x7f362c1094a0 2024-09-21T03:40:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.910+0000 7f36328f5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f362c113c30 con 0x7f362c109df0 2024-09-21T03:40:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.910+0000 7f362bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f362c103b60 0x7f362c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.910+0000 7f362bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f362c103b60 0x7f362c075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47708/0 (socket says 172.21.15.84:47708) 2024-09-21T03:40:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.910+0000 7f362bfff640 1 -- 172.21.15.84:0/3265113924 learned_addr learned my addr 172.21.15.84:0/3265113924 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.910+0000 7f3630e92640 1 --2- 172.21.15.84:0/3265113924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f362c109df0 0x7f362c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.910+0000 7f362b7fe640 1 --2- 172.21.15.84:0/3265113924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f362c1094a0 0x7f362c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.910+0000 7f362bfff640 1 -- 172.21.15.84:0/3265113924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f362c109df0 msgr2=0x7f362c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.910+0000 7f362bfff640 1 --2- 172.21.15.84:0/3265113924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f362c109df0 0x7f362c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.910+0000 7f362bfff640 1 -- 172.21.15.84:0/3265113924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f362c1094a0 msgr2=0x7f362c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:40.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.910+0000 7f362bfff640 1 --2- 172.21.15.84:0/3265113924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f362c1094a0 0x7f362c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.910+0000 7f362bfff640 1 -- 172.21.15.84:0/3265113924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362c1a86c0 con 0x7f362c103b60 2024-09-21T03:40:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.910+0000 7f362b7fe640 1 --2- 172.21.15.84:0/3265113924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f362c1094a0 0x7f362c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:40:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.910+0000 7f362bfff640 1 --2- 172.21.15.84:0/3265113924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f362c103b60 0x7f362c075710 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f361c00d950 tx=0x7f361c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.910+0000 7f36297fa640 1 -- 172.21.15.84:0/3265113924 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c017070 con 0x7f362c103b60 2024-09-21T03:40:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.911+0000 7f36328f5640 1 -- 172.21.15.84:0/3265113924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f362c1a89b0 con 0x7f362c103b60 2024-09-21T03:40:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.911+0000 7f36297fa640 1 -- 172.21.15.84:0/3265113924 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f361c009c30 con 0x7f362c103b60 2024-09-21T03:40:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.911+0000 7f36297fa640 1 -- 172.21.15.84:0/3265113924 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361c00f620 con 0x7f362c103b60 2024-09-21T03:40:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.911+0000 7f36328f5640 1 -- 172.21.15.84:0/3265113924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f362c1a8ef0 con 0x7f362c103b60 2024-09-21T03:40:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.912+0000 7f36328f5640 1 -- 172.21.15.84:0/3265113924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f362c103f70 con 0x7f362c103b60 2024-09-21T03:40:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.913+0000 7f36297fa640 1 -- 172.21.15.84:0/3265113924 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7f361c005030 con 0x7f362c103b60 2024-09-21T03:40:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.914+0000 7f36297fa640 1 --2- 172.21.15.84:0/3265113924 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f36140b6560 0x7f36140b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.914+0000 7f362b7fe640 1 --2- 172.21.15.84:0/3265113924 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f36140b6560 0x7f36140b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.914+0000 7f36297fa640 1 -- 172.21.15.84:0/3265113924 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f361c0e6ff0 con 0x7f362c103b60 2024-09-21T03:40:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.915+0000 7f362b7fe640 1 --2- 172.21.15.84:0/3265113924 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f36140b6560 0x7f36140b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f362c109170 tx=0x7f3620005d30 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:40.917+0000 7f36297fa640 1 -- 172.21.15.84:0/3265113924 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f361c0ad8a0 con 0x7f362c103b60 2024-09-21T03:40:41.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:41.130+0000 7f36328f5640 1 -- 172.21.15.84:0/3265113924 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f362c02e640 con 0x7f362c103b60 2024-09-21T03:40:41.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:41.413+0000 7f36297fa640 1 -- 172.21.15.84:0/3265113924 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f361c0d0020 con 0x7f362c103b60 2024-09-21T03:40:41.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:41.417+0000 7f36328f5640 1 -- 172.21.15.84:0/3265113924 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f36140b6560 msgr2=0x7f36140b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:41.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:41.417+0000 7f36328f5640 1 --2- 172.21.15.84:0/3265113924 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f36140b6560 0x7f36140b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f362c109170 tx=0x7f3620005d30 comp rx=0 tx=0).stop 2024-09-21T03:40:41.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:41.417+0000 7f36328f5640 1 -- 172.21.15.84:0/3265113924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f362c103b60 msgr2=0x7f362c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:41.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:41.417+0000 7f36328f5640 1 --2- 172.21.15.84:0/3265113924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f362c103b60 0x7f362c075710 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f361c00d950 tx=0x7f361c00de10 comp rx=0 tx=0).stop 2024-09-21T03:40:41.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:41.417+0000 7f36328f5640 1 -- 172.21.15.84:0/3265113924 shutdown_connections 2024-09-21T03:40:41.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:41.417+0000 7f36328f5640 1 --2- 172.21.15.84:0/3265113924 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f36140b6560 0x7f36140b8a70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:41.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:41.417+0000 7f36328f5640 1 --2- 172.21.15.84:0/3265113924 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f362c109df0 0x7f362c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:41.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:41.417+0000 7f36328f5640 1 --2- 172.21.15.84:0/3265113924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f362c1094a0 0x7f362c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:41.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:41.417+0000 7f36328f5640 1 --2- 172.21.15.84:0/3265113924 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f362c103b60 0x7f362c075710 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:41.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:41.417+0000 7f36328f5640 1 -- 172.21.15.84:0/3265113924 >> 172.21.15.84:0/3265113924 conn(0x7f362c07b850 msgr2=0x7f362c107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:41.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:41.417+0000 7f36328f5640 1 -- 172.21.15.84:0/3265113924 shutdown_connections 2024-09-21T03:40:41.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:41.417+0000 7f36328f5640 1 -- 172.21.15.84:0/3265113924 wait complete. 2024-09-21T03:40:41.805 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:41 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3265113924' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T03:40:41.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:41 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3265113924' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T03:40:41.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:41 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3265113924' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T03:40:42.174 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-21T03:40:42.174 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T03:40:42.424 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:42.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:42 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3265113924' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T03:40:42.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:42 smithi174 ceph-mon[34403]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:40:42.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:42 smithi174 ceph-mon[34403]: pgmap v269: 97 pgs: 97 active+clean; 582 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T03:40:42.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:42 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3265113924' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T03:40:42.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:42 smithi172 ceph-mon[34821]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:40:42.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:42 smithi172 ceph-mon[34821]: pgmap v269: 97 pgs: 97 active+clean; 582 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T03:40:42.680 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:42 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3265113924' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T03:40:42.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:42 smithi084 ceph-mon[30941]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:40:42.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:42 smithi084 ceph-mon[30941]: pgmap v269: 97 pgs: 97 active+clean; 582 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T03:40:42.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.909+0000 7fe0cf855640 1 -- 172.21.15.84:0/1782542695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0c81083a0 msgr2=0x7fe0c81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:42.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.909+0000 7fe0cf855640 1 --2- 172.21.15.84:0/1782542695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0c81083a0 0x7fe0c81087b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8009900 tx=0x7fe0b802a410 comp rx=0 tx=0).stop 2024-09-21T03:40:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.909+0000 7fe0cf855640 1 -- 172.21.15.84:0/1782542695 shutdown_connections 2024-09-21T03:40:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.909+0000 7fe0cf855640 1 --2- 172.21.15.84:0/1782542695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0c8108cf0 0x7fe0c810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.909+0000 7fe0cf855640 1 --2- 172.21.15.84:0/1782542695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0c81083a0 0x7fe0c81087b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.909+0000 7fe0cf855640 1 --2- 172.21.15.84:0/1782542695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0c8102a60 0x7fe0c8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.909+0000 7fe0cf855640 1 -- 172.21.15.84:0/1782542695 >> 172.21.15.84:0/1782542695 conn(0x7fe0c8079730 msgr2=0x7fe0c8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.909+0000 7fe0cf855640 1 -- 172.21.15.84:0/1782542695 shutdown_connections 2024-09-21T03:40:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.909+0000 7fe0cf855640 1 -- 172.21.15.84:0/1782542695 wait complete. 2024-09-21T03:40:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.910+0000 7fe0cf855640 1 Processor -- start 2024-09-21T03:40:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.910+0000 7fe0cf855640 1 -- start start 2024-09-21T03:40:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.910+0000 7fe0cf855640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0c8102a60 0x7fe0c81993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.910+0000 7fe0cf855640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0c81083a0 0x7fe0c8199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.910+0000 7fe0cf855640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0c8108cf0 0x7fe0c819ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:42.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.910+0000 7fe0cf855640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c8112960 con 0x7fe0c8102a60 2024-09-21T03:40:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.910+0000 7fe0cf855640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c81127e0 con 0x7fe0c8108cf0 2024-09-21T03:40:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.910+0000 7fe0cf855640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c8112ae0 con 0x7fe0c81083a0 2024-09-21T03:40:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.910+0000 7fe0cd5f1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0c8102a60 0x7fe0c81993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.910+0000 7fe0cd5f1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0c8102a60 0x7fe0c81993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47720/0 (socket says 172.21.15.84:47720) 2024-09-21T03:40:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.910+0000 7fe0cd5f1640 1 -- 172.21.15.84:0/1725295523 learned_addr learned my addr 172.21.15.84:0/1725295523 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.911+0000 7fe0cddf2640 1 --2- 172.21.15.84:0/1725295523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0c8108cf0 0x7fe0c819ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.911+0000 7fe0ccdf0640 1 --2- 172.21.15.84:0/1725295523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0c81083a0 0x7fe0c8199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.911+0000 7fe0cd5f1640 1 -- 172.21.15.84:0/1725295523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0c81083a0 msgr2=0x7fe0c8199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.911+0000 7fe0cd5f1640 1 --2- 172.21.15.84:0/1725295523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0c81083a0 0x7fe0c8199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.911+0000 7fe0cd5f1640 1 -- 172.21.15.84:0/1725295523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0c8108cf0 msgr2=0x7fe0c819ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.911+0000 7fe0cd5f1640 1 --2- 172.21.15.84:0/1725295523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0c8108cf0 0x7fe0c819ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.911+0000 7fe0cd5f1640 1 -- 172.21.15.84:0/1725295523 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c819f340 con 0x7fe0c8102a60 2024-09-21T03:40:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.911+0000 7fe0cddf2640 1 --2- 172.21.15.84:0/1725295523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0c8108cf0 0x7fe0c819ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:40:42.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.911+0000 7fe0cd5f1640 1 --2- 172.21.15.84:0/1725295523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0c8102a60 0x7fe0c81993d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4007910 tx=0x7fe0c4007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:42.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.911+0000 7fe0be7fc640 1 -- 172.21.15.84:0/1725295523 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4019070 con 0x7fe0c8102a60 2024-09-21T03:40:42.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.911+0000 7fe0be7fc640 1 -- 172.21.15.84:0/1725295523 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0c4005020 con 0x7fe0c8102a60 2024-09-21T03:40:42.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.911+0000 7fe0cf855640 1 -- 172.21.15.84:0/1725295523 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c819f630 con 0x7fe0c8102a60 2024-09-21T03:40:42.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.911+0000 7fe0be7fc640 1 -- 172.21.15.84:0/1725295523 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4004a00 con 0x7fe0c8102a60 2024-09-21T03:40:42.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.911+0000 7fe0cf855640 1 -- 172.21.15.84:0/1725295523 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c806ae60 con 0x7fe0c8102a60 2024-09-21T03:40:42.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.912+0000 7fe0cf855640 1 -- 172.21.15.84:0/1725295523 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c8102e70 con 0x7fe0c8102a60 2024-09-21T03:40:42.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.913+0000 7fe0be7fc640 1 -- 172.21.15.84:0/1725295523 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 21) ==== 154529+0+0 (secure 0 0 0) 0x7fe0c401c070 con 0x7fe0c8102a60 2024-09-21T03:40:42.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.915+0000 7fe0be7fc640 1 --2- 172.21.15.84:0/1725295523 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe0b40b6560 0x7fe0b40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:42.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.915+0000 7fe0ccdf0640 1 --2- 172.21.15.84:0/1725295523 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe0b40b6560 0x7fe0b40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:42.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.915+0000 7fe0be7fc640 1 -- 172.21.15.84:0/1725295523 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fe0c40e8590 con 0x7fe0c8102a60 2024-09-21T03:40:42.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.915+0000 7fe0ccdf0640 1 --2- 172.21.15.84:0/1725295523 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe0b40b6560 0x7fe0b40b8a70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8000c00 tx=0x7fe0b8031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:42.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:42.918+0000 7fe0be7fc640 1 -- 172.21.15.84:0/1725295523 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe0c40aede0 con 0x7fe0c8102a60 2024-09-21T03:40:43.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:43.122+0000 7fe0cf855640 1 -- 172.21.15.84:0/1725295523 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fe0c806b8b0 con 0x7fe0b40b6560 2024-09-21T03:40:43.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:43.149+0000 7fe0be7fc640 1 -- 172.21.15.84:0/1725295523 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe0c806b8b0 con 0x7fe0b40b6560 2024-09-21T03:40:43.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:43.152+0000 7fe0cf855640 1 -- 172.21.15.84:0/1725295523 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe0b40b6560 msgr2=0x7fe0b40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:43.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:43.152+0000 7fe0cf855640 1 --2- 172.21.15.84:0/1725295523 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe0b40b6560 0x7fe0b40b8a70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8000c00 tx=0x7fe0b8031400 comp rx=0 tx=0).stop 2024-09-21T03:40:43.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:43.152+0000 7fe0cf855640 1 -- 172.21.15.84:0/1725295523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0c8102a60 msgr2=0x7fe0c81993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:43.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:43.152+0000 7fe0cf855640 1 --2- 172.21.15.84:0/1725295523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0c8102a60 0x7fe0c81993d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4007910 tx=0x7fe0c4007dd0 comp rx=0 tx=0).stop 2024-09-21T03:40:43.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:43.152+0000 7fe0cf855640 1 -- 172.21.15.84:0/1725295523 shutdown_connections 2024-09-21T03:40:43.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:43.152+0000 7fe0cf855640 1 --2- 172.21.15.84:0/1725295523 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe0b40b6560 0x7fe0b40b8a70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:43.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:43.152+0000 7fe0cf855640 1 --2- 172.21.15.84:0/1725295523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0c8108cf0 0x7fe0c819ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:43.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:43.152+0000 7fe0cf855640 1 --2- 172.21.15.84:0/1725295523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe0c81083a0 0x7fe0c8199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:43.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:43.152+0000 7fe0cf855640 1 --2- 172.21.15.84:0/1725295523 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe0c8102a60 0x7fe0c81993d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:43.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:43.152+0000 7fe0cf855640 1 -- 172.21.15.84:0/1725295523 >> 172.21.15.84:0/1725295523 conn(0x7fe0c8079730 msgr2=0x7fe0c81044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:43.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:43.152+0000 7fe0cf855640 1 -- 172.21.15.84:0/1725295523 shutdown_connections 2024-09-21T03:40:43.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:43.152+0000 7fe0cf855640 1 -- 172.21.15.84:0/1725295523 wait complete. 2024-09-21T03:40:43.425 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:40:43 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:40:43.127+0000 7fa4cd7bf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:40:43.425 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:40:43 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:40:43.127+0000 7fa4cd7bf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:40:43.425 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:40:43 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:40:43.127+0000 7fa4cd7bf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:40:43.426 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:40:43 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:40:43.127+0000 7fa4cd7bf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:40:43.426 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:40:43 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:40:43.127+0000 7fa4cd7bf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:40:43.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:43 smithi084 ceph-mon[30941]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:43.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:43 smithi174 ceph-mon[34403]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:43.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:43 smithi172 ceph-mon[34821]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:43.910 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T03:40:44.155 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:44.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:44 smithi084 ceph-mon[30941]: pgmap v270: 97 pgs: 97 active+clean; 588 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-09-21T03:40:44.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.660+0000 7fbf2c86f640 1 -- 172.21.15.84:0/657617129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf281020b0 msgr2=0x7fbf281024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:44.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.660+0000 7fbf2c86f640 1 --2- 172.21.15.84:0/657617129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf281020b0 0x7fbf281024c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbf18009900 tx=0x7fbf1802a3f0 comp rx=0 tx=0).stop 2024-09-21T03:40:44.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.660+0000 7fbf2c86f640 1 -- 172.21.15.84:0/657617129 shutdown_connections 2024-09-21T03:40:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.660+0000 7fbf2c86f640 1 --2- 172.21.15.84:0/657617129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf28106bf0 0x7fbf28110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.660+0000 7fbf2c86f640 1 --2- 172.21.15.84:0/657617129 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf281062a0 0x7fbf281066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.660+0000 7fbf2c86f640 1 --2- 172.21.15.84:0/657617129 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf281020b0 0x7fbf281024c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.660+0000 7fbf2c86f640 1 -- 172.21.15.84:0/657617129 >> 172.21.15.84:0/657617129 conn(0x7fbf28079e30 msgr2=0x7fbf2807a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.660+0000 7fbf2c86f640 1 -- 172.21.15.84:0/657617129 shutdown_connections 2024-09-21T03:40:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.660+0000 7fbf2c86f640 1 -- 172.21.15.84:0/657617129 wait complete. 2024-09-21T03:40:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.661+0000 7fbf2c86f640 1 Processor -- start 2024-09-21T03:40:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.661+0000 7fbf2c86f640 1 -- start start 2024-09-21T03:40:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.661+0000 7fbf2c86f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf281020b0 0x7fbf28103050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.661+0000 7fbf2c86f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf281062a0 0x7fbf28103590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.661+0000 7fbf2c86f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf28106bf0 0x7fbf28103ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.661+0000 7fbf2c86f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbf28113af0 con 0x7fbf28106bf0 2024-09-21T03:40:44.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.661+0000 7fbf2c86f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbf28113970 con 0x7fbf281062a0 2024-09-21T03:40:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.661+0000 7fbf2c86f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbf28113c70 con 0x7fbf281020b0 2024-09-21T03:40:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.661+0000 7fbf26d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf28106bf0 0x7fbf28103ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.661+0000 7fbf26d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf28106bf0 0x7fbf28103ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47760/0 (socket says 172.21.15.84:47760) 2024-09-21T03:40:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.661+0000 7fbf26d9d640 1 -- 172.21.15.84:0/3948298658 learned_addr learned my addr 172.21.15.84:0/3948298658 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.661+0000 7fbf25d9b640 1 --2- 172.21.15.84:0/3948298658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf281062a0 0x7fbf28103590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.662+0000 7fbf2659c640 1 --2- 172.21.15.84:0/3948298658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf281020b0 0x7fbf28103050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.662+0000 7fbf26d9d640 1 -- 172.21.15.84:0/3948298658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf281020b0 msgr2=0x7fbf28103050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.662+0000 7fbf26d9d640 1 --2- 172.21.15.84:0/3948298658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf281020b0 0x7fbf28103050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.662+0000 7fbf26d9d640 1 -- 172.21.15.84:0/3948298658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf281062a0 msgr2=0x7fbf28103590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.662+0000 7fbf26d9d640 1 --2- 172.21.15.84:0/3948298658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf281062a0 0x7fbf28103590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.662+0000 7fbf26d9d640 1 -- 172.21.15.84:0/3948298658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf281a8730 con 0x7fbf28106bf0 2024-09-21T03:40:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.662+0000 7fbf26d9d640 1 --2- 172.21.15.84:0/3948298658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf28106bf0 0x7fbf28103ad0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000c970 tx=0x7fbf2000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:44.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.662+0000 7fbf177fe640 1 -- 172.21.15.84:0/3948298658 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf20007bb0 con 0x7fbf28106bf0 2024-09-21T03:40:44.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.662+0000 7fbf2c86f640 1 -- 172.21.15.84:0/3948298658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf281a8a20 con 0x7fbf28106bf0 2024-09-21T03:40:44.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.662+0000 7fbf177fe640 1 -- 172.21.15.84:0/3948298658 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf20007d50 con 0x7fbf28106bf0 2024-09-21T03:40:44.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.662+0000 7fbf177fe640 1 -- 172.21.15.84:0/3948298658 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf20018770 con 0x7fbf28106bf0 2024-09-21T03:40:44.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.662+0000 7fbf2c86f640 1 -- 172.21.15.84:0/3948298658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf281a8f10 con 0x7fbf28106bf0 2024-09-21T03:40:44.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.663+0000 7fbf2c86f640 1 -- 172.21.15.84:0/3948298658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf281024c0 con 0x7fbf28106bf0 2024-09-21T03:40:44.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.665+0000 7fbf177fe640 1 -- 172.21.15.84:0/3948298658 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fbf2000f990 con 0x7fbf28106bf0 2024-09-21T03:40:44.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.665+0000 7fbf177fe640 1 --2- 172.21.15.84:0/3948298658 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbf100b65f0 0x7fbf100b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:44.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.665+0000 7fbf2659c640 1 --2- 172.21.15.84:0/3948298658 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbf100b65f0 0x7fbf100b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:44.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.666+0000 7fbf177fe640 1 -- 172.21.15.84:0/3948298658 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fbf200e7740 con 0x7fbf28106bf0 2024-09-21T03:40:44.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.666+0000 7fbf2659c640 1 --2- 172.21.15.84:0/3948298658 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbf100b65f0 0x7fbf100b8b00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbf18006010 tx=0x7fbf18000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:44.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.669+0000 7fbf177fe640 1 -- 172.21.15.84:0/3948298658 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbf20014030 con 0x7fbf28106bf0 2024-09-21T03:40:44.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.871+0000 7fbf2c86f640 1 -- 172.21.15.84:0/3948298658 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fbf28063800 con 0x7fbf100b65f0 2024-09-21T03:40:44.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:44 smithi174 ceph-mon[34403]: pgmap v270: 97 pgs: 97 active+clean; 588 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-09-21T03:40:44.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:44 smithi172 ceph-mon[34821]: pgmap v270: 97 pgs: 97 active+clean; 588 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-09-21T03:40:44.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.900+0000 7fbf177fe640 1 -- 172.21.15.84:0/3948298658 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbf28063800 con 0x7fbf100b65f0 2024-09-21T03:40:44.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.902+0000 7fbf2c86f640 1 -- 172.21.15.84:0/3948298658 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbf100b65f0 msgr2=0x7fbf100b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:44.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.902+0000 7fbf2c86f640 1 --2- 172.21.15.84:0/3948298658 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbf100b65f0 0x7fbf100b8b00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbf18006010 tx=0x7fbf18000bc0 comp rx=0 tx=0).stop 2024-09-21T03:40:44.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.902+0000 7fbf2c86f640 1 -- 172.21.15.84:0/3948298658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf28106bf0 msgr2=0x7fbf28103ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:44.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.902+0000 7fbf2c86f640 1 --2- 172.21.15.84:0/3948298658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf28106bf0 0x7fbf28103ad0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000c970 tx=0x7fbf2000ce30 comp rx=0 tx=0).stop 2024-09-21T03:40:44.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.902+0000 7fbf2c86f640 1 -- 172.21.15.84:0/3948298658 shutdown_connections 2024-09-21T03:40:44.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.902+0000 7fbf2c86f640 1 --2- 172.21.15.84:0/3948298658 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbf100b65f0 0x7fbf100b8b00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:44.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.902+0000 7fbf2c86f640 1 --2- 172.21.15.84:0/3948298658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbf28106bf0 0x7fbf28103ad0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:44.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.902+0000 7fbf2c86f640 1 --2- 172.21.15.84:0/3948298658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf281062a0 0x7fbf28103590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:44.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.902+0000 7fbf2c86f640 1 --2- 172.21.15.84:0/3948298658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbf281020b0 0x7fbf28103050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:44.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.902+0000 7fbf2c86f640 1 -- 172.21.15.84:0/3948298658 >> 172.21.15.84:0/3948298658 conn(0x7fbf28079e30 msgr2=0x7fbf28108150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:44.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.902+0000 7fbf2c86f640 1 -- 172.21.15.84:0/3948298658 shutdown_connections 2024-09-21T03:40:44.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:44.902+0000 7fbf2c86f640 1 -- 172.21.15.84:0/3948298658 wait complete. 2024-09-21T03:40:45.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:45 smithi084 ceph-mon[30941]: mgrmap e22: x(active, since 6m), standbys: z, y 2024-09-21T03:40:45.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:45 smithi084 ceph-mon[30941]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:45.734 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T03:40:45.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:45 smithi174 ceph-mon[34403]: mgrmap e22: x(active, since 6m), standbys: z, y 2024-09-21T03:40:45.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:45 smithi174 ceph-mon[34403]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:45.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:45 smithi172 ceph-mon[34821]: mgrmap e22: x(active, since 6m), standbys: z, y 2024-09-21T03:40:45.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:45 smithi172 ceph-mon[34821]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:45.978 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:46.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.494+0000 7fefffdfb640 1 -- 172.21.15.84:0/193871383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feff81083a0 msgr2=0x7feff81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.494+0000 7fefffdfb640 1 --2- 172.21.15.84:0/193871383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feff81083a0 0x7feff81087b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fefec009900 tx=0x7fefec02a410 comp rx=0 tx=0).stop 2024-09-21T03:40:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.494+0000 7fefffdfb640 1 -- 172.21.15.84:0/193871383 shutdown_connections 2024-09-21T03:40:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.494+0000 7fefffdfb640 1 --2- 172.21.15.84:0/193871383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feff8108cf0 0x7feff810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.494+0000 7fefffdfb640 1 --2- 172.21.15.84:0/193871383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feff81083a0 0x7feff81087b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.494+0000 7fefffdfb640 1 --2- 172.21.15.84:0/193871383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feff8102a60 0x7feff8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.494+0000 7fefffdfb640 1 -- 172.21.15.84:0/193871383 >> 172.21.15.84:0/193871383 conn(0x7feff8079730 msgr2=0x7feff8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.494+0000 7fefffdfb640 1 -- 172.21.15.84:0/193871383 shutdown_connections 2024-09-21T03:40:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.494+0000 7fefffdfb640 1 -- 172.21.15.84:0/193871383 wait complete. 2024-09-21T03:40:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.494+0000 7fefffdfb640 1 Processor -- start 2024-09-21T03:40:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.494+0000 7fefffdfb640 1 -- start start 2024-09-21T03:40:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7fefffdfb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feff8102a60 0x7feff819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7fefffdfb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feff81083a0 0x7feff819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:46.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7fefffdfb640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feff8108cf0 0x7feff819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:46.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7fefffdfb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7feff8113a80 con 0x7feff8102a60 2024-09-21T03:40:46.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7fefffdfb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feff8113900 con 0x7feff81083a0 2024-09-21T03:40:46.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7fefffdfb640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7feff8113c00 con 0x7feff8108cf0 2024-09-21T03:40:46.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7feffdb97640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feff8102a60 0x7feff819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:46.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7feffdb97640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feff8102a60 0x7feff819a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47780/0 (socket says 172.21.15.84:47780) 2024-09-21T03:40:46.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7feffdb97640 1 -- 172.21.15.84:0/2181121381 learned_addr learned my addr 172.21.15.84:0/2181121381 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:46.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7feffd396640 1 --2- 172.21.15.84:0/2181121381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feff81083a0 0x7feff819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:46.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7feffe398640 1 --2- 172.21.15.84:0/2181121381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feff8108cf0 0x7feff819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:46.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7feffdb97640 1 -- 172.21.15.84:0/2181121381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feff8108cf0 msgr2=0x7feff819fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:46.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7feffdb97640 1 --2- 172.21.15.84:0/2181121381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feff8108cf0 0x7feff819fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:46.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7feffdb97640 1 -- 172.21.15.84:0/2181121381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feff81083a0 msgr2=0x7feff819aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:46.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7feffdb97640 1 --2- 172.21.15.84:0/2181121381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feff81083a0 0x7feff819aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:46.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7feffdb97640 1 -- 172.21.15.84:0/2181121381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff81a0420 con 0x7feff8102a60 2024-09-21T03:40:46.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7feffd396640 1 --2- 172.21.15.84:0/2181121381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feff81083a0 0x7feff819aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:40:46.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7feffdb97640 1 --2- 172.21.15.84:0/2181121381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feff8102a60 0x7feff819a4b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fefe800cce0 tx=0x7fefe800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:46.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7feff6ffd640 1 -- 172.21.15.84:0/2181121381 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe8004b20 con 0x7feff8102a60 2024-09-21T03:40:46.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7feff6ffd640 1 -- 172.21.15.84:0/2181121381 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefe8004cc0 con 0x7feff8102a60 2024-09-21T03:40:46.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.495+0000 7fefffdfb640 1 -- 172.21.15.84:0/2181121381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff81a0710 con 0x7feff8102a60 2024-09-21T03:40:46.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.496+0000 7feff6ffd640 1 -- 172.21.15.84:0/2181121381 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe800f6b0 con 0x7feff8102a60 2024-09-21T03:40:46.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.496+0000 7fefffdfb640 1 -- 172.21.15.84:0/2181121381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff81a6e70 con 0x7feff8102a60 2024-09-21T03:40:46.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.496+0000 7fefffdfb640 1 -- 172.21.15.84:0/2181121381 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff8102e70 con 0x7feff8102a60 2024-09-21T03:40:46.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.499+0000 7feff6ffd640 1 -- 172.21.15.84:0/2181121381 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fefe800f850 con 0x7feff8102a60 2024-09-21T03:40:46.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.499+0000 7feff6ffd640 1 --2- 172.21.15.84:0/2181121381 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fefe00b65f0 0x7fefe00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:46.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.500+0000 7feffd396640 1 --2- 172.21.15.84:0/2181121381 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fefe00b65f0 0x7fefe00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:46.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.500+0000 7feff6ffd640 1 -- 172.21.15.84:0/2181121381 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fefe80e79f0 con 0x7feff8102a60 2024-09-21T03:40:46.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.500+0000 7feffd396640 1 --2- 172.21.15.84:0/2181121381 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fefe00b65f0 0x7fefe00b8b00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fefec000c00 tx=0x7fefec031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:46.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.503+0000 7feff6ffd640 1 -- 172.21.15.84:0/2181121381 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fefe8014030 con 0x7feff8102a60 2024-09-21T03:40:46.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.711+0000 7fefffdfb640 1 -- 172.21.15.84:0/2181121381 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7feff8063800 con 0x7fefe00b65f0 2024-09-21T03:40:46.713 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:46 smithi084 ceph-mon[30941]: pgmap v271: 97 pgs: 97 active+clean; 588 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-21T03:40:46.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.718+0000 7feff6ffd640 1 -- 172.21.15.84:0/2181121381 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7feff8063800 con 0x7fefe00b65f0 2024-09-21T03:40:46.720 INFO:teuthology.orchestra.run.smithi084.stdout:/volumes/qa/sv_0/38e136ad-e6ea-4b5b-8ce3-a7ccc3cfd310 2024-09-21T03:40:46.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.720+0000 7fefffdfb640 1 -- 172.21.15.84:0/2181121381 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fefe00b65f0 msgr2=0x7fefe00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:46.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.720+0000 7fefffdfb640 1 --2- 172.21.15.84:0/2181121381 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fefe00b65f0 0x7fefe00b8b00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fefec000c00 tx=0x7fefec031400 comp rx=0 tx=0).stop 2024-09-21T03:40:46.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.721+0000 7fefffdfb640 1 -- 172.21.15.84:0/2181121381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feff8102a60 msgr2=0x7feff819a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:46.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.721+0000 7fefffdfb640 1 --2- 172.21.15.84:0/2181121381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feff8102a60 0x7feff819a4b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fefe800cce0 tx=0x7fefe800a620 comp rx=0 tx=0).stop 2024-09-21T03:40:46.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.721+0000 7fefffdfb640 1 -- 172.21.15.84:0/2181121381 shutdown_connections 2024-09-21T03:40:46.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.721+0000 7fefffdfb640 1 --2- 172.21.15.84:0/2181121381 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fefe00b65f0 0x7fefe00b8b00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:46.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.721+0000 7fefffdfb640 1 --2- 172.21.15.84:0/2181121381 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7feff8108cf0 0x7feff819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:46.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.721+0000 7fefffdfb640 1 --2- 172.21.15.84:0/2181121381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feff81083a0 0x7feff819aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:46.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.721+0000 7fefffdfb640 1 --2- 172.21.15.84:0/2181121381 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7feff8102a60 0x7feff819a4b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:46.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.721+0000 7fefffdfb640 1 -- 172.21.15.84:0/2181121381 >> 172.21.15.84:0/2181121381 conn(0x7feff8079730 msgr2=0x7feff8104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:46.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.721+0000 7fefffdfb640 1 -- 172.21.15.84:0/2181121381 shutdown_connections 2024-09-21T03:40:46.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:46.721+0000 7fefffdfb640 1 -- 172.21.15.84:0/2181121381 wait complete. 2024-09-21T03:40:46.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:46 smithi174 ceph-mon[34403]: pgmap v271: 97 pgs: 97 active+clean; 588 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-21T03:40:46.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:46 smithi172 ceph-mon[34821]: pgmap v271: 97 pgs: 97 active+clean; 588 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-21T03:40:47.568 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T03:40:47.813 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:47.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:47 smithi084 ceph-mon[30941]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:47.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:47 smithi174 ceph-mon[34403]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:47.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:47 smithi172 ceph-mon[34821]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:48.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.337+0000 7fefed9a5640 1 -- 172.21.15.84:0/247217299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefe8108cf0 msgr2=0x7fefe810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:48.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.337+0000 7fefed9a5640 1 --2- 172.21.15.84:0/247217299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefe8108cf0 0x7fefe810f520 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009ca0 tx=0x7fefe002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:40:48.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.337+0000 7fefed9a5640 1 -- 172.21.15.84:0/247217299 shutdown_connections 2024-09-21T03:40:48.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.337+0000 7fefed9a5640 1 --2- 172.21.15.84:0/247217299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefe8108cf0 0x7fefe810f520 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:48.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.337+0000 7fefed9a5640 1 --2- 172.21.15.84:0/247217299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefe81083a0 0x7fefe81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:48.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.337+0000 7fefed9a5640 1 --2- 172.21.15.84:0/247217299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefe8102a60 0x7fefe8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:48.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.337+0000 7fefed9a5640 1 -- 172.21.15.84:0/247217299 >> 172.21.15.84:0/247217299 conn(0x7fefe8079730 msgr2=0x7fefe8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:48.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.337+0000 7fefed9a5640 1 -- 172.21.15.84:0/247217299 shutdown_connections 2024-09-21T03:40:48.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.337+0000 7fefed9a5640 1 -- 172.21.15.84:0/247217299 wait complete. 2024-09-21T03:40:48.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.338+0000 7fefed9a5640 1 Processor -- start 2024-09-21T03:40:48.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.338+0000 7fefed9a5640 1 -- start start 2024-09-21T03:40:48.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.338+0000 7fefed9a5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefe8102a60 0x7fefe8199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:48.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.338+0000 7fefed9a5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefe81083a0 0x7fefe81999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:48.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.338+0000 7fefed9a5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefe8108cf0 0x7fefe819ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:48.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.338+0000 7fefed9a5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fefe81129e0 con 0x7fefe81083a0 2024-09-21T03:40:48.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.338+0000 7fefed9a5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fefe8112860 con 0x7fefe8108cf0 2024-09-21T03:40:48.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.338+0000 7fefed9a5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fefe8112b60 con 0x7fefe8102a60 2024-09-21T03:40:48.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.338+0000 7fefe67fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefe81083a0 0x7fefe81999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:48.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.338+0000 7fefe67fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefe81083a0 0x7fefe81999b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54852/0 (socket says 172.21.15.84:54852) 2024-09-21T03:40:48.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.338+0000 7fefe67fc640 1 -- 172.21.15.84:0/2233837573 learned_addr learned my addr 172.21.15.84:0/2233837573 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:48.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.338+0000 7fefe77fe640 1 --2- 172.21.15.84:0/2233837573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefe8108cf0 0x7fefe819ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:48.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.338+0000 7fefe6ffd640 1 --2- 172.21.15.84:0/2233837573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefe8102a60 0x7fefe8199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:48.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.339+0000 7fefe67fc640 1 -- 172.21.15.84:0/2233837573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefe8102a60 msgr2=0x7fefe8199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:48.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.339+0000 7fefe67fc640 1 --2- 172.21.15.84:0/2233837573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefe8102a60 0x7fefe8199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:48.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.339+0000 7fefe67fc640 1 -- 172.21.15.84:0/2233837573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefe8108cf0 msgr2=0x7fefe819ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:48.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.339+0000 7fefe67fc640 1 --2- 172.21.15.84:0/2233837573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefe8108cf0 0x7fefe819ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:48.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.339+0000 7fefe67fc640 1 -- 172.21.15.84:0/2233837573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe819f380 con 0x7fefe81083a0 2024-09-21T03:40:48.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.339+0000 7fefe67fc640 1 --2- 172.21.15.84:0/2233837573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefe81083a0 0x7fefe81999b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fefd000b450 tx=0x7fefd000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:48.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.339+0000 7fefec9a3640 1 -- 172.21.15.84:0/2233837573 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd0015020 con 0x7fefe81083a0 2024-09-21T03:40:48.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.339+0000 7fefed9a5640 1 -- 172.21.15.84:0/2233837573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe819f670 con 0x7fefe81083a0 2024-09-21T03:40:48.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.339+0000 7fefec9a3640 1 -- 172.21.15.84:0/2233837573 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefd0011d40 con 0x7fefe81083a0 2024-09-21T03:40:48.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.339+0000 7fefec9a3640 1 -- 172.21.15.84:0/2233837573 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd000f340 con 0x7fefe81083a0 2024-09-21T03:40:48.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.339+0000 7fefed9a5640 1 -- 172.21.15.84:0/2233837573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe81a5dd0 con 0x7fefe81083a0 2024-09-21T03:40:48.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.340+0000 7fefed9a5640 1 -- 172.21.15.84:0/2233837573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefe8102e70 con 0x7fefe81083a0 2024-09-21T03:40:48.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.342+0000 7fefec9a3640 1 -- 172.21.15.84:0/2233837573 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fefd0018020 con 0x7fefe81083a0 2024-09-21T03:40:48.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.342+0000 7fefec9a3640 1 --2- 172.21.15.84:0/2233837573 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fefd40b65f0 0x7fefd40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:48.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.342+0000 7fefe6ffd640 1 --2- 172.21.15.84:0/2233837573 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fefd40b65f0 0x7fefd40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:48.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.342+0000 7fefec9a3640 1 -- 172.21.15.84:0/2233837573 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fefd00e73a0 con 0x7fefe81083a0 2024-09-21T03:40:48.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.343+0000 7fefe6ffd640 1 --2- 172.21.15.84:0/2233837573 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fefd40b65f0 0x7fefd40b8b00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fefd80058c0 tx=0x7fefd800a250 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:48.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.345+0000 7fefec9a3640 1 -- 172.21.15.84:0/2233837573 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fefd001f020 con 0x7fefe81083a0 2024-09-21T03:40:48.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.552+0000 7fefed9a5640 1 -- 172.21.15.84:0/2233837573 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fefe8063800 con 0x7fefd40b65f0 2024-09-21T03:40:48.555 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:48 smithi084 ceph-mon[30941]: pgmap v272: 97 pgs: 97 active+clean; 588 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-09-21T03:40:48.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.582+0000 7fefec9a3640 1 -- 172.21.15.84:0/2233837573 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fefe8063800 con 0x7fefd40b65f0 2024-09-21T03:40:48.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.584+0000 7fefed9a5640 1 -- 172.21.15.84:0/2233837573 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fefd40b65f0 msgr2=0x7fefd40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:48.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.584+0000 7fefed9a5640 1 --2- 172.21.15.84:0/2233837573 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fefd40b65f0 0x7fefd40b8b00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fefd80058c0 tx=0x7fefd800a250 comp rx=0 tx=0).stop 2024-09-21T03:40:48.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.584+0000 7fefed9a5640 1 -- 172.21.15.84:0/2233837573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefe81083a0 msgr2=0x7fefe81999b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.584+0000 7fefed9a5640 1 --2- 172.21.15.84:0/2233837573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefe81083a0 0x7fefe81999b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fefd000b450 tx=0x7fefd000b910 comp rx=0 tx=0).stop 2024-09-21T03:40:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.584+0000 7fefed9a5640 1 -- 172.21.15.84:0/2233837573 shutdown_connections 2024-09-21T03:40:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.584+0000 7fefed9a5640 1 --2- 172.21.15.84:0/2233837573 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fefd40b65f0 0x7fefd40b8b00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.584+0000 7fefed9a5640 1 --2- 172.21.15.84:0/2233837573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefe8108cf0 0x7fefe819ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.584+0000 7fefed9a5640 1 --2- 172.21.15.84:0/2233837573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fefe81083a0 0x7fefe81999b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.584+0000 7fefed9a5640 1 --2- 172.21.15.84:0/2233837573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fefe8102a60 0x7fefe8199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.584+0000 7fefed9a5640 1 -- 172.21.15.84:0/2233837573 >> 172.21.15.84:0/2233837573 conn(0x7fefe8079730 msgr2=0x7fefe8105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.585+0000 7fefed9a5640 1 -- 172.21.15.84:0/2233837573 shutdown_connections 2024-09-21T03:40:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:48.585+0000 7fefed9a5640 1 -- 172.21.15.84:0/2233837573 wait complete. 2024-09-21T03:40:48.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:48 smithi174 ceph-mon[34403]: pgmap v272: 97 pgs: 97 active+clean; 588 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-09-21T03:40:48.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:48 smithi172 ceph-mon[34821]: pgmap v272: 97 pgs: 97 active+clean; 588 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-09-21T03:40:49.385 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T03:40:49.631 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:49.751 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:49 smithi084 ceph-mon[30941]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:49.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:49 smithi174 ceph-mon[34403]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:49.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:49 smithi172 ceph-mon[34821]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:50.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.160+0000 7fb82c5e6640 1 -- 172.21.15.84:0/4011397441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb824109df0 msgr2=0x7fb824110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:50.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.160+0000 7fb82c5e6640 1 --2- 172.21.15.84:0/4011397441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb824109df0 0x7fb824110620 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009ca0 tx=0x7fb81c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:40:50.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.160+0000 7fb82c5e6640 1 -- 172.21.15.84:0/4011397441 shutdown_connections 2024-09-21T03:40:50.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.160+0000 7fb82c5e6640 1 --2- 172.21.15.84:0/4011397441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb824109df0 0x7fb824110620 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:50.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.160+0000 7fb82c5e6640 1 --2- 172.21.15.84:0/4011397441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8241094a0 0x7fb8241098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:50.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.160+0000 7fb82c5e6640 1 --2- 172.21.15.84:0/4011397441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb824103b60 0x7fb824103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:50.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.160+0000 7fb82c5e6640 1 -- 172.21.15.84:0/4011397441 >> 172.21.15.84:0/4011397441 conn(0x7fb82407b850 msgr2=0x7fb82407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:50.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.160+0000 7fb82c5e6640 1 -- 172.21.15.84:0/4011397441 shutdown_connections 2024-09-21T03:40:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.160+0000 7fb82c5e6640 1 -- 172.21.15.84:0/4011397441 wait complete. 2024-09-21T03:40:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.161+0000 7fb82c5e6640 1 Processor -- start 2024-09-21T03:40:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.161+0000 7fb82c5e6640 1 -- start start 2024-09-21T03:40:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.161+0000 7fb82c5e6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb824103b60 0x7fb82419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.161+0000 7fb82c5e6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8241094a0 0x7fb82419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.161+0000 7fb82c5e6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb824109df0 0x7fb82419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.161+0000 7fb82c5e6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb824113b10 con 0x7fb824103b60 2024-09-21T03:40:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.161+0000 7fb82c5e6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb824113990 con 0x7fb8241094a0 2024-09-21T03:40:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.161+0000 7fb82c5e6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb824113c90 con 0x7fb824109df0 2024-09-21T03:40:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.161+0000 7fb82a382640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb824103b60 0x7fb82419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.161+0000 7fb82a382640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb824103b60 0x7fb82419a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54860/0 (socket says 172.21.15.84:54860) 2024-09-21T03:40:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.161+0000 7fb82a382640 1 -- 172.21.15.84:0/1748683520 learned_addr learned my addr 172.21.15.84:0/1748683520 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:50.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.162+0000 7fb82ab83640 1 --2- 172.21.15.84:0/1748683520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb824109df0 0x7fb82419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.162+0000 7fb829b81640 1 --2- 172.21.15.84:0/1748683520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8241094a0 0x7fb82419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.162+0000 7fb82a382640 1 -- 172.21.15.84:0/1748683520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb824109df0 msgr2=0x7fb82419fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.162+0000 7fb82a382640 1 --2- 172.21.15.84:0/1748683520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb824109df0 0x7fb82419fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.162+0000 7fb82a382640 1 -- 172.21.15.84:0/1748683520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8241094a0 msgr2=0x7fb82419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.162+0000 7fb82a382640 1 --2- 172.21.15.84:0/1748683520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8241094a0 0x7fb82419aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.162+0000 7fb82a382640 1 -- 172.21.15.84:0/1748683520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8241a0390 con 0x7fb824103b60 2024-09-21T03:40:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.162+0000 7fb82a382640 1 --2- 172.21.15.84:0/1748683520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb824103b60 0x7fb82419a4e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb81400b4a0 tx=0x7fb81400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.162+0000 7fb8237fe640 1 -- 172.21.15.84:0/1748683520 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814014070 con 0x7fb824103b60 2024-09-21T03:40:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.162+0000 7fb82c5e6640 1 -- 172.21.15.84:0/1748683520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8241a0680 con 0x7fb824103b60 2024-09-21T03:40:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.162+0000 7fb8237fe640 1 -- 172.21.15.84:0/1748683520 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb814010ac0 con 0x7fb824103b60 2024-09-21T03:40:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.162+0000 7fb8237fe640 1 -- 172.21.15.84:0/1748683520 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81401e060 con 0x7fb824103b60 2024-09-21T03:40:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.162+0000 7fb82c5e6640 1 -- 172.21.15.84:0/1748683520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8241a6ea0 con 0x7fb824103b60 2024-09-21T03:40:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.163+0000 7fb82c5e6640 1 -- 172.21.15.84:0/1748683520 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb824103f70 con 0x7fb824103b60 2024-09-21T03:40:50.187 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.165+0000 7fb8237fe640 1 -- 172.21.15.84:0/1748683520 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fb814017070 con 0x7fb824103b60 2024-09-21T03:40:50.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.165+0000 7fb8237fe640 1 --2- 172.21.15.84:0/1748683520 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb80c0b6620 0x7fb80c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:50.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.165+0000 7fb829b81640 1 --2- 172.21.15.84:0/1748683520 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb80c0b6620 0x7fb80c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:50.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.166+0000 7fb8237fe640 1 -- 172.21.15.84:0/1748683520 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fb8140e6d20 con 0x7fb824103b60 2024-09-21T03:40:50.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.166+0000 7fb829b81640 1 --2- 172.21.15.84:0/1748683520 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb80c0b6620 0x7fb80c0b8b30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb824108fc0 tx=0x7fb818005cc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:50.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.168+0000 7fb8237fe640 1 -- 172.21.15.84:0/1748683520 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb8140ad470 con 0x7fb824103b60 2024-09-21T03:40:50.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.378+0000 7fb82c5e6640 1 -- 172.21.15.84:0/1748683520 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fb824063800 con 0x7fb80c0b6620 2024-09-21T03:40:50.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.383+0000 7fb8237fe640 1 -- 172.21.15.84:0/1748683520 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fb824063800 con 0x7fb80c0b6620 2024-09-21T03:40:50.384 INFO:teuthology.orchestra.run.smithi084.stdout:/volumes/qa/sv_1/1797eb52-0f11-4c8e-b4b4-dae56405551a 2024-09-21T03:40:50.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.385+0000 7fb82c5e6640 1 -- 172.21.15.84:0/1748683520 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb80c0b6620 msgr2=0x7fb80c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:50.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.385+0000 7fb82c5e6640 1 --2- 172.21.15.84:0/1748683520 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb80c0b6620 0x7fb80c0b8b30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb824108fc0 tx=0x7fb818005cc0 comp rx=0 tx=0).stop 2024-09-21T03:40:50.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.385+0000 7fb82c5e6640 1 -- 172.21.15.84:0/1748683520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb824103b60 msgr2=0x7fb82419a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:50.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.385+0000 7fb82c5e6640 1 --2- 172.21.15.84:0/1748683520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb824103b60 0x7fb82419a4e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb81400b4a0 tx=0x7fb81400b960 comp rx=0 tx=0).stop 2024-09-21T03:40:50.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.385+0000 7fb82c5e6640 1 -- 172.21.15.84:0/1748683520 shutdown_connections 2024-09-21T03:40:50.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.385+0000 7fb82c5e6640 1 --2- 172.21.15.84:0/1748683520 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb80c0b6620 0x7fb80c0b8b30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:50.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.385+0000 7fb82c5e6640 1 --2- 172.21.15.84:0/1748683520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb824109df0 0x7fb82419fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:50.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.385+0000 7fb82c5e6640 1 --2- 172.21.15.84:0/1748683520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8241094a0 0x7fb82419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:50.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.385+0000 7fb82c5e6640 1 --2- 172.21.15.84:0/1748683520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb824103b60 0x7fb82419a4e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:50.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.385+0000 7fb82c5e6640 1 -- 172.21.15.84:0/1748683520 >> 172.21.15.84:0/1748683520 conn(0x7fb82407b850 msgr2=0x7fb8241074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:50.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.385+0000 7fb82c5e6640 1 -- 172.21.15.84:0/1748683520 shutdown_connections 2024-09-21T03:40:50.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:50.385+0000 7fb82c5e6640 1 -- 172.21.15.84:0/1748683520 wait complete. 2024-09-21T03:40:50.777 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:50 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-21T03:40:50.777 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:50 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2024-09-21T03:40:50.777 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:50 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T03:40:50.777 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:50 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-09-21T03:40:50.777 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:50 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-21T03:40:50.777 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:50 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-21T03:40:50.778 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:50 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-09-21T03:40:50.778 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:50 smithi084 ceph-mon[30941]: pgmap v273: 97 pgs: 97 active+clean; 604 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-09-21T03:40:50.778 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:50 smithi084 ceph-mon[30941]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:50.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:50 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-21T03:40:50.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:50 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2024-09-21T03:40:50.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:50 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T03:40:50.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:50 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-09-21T03:40:50.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:50 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-21T03:40:50.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:50 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-21T03:40:50.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:50 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-09-21T03:40:50.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:50 smithi174 ceph-mon[34403]: pgmap v273: 97 pgs: 97 active+clean; 604 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-09-21T03:40:50.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:50 smithi174 ceph-mon[34403]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:50.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:50 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-21T03:40:50.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:50 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2024-09-21T03:40:50.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:50 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T03:40:50.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:50 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-09-21T03:40:50.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:50 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-21T03:40:50.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:50 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-21T03:40:50.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:50 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-09-21T03:40:50.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:50 smithi172 ceph-mon[34821]: pgmap v273: 97 pgs: 97 active+clean; 604 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-09-21T03:40:50.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:50 smithi172 ceph-mon[34821]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:40:51.110 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:40:51.355 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:51.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-21T03:40:51.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-21T03:40:51.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T03:40:51.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-21T03:40:51.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-21T03:40:51.734 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-21T03:40:51.735 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:51 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-21T03:40:51.735 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:51 smithi084 ceph-mon[30941]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T03:40:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.821+0000 7f990ecf8640 1 -- 172.21.15.84:0/1459646986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9908108d30 msgr2=0x7f990810f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.821+0000 7f990ecf8640 1 --2- 172.21.15.84:0/1459646986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9908108d30 0x7f990810f560 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9900009900 tx=0x7f990002a410 comp rx=0 tx=0).stop 2024-09-21T03:40:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.821+0000 7f990ecf8640 1 -- 172.21.15.84:0/1459646986 shutdown_connections 2024-09-21T03:40:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.821+0000 7f990ecf8640 1 --2- 172.21.15.84:0/1459646986 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9908108d30 0x7f990810f560 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.821+0000 7f990ecf8640 1 --2- 172.21.15.84:0/1459646986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99081083e0 0x7f99081087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.821+0000 7f990ecf8640 1 --2- 172.21.15.84:0/1459646986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9908102aa0 0x7f9908102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.821+0000 7f990ecf8640 1 -- 172.21.15.84:0/1459646986 >> 172.21.15.84:0/1459646986 conn(0x7f99080797e0 msgr2=0x7f9908079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.821+0000 7f990ecf8640 1 -- 172.21.15.84:0/1459646986 shutdown_connections 2024-09-21T03:40:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.821+0000 7f990ecf8640 1 -- 172.21.15.84:0/1459646986 wait complete. 2024-09-21T03:40:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.822+0000 7f990ecf8640 1 Processor -- start 2024-09-21T03:40:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.822+0000 7f990ecf8640 1 -- start start 2024-09-21T03:40:51.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.822+0000 7f990ecf8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9908102aa0 0x7f990819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.822+0000 7f990ecf8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99081083e0 0x7f990819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.822+0000 7f990ecf8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9908108d30 0x7f990819fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.822+0000 7f990ecf8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9908113b80 con 0x7f9908102aa0 2024-09-21T03:40:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.822+0000 7f990ecf8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9908113a00 con 0x7f99081083e0 2024-09-21T03:40:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.822+0000 7f990ecf8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9908113d00 con 0x7f9908108d30 2024-09-21T03:40:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.822+0000 7f990ca94640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9908102aa0 0x7f990819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.822+0000 7f990ca94640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9908102aa0 0x7f990819a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54882/0 (socket says 172.21.15.84:54882) 2024-09-21T03:40:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.822+0000 7f990ca94640 1 -- 172.21.15.84:0/1222057018 learned_addr learned my addr 172.21.15.84:0/1222057018 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.822+0000 7f9907fff640 1 --2- 172.21.15.84:0/1222057018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99081083e0 0x7f990819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.822+0000 7f990d295640 1 --2- 172.21.15.84:0/1222057018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9908108d30 0x7f990819fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.823+0000 7f990ca94640 1 -- 172.21.15.84:0/1222057018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9908108d30 msgr2=0x7f990819fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.823+0000 7f990ca94640 1 --2- 172.21.15.84:0/1222057018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9908108d30 0x7f990819fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:51.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.823+0000 7f990ca94640 1 -- 172.21.15.84:0/1222057018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99081083e0 msgr2=0x7f990819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:51.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.823+0000 7f990ca94640 1 --2- 172.21.15.84:0/1222057018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99081083e0 0x7f990819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:51.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.823+0000 7f990ca94640 1 -- 172.21.15.84:0/1222057018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99081a0520 con 0x7f9908102aa0 2024-09-21T03:40:51.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.823+0000 7f990d295640 1 --2- 172.21.15.84:0/1222057018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9908108d30 0x7f990819fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:40:51.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.823+0000 7f990ca94640 1 --2- 172.21.15.84:0/1222057018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9908102aa0 0x7f990819a5b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f98f800ba50 tx=0x7f98f800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:51.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.823+0000 7f9905ffb640 1 -- 172.21.15.84:0/1222057018 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8019070 con 0x7f9908102aa0 2024-09-21T03:40:51.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.823+0000 7f9905ffb640 1 -- 172.21.15.84:0/1222057018 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98f8014440 con 0x7f9908102aa0 2024-09-21T03:40:51.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.823+0000 7f990ecf8640 1 -- 172.21.15.84:0/1222057018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99081a0810 con 0x7f9908102aa0 2024-09-21T03:40:51.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.823+0000 7f9905ffb640 1 -- 172.21.15.84:0/1222057018 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f80075b0 con 0x7f9908102aa0 2024-09-21T03:40:51.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.823+0000 7f990ecf8640 1 -- 172.21.15.84:0/1222057018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99081a6f70 con 0x7f9908102aa0 2024-09-21T03:40:51.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.824+0000 7f990ecf8640 1 -- 172.21.15.84:0/1222057018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9908102f30 con 0x7f9908102aa0 2024-09-21T03:40:51.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.825+0000 7f9905ffb640 1 -- 172.21.15.84:0/1222057018 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f98f801c070 con 0x7f9908102aa0 2024-09-21T03:40:51.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.826+0000 7f9905ffb640 1 --2- 172.21.15.84:0/1222057018 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f98f40b65f0 0x7f98f40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:51.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.826+0000 7f9907fff640 1 --2- 172.21.15.84:0/1222057018 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f98f40b65f0 0x7f98f40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:51.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.826+0000 7f9905ffb640 1 -- 172.21.15.84:0/1222057018 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f98f80e6ab0 con 0x7f9908102aa0 2024-09-21T03:40:51.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.827+0000 7f9907fff640 1 --2- 172.21.15.84:0/1222057018 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f98f40b65f0 0x7f98f40b8b00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9908107ab0 tx=0x7f98f0009110 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:51.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:51.830+0000 7f9905ffb640 1 -- 172.21.15.84:0/1222057018 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f98f80ad140 con 0x7f9908102aa0 2024-09-21T03:40:51.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-21T03:40:51.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-21T03:40:51.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T03:40:51.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-21T03:40:51.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-21T03:40:51.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-21T03:40:51.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:51 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-21T03:40:51.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:51 smithi174 ceph-mon[34403]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T03:40:51.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-21T03:40:51.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-21T03:40:51.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T03:40:51.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-09-21T03:40:51.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-21T03:40:51.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-21T03:40:51.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:51 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-21T03:40:51.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:51 smithi172 ceph-mon[34821]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T03:40:52.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:52.048+0000 7f990ecf8640 1 -- 172.21.15.84:0/1222057018 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f990802e640 con 0x7f9908102aa0 2024-09-21T03:40:52.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:52.049+0000 7f9905ffb640 1 -- 172.21.15.84:0/1222057018 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7f98f80b1520 con 0x7f9908102aa0 2024-09-21T03:40:52.051 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:40:52.051 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"btime":"2024-09-21T03:40:41:408095+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:40:41.132161+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24634,24638,24668]},"id":1}]} 2024-09-21T03:40:52.052 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 24 2024-09-21T03:40:52.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:52.051+0000 7f990ecf8640 1 -- 172.21.15.84:0/1222057018 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f98f40b65f0 msgr2=0x7f98f40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:52.052+0000 7f990ecf8640 1 --2- 172.21.15.84:0/1222057018 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f98f40b65f0 0x7f98f40b8b00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9908107ab0 tx=0x7f98f0009110 comp rx=0 tx=0).stop 2024-09-21T03:40:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:52.052+0000 7f990ecf8640 1 -- 172.21.15.84:0/1222057018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9908102aa0 msgr2=0x7f990819a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:52.052+0000 7f990ecf8640 1 --2- 172.21.15.84:0/1222057018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9908102aa0 0x7f990819a5b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f98f800ba50 tx=0x7f98f800be50 comp rx=0 tx=0).stop 2024-09-21T03:40:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:52.052+0000 7f990ecf8640 1 -- 172.21.15.84:0/1222057018 shutdown_connections 2024-09-21T03:40:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:52.052+0000 7f990ecf8640 1 --2- 172.21.15.84:0/1222057018 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f98f40b65f0 0x7f98f40b8b00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:52.052+0000 7f990ecf8640 1 --2- 172.21.15.84:0/1222057018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9908108d30 0x7f990819fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:52.052+0000 7f990ecf8640 1 --2- 172.21.15.84:0/1222057018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99081083e0 0x7f990819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:52.052+0000 7f990ecf8640 1 --2- 172.21.15.84:0/1222057018 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9908102aa0 0x7f990819a5b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:52.052+0000 7f990ecf8640 1 -- 172.21.15.84:0/1222057018 >> 172.21.15.84:0/1222057018 conn(0x7f99080797e0 msgr2=0x7f99081052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:52.052+0000 7f990ecf8640 1 -- 172.21.15.84:0/1222057018 shutdown_connections 2024-09-21T03:40:52.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:52.052+0000 7f990ecf8640 1 -- 172.21.15.84:0/1222057018 wait complete. 2024-09-21T03:40:52.705 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:52 smithi084 ceph-mon[30941]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T03:40:52.705 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:52 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1222057018' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:52.706 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:52 smithi084 ceph-mon[30941]: pgmap v276: 97 pgs: 97 active+clean; 604 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.6 KiB/s wr, 6 op/s; 126 B/s, 0 objects/s recovering 2024-09-21T03:40:52.732 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:40:52.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:52 smithi174 ceph-mon[34403]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T03:40:52.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:52 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1222057018' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:52.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:52 smithi174 ceph-mon[34403]: pgmap v276: 97 pgs: 97 active+clean; 604 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.6 KiB/s wr, 6 op/s; 126 B/s, 0 objects/s recovering 2024-09-21T03:40:52.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:52 smithi172 ceph-mon[34821]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T03:40:52.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:52 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1222057018' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:52.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:52 smithi172 ceph-mon[34821]: pgmap v276: 97 pgs: 97 active+clean; 604 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.6 KiB/s wr, 6 op/s; 126 B/s, 0 objects/s recovering 2024-09-21T03:40:52.975 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:53.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.477+0000 7f4778bf0640 1 -- 172.21.15.84:0/2173817932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4774108cf0 msgr2=0x7f477410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:53.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.477+0000 7f4778bf0640 1 --2- 172.21.15.84:0/2173817932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4774108cf0 0x7f477410f520 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f476c009ca0 tx=0x7f476c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:40:53.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.478+0000 7f4778bf0640 1 -- 172.21.15.84:0/2173817932 shutdown_connections 2024-09-21T03:40:53.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.478+0000 7f4778bf0640 1 --2- 172.21.15.84:0/2173817932 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4774108cf0 0x7f477410f520 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:53.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.478+0000 7f4778bf0640 1 --2- 172.21.15.84:0/2173817932 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47741083a0 0x7f47741087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:53.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.478+0000 7f4778bf0640 1 --2- 172.21.15.84:0/2173817932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4774102a60 0x7f4774102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:53.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.478+0000 7f4778bf0640 1 -- 172.21.15.84:0/2173817932 >> 172.21.15.84:0/2173817932 conn(0x7f4774079730 msgr2=0x7f4774079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:53.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.478+0000 7f4778bf0640 1 -- 172.21.15.84:0/2173817932 shutdown_connections 2024-09-21T03:40:53.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.478+0000 7f4778bf0640 1 -- 172.21.15.84:0/2173817932 wait complete. 2024-09-21T03:40:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.478+0000 7f4778bf0640 1 Processor -- start 2024-09-21T03:40:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.479+0000 7f4778bf0640 1 -- start start 2024-09-21T03:40:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.479+0000 7f4778bf0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4774102a60 0x7f477419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.479+0000 7f4778bf0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47741083a0 0x7f477419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.479+0000 7f4778bf0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4774108cf0 0x7f477419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.479+0000 7f4778bf0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4774112960 con 0x7f47741083a0 2024-09-21T03:40:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.479+0000 7f4778bf0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f47741127e0 con 0x7f4774108cf0 2024-09-21T03:40:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.479+0000 7f4778bf0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4774112ae0 con 0x7f4774102a60 2024-09-21T03:40:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.479+0000 7f4769d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47741083a0 0x7f477419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.479+0000 7f4769d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47741083a0 0x7f477419aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54904/0 (socket says 172.21.15.84:54904) 2024-09-21T03:40:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.479+0000 7f4769d9b640 1 -- 172.21.15.84:0/2302255604 learned_addr learned my addr 172.21.15.84:0/2302255604 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:53.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.479+0000 7f4772d9d640 1 --2- 172.21.15.84:0/2302255604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4774108cf0 0x7f477419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.479+0000 7f477259c640 1 --2- 172.21.15.84:0/2302255604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4774102a60 0x7f477419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.479+0000 7f4769d9b640 1 -- 172.21.15.84:0/2302255604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4774102a60 msgr2=0x7f477419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.479+0000 7f4769d9b640 1 --2- 172.21.15.84:0/2302255604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4774102a60 0x7f477419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.479+0000 7f4769d9b640 1 -- 172.21.15.84:0/2302255604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4774108cf0 msgr2=0x7f477419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.479+0000 7f4769d9b640 1 --2- 172.21.15.84:0/2302255604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4774108cf0 0x7f477419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.479+0000 7f4769d9b640 1 -- 172.21.15.84:0/2302255604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47741a0410 con 0x7f47741083a0 2024-09-21T03:40:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.480+0000 7f4769d9b640 1 --2- 172.21.15.84:0/2302255604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47741083a0 0x7f477419aa40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f475c00c970 tx=0x7f475c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.480+0000 7f476bfff640 1 -- 172.21.15.84:0/2302255604 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c007bb0 con 0x7f47741083a0 2024-09-21T03:40:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.480+0000 7f476bfff640 1 -- 172.21.15.84:0/2302255604 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f475c007d50 con 0x7f47741083a0 2024-09-21T03:40:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.480+0000 7f4778bf0640 1 -- 172.21.15.84:0/2302255604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47741a0700 con 0x7f47741083a0 2024-09-21T03:40:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.480+0000 7f476bfff640 1 -- 172.21.15.84:0/2302255604 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c00f450 con 0x7f47741083a0 2024-09-21T03:40:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.480+0000 7f4778bf0640 1 -- 172.21.15.84:0/2302255604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47741a6e60 con 0x7f47741083a0 2024-09-21T03:40:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.481+0000 7f4778bf0640 1 -- 172.21.15.84:0/2302255604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4774102e70 con 0x7f47741083a0 2024-09-21T03:40:53.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.482+0000 7f476bfff640 1 -- 172.21.15.84:0/2302255604 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f475c005020 con 0x7f47741083a0 2024-09-21T03:40:53.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.483+0000 7f476bfff640 1 --2- 172.21.15.84:0/2302255604 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f47600b65f0 0x7f47600b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:53.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.483+0000 7f477259c640 1 --2- 172.21.15.84:0/2302255604 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f47600b65f0 0x7f47600b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:53.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.483+0000 7f476bfff640 1 -- 172.21.15.84:0/2302255604 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f475c0e7560 con 0x7f47741083a0 2024-09-21T03:40:53.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.484+0000 7f477259c640 1 --2- 172.21.15.84:0/2302255604 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f47600b65f0 0x7f47600b8b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4764005fd0 tx=0x7f476400b590 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:53.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.487+0000 7f476bfff640 1 -- 172.21.15.84:0/2302255604 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f475c014030 con 0x7f47741083a0 2024-09-21T03:40:53.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.668+0000 7f4778bf0640 1 -- 172.21.15.84:0/2302255604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f477410b560 con 0x7f47741083a0 2024-09-21T03:40:53.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.669+0000 7f476bfff640 1 -- 172.21.15.84:0/2302255604 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+23019 (secure 0 0 0) 0x7f475c0adbf0 con 0x7f47741083a0 2024-09-21T03:40:53.672 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:40:53.672 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":77,"fsid":"e3f8c18e-77c9-11ef-baf5-efdc52797490","created":"2024-09-21T03:31:55.307035+0000","modified":"2024-09-21T03:40:51.455331+0000","last_up_change":"2024-09-21T03:39:38.786385+0000","last_in_change":"2024-09-21T03:39:15.267368+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:35:50.488653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:40:25.934375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:40:27.981681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d283ba0-18f3-4668-90c4-884e9e957a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6803","nonce":508132562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6805","nonce":508132562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6809","nonce":508132562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6807","nonce":508132562}]},"public_addr":"172.21.15.84:6803/508132562","cluster_addr":"172.21.15.84:6805/508132562","heartbeat_back_addr":"172.21.15.84:6809/508132562","heartbeat_front_addr":"172.21.15.84:6807/508132562","state":["exists","up"]},{"osd":1,"uuid":"f115c5b6-812d-430f-9f0e-cb5311b7581e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6801","nonce":2931872350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6803","nonce":2931872350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6807","nonce":2931872350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6805","nonce":2931872350}]},"public_addr":"172.21.15.172:6801/2931872350","cluster_addr":"172.21.15.172:6803/2931872350","heartbeat_back_addr":"172.21.15.172:6807/2931872350","heartbeat_front_addr":"172.21.15.172:6805/2931872350","state":["exists","up"]},{"osd":2,"uuid":"36489240-e233-4aa7-ae9c-089d76683172","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6801","nonce":1847612335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6803","nonce":1847612335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6807","nonce":1847612335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6805","nonce":1847612335}]},"public_addr":"172.21.15.174:6801/1847612335","cluster_addr":"172.21.15.174:6803/1847612335","heartbeat_back_addr":"172.21.15.174:6807/1847612335","heartbeat_front_addr":"172.21.15.174:6805/1847612335","state":["exists","up"]},{"osd":3,"uuid":"1f35b404-b658-4e94-a5f4-74a6431a6a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6811","nonce":2230529863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6813","nonce":2230529863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6817","nonce":2230529863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6815","nonce":2230529863}]},"public_addr":"172.21.15.84:6811/2230529863","cluster_addr":"172.21.15.84:6813/2230529863","heartbeat_back_addr":"172.21.15.84:6817/2230529863","heartbeat_front_addr":"172.21.15.84:6815/2230529863","state":["exists","up"]},{"osd":4,"uuid":"91a2f83b-4c7d-4661-86a1-63a09888939d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6809","nonce":3069862739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6811","nonce":3069862739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6815","nonce":3069862739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6813","nonce":3069862739}]},"public_addr":"172.21.15.172:6809/3069862739","cluster_addr":"172.21.15.172:6811/3069862739","heartbeat_back_addr":"172.21.15.172:6815/3069862739","heartbeat_front_addr":"172.21.15.172:6813/3069862739","state":["exists","up"]},{"osd":5,"uuid":"e8f06b34-3956-499f-8073-09011cf1ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6809","nonce":1987010600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6811","nonce":1987010600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6815","nonce":1987010600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6813","nonce":1987010600}]},"public_addr":"172.21.15.174:6809/1987010600","cluster_addr":"172.21.15.174:6811/1987010600","heartbeat_back_addr":"172.21.15.174:6815/1987010600","heartbeat_front_addr":"172.21.15.174:6813/1987010600","state":["exists","up"]},{"osd":6,"uuid":"23d55e96-4987-4cbe-8c6b-cece4de9269b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6819","nonce":3418459345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6821","nonce":3418459345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6825","nonce":3418459345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6823","nonce":3418459345}]},"public_addr":"172.21.15.84:6819/3418459345","cluster_addr":"172.21.15.84:6821/3418459345","heartbeat_back_addr":"172.21.15.84:6825/3418459345","heartbeat_front_addr":"172.21.15.84:6823/3418459345","state":["exists","up"]},{"osd":7,"uuid":"ca91a34c-d8b1-48b8-93f4-72a5c15939d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6817","nonce":4056019738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6819","nonce":4056019738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6823","nonce":4056019738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6821","nonce":4056019738}]},"public_addr":"172.21.15.172:6817/4056019738","cluster_addr":"172.21.15.172:6819/4056019738","heartbeat_back_addr":"172.21.15.172:6823/4056019738","heartbeat_front_addr":"172.21.15.172:6821/4056019738","state":["exists","up"]},{"osd":8,"uuid":"37da8c61-d72f-4b58-b10c-7c7539ecffd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6817","nonce":2162992546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6819","nonce":2162992546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6823","nonce":2162992546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6821","nonce":2162992546}]},"public_addr":"172.21.15.174:6817/2162992546","cluster_addr":"172.21.15.174:6819/2162992546","heartbeat_back_addr":"172.21.15.174:6823/2162992546","heartbeat_front_addr":"172.21.15.174:6821/2162992546","state":["exists","up"]},{"osd":9,"uuid":"c9179f33-622d-44bd-9d8a-c92951afb1e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6827","nonce":3230873673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6829","nonce":3230873673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6833","nonce":3230873673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6831","nonce":3230873673}]},"public_addr":"172.21.15.84:6827/3230873673","cluster_addr":"172.21.15.84:6829/3230873673","heartbeat_back_addr":"172.21.15.84:6833/3230873673","heartbeat_front_addr":"172.21.15.84:6831/3230873673","state":["exists","up"]},{"osd":10,"uuid":"9788fa2d-49fb-431b-a0e3-62d6e421e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6825","nonce":2667099391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6827","nonce":2667099391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6831","nonce":2667099391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6829","nonce":2667099391}]},"public_addr":"172.21.15.172:6825/2667099391","cluster_addr":"172.21.15.172:6827/2667099391","heartbeat_back_addr":"172.21.15.172:6831/2667099391","heartbeat_front_addr":"172.21.15.172:6829/2667099391","state":["exists","up"]},{"osd":11,"uuid":"a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6825","nonce":3452825924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6827","nonce":3452825924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6831","nonce":3452825924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6829","nonce":3452825924}]},"public_addr":"172.21.15.174:6825/3452825924","cluster_addr":"172.21.15.174:6827/3452825924","heartbeat_back_addr":"172.21.15.174:6831/3452825924","heartbeat_front_addr":"172.21.15.174:6829/3452825924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:34:57.413946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:22.813846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:47.074625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:12.871112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:38.705563+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:04.277966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:29.661290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:55.475432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:20.644247+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:46.151594+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:11.499623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:36.688459+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6800/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3308084314":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3663660709":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/1794153935":"2024-09-22T03:32:49.459372+0000","172.21.15.84:6800/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6800/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1874814897":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6801/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/390051797":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/2148206075":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1916019809":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6801/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3491731835":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3418048965":"2024-09-22T03:33:50.188998+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:40:53.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.672+0000 7f4778bf0640 1 -- 172.21.15.84:0/2302255604 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f47600b65f0 msgr2=0x7f47600b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:53.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.672+0000 7f4778bf0640 1 --2- 172.21.15.84:0/2302255604 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f47600b65f0 0x7f47600b8b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4764005fd0 tx=0x7f476400b590 comp rx=0 tx=0).stop 2024-09-21T03:40:53.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.672+0000 7f4778bf0640 1 -- 172.21.15.84:0/2302255604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47741083a0 msgr2=0x7f477419aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:53.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.672+0000 7f4778bf0640 1 --2- 172.21.15.84:0/2302255604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47741083a0 0x7f477419aa40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f475c00c970 tx=0x7f475c00ce30 comp rx=0 tx=0).stop 2024-09-21T03:40:53.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.672+0000 7f4778bf0640 1 -- 172.21.15.84:0/2302255604 shutdown_connections 2024-09-21T03:40:53.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.672+0000 7f4778bf0640 1 --2- 172.21.15.84:0/2302255604 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f47600b65f0 0x7f47600b8b00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:53.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.672+0000 7f4778bf0640 1 --2- 172.21.15.84:0/2302255604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4774108cf0 0x7f477419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:53.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.672+0000 7f4778bf0640 1 --2- 172.21.15.84:0/2302255604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f47741083a0 0x7f477419aa40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:53.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.672+0000 7f4778bf0640 1 --2- 172.21.15.84:0/2302255604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4774102a60 0x7f477419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:53.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.672+0000 7f4778bf0640 1 -- 172.21.15.84:0/2302255604 >> 172.21.15.84:0/2302255604 conn(0x7f4774079730 msgr2=0x7f477406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:53.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.672+0000 7f4778bf0640 1 -- 172.21.15.84:0/2302255604 shutdown_connections 2024-09-21T03:40:53.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:53.672+0000 7f4778bf0640 1 -- 172.21.15.84:0/2302255604 wait complete. 2024-09-21T03:40:54.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:53 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2302255604' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:40:54.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:53 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2302255604' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:40:54.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:53 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2302255604' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:40:54.422 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T03:40:54.422 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T03:40:54.668 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:55.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:54 smithi084 ceph-mon[30941]: pgmap v277: 97 pgs: 97 active+clean; 630 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 KiB/s wr, 10 op/s; 126 B/s, 0 objects/s recovering 2024-09-21T03:40:55.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:54 smithi174 ceph-mon[34403]: pgmap v277: 97 pgs: 97 active+clean; 630 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 KiB/s wr, 10 op/s; 126 B/s, 0 objects/s recovering 2024-09-21T03:40:55.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:54 smithi172 ceph-mon[34821]: pgmap v277: 97 pgs: 97 active+clean; 630 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 KiB/s wr, 10 op/s; 126 B/s, 0 objects/s recovering 2024-09-21T03:40:55.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.171+0000 7ffa92abf640 1 -- 172.21.15.84:0/3755512989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c1027d0 msgr2=0x7ffa8c107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:55.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.171+0000 7ffa92abf640 1 --2- 172.21.15.84:0/3755512989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c1027d0 0x7ffa8c107bd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009900 tx=0x7ffa7802a410 comp rx=0 tx=0).stop 2024-09-21T03:40:55.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.171+0000 7ffa92abf640 1 -- 172.21.15.84:0/3755512989 shutdown_connections 2024-09-21T03:40:55.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.171+0000 7ffa92abf640 1 --2- 172.21.15.84:0/3755512989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa8c102be0 0x7ffa8c108110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:55.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.171+0000 7ffa92abf640 1 --2- 172.21.15.84:0/3755512989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c1027d0 0x7ffa8c107bd0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:55.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.171+0000 7ffa92abf640 1 --2- 172.21.15.84:0/3755512989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa8c06b330 0x7ffa8c102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:55.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.171+0000 7ffa92abf640 1 -- 172.21.15.84:0/3755512989 >> 172.21.15.84:0/3755512989 conn(0x7ffa8c079ea0 msgr2=0x7ffa8c07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:55.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.171+0000 7ffa92abf640 1 -- 172.21.15.84:0/3755512989 shutdown_connections 2024-09-21T03:40:55.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.171+0000 7ffa92abf640 1 -- 172.21.15.84:0/3755512989 wait complete. 2024-09-21T03:40:55.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.172+0000 7ffa92abf640 1 Processor -- start 2024-09-21T03:40:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.172+0000 7ffa92abf640 1 -- start start 2024-09-21T03:40:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.172+0000 7ffa92abf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa8c06b330 0x7ffa8c0feed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.172+0000 7ffa92abf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa8c1027d0 0x7ffa8c0ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.172+0000 7ffa92abf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c102be0 0x7ffa8c0ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.172+0000 7ffa92abf640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c112a50 con 0x7ffa8c102be0 2024-09-21T03:40:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.172+0000 7ffa92abf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c1128d0 con 0x7ffa8c1027d0 2024-09-21T03:40:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.172+0000 7ffa92abf640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8c112bd0 con 0x7ffa8c06b330 2024-09-21T03:40:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.172+0000 7ffa9105c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c102be0 0x7ffa8c0ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.172+0000 7ffa9105c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c102be0 0x7ffa8c0ff950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54920/0 (socket says 172.21.15.84:54920) 2024-09-21T03:40:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.172+0000 7ffa9105c640 1 -- 172.21.15.84:0/3708484031 learned_addr learned my addr 172.21.15.84:0/3708484031 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.172+0000 7ffa8bfff640 1 --2- 172.21.15.84:0/3708484031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa8c1027d0 0x7ffa8c0ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.172+0000 7ffa9085b640 1 --2- 172.21.15.84:0/3708484031 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa8c06b330 0x7ffa8c0feed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.172+0000 7ffa9105c640 1 -- 172.21.15.84:0/3708484031 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa8c06b330 msgr2=0x7ffa8c0feed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:55.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.172+0000 7ffa9105c640 1 --2- 172.21.15.84:0/3708484031 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa8c06b330 0x7ffa8c0feed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:55.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.172+0000 7ffa9105c640 1 -- 172.21.15.84:0/3708484031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa8c1027d0 msgr2=0x7ffa8c0ff410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:55.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.172+0000 7ffa9105c640 1 --2- 172.21.15.84:0/3708484031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa8c1027d0 0x7ffa8c0ff410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:55.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.172+0000 7ffa9105c640 1 -- 172.21.15.84:0/3708484031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8c1a8810 con 0x7ffa8c102be0 2024-09-21T03:40:55.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.172+0000 7ffa9085b640 1 --2- 172.21.15.84:0/3708484031 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa8c06b330 0x7ffa8c0feed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:40:55.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.173+0000 7ffa9105c640 1 --2- 172.21.15.84:0/3708484031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c102be0 0x7ffa8c0ff950 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400cad0 tx=0x7ffa8400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:55.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.173+0000 7ffa89ffb640 1 -- 172.21.15.84:0/3708484031 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8400ae20 con 0x7ffa8c102be0 2024-09-21T03:40:55.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.173+0000 7ffa89ffb640 1 -- 172.21.15.84:0/3708484031 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa84005020 con 0x7ffa8c102be0 2024-09-21T03:40:55.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.173+0000 7ffa89ffb640 1 -- 172.21.15.84:0/3708484031 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8400f6b0 con 0x7ffa8c102be0 2024-09-21T03:40:55.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.173+0000 7ffa92abf640 1 -- 172.21.15.84:0/3708484031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa8c1a8b00 con 0x7ffa8c102be0 2024-09-21T03:40:55.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.173+0000 7ffa92abf640 1 -- 172.21.15.84:0/3708484031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa8c1a8fc0 con 0x7ffa8c102be0 2024-09-21T03:40:55.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.174+0000 7ffa92abf640 1 -- 172.21.15.84:0/3708484031 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa8c102290 con 0x7ffa8c102be0 2024-09-21T03:40:55.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.175+0000 7ffa89ffb640 1 -- 172.21.15.84:0/3708484031 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7ffa840051d0 con 0x7ffa8c102be0 2024-09-21T03:40:55.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.176+0000 7ffa89ffb640 1 --2- 172.21.15.84:0/3708484031 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ffa7c0b65f0 0x7ffa7c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:55.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.176+0000 7ffa9085b640 1 --2- 172.21.15.84:0/3708484031 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ffa7c0b65f0 0x7ffa7c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:55.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.176+0000 7ffa89ffb640 1 -- 172.21.15.84:0/3708484031 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ffa840e76c0 con 0x7ffa8c102be0 2024-09-21T03:40:55.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.177+0000 7ffa9085b640 1 --2- 172.21.15.84:0/3708484031 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ffa7c0b65f0 0x7ffa7c0b8b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffa800058c0 tx=0x7ffa80005d50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:55.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.180+0000 7ffa89ffb640 1 -- 172.21.15.84:0/3708484031 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffa84014030 con 0x7ffa8c102be0 2024-09-21T03:40:55.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.358+0000 7ffa92abf640 1 -- 172.21.15.84:0/3708484031 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffa8c063800 con 0x7ffa7c0b65f0 2024-09-21T03:40:55.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.362+0000 7ffa89ffb640 1 -- 172.21.15.84:0/3708484031 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258921 (secure 0 0 0) 0x7ffa8c063800 con 0x7ffa7c0b65f0 2024-09-21T03:40:55.366 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:40:55.367 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T03:40:55.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.365+0000 7ffa92abf640 1 -- 172.21.15.84:0/3708484031 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ffa7c0b65f0 msgr2=0x7ffa7c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:55.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.365+0000 7ffa92abf640 1 --2- 172.21.15.84:0/3708484031 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ffa7c0b65f0 0x7ffa7c0b8b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffa800058c0 tx=0x7ffa80005d50 comp rx=0 tx=0).stop 2024-09-21T03:40:55.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.365+0000 7ffa92abf640 1 -- 172.21.15.84:0/3708484031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c102be0 msgr2=0x7ffa8c0ff950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:55.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.365+0000 7ffa92abf640 1 --2- 172.21.15.84:0/3708484031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c102be0 0x7ffa8c0ff950 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400cad0 tx=0x7ffa8400cf90 comp rx=0 tx=0).stop 2024-09-21T03:40:55.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.365+0000 7ffa92abf640 1 -- 172.21.15.84:0/3708484031 shutdown_connections 2024-09-21T03:40:55.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.365+0000 7ffa92abf640 1 --2- 172.21.15.84:0/3708484031 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ffa7c0b65f0 0x7ffa7c0b8b00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:55.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.365+0000 7ffa92abf640 1 --2- 172.21.15.84:0/3708484031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa8c102be0 0x7ffa8c0ff950 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:55.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.365+0000 7ffa92abf640 1 --2- 172.21.15.84:0/3708484031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa8c1027d0 0x7ffa8c0ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:55.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.365+0000 7ffa92abf640 1 --2- 172.21.15.84:0/3708484031 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa8c06b330 0x7ffa8c0feed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:55.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.365+0000 7ffa92abf640 1 -- 172.21.15.84:0/3708484031 >> 172.21.15.84:0/3708484031 conn(0x7ffa8c079ea0 msgr2=0x7ffa8c108d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:55.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.366+0000 7ffa92abf640 1 -- 172.21.15.84:0/3708484031 shutdown_connections 2024-09-21T03:40:55.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:55.366+0000 7ffa92abf640 1 -- 172.21.15.84:0/3708484031 wait complete. 2024-09-21T03:40:56.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:55 smithi084 ceph-mon[30941]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:40:56.123 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":277,"stamp":"2024-09-21T03:40:54.282193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645543,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":177,"num_read_kb":180,"num_write":276,"num_write_kb":2250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2952853,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376028,"kb_used_data":10104,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565796,"statfs":{"total":1151940427776,"available":1151555375104,"internally_reserved":0,"allocated":10346496,"data_stored":6791012,"data_compressed":145637,"data_compressed_allocated":192512,"data_compressed_original":1884160,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":43353,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":80,"num_write":25,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002045"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.327330+0000","last_change":"2024-09-21T03:40:29.337467+0000","last_active":"2024-09-21T03:40:30.327330+0000","last_peered":"2024-09-21T03:40:30.327330+0000","last_clean":"2024-09-21T03:40:30.327330+0000","last_became_active":"2024-09-21T03:40:29.337102+0000","last_became_peered":"2024-09-21T03:40:29.337102+0000","last_unstale":"2024-09-21T03:40:30.327330+0000","last_undegraded":"2024-09-21T03:40:30.327330+0000","last_fullsized":"2024-09-21T03:40:30.327330+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:53.798977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.345290+0000","last_change":"2024-09-21T03:40:29.336446+0000","last_active":"2024-09-21T03:40:30.345290+0000","last_peered":"2024-09-21T03:40:30.345290+0000","last_clean":"2024-09-21T03:40:30.345290+0000","last_became_active":"2024-09-21T03:40:29.336081+0000","last_became_peered":"2024-09-21T03:40:29.336081+0000","last_unstale":"2024-09-21T03:40:30.345290+0000","last_undegraded":"2024-09-21T03:40:30.345290+0000","last_fullsized":"2024-09-21T03:40:30.345290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:23.892700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.343404+0000","last_change":"2024-09-21T03:40:29.342861+0000","last_active":"2024-09-21T03:40:30.343404+0000","last_peered":"2024-09-21T03:40:30.343404+0000","last_clean":"2024-09-21T03:40:30.343404+0000","last_became_active":"2024-09-21T03:40:29.342111+0000","last_became_peered":"2024-09-21T03:40:29.342111+0000","last_unstale":"2024-09-21T03:40:30.343404+0000","last_undegraded":"2024-09-21T03:40:30.343404+0000","last_fullsized":"2024-09-21T03:40:30.343404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:30.012195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:40:50.461939+0000","last_change":"2024-09-21T03:40:29.339822+0000","last_active":"2024-09-21T03:40:50.461939+0000","last_peered":"2024-09-21T03:40:50.461939+0000","last_clean":"2024-09-21T03:40:50.461939+0000","last_became_active":"2024-09-21T03:40:29.339126+0000","last_became_peered":"2024-09-21T03:40:29.339126+0000","last_unstale":"2024-09-21T03:40:50.461939+0000","last_undegraded":"2024-09-21T03:40:50.461939+0000","last_fullsized":"2024-09-21T03:40:50.461939+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:44.874344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470141+0000","last_change":"2024-09-21T03:40:29.333683+0000","last_active":"2024-09-21T03:40:51.470141+0000","last_peered":"2024-09-21T03:40:51.470141+0000","last_clean":"2024-09-21T03:40:51.470141+0000","last_became_active":"2024-09-21T03:40:29.333329+0000","last_became_peered":"2024-09-21T03:40:29.333329+0000","last_unstale":"2024-09-21T03:40:51.470141+0000","last_undegraded":"2024-09-21T03:40:51.470141+0000","last_fullsized":"2024-09-21T03:40:51.470141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:42.655732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468828+0000","last_change":"2024-09-21T03:40:29.346193+0000","last_active":"2024-09-21T03:40:51.468828+0000","last_peered":"2024-09-21T03:40:51.468828+0000","last_clean":"2024-09-21T03:40:51.468828+0000","last_became_active":"2024-09-21T03:40:29.345808+0000","last_became_peered":"2024-09-21T03:40:29.345808+0000","last_unstale":"2024-09-21T03:40:51.468828+0000","last_undegraded":"2024-09-21T03:40:51.468828+0000","last_fullsized":"2024-09-21T03:40:51.468828+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:59.621904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464272+0000","last_change":"2024-09-21T03:40:29.337782+0000","last_active":"2024-09-21T03:40:51.464272+0000","last_peered":"2024-09-21T03:40:51.464272+0000","last_clean":"2024-09-21T03:40:51.464272+0000","last_became_active":"2024-09-21T03:40:29.337390+0000","last_became_peered":"2024-09-21T03:40:29.337390+0000","last_unstale":"2024-09-21T03:40:51.464272+0000","last_undegraded":"2024-09-21T03:40:51.464272+0000","last_fullsized":"2024-09-21T03:40:51.464272+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:49.924375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.346248+0000","last_change":"2024-09-21T03:40:29.340821+0000","last_active":"2024-09-21T03:40:30.346248+0000","last_peered":"2024-09-21T03:40:30.346248+0000","last_clean":"2024-09-21T03:40:30.346248+0000","last_became_active":"2024-09-21T03:40:29.340465+0000","last_became_peered":"2024-09-21T03:40:29.340465+0000","last_unstale":"2024-09-21T03:40:30.346248+0000","last_undegraded":"2024-09-21T03:40:30.346248+0000","last_fullsized":"2024-09-21T03:40:30.346248+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:18.600335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.344509+0000","last_change":"2024-09-21T03:40:29.345218+0000","last_active":"2024-09-21T03:40:30.344509+0000","last_peered":"2024-09-21T03:40:30.344509+0000","last_clean":"2024-09-21T03:40:30.344509+0000","last_became_active":"2024-09-21T03:40:29.344862+0000","last_became_peered":"2024-09-21T03:40:29.344862+0000","last_unstale":"2024-09-21T03:40:30.344509+0000","last_undegraded":"2024-09-21T03:40:30.344509+0000","last_fullsized":"2024-09-21T03:40:30.344509+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:53.570489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.471722+0000","last_change":"2024-09-21T03:40:51.471622+0000","last_active":"2024-09-21T03:40:51.471722+0000","last_peered":"2024-09-21T03:40:51.471722+0000","last_clean":"2024-09-21T03:40:51.471722+0000","last_became_active":"2024-09-21T03:40:51.471276+0000","last_became_peered":"2024-09-21T03:40:51.471276+0000","last_unstale":"2024-09-21T03:40:51.471722+0000","last_undegraded":"2024-09-21T03:40:51.471722+0000","last_fullsized":"2024-09-21T03:40:51.471722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:38.030634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464696+0000","last_change":"2024-09-21T03:40:29.338353+0000","last_active":"2024-09-21T03:40:51.464696+0000","last_peered":"2024-09-21T03:40:51.464696+0000","last_clean":"2024-09-21T03:40:51.464696+0000","last_became_active":"2024-09-21T03:40:29.337976+0000","last_became_peered":"2024-09-21T03:40:29.337976+0000","last_unstale":"2024-09-21T03:40:51.464696+0000","last_undegraded":"2024-09-21T03:40:51.464696+0000","last_fullsized":"2024-09-21T03:40:51.464696+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:10.182045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:40:50.462102+0000","last_change":"2024-09-21T03:40:29.343617+0000","last_active":"2024-09-21T03:40:50.462102+0000","last_peered":"2024-09-21T03:40:50.462102+0000","last_clean":"2024-09-21T03:40:50.462102+0000","last_became_active":"2024-09-21T03:40:29.342586+0000","last_became_peered":"2024-09-21T03:40:29.342586+0000","last_unstale":"2024-09-21T03:40:50.462102+0000","last_undegraded":"2024-09-21T03:40:50.462102+0000","last_fullsized":"2024-09-21T03:40:50.462102+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:06.823802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780499+0000","last_change":"2024-09-21T03:40:29.338633+0000","last_active":"2024-09-21T03:40:51.780499+0000","last_peered":"2024-09-21T03:40:51.780499+0000","last_clean":"2024-09-21T03:40:51.780499+0000","last_became_active":"2024-09-21T03:40:29.337502+0000","last_became_peered":"2024-09-21T03:40:29.337502+0000","last_unstale":"2024-09-21T03:40:51.780499+0000","last_undegraded":"2024-09-21T03:40:51.780499+0000","last_fullsized":"2024-09-21T03:40:51.780499+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:04.121275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.344123+0000","last_change":"2024-09-21T03:40:29.335774+0000","last_active":"2024-09-21T03:40:30.344123+0000","last_peered":"2024-09-21T03:40:30.344123+0000","last_clean":"2024-09-21T03:40:30.344123+0000","last_became_active":"2024-09-21T03:40:29.335452+0000","last_became_peered":"2024-09-21T03:40:29.335452+0000","last_unstale":"2024-09-21T03:40:30.344123+0000","last_undegraded":"2024-09-21T03:40:30.344123+0000","last_fullsized":"2024-09-21T03:40:30.344123+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:37.427015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.344396+0000","last_change":"2024-09-21T03:40:29.342874+0000","last_active":"2024-09-21T03:40:30.344396+0000","last_peered":"2024-09-21T03:40:30.344396+0000","last_clean":"2024-09-21T03:40:30.344396+0000","last_became_active":"2024-09-21T03:40:29.342343+0000","last_became_peered":"2024-09-21T03:40:29.342343+0000","last_unstale":"2024-09-21T03:40:30.344396+0000","last_undegraded":"2024-09-21T03:40:30.344396+0000","last_fullsized":"2024-09-21T03:40:30.344396+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:52.473608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.344256+0000","last_change":"2024-09-21T03:40:29.339231+0000","last_active":"2024-09-21T03:40:30.344256+0000","last_peered":"2024-09-21T03:40:30.344256+0000","last_clean":"2024-09-21T03:40:30.344256+0000","last_became_active":"2024-09-21T03:40:29.338724+0000","last_became_peered":"2024-09-21T03:40:29.338724+0000","last_unstale":"2024-09-21T03:40:30.344256+0000","last_undegraded":"2024-09-21T03:40:30.344256+0000","last_fullsized":"2024-09-21T03:40:30.344256+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:55.592713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.327340+0000","last_change":"2024-09-21T03:40:29.338480+0000","last_active":"2024-09-21T03:40:30.327340+0000","last_peered":"2024-09-21T03:40:30.327340+0000","last_clean":"2024-09-21T03:40:30.327340+0000","last_became_active":"2024-09-21T03:40:29.338092+0000","last_became_peered":"2024-09-21T03:40:29.338092+0000","last_unstale":"2024-09-21T03:40:30.327340+0000","last_undegraded":"2024-09-21T03:40:30.327340+0000","last_fullsized":"2024-09-21T03:40:30.327340+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:25.557502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470765+0000","last_change":"2024-09-21T03:40:29.335557+0000","last_active":"2024-09-21T03:40:51.470765+0000","last_peered":"2024-09-21T03:40:51.470765+0000","last_clean":"2024-09-21T03:40:51.470765+0000","last_became_active":"2024-09-21T03:40:29.335214+0000","last_became_peered":"2024-09-21T03:40:29.335214+0000","last_unstale":"2024-09-21T03:40:51.470765+0000","last_undegraded":"2024-09-21T03:40:51.470765+0000","last_fullsized":"2024-09-21T03:40:51.470765+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:21.395995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.345280+0000","last_change":"2024-09-21T03:40:29.333041+0000","last_active":"2024-09-21T03:40:30.345280+0000","last_peered":"2024-09-21T03:40:30.345280+0000","last_clean":"2024-09-21T03:40:30.345280+0000","last_became_active":"2024-09-21T03:40:29.332187+0000","last_became_peered":"2024-09-21T03:40:29.332187+0000","last_unstale":"2024-09-21T03:40:30.345280+0000","last_undegraded":"2024-09-21T03:40:30.345280+0000","last_fullsized":"2024-09-21T03:40:30.345280+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:03.253594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.326736+0000","last_change":"2024-09-21T03:40:29.339152+0000","last_active":"2024-09-21T03:40:30.326736+0000","last_peered":"2024-09-21T03:40:30.326736+0000","last_clean":"2024-09-21T03:40:30.326736+0000","last_became_active":"2024-09-21T03:40:29.338722+0000","last_became_peered":"2024-09-21T03:40:29.338722+0000","last_unstale":"2024-09-21T03:40:30.326736+0000","last_undegraded":"2024-09-21T03:40:30.326736+0000","last_fullsized":"2024-09-21T03:40:30.326736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:32.143498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780525+0000","last_change":"2024-09-21T03:40:29.329169+0000","last_active":"2024-09-21T03:40:51.780525+0000","last_peered":"2024-09-21T03:40:51.780525+0000","last_clean":"2024-09-21T03:40:51.780525+0000","last_became_active":"2024-09-21T03:40:29.328805+0000","last_became_peered":"2024-09-21T03:40:29.328805+0000","last_unstale":"2024-09-21T03:40:51.780525+0000","last_undegraded":"2024-09-21T03:40:51.780525+0000","last_fullsized":"2024-09-21T03:40:51.780525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:13.725038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.344110+0000","last_change":"2024-09-21T03:40:29.336699+0000","last_active":"2024-09-21T03:40:30.344110+0000","last_peered":"2024-09-21T03:40:30.344110+0000","last_clean":"2024-09-21T03:40:30.344110+0000","last_became_active":"2024-09-21T03:40:29.333649+0000","last_became_peered":"2024-09-21T03:40:29.333649+0000","last_unstale":"2024-09-21T03:40:30.344110+0000","last_undegraded":"2024-09-21T03:40:30.344110+0000","last_fullsized":"2024-09-21T03:40:30.344110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:49.418205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.346652+0000","last_change":"2024-09-21T03:40:29.337936+0000","last_active":"2024-09-21T03:40:30.346652+0000","last_peered":"2024-09-21T03:40:30.346652+0000","last_clean":"2024-09-21T03:40:30.346652+0000","last_became_active":"2024-09-21T03:40:29.337521+0000","last_became_peered":"2024-09-21T03:40:29.337521+0000","last_unstale":"2024-09-21T03:40:30.346652+0000","last_undegraded":"2024-09-21T03:40:30.346652+0000","last_fullsized":"2024-09-21T03:40:30.346652+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:09.223634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464197+0000","last_change":"2024-09-21T03:40:29.336866+0000","last_active":"2024-09-21T03:40:51.464197+0000","last_peered":"2024-09-21T03:40:51.464197+0000","last_clean":"2024-09-21T03:40:51.464197+0000","last_became_active":"2024-09-21T03:40:29.336447+0000","last_became_peered":"2024-09-21T03:40:29.336447+0000","last_unstale":"2024-09-21T03:40:51.464197+0000","last_undegraded":"2024-09-21T03:40:51.464197+0000","last_fullsized":"2024-09-21T03:40:51.464197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:53.487678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.347441+0000","last_change":"2024-09-21T03:40:29.333666+0000","last_active":"2024-09-21T03:40:30.347441+0000","last_peered":"2024-09-21T03:40:30.347441+0000","last_clean":"2024-09-21T03:40:30.347441+0000","last_became_active":"2024-09-21T03:40:29.333248+0000","last_became_peered":"2024-09-21T03:40:29.333248+0000","last_unstale":"2024-09-21T03:40:30.347441+0000","last_undegraded":"2024-09-21T03:40:30.347441+0000","last_fullsized":"2024-09-21T03:40:30.347441+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:54.721926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.349882+0000","last_change":"2024-09-21T03:40:29.342165+0000","last_active":"2024-09-21T03:40:30.349882+0000","last_peered":"2024-09-21T03:40:30.349882+0000","last_clean":"2024-09-21T03:40:30.349882+0000","last_became_active":"2024-09-21T03:40:29.341744+0000","last_became_peered":"2024-09-21T03:40:29.341744+0000","last_unstale":"2024-09-21T03:40:30.349882+0000","last_undegraded":"2024-09-21T03:40:30.349882+0000","last_fullsized":"2024-09-21T03:40:30.349882+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:04.641927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.327007+0000","last_change":"2024-09-21T03:40:29.341728+0000","last_active":"2024-09-21T03:40:30.327007+0000","last_peered":"2024-09-21T03:40:30.327007+0000","last_clean":"2024-09-21T03:40:30.327007+0000","last_became_active":"2024-09-21T03:40:29.339252+0000","last_became_peered":"2024-09-21T03:40:29.339252+0000","last_unstale":"2024-09-21T03:40:30.327007+0000","last_undegraded":"2024-09-21T03:40:30.327007+0000","last_fullsized":"2024-09-21T03:40:30.327007+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:53.618128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780271+0000","last_change":"2024-09-21T03:40:29.326893+0000","last_active":"2024-09-21T03:40:51.780271+0000","last_peered":"2024-09-21T03:40:51.780271+0000","last_clean":"2024-09-21T03:40:51.780271+0000","last_became_active":"2024-09-21T03:40:29.326427+0000","last_became_peered":"2024-09-21T03:40:29.326427+0000","last_unstale":"2024-09-21T03:40:51.780271+0000","last_undegraded":"2024-09-21T03:40:51.780271+0000","last_fullsized":"2024-09-21T03:40:51.780271+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:41.036179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.343638+0000","last_change":"2024-09-21T03:40:29.340410+0000","last_active":"2024-09-21T03:40:30.343638+0000","last_peered":"2024-09-21T03:40:30.343638+0000","last_clean":"2024-09-21T03:40:30.343638+0000","last_became_active":"2024-09-21T03:40:29.340062+0000","last_became_peered":"2024-09-21T03:40:29.340062+0000","last_unstale":"2024-09-21T03:40:30.343638+0000","last_undegraded":"2024-09-21T03:40:30.343638+0000","last_fullsized":"2024-09-21T03:40:30.343638+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:44.971145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.344399+0000","last_change":"2024-09-21T03:40:29.333387+0000","last_active":"2024-09-21T03:40:30.344399+0000","last_peered":"2024-09-21T03:40:30.344399+0000","last_clean":"2024-09-21T03:40:30.344399+0000","last_became_active":"2024-09-21T03:40:29.332511+0000","last_became_peered":"2024-09-21T03:40:29.332511+0000","last_unstale":"2024-09-21T03:40:30.344399+0000","last_undegraded":"2024-09-21T03:40:30.344399+0000","last_fullsized":"2024-09-21T03:40:30.344399+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:24.513267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.345965+0000","last_change":"2024-09-21T03:40:29.337845+0000","last_active":"2024-09-21T03:40:30.345965+0000","last_peered":"2024-09-21T03:40:30.345965+0000","last_clean":"2024-09-21T03:40:30.345965+0000","last_became_active":"2024-09-21T03:40:29.337387+0000","last_became_peered":"2024-09-21T03:40:29.337387+0000","last_unstale":"2024-09-21T03:40:30.345965+0000","last_undegraded":"2024-09-21T03:40:30.345965+0000","last_fullsized":"2024-09-21T03:40:30.345965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:31.398337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.326682+0000","last_change":"2024-09-21T03:40:29.342691+0000","last_active":"2024-09-21T03:40:30.326682+0000","last_peered":"2024-09-21T03:40:30.326682+0000","last_clean":"2024-09-21T03:40:30.326682+0000","last_became_active":"2024-09-21T03:40:29.342294+0000","last_became_peered":"2024-09-21T03:40:29.342294+0000","last_unstale":"2024-09-21T03:40:30.326682+0000","last_undegraded":"2024-09-21T03:40:30.326682+0000","last_fullsized":"2024-09-21T03:40:30.326682+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:25.806074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470482+0000","last_change":"2024-09-21T03:40:29.338280+0000","last_active":"2024-09-21T03:40:51.470482+0000","last_peered":"2024-09-21T03:40:51.470482+0000","last_clean":"2024-09-21T03:40:51.470482+0000","last_became_active":"2024-09-21T03:40:29.337825+0000","last_became_peered":"2024-09-21T03:40:29.337825+0000","last_unstale":"2024-09-21T03:40:51.470482+0000","last_undegraded":"2024-09-21T03:40:51.470482+0000","last_fullsized":"2024-09-21T03:40:51.470482+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:43.340248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":58,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.641217+0000","last_change":"2024-09-21T03:40:51.641130+0000","last_active":"2024-09-21T03:40:51.641217+0000","last_peered":"2024-09-21T03:40:51.641217+0000","last_clean":"2024-09-21T03:40:51.641217+0000","last_became_active":"2024-09-21T03:40:51.636641+0000","last_became_peered":"2024-09-21T03:40:51.636641+0000","last_unstale":"2024-09-21T03:40:51.641217+0000","last_undegraded":"2024-09-21T03:40:51.641217+0000","last_fullsized":"2024-09-21T03:40:51.641217+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:34.797959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464518+0000","last_change":"2024-09-21T03:40:29.341830+0000","last_active":"2024-09-21T03:40:51.464518+0000","last_peered":"2024-09-21T03:40:51.464518+0000","last_clean":"2024-09-21T03:40:51.464518+0000","last_became_active":"2024-09-21T03:40:29.341112+0000","last_became_peered":"2024-09-21T03:40:29.341112+0000","last_unstale":"2024-09-21T03:40:51.464518+0000","last_undegraded":"2024-09-21T03:40:51.464518+0000","last_fullsized":"2024-09-21T03:40:51.464518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:31.560605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468958+0000","last_change":"2024-09-21T03:40:27.319393+0000","last_active":"2024-09-21T03:40:51.468958+0000","last_peered":"2024-09-21T03:40:51.468958+0000","last_clean":"2024-09-21T03:40:51.468958+0000","last_became_active":"2024-09-21T03:40:27.319000+0000","last_became_peered":"2024-09-21T03:40:27.319000+0000","last_unstale":"2024-09-21T03:40:51.468958+0000","last_undegraded":"2024-09-21T03:40:51.468958+0000","last_fullsized":"2024-09-21T03:40:51.468958+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:24.752295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780193+0000","last_change":"2024-09-21T03:40:27.317276+0000","last_active":"2024-09-21T03:40:51.780193+0000","last_peered":"2024-09-21T03:40:51.780193+0000","last_clean":"2024-09-21T03:40:51.780193+0000","last_became_active":"2024-09-21T03:40:27.316955+0000","last_became_peered":"2024-09-21T03:40:27.316955+0000","last_unstale":"2024-09-21T03:40:51.780193+0000","last_undegraded":"2024-09-21T03:40:51.780193+0000","last_fullsized":"2024-09-21T03:40:51.780193+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:23.208493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.346473+0000","last_change":"2024-09-21T03:40:29.324774+0000","last_active":"2024-09-21T03:40:30.346473+0000","last_peered":"2024-09-21T03:40:30.346473+0000","last_clean":"2024-09-21T03:40:30.346473+0000","last_became_active":"2024-09-21T03:40:29.324107+0000","last_became_peered":"2024-09-21T03:40:29.324107+0000","last_unstale":"2024-09-21T03:40:30.346473+0000","last_undegraded":"2024-09-21T03:40:30.346473+0000","last_fullsized":"2024-09-21T03:40:30.346473+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:15.408620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464393+0000","last_change":"2024-09-21T03:40:27.316818+0000","last_active":"2024-09-21T03:40:51.464393+0000","last_peered":"2024-09-21T03:40:51.464393+0000","last_clean":"2024-09-21T03:40:51.464393+0000","last_became_active":"2024-09-21T03:40:27.316209+0000","last_became_peered":"2024-09-21T03:40:27.316209+0000","last_unstale":"2024-09-21T03:40:51.464393+0000","last_undegraded":"2024-09-21T03:40:51.464393+0000","last_fullsized":"2024-09-21T03:40:51.464393+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:01.869684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470071+0000","last_change":"2024-09-21T03:40:29.335033+0000","last_active":"2024-09-21T03:40:51.470071+0000","last_peered":"2024-09-21T03:40:51.470071+0000","last_clean":"2024-09-21T03:40:51.470071+0000","last_became_active":"2024-09-21T03:40:29.334607+0000","last_became_peered":"2024-09-21T03:40:29.334607+0000","last_unstale":"2024-09-21T03:40:51.470071+0000","last_undegraded":"2024-09-21T03:40:51.470071+0000","last_fullsized":"2024-09-21T03:40:51.470071+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:05.892248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469434+0000","last_change":"2024-09-21T03:40:27.319422+0000","last_active":"2024-09-21T03:40:51.469434+0000","last_peered":"2024-09-21T03:40:51.469434+0000","last_clean":"2024-09-21T03:40:51.469434+0000","last_became_active":"2024-09-21T03:40:27.318970+0000","last_became_peered":"2024-09-21T03:40:27.318970+0000","last_unstale":"2024-09-21T03:40:51.469434+0000","last_undegraded":"2024-09-21T03:40:51.469434+0000","last_fullsized":"2024-09-21T03:40:51.469434+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:04.263789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.345193+0000","last_change":"2024-09-21T03:40:29.334279+0000","last_active":"2024-09-21T03:40:30.345193+0000","last_peered":"2024-09-21T03:40:30.345193+0000","last_clean":"2024-09-21T03:40:30.345193+0000","last_became_active":"2024-09-21T03:40:29.333445+0000","last_became_peered":"2024-09-21T03:40:29.333445+0000","last_unstale":"2024-09-21T03:40:30.345193+0000","last_undegraded":"2024-09-21T03:40:30.345193+0000","last_fullsized":"2024-09-21T03:40:30.345193+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:10.445162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.643258+0000","last_change":"2024-09-21T03:40:51.643129+0000","last_active":"2024-09-21T03:40:51.643258+0000","last_peered":"2024-09-21T03:40:51.643258+0000","last_clean":"2024-09-21T03:40:51.643258+0000","last_became_active":"2024-09-21T03:40:51.637136+0000","last_became_peered":"2024-09-21T03:40:51.637136+0000","last_unstale":"2024-09-21T03:40:51.643258+0000","last_undegraded":"2024-09-21T03:40:51.643258+0000","last_fullsized":"2024-09-21T03:40:51.643258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:39.540452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.345035+0000","last_change":"2024-09-21T03:40:29.340393+0000","last_active":"2024-09-21T03:40:30.345035+0000","last_peered":"2024-09-21T03:40:30.345035+0000","last_clean":"2024-09-21T03:40:30.345035+0000","last_became_active":"2024-09-21T03:40:29.340042+0000","last_became_peered":"2024-09-21T03:40:29.340042+0000","last_unstale":"2024-09-21T03:40:30.345035+0000","last_undegraded":"2024-09-21T03:40:30.345035+0000","last_fullsized":"2024-09-21T03:40:30.345035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:43.794252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464730+0000","last_change":"2024-09-21T03:40:27.526458+0000","last_active":"2024-09-21T03:40:51.464730+0000","last_peered":"2024-09-21T03:40:51.464730+0000","last_clean":"2024-09-21T03:40:51.464730+0000","last_became_active":"2024-09-21T03:40:27.525918+0000","last_became_peered":"2024-09-21T03:40:27.525918+0000","last_unstale":"2024-09-21T03:40:51.464730+0000","last_undegraded":"2024-09-21T03:40:51.464730+0000","last_fullsized":"2024-09-21T03:40:51.464730+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:47.286475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.344786+0000","last_change":"2024-09-21T03:40:29.338197+0000","last_active":"2024-09-21T03:40:30.344786+0000","last_peered":"2024-09-21T03:40:30.344786+0000","last_clean":"2024-09-21T03:40:30.344786+0000","last_became_active":"2024-09-21T03:40:29.337852+0000","last_became_peered":"2024-09-21T03:40:29.337852+0000","last_unstale":"2024-09-21T03:40:30.344786+0000","last_undegraded":"2024-09-21T03:40:30.344786+0000","last_fullsized":"2024-09-21T03:40:30.344786+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:09.132407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'22","reported_seq":79,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:52.638945+0000","last_change":"2024-09-21T03:40:27.320891+0000","last_active":"2024-09-21T03:40:52.638945+0000","last_peered":"2024-09-21T03:40:52.638945+0000","last_clean":"2024-09-21T03:40:52.638945+0000","last_became_active":"2024-09-21T03:40:27.320512+0000","last_became_peered":"2024-09-21T03:40:27.320512+0000","last_unstale":"2024-09-21T03:40:52.638945+0000","last_undegraded":"2024-09-21T03:40:52.638945+0000","last_fullsized":"2024-09-21T03:40:52.638945+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:27.181130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50940,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":66,"num_write":23,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470843+0000","last_change":"2024-09-21T03:40:29.335570+0000","last_active":"2024-09-21T03:40:51.470843+0000","last_peered":"2024-09-21T03:40:51.470843+0000","last_clean":"2024-09-21T03:40:51.470843+0000","last_became_active":"2024-09-21T03:40:29.335226+0000","last_became_peered":"2024-09-21T03:40:29.335226+0000","last_unstale":"2024-09-21T03:40:51.470843+0000","last_undegraded":"2024-09-21T03:40:51.470843+0000","last_fullsized":"2024-09-21T03:40:51.470843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:56.434945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":26,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:38.413881+0000","last_change":"2024-09-21T03:40:27.318436+0000","last_active":"2024-09-21T03:40:38.413881+0000","last_peered":"2024-09-21T03:40:38.413881+0000","last_clean":"2024-09-21T03:40:38.413881+0000","last_became_active":"2024-09-21T03:40:27.317969+0000","last_became_peered":"2024-09-21T03:40:27.317969+0000","last_unstale":"2024-09-21T03:40:38.413881+0000","last_undegraded":"2024-09-21T03:40:38.413881+0000","last_fullsized":"2024-09-21T03:40:38.413881+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:43.137717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780149+0000","last_change":"2024-09-21T03:40:29.325824+0000","last_active":"2024-09-21T03:40:51.780149+0000","last_peered":"2024-09-21T03:40:51.780149+0000","last_clean":"2024-09-21T03:40:51.780149+0000","last_became_active":"2024-09-21T03:40:29.325498+0000","last_became_peered":"2024-09-21T03:40:29.325498+0000","last_unstale":"2024-09-21T03:40:51.780149+0000","last_undegraded":"2024-09-21T03:40:51.780149+0000","last_fullsized":"2024-09-21T03:40:51.780149+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:13.044835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464366+0000","last_change":"2024-09-21T03:40:27.308889+0000","last_active":"2024-09-21T03:40:51.464366+0000","last_peered":"2024-09-21T03:40:51.464366+0000","last_clean":"2024-09-21T03:40:51.464366+0000","last_became_active":"2024-09-21T03:40:27.308491+0000","last_became_peered":"2024-09-21T03:40:27.308491+0000","last_unstale":"2024-09-21T03:40:51.464366+0000","last_undegraded":"2024-09-21T03:40:51.464366+0000","last_fullsized":"2024-09-21T03:40:51.464366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:48.250898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.781387+0000","last_change":"2024-09-21T03:40:51.781287+0000","last_active":"2024-09-21T03:40:51.781387+0000","last_peered":"2024-09-21T03:40:51.781387+0000","last_clean":"2024-09-21T03:40:51.781387+0000","last_became_active":"2024-09-21T03:40:51.780925+0000","last_became_peered":"2024-09-21T03:40:51.780925+0000","last_unstale":"2024-09-21T03:40:51.781387+0000","last_undegraded":"2024-09-21T03:40:51.781387+0000","last_fullsized":"2024-09-21T03:40:51.781387+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:36.599949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'3","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:40:50.462409+0000","last_change":"2024-09-21T03:40:27.316066+0000","last_active":"2024-09-21T03:40:50.462409+0000","last_peered":"2024-09-21T03:40:50.462409+0000","last_clean":"2024-09-21T03:40:50.462409+0000","last_became_active":"2024-09-21T03:40:27.315580+0000","last_became_peered":"2024-09-21T03:40:27.315580+0000","last_unstale":"2024-09-21T03:40:50.462409+0000","last_undegraded":"2024-09-21T03:40:50.462409+0000","last_fullsized":"2024-09-21T03:40:50.462409+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:14.592824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464178+0000","last_change":"2024-09-21T03:40:29.339736+0000","last_active":"2024-09-21T03:40:51.464178+0000","last_peered":"2024-09-21T03:40:51.464178+0000","last_clean":"2024-09-21T03:40:51.464178+0000","last_became_active":"2024-09-21T03:40:29.338343+0000","last_became_peered":"2024-09-21T03:40:29.338343+0000","last_unstale":"2024-09-21T03:40:51.464178+0000","last_undegraded":"2024-09-21T03:40:51.464178+0000","last_fullsized":"2024-09-21T03:40:51.464178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:33.531580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:38.415075+0000","last_change":"2024-09-21T03:40:27.526877+0000","last_active":"2024-09-21T03:40:38.415075+0000","last_peered":"2024-09-21T03:40:38.415075+0000","last_clean":"2024-09-21T03:40:38.415075+0000","last_became_active":"2024-09-21T03:40:27.526354+0000","last_became_peered":"2024-09-21T03:40:27.526354+0000","last_unstale":"2024-09-21T03:40:38.415075+0000","last_undegraded":"2024-09-21T03:40:38.415075+0000","last_fullsized":"2024-09-21T03:40:38.415075+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:12:32.649960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464267+0000","last_change":"2024-09-21T03:40:29.340712+0000","last_active":"2024-09-21T03:40:51.464267+0000","last_peered":"2024-09-21T03:40:51.464267+0000","last_clean":"2024-09-21T03:40:51.464267+0000","last_became_active":"2024-09-21T03:40:29.340349+0000","last_became_peered":"2024-09-21T03:40:29.340349+0000","last_unstale":"2024-09-21T03:40:51.464267+0000","last_undegraded":"2024-09-21T03:40:51.464267+0000","last_fullsized":"2024-09-21T03:40:51.464267+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:29.980697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470772+0000","last_change":"2024-09-21T03:40:27.319689+0000","last_active":"2024-09-21T03:40:51.470772+0000","last_peered":"2024-09-21T03:40:51.470772+0000","last_clean":"2024-09-21T03:40:51.470772+0000","last_became_active":"2024-09-21T03:40:27.319010+0000","last_became_peered":"2024-09-21T03:40:27.319010+0000","last_unstale":"2024-09-21T03:40:51.470772+0000","last_undegraded":"2024-09-21T03:40:51.470772+0000","last_fullsized":"2024-09-21T03:40:51.470772+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:42.965205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.327022+0000","last_change":"2024-09-21T03:40:29.341790+0000","last_active":"2024-09-21T03:40:30.327022+0000","last_peered":"2024-09-21T03:40:30.327022+0000","last_clean":"2024-09-21T03:40:30.327022+0000","last_became_active":"2024-09-21T03:40:29.341352+0000","last_became_peered":"2024-09-21T03:40:29.341352+0000","last_unstale":"2024-09-21T03:40:30.327022+0000","last_undegraded":"2024-09-21T03:40:30.327022+0000","last_fullsized":"2024-09-21T03:40:30.327022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:18:33.688429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780182+0000","last_change":"2024-09-21T03:40:27.316086+0000","last_active":"2024-09-21T03:40:51.780182+0000","last_peered":"2024-09-21T03:40:51.780182+0000","last_clean":"2024-09-21T03:40:51.780182+0000","last_became_active":"2024-09-21T03:40:27.315645+0000","last_became_peered":"2024-09-21T03:40:27.315645+0000","last_unstale":"2024-09-21T03:40:51.780182+0000","last_undegraded":"2024-09-21T03:40:51.780182+0000","last_fullsized":"2024-09-21T03:40:51.780182+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:41.536778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464622+0000","last_change":"2024-09-21T03:40:29.339546+0000","last_active":"2024-09-21T03:40:51.464622+0000","last_peered":"2024-09-21T03:40:51.464622+0000","last_clean":"2024-09-21T03:40:51.464622+0000","last_became_active":"2024-09-21T03:40:29.339176+0000","last_became_peered":"2024-09-21T03:40:29.339176+0000","last_unstale":"2024-09-21T03:40:51.464622+0000","last_undegraded":"2024-09-21T03:40:51.464622+0000","last_fullsized":"2024-09-21T03:40:51.464622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:26.405624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464973+0000","last_change":"2024-09-21T03:40:27.315440+0000","last_active":"2024-09-21T03:40:51.464973+0000","last_peered":"2024-09-21T03:40:51.464973+0000","last_clean":"2024-09-21T03:40:51.464973+0000","last_became_active":"2024-09-21T03:40:27.314608+0000","last_became_peered":"2024-09-21T03:40:27.314608+0000","last_unstale":"2024-09-21T03:40:51.464973+0000","last_undegraded":"2024-09-21T03:40:51.464973+0000","last_fullsized":"2024-09-21T03:40:51.464973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:11.465078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464466+0000","last_change":"2024-09-21T03:40:29.336631+0000","last_active":"2024-09-21T03:40:51.464466+0000","last_peered":"2024-09-21T03:40:51.464466+0000","last_clean":"2024-09-21T03:40:51.464466+0000","last_became_active":"2024-09-21T03:40:29.336201+0000","last_became_peered":"2024-09-21T03:40:29.336201+0000","last_unstale":"2024-09-21T03:40:51.464466+0000","last_undegraded":"2024-09-21T03:40:51.464466+0000","last_fullsized":"2024-09-21T03:40:51.464466+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:29.514908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":23,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:38.415214+0000","last_change":"2024-09-21T03:40:27.719183+0000","last_active":"2024-09-21T03:40:38.415214+0000","last_peered":"2024-09-21T03:40:38.415214+0000","last_clean":"2024-09-21T03:40:38.415214+0000","last_became_active":"2024-09-21T03:40:27.718658+0000","last_became_peered":"2024-09-21T03:40:27.718658+0000","last_unstale":"2024-09-21T03:40:38.415214+0000","last_undegraded":"2024-09-21T03:40:38.415214+0000","last_fullsized":"2024-09-21T03:40:38.415214+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:52.280654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464860+0000","last_change":"2024-09-21T03:40:29.335258+0000","last_active":"2024-09-21T03:40:51.464860+0000","last_peered":"2024-09-21T03:40:51.464860+0000","last_clean":"2024-09-21T03:40:51.464860+0000","last_became_active":"2024-09-21T03:40:29.334897+0000","last_became_peered":"2024-09-21T03:40:29.334897+0000","last_unstale":"2024-09-21T03:40:51.464860+0000","last_undegraded":"2024-09-21T03:40:51.464860+0000","last_fullsized":"2024-09-21T03:40:51.464860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:27.040232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":95,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464382+0000","last_change":"2024-09-21T03:39:15.369567+0000","last_active":"2024-09-21T03:40:51.464382+0000","last_peered":"2024-09-21T03:40:51.464382+0000","last_clean":"2024-09-21T03:40:51.464382+0000","last_became_active":"2024-09-21T03:39:15.363960+0000","last_became_peered":"2024-09-21T03:39:15.363960+0000","last_unstale":"2024-09-21T03:40:51.464382+0000","last_undegraded":"2024-09-21T03:40:51.464382+0000","last_fullsized":"2024-09-21T03:40:51.464382+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:35:51.240165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:35:51.240165+0000","last_clean_scrub_stamp":"2024-09-21T03:35:51.240165+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:10.335425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:40:50.462002+0000","last_change":"2024-09-21T03:40:27.316831+0000","last_active":"2024-09-21T03:40:50.462002+0000","last_peered":"2024-09-21T03:40:50.462002+0000","last_clean":"2024-09-21T03:40:50.462002+0000","last_became_active":"2024-09-21T03:40:27.315547+0000","last_became_peered":"2024-09-21T03:40:27.315547+0000","last_unstale":"2024-09-21T03:40:50.462002+0000","last_undegraded":"2024-09-21T03:40:50.462002+0000","last_fullsized":"2024-09-21T03:40:50.462002+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:02.727366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.347116+0000","last_change":"2024-09-21T03:40:29.339059+0000","last_active":"2024-09-21T03:40:30.347116+0000","last_peered":"2024-09-21T03:40:30.347116+0000","last_clean":"2024-09-21T03:40:30.347116+0000","last_became_active":"2024-09-21T03:40:29.338710+0000","last_became_peered":"2024-09-21T03:40:29.338710+0000","last_unstale":"2024-09-21T03:40:30.347116+0000","last_undegraded":"2024-09-21T03:40:30.347116+0000","last_fullsized":"2024-09-21T03:40:30.347116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:50.390629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464355+0000","last_change":"2024-09-21T03:40:27.314666+0000","last_active":"2024-09-21T03:40:51.464355+0000","last_peered":"2024-09-21T03:40:51.464355+0000","last_clean":"2024-09-21T03:40:51.464355+0000","last_became_active":"2024-09-21T03:40:27.314254+0000","last_became_peered":"2024-09-21T03:40:27.314254+0000","last_unstale":"2024-09-21T03:40:51.464355+0000","last_undegraded":"2024-09-21T03:40:51.464355+0000","last_fullsized":"2024-09-21T03:40:51.464355+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:57.230420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780142+0000","last_change":"2024-09-21T03:40:29.338249+0000","last_active":"2024-09-21T03:40:51.780142+0000","last_peered":"2024-09-21T03:40:51.780142+0000","last_clean":"2024-09-21T03:40:51.780142+0000","last_became_active":"2024-09-21T03:40:29.337901+0000","last_became_peered":"2024-09-21T03:40:29.337901+0000","last_unstale":"2024-09-21T03:40:51.780142+0000","last_undegraded":"2024-09-21T03:40:51.780142+0000","last_fullsized":"2024-09-21T03:40:51.780142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:21.054734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.779979+0000","last_change":"2024-09-21T03:40:27.525651+0000","last_active":"2024-09-21T03:40:51.779979+0000","last_peered":"2024-09-21T03:40:51.779979+0000","last_clean":"2024-09-21T03:40:51.779979+0000","last_became_active":"2024-09-21T03:40:27.525299+0000","last_became_peered":"2024-09-21T03:40:27.525299+0000","last_unstale":"2024-09-21T03:40:51.779979+0000","last_undegraded":"2024-09-21T03:40:51.779979+0000","last_fullsized":"2024-09-21T03:40:51.779979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:21.983937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464267+0000","last_change":"2024-09-21T03:40:29.339021+0000","last_active":"2024-09-21T03:40:51.464267+0000","last_peered":"2024-09-21T03:40:51.464267+0000","last_clean":"2024-09-21T03:40:51.464267+0000","last_became_active":"2024-09-21T03:40:29.338660+0000","last_became_peered":"2024-09-21T03:40:29.338660+0000","last_unstale":"2024-09-21T03:40:51.464267+0000","last_undegraded":"2024-09-21T03:40:51.464267+0000","last_fullsized":"2024-09-21T03:40:51.464267+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:56.652048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.465111+0000","last_change":"2024-09-21T03:40:27.319650+0000","last_active":"2024-09-21T03:40:51.465111+0000","last_peered":"2024-09-21T03:40:51.465111+0000","last_clean":"2024-09-21T03:40:51.465111+0000","last_became_active":"2024-09-21T03:40:27.319188+0000","last_became_peered":"2024-09-21T03:40:27.319188+0000","last_unstale":"2024-09-21T03:40:51.465111+0000","last_undegraded":"2024-09-21T03:40:51.465111+0000","last_fullsized":"2024-09-21T03:40:51.465111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:12.905682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469050+0000","last_change":"2024-09-21T03:40:29.340673+0000","last_active":"2024-09-21T03:40:51.469050+0000","last_peered":"2024-09-21T03:40:51.469050+0000","last_clean":"2024-09-21T03:40:51.469050+0000","last_became_active":"2024-09-21T03:40:29.340240+0000","last_became_peered":"2024-09-21T03:40:29.340240+0000","last_unstale":"2024-09-21T03:40:51.469050+0000","last_undegraded":"2024-09-21T03:40:51.469050+0000","last_fullsized":"2024-09-21T03:40:51.469050+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:02.989879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470390+0000","last_change":"2024-09-21T03:40:27.527803+0000","last_active":"2024-09-21T03:40:51.470390+0000","last_peered":"2024-09-21T03:40:51.470390+0000","last_clean":"2024-09-21T03:40:51.470390+0000","last_became_active":"2024-09-21T03:40:27.527419+0000","last_became_peered":"2024-09-21T03:40:27.527419+0000","last_unstale":"2024-09-21T03:40:51.470390+0000","last_undegraded":"2024-09-21T03:40:51.470390+0000","last_fullsized":"2024-09-21T03:40:51.470390+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:15:16.081458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469232+0000","last_change":"2024-09-21T03:40:29.347927+0000","last_active":"2024-09-21T03:40:51.469232+0000","last_peered":"2024-09-21T03:40:51.469232+0000","last_clean":"2024-09-21T03:40:51.469232+0000","last_became_active":"2024-09-21T03:40:29.347574+0000","last_became_peered":"2024-09-21T03:40:29.347574+0000","last_unstale":"2024-09-21T03:40:51.469232+0000","last_undegraded":"2024-09-21T03:40:51.469232+0000","last_fullsized":"2024-09-21T03:40:51.469232+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:10.142931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:37.396285+0000","last_change":"2024-09-21T03:40:27.526703+0000","last_active":"2024-09-21T03:40:37.396285+0000","last_peered":"2024-09-21T03:40:37.396285+0000","last_clean":"2024-09-21T03:40:37.396285+0000","last_became_active":"2024-09-21T03:40:27.526271+0000","last_became_peered":"2024-09-21T03:40:27.526271+0000","last_unstale":"2024-09-21T03:40:37.396285+0000","last_undegraded":"2024-09-21T03:40:37.396285+0000","last_fullsized":"2024-09-21T03:40:37.396285+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:53.422541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780314+0000","last_change":"2024-09-21T03:40:29.332539+0000","last_active":"2024-09-21T03:40:51.780314+0000","last_peered":"2024-09-21T03:40:51.780314+0000","last_clean":"2024-09-21T03:40:51.780314+0000","last_became_active":"2024-09-21T03:40:29.332178+0000","last_became_peered":"2024-09-21T03:40:29.332178+0000","last_unstale":"2024-09-21T03:40:51.780314+0000","last_undegraded":"2024-09-21T03:40:51.780314+0000","last_fullsized":"2024-09-21T03:40:51.780314+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:00.354558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'8","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470835+0000","last_change":"2024-09-21T03:40:27.313942+0000","last_active":"2024-09-21T03:40:51.470835+0000","last_peered":"2024-09-21T03:40:51.470835+0000","last_clean":"2024-09-21T03:40:51.470835+0000","last_became_active":"2024-09-21T03:40:27.313541+0000","last_became_peered":"2024-09-21T03:40:27.313541+0000","last_unstale":"2024-09-21T03:40:51.470835+0000","last_undegraded":"2024-09-21T03:40:51.470835+0000","last_fullsized":"2024-09-21T03:40:51.470835+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:58.572154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.347694+0000","last_change":"2024-09-21T03:40:29.330712+0000","last_active":"2024-09-21T03:40:30.347694+0000","last_peered":"2024-09-21T03:40:30.347694+0000","last_clean":"2024-09-21T03:40:30.347694+0000","last_became_active":"2024-09-21T03:40:29.330345+0000","last_became_peered":"2024-09-21T03:40:29.330345+0000","last_unstale":"2024-09-21T03:40:30.347694+0000","last_undegraded":"2024-09-21T03:40:30.347694+0000","last_fullsized":"2024-09-21T03:40:30.347694+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:54.225288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:40:50.462464+0000","last_change":"2024-09-21T03:40:27.719239+0000","last_active":"2024-09-21T03:40:50.462464+0000","last_peered":"2024-09-21T03:40:50.462464+0000","last_clean":"2024-09-21T03:40:50.462464+0000","last_became_active":"2024-09-21T03:40:27.718834+0000","last_became_peered":"2024-09-21T03:40:27.718834+0000","last_unstale":"2024-09-21T03:40:50.462464+0000","last_undegraded":"2024-09-21T03:40:50.462464+0000","last_fullsized":"2024-09-21T03:40:50.462464+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:47.357723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.346212+0000","last_change":"2024-09-21T03:40:29.338470+0000","last_active":"2024-09-21T03:40:30.346212+0000","last_peered":"2024-09-21T03:40:30.346212+0000","last_clean":"2024-09-21T03:40:30.346212+0000","last_became_active":"2024-09-21T03:40:29.338114+0000","last_became_peered":"2024-09-21T03:40:29.338114+0000","last_unstale":"2024-09-21T03:40:30.346212+0000","last_undegraded":"2024-09-21T03:40:30.346212+0000","last_fullsized":"2024-09-21T03:40:30.346212+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:23.715773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:37.398592+0000","last_change":"2024-09-21T03:40:27.525544+0000","last_active":"2024-09-21T03:40:37.398592+0000","last_peered":"2024-09-21T03:40:37.398592+0000","last_clean":"2024-09-21T03:40:37.398592+0000","last_became_active":"2024-09-21T03:40:27.525196+0000","last_became_peered":"2024-09-21T03:40:27.525196+0000","last_unstale":"2024-09-21T03:40:37.398592+0000","last_undegraded":"2024-09-21T03:40:37.398592+0000","last_fullsized":"2024-09-21T03:40:37.398592+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:57:07.882351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470212+0000","last_change":"2024-09-21T03:40:29.337774+0000","last_active":"2024-09-21T03:40:51.470212+0000","last_peered":"2024-09-21T03:40:51.470212+0000","last_clean":"2024-09-21T03:40:51.470212+0000","last_became_active":"2024-09-21T03:40:29.337393+0000","last_became_peered":"2024-09-21T03:40:29.337393+0000","last_unstale":"2024-09-21T03:40:51.470212+0000","last_undegraded":"2024-09-21T03:40:51.470212+0000","last_fullsized":"2024-09-21T03:40:51.470212+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:20.471042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":22,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:37.399563+0000","last_change":"2024-09-21T03:40:27.312953+0000","last_active":"2024-09-21T03:40:37.399563+0000","last_peered":"2024-09-21T03:40:37.399563+0000","last_clean":"2024-09-21T03:40:37.399563+0000","last_became_active":"2024-09-21T03:40:27.312603+0000","last_became_peered":"2024-09-21T03:40:27.312603+0000","last_unstale":"2024-09-21T03:40:37.399563+0000","last_undegraded":"2024-09-21T03:40:37.399563+0000","last_fullsized":"2024-09-21T03:40:37.399563+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:18.102812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.326776+0000","last_change":"2024-09-21T03:40:29.330802+0000","last_active":"2024-09-21T03:40:30.326776+0000","last_peered":"2024-09-21T03:40:30.326776+0000","last_clean":"2024-09-21T03:40:30.326776+0000","last_became_active":"2024-09-21T03:40:29.330426+0000","last_became_peered":"2024-09-21T03:40:29.330426+0000","last_unstale":"2024-09-21T03:40:30.326776+0000","last_undegraded":"2024-09-21T03:40:30.326776+0000","last_fullsized":"2024-09-21T03:40:30.326776+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:08:18.552649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.344833+0000","last_change":"2024-09-21T03:40:27.319829+0000","last_active":"2024-09-21T03:40:30.344833+0000","last_peered":"2024-09-21T03:40:30.344833+0000","last_clean":"2024-09-21T03:40:30.344833+0000","last_became_active":"2024-09-21T03:40:27.319410+0000","last_became_peered":"2024-09-21T03:40:27.319410+0000","last_unstale":"2024-09-21T03:40:30.344833+0000","last_undegraded":"2024-09-21T03:40:30.344833+0000","last_fullsized":"2024-09-21T03:40:30.344833+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:56.475721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.347404+0000","last_change":"2024-09-21T03:40:29.335897+0000","last_active":"2024-09-21T03:40:30.347404+0000","last_peered":"2024-09-21T03:40:30.347404+0000","last_clean":"2024-09-21T03:40:30.347404+0000","last_became_active":"2024-09-21T03:40:29.335549+0000","last_became_peered":"2024-09-21T03:40:29.335549+0000","last_unstale":"2024-09-21T03:40:30.347404+0000","last_undegraded":"2024-09-21T03:40:30.347404+0000","last_fullsized":"2024-09-21T03:40:30.347404+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:01.401766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470266+0000","last_change":"2024-09-21T03:40:27.316678+0000","last_active":"2024-09-21T03:40:51.470266+0000","last_peered":"2024-09-21T03:40:51.470266+0000","last_clean":"2024-09-21T03:40:51.470266+0000","last_became_active":"2024-09-21T03:40:27.315980+0000","last_became_peered":"2024-09-21T03:40:27.315980+0000","last_unstale":"2024-09-21T03:40:51.470266+0000","last_undegraded":"2024-09-21T03:40:51.470266+0000","last_fullsized":"2024-09-21T03:40:51.470266+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:56.280077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464472+0000","last_change":"2024-09-21T03:40:29.333638+0000","last_active":"2024-09-21T03:40:51.464472+0000","last_peered":"2024-09-21T03:40:51.464472+0000","last_clean":"2024-09-21T03:40:51.464472+0000","last_became_active":"2024-09-21T03:40:29.333268+0000","last_became_peered":"2024-09-21T03:40:29.333268+0000","last_unstale":"2024-09-21T03:40:51.464472+0000","last_undegraded":"2024-09-21T03:40:51.464472+0000","last_fullsized":"2024-09-21T03:40:51.464472+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:35:23.346837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464730+0000","last_change":"2024-09-21T03:40:29.342199+0000","last_active":"2024-09-21T03:40:51.464730+0000","last_peered":"2024-09-21T03:40:51.464730+0000","last_clean":"2024-09-21T03:40:51.464730+0000","last_became_active":"2024-09-21T03:40:29.341675+0000","last_became_peered":"2024-09-21T03:40:29.341675+0000","last_unstale":"2024-09-21T03:40:51.464730+0000","last_undegraded":"2024-09-21T03:40:51.464730+0000","last_fullsized":"2024-09-21T03:40:51.464730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:01.439058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470666+0000","last_change":"2024-09-21T03:40:27.319327+0000","last_active":"2024-09-21T03:40:51.470666+0000","last_peered":"2024-09-21T03:40:51.470666+0000","last_clean":"2024-09-21T03:40:51.470666+0000","last_became_active":"2024-09-21T03:40:27.318773+0000","last_became_peered":"2024-09-21T03:40:27.318773+0000","last_unstale":"2024-09-21T03:40:51.470666+0000","last_undegraded":"2024-09-21T03:40:51.470666+0000","last_fullsized":"2024-09-21T03:40:51.470666+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:42.444238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.344580+0000","last_change":"2024-09-21T03:40:29.336121+0000","last_active":"2024-09-21T03:40:30.344580+0000","last_peered":"2024-09-21T03:40:30.344580+0000","last_clean":"2024-09-21T03:40:30.344580+0000","last_became_active":"2024-09-21T03:40:29.333523+0000","last_became_peered":"2024-09-21T03:40:29.333523+0000","last_unstale":"2024-09-21T03:40:30.344580+0000","last_undegraded":"2024-09-21T03:40:30.344580+0000","last_fullsized":"2024-09-21T03:40:30.344580+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:29.303410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470911+0000","last_change":"2024-09-21T03:40:27.316523+0000","last_active":"2024-09-21T03:40:51.470911+0000","last_peered":"2024-09-21T03:40:51.470911+0000","last_clean":"2024-09-21T03:40:51.470911+0000","last_became_active":"2024-09-21T03:40:27.316099+0000","last_became_peered":"2024-09-21T03:40:27.316099+0000","last_unstale":"2024-09-21T03:40:51.470911+0000","last_undegraded":"2024-09-21T03:40:51.470911+0000","last_fullsized":"2024-09-21T03:40:51.470911+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:44.091964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.343784+0000","last_change":"2024-09-21T03:40:29.333887+0000","last_active":"2024-09-21T03:40:30.343784+0000","last_peered":"2024-09-21T03:40:30.343784+0000","last_clean":"2024-09-21T03:40:30.343784+0000","last_became_active":"2024-09-21T03:40:29.333465+0000","last_became_peered":"2024-09-21T03:40:29.333465+0000","last_unstale":"2024-09-21T03:40:30.343784+0000","last_undegraded":"2024-09-21T03:40:30.343784+0000","last_fullsized":"2024-09-21T03:40:30.343784+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:46.788188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":21,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.350850+0000","last_change":"2024-09-21T03:40:27.525812+0000","last_active":"2024-09-21T03:40:30.350850+0000","last_peered":"2024-09-21T03:40:30.350850+0000","last_clean":"2024-09-21T03:40:30.350850+0000","last_became_active":"2024-09-21T03:40:27.525391+0000","last_became_peered":"2024-09-21T03:40:27.525391+0000","last_unstale":"2024-09-21T03:40:30.350850+0000","last_undegraded":"2024-09-21T03:40:30.350850+0000","last_fullsized":"2024-09-21T03:40:30.350850+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:07.856442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-09-21T03:40:30.347602+0000","last_change":"2024-09-21T03:40:29.339079+0000","last_active":"2024-09-21T03:40:30.347602+0000","last_peered":"2024-09-21T03:40:30.347602+0000","last_clean":"2024-09-21T03:40:30.347602+0000","last_became_active":"2024-09-21T03:40:29.338737+0000","last_became_peered":"2024-09-21T03:40:29.338737+0000","last_unstale":"2024-09-21T03:40:30.347602+0000","last_undegraded":"2024-09-21T03:40:30.347602+0000","last_fullsized":"2024-09-21T03:40:30.347602+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:14.863848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470639+0000","last_change":"2024-09-21T03:40:27.316037+0000","last_active":"2024-09-21T03:40:51.470639+0000","last_peered":"2024-09-21T03:40:51.470639+0000","last_clean":"2024-09-21T03:40:51.470639+0000","last_became_active":"2024-09-21T03:40:27.315604+0000","last_became_peered":"2024-09-21T03:40:27.315604+0000","last_unstale":"2024-09-21T03:40:51.470639+0000","last_undegraded":"2024-09-21T03:40:51.470639+0000","last_fullsized":"2024-09-21T03:40:51.470639+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:48.176252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54941,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":96,"num_read_kb":111,"num_write":151,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":158952,"data_compressed":5679,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247442,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743441,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713176,"statfs":{"total":95995035648,"available":95962292224,"internally_reserved":0,"allocated":811008,"data_stored":398608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906966,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":974848,"data_stored":1058458,"data_compressed":43442,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070492,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":851968,"data_stored":416273,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266720,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":839680,"data_stored":416059,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430245,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":901120,"data_stored":1008123,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593771,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":827392,"data_stored":407033,"data_compressed":2865,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790000,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":913408,"data_stored":1007807,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986229,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":831488,"data_stored":407470,"data_compressed":2865,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31996,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713156,"statfs":{"total":95995035648,"available":95962271744,"internally_reserved":0,"allocated":831488,"data_stored":398544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":864256,"data_stored":424167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":864256,"data_stored":448966,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":835584,"data_stored":399504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34191,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34191,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":50940,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":46944,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":52518,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:40:56.128 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T03:40:56.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:55 smithi174 ceph-mon[34403]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:40:56.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:55 smithi172 ceph-mon[34821]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:40:56.381 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:56.809 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:56 smithi084 ceph-mon[30941]: pgmap v278: 97 pgs: 97 active+clean; 630 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.6 KiB/s wr, 7 op/s; 143 B/s, 1 objects/s recovering 2024-09-21T03:40:56.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.896+0000 7fad4c5d0640 1 -- 172.21.15.84:0/4126847712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad441094a0 msgr2=0x7fad441098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:56.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.896+0000 7fad4c5d0640 1 --2- 172.21.15.84:0/4126847712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad441094a0 0x7fad441098b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fad38009900 tx=0x7fad3802a410 comp rx=0 tx=0).stop 2024-09-21T03:40:56.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.896+0000 7fad4c5d0640 1 -- 172.21.15.84:0/4126847712 shutdown_connections 2024-09-21T03:40:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.896+0000 7fad4c5d0640 1 --2- 172.21.15.84:0/4126847712 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad44109df0 0x7fad44110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.896+0000 7fad4c5d0640 1 --2- 172.21.15.84:0/4126847712 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad441094a0 0x7fad441098b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.896+0000 7fad4c5d0640 1 --2- 172.21.15.84:0/4126847712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad44103b60 0x7fad44103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.896+0000 7fad4c5d0640 1 -- 172.21.15.84:0/4126847712 >> 172.21.15.84:0/4126847712 conn(0x7fad4407b850 msgr2=0x7fad4407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.896+0000 7fad4c5d0640 1 -- 172.21.15.84:0/4126847712 shutdown_connections 2024-09-21T03:40:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.896+0000 7fad4c5d0640 1 -- 172.21.15.84:0/4126847712 wait complete. 2024-09-21T03:40:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.896+0000 7fad4c5d0640 1 Processor -- start 2024-09-21T03:40:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.897+0000 7fad4c5d0640 1 -- start start 2024-09-21T03:40:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.897+0000 7fad4c5d0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad44103b60 0x7fad4419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.897+0000 7fad4c5d0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad441094a0 0x7fad4419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.897+0000 7fad4c5d0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad44109df0 0x7fad4419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.897+0000 7fad4c5d0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fad44113ab0 con 0x7fad44109df0 2024-09-21T03:40:56.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.897+0000 7fad4c5d0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fad44113930 con 0x7fad44103b60 2024-09-21T03:40:56.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.897+0000 7fad4c5d0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fad44113c30 con 0x7fad441094a0 2024-09-21T03:40:56.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.897+0000 7fad4ab6d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad44109df0 0x7fad4419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:56.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.897+0000 7fad4ab6d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad44109df0 0x7fad4419fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54940/0 (socket says 172.21.15.84:54940) 2024-09-21T03:40:56.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.897+0000 7fad4ab6d640 1 -- 172.21.15.84:0/3884324887 learned_addr learned my addr 172.21.15.84:0/3884324887 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:56.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.897+0000 7fad4a36c640 1 --2- 172.21.15.84:0/3884324887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad44103b60 0x7fad4419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:56.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.897+0000 7fad49b6b640 1 --2- 172.21.15.84:0/3884324887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad441094a0 0x7fad4419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:56.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.897+0000 7fad4ab6d640 1 -- 172.21.15.84:0/3884324887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad441094a0 msgr2=0x7fad4419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:56.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.897+0000 7fad4ab6d640 1 --2- 172.21.15.84:0/3884324887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad441094a0 0x7fad4419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:56.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.897+0000 7fad4ab6d640 1 -- 172.21.15.84:0/3884324887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad44103b60 msgr2=0x7fad4419a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:56.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.897+0000 7fad4ab6d640 1 --2- 172.21.15.84:0/3884324887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad44103b60 0x7fad4419a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:56.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.897+0000 7fad4ab6d640 1 -- 172.21.15.84:0/3884324887 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad441a0430 con 0x7fad44109df0 2024-09-21T03:40:56.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.897+0000 7fad4ab6d640 1 --2- 172.21.15.84:0/3884324887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad44109df0 0x7fad4419fdc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00c970 tx=0x7fad3c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:56.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.897+0000 7fad437fe640 1 -- 172.21.15.84:0/3884324887 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c007bb0 con 0x7fad44109df0 2024-09-21T03:40:56.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.898+0000 7fad4c5d0640 1 -- 172.21.15.84:0/3884324887 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad441a0720 con 0x7fad44109df0 2024-09-21T03:40:56.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.898+0000 7fad437fe640 1 -- 172.21.15.84:0/3884324887 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad3c007d50 con 0x7fad44109df0 2024-09-21T03:40:56.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.898+0000 7fad437fe640 1 -- 172.21.15.84:0/3884324887 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c018770 con 0x7fad44109df0 2024-09-21T03:40:56.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.898+0000 7fad4c5d0640 1 -- 172.21.15.84:0/3884324887 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad441a0be0 con 0x7fad44109df0 2024-09-21T03:40:56.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.899+0000 7fad4c5d0640 1 -- 172.21.15.84:0/3884324887 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad44103f70 con 0x7fad44109df0 2024-09-21T03:40:56.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.901+0000 7fad437fe640 1 -- 172.21.15.84:0/3884324887 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fad3c00f990 con 0x7fad44109df0 2024-09-21T03:40:56.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.902+0000 7fad437fe640 1 --2- 172.21.15.84:0/3884324887 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fad2c0b6620 0x7fad2c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:56.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.902+0000 7fad4a36c640 1 --2- 172.21.15.84:0/3884324887 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fad2c0b6620 0x7fad2c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:56.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.902+0000 7fad437fe640 1 -- 172.21.15.84:0/3884324887 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fad3c0e7620 con 0x7fad44109df0 2024-09-21T03:40:56.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.902+0000 7fad4a36c640 1 --2- 172.21.15.84:0/3884324887 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fad2c0b6620 0x7fad2c0b8b30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fad34005fd0 tx=0x7fad34009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:56.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:56.905+0000 7fad437fe640 1 -- 172.21.15.84:0/3884324887 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fad3c014030 con 0x7fad44109df0 2024-09-21T03:40:57.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:57.082+0000 7fad4c5d0640 1 -- 172.21.15.84:0/3884324887 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad44063800 con 0x7fad2c0b6620 2024-09-21T03:40:57.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:57.086+0000 7fad437fe640 1 -- 172.21.15.84:0/3884324887 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258978 (secure 0 0 0) 0x7fad44063800 con 0x7fad2c0b6620 2024-09-21T03:40:57.094 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:40:57.095 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T03:40:57.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:57.089+0000 7fad4c5d0640 1 -- 172.21.15.84:0/3884324887 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fad2c0b6620 msgr2=0x7fad2c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:57.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:57.089+0000 7fad4c5d0640 1 --2- 172.21.15.84:0/3884324887 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fad2c0b6620 0x7fad2c0b8b30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fad34005fd0 tx=0x7fad34009680 comp rx=0 tx=0).stop 2024-09-21T03:40:57.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:57.090+0000 7fad4c5d0640 1 -- 172.21.15.84:0/3884324887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad44109df0 msgr2=0x7fad4419fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:57.090+0000 7fad4c5d0640 1 --2- 172.21.15.84:0/3884324887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad44109df0 0x7fad4419fdc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fad3c00c970 tx=0x7fad3c00ce30 comp rx=0 tx=0).stop 2024-09-21T03:40:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:57.090+0000 7fad4c5d0640 1 -- 172.21.15.84:0/3884324887 shutdown_connections 2024-09-21T03:40:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:57.090+0000 7fad4c5d0640 1 --2- 172.21.15.84:0/3884324887 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fad2c0b6620 0x7fad2c0b8b30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:57.090+0000 7fad4c5d0640 1 --2- 172.21.15.84:0/3884324887 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fad44109df0 0x7fad4419fdc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:57.090+0000 7fad4c5d0640 1 --2- 172.21.15.84:0/3884324887 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad441094a0 0x7fad4419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:57.090+0000 7fad4c5d0640 1 --2- 172.21.15.84:0/3884324887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad44103b60 0x7fad4419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:57.090+0000 7fad4c5d0640 1 -- 172.21.15.84:0/3884324887 >> 172.21.15.84:0/3884324887 conn(0x7fad4407b850 msgr2=0x7fad44105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:57.090+0000 7fad4c5d0640 1 -- 172.21.15.84:0/3884324887 shutdown_connections 2024-09-21T03:40:57.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:57.090+0000 7fad4c5d0640 1 -- 172.21.15.84:0/3884324887 wait complete. 2024-09-21T03:40:57.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:56 smithi174 ceph-mon[34403]: pgmap v278: 97 pgs: 97 active+clean; 630 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.6 KiB/s wr, 7 op/s; 143 B/s, 1 objects/s recovering 2024-09-21T03:40:57.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:56 smithi172 ceph-mon[34821]: pgmap v278: 97 pgs: 97 active+clean; 630 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.6 KiB/s wr, 7 op/s; 143 B/s, 1 objects/s recovering 2024-09-21T03:40:57.994 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:57 smithi084 ceph-mon[30941]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:40:57.995 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-21T03:40:56.282758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645543,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":175,"num_read_kb":178,"num_write":276,"num_write_kb":2250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":2952987,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":223,"ondisk_log_size":223,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":293,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376204,"kb_used_data":10260,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565620,"statfs":{"total":1151940427776,"available":1151555194880,"internally_reserved":0,"allocated":10506240,"data_stored":6911970,"data_compressed":176215,"data_compressed_allocated":237568,"data_compressed_original":1974272,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":42962,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":72,"num_write":24,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1147,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002120"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467399+0000","last_change":"2024-09-21T03:40:29.337467+0000","last_active":"2024-09-21T03:40:51.467399+0000","last_peered":"2024-09-21T03:40:51.467399+0000","last_clean":"2024-09-21T03:40:51.467399+0000","last_became_active":"2024-09-21T03:40:29.337102+0000","last_became_peered":"2024-09-21T03:40:29.337102+0000","last_unstale":"2024-09-21T03:40:51.467399+0000","last_undegraded":"2024-09-21T03:40:51.467399+0000","last_fullsized":"2024-09-21T03:40:51.467399+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:53.798977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469953+0000","last_change":"2024-09-21T03:40:29.336446+0000","last_active":"2024-09-21T03:40:51.469953+0000","last_peered":"2024-09-21T03:40:51.469953+0000","last_clean":"2024-09-21T03:40:51.469953+0000","last_became_active":"2024-09-21T03:40:29.336081+0000","last_became_peered":"2024-09-21T03:40:29.336081+0000","last_unstale":"2024-09-21T03:40:51.469953+0000","last_undegraded":"2024-09-21T03:40:51.469953+0000","last_fullsized":"2024-09-21T03:40:51.469953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:23.892700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470293+0000","last_change":"2024-09-21T03:40:29.342861+0000","last_active":"2024-09-21T03:40:51.470293+0000","last_peered":"2024-09-21T03:40:51.470293+0000","last_clean":"2024-09-21T03:40:51.470293+0000","last_became_active":"2024-09-21T03:40:29.342111+0000","last_became_peered":"2024-09-21T03:40:29.342111+0000","last_unstale":"2024-09-21T03:40:51.470293+0000","last_undegraded":"2024-09-21T03:40:51.470293+0000","last_fullsized":"2024-09-21T03:40:51.470293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:30.012195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:40:50.461939+0000","last_change":"2024-09-21T03:40:29.339822+0000","last_active":"2024-09-21T03:40:50.461939+0000","last_peered":"2024-09-21T03:40:50.461939+0000","last_clean":"2024-09-21T03:40:50.461939+0000","last_became_active":"2024-09-21T03:40:29.339126+0000","last_became_peered":"2024-09-21T03:40:29.339126+0000","last_unstale":"2024-09-21T03:40:50.461939+0000","last_undegraded":"2024-09-21T03:40:50.461939+0000","last_fullsized":"2024-09-21T03:40:50.461939+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:44.874344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470141+0000","last_change":"2024-09-21T03:40:29.333683+0000","last_active":"2024-09-21T03:40:51.470141+0000","last_peered":"2024-09-21T03:40:51.470141+0000","last_clean":"2024-09-21T03:40:51.470141+0000","last_became_active":"2024-09-21T03:40:29.333329+0000","last_became_peered":"2024-09-21T03:40:29.333329+0000","last_unstale":"2024-09-21T03:40:51.470141+0000","last_undegraded":"2024-09-21T03:40:51.470141+0000","last_fullsized":"2024-09-21T03:40:51.470141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:42.655732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468828+0000","last_change":"2024-09-21T03:40:29.346193+0000","last_active":"2024-09-21T03:40:51.468828+0000","last_peered":"2024-09-21T03:40:51.468828+0000","last_clean":"2024-09-21T03:40:51.468828+0000","last_became_active":"2024-09-21T03:40:29.345808+0000","last_became_peered":"2024-09-21T03:40:29.345808+0000","last_unstale":"2024-09-21T03:40:51.468828+0000","last_undegraded":"2024-09-21T03:40:51.468828+0000","last_fullsized":"2024-09-21T03:40:51.468828+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:59.621904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464272+0000","last_change":"2024-09-21T03:40:29.337782+0000","last_active":"2024-09-21T03:40:51.464272+0000","last_peered":"2024-09-21T03:40:51.464272+0000","last_clean":"2024-09-21T03:40:51.464272+0000","last_became_active":"2024-09-21T03:40:29.337390+0000","last_became_peered":"2024-09-21T03:40:29.337390+0000","last_unstale":"2024-09-21T03:40:51.464272+0000","last_undegraded":"2024-09-21T03:40:51.464272+0000","last_fullsized":"2024-09-21T03:40:51.464272+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:49.924375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463416+0000","last_change":"2024-09-21T03:40:29.340821+0000","last_active":"2024-09-21T03:40:51.463416+0000","last_peered":"2024-09-21T03:40:51.463416+0000","last_clean":"2024-09-21T03:40:51.463416+0000","last_became_active":"2024-09-21T03:40:29.340465+0000","last_became_peered":"2024-09-21T03:40:29.340465+0000","last_unstale":"2024-09-21T03:40:51.463416+0000","last_undegraded":"2024-09-21T03:40:51.463416+0000","last_fullsized":"2024-09-21T03:40:51.463416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:18.600335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467779+0000","last_change":"2024-09-21T03:40:29.345218+0000","last_active":"2024-09-21T03:40:51.467779+0000","last_peered":"2024-09-21T03:40:51.467779+0000","last_clean":"2024-09-21T03:40:51.467779+0000","last_became_active":"2024-09-21T03:40:29.344862+0000","last_became_peered":"2024-09-21T03:40:29.344862+0000","last_unstale":"2024-09-21T03:40:51.467779+0000","last_undegraded":"2024-09-21T03:40:51.467779+0000","last_fullsized":"2024-09-21T03:40:51.467779+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:53.570489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.471722+0000","last_change":"2024-09-21T03:40:51.471622+0000","last_active":"2024-09-21T03:40:51.471722+0000","last_peered":"2024-09-21T03:40:51.471722+0000","last_clean":"2024-09-21T03:40:51.471722+0000","last_became_active":"2024-09-21T03:40:51.471276+0000","last_became_peered":"2024-09-21T03:40:51.471276+0000","last_unstale":"2024-09-21T03:40:51.471722+0000","last_undegraded":"2024-09-21T03:40:51.471722+0000","last_fullsized":"2024-09-21T03:40:51.471722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:38.030634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464696+0000","last_change":"2024-09-21T03:40:29.338353+0000","last_active":"2024-09-21T03:40:51.464696+0000","last_peered":"2024-09-21T03:40:51.464696+0000","last_clean":"2024-09-21T03:40:51.464696+0000","last_became_active":"2024-09-21T03:40:29.337976+0000","last_became_peered":"2024-09-21T03:40:29.337976+0000","last_unstale":"2024-09-21T03:40:51.464696+0000","last_undegraded":"2024-09-21T03:40:51.464696+0000","last_fullsized":"2024-09-21T03:40:51.464696+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:10.182045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:40:50.462102+0000","last_change":"2024-09-21T03:40:29.343617+0000","last_active":"2024-09-21T03:40:50.462102+0000","last_peered":"2024-09-21T03:40:50.462102+0000","last_clean":"2024-09-21T03:40:50.462102+0000","last_became_active":"2024-09-21T03:40:29.342586+0000","last_became_peered":"2024-09-21T03:40:29.342586+0000","last_unstale":"2024-09-21T03:40:50.462102+0000","last_undegraded":"2024-09-21T03:40:50.462102+0000","last_fullsized":"2024-09-21T03:40:50.462102+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:06.823802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780499+0000","last_change":"2024-09-21T03:40:29.338633+0000","last_active":"2024-09-21T03:40:51.780499+0000","last_peered":"2024-09-21T03:40:51.780499+0000","last_clean":"2024-09-21T03:40:51.780499+0000","last_became_active":"2024-09-21T03:40:29.337502+0000","last_became_peered":"2024-09-21T03:40:29.337502+0000","last_unstale":"2024-09-21T03:40:51.780499+0000","last_undegraded":"2024-09-21T03:40:51.780499+0000","last_fullsized":"2024-09-21T03:40:51.780499+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:04.121275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469621+0000","last_change":"2024-09-21T03:40:29.335774+0000","last_active":"2024-09-21T03:40:51.469621+0000","last_peered":"2024-09-21T03:40:51.469621+0000","last_clean":"2024-09-21T03:40:51.469621+0000","last_became_active":"2024-09-21T03:40:29.335452+0000","last_became_peered":"2024-09-21T03:40:29.335452+0000","last_unstale":"2024-09-21T03:40:51.469621+0000","last_undegraded":"2024-09-21T03:40:51.469621+0000","last_fullsized":"2024-09-21T03:40:51.469621+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:37.427015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469467+0000","last_change":"2024-09-21T03:40:29.342874+0000","last_active":"2024-09-21T03:40:51.469467+0000","last_peered":"2024-09-21T03:40:51.469467+0000","last_clean":"2024-09-21T03:40:51.469467+0000","last_became_active":"2024-09-21T03:40:29.342343+0000","last_became_peered":"2024-09-21T03:40:29.342343+0000","last_unstale":"2024-09-21T03:40:51.469467+0000","last_undegraded":"2024-09-21T03:40:51.469467+0000","last_fullsized":"2024-09-21T03:40:51.469467+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:52.473608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467076+0000","last_change":"2024-09-21T03:40:29.339231+0000","last_active":"2024-09-21T03:40:51.467076+0000","last_peered":"2024-09-21T03:40:51.467076+0000","last_clean":"2024-09-21T03:40:51.467076+0000","last_became_active":"2024-09-21T03:40:29.338724+0000","last_became_peered":"2024-09-21T03:40:29.338724+0000","last_unstale":"2024-09-21T03:40:51.467076+0000","last_undegraded":"2024-09-21T03:40:51.467076+0000","last_fullsized":"2024-09-21T03:40:51.467076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:55.592713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467451+0000","last_change":"2024-09-21T03:40:29.338480+0000","last_active":"2024-09-21T03:40:51.467451+0000","last_peered":"2024-09-21T03:40:51.467451+0000","last_clean":"2024-09-21T03:40:51.467451+0000","last_became_active":"2024-09-21T03:40:29.338092+0000","last_became_peered":"2024-09-21T03:40:29.338092+0000","last_unstale":"2024-09-21T03:40:51.467451+0000","last_undegraded":"2024-09-21T03:40:51.467451+0000","last_fullsized":"2024-09-21T03:40:51.467451+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:25.557502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470765+0000","last_change":"2024-09-21T03:40:29.335557+0000","last_active":"2024-09-21T03:40:51.470765+0000","last_peered":"2024-09-21T03:40:51.470765+0000","last_clean":"2024-09-21T03:40:51.470765+0000","last_became_active":"2024-09-21T03:40:29.335214+0000","last_became_peered":"2024-09-21T03:40:29.335214+0000","last_unstale":"2024-09-21T03:40:51.470765+0000","last_undegraded":"2024-09-21T03:40:51.470765+0000","last_fullsized":"2024-09-21T03:40:51.470765+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:21.395995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467706+0000","last_change":"2024-09-21T03:40:29.333041+0000","last_active":"2024-09-21T03:40:51.467706+0000","last_peered":"2024-09-21T03:40:51.467706+0000","last_clean":"2024-09-21T03:40:51.467706+0000","last_became_active":"2024-09-21T03:40:29.332187+0000","last_became_peered":"2024-09-21T03:40:29.332187+0000","last_unstale":"2024-09-21T03:40:51.467706+0000","last_undegraded":"2024-09-21T03:40:51.467706+0000","last_fullsized":"2024-09-21T03:40:51.467706+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:03.253594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.466928+0000","last_change":"2024-09-21T03:40:29.339152+0000","last_active":"2024-09-21T03:40:51.466928+0000","last_peered":"2024-09-21T03:40:51.466928+0000","last_clean":"2024-09-21T03:40:51.466928+0000","last_became_active":"2024-09-21T03:40:29.338722+0000","last_became_peered":"2024-09-21T03:40:29.338722+0000","last_unstale":"2024-09-21T03:40:51.466928+0000","last_undegraded":"2024-09-21T03:40:51.466928+0000","last_fullsized":"2024-09-21T03:40:51.466928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:32.143498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780525+0000","last_change":"2024-09-21T03:40:29.329169+0000","last_active":"2024-09-21T03:40:51.780525+0000","last_peered":"2024-09-21T03:40:51.780525+0000","last_clean":"2024-09-21T03:40:51.780525+0000","last_became_active":"2024-09-21T03:40:29.328805+0000","last_became_peered":"2024-09-21T03:40:29.328805+0000","last_unstale":"2024-09-21T03:40:51.780525+0000","last_undegraded":"2024-09-21T03:40:51.780525+0000","last_fullsized":"2024-09-21T03:40:51.780525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:13.725038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467313+0000","last_change":"2024-09-21T03:40:29.336699+0000","last_active":"2024-09-21T03:40:51.467313+0000","last_peered":"2024-09-21T03:40:51.467313+0000","last_clean":"2024-09-21T03:40:51.467313+0000","last_became_active":"2024-09-21T03:40:29.333649+0000","last_became_peered":"2024-09-21T03:40:29.333649+0000","last_unstale":"2024-09-21T03:40:51.467313+0000","last_undegraded":"2024-09-21T03:40:51.467313+0000","last_fullsized":"2024-09-21T03:40:51.467313+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:49.418205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463479+0000","last_change":"2024-09-21T03:40:29.337936+0000","last_active":"2024-09-21T03:40:51.463479+0000","last_peered":"2024-09-21T03:40:51.463479+0000","last_clean":"2024-09-21T03:40:51.463479+0000","last_became_active":"2024-09-21T03:40:29.337521+0000","last_became_peered":"2024-09-21T03:40:29.337521+0000","last_unstale":"2024-09-21T03:40:51.463479+0000","last_undegraded":"2024-09-21T03:40:51.463479+0000","last_fullsized":"2024-09-21T03:40:51.463479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:09.223634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464197+0000","last_change":"2024-09-21T03:40:29.336866+0000","last_active":"2024-09-21T03:40:51.464197+0000","last_peered":"2024-09-21T03:40:51.464197+0000","last_clean":"2024-09-21T03:40:51.464197+0000","last_became_active":"2024-09-21T03:40:29.336447+0000","last_became_peered":"2024-09-21T03:40:29.336447+0000","last_unstale":"2024-09-21T03:40:51.464197+0000","last_undegraded":"2024-09-21T03:40:51.464197+0000","last_fullsized":"2024-09-21T03:40:51.464197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:53.487678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463782+0000","last_change":"2024-09-21T03:40:29.333666+0000","last_active":"2024-09-21T03:40:51.463782+0000","last_peered":"2024-09-21T03:40:51.463782+0000","last_clean":"2024-09-21T03:40:51.463782+0000","last_became_active":"2024-09-21T03:40:29.333248+0000","last_became_peered":"2024-09-21T03:40:29.333248+0000","last_unstale":"2024-09-21T03:40:51.463782+0000","last_undegraded":"2024-09-21T03:40:51.463782+0000","last_fullsized":"2024-09-21T03:40:51.463782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:54.721926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467995+0000","last_change":"2024-09-21T03:40:29.342165+0000","last_active":"2024-09-21T03:40:51.467995+0000","last_peered":"2024-09-21T03:40:51.467995+0000","last_clean":"2024-09-21T03:40:51.467995+0000","last_became_active":"2024-09-21T03:40:29.341744+0000","last_became_peered":"2024-09-21T03:40:29.341744+0000","last_unstale":"2024-09-21T03:40:51.467995+0000","last_undegraded":"2024-09-21T03:40:51.467995+0000","last_fullsized":"2024-09-21T03:40:51.467995+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:04.641927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467072+0000","last_change":"2024-09-21T03:40:29.341728+0000","last_active":"2024-09-21T03:40:51.467072+0000","last_peered":"2024-09-21T03:40:51.467072+0000","last_clean":"2024-09-21T03:40:51.467072+0000","last_became_active":"2024-09-21T03:40:29.339252+0000","last_became_peered":"2024-09-21T03:40:29.339252+0000","last_unstale":"2024-09-21T03:40:51.467072+0000","last_undegraded":"2024-09-21T03:40:51.467072+0000","last_fullsized":"2024-09-21T03:40:51.467072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:53.618128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780271+0000","last_change":"2024-09-21T03:40:29.326893+0000","last_active":"2024-09-21T03:40:51.780271+0000","last_peered":"2024-09-21T03:40:51.780271+0000","last_clean":"2024-09-21T03:40:51.780271+0000","last_became_active":"2024-09-21T03:40:29.326427+0000","last_became_peered":"2024-09-21T03:40:29.326427+0000","last_unstale":"2024-09-21T03:40:51.780271+0000","last_undegraded":"2024-09-21T03:40:51.780271+0000","last_fullsized":"2024-09-21T03:40:51.780271+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:41.036179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469836+0000","last_change":"2024-09-21T03:40:29.340410+0000","last_active":"2024-09-21T03:40:51.469836+0000","last_peered":"2024-09-21T03:40:51.469836+0000","last_clean":"2024-09-21T03:40:51.469836+0000","last_became_active":"2024-09-21T03:40:29.340062+0000","last_became_peered":"2024-09-21T03:40:29.340062+0000","last_unstale":"2024-09-21T03:40:51.469836+0000","last_undegraded":"2024-09-21T03:40:51.469836+0000","last_fullsized":"2024-09-21T03:40:51.469836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:44.971145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467557+0000","last_change":"2024-09-21T03:40:29.333387+0000","last_active":"2024-09-21T03:40:51.467557+0000","last_peered":"2024-09-21T03:40:51.467557+0000","last_clean":"2024-09-21T03:40:51.467557+0000","last_became_active":"2024-09-21T03:40:29.332511+0000","last_became_peered":"2024-09-21T03:40:29.332511+0000","last_unstale":"2024-09-21T03:40:51.467557+0000","last_undegraded":"2024-09-21T03:40:51.467557+0000","last_fullsized":"2024-09-21T03:40:51.467557+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:24.513267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468408+0000","last_change":"2024-09-21T03:40:29.337845+0000","last_active":"2024-09-21T03:40:51.468408+0000","last_peered":"2024-09-21T03:40:51.468408+0000","last_clean":"2024-09-21T03:40:51.468408+0000","last_became_active":"2024-09-21T03:40:29.337387+0000","last_became_peered":"2024-09-21T03:40:29.337387+0000","last_unstale":"2024-09-21T03:40:51.468408+0000","last_undegraded":"2024-09-21T03:40:51.468408+0000","last_fullsized":"2024-09-21T03:40:51.468408+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:31.398337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.466847+0000","last_change":"2024-09-21T03:40:29.342691+0000","last_active":"2024-09-21T03:40:51.466847+0000","last_peered":"2024-09-21T03:40:51.466847+0000","last_clean":"2024-09-21T03:40:51.466847+0000","last_became_active":"2024-09-21T03:40:29.342294+0000","last_became_peered":"2024-09-21T03:40:29.342294+0000","last_unstale":"2024-09-21T03:40:51.466847+0000","last_undegraded":"2024-09-21T03:40:51.466847+0000","last_fullsized":"2024-09-21T03:40:51.466847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:25.806074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470482+0000","last_change":"2024-09-21T03:40:29.338280+0000","last_active":"2024-09-21T03:40:51.470482+0000","last_peered":"2024-09-21T03:40:51.470482+0000","last_clean":"2024-09-21T03:40:51.470482+0000","last_became_active":"2024-09-21T03:40:29.337825+0000","last_became_peered":"2024-09-21T03:40:29.337825+0000","last_unstale":"2024-09-21T03:40:51.470482+0000","last_undegraded":"2024-09-21T03:40:51.470482+0000","last_fullsized":"2024-09-21T03:40:51.470482+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:43.340248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":58,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.641217+0000","last_change":"2024-09-21T03:40:51.641130+0000","last_active":"2024-09-21T03:40:51.641217+0000","last_peered":"2024-09-21T03:40:51.641217+0000","last_clean":"2024-09-21T03:40:51.641217+0000","last_became_active":"2024-09-21T03:40:51.636641+0000","last_became_peered":"2024-09-21T03:40:51.636641+0000","last_unstale":"2024-09-21T03:40:51.641217+0000","last_undegraded":"2024-09-21T03:40:51.641217+0000","last_fullsized":"2024-09-21T03:40:51.641217+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:34.797959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464518+0000","last_change":"2024-09-21T03:40:29.341830+0000","last_active":"2024-09-21T03:40:51.464518+0000","last_peered":"2024-09-21T03:40:51.464518+0000","last_clean":"2024-09-21T03:40:51.464518+0000","last_became_active":"2024-09-21T03:40:29.341112+0000","last_became_peered":"2024-09-21T03:40:29.341112+0000","last_unstale":"2024-09-21T03:40:51.464518+0000","last_undegraded":"2024-09-21T03:40:51.464518+0000","last_fullsized":"2024-09-21T03:40:51.464518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:31.560605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468958+0000","last_change":"2024-09-21T03:40:27.319393+0000","last_active":"2024-09-21T03:40:51.468958+0000","last_peered":"2024-09-21T03:40:51.468958+0000","last_clean":"2024-09-21T03:40:51.468958+0000","last_became_active":"2024-09-21T03:40:27.319000+0000","last_became_peered":"2024-09-21T03:40:27.319000+0000","last_unstale":"2024-09-21T03:40:51.468958+0000","last_undegraded":"2024-09-21T03:40:51.468958+0000","last_fullsized":"2024-09-21T03:40:51.468958+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:24.752295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780193+0000","last_change":"2024-09-21T03:40:27.317276+0000","last_active":"2024-09-21T03:40:51.780193+0000","last_peered":"2024-09-21T03:40:51.780193+0000","last_clean":"2024-09-21T03:40:51.780193+0000","last_became_active":"2024-09-21T03:40:27.316955+0000","last_became_peered":"2024-09-21T03:40:27.316955+0000","last_unstale":"2024-09-21T03:40:51.780193+0000","last_undegraded":"2024-09-21T03:40:51.780193+0000","last_fullsized":"2024-09-21T03:40:51.780193+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:23.208493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463471+0000","last_change":"2024-09-21T03:40:29.324774+0000","last_active":"2024-09-21T03:40:51.463471+0000","last_peered":"2024-09-21T03:40:51.463471+0000","last_clean":"2024-09-21T03:40:51.463471+0000","last_became_active":"2024-09-21T03:40:29.324107+0000","last_became_peered":"2024-09-21T03:40:29.324107+0000","last_unstale":"2024-09-21T03:40:51.463471+0000","last_undegraded":"2024-09-21T03:40:51.463471+0000","last_fullsized":"2024-09-21T03:40:51.463471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:15.408620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464393+0000","last_change":"2024-09-21T03:40:27.316818+0000","last_active":"2024-09-21T03:40:51.464393+0000","last_peered":"2024-09-21T03:40:51.464393+0000","last_clean":"2024-09-21T03:40:51.464393+0000","last_became_active":"2024-09-21T03:40:27.316209+0000","last_became_peered":"2024-09-21T03:40:27.316209+0000","last_unstale":"2024-09-21T03:40:51.464393+0000","last_undegraded":"2024-09-21T03:40:51.464393+0000","last_fullsized":"2024-09-21T03:40:51.464393+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:01.869684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470071+0000","last_change":"2024-09-21T03:40:29.335033+0000","last_active":"2024-09-21T03:40:51.470071+0000","last_peered":"2024-09-21T03:40:51.470071+0000","last_clean":"2024-09-21T03:40:51.470071+0000","last_became_active":"2024-09-21T03:40:29.334607+0000","last_became_peered":"2024-09-21T03:40:29.334607+0000","last_unstale":"2024-09-21T03:40:51.470071+0000","last_undegraded":"2024-09-21T03:40:51.470071+0000","last_fullsized":"2024-09-21T03:40:51.470071+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:05.892248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469434+0000","last_change":"2024-09-21T03:40:27.319422+0000","last_active":"2024-09-21T03:40:51.469434+0000","last_peered":"2024-09-21T03:40:51.469434+0000","last_clean":"2024-09-21T03:40:51.469434+0000","last_became_active":"2024-09-21T03:40:27.318970+0000","last_became_peered":"2024-09-21T03:40:27.318970+0000","last_unstale":"2024-09-21T03:40:51.469434+0000","last_undegraded":"2024-09-21T03:40:51.469434+0000","last_fullsized":"2024-09-21T03:40:51.469434+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:04.263789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467619+0000","last_change":"2024-09-21T03:40:29.334279+0000","last_active":"2024-09-21T03:40:51.467619+0000","last_peered":"2024-09-21T03:40:51.467619+0000","last_clean":"2024-09-21T03:40:51.467619+0000","last_became_active":"2024-09-21T03:40:29.333445+0000","last_became_peered":"2024-09-21T03:40:29.333445+0000","last_unstale":"2024-09-21T03:40:51.467619+0000","last_undegraded":"2024-09-21T03:40:51.467619+0000","last_fullsized":"2024-09-21T03:40:51.467619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:10.445162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.643258+0000","last_change":"2024-09-21T03:40:51.643129+0000","last_active":"2024-09-21T03:40:51.643258+0000","last_peered":"2024-09-21T03:40:51.643258+0000","last_clean":"2024-09-21T03:40:51.643258+0000","last_became_active":"2024-09-21T03:40:51.637136+0000","last_became_peered":"2024-09-21T03:40:51.637136+0000","last_unstale":"2024-09-21T03:40:51.643258+0000","last_undegraded":"2024-09-21T03:40:51.643258+0000","last_fullsized":"2024-09-21T03:40:51.643258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:39.540452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470202+0000","last_change":"2024-09-21T03:40:29.340393+0000","last_active":"2024-09-21T03:40:51.470202+0000","last_peered":"2024-09-21T03:40:51.470202+0000","last_clean":"2024-09-21T03:40:51.470202+0000","last_became_active":"2024-09-21T03:40:29.340042+0000","last_became_peered":"2024-09-21T03:40:29.340042+0000","last_unstale":"2024-09-21T03:40:51.470202+0000","last_undegraded":"2024-09-21T03:40:51.470202+0000","last_fullsized":"2024-09-21T03:40:51.470202+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:43.794252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464730+0000","last_change":"2024-09-21T03:40:27.526458+0000","last_active":"2024-09-21T03:40:51.464730+0000","last_peered":"2024-09-21T03:40:51.464730+0000","last_clean":"2024-09-21T03:40:51.464730+0000","last_became_active":"2024-09-21T03:40:27.525918+0000","last_became_peered":"2024-09-21T03:40:27.525918+0000","last_unstale":"2024-09-21T03:40:51.464730+0000","last_undegraded":"2024-09-21T03:40:51.464730+0000","last_fullsized":"2024-09-21T03:40:51.464730+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:47.286475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467301+0000","last_change":"2024-09-21T03:40:29.338197+0000","last_active":"2024-09-21T03:40:51.467301+0000","last_peered":"2024-09-21T03:40:51.467301+0000","last_clean":"2024-09-21T03:40:51.467301+0000","last_became_active":"2024-09-21T03:40:29.337852+0000","last_became_peered":"2024-09-21T03:40:29.337852+0000","last_unstale":"2024-09-21T03:40:51.467301+0000","last_undegraded":"2024-09-21T03:40:51.467301+0000","last_fullsized":"2024-09-21T03:40:51.467301+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:09.132407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"75'22","reported_seq":79,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:52.638945+0000","last_change":"2024-09-21T03:40:27.320891+0000","last_active":"2024-09-21T03:40:52.638945+0000","last_peered":"2024-09-21T03:40:52.638945+0000","last_clean":"2024-09-21T03:40:52.638945+0000","last_became_active":"2024-09-21T03:40:27.320512+0000","last_became_peered":"2024-09-21T03:40:27.320512+0000","last_unstale":"2024-09-21T03:40:52.638945+0000","last_undegraded":"2024-09-21T03:40:52.638945+0000","last_fullsized":"2024-09-21T03:40:52.638945+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:27.181130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50940,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":66,"num_write":23,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470843+0000","last_change":"2024-09-21T03:40:29.335570+0000","last_active":"2024-09-21T03:40:51.470843+0000","last_peered":"2024-09-21T03:40:51.470843+0000","last_clean":"2024-09-21T03:40:51.470843+0000","last_became_active":"2024-09-21T03:40:29.335226+0000","last_became_peered":"2024-09-21T03:40:29.335226+0000","last_unstale":"2024-09-21T03:40:51.470843+0000","last_undegraded":"2024-09-21T03:40:51.470843+0000","last_fullsized":"2024-09-21T03:40:51.470843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:56.434945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468293+0000","last_change":"2024-09-21T03:40:27.318436+0000","last_active":"2024-09-21T03:40:51.468293+0000","last_peered":"2024-09-21T03:40:51.468293+0000","last_clean":"2024-09-21T03:40:51.468293+0000","last_became_active":"2024-09-21T03:40:27.317969+0000","last_became_peered":"2024-09-21T03:40:27.317969+0000","last_unstale":"2024-09-21T03:40:51.468293+0000","last_undegraded":"2024-09-21T03:40:51.468293+0000","last_fullsized":"2024-09-21T03:40:51.468293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:43.137717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780149+0000","last_change":"2024-09-21T03:40:29.325824+0000","last_active":"2024-09-21T03:40:51.780149+0000","last_peered":"2024-09-21T03:40:51.780149+0000","last_clean":"2024-09-21T03:40:51.780149+0000","last_became_active":"2024-09-21T03:40:29.325498+0000","last_became_peered":"2024-09-21T03:40:29.325498+0000","last_unstale":"2024-09-21T03:40:51.780149+0000","last_undegraded":"2024-09-21T03:40:51.780149+0000","last_fullsized":"2024-09-21T03:40:51.780149+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:13.044835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464366+0000","last_change":"2024-09-21T03:40:27.308889+0000","last_active":"2024-09-21T03:40:51.464366+0000","last_peered":"2024-09-21T03:40:51.464366+0000","last_clean":"2024-09-21T03:40:51.464366+0000","last_became_active":"2024-09-21T03:40:27.308491+0000","last_became_peered":"2024-09-21T03:40:27.308491+0000","last_unstale":"2024-09-21T03:40:51.464366+0000","last_undegraded":"2024-09-21T03:40:51.464366+0000","last_fullsized":"2024-09-21T03:40:51.464366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:48.250898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.781387+0000","last_change":"2024-09-21T03:40:51.781287+0000","last_active":"2024-09-21T03:40:51.781387+0000","last_peered":"2024-09-21T03:40:51.781387+0000","last_clean":"2024-09-21T03:40:51.781387+0000","last_became_active":"2024-09-21T03:40:51.780925+0000","last_became_peered":"2024-09-21T03:40:51.780925+0000","last_unstale":"2024-09-21T03:40:51.781387+0000","last_undegraded":"2024-09-21T03:40:51.781387+0000","last_fullsized":"2024-09-21T03:40:51.781387+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:36.599949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'3","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:40:50.462409+0000","last_change":"2024-09-21T03:40:27.316066+0000","last_active":"2024-09-21T03:40:50.462409+0000","last_peered":"2024-09-21T03:40:50.462409+0000","last_clean":"2024-09-21T03:40:50.462409+0000","last_became_active":"2024-09-21T03:40:27.315580+0000","last_became_peered":"2024-09-21T03:40:27.315580+0000","last_unstale":"2024-09-21T03:40:50.462409+0000","last_undegraded":"2024-09-21T03:40:50.462409+0000","last_fullsized":"2024-09-21T03:40:50.462409+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:14.592824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464178+0000","last_change":"2024-09-21T03:40:29.339736+0000","last_active":"2024-09-21T03:40:51.464178+0000","last_peered":"2024-09-21T03:40:51.464178+0000","last_clean":"2024-09-21T03:40:51.464178+0000","last_became_active":"2024-09-21T03:40:29.338343+0000","last_became_peered":"2024-09-21T03:40:29.338343+0000","last_unstale":"2024-09-21T03:40:51.464178+0000","last_undegraded":"2024-09-21T03:40:51.464178+0000","last_fullsized":"2024-09-21T03:40:51.464178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:33.531580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.485664+0000","last_change":"2024-09-21T03:40:51.485123+0000","last_active":"2024-09-21T03:40:51.485664+0000","last_peered":"2024-09-21T03:40:51.485664+0000","last_clean":"2024-09-21T03:40:51.485664+0000","last_became_active":"2024-09-21T03:40:51.471029+0000","last_became_peered":"2024-09-21T03:40:51.471029+0000","last_unstale":"2024-09-21T03:40:51.485664+0000","last_undegraded":"2024-09-21T03:40:51.485664+0000","last_fullsized":"2024-09-21T03:40:51.485664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:32.870908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464267+0000","last_change":"2024-09-21T03:40:29.340712+0000","last_active":"2024-09-21T03:40:51.464267+0000","last_peered":"2024-09-21T03:40:51.464267+0000","last_clean":"2024-09-21T03:40:51.464267+0000","last_became_active":"2024-09-21T03:40:29.340349+0000","last_became_peered":"2024-09-21T03:40:29.340349+0000","last_unstale":"2024-09-21T03:40:51.464267+0000","last_undegraded":"2024-09-21T03:40:51.464267+0000","last_fullsized":"2024-09-21T03:40:51.464267+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:29.980697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470772+0000","last_change":"2024-09-21T03:40:27.319689+0000","last_active":"2024-09-21T03:40:51.470772+0000","last_peered":"2024-09-21T03:40:51.470772+0000","last_clean":"2024-09-21T03:40:51.470772+0000","last_became_active":"2024-09-21T03:40:27.319010+0000","last_became_peered":"2024-09-21T03:40:27.319010+0000","last_unstale":"2024-09-21T03:40:51.470772+0000","last_undegraded":"2024-09-21T03:40:51.470772+0000","last_fullsized":"2024-09-21T03:40:51.470772+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:42.965205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.636897+0000","last_change":"2024-09-21T03:40:51.636790+0000","last_active":"2024-09-21T03:40:51.636897+0000","last_peered":"2024-09-21T03:40:51.636897+0000","last_clean":"2024-09-21T03:40:51.636897+0000","last_became_active":"2024-09-21T03:40:51.636333+0000","last_became_peered":"2024-09-21T03:40:51.636333+0000","last_unstale":"2024-09-21T03:40:51.636897+0000","last_undegraded":"2024-09-21T03:40:51.636897+0000","last_fullsized":"2024-09-21T03:40:51.636897+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:27.186564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780182+0000","last_change":"2024-09-21T03:40:27.316086+0000","last_active":"2024-09-21T03:40:51.780182+0000","last_peered":"2024-09-21T03:40:51.780182+0000","last_clean":"2024-09-21T03:40:51.780182+0000","last_became_active":"2024-09-21T03:40:27.315645+0000","last_became_peered":"2024-09-21T03:40:27.315645+0000","last_unstale":"2024-09-21T03:40:51.780182+0000","last_undegraded":"2024-09-21T03:40:51.780182+0000","last_fullsized":"2024-09-21T03:40:51.780182+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:41.536778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464622+0000","last_change":"2024-09-21T03:40:29.339546+0000","last_active":"2024-09-21T03:40:51.464622+0000","last_peered":"2024-09-21T03:40:51.464622+0000","last_clean":"2024-09-21T03:40:51.464622+0000","last_became_active":"2024-09-21T03:40:29.339176+0000","last_became_peered":"2024-09-21T03:40:29.339176+0000","last_unstale":"2024-09-21T03:40:51.464622+0000","last_undegraded":"2024-09-21T03:40:51.464622+0000","last_fullsized":"2024-09-21T03:40:51.464622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:26.405624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464973+0000","last_change":"2024-09-21T03:40:27.315440+0000","last_active":"2024-09-21T03:40:51.464973+0000","last_peered":"2024-09-21T03:40:51.464973+0000","last_clean":"2024-09-21T03:40:51.464973+0000","last_became_active":"2024-09-21T03:40:27.314608+0000","last_became_peered":"2024-09-21T03:40:27.314608+0000","last_unstale":"2024-09-21T03:40:51.464973+0000","last_undegraded":"2024-09-21T03:40:51.464973+0000","last_fullsized":"2024-09-21T03:40:51.464973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:11.465078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464466+0000","last_change":"2024-09-21T03:40:29.336631+0000","last_active":"2024-09-21T03:40:51.464466+0000","last_peered":"2024-09-21T03:40:51.464466+0000","last_clean":"2024-09-21T03:40:51.464466+0000","last_became_active":"2024-09-21T03:40:29.336201+0000","last_became_peered":"2024-09-21T03:40:29.336201+0000","last_unstale":"2024-09-21T03:40:51.464466+0000","last_undegraded":"2024-09-21T03:40:51.464466+0000","last_fullsized":"2024-09-21T03:40:51.464466+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:29.514908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468161+0000","last_change":"2024-09-21T03:40:27.719183+0000","last_active":"2024-09-21T03:40:51.468161+0000","last_peered":"2024-09-21T03:40:51.468161+0000","last_clean":"2024-09-21T03:40:51.468161+0000","last_became_active":"2024-09-21T03:40:27.718658+0000","last_became_peered":"2024-09-21T03:40:27.718658+0000","last_unstale":"2024-09-21T03:40:51.468161+0000","last_undegraded":"2024-09-21T03:40:51.468161+0000","last_fullsized":"2024-09-21T03:40:51.468161+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:52.280654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464860+0000","last_change":"2024-09-21T03:40:29.335258+0000","last_active":"2024-09-21T03:40:51.464860+0000","last_peered":"2024-09-21T03:40:51.464860+0000","last_clean":"2024-09-21T03:40:51.464860+0000","last_became_active":"2024-09-21T03:40:29.334897+0000","last_became_peered":"2024-09-21T03:40:29.334897+0000","last_unstale":"2024-09-21T03:40:51.464860+0000","last_undegraded":"2024-09-21T03:40:51.464860+0000","last_fullsized":"2024-09-21T03:40:51.464860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:27.040232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":95,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464382+0000","last_change":"2024-09-21T03:39:15.369567+0000","last_active":"2024-09-21T03:40:51.464382+0000","last_peered":"2024-09-21T03:40:51.464382+0000","last_clean":"2024-09-21T03:40:51.464382+0000","last_became_active":"2024-09-21T03:39:15.363960+0000","last_became_peered":"2024-09-21T03:39:15.363960+0000","last_unstale":"2024-09-21T03:40:51.464382+0000","last_undegraded":"2024-09-21T03:40:51.464382+0000","last_fullsized":"2024-09-21T03:40:51.464382+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:35:51.240165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:35:51.240165+0000","last_clean_scrub_stamp":"2024-09-21T03:35:51.240165+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:10.335425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:40:50.462002+0000","last_change":"2024-09-21T03:40:27.316831+0000","last_active":"2024-09-21T03:40:50.462002+0000","last_peered":"2024-09-21T03:40:50.462002+0000","last_clean":"2024-09-21T03:40:50.462002+0000","last_became_active":"2024-09-21T03:40:27.315547+0000","last_became_peered":"2024-09-21T03:40:27.315547+0000","last_unstale":"2024-09-21T03:40:50.462002+0000","last_undegraded":"2024-09-21T03:40:50.462002+0000","last_fullsized":"2024-09-21T03:40:50.462002+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:02.727366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463852+0000","last_change":"2024-09-21T03:40:29.339059+0000","last_active":"2024-09-21T03:40:51.463852+0000","last_peered":"2024-09-21T03:40:51.463852+0000","last_clean":"2024-09-21T03:40:51.463852+0000","last_became_active":"2024-09-21T03:40:29.338710+0000","last_became_peered":"2024-09-21T03:40:29.338710+0000","last_unstale":"2024-09-21T03:40:51.463852+0000","last_undegraded":"2024-09-21T03:40:51.463852+0000","last_fullsized":"2024-09-21T03:40:51.463852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:50.390629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464355+0000","last_change":"2024-09-21T03:40:27.314666+0000","last_active":"2024-09-21T03:40:51.464355+0000","last_peered":"2024-09-21T03:40:51.464355+0000","last_clean":"2024-09-21T03:40:51.464355+0000","last_became_active":"2024-09-21T03:40:27.314254+0000","last_became_peered":"2024-09-21T03:40:27.314254+0000","last_unstale":"2024-09-21T03:40:51.464355+0000","last_undegraded":"2024-09-21T03:40:51.464355+0000","last_fullsized":"2024-09-21T03:40:51.464355+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:57.230420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780142+0000","last_change":"2024-09-21T03:40:29.338249+0000","last_active":"2024-09-21T03:40:51.780142+0000","last_peered":"2024-09-21T03:40:51.780142+0000","last_clean":"2024-09-21T03:40:51.780142+0000","last_became_active":"2024-09-21T03:40:29.337901+0000","last_became_peered":"2024-09-21T03:40:29.337901+0000","last_unstale":"2024-09-21T03:40:51.780142+0000","last_undegraded":"2024-09-21T03:40:51.780142+0000","last_fullsized":"2024-09-21T03:40:51.780142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:21.054734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.779979+0000","last_change":"2024-09-21T03:40:27.525651+0000","last_active":"2024-09-21T03:40:51.779979+0000","last_peered":"2024-09-21T03:40:51.779979+0000","last_clean":"2024-09-21T03:40:51.779979+0000","last_became_active":"2024-09-21T03:40:27.525299+0000","last_became_peered":"2024-09-21T03:40:27.525299+0000","last_unstale":"2024-09-21T03:40:51.779979+0000","last_undegraded":"2024-09-21T03:40:51.779979+0000","last_fullsized":"2024-09-21T03:40:51.779979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:21.983937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464267+0000","last_change":"2024-09-21T03:40:29.339021+0000","last_active":"2024-09-21T03:40:51.464267+0000","last_peered":"2024-09-21T03:40:51.464267+0000","last_clean":"2024-09-21T03:40:51.464267+0000","last_became_active":"2024-09-21T03:40:29.338660+0000","last_became_peered":"2024-09-21T03:40:29.338660+0000","last_unstale":"2024-09-21T03:40:51.464267+0000","last_undegraded":"2024-09-21T03:40:51.464267+0000","last_fullsized":"2024-09-21T03:40:51.464267+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:56.652048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.465111+0000","last_change":"2024-09-21T03:40:27.319650+0000","last_active":"2024-09-21T03:40:51.465111+0000","last_peered":"2024-09-21T03:40:51.465111+0000","last_clean":"2024-09-21T03:40:51.465111+0000","last_became_active":"2024-09-21T03:40:27.319188+0000","last_became_peered":"2024-09-21T03:40:27.319188+0000","last_unstale":"2024-09-21T03:40:51.465111+0000","last_undegraded":"2024-09-21T03:40:51.465111+0000","last_fullsized":"2024-09-21T03:40:51.465111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:12.905682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469050+0000","last_change":"2024-09-21T03:40:29.340673+0000","last_active":"2024-09-21T03:40:51.469050+0000","last_peered":"2024-09-21T03:40:51.469050+0000","last_clean":"2024-09-21T03:40:51.469050+0000","last_became_active":"2024-09-21T03:40:29.340240+0000","last_became_peered":"2024-09-21T03:40:29.340240+0000","last_unstale":"2024-09-21T03:40:51.469050+0000","last_undegraded":"2024-09-21T03:40:51.469050+0000","last_fullsized":"2024-09-21T03:40:51.469050+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:02.989879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470390+0000","last_change":"2024-09-21T03:40:27.527803+0000","last_active":"2024-09-21T03:40:51.470390+0000","last_peered":"2024-09-21T03:40:51.470390+0000","last_clean":"2024-09-21T03:40:51.470390+0000","last_became_active":"2024-09-21T03:40:27.527419+0000","last_became_peered":"2024-09-21T03:40:27.527419+0000","last_unstale":"2024-09-21T03:40:51.470390+0000","last_undegraded":"2024-09-21T03:40:51.470390+0000","last_fullsized":"2024-09-21T03:40:51.470390+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:15:16.081458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469232+0000","last_change":"2024-09-21T03:40:29.347927+0000","last_active":"2024-09-21T03:40:51.469232+0000","last_peered":"2024-09-21T03:40:51.469232+0000","last_clean":"2024-09-21T03:40:51.469232+0000","last_became_active":"2024-09-21T03:40:29.347574+0000","last_became_peered":"2024-09-21T03:40:29.347574+0000","last_unstale":"2024-09-21T03:40:51.469232+0000","last_undegraded":"2024-09-21T03:40:51.469232+0000","last_fullsized":"2024-09-21T03:40:51.469232+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:10.142931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.488011+0000","last_change":"2024-09-21T03:40:51.487492+0000","last_active":"2024-09-21T03:40:51.488011+0000","last_peered":"2024-09-21T03:40:51.488011+0000","last_clean":"2024-09-21T03:40:51.488011+0000","last_became_active":"2024-09-21T03:40:51.472023+0000","last_became_peered":"2024-09-21T03:40:51.472023+0000","last_unstale":"2024-09-21T03:40:51.488011+0000","last_undegraded":"2024-09-21T03:40:51.488011+0000","last_fullsized":"2024-09-21T03:40:51.488011+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:40.164056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780314+0000","last_change":"2024-09-21T03:40:29.332539+0000","last_active":"2024-09-21T03:40:51.780314+0000","last_peered":"2024-09-21T03:40:51.780314+0000","last_clean":"2024-09-21T03:40:51.780314+0000","last_became_active":"2024-09-21T03:40:29.332178+0000","last_became_peered":"2024-09-21T03:40:29.332178+0000","last_unstale":"2024-09-21T03:40:51.780314+0000","last_undegraded":"2024-09-21T03:40:51.780314+0000","last_fullsized":"2024-09-21T03:40:51.780314+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:00.354558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'8","reported_seq":31,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470835+0000","last_change":"2024-09-21T03:40:27.313942+0000","last_active":"2024-09-21T03:40:51.470835+0000","last_peered":"2024-09-21T03:40:51.470835+0000","last_clean":"2024-09-21T03:40:51.470835+0000","last_became_active":"2024-09-21T03:40:27.313541+0000","last_became_peered":"2024-09-21T03:40:27.313541+0000","last_unstale":"2024-09-21T03:40:51.470835+0000","last_undegraded":"2024-09-21T03:40:51.470835+0000","last_fullsized":"2024-09-21T03:40:51.470835+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:58.572154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463827+0000","last_change":"2024-09-21T03:40:29.330712+0000","last_active":"2024-09-21T03:40:51.463827+0000","last_peered":"2024-09-21T03:40:51.463827+0000","last_clean":"2024-09-21T03:40:51.463827+0000","last_became_active":"2024-09-21T03:40:29.330345+0000","last_became_peered":"2024-09-21T03:40:29.330345+0000","last_unstale":"2024-09-21T03:40:51.463827+0000","last_undegraded":"2024-09-21T03:40:51.463827+0000","last_fullsized":"2024-09-21T03:40:51.463827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:54.225288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T03:40:50.462464+0000","last_change":"2024-09-21T03:40:27.719239+0000","last_active":"2024-09-21T03:40:50.462464+0000","last_peered":"2024-09-21T03:40:50.462464+0000","last_clean":"2024-09-21T03:40:50.462464+0000","last_became_active":"2024-09-21T03:40:27.718834+0000","last_became_peered":"2024-09-21T03:40:27.718834+0000","last_unstale":"2024-09-21T03:40:50.462464+0000","last_undegraded":"2024-09-21T03:40:50.462464+0000","last_fullsized":"2024-09-21T03:40:50.462464+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:47.357723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470066+0000","last_change":"2024-09-21T03:40:29.338470+0000","last_active":"2024-09-21T03:40:51.470066+0000","last_peered":"2024-09-21T03:40:51.470066+0000","last_clean":"2024-09-21T03:40:51.470066+0000","last_became_active":"2024-09-21T03:40:29.338114+0000","last_became_peered":"2024-09-21T03:40:29.338114+0000","last_unstale":"2024-09-21T03:40:51.470066+0000","last_undegraded":"2024-09-21T03:40:51.470066+0000","last_fullsized":"2024-09-21T03:40:51.470066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:23.715773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467223+0000","last_change":"2024-09-21T03:40:27.525544+0000","last_active":"2024-09-21T03:40:51.467223+0000","last_peered":"2024-09-21T03:40:51.467223+0000","last_clean":"2024-09-21T03:40:51.467223+0000","last_became_active":"2024-09-21T03:40:27.525196+0000","last_became_peered":"2024-09-21T03:40:27.525196+0000","last_unstale":"2024-09-21T03:40:51.467223+0000","last_undegraded":"2024-09-21T03:40:51.467223+0000","last_fullsized":"2024-09-21T03:40:51.467223+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:57:07.882351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470212+0000","last_change":"2024-09-21T03:40:29.337774+0000","last_active":"2024-09-21T03:40:51.470212+0000","last_peered":"2024-09-21T03:40:51.470212+0000","last_clean":"2024-09-21T03:40:51.470212+0000","last_became_active":"2024-09-21T03:40:29.337393+0000","last_became_peered":"2024-09-21T03:40:29.337393+0000","last_unstale":"2024-09-21T03:40:51.470212+0000","last_undegraded":"2024-09-21T03:40:51.470212+0000","last_fullsized":"2024-09-21T03:40:51.470212+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:20.471042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463610+0000","last_change":"2024-09-21T03:40:27.312953+0000","last_active":"2024-09-21T03:40:51.463610+0000","last_peered":"2024-09-21T03:40:51.463610+0000","last_clean":"2024-09-21T03:40:51.463610+0000","last_became_active":"2024-09-21T03:40:27.312603+0000","last_became_peered":"2024-09-21T03:40:27.312603+0000","last_unstale":"2024-09-21T03:40:51.463610+0000","last_undegraded":"2024-09-21T03:40:51.463610+0000","last_fullsized":"2024-09-21T03:40:51.463610+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:18.102812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467010+0000","last_change":"2024-09-21T03:40:29.330802+0000","last_active":"2024-09-21T03:40:51.467010+0000","last_peered":"2024-09-21T03:40:51.467010+0000","last_clean":"2024-09-21T03:40:51.467010+0000","last_became_active":"2024-09-21T03:40:29.330426+0000","last_became_peered":"2024-09-21T03:40:29.330426+0000","last_unstale":"2024-09-21T03:40:51.467010+0000","last_undegraded":"2024-09-21T03:40:51.467010+0000","last_fullsized":"2024-09-21T03:40:51.467010+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:08:18.552649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467619+0000","last_change":"2024-09-21T03:40:27.319829+0000","last_active":"2024-09-21T03:40:51.467619+0000","last_peered":"2024-09-21T03:40:51.467619+0000","last_clean":"2024-09-21T03:40:51.467619+0000","last_became_active":"2024-09-21T03:40:27.319410+0000","last_became_peered":"2024-09-21T03:40:27.319410+0000","last_unstale":"2024-09-21T03:40:51.467619+0000","last_undegraded":"2024-09-21T03:40:51.467619+0000","last_fullsized":"2024-09-21T03:40:51.467619+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:56.475721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463651+0000","last_change":"2024-09-21T03:40:29.335897+0000","last_active":"2024-09-21T03:40:51.463651+0000","last_peered":"2024-09-21T03:40:51.463651+0000","last_clean":"2024-09-21T03:40:51.463651+0000","last_became_active":"2024-09-21T03:40:29.335549+0000","last_became_peered":"2024-09-21T03:40:29.335549+0000","last_unstale":"2024-09-21T03:40:51.463651+0000","last_undegraded":"2024-09-21T03:40:51.463651+0000","last_fullsized":"2024-09-21T03:40:51.463651+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:01.401766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470266+0000","last_change":"2024-09-21T03:40:27.316678+0000","last_active":"2024-09-21T03:40:51.470266+0000","last_peered":"2024-09-21T03:40:51.470266+0000","last_clean":"2024-09-21T03:40:51.470266+0000","last_became_active":"2024-09-21T03:40:27.315980+0000","last_became_peered":"2024-09-21T03:40:27.315980+0000","last_unstale":"2024-09-21T03:40:51.470266+0000","last_undegraded":"2024-09-21T03:40:51.470266+0000","last_fullsized":"2024-09-21T03:40:51.470266+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:56.280077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464472+0000","last_change":"2024-09-21T03:40:29.333638+0000","last_active":"2024-09-21T03:40:51.464472+0000","last_peered":"2024-09-21T03:40:51.464472+0000","last_clean":"2024-09-21T03:40:51.464472+0000","last_became_active":"2024-09-21T03:40:29.333268+0000","last_became_peered":"2024-09-21T03:40:29.333268+0000","last_unstale":"2024-09-21T03:40:51.464472+0000","last_undegraded":"2024-09-21T03:40:51.464472+0000","last_fullsized":"2024-09-21T03:40:51.464472+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:35:23.346837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464730+0000","last_change":"2024-09-21T03:40:29.342199+0000","last_active":"2024-09-21T03:40:51.464730+0000","last_peered":"2024-09-21T03:40:51.464730+0000","last_clean":"2024-09-21T03:40:51.464730+0000","last_became_active":"2024-09-21T03:40:29.341675+0000","last_became_peered":"2024-09-21T03:40:29.341675+0000","last_unstale":"2024-09-21T03:40:51.464730+0000","last_undegraded":"2024-09-21T03:40:51.464730+0000","last_fullsized":"2024-09-21T03:40:51.464730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:01.439058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470666+0000","last_change":"2024-09-21T03:40:27.319327+0000","last_active":"2024-09-21T03:40:51.470666+0000","last_peered":"2024-09-21T03:40:51.470666+0000","last_clean":"2024-09-21T03:40:51.470666+0000","last_became_active":"2024-09-21T03:40:27.318773+0000","last_became_peered":"2024-09-21T03:40:27.318773+0000","last_unstale":"2024-09-21T03:40:51.470666+0000","last_undegraded":"2024-09-21T03:40:51.470666+0000","last_fullsized":"2024-09-21T03:40:51.470666+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:42.444238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467214+0000","last_change":"2024-09-21T03:40:29.336121+0000","last_active":"2024-09-21T03:40:51.467214+0000","last_peered":"2024-09-21T03:40:51.467214+0000","last_clean":"2024-09-21T03:40:51.467214+0000","last_became_active":"2024-09-21T03:40:29.333523+0000","last_became_peered":"2024-09-21T03:40:29.333523+0000","last_unstale":"2024-09-21T03:40:51.467214+0000","last_undegraded":"2024-09-21T03:40:51.467214+0000","last_fullsized":"2024-09-21T03:40:51.467214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:29.303410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470911+0000","last_change":"2024-09-21T03:40:27.316523+0000","last_active":"2024-09-21T03:40:51.470911+0000","last_peered":"2024-09-21T03:40:51.470911+0000","last_clean":"2024-09-21T03:40:51.470911+0000","last_became_active":"2024-09-21T03:40:27.316099+0000","last_became_peered":"2024-09-21T03:40:27.316099+0000","last_unstale":"2024-09-21T03:40:51.470911+0000","last_undegraded":"2024-09-21T03:40:51.470911+0000","last_fullsized":"2024-09-21T03:40:51.470911+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:44.091964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470170+0000","last_change":"2024-09-21T03:40:29.333887+0000","last_active":"2024-09-21T03:40:51.470170+0000","last_peered":"2024-09-21T03:40:51.470170+0000","last_clean":"2024-09-21T03:40:51.470170+0000","last_became_active":"2024-09-21T03:40:29.333465+0000","last_became_peered":"2024-09-21T03:40:29.333465+0000","last_unstale":"2024-09-21T03:40:51.470170+0000","last_undegraded":"2024-09-21T03:40:51.470170+0000","last_fullsized":"2024-09-21T03:40:51.470170+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:46.788188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464003+0000","last_change":"2024-09-21T03:40:27.525812+0000","last_active":"2024-09-21T03:40:51.464003+0000","last_peered":"2024-09-21T03:40:51.464003+0000","last_clean":"2024-09-21T03:40:51.464003+0000","last_became_active":"2024-09-21T03:40:27.525391+0000","last_became_peered":"2024-09-21T03:40:27.525391+0000","last_unstale":"2024-09-21T03:40:51.464003+0000","last_undegraded":"2024-09-21T03:40:51.464003+0000","last_fullsized":"2024-09-21T03:40:51.464003+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:07.856442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463860+0000","last_change":"2024-09-21T03:40:29.339079+0000","last_active":"2024-09-21T03:40:51.463860+0000","last_peered":"2024-09-21T03:40:51.463860+0000","last_clean":"2024-09-21T03:40:51.463860+0000","last_became_active":"2024-09-21T03:40:29.338737+0000","last_became_peered":"2024-09-21T03:40:29.338737+0000","last_unstale":"2024-09-21T03:40:51.463860+0000","last_undegraded":"2024-09-21T03:40:51.463860+0000","last_fullsized":"2024-09-21T03:40:51.463860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:14.863848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470639+0000","last_change":"2024-09-21T03:40:27.316037+0000","last_active":"2024-09-21T03:40:51.470639+0000","last_peered":"2024-09-21T03:40:51.470639+0000","last_clean":"2024-09-21T03:40:51.470639+0000","last_became_active":"2024-09-21T03:40:27.315604+0000","last_became_peered":"2024-09-21T03:40:27.315604+0000","last_unstale":"2024-09-21T03:40:51.470639+0000","last_undegraded":"2024-09-21T03:40:51.470639+0000","last_fullsized":"2024-09-21T03:40:51.470639+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:48.176252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54941,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":94,"num_read_kb":109,"num_write":151,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1147,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":171962,"data_compressed":5679,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247442,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743442,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":847872,"data_stored":416171,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906966,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":974848,"data_stored":1058458,"data_compressed":43442,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070492,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":851968,"data_stored":416273,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266720,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":839680,"data_stored":416059,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430245,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":901120,"data_stored":1008123,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593771,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":827392,"data_stored":407033,"data_compressed":2865,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790000,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":913408,"data_stored":1007807,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986229,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":831488,"data_stored":407470,"data_compressed":2865,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":856064,"data_stored":415973,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":905216,"data_stored":467123,"data_compressed":7630,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":474547,"data_compressed":7630,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705738,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":860160,"data_stored":416933,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34191,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34191,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":59092,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":51668,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":52518,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:40:57.999 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T03:40:57.999 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T03:40:58.000 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T03:40:58.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:57 smithi174 ceph-mon[34403]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:40:58.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:57 smithi172 ceph-mon[34821]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:40:58.249 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:58.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.799+0000 7fc057af1640 1 -- 172.21.15.84:0/74176134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc050102a80 msgr2=0x7fc050102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:58.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.799+0000 7fc057af1640 1 --2- 172.21.15.84:0/74176134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc050102a80 0x7fc050102e90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009900 tx=0x7fc04c02a3f0 comp rx=0 tx=0).stop 2024-09-21T03:40:58.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.799+0000 7fc057af1640 1 -- 172.21.15.84:0/74176134 shutdown_connections 2024-09-21T03:40:58.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.799+0000 7fc057af1640 1 --2- 172.21.15.84:0/74176134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc050108d10 0x7fc05010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:58.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.799+0000 7fc057af1640 1 --2- 172.21.15.84:0/74176134 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0501083c0 0x7fc0501087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:58.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.799+0000 7fc057af1640 1 --2- 172.21.15.84:0/74176134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc050102a80 0x7fc050102e90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:58.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.799+0000 7fc057af1640 1 -- 172.21.15.84:0/74176134 >> 172.21.15.84:0/74176134 conn(0x7fc050079760 msgr2=0x7fc050079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:58.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.799+0000 7fc057af1640 1 -- 172.21.15.84:0/74176134 shutdown_connections 2024-09-21T03:40:58.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.799+0000 7fc057af1640 1 -- 172.21.15.84:0/74176134 wait complete. 2024-09-21T03:40:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.800+0000 7fc057af1640 1 Processor -- start 2024-09-21T03:40:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.800+0000 7fc057af1640 1 -- start start 2024-09-21T03:40:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.800+0000 7fc057af1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc050102a80 0x7fc05019b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.800+0000 7fc057af1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0501083c0 0x7fc05019b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.800+0000 7fc057af1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc050108d10 0x7fc05019bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.800+0000 7fc057af1640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc050112980 con 0x7fc050108d10 2024-09-21T03:40:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.800+0000 7fc057af1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc050112800 con 0x7fc050102a80 2024-09-21T03:40:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.800+0000 7fc057af1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc050112b00 con 0x7fc0501083c0 2024-09-21T03:40:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.801+0000 7fc05608e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc050108d10 0x7fc05019bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.801+0000 7fc05608e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc050108d10 0x7fc05019bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55890/0 (socket says 172.21.15.84:55890) 2024-09-21T03:40:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.801+0000 7fc05608e640 1 -- 172.21.15.84:0/111191224 learned_addr learned my addr 172.21.15.84:0/111191224 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:40:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.801+0000 7fc05588d640 1 --2- 172.21.15.84:0/111191224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc050102a80 0x7fc05019b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.801+0000 7fc05508c640 1 --2- 172.21.15.84:0/111191224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0501083c0 0x7fc05019b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.801+0000 7fc05608e640 1 -- 172.21.15.84:0/111191224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0501083c0 msgr2=0x7fc05019b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:58.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.801+0000 7fc05608e640 1 --2- 172.21.15.84:0/111191224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0501083c0 0x7fc05019b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.801+0000 7fc05608e640 1 -- 172.21.15.84:0/111191224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc050102a80 msgr2=0x7fc05019b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.801+0000 7fc05608e640 1 --2- 172.21.15.84:0/111191224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc050102a80 0x7fc05019b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.801+0000 7fc05608e640 1 -- 172.21.15.84:0/111191224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0501a63f0 con 0x7fc050108d10 2024-09-21T03:40:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.801+0000 7fc05608e640 1 --2- 172.21.15.84:0/111191224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc050108d10 0x7fc05019bc70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc04800cce0 tx=0x7fc04800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.801+0000 7fc046ffd640 1 -- 172.21.15.84:0/111191224 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04800f450 con 0x7fc050108d10 2024-09-21T03:40:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.801+0000 7fc057af1640 1 -- 172.21.15.84:0/111191224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0501a66e0 con 0x7fc050108d10 2024-09-21T03:40:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.801+0000 7fc046ffd640 1 -- 172.21.15.84:0/111191224 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc04800faa0 con 0x7fc050108d10 2024-09-21T03:40:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.801+0000 7fc046ffd640 1 -- 172.21.15.84:0/111191224 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc048018b70 con 0x7fc050108d10 2024-09-21T03:40:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.801+0000 7fc057af1640 1 -- 172.21.15.84:0/111191224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0501a6c20 con 0x7fc050108d10 2024-09-21T03:40:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.802+0000 7fc057af1640 1 -- 172.21.15.84:0/111191224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc050102e90 con 0x7fc050108d10 2024-09-21T03:40:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.804+0000 7fc046ffd640 1 -- 172.21.15.84:0/111191224 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fc048018d10 con 0x7fc050108d10 2024-09-21T03:40:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.805+0000 7fc046ffd640 1 --2- 172.21.15.84:0/111191224 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc03c0b6620 0x7fc03c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.805+0000 7fc05588d640 1 --2- 172.21.15.84:0/111191224 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc03c0b6620 0x7fc03c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.805+0000 7fc046ffd640 1 -- 172.21.15.84:0/111191224 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fc0480e7a70 con 0x7fc050108d10 2024-09-21T03:40:58.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.805+0000 7fc05588d640 1 --2- 172.21.15.84:0/111191224 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc03c0b6620 0x7fc03c0b8b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc04c000c00 tx=0x7fc04c031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:58.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:58.808+0000 7fc046ffd640 1 -- 172.21.15.84:0/111191224 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc048014030 con 0x7fc050108d10 2024-09-21T03:40:59.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:59.055+0000 7fc057af1640 1 -- 172.21.15.84:0/111191224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fc05006b270 con 0x7fc050108d10 2024-09-21T03:40:59.057 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:58 smithi084 ceph-mon[30941]: pgmap v279: 97 pgs: 97 active+clean; 630 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.1 KiB/s wr, 6 op/s; 143 B/s, 1 objects/s recovering 2024-09-21T03:40:59.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:59.059+0000 7fc046ffd640 1 -- 172.21.15.84:0/111191224 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fc05006b270 con 0x7fc050108d10 2024-09-21T03:40:59.061 INFO:teuthology.orchestra.run.smithi084.stdout:[client.0] 2024-09-21T03:40:59.061 INFO:teuthology.orchestra.run.smithi084.stdout: key = AQBLQO5mmWdmAxAAyYjKUjDStYNHUbzclMG+YA== 2024-09-21T03:40:59.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:59.061+0000 7fc057af1640 1 -- 172.21.15.84:0/111191224 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc03c0b6620 msgr2=0x7fc03c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:59.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:59.061+0000 7fc057af1640 1 --2- 172.21.15.84:0/111191224 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc03c0b6620 0x7fc03c0b8b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc04c000c00 tx=0x7fc04c031400 comp rx=0 tx=0).stop 2024-09-21T03:40:59.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:59.061+0000 7fc057af1640 1 -- 172.21.15.84:0/111191224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc050108d10 msgr2=0x7fc05019bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:59.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:59.061+0000 7fc057af1640 1 --2- 172.21.15.84:0/111191224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc050108d10 0x7fc05019bc70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc04800cce0 tx=0x7fc04800a620 comp rx=0 tx=0).stop 2024-09-21T03:40:59.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:59.061+0000 7fc057af1640 1 -- 172.21.15.84:0/111191224 shutdown_connections 2024-09-21T03:40:59.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:59.061+0000 7fc057af1640 1 --2- 172.21.15.84:0/111191224 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc03c0b6620 0x7fc03c0b8b30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:59.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:59.061+0000 7fc057af1640 1 --2- 172.21.15.84:0/111191224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc050108d10 0x7fc05019bc70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:59.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:59.061+0000 7fc057af1640 1 --2- 172.21.15.84:0/111191224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc0501083c0 0x7fc05019b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:59.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:59.061+0000 7fc057af1640 1 --2- 172.21.15.84:0/111191224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc050102a80 0x7fc05019b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:59.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:59.061+0000 7fc057af1640 1 -- 172.21.15.84:0/111191224 >> 172.21.15.84:0/111191224 conn(0x7fc050079760 msgr2=0x7fc050101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:59.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:59.061+0000 7fc057af1640 1 -- 172.21.15.84:0/111191224 shutdown_connections 2024-09-21T03:40:59.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:40:59.061+0000 7fc057af1640 1 -- 172.21.15.84:0/111191224 wait complete. 2024-09-21T03:40:59.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:58 smithi174 ceph-mon[34403]: pgmap v279: 97 pgs: 97 active+clean; 630 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.1 KiB/s wr, 6 op/s; 143 B/s, 1 objects/s recovering 2024-09-21T03:40:59.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:58 smithi172 ceph-mon[34821]: pgmap v279: 97 pgs: 97 active+clean; 630 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.1 KiB/s wr, 6 op/s; 143 B/s, 1 objects/s recovering 2024-09-21T03:40:59.884 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T03:40:59.884 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T03:40:59.885 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T03:40:59.921 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T03:41:00.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:59 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/111191224' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T03:41:00.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:40:59 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/111191224' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T03:41:00.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:59 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/111191224' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T03:41:00.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:40:59 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/111191224' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T03:41:00.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:59 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/111191224' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T03:41:00.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:40:59 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/111191224' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T03:41:00.204 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:00.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.721+0000 7fc13be85640 1 -- 172.21.15.84:0/2975099612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc134102ae0 msgr2=0x7fc134102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:00.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.721+0000 7fc13be85640 1 --2- 172.21.15.84:0/2975099612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc134102ae0 0x7fc134102ef0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc130009900 tx=0x7fc13002a410 comp rx=0 tx=0).stop 2024-09-21T03:41:00.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.721+0000 7fc13be85640 1 -- 172.21.15.84:0/2975099612 shutdown_connections 2024-09-21T03:41:00.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.721+0000 7fc13be85640 1 --2- 172.21.15.84:0/2975099612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc134108d70 0x7fc13410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:00.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.721+0000 7fc13be85640 1 --2- 172.21.15.84:0/2975099612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc134108420 0x7fc134108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:00.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.721+0000 7fc13be85640 1 --2- 172.21.15.84:0/2975099612 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc134102ae0 0x7fc134102ef0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:00.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.721+0000 7fc13be85640 1 -- 172.21.15.84:0/2975099612 >> 172.21.15.84:0/2975099612 conn(0x7fc134079770 msgr2=0x7fc134079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:00.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.722+0000 7fc13be85640 1 -- 172.21.15.84:0/2975099612 shutdown_connections 2024-09-21T03:41:00.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.722+0000 7fc13be85640 1 -- 172.21.15.84:0/2975099612 wait complete. 2024-09-21T03:41:00.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.722+0000 7fc13be85640 1 Processor -- start 2024-09-21T03:41:00.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.722+0000 7fc13be85640 1 -- start start 2024-09-21T03:41:00.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.722+0000 7fc13be85640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc134102ae0 0x7fc1340ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:00.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.722+0000 7fc13be85640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc134108420 0x7fc1340ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:00.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.722+0000 7fc13be85640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc134108d70 0x7fc1341000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:00.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.723+0000 7fc13be85640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc134112af0 con 0x7fc134102ae0 2024-09-21T03:41:00.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.723+0000 7fc13be85640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc134112970 con 0x7fc134108d70 2024-09-21T03:41:00.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.723+0000 7fc13be85640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc134112c70 con 0x7fc134108420 2024-09-21T03:41:00.742 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.723+0000 7fc139c21640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc134102ae0 0x7fc1340ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:00.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.723+0000 7fc139c21640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc134102ae0 0x7fc1340ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55912/0 (socket says 172.21.15.84:55912) 2024-09-21T03:41:00.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.723+0000 7fc139c21640 1 -- 172.21.15.84:0/3480560701 learned_addr learned my addr 172.21.15.84:0/3480560701 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:00.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.723+0000 7fc139420640 1 --2- 172.21.15.84:0/3480560701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc134108420 0x7fc1340ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:00.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.723+0000 7fc13a422640 1 --2- 172.21.15.84:0/3480560701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc134108d70 0x7fc1341000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:00.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.723+0000 7fc139c21640 1 -- 172.21.15.84:0/3480560701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc134108420 msgr2=0x7fc1340ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:00.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.723+0000 7fc139c21640 1 --2- 172.21.15.84:0/3480560701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc134108420 0x7fc1340ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:00.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.723+0000 7fc139c21640 1 -- 172.21.15.84:0/3480560701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc134108d70 msgr2=0x7fc1341000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:00.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.723+0000 7fc139c21640 1 --2- 172.21.15.84:0/3480560701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc134108d70 0x7fc1341000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:00.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.723+0000 7fc139c21640 1 -- 172.21.15.84:0/3480560701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1341a88f0 con 0x7fc134102ae0 2024-09-21T03:41:00.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.723+0000 7fc139c21640 1 --2- 172.21.15.84:0/3480560701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc134102ae0 0x7fc1340ff670 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc130006010 tx=0x7fc1300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:00.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.723+0000 7fc12affd640 1 -- 172.21.15.84:0/3480560701 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13003f030 con 0x7fc134102ae0 2024-09-21T03:41:00.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.723+0000 7fc12affd640 1 -- 172.21.15.84:0/3480560701 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc130003800 con 0x7fc134102ae0 2024-09-21T03:41:00.743 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.723+0000 7fc13be85640 1 -- 172.21.15.84:0/3480560701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1341a8b80 con 0x7fc134102ae0 2024-09-21T03:41:00.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.723+0000 7fc12affd640 1 -- 172.21.15.84:0/3480560701 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc130035070 con 0x7fc134102ae0 2024-09-21T03:41:00.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.723+0000 7fc13be85640 1 -- 172.21.15.84:0/3480560701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1341a9060 con 0x7fc134102ae0 2024-09-21T03:41:00.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.725+0000 7fc13be85640 1 -- 172.21.15.84:0/3480560701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc134103d60 con 0x7fc134102ae0 2024-09-21T03:41:00.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.726+0000 7fc12affd640 1 -- 172.21.15.84:0/3480560701 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fc1300039b0 con 0x7fc134102ae0 2024-09-21T03:41:00.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.727+0000 7fc12affd640 1 --2- 172.21.15.84:0/3480560701 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc1200b65f0 0x7fc1200b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:00.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.727+0000 7fc139420640 1 --2- 172.21.15.84:0/3480560701 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc1200b65f0 0x7fc1200b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:00.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.727+0000 7fc12affd640 1 -- 172.21.15.84:0/3480560701 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fc130108180 con 0x7fc134102ae0 2024-09-21T03:41:00.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.728+0000 7fc139420640 1 --2- 172.21.15.84:0/3480560701 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc1200b65f0 0x7fc1200b8b00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc134105560 tx=0x7fc124009110 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:00.744 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.731+0000 7fc12affd640 1 -- 172.21.15.84:0/3480560701 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc1300ce810 con 0x7fc134102ae0 2024-09-21T03:41:00.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.915+0000 7fc13be85640 1 -- 172.21.15.84:0/3480560701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fc134100970 con 0x7fc134102ae0 2024-09-21T03:41:00.917 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:00 smithi084 ceph-mon[30941]: pgmap v280: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.4 KiB/s wr, 7 op/s; 116 B/s, 1 objects/s recovering 2024-09-21T03:41:00.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.915+0000 7fc12affd640 1 -- 172.21.15.84:0/3480560701 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v59) ==== 86+0+133 (secure 0 0 0) 0x7fc1300d2bf0 con 0x7fc134102ae0 2024-09-21T03:41:00.917 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:41:00.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.917+0000 7fc13be85640 1 -- 172.21.15.84:0/3480560701 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc1200b65f0 msgr2=0x7fc1200b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.917+0000 7fc13be85640 1 --2- 172.21.15.84:0/3480560701 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc1200b65f0 0x7fc1200b8b00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc134105560 tx=0x7fc124009110 comp rx=0 tx=0).stop 2024-09-21T03:41:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.917+0000 7fc13be85640 1 -- 172.21.15.84:0/3480560701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc134102ae0 msgr2=0x7fc1340ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.917+0000 7fc13be85640 1 --2- 172.21.15.84:0/3480560701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc134102ae0 0x7fc1340ff670 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc130006010 tx=0x7fc1300042f0 comp rx=0 tx=0).stop 2024-09-21T03:41:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.917+0000 7fc13be85640 1 -- 172.21.15.84:0/3480560701 shutdown_connections 2024-09-21T03:41:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.917+0000 7fc13be85640 1 --2- 172.21.15.84:0/3480560701 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc1200b65f0 0x7fc1200b8b00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.917+0000 7fc13be85640 1 --2- 172.21.15.84:0/3480560701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc134108d70 0x7fc1341000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.917+0000 7fc13be85640 1 --2- 172.21.15.84:0/3480560701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc134108420 0x7fc1340ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.917+0000 7fc13be85640 1 --2- 172.21.15.84:0/3480560701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc134102ae0 0x7fc1340ff670 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.917+0000 7fc13be85640 1 -- 172.21.15.84:0/3480560701 >> 172.21.15.84:0/3480560701 conn(0x7fc134079770 msgr2=0x7fc134101ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.918+0000 7fc13be85640 1 -- 172.21.15.84:0/3480560701 shutdown_connections 2024-09-21T03:41:00.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:00.918+0000 7fc13be85640 1 -- 172.21.15.84:0/3480560701 wait complete. 2024-09-21T03:41:01.029 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:00 smithi174 ceph-mon[34403]: pgmap v280: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.4 KiB/s wr, 7 op/s; 116 B/s, 1 objects/s recovering 2024-09-21T03:41:01.052 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:00 smithi172 ceph-mon[34821]: pgmap v280: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.4 KiB/s wr, 7 op/s; 116 B/s, 1 objects/s recovering 2024-09-21T03:41:01.751 INFO:teuthology.orchestra.run.smithi084.stdout:[{"version":59,"timestamp":"2024-09-21T03:40:19.784744+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T03:41:01.752 INFO:tasks.ceph_manager:config epoch is 59 2024-09-21T03:41:01.752 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T03:41:01.752 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T03:41:01.752 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T03:41:01.999 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:02.064 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:01 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3480560701' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T03:41:02.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:01 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3480560701' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T03:41:02.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:01 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3480560701' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T03:41:02.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.553+0000 7f22c554b640 1 -- 172.21.15.84:0/1181177693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c01094c0 msgr2=0x7f22c01098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:02.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.553+0000 7f22c554b640 1 --2- 172.21.15.84:0/1181177693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c01094c0 0x7f22c01098d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009900 tx=0x7f22a802a410 comp rx=0 tx=0).stop 2024-09-21T03:41:02.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.553+0000 7f22c554b640 1 -- 172.21.15.84:0/1181177693 shutdown_connections 2024-09-21T03:41:02.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.553+0000 7f22c554b640 1 --2- 172.21.15.84:0/1181177693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22c0109e10 0x7f22c0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:02.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.553+0000 7f22c554b640 1 --2- 172.21.15.84:0/1181177693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c01094c0 0x7f22c01098d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:02.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.553+0000 7f22c554b640 1 --2- 172.21.15.84:0/1181177693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22c0103b80 0x7f22c0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:02.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.553+0000 7f22c554b640 1 -- 172.21.15.84:0/1181177693 >> 172.21.15.84:0/1181177693 conn(0x7f22c00ff590 msgr2=0x7f22c01019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:02.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.553+0000 7f22c554b640 1 -- 172.21.15.84:0/1181177693 shutdown_connections 2024-09-21T03:41:02.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.553+0000 7f22c554b640 1 -- 172.21.15.84:0/1181177693 wait complete. 2024-09-21T03:41:02.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.554+0000 7f22c554b640 1 Processor -- start 2024-09-21T03:41:02.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.554+0000 7f22c554b640 1 -- start start 2024-09-21T03:41:02.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.554+0000 7f22c554b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c0103b80 0x7f22c019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:02.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.554+0000 7f22c554b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22c01094c0 0x7f22c019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:02.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.554+0000 7f22c554b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22c0109e10 0x7f22c019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.555+0000 7f22c554b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f22c0113ad0 con 0x7f22c0103b80 2024-09-21T03:41:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.555+0000 7f22c554b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f22c0113950 con 0x7f22c01094c0 2024-09-21T03:41:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.555+0000 7f22c554b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f22c0113c50 con 0x7f22c0109e10 2024-09-21T03:41:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.555+0000 7f22beffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c0103b80 0x7f22c019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.555+0000 7f22beffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c0103b80 0x7f22c019a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55930/0 (socket says 172.21.15.84:55930) 2024-09-21T03:41:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.555+0000 7f22beffd640 1 -- 172.21.15.84:0/2074532388 learned_addr learned my addr 172.21.15.84:0/2074532388 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.555+0000 7f22b67fc640 1 --2- 172.21.15.84:0/2074532388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22c01094c0 0x7f22c019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.555+0000 7f22bf7fe640 1 --2- 172.21.15.84:0/2074532388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22c0109e10 0x7f22c019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.555+0000 7f22beffd640 1 -- 172.21.15.84:0/2074532388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22c0109e10 msgr2=0x7f22c019fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.555+0000 7f22beffd640 1 --2- 172.21.15.84:0/2074532388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22c0109e10 0x7f22c019fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.555+0000 7f22beffd640 1 -- 172.21.15.84:0/2074532388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22c01094c0 msgr2=0x7f22c019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.555+0000 7f22beffd640 1 --2- 172.21.15.84:0/2074532388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22c01094c0 0x7f22c019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.555+0000 7f22beffd640 1 -- 172.21.15.84:0/2074532388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c01a04d0 con 0x7f22c0103b80 2024-09-21T03:41:02.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.555+0000 7f22bf7fe640 1 --2- 172.21.15.84:0/2074532388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22c0109e10 0x7f22c019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.555+0000 7f22beffd640 1 --2- 172.21.15.84:0/2074532388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c0103b80 0x7f22c019a560 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f22b000d950 tx=0x7f22b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.555+0000 7f22bcff9640 1 -- 172.21.15.84:0/2074532388 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b0017030 con 0x7f22c0103b80 2024-09-21T03:41:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.555+0000 7f22bcff9640 1 -- 172.21.15.84:0/2074532388 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22b0004020 con 0x7f22c0103b80 2024-09-21T03:41:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.555+0000 7f22c554b640 1 -- 172.21.15.84:0/2074532388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c01a07c0 con 0x7f22c0103b80 2024-09-21T03:41:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.555+0000 7f22bcff9640 1 -- 172.21.15.84:0/2074532388 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b00047a0 con 0x7f22c0103b80 2024-09-21T03:41:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.555+0000 7f22c554b640 1 -- 172.21.15.84:0/2074532388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c01a6f20 con 0x7f22c0103b80 2024-09-21T03:41:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.556+0000 7f22c554b640 1 -- 172.21.15.84:0/2074532388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22c0103f90 con 0x7f22c0103b80 2024-09-21T03:41:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.558+0000 7f22bcff9640 1 -- 172.21.15.84:0/2074532388 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f22b0009a30 con 0x7f22c0103b80 2024-09-21T03:41:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.558+0000 7f22bcff9640 1 --2- 172.21.15.84:0/2074532388 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f22ac0b65f0 0x7f22ac0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.559+0000 7f22b67fc640 1 --2- 172.21.15.84:0/2074532388 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f22ac0b65f0 0x7f22ac0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.559+0000 7f22bcff9640 1 -- 172.21.15.84:0/2074532388 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f22b00e7630 con 0x7f22c0103b80 2024-09-21T03:41:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.559+0000 7f22b67fc640 1 --2- 172.21.15.84:0/2074532388 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f22ac0b65f0 0x7f22ac0b8b00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009230 tx=0x7f22a8031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:02.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.562+0000 7f22bcff9640 1 -- 172.21.15.84:0/2074532388 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f22b00adcc0 con 0x7f22c0103b80 2024-09-21T03:41:02.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.787+0000 7f22c554b640 1 -- 172.21.15.84:0/2074532388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f22c019b690 con 0x7f22c0103b80 2024-09-21T03:41:02.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.791+0000 7f22bcff9640 1 -- 172.21.15.84:0/2074532388 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v22) ==== 74+0+296453 (secure 0 0 0) 0x7f22c019b690 con 0x7f22c0103b80 2024-09-21T03:41:02.797 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:41:02.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.796+0000 7f22c554b640 1 -- 172.21.15.84:0/2074532388 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f22ac0b65f0 msgr2=0x7f22ac0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:02.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.796+0000 7f22c554b640 1 --2- 172.21.15.84:0/2074532388 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f22ac0b65f0 0x7f22ac0b8b00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009230 tx=0x7f22a8031400 comp rx=0 tx=0).stop 2024-09-21T03:41:02.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.796+0000 7f22c554b640 1 -- 172.21.15.84:0/2074532388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c0103b80 msgr2=0x7f22c019a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:02.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.796+0000 7f22c554b640 1 --2- 172.21.15.84:0/2074532388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c0103b80 0x7f22c019a560 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f22b000d950 tx=0x7f22b000de10 comp rx=0 tx=0).stop 2024-09-21T03:41:02.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.796+0000 7f22c554b640 1 -- 172.21.15.84:0/2074532388 shutdown_connections 2024-09-21T03:41:02.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.796+0000 7f22c554b640 1 --2- 172.21.15.84:0/2074532388 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f22ac0b65f0 0x7f22ac0b8b00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:02.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.796+0000 7f22c554b640 1 --2- 172.21.15.84:0/2074532388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f22c0109e10 0x7f22c019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:02.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.796+0000 7f22c554b640 1 --2- 172.21.15.84:0/2074532388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22c01094c0 0x7f22c019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:02.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.796+0000 7f22c554b640 1 --2- 172.21.15.84:0/2074532388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f22c0103b80 0x7f22c019a560 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:02.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.796+0000 7f22c554b640 1 -- 172.21.15.84:0/2074532388 >> 172.21.15.84:0/2074532388 conn(0x7f22c00ff590 msgr2=0x7f22c0107c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:02.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.796+0000 7f22c554b640 1 -- 172.21.15.84:0/2074532388 shutdown_connections 2024-09-21T03:41:02.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:02.796+0000 7f22c554b640 1 -- 172.21.15.84:0/2074532388 wait complete. 2024-09-21T03:41:03.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:02 smithi084 ceph-mon[30941]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 KiB/s wr, 7 op/s; 105 B/s, 1 objects/s recovering 2024-09-21T03:41:03.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:02 smithi174 ceph-mon[34403]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 KiB/s wr, 7 op/s; 105 B/s, 1 objects/s recovering 2024-09-21T03:41:03.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:02 smithi172 ceph-mon[34821]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 KiB/s wr, 7 op/s; 105 B/s, 1 objects/s recovering 2024-09-21T03:41:03.566 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":22,"flags":0,"active_gid":14226,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":4090897078},{"type":"v1","addr":"172.21.15.84:6801","nonce":4090897078}]},"active_addr":"172.21.15.84:6801/4090897078","active_change":"2024-09-21T03:33:50.189121+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24133,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24155,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.84:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":3075077729}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":1572103713}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2971969843}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":176497640}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":4067165276}]}]} 2024-09-21T03:41:03.573 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T03:41:03.573 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T03:41:03.573 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:41:03.817 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:03.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:03 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2074532388' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T03:41:04.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:03 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2074532388' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T03:41:04.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:03 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2074532388' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T03:41:04.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.319+0000 7f92d2619640 1 -- 172.21.15.84:0/3611968226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92cc103230 msgr2=0x7f92cc103640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:04.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.319+0000 7f92d2619640 1 --2- 172.21.15.84:0/3611968226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92cc103230 0x7f92cc103640 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009900 tx=0x7f92bc02a410 comp rx=0 tx=0).stop 2024-09-21T03:41:04.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.319+0000 7f92d2619640 1 -- 172.21.15.84:0/3611968226 shutdown_connections 2024-09-21T03:41:04.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.319+0000 7f92d2619640 1 --2- 172.21.15.84:0/3611968226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92cc108fc0 0x7f92cc10f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:04.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.319+0000 7f92d2619640 1 --2- 172.21.15.84:0/3611968226 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92cc108670 0x7f92cc108a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:04.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.319+0000 7f92d2619640 1 --2- 172.21.15.84:0/3611968226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92cc103230 0x7f92cc103640 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.319+0000 7f92d2619640 1 -- 172.21.15.84:0/3611968226 >> 172.21.15.84:0/3611968226 conn(0x7f92cc079ea0 msgr2=0x7f92cc07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.319+0000 7f92d2619640 1 -- 172.21.15.84:0/3611968226 shutdown_connections 2024-09-21T03:41:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.319+0000 7f92d2619640 1 -- 172.21.15.84:0/3611968226 wait complete. 2024-09-21T03:41:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.320+0000 7f92d2619640 1 Processor -- start 2024-09-21T03:41:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.320+0000 7f92d2619640 1 -- start start 2024-09-21T03:41:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.320+0000 7f92d2619640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92cc103230 0x7f92cc19a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.320+0000 7f92d2619640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92cc108670 0x7f92cc19ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.320+0000 7f92d2619640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92cc108fc0 0x7f92cc19ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.320+0000 7f92d2619640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc112c80 con 0x7f92cc108670 2024-09-21T03:41:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.320+0000 7f92d2619640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc112b00 con 0x7f92cc108fc0 2024-09-21T03:41:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.320+0000 7f92d2619640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f92cc112e00 con 0x7f92cc103230 2024-09-21T03:41:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.320+0000 7f92c3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92cc108670 0x7f92cc19ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:04.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.320+0000 7f92c3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92cc108670 0x7f92cc19ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55948/0 (socket says 172.21.15.84:55948) 2024-09-21T03:41:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.320+0000 7f92c3fff640 1 -- 172.21.15.84:0/1129821396 learned_addr learned my addr 172.21.15.84:0/1129821396 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.320+0000 7f92d0bb6640 1 --2- 172.21.15.84:0/1129821396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92cc108fc0 0x7f92cc19ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.320+0000 7f92c3fff640 1 -- 172.21.15.84:0/1129821396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92cc103230 msgr2=0x7f92cc19a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.320+0000 7f92c3fff640 1 --2- 172.21.15.84:0/1129821396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92cc103230 0x7f92cc19a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.320+0000 7f92c3fff640 1 -- 172.21.15.84:0/1129821396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92cc108fc0 msgr2=0x7f92cc19ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.320+0000 7f92c3fff640 1 --2- 172.21.15.84:0/1129821396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92cc108fc0 0x7f92cc19ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.320+0000 7f92c3fff640 1 -- 172.21.15.84:0/1129821396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92cc1a06f0 con 0x7f92cc108670 2024-09-21T03:41:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.320+0000 7f92c3fff640 1 --2- 172.21.15.84:0/1129821396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92cc108670 0x7f92cc19ad20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f92b400d950 tx=0x7f92b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.321+0000 7f92c9ffb640 1 -- 172.21.15.84:0/1129821396 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4017070 con 0x7f92cc108670 2024-09-21T03:41:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.321+0000 7f92c9ffb640 1 -- 172.21.15.84:0/1129821396 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92b4009c30 con 0x7f92cc108670 2024-09-21T03:41:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.321+0000 7f92d2619640 1 -- 172.21.15.84:0/1129821396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92cc1a09e0 con 0x7f92cc108670 2024-09-21T03:41:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.321+0000 7f92c9ffb640 1 -- 172.21.15.84:0/1129821396 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b40047a0 con 0x7f92cc108670 2024-09-21T03:41:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.321+0000 7f92d2619640 1 -- 172.21.15.84:0/1129821396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92cc1a7140 con 0x7f92cc108670 2024-09-21T03:41:04.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.322+0000 7f92d2619640 1 -- 172.21.15.84:0/1129821396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92cc103640 con 0x7f92cc108670 2024-09-21T03:41:04.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.323+0000 7f92c9ffb640 1 -- 172.21.15.84:0/1129821396 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f92b4004020 con 0x7f92cc108670 2024-09-21T03:41:04.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.324+0000 7f92c9ffb640 1 --2- 172.21.15.84:0/1129821396 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f92b80b65f0 0x7f92b80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:04.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.324+0000 7f92cbfff640 1 --2- 172.21.15.84:0/1129821396 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f92b80b65f0 0x7f92b80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:04.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.324+0000 7f92c9ffb640 1 -- 172.21.15.84:0/1129821396 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f92b40e7750 con 0x7f92cc108670 2024-09-21T03:41:04.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.325+0000 7f92cbfff640 1 --2- 172.21.15.84:0/1129821396 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f92b80b65f0 0x7f92b80b8b00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f92bc02a930 tx=0x7f92bc031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:04.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.327+0000 7f92c9ffb640 1 -- 172.21.15.84:0/1129821396 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f92b4020020 con 0x7f92cc108670 2024-09-21T03:41:04.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.507+0000 7f92d2619640 1 -- 172.21.15.84:0/1129821396 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92cc1a7310 con 0x7f92cc108670 2024-09-21T03:41:04.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.509+0000 7f92c9ffb640 1 -- 172.21.15.84:0/1129821396 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+23019 (secure 0 0 0) 0x7f92b40adde0 con 0x7f92cc108670 2024-09-21T03:41:04.511 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:41:04.511 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":77,"fsid":"e3f8c18e-77c9-11ef-baf5-efdc52797490","created":"2024-09-21T03:31:55.307035+0000","modified":"2024-09-21T03:40:51.455331+0000","last_up_change":"2024-09-21T03:39:38.786385+0000","last_in_change":"2024-09-21T03:39:15.267368+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:35:50.488653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:40:25.934375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:40:27.981681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d283ba0-18f3-4668-90c4-884e9e957a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6803","nonce":508132562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6805","nonce":508132562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6809","nonce":508132562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6807","nonce":508132562}]},"public_addr":"172.21.15.84:6803/508132562","cluster_addr":"172.21.15.84:6805/508132562","heartbeat_back_addr":"172.21.15.84:6809/508132562","heartbeat_front_addr":"172.21.15.84:6807/508132562","state":["exists","up"]},{"osd":1,"uuid":"f115c5b6-812d-430f-9f0e-cb5311b7581e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6801","nonce":2931872350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6803","nonce":2931872350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6807","nonce":2931872350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6805","nonce":2931872350}]},"public_addr":"172.21.15.172:6801/2931872350","cluster_addr":"172.21.15.172:6803/2931872350","heartbeat_back_addr":"172.21.15.172:6807/2931872350","heartbeat_front_addr":"172.21.15.172:6805/2931872350","state":["exists","up"]},{"osd":2,"uuid":"36489240-e233-4aa7-ae9c-089d76683172","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6801","nonce":1847612335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6803","nonce":1847612335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6807","nonce":1847612335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6805","nonce":1847612335}]},"public_addr":"172.21.15.174:6801/1847612335","cluster_addr":"172.21.15.174:6803/1847612335","heartbeat_back_addr":"172.21.15.174:6807/1847612335","heartbeat_front_addr":"172.21.15.174:6805/1847612335","state":["exists","up"]},{"osd":3,"uuid":"1f35b404-b658-4e94-a5f4-74a6431a6a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6811","nonce":2230529863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6813","nonce":2230529863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6817","nonce":2230529863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6815","nonce":2230529863}]},"public_addr":"172.21.15.84:6811/2230529863","cluster_addr":"172.21.15.84:6813/2230529863","heartbeat_back_addr":"172.21.15.84:6817/2230529863","heartbeat_front_addr":"172.21.15.84:6815/2230529863","state":["exists","up"]},{"osd":4,"uuid":"91a2f83b-4c7d-4661-86a1-63a09888939d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6809","nonce":3069862739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6811","nonce":3069862739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6815","nonce":3069862739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6813","nonce":3069862739}]},"public_addr":"172.21.15.172:6809/3069862739","cluster_addr":"172.21.15.172:6811/3069862739","heartbeat_back_addr":"172.21.15.172:6815/3069862739","heartbeat_front_addr":"172.21.15.172:6813/3069862739","state":["exists","up"]},{"osd":5,"uuid":"e8f06b34-3956-499f-8073-09011cf1ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6809","nonce":1987010600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6811","nonce":1987010600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6815","nonce":1987010600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6813","nonce":1987010600}]},"public_addr":"172.21.15.174:6809/1987010600","cluster_addr":"172.21.15.174:6811/1987010600","heartbeat_back_addr":"172.21.15.174:6815/1987010600","heartbeat_front_addr":"172.21.15.174:6813/1987010600","state":["exists","up"]},{"osd":6,"uuid":"23d55e96-4987-4cbe-8c6b-cece4de9269b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6819","nonce":3418459345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6821","nonce":3418459345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6825","nonce":3418459345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6823","nonce":3418459345}]},"public_addr":"172.21.15.84:6819/3418459345","cluster_addr":"172.21.15.84:6821/3418459345","heartbeat_back_addr":"172.21.15.84:6825/3418459345","heartbeat_front_addr":"172.21.15.84:6823/3418459345","state":["exists","up"]},{"osd":7,"uuid":"ca91a34c-d8b1-48b8-93f4-72a5c15939d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6817","nonce":4056019738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6819","nonce":4056019738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6823","nonce":4056019738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6821","nonce":4056019738}]},"public_addr":"172.21.15.172:6817/4056019738","cluster_addr":"172.21.15.172:6819/4056019738","heartbeat_back_addr":"172.21.15.172:6823/4056019738","heartbeat_front_addr":"172.21.15.172:6821/4056019738","state":["exists","up"]},{"osd":8,"uuid":"37da8c61-d72f-4b58-b10c-7c7539ecffd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6817","nonce":2162992546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6819","nonce":2162992546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6823","nonce":2162992546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6821","nonce":2162992546}]},"public_addr":"172.21.15.174:6817/2162992546","cluster_addr":"172.21.15.174:6819/2162992546","heartbeat_back_addr":"172.21.15.174:6823/2162992546","heartbeat_front_addr":"172.21.15.174:6821/2162992546","state":["exists","up"]},{"osd":9,"uuid":"c9179f33-622d-44bd-9d8a-c92951afb1e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6827","nonce":3230873673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6829","nonce":3230873673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6833","nonce":3230873673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6831","nonce":3230873673}]},"public_addr":"172.21.15.84:6827/3230873673","cluster_addr":"172.21.15.84:6829/3230873673","heartbeat_back_addr":"172.21.15.84:6833/3230873673","heartbeat_front_addr":"172.21.15.84:6831/3230873673","state":["exists","up"]},{"osd":10,"uuid":"9788fa2d-49fb-431b-a0e3-62d6e421e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6825","nonce":2667099391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6827","nonce":2667099391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6831","nonce":2667099391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6829","nonce":2667099391}]},"public_addr":"172.21.15.172:6825/2667099391","cluster_addr":"172.21.15.172:6827/2667099391","heartbeat_back_addr":"172.21.15.172:6831/2667099391","heartbeat_front_addr":"172.21.15.172:6829/2667099391","state":["exists","up"]},{"osd":11,"uuid":"a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6825","nonce":3452825924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6827","nonce":3452825924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6831","nonce":3452825924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6829","nonce":3452825924}]},"public_addr":"172.21.15.174:6825/3452825924","cluster_addr":"172.21.15.174:6827/3452825924","heartbeat_back_addr":"172.21.15.174:6831/3452825924","heartbeat_front_addr":"172.21.15.174:6829/3452825924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:34:57.413946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:22.813846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:47.074625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:12.871112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:38.705563+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:04.277966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:29.661290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:55.475432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:20.644247+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:46.151594+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:11.499623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:36.688459+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6800/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3308084314":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3663660709":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/1794153935":"2024-09-22T03:32:49.459372+0000","172.21.15.84:6800/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6800/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1874814897":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6801/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/390051797":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/2148206075":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1916019809":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6801/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3491731835":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3418048965":"2024-09-22T03:33:50.188998+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:41:04.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.511+0000 7f92d2619640 1 -- 172.21.15.84:0/1129821396 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f92b80b65f0 msgr2=0x7f92b80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:04.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.511+0000 7f92d2619640 1 --2- 172.21.15.84:0/1129821396 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f92b80b65f0 0x7f92b80b8b00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f92bc02a930 tx=0x7f92bc031400 comp rx=0 tx=0).stop 2024-09-21T03:41:04.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.511+0000 7f92d2619640 1 -- 172.21.15.84:0/1129821396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92cc108670 msgr2=0x7f92cc19ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:04.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.511+0000 7f92d2619640 1 --2- 172.21.15.84:0/1129821396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92cc108670 0x7f92cc19ad20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f92b400d950 tx=0x7f92b400de10 comp rx=0 tx=0).stop 2024-09-21T03:41:04.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.511+0000 7f92d2619640 1 -- 172.21.15.84:0/1129821396 shutdown_connections 2024-09-21T03:41:04.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.511+0000 7f92d2619640 1 --2- 172.21.15.84:0/1129821396 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f92b80b65f0 0x7f92b80b8b00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:04.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.511+0000 7f92d2619640 1 --2- 172.21.15.84:0/1129821396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92cc108fc0 0x7f92cc19ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:04.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.511+0000 7f92d2619640 1 --2- 172.21.15.84:0/1129821396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f92cc108670 0x7f92cc19ad20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:04.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.511+0000 7f92d2619640 1 --2- 172.21.15.84:0/1129821396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92cc103230 0x7f92cc19a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:04.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.511+0000 7f92d2619640 1 -- 172.21.15.84:0/1129821396 >> 172.21.15.84:0/1129821396 conn(0x7f92cc079ea0 msgr2=0x7f92cc1011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:04.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.511+0000 7f92d2619640 1 -- 172.21.15.84:0/1129821396 shutdown_connections 2024-09-21T03:41:04.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:04.511+0000 7f92d2619640 1 -- 172.21.15.84:0/1129821396 wait complete. 2024-09-21T03:41:05.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:04 smithi084 ceph-mon[30941]: pgmap v282: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.0 KiB/s wr, 8 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T03:41:05.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:04 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1129821396' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:41:05.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:04 smithi174 ceph-mon[34403]: pgmap v282: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.0 KiB/s wr, 8 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T03:41:05.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:04 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1129821396' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:41:05.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:04 smithi172 ceph-mon[34821]: pgmap v282: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.0 KiB/s wr, 8 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T03:41:05.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:04 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1129821396' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:41:05.299 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T03:41:05.299 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:41:05.550 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:06.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.044+0000 7f63dff07640 1 -- 172.21.15.84:0/2819210011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d8103b60 msgr2=0x7f63d8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:06.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.044+0000 7f63dff07640 1 --2- 172.21.15.84:0/2819210011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d8103b60 0x7f63d8103f70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f63d4009900 tx=0x7f63d402a410 comp rx=0 tx=0).stop 2024-09-21T03:41:06.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.044+0000 7f63dff07640 1 -- 172.21.15.84:0/2819210011 shutdown_connections 2024-09-21T03:41:06.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.044+0000 7f63dff07640 1 --2- 172.21.15.84:0/2819210011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63d8109df0 0x7f63d8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.044+0000 7f63dff07640 1 --2- 172.21.15.84:0/2819210011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63d81094a0 0x7f63d81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.044+0000 7f63dff07640 1 --2- 172.21.15.84:0/2819210011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d8103b60 0x7f63d8103f70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.044+0000 7f63dff07640 1 -- 172.21.15.84:0/2819210011 >> 172.21.15.84:0/2819210011 conn(0x7f63d807b850 msgr2=0x7f63d807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:06.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.044+0000 7f63dff07640 1 -- 172.21.15.84:0/2819210011 shutdown_connections 2024-09-21T03:41:06.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.044+0000 7f63dff07640 1 -- 172.21.15.84:0/2819210011 wait complete. 2024-09-21T03:41:06.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.045+0000 7f63dff07640 1 Processor -- start 2024-09-21T03:41:06.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.045+0000 7f63dff07640 1 -- start start 2024-09-21T03:41:06.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.045+0000 7f63dff07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63d8103b60 0x7f63d819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.045+0000 7f63dff07640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63d81094a0 0x7f63d819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.045+0000 7f63dff07640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d8109df0 0x7f63d819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.045+0000 7f63dff07640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f63d8113ab0 con 0x7f63d8109df0 2024-09-21T03:41:06.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.046+0000 7f63dff07640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f63d8113930 con 0x7f63d8103b60 2024-09-21T03:41:06.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.046+0000 7f63dff07640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f63d8113c30 con 0x7f63d81094a0 2024-09-21T03:41:06.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.046+0000 7f63de4a4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d8109df0 0x7f63d819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.046+0000 7f63de4a4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d8109df0 0x7f63d819fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55974/0 (socket says 172.21.15.84:55974) 2024-09-21T03:41:06.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.046+0000 7f63de4a4640 1 -- 172.21.15.84:0/3071550593 learned_addr learned my addr 172.21.15.84:0/3071550593 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:06.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.046+0000 7f63dd4a2640 1 --2- 172.21.15.84:0/3071550593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63d81094a0 0x7f63d819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.046+0000 7f63ddca3640 1 --2- 172.21.15.84:0/3071550593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63d8103b60 0x7f63d819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.046+0000 7f63de4a4640 1 -- 172.21.15.84:0/3071550593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63d81094a0 msgr2=0x7f63d819aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:06.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.046+0000 7f63de4a4640 1 --2- 172.21.15.84:0/3071550593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63d81094a0 0x7f63d819aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.046+0000 7f63de4a4640 1 -- 172.21.15.84:0/3071550593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63d8103b60 msgr2=0x7f63d819a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:06.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.046+0000 7f63de4a4640 1 --2- 172.21.15.84:0/3071550593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63d8103b60 0x7f63d819a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.046+0000 7f63de4a4640 1 -- 172.21.15.84:0/3071550593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d81a0350 con 0x7f63d8109df0 2024-09-21T03:41:06.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.046+0000 7f63dd4a2640 1 --2- 172.21.15.84:0/3071550593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63d81094a0 0x7f63d819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:06.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.046+0000 7f63ddca3640 1 --2- 172.21.15.84:0/3071550593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63d8103b60 0x7f63d819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:06.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.046+0000 7f63de4a4640 1 --2- 172.21.15.84:0/3071550593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d8109df0 0x7f63d819fce0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f63d000cad0 tx=0x7f63d000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:06.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.046+0000 7f63ceffd640 1 -- 172.21.15.84:0/3071550593 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d000ae20 con 0x7f63d8109df0 2024-09-21T03:41:06.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.046+0000 7f63ceffd640 1 -- 172.21.15.84:0/3071550593 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63d0005020 con 0x7f63d8109df0 2024-09-21T03:41:06.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.046+0000 7f63dff07640 1 -- 172.21.15.84:0/3071550593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63d81a0640 con 0x7f63d8109df0 2024-09-21T03:41:06.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.046+0000 7f63ceffd640 1 -- 172.21.15.84:0/3071550593 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d000f6b0 con 0x7f63d8109df0 2024-09-21T03:41:06.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.046+0000 7f63dff07640 1 -- 172.21.15.84:0/3071550593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63d81a6e60 con 0x7f63d8109df0 2024-09-21T03:41:06.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.047+0000 7f63dff07640 1 -- 172.21.15.84:0/3071550593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63d8103f70 con 0x7f63d8109df0 2024-09-21T03:41:06.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.049+0000 7f63ceffd640 1 -- 172.21.15.84:0/3071550593 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f63d00051d0 con 0x7f63d8109df0 2024-09-21T03:41:06.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.050+0000 7f63ceffd640 1 --2- 172.21.15.84:0/3071550593 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f63c40b6620 0x7f63c40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.050+0000 7f63ddca3640 1 --2- 172.21.15.84:0/3071550593 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f63c40b6620 0x7f63c40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.050+0000 7f63ceffd640 1 -- 172.21.15.84:0/3071550593 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f63d00e79d0 con 0x7f63d8109df0 2024-09-21T03:41:06.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.051+0000 7f63ddca3640 1 --2- 172.21.15.84:0/3071550593 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f63c40b6620 0x7f63c40b8b30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f63d40096c0 tx=0x7f63d4031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:06.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.054+0000 7f63ceffd640 1 -- 172.21.15.84:0/3071550593 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f63d0014030 con 0x7f63d8109df0 2024-09-21T03:41:06.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.234+0000 7f63dff07640 1 -- 172.21.15.84:0/3071550593 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63d810bbf0 con 0x7f63d8109df0 2024-09-21T03:41:06.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.235+0000 7f63ceffd640 1 -- 172.21.15.84:0/3071550593 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+23019 (secure 0 0 0) 0x7f63d00ae060 con 0x7f63d8109df0 2024-09-21T03:41:06.238 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:41:06.238 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":77,"fsid":"e3f8c18e-77c9-11ef-baf5-efdc52797490","created":"2024-09-21T03:31:55.307035+0000","modified":"2024-09-21T03:40:51.455331+0000","last_up_change":"2024-09-21T03:39:38.786385+0000","last_in_change":"2024-09-21T03:39:15.267368+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:35:50.488653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:40:25.934375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:40:27.981681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d283ba0-18f3-4668-90c4-884e9e957a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6803","nonce":508132562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6805","nonce":508132562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6809","nonce":508132562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6807","nonce":508132562}]},"public_addr":"172.21.15.84:6803/508132562","cluster_addr":"172.21.15.84:6805/508132562","heartbeat_back_addr":"172.21.15.84:6809/508132562","heartbeat_front_addr":"172.21.15.84:6807/508132562","state":["exists","up"]},{"osd":1,"uuid":"f115c5b6-812d-430f-9f0e-cb5311b7581e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6801","nonce":2931872350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6803","nonce":2931872350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6807","nonce":2931872350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6805","nonce":2931872350}]},"public_addr":"172.21.15.172:6801/2931872350","cluster_addr":"172.21.15.172:6803/2931872350","heartbeat_back_addr":"172.21.15.172:6807/2931872350","heartbeat_front_addr":"172.21.15.172:6805/2931872350","state":["exists","up"]},{"osd":2,"uuid":"36489240-e233-4aa7-ae9c-089d76683172","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6801","nonce":1847612335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6803","nonce":1847612335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6807","nonce":1847612335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6805","nonce":1847612335}]},"public_addr":"172.21.15.174:6801/1847612335","cluster_addr":"172.21.15.174:6803/1847612335","heartbeat_back_addr":"172.21.15.174:6807/1847612335","heartbeat_front_addr":"172.21.15.174:6805/1847612335","state":["exists","up"]},{"osd":3,"uuid":"1f35b404-b658-4e94-a5f4-74a6431a6a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6811","nonce":2230529863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6813","nonce":2230529863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6817","nonce":2230529863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6815","nonce":2230529863}]},"public_addr":"172.21.15.84:6811/2230529863","cluster_addr":"172.21.15.84:6813/2230529863","heartbeat_back_addr":"172.21.15.84:6817/2230529863","heartbeat_front_addr":"172.21.15.84:6815/2230529863","state":["exists","up"]},{"osd":4,"uuid":"91a2f83b-4c7d-4661-86a1-63a09888939d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6809","nonce":3069862739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6811","nonce":3069862739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6815","nonce":3069862739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6813","nonce":3069862739}]},"public_addr":"172.21.15.172:6809/3069862739","cluster_addr":"172.21.15.172:6811/3069862739","heartbeat_back_addr":"172.21.15.172:6815/3069862739","heartbeat_front_addr":"172.21.15.172:6813/3069862739","state":["exists","up"]},{"osd":5,"uuid":"e8f06b34-3956-499f-8073-09011cf1ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6809","nonce":1987010600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6811","nonce":1987010600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6815","nonce":1987010600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6813","nonce":1987010600}]},"public_addr":"172.21.15.174:6809/1987010600","cluster_addr":"172.21.15.174:6811/1987010600","heartbeat_back_addr":"172.21.15.174:6815/1987010600","heartbeat_front_addr":"172.21.15.174:6813/1987010600","state":["exists","up"]},{"osd":6,"uuid":"23d55e96-4987-4cbe-8c6b-cece4de9269b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6819","nonce":3418459345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6821","nonce":3418459345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6825","nonce":3418459345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6823","nonce":3418459345}]},"public_addr":"172.21.15.84:6819/3418459345","cluster_addr":"172.21.15.84:6821/3418459345","heartbeat_back_addr":"172.21.15.84:6825/3418459345","heartbeat_front_addr":"172.21.15.84:6823/3418459345","state":["exists","up"]},{"osd":7,"uuid":"ca91a34c-d8b1-48b8-93f4-72a5c15939d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6817","nonce":4056019738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6819","nonce":4056019738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6823","nonce":4056019738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6821","nonce":4056019738}]},"public_addr":"172.21.15.172:6817/4056019738","cluster_addr":"172.21.15.172:6819/4056019738","heartbeat_back_addr":"172.21.15.172:6823/4056019738","heartbeat_front_addr":"172.21.15.172:6821/4056019738","state":["exists","up"]},{"osd":8,"uuid":"37da8c61-d72f-4b58-b10c-7c7539ecffd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6817","nonce":2162992546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6819","nonce":2162992546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6823","nonce":2162992546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6821","nonce":2162992546}]},"public_addr":"172.21.15.174:6817/2162992546","cluster_addr":"172.21.15.174:6819/2162992546","heartbeat_back_addr":"172.21.15.174:6823/2162992546","heartbeat_front_addr":"172.21.15.174:6821/2162992546","state":["exists","up"]},{"osd":9,"uuid":"c9179f33-622d-44bd-9d8a-c92951afb1e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6827","nonce":3230873673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6829","nonce":3230873673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6833","nonce":3230873673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6831","nonce":3230873673}]},"public_addr":"172.21.15.84:6827/3230873673","cluster_addr":"172.21.15.84:6829/3230873673","heartbeat_back_addr":"172.21.15.84:6833/3230873673","heartbeat_front_addr":"172.21.15.84:6831/3230873673","state":["exists","up"]},{"osd":10,"uuid":"9788fa2d-49fb-431b-a0e3-62d6e421e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6825","nonce":2667099391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6827","nonce":2667099391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6831","nonce":2667099391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6829","nonce":2667099391}]},"public_addr":"172.21.15.172:6825/2667099391","cluster_addr":"172.21.15.172:6827/2667099391","heartbeat_back_addr":"172.21.15.172:6831/2667099391","heartbeat_front_addr":"172.21.15.172:6829/2667099391","state":["exists","up"]},{"osd":11,"uuid":"a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6825","nonce":3452825924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6827","nonce":3452825924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6831","nonce":3452825924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6829","nonce":3452825924}]},"public_addr":"172.21.15.174:6825/3452825924","cluster_addr":"172.21.15.174:6827/3452825924","heartbeat_back_addr":"172.21.15.174:6831/3452825924","heartbeat_front_addr":"172.21.15.174:6829/3452825924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:34:57.413946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:22.813846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:47.074625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:12.871112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:38.705563+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:04.277966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:29.661290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:55.475432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:20.644247+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:46.151594+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:11.499623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:36.688459+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6800/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3308084314":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3663660709":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/1794153935":"2024-09-22T03:32:49.459372+0000","172.21.15.84:6800/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6800/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1874814897":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6801/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/390051797":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/2148206075":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1916019809":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6801/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3491731835":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3418048965":"2024-09-22T03:33:50.188998+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:41:06.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.238+0000 7f63dff07640 1 -- 172.21.15.84:0/3071550593 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f63c40b6620 msgr2=0x7f63c40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:06.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.238+0000 7f63dff07640 1 --2- 172.21.15.84:0/3071550593 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f63c40b6620 0x7f63c40b8b30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f63d40096c0 tx=0x7f63d4031400 comp rx=0 tx=0).stop 2024-09-21T03:41:06.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.238+0000 7f63dff07640 1 -- 172.21.15.84:0/3071550593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d8109df0 msgr2=0x7f63d819fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:06.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.238+0000 7f63dff07640 1 --2- 172.21.15.84:0/3071550593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d8109df0 0x7f63d819fce0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f63d000cad0 tx=0x7f63d000cf90 comp rx=0 tx=0).stop 2024-09-21T03:41:06.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.238+0000 7f63dff07640 1 -- 172.21.15.84:0/3071550593 shutdown_connections 2024-09-21T03:41:06.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.238+0000 7f63dff07640 1 --2- 172.21.15.84:0/3071550593 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f63c40b6620 0x7f63c40b8b30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.238+0000 7f63dff07640 1 --2- 172.21.15.84:0/3071550593 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f63d8109df0 0x7f63d819fce0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.238+0000 7f63dff07640 1 --2- 172.21.15.84:0/3071550593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63d81094a0 0x7f63d819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.238+0000 7f63dff07640 1 --2- 172.21.15.84:0/3071550593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63d8103b60 0x7f63d819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.238+0000 7f63dff07640 1 -- 172.21.15.84:0/3071550593 >> 172.21.15.84:0/3071550593 conn(0x7f63d807b850 msgr2=0x7f63d8107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:06.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.238+0000 7f63dff07640 1 -- 172.21.15.84:0/3071550593 shutdown_connections 2024-09-21T03:41:06.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:06.238+0000 7f63dff07640 1 -- 172.21.15.84:0/3071550593 wait complete. 2024-09-21T03:41:06.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:06 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3071550593' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:41:06.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:06 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3071550593' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:41:06.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:06 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3071550593' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:41:07.061 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T03:41:07.062 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T03:41:07.062 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T03:41:07.063 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T03:41:07.063 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T03:41:07.063 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T03:41:07.064 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T03:41:07.064 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T03:41:07.065 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T03:41:07.065 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T03:41:07.065 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T03:41:07.066 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T03:41:07.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:07 smithi174 ceph-mon[34403]: pgmap v283: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 5 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T03:41:07.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:07 smithi172 ceph-mon[34821]: pgmap v283: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 5 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T03:41:07.777 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:07.777 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:07.777 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:07.792 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:07.793 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:07.794 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:07.799 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:07.799 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:07.807 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:07.807 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:07.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:07 smithi084 ceph-mon[30941]: pgmap v283: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 5 op/s; 11 B/s, 0 objects/s recovering 2024-09-21T03:41:07.847 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:07.848 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:08.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.774+0000 7f5f834a1640 1 -- 172.21.15.84:0/3634299113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f7c1062d0 msgr2=0x7f5f7c1066e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:08.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.774+0000 7f5f834a1640 1 --2- 172.21.15.84:0/3634299113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f7c1062d0 0x7f5f7c1066e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009900 tx=0x7f5f7002a410 comp rx=0 tx=0).stop 2024-09-21T03:41:08.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.774+0000 7f5f834a1640 1 -- 172.21.15.84:0/3634299113 shutdown_connections 2024-09-21T03:41:08.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.774+0000 7f5f834a1640 1 --2- 172.21.15.84:0/3634299113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f7c106c20 0x7f5f7c110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:08.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.774+0000 7f5f834a1640 1 --2- 172.21.15.84:0/3634299113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f7c1062d0 0x7f5f7c1066e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:08.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.774+0000 7f5f834a1640 1 --2- 172.21.15.84:0/3634299113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f7c101ff0 0x7f5f7c102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:08.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.774+0000 7f5f834a1640 1 -- 172.21.15.84:0/3634299113 >> 172.21.15.84:0/3634299113 conn(0x7f5f7c077cc0 msgr2=0x7f5f7c078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:08.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.774+0000 7f5f834a1640 1 -- 172.21.15.84:0/3634299113 shutdown_connections 2024-09-21T03:41:08.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.774+0000 7f5f834a1640 1 -- 172.21.15.84:0/3634299113 wait complete. 2024-09-21T03:41:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.775+0000 7f5f834a1640 1 Processor -- start 2024-09-21T03:41:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.775+0000 7f5f834a1640 1 -- start start 2024-09-21T03:41:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.775+0000 7f5f834a1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f7c101ff0 0x7f5f7c102f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.775+0000 7f5f834a1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f7c1062d0 0x7f5f7c1034d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.775+0000 7f5f834a1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f7c106c20 0x7f5f7c103a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.775+0000 7f5f834a1640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c113ac0 con 0x7f5f7c101ff0 2024-09-21T03:41:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.775+0000 7f5f834a1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c113940 con 0x7f5f7c1062d0 2024-09-21T03:41:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.775+0000 7f5f834a1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c113c40 con 0x7f5f7c106c20 2024-09-21T03:41:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.775+0000 7f5f8123d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f7c101ff0 0x7f5f7c102f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.776+0000 7f5f8123d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f7c101ff0 0x7f5f7c102f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54724/0 (socket says 172.21.15.84:54724) 2024-09-21T03:41:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.776+0000 7f5f8123d640 1 -- 172.21.15.84:0/2023469082 learned_addr learned my addr 172.21.15.84:0/2023469082 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.776+0000 7f5f80a3c640 1 --2- 172.21.15.84:0/2023469082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f7c1062d0 0x7f5f7c1034d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.776+0000 7f5f81a3e640 1 --2- 172.21.15.84:0/2023469082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f7c106c20 0x7f5f7c103a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.776+0000 7f5f8123d640 1 -- 172.21.15.84:0/2023469082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f7c106c20 msgr2=0x7f5f7c103a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:08.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.776+0000 7f5f8123d640 1 --2- 172.21.15.84:0/2023469082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f7c106c20 0x7f5f7c103a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.776+0000 7f5f8123d640 1 -- 172.21.15.84:0/2023469082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f7c1062d0 msgr2=0x7f5f7c1034d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.776+0000 7f5f8123d640 1 --2- 172.21.15.84:0/2023469082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f7c1062d0 0x7f5f7c1034d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.776+0000 7f5f8123d640 1 -- 172.21.15.84:0/2023469082 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f7c1a8770 con 0x7f5f7c101ff0 2024-09-21T03:41:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.776+0000 7f5f8123d640 1 --2- 172.21.15.84:0/2023469082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f7c101ff0 0x7f5f7c102f90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5f7800e9f0 tx=0x7f5f7800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.776+0000 7f5f6e7fc640 1 -- 172.21.15.84:0/2023469082 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7800cd80 con 0x7f5f7c101ff0 2024-09-21T03:41:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.777+0000 7f5f6e7fc640 1 -- 172.21.15.84:0/2023469082 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f780108e0 con 0x7f5f7c101ff0 2024-09-21T03:41:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.777+0000 7f5f834a1640 1 -- 172.21.15.84:0/2023469082 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f7c1a8a60 con 0x7f5f7c101ff0 2024-09-21T03:41:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.777+0000 7f5f6e7fc640 1 -- 172.21.15.84:0/2023469082 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78018980 con 0x7f5f7c101ff0 2024-09-21T03:41:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.777+0000 7f5f834a1640 1 -- 172.21.15.84:0/2023469082 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f7c1a8fc0 con 0x7f5f7c101ff0 2024-09-21T03:41:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.778+0000 7f5f67fff640 1 -- 172.21.15.84:0/2023469082 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5f5c001030 con 0x7f5f7c101ff0 2024-09-21T03:41:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.779+0000 7f5f6e7fc640 1 -- 172.21.15.84:0/2023469082 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f5f78010430 con 0x7f5f7c101ff0 2024-09-21T03:41:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.780+0000 7f5f6e7fc640 1 --2- 172.21.15.84:0/2023469082 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f680b6670 0x7f5f680b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.780+0000 7f5f80a3c640 1 --2- 172.21.15.84:0/2023469082 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f680b6670 0x7f5f680b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:08.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.780+0000 7f5f6e7fc640 1 -- 172.21.15.84:0/2023469082 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f5f780e8380 con 0x7f5f7c101ff0 2024-09-21T03:41:08.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.780+0000 7f5f6e7fc640 1 --2- 172.21.15.84:0/2023469082 >> [v2:172.21.15.172:6800/2931872350,v1:172.21.15.172:6801/2931872350] conn(0x7f5f680c0360 0x7f5f680c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:08.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.780+0000 7f5f6e7fc640 1 -- 172.21.15.84:0/2023469082 --> [v2:172.21.15.172:6800/2931872350,v1:172.21.15.172:6801/2931872350] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f680c2f20 con 0x7f5f680c0360 2024-09-21T03:41:08.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.780+0000 7f5f6e7fc640 1 -- 172.21.15.84:0/2023469082 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f5f780e87d0 con 0x7f5f7c101ff0 2024-09-21T03:41:08.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.781+0000 7f5f80a3c640 1 --2- 172.21.15.84:0/2023469082 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f680b6670 0x7f5f680b8b80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009230 tx=0x7f5f70031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:08.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.781+0000 7f5f81a3e640 1 --2- 172.21.15.84:0/2023469082 >> [v2:172.21.15.172:6800/2931872350,v1:172.21.15.172:6801/2931872350] conn(0x7f5f680c0360 0x7f5f680c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:08.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.781+0000 7f5f81a3e640 1 --2- 172.21.15.84:0/2023469082 >> [v2:172.21.15.172:6800/2931872350,v1:172.21.15.172:6801/2931872350] conn(0x7f5f680c0360 0x7f5f680c2850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:08.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.782+0000 7f5f6e7fc640 1 -- 172.21.15.84:0/2023469082 <== osd.1 v2:172.21.15.172:6800/2931872350 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5f680c2f20 con 0x7f5f680c0360 2024-09-21T03:41:08.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.796+0000 7f5f67fff640 1 -- 172.21.15.84:0/2023469082 --> [v2:172.21.15.172:6800/2931872350,v1:172.21.15.172:6801/2931872350] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5f5c002dd0 con 0x7f5f680c0360 2024-09-21T03:41:08.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.797+0000 7f5f6e7fc640 1 -- 172.21.15.84:0/2023469082 <== osd.1 v2:172.21.15.172:6800/2931872350 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5f5c002dd0 con 0x7f5f680c0360 2024-09-21T03:41:08.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.797+0000 7f5f67fff640 1 -- 172.21.15.84:0/2023469082 >> [v2:172.21.15.172:6800/2931872350,v1:172.21.15.172:6801/2931872350] conn(0x7f5f680c0360 msgr2=0x7f5f680c2850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:08.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.797+0000 7f5f67fff640 1 --2- 172.21.15.84:0/2023469082 >> [v2:172.21.15.172:6800/2931872350,v1:172.21.15.172:6801/2931872350] conn(0x7f5f680c0360 0x7f5f680c2850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:08.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.797+0000 7f5f67fff640 1 -- 172.21.15.84:0/2023469082 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f680b6670 msgr2=0x7f5f680b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:08.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.797+0000 7f5f67fff640 1 --2- 172.21.15.84:0/2023469082 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f680b6670 0x7f5f680b8b80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009230 tx=0x7f5f70031400 comp rx=0 tx=0).stop 2024-09-21T03:41:08.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.797+0000 7f5f67fff640 1 -- 172.21.15.84:0/2023469082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f7c101ff0 msgr2=0x7f5f7c102f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:08.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.797+0000 7f5f67fff640 1 --2- 172.21.15.84:0/2023469082 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f7c101ff0 0x7f5f7c102f90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5f7800e9f0 tx=0x7f5f7800eeb0 comp rx=0 tx=0).stop 2024-09-21T03:41:08.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.797+0000 7f5f81a3e640 1 -- 172.21.15.84:0/2023469082 reap_dead start 2024-09-21T03:41:08.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.797+0000 7f5f67fff640 1 -- 172.21.15.84:0/2023469082 shutdown_connections 2024-09-21T03:41:08.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.797+0000 7f5f67fff640 1 -- 172.21.15.84:0/2023469082 >> 172.21.15.84:0/2023469082 conn(0x7f5f7c077cc0 msgr2=0x7f5f7c107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:08.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.797+0000 7f5f67fff640 1 -- 172.21.15.84:0/2023469082 shutdown_connections 2024-09-21T03:41:08.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:08.797+0000 7f5f67fff640 1 -- 172.21.15.84:0/2023469082 wait complete. 2024-09-21T03:41:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.417+0000 7ffb72bf0640 1 -- 172.21.15.84:0/3498030783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb6c108cf0 msgr2=0x7ffb6c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.417+0000 7ffb72bf0640 1 --2- 172.21.15.84:0/3498030783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb6c108cf0 0x7ffb6c10f520 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffb64009ca0 tx=0x7ffb6402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:41:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.417+0000 7ffb72bf0640 1 -- 172.21.15.84:0/3498030783 shutdown_connections 2024-09-21T03:41:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.417+0000 7ffb72bf0640 1 --2- 172.21.15.84:0/3498030783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb6c108cf0 0x7ffb6c10f520 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.417+0000 7ffb72bf0640 1 --2- 172.21.15.84:0/3498030783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb6c1083a0 0x7ffb6c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.417+0000 7ffb72bf0640 1 --2- 172.21.15.84:0/3498030783 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb6c102a60 0x7ffb6c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.417+0000 7ffb72bf0640 1 -- 172.21.15.84:0/3498030783 >> 172.21.15.84:0/3498030783 conn(0x7ffb6c079730 msgr2=0x7ffb6c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.417+0000 7ffb72bf0640 1 -- 172.21.15.84:0/3498030783 shutdown_connections 2024-09-21T03:41:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.417+0000 7ffb72bf0640 1 -- 172.21.15.84:0/3498030783 wait complete. 2024-09-21T03:41:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.418+0000 7ffb72bf0640 1 Processor -- start 2024-09-21T03:41:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.418+0000 7ffb72bf0640 1 -- start start 2024-09-21T03:41:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.418+0000 7ffb72bf0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb6c102a60 0x7ffb6c1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.418+0000 7ffb72bf0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb6c1083a0 0x7ffb6c199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.418+0000 7ffb72bf0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb6c108cf0 0x7ffb6c19ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.418+0000 7ffb72bf0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c1129c0 con 0x7ffb6c108cf0 2024-09-21T03:41:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.418+0000 7ffb72bf0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c112840 con 0x7ffb6c102a60 2024-09-21T03:41:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.418+0000 7ffb72bf0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c112b40 con 0x7ffb6c1083a0 2024-09-21T03:41:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.418+0000 7ffb7118d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb6c108cf0 0x7ffb6c19ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.418+0000 7ffb7118d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb6c108cf0 0x7ffb6c19ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54744/0 (socket says 172.21.15.84:54744) 2024-09-21T03:41:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.418+0000 7ffb7118d640 1 -- 172.21.15.84:0/554877249 learned_addr learned my addr 172.21.15.84:0/554877249 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.418+0000 7ffb6bfff640 1 --2- 172.21.15.84:0/554877249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb6c1083a0 0x7ffb6c199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.418+0000 7ffb7098c640 1 --2- 172.21.15.84:0/554877249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb6c102a60 0x7ffb6c1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.418+0000 7ffb7118d640 1 -- 172.21.15.84:0/554877249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb6c1083a0 msgr2=0x7ffb6c199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.418+0000 7ffb7118d640 1 --2- 172.21.15.84:0/554877249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffb6c1083a0 0x7ffb6c199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.418+0000 7ffb7118d640 1 -- 172.21.15.84:0/554877249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb6c102a60 msgr2=0x7ffb6c1993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.418+0000 7ffb7118d640 1 --2- 172.21.15.84:0/554877249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb6c102a60 0x7ffb6c1993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.418+0000 7ffb7118d640 1 -- 172.21.15.84:0/554877249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6c19f340 con 0x7ffb6c108cf0 2024-09-21T03:41:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.418+0000 7ffb7098c640 1 --2- 172.21.15.84:0/554877249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb6c102a60 0x7ffb6c1993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.419+0000 7ffb7118d640 1 --2- 172.21.15.84:0/554877249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb6c108cf0 0x7ffb6c19ec10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ffb64005cc0 tx=0x7ffb6402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.419+0000 7ffb69ffb640 1 -- 172.21.15.84:0/554877249 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64003bf0 con 0x7ffb6c108cf0 2024-09-21T03:41:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.419+0000 7ffb72bf0640 1 -- 172.21.15.84:0/554877249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb6c19f5d0 con 0x7ffb6c108cf0 2024-09-21T03:41:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.419+0000 7ffb69ffb640 1 -- 172.21.15.84:0/554877249 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb64003d90 con 0x7ffb6c108cf0 2024-09-21T03:41:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.419+0000 7ffb69ffb640 1 -- 172.21.15.84:0/554877249 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6402fbc0 con 0x7ffb6c108cf0 2024-09-21T03:41:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.419+0000 7ffb72bf0640 1 -- 172.21.15.84:0/554877249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb6c06ae60 con 0x7ffb6c108cf0 2024-09-21T03:41:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.420+0000 7ffb72bf0640 1 -- 172.21.15.84:0/554877249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffb6c06b490 con 0x7ffb6c108cf0 2024-09-21T03:41:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.422+0000 7ffb69ffb640 1 -- 172.21.15.84:0/554877249 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7ffb6402fd60 con 0x7ffb6c108cf0 2024-09-21T03:41:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.422+0000 7ffb69ffb640 1 --2- 172.21.15.84:0/554877249 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ffb5c0b65f0 0x7ffb5c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.422+0000 7ffb7098c640 1 --2- 172.21.15.84:0/554877249 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ffb5c0b65f0 0x7ffb5c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.422+0000 7ffb69ffb640 1 -- 172.21.15.84:0/554877249 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ffb64108ee0 con 0x7ffb6c108cf0 2024-09-21T03:41:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.423+0000 7ffb69ffb640 1 --2- 172.21.15.84:0/554877249 >> [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345] conn(0x7ffb5c0c02e0 0x7ffb5c0c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.423+0000 7ffb69ffb640 1 -- 172.21.15.84:0/554877249 --> [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb5c0c2ea0 con 0x7ffb5c0c02e0 2024-09-21T03:41:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.423+0000 7ffb69ffb640 1 -- 172.21.15.84:0/554877249 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7ffb64109330 con 0x7ffb6c108cf0 2024-09-21T03:41:09.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.423+0000 7ffb6bfff640 1 --2- 172.21.15.84:0/554877249 >> [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345] conn(0x7ffb5c0c02e0 0x7ffb5c0c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:09.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.423+0000 7ffb7098c640 1 --2- 172.21.15.84:0/554877249 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ffb5c0b65f0 0x7ffb5c0b8b00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009b40 tx=0x7ffb60005e50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:09.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.423+0000 7ffb6bfff640 1 --2- 172.21.15.84:0/554877249 >> [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345] conn(0x7ffb5c0c02e0 0x7ffb5c0c27d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:09.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.424+0000 7ffb69ffb640 1 -- 172.21.15.84:0/554877249 <== osd.6 v2:172.21.15.84:6818/3418459345 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffb5c0c2ea0 con 0x7ffb5c0c02e0 2024-09-21T03:41:09.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.437+0000 7ffb72bf0640 1 -- 172.21.15.84:0/554877249 --> [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffb6c06b8c0 con 0x7ffb5c0c02e0 2024-09-21T03:41:09.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.438+0000 7ffb69ffb640 1 -- 172.21.15.84:0/554877249 <== osd.6 v2:172.21.15.84:6818/3418459345 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ffb6c06b8c0 con 0x7ffb5c0c02e0 2024-09-21T03:41:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.438+0000 7ffb72bf0640 1 -- 172.21.15.84:0/554877249 >> [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345] conn(0x7ffb5c0c02e0 msgr2=0x7ffb5c0c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.438+0000 7ffb72bf0640 1 --2- 172.21.15.84:0/554877249 >> [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345] conn(0x7ffb5c0c02e0 0x7ffb5c0c27d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.438+0000 7ffb72bf0640 1 -- 172.21.15.84:0/554877249 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ffb5c0b65f0 msgr2=0x7ffb5c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.438+0000 7ffb72bf0640 1 --2- 172.21.15.84:0/554877249 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ffb5c0b65f0 0x7ffb5c0b8b00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009b40 tx=0x7ffb60005e50 comp rx=0 tx=0).stop 2024-09-21T03:41:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.438+0000 7ffb72bf0640 1 -- 172.21.15.84:0/554877249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb6c108cf0 msgr2=0x7ffb6c19ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.438+0000 7ffb72bf0640 1 --2- 172.21.15.84:0/554877249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffb6c108cf0 0x7ffb6c19ec10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ffb64005cc0 tx=0x7ffb6402f380 comp rx=0 tx=0).stop 2024-09-21T03:41:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.438+0000 7ffb7118d640 1 -- 172.21.15.84:0/554877249 reap_dead start 2024-09-21T03:41:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.438+0000 7ffb72bf0640 1 -- 172.21.15.84:0/554877249 shutdown_connections 2024-09-21T03:41:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.438+0000 7ffb72bf0640 1 -- 172.21.15.84:0/554877249 >> 172.21.15.84:0/554877249 conn(0x7ffb6c079730 msgr2=0x7ffb6c1052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.439+0000 7ffb72bf0640 1 -- 172.21.15.84:0/554877249 shutdown_connections 2024-09-21T03:41:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:09.439+0000 7ffb72bf0640 1 -- 172.21.15.84:0/554877249 wait complete. 2024-09-21T03:41:09.575 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:09 smithi084 ceph-mon[30941]: pgmap v284: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-21T03:41:09.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:09 smithi174 ceph-mon[34403]: pgmap v284: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-21T03:41:09.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:09 smithi172 ceph-mon[34821]: pgmap v284: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-21T03:41:10.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.647+0000 7f07e5f8f640 1 -- 172.21.15.84:0/383995968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07e0103b90 msgr2=0x7f07e0103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:10.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.647+0000 7f07e5f8f640 1 --2- 172.21.15.84:0/383995968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07e0103b90 0x7f07e0103fa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009900 tx=0x7f07d002a410 comp rx=0 tx=0).stop 2024-09-21T03:41:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.647+0000 7f07e5f8f640 1 -- 172.21.15.84:0/383995968 shutdown_connections 2024-09-21T03:41:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.647+0000 7f07e5f8f640 1 --2- 172.21.15.84:0/383995968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07e0109e20 0x7f07e0110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.647+0000 7f07e5f8f640 1 --2- 172.21.15.84:0/383995968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e01094d0 0x7f07e01098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.647+0000 7f07e5f8f640 1 --2- 172.21.15.84:0/383995968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07e0103b90 0x7f07e0103fa0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.647+0000 7f07e5f8f640 1 -- 172.21.15.84:0/383995968 >> 172.21.15.84:0/383995968 conn(0x7f07e00ff600 msgr2=0x7f07e0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.647+0000 7f07e5f8f640 1 -- 172.21.15.84:0/383995968 shutdown_connections 2024-09-21T03:41:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.647+0000 7f07e5f8f640 1 -- 172.21.15.84:0/383995968 wait complete. 2024-09-21T03:41:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.648+0000 7f07e5f8f640 1 Processor -- start 2024-09-21T03:41:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.648+0000 7f07e5f8f640 1 -- start start 2024-09-21T03:41:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.648+0000 7f07e5f8f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07e0103b90 0x7f07e019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.648+0000 7f07e5f8f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07e01094d0 0x7f07e019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.648+0000 7f07e5f8f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e0109e20 0x7f07e019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.648+0000 7f07e5f8f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f07e0113b20 con 0x7f07e01094d0 2024-09-21T03:41:10.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.648+0000 7f07e5f8f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f07e01139a0 con 0x7f07e0103b90 2024-09-21T03:41:10.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.648+0000 7f07e5f8f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f07e0113ca0 con 0x7f07e0109e20 2024-09-21T03:41:10.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.648+0000 7f07deffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07e01094d0 0x7f07e019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.648+0000 7f07deffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07e01094d0 0x7f07e019aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54752/0 (socket says 172.21.15.84:54752) 2024-09-21T03:41:10.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.648+0000 7f07deffd640 1 -- 172.21.15.84:0/787328386 learned_addr learned my addr 172.21.15.84:0/787328386 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:10.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.649+0000 7f07df7fe640 1 --2- 172.21.15.84:0/787328386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07e0103b90 0x7f07e019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.649+0000 7f07dffff640 1 --2- 172.21.15.84:0/787328386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e0109e20 0x7f07e019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.649+0000 7f07deffd640 1 -- 172.21.15.84:0/787328386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e0109e20 msgr2=0x7f07e019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:10.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.649+0000 7f07deffd640 1 --2- 172.21.15.84:0/787328386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e0109e20 0x7f07e019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.649+0000 7f07deffd640 1 -- 172.21.15.84:0/787328386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07e0103b90 msgr2=0x7f07e019a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:10.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.649+0000 7f07deffd640 1 --2- 172.21.15.84:0/787328386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07e0103b90 0x7f07e019a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.649+0000 7f07deffd640 1 -- 172.21.15.84:0/787328386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e01a0460 con 0x7f07e01094d0 2024-09-21T03:41:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.649+0000 7f07dffff640 1 --2- 172.21.15.84:0/787328386 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f07e0109e20 0x7f07e019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.649+0000 7f07deffd640 1 --2- 172.21.15.84:0/787328386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07e01094d0 0x7f07e019aa90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f07d4006fd0 tx=0x7f07d400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.649+0000 7f07dcff9640 1 -- 172.21.15.84:0/787328386 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d4011830 con 0x7f07e01094d0 2024-09-21T03:41:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.649+0000 7f07e5f8f640 1 -- 172.21.15.84:0/787328386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e01a0750 con 0x7f07e01094d0 2024-09-21T03:41:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.649+0000 7f07dcff9640 1 -- 172.21.15.84:0/787328386 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07d4016070 con 0x7f07e01094d0 2024-09-21T03:41:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.649+0000 7f07dcff9640 1 -- 172.21.15.84:0/787328386 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d4010e00 con 0x7f07e01094d0 2024-09-21T03:41:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.649+0000 7f07e5f8f640 1 -- 172.21.15.84:0/787328386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e01a6eb0 con 0x7f07e01094d0 2024-09-21T03:41:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.650+0000 7f07e5f8f640 1 -- 172.21.15.84:0/787328386 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f07e0063b50 con 0x7f07e01094d0 2024-09-21T03:41:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.652+0000 7f07dcff9640 1 -- 172.21.15.84:0/787328386 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f07d40243d0 con 0x7f07e01094d0 2024-09-21T03:41:10.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.652+0000 7f07dcff9640 1 --2- 172.21.15.84:0/787328386 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f07c80b65f0 0x7f07c80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.652+0000 7f07df7fe640 1 --2- 172.21.15.84:0/787328386 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f07c80b65f0 0x7f07c80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.653+0000 7f07dcff9640 1 -- 172.21.15.84:0/787328386 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f07d40e75c0 con 0x7f07e01094d0 2024-09-21T03:41:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.653+0000 7f07dcff9640 1 --2- 172.21.15.84:0/787328386 >> [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924] conn(0x7f07c80c02e0 0x7f07c80c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.653+0000 7f07dcff9640 1 -- 172.21.15.84:0/787328386 --> [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f07d401ce50 con 0x7f07c80c02e0 2024-09-21T03:41:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.653+0000 7f07dcff9640 1 -- 172.21.15.84:0/787328386 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f07d40e7a10 con 0x7f07e01094d0 2024-09-21T03:41:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.653+0000 7f07df7fe640 1 --2- 172.21.15.84:0/787328386 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f07c80b65f0 0x7f07c80b8b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f07d0031440 tx=0x7f07d0005e80 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.653+0000 7f07dffff640 1 --2- 172.21.15.84:0/787328386 >> [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924] conn(0x7f07c80c02e0 0x7f07c80c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.654+0000 7f07dffff640 1 --2- 172.21.15.84:0/787328386 >> [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924] conn(0x7f07c80c02e0 0x7f07c80c27d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.654+0000 7f07dcff9640 1 -- 172.21.15.84:0/787328386 <== osd.11 v2:172.21.15.174:6824/3452825924 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f07d401ce50 con 0x7f07c80c02e0 2024-09-21T03:41:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.668+0000 7f07e5f8f640 1 -- 172.21.15.84:0/787328386 --> [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f07e0063fd0 con 0x7f07c80c02e0 2024-09-21T03:41:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.668+0000 7f07dcff9640 1 -- 172.21.15.84:0/787328386 <== osd.11 v2:172.21.15.174:6824/3452825924 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f07e0063fd0 con 0x7f07c80c02e0 2024-09-21T03:41:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.668+0000 7f07e5f8f640 1 -- 172.21.15.84:0/787328386 >> [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924] conn(0x7f07c80c02e0 msgr2=0x7f07c80c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:10.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.668+0000 7f07e5f8f640 1 --2- 172.21.15.84:0/787328386 >> [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924] conn(0x7f07c80c02e0 0x7f07c80c27d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.668+0000 7f07e5f8f640 1 -- 172.21.15.84:0/787328386 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f07c80b65f0 msgr2=0x7f07c80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.668+0000 7f07e5f8f640 1 --2- 172.21.15.84:0/787328386 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f07c80b65f0 0x7f07c80b8b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f07d0031440 tx=0x7f07d0005e80 comp rx=0 tx=0).stop 2024-09-21T03:41:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.668+0000 7f07e5f8f640 1 -- 172.21.15.84:0/787328386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07e01094d0 msgr2=0x7f07e019aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.668+0000 7f07e5f8f640 1 --2- 172.21.15.84:0/787328386 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f07e01094d0 0x7f07e019aa90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f07d4006fd0 tx=0x7f07d400b8e0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.668+0000 7f07dffff640 1 -- 172.21.15.84:0/787328386 reap_dead start 2024-09-21T03:41:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.668+0000 7f07e5f8f640 1 -- 172.21.15.84:0/787328386 shutdown_connections 2024-09-21T03:41:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.668+0000 7f07e5f8f640 1 -- 172.21.15.84:0/787328386 >> 172.21.15.84:0/787328386 conn(0x7f07e00ff600 msgr2=0x7f07e0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.669+0000 7f07e5f8f640 1 -- 172.21.15.84:0/787328386 shutdown_connections 2024-09-21T03:41:10.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:10.669+0000 7f07e5f8f640 1 -- 172.21.15.84:0/787328386 wait complete. 2024-09-21T03:41:11.607 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:11 smithi084 ceph-mon[30941]: pgmap v285: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-21T03:41:11.608 INFO:teuthology.orchestra.run.smithi084.stdout:296352743446 2024-09-21T03:41:11.608 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T03:41:11.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:11 smithi174 ceph-mon[34403]: pgmap v285: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-21T03:41:11.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:11 smithi172 ceph-mon[34821]: pgmap v285: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-21T03:41:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.890+0000 7f1889c1c640 1 -- 172.21.15.84:0/327089212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1884108cf0 msgr2=0x7f188410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.890+0000 7f1889c1c640 1 --2- 172.21.15.84:0/327089212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1884108cf0 0x7f188410f520 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f187c009900 tx=0x7f187c02a410 comp rx=0 tx=0).stop 2024-09-21T03:41:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.890+0000 7f1889c1c640 1 -- 172.21.15.84:0/327089212 shutdown_connections 2024-09-21T03:41:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.890+0000 7f1889c1c640 1 --2- 172.21.15.84:0/327089212 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1884108cf0 0x7f188410f520 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:11.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.890+0000 7f1889c1c640 1 --2- 172.21.15.84:0/327089212 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18841083a0 0x7f18841087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.890+0000 7f1889c1c640 1 --2- 172.21.15.84:0/327089212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1884102a60 0x7f1884102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.890+0000 7f1889c1c640 1 -- 172.21.15.84:0/327089212 >> 172.21.15.84:0/327089212 conn(0x7f1884079730 msgr2=0x7f1884079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.890+0000 7f1889c1c640 1 -- 172.21.15.84:0/327089212 shutdown_connections 2024-09-21T03:41:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.890+0000 7f1889c1c640 1 -- 172.21.15.84:0/327089212 wait complete. 2024-09-21T03:41:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.891+0000 7f1889c1c640 1 Processor -- start 2024-09-21T03:41:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.891+0000 7f1889c1c640 1 -- start start 2024-09-21T03:41:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.891+0000 7f1889c1c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1884102a60 0x7f18840ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.891+0000 7f1889c1c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18841083a0 0x7f18840ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.891+0000 7f1889c1c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1884108cf0 0x7f18841000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.891+0000 7f1889c1c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1884112960 con 0x7f1884108cf0 2024-09-21T03:41:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.891+0000 7f1889c1c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f18841127e0 con 0x7f18841083a0 2024-09-21T03:41:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.891+0000 7f1889c1c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1884112ae0 con 0x7f1884102a60 2024-09-21T03:41:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.891+0000 7f1883fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1884108cf0 0x7f18841000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:11.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.891+0000 7f1883fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1884108cf0 0x7f18841000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54778/0 (socket says 172.21.15.84:54778) 2024-09-21T03:41:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.892+0000 7f1883fff640 1 -- 172.21.15.84:0/3429338848 learned_addr learned my addr 172.21.15.84:0/3429338848 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.892+0000 7f18837fe640 1 --2- 172.21.15.84:0/3429338848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1884102a60 0x7f18840ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.892+0000 7f1882ffd640 1 --2- 172.21.15.84:0/3429338848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18841083a0 0x7f18840ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.892+0000 7f1883fff640 1 -- 172.21.15.84:0/3429338848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1884102a60 msgr2=0x7f18840ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.892+0000 7f1883fff640 1 --2- 172.21.15.84:0/3429338848 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1884102a60 0x7f18840ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.892+0000 7f1883fff640 1 -- 172.21.15.84:0/3429338848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18841083a0 msgr2=0x7f18840ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.892+0000 7f1883fff640 1 --2- 172.21.15.84:0/3429338848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18841083a0 0x7f18840ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.892+0000 7f1883fff640 1 -- 172.21.15.84:0/3429338848 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18841a85f0 con 0x7f1884108cf0 2024-09-21T03:41:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.892+0000 7f1882ffd640 1 --2- 172.21.15.84:0/3429338848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18841083a0 0x7f18840ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.892+0000 7f1883fff640 1 --2- 172.21.15.84:0/3429338848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1884108cf0 0x7f18841000f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f187c009a20 tx=0x7f187c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.892+0000 7f1880ff9640 1 -- 172.21.15.84:0/3429338848 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c03f030 con 0x7f1884108cf0 2024-09-21T03:41:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.892+0000 7f1889c1c640 1 -- 172.21.15.84:0/3429338848 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18841a8880 con 0x7f1884108cf0 2024-09-21T03:41:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.892+0000 7f1880ff9640 1 -- 172.21.15.84:0/3429338848 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f187c003aa0 con 0x7f1884108cf0 2024-09-21T03:41:11.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.892+0000 7f1880ff9640 1 -- 172.21.15.84:0/3429338848 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c035070 con 0x7f1884108cf0 2024-09-21T03:41:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.892+0000 7f1889c1c640 1 -- 172.21.15.84:0/3429338848 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18841a8db0 con 0x7f1884108cf0 2024-09-21T03:41:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.893+0000 7f1889c1c640 1 -- 172.21.15.84:0/3429338848 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1884063b50 con 0x7f1884108cf0 2024-09-21T03:41:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.895+0000 7f1880ff9640 1 -- 172.21.15.84:0/3429338848 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f187c042030 con 0x7f1884108cf0 2024-09-21T03:41:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.896+0000 7f1880ff9640 1 --2- 172.21.15.84:0/3429338848 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f186c0b65f0 0x7f186c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.896+0000 7f18837fe640 1 --2- 172.21.15.84:0/3429338848 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f186c0b65f0 0x7f186c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.896+0000 7f1880ff9640 1 -- 172.21.15.84:0/3429338848 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f187c1085a0 con 0x7f1884108cf0 2024-09-21T03:41:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.896+0000 7f1880ff9640 1 --2- 172.21.15.84:0/3429338848 >> [v2:172.21.15.174:6816/2162992546,v1:172.21.15.174:6817/2162992546] conn(0x7f186c0c02e0 0x7f186c0c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.896+0000 7f1880ff9640 1 -- 172.21.15.84:0/3429338848 --> [v2:172.21.15.174:6816/2162992546,v1:172.21.15.174:6817/2162992546] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f186c0c2ea0 con 0x7f186c0c02e0 2024-09-21T03:41:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.896+0000 7f1880ff9640 1 -- 172.21.15.84:0/3429338848 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f187c1089f0 con 0x7f1884108cf0 2024-09-21T03:41:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.896+0000 7f18837fe640 1 --2- 172.21.15.84:0/3429338848 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f186c0b65f0 0x7f186c0b8b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1874007350 tx=0x7f18740072e0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.896+0000 7f1882ffd640 1 --2- 172.21.15.84:0/3429338848 >> [v2:172.21.15.174:6816/2162992546,v1:172.21.15.174:6817/2162992546] conn(0x7f186c0c02e0 0x7f186c0c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:11.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.897+0000 7f1882ffd640 1 --2- 172.21.15.84:0/3429338848 >> [v2:172.21.15.174:6816/2162992546,v1:172.21.15.174:6817/2162992546] conn(0x7f186c0c02e0 0x7f186c0c27d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:11.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.898+0000 7f1880ff9640 1 -- 172.21.15.84:0/3429338848 <== osd.8 v2:172.21.15.174:6816/2162992546 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f186c0c2ea0 con 0x7f186c0c02e0 2024-09-21T03:41:11.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.915+0000 7f1889c1c640 1 -- 172.21.15.84:0/3429338848 --> [v2:172.21.15.174:6816/2162992546,v1:172.21.15.174:6817/2162992546] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1884063f50 con 0x7f186c0c02e0 2024-09-21T03:41:11.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.916+0000 7f1880ff9640 1 -- 172.21.15.84:0/3429338848 <== osd.8 v2:172.21.15.174:6816/2162992546 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1884063f50 con 0x7f186c0c02e0 2024-09-21T03:41:11.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.916+0000 7f1889c1c640 1 -- 172.21.15.84:0/3429338848 >> [v2:172.21.15.174:6816/2162992546,v1:172.21.15.174:6817/2162992546] conn(0x7f186c0c02e0 msgr2=0x7f186c0c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:11.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.916+0000 7f1889c1c640 1 --2- 172.21.15.84:0/3429338848 >> [v2:172.21.15.174:6816/2162992546,v1:172.21.15.174:6817/2162992546] conn(0x7f186c0c02e0 0x7f186c0c27d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:11.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.916+0000 7f1889c1c640 1 -- 172.21.15.84:0/3429338848 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f186c0b65f0 msgr2=0x7f186c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:11.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.916+0000 7f1889c1c640 1 --2- 172.21.15.84:0/3429338848 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f186c0b65f0 0x7f186c0b8b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1874007350 tx=0x7f18740072e0 comp rx=0 tx=0).stop 2024-09-21T03:41:11.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.916+0000 7f1889c1c640 1 -- 172.21.15.84:0/3429338848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1884108cf0 msgr2=0x7f18841000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:11.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.916+0000 7f1889c1c640 1 --2- 172.21.15.84:0/3429338848 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1884108cf0 0x7f18841000f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f187c009a20 tx=0x7f187c004270 comp rx=0 tx=0).stop 2024-09-21T03:41:11.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.916+0000 7f1883fff640 1 -- 172.21.15.84:0/3429338848 reap_dead start 2024-09-21T03:41:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.916+0000 7f1889c1c640 1 -- 172.21.15.84:0/3429338848 shutdown_connections 2024-09-21T03:41:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.916+0000 7f1889c1c640 1 -- 172.21.15.84:0/3429338848 >> 172.21.15.84:0/3429338848 conn(0x7f1884079730 msgr2=0x7f188406b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.916+0000 7f1889c1c640 1 -- 172.21.15.84:0/3429338848 shutdown_connections 2024-09-21T03:41:11.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.916+0000 7f1889c1c640 1 -- 172.21.15.84:0/3429338848 wait complete. 2024-09-21T03:41:12.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.773+0000 7ff2bac18640 1 -- 172.21.15.84:0/398871461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2b4102ae0 msgr2=0x7ff2b4102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.773+0000 7ff2bac18640 1 --2- 172.21.15.84:0/398871461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2b4102ae0 0x7ff2b4102ef0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0009900 tx=0x7ff2b002a410 comp rx=0 tx=0).stop 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.773+0000 7ff2bac18640 1 -- 172.21.15.84:0/398871461 shutdown_connections 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.773+0000 7ff2bac18640 1 --2- 172.21.15.84:0/398871461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2b4108d20 0x7ff2b410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.773+0000 7ff2bac18640 1 --2- 172.21.15.84:0/398871461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2b41083d0 0x7ff2b41087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.773+0000 7ff2bac18640 1 --2- 172.21.15.84:0/398871461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2b4102ae0 0x7ff2b4102ef0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.773+0000 7ff2bac18640 1 -- 172.21.15.84:0/398871461 >> 172.21.15.84:0/398871461 conn(0x7ff2b4079760 msgr2=0x7ff2b4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.773+0000 7ff2bac18640 1 -- 172.21.15.84:0/398871461 shutdown_connections 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.773+0000 7ff2bac18640 1 -- 172.21.15.84:0/398871461 wait complete. 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.774+0000 7ff2bac18640 1 Processor -- start 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.774+0000 7ff2bac18640 1 -- start start 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.774+0000 7ff2bac18640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2b4102ae0 0x7ff2b419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:12.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.774+0000 7ff2bac18640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2b41083d0 0x7ff2b419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:12.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.774+0000 7ff2bac18640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2b4108d20 0x7ff2b419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:12.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.774+0000 7ff2bac18640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b41129f0 con 0x7ff2b41083d0 2024-09-21T03:41:12.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.774+0000 7ff2bac18640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b4112870 con 0x7ff2b4108d20 2024-09-21T03:41:12.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.774+0000 7ff2bac18640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b4112b70 con 0x7ff2b4102ae0 2024-09-21T03:41:12.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.774+0000 7ff2abfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2b41083d0 0x7ff2b419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:12.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.774+0000 7ff2abfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2b41083d0 0x7ff2b419aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54772/0 (socket says 172.21.15.84:54772) 2024-09-21T03:41:12.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.774+0000 7ff2abfff640 1 -- 172.21.15.84:0/1775450488 learned_addr learned my addr 172.21.15.84:0/1775450488 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:12.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.774+0000 7ff2b91b5640 1 --2- 172.21.15.84:0/1775450488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2b4108d20 0x7ff2b419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:12.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.774+0000 7ff2b89b4640 1 --2- 172.21.15.84:0/1775450488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2b4102ae0 0x7ff2b419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:12.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.774+0000 7ff2abfff640 1 -- 172.21.15.84:0/1775450488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2b4102ae0 msgr2=0x7ff2b419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:12.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.774+0000 7ff2abfff640 1 --2- 172.21.15.84:0/1775450488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff2b4102ae0 0x7ff2b419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.774+0000 7ff2abfff640 1 -- 172.21.15.84:0/1775450488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2b4108d20 msgr2=0x7ff2b419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:12.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.774+0000 7ff2abfff640 1 --2- 172.21.15.84:0/1775450488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2b4108d20 0x7ff2b419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.774+0000 7ff2abfff640 1 -- 172.21.15.84:0/1775450488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b41a0460 con 0x7ff2b41083d0 2024-09-21T03:41:12.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.775+0000 7ff2abfff640 1 --2- 172.21.15.84:0/1775450488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2b41083d0 0x7ff2b419aa90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff2a400b450 tx=0x7ff2a400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:12.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.775+0000 7ff2a9ffb640 1 -- 172.21.15.84:0/1775450488 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a4015020 con 0x7ff2b41083d0 2024-09-21T03:41:12.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.775+0000 7ff2a9ffb640 1 -- 172.21.15.84:0/1775450488 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2a4011d40 con 0x7ff2b41083d0 2024-09-21T03:41:12.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.775+0000 7ff2a9ffb640 1 -- 172.21.15.84:0/1775450488 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a400f340 con 0x7ff2b41083d0 2024-09-21T03:41:12.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.775+0000 7ff2bac18640 1 -- 172.21.15.84:0/1775450488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b41a0750 con 0x7ff2b41083d0 2024-09-21T03:41:12.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.775+0000 7ff2bac18640 1 -- 172.21.15.84:0/1775450488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b41a6f30 con 0x7ff2b41083d0 2024-09-21T03:41:12.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.776+0000 7ff2bac18640 1 -- 172.21.15.84:0/1775450488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff2b4101470 con 0x7ff2b41083d0 2024-09-21T03:41:12.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.778+0000 7ff2a9ffb640 1 -- 172.21.15.84:0/1775450488 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7ff2a4018020 con 0x7ff2b41083d0 2024-09-21T03:41:12.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.779+0000 7ff2a9ffb640 1 --2- 172.21.15.84:0/1775450488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff29c0b6670 0x7ff29c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:12.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.779+0000 7ff2b89b4640 1 --2- 172.21.15.84:0/1775450488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff29c0b6670 0x7ff29c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:12.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.779+0000 7ff2a9ffb640 1 -- 172.21.15.84:0/1775450488 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff2a40e7600 con 0x7ff2b41083d0 2024-09-21T03:41:12.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.780+0000 7ff2a9ffb640 1 --2- 172.21.15.84:0/1775450488 >> [v2:172.21.15.172:6824/2667099391,v1:172.21.15.172:6825/2667099391] conn(0x7ff29c0c0360 0x7ff29c0c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:12.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.780+0000 7ff2a9ffb640 1 -- 172.21.15.84:0/1775450488 --> [v2:172.21.15.172:6824/2667099391,v1:172.21.15.172:6825/2667099391] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2a4021e70 con 0x7ff29c0c0360 2024-09-21T03:41:12.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.780+0000 7ff2a9ffb640 1 -- 172.21.15.84:0/1775450488 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7ff2a40e7a50 con 0x7ff2b41083d0 2024-09-21T03:41:12.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.780+0000 7ff2b89b4640 1 --2- 172.21.15.84:0/1775450488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff29c0b6670 0x7ff29c0b8b80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0005f70 tx=0x7ff2b0000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:12.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.780+0000 7ff2b91b5640 1 --2- 172.21.15.84:0/1775450488 >> [v2:172.21.15.172:6824/2667099391,v1:172.21.15.172:6825/2667099391] conn(0x7ff29c0c0360 0x7ff29c0c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:12.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.780+0000 7ff2b91b5640 1 --2- 172.21.15.84:0/1775450488 >> [v2:172.21.15.172:6824/2667099391,v1:172.21.15.172:6825/2667099391] conn(0x7ff29c0c0360 0x7ff29c0c2850 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:12.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.781+0000 7ff2a9ffb640 1 -- 172.21.15.84:0/1775450488 <== osd.10 v2:172.21.15.172:6824/2667099391 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff2a4021e70 con 0x7ff29c0c0360 2024-09-21T03:41:12.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.795+0000 7ff2bac18640 1 -- 172.21.15.84:0/1775450488 --> [v2:172.21.15.172:6824/2667099391,v1:172.21.15.172:6825/2667099391] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff2b4103d10 con 0x7ff29c0c0360 2024-09-21T03:41:12.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.796+0000 7ff2a9ffb640 1 -- 172.21.15.84:0/1775450488 <== osd.10 v2:172.21.15.172:6824/2667099391 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff2b4103d10 con 0x7ff29c0c0360 2024-09-21T03:41:12.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.796+0000 7ff2bac18640 1 -- 172.21.15.84:0/1775450488 >> [v2:172.21.15.172:6824/2667099391,v1:172.21.15.172:6825/2667099391] conn(0x7ff29c0c0360 msgr2=0x7ff29c0c2850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:12.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.796+0000 7ff2bac18640 1 --2- 172.21.15.84:0/1775450488 >> [v2:172.21.15.172:6824/2667099391,v1:172.21.15.172:6825/2667099391] conn(0x7ff29c0c0360 0x7ff29c0c2850 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.796+0000 7ff2bac18640 1 -- 172.21.15.84:0/1775450488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff29c0b6670 msgr2=0x7ff29c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:12.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.796+0000 7ff2bac18640 1 --2- 172.21.15.84:0/1775450488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff29c0b6670 0x7ff29c0b8b80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff2b0005f70 tx=0x7ff2b0000bc0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.796+0000 7ff2bac18640 1 -- 172.21.15.84:0/1775450488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2b41083d0 msgr2=0x7ff2b419aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:12.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.796+0000 7ff2bac18640 1 --2- 172.21.15.84:0/1775450488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff2b41083d0 0x7ff2b419aa90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff2a400b450 tx=0x7ff2a400b910 comp rx=0 tx=0).stop 2024-09-21T03:41:12.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.796+0000 7ff2b91b5640 1 -- 172.21.15.84:0/1775450488 reap_dead start 2024-09-21T03:41:12.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.796+0000 7ff2bac18640 1 -- 172.21.15.84:0/1775450488 shutdown_connections 2024-09-21T03:41:12.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.796+0000 7ff2bac18640 1 -- 172.21.15.84:0/1775450488 >> 172.21.15.84:0/1775450488 conn(0x7ff2b4079760 msgr2=0x7ff2b41066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:12.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.796+0000 7ff2bac18640 1 -- 172.21.15.84:0/1775450488 shutdown_connections 2024-09-21T03:41:12.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:11.796+0000 7ff2bac18640 1 -- 172.21.15.84:0/1775450488 wait complete. 2024-09-21T03:41:12.788 INFO:teuthology.orchestra.run.smithi084.stdout:274877906970 2024-09-21T03:41:12.788 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T03:41:13.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.288+0000 7ff95fe68640 1 -- 172.21.15.84:0/4278331869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff958109e10 msgr2=0x7ff958110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.288+0000 7ff95fe68640 1 --2- 172.21.15.84:0/4278331869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff958109e10 0x7ff958110640 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff950009ca0 tx=0x7ff95002a8e0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.288+0000 7ff95fe68640 1 -- 172.21.15.84:0/4278331869 shutdown_connections 2024-09-21T03:41:13.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.288+0000 7ff95fe68640 1 --2- 172.21.15.84:0/4278331869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff958109e10 0x7ff958110640 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.288+0000 7ff95fe68640 1 --2- 172.21.15.84:0/4278331869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9581094c0 0x7ff9581098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.288+0000 7ff95fe68640 1 --2- 172.21.15.84:0/4278331869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff958103b80 0x7ff958103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.288+0000 7ff95fe68640 1 -- 172.21.15.84:0/4278331869 >> 172.21.15.84:0/4278331869 conn(0x7ff9580ff610 msgr2=0x7ff958101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:13.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.288+0000 7ff95fe68640 1 -- 172.21.15.84:0/4278331869 shutdown_connections 2024-09-21T03:41:13.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.288+0000 7ff95fe68640 1 -- 172.21.15.84:0/4278331869 wait complete. 2024-09-21T03:41:13.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.289+0000 7ff95fe68640 1 Processor -- start 2024-09-21T03:41:13.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.289+0000 7ff95fe68640 1 -- start start 2024-09-21T03:41:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.289+0000 7ff95fe68640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff958103b80 0x7ff95819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.289+0000 7ff95fe68640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9581094c0 0x7ff95819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.289+0000 7ff95fe68640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff958109e10 0x7ff95819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.289+0000 7ff95fe68640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff958113b30 con 0x7ff958103b80 2024-09-21T03:41:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.289+0000 7ff95fe68640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff9581139b0 con 0x7ff9581094c0 2024-09-21T03:41:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.289+0000 7ff95fe68640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff958113cb0 con 0x7ff958109e10 2024-09-21T03:41:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.289+0000 7ff95dc04640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff958103b80 0x7ff95819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.289+0000 7ff95dc04640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff958103b80 0x7ff95819a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54798/0 (socket says 172.21.15.84:54798) 2024-09-21T03:41:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.289+0000 7ff95dc04640 1 -- 172.21.15.84:0/3691810122 learned_addr learned my addr 172.21.15.84:0/3691810122 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.289+0000 7ff95d403640 1 --2- 172.21.15.84:0/3691810122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9581094c0 0x7ff95819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.290+0000 7ff95e405640 1 --2- 172.21.15.84:0/3691810122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff958109e10 0x7ff95819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.290+0000 7ff95dc04640 1 -- 172.21.15.84:0/3691810122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff958109e10 msgr2=0x7ff95819fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.290+0000 7ff95dc04640 1 --2- 172.21.15.84:0/3691810122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff958109e10 0x7ff95819fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.290+0000 7ff95dc04640 1 -- 172.21.15.84:0/3691810122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9581094c0 msgr2=0x7ff95819aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.290+0000 7ff95dc04640 1 --2- 172.21.15.84:0/3691810122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9581094c0 0x7ff95819aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.290+0000 7ff95dc04640 1 -- 172.21.15.84:0/3691810122 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9581a0410 con 0x7ff958103b80 2024-09-21T03:41:13.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.290+0000 7ff95dc04640 1 --2- 172.21.15.84:0/3691810122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff958103b80 0x7ff95819a4a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff95400c970 tx=0x7ff95400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:13.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.290+0000 7ff94effd640 1 -- 172.21.15.84:0/3691810122 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff954007bb0 con 0x7ff958103b80 2024-09-21T03:41:13.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.290+0000 7ff95fe68640 1 -- 172.21.15.84:0/3691810122 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9581a0700 con 0x7ff958103b80 2024-09-21T03:41:13.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.290+0000 7ff94effd640 1 -- 172.21.15.84:0/3691810122 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff954007d50 con 0x7ff958103b80 2024-09-21T03:41:13.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.290+0000 7ff94effd640 1 -- 172.21.15.84:0/3691810122 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff954004de0 con 0x7ff958103b80 2024-09-21T03:41:13.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.290+0000 7ff95fe68640 1 -- 172.21.15.84:0/3691810122 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9580755f0 con 0x7ff958103b80 2024-09-21T03:41:13.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.291+0000 7ff95fe68640 1 -- 172.21.15.84:0/3691810122 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff958063a90 con 0x7ff958103b80 2024-09-21T03:41:13.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.293+0000 7ff94effd640 1 -- 172.21.15.84:0/3691810122 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7ff954004f80 con 0x7ff958103b80 2024-09-21T03:41:13.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.294+0000 7ff94effd640 1 --2- 172.21.15.84:0/3691810122 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff9440b65f0 0x7ff9440b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.294+0000 7ff95d403640 1 --2- 172.21.15.84:0/3691810122 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff9440b65f0 0x7ff9440b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.294+0000 7ff94effd640 1 -- 172.21.15.84:0/3691810122 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff9540e7730 con 0x7ff958103b80 2024-09-21T03:41:13.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.294+0000 7ff94effd640 1 --2- 172.21.15.84:0/3691810122 >> [v2:172.21.15.172:6808/3069862739,v1:172.21.15.172:6809/3069862739] conn(0x7ff9440c02e0 0x7ff9440c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.294+0000 7ff94effd640 1 -- 172.21.15.84:0/3691810122 --> [v2:172.21.15.172:6808/3069862739,v1:172.21.15.172:6809/3069862739] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9440c2ea0 con 0x7ff9440c02e0 2024-09-21T03:41:13.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.294+0000 7ff94effd640 1 -- 172.21.15.84:0/3691810122 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7ff9540e7b80 con 0x7ff958103b80 2024-09-21T03:41:13.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.294+0000 7ff95d403640 1 --2- 172.21.15.84:0/3691810122 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff9440b65f0 0x7ff9440b8b00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff958102e60 tx=0x7ff948009110 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:13.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.294+0000 7ff95e405640 1 --2- 172.21.15.84:0/3691810122 >> [v2:172.21.15.172:6808/3069862739,v1:172.21.15.172:6809/3069862739] conn(0x7ff9440c02e0 0x7ff9440c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.295+0000 7ff95e405640 1 --2- 172.21.15.84:0/3691810122 >> [v2:172.21.15.172:6808/3069862739,v1:172.21.15.172:6809/3069862739] conn(0x7ff9440c02e0 0x7ff9440c27d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:13.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.296+0000 7ff94effd640 1 -- 172.21.15.84:0/3691810122 <== osd.4 v2:172.21.15.172:6808/3069862739 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9440c2ea0 con 0x7ff9440c02e0 2024-09-21T03:41:13.310 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.309+0000 7ff95fe68640 1 -- 172.21.15.84:0/3691810122 --> [v2:172.21.15.172:6808/3069862739,v1:172.21.15.172:6809/3069862739] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff958063f10 con 0x7ff9440c02e0 2024-09-21T03:41:13.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.310+0000 7ff94effd640 1 -- 172.21.15.84:0/3691810122 <== osd.4 v2:172.21.15.172:6808/3069862739 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff958063f10 con 0x7ff9440c02e0 2024-09-21T03:41:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.310+0000 7ff95fe68640 1 -- 172.21.15.84:0/3691810122 >> [v2:172.21.15.172:6808/3069862739,v1:172.21.15.172:6809/3069862739] conn(0x7ff9440c02e0 msgr2=0x7ff9440c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.310+0000 7ff95fe68640 1 --2- 172.21.15.84:0/3691810122 >> [v2:172.21.15.172:6808/3069862739,v1:172.21.15.172:6809/3069862739] conn(0x7ff9440c02e0 0x7ff9440c27d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.310+0000 7ff95fe68640 1 -- 172.21.15.84:0/3691810122 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff9440b65f0 msgr2=0x7ff9440b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.310+0000 7ff95fe68640 1 --2- 172.21.15.84:0/3691810122 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff9440b65f0 0x7ff9440b8b00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff958102e60 tx=0x7ff948009110 comp rx=0 tx=0).stop 2024-09-21T03:41:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.310+0000 7ff95fe68640 1 -- 172.21.15.84:0/3691810122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff958103b80 msgr2=0x7ff95819a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.310+0000 7ff95fe68640 1 --2- 172.21.15.84:0/3691810122 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff958103b80 0x7ff95819a4a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff95400c970 tx=0x7ff95400cd70 comp rx=0 tx=0).stop 2024-09-21T03:41:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.310+0000 7ff95e405640 1 -- 172.21.15.84:0/3691810122 reap_dead start 2024-09-21T03:41:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.310+0000 7ff95fe68640 1 -- 172.21.15.84:0/3691810122 shutdown_connections 2024-09-21T03:41:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.310+0000 7ff95fe68640 1 -- 172.21.15.84:0/3691810122 >> 172.21.15.84:0/3691810122 conn(0x7ff9580ff610 msgr2=0x7ff958106a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.310+0000 7ff95fe68640 1 -- 172.21.15.84:0/3691810122 shutdown_connections 2024-09-21T03:41:13.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.310+0000 7ff95fe68640 1 -- 172.21.15.84:0/3691810122 wait complete. 2024-09-21T03:41:13.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.498+0000 7fe7a1dcb640 1 -- 172.21.15.84:0/2623624690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe79c10de10 msgr2=0x7fe79c1102f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.498+0000 7fe7a1dcb640 1 --2- 172.21.15.84:0/2623624690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe79c10de10 0x7fe79c1102f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe794009ca0 tx=0x7fe79402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.498+0000 7fe7a1dcb640 1 -- 172.21.15.84:0/2623624690 shutdown_connections 2024-09-21T03:41:13.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.498+0000 7fe7a1dcb640 1 --2- 172.21.15.84:0/2623624690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe79c10de10 0x7fe79c1102f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.498+0000 7fe7a1dcb640 1 --2- 172.21.15.84:0/2623624690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe79c105290 0x7fe79c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.498+0000 7fe7a1dcb640 1 --2- 172.21.15.84:0/2623624690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe79c104860 0x7fe79c104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.498+0000 7fe7a1dcb640 1 -- 172.21.15.84:0/2623624690 >> 172.21.15.84:0/2623624690 conn(0x7fe79c079730 msgr2=0x7fe79c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:13.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.498+0000 7fe7a1dcb640 1 -- 172.21.15.84:0/2623624690 shutdown_connections 2024-09-21T03:41:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.498+0000 7fe7a1dcb640 1 -- 172.21.15.84:0/2623624690 wait complete. 2024-09-21T03:41:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.498+0000 7fe7a1dcb640 1 Processor -- start 2024-09-21T03:41:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.498+0000 7fe7a1dcb640 1 -- start start 2024-09-21T03:41:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.499+0000 7fe7a1dcb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe79c104860 0x7fe79c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.499+0000 7fe7a1dcb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe79c105290 0x7fe79c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.499+0000 7fe7a1dcb640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe79c10de10 0x7fe79c19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.499+0000 7fe7a1dcb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c113a60 con 0x7fe79c105290 2024-09-21T03:41:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.499+0000 7fe7a1dcb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1138e0 con 0x7fe79c104860 2024-09-21T03:41:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.499+0000 7fe7a1dcb640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c113be0 con 0x7fe79c10de10 2024-09-21T03:41:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.499+0000 7fe792ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe79c105290 0x7fe79c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.499+0000 7fe792ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe79c105290 0x7fe79c19aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54824/0 (socket says 172.21.15.84:54824) 2024-09-21T03:41:13.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.499+0000 7fe792ffd640 1 -- 172.21.15.84:0/4116848379 learned_addr learned my addr 172.21.15.84:0/4116848379 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:13.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.499+0000 7fe79b7fe640 1 --2- 172.21.15.84:0/4116848379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe79c104860 0x7fe79c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.499+0000 7fe79bfff640 1 --2- 172.21.15.84:0/4116848379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe79c10de10 0x7fe79c19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.499+0000 7fe792ffd640 1 -- 172.21.15.84:0/4116848379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe79c10de10 msgr2=0x7fe79c19fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.499+0000 7fe792ffd640 1 --2- 172.21.15.84:0/4116848379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe79c10de10 0x7fe79c19fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.499+0000 7fe792ffd640 1 -- 172.21.15.84:0/4116848379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe79c104860 msgr2=0x7fe79c19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.499+0000 7fe792ffd640 1 --2- 172.21.15.84:0/4116848379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe79c104860 0x7fe79c19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.499+0000 7fe792ffd640 1 -- 172.21.15.84:0/4116848379 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe79c1a0320 con 0x7fe79c105290 2024-09-21T03:41:13.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.500+0000 7fe792ffd640 1 --2- 172.21.15.84:0/4116848379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe79c105290 0x7fe79c19aa10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe78400d740 tx=0x7fe78400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:13.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.500+0000 7fe7997fa640 1 -- 172.21.15.84:0/4116848379 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe784017070 con 0x7fe79c105290 2024-09-21T03:41:13.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.500+0000 7fe7a1dcb640 1 -- 172.21.15.84:0/4116848379 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe79c1a0610 con 0x7fe79c105290 2024-09-21T03:41:13.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.500+0000 7fe7997fa640 1 -- 172.21.15.84:0/4116848379 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe784010460 con 0x7fe79c105290 2024-09-21T03:41:13.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.500+0000 7fe7997fa640 1 -- 172.21.15.84:0/4116848379 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78400f600 con 0x7fe79c105290 2024-09-21T03:41:13.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.500+0000 7fe7a1dcb640 1 -- 172.21.15.84:0/4116848379 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe79c1a6e30 con 0x7fe79c105290 2024-09-21T03:41:13.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.501+0000 7fe7a1dcb640 1 -- 172.21.15.84:0/4116848379 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe79c1083c0 con 0x7fe79c105290 2024-09-21T03:41:13.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.503+0000 7fe7997fa640 1 -- 172.21.15.84:0/4116848379 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fe78401a070 con 0x7fe79c105290 2024-09-21T03:41:13.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.503+0000 7fe7997fa640 1 --2- 172.21.15.84:0/4116848379 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe7880b66a0 0x7fe7880b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.503+0000 7fe79b7fe640 1 --2- 172.21.15.84:0/4116848379 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe7880b66a0 0x7fe7880b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.503+0000 7fe7997fa640 1 -- 172.21.15.84:0/4116848379 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe7840e73e0 con 0x7fe79c105290 2024-09-21T03:41:13.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.504+0000 7fe7997fa640 1 --2- 172.21.15.84:0/4116848379 >> [v2:172.21.15.172:6816/4056019738,v1:172.21.15.172:6817/4056019738] conn(0x7fe7880c0390 0x7fe7880c2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.504+0000 7fe7997fa640 1 -- 172.21.15.84:0/4116848379 --> [v2:172.21.15.172:6816/4056019738,v1:172.21.15.172:6817/4056019738] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe78401ae50 con 0x7fe7880c0390 2024-09-21T03:41:13.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.504+0000 7fe7997fa640 1 -- 172.21.15.84:0/4116848379 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fe7840e7830 con 0x7fe79c105290 2024-09-21T03:41:13.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.504+0000 7fe79b7fe640 1 --2- 172.21.15.84:0/4116848379 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe7880b66a0 0x7fe7880b8bb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00abe0 tx=0x7fe78c00a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:13.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.504+0000 7fe79bfff640 1 --2- 172.21.15.84:0/4116848379 >> [v2:172.21.15.172:6816/4056019738,v1:172.21.15.172:6817/4056019738] conn(0x7fe7880c0390 0x7fe7880c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.505+0000 7fe79bfff640 1 --2- 172.21.15.84:0/4116848379 >> [v2:172.21.15.172:6816/4056019738,v1:172.21.15.172:6817/4056019738] conn(0x7fe7880c0390 0x7fe7880c2880 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:13.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.505+0000 7fe7997fa640 1 -- 172.21.15.84:0/4116848379 <== osd.7 v2:172.21.15.172:6816/4056019738 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe78401ae50 con 0x7fe7880c0390 2024-09-21T03:41:13.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.521+0000 7fe7a1dcb640 1 -- 172.21.15.84:0/4116848379 --> [v2:172.21.15.172:6816/4056019738,v1:172.21.15.172:6817/4056019738] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe79c06b4e0 con 0x7fe7880c0390 2024-09-21T03:41:13.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.521+0000 7fe7997fa640 1 -- 172.21.15.84:0/4116848379 <== osd.7 v2:172.21.15.172:6816/4056019738 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe79c06b4e0 con 0x7fe7880c0390 2024-09-21T03:41:13.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.522+0000 7fe7a1dcb640 1 -- 172.21.15.84:0/4116848379 >> [v2:172.21.15.172:6816/4056019738,v1:172.21.15.172:6817/4056019738] conn(0x7fe7880c0390 msgr2=0x7fe7880c2880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.522+0000 7fe7a1dcb640 1 --2- 172.21.15.84:0/4116848379 >> [v2:172.21.15.172:6816/4056019738,v1:172.21.15.172:6817/4056019738] conn(0x7fe7880c0390 0x7fe7880c2880 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.522+0000 7fe7a1dcb640 1 -- 172.21.15.84:0/4116848379 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe7880b66a0 msgr2=0x7fe7880b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.522+0000 7fe7a1dcb640 1 --2- 172.21.15.84:0/4116848379 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe7880b66a0 0x7fe7880b8bb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00abe0 tx=0x7fe78c00a2d0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.522+0000 7fe7a1dcb640 1 -- 172.21.15.84:0/4116848379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe79c105290 msgr2=0x7fe79c19aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.522+0000 7fe7a1dcb640 1 --2- 172.21.15.84:0/4116848379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe79c105290 0x7fe79c19aa10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe78400d740 tx=0x7fe78400db40 comp rx=0 tx=0).stop 2024-09-21T03:41:13.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.522+0000 7fe79bfff640 1 -- 172.21.15.84:0/4116848379 reap_dead start 2024-09-21T03:41:13.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.522+0000 7fe7a1dcb640 1 -- 172.21.15.84:0/4116848379 shutdown_connections 2024-09-21T03:41:13.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.522+0000 7fe7a1dcb640 1 -- 172.21.15.84:0/4116848379 >> 172.21.15.84:0/4116848379 conn(0x7fe79c079730 msgr2=0x7fe79c107960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:13.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.522+0000 7fe7a1dcb640 1 -- 172.21.15.84:0/4116848379 shutdown_connections 2024-09-21T03:41:13.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:13.522+0000 7fe7a1dcb640 1 -- 172.21.15.84:0/4116848379 wait complete. 2024-09-21T03:41:13.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:13 smithi174 ceph-mon[34403]: pgmap v286: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:41:13.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:13 smithi172 ceph-mon[34821]: pgmap v286: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:41:13.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:13 smithi084 ceph-mon[30941]: pgmap v286: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:41:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.246+0000 7fc3c49a7640 1 -- 172.21.15.84:0/1163309349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c0102ae0 msgr2=0x7fc3c0102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.246+0000 7fc3c49a7640 1 --2- 172.21.15.84:0/1163309349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c0102ae0 0x7fc3c0102ef0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0009900 tx=0x7fc3b002a410 comp rx=0 tx=0).stop 2024-09-21T03:41:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.246+0000 7fc3c49a7640 1 -- 172.21.15.84:0/1163309349 shutdown_connections 2024-09-21T03:41:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.246+0000 7fc3c49a7640 1 --2- 172.21.15.84:0/1163309349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c0108d70 0x7fc3c010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.246+0000 7fc3c49a7640 1 --2- 172.21.15.84:0/1163309349 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3c0108420 0x7fc3c0108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.246+0000 7fc3c49a7640 1 --2- 172.21.15.84:0/1163309349 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c0102ae0 0x7fc3c0102ef0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.246+0000 7fc3c49a7640 1 -- 172.21.15.84:0/1163309349 >> 172.21.15.84:0/1163309349 conn(0x7fc3c0079770 msgr2=0x7fc3c0079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.246+0000 7fc3c49a7640 1 -- 172.21.15.84:0/1163309349 shutdown_connections 2024-09-21T03:41:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.246+0000 7fc3c49a7640 1 -- 172.21.15.84:0/1163309349 wait complete. 2024-09-21T03:41:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.247+0000 7fc3c49a7640 1 Processor -- start 2024-09-21T03:41:14.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.247+0000 7fc3c49a7640 1 -- start start 2024-09-21T03:41:14.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.248+0000 7fc3c49a7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3c0102ae0 0x7fc3c019b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:14.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.248+0000 7fc3c49a7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c0108420 0x7fc3c019b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:14.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.248+0000 7fc3c49a7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c0108d70 0x7fc3c019be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:14.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.248+0000 7fc3c49a7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c0112a30 con 0x7fc3c0108d70 2024-09-21T03:41:14.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.248+0000 7fc3c49a7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c01128b0 con 0x7fc3c0108420 2024-09-21T03:41:14.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.248+0000 7fc3c49a7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c0112bb0 con 0x7fc3c0102ae0 2024-09-21T03:41:14.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.248+0000 7fc3bed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c0108d70 0x7fc3c019be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:14.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.248+0000 7fc3bed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c0108d70 0x7fc3c019be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54838/0 (socket says 172.21.15.84:54838) 2024-09-21T03:41:14.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.248+0000 7fc3bed9d640 1 -- 172.21.15.84:0/4096510033 learned_addr learned my addr 172.21.15.84:0/4096510033 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:14.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.248+0000 7fc3b5d9b640 1 --2- 172.21.15.84:0/4096510033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c0108420 0x7fc3c019b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:14.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.248+0000 7fc3be59c640 1 --2- 172.21.15.84:0/4096510033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3c0102ae0 0x7fc3c019b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:14.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.248+0000 7fc3bed9d640 1 -- 172.21.15.84:0/4096510033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3c0102ae0 msgr2=0x7fc3c019b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:14.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.248+0000 7fc3bed9d640 1 --2- 172.21.15.84:0/4096510033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3c0102ae0 0x7fc3c019b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:14.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.248+0000 7fc3bed9d640 1 -- 172.21.15.84:0/4096510033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c0108420 msgr2=0x7fc3c019b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:14.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.248+0000 7fc3bed9d640 1 --2- 172.21.15.84:0/4096510033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3c0108420 0x7fc3c019b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:14.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.248+0000 7fc3bed9d640 1 -- 172.21.15.84:0/4096510033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c01a6690 con 0x7fc3c0108d70 2024-09-21T03:41:14.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.248+0000 7fc3bed9d640 1 --2- 172.21.15.84:0/4096510033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c0108d70 0x7fc3c019be80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800eaa0 tx=0x7fc3b800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:14.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.249+0000 7fc3b7fff640 1 -- 172.21.15.84:0/4096510033 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b800cdb0 con 0x7fc3c0108d70 2024-09-21T03:41:14.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.249+0000 7fc3c49a7640 1 -- 172.21.15.84:0/4096510033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3c01a6980 con 0x7fc3c0108d70 2024-09-21T03:41:14.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.249+0000 7fc3b7fff640 1 -- 172.21.15.84:0/4096510033 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3b8005020 con 0x7fc3c0108d70 2024-09-21T03:41:14.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.249+0000 7fc3b7fff640 1 -- 172.21.15.84:0/4096510033 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b80116d0 con 0x7fc3c0108d70 2024-09-21T03:41:14.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.249+0000 7fc3c49a7640 1 -- 172.21.15.84:0/4096510033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3c01a6e70 con 0x7fc3c0108d70 2024-09-21T03:41:14.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.250+0000 7fc3c49a7640 1 -- 172.21.15.84:0/4096510033 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc3c0063ad0 con 0x7fc3c0108d70 2024-09-21T03:41:14.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.251+0000 7fc3b7fff640 1 -- 172.21.15.84:0/4096510033 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fc3b80051d0 con 0x7fc3c0108d70 2024-09-21T03:41:14.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.252+0000 7fc3b7fff640 1 --2- 172.21.15.84:0/4096510033 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc3ac0b6620 0x7fc3ac0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:14.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.252+0000 7fc3be59c640 1 --2- 172.21.15.84:0/4096510033 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc3ac0b6620 0x7fc3ac0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:14.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.252+0000 7fc3b7fff640 1 -- 172.21.15.84:0/4096510033 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fc3b80e7b00 con 0x7fc3c0108d70 2024-09-21T03:41:14.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.252+0000 7fc3b7fff640 1 --2- 172.21.15.84:0/4096510033 >> [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673] conn(0x7fc3ac0c0310 0x7fc3ac0c2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:14.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.252+0000 7fc3b7fff640 1 -- 172.21.15.84:0/4096510033 --> [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3b801ce50 con 0x7fc3ac0c0310 2024-09-21T03:41:14.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.252+0000 7fc3b7fff640 1 -- 172.21.15.84:0/4096510033 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fc3b80e7f50 con 0x7fc3c0108d70 2024-09-21T03:41:14.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.253+0000 7fc3b5d9b640 1 --2- 172.21.15.84:0/4096510033 >> [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673] conn(0x7fc3ac0c0310 0x7fc3ac0c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:14.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.253+0000 7fc3be59c640 1 --2- 172.21.15.84:0/4096510033 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc3ac0b6620 0x7fc3ac0b8b30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0000c00 tx=0x7fc3b0031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:14.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.253+0000 7fc3b5d9b640 1 --2- 172.21.15.84:0/4096510033 >> [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673] conn(0x7fc3ac0c0310 0x7fc3ac0c2800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:14.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.254+0000 7fc3b7fff640 1 -- 172.21.15.84:0/4096510033 <== osd.9 v2:172.21.15.84:6826/3230873673 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc3b801ce50 con 0x7fc3ac0c0310 2024-09-21T03:41:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.267+0000 7fc3c49a7640 1 -- 172.21.15.84:0/4096510033 --> [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc3c0063f50 con 0x7fc3ac0c0310 2024-09-21T03:41:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.267+0000 7fc3b7fff640 1 -- 172.21.15.84:0/4096510033 <== osd.9 v2:172.21.15.84:6826/3230873673 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc3c0063f50 con 0x7fc3ac0c0310 2024-09-21T03:41:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.268+0000 7fc3c49a7640 1 -- 172.21.15.84:0/4096510033 >> [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673] conn(0x7fc3ac0c0310 msgr2=0x7fc3ac0c2800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.268+0000 7fc3c49a7640 1 --2- 172.21.15.84:0/4096510033 >> [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673] conn(0x7fc3ac0c0310 0x7fc3ac0c2800 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.268+0000 7fc3c49a7640 1 -- 172.21.15.84:0/4096510033 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc3ac0b6620 msgr2=0x7fc3ac0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.268+0000 7fc3c49a7640 1 --2- 172.21.15.84:0/4096510033 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc3ac0b6620 0x7fc3ac0b8b30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0000c00 tx=0x7fc3b0031400 comp rx=0 tx=0).stop 2024-09-21T03:41:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.268+0000 7fc3c49a7640 1 -- 172.21.15.84:0/4096510033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c0108d70 msgr2=0x7fc3c019be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.268+0000 7fc3c49a7640 1 --2- 172.21.15.84:0/4096510033 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc3c0108d70 0x7fc3c019be80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800eaa0 tx=0x7fc3b800ef60 comp rx=0 tx=0).stop 2024-09-21T03:41:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.268+0000 7fc3bed9d640 1 -- 172.21.15.84:0/4096510033 reap_dead start 2024-09-21T03:41:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.268+0000 7fc3c49a7640 1 -- 172.21.15.84:0/4096510033 shutdown_connections 2024-09-21T03:41:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.268+0000 7fc3c49a7640 1 -- 172.21.15.84:0/4096510033 >> 172.21.15.84:0/4096510033 conn(0x7fc3c0079770 msgr2=0x7fc3c0106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.268+0000 7fc3c49a7640 1 -- 172.21.15.84:0/4096510033 shutdown_connections 2024-09-21T03:41:14.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.268+0000 7fc3c49a7640 1 -- 172.21.15.84:0/4096510033 wait complete. 2024-09-21T03:41:14.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.702+0000 7f6626fbf640 1 -- 172.21.15.84:0/899755851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6620108d50 msgr2=0x7f662010f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:14.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.702+0000 7f6626fbf640 1 --2- 172.21.15.84:0/899755851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6620108d50 0x7f662010f580 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6618009ca0 tx=0x7f661802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:41:14.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.702+0000 7f6626fbf640 1 -- 172.21.15.84:0/899755851 shutdown_connections 2024-09-21T03:41:14.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.702+0000 7f6626fbf640 1 --2- 172.21.15.84:0/899755851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6620108d50 0x7f662010f580 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:14.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.702+0000 7f6626fbf640 1 --2- 172.21.15.84:0/899755851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6620108400 0x7f6620108810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:14.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.702+0000 7f6626fbf640 1 --2- 172.21.15.84:0/899755851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6620103190 0x7f66201035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:14.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.702+0000 7f6626fbf640 1 -- 172.21.15.84:0/899755851 >> 172.21.15.84:0/899755851 conn(0x7f6620079f90 msgr2=0x7f662007a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:14.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.703+0000 7f6626fbf640 1 -- 172.21.15.84:0/899755851 shutdown_connections 2024-09-21T03:41:14.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.703+0000 7f6626fbf640 1 -- 172.21.15.84:0/899755851 wait complete. 2024-09-21T03:41:14.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.703+0000 7f6626fbf640 1 Processor -- start 2024-09-21T03:41:14.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.703+0000 7f6626fbf640 1 -- start start 2024-09-21T03:41:14.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.704+0000 7f6626fbf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6620103190 0x7f6620199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:14.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.704+0000 7f6626fbf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6620108400 0x7f66201999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:14.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.704+0000 7f6626fbf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6620108d50 0x7f662019ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:14.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.704+0000 7f6626fbf640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6620112a10 con 0x7f6620108d50 2024-09-21T03:41:14.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.704+0000 7f6626fbf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6620112890 con 0x7f6620103190 2024-09-21T03:41:14.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.704+0000 7f6626fbf640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6620112b90 con 0x7f6620108400 2024-09-21T03:41:14.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.704+0000 7f662555c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6620108d50 0x7f662019ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:14.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.704+0000 7f662555c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6620108d50 0x7f662019ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54864/0 (socket says 172.21.15.84:54864) 2024-09-21T03:41:14.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.704+0000 7f662555c640 1 -- 172.21.15.84:0/2438828661 learned_addr learned my addr 172.21.15.84:0/2438828661 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:14.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.704+0000 7f6624d5b640 1 --2- 172.21.15.84:0/2438828661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6620103190 0x7f6620199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:14.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.704+0000 7f661ffff640 1 --2- 172.21.15.84:0/2438828661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6620108400 0x7f66201999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:14.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.704+0000 7f662555c640 1 -- 172.21.15.84:0/2438828661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6620108400 msgr2=0x7f66201999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:14.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.704+0000 7f662555c640 1 --2- 172.21.15.84:0/2438828661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6620108400 0x7f66201999c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:14.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.704+0000 7f662555c640 1 -- 172.21.15.84:0/2438828661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6620103190 msgr2=0x7f6620199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:14.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.704+0000 7f662555c640 1 --2- 172.21.15.84:0/2438828661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6620103190 0x7f6620199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:14.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.704+0000 7f662555c640 1 -- 172.21.15.84:0/2438828661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662019f390 con 0x7f6620108d50 2024-09-21T03:41:14.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.704+0000 7f662555c640 1 --2- 172.21.15.84:0/2438828661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6620108d50 0x7f662019ec60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f66180098d0 tx=0x7f66180317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:14.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.704+0000 7f661dffb640 1 -- 172.21.15.84:0/2438828661 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6618003b70 con 0x7f6620108d50 2024-09-21T03:41:14.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.704+0000 7f661dffb640 1 -- 172.21.15.84:0/2438828661 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6618003d10 con 0x7f6620108d50 2024-09-21T03:41:14.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.705+0000 7f6626fbf640 1 -- 172.21.15.84:0/2438828661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f662019f620 con 0x7f6620108d50 2024-09-21T03:41:14.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.705+0000 7f661dffb640 1 -- 172.21.15.84:0/2438828661 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661802fa20 con 0x7f6620108d50 2024-09-21T03:41:14.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.705+0000 7f6626fbf640 1 -- 172.21.15.84:0/2438828661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66201a5de0 con 0x7f6620108d50 2024-09-21T03:41:14.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.705+0000 7f6626fbf640 1 -- 172.21.15.84:0/2438828661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6620063b50 con 0x7f6620108d50 2024-09-21T03:41:14.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.707+0000 7f661dffb640 1 -- 172.21.15.84:0/2438828661 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f661802fbe0 con 0x7f6620108d50 2024-09-21T03:41:14.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.708+0000 7f661dffb640 1 --2- 172.21.15.84:0/2438828661 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f66100b65f0 0x7f66100b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:14.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.708+0000 7f6624d5b640 1 --2- 172.21.15.84:0/2438828661 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f66100b65f0 0x7f66100b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:14.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.708+0000 7f661dffb640 1 -- 172.21.15.84:0/2438828661 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f6618108c40 con 0x7f6620108d50 2024-09-21T03:41:14.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.708+0000 7f661dffb640 1 --2- 172.21.15.84:0/2438828661 >> [v2:172.21.15.174:6808/1987010600,v1:172.21.15.174:6809/1987010600] conn(0x7f66100c02e0 0x7f66100c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:14.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.708+0000 7f661dffb640 1 -- 172.21.15.84:0/2438828661 --> [v2:172.21.15.174:6808/1987010600,v1:172.21.15.174:6809/1987010600] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66100c2ea0 con 0x7f66100c02e0 2024-09-21T03:41:14.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.708+0000 7f661dffb640 1 -- 172.21.15.84:0/2438828661 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f6618109090 con 0x7f6620108d50 2024-09-21T03:41:14.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.709+0000 7f6624d5b640 1 --2- 172.21.15.84:0/2438828661 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f66100b65f0 0x7f66100b8b00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6614009bd0 tx=0x7f6614005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:14.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.709+0000 7f661ffff640 1 --2- 172.21.15.84:0/2438828661 >> [v2:172.21.15.174:6808/1987010600,v1:172.21.15.174:6809/1987010600] conn(0x7f66100c02e0 0x7f66100c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:14.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.709+0000 7f661ffff640 1 --2- 172.21.15.84:0/2438828661 >> [v2:172.21.15.174:6808/1987010600,v1:172.21.15.174:6809/1987010600] conn(0x7f66100c02e0 0x7f66100c27d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:14.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.710+0000 7f661dffb640 1 -- 172.21.15.84:0/2438828661 <== osd.5 v2:172.21.15.174:6808/1987010600 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f66100c2ea0 con 0x7f66100c02e0 2024-09-21T03:41:14.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.723+0000 7f6626fbf640 1 -- 172.21.15.84:0/2438828661 --> [v2:172.21.15.174:6808/1987010600,v1:172.21.15.174:6809/1987010600] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6620063f50 con 0x7f66100c02e0 2024-09-21T03:41:14.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.724+0000 7f661dffb640 1 -- 172.21.15.84:0/2438828661 <== osd.5 v2:172.21.15.174:6808/1987010600 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6620063f50 con 0x7f66100c02e0 2024-09-21T03:41:14.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.724+0000 7f6626fbf640 1 -- 172.21.15.84:0/2438828661 >> [v2:172.21.15.174:6808/1987010600,v1:172.21.15.174:6809/1987010600] conn(0x7f66100c02e0 msgr2=0x7f66100c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:14.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.724+0000 7f6626fbf640 1 --2- 172.21.15.84:0/2438828661 >> [v2:172.21.15.174:6808/1987010600,v1:172.21.15.174:6809/1987010600] conn(0x7f66100c02e0 0x7f66100c27d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:14.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.725+0000 7f6626fbf640 1 -- 172.21.15.84:0/2438828661 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f66100b65f0 msgr2=0x7f66100b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:14.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.725+0000 7f6626fbf640 1 --2- 172.21.15.84:0/2438828661 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f66100b65f0 0x7f66100b8b00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6614009bd0 tx=0x7f6614005f90 comp rx=0 tx=0).stop 2024-09-21T03:41:14.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.725+0000 7f6626fbf640 1 -- 172.21.15.84:0/2438828661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6620108d50 msgr2=0x7f662019ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:14.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.725+0000 7f6626fbf640 1 --2- 172.21.15.84:0/2438828661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6620108d50 0x7f662019ec60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f66180098d0 tx=0x7f66180317b0 comp rx=0 tx=0).stop 2024-09-21T03:41:14.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.725+0000 7f662555c640 1 -- 172.21.15.84:0/2438828661 reap_dead start 2024-09-21T03:41:14.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.725+0000 7f6626fbf640 1 -- 172.21.15.84:0/2438828661 shutdown_connections 2024-09-21T03:41:14.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.725+0000 7f6626fbf640 1 -- 172.21.15.84:0/2438828661 >> 172.21.15.84:0/2438828661 conn(0x7f6620079f90 msgr2=0x7f6620104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:14.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.725+0000 7f6626fbf640 1 -- 172.21.15.84:0/2438828661 shutdown_connections 2024-09-21T03:41:14.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:14.725+0000 7f6626fbf640 1 -- 172.21.15.84:0/2438828661 wait complete. 2024-09-21T03:41:15.167 INFO:teuthology.orchestra.run.smithi084.stdout:253403070497 2024-09-21T03:41:15.168 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T03:41:15.410 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:15 smithi084 ceph-mon[30941]: pgmap v287: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:41:15.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:15 smithi174 ceph-mon[34403]: pgmap v287: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:41:15.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:15 smithi172 ceph-mon[34821]: pgmap v287: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:41:16.060 INFO:teuthology.orchestra.run.smithi084.stdout:55834574920 2024-09-21T03:41:16.061 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T03:41:16.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.649+0000 7f2dbd50f640 1 -- 172.21.15.84:0/1543721058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2db81028e0 msgr2=0x7f2db8112570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:16.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.649+0000 7f2dbd50f640 1 --2- 172.21.15.84:0/1543721058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2db81028e0 0x7f2db8112570 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009900 tx=0x7f2db002a410 comp rx=0 tx=0).stop 2024-09-21T03:41:16.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.649+0000 7f2dbd50f640 1 -- 172.21.15.84:0/1543721058 shutdown_connections 2024-09-21T03:41:16.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.649+0000 7f2dbd50f640 1 --2- 172.21.15.84:0/1543721058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2db81028e0 0x7f2db8112570 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.649+0000 7f2dbd50f640 1 --2- 172.21.15.84:0/1543721058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2db8101dc0 0x7f2db81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.649+0000 7f2dbd50f640 1 --2- 172.21.15.84:0/1543721058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db81046b0 0x7f2db8104ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.649+0000 7f2dbd50f640 1 -- 172.21.15.84:0/1543721058 >> 172.21.15.84:0/1543721058 conn(0x7f2db8079f90 msgr2=0x7f2db807a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.649+0000 7f2dbd50f640 1 -- 172.21.15.84:0/1543721058 shutdown_connections 2024-09-21T03:41:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.649+0000 7f2dbd50f640 1 -- 172.21.15.84:0/1543721058 wait complete. 2024-09-21T03:41:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.649+0000 7f2dbd50f640 1 Processor -- start 2024-09-21T03:41:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.650+0000 7f2dbd50f640 1 -- start start 2024-09-21T03:41:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.650+0000 7f2dbd50f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2db8101dc0 0x7f2db819c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.650+0000 7f2dbd50f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2db81028e0 0x7f2db819cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.650+0000 7f2dbd50f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db81046b0 0x7f2db81a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.650+0000 7f2dbd50f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2db8115d00 con 0x7f2db81028e0 2024-09-21T03:41:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.650+0000 7f2dbd50f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2db8115b80 con 0x7f2db8101dc0 2024-09-21T03:41:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.650+0000 7f2dbd50f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2db8115e80 con 0x7f2db81046b0 2024-09-21T03:41:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.650+0000 7f2db67fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2db81028e0 0x7f2db819cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.650+0000 7f2db67fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2db81028e0 0x7f2db819cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54914/0 (socket says 172.21.15.84:54914) 2024-09-21T03:41:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.650+0000 7f2db67fc640 1 -- 172.21.15.84:0/2405418606 learned_addr learned my addr 172.21.15.84:0/2405418606 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:16.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.650+0000 7f2db6ffd640 1 --2- 172.21.15.84:0/2405418606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2db8101dc0 0x7f2db819c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.650+0000 7f2db77fe640 1 --2- 172.21.15.84:0/2405418606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db81046b0 0x7f2db81a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.650+0000 7f2db67fc640 1 -- 172.21.15.84:0/2405418606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db81046b0 msgr2=0x7f2db81a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.650+0000 7f2db67fc640 1 --2- 172.21.15.84:0/2405418606 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2db81046b0 0x7f2db81a1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.650+0000 7f2db67fc640 1 -- 172.21.15.84:0/2405418606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2db8101dc0 msgr2=0x7f2db819c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.650+0000 7f2db67fc640 1 --2- 172.21.15.84:0/2405418606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2db8101dc0 0x7f2db819c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.650+0000 7f2db67fc640 1 -- 172.21.15.84:0/2405418606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db81a2590 con 0x7f2db81028e0 2024-09-21T03:41:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.651+0000 7f2db67fc640 1 --2- 172.21.15.84:0/2405418606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2db81028e0 0x7f2db819cbc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2dac00e9f0 tx=0x7f2dac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.651+0000 7f2d9ffff640 1 -- 172.21.15.84:0/2405418606 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac00ccc0 con 0x7f2db81028e0 2024-09-21T03:41:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.651+0000 7f2dbd50f640 1 -- 172.21.15.84:0/2405418606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db81a2880 con 0x7f2db81028e0 2024-09-21T03:41:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.651+0000 7f2d9ffff640 1 -- 172.21.15.84:0/2405418606 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dac0108e0 con 0x7f2db81028e0 2024-09-21T03:41:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.651+0000 7f2d9ffff640 1 -- 172.21.15.84:0/2405418606 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac018860 con 0x7f2db81028e0 2024-09-21T03:41:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.651+0000 7f2dbd50f640 1 -- 172.21.15.84:0/2405418606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db81a8fe0 con 0x7f2db81028e0 2024-09-21T03:41:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.652+0000 7f2dbd50f640 1 -- 172.21.15.84:0/2405418606 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2db810cf20 con 0x7f2db81028e0 2024-09-21T03:41:16.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.653+0000 7f2d9ffff640 1 -- 172.21.15.84:0/2405418606 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f2dac010430 con 0x7f2db81028e0 2024-09-21T03:41:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.654+0000 7f2d9ffff640 1 --2- 172.21.15.84:0/2405418606 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2da00b65f0 0x7f2da00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.654+0000 7f2db6ffd640 1 --2- 172.21.15.84:0/2405418606 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2da00b65f0 0x7f2da00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.654+0000 7f2d9ffff640 1 -- 172.21.15.84:0/2405418606 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f2dac0e8040 con 0x7f2db81028e0 2024-09-21T03:41:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.654+0000 7f2d9ffff640 1 --2- 172.21.15.84:0/2405418606 >> [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863] conn(0x7f2da00c02e0 0x7f2da00c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.654+0000 7f2d9ffff640 1 -- 172.21.15.84:0/2405418606 --> [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2dac01ce70 con 0x7f2da00c02e0 2024-09-21T03:41:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.654+0000 7f2d9ffff640 1 -- 172.21.15.84:0/2405418606 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f2dac0e8520 con 0x7f2db81028e0 2024-09-21T03:41:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.654+0000 7f2db6ffd640 1 --2- 172.21.15.84:0/2405418606 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2da00b65f0 0x7f2da00b8b00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2da8005fd0 tx=0x7f2da8009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.654+0000 7f2db77fe640 1 --2- 172.21.15.84:0/2405418606 >> [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863] conn(0x7f2da00c02e0 0x7f2da00c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.655+0000 7f2db77fe640 1 --2- 172.21.15.84:0/2405418606 >> [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863] conn(0x7f2da00c02e0 0x7f2da00c27d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:16.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.655+0000 7f2d9ffff640 1 -- 172.21.15.84:0/2405418606 <== osd.3 v2:172.21.15.84:6810/2230529863 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2dac01ce70 con 0x7f2da00c02e0 2024-09-21T03:41:16.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.669+0000 7f2dbd50f640 1 -- 172.21.15.84:0/2405418606 --> [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2db8102d40 con 0x7f2da00c02e0 2024-09-21T03:41:16.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.669+0000 7f2d9ffff640 1 -- 172.21.15.84:0/2405418606 <== osd.3 v2:172.21.15.84:6810/2230529863 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2db8102d40 con 0x7f2da00c02e0 2024-09-21T03:41:16.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.669+0000 7f2dbd50f640 1 -- 172.21.15.84:0/2405418606 >> [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863] conn(0x7f2da00c02e0 msgr2=0x7f2da00c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:16.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.670+0000 7f2dbd50f640 1 --2- 172.21.15.84:0/2405418606 >> [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863] conn(0x7f2da00c02e0 0x7f2da00c27d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.670+0000 7f2dbd50f640 1 -- 172.21.15.84:0/2405418606 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2da00b65f0 msgr2=0x7f2da00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:16.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.670+0000 7f2dbd50f640 1 --2- 172.21.15.84:0/2405418606 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2da00b65f0 0x7f2da00b8b00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2da8005fd0 tx=0x7f2da8009500 comp rx=0 tx=0).stop 2024-09-21T03:41:16.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.670+0000 7f2dbd50f640 1 -- 172.21.15.84:0/2405418606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2db81028e0 msgr2=0x7f2db819cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:16.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.670+0000 7f2dbd50f640 1 --2- 172.21.15.84:0/2405418606 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2db81028e0 0x7f2db819cbc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2dac00e9f0 tx=0x7f2dac00eeb0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.670+0000 7f2db77fe640 1 -- 172.21.15.84:0/2405418606 reap_dead start 2024-09-21T03:41:16.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.670+0000 7f2dbd50f640 1 -- 172.21.15.84:0/2405418606 shutdown_connections 2024-09-21T03:41:16.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.670+0000 7f2dbd50f640 1 -- 172.21.15.84:0/2405418606 >> 172.21.15.84:0/2405418606 conn(0x7f2db8079f90 msgr2=0x7f2db810c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:16.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.670+0000 7f2dbd50f640 1 -- 172.21.15.84:0/2405418606 shutdown_connections 2024-09-21T03:41:16.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.670+0000 7f2dbd50f640 1 -- 172.21.15.84:0/2405418606 wait complete. 2024-09-21T03:41:17.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.364+0000 7fb49f7f7640 1 -- 172.21.15.84:0/2235856112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4981083e0 msgr2=0x7fb4981087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:17.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.364+0000 7fb49f7f7640 1 --2- 172.21.15.84:0/2235856112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4981083e0 0x7fb4981087f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb494009900 tx=0x7fb49402a410 comp rx=0 tx=0).stop 2024-09-21T03:41:17.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.364+0000 7fb49f7f7640 1 -- 172.21.15.84:0/2235856112 shutdown_connections 2024-09-21T03:41:17.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.364+0000 7fb49f7f7640 1 --2- 172.21.15.84:0/2235856112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb498108d30 0x7fb49810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.364+0000 7fb49f7f7640 1 --2- 172.21.15.84:0/2235856112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4981083e0 0x7fb4981087f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.364+0000 7fb49f7f7640 1 --2- 172.21.15.84:0/2235856112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb498102aa0 0x7fb498102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.364+0000 7fb49f7f7640 1 -- 172.21.15.84:0/2235856112 >> 172.21.15.84:0/2235856112 conn(0x7fb498079750 msgr2=0x7fb498079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:17.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.364+0000 7fb49f7f7640 1 -- 172.21.15.84:0/2235856112 shutdown_connections 2024-09-21T03:41:17.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.364+0000 7fb49f7f7640 1 -- 172.21.15.84:0/2235856112 wait complete. 2024-09-21T03:41:17.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.365+0000 7fb49f7f7640 1 Processor -- start 2024-09-21T03:41:17.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.365+0000 7fb49f7f7640 1 -- start start 2024-09-21T03:41:17.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.365+0000 7fb49f7f7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb498102aa0 0x7fb498199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.365+0000 7fb49f7f7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4981083e0 0x7fb4981999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.365+0000 7fb49f7f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb498108d30 0x7fb49819ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.365+0000 7fb49f7f7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb498112a30 con 0x7fb4981083e0 2024-09-21T03:41:17.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.365+0000 7fb49f7f7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb4981128b0 con 0x7fb498108d30 2024-09-21T03:41:17.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.365+0000 7fb49f7f7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb498112bb0 con 0x7fb498102aa0 2024-09-21T03:41:17.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.365+0000 7fb49cd92640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4981083e0 0x7fb4981999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.365+0000 7fb49cd92640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4981083e0 0x7fb4981999c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54892/0 (socket says 172.21.15.84:54892) 2024-09-21T03:41:17.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.365+0000 7fb49cd92640 1 -- 172.21.15.84:0/3484675187 learned_addr learned my addr 172.21.15.84:0/3484675187 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:17.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.365+0000 7fb49dd94640 1 --2- 172.21.15.84:0/3484675187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb498108d30 0x7fb49819ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.365+0000 7fb49d593640 1 --2- 172.21.15.84:0/3484675187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb498102aa0 0x7fb498199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.365+0000 7fb49cd92640 1 -- 172.21.15.84:0/3484675187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb498102aa0 msgr2=0x7fb498199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:17.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.365+0000 7fb49cd92640 1 --2- 172.21.15.84:0/3484675187 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb498102aa0 0x7fb498199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.365+0000 7fb49cd92640 1 -- 172.21.15.84:0/3484675187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb498108d30 msgr2=0x7fb49819ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:17.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.365+0000 7fb49cd92640 1 --2- 172.21.15.84:0/3484675187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb498108d30 0x7fb49819ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.365+0000 7fb49cd92640 1 -- 172.21.15.84:0/3484675187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb49819f390 con 0x7fb4981083e0 2024-09-21T03:41:17.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.365+0000 7fb49dd94640 1 --2- 172.21.15.84:0/3484675187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb498108d30 0x7fb49819ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:17.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.366+0000 7fb49cd92640 1 --2- 172.21.15.84:0/3484675187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4981083e0 0x7fb4981999c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb49402a930 tx=0x7fb494004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:17.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.366+0000 7fb48a7fc640 1 -- 172.21.15.84:0/3484675187 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb494046070 con 0x7fb4981083e0 2024-09-21T03:41:17.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.366+0000 7fb48a7fc640 1 -- 172.21.15.84:0/3484675187 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4940044a0 con 0x7fb4981083e0 2024-09-21T03:41:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.366+0000 7fb48a7fc640 1 -- 172.21.15.84:0/3484675187 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb494035050 con 0x7fb4981083e0 2024-09-21T03:41:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.366+0000 7fb49f7f7640 1 -- 172.21.15.84:0/3484675187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb49819f620 con 0x7fb4981083e0 2024-09-21T03:41:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.366+0000 7fb49f7f7640 1 -- 172.21.15.84:0/3484675187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb49806bb40 con 0x7fb4981083e0 2024-09-21T03:41:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.367+0000 7fb49f7f7640 1 -- 172.21.15.84:0/3484675187 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb49806c0b0 con 0x7fb4981083e0 2024-09-21T03:41:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.368+0000 7fb48a7fc640 1 -- 172.21.15.84:0/3484675187 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fb494049070 con 0x7fb4981083e0 2024-09-21T03:41:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.369+0000 7fb48a7fc640 1 --2- 172.21.15.84:0/3484675187 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb4840b6670 0x7fb4840b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.369+0000 7fb49d593640 1 --2- 172.21.15.84:0/3484675187 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb4840b6670 0x7fb4840b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.369+0000 7fb48a7fc640 1 -- 172.21.15.84:0/3484675187 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fb494109610 con 0x7fb4981083e0 2024-09-21T03:41:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.369+0000 7fb48a7fc640 1 --2- 172.21.15.84:0/3484675187 >> [v2:172.21.15.174:6800/1847612335,v1:172.21.15.174:6801/1847612335] conn(0x7fb4840c0360 0x7fb4840c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.369+0000 7fb48a7fc640 1 -- 172.21.15.84:0/3484675187 --> [v2:172.21.15.174:6800/1847612335,v1:172.21.15.174:6801/1847612335] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb49404be50 con 0x7fb4840c0360 2024-09-21T03:41:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.369+0000 7fb48a7fc640 1 -- 172.21.15.84:0/3484675187 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fb494109a60 con 0x7fb4981083e0 2024-09-21T03:41:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.370+0000 7fb49d593640 1 --2- 172.21.15.84:0/3484675187 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb4840b6670 0x7fb4840b8b80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb48c009890 tx=0x7fb48c008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.370+0000 7fb49dd94640 1 --2- 172.21.15.84:0/3484675187 >> [v2:172.21.15.174:6800/1847612335,v1:172.21.15.174:6801/1847612335] conn(0x7fb4840c0360 0x7fb4840c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.370+0000 7fb49dd94640 1 --2- 172.21.15.84:0/3484675187 >> [v2:172.21.15.174:6800/1847612335,v1:172.21.15.174:6801/1847612335] conn(0x7fb4840c0360 0x7fb4840c2850 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:17.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.371+0000 7fb48a7fc640 1 -- 172.21.15.84:0/3484675187 <== osd.2 v2:172.21.15.174:6800/1847612335 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb49404be50 con 0x7fb4840c0360 2024-09-21T03:41:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.385+0000 7fb49f7f7640 1 -- 172.21.15.84:0/3484675187 --> [v2:172.21.15.174:6800/1847612335,v1:172.21.15.174:6801/1847612335] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb49806c4b0 con 0x7fb4840c0360 2024-09-21T03:41:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.385+0000 7fb48a7fc640 1 -- 172.21.15.84:0/3484675187 <== osd.2 v2:172.21.15.174:6800/1847612335 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb49806c4b0 con 0x7fb4840c0360 2024-09-21T03:41:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.386+0000 7fb49f7f7640 1 -- 172.21.15.84:0/3484675187 >> [v2:172.21.15.174:6800/1847612335,v1:172.21.15.174:6801/1847612335] conn(0x7fb4840c0360 msgr2=0x7fb4840c2850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.386+0000 7fb49f7f7640 1 --2- 172.21.15.84:0/3484675187 >> [v2:172.21.15.174:6800/1847612335,v1:172.21.15.174:6801/1847612335] conn(0x7fb4840c0360 0x7fb4840c2850 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.386+0000 7fb49f7f7640 1 -- 172.21.15.84:0/3484675187 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb4840b6670 msgr2=0x7fb4840b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.386+0000 7fb49f7f7640 1 --2- 172.21.15.84:0/3484675187 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb4840b6670 0x7fb4840b8b80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb48c009890 tx=0x7fb48c008040 comp rx=0 tx=0).stop 2024-09-21T03:41:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.386+0000 7fb49f7f7640 1 -- 172.21.15.84:0/3484675187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4981083e0 msgr2=0x7fb4981999c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.386+0000 7fb49f7f7640 1 --2- 172.21.15.84:0/3484675187 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb4981083e0 0x7fb4981999c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb49402a930 tx=0x7fb494004270 comp rx=0 tx=0).stop 2024-09-21T03:41:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.386+0000 7fb49dd94640 1 -- 172.21.15.84:0/3484675187 reap_dead start 2024-09-21T03:41:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.386+0000 7fb49f7f7640 1 -- 172.21.15.84:0/3484675187 shutdown_connections 2024-09-21T03:41:17.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.386+0000 7fb49f7f7640 1 -- 172.21.15.84:0/3484675187 >> 172.21.15.84:0/3484675187 conn(0x7fb498079750 msgr2=0x7fb498106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:17.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.386+0000 7fb49f7f7640 1 -- 172.21.15.84:0/3484675187 shutdown_connections 2024-09-21T03:41:17.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:16.386+0000 7fb49f7f7640 1 -- 172.21.15.84:0/3484675187 wait complete. 2024-09-21T03:41:17.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:17 smithi174 ceph-mon[34403]: pgmap v288: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:41:17.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:17 smithi172 ceph-mon[34821]: pgmap v288: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:41:17.662 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:17 smithi084 ceph-mon[30941]: pgmap v288: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:41:18.001 INFO:teuthology.orchestra.run.smithi084.stdout:133143986234 2024-09-21T03:41:18.002 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T03:41:18.465 INFO:teuthology.orchestra.run.smithi084.stdout:107374182462 2024-09-21T03:41:18.466 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T03:41:18.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.880+0000 7f1e6245a640 1 -- 172.21.15.84:0/3573493176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e5c1094a0 msgr2=0x7f1e5c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:18.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.880+0000 7f1e6245a640 1 --2- 172.21.15.84:0/3573493176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e5c1094a0 0x7f1e5c1098b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009900 tx=0x7f1e5002a410 comp rx=0 tx=0).stop 2024-09-21T03:41:18.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.880+0000 7f1e6245a640 1 -- 172.21.15.84:0/3573493176 shutdown_connections 2024-09-21T03:41:18.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.880+0000 7f1e6245a640 1 --2- 172.21.15.84:0/3573493176 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e5c109df0 0x7f1e5c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:18.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.880+0000 7f1e6245a640 1 --2- 172.21.15.84:0/3573493176 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e5c1094a0 0x7f1e5c1098b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.880+0000 7f1e6245a640 1 --2- 172.21.15.84:0/3573493176 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e5c103b60 0x7f1e5c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.880+0000 7f1e6245a640 1 -- 172.21.15.84:0/3573493176 >> 172.21.15.84:0/3573493176 conn(0x7f1e5c07b850 msgr2=0x7f1e5c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.880+0000 7f1e6245a640 1 -- 172.21.15.84:0/3573493176 shutdown_connections 2024-09-21T03:41:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.880+0000 7f1e6245a640 1 -- 172.21.15.84:0/3573493176 wait complete. 2024-09-21T03:41:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.881+0000 7f1e6245a640 1 Processor -- start 2024-09-21T03:41:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.881+0000 7f1e6245a640 1 -- start start 2024-09-21T03:41:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.881+0000 7f1e6245a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e5c103b60 0x7f1e5c19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.881+0000 7f1e6245a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e5c1094a0 0x7f1e5c19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.881+0000 7f1e6245a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e5c109df0 0x7f1e5c19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.881+0000 7f1e6245a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c113ab0 con 0x7f1e5c1094a0 2024-09-21T03:41:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.881+0000 7f1e6245a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c113930 con 0x7f1e5c103b60 2024-09-21T03:41:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.881+0000 7f1e6245a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c113c30 con 0x7f1e5c109df0 2024-09-21T03:41:18.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.881+0000 7f1e5b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e5c1094a0 0x7f1e5c19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.881+0000 7f1e5b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e5c1094a0 0x7f1e5c19ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39684/0 (socket says 172.21.15.84:39684) 2024-09-21T03:41:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.881+0000 7f1e5b7fe640 1 -- 172.21.15.84:0/1172458895 learned_addr learned my addr 172.21.15.84:0/1172458895 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.881+0000 7f1e5bfff640 1 --2- 172.21.15.84:0/1172458895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e5c103b60 0x7f1e5c19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.881+0000 7f1e609f7640 1 --2- 172.21.15.84:0/1172458895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e5c109df0 0x7f1e5c19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.882+0000 7f1e5b7fe640 1 -- 172.21.15.84:0/1172458895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e5c109df0 msgr2=0x7f1e5c19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.882+0000 7f1e5b7fe640 1 --2- 172.21.15.84:0/1172458895 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e5c109df0 0x7f1e5c19fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.882+0000 7f1e5b7fe640 1 -- 172.21.15.84:0/1172458895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e5c103b60 msgr2=0x7f1e5c19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.882+0000 7f1e5b7fe640 1 --2- 172.21.15.84:0/1172458895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e5c103b60 0x7f1e5c19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:18.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.882+0000 7f1e5b7fe640 1 -- 172.21.15.84:0/1172458895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e5c1a04d0 con 0x7f1e5c1094a0 2024-09-21T03:41:18.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.882+0000 7f1e5b7fe640 1 --2- 172.21.15.84:0/1172458895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e5c1094a0 0x7f1e5c19ab00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1e50006010 tx=0x7f1e50004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:18.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.882+0000 7f1e597fa640 1 -- 172.21.15.84:0/1172458895 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5003f030 con 0x7f1e5c1094a0 2024-09-21T03:41:18.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.882+0000 7f1e6245a640 1 -- 172.21.15.84:0/1172458895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e5c1a0760 con 0x7f1e5c1094a0 2024-09-21T03:41:18.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.882+0000 7f1e597fa640 1 -- 172.21.15.84:0/1172458895 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e50003aa0 con 0x7f1e5c1094a0 2024-09-21T03:41:18.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.882+0000 7f1e597fa640 1 -- 172.21.15.84:0/1172458895 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e50035070 con 0x7f1e5c1094a0 2024-09-21T03:41:18.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.882+0000 7f1e6245a640 1 -- 172.21.15.84:0/1172458895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e5c1a6f20 con 0x7f1e5c1094a0 2024-09-21T03:41:18.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.883+0000 7f1e6245a640 1 -- 172.21.15.84:0/1172458895 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1e5c063b50 con 0x7f1e5c1094a0 2024-09-21T03:41:18.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.884+0000 7f1e597fa640 1 -- 172.21.15.84:0/1172458895 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f1e50042030 con 0x7f1e5c1094a0 2024-09-21T03:41:18.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.885+0000 7f1e597fa640 1 --2- 172.21.15.84:0/1172458895 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1e440b65f0 0x7f1e440b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:18.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.885+0000 7f1e5bfff640 1 --2- 172.21.15.84:0/1172458895 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1e440b65f0 0x7f1e440b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:18.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.885+0000 7f1e597fa640 1 -- 172.21.15.84:0/1172458895 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f1e50107f30 con 0x7f1e5c1094a0 2024-09-21T03:41:18.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.885+0000 7f1e597fa640 1 --2- 172.21.15.84:0/1172458895 >> [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562] conn(0x7f1e440c02e0 0x7f1e440c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:18.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.885+0000 7f1e597fa640 1 -- 172.21.15.84:0/1172458895 --> [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1e50009080 con 0x7f1e440c02e0 2024-09-21T03:41:18.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.885+0000 7f1e597fa640 1 -- 172.21.15.84:0/1172458895 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f1e50108380 con 0x7f1e5c1094a0 2024-09-21T03:41:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.886+0000 7f1e609f7640 1 --2- 172.21.15.84:0/1172458895 >> [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562] conn(0x7f1e440c02e0 0x7f1e440c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.886+0000 7f1e5bfff640 1 --2- 172.21.15.84:0/1172458895 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1e440b65f0 0x7f1e440b8b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00bbe0 tx=0x7f1e4c00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.886+0000 7f1e609f7640 1 --2- 172.21.15.84:0/1172458895 >> [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562] conn(0x7f1e440c02e0 0x7f1e440c27d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.887+0000 7f1e597fa640 1 -- 172.21.15.84:0/1172458895 <== osd.0 v2:172.21.15.84:6802/508132562 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1e50009080 con 0x7f1e440c02e0 2024-09-21T03:41:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.900+0000 7f1e6245a640 1 -- 172.21.15.84:0/1172458895 --> [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1e5c063f80 con 0x7f1e440c02e0 2024-09-21T03:41:18.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.900+0000 7f1e597fa640 1 -- 172.21.15.84:0/1172458895 <== osd.0 v2:172.21.15.84:6802/508132562 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1e5c063f80 con 0x7f1e440c02e0 2024-09-21T03:41:18.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.901+0000 7f1e6245a640 1 -- 172.21.15.84:0/1172458895 >> [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562] conn(0x7f1e440c02e0 msgr2=0x7f1e440c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:18.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.901+0000 7f1e6245a640 1 --2- 172.21.15.84:0/1172458895 >> [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562] conn(0x7f1e440c02e0 0x7f1e440c27d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:18.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.901+0000 7f1e6245a640 1 -- 172.21.15.84:0/1172458895 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1e440b65f0 msgr2=0x7f1e440b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:18.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.901+0000 7f1e6245a640 1 --2- 172.21.15.84:0/1172458895 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1e440b65f0 0x7f1e440b8b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00bbe0 tx=0x7f1e4c00b390 comp rx=0 tx=0).stop 2024-09-21T03:41:18.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.901+0000 7f1e6245a640 1 -- 172.21.15.84:0/1172458895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e5c1094a0 msgr2=0x7f1e5c19ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:18.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.901+0000 7f1e6245a640 1 --2- 172.21.15.84:0/1172458895 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e5c1094a0 0x7f1e5c19ab00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1e50006010 tx=0x7f1e50004060 comp rx=0 tx=0).stop 2024-09-21T03:41:18.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.901+0000 7f1e609f7640 1 -- 172.21.15.84:0/1172458895 reap_dead start 2024-09-21T03:41:18.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.901+0000 7f1e6245a640 1 -- 172.21.15.84:0/1172458895 shutdown_connections 2024-09-21T03:41:18.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.901+0000 7f1e6245a640 1 -- 172.21.15.84:0/1172458895 >> 172.21.15.84:0/1172458895 conn(0x7f1e5c07b850 msgr2=0x7f1e5c105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:18.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.901+0000 7f1e6245a640 1 -- 172.21.15.84:0/1172458895 shutdown_connections 2024-09-21T03:41:18.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:18.901+0000 7f1e6245a640 1 -- 172.21.15.84:0/1172458895 wait complete. 2024-09-21T03:41:19.574 INFO:teuthology.orchestra.run.smithi084.stdout:184683593775 2024-09-21T03:41:19.574 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T03:41:19.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:19 smithi174 ceph-mon[34403]: pgmap v289: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:41:19.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:19 smithi172 ceph-mon[34821]: pgmap v289: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:41:19.687 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:19 smithi084 ceph-mon[30941]: pgmap v289: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:41:19.981 INFO:teuthology.orchestra.run.smithi084.stdout:38654705743 2024-09-21T03:41:19.981 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T03:41:20.463 INFO:teuthology.orchestra.run.smithi084.stdout:77309411397 2024-09-21T03:41:20.463 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T03:41:20.879 INFO:teuthology.orchestra.run.smithi084.stdout:158913790005 2024-09-21T03:41:20.880 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T03:41:21.334 INFO:teuthology.orchestra.run.smithi084.stdout:227633266724 2024-09-21T03:41:21.334 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T03:41:21.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:21 smithi084 ceph-mon[30941]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:41:21.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:21 smithi174 ceph-mon[34403]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:41:21.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:21 smithi172 ceph-mon[34821]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:41:21.790 INFO:teuthology.orchestra.run.smithi084.stdout:206158430250 2024-09-21T03:41:21.790 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T03:41:21.792 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:21.792 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:22.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.687+0000 7f71d9ec6640 1 -- 172.21.15.84:0/2488279389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71d4103b60 msgr2=0x7f71d4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.687+0000 7f71d9ec6640 1 --2- 172.21.15.84:0/2488279389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71d4103b60 0x7f71d4103f70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f71c4009900 tx=0x7f71c402a410 comp rx=0 tx=0).stop 2024-09-21T03:41:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.687+0000 7f71d9ec6640 1 -- 172.21.15.84:0/2488279389 shutdown_connections 2024-09-21T03:41:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.687+0000 7f71d9ec6640 1 --2- 172.21.15.84:0/2488279389 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71d4109df0 0x7f71d4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.687+0000 7f71d9ec6640 1 --2- 172.21.15.84:0/2488279389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d41094a0 0x7f71d41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.687+0000 7f71d9ec6640 1 --2- 172.21.15.84:0/2488279389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71d4103b60 0x7f71d4103f70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.687+0000 7f71d9ec6640 1 -- 172.21.15.84:0/2488279389 >> 172.21.15.84:0/2488279389 conn(0x7f71d407b850 msgr2=0x7f71d407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.687+0000 7f71d9ec6640 1 -- 172.21.15.84:0/2488279389 shutdown_connections 2024-09-21T03:41:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.687+0000 7f71d9ec6640 1 -- 172.21.15.84:0/2488279389 wait complete. 2024-09-21T03:41:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.688+0000 7f71d9ec6640 1 Processor -- start 2024-09-21T03:41:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.688+0000 7f71d9ec6640 1 -- start start 2024-09-21T03:41:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.688+0000 7f71d9ec6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71d4103b60 0x7f71d419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d9ec6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71d41094a0 0x7f71d419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d9ec6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d4109df0 0x7f71d419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d9ec6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f71d4113ab0 con 0x7f71d4103b60 2024-09-21T03:41:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d9ec6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f71d4113930 con 0x7f71d4109df0 2024-09-21T03:41:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d9ec6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f71d4113c30 con 0x7f71d41094a0 2024-09-21T03:41:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71d4103b60 0x7f71d419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71d4103b60 0x7f71d419a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39710/0 (socket says 172.21.15.84:39710) 2024-09-21T03:41:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d37fe640 1 -- 172.21.15.84:0/220172030 learned_addr learned my addr 172.21.15.84:0/220172030 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d2ffd640 1 --2- 172.21.15.84:0/220172030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71d41094a0 0x7f71d419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d3fff640 1 --2- 172.21.15.84:0/220172030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d4109df0 0x7f71d419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d37fe640 1 -- 172.21.15.84:0/220172030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71d41094a0 msgr2=0x7f71d419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d37fe640 1 --2- 172.21.15.84:0/220172030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71d41094a0 0x7f71d419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d37fe640 1 -- 172.21.15.84:0/220172030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d4109df0 msgr2=0x7f71d419fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d37fe640 1 --2- 172.21.15.84:0/220172030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d4109df0 0x7f71d419fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d37fe640 1 -- 172.21.15.84:0/220172030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d41a03d0 con 0x7f71d4103b60 2024-09-21T03:41:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d37fe640 1 --2- 172.21.15.84:0/220172030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71d4103b60 0x7f71d419a460 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f71c4005940 tx=0x7f71c40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d0ff9640 1 -- 172.21.15.84:0/220172030 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c403f030 con 0x7f71d4103b60 2024-09-21T03:41:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d9ec6640 1 -- 172.21.15.84:0/220172030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d41a0660 con 0x7f71d4103b60 2024-09-21T03:41:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d0ff9640 1 -- 172.21.15.84:0/220172030 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71c4003cb0 con 0x7f71d4103b60 2024-09-21T03:41:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d0ff9640 1 -- 172.21.15.84:0/220172030 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c4035070 con 0x7f71d4103b60 2024-09-21T03:41:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.689+0000 7f71d9ec6640 1 -- 172.21.15.84:0/220172030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d41a6e20 con 0x7f71d4103b60 2024-09-21T03:41:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.690+0000 7f71d9ec6640 1 -- 172.21.15.84:0/220172030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71d4103f70 con 0x7f71d4103b60 2024-09-21T03:41:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.692+0000 7f71d0ff9640 1 -- 172.21.15.84:0/220172030 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f71c4042030 con 0x7f71d4103b60 2024-09-21T03:41:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.693+0000 7f71d0ff9640 1 --2- 172.21.15.84:0/220172030 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f71bc0b65f0 0x7f71bc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.693+0000 7f71d2ffd640 1 --2- 172.21.15.84:0/220172030 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f71bc0b65f0 0x7f71bc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.693+0000 7f71d0ff9640 1 -- 172.21.15.84:0/220172030 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f71c41080b0 con 0x7f71d4103b60 2024-09-21T03:41:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.693+0000 7f71d2ffd640 1 --2- 172.21.15.84:0/220172030 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f71bc0b65f0 0x7f71bc0b8b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f71d41064c0 tx=0x7f71c800b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:22.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.696+0000 7f71d0ff9640 1 -- 172.21.15.84:0/220172030 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71c40ce740 con 0x7f71d4103b60 2024-09-21T03:41:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.880+0000 7f71d9ec6640 1 -- 172.21.15.84:0/220172030 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f71d419b590 con 0x7f71d4103b60 2024-09-21T03:41:22.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.881+0000 7f71d0ff9640 1 -- 172.21.15.84:0/220172030 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f71d419b590 con 0x7f71d4103b60 2024-09-21T03:41:22.883 INFO:teuthology.orchestra.run.smithi084.stdout:296352743448 2024-09-21T03:41:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.884+0000 7f71d9ec6640 1 -- 172.21.15.84:0/220172030 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f71bc0b65f0 msgr2=0x7f71bc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.884+0000 7f71d9ec6640 1 --2- 172.21.15.84:0/220172030 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f71bc0b65f0 0x7f71bc0b8b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f71d41064c0 tx=0x7f71c800b390 comp rx=0 tx=0).stop 2024-09-21T03:41:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.884+0000 7f71d9ec6640 1 -- 172.21.15.84:0/220172030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71d4103b60 msgr2=0x7f71d419a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.884+0000 7f71d9ec6640 1 --2- 172.21.15.84:0/220172030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71d4103b60 0x7f71d419a460 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f71c4005940 tx=0x7f71c40042f0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.884+0000 7f71d9ec6640 1 -- 172.21.15.84:0/220172030 shutdown_connections 2024-09-21T03:41:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.884+0000 7f71d9ec6640 1 --2- 172.21.15.84:0/220172030 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f71bc0b65f0 0x7f71bc0b8b00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.884+0000 7f71d9ec6640 1 --2- 172.21.15.84:0/220172030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71d4109df0 0x7f71d419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.884+0000 7f71d9ec6640 1 --2- 172.21.15.84:0/220172030 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f71d41094a0 0x7f71d419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.884+0000 7f71d9ec6640 1 --2- 172.21.15.84:0/220172030 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f71d4103b60 0x7f71d419a460 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.884+0000 7f71d9ec6640 1 -- 172.21.15.84:0/220172030 >> 172.21.15.84:0/220172030 conn(0x7f71d407b850 msgr2=0x7f71d4107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.884+0000 7f71d9ec6640 1 -- 172.21.15.84:0/220172030 shutdown_connections 2024-09-21T03:41:22.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.884+0000 7f71d9ec6640 1 -- 172.21.15.84:0/220172030 wait complete. 2024-09-21T03:41:22.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.908+0000 7f110e0af640 1 -- 172.21.15.84:0/1947347901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1108102a80 msgr2=0x7f1108102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:22.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.908+0000 7f110e0af640 1 --2- 172.21.15.84:0/1947347901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1108102a80 0x7f1108102e90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009900 tx=0x7f10f802a410 comp rx=0 tx=0).stop 2024-09-21T03:41:22.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.908+0000 7f110e0af640 1 -- 172.21.15.84:0/1947347901 shutdown_connections 2024-09-21T03:41:22.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.908+0000 7f110e0af640 1 --2- 172.21.15.84:0/1947347901 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1108108d10 0x7f110810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.908+0000 7f110e0af640 1 --2- 172.21.15.84:0/1947347901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11081083c0 0x7f11081087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.908+0000 7f110e0af640 1 --2- 172.21.15.84:0/1947347901 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1108102a80 0x7f1108102e90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.908+0000 7f110e0af640 1 -- 172.21.15.84:0/1947347901 >> 172.21.15.84:0/1947347901 conn(0x7f1108079740 msgr2=0x7f1108079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:22.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.908+0000 7f110e0af640 1 -- 172.21.15.84:0/1947347901 shutdown_connections 2024-09-21T03:41:22.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.908+0000 7f110e0af640 1 -- 172.21.15.84:0/1947347901 wait complete. 2024-09-21T03:41:22.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.909+0000 7f110e0af640 1 Processor -- start 2024-09-21T03:41:22.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.909+0000 7f110e0af640 1 -- start start 2024-09-21T03:41:22.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.910+0000 7f110e0af640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1108102a80 0x7f1108198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.910+0000 7f110e0af640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11081083c0 0x7f11081987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.910+0000 7f110e0af640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1108108d10 0x7f110819da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.910+0000 7f110e0af640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f11081118c0 con 0x7f1108108d10 2024-09-21T03:41:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.910+0000 7f110e0af640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1108111740 con 0x7f1108102a80 2024-09-21T03:41:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.910+0000 7f110e0af640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1108111a40 con 0x7f11081083c0 2024-09-21T03:41:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.910+0000 7f1107fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1108108d10 0x7f110819da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.910+0000 7f1107fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1108108d10 0x7f110819da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39726/0 (socket says 172.21.15.84:39726) 2024-09-21T03:41:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.910+0000 7f1107fff640 1 -- 172.21.15.84:0/4019422412 learned_addr learned my addr 172.21.15.84:0/4019422412 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.910+0000 7f1106ffd640 1 --2- 172.21.15.84:0/4019422412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11081083c0 0x7f11081987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.910+0000 7f11077fe640 1 --2- 172.21.15.84:0/4019422412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1108102a80 0x7f1108198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.910+0000 7f1107fff640 1 -- 172.21.15.84:0/4019422412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11081083c0 msgr2=0x7f11081987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.910+0000 7f1107fff640 1 --2- 172.21.15.84:0/4019422412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11081083c0 0x7f11081987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.910+0000 7f1107fff640 1 -- 172.21.15.84:0/4019422412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1108102a80 msgr2=0x7f1108198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.910+0000 7f1107fff640 1 --2- 172.21.15.84:0/4019422412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1108102a80 0x7f1108198210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.910+0000 7f1107fff640 1 -- 172.21.15.84:0/4019422412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f110819e180 con 0x7f1108108d10 2024-09-21T03:41:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.910+0000 7f1107fff640 1 --2- 172.21.15.84:0/4019422412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1108108d10 0x7f110819da50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f110000eb10 tx=0x7f110000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.910+0000 7f1104ff9640 1 -- 172.21.15.84:0/4019422412 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100004b20 con 0x7f1108108d10 2024-09-21T03:41:22.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.911+0000 7f110e0af640 1 -- 172.21.15.84:0/4019422412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f110819e470 con 0x7f1108108d10 2024-09-21T03:41:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.911+0000 7f1104ff9640 1 -- 172.21.15.84:0/4019422412 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1100004cc0 con 0x7f1108108d10 2024-09-21T03:41:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.911+0000 7f1104ff9640 1 -- 172.21.15.84:0/4019422412 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100010670 con 0x7f1108108d10 2024-09-21T03:41:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.911+0000 7f110e0af640 1 -- 172.21.15.84:0/4019422412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11081a4bd0 con 0x7f1108108d10 2024-09-21T03:41:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.912+0000 7f110e0af640 1 -- 172.21.15.84:0/4019422412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1108102e90 con 0x7f1108108d10 2024-09-21T03:41:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.915+0000 7f1104ff9640 1 -- 172.21.15.84:0/4019422412 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f1100005000 con 0x7f1108108d10 2024-09-21T03:41:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.915+0000 7f1104ff9640 1 --2- 172.21.15.84:0/4019422412 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f10f00b6670 0x7f10f00b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.915+0000 7f1104ff9640 1 -- 172.21.15.84:0/4019422412 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f11000e7cd0 con 0x7f1108108d10 2024-09-21T03:41:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.915+0000 7f11077fe640 1 --2- 172.21.15.84:0/4019422412 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f10f00b6670 0x7f10f00b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.916+0000 7f11077fe640 1 --2- 172.21.15.84:0/4019422412 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f10f00b6670 0x7f10f00b8b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f10f8005ab0 tx=0x7f10f8005a20 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:22.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:22.919+0000 7f1104ff9640 1 -- 172.21.15.84:0/4019422412 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1100056710 con 0x7f1108108d10 2024-09-21T03:41:22.955 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:22.955 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:22.961 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:22.968 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:22.968 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:22.981 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:23.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:23.166+0000 7f110e0af640 1 -- 172.21.15.84:0/4019422412 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f110810a550 con 0x7f1108108d10 2024-09-21T03:41:23.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:23.166+0000 7f1104ff9640 1 -- 172.21.15.84:0/4019422412 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f11000ae360 con 0x7f1108108d10 2024-09-21T03:41:23.168 INFO:teuthology.orchestra.run.smithi084.stdout:274877906972 2024-09-21T03:41:23.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:23.168+0000 7f110e0af640 1 -- 172.21.15.84:0/4019422412 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f10f00b6670 msgr2=0x7f10f00b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:23.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:23.168+0000 7f110e0af640 1 --2- 172.21.15.84:0/4019422412 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f10f00b6670 0x7f10f00b8b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f10f8005ab0 tx=0x7f10f8005a20 comp rx=0 tx=0).stop 2024-09-21T03:41:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:23.168+0000 7f110e0af640 1 -- 172.21.15.84:0/4019422412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1108108d10 msgr2=0x7f110819da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:23.168+0000 7f110e0af640 1 --2- 172.21.15.84:0/4019422412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1108108d10 0x7f110819da50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f110000eb10 tx=0x7f110000c2d0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:23.168+0000 7f110e0af640 1 -- 172.21.15.84:0/4019422412 shutdown_connections 2024-09-21T03:41:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:23.168+0000 7f110e0af640 1 --2- 172.21.15.84:0/4019422412 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f10f00b6670 0x7f10f00b8b80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:23.168+0000 7f110e0af640 1 --2- 172.21.15.84:0/4019422412 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1108108d10 0x7f110819da50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:23.168+0000 7f110e0af640 1 --2- 172.21.15.84:0/4019422412 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11081083c0 0x7f11081987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:23.168+0000 7f110e0af640 1 --2- 172.21.15.84:0/4019422412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1108102a80 0x7f1108198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:23.168+0000 7f110e0af640 1 -- 172.21.15.84:0/4019422412 >> 172.21.15.84:0/4019422412 conn(0x7f1108079740 msgr2=0x7f1108101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:23.169+0000 7f110e0af640 1 -- 172.21.15.84:0/4019422412 shutdown_connections 2024-09-21T03:41:23.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:23.169+0000 7f110e0af640 1 -- 172.21.15.84:0/4019422412 wait complete. 2024-09-21T03:41:23.532 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:23 smithi084 ceph-mon[30941]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:41:23.533 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:23 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/220172030' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T03:41:23.533 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:23 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/4019422412' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T03:41:23.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:23 smithi174 ceph-mon[34403]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:41:23.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:23 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/220172030' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T03:41:23.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:23 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/4019422412' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T03:41:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:23 smithi172 ceph-mon[34821]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:41:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:23 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/220172030' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T03:41:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:23 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/4019422412' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T03:41:23.869 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743446 got 296352743448 for osd.11 2024-09-21T03:41:23.870 DEBUG:teuthology.parallel:result is None 2024-09-21T03:41:24.093 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:24.094 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:25.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.124+0000 7fdcd848d640 1 -- 172.21.15.84:0/2423998925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd0109df0 msgr2=0x7fdcd0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:25.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.124+0000 7fdcd848d640 1 --2- 172.21.15.84:0/2423998925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd0109df0 0x7fdcd0110620 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8009900 tx=0x7fdcc802a410 comp rx=0 tx=0).stop 2024-09-21T03:41:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.124+0000 7fdcd848d640 1 -- 172.21.15.84:0/2423998925 shutdown_connections 2024-09-21T03:41:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.124+0000 7fdcd848d640 1 --2- 172.21.15.84:0/2423998925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd0109df0 0x7fdcd0110620 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.124+0000 7fdcd848d640 1 --2- 172.21.15.84:0/2423998925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcd01094a0 0x7fdcd01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.124+0000 7fdcd848d640 1 --2- 172.21.15.84:0/2423998925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcd0103b60 0x7fdcd0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.124+0000 7fdcd848d640 1 -- 172.21.15.84:0/2423998925 >> 172.21.15.84:0/2423998925 conn(0x7fdcd007b850 msgr2=0x7fdcd007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.124+0000 7fdcd848d640 1 -- 172.21.15.84:0/2423998925 shutdown_connections 2024-09-21T03:41:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.124+0000 7fdcd848d640 1 -- 172.21.15.84:0/2423998925 wait complete. 2024-09-21T03:41:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.124+0000 7fdcd848d640 1 Processor -- start 2024-09-21T03:41:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.124+0000 7fdcd848d640 1 -- start start 2024-09-21T03:41:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.125+0000 7fdcd848d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd0103b60 0x7fdcd019c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.125+0000 7fdcd848d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcd01094a0 0x7fdcd019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.125+0000 7fdcd848d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcd0109df0 0x7fdcd01a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:25.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.125+0000 7fdcd848d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd0113ab0 con 0x7fdcd0103b60 2024-09-21T03:41:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.125+0000 7fdcd848d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd0113930 con 0x7fdcd0109df0 2024-09-21T03:41:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.125+0000 7fdcd848d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd0113c30 con 0x7fdcd01094a0 2024-09-21T03:41:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.125+0000 7fdcd6229640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd0103b60 0x7fdcd019c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.125+0000 7fdcd6229640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd0103b60 0x7fdcd019c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39746/0 (socket says 172.21.15.84:39746) 2024-09-21T03:41:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.125+0000 7fdcd6229640 1 -- 172.21.15.84:0/3035211812 learned_addr learned my addr 172.21.15.84:0/3035211812 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.125+0000 7fdcd6a2a640 1 --2- 172.21.15.84:0/3035211812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcd0109df0 0x7fdcd01a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.125+0000 7fdcd5a28640 1 --2- 172.21.15.84:0/3035211812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcd01094a0 0x7fdcd019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.125+0000 7fdcd6229640 1 -- 172.21.15.84:0/3035211812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcd01094a0 msgr2=0x7fdcd019cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.125+0000 7fdcd6229640 1 --2- 172.21.15.84:0/3035211812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcd01094a0 0x7fdcd019cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.125+0000 7fdcd6229640 1 -- 172.21.15.84:0/3035211812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcd0109df0 msgr2=0x7fdcd01a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.125+0000 7fdcd6229640 1 --2- 172.21.15.84:0/3035211812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcd0109df0 0x7fdcd01a1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.125+0000 7fdcd6229640 1 -- 172.21.15.84:0/3035211812 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd01a24d0 con 0x7fdcd0103b60 2024-09-21T03:41:25.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.125+0000 7fdcd6a2a640 1 --2- 172.21.15.84:0/3035211812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcd0109df0 0x7fdcd01a1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:25.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.125+0000 7fdcd6229640 1 --2- 172.21.15.84:0/3035211812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd0103b60 0x7fdcd019c620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000eab0 tx=0x7fdcc000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:25.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.125+0000 7fdccf7fe640 1 -- 172.21.15.84:0/3035211812 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc000ce40 con 0x7fdcd0103b60 2024-09-21T03:41:25.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.126+0000 7fdccf7fe640 1 -- 172.21.15.84:0/3035211812 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcc0011920 con 0x7fdcd0103b60 2024-09-21T03:41:25.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.126+0000 7fdcd848d640 1 -- 172.21.15.84:0/3035211812 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcd01a27c0 con 0x7fdcd0103b60 2024-09-21T03:41:25.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.126+0000 7fdccf7fe640 1 -- 172.21.15.84:0/3035211812 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0010a30 con 0x7fdcd0103b60 2024-09-21T03:41:25.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.126+0000 7fdcd848d640 1 -- 172.21.15.84:0/3035211812 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcd01a8fe0 con 0x7fdcd0103b60 2024-09-21T03:41:25.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.127+0000 7fdcd848d640 1 -- 172.21.15.84:0/3035211812 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcd0103f70 con 0x7fdcd0103b60 2024-09-21T03:41:25.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.128+0000 7fdccf7fe640 1 -- 172.21.15.84:0/3035211812 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fdcc0010bd0 con 0x7fdcd0103b60 2024-09-21T03:41:25.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.129+0000 7fdccf7fe640 1 --2- 172.21.15.84:0/3035211812 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdcb80b6620 0x7fdcb80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:25.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.129+0000 7fdcd5a28640 1 --2- 172.21.15.84:0/3035211812 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdcb80b6620 0x7fdcb80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:25.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.129+0000 7fdccf7fe640 1 -- 172.21.15.84:0/3035211812 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fdcc00e7c20 con 0x7fdcd0103b60 2024-09-21T03:41:25.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.129+0000 7fdcd5a28640 1 --2- 172.21.15.84:0/3035211812 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdcb80b6620 0x7fdcb80b8b30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4005e10 tx=0x7fdcc4005da0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:25.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.132+0000 7fdccf7fe640 1 -- 172.21.15.84:0/3035211812 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdcc0016030 con 0x7fdcd0103b60 2024-09-21T03:41:25.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.331+0000 7fdcd848d640 1 -- 172.21.15.84:0/3035211812 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fdcd019d750 con 0x7fdcd0103b60 2024-09-21T03:41:25.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.332+0000 7fdccf7fe640 1 -- 172.21.15.84:0/3035211812 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdcc00ae2b0 con 0x7fdcd0103b60 2024-09-21T03:41:25.334 INFO:teuthology.orchestra.run.smithi084.stdout:133143986236 2024-09-21T03:41:25.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.335+0000 7fdcd848d640 1 -- 172.21.15.84:0/3035211812 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdcb80b6620 msgr2=0x7fdcb80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:25.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.335+0000 7fdcd848d640 1 --2- 172.21.15.84:0/3035211812 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdcb80b6620 0x7fdcb80b8b30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4005e10 tx=0x7fdcc4005da0 comp rx=0 tx=0).stop 2024-09-21T03:41:25.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.335+0000 7fdcd848d640 1 -- 172.21.15.84:0/3035211812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd0103b60 msgr2=0x7fdcd019c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:25.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.335+0000 7fdcd848d640 1 --2- 172.21.15.84:0/3035211812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd0103b60 0x7fdcd019c620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000eab0 tx=0x7fdcc000ef70 comp rx=0 tx=0).stop 2024-09-21T03:41:25.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.335+0000 7fdcd848d640 1 -- 172.21.15.84:0/3035211812 shutdown_connections 2024-09-21T03:41:25.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.335+0000 7fdcd848d640 1 --2- 172.21.15.84:0/3035211812 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdcb80b6620 0x7fdcb80b8b30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:25.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.335+0000 7fdcd848d640 1 --2- 172.21.15.84:0/3035211812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcd0109df0 0x7fdcd01a1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:25.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.335+0000 7fdcd848d640 1 --2- 172.21.15.84:0/3035211812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcd01094a0 0x7fdcd019cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:25.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.335+0000 7fdcd848d640 1 --2- 172.21.15.84:0/3035211812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd0103b60 0x7fdcd019c620 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:25.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.335+0000 7fdcd848d640 1 -- 172.21.15.84:0/3035211812 >> 172.21.15.84:0/3035211812 conn(0x7fdcd007b850 msgr2=0x7fdcd0105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:25.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.335+0000 7fdcd848d640 1 -- 172.21.15.84:0/3035211812 shutdown_connections 2024-09-21T03:41:25.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.335+0000 7fdcd848d640 1 -- 172.21.15.84:0/3035211812 wait complete. 2024-09-21T03:41:25.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.343+0000 7f7f88ede640 1 -- 172.21.15.84:0/3242012078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f84101ce0 msgr2=0x7f7f841020f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:25.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.343+0000 7f7f88ede640 1 --2- 172.21.15.84:0/3242012078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f84101ce0 0x7f7f841020f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009900 tx=0x7f7f6c02a410 comp rx=0 tx=0).stop 2024-09-21T03:41:25.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.343+0000 7f7f88ede640 1 -- 172.21.15.84:0/3242012078 shutdown_connections 2024-09-21T03:41:25.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.343+0000 7f7f88ede640 1 --2- 172.21.15.84:0/3242012078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f84102630 0x7f7f84106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:25.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.343+0000 7f7f88ede640 1 --2- 172.21.15.84:0/3242012078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f84101ce0 0x7f7f841020f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:25.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.343+0000 7f7f88ede640 1 --2- 172.21.15.84:0/3242012078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f841053f0 0x7f7f84105800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:25.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.343+0000 7f7f88ede640 1 -- 172.21.15.84:0/3242012078 >> 172.21.15.84:0/3242012078 conn(0x7f7f84077c60 msgr2=0x7f7f840780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.343+0000 7f7f88ede640 1 -- 172.21.15.84:0/3242012078 shutdown_connections 2024-09-21T03:41:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.343+0000 7f7f88ede640 1 -- 172.21.15.84:0/3242012078 wait complete. 2024-09-21T03:41:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.344+0000 7f7f88ede640 1 Processor -- start 2024-09-21T03:41:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.344+0000 7f7f88ede640 1 -- start start 2024-09-21T03:41:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.344+0000 7f7f88ede640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f84101ce0 0x7f7f841a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.344+0000 7f7f88ede640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f84102630 0x7f7f841a10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.344+0000 7f7f88ede640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f841053f0 0x7f7f841a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.344+0000 7f7f88ede640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8411a0a0 con 0x7f7f84101ce0 2024-09-21T03:41:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.345+0000 7f7f88ede640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7f84119f20 con 0x7f7f84102630 2024-09-21T03:41:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.345+0000 7f7f88ede640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8411a220 con 0x7f7f841053f0 2024-09-21T03:41:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.345+0000 7f7f7bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f84102630 0x7f7f841a10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.345+0000 7f7f82d9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f841053f0 0x7f7f841a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.345+0000 7f7f7bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f84102630 0x7f7f841a10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:42844/0 (socket says 172.21.15.84:42844) 2024-09-21T03:41:25.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.345+0000 7f7f82d9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f841053f0 0x7f7f841a6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.84:54048/0 (socket says 172.21.15.84:54048) 2024-09-21T03:41:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.345+0000 7f7f7bfff640 1 -- 172.21.15.84:0/3104661460 learned_addr learned my addr 172.21.15.84:0/3104661460 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.345+0000 7f7f8259c640 1 --2- 172.21.15.84:0/3104661460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f84101ce0 0x7f7f841a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.345+0000 7f7f82d9d640 1 -- 172.21.15.84:0/3104661460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f84102630 msgr2=0x7f7f841a10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.345+0000 7f7f82d9d640 1 --2- 172.21.15.84:0/3104661460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f84102630 0x7f7f841a10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.345+0000 7f7f82d9d640 1 -- 172.21.15.84:0/3104661460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f84101ce0 msgr2=0x7f7f841a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.345+0000 7f7f82d9d640 1 --2- 172.21.15.84:0/3104661460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f84101ce0 0x7f7f841a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.345+0000 7f7f82d9d640 1 -- 172.21.15.84:0/3104661460 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f841a6ac0 con 0x7f7f841053f0 2024-09-21T03:41:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.345+0000 7f7f7bfff640 1 --2- 172.21.15.84:0/3104661460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f84102630 0x7f7f841a10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:41:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.345+0000 7f7f82d9d640 1 --2- 172.21.15.84:0/3104661460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f841053f0 0x7f7f841a6390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009fd0 tx=0x7f7f7c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.346+0000 7f7f7b7fe640 1 -- 172.21.15.84:0/3104661460 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c00ce20 con 0x7f7f841053f0 2024-09-21T03:41:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.346+0000 7f7f7b7fe640 1 -- 172.21.15.84:0/3104661460 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f7c005020 con 0x7f7f841053f0 2024-09-21T03:41:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.346+0000 7f7f88ede640 1 -- 172.21.15.84:0/3104661460 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f841a6db0 con 0x7f7f841053f0 2024-09-21T03:41:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.346+0000 7f7f7b7fe640 1 -- 172.21.15.84:0/3104661460 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c010690 con 0x7f7f841053f0 2024-09-21T03:41:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.346+0000 7f7f88ede640 1 -- 172.21.15.84:0/3104661460 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f841ad510 con 0x7f7f841053f0 2024-09-21T03:41:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.347+0000 7f7f88ede640 1 -- 172.21.15.84:0/3104661460 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f84106190 con 0x7f7f841053f0 2024-09-21T03:41:25.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.349+0000 7f7f7b7fe640 1 -- 172.21.15.84:0/3104661460 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f7f7c004b20 con 0x7f7f841053f0 2024-09-21T03:41:25.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.350+0000 7f7f7b7fe640 1 --2- 172.21.15.84:0/3104661460 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7f700b65f0 0x7f7f700b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:25.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.350+0000 7f7f8259c640 1 --2- 172.21.15.84:0/3104661460 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7f700b65f0 0x7f7f700b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:25.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.350+0000 7f7f7b7fe640 1 -- 172.21.15.84:0/3104661460 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f7f7c0e7c70 con 0x7f7f841053f0 2024-09-21T03:41:25.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.351+0000 7f7f8259c640 1 --2- 172.21.15.84:0/3104661460 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7f700b65f0 0x7f7f700b8b00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7f740095f0 tx=0x7f7f74005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:25.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.355+0000 7f7f7b7fe640 1 -- 172.21.15.84:0/3104661460 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7f7c0ae300 con 0x7f7f841053f0 2024-09-21T03:41:25.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.543+0000 7f7f88ede640 1 -- 172.21.15.84:0/3104661460 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f7f841ad710 con 0x7f7f841053f0 2024-09-21T03:41:25.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.543+0000 7f7f7b7fe640 1 -- 172.21.15.84:0/3104661460 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7f7c0b26e0 con 0x7f7f841053f0 2024-09-21T03:41:25.545 INFO:teuthology.orchestra.run.smithi084.stdout:253403070499 2024-09-21T03:41:25.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.546+0000 7f7f88ede640 1 -- 172.21.15.84:0/3104661460 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7f700b65f0 msgr2=0x7f7f700b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:25.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.546+0000 7f7f88ede640 1 --2- 172.21.15.84:0/3104661460 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7f700b65f0 0x7f7f700b8b00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7f740095f0 tx=0x7f7f74005f90 comp rx=0 tx=0).stop 2024-09-21T03:41:25.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.546+0000 7f7f88ede640 1 -- 172.21.15.84:0/3104661460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f841053f0 msgr2=0x7f7f841a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:25.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.546+0000 7f7f88ede640 1 --2- 172.21.15.84:0/3104661460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f841053f0 0x7f7f841a6390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c009fd0 tx=0x7f7f7c00ef10 comp rx=0 tx=0).stop 2024-09-21T03:41:25.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.546+0000 7f7f88ede640 1 -- 172.21.15.84:0/3104661460 shutdown_connections 2024-09-21T03:41:25.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.546+0000 7f7f88ede640 1 --2- 172.21.15.84:0/3104661460 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7f700b65f0 0x7f7f700b8b00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:25.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.546+0000 7f7f88ede640 1 --2- 172.21.15.84:0/3104661460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7f841053f0 0x7f7f841a6390 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:25.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.546+0000 7f7f88ede640 1 --2- 172.21.15.84:0/3104661460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7f84102630 0x7f7f841a10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:25.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.546+0000 7f7f88ede640 1 --2- 172.21.15.84:0/3104661460 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7f84101ce0 0x7f7f841a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:25.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.546+0000 7f7f88ede640 1 -- 172.21.15.84:0/3104661460 >> 172.21.15.84:0/3104661460 conn(0x7f7f84077c60 msgr2=0x7f7f84100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:25.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.546+0000 7f7f88ede640 1 -- 172.21.15.84:0/3104661460 shutdown_connections 2024-09-21T03:41:25.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:25.546+0000 7f7f88ede640 1 -- 172.21.15.84:0/3104661460 wait complete. 2024-09-21T03:41:25.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:25 smithi174 ceph-mon[34403]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T03:41:25.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:25 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:41:25.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:25 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3035211812' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T03:41:25.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:25 smithi172 ceph-mon[34821]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T03:41:25.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:25 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:41:25.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:25 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3035211812' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T03:41:25.662 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:25 smithi084 ceph-mon[30941]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T03:41:25.662 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:25 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:41:25.662 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:25 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3035211812' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T03:41:26.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.088+0000 7f7277414640 1 -- 172.21.15.84:0/1428167482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72701083a0 msgr2=0x7f72701087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:26.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.088+0000 7f7277414640 1 --2- 172.21.15.84:0/1428167482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72701083a0 0x7f72701087b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7260009900 tx=0x7f726002a410 comp rx=0 tx=0).stop 2024-09-21T03:41:26.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.088+0000 7f7277414640 1 -- 172.21.15.84:0/1428167482 shutdown_connections 2024-09-21T03:41:26.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.088+0000 7f7277414640 1 --2- 172.21.15.84:0/1428167482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7270108cf0 0x7f727010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.088+0000 7f7277414640 1 --2- 172.21.15.84:0/1428167482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72701083a0 0x7f72701087b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.088+0000 7f7277414640 1 --2- 172.21.15.84:0/1428167482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7270102a60 0x7f7270102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.088+0000 7f7277414640 1 -- 172.21.15.84:0/1428167482 >> 172.21.15.84:0/1428167482 conn(0x7f7270079730 msgr2=0x7f7270079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:26.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.089+0000 7f7277414640 1 -- 172.21.15.84:0/1428167482 shutdown_connections 2024-09-21T03:41:26.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.089+0000 7f7277414640 1 -- 172.21.15.84:0/1428167482 wait complete. 2024-09-21T03:41:26.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.089+0000 7f7277414640 1 Processor -- start 2024-09-21T03:41:26.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.089+0000 7f7277414640 1 -- start start 2024-09-21T03:41:26.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.089+0000 7f7277414640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7270102a60 0x7f72701993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.089+0000 7f7277414640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72701083a0 0x7f7270199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.089+0000 7f7277414640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7270108cf0 0x7f727019ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.089+0000 7f7277414640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7270112960 con 0x7f7270108cf0 2024-09-21T03:41:26.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.089+0000 7f7277414640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f72701127e0 con 0x7f7270102a60 2024-09-21T03:41:26.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.089+0000 7f7277414640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7270112ae0 con 0x7f72701083a0 2024-09-21T03:41:26.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.090+0000 7f72759b1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7270108cf0 0x7f727019ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.090+0000 7f72759b1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7270108cf0 0x7f727019ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39796/0 (socket says 172.21.15.84:39796) 2024-09-21T03:41:26.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.090+0000 7f72759b1640 1 -- 172.21.15.84:0/205819273 learned_addr learned my addr 172.21.15.84:0/205819273 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:26.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.090+0000 7f72751b0640 1 --2- 172.21.15.84:0/205819273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7270102a60 0x7f72701993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.090+0000 7f72749af640 1 --2- 172.21.15.84:0/205819273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72701083a0 0x7f7270199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.090+0000 7f72759b1640 1 -- 172.21.15.84:0/205819273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72701083a0 msgr2=0x7f7270199970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:26.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.090+0000 7f72759b1640 1 --2- 172.21.15.84:0/205819273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72701083a0 0x7f7270199970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.090+0000 7f72759b1640 1 -- 172.21.15.84:0/205819273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7270102a60 msgr2=0x7f72701993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:26.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.090+0000 7f72759b1640 1 --2- 172.21.15.84:0/205819273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7270102a60 0x7f72701993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.090+0000 7f72759b1640 1 -- 172.21.15.84:0/205819273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727019f340 con 0x7f7270108cf0 2024-09-21T03:41:26.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.090+0000 7f72751b0640 1 --2- 172.21.15.84:0/205819273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7270102a60 0x7f72701993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:26.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.090+0000 7f72759b1640 1 --2- 172.21.15.84:0/205819273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7270108cf0 0x7f727019ec10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7268009fd0 tx=0x7f726800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:26.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.090+0000 7f72667fc640 1 -- 172.21.15.84:0/205819273 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7268017070 con 0x7f7270108cf0 2024-09-21T03:41:26.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.090+0000 7f72667fc640 1 -- 172.21.15.84:0/205819273 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7268003e20 con 0x7f7270108cf0 2024-09-21T03:41:26.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.090+0000 7f7277414640 1 -- 172.21.15.84:0/205819273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f727019f630 con 0x7f7270108cf0 2024-09-21T03:41:26.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.090+0000 7f72667fc640 1 -- 172.21.15.84:0/205819273 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7268010460 con 0x7f7270108cf0 2024-09-21T03:41:26.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.090+0000 7f7277414640 1 -- 172.21.15.84:0/205819273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72701a5d90 con 0x7f7270108cf0 2024-09-21T03:41:26.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.091+0000 7f7277414640 1 -- 172.21.15.84:0/205819273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7270103ce0 con 0x7f7270108cf0 2024-09-21T03:41:26.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.093+0000 7f72667fc640 1 -- 172.21.15.84:0/205819273 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f7268003970 con 0x7f7270108cf0 2024-09-21T03:41:26.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.094+0000 7f72667fc640 1 --2- 172.21.15.84:0/205819273 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f725c0b65f0 0x7f725c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.094+0000 7f72751b0640 1 --2- 172.21.15.84:0/205819273 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f725c0b65f0 0x7f725c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.094+0000 7f72667fc640 1 -- 172.21.15.84:0/205819273 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f72680e7400 con 0x7f7270108cf0 2024-09-21T03:41:26.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.094+0000 7f72751b0640 1 --2- 172.21.15.84:0/205819273 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f725c0b65f0 0x7f725c0b8b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f726c005fd0 tx=0x7f726c005ea0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:26.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.097+0000 7f72667fc640 1 -- 172.21.15.84:0/205819273 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f72680ada90 con 0x7f7270108cf0 2024-09-21T03:41:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.282+0000 7f7277414640 1 -- 172.21.15.84:0/205819273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f7270102e70 con 0x7f7270108cf0 2024-09-21T03:41:26.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.282+0000 7f72667fc640 1 -- 172.21.15.84:0/205819273 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7270102e70 con 0x7f7270108cf0 2024-09-21T03:41:26.284 INFO:teuthology.orchestra.run.smithi084.stdout:184683593778 2024-09-21T03:41:26.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.285+0000 7f7277414640 1 -- 172.21.15.84:0/205819273 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f725c0b65f0 msgr2=0x7f725c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:26.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.285+0000 7f7277414640 1 --2- 172.21.15.84:0/205819273 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f725c0b65f0 0x7f725c0b8b00 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f726c005fd0 tx=0x7f726c005ea0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.285+0000 7f7277414640 1 -- 172.21.15.84:0/205819273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7270108cf0 msgr2=0x7f727019ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:26.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.285+0000 7f7277414640 1 --2- 172.21.15.84:0/205819273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7270108cf0 0x7f727019ec10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7268009fd0 tx=0x7f726800b260 comp rx=0 tx=0).stop 2024-09-21T03:41:26.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.285+0000 7f7277414640 1 -- 172.21.15.84:0/205819273 shutdown_connections 2024-09-21T03:41:26.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.285+0000 7f7277414640 1 --2- 172.21.15.84:0/205819273 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f725c0b65f0 0x7f725c0b8b00 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.285+0000 7f7277414640 1 --2- 172.21.15.84:0/205819273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7270108cf0 0x7f727019ec10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.285+0000 7f7277414640 1 --2- 172.21.15.84:0/205819273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f72701083a0 0x7f7270199970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.285+0000 7f7277414640 1 --2- 172.21.15.84:0/205819273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7270102a60 0x7f72701993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.285+0000 7f7277414640 1 -- 172.21.15.84:0/205819273 >> 172.21.15.84:0/205819273 conn(0x7f7270079730 msgr2=0x7f72701044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:26.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.285+0000 7f7277414640 1 -- 172.21.15.84:0/205819273 shutdown_connections 2024-09-21T03:41:26.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.285+0000 7f7277414640 1 -- 172.21.15.84:0/205819273 wait complete. 2024-09-21T03:41:26.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.301+0000 7f68e34e9640 1 -- 172.21.15.84:0/2953414210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68dc1021f0 msgr2=0x7f68dc102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.301+0000 7f68e34e9640 1 --2- 172.21.15.84:0/2953414210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68dc1021f0 0x7f68dc102600 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f68d8009900 tx=0x7f68d802a410 comp rx=0 tx=0).stop 2024-09-21T03:41:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.301+0000 7f68e34e9640 1 -- 172.21.15.84:0/2953414210 shutdown_connections 2024-09-21T03:41:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.301+0000 7f68e34e9640 1 --2- 172.21.15.84:0/2953414210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68dc108480 0x7f68dc10ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.301+0000 7f68e34e9640 1 --2- 172.21.15.84:0/2953414210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68dc107b30 0x7f68dc107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.301+0000 7f68e34e9640 1 --2- 172.21.15.84:0/2953414210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68dc1021f0 0x7f68dc102600 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.301+0000 7f68e34e9640 1 -- 172.21.15.84:0/2953414210 >> 172.21.15.84:0/2953414210 conn(0x7f68dc077c60 msgr2=0x7f68dc0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.301+0000 7f68e34e9640 1 -- 172.21.15.84:0/2953414210 shutdown_connections 2024-09-21T03:41:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.302+0000 7f68e34e9640 1 -- 172.21.15.84:0/2953414210 wait complete. 2024-09-21T03:41:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.302+0000 7f68e34e9640 1 Processor -- start 2024-09-21T03:41:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.303+0000 7f68e34e9640 1 -- start start 2024-09-21T03:41:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.303+0000 7f68e34e9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68dc1021f0 0x7f68dc199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.303+0000 7f68e34e9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68dc107b30 0x7f68dc199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.303+0000 7f68e34e9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68dc108480 0x7f68dc19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.303+0000 7f68e34e9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f68dc1129c0 con 0x7f68dc108480 2024-09-21T03:41:26.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.303+0000 7f68e34e9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f68dc112840 con 0x7f68dc1021f0 2024-09-21T03:41:26.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.303+0000 7f68e34e9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f68dc112b40 con 0x7f68dc107b30 2024-09-21T03:41:26.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.303+0000 7f68e1a86640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68dc108480 0x7f68dc19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.303+0000 7f68e1a86640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68dc108480 0x7f68dc19ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39810/0 (socket says 172.21.15.84:39810) 2024-09-21T03:41:26.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.303+0000 7f68e1a86640 1 -- 172.21.15.84:0/453610571 learned_addr learned my addr 172.21.15.84:0/453610571 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:26.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.303+0000 7f68e1285640 1 --2- 172.21.15.84:0/453610571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68dc1021f0 0x7f68dc199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.303+0000 7f68e0a84640 1 --2- 172.21.15.84:0/453610571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68dc107b30 0x7f68dc199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.303+0000 7f68e1a86640 1 -- 172.21.15.84:0/453610571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68dc107b30 msgr2=0x7f68dc199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:26.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.303+0000 7f68e1a86640 1 --2- 172.21.15.84:0/453610571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68dc107b30 0x7f68dc199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.303+0000 7f68e1a86640 1 -- 172.21.15.84:0/453610571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68dc1021f0 msgr2=0x7f68dc199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:26.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.303+0000 7f68e1a86640 1 --2- 172.21.15.84:0/453610571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68dc1021f0 0x7f68dc199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.303+0000 7f68e1a86640 1 -- 172.21.15.84:0/453610571 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68dc19f2e0 con 0x7f68dc108480 2024-09-21T03:41:26.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.304+0000 7f68e1a86640 1 --2- 172.21.15.84:0/453610571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68dc108480 0x7f68dc19ebb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f68d4010d20 tx=0x7f68d400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:26.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.304+0000 7f68d27fc640 1 -- 172.21.15.84:0/453610571 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d4004d20 con 0x7f68dc108480 2024-09-21T03:41:26.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.304+0000 7f68e34e9640 1 -- 172.21.15.84:0/453610571 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68dc19f5d0 con 0x7f68dc108480 2024-09-21T03:41:26.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.304+0000 7f68d27fc640 1 -- 172.21.15.84:0/453610571 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68d40054d0 con 0x7f68dc108480 2024-09-21T03:41:26.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.304+0000 7f68d27fc640 1 -- 172.21.15.84:0/453610571 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d4018970 con 0x7f68dc108480 2024-09-21T03:41:26.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.304+0000 7f68e34e9640 1 -- 172.21.15.84:0/453610571 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68dc10f670 con 0x7f68dc108480 2024-09-21T03:41:26.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.305+0000 7f68e34e9640 1 -- 172.21.15.84:0/453610571 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68dc103470 con 0x7f68dc108480 2024-09-21T03:41:26.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.307+0000 7f68d27fc640 1 -- 172.21.15.84:0/453610571 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f68d4004fe0 con 0x7f68dc108480 2024-09-21T03:41:26.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.308+0000 7f68d27fc640 1 --2- 172.21.15.84:0/453610571 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f68c80b65f0 0x7f68c80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.308+0000 7f68e1285640 1 --2- 172.21.15.84:0/453610571 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f68c80b65f0 0x7f68c80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.308+0000 7f68d27fc640 1 -- 172.21.15.84:0/453610571 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f68d40e95e0 con 0x7f68dc108480 2024-09-21T03:41:26.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.308+0000 7f68e1285640 1 --2- 172.21.15.84:0/453610571 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f68c80b65f0 0x7f68c80b8b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f68d8031440 tx=0x7f68d8009560 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:26.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.313+0000 7f68d27fc640 1 -- 172.21.15.84:0/453610571 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f68d40b4050 con 0x7f68dc108480 2024-09-21T03:41:26.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.500+0000 7f68e34e9640 1 -- 172.21.15.84:0/453610571 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f68dc110090 con 0x7f68dc108480 2024-09-21T03:41:26.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.501+0000 7f68d27fc640 1 -- 172.21.15.84:0/453610571 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f68d40b8f90 con 0x7f68dc108480 2024-09-21T03:41:26.503 INFO:teuthology.orchestra.run.smithi084.stdout:107374182464 2024-09-21T03:41:26.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.503+0000 7f68e34e9640 1 -- 172.21.15.84:0/453610571 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f68c80b65f0 msgr2=0x7f68c80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:26.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.503+0000 7f68e34e9640 1 --2- 172.21.15.84:0/453610571 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f68c80b65f0 0x7f68c80b8b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f68d8031440 tx=0x7f68d8009560 comp rx=0 tx=0).stop 2024-09-21T03:41:26.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.503+0000 7f68e34e9640 1 -- 172.21.15.84:0/453610571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68dc108480 msgr2=0x7f68dc19ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:26.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.503+0000 7f68e34e9640 1 --2- 172.21.15.84:0/453610571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68dc108480 0x7f68dc19ebb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f68d4010d20 tx=0x7f68d400c6a0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.503+0000 7f68e34e9640 1 -- 172.21.15.84:0/453610571 shutdown_connections 2024-09-21T03:41:26.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.503+0000 7f68e34e9640 1 --2- 172.21.15.84:0/453610571 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f68c80b65f0 0x7f68c80b8b00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.503+0000 7f68e34e9640 1 --2- 172.21.15.84:0/453610571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f68dc108480 0x7f68dc19ebb0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.503+0000 7f68e34e9640 1 --2- 172.21.15.84:0/453610571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f68dc107b30 0x7f68dc199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.503+0000 7f68e34e9640 1 --2- 172.21.15.84:0/453610571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68dc1021f0 0x7f68dc199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.503+0000 7f68e34e9640 1 -- 172.21.15.84:0/453610571 >> 172.21.15.84:0/453610571 conn(0x7f68dc077c60 msgr2=0x7f68dc105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:26.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.503+0000 7f68e34e9640 1 -- 172.21.15.84:0/453610571 shutdown_connections 2024-09-21T03:41:26.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:26.503+0000 7f68e34e9640 1 -- 172.21.15.84:0/453610571 wait complete. 2024-09-21T03:41:26.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:26 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3104661460' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T03:41:26.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:26 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/205819273' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T03:41:26.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:26 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3104661460' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T03:41:26.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:26 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/205819273' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T03:41:26.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:26 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3104661460' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T03:41:26.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:26 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/205819273' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T03:41:27.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:27 smithi084 ceph-mon[30941]: pgmap v293: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:41:27.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:27 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/453610571' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T03:41:27.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:27 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:27.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:27 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:27.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:27 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:27.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:27 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:27.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:27 smithi172 ceph-mon[34821]: pgmap v293: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:41:27.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:27 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/453610571' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T03:41:27.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:27 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:27.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:27 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:27.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:27 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:27.652 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:27 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:27.759 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182462 got 107374182464 for osd.3 2024-09-21T03:41:27.759 DEBUG:teuthology.parallel:result is None 2024-09-21T03:41:27.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:27 smithi174 ceph-mon[34403]: pgmap v293: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:41:27.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:27 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/453610571' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T03:41:27.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:27 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:27.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:27 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:27.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:27 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:27.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:27 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:27.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.920+0000 7faf93b53640 1 -- 172.21.15.84:0/6036048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf8c109df0 msgr2=0x7faf8c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:27.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.920+0000 7faf93b53640 1 --2- 172.21.15.84:0/6036048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf8c109df0 0x7faf8c110620 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7faf84009ca0 tx=0x7faf8402a8e0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.920+0000 7faf93b53640 1 -- 172.21.15.84:0/6036048 shutdown_connections 2024-09-21T03:41:27.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.920+0000 7faf93b53640 1 --2- 172.21.15.84:0/6036048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf8c109df0 0x7faf8c110620 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.920+0000 7faf93b53640 1 --2- 172.21.15.84:0/6036048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf8c1094a0 0x7faf8c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.920+0000 7faf93b53640 1 --2- 172.21.15.84:0/6036048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf8c103b60 0x7faf8c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.920+0000 7faf93b53640 1 -- 172.21.15.84:0/6036048 >> 172.21.15.84:0/6036048 conn(0x7faf8c07b850 msgr2=0x7faf8c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:27.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.920+0000 7faf93b53640 1 -- 172.21.15.84:0/6036048 shutdown_connections 2024-09-21T03:41:27.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.920+0000 7faf93b53640 1 -- 172.21.15.84:0/6036048 wait complete. 2024-09-21T03:41:27.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.921+0000 7faf93b53640 1 Processor -- start 2024-09-21T03:41:27.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.921+0000 7faf93b53640 1 -- start start 2024-09-21T03:41:27.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.922+0000 7faf93b53640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf8c103b60 0x7faf8c19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.922+0000 7faf93b53640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf8c1094a0 0x7faf8c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.922+0000 7faf93b53640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf8c109df0 0x7faf8c19fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.922+0000 7faf93b53640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c113b70 con 0x7faf8c109df0 2024-09-21T03:41:27.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.922+0000 7faf93b53640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c1139f0 con 0x7faf8c103b60 2024-09-21T03:41:27.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.922+0000 7faf93b53640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c113cf0 con 0x7faf8c1094a0 2024-09-21T03:41:27.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.922+0000 7faf910ee640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf8c1094a0 0x7faf8c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.922+0000 7faf918ef640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf8c103b60 0x7faf8c19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.922+0000 7faf910ee640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf8c1094a0 0x7faf8c19ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.84:54106/0 (socket says 172.21.15.84:54106) 2024-09-21T03:41:27.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.922+0000 7faf910ee640 1 -- 172.21.15.84:0/2659055845 learned_addr learned my addr 172.21.15.84:0/2659055845 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:27.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.922+0000 7faf920f0640 1 --2- 172.21.15.84:0/2659055845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf8c109df0 0x7faf8c19fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.923+0000 7faf918ef640 1 -- 172.21.15.84:0/2659055845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf8c1094a0 msgr2=0x7faf8c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:27.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.923+0000 7faf918ef640 1 --2- 172.21.15.84:0/2659055845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf8c1094a0 0x7faf8c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.923+0000 7faf918ef640 1 -- 172.21.15.84:0/2659055845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf8c109df0 msgr2=0x7faf8c19fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:27.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.923+0000 7faf918ef640 1 --2- 172.21.15.84:0/2659055845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf8c109df0 0x7faf8c19fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.923+0000 7faf918ef640 1 -- 172.21.15.84:0/2659055845 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8c1a0510 con 0x7faf8c103b60 2024-09-21T03:41:27.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.923+0000 7faf918ef640 1 --2- 172.21.15.84:0/2659055845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf8c103b60 0x7faf8c19a5a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faf8800b3f0 tx=0x7faf8800b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:27.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.923+0000 7faf82ffd640 1 -- 172.21.15.84:0/2659055845 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf88015020 con 0x7faf8c103b60 2024-09-21T03:41:27.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.923+0000 7faf93b53640 1 -- 172.21.15.84:0/2659055845 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf8c1a0800 con 0x7faf8c103b60 2024-09-21T03:41:27.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.923+0000 7faf82ffd640 1 -- 172.21.15.84:0/2659055845 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf88011ce0 con 0x7faf8c103b60 2024-09-21T03:41:27.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.923+0000 7faf82ffd640 1 -- 172.21.15.84:0/2659055845 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf88010d80 con 0x7faf8c103b60 2024-09-21T03:41:27.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.923+0000 7faf93b53640 1 -- 172.21.15.84:0/2659055845 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf8c1a6f60 con 0x7faf8c103b60 2024-09-21T03:41:27.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.924+0000 7faf93b53640 1 -- 172.21.15.84:0/2659055845 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf8c103ff0 con 0x7faf8c103b60 2024-09-21T03:41:27.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.926+0000 7faf82ffd640 1 -- 172.21.15.84:0/2659055845 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7faf88018020 con 0x7faf8c103b60 2024-09-21T03:41:27.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.927+0000 7faf82ffd640 1 --2- 172.21.15.84:0/2659055845 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7faf780b65f0 0x7faf780b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.927+0000 7faf910ee640 1 --2- 172.21.15.84:0/2659055845 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7faf780b65f0 0x7faf780b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.927+0000 7faf82ffd640 1 -- 172.21.15.84:0/2659055845 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7faf880e71e0 con 0x7faf8c103b60 2024-09-21T03:41:27.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.927+0000 7faf910ee640 1 --2- 172.21.15.84:0/2659055845 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7faf780b65f0 0x7faf780b8b00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faf8c106530 tx=0x7faf7c009190 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:27.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:27.930+0000 7faf82ffd640 1 -- 172.21.15.84:0/2659055845 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faf8801f020 con 0x7faf8c103b60 2024-09-21T03:41:28.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:28.116+0000 7faf93b53640 1 -- 172.21.15.84:0/2659055845 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7faf8c19b6d0 con 0x7faf8c103b60 2024-09-21T03:41:28.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:28.116+0000 7faf82ffd640 1 -- 172.21.15.84:0/2659055845 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faf8c19b6d0 con 0x7faf8c103b60 2024-09-21T03:41:28.119 INFO:teuthology.orchestra.run.smithi084.stdout:55834574924 2024-09-21T03:41:28.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:28.119+0000 7faf93b53640 1 -- 172.21.15.84:0/2659055845 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7faf780b65f0 msgr2=0x7faf780b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:28.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:28.119+0000 7faf93b53640 1 --2- 172.21.15.84:0/2659055845 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7faf780b65f0 0x7faf780b8b00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faf8c106530 tx=0x7faf7c009190 comp rx=0 tx=0).stop 2024-09-21T03:41:28.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:28.119+0000 7faf93b53640 1 -- 172.21.15.84:0/2659055845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf8c103b60 msgr2=0x7faf8c19a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:28.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:28.119+0000 7faf93b53640 1 --2- 172.21.15.84:0/2659055845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf8c103b60 0x7faf8c19a5a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faf8800b3f0 tx=0x7faf8800b8b0 comp rx=0 tx=0).stop 2024-09-21T03:41:28.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:28.119+0000 7faf93b53640 1 -- 172.21.15.84:0/2659055845 shutdown_connections 2024-09-21T03:41:28.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:28.119+0000 7faf93b53640 1 --2- 172.21.15.84:0/2659055845 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7faf780b65f0 0x7faf780b8b00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:28.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:28.119+0000 7faf93b53640 1 --2- 172.21.15.84:0/2659055845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7faf8c109df0 0x7faf8c19fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:28.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:28.119+0000 7faf93b53640 1 --2- 172.21.15.84:0/2659055845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7faf8c1094a0 0x7faf8c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:28.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:28.119+0000 7faf93b53640 1 --2- 172.21.15.84:0/2659055845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf8c103b60 0x7faf8c19a5a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:28.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:28.119+0000 7faf93b53640 1 -- 172.21.15.84:0/2659055845 >> 172.21.15.84:0/2659055845 conn(0x7faf8c07b850 msgr2=0x7faf8c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:28.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:28.119+0000 7faf93b53640 1 -- 172.21.15.84:0/2659055845 shutdown_connections 2024-09-21T03:41:28.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:28.119+0000 7faf93b53640 1 -- 172.21.15.84:0/2659055845 wait complete. 2024-09-21T03:41:28.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:28 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2659055845' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T03:41:28.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:28 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2659055845' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T03:41:28.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:28 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2659055845' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T03:41:28.907 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574920 got 55834574924 for osd.1 2024-09-21T03:41:28.907 DEBUG:teuthology.parallel:result is None 2024-09-21T03:41:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.197+0000 7fb154425640 1 -- 172.21.15.84:0/118219162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb14c108cf0 msgr2=0x7fb14c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.197+0000 7fb154425640 1 --2- 172.21.15.84:0/118219162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb14c108cf0 0x7fb14c10f520 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb13c009900 tx=0x7fb13c02a410 comp rx=0 tx=0).stop 2024-09-21T03:41:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.197+0000 7fb154425640 1 -- 172.21.15.84:0/118219162 shutdown_connections 2024-09-21T03:41:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.197+0000 7fb154425640 1 --2- 172.21.15.84:0/118219162 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb14c108cf0 0x7fb14c10f520 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.197+0000 7fb154425640 1 --2- 172.21.15.84:0/118219162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb14c1083a0 0x7fb14c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.197+0000 7fb154425640 1 --2- 172.21.15.84:0/118219162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb14c102a60 0x7fb14c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.197+0000 7fb154425640 1 -- 172.21.15.84:0/118219162 >> 172.21.15.84:0/118219162 conn(0x7fb14c079730 msgr2=0x7fb14c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:29.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.197+0000 7fb154425640 1 -- 172.21.15.84:0/118219162 shutdown_connections 2024-09-21T03:41:29.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.197+0000 7fb154425640 1 -- 172.21.15.84:0/118219162 wait complete. 2024-09-21T03:41:29.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.197+0000 7fb154425640 1 Processor -- start 2024-09-21T03:41:29.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.198+0000 7fb154425640 1 -- start start 2024-09-21T03:41:29.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.198+0000 7fb154425640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb14c102a60 0x7fb14c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:29.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.198+0000 7fb154425640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb14c1083a0 0x7fb14c19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:29.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.198+0000 7fb154425640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb14c108cf0 0x7fb14c19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:29.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.198+0000 7fb154425640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c112a90 con 0x7fb14c108cf0 2024-09-21T03:41:29.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.198+0000 7fb154425640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c112910 con 0x7fb14c102a60 2024-09-21T03:41:29.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.198+0000 7fb154425640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb14c112c10 con 0x7fb14c1083a0 2024-09-21T03:41:29.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.198+0000 7fb1529c2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb14c108cf0 0x7fb14c19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:29.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.198+0000 7fb1529c2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb14c108cf0 0x7fb14c19fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32936/0 (socket says 172.21.15.84:32936) 2024-09-21T03:41:29.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.198+0000 7fb1529c2640 1 -- 172.21.15.84:0/2656504943 learned_addr learned my addr 172.21.15.84:0/2656504943 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:29.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.198+0000 7fb1519c0640 1 --2- 172.21.15.84:0/2656504943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb14c1083a0 0x7fb14c19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:29.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.198+0000 7fb1521c1640 1 --2- 172.21.15.84:0/2656504943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb14c102a60 0x7fb14c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:29.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.198+0000 7fb1529c2640 1 -- 172.21.15.84:0/2656504943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb14c1083a0 msgr2=0x7fb14c19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:29.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.198+0000 7fb1529c2640 1 --2- 172.21.15.84:0/2656504943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb14c1083a0 0x7fb14c19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.198+0000 7fb1529c2640 1 -- 172.21.15.84:0/2656504943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb14c102a60 msgr2=0x7fb14c19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:29.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.198+0000 7fb1529c2640 1 --2- 172.21.15.84:0/2656504943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb14c102a60 0x7fb14c19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.198+0000 7fb1529c2640 1 -- 172.21.15.84:0/2656504943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14c1a0500 con 0x7fb14c108cf0 2024-09-21T03:41:29.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.198+0000 7fb1519c0640 1 --2- 172.21.15.84:0/2656504943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb14c1083a0 0x7fb14c19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:29.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.198+0000 7fb1529c2640 1 --2- 172.21.15.84:0/2656504943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb14c108cf0 0x7fb14c19fdd0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb13c02a930 tx=0x7fb13c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:29.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.199+0000 7fb14b7fe640 1 -- 172.21.15.84:0/2656504943 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c03f070 con 0x7fb14c108cf0 2024-09-21T03:41:29.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.199+0000 7fb14b7fe640 1 -- 172.21.15.84:0/2656504943 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb13c031d60 con 0x7fb14c108cf0 2024-09-21T03:41:29.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.199+0000 7fb154425640 1 -- 172.21.15.84:0/2656504943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb14c1a0790 con 0x7fb14c108cf0 2024-09-21T03:41:29.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.199+0000 7fb14b7fe640 1 -- 172.21.15.84:0/2656504943 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c035030 con 0x7fb14c108cf0 2024-09-21T03:41:29.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.199+0000 7fb154425640 1 -- 172.21.15.84:0/2656504943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb14c1a6f50 con 0x7fb14c108cf0 2024-09-21T03:41:29.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.200+0000 7fb154425640 1 -- 172.21.15.84:0/2656504943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb14c102ef0 con 0x7fb14c108cf0 2024-09-21T03:41:29.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.201+0000 7fb14b7fe640 1 -- 172.21.15.84:0/2656504943 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fb13c042070 con 0x7fb14c108cf0 2024-09-21T03:41:29.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.202+0000 7fb14b7fe640 1 --2- 172.21.15.84:0/2656504943 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb1340b65f0 0x7fb1340b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:29.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.202+0000 7fb1521c1640 1 --2- 172.21.15.84:0/2656504943 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb1340b65f0 0x7fb1340b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:29.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.202+0000 7fb14b7fe640 1 -- 172.21.15.84:0/2656504943 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fb13c107ce0 con 0x7fb14c108cf0 2024-09-21T03:41:29.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.202+0000 7fb1521c1640 1 --2- 172.21.15.84:0/2656504943 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb1340b65f0 0x7fb1340b8b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb144009f20 tx=0x7fb1440094f0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:29.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.206+0000 7fb14b7fe640 1 -- 172.21.15.84:0/2656504943 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb13c0ce370 con 0x7fb14c108cf0 2024-09-21T03:41:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.389+0000 7fb154425640 1 -- 172.21.15.84:0/2656504943 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fb14c10baf0 con 0x7fb14c108cf0 2024-09-21T03:41:29.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.389+0000 7fb14b7fe640 1 -- 172.21.15.84:0/2656504943 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb13c0d2750 con 0x7fb14c108cf0 2024-09-21T03:41:29.391 INFO:teuthology.orchestra.run.smithi084.stdout:227633266728 2024-09-21T03:41:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.391+0000 7fb154425640 1 -- 172.21.15.84:0/2656504943 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb1340b65f0 msgr2=0x7fb1340b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:29.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.391+0000 7fb154425640 1 --2- 172.21.15.84:0/2656504943 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb1340b65f0 0x7fb1340b8b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb144009f20 tx=0x7fb1440094f0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.391+0000 7fb154425640 1 -- 172.21.15.84:0/2656504943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb14c108cf0 msgr2=0x7fb14c19fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.391+0000 7fb154425640 1 --2- 172.21.15.84:0/2656504943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb14c108cf0 0x7fb14c19fdd0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb13c02a930 tx=0x7fb13c003cd0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.391+0000 7fb154425640 1 -- 172.21.15.84:0/2656504943 shutdown_connections 2024-09-21T03:41:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.391+0000 7fb154425640 1 --2- 172.21.15.84:0/2656504943 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb1340b65f0 0x7fb1340b8b00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.391+0000 7fb154425640 1 --2- 172.21.15.84:0/2656504943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb14c108cf0 0x7fb14c19fdd0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.391+0000 7fb154425640 1 --2- 172.21.15.84:0/2656504943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb14c1083a0 0x7fb14c19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.391+0000 7fb154425640 1 --2- 172.21.15.84:0/2656504943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb14c102a60 0x7fb14c19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.391+0000 7fb154425640 1 -- 172.21.15.84:0/2656504943 >> 172.21.15.84:0/2656504943 conn(0x7fb14c079730 msgr2=0x7fb14c06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.392+0000 7fb154425640 1 -- 172.21.15.84:0/2656504943 shutdown_connections 2024-09-21T03:41:29.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.392+0000 7fb154425640 1 -- 172.21.15.84:0/2656504943 wait complete. 2024-09-21T03:41:29.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.397+0000 7f4b3c73c640 1 -- 172.21.15.84:0/2360163220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b34103080 msgr2=0x7f4b34103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:29.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.397+0000 7f4b3c73c640 1 --2- 172.21.15.84:0/2360163220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b34103080 0x7f4b34103490 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4b30009900 tx=0x7f4b3002a410 comp rx=0 tx=0).stop 2024-09-21T03:41:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.397+0000 7f4b3c73c640 1 -- 172.21.15.84:0/2360163220 shutdown_connections 2024-09-21T03:41:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.397+0000 7f4b3c73c640 1 --2- 172.21.15.84:0/2360163220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b34105ac0 0x7f4b3410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.397+0000 7f4b3c73c640 1 --2- 172.21.15.84:0/2360163220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b34105170 0x7f4b34105580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.397+0000 7f4b3c73c640 1 --2- 172.21.15.84:0/2360163220 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b34103080 0x7f4b34103490 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.397+0000 7f4b3c73c640 1 -- 172.21.15.84:0/2360163220 >> 172.21.15.84:0/2360163220 conn(0x7f4b34077c60 msgr2=0x7f4b340780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.397+0000 7f4b3c73c640 1 -- 172.21.15.84:0/2360163220 shutdown_connections 2024-09-21T03:41:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.397+0000 7f4b3c73c640 1 -- 172.21.15.84:0/2360163220 wait complete. 2024-09-21T03:41:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.398+0000 7f4b3c73c640 1 Processor -- start 2024-09-21T03:41:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.398+0000 7f4b3c73c640 1 -- start start 2024-09-21T03:41:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.399+0000 7f4b3c73c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b34103080 0x7f4b34199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.399+0000 7f4b3c73c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b34105170 0x7f4b341998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.399+0000 7f4b3c73c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b34105ac0 0x7f4b3419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.399+0000 7f4b3c73c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4b341129c0 con 0x7f4b34105ac0 2024-09-21T03:41:29.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.399+0000 7f4b3c73c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b34112840 con 0x7f4b34103080 2024-09-21T03:41:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.399+0000 7f4b3c73c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4b34112b40 con 0x7f4b34105170 2024-09-21T03:41:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.399+0000 7f4b3acd9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b34105ac0 0x7f4b3419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.399+0000 7f4b3acd9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b34105ac0 0x7f4b3419eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32948/0 (socket says 172.21.15.84:32948) 2024-09-21T03:41:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.399+0000 7f4b3acd9640 1 -- 172.21.15.84:0/3933844542 learned_addr learned my addr 172.21.15.84:0/3933844542 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.399+0000 7f4b39cd7640 1 --2- 172.21.15.84:0/3933844542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b34105170 0x7f4b341998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.399+0000 7f4b3a4d8640 1 --2- 172.21.15.84:0/3933844542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b34103080 0x7f4b34199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.399+0000 7f4b3acd9640 1 -- 172.21.15.84:0/3933844542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b34105170 msgr2=0x7f4b341998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.399+0000 7f4b3acd9640 1 --2- 172.21.15.84:0/3933844542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b34105170 0x7f4b341998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.399+0000 7f4b3acd9640 1 -- 172.21.15.84:0/3933844542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b34103080 msgr2=0x7f4b34199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.399+0000 7f4b3acd9640 1 --2- 172.21.15.84:0/3933844542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b34103080 0x7f4b34199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.399+0000 7f4b3acd9640 1 -- 172.21.15.84:0/3933844542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3419f2a0 con 0x7f4b34105ac0 2024-09-21T03:41:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.399+0000 7f4b3acd9640 1 --2- 172.21.15.84:0/3933844542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b34105ac0 0x7f4b3419eb70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00eb10 tx=0x7f4b2c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:29.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.400+0000 7f4b2b7fe640 1 -- 172.21.15.84:0/3933844542 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c004b20 con 0x7f4b34105ac0 2024-09-21T03:41:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.400+0000 7f4b3c73c640 1 -- 172.21.15.84:0/3933844542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b3419f590 con 0x7f4b34105ac0 2024-09-21T03:41:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.400+0000 7f4b2b7fe640 1 -- 172.21.15.84:0/3933844542 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b2c004cc0 con 0x7f4b34105ac0 2024-09-21T03:41:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.400+0000 7f4b2b7fe640 1 -- 172.21.15.84:0/3933844542 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c010670 con 0x7f4b34105ac0 2024-09-21T03:41:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.400+0000 7f4b3c73c640 1 -- 172.21.15.84:0/3933844542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b341a5cf0 con 0x7f4b34105ac0 2024-09-21T03:41:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.401+0000 7f4b3c73c640 1 -- 172.21.15.84:0/3933844542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b34103490 con 0x7f4b34105ac0 2024-09-21T03:41:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.402+0000 7f4b2b7fe640 1 -- 172.21.15.84:0/3933844542 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f4b2c005020 con 0x7f4b34105ac0 2024-09-21T03:41:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.403+0000 7f4b2b7fe640 1 --2- 172.21.15.84:0/3933844542 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b200b65f0 0x7f4b200b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.404+0000 7f4b2b7fe640 1 -- 172.21.15.84:0/3933844542 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4b2c0e7c10 con 0x7f4b34105ac0 2024-09-21T03:41:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.404+0000 7f4b3a4d8640 1 --2- 172.21.15.84:0/3933844542 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b200b65f0 0x7f4b200b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:29.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.404+0000 7f4b3a4d8640 1 --2- 172.21.15.84:0/3933844542 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b200b65f0 0x7f4b200b8b00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4b30031440 tx=0x7f4b30005d50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:29.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.408+0000 7f4b2b7fe640 1 -- 172.21.15.84:0/3933844542 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4b2c0ae2a0 con 0x7f4b34105ac0 2024-09-21T03:41:29.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:29 smithi084 ceph-mon[30941]: pgmap v294: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:41:29.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.596+0000 7f4b3c73c640 1 -- 172.21.15.84:0/3933844542 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f4b3410a4d0 con 0x7f4b34105ac0 2024-09-21T03:41:29.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.597+0000 7f4b2b7fe640 1 -- 172.21.15.84:0/3933844542 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4b2c0b2680 con 0x7f4b34105ac0 2024-09-21T03:41:29.599 INFO:teuthology.orchestra.run.smithi084.stdout:158913790008 2024-09-21T03:41:29.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.599+0000 7f4b3c73c640 1 -- 172.21.15.84:0/3933844542 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b200b65f0 msgr2=0x7f4b200b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:29.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.599+0000 7f4b3c73c640 1 --2- 172.21.15.84:0/3933844542 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b200b65f0 0x7f4b200b8b00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4b30031440 tx=0x7f4b30005d50 comp rx=0 tx=0).stop 2024-09-21T03:41:29.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.599+0000 7f4b3c73c640 1 -- 172.21.15.84:0/3933844542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b34105ac0 msgr2=0x7f4b3419eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:29.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.599+0000 7f4b3c73c640 1 --2- 172.21.15.84:0/3933844542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b34105ac0 0x7f4b3419eb70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00eb10 tx=0x7f4b2c00c2d0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.599+0000 7f4b3c73c640 1 -- 172.21.15.84:0/3933844542 shutdown_connections 2024-09-21T03:41:29.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.599+0000 7f4b3c73c640 1 --2- 172.21.15.84:0/3933844542 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b200b65f0 0x7f4b200b8b00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.599+0000 7f4b3c73c640 1 --2- 172.21.15.84:0/3933844542 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b34105ac0 0x7f4b3419eb70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.599+0000 7f4b3c73c640 1 --2- 172.21.15.84:0/3933844542 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b34105170 0x7f4b341998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.599+0000 7f4b3c73c640 1 --2- 172.21.15.84:0/3933844542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b34103080 0x7f4b34199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.599+0000 7f4b3c73c640 1 -- 172.21.15.84:0/3933844542 >> 172.21.15.84:0/3933844542 conn(0x7f4b34077c60 msgr2=0x7f4b34106ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:29.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.599+0000 7f4b3c73c640 1 -- 172.21.15.84:0/3933844542 shutdown_connections 2024-09-21T03:41:29.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:29.599+0000 7f4b3c73c640 1 -- 172.21.15.84:0/3933844542 wait complete. 2024-09-21T03:41:29.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:29 smithi172 ceph-mon[34821]: pgmap v294: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:41:29.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:29 smithi174 ceph-mon[34403]: pgmap v294: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:41:30.434 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986234 got 133143986236 for osd.4 2024-09-21T03:41:30.434 DEBUG:teuthology.parallel:result is None 2024-09-21T03:41:30.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:30 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2656504943' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T03:41:30.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:30 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3933844542' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T03:41:30.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:30 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2656504943' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T03:41:30.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:30 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3933844542' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T03:41:30.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:30 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2656504943' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T03:41:30.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:30 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3933844542' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T03:41:30.880 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:30.888 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070497 got 253403070499 for osd.9 2024-09-21T03:41:30.889 DEBUG:teuthology.parallel:result is None 2024-09-21T03:41:31.313 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:31.342 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906970 got 274877906972 for osd.10 2024-09-21T03:41:31.342 DEBUG:teuthology.parallel:result is None 2024-09-21T03:41:31.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:31 smithi084 ceph-mon[30941]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:41:31.778 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790005 got 158913790008 for osd.5 2024-09-21T03:41:31.778 DEBUG:teuthology.parallel:result is None 2024-09-21T03:41:31.779 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:31 smithi174 ceph-mon[34403]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:41:31.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:31 smithi172 ceph-mon[34821]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:41:32.194 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266724 got 227633266728 for osd.8 2024-09-21T03:41:32.194 DEBUG:teuthology.parallel:result is None 2024-09-21T03:41:32.886 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593775 got 184683593778 for osd.6 2024-09-21T03:41:32.886 DEBUG:teuthology.parallel:result is None 2024-09-21T03:41:33.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.135+0000 7fd4be372640 1 -- 172.21.15.84:0/3174205513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4b8105220 msgr2=0x7fd4b8105630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:33.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.135+0000 7fd4be372640 1 --2- 172.21.15.84:0/3174205513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4b8105220 0x7fd4b8105630 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009900 tx=0x7fd4ac02a3f0 comp rx=0 tx=0).stop 2024-09-21T03:41:33.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.135+0000 7fd4be372640 1 -- 172.21.15.84:0/3174205513 shutdown_connections 2024-09-21T03:41:33.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.135+0000 7fd4be372640 1 --2- 172.21.15.84:0/3174205513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4b8105b70 0x7fd4b810f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:33.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.135+0000 7fd4be372640 1 --2- 172.21.15.84:0/3174205513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4b8105220 0x7fd4b8105630 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:33.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.135+0000 7fd4be372640 1 --2- 172.21.15.84:0/3174205513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b8103210 0x7fd4b8103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:33.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.135+0000 7fd4be372640 1 -- 172.21.15.84:0/3174205513 >> 172.21.15.84:0/3174205513 conn(0x7fd4b8079ea0 msgr2=0x7fd4b807a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:33.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.135+0000 7fd4be372640 1 -- 172.21.15.84:0/3174205513 shutdown_connections 2024-09-21T03:41:33.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.135+0000 7fd4be372640 1 -- 172.21.15.84:0/3174205513 wait complete. 2024-09-21T03:41:33.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.136+0000 7fd4be372640 1 Processor -- start 2024-09-21T03:41:33.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.136+0000 7fd4be372640 1 -- start start 2024-09-21T03:41:33.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.137+0000 7fd4be372640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4b8103210 0x7fd4b8199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:33.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.137+0000 7fd4be372640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b8105220 0x7fd4b81999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:33.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.137+0000 7fd4be372640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4b8105b70 0x7fd4b819ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:33.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.137+0000 7fd4be372640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b8112a40 con 0x7fd4b8103210 2024-09-21T03:41:33.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.137+0000 7fd4be372640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b81128c0 con 0x7fd4b8105220 2024-09-21T03:41:33.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.137+0000 7fd4be372640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b8112bc0 con 0x7fd4b8105b70 2024-09-21T03:41:33.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.137+0000 7fd4b7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4b8103210 0x7fd4b8199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:33.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.137+0000 7fd4b7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4b8103210 0x7fd4b8199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32972/0 (socket says 172.21.15.84:32972) 2024-09-21T03:41:33.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.137+0000 7fd4b7fff640 1 -- 172.21.15.84:0/2307210214 learned_addr learned my addr 172.21.15.84:0/2307210214 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:33.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.137+0000 7fd4bc90f640 1 --2- 172.21.15.84:0/2307210214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4b8105b70 0x7fd4b819ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:33.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.137+0000 7fd4b77fe640 1 --2- 172.21.15.84:0/2307210214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b8105220 0x7fd4b81999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:33.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.137+0000 7fd4b7fff640 1 -- 172.21.15.84:0/2307210214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4b8105b70 msgr2=0x7fd4b819ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:33.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.137+0000 7fd4b7fff640 1 --2- 172.21.15.84:0/2307210214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4b8105b70 0x7fd4b819ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:33.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.137+0000 7fd4b7fff640 1 -- 172.21.15.84:0/2307210214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b8105220 msgr2=0x7fd4b81999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:33.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.137+0000 7fd4b7fff640 1 --2- 172.21.15.84:0/2307210214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b8105220 0x7fd4b81999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:33.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.137+0000 7fd4b7fff640 1 -- 172.21.15.84:0/2307210214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b819f3a0 con 0x7fd4b8103210 2024-09-21T03:41:33.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.137+0000 7fd4b77fe640 1 --2- 172.21.15.84:0/2307210214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b8105220 0x7fd4b81999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:33.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.137+0000 7fd4b7fff640 1 --2- 172.21.15.84:0/2307210214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4b8103210 0x7fd4b8199430 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009860 tx=0x7fd4a8009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:33.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.138+0000 7fd4b57fa640 1 -- 172.21.15.84:0/2307210214 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8004020 con 0x7fd4b8103210 2024-09-21T03:41:33.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.138+0000 7fd4be372640 1 -- 172.21.15.84:0/2307210214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b819f690 con 0x7fd4b8103210 2024-09-21T03:41:33.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.138+0000 7fd4b57fa640 1 -- 172.21.15.84:0/2307210214 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4a8007c50 con 0x7fd4b8103210 2024-09-21T03:41:33.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.138+0000 7fd4b57fa640 1 -- 172.21.15.84:0/2307210214 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8003ab0 con 0x7fd4b8103210 2024-09-21T03:41:33.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.138+0000 7fd4be372640 1 -- 172.21.15.84:0/2307210214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b8101e70 con 0x7fd4b8103210 2024-09-21T03:41:33.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.139+0000 7fd4be372640 1 -- 172.21.15.84:0/2307210214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b8103620 con 0x7fd4b8103210 2024-09-21T03:41:33.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.140+0000 7fd4b57fa640 1 -- 172.21.15.84:0/2307210214 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fd4a80041c0 con 0x7fd4b8103210 2024-09-21T03:41:33.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.141+0000 7fd4b57fa640 1 --2- 172.21.15.84:0/2307210214 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4a00b65f0 0x7fd4a00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:33.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.141+0000 7fd4b77fe640 1 --2- 172.21.15.84:0/2307210214 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4a00b65f0 0x7fd4a00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:33.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.141+0000 7fd4b57fa640 1 -- 172.21.15.84:0/2307210214 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fd4a80e9180 con 0x7fd4b8103210 2024-09-21T03:41:33.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.142+0000 7fd4b77fe640 1 --2- 172.21.15.84:0/2307210214 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4a00b65f0 0x7fd4a00b8b00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009230 tx=0x7fd4ac005de0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:33.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.144+0000 7fd4b57fa640 1 -- 172.21.15.84:0/2307210214 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd4a80af810 con 0x7fd4b8103210 2024-09-21T03:41:33.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.326+0000 7fd4be372640 1 -- 172.21.15.84:0/2307210214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd4b8102950 con 0x7fd4b8103210 2024-09-21T03:41:33.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.326+0000 7fd4b57fa640 1 -- 172.21.15.84:0/2307210214 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd4a80b3bf0 con 0x7fd4b8103210 2024-09-21T03:41:33.328 INFO:teuthology.orchestra.run.smithi084.stdout:38654705746 2024-09-21T03:41:33.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.328+0000 7fd4be372640 1 -- 172.21.15.84:0/2307210214 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4a00b65f0 msgr2=0x7fd4a00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:33.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.328+0000 7fd4be372640 1 --2- 172.21.15.84:0/2307210214 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4a00b65f0 0x7fd4a00b8b00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009230 tx=0x7fd4ac005de0 comp rx=0 tx=0).stop 2024-09-21T03:41:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.328+0000 7fd4be372640 1 -- 172.21.15.84:0/2307210214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4b8103210 msgr2=0x7fd4b8199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.328+0000 7fd4be372640 1 --2- 172.21.15.84:0/2307210214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4b8103210 0x7fd4b8199430 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009860 tx=0x7fd4a8009d20 comp rx=0 tx=0).stop 2024-09-21T03:41:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.328+0000 7fd4be372640 1 -- 172.21.15.84:0/2307210214 shutdown_connections 2024-09-21T03:41:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.328+0000 7fd4be372640 1 --2- 172.21.15.84:0/2307210214 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4a00b65f0 0x7fd4a00b8b00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.328+0000 7fd4be372640 1 --2- 172.21.15.84:0/2307210214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4b8105b70 0x7fd4b819ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.328+0000 7fd4be372640 1 --2- 172.21.15.84:0/2307210214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4b8105220 0x7fd4b81999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.328+0000 7fd4be372640 1 --2- 172.21.15.84:0/2307210214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4b8103210 0x7fd4b8199430 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.328+0000 7fd4be372640 1 -- 172.21.15.84:0/2307210214 >> 172.21.15.84:0/2307210214 conn(0x7fd4b8079ea0 msgr2=0x7fd4b81064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.329+0000 7fd4be372640 1 -- 172.21.15.84:0/2307210214 shutdown_connections 2024-09-21T03:41:33.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:33.329+0000 7fd4be372640 1 -- 172.21.15.84:0/2307210214 wait complete. 2024-09-21T03:41:33.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:33 smithi084 ceph-mon[30941]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:41:33.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:33 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2307210214' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T03:41:33.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:33 smithi174 ceph-mon[34403]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:41:33.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:33 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2307210214' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T03:41:33.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:33 smithi172 ceph-mon[34821]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:41:33.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:33 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2307210214' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T03:41:34.136 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705743 got 38654705746 for osd.0 2024-09-21T03:41:34.136 DEBUG:teuthology.parallel:result is None 2024-09-21T03:41:34.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.591+0000 7eff2e1f1640 1 -- 172.21.15.84:0/2331835930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff28108d00 msgr2=0x7eff2810f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:34.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.591+0000 7eff2e1f1640 1 --2- 172.21.15.84:0/2331835930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff28108d00 0x7eff2810f530 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7eff20009ca0 tx=0x7eff2002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.591+0000 7eff2e1f1640 1 -- 172.21.15.84:0/2331835930 shutdown_connections 2024-09-21T03:41:34.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.591+0000 7eff2e1f1640 1 --2- 172.21.15.84:0/2331835930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff28108d00 0x7eff2810f530 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.591+0000 7eff2e1f1640 1 --2- 172.21.15.84:0/2331835930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff281083b0 0x7eff281087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.591+0000 7eff2e1f1640 1 --2- 172.21.15.84:0/2331835930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff28102a70 0x7eff28102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.591+0000 7eff2e1f1640 1 -- 172.21.15.84:0/2331835930 >> 172.21.15.84:0/2331835930 conn(0x7eff28079710 msgr2=0x7eff28079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:34.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.591+0000 7eff2e1f1640 1 -- 172.21.15.84:0/2331835930 shutdown_connections 2024-09-21T03:41:34.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.591+0000 7eff2e1f1640 1 -- 172.21.15.84:0/2331835930 wait complete. 2024-09-21T03:41:34.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.592+0000 7eff2e1f1640 1 Processor -- start 2024-09-21T03:41:34.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.592+0000 7eff2e1f1640 1 -- start start 2024-09-21T03:41:34.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff2e1f1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff28102a70 0x7eff281993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff2e1f1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff281083b0 0x7eff28199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff2e1f1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff28108d00 0x7eff2819ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff2e1f1640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7eff281129c0 con 0x7eff28108d00 2024-09-21T03:41:34.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff2e1f1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7eff28112840 con 0x7eff28102a70 2024-09-21T03:41:34.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff2e1f1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7eff28112b40 con 0x7eff281083b0 2024-09-21T03:41:34.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff27fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff28108d00 0x7eff2819ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff27fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff28108d00 0x7eff2819ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:32986/0 (socket says 172.21.15.84:32986) 2024-09-21T03:41:34.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff27fff640 1 -- 172.21.15.84:0/422762295 learned_addr learned my addr 172.21.15.84:0/422762295 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:34.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff277fe640 1 --2- 172.21.15.84:0/422762295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff28102a70 0x7eff281993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff26ffd640 1 --2- 172.21.15.84:0/422762295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff281083b0 0x7eff28199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff27fff640 1 -- 172.21.15.84:0/422762295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff281083b0 msgr2=0x7eff28199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:34.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff27fff640 1 --2- 172.21.15.84:0/422762295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff281083b0 0x7eff28199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff27fff640 1 -- 172.21.15.84:0/422762295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff28102a70 msgr2=0x7eff281993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:34.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff27fff640 1 --2- 172.21.15.84:0/422762295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff28102a70 0x7eff281993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff27fff640 1 -- 172.21.15.84:0/422762295 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2819f2a0 con 0x7eff28108d00 2024-09-21T03:41:34.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff27fff640 1 --2- 172.21.15.84:0/422762295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff28108d00 0x7eff2819ec30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7eff20005cc0 tx=0x7eff2002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:34.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff24ff9640 1 -- 172.21.15.84:0/422762295 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff20003bf0 con 0x7eff28108d00 2024-09-21T03:41:34.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff24ff9640 1 -- 172.21.15.84:0/422762295 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff20003d90 con 0x7eff28108d00 2024-09-21T03:41:34.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff24ff9640 1 -- 172.21.15.84:0/422762295 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2002fb20 con 0x7eff28108d00 2024-09-21T03:41:34.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.593+0000 7eff2e1f1640 1 -- 172.21.15.84:0/422762295 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff2819f530 con 0x7eff28108d00 2024-09-21T03:41:34.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.594+0000 7eff2e1f1640 1 -- 172.21.15.84:0/422762295 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff281a5db0 con 0x7eff28108d00 2024-09-21T03:41:34.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.594+0000 7eff2e1f1640 1 -- 172.21.15.84:0/422762295 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff28103cf0 con 0x7eff28108d00 2024-09-21T03:41:34.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.597+0000 7eff24ff9640 1 -- 172.21.15.84:0/422762295 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7eff20004580 con 0x7eff28108d00 2024-09-21T03:41:34.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.598+0000 7eff24ff9640 1 --2- 172.21.15.84:0/422762295 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7eff100b66a0 0x7eff100b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.598+0000 7eff277fe640 1 --2- 172.21.15.84:0/422762295 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7eff100b66a0 0x7eff100b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.598+0000 7eff24ff9640 1 -- 172.21.15.84:0/422762295 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7eff201089a0 con 0x7eff28108d00 2024-09-21T03:41:34.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.598+0000 7eff277fe640 1 --2- 172.21.15.84:0/422762295 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7eff100b66a0 0x7eff100b8bb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7eff1800abe0 tx=0x7eff1800a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:34.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.601+0000 7eff24ff9640 1 -- 172.21.15.84:0/422762295 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7eff200098b0 con 0x7eff28108d00 2024-09-21T03:41:34.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.784+0000 7eff2e1f1640 1 -- 172.21.15.84:0/422762295 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7eff2810aaf0 con 0x7eff28108d00 2024-09-21T03:41:34.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.785+0000 7eff24ff9640 1 -- 172.21.15.84:0/422762295 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7eff200cf030 con 0x7eff28108d00 2024-09-21T03:41:34.787 INFO:teuthology.orchestra.run.smithi084.stdout:77309411400 2024-09-21T03:41:34.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.787+0000 7eff2e1f1640 1 -- 172.21.15.84:0/422762295 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7eff100b66a0 msgr2=0x7eff100b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:34.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.787+0000 7eff2e1f1640 1 --2- 172.21.15.84:0/422762295 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7eff100b66a0 0x7eff100b8bb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7eff1800abe0 tx=0x7eff1800a2d0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.787+0000 7eff2e1f1640 1 -- 172.21.15.84:0/422762295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff28108d00 msgr2=0x7eff2819ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:34.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.787+0000 7eff2e1f1640 1 --2- 172.21.15.84:0/422762295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff28108d00 0x7eff2819ec30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7eff20005cc0 tx=0x7eff2002f380 comp rx=0 tx=0).stop 2024-09-21T03:41:34.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.787+0000 7eff2e1f1640 1 -- 172.21.15.84:0/422762295 shutdown_connections 2024-09-21T03:41:34.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.787+0000 7eff2e1f1640 1 --2- 172.21.15.84:0/422762295 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7eff100b66a0 0x7eff100b8bb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.787+0000 7eff2e1f1640 1 --2- 172.21.15.84:0/422762295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7eff28108d00 0x7eff2819ec30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.787+0000 7eff2e1f1640 1 --2- 172.21.15.84:0/422762295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7eff281083b0 0x7eff28199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.787+0000 7eff2e1f1640 1 --2- 172.21.15.84:0/422762295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff28102a70 0x7eff281993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.787+0000 7eff2e1f1640 1 -- 172.21.15.84:0/422762295 >> 172.21.15.84:0/422762295 conn(0x7eff28079710 msgr2=0x7eff28106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:34.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.787+0000 7eff2e1f1640 1 -- 172.21.15.84:0/422762295 shutdown_connections 2024-09-21T03:41:34.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.787+0000 7eff2e1f1640 1 -- 172.21.15.84:0/422762295 wait complete. 2024-09-21T03:41:34.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.840+0000 7f4433d8c640 1 -- 172.21.15.84:0/3022579950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442c10ddf0 msgr2=0x7f442c110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:34.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.840+0000 7f4433d8c640 1 --2- 172.21.15.84:0/3022579950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442c10ddf0 0x7f442c110300 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4424009ca0 tx=0x7f442402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.840+0000 7f4433d8c640 1 -- 172.21.15.84:0/3022579950 shutdown_connections 2024-09-21T03:41:34.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.840+0000 7f4433d8c640 1 --2- 172.21.15.84:0/3022579950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442c10ddf0 0x7f442c110300 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.840+0000 7f4433d8c640 1 --2- 172.21.15.84:0/3022579950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442c105270 0x7f442c10d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.840+0000 7f4433d8c640 1 --2- 172.21.15.84:0/3022579950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f442c104840 0x7f442c104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.840+0000 7f4433d8c640 1 -- 172.21.15.84:0/3022579950 >> 172.21.15.84:0/3022579950 conn(0x7f442c079730 msgr2=0x7f442c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.840+0000 7f4433d8c640 1 -- 172.21.15.84:0/3022579950 shutdown_connections 2024-09-21T03:41:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.840+0000 7f4433d8c640 1 -- 172.21.15.84:0/3022579950 wait complete. 2024-09-21T03:41:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.841+0000 7f4433d8c640 1 Processor -- start 2024-09-21T03:41:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.841+0000 7f4433d8c640 1 -- start start 2024-09-21T03:41:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.841+0000 7f4433d8c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f442c104840 0x7f442c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.841+0000 7f4433d8c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442c105270 0x7f442c19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.841+0000 7f4433d8c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442c10ddf0 0x7f442c19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.841+0000 7f4433d8c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f442c113a90 con 0x7f442c105270 2024-09-21T03:41:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.841+0000 7f4433d8c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f442c113910 con 0x7f442c10ddf0 2024-09-21T03:41:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.841+0000 7f4433d8c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f442c113c10 con 0x7f442c104840 2024-09-21T03:41:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.841+0000 7f4431327640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442c105270 0x7f442c19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.841+0000 7f4431327640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442c105270 0x7f442c19a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33012/0 (socket says 172.21.15.84:33012) 2024-09-21T03:41:34.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.841+0000 7f4431327640 1 -- 172.21.15.84:0/2621241867 learned_addr learned my addr 172.21.15.84:0/2621241867 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:34.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.841+0000 7f4431b28640 1 --2- 172.21.15.84:0/2621241867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f442c104840 0x7f442c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.842+0000 7f4432329640 1 --2- 172.21.15.84:0/2621241867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442c10ddf0 0x7f442c19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.842+0000 7f4431327640 1 -- 172.21.15.84:0/2621241867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f442c104840 msgr2=0x7f442c19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:34.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.842+0000 7f4431327640 1 --2- 172.21.15.84:0/2621241867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f442c104840 0x7f442c19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.842+0000 7f4431327640 1 -- 172.21.15.84:0/2621241867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442c10ddf0 msgr2=0x7f442c19fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.842+0000 7f4431327640 1 --2- 172.21.15.84:0/2621241867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442c10ddf0 0x7f442c19fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.842+0000 7f4431327640 1 -- 172.21.15.84:0/2621241867 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442c1a0350 con 0x7f442c105270 2024-09-21T03:41:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.842+0000 7f4432329640 1 --2- 172.21.15.84:0/2621241867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442c10ddf0 0x7f442c19fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.842+0000 7f4431327640 1 --2- 172.21.15.84:0/2621241867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442c105270 0x7f442c19a980 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f441c00d950 tx=0x7f441c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.842+0000 7f4422ffd640 1 -- 172.21.15.84:0/2621241867 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c017070 con 0x7f442c105270 2024-09-21T03:41:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.842+0000 7f4422ffd640 1 -- 172.21.15.84:0/2621241867 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f441c009c30 con 0x7f442c105270 2024-09-21T03:41:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.842+0000 7f4433d8c640 1 -- 172.21.15.84:0/2621241867 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442c1a0640 con 0x7f442c105270 2024-09-21T03:41:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.842+0000 7f4422ffd640 1 -- 172.21.15.84:0/2621241867 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c0047a0 con 0x7f442c105270 2024-09-21T03:41:34.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.842+0000 7f4433d8c640 1 -- 172.21.15.84:0/2621241867 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f442c1a6da0 con 0x7f442c105270 2024-09-21T03:41:34.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.843+0000 7f4433d8c640 1 -- 172.21.15.84:0/2621241867 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f442c104c50 con 0x7f442c105270 2024-09-21T03:41:34.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.845+0000 7f4422ffd640 1 -- 172.21.15.84:0/2621241867 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f441c004020 con 0x7f442c105270 2024-09-21T03:41:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.846+0000 7f4422ffd640 1 --2- 172.21.15.84:0/2621241867 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f44180b65f0 0x7f44180b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.846+0000 7f4431b28640 1 --2- 172.21.15.84:0/2621241867 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f44180b65f0 0x7f44180b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.846+0000 7f4422ffd640 1 -- 172.21.15.84:0/2621241867 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f441c0e7640 con 0x7f442c105270 2024-09-21T03:41:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.846+0000 7f4431b28640 1 --2- 172.21.15.84:0/2621241867 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f44180b65f0 0x7f44180b8b00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f442c06bc00 tx=0x7f4428005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:34.849+0000 7f4422ffd640 1 -- 172.21.15.84:0/2621241867 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f441c020020 con 0x7f442c105270 2024-09-21T03:41:35.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:35.030+0000 7f4433d8c640 1 -- 172.21.15.84:0/2621241867 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f442c1a7090 con 0x7f442c105270 2024-09-21T03:41:35.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:35.030+0000 7f4422ffd640 1 -- 172.21.15.84:0/2621241867 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f441c0adcd0 con 0x7f442c105270 2024-09-21T03:41:35.032 INFO:teuthology.orchestra.run.smithi084.stdout:206158430254 2024-09-21T03:41:35.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:35.033+0000 7f4433d8c640 1 -- 172.21.15.84:0/2621241867 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f44180b65f0 msgr2=0x7f44180b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:35.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:35.033+0000 7f4433d8c640 1 --2- 172.21.15.84:0/2621241867 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f44180b65f0 0x7f44180b8b00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f442c06bc00 tx=0x7f4428005f90 comp rx=0 tx=0).stop 2024-09-21T03:41:35.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:35.033+0000 7f4433d8c640 1 -- 172.21.15.84:0/2621241867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442c105270 msgr2=0x7f442c19a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:35.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:35.033+0000 7f4433d8c640 1 --2- 172.21.15.84:0/2621241867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442c105270 0x7f442c19a980 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f441c00d950 tx=0x7f441c00de10 comp rx=0 tx=0).stop 2024-09-21T03:41:35.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:35.034+0000 7f4433d8c640 1 -- 172.21.15.84:0/2621241867 shutdown_connections 2024-09-21T03:41:35.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:35.034+0000 7f4433d8c640 1 --2- 172.21.15.84:0/2621241867 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f44180b65f0 0x7f44180b8b00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:35.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:35.034+0000 7f4433d8c640 1 --2- 172.21.15.84:0/2621241867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f442c10ddf0 0x7f442c19fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:35.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:35.034+0000 7f4433d8c640 1 --2- 172.21.15.84:0/2621241867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f442c105270 0x7f442c19a980 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:35.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:35.034+0000 7f4433d8c640 1 --2- 172.21.15.84:0/2621241867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f442c104840 0x7f442c19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:35.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:35.034+0000 7f4433d8c640 1 -- 172.21.15.84:0/2621241867 >> 172.21.15.84:0/2621241867 conn(0x7f442c079730 msgr2=0x7f442c1062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:35.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:35.034+0000 7f4433d8c640 1 -- 172.21.15.84:0/2621241867 shutdown_connections 2024-09-21T03:41:35.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:35.034+0000 7f4433d8c640 1 -- 172.21.15.84:0/2621241867 wait complete. 2024-09-21T03:41:35.491 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411397 got 77309411400 for osd.2 2024-09-21T03:41:35.491 DEBUG:teuthology.parallel:result is None 2024-09-21T03:41:35.792 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:35 smithi084 ceph-mon[30941]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:41:35.792 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:35 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/422762295' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T03:41:35.792 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:35 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2621241867' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T03:41:35.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:35 smithi174 ceph-mon[34403]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:41:35.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:35 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/422762295' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T03:41:35.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:35 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2621241867' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T03:41:35.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:35 smithi172 ceph-mon[34821]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:41:35.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:35 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/422762295' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T03:41:35.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:35 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2621241867' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T03:41:36.142 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430250 got 206158430254 for osd.7 2024-09-21T03:41:36.142 DEBUG:teuthology.parallel:result is None 2024-09-21T03:41:36.142 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T03:41:36.142 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T03:41:36.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:36 smithi084 ceph-mon[30941]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:41:36.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:36 smithi174 ceph-mon[34403]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:41:36.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:36 smithi172 ceph-mon[34821]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:41:36.909 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:37.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.463+0000 7f131c59a640 1 -- 172.21.15.84:0/3615380109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13141083c0 msgr2=0x7f13141087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:37.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.463+0000 7f131c59a640 1 --2- 172.21.15.84:0/3615380109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13141083c0 0x7f13141087d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1304009900 tx=0x7f130402a410 comp rx=0 tx=0).stop 2024-09-21T03:41:37.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.463+0000 7f131c59a640 1 -- 172.21.15.84:0/3615380109 shutdown_connections 2024-09-21T03:41:37.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.463+0000 7f131c59a640 1 --2- 172.21.15.84:0/3615380109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1314108d10 0x7f131410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:37.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.463+0000 7f131c59a640 1 --2- 172.21.15.84:0/3615380109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13141083c0 0x7f13141087d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:37.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.463+0000 7f131c59a640 1 --2- 172.21.15.84:0/3615380109 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1314102a80 0x7f1314102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:37.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.463+0000 7f131c59a640 1 -- 172.21.15.84:0/3615380109 >> 172.21.15.84:0/3615380109 conn(0x7f1314079740 msgr2=0x7f1314079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:37.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.463+0000 7f131c59a640 1 -- 172.21.15.84:0/3615380109 shutdown_connections 2024-09-21T03:41:37.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.463+0000 7f131c59a640 1 -- 172.21.15.84:0/3615380109 wait complete. 2024-09-21T03:41:37.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.464+0000 7f131c59a640 1 Processor -- start 2024-09-21T03:41:37.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.464+0000 7f131c59a640 1 -- start start 2024-09-21T03:41:37.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.464+0000 7f131c59a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1314102a80 0x7f131419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:37.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.464+0000 7f131c59a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13141083c0 0x7f131419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:37.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.464+0000 7f131c59a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1314108d10 0x7f131419fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:37.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.464+0000 7f131c59a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1314113aa0 con 0x7f1314108d10 2024-09-21T03:41:37.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.464+0000 7f131c59a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1314113920 con 0x7f1314102a80 2024-09-21T03:41:37.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.464+0000 7f131c59a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1314113c20 con 0x7f13141083c0 2024-09-21T03:41:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.464+0000 7f131ab37640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1314108d10 0x7f131419fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.464+0000 7f131ab37640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1314108d10 0x7f131419fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33030/0 (socket says 172.21.15.84:33030) 2024-09-21T03:41:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.464+0000 7f131ab37640 1 -- 172.21.15.84:0/3928224546 learned_addr learned my addr 172.21.15.84:0/3928224546 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.465+0000 7f131a336640 1 --2- 172.21.15.84:0/3928224546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1314102a80 0x7f131419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.465+0000 7f1319b35640 1 --2- 172.21.15.84:0/3928224546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13141083c0 0x7f131419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.465+0000 7f131ab37640 1 -- 172.21.15.84:0/3928224546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13141083c0 msgr2=0x7f131419a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.465+0000 7f131ab37640 1 --2- 172.21.15.84:0/3928224546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13141083c0 0x7f131419a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.465+0000 7f131ab37640 1 -- 172.21.15.84:0/3928224546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1314102a80 msgr2=0x7f131419a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.465+0000 7f131ab37640 1 --2- 172.21.15.84:0/3928224546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1314102a80 0x7f131419a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.465+0000 7f131ab37640 1 -- 172.21.15.84:0/3928224546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13141a0300 con 0x7f1314108d10 2024-09-21T03:41:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.465+0000 7f131a336640 1 --2- 172.21.15.84:0/3928224546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1314102a80 0x7f131419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.465+0000 7f131ab37640 1 --2- 172.21.15.84:0/3928224546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1314108d10 0x7f131419fc90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f130c00eaa0 tx=0x7f130c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.465+0000 7f130b7fe640 1 -- 172.21.15.84:0/3928224546 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130c00cdb0 con 0x7f1314108d10 2024-09-21T03:41:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.465+0000 7f130b7fe640 1 -- 172.21.15.84:0/3928224546 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f130c005020 con 0x7f1314108d10 2024-09-21T03:41:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.465+0000 7f130b7fe640 1 -- 172.21.15.84:0/3928224546 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130c0116d0 con 0x7f1314108d10 2024-09-21T03:41:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.465+0000 7f131c59a640 1 -- 172.21.15.84:0/3928224546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13141a05f0 con 0x7f1314108d10 2024-09-21T03:41:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.465+0000 7f131c59a640 1 -- 172.21.15.84:0/3928224546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13141a6e10 con 0x7f1314108d10 2024-09-21T03:41:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.466+0000 7f131c59a640 1 -- 172.21.15.84:0/3928224546 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1314103d00 con 0x7f1314108d10 2024-09-21T03:41:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.468+0000 7f130b7fe640 1 -- 172.21.15.84:0/3928224546 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f130c0051d0 con 0x7f1314108d10 2024-09-21T03:41:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.468+0000 7f130b7fe640 1 --2- 172.21.15.84:0/3928224546 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f13000b6620 0x7f13000b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.469+0000 7f131a336640 1 --2- 172.21.15.84:0/3928224546 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f13000b6620 0x7f13000b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.469+0000 7f130b7fe640 1 -- 172.21.15.84:0/3928224546 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f130c0e7c10 con 0x7f1314108d10 2024-09-21T03:41:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.469+0000 7f131a336640 1 --2- 172.21.15.84:0/3928224546 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f13000b6620 0x7f13000b8b30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f131000baa0 tx=0x7f1310005d90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.472+0000 7f130b7fe640 1 -- 172.21.15.84:0/3928224546 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f130c016030 con 0x7f1314108d10 2024-09-21T03:41:37.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.661+0000 7f131c59a640 1 -- 172.21.15.84:0/3928224546 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1314063800 con 0x7f13000b6620 2024-09-21T03:41:37.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.666+0000 7f130b7fe640 1 -- 172.21.15.84:0/3928224546 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258980 (secure 0 0 0) 0x7f1314063800 con 0x7f13000b6620 2024-09-21T03:41:37.670 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:41:37.671 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T03:41:37.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.670+0000 7f131c59a640 1 -- 172.21.15.84:0/3928224546 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f13000b6620 msgr2=0x7f13000b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:37.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.670+0000 7f131c59a640 1 --2- 172.21.15.84:0/3928224546 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f13000b6620 0x7f13000b8b30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f131000baa0 tx=0x7f1310005d90 comp rx=0 tx=0).stop 2024-09-21T03:41:37.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.670+0000 7f131c59a640 1 -- 172.21.15.84:0/3928224546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1314108d10 msgr2=0x7f131419fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:37.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.670+0000 7f131c59a640 1 --2- 172.21.15.84:0/3928224546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1314108d10 0x7f131419fc90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f130c00eaa0 tx=0x7f130c00ef60 comp rx=0 tx=0).stop 2024-09-21T03:41:37.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.670+0000 7f131c59a640 1 -- 172.21.15.84:0/3928224546 shutdown_connections 2024-09-21T03:41:37.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.670+0000 7f131c59a640 1 --2- 172.21.15.84:0/3928224546 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f13000b6620 0x7f13000b8b30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:37.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.670+0000 7f131c59a640 1 --2- 172.21.15.84:0/3928224546 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1314108d10 0x7f131419fc90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:37.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.670+0000 7f131c59a640 1 --2- 172.21.15.84:0/3928224546 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13141083c0 0x7f131419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:37.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.670+0000 7f131c59a640 1 --2- 172.21.15.84:0/3928224546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1314102a80 0x7f131419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:37.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.670+0000 7f131c59a640 1 -- 172.21.15.84:0/3928224546 >> 172.21.15.84:0/3928224546 conn(0x7f1314079740 msgr2=0x7f13141052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:37.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.670+0000 7f131c59a640 1 -- 172.21.15.84:0/3928224546 shutdown_connections 2024-09-21T03:41:37.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:37.670+0000 7f131c59a640 1 -- 172.21.15.84:0/3928224546 wait complete. 2024-09-21T03:41:38.422 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2024-09-21T03:41:36.294666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657952,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":417,"num_read_kb":311,"num_write":284,"num_write_kb":2265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":2952987,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376244,"kb_used_data":10320,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565580,"statfs":{"total":1151940427776,"available":1151555153920,"internally_reserved":0,"allocated":10567680,"data_stored":6959316,"data_compressed":181959,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003553"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467399+0000","last_change":"2024-09-21T03:40:29.337467+0000","last_active":"2024-09-21T03:40:51.467399+0000","last_peered":"2024-09-21T03:40:51.467399+0000","last_clean":"2024-09-21T03:40:51.467399+0000","last_became_active":"2024-09-21T03:40:29.337102+0000","last_became_peered":"2024-09-21T03:40:29.337102+0000","last_unstale":"2024-09-21T03:40:51.467399+0000","last_undegraded":"2024-09-21T03:40:51.467399+0000","last_fullsized":"2024-09-21T03:40:51.467399+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:53.798977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469953+0000","last_change":"2024-09-21T03:40:29.336446+0000","last_active":"2024-09-21T03:40:51.469953+0000","last_peered":"2024-09-21T03:40:51.469953+0000","last_clean":"2024-09-21T03:40:51.469953+0000","last_became_active":"2024-09-21T03:40:29.336081+0000","last_became_peered":"2024-09-21T03:40:29.336081+0000","last_unstale":"2024-09-21T03:40:51.469953+0000","last_undegraded":"2024-09-21T03:40:51.469953+0000","last_fullsized":"2024-09-21T03:40:51.469953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:23.892700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470293+0000","last_change":"2024-09-21T03:40:29.342861+0000","last_active":"2024-09-21T03:40:51.470293+0000","last_peered":"2024-09-21T03:40:51.470293+0000","last_clean":"2024-09-21T03:40:51.470293+0000","last_became_active":"2024-09-21T03:40:29.342111+0000","last_became_peered":"2024-09-21T03:40:29.342111+0000","last_unstale":"2024-09-21T03:40:51.470293+0000","last_undegraded":"2024-09-21T03:40:51.470293+0000","last_fullsized":"2024-09-21T03:40:51.470293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:30.012195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.635710+0000","last_change":"2024-09-21T03:40:29.339822+0000","last_active":"2024-09-21T03:40:51.635710+0000","last_peered":"2024-09-21T03:40:51.635710+0000","last_clean":"2024-09-21T03:40:51.635710+0000","last_became_active":"2024-09-21T03:40:29.339126+0000","last_became_peered":"2024-09-21T03:40:29.339126+0000","last_unstale":"2024-09-21T03:40:51.635710+0000","last_undegraded":"2024-09-21T03:40:51.635710+0000","last_fullsized":"2024-09-21T03:40:51.635710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:44.874344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470141+0000","last_change":"2024-09-21T03:40:29.333683+0000","last_active":"2024-09-21T03:40:51.470141+0000","last_peered":"2024-09-21T03:40:51.470141+0000","last_clean":"2024-09-21T03:40:51.470141+0000","last_became_active":"2024-09-21T03:40:29.333329+0000","last_became_peered":"2024-09-21T03:40:29.333329+0000","last_unstale":"2024-09-21T03:40:51.470141+0000","last_undegraded":"2024-09-21T03:40:51.470141+0000","last_fullsized":"2024-09-21T03:40:51.470141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:42.655732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468828+0000","last_change":"2024-09-21T03:40:29.346193+0000","last_active":"2024-09-21T03:40:51.468828+0000","last_peered":"2024-09-21T03:40:51.468828+0000","last_clean":"2024-09-21T03:40:51.468828+0000","last_became_active":"2024-09-21T03:40:29.345808+0000","last_became_peered":"2024-09-21T03:40:29.345808+0000","last_unstale":"2024-09-21T03:40:51.468828+0000","last_undegraded":"2024-09-21T03:40:51.468828+0000","last_fullsized":"2024-09-21T03:40:51.468828+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:59.621904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464272+0000","last_change":"2024-09-21T03:40:29.337782+0000","last_active":"2024-09-21T03:40:51.464272+0000","last_peered":"2024-09-21T03:40:51.464272+0000","last_clean":"2024-09-21T03:40:51.464272+0000","last_became_active":"2024-09-21T03:40:29.337390+0000","last_became_peered":"2024-09-21T03:40:29.337390+0000","last_unstale":"2024-09-21T03:40:51.464272+0000","last_undegraded":"2024-09-21T03:40:51.464272+0000","last_fullsized":"2024-09-21T03:40:51.464272+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:49.924375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463416+0000","last_change":"2024-09-21T03:40:29.340821+0000","last_active":"2024-09-21T03:40:51.463416+0000","last_peered":"2024-09-21T03:40:51.463416+0000","last_clean":"2024-09-21T03:40:51.463416+0000","last_became_active":"2024-09-21T03:40:29.340465+0000","last_became_peered":"2024-09-21T03:40:29.340465+0000","last_unstale":"2024-09-21T03:40:51.463416+0000","last_undegraded":"2024-09-21T03:40:51.463416+0000","last_fullsized":"2024-09-21T03:40:51.463416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:18.600335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467779+0000","last_change":"2024-09-21T03:40:29.345218+0000","last_active":"2024-09-21T03:40:51.467779+0000","last_peered":"2024-09-21T03:40:51.467779+0000","last_clean":"2024-09-21T03:40:51.467779+0000","last_became_active":"2024-09-21T03:40:29.344862+0000","last_became_peered":"2024-09-21T03:40:29.344862+0000","last_unstale":"2024-09-21T03:40:51.467779+0000","last_undegraded":"2024-09-21T03:40:51.467779+0000","last_fullsized":"2024-09-21T03:40:51.467779+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:53.570489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.471722+0000","last_change":"2024-09-21T03:40:51.471622+0000","last_active":"2024-09-21T03:40:51.471722+0000","last_peered":"2024-09-21T03:40:51.471722+0000","last_clean":"2024-09-21T03:40:51.471722+0000","last_became_active":"2024-09-21T03:40:51.471276+0000","last_became_peered":"2024-09-21T03:40:51.471276+0000","last_unstale":"2024-09-21T03:40:51.471722+0000","last_undegraded":"2024-09-21T03:40:51.471722+0000","last_fullsized":"2024-09-21T03:40:51.471722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:38.030634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464696+0000","last_change":"2024-09-21T03:40:29.338353+0000","last_active":"2024-09-21T03:40:51.464696+0000","last_peered":"2024-09-21T03:40:51.464696+0000","last_clean":"2024-09-21T03:40:51.464696+0000","last_became_active":"2024-09-21T03:40:29.337976+0000","last_became_peered":"2024-09-21T03:40:29.337976+0000","last_unstale":"2024-09-21T03:40:51.464696+0000","last_undegraded":"2024-09-21T03:40:51.464696+0000","last_fullsized":"2024-09-21T03:40:51.464696+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:10.182045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.635865+0000","last_change":"2024-09-21T03:40:29.343617+0000","last_active":"2024-09-21T03:40:51.635865+0000","last_peered":"2024-09-21T03:40:51.635865+0000","last_clean":"2024-09-21T03:40:51.635865+0000","last_became_active":"2024-09-21T03:40:29.342586+0000","last_became_peered":"2024-09-21T03:40:29.342586+0000","last_unstale":"2024-09-21T03:40:51.635865+0000","last_undegraded":"2024-09-21T03:40:51.635865+0000","last_fullsized":"2024-09-21T03:40:51.635865+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:06.823802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780499+0000","last_change":"2024-09-21T03:40:29.338633+0000","last_active":"2024-09-21T03:40:51.780499+0000","last_peered":"2024-09-21T03:40:51.780499+0000","last_clean":"2024-09-21T03:40:51.780499+0000","last_became_active":"2024-09-21T03:40:29.337502+0000","last_became_peered":"2024-09-21T03:40:29.337502+0000","last_unstale":"2024-09-21T03:40:51.780499+0000","last_undegraded":"2024-09-21T03:40:51.780499+0000","last_fullsized":"2024-09-21T03:40:51.780499+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:04.121275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469621+0000","last_change":"2024-09-21T03:40:29.335774+0000","last_active":"2024-09-21T03:40:51.469621+0000","last_peered":"2024-09-21T03:40:51.469621+0000","last_clean":"2024-09-21T03:40:51.469621+0000","last_became_active":"2024-09-21T03:40:29.335452+0000","last_became_peered":"2024-09-21T03:40:29.335452+0000","last_unstale":"2024-09-21T03:40:51.469621+0000","last_undegraded":"2024-09-21T03:40:51.469621+0000","last_fullsized":"2024-09-21T03:40:51.469621+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:37.427015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469467+0000","last_change":"2024-09-21T03:40:29.342874+0000","last_active":"2024-09-21T03:40:51.469467+0000","last_peered":"2024-09-21T03:40:51.469467+0000","last_clean":"2024-09-21T03:40:51.469467+0000","last_became_active":"2024-09-21T03:40:29.342343+0000","last_became_peered":"2024-09-21T03:40:29.342343+0000","last_unstale":"2024-09-21T03:40:51.469467+0000","last_undegraded":"2024-09-21T03:40:51.469467+0000","last_fullsized":"2024-09-21T03:40:51.469467+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:52.473608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467076+0000","last_change":"2024-09-21T03:40:29.339231+0000","last_active":"2024-09-21T03:40:51.467076+0000","last_peered":"2024-09-21T03:40:51.467076+0000","last_clean":"2024-09-21T03:40:51.467076+0000","last_became_active":"2024-09-21T03:40:29.338724+0000","last_became_peered":"2024-09-21T03:40:29.338724+0000","last_unstale":"2024-09-21T03:40:51.467076+0000","last_undegraded":"2024-09-21T03:40:51.467076+0000","last_fullsized":"2024-09-21T03:40:51.467076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:55.592713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467451+0000","last_change":"2024-09-21T03:40:29.338480+0000","last_active":"2024-09-21T03:40:51.467451+0000","last_peered":"2024-09-21T03:40:51.467451+0000","last_clean":"2024-09-21T03:40:51.467451+0000","last_became_active":"2024-09-21T03:40:29.338092+0000","last_became_peered":"2024-09-21T03:40:29.338092+0000","last_unstale":"2024-09-21T03:40:51.467451+0000","last_undegraded":"2024-09-21T03:40:51.467451+0000","last_fullsized":"2024-09-21T03:40:51.467451+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:25.557502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470765+0000","last_change":"2024-09-21T03:40:29.335557+0000","last_active":"2024-09-21T03:40:51.470765+0000","last_peered":"2024-09-21T03:40:51.470765+0000","last_clean":"2024-09-21T03:40:51.470765+0000","last_became_active":"2024-09-21T03:40:29.335214+0000","last_became_peered":"2024-09-21T03:40:29.335214+0000","last_unstale":"2024-09-21T03:40:51.470765+0000","last_undegraded":"2024-09-21T03:40:51.470765+0000","last_fullsized":"2024-09-21T03:40:51.470765+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:21.395995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467706+0000","last_change":"2024-09-21T03:40:29.333041+0000","last_active":"2024-09-21T03:40:51.467706+0000","last_peered":"2024-09-21T03:40:51.467706+0000","last_clean":"2024-09-21T03:40:51.467706+0000","last_became_active":"2024-09-21T03:40:29.332187+0000","last_became_peered":"2024-09-21T03:40:29.332187+0000","last_unstale":"2024-09-21T03:40:51.467706+0000","last_undegraded":"2024-09-21T03:40:51.467706+0000","last_fullsized":"2024-09-21T03:40:51.467706+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:03.253594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.466928+0000","last_change":"2024-09-21T03:40:29.339152+0000","last_active":"2024-09-21T03:40:51.466928+0000","last_peered":"2024-09-21T03:40:51.466928+0000","last_clean":"2024-09-21T03:40:51.466928+0000","last_became_active":"2024-09-21T03:40:29.338722+0000","last_became_peered":"2024-09-21T03:40:29.338722+0000","last_unstale":"2024-09-21T03:40:51.466928+0000","last_undegraded":"2024-09-21T03:40:51.466928+0000","last_fullsized":"2024-09-21T03:40:51.466928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:32.143498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780525+0000","last_change":"2024-09-21T03:40:29.329169+0000","last_active":"2024-09-21T03:40:51.780525+0000","last_peered":"2024-09-21T03:40:51.780525+0000","last_clean":"2024-09-21T03:40:51.780525+0000","last_became_active":"2024-09-21T03:40:29.328805+0000","last_became_peered":"2024-09-21T03:40:29.328805+0000","last_unstale":"2024-09-21T03:40:51.780525+0000","last_undegraded":"2024-09-21T03:40:51.780525+0000","last_fullsized":"2024-09-21T03:40:51.780525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:13.725038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467313+0000","last_change":"2024-09-21T03:40:29.336699+0000","last_active":"2024-09-21T03:40:51.467313+0000","last_peered":"2024-09-21T03:40:51.467313+0000","last_clean":"2024-09-21T03:40:51.467313+0000","last_became_active":"2024-09-21T03:40:29.333649+0000","last_became_peered":"2024-09-21T03:40:29.333649+0000","last_unstale":"2024-09-21T03:40:51.467313+0000","last_undegraded":"2024-09-21T03:40:51.467313+0000","last_fullsized":"2024-09-21T03:40:51.467313+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:49.418205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463479+0000","last_change":"2024-09-21T03:40:29.337936+0000","last_active":"2024-09-21T03:40:51.463479+0000","last_peered":"2024-09-21T03:40:51.463479+0000","last_clean":"2024-09-21T03:40:51.463479+0000","last_became_active":"2024-09-21T03:40:29.337521+0000","last_became_peered":"2024-09-21T03:40:29.337521+0000","last_unstale":"2024-09-21T03:40:51.463479+0000","last_undegraded":"2024-09-21T03:40:51.463479+0000","last_fullsized":"2024-09-21T03:40:51.463479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:09.223634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464197+0000","last_change":"2024-09-21T03:40:29.336866+0000","last_active":"2024-09-21T03:40:51.464197+0000","last_peered":"2024-09-21T03:40:51.464197+0000","last_clean":"2024-09-21T03:40:51.464197+0000","last_became_active":"2024-09-21T03:40:29.336447+0000","last_became_peered":"2024-09-21T03:40:29.336447+0000","last_unstale":"2024-09-21T03:40:51.464197+0000","last_undegraded":"2024-09-21T03:40:51.464197+0000","last_fullsized":"2024-09-21T03:40:51.464197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:53.487678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463782+0000","last_change":"2024-09-21T03:40:29.333666+0000","last_active":"2024-09-21T03:40:51.463782+0000","last_peered":"2024-09-21T03:40:51.463782+0000","last_clean":"2024-09-21T03:40:51.463782+0000","last_became_active":"2024-09-21T03:40:29.333248+0000","last_became_peered":"2024-09-21T03:40:29.333248+0000","last_unstale":"2024-09-21T03:40:51.463782+0000","last_undegraded":"2024-09-21T03:40:51.463782+0000","last_fullsized":"2024-09-21T03:40:51.463782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:54.721926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467995+0000","last_change":"2024-09-21T03:40:29.342165+0000","last_active":"2024-09-21T03:40:51.467995+0000","last_peered":"2024-09-21T03:40:51.467995+0000","last_clean":"2024-09-21T03:40:51.467995+0000","last_became_active":"2024-09-21T03:40:29.341744+0000","last_became_peered":"2024-09-21T03:40:29.341744+0000","last_unstale":"2024-09-21T03:40:51.467995+0000","last_undegraded":"2024-09-21T03:40:51.467995+0000","last_fullsized":"2024-09-21T03:40:51.467995+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:04.641927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467072+0000","last_change":"2024-09-21T03:40:29.341728+0000","last_active":"2024-09-21T03:40:51.467072+0000","last_peered":"2024-09-21T03:40:51.467072+0000","last_clean":"2024-09-21T03:40:51.467072+0000","last_became_active":"2024-09-21T03:40:29.339252+0000","last_became_peered":"2024-09-21T03:40:29.339252+0000","last_unstale":"2024-09-21T03:40:51.467072+0000","last_undegraded":"2024-09-21T03:40:51.467072+0000","last_fullsized":"2024-09-21T03:40:51.467072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:53.618128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780271+0000","last_change":"2024-09-21T03:40:29.326893+0000","last_active":"2024-09-21T03:40:51.780271+0000","last_peered":"2024-09-21T03:40:51.780271+0000","last_clean":"2024-09-21T03:40:51.780271+0000","last_became_active":"2024-09-21T03:40:29.326427+0000","last_became_peered":"2024-09-21T03:40:29.326427+0000","last_unstale":"2024-09-21T03:40:51.780271+0000","last_undegraded":"2024-09-21T03:40:51.780271+0000","last_fullsized":"2024-09-21T03:40:51.780271+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:41.036179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469836+0000","last_change":"2024-09-21T03:40:29.340410+0000","last_active":"2024-09-21T03:40:51.469836+0000","last_peered":"2024-09-21T03:40:51.469836+0000","last_clean":"2024-09-21T03:40:51.469836+0000","last_became_active":"2024-09-21T03:40:29.340062+0000","last_became_peered":"2024-09-21T03:40:29.340062+0000","last_unstale":"2024-09-21T03:40:51.469836+0000","last_undegraded":"2024-09-21T03:40:51.469836+0000","last_fullsized":"2024-09-21T03:40:51.469836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:44.971145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467557+0000","last_change":"2024-09-21T03:40:29.333387+0000","last_active":"2024-09-21T03:40:51.467557+0000","last_peered":"2024-09-21T03:40:51.467557+0000","last_clean":"2024-09-21T03:40:51.467557+0000","last_became_active":"2024-09-21T03:40:29.332511+0000","last_became_peered":"2024-09-21T03:40:29.332511+0000","last_unstale":"2024-09-21T03:40:51.467557+0000","last_undegraded":"2024-09-21T03:40:51.467557+0000","last_fullsized":"2024-09-21T03:40:51.467557+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:24.513267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468408+0000","last_change":"2024-09-21T03:40:29.337845+0000","last_active":"2024-09-21T03:40:51.468408+0000","last_peered":"2024-09-21T03:40:51.468408+0000","last_clean":"2024-09-21T03:40:51.468408+0000","last_became_active":"2024-09-21T03:40:29.337387+0000","last_became_peered":"2024-09-21T03:40:29.337387+0000","last_unstale":"2024-09-21T03:40:51.468408+0000","last_undegraded":"2024-09-21T03:40:51.468408+0000","last_fullsized":"2024-09-21T03:40:51.468408+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:31.398337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.466847+0000","last_change":"2024-09-21T03:40:29.342691+0000","last_active":"2024-09-21T03:40:51.466847+0000","last_peered":"2024-09-21T03:40:51.466847+0000","last_clean":"2024-09-21T03:40:51.466847+0000","last_became_active":"2024-09-21T03:40:29.342294+0000","last_became_peered":"2024-09-21T03:40:29.342294+0000","last_unstale":"2024-09-21T03:40:51.466847+0000","last_undegraded":"2024-09-21T03:40:51.466847+0000","last_fullsized":"2024-09-21T03:40:51.466847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:25.806074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470482+0000","last_change":"2024-09-21T03:40:29.338280+0000","last_active":"2024-09-21T03:40:51.470482+0000","last_peered":"2024-09-21T03:40:51.470482+0000","last_clean":"2024-09-21T03:40:51.470482+0000","last_became_active":"2024-09-21T03:40:29.337825+0000","last_became_peered":"2024-09-21T03:40:29.337825+0000","last_unstale":"2024-09-21T03:40:51.470482+0000","last_undegraded":"2024-09-21T03:40:51.470482+0000","last_fullsized":"2024-09-21T03:40:51.470482+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:43.340248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:30.697857+0000","last_change":"2024-09-21T03:40:51.641130+0000","last_active":"2024-09-21T03:41:30.697857+0000","last_peered":"2024-09-21T03:41:30.697857+0000","last_clean":"2024-09-21T03:41:30.697857+0000","last_became_active":"2024-09-21T03:40:51.636641+0000","last_became_peered":"2024-09-21T03:40:51.636641+0000","last_unstale":"2024-09-21T03:41:30.697857+0000","last_undegraded":"2024-09-21T03:41:30.697857+0000","last_fullsized":"2024-09-21T03:41:30.697857+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:34.797959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":47,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464518+0000","last_change":"2024-09-21T03:40:29.341830+0000","last_active":"2024-09-21T03:40:51.464518+0000","last_peered":"2024-09-21T03:40:51.464518+0000","last_clean":"2024-09-21T03:40:51.464518+0000","last_became_active":"2024-09-21T03:40:29.341112+0000","last_became_peered":"2024-09-21T03:40:29.341112+0000","last_unstale":"2024-09-21T03:40:51.464518+0000","last_undegraded":"2024-09-21T03:40:51.464518+0000","last_fullsized":"2024-09-21T03:40:51.464518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:31.560605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468958+0000","last_change":"2024-09-21T03:40:27.319393+0000","last_active":"2024-09-21T03:40:51.468958+0000","last_peered":"2024-09-21T03:40:51.468958+0000","last_clean":"2024-09-21T03:40:51.468958+0000","last_became_active":"2024-09-21T03:40:27.319000+0000","last_became_peered":"2024-09-21T03:40:27.319000+0000","last_unstale":"2024-09-21T03:40:51.468958+0000","last_undegraded":"2024-09-21T03:40:51.468958+0000","last_fullsized":"2024-09-21T03:40:51.468958+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:24.752295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780193+0000","last_change":"2024-09-21T03:40:27.317276+0000","last_active":"2024-09-21T03:40:51.780193+0000","last_peered":"2024-09-21T03:40:51.780193+0000","last_clean":"2024-09-21T03:40:51.780193+0000","last_became_active":"2024-09-21T03:40:27.316955+0000","last_became_peered":"2024-09-21T03:40:27.316955+0000","last_unstale":"2024-09-21T03:40:51.780193+0000","last_undegraded":"2024-09-21T03:40:51.780193+0000","last_fullsized":"2024-09-21T03:40:51.780193+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:23.208493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463471+0000","last_change":"2024-09-21T03:40:29.324774+0000","last_active":"2024-09-21T03:40:51.463471+0000","last_peered":"2024-09-21T03:40:51.463471+0000","last_clean":"2024-09-21T03:40:51.463471+0000","last_became_active":"2024-09-21T03:40:29.324107+0000","last_became_peered":"2024-09-21T03:40:29.324107+0000","last_unstale":"2024-09-21T03:40:51.463471+0000","last_undegraded":"2024-09-21T03:40:51.463471+0000","last_fullsized":"2024-09-21T03:40:51.463471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:15.408620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464393+0000","last_change":"2024-09-21T03:40:27.316818+0000","last_active":"2024-09-21T03:40:51.464393+0000","last_peered":"2024-09-21T03:40:51.464393+0000","last_clean":"2024-09-21T03:40:51.464393+0000","last_became_active":"2024-09-21T03:40:27.316209+0000","last_became_peered":"2024-09-21T03:40:27.316209+0000","last_unstale":"2024-09-21T03:40:51.464393+0000","last_undegraded":"2024-09-21T03:40:51.464393+0000","last_fullsized":"2024-09-21T03:40:51.464393+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:01.869684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470071+0000","last_change":"2024-09-21T03:40:29.335033+0000","last_active":"2024-09-21T03:40:51.470071+0000","last_peered":"2024-09-21T03:40:51.470071+0000","last_clean":"2024-09-21T03:40:51.470071+0000","last_became_active":"2024-09-21T03:40:29.334607+0000","last_became_peered":"2024-09-21T03:40:29.334607+0000","last_unstale":"2024-09-21T03:40:51.470071+0000","last_undegraded":"2024-09-21T03:40:51.470071+0000","last_fullsized":"2024-09-21T03:40:51.470071+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:05.892248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":80,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:31.698913+0000","last_change":"2024-09-21T03:40:27.319422+0000","last_active":"2024-09-21T03:41:31.698913+0000","last_peered":"2024-09-21T03:41:31.698913+0000","last_clean":"2024-09-21T03:41:31.698913+0000","last_became_active":"2024-09-21T03:40:27.318970+0000","last_became_peered":"2024-09-21T03:40:27.318970+0000","last_unstale":"2024-09-21T03:41:31.698913+0000","last_undegraded":"2024-09-21T03:41:31.698913+0000","last_fullsized":"2024-09-21T03:41:31.698913+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:04.263789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467619+0000","last_change":"2024-09-21T03:40:29.334279+0000","last_active":"2024-09-21T03:40:51.467619+0000","last_peered":"2024-09-21T03:40:51.467619+0000","last_clean":"2024-09-21T03:40:51.467619+0000","last_became_active":"2024-09-21T03:40:29.333445+0000","last_became_peered":"2024-09-21T03:40:29.333445+0000","last_unstale":"2024-09-21T03:40:51.467619+0000","last_undegraded":"2024-09-21T03:40:51.467619+0000","last_fullsized":"2024-09-21T03:40:51.467619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:10.445162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.643258+0000","last_change":"2024-09-21T03:40:51.643129+0000","last_active":"2024-09-21T03:40:51.643258+0000","last_peered":"2024-09-21T03:40:51.643258+0000","last_clean":"2024-09-21T03:40:51.643258+0000","last_became_active":"2024-09-21T03:40:51.637136+0000","last_became_peered":"2024-09-21T03:40:51.637136+0000","last_unstale":"2024-09-21T03:40:51.643258+0000","last_undegraded":"2024-09-21T03:40:51.643258+0000","last_fullsized":"2024-09-21T03:40:51.643258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:39.540452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470202+0000","last_change":"2024-09-21T03:40:29.340393+0000","last_active":"2024-09-21T03:40:51.470202+0000","last_peered":"2024-09-21T03:40:51.470202+0000","last_clean":"2024-09-21T03:40:51.470202+0000","last_became_active":"2024-09-21T03:40:29.340042+0000","last_became_peered":"2024-09-21T03:40:29.340042+0000","last_unstale":"2024-09-21T03:40:51.470202+0000","last_undegraded":"2024-09-21T03:40:51.470202+0000","last_fullsized":"2024-09-21T03:40:51.470202+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:43.794252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464730+0000","last_change":"2024-09-21T03:40:27.526458+0000","last_active":"2024-09-21T03:40:51.464730+0000","last_peered":"2024-09-21T03:40:51.464730+0000","last_clean":"2024-09-21T03:40:51.464730+0000","last_became_active":"2024-09-21T03:40:27.525918+0000","last_became_peered":"2024-09-21T03:40:27.525918+0000","last_unstale":"2024-09-21T03:40:51.464730+0000","last_undegraded":"2024-09-21T03:40:51.464730+0000","last_fullsized":"2024-09-21T03:40:51.464730+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:47.286475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467301+0000","last_change":"2024-09-21T03:40:29.338197+0000","last_active":"2024-09-21T03:40:51.467301+0000","last_peered":"2024-09-21T03:40:51.467301+0000","last_clean":"2024-09-21T03:40:51.467301+0000","last_became_active":"2024-09-21T03:40:29.337852+0000","last_became_peered":"2024-09-21T03:40:29.337852+0000","last_unstale":"2024-09-21T03:40:51.467301+0000","last_undegraded":"2024-09-21T03:40:51.467301+0000","last_fullsized":"2024-09-21T03:40:51.467301+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:09.132407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'26","reported_seq":165,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:32.700425+0000","last_change":"2024-09-21T03:40:27.320891+0000","last_active":"2024-09-21T03:41:32.700425+0000","last_peered":"2024-09-21T03:41:32.700425+0000","last_clean":"2024-09-21T03:41:32.700425+0000","last_became_active":"2024-09-21T03:40:27.320512+0000","last_became_peered":"2024-09-21T03:40:27.320512+0000","last_unstale":"2024-09-21T03:41:32.700425+0000","last_undegraded":"2024-09-21T03:41:32.700425+0000","last_fullsized":"2024-09-21T03:41:32.700425+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:27.181130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63349,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":119,"num_write":27,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470843+0000","last_change":"2024-09-21T03:40:29.335570+0000","last_active":"2024-09-21T03:40:51.470843+0000","last_peered":"2024-09-21T03:40:51.470843+0000","last_clean":"2024-09-21T03:40:51.470843+0000","last_became_active":"2024-09-21T03:40:29.335226+0000","last_became_peered":"2024-09-21T03:40:29.335226+0000","last_unstale":"2024-09-21T03:40:51.470843+0000","last_undegraded":"2024-09-21T03:40:51.470843+0000","last_fullsized":"2024-09-21T03:40:51.470843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:56.434945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468293+0000","last_change":"2024-09-21T03:40:27.318436+0000","last_active":"2024-09-21T03:40:51.468293+0000","last_peered":"2024-09-21T03:40:51.468293+0000","last_clean":"2024-09-21T03:40:51.468293+0000","last_became_active":"2024-09-21T03:40:27.317969+0000","last_became_peered":"2024-09-21T03:40:27.317969+0000","last_unstale":"2024-09-21T03:40:51.468293+0000","last_undegraded":"2024-09-21T03:40:51.468293+0000","last_fullsized":"2024-09-21T03:40:51.468293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:43.137717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780149+0000","last_change":"2024-09-21T03:40:29.325824+0000","last_active":"2024-09-21T03:40:51.780149+0000","last_peered":"2024-09-21T03:40:51.780149+0000","last_clean":"2024-09-21T03:40:51.780149+0000","last_became_active":"2024-09-21T03:40:29.325498+0000","last_became_peered":"2024-09-21T03:40:29.325498+0000","last_unstale":"2024-09-21T03:40:51.780149+0000","last_undegraded":"2024-09-21T03:40:51.780149+0000","last_fullsized":"2024-09-21T03:40:51.780149+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:13.044835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464366+0000","last_change":"2024-09-21T03:40:27.308889+0000","last_active":"2024-09-21T03:40:51.464366+0000","last_peered":"2024-09-21T03:40:51.464366+0000","last_clean":"2024-09-21T03:40:51.464366+0000","last_became_active":"2024-09-21T03:40:27.308491+0000","last_became_peered":"2024-09-21T03:40:27.308491+0000","last_unstale":"2024-09-21T03:40:51.464366+0000","last_undegraded":"2024-09-21T03:40:51.464366+0000","last_fullsized":"2024-09-21T03:40:51.464366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:48.250898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.781387+0000","last_change":"2024-09-21T03:40:51.781287+0000","last_active":"2024-09-21T03:40:51.781387+0000","last_peered":"2024-09-21T03:40:51.781387+0000","last_clean":"2024-09-21T03:40:51.781387+0000","last_became_active":"2024-09-21T03:40:51.780925+0000","last_became_peered":"2024-09-21T03:40:51.780925+0000","last_unstale":"2024-09-21T03:40:51.781387+0000","last_undegraded":"2024-09-21T03:40:51.781387+0000","last_fullsized":"2024-09-21T03:40:51.781387+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:36.599949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'3","reported_seq":80,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:29.508113+0000","last_change":"2024-09-21T03:40:27.316066+0000","last_active":"2024-09-21T03:41:29.508113+0000","last_peered":"2024-09-21T03:41:29.508113+0000","last_clean":"2024-09-21T03:41:29.508113+0000","last_became_active":"2024-09-21T03:40:27.315580+0000","last_became_peered":"2024-09-21T03:40:27.315580+0000","last_unstale":"2024-09-21T03:41:29.508113+0000","last_undegraded":"2024-09-21T03:41:29.508113+0000","last_fullsized":"2024-09-21T03:41:29.508113+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:14.592824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464178+0000","last_change":"2024-09-21T03:40:29.339736+0000","last_active":"2024-09-21T03:40:51.464178+0000","last_peered":"2024-09-21T03:40:51.464178+0000","last_clean":"2024-09-21T03:40:51.464178+0000","last_became_active":"2024-09-21T03:40:29.338343+0000","last_became_peered":"2024-09-21T03:40:29.338343+0000","last_unstale":"2024-09-21T03:40:51.464178+0000","last_undegraded":"2024-09-21T03:40:51.464178+0000","last_fullsized":"2024-09-21T03:40:51.464178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:33.531580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.485664+0000","last_change":"2024-09-21T03:40:51.485123+0000","last_active":"2024-09-21T03:40:51.485664+0000","last_peered":"2024-09-21T03:40:51.485664+0000","last_clean":"2024-09-21T03:40:51.485664+0000","last_became_active":"2024-09-21T03:40:51.471029+0000","last_became_peered":"2024-09-21T03:40:51.471029+0000","last_unstale":"2024-09-21T03:40:51.485664+0000","last_undegraded":"2024-09-21T03:40:51.485664+0000","last_fullsized":"2024-09-21T03:40:51.485664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:32.870908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464267+0000","last_change":"2024-09-21T03:40:29.340712+0000","last_active":"2024-09-21T03:40:51.464267+0000","last_peered":"2024-09-21T03:40:51.464267+0000","last_clean":"2024-09-21T03:40:51.464267+0000","last_became_active":"2024-09-21T03:40:29.340349+0000","last_became_peered":"2024-09-21T03:40:29.340349+0000","last_unstale":"2024-09-21T03:40:51.464267+0000","last_undegraded":"2024-09-21T03:40:51.464267+0000","last_fullsized":"2024-09-21T03:40:51.464267+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:29.980697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470772+0000","last_change":"2024-09-21T03:40:27.319689+0000","last_active":"2024-09-21T03:40:51.470772+0000","last_peered":"2024-09-21T03:40:51.470772+0000","last_clean":"2024-09-21T03:40:51.470772+0000","last_became_active":"2024-09-21T03:40:27.319010+0000","last_became_peered":"2024-09-21T03:40:27.319010+0000","last_unstale":"2024-09-21T03:40:51.470772+0000","last_undegraded":"2024-09-21T03:40:51.470772+0000","last_fullsized":"2024-09-21T03:40:51.470772+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:42.965205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.636897+0000","last_change":"2024-09-21T03:40:51.636790+0000","last_active":"2024-09-21T03:40:51.636897+0000","last_peered":"2024-09-21T03:40:51.636897+0000","last_clean":"2024-09-21T03:40:51.636897+0000","last_became_active":"2024-09-21T03:40:51.636333+0000","last_became_peered":"2024-09-21T03:40:51.636333+0000","last_unstale":"2024-09-21T03:40:51.636897+0000","last_undegraded":"2024-09-21T03:40:51.636897+0000","last_fullsized":"2024-09-21T03:40:51.636897+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:27.186564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780182+0000","last_change":"2024-09-21T03:40:27.316086+0000","last_active":"2024-09-21T03:40:51.780182+0000","last_peered":"2024-09-21T03:40:51.780182+0000","last_clean":"2024-09-21T03:40:51.780182+0000","last_became_active":"2024-09-21T03:40:27.315645+0000","last_became_peered":"2024-09-21T03:40:27.315645+0000","last_unstale":"2024-09-21T03:40:51.780182+0000","last_undegraded":"2024-09-21T03:40:51.780182+0000","last_fullsized":"2024-09-21T03:40:51.780182+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:41.536778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464622+0000","last_change":"2024-09-21T03:40:29.339546+0000","last_active":"2024-09-21T03:40:51.464622+0000","last_peered":"2024-09-21T03:40:51.464622+0000","last_clean":"2024-09-21T03:40:51.464622+0000","last_became_active":"2024-09-21T03:40:29.339176+0000","last_became_peered":"2024-09-21T03:40:29.339176+0000","last_unstale":"2024-09-21T03:40:51.464622+0000","last_undegraded":"2024-09-21T03:40:51.464622+0000","last_fullsized":"2024-09-21T03:40:51.464622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:26.405624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464973+0000","last_change":"2024-09-21T03:40:27.315440+0000","last_active":"2024-09-21T03:40:51.464973+0000","last_peered":"2024-09-21T03:40:51.464973+0000","last_clean":"2024-09-21T03:40:51.464973+0000","last_became_active":"2024-09-21T03:40:27.314608+0000","last_became_peered":"2024-09-21T03:40:27.314608+0000","last_unstale":"2024-09-21T03:40:51.464973+0000","last_undegraded":"2024-09-21T03:40:51.464973+0000","last_fullsized":"2024-09-21T03:40:51.464973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:11.465078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464466+0000","last_change":"2024-09-21T03:40:29.336631+0000","last_active":"2024-09-21T03:40:51.464466+0000","last_peered":"2024-09-21T03:40:51.464466+0000","last_clean":"2024-09-21T03:40:51.464466+0000","last_became_active":"2024-09-21T03:40:29.336201+0000","last_became_peered":"2024-09-21T03:40:29.336201+0000","last_unstale":"2024-09-21T03:40:51.464466+0000","last_undegraded":"2024-09-21T03:40:51.464466+0000","last_fullsized":"2024-09-21T03:40:51.464466+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:29.514908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468161+0000","last_change":"2024-09-21T03:40:27.719183+0000","last_active":"2024-09-21T03:40:51.468161+0000","last_peered":"2024-09-21T03:40:51.468161+0000","last_clean":"2024-09-21T03:40:51.468161+0000","last_became_active":"2024-09-21T03:40:27.718658+0000","last_became_peered":"2024-09-21T03:40:27.718658+0000","last_unstale":"2024-09-21T03:40:51.468161+0000","last_undegraded":"2024-09-21T03:40:51.468161+0000","last_fullsized":"2024-09-21T03:40:51.468161+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:52.280654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464860+0000","last_change":"2024-09-21T03:40:29.335258+0000","last_active":"2024-09-21T03:40:51.464860+0000","last_peered":"2024-09-21T03:40:51.464860+0000","last_clean":"2024-09-21T03:40:51.464860+0000","last_became_active":"2024-09-21T03:40:29.334897+0000","last_became_peered":"2024-09-21T03:40:29.334897+0000","last_unstale":"2024-09-21T03:40:51.464860+0000","last_undegraded":"2024-09-21T03:40:51.464860+0000","last_fullsized":"2024-09-21T03:40:51.464860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:27.040232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":95,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464382+0000","last_change":"2024-09-21T03:39:15.369567+0000","last_active":"2024-09-21T03:40:51.464382+0000","last_peered":"2024-09-21T03:40:51.464382+0000","last_clean":"2024-09-21T03:40:51.464382+0000","last_became_active":"2024-09-21T03:39:15.363960+0000","last_became_peered":"2024-09-21T03:39:15.363960+0000","last_unstale":"2024-09-21T03:40:51.464382+0000","last_undegraded":"2024-09-21T03:40:51.464382+0000","last_fullsized":"2024-09-21T03:40:51.464382+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:35:51.240165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:35:51.240165+0000","last_clean_scrub_stamp":"2024-09-21T03:35:51.240165+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:10.335425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.635844+0000","last_change":"2024-09-21T03:40:27.316831+0000","last_active":"2024-09-21T03:40:51.635844+0000","last_peered":"2024-09-21T03:40:51.635844+0000","last_clean":"2024-09-21T03:40:51.635844+0000","last_became_active":"2024-09-21T03:40:27.315547+0000","last_became_peered":"2024-09-21T03:40:27.315547+0000","last_unstale":"2024-09-21T03:40:51.635844+0000","last_undegraded":"2024-09-21T03:40:51.635844+0000","last_fullsized":"2024-09-21T03:40:51.635844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:02.727366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463852+0000","last_change":"2024-09-21T03:40:29.339059+0000","last_active":"2024-09-21T03:40:51.463852+0000","last_peered":"2024-09-21T03:40:51.463852+0000","last_clean":"2024-09-21T03:40:51.463852+0000","last_became_active":"2024-09-21T03:40:29.338710+0000","last_became_peered":"2024-09-21T03:40:29.338710+0000","last_unstale":"2024-09-21T03:40:51.463852+0000","last_undegraded":"2024-09-21T03:40:51.463852+0000","last_fullsized":"2024-09-21T03:40:51.463852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:50.390629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464355+0000","last_change":"2024-09-21T03:40:27.314666+0000","last_active":"2024-09-21T03:40:51.464355+0000","last_peered":"2024-09-21T03:40:51.464355+0000","last_clean":"2024-09-21T03:40:51.464355+0000","last_became_active":"2024-09-21T03:40:27.314254+0000","last_became_peered":"2024-09-21T03:40:27.314254+0000","last_unstale":"2024-09-21T03:40:51.464355+0000","last_undegraded":"2024-09-21T03:40:51.464355+0000","last_fullsized":"2024-09-21T03:40:51.464355+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:57.230420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780142+0000","last_change":"2024-09-21T03:40:29.338249+0000","last_active":"2024-09-21T03:40:51.780142+0000","last_peered":"2024-09-21T03:40:51.780142+0000","last_clean":"2024-09-21T03:40:51.780142+0000","last_became_active":"2024-09-21T03:40:29.337901+0000","last_became_peered":"2024-09-21T03:40:29.337901+0000","last_unstale":"2024-09-21T03:40:51.780142+0000","last_undegraded":"2024-09-21T03:40:51.780142+0000","last_fullsized":"2024-09-21T03:40:51.780142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:21.054734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":80,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:30.509326+0000","last_change":"2024-09-21T03:40:27.525651+0000","last_active":"2024-09-21T03:41:30.509326+0000","last_peered":"2024-09-21T03:41:30.509326+0000","last_clean":"2024-09-21T03:41:30.509326+0000","last_became_active":"2024-09-21T03:40:27.525299+0000","last_became_peered":"2024-09-21T03:40:27.525299+0000","last_unstale":"2024-09-21T03:41:30.509326+0000","last_undegraded":"2024-09-21T03:41:30.509326+0000","last_fullsized":"2024-09-21T03:41:30.509326+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:21.983937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464267+0000","last_change":"2024-09-21T03:40:29.339021+0000","last_active":"2024-09-21T03:40:51.464267+0000","last_peered":"2024-09-21T03:40:51.464267+0000","last_clean":"2024-09-21T03:40:51.464267+0000","last_became_active":"2024-09-21T03:40:29.338660+0000","last_became_peered":"2024-09-21T03:40:29.338660+0000","last_unstale":"2024-09-21T03:40:51.464267+0000","last_undegraded":"2024-09-21T03:40:51.464267+0000","last_fullsized":"2024-09-21T03:40:51.464267+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:56.652048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.465111+0000","last_change":"2024-09-21T03:40:27.319650+0000","last_active":"2024-09-21T03:40:51.465111+0000","last_peered":"2024-09-21T03:40:51.465111+0000","last_clean":"2024-09-21T03:40:51.465111+0000","last_became_active":"2024-09-21T03:40:27.319188+0000","last_became_peered":"2024-09-21T03:40:27.319188+0000","last_unstale":"2024-09-21T03:40:51.465111+0000","last_undegraded":"2024-09-21T03:40:51.465111+0000","last_fullsized":"2024-09-21T03:40:51.465111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:12.905682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469050+0000","last_change":"2024-09-21T03:40:29.340673+0000","last_active":"2024-09-21T03:40:51.469050+0000","last_peered":"2024-09-21T03:40:51.469050+0000","last_clean":"2024-09-21T03:40:51.469050+0000","last_became_active":"2024-09-21T03:40:29.340240+0000","last_became_peered":"2024-09-21T03:40:29.340240+0000","last_unstale":"2024-09-21T03:40:51.469050+0000","last_undegraded":"2024-09-21T03:40:51.469050+0000","last_fullsized":"2024-09-21T03:40:51.469050+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:02.989879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470390+0000","last_change":"2024-09-21T03:40:27.527803+0000","last_active":"2024-09-21T03:40:51.470390+0000","last_peered":"2024-09-21T03:40:51.470390+0000","last_clean":"2024-09-21T03:40:51.470390+0000","last_became_active":"2024-09-21T03:40:27.527419+0000","last_became_peered":"2024-09-21T03:40:27.527419+0000","last_unstale":"2024-09-21T03:40:51.470390+0000","last_undegraded":"2024-09-21T03:40:51.470390+0000","last_fullsized":"2024-09-21T03:40:51.470390+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:15:16.081458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469232+0000","last_change":"2024-09-21T03:40:29.347927+0000","last_active":"2024-09-21T03:40:51.469232+0000","last_peered":"2024-09-21T03:40:51.469232+0000","last_clean":"2024-09-21T03:40:51.469232+0000","last_became_active":"2024-09-21T03:40:29.347574+0000","last_became_peered":"2024-09-21T03:40:29.347574+0000","last_unstale":"2024-09-21T03:40:51.469232+0000","last_undegraded":"2024-09-21T03:40:51.469232+0000","last_fullsized":"2024-09-21T03:40:51.469232+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:10.142931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.488011+0000","last_change":"2024-09-21T03:40:51.487492+0000","last_active":"2024-09-21T03:40:51.488011+0000","last_peered":"2024-09-21T03:40:51.488011+0000","last_clean":"2024-09-21T03:40:51.488011+0000","last_became_active":"2024-09-21T03:40:51.472023+0000","last_became_peered":"2024-09-21T03:40:51.472023+0000","last_unstale":"2024-09-21T03:40:51.488011+0000","last_undegraded":"2024-09-21T03:40:51.488011+0000","last_fullsized":"2024-09-21T03:40:51.488011+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:40.164056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780314+0000","last_change":"2024-09-21T03:40:29.332539+0000","last_active":"2024-09-21T03:40:51.780314+0000","last_peered":"2024-09-21T03:40:51.780314+0000","last_clean":"2024-09-21T03:40:51.780314+0000","last_became_active":"2024-09-21T03:40:29.332178+0000","last_became_peered":"2024-09-21T03:40:29.332178+0000","last_unstale":"2024-09-21T03:40:51.780314+0000","last_undegraded":"2024-09-21T03:40:51.780314+0000","last_fullsized":"2024-09-21T03:40:51.780314+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:00.354558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'10","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:54.344416+0000","last_change":"2024-09-21T03:40:27.313942+0000","last_active":"2024-09-21T03:40:54.344416+0000","last_peered":"2024-09-21T03:40:54.344416+0000","last_clean":"2024-09-21T03:40:54.344416+0000","last_became_active":"2024-09-21T03:40:27.313541+0000","last_became_peered":"2024-09-21T03:40:27.313541+0000","last_unstale":"2024-09-21T03:40:54.344416+0000","last_undegraded":"2024-09-21T03:40:54.344416+0000","last_fullsized":"2024-09-21T03:40:54.344416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:58.572154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463827+0000","last_change":"2024-09-21T03:40:29.330712+0000","last_active":"2024-09-21T03:40:51.463827+0000","last_peered":"2024-09-21T03:40:51.463827+0000","last_clean":"2024-09-21T03:40:51.463827+0000","last_became_active":"2024-09-21T03:40:29.330345+0000","last_became_peered":"2024-09-21T03:40:29.330345+0000","last_unstale":"2024-09-21T03:40:51.463827+0000","last_undegraded":"2024-09-21T03:40:51.463827+0000","last_fullsized":"2024-09-21T03:40:51.463827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:54.225288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.635760+0000","last_change":"2024-09-21T03:40:27.719239+0000","last_active":"2024-09-21T03:40:51.635760+0000","last_peered":"2024-09-21T03:40:51.635760+0000","last_clean":"2024-09-21T03:40:51.635760+0000","last_became_active":"2024-09-21T03:40:27.718834+0000","last_became_peered":"2024-09-21T03:40:27.718834+0000","last_unstale":"2024-09-21T03:40:51.635760+0000","last_undegraded":"2024-09-21T03:40:51.635760+0000","last_fullsized":"2024-09-21T03:40:51.635760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:47.357723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470066+0000","last_change":"2024-09-21T03:40:29.338470+0000","last_active":"2024-09-21T03:40:51.470066+0000","last_peered":"2024-09-21T03:40:51.470066+0000","last_clean":"2024-09-21T03:40:51.470066+0000","last_became_active":"2024-09-21T03:40:29.338114+0000","last_became_peered":"2024-09-21T03:40:29.338114+0000","last_unstale":"2024-09-21T03:40:51.470066+0000","last_undegraded":"2024-09-21T03:40:51.470066+0000","last_fullsized":"2024-09-21T03:40:51.470066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:23.715773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467223+0000","last_change":"2024-09-21T03:40:27.525544+0000","last_active":"2024-09-21T03:40:51.467223+0000","last_peered":"2024-09-21T03:40:51.467223+0000","last_clean":"2024-09-21T03:40:51.467223+0000","last_became_active":"2024-09-21T03:40:27.525196+0000","last_became_peered":"2024-09-21T03:40:27.525196+0000","last_unstale":"2024-09-21T03:40:51.467223+0000","last_undegraded":"2024-09-21T03:40:51.467223+0000","last_fullsized":"2024-09-21T03:40:51.467223+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:57:07.882351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470212+0000","last_change":"2024-09-21T03:40:29.337774+0000","last_active":"2024-09-21T03:40:51.470212+0000","last_peered":"2024-09-21T03:40:51.470212+0000","last_clean":"2024-09-21T03:40:51.470212+0000","last_became_active":"2024-09-21T03:40:29.337393+0000","last_became_peered":"2024-09-21T03:40:29.337393+0000","last_unstale":"2024-09-21T03:40:51.470212+0000","last_undegraded":"2024-09-21T03:40:51.470212+0000","last_fullsized":"2024-09-21T03:40:51.470212+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:20.471042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463610+0000","last_change":"2024-09-21T03:40:27.312953+0000","last_active":"2024-09-21T03:40:51.463610+0000","last_peered":"2024-09-21T03:40:51.463610+0000","last_clean":"2024-09-21T03:40:51.463610+0000","last_became_active":"2024-09-21T03:40:27.312603+0000","last_became_peered":"2024-09-21T03:40:27.312603+0000","last_unstale":"2024-09-21T03:40:51.463610+0000","last_undegraded":"2024-09-21T03:40:51.463610+0000","last_fullsized":"2024-09-21T03:40:51.463610+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:18.102812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467010+0000","last_change":"2024-09-21T03:40:29.330802+0000","last_active":"2024-09-21T03:40:51.467010+0000","last_peered":"2024-09-21T03:40:51.467010+0000","last_clean":"2024-09-21T03:40:51.467010+0000","last_became_active":"2024-09-21T03:40:29.330426+0000","last_became_peered":"2024-09-21T03:40:29.330426+0000","last_unstale":"2024-09-21T03:40:51.467010+0000","last_undegraded":"2024-09-21T03:40:51.467010+0000","last_fullsized":"2024-09-21T03:40:51.467010+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:08:18.552649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467619+0000","last_change":"2024-09-21T03:40:27.319829+0000","last_active":"2024-09-21T03:40:51.467619+0000","last_peered":"2024-09-21T03:40:51.467619+0000","last_clean":"2024-09-21T03:40:51.467619+0000","last_became_active":"2024-09-21T03:40:27.319410+0000","last_became_peered":"2024-09-21T03:40:27.319410+0000","last_unstale":"2024-09-21T03:40:51.467619+0000","last_undegraded":"2024-09-21T03:40:51.467619+0000","last_fullsized":"2024-09-21T03:40:51.467619+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:56.475721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463651+0000","last_change":"2024-09-21T03:40:29.335897+0000","last_active":"2024-09-21T03:40:51.463651+0000","last_peered":"2024-09-21T03:40:51.463651+0000","last_clean":"2024-09-21T03:40:51.463651+0000","last_became_active":"2024-09-21T03:40:29.335549+0000","last_became_peered":"2024-09-21T03:40:29.335549+0000","last_unstale":"2024-09-21T03:40:51.463651+0000","last_undegraded":"2024-09-21T03:40:51.463651+0000","last_fullsized":"2024-09-21T03:40:51.463651+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:01.401766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470266+0000","last_change":"2024-09-21T03:40:27.316678+0000","last_active":"2024-09-21T03:40:51.470266+0000","last_peered":"2024-09-21T03:40:51.470266+0000","last_clean":"2024-09-21T03:40:51.470266+0000","last_became_active":"2024-09-21T03:40:27.315980+0000","last_became_peered":"2024-09-21T03:40:27.315980+0000","last_unstale":"2024-09-21T03:40:51.470266+0000","last_undegraded":"2024-09-21T03:40:51.470266+0000","last_fullsized":"2024-09-21T03:40:51.470266+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:56.280077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464472+0000","last_change":"2024-09-21T03:40:29.333638+0000","last_active":"2024-09-21T03:40:51.464472+0000","last_peered":"2024-09-21T03:40:51.464472+0000","last_clean":"2024-09-21T03:40:51.464472+0000","last_became_active":"2024-09-21T03:40:29.333268+0000","last_became_peered":"2024-09-21T03:40:29.333268+0000","last_unstale":"2024-09-21T03:40:51.464472+0000","last_undegraded":"2024-09-21T03:40:51.464472+0000","last_fullsized":"2024-09-21T03:40:51.464472+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:35:23.346837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464730+0000","last_change":"2024-09-21T03:40:29.342199+0000","last_active":"2024-09-21T03:40:51.464730+0000","last_peered":"2024-09-21T03:40:51.464730+0000","last_clean":"2024-09-21T03:40:51.464730+0000","last_became_active":"2024-09-21T03:40:29.341675+0000","last_became_peered":"2024-09-21T03:40:29.341675+0000","last_unstale":"2024-09-21T03:40:51.464730+0000","last_undegraded":"2024-09-21T03:40:51.464730+0000","last_fullsized":"2024-09-21T03:40:51.464730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:01.439058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470666+0000","last_change":"2024-09-21T03:40:27.319327+0000","last_active":"2024-09-21T03:40:51.470666+0000","last_peered":"2024-09-21T03:40:51.470666+0000","last_clean":"2024-09-21T03:40:51.470666+0000","last_became_active":"2024-09-21T03:40:27.318773+0000","last_became_peered":"2024-09-21T03:40:27.318773+0000","last_unstale":"2024-09-21T03:40:51.470666+0000","last_undegraded":"2024-09-21T03:40:51.470666+0000","last_fullsized":"2024-09-21T03:40:51.470666+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:42.444238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467214+0000","last_change":"2024-09-21T03:40:29.336121+0000","last_active":"2024-09-21T03:40:51.467214+0000","last_peered":"2024-09-21T03:40:51.467214+0000","last_clean":"2024-09-21T03:40:51.467214+0000","last_became_active":"2024-09-21T03:40:29.333523+0000","last_became_peered":"2024-09-21T03:40:29.333523+0000","last_unstale":"2024-09-21T03:40:51.467214+0000","last_undegraded":"2024-09-21T03:40:51.467214+0000","last_fullsized":"2024-09-21T03:40:51.467214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:29.303410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470911+0000","last_change":"2024-09-21T03:40:27.316523+0000","last_active":"2024-09-21T03:40:51.470911+0000","last_peered":"2024-09-21T03:40:51.470911+0000","last_clean":"2024-09-21T03:40:51.470911+0000","last_became_active":"2024-09-21T03:40:27.316099+0000","last_became_peered":"2024-09-21T03:40:27.316099+0000","last_unstale":"2024-09-21T03:40:51.470911+0000","last_undegraded":"2024-09-21T03:40:51.470911+0000","last_fullsized":"2024-09-21T03:40:51.470911+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:44.091964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470170+0000","last_change":"2024-09-21T03:40:29.333887+0000","last_active":"2024-09-21T03:40:51.470170+0000","last_peered":"2024-09-21T03:40:51.470170+0000","last_clean":"2024-09-21T03:40:51.470170+0000","last_became_active":"2024-09-21T03:40:29.333465+0000","last_became_peered":"2024-09-21T03:40:29.333465+0000","last_unstale":"2024-09-21T03:40:51.470170+0000","last_undegraded":"2024-09-21T03:40:51.470170+0000","last_fullsized":"2024-09-21T03:40:51.470170+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:46.788188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464003+0000","last_change":"2024-09-21T03:40:27.525812+0000","last_active":"2024-09-21T03:40:51.464003+0000","last_peered":"2024-09-21T03:40:51.464003+0000","last_clean":"2024-09-21T03:40:51.464003+0000","last_became_active":"2024-09-21T03:40:27.525391+0000","last_became_peered":"2024-09-21T03:40:27.525391+0000","last_unstale":"2024-09-21T03:40:51.464003+0000","last_undegraded":"2024-09-21T03:40:51.464003+0000","last_fullsized":"2024-09-21T03:40:51.464003+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:07.856442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463860+0000","last_change":"2024-09-21T03:40:29.339079+0000","last_active":"2024-09-21T03:40:51.463860+0000","last_peered":"2024-09-21T03:40:51.463860+0000","last_clean":"2024-09-21T03:40:51.463860+0000","last_became_active":"2024-09-21T03:40:29.338737+0000","last_became_peered":"2024-09-21T03:40:29.338737+0000","last_unstale":"2024-09-21T03:40:51.463860+0000","last_undegraded":"2024-09-21T03:40:51.463860+0000","last_fullsized":"2024-09-21T03:40:51.463860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:14.863848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470639+0000","last_change":"2024-09-21T03:40:27.316037+0000","last_active":"2024-09-21T03:40:51.470639+0000","last_peered":"2024-09-21T03:40:51.470639+0000","last_clean":"2024-09-21T03:40:51.470639+0000","last_became_active":"2024-09-21T03:40:27.315604+0000","last_became_peered":"2024-09-21T03:40:27.315604+0000","last_unstale":"2024-09-21T03:40:51.470639+0000","last_undegraded":"2024-09-21T03:40:51.470639+0000","last_fullsized":"2024-09-21T03:40:51.470639+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:48.176252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67350,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":336,"num_read_kb":242,"num_write":159,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1147,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":202050,"data_compressed":5679,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247442,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743451,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":847872,"data_stored":416171,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906975,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":1070867,"data_compressed":43442,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070501,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":416273,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266729,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":839680,"data_stored":416059,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430254,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":901120,"data_stored":1008123,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593780,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":839680,"data_stored":415662,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790009,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":913408,"data_stored":1007807,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986238,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":851968,"data_stored":417112,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":415973,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":479532,"data_compressed":7630,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":478804,"data_compressed":7630,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705747,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":860160,"data_stored":416933,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34191,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34191,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":63349,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64077,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64927,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:41:38.427 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T03:41:38.671 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:39.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:38 smithi084 ceph-mon[30941]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:41:39.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:38 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:39.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:38 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:39.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:38 smithi084 ceph-mon[30941]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:41:39.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:38 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:41:39.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:38 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:41:39.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:38 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:39.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.229+0000 7f4b26fe1640 1 -- 172.21.15.84:0/1299682713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b20102ae0 msgr2=0x7f4b20102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:39.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.229+0000 7f4b26fe1640 1 --2- 172.21.15.84:0/1299682713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b20102ae0 0x7f4b20102ef0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009900 tx=0x7f4b0802a410 comp rx=0 tx=0).stop 2024-09-21T03:41:39.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.229+0000 7f4b26fe1640 1 -- 172.21.15.84:0/1299682713 shutdown_connections 2024-09-21T03:41:39.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.229+0000 7f4b26fe1640 1 --2- 172.21.15.84:0/1299682713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b20108d70 0x7f4b2010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:39.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.229+0000 7f4b26fe1640 1 --2- 172.21.15.84:0/1299682713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b20108420 0x7f4b20108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:39.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.229+0000 7f4b26fe1640 1 --2- 172.21.15.84:0/1299682713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b20102ae0 0x7f4b20102ef0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:39.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.229+0000 7f4b26fe1640 1 -- 172.21.15.84:0/1299682713 >> 172.21.15.84:0/1299682713 conn(0x7f4b20079770 msgr2=0x7f4b20079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:39.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.229+0000 7f4b26fe1640 1 -- 172.21.15.84:0/1299682713 shutdown_connections 2024-09-21T03:41:39.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.229+0000 7f4b26fe1640 1 -- 172.21.15.84:0/1299682713 wait complete. 2024-09-21T03:41:39.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.230+0000 7f4b26fe1640 1 Processor -- start 2024-09-21T03:41:39.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.230+0000 7f4b26fe1640 1 -- start start 2024-09-21T03:41:39.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.230+0000 7f4b26fe1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b20102ae0 0x7f4b20199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:39.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.230+0000 7f4b26fe1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b20108420 0x7f4b201999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:39.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.230+0000 7f4b26fe1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b20108d70 0x7f4b2019ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:39.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.230+0000 7f4b26fe1640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4b20112a30 con 0x7f4b20102ae0 2024-09-21T03:41:39.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.230+0000 7f4b26fe1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b201128b0 con 0x7f4b20108420 2024-09-21T03:41:39.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.230+0000 7f4b26fe1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4b20112bb0 con 0x7f4b20108d70 2024-09-21T03:41:39.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.230+0000 7f4b24d7d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b20102ae0 0x7f4b20199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:39.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.230+0000 7f4b24d7d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b20102ae0 0x7f4b20199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34170/0 (socket says 172.21.15.84:34170) 2024-09-21T03:41:39.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.230+0000 7f4b24d7d640 1 -- 172.21.15.84:0/3380242271 learned_addr learned my addr 172.21.15.84:0/3380242271 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:39.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.231+0000 7f4b2557e640 1 --2- 172.21.15.84:0/3380242271 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b20108d70 0x7f4b2019ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:39.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.231+0000 7f4b1ffff640 1 --2- 172.21.15.84:0/3380242271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b20108420 0x7f4b201999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:39.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.231+0000 7f4b24d7d640 1 -- 172.21.15.84:0/3380242271 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b20108d70 msgr2=0x7f4b2019ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.231+0000 7f4b24d7d640 1 --2- 172.21.15.84:0/3380242271 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b20108d70 0x7f4b2019ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.231+0000 7f4b24d7d640 1 -- 172.21.15.84:0/3380242271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b20108420 msgr2=0x7f4b201999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.231+0000 7f4b24d7d640 1 --2- 172.21.15.84:0/3380242271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b20108420 0x7f4b201999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.231+0000 7f4b24d7d640 1 -- 172.21.15.84:0/3380242271 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2019f2b0 con 0x7f4b20102ae0 2024-09-21T03:41:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.231+0000 7f4b24d7d640 1 --2- 172.21.15.84:0/3380242271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b20102ae0 0x7f4b20199400 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4b08005940 tx=0x7f4b08004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.231+0000 7f4b1dffb640 1 -- 172.21.15.84:0/3380242271 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0803f030 con 0x7f4b20102ae0 2024-09-21T03:41:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.231+0000 7f4b1dffb640 1 -- 172.21.15.84:0/3380242271 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b08003aa0 con 0x7f4b20102ae0 2024-09-21T03:41:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.231+0000 7f4b1dffb640 1 -- 172.21.15.84:0/3380242271 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b08035070 con 0x7f4b20102ae0 2024-09-21T03:41:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.231+0000 7f4b26fe1640 1 -- 172.21.15.84:0/3380242271 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b2019f540 con 0x7f4b20102ae0 2024-09-21T03:41:39.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.231+0000 7f4b26fe1640 1 -- 172.21.15.84:0/3380242271 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b2019fa20 con 0x7f4b20102ae0 2024-09-21T03:41:39.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.232+0000 7f4b26fe1640 1 -- 172.21.15.84:0/3380242271 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b20103d60 con 0x7f4b20102ae0 2024-09-21T03:41:39.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.234+0000 7f4b1dffb640 1 -- 172.21.15.84:0/3380242271 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f4b08042030 con 0x7f4b20102ae0 2024-09-21T03:41:39.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.235+0000 7f4b1dffb640 1 --2- 172.21.15.84:0/3380242271 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b0c0b6620 0x7f4b0c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:39.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.235+0000 7f4b1ffff640 1 --2- 172.21.15.84:0/3380242271 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b0c0b6620 0x7f4b0c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:39.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.235+0000 7f4b1dffb640 1 -- 172.21.15.84:0/3380242271 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4b08107f70 con 0x7f4b20102ae0 2024-09-21T03:41:39.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.235+0000 7f4b1ffff640 1 --2- 172.21.15.84:0/3380242271 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b0c0b6620 0x7f4b0c0b8b30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4b10007350 tx=0x7f4b100072e0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.238+0000 7f4b1dffb640 1 -- 172.21.15.84:0/3380242271 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4b080ce600 con 0x7f4b20102ae0 2024-09-21T03:41:39.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:38 smithi174 ceph-mon[34403]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:41:39.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:38 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:39.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:38 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:39.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:38 smithi174 ceph-mon[34403]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:41:39.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:38 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:41:39.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:38 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:41:39.379 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:38 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:39.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:38 smithi172 ceph-mon[34821]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:41:39.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:38 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:39.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:38 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:39.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:38 smithi172 ceph-mon[34821]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:41:39.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:38 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:41:39.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:38 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:41:39.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:38 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:41:39.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.414+0000 7f4b26fe1640 1 -- 172.21.15.84:0/3380242271 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4b20063800 con 0x7f4b0c0b6620 2024-09-21T03:41:39.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.419+0000 7f4b1dffb640 1 -- 172.21.15.84:0/3380242271 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258981 (secure 0 0 0) 0x7f4b20063800 con 0x7f4b0c0b6620 2024-09-21T03:41:39.423 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:41:39.424 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T03:41:39.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.422+0000 7f4b26fe1640 1 -- 172.21.15.84:0/3380242271 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b0c0b6620 msgr2=0x7f4b0c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:39.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.422+0000 7f4b26fe1640 1 --2- 172.21.15.84:0/3380242271 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b0c0b6620 0x7f4b0c0b8b30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4b10007350 tx=0x7f4b100072e0 comp rx=0 tx=0).stop 2024-09-21T03:41:39.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.422+0000 7f4b26fe1640 1 -- 172.21.15.84:0/3380242271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b20102ae0 msgr2=0x7f4b20199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:39.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.422+0000 7f4b26fe1640 1 --2- 172.21.15.84:0/3380242271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b20102ae0 0x7f4b20199400 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4b08005940 tx=0x7f4b08004270 comp rx=0 tx=0).stop 2024-09-21T03:41:39.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.422+0000 7f4b26fe1640 1 -- 172.21.15.84:0/3380242271 shutdown_connections 2024-09-21T03:41:39.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.422+0000 7f4b26fe1640 1 --2- 172.21.15.84:0/3380242271 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b0c0b6620 0x7f4b0c0b8b30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:39.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.422+0000 7f4b26fe1640 1 --2- 172.21.15.84:0/3380242271 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b20108d70 0x7f4b2019ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:39.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.422+0000 7f4b26fe1640 1 --2- 172.21.15.84:0/3380242271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b20108420 0x7f4b201999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:39.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.422+0000 7f4b26fe1640 1 --2- 172.21.15.84:0/3380242271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b20102ae0 0x7f4b20199400 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:39.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.422+0000 7f4b26fe1640 1 -- 172.21.15.84:0/3380242271 >> 172.21.15.84:0/3380242271 conn(0x7f4b20079770 msgr2=0x7f4b20106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:39.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.423+0000 7f4b26fe1640 1 -- 172.21.15.84:0/3380242271 shutdown_connections 2024-09-21T03:41:39.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:39.423+0000 7f4b26fe1640 1 -- 172.21.15.84:0/3380242271 wait complete. 2024-09-21T03:41:40.126 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2024-09-21T03:41:38.295127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657952,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":432,"num_read_kb":316,"num_write":284,"num_write_kb":2265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":2952987,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376244,"kb_used_data":10320,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124565580,"statfs":{"total":1151940427776,"available":1151555153920,"internally_reserved":0,"allocated":10567680,"data_stored":6959316,"data_compressed":181959,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19142,"internal_metadata":374453562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003566"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467399+0000","last_change":"2024-09-21T03:40:29.337467+0000","last_active":"2024-09-21T03:40:51.467399+0000","last_peered":"2024-09-21T03:40:51.467399+0000","last_clean":"2024-09-21T03:40:51.467399+0000","last_became_active":"2024-09-21T03:40:29.337102+0000","last_became_peered":"2024-09-21T03:40:29.337102+0000","last_unstale":"2024-09-21T03:40:51.467399+0000","last_undegraded":"2024-09-21T03:40:51.467399+0000","last_fullsized":"2024-09-21T03:40:51.467399+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:53.798977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469953+0000","last_change":"2024-09-21T03:40:29.336446+0000","last_active":"2024-09-21T03:40:51.469953+0000","last_peered":"2024-09-21T03:40:51.469953+0000","last_clean":"2024-09-21T03:40:51.469953+0000","last_became_active":"2024-09-21T03:40:29.336081+0000","last_became_peered":"2024-09-21T03:40:29.336081+0000","last_unstale":"2024-09-21T03:40:51.469953+0000","last_undegraded":"2024-09-21T03:40:51.469953+0000","last_fullsized":"2024-09-21T03:40:51.469953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:23.892700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470293+0000","last_change":"2024-09-21T03:40:29.342861+0000","last_active":"2024-09-21T03:40:51.470293+0000","last_peered":"2024-09-21T03:40:51.470293+0000","last_clean":"2024-09-21T03:40:51.470293+0000","last_became_active":"2024-09-21T03:40:29.342111+0000","last_became_peered":"2024-09-21T03:40:29.342111+0000","last_unstale":"2024-09-21T03:40:51.470293+0000","last_undegraded":"2024-09-21T03:40:51.470293+0000","last_fullsized":"2024-09-21T03:40:51.470293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:30.012195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.635710+0000","last_change":"2024-09-21T03:40:29.339822+0000","last_active":"2024-09-21T03:40:51.635710+0000","last_peered":"2024-09-21T03:40:51.635710+0000","last_clean":"2024-09-21T03:40:51.635710+0000","last_became_active":"2024-09-21T03:40:29.339126+0000","last_became_peered":"2024-09-21T03:40:29.339126+0000","last_unstale":"2024-09-21T03:40:51.635710+0000","last_undegraded":"2024-09-21T03:40:51.635710+0000","last_fullsized":"2024-09-21T03:40:51.635710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:44.874344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470141+0000","last_change":"2024-09-21T03:40:29.333683+0000","last_active":"2024-09-21T03:40:51.470141+0000","last_peered":"2024-09-21T03:40:51.470141+0000","last_clean":"2024-09-21T03:40:51.470141+0000","last_became_active":"2024-09-21T03:40:29.333329+0000","last_became_peered":"2024-09-21T03:40:29.333329+0000","last_unstale":"2024-09-21T03:40:51.470141+0000","last_undegraded":"2024-09-21T03:40:51.470141+0000","last_fullsized":"2024-09-21T03:40:51.470141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:42.655732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468828+0000","last_change":"2024-09-21T03:40:29.346193+0000","last_active":"2024-09-21T03:40:51.468828+0000","last_peered":"2024-09-21T03:40:51.468828+0000","last_clean":"2024-09-21T03:40:51.468828+0000","last_became_active":"2024-09-21T03:40:29.345808+0000","last_became_peered":"2024-09-21T03:40:29.345808+0000","last_unstale":"2024-09-21T03:40:51.468828+0000","last_undegraded":"2024-09-21T03:40:51.468828+0000","last_fullsized":"2024-09-21T03:40:51.468828+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:59.621904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464272+0000","last_change":"2024-09-21T03:40:29.337782+0000","last_active":"2024-09-21T03:40:51.464272+0000","last_peered":"2024-09-21T03:40:51.464272+0000","last_clean":"2024-09-21T03:40:51.464272+0000","last_became_active":"2024-09-21T03:40:29.337390+0000","last_became_peered":"2024-09-21T03:40:29.337390+0000","last_unstale":"2024-09-21T03:40:51.464272+0000","last_undegraded":"2024-09-21T03:40:51.464272+0000","last_fullsized":"2024-09-21T03:40:51.464272+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:49.924375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463416+0000","last_change":"2024-09-21T03:40:29.340821+0000","last_active":"2024-09-21T03:40:51.463416+0000","last_peered":"2024-09-21T03:40:51.463416+0000","last_clean":"2024-09-21T03:40:51.463416+0000","last_became_active":"2024-09-21T03:40:29.340465+0000","last_became_peered":"2024-09-21T03:40:29.340465+0000","last_unstale":"2024-09-21T03:40:51.463416+0000","last_undegraded":"2024-09-21T03:40:51.463416+0000","last_fullsized":"2024-09-21T03:40:51.463416+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:18.600335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467779+0000","last_change":"2024-09-21T03:40:29.345218+0000","last_active":"2024-09-21T03:40:51.467779+0000","last_peered":"2024-09-21T03:40:51.467779+0000","last_clean":"2024-09-21T03:40:51.467779+0000","last_became_active":"2024-09-21T03:40:29.344862+0000","last_became_peered":"2024-09-21T03:40:29.344862+0000","last_unstale":"2024-09-21T03:40:51.467779+0000","last_undegraded":"2024-09-21T03:40:51.467779+0000","last_fullsized":"2024-09-21T03:40:51.467779+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:53.570489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.471722+0000","last_change":"2024-09-21T03:40:51.471622+0000","last_active":"2024-09-21T03:40:51.471722+0000","last_peered":"2024-09-21T03:40:51.471722+0000","last_clean":"2024-09-21T03:40:51.471722+0000","last_became_active":"2024-09-21T03:40:51.471276+0000","last_became_peered":"2024-09-21T03:40:51.471276+0000","last_unstale":"2024-09-21T03:40:51.471722+0000","last_undegraded":"2024-09-21T03:40:51.471722+0000","last_fullsized":"2024-09-21T03:40:51.471722+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:38.030634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464696+0000","last_change":"2024-09-21T03:40:29.338353+0000","last_active":"2024-09-21T03:40:51.464696+0000","last_peered":"2024-09-21T03:40:51.464696+0000","last_clean":"2024-09-21T03:40:51.464696+0000","last_became_active":"2024-09-21T03:40:29.337976+0000","last_became_peered":"2024-09-21T03:40:29.337976+0000","last_unstale":"2024-09-21T03:40:51.464696+0000","last_undegraded":"2024-09-21T03:40:51.464696+0000","last_fullsized":"2024-09-21T03:40:51.464696+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:10.182045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.635865+0000","last_change":"2024-09-21T03:40:29.343617+0000","last_active":"2024-09-21T03:40:51.635865+0000","last_peered":"2024-09-21T03:40:51.635865+0000","last_clean":"2024-09-21T03:40:51.635865+0000","last_became_active":"2024-09-21T03:40:29.342586+0000","last_became_peered":"2024-09-21T03:40:29.342586+0000","last_unstale":"2024-09-21T03:40:51.635865+0000","last_undegraded":"2024-09-21T03:40:51.635865+0000","last_fullsized":"2024-09-21T03:40:51.635865+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:06.823802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780499+0000","last_change":"2024-09-21T03:40:29.338633+0000","last_active":"2024-09-21T03:40:51.780499+0000","last_peered":"2024-09-21T03:40:51.780499+0000","last_clean":"2024-09-21T03:40:51.780499+0000","last_became_active":"2024-09-21T03:40:29.337502+0000","last_became_peered":"2024-09-21T03:40:29.337502+0000","last_unstale":"2024-09-21T03:40:51.780499+0000","last_undegraded":"2024-09-21T03:40:51.780499+0000","last_fullsized":"2024-09-21T03:40:51.780499+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:04.121275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469621+0000","last_change":"2024-09-21T03:40:29.335774+0000","last_active":"2024-09-21T03:40:51.469621+0000","last_peered":"2024-09-21T03:40:51.469621+0000","last_clean":"2024-09-21T03:40:51.469621+0000","last_became_active":"2024-09-21T03:40:29.335452+0000","last_became_peered":"2024-09-21T03:40:29.335452+0000","last_unstale":"2024-09-21T03:40:51.469621+0000","last_undegraded":"2024-09-21T03:40:51.469621+0000","last_fullsized":"2024-09-21T03:40:51.469621+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:37.427015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469467+0000","last_change":"2024-09-21T03:40:29.342874+0000","last_active":"2024-09-21T03:40:51.469467+0000","last_peered":"2024-09-21T03:40:51.469467+0000","last_clean":"2024-09-21T03:40:51.469467+0000","last_became_active":"2024-09-21T03:40:29.342343+0000","last_became_peered":"2024-09-21T03:40:29.342343+0000","last_unstale":"2024-09-21T03:40:51.469467+0000","last_undegraded":"2024-09-21T03:40:51.469467+0000","last_fullsized":"2024-09-21T03:40:51.469467+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:52.473608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467076+0000","last_change":"2024-09-21T03:40:29.339231+0000","last_active":"2024-09-21T03:40:51.467076+0000","last_peered":"2024-09-21T03:40:51.467076+0000","last_clean":"2024-09-21T03:40:51.467076+0000","last_became_active":"2024-09-21T03:40:29.338724+0000","last_became_peered":"2024-09-21T03:40:29.338724+0000","last_unstale":"2024-09-21T03:40:51.467076+0000","last_undegraded":"2024-09-21T03:40:51.467076+0000","last_fullsized":"2024-09-21T03:40:51.467076+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:55.592713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467451+0000","last_change":"2024-09-21T03:40:29.338480+0000","last_active":"2024-09-21T03:40:51.467451+0000","last_peered":"2024-09-21T03:40:51.467451+0000","last_clean":"2024-09-21T03:40:51.467451+0000","last_became_active":"2024-09-21T03:40:29.338092+0000","last_became_peered":"2024-09-21T03:40:29.338092+0000","last_unstale":"2024-09-21T03:40:51.467451+0000","last_undegraded":"2024-09-21T03:40:51.467451+0000","last_fullsized":"2024-09-21T03:40:51.467451+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:25.557502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470765+0000","last_change":"2024-09-21T03:40:29.335557+0000","last_active":"2024-09-21T03:40:51.470765+0000","last_peered":"2024-09-21T03:40:51.470765+0000","last_clean":"2024-09-21T03:40:51.470765+0000","last_became_active":"2024-09-21T03:40:29.335214+0000","last_became_peered":"2024-09-21T03:40:29.335214+0000","last_unstale":"2024-09-21T03:40:51.470765+0000","last_undegraded":"2024-09-21T03:40:51.470765+0000","last_fullsized":"2024-09-21T03:40:51.470765+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:21.395995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467706+0000","last_change":"2024-09-21T03:40:29.333041+0000","last_active":"2024-09-21T03:40:51.467706+0000","last_peered":"2024-09-21T03:40:51.467706+0000","last_clean":"2024-09-21T03:40:51.467706+0000","last_became_active":"2024-09-21T03:40:29.332187+0000","last_became_peered":"2024-09-21T03:40:29.332187+0000","last_unstale":"2024-09-21T03:40:51.467706+0000","last_undegraded":"2024-09-21T03:40:51.467706+0000","last_fullsized":"2024-09-21T03:40:51.467706+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:03.253594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.466928+0000","last_change":"2024-09-21T03:40:29.339152+0000","last_active":"2024-09-21T03:40:51.466928+0000","last_peered":"2024-09-21T03:40:51.466928+0000","last_clean":"2024-09-21T03:40:51.466928+0000","last_became_active":"2024-09-21T03:40:29.338722+0000","last_became_peered":"2024-09-21T03:40:29.338722+0000","last_unstale":"2024-09-21T03:40:51.466928+0000","last_undegraded":"2024-09-21T03:40:51.466928+0000","last_fullsized":"2024-09-21T03:40:51.466928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:32.143498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780525+0000","last_change":"2024-09-21T03:40:29.329169+0000","last_active":"2024-09-21T03:40:51.780525+0000","last_peered":"2024-09-21T03:40:51.780525+0000","last_clean":"2024-09-21T03:40:51.780525+0000","last_became_active":"2024-09-21T03:40:29.328805+0000","last_became_peered":"2024-09-21T03:40:29.328805+0000","last_unstale":"2024-09-21T03:40:51.780525+0000","last_undegraded":"2024-09-21T03:40:51.780525+0000","last_fullsized":"2024-09-21T03:40:51.780525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:13.725038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467313+0000","last_change":"2024-09-21T03:40:29.336699+0000","last_active":"2024-09-21T03:40:51.467313+0000","last_peered":"2024-09-21T03:40:51.467313+0000","last_clean":"2024-09-21T03:40:51.467313+0000","last_became_active":"2024-09-21T03:40:29.333649+0000","last_became_peered":"2024-09-21T03:40:29.333649+0000","last_unstale":"2024-09-21T03:40:51.467313+0000","last_undegraded":"2024-09-21T03:40:51.467313+0000","last_fullsized":"2024-09-21T03:40:51.467313+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:49.418205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463479+0000","last_change":"2024-09-21T03:40:29.337936+0000","last_active":"2024-09-21T03:40:51.463479+0000","last_peered":"2024-09-21T03:40:51.463479+0000","last_clean":"2024-09-21T03:40:51.463479+0000","last_became_active":"2024-09-21T03:40:29.337521+0000","last_became_peered":"2024-09-21T03:40:29.337521+0000","last_unstale":"2024-09-21T03:40:51.463479+0000","last_undegraded":"2024-09-21T03:40:51.463479+0000","last_fullsized":"2024-09-21T03:40:51.463479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:09.223634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464197+0000","last_change":"2024-09-21T03:40:29.336866+0000","last_active":"2024-09-21T03:40:51.464197+0000","last_peered":"2024-09-21T03:40:51.464197+0000","last_clean":"2024-09-21T03:40:51.464197+0000","last_became_active":"2024-09-21T03:40:29.336447+0000","last_became_peered":"2024-09-21T03:40:29.336447+0000","last_unstale":"2024-09-21T03:40:51.464197+0000","last_undegraded":"2024-09-21T03:40:51.464197+0000","last_fullsized":"2024-09-21T03:40:51.464197+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:53.487678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463782+0000","last_change":"2024-09-21T03:40:29.333666+0000","last_active":"2024-09-21T03:40:51.463782+0000","last_peered":"2024-09-21T03:40:51.463782+0000","last_clean":"2024-09-21T03:40:51.463782+0000","last_became_active":"2024-09-21T03:40:29.333248+0000","last_became_peered":"2024-09-21T03:40:29.333248+0000","last_unstale":"2024-09-21T03:40:51.463782+0000","last_undegraded":"2024-09-21T03:40:51.463782+0000","last_fullsized":"2024-09-21T03:40:51.463782+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:54.721926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467995+0000","last_change":"2024-09-21T03:40:29.342165+0000","last_active":"2024-09-21T03:40:51.467995+0000","last_peered":"2024-09-21T03:40:51.467995+0000","last_clean":"2024-09-21T03:40:51.467995+0000","last_became_active":"2024-09-21T03:40:29.341744+0000","last_became_peered":"2024-09-21T03:40:29.341744+0000","last_unstale":"2024-09-21T03:40:51.467995+0000","last_undegraded":"2024-09-21T03:40:51.467995+0000","last_fullsized":"2024-09-21T03:40:51.467995+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:04.641927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467072+0000","last_change":"2024-09-21T03:40:29.341728+0000","last_active":"2024-09-21T03:40:51.467072+0000","last_peered":"2024-09-21T03:40:51.467072+0000","last_clean":"2024-09-21T03:40:51.467072+0000","last_became_active":"2024-09-21T03:40:29.339252+0000","last_became_peered":"2024-09-21T03:40:29.339252+0000","last_unstale":"2024-09-21T03:40:51.467072+0000","last_undegraded":"2024-09-21T03:40:51.467072+0000","last_fullsized":"2024-09-21T03:40:51.467072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:53.618128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780271+0000","last_change":"2024-09-21T03:40:29.326893+0000","last_active":"2024-09-21T03:40:51.780271+0000","last_peered":"2024-09-21T03:40:51.780271+0000","last_clean":"2024-09-21T03:40:51.780271+0000","last_became_active":"2024-09-21T03:40:29.326427+0000","last_became_peered":"2024-09-21T03:40:29.326427+0000","last_unstale":"2024-09-21T03:40:51.780271+0000","last_undegraded":"2024-09-21T03:40:51.780271+0000","last_fullsized":"2024-09-21T03:40:51.780271+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:41.036179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469836+0000","last_change":"2024-09-21T03:40:29.340410+0000","last_active":"2024-09-21T03:40:51.469836+0000","last_peered":"2024-09-21T03:40:51.469836+0000","last_clean":"2024-09-21T03:40:51.469836+0000","last_became_active":"2024-09-21T03:40:29.340062+0000","last_became_peered":"2024-09-21T03:40:29.340062+0000","last_unstale":"2024-09-21T03:40:51.469836+0000","last_undegraded":"2024-09-21T03:40:51.469836+0000","last_fullsized":"2024-09-21T03:40:51.469836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:44.971145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467557+0000","last_change":"2024-09-21T03:40:29.333387+0000","last_active":"2024-09-21T03:40:51.467557+0000","last_peered":"2024-09-21T03:40:51.467557+0000","last_clean":"2024-09-21T03:40:51.467557+0000","last_became_active":"2024-09-21T03:40:29.332511+0000","last_became_peered":"2024-09-21T03:40:29.332511+0000","last_unstale":"2024-09-21T03:40:51.467557+0000","last_undegraded":"2024-09-21T03:40:51.467557+0000","last_fullsized":"2024-09-21T03:40:51.467557+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:24.513267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468408+0000","last_change":"2024-09-21T03:40:29.337845+0000","last_active":"2024-09-21T03:40:51.468408+0000","last_peered":"2024-09-21T03:40:51.468408+0000","last_clean":"2024-09-21T03:40:51.468408+0000","last_became_active":"2024-09-21T03:40:29.337387+0000","last_became_peered":"2024-09-21T03:40:29.337387+0000","last_unstale":"2024-09-21T03:40:51.468408+0000","last_undegraded":"2024-09-21T03:40:51.468408+0000","last_fullsized":"2024-09-21T03:40:51.468408+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:31.398337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.466847+0000","last_change":"2024-09-21T03:40:29.342691+0000","last_active":"2024-09-21T03:40:51.466847+0000","last_peered":"2024-09-21T03:40:51.466847+0000","last_clean":"2024-09-21T03:40:51.466847+0000","last_became_active":"2024-09-21T03:40:29.342294+0000","last_became_peered":"2024-09-21T03:40:29.342294+0000","last_unstale":"2024-09-21T03:40:51.466847+0000","last_undegraded":"2024-09-21T03:40:51.466847+0000","last_fullsized":"2024-09-21T03:40:51.466847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:25.806074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470482+0000","last_change":"2024-09-21T03:40:29.338280+0000","last_active":"2024-09-21T03:40:51.470482+0000","last_peered":"2024-09-21T03:40:51.470482+0000","last_clean":"2024-09-21T03:40:51.470482+0000","last_became_active":"2024-09-21T03:40:29.337825+0000","last_became_peered":"2024-09-21T03:40:29.337825+0000","last_unstale":"2024-09-21T03:40:51.470482+0000","last_undegraded":"2024-09-21T03:40:51.470482+0000","last_fullsized":"2024-09-21T03:40:51.470482+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:43.340248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":103,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:35.705764+0000","last_change":"2024-09-21T03:40:51.641130+0000","last_active":"2024-09-21T03:41:35.705764+0000","last_peered":"2024-09-21T03:41:35.705764+0000","last_clean":"2024-09-21T03:41:35.705764+0000","last_became_active":"2024-09-21T03:40:51.636641+0000","last_became_peered":"2024-09-21T03:40:51.636641+0000","last_unstale":"2024-09-21T03:41:35.705764+0000","last_undegraded":"2024-09-21T03:41:35.705764+0000","last_fullsized":"2024-09-21T03:41:35.705764+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:34.797959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464518+0000","last_change":"2024-09-21T03:40:29.341830+0000","last_active":"2024-09-21T03:40:51.464518+0000","last_peered":"2024-09-21T03:40:51.464518+0000","last_clean":"2024-09-21T03:40:51.464518+0000","last_became_active":"2024-09-21T03:40:29.341112+0000","last_became_peered":"2024-09-21T03:40:29.341112+0000","last_unstale":"2024-09-21T03:40:51.464518+0000","last_undegraded":"2024-09-21T03:40:51.464518+0000","last_fullsized":"2024-09-21T03:40:51.464518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:31.560605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468958+0000","last_change":"2024-09-21T03:40:27.319393+0000","last_active":"2024-09-21T03:40:51.468958+0000","last_peered":"2024-09-21T03:40:51.468958+0000","last_clean":"2024-09-21T03:40:51.468958+0000","last_became_active":"2024-09-21T03:40:27.319000+0000","last_became_peered":"2024-09-21T03:40:27.319000+0000","last_unstale":"2024-09-21T03:40:51.468958+0000","last_undegraded":"2024-09-21T03:40:51.468958+0000","last_fullsized":"2024-09-21T03:40:51.468958+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:24.752295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780193+0000","last_change":"2024-09-21T03:40:27.317276+0000","last_active":"2024-09-21T03:40:51.780193+0000","last_peered":"2024-09-21T03:40:51.780193+0000","last_clean":"2024-09-21T03:40:51.780193+0000","last_became_active":"2024-09-21T03:40:27.316955+0000","last_became_peered":"2024-09-21T03:40:27.316955+0000","last_unstale":"2024-09-21T03:40:51.780193+0000","last_undegraded":"2024-09-21T03:40:51.780193+0000","last_fullsized":"2024-09-21T03:40:51.780193+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:23.208493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463471+0000","last_change":"2024-09-21T03:40:29.324774+0000","last_active":"2024-09-21T03:40:51.463471+0000","last_peered":"2024-09-21T03:40:51.463471+0000","last_clean":"2024-09-21T03:40:51.463471+0000","last_became_active":"2024-09-21T03:40:29.324107+0000","last_became_peered":"2024-09-21T03:40:29.324107+0000","last_unstale":"2024-09-21T03:40:51.463471+0000","last_undegraded":"2024-09-21T03:40:51.463471+0000","last_fullsized":"2024-09-21T03:40:51.463471+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:15.408620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464393+0000","last_change":"2024-09-21T03:40:27.316818+0000","last_active":"2024-09-21T03:40:51.464393+0000","last_peered":"2024-09-21T03:40:51.464393+0000","last_clean":"2024-09-21T03:40:51.464393+0000","last_became_active":"2024-09-21T03:40:27.316209+0000","last_became_peered":"2024-09-21T03:40:27.316209+0000","last_unstale":"2024-09-21T03:40:51.464393+0000","last_undegraded":"2024-09-21T03:40:51.464393+0000","last_fullsized":"2024-09-21T03:40:51.464393+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:01.869684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470071+0000","last_change":"2024-09-21T03:40:29.335033+0000","last_active":"2024-09-21T03:40:51.470071+0000","last_peered":"2024-09-21T03:40:51.470071+0000","last_clean":"2024-09-21T03:40:51.470071+0000","last_became_active":"2024-09-21T03:40:29.334607+0000","last_became_peered":"2024-09-21T03:40:29.334607+0000","last_unstale":"2024-09-21T03:40:51.470071+0000","last_undegraded":"2024-09-21T03:40:51.470071+0000","last_fullsized":"2024-09-21T03:40:51.470071+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:05.892248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":80,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:31.698913+0000","last_change":"2024-09-21T03:40:27.319422+0000","last_active":"2024-09-21T03:41:31.698913+0000","last_peered":"2024-09-21T03:41:31.698913+0000","last_clean":"2024-09-21T03:41:31.698913+0000","last_became_active":"2024-09-21T03:40:27.318970+0000","last_became_peered":"2024-09-21T03:40:27.318970+0000","last_unstale":"2024-09-21T03:41:31.698913+0000","last_undegraded":"2024-09-21T03:41:31.698913+0000","last_fullsized":"2024-09-21T03:41:31.698913+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:04.263789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467619+0000","last_change":"2024-09-21T03:40:29.334279+0000","last_active":"2024-09-21T03:40:51.467619+0000","last_peered":"2024-09-21T03:40:51.467619+0000","last_clean":"2024-09-21T03:40:51.467619+0000","last_became_active":"2024-09-21T03:40:29.333445+0000","last_became_peered":"2024-09-21T03:40:29.333445+0000","last_unstale":"2024-09-21T03:40:51.467619+0000","last_undegraded":"2024-09-21T03:40:51.467619+0000","last_fullsized":"2024-09-21T03:40:51.467619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:10.445162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.643258+0000","last_change":"2024-09-21T03:40:51.643129+0000","last_active":"2024-09-21T03:40:51.643258+0000","last_peered":"2024-09-21T03:40:51.643258+0000","last_clean":"2024-09-21T03:40:51.643258+0000","last_became_active":"2024-09-21T03:40:51.637136+0000","last_became_peered":"2024-09-21T03:40:51.637136+0000","last_unstale":"2024-09-21T03:40:51.643258+0000","last_undegraded":"2024-09-21T03:40:51.643258+0000","last_fullsized":"2024-09-21T03:40:51.643258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:39.540452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470202+0000","last_change":"2024-09-21T03:40:29.340393+0000","last_active":"2024-09-21T03:40:51.470202+0000","last_peered":"2024-09-21T03:40:51.470202+0000","last_clean":"2024-09-21T03:40:51.470202+0000","last_became_active":"2024-09-21T03:40:29.340042+0000","last_became_peered":"2024-09-21T03:40:29.340042+0000","last_unstale":"2024-09-21T03:40:51.470202+0000","last_undegraded":"2024-09-21T03:40:51.470202+0000","last_fullsized":"2024-09-21T03:40:51.470202+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:43.794252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464730+0000","last_change":"2024-09-21T03:40:27.526458+0000","last_active":"2024-09-21T03:40:51.464730+0000","last_peered":"2024-09-21T03:40:51.464730+0000","last_clean":"2024-09-21T03:40:51.464730+0000","last_became_active":"2024-09-21T03:40:27.525918+0000","last_became_peered":"2024-09-21T03:40:27.525918+0000","last_unstale":"2024-09-21T03:40:51.464730+0000","last_undegraded":"2024-09-21T03:40:51.464730+0000","last_fullsized":"2024-09-21T03:40:51.464730+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:47.286475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467301+0000","last_change":"2024-09-21T03:40:29.338197+0000","last_active":"2024-09-21T03:40:51.467301+0000","last_peered":"2024-09-21T03:40:51.467301+0000","last_clean":"2024-09-21T03:40:51.467301+0000","last_became_active":"2024-09-21T03:40:29.337852+0000","last_became_peered":"2024-09-21T03:40:29.337852+0000","last_unstale":"2024-09-21T03:40:51.467301+0000","last_undegraded":"2024-09-21T03:40:51.467301+0000","last_fullsized":"2024-09-21T03:40:51.467301+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:09.132407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'26","reported_seq":165,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:32.700425+0000","last_change":"2024-09-21T03:40:27.320891+0000","last_active":"2024-09-21T03:41:32.700425+0000","last_peered":"2024-09-21T03:41:32.700425+0000","last_clean":"2024-09-21T03:41:32.700425+0000","last_became_active":"2024-09-21T03:40:27.320512+0000","last_became_peered":"2024-09-21T03:40:27.320512+0000","last_unstale":"2024-09-21T03:41:32.700425+0000","last_undegraded":"2024-09-21T03:41:32.700425+0000","last_fullsized":"2024-09-21T03:41:32.700425+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:27.181130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63349,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":119,"num_write":27,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470843+0000","last_change":"2024-09-21T03:40:29.335570+0000","last_active":"2024-09-21T03:40:51.470843+0000","last_peered":"2024-09-21T03:40:51.470843+0000","last_clean":"2024-09-21T03:40:51.470843+0000","last_became_active":"2024-09-21T03:40:29.335226+0000","last_became_peered":"2024-09-21T03:40:29.335226+0000","last_unstale":"2024-09-21T03:40:51.470843+0000","last_undegraded":"2024-09-21T03:40:51.470843+0000","last_fullsized":"2024-09-21T03:40:51.470843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:56.434945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468293+0000","last_change":"2024-09-21T03:40:27.318436+0000","last_active":"2024-09-21T03:40:51.468293+0000","last_peered":"2024-09-21T03:40:51.468293+0000","last_clean":"2024-09-21T03:40:51.468293+0000","last_became_active":"2024-09-21T03:40:27.317969+0000","last_became_peered":"2024-09-21T03:40:27.317969+0000","last_unstale":"2024-09-21T03:40:51.468293+0000","last_undegraded":"2024-09-21T03:40:51.468293+0000","last_fullsized":"2024-09-21T03:40:51.468293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:43.137717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780149+0000","last_change":"2024-09-21T03:40:29.325824+0000","last_active":"2024-09-21T03:40:51.780149+0000","last_peered":"2024-09-21T03:40:51.780149+0000","last_clean":"2024-09-21T03:40:51.780149+0000","last_became_active":"2024-09-21T03:40:29.325498+0000","last_became_peered":"2024-09-21T03:40:29.325498+0000","last_unstale":"2024-09-21T03:40:51.780149+0000","last_undegraded":"2024-09-21T03:40:51.780149+0000","last_fullsized":"2024-09-21T03:40:51.780149+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:13.044835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464366+0000","last_change":"2024-09-21T03:40:27.308889+0000","last_active":"2024-09-21T03:40:51.464366+0000","last_peered":"2024-09-21T03:40:51.464366+0000","last_clean":"2024-09-21T03:40:51.464366+0000","last_became_active":"2024-09-21T03:40:27.308491+0000","last_became_peered":"2024-09-21T03:40:27.308491+0000","last_unstale":"2024-09-21T03:40:51.464366+0000","last_undegraded":"2024-09-21T03:40:51.464366+0000","last_fullsized":"2024-09-21T03:40:51.464366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:48.250898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.781387+0000","last_change":"2024-09-21T03:40:51.781287+0000","last_active":"2024-09-21T03:40:51.781387+0000","last_peered":"2024-09-21T03:40:51.781387+0000","last_clean":"2024-09-21T03:40:51.781387+0000","last_became_active":"2024-09-21T03:40:51.780925+0000","last_became_peered":"2024-09-21T03:40:51.780925+0000","last_unstale":"2024-09-21T03:40:51.781387+0000","last_undegraded":"2024-09-21T03:40:51.781387+0000","last_fullsized":"2024-09-21T03:40:51.781387+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:36.599949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'3","reported_seq":85,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:34.518150+0000","last_change":"2024-09-21T03:40:27.316066+0000","last_active":"2024-09-21T03:41:34.518150+0000","last_peered":"2024-09-21T03:41:34.518150+0000","last_clean":"2024-09-21T03:41:34.518150+0000","last_became_active":"2024-09-21T03:40:27.315580+0000","last_became_peered":"2024-09-21T03:40:27.315580+0000","last_unstale":"2024-09-21T03:41:34.518150+0000","last_undegraded":"2024-09-21T03:41:34.518150+0000","last_fullsized":"2024-09-21T03:41:34.518150+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:14.592824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464178+0000","last_change":"2024-09-21T03:40:29.339736+0000","last_active":"2024-09-21T03:40:51.464178+0000","last_peered":"2024-09-21T03:40:51.464178+0000","last_clean":"2024-09-21T03:40:51.464178+0000","last_became_active":"2024-09-21T03:40:29.338343+0000","last_became_peered":"2024-09-21T03:40:29.338343+0000","last_unstale":"2024-09-21T03:40:51.464178+0000","last_undegraded":"2024-09-21T03:40:51.464178+0000","last_fullsized":"2024-09-21T03:40:51.464178+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:33.531580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.485664+0000","last_change":"2024-09-21T03:40:51.485123+0000","last_active":"2024-09-21T03:40:51.485664+0000","last_peered":"2024-09-21T03:40:51.485664+0000","last_clean":"2024-09-21T03:40:51.485664+0000","last_became_active":"2024-09-21T03:40:51.471029+0000","last_became_peered":"2024-09-21T03:40:51.471029+0000","last_unstale":"2024-09-21T03:40:51.485664+0000","last_undegraded":"2024-09-21T03:40:51.485664+0000","last_fullsized":"2024-09-21T03:40:51.485664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:32.870908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464267+0000","last_change":"2024-09-21T03:40:29.340712+0000","last_active":"2024-09-21T03:40:51.464267+0000","last_peered":"2024-09-21T03:40:51.464267+0000","last_clean":"2024-09-21T03:40:51.464267+0000","last_became_active":"2024-09-21T03:40:29.340349+0000","last_became_peered":"2024-09-21T03:40:29.340349+0000","last_unstale":"2024-09-21T03:40:51.464267+0000","last_undegraded":"2024-09-21T03:40:51.464267+0000","last_fullsized":"2024-09-21T03:40:51.464267+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:29.980697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470772+0000","last_change":"2024-09-21T03:40:27.319689+0000","last_active":"2024-09-21T03:40:51.470772+0000","last_peered":"2024-09-21T03:40:51.470772+0000","last_clean":"2024-09-21T03:40:51.470772+0000","last_became_active":"2024-09-21T03:40:27.319010+0000","last_became_peered":"2024-09-21T03:40:27.319010+0000","last_unstale":"2024-09-21T03:40:51.470772+0000","last_undegraded":"2024-09-21T03:40:51.470772+0000","last_fullsized":"2024-09-21T03:40:51.470772+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:42.965205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.636897+0000","last_change":"2024-09-21T03:40:51.636790+0000","last_active":"2024-09-21T03:40:51.636897+0000","last_peered":"2024-09-21T03:40:51.636897+0000","last_clean":"2024-09-21T03:40:51.636897+0000","last_became_active":"2024-09-21T03:40:51.636333+0000","last_became_peered":"2024-09-21T03:40:51.636333+0000","last_unstale":"2024-09-21T03:40:51.636897+0000","last_undegraded":"2024-09-21T03:40:51.636897+0000","last_fullsized":"2024-09-21T03:40:51.636897+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:27.186564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780182+0000","last_change":"2024-09-21T03:40:27.316086+0000","last_active":"2024-09-21T03:40:51.780182+0000","last_peered":"2024-09-21T03:40:51.780182+0000","last_clean":"2024-09-21T03:40:51.780182+0000","last_became_active":"2024-09-21T03:40:27.315645+0000","last_became_peered":"2024-09-21T03:40:27.315645+0000","last_unstale":"2024-09-21T03:40:51.780182+0000","last_undegraded":"2024-09-21T03:40:51.780182+0000","last_fullsized":"2024-09-21T03:40:51.780182+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:41.536778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464622+0000","last_change":"2024-09-21T03:40:29.339546+0000","last_active":"2024-09-21T03:40:51.464622+0000","last_peered":"2024-09-21T03:40:51.464622+0000","last_clean":"2024-09-21T03:40:51.464622+0000","last_became_active":"2024-09-21T03:40:29.339176+0000","last_became_peered":"2024-09-21T03:40:29.339176+0000","last_unstale":"2024-09-21T03:40:51.464622+0000","last_undegraded":"2024-09-21T03:40:51.464622+0000","last_fullsized":"2024-09-21T03:40:51.464622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:26.405624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464973+0000","last_change":"2024-09-21T03:40:27.315440+0000","last_active":"2024-09-21T03:40:51.464973+0000","last_peered":"2024-09-21T03:40:51.464973+0000","last_clean":"2024-09-21T03:40:51.464973+0000","last_became_active":"2024-09-21T03:40:27.314608+0000","last_became_peered":"2024-09-21T03:40:27.314608+0000","last_unstale":"2024-09-21T03:40:51.464973+0000","last_undegraded":"2024-09-21T03:40:51.464973+0000","last_fullsized":"2024-09-21T03:40:51.464973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:11.465078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464466+0000","last_change":"2024-09-21T03:40:29.336631+0000","last_active":"2024-09-21T03:40:51.464466+0000","last_peered":"2024-09-21T03:40:51.464466+0000","last_clean":"2024-09-21T03:40:51.464466+0000","last_became_active":"2024-09-21T03:40:29.336201+0000","last_became_peered":"2024-09-21T03:40:29.336201+0000","last_unstale":"2024-09-21T03:40:51.464466+0000","last_undegraded":"2024-09-21T03:40:51.464466+0000","last_fullsized":"2024-09-21T03:40:51.464466+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:29.514908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468161+0000","last_change":"2024-09-21T03:40:27.719183+0000","last_active":"2024-09-21T03:40:51.468161+0000","last_peered":"2024-09-21T03:40:51.468161+0000","last_clean":"2024-09-21T03:40:51.468161+0000","last_became_active":"2024-09-21T03:40:27.718658+0000","last_became_peered":"2024-09-21T03:40:27.718658+0000","last_unstale":"2024-09-21T03:40:51.468161+0000","last_undegraded":"2024-09-21T03:40:51.468161+0000","last_fullsized":"2024-09-21T03:40:51.468161+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:52.280654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464860+0000","last_change":"2024-09-21T03:40:29.335258+0000","last_active":"2024-09-21T03:40:51.464860+0000","last_peered":"2024-09-21T03:40:51.464860+0000","last_clean":"2024-09-21T03:40:51.464860+0000","last_became_active":"2024-09-21T03:40:29.334897+0000","last_became_peered":"2024-09-21T03:40:29.334897+0000","last_unstale":"2024-09-21T03:40:51.464860+0000","last_undegraded":"2024-09-21T03:40:51.464860+0000","last_fullsized":"2024-09-21T03:40:51.464860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:27.040232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":95,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464382+0000","last_change":"2024-09-21T03:39:15.369567+0000","last_active":"2024-09-21T03:40:51.464382+0000","last_peered":"2024-09-21T03:40:51.464382+0000","last_clean":"2024-09-21T03:40:51.464382+0000","last_became_active":"2024-09-21T03:39:15.363960+0000","last_became_peered":"2024-09-21T03:39:15.363960+0000","last_unstale":"2024-09-21T03:40:51.464382+0000","last_undegraded":"2024-09-21T03:40:51.464382+0000","last_fullsized":"2024-09-21T03:40:51.464382+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:35:51.240165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:35:51.240165+0000","last_clean_scrub_stamp":"2024-09-21T03:35:51.240165+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:10.335425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.635844+0000","last_change":"2024-09-21T03:40:27.316831+0000","last_active":"2024-09-21T03:40:51.635844+0000","last_peered":"2024-09-21T03:40:51.635844+0000","last_clean":"2024-09-21T03:40:51.635844+0000","last_became_active":"2024-09-21T03:40:27.315547+0000","last_became_peered":"2024-09-21T03:40:27.315547+0000","last_unstale":"2024-09-21T03:40:51.635844+0000","last_undegraded":"2024-09-21T03:40:51.635844+0000","last_fullsized":"2024-09-21T03:40:51.635844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:02.727366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463852+0000","last_change":"2024-09-21T03:40:29.339059+0000","last_active":"2024-09-21T03:40:51.463852+0000","last_peered":"2024-09-21T03:40:51.463852+0000","last_clean":"2024-09-21T03:40:51.463852+0000","last_became_active":"2024-09-21T03:40:29.338710+0000","last_became_peered":"2024-09-21T03:40:29.338710+0000","last_unstale":"2024-09-21T03:40:51.463852+0000","last_undegraded":"2024-09-21T03:40:51.463852+0000","last_fullsized":"2024-09-21T03:40:51.463852+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:50.390629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464355+0000","last_change":"2024-09-21T03:40:27.314666+0000","last_active":"2024-09-21T03:40:51.464355+0000","last_peered":"2024-09-21T03:40:51.464355+0000","last_clean":"2024-09-21T03:40:51.464355+0000","last_became_active":"2024-09-21T03:40:27.314254+0000","last_became_peered":"2024-09-21T03:40:27.314254+0000","last_unstale":"2024-09-21T03:40:51.464355+0000","last_undegraded":"2024-09-21T03:40:51.464355+0000","last_fullsized":"2024-09-21T03:40:51.464355+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:57.230420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780142+0000","last_change":"2024-09-21T03:40:29.338249+0000","last_active":"2024-09-21T03:40:51.780142+0000","last_peered":"2024-09-21T03:40:51.780142+0000","last_clean":"2024-09-21T03:40:51.780142+0000","last_became_active":"2024-09-21T03:40:29.337901+0000","last_became_peered":"2024-09-21T03:40:29.337901+0000","last_unstale":"2024-09-21T03:40:51.780142+0000","last_undegraded":"2024-09-21T03:40:51.780142+0000","last_fullsized":"2024-09-21T03:40:51.780142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:21.054734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":85,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:35.519485+0000","last_change":"2024-09-21T03:40:27.525651+0000","last_active":"2024-09-21T03:41:35.519485+0000","last_peered":"2024-09-21T03:41:35.519485+0000","last_clean":"2024-09-21T03:41:35.519485+0000","last_became_active":"2024-09-21T03:40:27.525299+0000","last_became_peered":"2024-09-21T03:40:27.525299+0000","last_unstale":"2024-09-21T03:41:35.519485+0000","last_undegraded":"2024-09-21T03:41:35.519485+0000","last_fullsized":"2024-09-21T03:41:35.519485+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:21.983937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464267+0000","last_change":"2024-09-21T03:40:29.339021+0000","last_active":"2024-09-21T03:40:51.464267+0000","last_peered":"2024-09-21T03:40:51.464267+0000","last_clean":"2024-09-21T03:40:51.464267+0000","last_became_active":"2024-09-21T03:40:29.338660+0000","last_became_peered":"2024-09-21T03:40:29.338660+0000","last_unstale":"2024-09-21T03:40:51.464267+0000","last_undegraded":"2024-09-21T03:40:51.464267+0000","last_fullsized":"2024-09-21T03:40:51.464267+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:56.652048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.465111+0000","last_change":"2024-09-21T03:40:27.319650+0000","last_active":"2024-09-21T03:40:51.465111+0000","last_peered":"2024-09-21T03:40:51.465111+0000","last_clean":"2024-09-21T03:40:51.465111+0000","last_became_active":"2024-09-21T03:40:27.319188+0000","last_became_peered":"2024-09-21T03:40:27.319188+0000","last_unstale":"2024-09-21T03:40:51.465111+0000","last_undegraded":"2024-09-21T03:40:51.465111+0000","last_fullsized":"2024-09-21T03:40:51.465111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:12.905682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469050+0000","last_change":"2024-09-21T03:40:29.340673+0000","last_active":"2024-09-21T03:40:51.469050+0000","last_peered":"2024-09-21T03:40:51.469050+0000","last_clean":"2024-09-21T03:40:51.469050+0000","last_became_active":"2024-09-21T03:40:29.340240+0000","last_became_peered":"2024-09-21T03:40:29.340240+0000","last_unstale":"2024-09-21T03:40:51.469050+0000","last_undegraded":"2024-09-21T03:40:51.469050+0000","last_fullsized":"2024-09-21T03:40:51.469050+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:02.989879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470390+0000","last_change":"2024-09-21T03:40:27.527803+0000","last_active":"2024-09-21T03:40:51.470390+0000","last_peered":"2024-09-21T03:40:51.470390+0000","last_clean":"2024-09-21T03:40:51.470390+0000","last_became_active":"2024-09-21T03:40:27.527419+0000","last_became_peered":"2024-09-21T03:40:27.527419+0000","last_unstale":"2024-09-21T03:40:51.470390+0000","last_undegraded":"2024-09-21T03:40:51.470390+0000","last_fullsized":"2024-09-21T03:40:51.470390+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:15:16.081458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.469232+0000","last_change":"2024-09-21T03:40:29.347927+0000","last_active":"2024-09-21T03:40:51.469232+0000","last_peered":"2024-09-21T03:40:51.469232+0000","last_clean":"2024-09-21T03:40:51.469232+0000","last_became_active":"2024-09-21T03:40:29.347574+0000","last_became_peered":"2024-09-21T03:40:29.347574+0000","last_unstale":"2024-09-21T03:40:51.469232+0000","last_undegraded":"2024-09-21T03:40:51.469232+0000","last_fullsized":"2024-09-21T03:40:51.469232+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:10.142931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.488011+0000","last_change":"2024-09-21T03:40:51.487492+0000","last_active":"2024-09-21T03:40:51.488011+0000","last_peered":"2024-09-21T03:40:51.488011+0000","last_clean":"2024-09-21T03:40:51.488011+0000","last_became_active":"2024-09-21T03:40:51.472023+0000","last_became_peered":"2024-09-21T03:40:51.472023+0000","last_unstale":"2024-09-21T03:40:51.488011+0000","last_undegraded":"2024-09-21T03:40:51.488011+0000","last_fullsized":"2024-09-21T03:40:51.488011+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:40.164056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780314+0000","last_change":"2024-09-21T03:40:29.332539+0000","last_active":"2024-09-21T03:40:51.780314+0000","last_peered":"2024-09-21T03:40:51.780314+0000","last_clean":"2024-09-21T03:40:51.780314+0000","last_became_active":"2024-09-21T03:40:29.332178+0000","last_became_peered":"2024-09-21T03:40:29.332178+0000","last_unstale":"2024-09-21T03:40:51.780314+0000","last_undegraded":"2024-09-21T03:40:51.780314+0000","last_fullsized":"2024-09-21T03:40:51.780314+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:00.354558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'10","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:54.344416+0000","last_change":"2024-09-21T03:40:27.313942+0000","last_active":"2024-09-21T03:40:54.344416+0000","last_peered":"2024-09-21T03:40:54.344416+0000","last_clean":"2024-09-21T03:40:54.344416+0000","last_became_active":"2024-09-21T03:40:27.313541+0000","last_became_peered":"2024-09-21T03:40:27.313541+0000","last_unstale":"2024-09-21T03:40:54.344416+0000","last_undegraded":"2024-09-21T03:40:54.344416+0000","last_fullsized":"2024-09-21T03:40:54.344416+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:58.572154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463827+0000","last_change":"2024-09-21T03:40:29.330712+0000","last_active":"2024-09-21T03:40:51.463827+0000","last_peered":"2024-09-21T03:40:51.463827+0000","last_clean":"2024-09-21T03:40:51.463827+0000","last_became_active":"2024-09-21T03:40:29.330345+0000","last_became_peered":"2024-09-21T03:40:29.330345+0000","last_unstale":"2024-09-21T03:40:51.463827+0000","last_undegraded":"2024-09-21T03:40:51.463827+0000","last_fullsized":"2024-09-21T03:40:51.463827+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:54.225288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.635760+0000","last_change":"2024-09-21T03:40:27.719239+0000","last_active":"2024-09-21T03:40:51.635760+0000","last_peered":"2024-09-21T03:40:51.635760+0000","last_clean":"2024-09-21T03:40:51.635760+0000","last_became_active":"2024-09-21T03:40:27.718834+0000","last_became_peered":"2024-09-21T03:40:27.718834+0000","last_unstale":"2024-09-21T03:40:51.635760+0000","last_undegraded":"2024-09-21T03:40:51.635760+0000","last_fullsized":"2024-09-21T03:40:51.635760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:47.357723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470066+0000","last_change":"2024-09-21T03:40:29.338470+0000","last_active":"2024-09-21T03:40:51.470066+0000","last_peered":"2024-09-21T03:40:51.470066+0000","last_clean":"2024-09-21T03:40:51.470066+0000","last_became_active":"2024-09-21T03:40:29.338114+0000","last_became_peered":"2024-09-21T03:40:29.338114+0000","last_unstale":"2024-09-21T03:40:51.470066+0000","last_undegraded":"2024-09-21T03:40:51.470066+0000","last_fullsized":"2024-09-21T03:40:51.470066+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:23.715773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467223+0000","last_change":"2024-09-21T03:40:27.525544+0000","last_active":"2024-09-21T03:40:51.467223+0000","last_peered":"2024-09-21T03:40:51.467223+0000","last_clean":"2024-09-21T03:40:51.467223+0000","last_became_active":"2024-09-21T03:40:27.525196+0000","last_became_peered":"2024-09-21T03:40:27.525196+0000","last_unstale":"2024-09-21T03:40:51.467223+0000","last_undegraded":"2024-09-21T03:40:51.467223+0000","last_fullsized":"2024-09-21T03:40:51.467223+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:57:07.882351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470212+0000","last_change":"2024-09-21T03:40:29.337774+0000","last_active":"2024-09-21T03:40:51.470212+0000","last_peered":"2024-09-21T03:40:51.470212+0000","last_clean":"2024-09-21T03:40:51.470212+0000","last_became_active":"2024-09-21T03:40:29.337393+0000","last_became_peered":"2024-09-21T03:40:29.337393+0000","last_unstale":"2024-09-21T03:40:51.470212+0000","last_undegraded":"2024-09-21T03:40:51.470212+0000","last_fullsized":"2024-09-21T03:40:51.470212+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:20.471042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463610+0000","last_change":"2024-09-21T03:40:27.312953+0000","last_active":"2024-09-21T03:40:51.463610+0000","last_peered":"2024-09-21T03:40:51.463610+0000","last_clean":"2024-09-21T03:40:51.463610+0000","last_became_active":"2024-09-21T03:40:27.312603+0000","last_became_peered":"2024-09-21T03:40:27.312603+0000","last_unstale":"2024-09-21T03:40:51.463610+0000","last_undegraded":"2024-09-21T03:40:51.463610+0000","last_fullsized":"2024-09-21T03:40:51.463610+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:18.102812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467010+0000","last_change":"2024-09-21T03:40:29.330802+0000","last_active":"2024-09-21T03:40:51.467010+0000","last_peered":"2024-09-21T03:40:51.467010+0000","last_clean":"2024-09-21T03:40:51.467010+0000","last_became_active":"2024-09-21T03:40:29.330426+0000","last_became_peered":"2024-09-21T03:40:29.330426+0000","last_unstale":"2024-09-21T03:40:51.467010+0000","last_undegraded":"2024-09-21T03:40:51.467010+0000","last_fullsized":"2024-09-21T03:40:51.467010+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:08:18.552649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467619+0000","last_change":"2024-09-21T03:40:27.319829+0000","last_active":"2024-09-21T03:40:51.467619+0000","last_peered":"2024-09-21T03:40:51.467619+0000","last_clean":"2024-09-21T03:40:51.467619+0000","last_became_active":"2024-09-21T03:40:27.319410+0000","last_became_peered":"2024-09-21T03:40:27.319410+0000","last_unstale":"2024-09-21T03:40:51.467619+0000","last_undegraded":"2024-09-21T03:40:51.467619+0000","last_fullsized":"2024-09-21T03:40:51.467619+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:56.475721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463651+0000","last_change":"2024-09-21T03:40:29.335897+0000","last_active":"2024-09-21T03:40:51.463651+0000","last_peered":"2024-09-21T03:40:51.463651+0000","last_clean":"2024-09-21T03:40:51.463651+0000","last_became_active":"2024-09-21T03:40:29.335549+0000","last_became_peered":"2024-09-21T03:40:29.335549+0000","last_unstale":"2024-09-21T03:40:51.463651+0000","last_undegraded":"2024-09-21T03:40:51.463651+0000","last_fullsized":"2024-09-21T03:40:51.463651+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:01.401766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470266+0000","last_change":"2024-09-21T03:40:27.316678+0000","last_active":"2024-09-21T03:40:51.470266+0000","last_peered":"2024-09-21T03:40:51.470266+0000","last_clean":"2024-09-21T03:40:51.470266+0000","last_became_active":"2024-09-21T03:40:27.315980+0000","last_became_peered":"2024-09-21T03:40:27.315980+0000","last_unstale":"2024-09-21T03:40:51.470266+0000","last_undegraded":"2024-09-21T03:40:51.470266+0000","last_fullsized":"2024-09-21T03:40:51.470266+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:56.280077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464472+0000","last_change":"2024-09-21T03:40:29.333638+0000","last_active":"2024-09-21T03:40:51.464472+0000","last_peered":"2024-09-21T03:40:51.464472+0000","last_clean":"2024-09-21T03:40:51.464472+0000","last_became_active":"2024-09-21T03:40:29.333268+0000","last_became_peered":"2024-09-21T03:40:29.333268+0000","last_unstale":"2024-09-21T03:40:51.464472+0000","last_undegraded":"2024-09-21T03:40:51.464472+0000","last_fullsized":"2024-09-21T03:40:51.464472+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:35:23.346837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464730+0000","last_change":"2024-09-21T03:40:29.342199+0000","last_active":"2024-09-21T03:40:51.464730+0000","last_peered":"2024-09-21T03:40:51.464730+0000","last_clean":"2024-09-21T03:40:51.464730+0000","last_became_active":"2024-09-21T03:40:29.341675+0000","last_became_peered":"2024-09-21T03:40:29.341675+0000","last_unstale":"2024-09-21T03:40:51.464730+0000","last_undegraded":"2024-09-21T03:40:51.464730+0000","last_fullsized":"2024-09-21T03:40:51.464730+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:01.439058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470666+0000","last_change":"2024-09-21T03:40:27.319327+0000","last_active":"2024-09-21T03:40:51.470666+0000","last_peered":"2024-09-21T03:40:51.470666+0000","last_clean":"2024-09-21T03:40:51.470666+0000","last_became_active":"2024-09-21T03:40:27.318773+0000","last_became_peered":"2024-09-21T03:40:27.318773+0000","last_unstale":"2024-09-21T03:40:51.470666+0000","last_undegraded":"2024-09-21T03:40:51.470666+0000","last_fullsized":"2024-09-21T03:40:51.470666+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:42.444238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467214+0000","last_change":"2024-09-21T03:40:29.336121+0000","last_active":"2024-09-21T03:40:51.467214+0000","last_peered":"2024-09-21T03:40:51.467214+0000","last_clean":"2024-09-21T03:40:51.467214+0000","last_became_active":"2024-09-21T03:40:29.333523+0000","last_became_peered":"2024-09-21T03:40:29.333523+0000","last_unstale":"2024-09-21T03:40:51.467214+0000","last_undegraded":"2024-09-21T03:40:51.467214+0000","last_fullsized":"2024-09-21T03:40:51.467214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:29.303410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470911+0000","last_change":"2024-09-21T03:40:27.316523+0000","last_active":"2024-09-21T03:40:51.470911+0000","last_peered":"2024-09-21T03:40:51.470911+0000","last_clean":"2024-09-21T03:40:51.470911+0000","last_became_active":"2024-09-21T03:40:27.316099+0000","last_became_peered":"2024-09-21T03:40:27.316099+0000","last_unstale":"2024-09-21T03:40:51.470911+0000","last_undegraded":"2024-09-21T03:40:51.470911+0000","last_fullsized":"2024-09-21T03:40:51.470911+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:44.091964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470170+0000","last_change":"2024-09-21T03:40:29.333887+0000","last_active":"2024-09-21T03:40:51.470170+0000","last_peered":"2024-09-21T03:40:51.470170+0000","last_clean":"2024-09-21T03:40:51.470170+0000","last_became_active":"2024-09-21T03:40:29.333465+0000","last_became_peered":"2024-09-21T03:40:29.333465+0000","last_unstale":"2024-09-21T03:40:51.470170+0000","last_undegraded":"2024-09-21T03:40:51.470170+0000","last_fullsized":"2024-09-21T03:40:51.470170+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:46.788188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464003+0000","last_change":"2024-09-21T03:40:27.525812+0000","last_active":"2024-09-21T03:40:51.464003+0000","last_peered":"2024-09-21T03:40:51.464003+0000","last_clean":"2024-09-21T03:40:51.464003+0000","last_became_active":"2024-09-21T03:40:27.525391+0000","last_became_peered":"2024-09-21T03:40:27.525391+0000","last_unstale":"2024-09-21T03:40:51.464003+0000","last_undegraded":"2024-09-21T03:40:51.464003+0000","last_fullsized":"2024-09-21T03:40:51.464003+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:07.856442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463860+0000","last_change":"2024-09-21T03:40:29.339079+0000","last_active":"2024-09-21T03:40:51.463860+0000","last_peered":"2024-09-21T03:40:51.463860+0000","last_clean":"2024-09-21T03:40:51.463860+0000","last_became_active":"2024-09-21T03:40:29.338737+0000","last_became_peered":"2024-09-21T03:40:29.338737+0000","last_unstale":"2024-09-21T03:40:51.463860+0000","last_undegraded":"2024-09-21T03:40:51.463860+0000","last_fullsized":"2024-09-21T03:40:51.463860+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:14.863848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470639+0000","last_change":"2024-09-21T03:40:27.316037+0000","last_active":"2024-09-21T03:40:51.470639+0000","last_peered":"2024-09-21T03:40:51.470639+0000","last_clean":"2024-09-21T03:40:51.470639+0000","last_became_active":"2024-09-21T03:40:27.315604+0000","last_became_peered":"2024-09-21T03:40:27.315604+0000","last_unstale":"2024-09-21T03:40:51.470639+0000","last_undegraded":"2024-09-21T03:40:51.470639+0000","last_fullsized":"2024-09-21T03:40:51.470639+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:48.176252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67350,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":351,"num_read_kb":247,"num_write":159,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1147,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":202050,"data_compressed":5679,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247442,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743451,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":847872,"data_stored":416171,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906975,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":1070867,"data_compressed":43442,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070501,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":416273,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266730,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":839680,"data_stored":416059,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430255,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":901120,"data_stored":1008123,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593781,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":839680,"data_stored":415662,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790010,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":913408,"data_stored":1007807,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986239,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":851968,"data_stored":417112,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":415973,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":479532,"data_compressed":7630,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":478804,"data_compressed":7630,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705747,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":860160,"data_stored":416933,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34191,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34191,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":63349,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64077,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64927,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:41:40.130 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T03:41:40.130 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T03:41:40.130 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T03:41:40.130 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T03:41:40.384 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.912+0000 7f8e4bb98640 1 -- 172.21.15.84:0/2171863136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e441094a0 msgr2=0x7f8e441098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.912+0000 7f8e4bb98640 1 --2- 172.21.15.84:0/2171863136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e441094a0 0x7f8e441098b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8e34009900 tx=0x7f8e3402a410 comp rx=0 tx=0).stop 2024-09-21T03:41:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.912+0000 7f8e4bb98640 1 -- 172.21.15.84:0/2171863136 shutdown_connections 2024-09-21T03:41:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.912+0000 7f8e4bb98640 1 --2- 172.21.15.84:0/2171863136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e44109df0 0x7f8e44110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.912+0000 7f8e4bb98640 1 --2- 172.21.15.84:0/2171863136 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e441094a0 0x7f8e441098b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.912+0000 7f8e4bb98640 1 --2- 172.21.15.84:0/2171863136 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e44103b60 0x7f8e44103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.912+0000 7f8e4bb98640 1 -- 172.21.15.84:0/2171863136 >> 172.21.15.84:0/2171863136 conn(0x7f8e4407b850 msgr2=0x7f8e4407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.913+0000 7f8e4bb98640 1 -- 172.21.15.84:0/2171863136 shutdown_connections 2024-09-21T03:41:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.913+0000 7f8e4bb98640 1 -- 172.21.15.84:0/2171863136 wait complete. 2024-09-21T03:41:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.913+0000 7f8e4bb98640 1 Processor -- start 2024-09-21T03:41:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.913+0000 7f8e4bb98640 1 -- start start 2024-09-21T03:41:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.914+0000 7f8e4bb98640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e44103b60 0x7f8e4419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.914+0000 7f8e4bb98640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e441094a0 0x7f8e4419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.914+0000 7f8e4bb98640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e44109df0 0x7f8e4419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.914+0000 7f8e4bb98640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8e44113ab0 con 0x7f8e441094a0 2024-09-21T03:41:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.914+0000 7f8e4bb98640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e44113930 con 0x7f8e44109df0 2024-09-21T03:41:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.914+0000 7f8e4bb98640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8e44113c30 con 0x7f8e44103b60 2024-09-21T03:41:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.914+0000 7f8e49133640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e441094a0 0x7f8e4419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.914+0000 7f8e49133640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e441094a0 0x7f8e4419ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34180/0 (socket says 172.21.15.84:34180) 2024-09-21T03:41:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.914+0000 7f8e49133640 1 -- 172.21.15.84:0/1733979114 learned_addr learned my addr 172.21.15.84:0/1733979114 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:40.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.914+0000 7f8e4a135640 1 --2- 172.21.15.84:0/1733979114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e44109df0 0x7f8e4419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:40.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.914+0000 7f8e49934640 1 --2- 172.21.15.84:0/1733979114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e44103b60 0x7f8e4419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:40.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.914+0000 7f8e49133640 1 -- 172.21.15.84:0/1733979114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e44103b60 msgr2=0x7f8e4419a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:40.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.914+0000 7f8e49133640 1 --2- 172.21.15.84:0/1733979114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e44103b60 0x7f8e4419a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:40.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.914+0000 7f8e49133640 1 -- 172.21.15.84:0/1733979114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e44109df0 msgr2=0x7f8e4419fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:40.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.914+0000 7f8e49133640 1 --2- 172.21.15.84:0/1733979114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e44109df0 0x7f8e4419fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.914+0000 7f8e49133640 1 -- 172.21.15.84:0/1733979114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e441a04f0 con 0x7f8e441094a0 2024-09-21T03:41:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.914+0000 7f8e4a135640 1 --2- 172.21.15.84:0/1733979114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e44109df0 0x7f8e4419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.914+0000 7f8e49133640 1 --2- 172.21.15.84:0/1733979114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e441094a0 0x7f8e4419ab20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8e3402a930 tx=0x7f8e34004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.914+0000 7f8e3affd640 1 -- 172.21.15.84:0/1733979114 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3403f030 con 0x7f8e441094a0 2024-09-21T03:41:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.915+0000 7f8e4bb98640 1 -- 172.21.15.84:0/1733979114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e441a0780 con 0x7f8e441094a0 2024-09-21T03:41:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.915+0000 7f8e3affd640 1 -- 172.21.15.84:0/1733979114 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e34003aa0 con 0x7f8e441094a0 2024-09-21T03:41:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.915+0000 7f8e3affd640 1 -- 172.21.15.84:0/1733979114 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e34035070 con 0x7f8e441094a0 2024-09-21T03:41:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.915+0000 7f8e4bb98640 1 -- 172.21.15.84:0/1733979114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e441a6f40 con 0x7f8e441094a0 2024-09-21T03:41:40.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.915+0000 7f8e4bb98640 1 -- 172.21.15.84:0/1733979114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e44104de0 con 0x7f8e441094a0 2024-09-21T03:41:40.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.917+0000 7f8e3affd640 1 -- 172.21.15.84:0/1733979114 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f8e34042030 con 0x7f8e441094a0 2024-09-21T03:41:40.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.918+0000 7f8e3affd640 1 --2- 172.21.15.84:0/1733979114 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8e300b65f0 0x7f8e300b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:40.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.918+0000 7f8e49934640 1 --2- 172.21.15.84:0/1733979114 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8e300b65f0 0x7f8e300b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:40.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.918+0000 7f8e3affd640 1 -- 172.21.15.84:0/1733979114 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8e34108040 con 0x7f8e441094a0 2024-09-21T03:41:40.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.918+0000 7f8e49934640 1 --2- 172.21.15.84:0/1733979114 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8e300b65f0 0x7f8e300b8b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8e40005c40 tx=0x7f8e4000a390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:40.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:40.921+0000 7f8e3affd640 1 -- 172.21.15.84:0/1733979114 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8e340ce770 con 0x7f8e441094a0 2024-09-21T03:41:41.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:41.137+0000 7f8e4bb98640 1 -- 172.21.15.84:0/1733979114 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8e4410bbc0 con 0x7f8e441094a0 2024-09-21T03:41:41.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:41.138+0000 7f8e3affd640 1 -- 172.21.15.84:0/1733979114 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8e340d2b50 con 0x7f8e441094a0 2024-09-21T03:41:41.140 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:41:41.140 INFO:teuthology.orchestra.run.smithi084.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T03:41:41.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:41.140+0000 7f8e4bb98640 1 -- 172.21.15.84:0/1733979114 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8e300b65f0 msgr2=0x7f8e300b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:41.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:41.140+0000 7f8e4bb98640 1 --2- 172.21.15.84:0/1733979114 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8e300b65f0 0x7f8e300b8b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8e40005c40 tx=0x7f8e4000a390 comp rx=0 tx=0).stop 2024-09-21T03:41:41.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:41.140+0000 7f8e4bb98640 1 -- 172.21.15.84:0/1733979114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e441094a0 msgr2=0x7f8e4419ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:41.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:41.140+0000 7f8e4bb98640 1 --2- 172.21.15.84:0/1733979114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e441094a0 0x7f8e4419ab20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8e3402a930 tx=0x7f8e34004270 comp rx=0 tx=0).stop 2024-09-21T03:41:41.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:41.140+0000 7f8e4bb98640 1 -- 172.21.15.84:0/1733979114 shutdown_connections 2024-09-21T03:41:41.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:41.140+0000 7f8e4bb98640 1 --2- 172.21.15.84:0/1733979114 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8e300b65f0 0x7f8e300b8b00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:41.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:41.140+0000 7f8e4bb98640 1 --2- 172.21.15.84:0/1733979114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e44109df0 0x7f8e4419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:41.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:41.140+0000 7f8e4bb98640 1 --2- 172.21.15.84:0/1733979114 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e441094a0 0x7f8e4419ab20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:41.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:41.140+0000 7f8e4bb98640 1 --2- 172.21.15.84:0/1733979114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e44103b60 0x7f8e4419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:41.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:41.140+0000 7f8e4bb98640 1 -- 172.21.15.84:0/1733979114 >> 172.21.15.84:0/1733979114 conn(0x7f8e4407b850 msgr2=0x7f8e44105580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:41.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:41.140+0000 7f8e4bb98640 1 -- 172.21.15.84:0/1733979114 shutdown_connections 2024-09-21T03:41:41.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:41.140+0000 7f8e4bb98640 1 -- 172.21.15.84:0/1733979114 wait complete. 2024-09-21T03:41:41.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:41 smithi084 ceph-mon[30941]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:41:41.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:41 smithi084 ceph-mon[30941]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:41:41.503 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:41 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1733979114' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T03:41:41.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:41 smithi174 ceph-mon[34403]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:41:41.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:41 smithi174 ceph-mon[34403]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:41:41.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:41 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1733979114' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T03:41:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:41 smithi172 ceph-mon[34821]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:41:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:41 smithi172 ceph-mon[34821]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:41:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:41 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1733979114' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T03:41:41.840 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T03:41:41.841 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:41:42.086 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:42.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.620+0000 7f1e1c71d640 1 -- 172.21.15.84:0/1429090722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e14108420 msgr2=0x7f1e14108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:42.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.620+0000 7f1e1c71d640 1 --2- 172.21.15.84:0/1429090722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e14108420 0x7f1e14108830 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009900 tx=0x7f1e1002a410 comp rx=0 tx=0).stop 2024-09-21T03:41:42.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.620+0000 7f1e1c71d640 1 -- 172.21.15.84:0/1429090722 shutdown_connections 2024-09-21T03:41:42.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.620+0000 7f1e1c71d640 1 --2- 172.21.15.84:0/1429090722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e14108d70 0x7f1e1410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:42.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.620+0000 7f1e1c71d640 1 --2- 172.21.15.84:0/1429090722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e14108420 0x7f1e14108830 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:42.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.620+0000 7f1e1c71d640 1 --2- 172.21.15.84:0/1429090722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e14102ae0 0x7f1e14102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:42.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.620+0000 7f1e1c71d640 1 -- 172.21.15.84:0/1429090722 >> 172.21.15.84:0/1429090722 conn(0x7f1e14079770 msgr2=0x7f1e14079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:42.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.620+0000 7f1e1c71d640 1 -- 172.21.15.84:0/1429090722 shutdown_connections 2024-09-21T03:41:42.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.620+0000 7f1e1c71d640 1 -- 172.21.15.84:0/1429090722 wait complete. 2024-09-21T03:41:42.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.621+0000 7f1e1c71d640 1 Processor -- start 2024-09-21T03:41:42.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.621+0000 7f1e1c71d640 1 -- start start 2024-09-21T03:41:42.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.621+0000 7f1e1c71d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e14102ae0 0x7f1e1419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:42.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.621+0000 7f1e1c71d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e14108420 0x7f1e1419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:42.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.621+0000 7f1e1c71d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e14108d70 0x7f1e1419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:42.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.621+0000 7f1e1c71d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1e14113b50 con 0x7f1e14102ae0 2024-09-21T03:41:42.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.621+0000 7f1e1c71d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1e141139d0 con 0x7f1e14108d70 2024-09-21T03:41:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.621+0000 7f1e1c71d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1e14113cd0 con 0x7f1e14108420 2024-09-21T03:41:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.621+0000 7f1e1a4b9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e14102ae0 0x7f1e1419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.622+0000 7f1e1a4b9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e14102ae0 0x7f1e1419a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34198/0 (socket says 172.21.15.84:34198) 2024-09-21T03:41:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.622+0000 7f1e1a4b9640 1 -- 172.21.15.84:0/1379317495 learned_addr learned my addr 172.21.15.84:0/1379317495 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.622+0000 7f1e19cb8640 1 --2- 172.21.15.84:0/1379317495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e14108420 0x7f1e1419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.622+0000 7f1e1acba640 1 --2- 172.21.15.84:0/1379317495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e14108d70 0x7f1e1419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.622+0000 7f1e1a4b9640 1 -- 172.21.15.84:0/1379317495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e14108420 msgr2=0x7f1e1419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.622+0000 7f1e1a4b9640 1 --2- 172.21.15.84:0/1379317495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e14108420 0x7f1e1419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.622+0000 7f1e1a4b9640 1 -- 172.21.15.84:0/1379317495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e14108d70 msgr2=0x7f1e1419fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.622+0000 7f1e1a4b9640 1 --2- 172.21.15.84:0/1379317495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e14108d70 0x7f1e1419fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.622+0000 7f1e1a4b9640 1 -- 172.21.15.84:0/1379317495 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e141a0410 con 0x7f1e14102ae0 2024-09-21T03:41:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.622+0000 7f1e1acba640 1 --2- 172.21.15.84:0/1379317495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e14108d70 0x7f1e1419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.622+0000 7f1e1a4b9640 1 --2- 172.21.15.84:0/1379317495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e14102ae0 0x7f1e1419a560 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400c970 tx=0x7f1e0400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.622+0000 7f1e0b7fe640 1 -- 172.21.15.84:0/1379317495 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e04007bb0 con 0x7f1e14102ae0 2024-09-21T03:41:42.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.622+0000 7f1e1c71d640 1 -- 172.21.15.84:0/1379317495 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e141a0700 con 0x7f1e14102ae0 2024-09-21T03:41:42.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.622+0000 7f1e0b7fe640 1 -- 172.21.15.84:0/1379317495 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e04007d50 con 0x7f1e14102ae0 2024-09-21T03:41:42.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.622+0000 7f1e0b7fe640 1 -- 172.21.15.84:0/1379317495 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0400f450 con 0x7f1e14102ae0 2024-09-21T03:41:42.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.622+0000 7f1e1c71d640 1 -- 172.21.15.84:0/1379317495 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e141a0bc0 con 0x7f1e14102ae0 2024-09-21T03:41:42.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.623+0000 7f1e1c71d640 1 -- 172.21.15.84:0/1379317495 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e14103d60 con 0x7f1e14102ae0 2024-09-21T03:41:42.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.625+0000 7f1e0b7fe640 1 -- 172.21.15.84:0/1379317495 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f1e04004ee0 con 0x7f1e14102ae0 2024-09-21T03:41:42.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.625+0000 7f1e0b7fe640 1 --2- 172.21.15.84:0/1379317495 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1e000b6620 0x7f1e000b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:42.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.626+0000 7f1e19cb8640 1 --2- 172.21.15.84:0/1379317495 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1e000b6620 0x7f1e000b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:42.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.626+0000 7f1e0b7fe640 1 -- 172.21.15.84:0/1379317495 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f1e040e7750 con 0x7f1e14102ae0 2024-09-21T03:41:42.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.626+0000 7f1e19cb8640 1 --2- 172.21.15.84:0/1379317495 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1e000b6620 0x7f1e000b8b30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009230 tx=0x7f1e10031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:42.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.629+0000 7f1e0b7fe640 1 -- 172.21.15.84:0/1379317495 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1e04014030 con 0x7f1e14102ae0 2024-09-21T03:41:42.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.846+0000 7f1e1c71d640 1 -- 172.21.15.84:0/1379317495 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e1419b690 con 0x7f1e14102ae0 2024-09-21T03:41:42.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.846+0000 7f1e0b7fe640 1 -- 172.21.15.84:0/1379317495 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7f1e1419b690 con 0x7f1e14102ae0 2024-09-21T03:41:42.849 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:41:42.849 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"btime":"2024-09-21T03:40:41:408095+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:40:41.132161+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24634,24638,24668]},"id":1}]} 2024-09-21T03:41:42.849 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 24 2024-09-21T03:41:42.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.849+0000 7f1e1c71d640 1 -- 172.21.15.84:0/1379317495 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1e000b6620 msgr2=0x7f1e000b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:42.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.849+0000 7f1e1c71d640 1 --2- 172.21.15.84:0/1379317495 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1e000b6620 0x7f1e000b8b30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009230 tx=0x7f1e10031400 comp rx=0 tx=0).stop 2024-09-21T03:41:42.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.849+0000 7f1e1c71d640 1 -- 172.21.15.84:0/1379317495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e14102ae0 msgr2=0x7f1e1419a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:42.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.849+0000 7f1e1c71d640 1 --2- 172.21.15.84:0/1379317495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e14102ae0 0x7f1e1419a560 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400c970 tx=0x7f1e0400ce30 comp rx=0 tx=0).stop 2024-09-21T03:41:42.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.849+0000 7f1e1c71d640 1 -- 172.21.15.84:0/1379317495 shutdown_connections 2024-09-21T03:41:42.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.849+0000 7f1e1c71d640 1 --2- 172.21.15.84:0/1379317495 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1e000b6620 0x7f1e000b8b30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:42.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.849+0000 7f1e1c71d640 1 --2- 172.21.15.84:0/1379317495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e14108d70 0x7f1e1419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:42.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.849+0000 7f1e1c71d640 1 --2- 172.21.15.84:0/1379317495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1e14108420 0x7f1e1419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:42.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.849+0000 7f1e1c71d640 1 --2- 172.21.15.84:0/1379317495 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1e14102ae0 0x7f1e1419a560 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:42.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.849+0000 7f1e1c71d640 1 -- 172.21.15.84:0/1379317495 >> 172.21.15.84:0/1379317495 conn(0x7f1e14079770 msgr2=0x7f1e141044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:42.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.849+0000 7f1e1c71d640 1 -- 172.21.15.84:0/1379317495 shutdown_connections 2024-09-21T03:41:42.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:42.849+0000 7f1e1c71d640 1 -- 172.21.15.84:0/1379317495 wait complete. 2024-09-21T03:41:43.545 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:43 smithi084 ceph-mon[30941]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:41:43.545 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:43 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1379317495' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:41:43.576 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:41:43.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:43 smithi174 ceph-mon[34403]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:41:43.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:43 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1379317495' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:41:43.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:43 smithi172 ceph-mon[34821]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:41:43.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:43 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1379317495' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:41:43.822 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:44.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.380+0000 7fc8e94cf640 1 -- 172.21.15.84:0/2390371854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8e4109e10 msgr2=0x7fc8e4110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:44.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.380+0000 7fc8e94cf640 1 --2- 172.21.15.84:0/2390371854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8e4109e10 0x7fc8e4110640 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc009900 tx=0x7fc8dc02a440 comp rx=0 tx=0).stop 2024-09-21T03:41:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.380+0000 7fc8e94cf640 1 -- 172.21.15.84:0/2390371854 shutdown_connections 2024-09-21T03:41:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.380+0000 7fc8e94cf640 1 --2- 172.21.15.84:0/2390371854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8e4109e10 0x7fc8e4110640 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.380+0000 7fc8e94cf640 1 --2- 172.21.15.84:0/2390371854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e41094c0 0x7fc8e41098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.380+0000 7fc8e94cf640 1 --2- 172.21.15.84:0/2390371854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8e4103b80 0x7fc8e4103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.380+0000 7fc8e94cf640 1 -- 172.21.15.84:0/2390371854 >> 172.21.15.84:0/2390371854 conn(0x7fc8e40ff5b0 msgr2=0x7fc8e4101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.380+0000 7fc8e94cf640 1 -- 172.21.15.84:0/2390371854 shutdown_connections 2024-09-21T03:41:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.380+0000 7fc8e94cf640 1 -- 172.21.15.84:0/2390371854 wait complete. 2024-09-21T03:41:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.380+0000 7fc8e94cf640 1 Processor -- start 2024-09-21T03:41:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.381+0000 7fc8e94cf640 1 -- start start 2024-09-21T03:41:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.381+0000 7fc8e94cf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8e4103b80 0x7fc8e419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.381+0000 7fc8e94cf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8e41094c0 0x7fc8e419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.381+0000 7fc8e94cf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e4109e10 0x7fc8e419fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.381+0000 7fc8e94cf640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e4113bb0 con 0x7fc8e41094c0 2024-09-21T03:41:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.381+0000 7fc8e94cf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e4113a30 con 0x7fc8e4109e10 2024-09-21T03:41:44.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.381+0000 7fc8e94cf640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e4113d30 con 0x7fc8e4103b80 2024-09-21T03:41:44.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.381+0000 7fc8e27fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8e41094c0 0x7fc8e419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:44.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.381+0000 7fc8e27fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8e41094c0 0x7fc8e419ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34228/0 (socket says 172.21.15.84:34228) 2024-09-21T03:41:44.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.381+0000 7fc8e27fc640 1 -- 172.21.15.84:0/2821824533 learned_addr learned my addr 172.21.15.84:0/2821824533 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:44.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.381+0000 7fc8e2ffd640 1 --2- 172.21.15.84:0/2821824533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8e4103b80 0x7fc8e419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:44.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.381+0000 7fc8e37fe640 1 --2- 172.21.15.84:0/2821824533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e4109e10 0x7fc8e419fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:44.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.381+0000 7fc8e27fc640 1 -- 172.21.15.84:0/2821824533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8e4103b80 msgr2=0x7fc8e419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:44.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.381+0000 7fc8e27fc640 1 --2- 172.21.15.84:0/2821824533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8e4103b80 0x7fc8e419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:44.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.381+0000 7fc8e27fc640 1 -- 172.21.15.84:0/2821824533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e4109e10 msgr2=0x7fc8e419fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:44.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.381+0000 7fc8e27fc640 1 --2- 172.21.15.84:0/2821824533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e4109e10 0x7fc8e419fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:44.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.381+0000 7fc8e27fc640 1 -- 172.21.15.84:0/2821824533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8e41a0550 con 0x7fc8e41094c0 2024-09-21T03:41:44.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.382+0000 7fc8e27fc640 1 --2- 172.21.15.84:0/2821824533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8e41094c0 0x7fc8e419ab80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc006fd0 tx=0x7fc8cc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:44.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.382+0000 7fc8dbfff640 1 -- 172.21.15.84:0/2821824533 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc011830 con 0x7fc8e41094c0 2024-09-21T03:41:44.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.382+0000 7fc8dbfff640 1 -- 172.21.15.84:0/2821824533 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8cc016070 con 0x7fc8e41094c0 2024-09-21T03:41:44.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.382+0000 7fc8e94cf640 1 -- 172.21.15.84:0/2821824533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8e41a0840 con 0x7fc8e41094c0 2024-09-21T03:41:44.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.382+0000 7fc8dbfff640 1 -- 172.21.15.84:0/2821824533 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc010e00 con 0x7fc8e41094c0 2024-09-21T03:41:44.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.382+0000 7fc8e94cf640 1 -- 172.21.15.84:0/2821824533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8e41a6fa0 con 0x7fc8e41094c0 2024-09-21T03:41:44.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.383+0000 7fc8e94cf640 1 -- 172.21.15.84:0/2821824533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8e4104e00 con 0x7fc8e41094c0 2024-09-21T03:41:44.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.384+0000 7fc8dbfff640 1 -- 172.21.15.84:0/2821824533 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fc8cc0119d0 con 0x7fc8e41094c0 2024-09-21T03:41:44.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.385+0000 7fc8dbfff640 1 --2- 172.21.15.84:0/2821824533 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc8d00b65f0 0x7fc8d00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:44.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.385+0000 7fc8e2ffd640 1 --2- 172.21.15.84:0/2821824533 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc8d00b65f0 0x7fc8d00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:44.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.386+0000 7fc8dbfff640 1 -- 172.21.15.84:0/2821824533 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fc8cc0e7290 con 0x7fc8e41094c0 2024-09-21T03:41:44.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.386+0000 7fc8e2ffd640 1 --2- 172.21.15.84:0/2821824533 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc8d00b65f0 0x7fc8d00b8b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009f60 tx=0x7fc8d40094f0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:44.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.389+0000 7fc8dbfff640 1 -- 172.21.15.84:0/2821824533 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8cc0ad8c0 con 0x7fc8e41094c0 2024-09-21T03:41:44.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.603+0000 7fc8e94cf640 1 -- 172.21.15.84:0/2821824533 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8e4104010 con 0x7fc8e41094c0 2024-09-21T03:41:44.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.604+0000 7fc8dbfff640 1 -- 172.21.15.84:0/2821824533 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7fc8e4104010 con 0x7fc8e41094c0 2024-09-21T03:41:44.606 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:41:44.606 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"btime":"2024-09-21T03:40:41:408095+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:40:41.132161+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24634,24638,24668]},"id":1}]} 2024-09-21T03:41:44.606 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 24 2024-09-21T03:41:44.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.606+0000 7fc8e94cf640 1 -- 172.21.15.84:0/2821824533 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc8d00b65f0 msgr2=0x7fc8d00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:44.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.606+0000 7fc8e94cf640 1 --2- 172.21.15.84:0/2821824533 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc8d00b65f0 0x7fc8d00b8b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009f60 tx=0x7fc8d40094f0 comp rx=0 tx=0).stop 2024-09-21T03:41:44.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.606+0000 7fc8e94cf640 1 -- 172.21.15.84:0/2821824533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8e41094c0 msgr2=0x7fc8e419ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:44.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.606+0000 7fc8e94cf640 1 --2- 172.21.15.84:0/2821824533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8e41094c0 0x7fc8e419ab80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc006fd0 tx=0x7fc8cc00b8e0 comp rx=0 tx=0).stop 2024-09-21T03:41:44.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.606+0000 7fc8e94cf640 1 -- 172.21.15.84:0/2821824533 shutdown_connections 2024-09-21T03:41:44.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.606+0000 7fc8e94cf640 1 --2- 172.21.15.84:0/2821824533 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc8d00b65f0 0x7fc8d00b8b00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:44.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.606+0000 7fc8e94cf640 1 --2- 172.21.15.84:0/2821824533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e4109e10 0x7fc8e419fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:44.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.606+0000 7fc8e94cf640 1 --2- 172.21.15.84:0/2821824533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc8e41094c0 0x7fc8e419ab80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:44.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.606+0000 7fc8e94cf640 1 --2- 172.21.15.84:0/2821824533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8e4103b80 0x7fc8e419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:44.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.606+0000 7fc8e94cf640 1 -- 172.21.15.84:0/2821824533 >> 172.21.15.84:0/2821824533 conn(0x7fc8e40ff5b0 msgr2=0x7fc8e4107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:44.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.606+0000 7fc8e94cf640 1 -- 172.21.15.84:0/2821824533 shutdown_connections 2024-09-21T03:41:44.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:44.606+0000 7fc8e94cf640 1 -- 172.21.15.84:0/2821824533 wait complete. 2024-09-21T03:41:45.298 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:41:45.544 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:45.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:45 smithi084 ceph-mon[30941]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:41:45.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:45 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2821824533' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:41:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:45 smithi174 ceph-mon[34403]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:41:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:45 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2821824533' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:41:45.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:45 smithi172 ceph-mon[34821]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:41:45.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:45 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2821824533' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:41:46.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.043+0000 7f29375fd640 1 -- 172.21.15.84:0/3418256444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2930106c80 msgr2=0x7f29301106d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:46.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.043+0000 7f29375fd640 1 --2- 172.21.15.84:0/3418256444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2930106c80 0x7f29301106d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f2928009900 tx=0x7f292802a410 comp rx=0 tx=0).stop 2024-09-21T03:41:46.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.043+0000 7f29375fd640 1 -- 172.21.15.84:0/3418256444 shutdown_connections 2024-09-21T03:41:46.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.043+0000 7f29375fd640 1 --2- 172.21.15.84:0/3418256444 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2930106c80 0x7f29301106d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:46.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.043+0000 7f29375fd640 1 --2- 172.21.15.84:0/3418256444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2930106330 0x7f2930106740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:46.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.043+0000 7f29375fd640 1 --2- 172.21.15.84:0/3418256444 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2930102140 0x7f2930102550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:46.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.043+0000 7f29375fd640 1 -- 172.21.15.84:0/3418256444 >> 172.21.15.84:0/3418256444 conn(0x7f2930079ea0 msgr2=0x7f293007a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:46.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.043+0000 7f29375fd640 1 -- 172.21.15.84:0/3418256444 shutdown_connections 2024-09-21T03:41:46.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.043+0000 7f29375fd640 1 -- 172.21.15.84:0/3418256444 wait complete. 2024-09-21T03:41:46.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.044+0000 7f29375fd640 1 Processor -- start 2024-09-21T03:41:46.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.044+0000 7f29375fd640 1 -- start start 2024-09-21T03:41:46.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.044+0000 7f29375fd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2930102140 0x7f29301030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:46.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.044+0000 7f29375fd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2930106330 0x7f2930103620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:46.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.044+0000 7f29375fd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2930106c80 0x7f2930103b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:46.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.044+0000 7f29375fd640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2930113b20 con 0x7f2930102140 2024-09-21T03:41:46.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.044+0000 7f29375fd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f29301139a0 con 0x7f2930106c80 2024-09-21T03:41:46.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.044+0000 7f29375fd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2930113ca0 con 0x7f2930106330 2024-09-21T03:41:46.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.044+0000 7f2935399640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2930102140 0x7f29301030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:46.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.044+0000 7f2935399640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2930102140 0x7f29301030e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34238/0 (socket says 172.21.15.84:34238) 2024-09-21T03:41:46.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.044+0000 7f2935399640 1 -- 172.21.15.84:0/1958396692 learned_addr learned my addr 172.21.15.84:0/1958396692 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:46.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.045+0000 7f2934b98640 1 --2- 172.21.15.84:0/1958396692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2930106330 0x7f2930103620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:46.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.045+0000 7f2935b9a640 1 --2- 172.21.15.84:0/1958396692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2930106c80 0x7f2930103b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:46.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.045+0000 7f2935399640 1 -- 172.21.15.84:0/1958396692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2930106330 msgr2=0x7f2930103620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:46.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.045+0000 7f2935399640 1 --2- 172.21.15.84:0/1958396692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2930106330 0x7f2930103620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:46.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.045+0000 7f2935399640 1 -- 172.21.15.84:0/1958396692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2930106c80 msgr2=0x7f2930103b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:46.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.045+0000 7f2935399640 1 --2- 172.21.15.84:0/1958396692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2930106c80 0x7f2930103b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:46.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.045+0000 7f2935399640 1 -- 172.21.15.84:0/1958396692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29301a87f0 con 0x7f2930102140 2024-09-21T03:41:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.045+0000 7f2935399640 1 --2- 172.21.15.84:0/1958396692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2930102140 0x7f29301030e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f292400eab0 tx=0x7f292400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.045+0000 7f29227fc640 1 -- 172.21.15.84:0/1958396692 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292400ce40 con 0x7f2930102140 2024-09-21T03:41:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.045+0000 7f29227fc640 1 -- 172.21.15.84:0/1958396692 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2924011920 con 0x7f2930102140 2024-09-21T03:41:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.045+0000 7f29375fd640 1 -- 172.21.15.84:0/1958396692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29301a8ae0 con 0x7f2930102140 2024-09-21T03:41:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.045+0000 7f29227fc640 1 -- 172.21.15.84:0/1958396692 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2924010a30 con 0x7f2930102140 2024-09-21T03:41:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.045+0000 7f29375fd640 1 -- 172.21.15.84:0/1958396692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29301a9020 con 0x7f2930102140 2024-09-21T03:41:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.046+0000 7f29375fd640 1 -- 172.21.15.84:0/1958396692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2930102550 con 0x7f2930102140 2024-09-21T03:41:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.048+0000 7f29227fc640 1 -- 172.21.15.84:0/1958396692 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f2924010bd0 con 0x7f2930102140 2024-09-21T03:41:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.048+0000 7f29227fc640 1 --2- 172.21.15.84:0/1958396692 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f291c0b65f0 0x7f291c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.048+0000 7f2934b98640 1 --2- 172.21.15.84:0/1958396692 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f291c0b65f0 0x7f291c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.048+0000 7f29227fc640 1 -- 172.21.15.84:0/1958396692 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f29240e7bb0 con 0x7f2930102140 2024-09-21T03:41:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.049+0000 7f2934b98640 1 --2- 172.21.15.84:0/1958396692 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f291c0b65f0 0x7f291c0b8b00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f293010a3c0 tx=0x7f292c00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:46.067 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.053+0000 7f29227fc640 1 -- 172.21.15.84:0/1958396692 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2924016030 con 0x7f2930102140 2024-09-21T03:41:46.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.232+0000 7f29375fd640 1 -- 172.21.15.84:0/1958396692 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f293002e640 con 0x7f2930102140 2024-09-21T03:41:46.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.234+0000 7f29227fc640 1 -- 172.21.15.84:0/1958396692 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+23019 (secure 0 0 0) 0x7f29240ae240 con 0x7f2930102140 2024-09-21T03:41:46.236 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:41:46.236 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":77,"fsid":"e3f8c18e-77c9-11ef-baf5-efdc52797490","created":"2024-09-21T03:31:55.307035+0000","modified":"2024-09-21T03:40:51.455331+0000","last_up_change":"2024-09-21T03:39:38.786385+0000","last_in_change":"2024-09-21T03:39:15.267368+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:35:50.488653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:40:25.934375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:40:27.981681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d283ba0-18f3-4668-90c4-884e9e957a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6803","nonce":508132562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6805","nonce":508132562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6809","nonce":508132562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6807","nonce":508132562}]},"public_addr":"172.21.15.84:6803/508132562","cluster_addr":"172.21.15.84:6805/508132562","heartbeat_back_addr":"172.21.15.84:6809/508132562","heartbeat_front_addr":"172.21.15.84:6807/508132562","state":["exists","up"]},{"osd":1,"uuid":"f115c5b6-812d-430f-9f0e-cb5311b7581e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6801","nonce":2931872350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6803","nonce":2931872350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6807","nonce":2931872350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6805","nonce":2931872350}]},"public_addr":"172.21.15.172:6801/2931872350","cluster_addr":"172.21.15.172:6803/2931872350","heartbeat_back_addr":"172.21.15.172:6807/2931872350","heartbeat_front_addr":"172.21.15.172:6805/2931872350","state":["exists","up"]},{"osd":2,"uuid":"36489240-e233-4aa7-ae9c-089d76683172","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6801","nonce":1847612335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6803","nonce":1847612335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6807","nonce":1847612335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6805","nonce":1847612335}]},"public_addr":"172.21.15.174:6801/1847612335","cluster_addr":"172.21.15.174:6803/1847612335","heartbeat_back_addr":"172.21.15.174:6807/1847612335","heartbeat_front_addr":"172.21.15.174:6805/1847612335","state":["exists","up"]},{"osd":3,"uuid":"1f35b404-b658-4e94-a5f4-74a6431a6a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6811","nonce":2230529863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6813","nonce":2230529863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6817","nonce":2230529863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6815","nonce":2230529863}]},"public_addr":"172.21.15.84:6811/2230529863","cluster_addr":"172.21.15.84:6813/2230529863","heartbeat_back_addr":"172.21.15.84:6817/2230529863","heartbeat_front_addr":"172.21.15.84:6815/2230529863","state":["exists","up"]},{"osd":4,"uuid":"91a2f83b-4c7d-4661-86a1-63a09888939d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6809","nonce":3069862739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6811","nonce":3069862739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6815","nonce":3069862739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6813","nonce":3069862739}]},"public_addr":"172.21.15.172:6809/3069862739","cluster_addr":"172.21.15.172:6811/3069862739","heartbeat_back_addr":"172.21.15.172:6815/3069862739","heartbeat_front_addr":"172.21.15.172:6813/3069862739","state":["exists","up"]},{"osd":5,"uuid":"e8f06b34-3956-499f-8073-09011cf1ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6809","nonce":1987010600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6811","nonce":1987010600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6815","nonce":1987010600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6813","nonce":1987010600}]},"public_addr":"172.21.15.174:6809/1987010600","cluster_addr":"172.21.15.174:6811/1987010600","heartbeat_back_addr":"172.21.15.174:6815/1987010600","heartbeat_front_addr":"172.21.15.174:6813/1987010600","state":["exists","up"]},{"osd":6,"uuid":"23d55e96-4987-4cbe-8c6b-cece4de9269b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6819","nonce":3418459345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6821","nonce":3418459345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6825","nonce":3418459345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6823","nonce":3418459345}]},"public_addr":"172.21.15.84:6819/3418459345","cluster_addr":"172.21.15.84:6821/3418459345","heartbeat_back_addr":"172.21.15.84:6825/3418459345","heartbeat_front_addr":"172.21.15.84:6823/3418459345","state":["exists","up"]},{"osd":7,"uuid":"ca91a34c-d8b1-48b8-93f4-72a5c15939d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6817","nonce":4056019738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6819","nonce":4056019738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6823","nonce":4056019738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6821","nonce":4056019738}]},"public_addr":"172.21.15.172:6817/4056019738","cluster_addr":"172.21.15.172:6819/4056019738","heartbeat_back_addr":"172.21.15.172:6823/4056019738","heartbeat_front_addr":"172.21.15.172:6821/4056019738","state":["exists","up"]},{"osd":8,"uuid":"37da8c61-d72f-4b58-b10c-7c7539ecffd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6817","nonce":2162992546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6819","nonce":2162992546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6823","nonce":2162992546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6821","nonce":2162992546}]},"public_addr":"172.21.15.174:6817/2162992546","cluster_addr":"172.21.15.174:6819/2162992546","heartbeat_back_addr":"172.21.15.174:6823/2162992546","heartbeat_front_addr":"172.21.15.174:6821/2162992546","state":["exists","up"]},{"osd":9,"uuid":"c9179f33-622d-44bd-9d8a-c92951afb1e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6827","nonce":3230873673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6829","nonce":3230873673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6833","nonce":3230873673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6831","nonce":3230873673}]},"public_addr":"172.21.15.84:6827/3230873673","cluster_addr":"172.21.15.84:6829/3230873673","heartbeat_back_addr":"172.21.15.84:6833/3230873673","heartbeat_front_addr":"172.21.15.84:6831/3230873673","state":["exists","up"]},{"osd":10,"uuid":"9788fa2d-49fb-431b-a0e3-62d6e421e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6825","nonce":2667099391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6827","nonce":2667099391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6831","nonce":2667099391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6829","nonce":2667099391}]},"public_addr":"172.21.15.172:6825/2667099391","cluster_addr":"172.21.15.172:6827/2667099391","heartbeat_back_addr":"172.21.15.172:6831/2667099391","heartbeat_front_addr":"172.21.15.172:6829/2667099391","state":["exists","up"]},{"osd":11,"uuid":"a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6825","nonce":3452825924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6827","nonce":3452825924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6831","nonce":3452825924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6829","nonce":3452825924}]},"public_addr":"172.21.15.174:6825/3452825924","cluster_addr":"172.21.15.174:6827/3452825924","heartbeat_back_addr":"172.21.15.174:6831/3452825924","heartbeat_front_addr":"172.21.15.174:6829/3452825924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:34:57.413946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:22.813846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:47.074625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:12.871112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:38.705563+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:04.277966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:29.661290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:55.475432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:20.644247+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:46.151594+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:11.499623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:36.688459+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6800/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3308084314":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3663660709":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/1794153935":"2024-09-22T03:32:49.459372+0000","172.21.15.84:6800/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6800/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1874814897":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6801/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/390051797":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/2148206075":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1916019809":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6801/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3491731835":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3418048965":"2024-09-22T03:33:50.188998+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:41:46.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.236+0000 7f29375fd640 1 -- 172.21.15.84:0/1958396692 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f291c0b65f0 msgr2=0x7f291c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:46.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.236+0000 7f29375fd640 1 --2- 172.21.15.84:0/1958396692 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f291c0b65f0 0x7f291c0b8b00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f293010a3c0 tx=0x7f292c00b390 comp rx=0 tx=0).stop 2024-09-21T03:41:46.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.236+0000 7f29375fd640 1 -- 172.21.15.84:0/1958396692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2930102140 msgr2=0x7f29301030e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:46.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.236+0000 7f29375fd640 1 --2- 172.21.15.84:0/1958396692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2930102140 0x7f29301030e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f292400eab0 tx=0x7f292400ef70 comp rx=0 tx=0).stop 2024-09-21T03:41:46.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.236+0000 7f29375fd640 1 -- 172.21.15.84:0/1958396692 shutdown_connections 2024-09-21T03:41:46.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.236+0000 7f29375fd640 1 --2- 172.21.15.84:0/1958396692 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f291c0b65f0 0x7f291c0b8b00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:46.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.236+0000 7f29375fd640 1 --2- 172.21.15.84:0/1958396692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2930106c80 0x7f2930103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:46.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.236+0000 7f29375fd640 1 --2- 172.21.15.84:0/1958396692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2930106330 0x7f2930103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:46.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.236+0000 7f29375fd640 1 --2- 172.21.15.84:0/1958396692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2930102140 0x7f29301030e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:46.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.236+0000 7f29375fd640 1 -- 172.21.15.84:0/1958396692 >> 172.21.15.84:0/1958396692 conn(0x7f2930079ea0 msgr2=0x7f2930107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:46.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.236+0000 7f29375fd640 1 -- 172.21.15.84:0/1958396692 shutdown_connections 2024-09-21T03:41:46.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:46.236+0000 7f29375fd640 1 -- 172.21.15.84:0/1958396692 wait complete. 2024-09-21T03:41:46.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:46 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1958396692' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:41:46.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:46 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1958396692' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:41:46.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:46 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1958396692' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:41:47.058 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:41:47.303 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:47.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:47 smithi174 ceph-mon[34403]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:41:47.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:47 smithi172 ceph-mon[34821]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:41:47.706 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:47 smithi084 ceph-mon[30941]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:41:47.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.793+0000 7fc9a26c3640 1 -- 172.21.15.84:0/4279666866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc99c108d70 msgr2=0x7fc99c10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:47.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.793+0000 7fc9a26c3640 1 --2- 172.21.15.84:0/4279666866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc99c108d70 0x7fc99c10f5a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc994009ca0 tx=0x7fc99402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:41:47.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.793+0000 7fc9a26c3640 1 -- 172.21.15.84:0/4279666866 shutdown_connections 2024-09-21T03:41:47.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.793+0000 7fc9a26c3640 1 --2- 172.21.15.84:0/4279666866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc99c108d70 0x7fc99c10f5a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:47.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.793+0000 7fc9a26c3640 1 --2- 172.21.15.84:0/4279666866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc99c108420 0x7fc99c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:47.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.793+0000 7fc9a26c3640 1 --2- 172.21.15.84:0/4279666866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc99c102ae0 0x7fc99c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:47.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.793+0000 7fc9a26c3640 1 -- 172.21.15.84:0/4279666866 >> 172.21.15.84:0/4279666866 conn(0x7fc99c079770 msgr2=0x7fc99c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:47.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.793+0000 7fc9a26c3640 1 -- 172.21.15.84:0/4279666866 shutdown_connections 2024-09-21T03:41:47.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.793+0000 7fc9a26c3640 1 -- 172.21.15.84:0/4279666866 wait complete. 2024-09-21T03:41:47.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.793+0000 7fc9a26c3640 1 Processor -- start 2024-09-21T03:41:47.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.793+0000 7fc9a26c3640 1 -- start start 2024-09-21T03:41:47.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.794+0000 7fc9a26c3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc99c102ae0 0x7fc99c110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:47.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.794+0000 7fc9a26c3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc99c108420 0x7fc99c1105c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:47.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.794+0000 7fc9a26c3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc99c108d70 0x7fc99c110b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:47.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.794+0000 7fc9a26c3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c113b50 con 0x7fc99c108420 2024-09-21T03:41:47.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.794+0000 7fc9a26c3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c1139d0 con 0x7fc99c102ae0 2024-09-21T03:41:47.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.794+0000 7fc9a26c3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc99c113cd0 con 0x7fc99c108d70 2024-09-21T03:41:47.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.794+0000 7fc99b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc99c108420 0x7fc99c1105c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:47.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.794+0000 7fc99b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc99c108420 0x7fc99c1105c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34264/0 (socket says 172.21.15.84:34264) 2024-09-21T03:41:47.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.794+0000 7fc99b7fe640 1 -- 172.21.15.84:0/4089930132 learned_addr learned my addr 172.21.15.84:0/4089930132 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:47.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.794+0000 7fc9a0c60640 1 --2- 172.21.15.84:0/4089930132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc99c108d70 0x7fc99c110b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:47.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.794+0000 7fc99b7fe640 1 -- 172.21.15.84:0/4089930132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc99c108d70 msgr2=0x7fc99c110b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:47.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.794+0000 7fc99b7fe640 1 --2- 172.21.15.84:0/4089930132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc99c108d70 0x7fc99c110b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:47.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.794+0000 7fc99b7fe640 1 -- 172.21.15.84:0/4089930132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc99c102ae0 msgr2=0x7fc99c110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:47.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.794+0000 7fc99b7fe640 1 --2- 172.21.15.84:0/4089930132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc99c102ae0 0x7fc99c110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:47.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.794+0000 7fc99b7fe640 1 -- 172.21.15.84:0/4089930132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc99c1a86b0 con 0x7fc99c108420 2024-09-21T03:41:47.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.794+0000 7fc9a0c60640 1 --2- 172.21.15.84:0/4089930132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc99c108d70 0x7fc99c110b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:47.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.794+0000 7fc99b7fe640 1 --2- 172.21.15.84:0/4089930132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc99c108420 0x7fc99c1105c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc99000c8c0 tx=0x7fc99000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:47.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.794+0000 7fc9997fa640 1 -- 172.21.15.84:0/4089930132 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc990007bb0 con 0x7fc99c108420 2024-09-21T03:41:47.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.795+0000 7fc9997fa640 1 -- 172.21.15.84:0/4089930132 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc990007d50 con 0x7fc99c108420 2024-09-21T03:41:47.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.795+0000 7fc9a26c3640 1 -- 172.21.15.84:0/4089930132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc99c1a89a0 con 0x7fc99c108420 2024-09-21T03:41:47.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.795+0000 7fc9997fa640 1 -- 172.21.15.84:0/4089930132 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9900187c0 con 0x7fc99c108420 2024-09-21T03:41:47.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.795+0000 7fc9a26c3640 1 -- 172.21.15.84:0/4089930132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc99c1a8f30 con 0x7fc99c108420 2024-09-21T03:41:47.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.796+0000 7fc9a26c3640 1 -- 172.21.15.84:0/4089930132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc99c103d60 con 0x7fc99c108420 2024-09-21T03:41:47.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.797+0000 7fc9997fa640 1 -- 172.21.15.84:0/4089930132 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7fc99000fa20 con 0x7fc99c108420 2024-09-21T03:41:47.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.798+0000 7fc9997fa640 1 --2- 172.21.15.84:0/4089930132 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc9840b6670 0x7fc9840b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:47.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.798+0000 7fc99bfff640 1 --2- 172.21.15.84:0/4089930132 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc9840b6670 0x7fc9840b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:47.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.799+0000 7fc9997fa640 1 -- 172.21.15.84:0/4089930132 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fc9900e79c0 con 0x7fc99c108420 2024-09-21T03:41:47.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.799+0000 7fc99bfff640 1 --2- 172.21.15.84:0/4089930132 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc9840b6670 0x7fc9840b8b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc99c111ad0 tx=0x7fc98c005bf0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:47.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:47.802+0000 7fc9997fa640 1 -- 172.21.15.84:0/4089930132 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc990014030 con 0x7fc99c108420 2024-09-21T03:41:48.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:48.017+0000 7fc9a26c3640 1 -- 172.21.15.84:0/4089930132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc99c102ef0 con 0x7fc99c108420 2024-09-21T03:41:48.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:48.018+0000 7fc9997fa640 1 -- 172.21.15.84:0/4089930132 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7fc9900ae100 con 0x7fc99c108420 2024-09-21T03:41:48.020 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:41:48.020 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"btime":"2024-09-21T03:40:41:408095+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:40:41.132161+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24634,24638,24668]},"id":1}]} 2024-09-21T03:41:48.021 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 24 2024-09-21T03:41:48.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:48.020+0000 7fc9a26c3640 1 -- 172.21.15.84:0/4089930132 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc9840b6670 msgr2=0x7fc9840b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:48.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:48.020+0000 7fc9a26c3640 1 --2- 172.21.15.84:0/4089930132 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc9840b6670 0x7fc9840b8b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc99c111ad0 tx=0x7fc98c005bf0 comp rx=0 tx=0).stop 2024-09-21T03:41:48.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:48.020+0000 7fc9a26c3640 1 -- 172.21.15.84:0/4089930132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc99c108420 msgr2=0x7fc99c1105c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:48.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:48.020+0000 7fc9a26c3640 1 --2- 172.21.15.84:0/4089930132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc99c108420 0x7fc99c1105c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fc99000c8c0 tx=0x7fc99000cd80 comp rx=0 tx=0).stop 2024-09-21T03:41:48.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:48.020+0000 7fc9a26c3640 1 -- 172.21.15.84:0/4089930132 shutdown_connections 2024-09-21T03:41:48.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:48.020+0000 7fc9a26c3640 1 --2- 172.21.15.84:0/4089930132 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc9840b6670 0x7fc9840b8b80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:48.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:48.020+0000 7fc9a26c3640 1 --2- 172.21.15.84:0/4089930132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc99c108d70 0x7fc99c110b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:48.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:48.020+0000 7fc9a26c3640 1 --2- 172.21.15.84:0/4089930132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc99c108420 0x7fc99c1105c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:48.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:48.020+0000 7fc9a26c3640 1 --2- 172.21.15.84:0/4089930132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc99c102ae0 0x7fc99c110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:48.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:48.020+0000 7fc9a26c3640 1 -- 172.21.15.84:0/4089930132 >> 172.21.15.84:0/4089930132 conn(0x7fc99c079770 msgr2=0x7fc99c1043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:48.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:48.021+0000 7fc9a26c3640 1 -- 172.21.15.84:0/4089930132 shutdown_connections 2024-09-21T03:41:48.023 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:48.021+0000 7fc9a26c3640 1 -- 172.21.15.84:0/4089930132 wait complete. 2024-09-21T03:41:48.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:48 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/4089930132' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:41:48.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:48 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/4089930132' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:41:48.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:48 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/4089930132' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:41:48.704 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T03:40:29.979744+0000', 'modified': '2024-09-21T03:40:41.132161+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24668, 'mds_1': 24638, 'mds_2': 24634}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24607': {'gid': 24607, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.174:6835/3726620036', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6834', 'nonce': 3726620036}, {'type': 'v1', 'addr': '172.21.15.174:6835', 'nonce': 3726620036}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24613': {'gid': 24613, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.174:6837/152508350', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6836', 'nonce': 152508350}, {'type': 'v1', 'addr': '172.21.15.174:6837', 'nonce': 152508350}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24614': {'gid': 24614, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/1309799170', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 1309799170}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 1309799170}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24634': {'gid': 24634, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.174:6839/386916231', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6838', 'nonce': 386916231}, {'type': 'v1', 'addr': '172.21.15.174:6839', 'nonce': 386916231}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24638': {'gid': 24638, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.172:6837/2515764700', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 2515764700}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 2515764700}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24668': {'gid': 24668, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.172:6839/3909390777', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 3909390777}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 3909390777}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24668, 'qdb_cluster': [24634, 24638, 24668]} 2024-09-21T03:41:48.704 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T03:41:48.704 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T03:41:48.948 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:49.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.460+0000 7f8fdd60e640 1 -- 172.21.15.84:0/753049820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd81083c0 msgr2=0x7f8fd81087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:49.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.460+0000 7f8fdd60e640 1 --2- 172.21.15.84:0/753049820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd81083c0 0x7f8fd81087d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0009900 tx=0x7f8fc002a410 comp rx=0 tx=0).stop 2024-09-21T03:41:49.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.460+0000 7f8fdd60e640 1 -- 172.21.15.84:0/753049820 shutdown_connections 2024-09-21T03:41:49.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.460+0000 7f8fdd60e640 1 --2- 172.21.15.84:0/753049820 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fd8108d10 0x7f8fd810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.460+0000 7f8fdd60e640 1 --2- 172.21.15.84:0/753049820 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd81083c0 0x7f8fd81087d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.460+0000 7f8fdd60e640 1 --2- 172.21.15.84:0/753049820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd8102a80 0x7f8fd8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.460+0000 7f8fdd60e640 1 -- 172.21.15.84:0/753049820 >> 172.21.15.84:0/753049820 conn(0x7f8fd8079740 msgr2=0x7f8fd8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:49.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.460+0000 7f8fdd60e640 1 -- 172.21.15.84:0/753049820 shutdown_connections 2024-09-21T03:41:49.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.460+0000 7f8fdd60e640 1 -- 172.21.15.84:0/753049820 wait complete. 2024-09-21T03:41:49.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.461+0000 7f8fdd60e640 1 Processor -- start 2024-09-21T03:41:49.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.461+0000 7f8fdd60e640 1 -- start start 2024-09-21T03:41:49.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.461+0000 7f8fdd60e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fd8102a80 0x7f8fd8199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:49.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.461+0000 7f8fdd60e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd81083c0 0x7f8fd81999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:49.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.461+0000 7f8fdd60e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd8108d10 0x7f8fd819ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:49.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.461+0000 7f8fdd60e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd8112980 con 0x7f8fd81083c0 2024-09-21T03:41:49.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.461+0000 7f8fdd60e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd8112800 con 0x7f8fd8108d10 2024-09-21T03:41:49.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.461+0000 7f8fdd60e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd8112b00 con 0x7f8fd8102a80 2024-09-21T03:41:49.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.462+0000 7f8fce7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd81083c0 0x7f8fd81999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:49.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.462+0000 7f8fce7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd81083c0 0x7f8fd81999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46662/0 (socket says 172.21.15.84:46662) 2024-09-21T03:41:49.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.462+0000 7f8fce7fc640 1 -- 172.21.15.84:0/2296870945 learned_addr learned my addr 172.21.15.84:0/2296870945 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:49.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.462+0000 7f8fd6ffd640 1 --2- 172.21.15.84:0/2296870945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fd8102a80 0x7f8fd8199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:49.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.462+0000 7f8fd77fe640 1 --2- 172.21.15.84:0/2296870945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd8108d10 0x7f8fd819ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:49.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.462+0000 7f8fce7fc640 1 -- 172.21.15.84:0/2296870945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fd8102a80 msgr2=0x7f8fd8199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:49.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.462+0000 7f8fce7fc640 1 --2- 172.21.15.84:0/2296870945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fd8102a80 0x7f8fd8199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.462+0000 7f8fce7fc640 1 -- 172.21.15.84:0/2296870945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd8108d10 msgr2=0x7f8fd819ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:49.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.462+0000 7f8fce7fc640 1 --2- 172.21.15.84:0/2296870945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd8108d10 0x7f8fd819ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.462+0000 7f8fce7fc640 1 -- 172.21.15.84:0/2296870945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd819f3a0 con 0x7f8fd81083c0 2024-09-21T03:41:49.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.462+0000 7f8fce7fc640 1 --2- 172.21.15.84:0/2296870945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd81083c0 0x7f8fd81999d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0032fd0 tx=0x7f8fc0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:49.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.462+0000 7f8fd4ff9640 1 -- 172.21.15.84:0/2296870945 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc003f030 con 0x7f8fd81083c0 2024-09-21T03:41:49.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.462+0000 7f8fdd60e640 1 -- 172.21.15.84:0/2296870945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fd819f630 con 0x7f8fd81083c0 2024-09-21T03:41:49.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.462+0000 7f8fd4ff9640 1 -- 172.21.15.84:0/2296870945 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fc0004490 con 0x7f8fd81083c0 2024-09-21T03:41:49.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.462+0000 7f8fd4ff9640 1 -- 172.21.15.84:0/2296870945 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0035070 con 0x7f8fd81083c0 2024-09-21T03:41:49.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.462+0000 7f8fdd60e640 1 -- 172.21.15.84:0/2296870945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fd81a5df0 con 0x7f8fd81083c0 2024-09-21T03:41:49.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.465+0000 7f8fe3b82740 1 Processor -- start 2024-09-21T03:41:49.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.465+0000 7f8fd4ff9640 1 -- 172.21.15.84:0/2296870945 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f8fc0042030 con 0x7f8fd81083c0 2024-09-21T03:41:49.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.465+0000 7f8fe3b82740 1 -- start start 2024-09-21T03:41:49.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.465+0000 7f8fe3b82740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603163a2f60 0x56031674b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:49.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.465+0000 7f8fe3b82740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56031637a0a0 0x56031674b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:49.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.465+0000 7f8fe3b82740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560316382280 0x56031674bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:49.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.465+0000 7f8fe3b82740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5603166c0c10 con 0x56031637a0a0 2024-09-21T03:41:49.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.465+0000 7f8fe3b82740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5603166b0040 con 0x5603163a2f60 2024-09-21T03:41:49.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.465+0000 7f8fe3b82740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5603166b3e50 con 0x560316382280 2024-09-21T03:41:49.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.465+0000 7f8fd6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56031637a0a0 0x56031674b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:49.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.466+0000 7f8fd6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56031637a0a0 0x56031674b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46678/0 (socket says 172.21.15.84:46678) 2024-09-21T03:41:49.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.466+0000 7f8fd6ffd640 1 -- 172.21.15.84:0/301614108 learned_addr learned my addr 172.21.15.84:0/301614108 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:49.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.466+0000 7f8fce7fc640 1 --2- 172.21.15.84:0/301614108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560316382280 0x56031674bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:49.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.466+0000 7f8fd77fe640 1 --2- 172.21.15.84:0/301614108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603163a2f60 0x56031674b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:49.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.466+0000 7f8fd6ffd640 1 -- 172.21.15.84:0/301614108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560316382280 msgr2=0x56031674bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:49.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.466+0000 7f8fd6ffd640 1 --2- 172.21.15.84:0/301614108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560316382280 0x56031674bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.466+0000 7f8fd6ffd640 1 -- 172.21.15.84:0/301614108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603163a2f60 msgr2=0x56031674b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:49.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.466+0000 7f8fd6ffd640 1 --2- 172.21.15.84:0/301614108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603163a2f60 0x56031674b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.466+0000 7f8fd6ffd640 1 -- 172.21.15.84:0/301614108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56031640e540 con 0x56031637a0a0 2024-09-21T03:41:49.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.466+0000 7f8fd77fe640 1 --2- 172.21.15.84:0/301614108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603163a2f60 0x56031674b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:49.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.466+0000 7f8fd6ffd640 1 --2- 172.21.15.84:0/301614108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56031637a0a0 0x56031674b650 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8fc800bd10 tx=0x7f8fc80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9724a159ef2a1898 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:49.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.466+0000 7f8fd4ff9640 1 --2- 172.21.15.84:0/2296870945 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8fc40b65f0 0x7f8fc40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:49.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.466+0000 7f8fd77fe640 1 --2- 172.21.15.84:0/2296870945 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8fc40b65f0 0x7f8fc40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:49.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.466+0000 7f8fcd7fa640 1 -- 172.21.15.84:0/301614108 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8004030 con 0x56031637a0a0 2024-09-21T03:41:49.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.466+0000 7f8fcd7fa640 1 -- 172.21.15.84:0/301614108 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fc80035f0 con 0x56031637a0a0 2024-09-21T03:41:49.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.466+0000 7f8fd4ff9640 1 -- 172.21.15.84:0/2296870945 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8fc0107b10 con 0x7f8fd81083c0 2024-09-21T03:41:49.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.466+0000 7f8fcd7fa640 1 -- 172.21.15.84:0/301614108 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8011770 con 0x56031637a0a0 2024-09-21T03:41:49.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.467+0000 7f8fe3b82740 1 -- 172.21.15.84:0/301614108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56031637a0a0 msgr2=0x56031674b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:49.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.467+0000 7f8fd77fe640 1 --2- 172.21.15.84:0/2296870945 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8fc40b65f0 0x7f8fc40b8b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0005fd0 tx=0x7f8fd0009560 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:49.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.467+0000 7f8fe3b82740 1 --2- 172.21.15.84:0/301614108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56031637a0a0 0x56031674b650 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8fc800bd10 tx=0x7f8fc80107a0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.467+0000 7f8fe3b82740 1 -- 172.21.15.84:0/301614108 shutdown_connections 2024-09-21T03:41:49.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.467+0000 7f8fe3b82740 1 --2- 172.21.15.84:0/301614108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560316382280 0x56031674bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.467+0000 7f8fe3b82740 1 --2- 172.21.15.84:0/301614108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56031637a0a0 0x56031674b650 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.467+0000 7f8fe3b82740 1 --2- 172.21.15.84:0/301614108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603163a2f60 0x56031674b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.467+0000 7f8fe3b82740 1 -- 172.21.15.84:0/301614108 >> 172.21.15.84:0/301614108 conn(0x560316397350 msgr2=0x560316749000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:49.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.467+0000 7f8fe3b82740 1 -- 172.21.15.84:0/301614108 shutdown_connections 2024-09-21T03:41:49.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.467+0000 7f8fe3b82740 1 -- 172.21.15.84:0/301614108 wait complete. 2024-09-21T03:41:49.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.468+0000 7f8fe3b82740 1 -- start start 2024-09-21T03:41:49.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.468+0000 7f8fe3b82740 1 Processor -- start 2024-09-21T03:41:49.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.468+0000 7f8fe3b82740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56031637a0a0 0x560316756c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:49.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.468+0000 7f8fe3b82740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560316382280 0x560316757150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:49.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.468+0000 7f8fe3b82740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603163a2f60 0x560316762c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:49.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.468+0000 7f8fe3b82740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5603165115f0 con 0x560316382280 2024-09-21T03:41:49.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.468+0000 7f8fe3b82740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56031664b010 con 0x5603163a2f60 2024-09-21T03:41:49.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.468+0000 7f8fe3b82740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5603167598f0 con 0x56031637a0a0 2024-09-21T03:41:49.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.468+0000 7f8fe3b82740 10 client.0 _ll_register_callbacks cb 0x5603166aa340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:49.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.468+0000 7f8fce7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560316382280 0x560316757150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.468+0000 7f8fce7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560316382280 0x560316757150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46692/0 (socket says 172.21.15.84:46692) 2024-09-21T03:41:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.468+0000 7f8fce7fc640 1 -- 172.21.15.84:0/3593742753 learned_addr learned my addr 172.21.15.84:0/3593742753 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.468+0000 7f8fd77fe640 1 --2- 172.21.15.84:0/3593742753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603163a2f60 0x560316762c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.468+0000 7f8fd6ffd640 1 --2- 172.21.15.84:0/3593742753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56031637a0a0 0x560316756c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.469+0000 7f8fce7fc640 1 -- 172.21.15.84:0/3593742753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56031637a0a0 msgr2=0x560316756c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.469+0000 7f8fce7fc640 1 --2- 172.21.15.84:0/3593742753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56031637a0a0 0x560316756c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.469+0000 7f8fce7fc640 1 -- 172.21.15.84:0/3593742753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603163a2f60 msgr2=0x560316762c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.469+0000 7f8fce7fc640 1 --2- 172.21.15.84:0/3593742753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603163a2f60 0x560316762c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.469+0000 7f8fce7fc640 1 -- 172.21.15.84:0/3593742753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560316678a00 con 0x560316382280 2024-09-21T03:41:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.469+0000 7f8fd6ffd640 1 --2- 172.21.15.84:0/3593742753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56031637a0a0 0x560316756c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.469+0000 7f8fd77fe640 1 --2- 172.21.15.84:0/3593742753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603163a2f60 0x560316762c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.469+0000 7f8fce7fc640 1 --2- 172.21.15.84:0/3593742753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560316382280 0x560316757150 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00cad10 tx=0x7f8fc0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994ce6ee2a69353c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.469+0000 7f8fbe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:41:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.469+0000 7f8fbe7fc640 1 -- 172.21.15.84:0/3593742753 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc0049070 con 0x560316382280 2024-09-21T03:41:49.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.469+0000 7f8fbe7fc640 1 -- 172.21.15.84:0/3593742753 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8fc00c9d10 con 0x560316382280 2024-09-21T03:41:49.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.469+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3593742753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fc80035f0 con 0x560316382280 2024-09-21T03:41:49.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.469+0000 7f8fbe7fc640 1 -- 172.21.15.84:0/3593742753 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8fc00cd210 con 0x560316382280 2024-09-21T03:41:49.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.469+0000 7f8fe3b82740 10 client.15228 fetch_fsmap learned FSMap version 24 2024-09-21T03:41:49.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.469+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3593742753 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560316765810 con 0x560316382280 2024-09-21T03:41:49.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.469+0000 7f8fbe7fc640 1 -- 172.21.15.84:0/3593742753 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fc80035f0 con 0x560316382280 2024-09-21T03:41:49.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.469+0000 7f8fbe7fc640 1 -- 172.21.15.84:0/3593742753 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8fc00d7030 con 0x560316382280 2024-09-21T03:41:49.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.469+0000 7f8fe3b82740 10 client.15228 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:41:49.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.470+0000 7f8fe3b82740 10 client.15228 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T03:41:49.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.470+0000 7f8fe3b82740 20 client.15228 populate_metadata read hostname 'smithi084' 2024-09-21T03:41:49.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.470+0000 7f8fe3b82740 1 --2- 172.21.15.84:0/3593742753 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5603163618e0 0x560316769330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:49.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.470+0000 7f8fe3b82740 4 client.15228 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:41:49.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.470+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3593742753 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603166c2b60 con 0x5603163618e0 2024-09-21T03:41:49.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.470+0000 7f8fd6ffd640 1 --2- 172.21.15.84:0/3593742753 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5603163618e0 0x560316769330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:49.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.470+0000 7f8fd6ffd640 1 --2- 172.21.15.84:0/3593742753 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5603163618e0 0x560316769330 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=968275bbc3f7a246 server_cookie=9b3a3e322cac3cde in_seq=0 out_seq=0 2024-09-21T03:41:49.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.470+0000 7f8fbe7fc640 10 client.15228 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:41:49.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.471+0000 7f8fbe7fc640 1 -- 172.21.15.84:0/3593742753 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5603166c2b60 con 0x5603163618e0 2024-09-21T03:41:49.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.471+0000 7f8fbe7fc640 10 client.15228 handle_command_reply: tid=0 2024-09-21T03:41:49.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.471+0000 7f8fe3b82740 1 client.15228 shutdown 2024-09-21T03:41:49.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.471+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3593742753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560316382280 msgr2=0x560316757150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:49.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.471+0000 7f8fe3b82740 1 --2- 172.21.15.84:0/3593742753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560316382280 0x560316757150 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8fc00cad10 tx=0x7f8fc0000bc0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.471+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3593742753 shutdown_connections 2024-09-21T03:41:49.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.471+0000 7f8fe3b82740 1 --2- 172.21.15.84:0/3593742753 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5603163618e0 0x560316769330 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.471+0000 7f8fe3b82740 1 --2- 172.21.15.84:0/3593742753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5603163a2f60 0x560316762c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.471+0000 7f8fe3b82740 1 --2- 172.21.15.84:0/3593742753 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560316382280 0x560316757150 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.471+0000 7f8fbe7fc640 0 client.15228 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:41:49.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.471+0000 7f8fe3b82740 1 --2- 172.21.15.84:0/3593742753 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56031637a0a0 0x560316756c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.471+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3593742753 >> 172.21.15.84:0/3593742753 conn(0x560316397350 msgr2=0x56031674e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:49.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.471+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3593742753 shutdown_connections 2024-09-21T03:41:49.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.472+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3593742753 wait complete. 2024-09-21T03:41:49.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.472+0000 7f8fe3b82740 20 client.15228 trim_cache size 0 max 16384 2024-09-21T03:41:49.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.489+0000 7f8fe3b82740 1 Processor -- start 2024-09-21T03:41:49.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.489+0000 7f8fe3b82740 1 -- start start 2024-09-21T03:41:49.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.490+0000 7f8fe3b82740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56031637a0a0 0x560316751230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:49.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.490+0000 7f8fe3b82740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560316382280 0x560316766b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:49.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.490+0000 7f8fe3b82740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603163a2f60 0x560316762b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:49.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.490+0000 7f8fe3b82740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560316767670 con 0x5603163a2f60 2024-09-21T03:41:49.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.490+0000 7f8fe3b82740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560316767d40 con 0x56031637a0a0 2024-09-21T03:41:49.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.490+0000 7f8fe3b82740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560316768410 con 0x560316382280 2024-09-21T03:41:49.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.490+0000 7f8fd77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603163a2f60 0x560316762b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:49.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.490+0000 7f8fd77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603163a2f60 0x560316762b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46706/0 (socket says 172.21.15.84:46706) 2024-09-21T03:41:49.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.490+0000 7f8fd77fe640 1 -- 172.21.15.84:0/3124528945 learned_addr learned my addr 172.21.15.84:0/3124528945 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:49.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.490+0000 7f8fd77fe640 1 -- 172.21.15.84:0/3124528945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560316382280 msgr2=0x560316766b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:49.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.490+0000 7f8fd77fe640 1 --2- 172.21.15.84:0/3124528945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560316382280 0x560316766b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.490+0000 7f8fd77fe640 1 -- 172.21.15.84:0/3124528945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56031637a0a0 msgr2=0x560316751230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:49.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.490+0000 7f8fd6ffd640 1 --2- 172.21.15.84:0/3124528945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56031637a0a0 0x560316751230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:49.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.490+0000 7f8fd77fe640 1 --2- 172.21.15.84:0/3124528945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56031637a0a0 0x560316751230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.490+0000 7f8fd77fe640 1 -- 172.21.15.84:0/3124528945 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56031674d800 con 0x5603163a2f60 2024-09-21T03:41:49.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.490+0000 7f8fd77fe640 1 --2- 172.21.15.84:0/3124528945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603163a2f60 0x560316762b80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8fd00128e0 tx=0x7f8fd0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8897bdef237d76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:49.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.491+0000 7f8fccff9640 1 -- 172.21.15.84:0/3124528945 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0003b70 con 0x5603163a2f60 2024-09-21T03:41:49.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.491+0000 7f8fccff9640 1 -- 172.21.15.84:0/3124528945 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fd001fdf0 con 0x5603163a2f60 2024-09-21T03:41:49.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.491+0000 7f8fccff9640 1 -- 172.21.15.84:0/3124528945 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00047a0 con 0x5603163a2f60 2024-09-21T03:41:49.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.491+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3124528945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603163a2f60 msgr2=0x560316762b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:49.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.491+0000 7f8fe3b82740 1 --2- 172.21.15.84:0/3124528945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603163a2f60 0x560316762b80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8fd00128e0 tx=0x7f8fd0014000 comp rx=0 tx=0).stop 2024-09-21T03:41:49.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.492+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3124528945 shutdown_connections 2024-09-21T03:41:49.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.492+0000 7f8fe3b82740 1 --2- 172.21.15.84:0/3124528945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5603163a2f60 0x560316762b80 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.492+0000 7f8fe3b82740 1 --2- 172.21.15.84:0/3124528945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560316382280 0x560316766b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.492+0000 7f8fe3b82740 1 --2- 172.21.15.84:0/3124528945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56031637a0a0 0x560316751230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.492+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3124528945 >> 172.21.15.84:0/3124528945 conn(0x560316397350 msgr2=0x560316755290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.492+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3124528945 shutdown_connections 2024-09-21T03:41:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.492+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3124528945 wait complete. 2024-09-21T03:41:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.492+0000 7f8fe3b82740 1 -- start start 2024-09-21T03:41:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.492+0000 7f8fe3b82740 1 Processor -- start 2024-09-21T03:41:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.492+0000 7f8fe3b82740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56031637a0a0 0x56031676bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.492+0000 7f8fe3b82740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560316382280 0x56031676c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.492+0000 7f8fe3b82740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603163a2f60 0x560316771260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.492+0000 7f8fe3b82740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5603167691b0 con 0x56031637a0a0 2024-09-21T03:41:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.492+0000 7f8fe3b82740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560316768ae0 con 0x560316382280 2024-09-21T03:41:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.492+0000 7f8fe3b82740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560316769880 con 0x5603163a2f60 2024-09-21T03:41:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.492+0000 7f8fe3b82740 10 client.0 _ll_register_callbacks cb 0x7f8fc0005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.492+0000 7f8fd6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56031637a0a0 0x56031676bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.492+0000 7f8fd6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56031637a0a0 0x56031676bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46718/0 (socket says 172.21.15.84:46718) 2024-09-21T03:41:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.492+0000 7f8fd6ffd640 1 -- 172.21.15.84:0/3566541543 learned_addr learned my addr 172.21.15.84:0/3566541543 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:49.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.493+0000 7f8fce7fc640 1 --2- 172.21.15.84:0/3566541543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560316382280 0x56031676c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:49.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.493+0000 7f8fd77fe640 1 --2- 172.21.15.84:0/3566541543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603163a2f60 0x560316771260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:49.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.493+0000 7f8fd6ffd640 1 -- 172.21.15.84:0/3566541543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603163a2f60 msgr2=0x560316771260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:49.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.493+0000 7f8fd6ffd640 1 --2- 172.21.15.84:0/3566541543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603163a2f60 0x560316771260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.493+0000 7f8fd6ffd640 1 -- 172.21.15.84:0/3566541543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560316382280 msgr2=0x56031676c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:49.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.493+0000 7f8fd6ffd640 1 --2- 172.21.15.84:0/3566541543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560316382280 0x56031676c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.493+0000 7f8fd6ffd640 1 -- 172.21.15.84:0/3566541543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603167717a0 con 0x56031637a0a0 2024-09-21T03:41:49.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.493+0000 7f8fd6ffd640 1 --2- 172.21.15.84:0/3566541543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56031637a0a0 0x56031676bd20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8011010 tx=0x7f8fc8005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef08e456a580829 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:49.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.493+0000 7f8fbe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:41:49.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.493+0000 7f8fbe7fc640 1 -- 172.21.15.84:0/3566541543 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8003a00 con 0x56031637a0a0 2024-09-21T03:41:49.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.493+0000 7f8fbe7fc640 1 -- 172.21.15.84:0/3566541543 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8fc8005040 con 0x56031637a0a0 2024-09-21T03:41:49.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.493+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3566541543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8fd001fdf0 con 0x56031637a0a0 2024-09-21T03:41:49.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.493+0000 7f8fbe7fc640 1 -- 172.21.15.84:0/3566541543 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8fc8003d70 con 0x56031637a0a0 2024-09-21T03:41:49.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.493+0000 7f8fe3b82740 10 client.15234 fetch_fsmap learned FSMap version 24 2024-09-21T03:41:49.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.493+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3566541543 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5603167d4fd0 con 0x56031637a0a0 2024-09-21T03:41:49.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.493+0000 7f8fbe7fc640 1 -- 172.21.15.84:0/3566541543 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fd001fdf0 con 0x56031637a0a0 2024-09-21T03:41:49.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.494+0000 7f8fbe7fc640 1 -- 172.21.15.84:0/3566541543 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8fc802c020 con 0x56031637a0a0 2024-09-21T03:41:49.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.494+0000 7f8fe3b82740 10 client.15234 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:41:49.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.494+0000 7f8fe3b82740 10 client.15234 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T03:41:49.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.494+0000 7f8fe3b82740 20 client.15234 populate_metadata read hostname 'smithi084' 2024-09-21T03:41:49.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.494+0000 7f8fe3b82740 1 --2- 172.21.15.84:0/3566541543 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x560316336c90 0x5603167d8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:49.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.494+0000 7f8fe3b82740 4 client.15234 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:41:49.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.494+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3566541543 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "status"}) -- 0x5603166be610 con 0x560316336c90 2024-09-21T03:41:49.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.494+0000 7f8fce7fc640 1 --2- 172.21.15.84:0/3566541543 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x560316336c90 0x5603167d8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:49.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.494+0000 7f8fbe7fc640 10 client.15234 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:41:49.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.494+0000 7f8fce7fc640 1 --2- 172.21.15.84:0/3566541543 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x560316336c90 0x5603167d8520 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=282e034ca8fdc620 server_cookie=240f7150d3739b0e in_seq=0 out_seq=0 2024-09-21T03:41:49.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.495+0000 7f8fbe7fc640 1 -- 172.21.15.84:0/3566541543 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5603166be610 con 0x560316336c90 2024-09-21T03:41:49.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.495+0000 7f8fbe7fc640 10 client.15234 handle_command_reply: tid=0 2024-09-21T03:41:49.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.495+0000 7f8fe3b82740 1 client.15234 shutdown 2024-09-21T03:41:49.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.495+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3566541543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56031637a0a0 msgr2=0x56031676bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:49.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.495+0000 7f8fe3b82740 1 --2- 172.21.15.84:0/3566541543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56031637a0a0 0x56031676bd20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8011010 tx=0x7f8fc8005850 comp rx=0 tx=0).stop 2024-09-21T03:41:49.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.495+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3566541543 shutdown_connections 2024-09-21T03:41:49.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.495+0000 7f8fe3b82740 1 --2- 172.21.15.84:0/3566541543 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x560316336c90 0x5603167d8520 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.495+0000 7f8fe3b82740 1 --2- 172.21.15.84:0/3566541543 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5603163a2f60 0x560316771260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.495+0000 7f8fe3b82740 1 --2- 172.21.15.84:0/3566541543 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560316382280 0x56031676c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.495+0000 7f8fe3b82740 1 --2- 172.21.15.84:0/3566541543 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56031637a0a0 0x56031676bd20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.495+0000 7f8fbe7fc640 0 client.15234 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:41:49.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.495+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3566541543 >> 172.21.15.84:0/3566541543 conn(0x560316397350 msgr2=0x560316748870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:49.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.495+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3566541543 shutdown_connections 2024-09-21T03:41:49.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.495+0000 7f8fe3b82740 1 -- 172.21.15.84:0/3566541543 wait complete. 2024-09-21T03:41:49.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.495+0000 7f8fe3b82740 20 client.15234 trim_cache size 0 max 16384 2024-09-21T03:41:49.501 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:41:49.501 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "e3f8c18e-77c9-11ef-baf5-efdc52797490", 2024-09-21T03:41:49.501 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 2, 2024-09-21T03:41:49.501 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24634, 2024-09-21T03:41:49.501 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T03:41:49.502 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T03:41:49.502 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T03:41:49.502 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 71.092267688000007, 2024-09-21T03:41:49.502 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 24, 2024-09-21T03:41:49.502 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 77, 2024-09-21T03:41:49.502 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T03:41:49.502 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 98.548116085999993 2024-09-21T03:41:49.502 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:41:49.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.495+0000 7f8fdd60e640 1 -- 172.21.15.84:0/2296870945 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8fc40b65f0 msgr2=0x7f8fc40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.495+0000 7f8fdd60e640 1 --2- 172.21.15.84:0/2296870945 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8fc40b65f0 0x7f8fc40b8b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0005fd0 tx=0x7f8fd0009560 comp rx=0 tx=0).stop 2024-09-21T03:41:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.496+0000 7f8fdd60e640 1 -- 172.21.15.84:0/2296870945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd81083c0 msgr2=0x7f8fd81999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.496+0000 7f8fdd60e640 1 --2- 172.21.15.84:0/2296870945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd81083c0 0x7f8fd81999d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8fc0032fd0 tx=0x7f8fc0004270 comp rx=0 tx=0).stop 2024-09-21T03:41:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.496+0000 7f8fdd60e640 1 -- 172.21.15.84:0/2296870945 shutdown_connections 2024-09-21T03:41:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.496+0000 7f8fdd60e640 1 --2- 172.21.15.84:0/2296870945 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8fc40b65f0 0x7f8fc40b8b00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.496+0000 7f8fdd60e640 1 --2- 172.21.15.84:0/2296870945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fd8108d10 0x7f8fd819ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.496+0000 7f8fdd60e640 1 --2- 172.21.15.84:0/2296870945 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8fd81083c0 0x7f8fd81999d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.496+0000 7f8fdd60e640 1 --2- 172.21.15.84:0/2296870945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8fd8102a80 0x7f8fd8199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.496+0000 7f8fdd60e640 1 -- 172.21.15.84:0/2296870945 >> 172.21.15.84:0/2296870945 conn(0x7f8fd8079740 msgr2=0x7f8fd81044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.496+0000 7f8fdd60e640 1 -- 172.21.15.84:0/2296870945 shutdown_connections 2024-09-21T03:41:49.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:49.496+0000 7f8fdd60e640 1 -- 172.21.15.84:0/2296870945 wait complete. 2024-09-21T03:41:49.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:49 smithi174 ceph-mon[34403]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:41:49.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:49 smithi172 ceph-mon[34821]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:41:49.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:49 smithi084 ceph-mon[30941]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:41:50.272 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T03:41:50.556 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:51.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.067+0000 7f56574d8640 1 -- 172.21.15.84:0/2441359553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5650109df0 msgr2=0x7f5650110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:51.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.067+0000 7f56574d8640 1 --2- 172.21.15.84:0/2441359553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5650109df0 0x7f5650110620 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5648009ca0 tx=0x7f564802a8e0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.067+0000 7f56574d8640 1 -- 172.21.15.84:0/2441359553 shutdown_connections 2024-09-21T03:41:51.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.067+0000 7f56574d8640 1 --2- 172.21.15.84:0/2441359553 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5650109df0 0x7f5650110620 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.067+0000 7f56574d8640 1 --2- 172.21.15.84:0/2441359553 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56501094a0 0x7f56501098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.067+0000 7f56574d8640 1 --2- 172.21.15.84:0/2441359553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5650103b60 0x7f5650103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.067+0000 7f56574d8640 1 -- 172.21.15.84:0/2441359553 >> 172.21.15.84:0/2441359553 conn(0x7f565007b850 msgr2=0x7f565007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:51.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.068+0000 7f56574d8640 1 -- 172.21.15.84:0/2441359553 shutdown_connections 2024-09-21T03:41:51.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.068+0000 7f56574d8640 1 -- 172.21.15.84:0/2441359553 wait complete. 2024-09-21T03:41:51.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.068+0000 7f56574d8640 1 Processor -- start 2024-09-21T03:41:51.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.068+0000 7f56574d8640 1 -- start start 2024-09-21T03:41:51.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.068+0000 7f56574d8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5650103b60 0x7f5650075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:51.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.068+0000 7f56574d8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56501094a0 0x7f5650075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:51.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.068+0000 7f56574d8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5650109df0 0x7f5650076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:51.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.068+0000 7f56574d8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5650113af0 con 0x7f5650103b60 2024-09-21T03:41:51.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.068+0000 7f56574d8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5650113970 con 0x7f56501094a0 2024-09-21T03:41:51.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.068+0000 7f56574d8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5650113c70 con 0x7f5650109df0 2024-09-21T03:41:51.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.069+0000 7f5655274640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5650103b60 0x7f5650075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:51.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.069+0000 7f5655274640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5650103b60 0x7f5650075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46746/0 (socket says 172.21.15.84:46746) 2024-09-21T03:41:51.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.069+0000 7f5655274640 1 -- 172.21.15.84:0/2897492407 learned_addr learned my addr 172.21.15.84:0/2897492407 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:51.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.069+0000 7f5655a75640 1 --2- 172.21.15.84:0/2897492407 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5650109df0 0x7f5650076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:51.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.069+0000 7f5654a73640 1 --2- 172.21.15.84:0/2897492407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56501094a0 0x7f5650075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:51.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.069+0000 7f5655274640 1 -- 172.21.15.84:0/2897492407 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5650109df0 msgr2=0x7f5650076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:51.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.069+0000 7f5655274640 1 --2- 172.21.15.84:0/2897492407 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5650109df0 0x7f5650076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.069+0000 7f5655274640 1 -- 172.21.15.84:0/2897492407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56501094a0 msgr2=0x7f5650075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:51.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.069+0000 7f5655274640 1 --2- 172.21.15.84:0/2897492407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56501094a0 0x7f5650075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.069+0000 7f5655274640 1 -- 172.21.15.84:0/2897492407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56501a86f0 con 0x7f5650103b60 2024-09-21T03:41:51.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.069+0000 7f5655a75640 1 --2- 172.21.15.84:0/2897492407 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5650109df0 0x7f5650076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:51.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.069+0000 7f5655274640 1 --2- 172.21.15.84:0/2897492407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5650103b60 0x7f5650075710 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f564400c920 tx=0x7f564400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:51.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.069+0000 7f56427fc640 1 -- 172.21.15.84:0/2897492407 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5644007c70 con 0x7f5650103b60 2024-09-21T03:41:51.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.069+0000 7f56574d8640 1 -- 172.21.15.84:0/2897492407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56501a89e0 con 0x7f5650103b60 2024-09-21T03:41:51.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.069+0000 7f56427fc640 1 -- 172.21.15.84:0/2897492407 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5644007e10 con 0x7f5650103b60 2024-09-21T03:41:51.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.069+0000 7f56427fc640 1 -- 172.21.15.84:0/2897492407 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5644018820 con 0x7f5650103b60 2024-09-21T03:41:51.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.069+0000 7f56574d8640 1 -- 172.21.15.84:0/2897492407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56501a8f20 con 0x7f5650103b60 2024-09-21T03:41:51.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.072+0000 7f565da4c740 1 Processor -- start 2024-09-21T03:41:51.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.072+0000 7f565da4c740 1 -- start start 2024-09-21T03:41:51.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.072+0000 7f56427fc640 1 -- 172.21.15.84:0/2897492407 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 22) ==== 154580+0+0 (secure 0 0 0) 0x7f564400f450 con 0x7f5650103b60 2024-09-21T03:41:51.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.072+0000 7f565da4c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f76a4f60 0x5600f7a4af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:51.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.072+0000 7f565da4c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600f767c0a0 0x5600f7a4b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:51.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.072+0000 7f565da4c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600f7684280 0x5600f7a4b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:51.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.072+0000 7f565da4c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5600f79c2c10 con 0x5600f76a4f60 2024-09-21T03:41:51.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.072+0000 7f565da4c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5600f79b2040 con 0x5600f767c0a0 2024-09-21T03:41:51.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.072+0000 7f565da4c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5600f79b5e50 con 0x5600f7684280 2024-09-21T03:41:51.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.073+0000 7f5655a75640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f76a4f60 0x5600f7a4af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:51.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.073+0000 7f5655a75640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f76a4f60 0x5600f7a4af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46758/0 (socket says 172.21.15.84:46758) 2024-09-21T03:41:51.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.073+0000 7f5655a75640 1 -- 172.21.15.84:0/1281467226 learned_addr learned my addr 172.21.15.84:0/1281467226 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:51.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.073+0000 7f5654a73640 1 --2- 172.21.15.84:0/1281467226 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600f7684280 0x5600f7a4b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:51.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.073+0000 7f5655274640 1 --2- 172.21.15.84:0/1281467226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600f767c0a0 0x5600f7a4b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:51.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.073+0000 7f5655a75640 1 -- 172.21.15.84:0/1281467226 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600f7684280 msgr2=0x5600f7a4b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:51.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.073+0000 7f5655a75640 1 --2- 172.21.15.84:0/1281467226 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600f7684280 0x5600f7a4b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.073+0000 7f5655a75640 1 -- 172.21.15.84:0/1281467226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600f767c0a0 msgr2=0x5600f7a4b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:51.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.073+0000 7f5655a75640 1 --2- 172.21.15.84:0/1281467226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600f767c0a0 0x5600f7a4b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.073+0000 7f5655a75640 1 -- 172.21.15.84:0/1281467226 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600f7710540 con 0x5600f76a4f60 2024-09-21T03:41:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.073+0000 7f5655a75640 1 --2- 172.21.15.84:0/1281467226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f76a4f60 0x5600f7a4af00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5648031630 tx=0x7f5648031660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e13b2e0863ef08 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.073+0000 7f563b7fe640 1 -- 172.21.15.84:0/1281467226 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f564803f070 con 0x5600f76a4f60 2024-09-21T03:41:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.073+0000 7f56427fc640 1 --2- 172.21.15.84:0/2897492407 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f563c0b65f0 0x7f563c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.073+0000 7f563b7fe640 1 -- 172.21.15.84:0/1281467226 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5648036040 con 0x5600f76a4f60 2024-09-21T03:41:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.073+0000 7f563b7fe640 1 -- 172.21.15.84:0/1281467226 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648004520 con 0x5600f76a4f60 2024-09-21T03:41:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.073+0000 7f5655274640 1 --2- 172.21.15.84:0/2897492407 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f563c0b65f0 0x7f563c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:51.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.074+0000 7f56427fc640 1 -- 172.21.15.84:0/2897492407 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f56440e77f0 con 0x7f5650103b60 2024-09-21T03:41:51.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.074+0000 7f565da4c740 1 -- 172.21.15.84:0/1281467226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f76a4f60 msgr2=0x5600f7a4af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:51.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.074+0000 7f5655274640 1 --2- 172.21.15.84:0/2897492407 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f563c0b65f0 0x7f563c0b8b00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f56440aa990 tx=0x7f56440a9d70 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:51.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.074+0000 7f565da4c740 1 --2- 172.21.15.84:0/1281467226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f76a4f60 0x5600f7a4af00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5648031630 tx=0x7f5648031660 comp rx=0 tx=0).stop 2024-09-21T03:41:51.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.074+0000 7f565da4c740 1 -- 172.21.15.84:0/1281467226 shutdown_connections 2024-09-21T03:41:51.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.074+0000 7f565da4c740 1 --2- 172.21.15.84:0/1281467226 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600f7684280 0x5600f7a4b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.074+0000 7f565da4c740 1 --2- 172.21.15.84:0/1281467226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600f767c0a0 0x5600f7a4b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.074+0000 7f565da4c740 1 --2- 172.21.15.84:0/1281467226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f76a4f60 0x5600f7a4af00 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.074+0000 7f565da4c740 1 -- 172.21.15.84:0/1281467226 >> 172.21.15.84:0/1281467226 conn(0x5600f7699350 msgr2=0x5600f7a48df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:51.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.074+0000 7f565da4c740 1 -- 172.21.15.84:0/1281467226 shutdown_connections 2024-09-21T03:41:51.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.074+0000 7f565da4c740 1 -- 172.21.15.84:0/1281467226 wait complete. 2024-09-21T03:41:51.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.075+0000 7f565da4c740 1 -- start start 2024-09-21T03:41:51.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.075+0000 7f565da4c740 1 Processor -- start 2024-09-21T03:41:51.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.075+0000 7f565da4c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f767c0a0 0x5600f7a569f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:51.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.075+0000 7f565da4c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600f7684280 0x5600f7a56f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:51.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.075+0000 7f565da4c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600f76a4f60 0x5600f7a629a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:51.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.075+0000 7f565da4c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5600f78135f0 con 0x5600f767c0a0 2024-09-21T03:41:51.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.075+0000 7f565da4c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5600f794d010 con 0x5600f7684280 2024-09-21T03:41:51.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.075+0000 7f565da4c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5600f7a59680 con 0x5600f76a4f60 2024-09-21T03:41:51.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.075+0000 7f5655a75640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f767c0a0 0x5600f7a569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:51.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.076+0000 7f5655a75640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f767c0a0 0x5600f7a569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46772/0 (socket says 172.21.15.84:46772) 2024-09-21T03:41:51.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.076+0000 7f5655a75640 1 -- 172.21.15.84:0/4117347845 learned_addr learned my addr 172.21.15.84:0/4117347845 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:51.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.076+0000 7f565da4c740 10 client.0 _ll_register_callbacks cb 0x5600f79ac340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:51.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.076+0000 7f5655a75640 1 --2- 172.21.15.84:0/4117347845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600f76a4f60 0x5600f7a629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:51.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.076+0000 7f5655a75640 1 -- 172.21.15.84:0/4117347845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600f76a4f60 msgr2=0x5600f7a629a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:51.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.076+0000 7f5655a75640 1 --2- 172.21.15.84:0/4117347845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600f76a4f60 0x5600f7a629a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.076+0000 7f5654a73640 1 --2- 172.21.15.84:0/4117347845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600f7684280 0x5600f7a56f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:51.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.076+0000 7f5655a75640 1 -- 172.21.15.84:0/4117347845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600f7684280 msgr2=0x5600f7a56f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:51.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.076+0000 7f5655a75640 1 --2- 172.21.15.84:0/4117347845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600f7684280 0x5600f7a56f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.076+0000 7f5655a75640 1 -- 172.21.15.84:0/4117347845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600f797aa00 con 0x5600f767c0a0 2024-09-21T03:41:51.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.076+0000 7f5655a75640 1 --2- 172.21.15.84:0/4117347845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f767c0a0 0x5600f7a569f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5648009620 tx=0x7f5648009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517f47f5309e8603 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:51.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.076+0000 7f5638ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:41:51.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.076+0000 7f5638ff9640 1 -- 172.21.15.84:0/4117347845 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648055060 con 0x5600f767c0a0 2024-09-21T03:41:51.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.076+0000 7f5638ff9640 1 -- 172.21.15.84:0/4117347845 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f5648003970 con 0x5600f767c0a0 2024-09-21T03:41:51.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.076+0000 7f565da4c740 1 -- 172.21.15.84:0/4117347845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5648036040 con 0x5600f767c0a0 2024-09-21T03:41:51.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.076+0000 7f5638ff9640 1 -- 172.21.15.84:0/4117347845 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f564803f070 con 0x5600f767c0a0 2024-09-21T03:41:51.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.076+0000 7f565da4c740 10 client.15246 fetch_fsmap learned FSMap version 24 2024-09-21T03:41:51.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.076+0000 7f565da4c740 1 -- 172.21.15.84:0/4117347845 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5600f7a65580 con 0x5600f767c0a0 2024-09-21T03:41:51.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.077+0000 7f5638ff9640 1 -- 172.21.15.84:0/4117347845 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5648036040 con 0x5600f767c0a0 2024-09-21T03:41:51.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.077+0000 7f5638ff9640 1 -- 172.21.15.84:0/4117347845 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f564804f070 con 0x5600f767c0a0 2024-09-21T03:41:51.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.077+0000 7f565da4c740 10 client.15246 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:41:51.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.077+0000 7f565da4c740 10 client.15246 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T03:41:51.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.077+0000 7f565da4c740 20 client.15246 populate_metadata read hostname 'smithi084' 2024-09-21T03:41:51.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.077+0000 7f565da4c740 1 --2- 172.21.15.84:0/4117347845 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5600f76638e0 0x5600f7a68b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:51.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.077+0000 7f565da4c740 4 client.15246 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:41:51.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.077+0000 7f565da4c740 1 -- 172.21.15.84:0/4117347845 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600f79c4b60 con 0x5600f76638e0 2024-09-21T03:41:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.077+0000 7f5654a73640 1 --2- 172.21.15.84:0/4117347845 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5600f76638e0 0x5600f7a68b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.078+0000 7f5638ff9640 10 client.15246 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:41:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.078+0000 7f5654a73640 1 --2- 172.21.15.84:0/4117347845 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5600f76638e0 0x5600f7a68b00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=63e9a102eeee80f3 server_cookie=a3537868ecc0fc6d in_seq=0 out_seq=0 2024-09-21T03:41:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.078+0000 7f5638ff9640 1 -- 172.21.15.84:0/4117347845 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5600f79c4b60 con 0x5600f76638e0 2024-09-21T03:41:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.078+0000 7f5638ff9640 10 client.15246 handle_command_reply: tid=0 2024-09-21T03:41:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.079+0000 7f565da4c740 1 client.15246 shutdown 2024-09-21T03:41:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.079+0000 7f565da4c740 1 -- 172.21.15.84:0/4117347845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f767c0a0 msgr2=0x5600f7a569f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.079+0000 7f565da4c740 1 --2- 172.21.15.84:0/4117347845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f767c0a0 0x5600f7a569f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5648009620 tx=0x7f5648009800 comp rx=0 tx=0).stop 2024-09-21T03:41:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.079+0000 7f565da4c740 1 -- 172.21.15.84:0/4117347845 shutdown_connections 2024-09-21T03:41:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.079+0000 7f565da4c740 1 --2- 172.21.15.84:0/4117347845 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5600f76638e0 0x5600f7a68b00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.079+0000 7f565da4c740 1 --2- 172.21.15.84:0/4117347845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600f76a4f60 0x5600f7a629a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.079+0000 7f565da4c740 1 --2- 172.21.15.84:0/4117347845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600f7684280 0x5600f7a56f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.079+0000 7f5638ff9640 0 client.15246 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:41:51.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.079+0000 7f565da4c740 1 --2- 172.21.15.84:0/4117347845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f767c0a0 0x5600f7a569f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.079+0000 7f565da4c740 1 -- 172.21.15.84:0/4117347845 >> 172.21.15.84:0/4117347845 conn(0x5600f7699350 msgr2=0x5600f7a4e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:51.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.079+0000 7f565da4c740 1 -- 172.21.15.84:0/4117347845 shutdown_connections 2024-09-21T03:41:51.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.079+0000 7f565da4c740 1 -- 172.21.15.84:0/4117347845 wait complete. 2024-09-21T03:41:51.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.079+0000 7f565da4c740 20 client.15246 trim_cache size 0 max 16384 2024-09-21T03:41:51.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.097+0000 7f565da4c740 1 Processor -- start 2024-09-21T03:41:51.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.097+0000 7f565da4c740 1 -- start start 2024-09-21T03:41:51.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.097+0000 7f565da4c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600f76638e0 0x5600f7a48e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:51.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.097+0000 7f565da4c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600f767c0a0 0x5600f7a51020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:51.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.097+0000 7f565da4c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f7684280 0x5600f7a62910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:51.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.097+0000 7f565da4c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5600f7a66e40 con 0x5600f7684280 2024-09-21T03:41:51.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.097+0000 7f565da4c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5600f7a67510 con 0x5600f76638e0 2024-09-21T03:41:51.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.097+0000 7f565da4c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5600f7a67be0 con 0x5600f767c0a0 2024-09-21T03:41:51.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.097+0000 7f5655a75640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f7684280 0x5600f7a62910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:51.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.097+0000 7f5655a75640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f7684280 0x5600f7a62910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46774/0 (socket says 172.21.15.84:46774) 2024-09-21T03:41:51.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.097+0000 7f5655a75640 1 -- 172.21.15.84:0/975381731 learned_addr learned my addr 172.21.15.84:0/975381731 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:51.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.097+0000 7f5655a75640 1 --2- 172.21.15.84:0/975381731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600f76638e0 0x5600f7a48e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:51.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.097+0000 7f5655a75640 1 -- 172.21.15.84:0/975381731 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600f767c0a0 msgr2=0x5600f7a51020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:51.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.097+0000 7f5655a75640 1 --2- 172.21.15.84:0/975381731 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600f767c0a0 0x5600f7a51020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.097+0000 7f5655a75640 1 -- 172.21.15.84:0/975381731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600f76638e0 msgr2=0x5600f7a48e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:51.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.097+0000 7f5655a75640 1 --2- 172.21.15.84:0/975381731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600f76638e0 0x5600f7a48e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.097+0000 7f5655a75640 1 -- 172.21.15.84:0/975381731 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600f7a52360 con 0x5600f7684280 2024-09-21T03:41:51.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.098+0000 7f5655a75640 1 --2- 172.21.15.84:0/975381731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f7684280 0x5600f7a62910 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5648006010 tx=0x7f564802a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45ac3f2d485678e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:51.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.098+0000 7f563affd640 1 -- 172.21.15.84:0/975381731 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648055070 con 0x5600f7684280 2024-09-21T03:41:51.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.098+0000 7f563affd640 1 -- 172.21.15.84:0/975381731 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5648036040 con 0x5600f7684280 2024-09-21T03:41:51.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.098+0000 7f563affd640 1 -- 172.21.15.84:0/975381731 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648044db0 con 0x5600f7684280 2024-09-21T03:41:51.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.098+0000 7f565da4c740 1 -- 172.21.15.84:0/975381731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f7684280 msgr2=0x5600f7a62910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:51.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.098+0000 7f565da4c740 1 --2- 172.21.15.84:0/975381731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f7684280 0x5600f7a62910 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5648006010 tx=0x7f564802a8e0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.098+0000 7f565da4c740 1 -- 172.21.15.84:0/975381731 shutdown_connections 2024-09-21T03:41:51.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.098+0000 7f565da4c740 1 --2- 172.21.15.84:0/975381731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f7684280 0x5600f7a62910 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.098+0000 7f565da4c740 1 --2- 172.21.15.84:0/975381731 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600f767c0a0 0x5600f7a51020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.098+0000 7f565da4c740 1 --2- 172.21.15.84:0/975381731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600f76638e0 0x5600f7a48e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.099+0000 7f565da4c740 1 -- 172.21.15.84:0/975381731 >> 172.21.15.84:0/975381731 conn(0x5600f7699350 msgr2=0x5600f7a48750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.099+0000 7f565da4c740 1 -- 172.21.15.84:0/975381731 shutdown_connections 2024-09-21T03:41:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.099+0000 7f565da4c740 1 -- 172.21.15.84:0/975381731 wait complete. 2024-09-21T03:41:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.099+0000 7f565da4c740 1 -- start start 2024-09-21T03:41:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.099+0000 7f565da4c740 1 Processor -- start 2024-09-21T03:41:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.099+0000 7f565da4c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f76638e0 0x5600f7a715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.099+0000 7f565da4c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600f767c0a0 0x5600f7a6aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.099+0000 7f565da4c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600f7684280 0x5600f7a6afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.099+0000 7f565da4c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5600f7a68980 con 0x5600f76638e0 2024-09-21T03:41:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.099+0000 7f565da4c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5600f7a682b0 con 0x5600f7684280 2024-09-21T03:41:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.099+0000 7f565da4c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5600f7a69050 con 0x5600f767c0a0 2024-09-21T03:41:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.100+0000 7f565da4c740 10 client.0 _ll_register_callbacks cb 0x7f5648031500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.100+0000 7f5655a75640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f76638e0 0x5600f7a715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.100+0000 7f5655a75640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f76638e0 0x5600f7a715a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46782/0 (socket says 172.21.15.84:46782) 2024-09-21T03:41:51.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.100+0000 7f5655a75640 1 -- 172.21.15.84:0/3825365026 learned_addr learned my addr 172.21.15.84:0/3825365026 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:51.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.100+0000 7f5654a73640 1 --2- 172.21.15.84:0/3825365026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600f767c0a0 0x5600f7a6aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:51.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.100+0000 7f5655a75640 1 --2- 172.21.15.84:0/3825365026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600f7684280 0x5600f7a6afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:51.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.100+0000 7f5655a75640 1 -- 172.21.15.84:0/3825365026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600f767c0a0 msgr2=0x5600f7a6aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:51.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.100+0000 7f5655a75640 1 --2- 172.21.15.84:0/3825365026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600f767c0a0 0x5600f7a6aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.100+0000 7f5655a75640 1 -- 172.21.15.84:0/3825365026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600f7684280 msgr2=0x5600f7a6afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:51.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.100+0000 7f5655a75640 1 --2- 172.21.15.84:0/3825365026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600f7684280 0x5600f7a6afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.100+0000 7f5655a75640 1 -- 172.21.15.84:0/3825365026 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600f7a6b740 con 0x5600f76638e0 2024-09-21T03:41:51.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.100+0000 7f5655a75640 1 --2- 172.21.15.84:0/3825365026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f76638e0 0x5600f7a715a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f56480094e0 tx=0x7f5648030f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181983d585d6b696 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:51.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.100+0000 7f5638ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:41:51.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.100+0000 7f5638ff9640 1 -- 172.21.15.84:0/3825365026 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5648055070 con 0x5600f76638e0 2024-09-21T03:41:51.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.100+0000 7f5638ff9640 1 -- 172.21.15.84:0/3825365026 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f5648004d40 con 0x5600f76638e0 2024-09-21T03:41:51.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.100+0000 7f565da4c740 1 -- 172.21.15.84:0/3825365026 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5648036040 con 0x5600f76638e0 2024-09-21T03:41:51.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.100+0000 7f5638ff9640 1 -- 172.21.15.84:0/3825365026 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f56480448b0 con 0x5600f76638e0 2024-09-21T03:41:51.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.100+0000 7f565da4c740 10 client.15252 fetch_fsmap learned FSMap version 24 2024-09-21T03:41:51.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.100+0000 7f565da4c740 1 -- 172.21.15.84:0/3825365026 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5600f7ad3fd0 con 0x5600f76638e0 2024-09-21T03:41:51.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.101+0000 7f5638ff9640 1 -- 172.21.15.84:0/3825365026 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5648036040 con 0x5600f76638e0 2024-09-21T03:41:51.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.101+0000 7f5638ff9640 1 -- 172.21.15.84:0/3825365026 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f564804f030 con 0x5600f76638e0 2024-09-21T03:41:51.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.101+0000 7f565da4c740 10 client.15252 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:41:51.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.101+0000 7f565da4c740 10 client.15252 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T03:41:51.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.101+0000 7f565da4c740 20 client.15252 populate_metadata read hostname 'smithi084' 2024-09-21T03:41:51.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.101+0000 7f565da4c740 1 --2- 172.21.15.84:0/3825365026 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5600f76a4f60 0x5600f7ad7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:51.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.101+0000 7f565da4c740 4 client.15252 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:41:51.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.101+0000 7f565da4c740 1 -- 172.21.15.84:0/3825365026 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "status"}) -- 0x5600f79c0610 con 0x5600f76a4f60 2024-09-21T03:41:51.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.101+0000 7f5654a73640 1 --2- 172.21.15.84:0/3825365026 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5600f76a4f60 0x5600f7ad7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:51.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.102+0000 7f5638ff9640 10 client.15252 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:41:51.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.102+0000 7f5654a73640 1 --2- 172.21.15.84:0/3825365026 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5600f76a4f60 0x5600f7ad7260 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d3c3afe5d996f431 server_cookie=c7a27227d562932e in_seq=0 out_seq=0 2024-09-21T03:41:51.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.102+0000 7f5638ff9640 1 -- 172.21.15.84:0/3825365026 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5600f79c0610 con 0x5600f76a4f60 2024-09-21T03:41:51.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.102+0000 7f5638ff9640 10 client.15252 handle_command_reply: tid=0 2024-09-21T03:41:51.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.102+0000 7f565da4c740 1 client.15252 shutdown 2024-09-21T03:41:51.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.102+0000 7f565da4c740 1 -- 172.21.15.84:0/3825365026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f76638e0 msgr2=0x5600f7a715a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:51.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.102+0000 7f565da4c740 1 --2- 172.21.15.84:0/3825365026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f76638e0 0x5600f7a715a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f56480094e0 tx=0x7f5648030f90 comp rx=0 tx=0).stop 2024-09-21T03:41:51.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.102+0000 7f565da4c740 1 -- 172.21.15.84:0/3825365026 shutdown_connections 2024-09-21T03:41:51.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.102+0000 7f565da4c740 1 --2- 172.21.15.84:0/3825365026 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5600f76a4f60 0x5600f7ad7260 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.102+0000 7f565da4c740 1 --2- 172.21.15.84:0/3825365026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600f7684280 0x5600f7a6afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.102+0000 7f565da4c740 1 --2- 172.21.15.84:0/3825365026 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5600f767c0a0 0x5600f7a6aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.102+0000 7f565da4c740 1 --2- 172.21.15.84:0/3825365026 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5600f76638e0 0x5600f7a715a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.102+0000 7f5638ff9640 0 client.15252 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:41:51.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.102+0000 7f565da4c740 1 -- 172.21.15.84:0/3825365026 >> 172.21.15.84:0/3825365026 conn(0x5600f7699350 msgr2=0x5600f7a473b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:51.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.102+0000 7f565da4c740 1 -- 172.21.15.84:0/3825365026 shutdown_connections 2024-09-21T03:41:51.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.102+0000 7f565da4c740 1 -- 172.21.15.84:0/3825365026 wait complete. 2024-09-21T03:41:51.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.102+0000 7f565da4c740 20 client.15252 trim_cache size 0 max 16384 2024-09-21T03:41:51.122 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:41:51.122 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "e3f8c18e-77c9-11ef-baf5-efdc52797490", 2024-09-21T03:41:51.122 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 1, 2024-09-21T03:41:51.122 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24638, 2024-09-21T03:41:51.122 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T03:41:51.122 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T03:41:51.122 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T03:41:51.122 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 73.714200982999998, 2024-09-21T03:41:51.122 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 24, 2024-09-21T03:41:51.122 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 77, 2024-09-21T03:41:51.122 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T03:41:51.122 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 102.701836434 2024-09-21T03:41:51.123 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:41:51.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.103+0000 7f56574d8640 1 -- 172.21.15.84:0/2897492407 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f563c0b65f0 msgr2=0x7f563c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:51.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.103+0000 7f56574d8640 1 --2- 172.21.15.84:0/2897492407 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f563c0b65f0 0x7f563c0b8b00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f56440aa990 tx=0x7f56440a9d70 comp rx=0 tx=0).stop 2024-09-21T03:41:51.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.103+0000 7f56574d8640 1 -- 172.21.15.84:0/2897492407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5650103b60 msgr2=0x7f5650075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:51.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.103+0000 7f56574d8640 1 --2- 172.21.15.84:0/2897492407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5650103b60 0x7f5650075710 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f564400c920 tx=0x7f564400cde0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.103+0000 7f56574d8640 1 -- 172.21.15.84:0/2897492407 shutdown_connections 2024-09-21T03:41:51.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.103+0000 7f56574d8640 1 --2- 172.21.15.84:0/2897492407 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f563c0b65f0 0x7f563c0b8b00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.103+0000 7f56574d8640 1 --2- 172.21.15.84:0/2897492407 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5650109df0 0x7f5650076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.103+0000 7f56574d8640 1 --2- 172.21.15.84:0/2897492407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56501094a0 0x7f5650075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.103+0000 7f56574d8640 1 --2- 172.21.15.84:0/2897492407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5650103b60 0x7f5650075710 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:51.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.103+0000 7f56574d8640 1 -- 172.21.15.84:0/2897492407 >> 172.21.15.84:0/2897492407 conn(0x7f565007b850 msgr2=0x7f5650107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:51.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.103+0000 7f56574d8640 1 -- 172.21.15.84:0/2897492407 shutdown_connections 2024-09-21T03:41:51.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:51.103+0000 7f56574d8640 1 -- 172.21.15.84:0/2897492407 wait complete. 2024-09-21T03:41:51.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:51 smithi172 ceph-mon[34821]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:41:51.784 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:51 smithi084 ceph-mon[30941]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:41:51.814 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T03:41:51.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:51 smithi174 ceph-mon[34403]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:41:52.061 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:52.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.574+0000 7f464e0f2640 1 -- 172.21.15.84:0/2224395398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4648109e10 msgr2=0x7f4648110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:52.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.574+0000 7f464e0f2640 1 --2- 172.21.15.84:0/2224395398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4648109e10 0x7f4648110640 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4640009ca0 tx=0x7f464002a8e0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.574+0000 7f464e0f2640 1 -- 172.21.15.84:0/2224395398 shutdown_connections 2024-09-21T03:41:52.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.574+0000 7f464e0f2640 1 --2- 172.21.15.84:0/2224395398 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4648109e10 0x7f4648110640 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.574+0000 7f464e0f2640 1 --2- 172.21.15.84:0/2224395398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46481094c0 0x7f46481098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.574+0000 7f464e0f2640 1 --2- 172.21.15.84:0/2224395398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4648103b80 0x7f4648103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.574+0000 7f464e0f2640 1 -- 172.21.15.84:0/2224395398 >> 172.21.15.84:0/2224395398 conn(0x7f46480ff610 msgr2=0x7f4648101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:52.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.574+0000 7f464e0f2640 1 -- 172.21.15.84:0/2224395398 shutdown_connections 2024-09-21T03:41:52.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.574+0000 7f464e0f2640 1 -- 172.21.15.84:0/2224395398 wait complete. 2024-09-21T03:41:52.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.575+0000 7f464e0f2640 1 Processor -- start 2024-09-21T03:41:52.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.575+0000 7f464e0f2640 1 -- start start 2024-09-21T03:41:52.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.576+0000 7f464e0f2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4648103b80 0x7f464819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:52.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.576+0000 7f464e0f2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46481094c0 0x7f464819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:52.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.576+0000 7f464e0f2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4648109e10 0x7f464819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:52.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.576+0000 7f464e0f2640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4648113b90 con 0x7f46481094c0 2024-09-21T03:41:52.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.576+0000 7f464e0f2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4648113a10 con 0x7f4648109e10 2024-09-21T03:41:52.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.576+0000 7f464e0f2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4648113d10 con 0x7f4648103b80 2024-09-21T03:41:52.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.576+0000 7f4646ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46481094c0 0x7f464819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:52.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.576+0000 7f4646ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46481094c0 0x7f464819ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46800/0 (socket says 172.21.15.84:46800) 2024-09-21T03:41:52.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.576+0000 7f4646ffd640 1 -- 172.21.15.84:0/3235186117 learned_addr learned my addr 172.21.15.84:0/3235186117 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:52.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.576+0000 7f4647fff640 1 --2- 172.21.15.84:0/3235186117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4648109e10 0x7f464819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:52.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.576+0000 7f46477fe640 1 --2- 172.21.15.84:0/3235186117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4648103b80 0x7f464819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:52.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.576+0000 7f4646ffd640 1 -- 172.21.15.84:0/3235186117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4648103b80 msgr2=0x7f464819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:52.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.576+0000 7f4646ffd640 1 --2- 172.21.15.84:0/3235186117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4648103b80 0x7f464819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.576+0000 7f4646ffd640 1 -- 172.21.15.84:0/3235186117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4648109e10 msgr2=0x7f464819fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:52.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.576+0000 7f4646ffd640 1 --2- 172.21.15.84:0/3235186117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4648109e10 0x7f464819fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.576+0000 7f4646ffd640 1 -- 172.21.15.84:0/3235186117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46481a0510 con 0x7f46481094c0 2024-09-21T03:41:52.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.576+0000 7f4647fff640 1 --2- 172.21.15.84:0/3235186117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4648109e10 0x7f464819fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:52.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.576+0000 7f4646ffd640 1 --2- 172.21.15.84:0/3235186117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46481094c0 0x7f464819ab40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f463c006fd0 tx=0x7f463c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:52.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.577+0000 7f4644ff9640 1 -- 172.21.15.84:0/3235186117 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c011830 con 0x7f46481094c0 2024-09-21T03:41:52.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.577+0000 7f464e0f2640 1 -- 172.21.15.84:0/3235186117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46481a0800 con 0x7f46481094c0 2024-09-21T03:41:52.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.577+0000 7f4644ff9640 1 -- 172.21.15.84:0/3235186117 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f463c016070 con 0x7f46481094c0 2024-09-21T03:41:52.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.577+0000 7f4644ff9640 1 -- 172.21.15.84:0/3235186117 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463c010e00 con 0x7f46481094c0 2024-09-21T03:41:52.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.577+0000 7f464e0f2640 1 -- 172.21.15.84:0/3235186117 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46481a6f60 con 0x7f46481094c0 2024-09-21T03:41:52.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.579+0000 7f4644ff9640 1 -- 172.21.15.84:0/3235186117 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f463c01b460 con 0x7f46481094c0 2024-09-21T03:41:52.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.579+0000 7f4654666740 1 Processor -- start 2024-09-21T03:41:52.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.579+0000 7f4654666740 1 -- start start 2024-09-21T03:41:52.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f4654666740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91823f60 0x55ca91bc9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:52.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f4654666740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 0x55ca91bca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:52.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f4654666740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca91803280 0x55ca91bca980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:52.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f4654666740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ca91b41c10 con 0x55ca917fb0a0 2024-09-21T03:41:52.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f4654666740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ca91b31040 con 0x55ca91823f60 2024-09-21T03:41:52.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f4654666740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ca91b34e50 con 0x55ca91803280 2024-09-21T03:41:52.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f46477fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 0x55ca91bca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:52.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f46477fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 0x55ca91bca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46814/0 (socket says 172.21.15.84:46814) 2024-09-21T03:41:52.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f46477fe640 1 -- 172.21.15.84:0/2396630440 learned_addr learned my addr 172.21.15.84:0/2396630440 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:52.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f4646ffd640 1 --2- 172.21.15.84:0/2396630440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca91803280 0x55ca91bca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:52.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f4644ff9640 1 --2- 172.21.15.84:0/3235186117 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f46300b6560 0x7f46300b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:52.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f46477fe640 1 -- 172.21.15.84:0/2396630440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca91803280 msgr2=0x55ca91bca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:52.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f46477fe640 1 --2- 172.21.15.84:0/2396630440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca91803280 0x55ca91bca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f46477fe640 1 -- 172.21.15.84:0/2396630440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91823f60 msgr2=0x55ca91bc9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:52.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f4647fff640 1 --2- 172.21.15.84:0/2396630440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91823f60 0x55ca91bc9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:52.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f46477fe640 1 --2- 172.21.15.84:0/2396630440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91823f60 0x55ca91bc9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f46477fe640 1 -- 172.21.15.84:0/2396630440 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca9188f540 con 0x55ca917fb0a0 2024-09-21T03:41:52.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f4647fff640 1 --2- 172.21.15.84:0/2396630440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91823f60 0x55ca91bc9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:52.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f4647fff640 1 --2- 172.21.15.84:0/3235186117 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f46300b6560 0x7f46300b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:52.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f46477fe640 1 --2- 172.21.15.84:0/2396630440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 0x55ca91bca440 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f463800b820 tx=0x7f463800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57dbc8c2dd453216 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:52.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.580+0000 7f4644ff9640 1 -- 172.21.15.84:0/3235186117 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f463c0e6a00 con 0x7f46481094c0 2024-09-21T03:41:52.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.581+0000 7f462dffb640 1 -- 172.21.15.84:0/2396630440 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463800d950 con 0x55ca917fb0a0 2024-09-21T03:41:52.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.581+0000 7f462dffb640 1 -- 172.21.15.84:0/2396630440 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4638019070 con 0x55ca917fb0a0 2024-09-21T03:41:52.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.581+0000 7f462dffb640 1 -- 172.21.15.84:0/2396630440 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46380123e0 con 0x55ca917fb0a0 2024-09-21T03:41:52.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.581+0000 7f4654666740 1 -- 172.21.15.84:0/2396630440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 msgr2=0x55ca91bca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:52.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.581+0000 7f4647fff640 1 --2- 172.21.15.84:0/3235186117 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f46300b6560 0x7f46300b8a70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4640005cc0 tx=0x7f4640032f50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:52.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.581+0000 7f4654666740 1 --2- 172.21.15.84:0/2396630440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 0x55ca91bca440 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f463800b820 tx=0x7f463800bce0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.581+0000 7f4654666740 1 -- 172.21.15.84:0/2396630440 shutdown_connections 2024-09-21T03:41:52.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.581+0000 7f4654666740 1 --2- 172.21.15.84:0/2396630440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca91803280 0x55ca91bca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.582+0000 7f4654666740 1 --2- 172.21.15.84:0/2396630440 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 0x55ca91bca440 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.582+0000 7f4654666740 1 --2- 172.21.15.84:0/2396630440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91823f60 0x55ca91bc9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.582+0000 7f4654666740 1 -- 172.21.15.84:0/2396630440 >> 172.21.15.84:0/2396630440 conn(0x55ca91818350 msgr2=0x55ca91bc7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:52.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.582+0000 7f4654666740 1 -- 172.21.15.84:0/2396630440 shutdown_connections 2024-09-21T03:41:52.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.582+0000 7f4654666740 1 -- 172.21.15.84:0/2396630440 wait complete. 2024-09-21T03:41:52.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.582+0000 7f4654666740 1 -- start start 2024-09-21T03:41:52.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.582+0000 7f4654666740 1 Processor -- start 2024-09-21T03:41:52.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.582+0000 7f4654666740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 0x55ca91bd57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:52.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.582+0000 7f4654666740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91803280 0x55ca91bd5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:52.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.582+0000 7f4654666740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca91823f60 0x55ca91be19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:52.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.582+0000 7f4654666740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ca919925f0 con 0x55ca917fb0a0 2024-09-21T03:41:52.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.582+0000 7f4654666740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ca91acc010 con 0x55ca91803280 2024-09-21T03:41:52.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.582+0000 7f4654666740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ca91bd86e0 con 0x55ca91823f60 2024-09-21T03:41:52.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.583+0000 7f4654666740 10 client.0 _ll_register_callbacks cb 0x55ca91b2b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:52.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.583+0000 7f46477fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 0x55ca91bd57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:52.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.583+0000 7f46477fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 0x55ca91bd57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46820/0 (socket says 172.21.15.84:46820) 2024-09-21T03:41:52.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.583+0000 7f46477fe640 1 -- 172.21.15.84:0/3289533249 learned_addr learned my addr 172.21.15.84:0/3289533249 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:52.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.583+0000 7f4647fff640 1 --2- 172.21.15.84:0/3289533249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca91823f60 0x55ca91be19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:52.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.583+0000 7f4646ffd640 1 --2- 172.21.15.84:0/3289533249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91803280 0x55ca91bd5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:52.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.583+0000 7f46477fe640 1 -- 172.21.15.84:0/3289533249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca91823f60 msgr2=0x55ca91be19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:52.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.583+0000 7f46477fe640 1 --2- 172.21.15.84:0/3289533249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca91823f60 0x55ca91be19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.583+0000 7f46477fe640 1 -- 172.21.15.84:0/3289533249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91803280 msgr2=0x55ca91bd5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:52.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.583+0000 7f46477fe640 1 --2- 172.21.15.84:0/3289533249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91803280 0x55ca91bd5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.583+0000 7f46477fe640 1 -- 172.21.15.84:0/3289533249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca91af9a00 con 0x55ca917fb0a0 2024-09-21T03:41:52.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.583+0000 7f4646ffd640 1 --2- 172.21.15.84:0/3289533249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91803280 0x55ca91bd5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:52.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.583+0000 7f46477fe640 1 --2- 172.21.15.84:0/3289533249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 0x55ca91bd57b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4638014b40 tx=0x7f4638014660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08764452f760364 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:52.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.583+0000 7f4626ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:41:52.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.583+0000 7f4626ffd640 1 -- 172.21.15.84:0/3289533249 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4638023070 con 0x55ca917fb0a0 2024-09-21T03:41:52.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.583+0000 7f4626ffd640 1 -- 172.21.15.84:0/3289533249 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f463800db50 con 0x55ca917fb0a0 2024-09-21T03:41:52.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.583+0000 7f4654666740 1 -- 172.21.15.84:0/3289533249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4638019070 con 0x55ca917fb0a0 2024-09-21T03:41:52.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.583+0000 7f4626ffd640 1 -- 172.21.15.84:0/3289533249 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f463802f050 con 0x55ca917fb0a0 2024-09-21T03:41:52.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.583+0000 7f4654666740 10 client.15264 fetch_fsmap learned FSMap version 24 2024-09-21T03:41:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.583+0000 7f4654666740 1 -- 172.21.15.84:0/3289533249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ca91be44f0 con 0x55ca917fb0a0 2024-09-21T03:41:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.584+0000 7f4626ffd640 1 -- 172.21.15.84:0/3289533249 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4638019070 con 0x55ca917fb0a0 2024-09-21T03:41:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.584+0000 7f4626ffd640 1 -- 172.21.15.84:0/3289533249 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4638013070 con 0x55ca917fb0a0 2024-09-21T03:41:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.584+0000 7f4654666740 10 client.15264 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:41:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.584+0000 7f4654666740 10 client.15264 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:41:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.584+0000 7f4654666740 20 client.15264 populate_metadata read hostname 'smithi084' 2024-09-21T03:41:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.584+0000 7f4654666740 1 --2- 172.21.15.84:0/3289533249 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ca917e28e0 0x55ca91be7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.584+0000 7f4654666740 4 client.15264 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:41:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.584+0000 7f4654666740 1 -- 172.21.15.84:0/3289533249 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca91b43b60 con 0x55ca917e28e0 2024-09-21T03:41:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.584+0000 7f4646ffd640 1 --2- 172.21.15.84:0/3289533249 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ca917e28e0 0x55ca91be7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.585+0000 7f4626ffd640 10 client.15264 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:41:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.585+0000 7f4646ffd640 1 --2- 172.21.15.84:0/3289533249 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ca917e28e0 0x55ca91be7bb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62beea313d0872b2 server_cookie=6aafad6c3c881ae5 in_seq=0 out_seq=0 2024-09-21T03:41:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.586+0000 7f4626ffd640 1 -- 172.21.15.84:0/3289533249 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ca91b43b60 con 0x55ca917e28e0 2024-09-21T03:41:52.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.586+0000 7f4626ffd640 10 client.15264 handle_command_reply: tid=0 2024-09-21T03:41:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.586+0000 7f4654666740 1 client.15264 shutdown 2024-09-21T03:41:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.586+0000 7f4654666740 1 -- 172.21.15.84:0/3289533249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 msgr2=0x55ca91bd57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.586+0000 7f4654666740 1 --2- 172.21.15.84:0/3289533249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 0x55ca91bd57b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4638014b40 tx=0x7f4638014660 comp rx=0 tx=0).stop 2024-09-21T03:41:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.586+0000 7f4654666740 1 -- 172.21.15.84:0/3289533249 shutdown_connections 2024-09-21T03:41:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.586+0000 7f4654666740 1 --2- 172.21.15.84:0/3289533249 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ca917e28e0 0x55ca91be7bb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.586+0000 7f4654666740 1 --2- 172.21.15.84:0/3289533249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca91823f60 0x55ca91be19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.586+0000 7f4626ffd640 0 client.15264 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:41:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.586+0000 7f4654666740 1 --2- 172.21.15.84:0/3289533249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91803280 0x55ca91bd5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.586+0000 7f4654666740 1 --2- 172.21.15.84:0/3289533249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 0x55ca91bd57b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.586+0000 7f4654666740 1 -- 172.21.15.84:0/3289533249 >> 172.21.15.84:0/3289533249 conn(0x55ca91818350 msgr2=0x55ca91bcd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.586+0000 7f4654666740 1 -- 172.21.15.84:0/3289533249 shutdown_connections 2024-09-21T03:41:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.586+0000 7f4654666740 1 -- 172.21.15.84:0/3289533249 wait complete. 2024-09-21T03:41:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.586+0000 7f4654666740 20 client.15264 trim_cache size 0 max 16384 2024-09-21T03:41:52.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.603+0000 7f4654666740 1 Processor -- start 2024-09-21T03:41:52.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.604+0000 7f4654666740 1 -- start start 2024-09-21T03:41:52.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.604+0000 7f4654666740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 0x55ca91bd0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:52.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.604+0000 7f4654666740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91803280 0x55ca91be1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:52.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.604+0000 7f4654666740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca91823f60 0x55ca91be1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:52.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.604+0000 7f4654666740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ca91be5ef0 con 0x55ca917fb0a0 2024-09-21T03:41:52.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.604+0000 7f4654666740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ca91be65c0 con 0x55ca91803280 2024-09-21T03:41:52.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.604+0000 7f4654666740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ca91be6c90 con 0x55ca91823f60 2024-09-21T03:41:52.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.604+0000 7f46477fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 0x55ca91bd0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:52.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.604+0000 7f46477fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 0x55ca91bd0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46828/0 (socket says 172.21.15.84:46828) 2024-09-21T03:41:52.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.604+0000 7f46477fe640 1 -- 172.21.15.84:0/3037949771 learned_addr learned my addr 172.21.15.84:0/3037949771 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:52.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.604+0000 7f4647fff640 1 --2- 172.21.15.84:0/3037949771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca91823f60 0x55ca91be1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:52.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.604+0000 7f46477fe640 1 -- 172.21.15.84:0/3037949771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca91823f60 msgr2=0x55ca91be1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:52.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.604+0000 7f46477fe640 1 --2- 172.21.15.84:0/3037949771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca91823f60 0x55ca91be1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.604+0000 7f46477fe640 1 -- 172.21.15.84:0/3037949771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91803280 msgr2=0x55ca91be1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:52.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.604+0000 7f46477fe640 1 --2- 172.21.15.84:0/3037949771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91803280 0x55ca91be1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.604+0000 7f46477fe640 1 -- 172.21.15.84:0/3037949771 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca91bd1040 con 0x55ca917fb0a0 2024-09-21T03:41:52.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.604+0000 7f4647fff640 1 --2- 172.21.15.84:0/3037949771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca91823f60 0x55ca91be1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:52.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.604+0000 7f46477fe640 1 --2- 172.21.15.84:0/3037949771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 0x55ca91bd0020 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f463801ff50 tx=0x7f4638006ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26166f417d6b57cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:52.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.604+0000 7f462d7fa640 1 -- 172.21.15.84:0/3037949771 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4638023070 con 0x55ca917fb0a0 2024-09-21T03:41:52.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.605+0000 7f462d7fa640 1 -- 172.21.15.84:0/3037949771 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4638019070 con 0x55ca917fb0a0 2024-09-21T03:41:52.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.605+0000 7f462d7fa640 1 -- 172.21.15.84:0/3037949771 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f463801db50 con 0x55ca917fb0a0 2024-09-21T03:41:52.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.605+0000 7f4654666740 1 -- 172.21.15.84:0/3037949771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 msgr2=0x55ca91bd0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:52.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.605+0000 7f4654666740 1 --2- 172.21.15.84:0/3037949771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 0x55ca91bd0020 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f463801ff50 tx=0x7f4638006ab0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.605+0000 7f4654666740 1 -- 172.21.15.84:0/3037949771 shutdown_connections 2024-09-21T03:41:52.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.605+0000 7f4654666740 1 --2- 172.21.15.84:0/3037949771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca91823f60 0x55ca91be1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.605+0000 7f4654666740 1 --2- 172.21.15.84:0/3037949771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91803280 0x55ca91be1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.605+0000 7f4654666740 1 --2- 172.21.15.84:0/3037949771 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca917fb0a0 0x55ca91bd0020 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.605+0000 7f4654666740 1 -- 172.21.15.84:0/3037949771 >> 172.21.15.84:0/3037949771 conn(0x55ca91818350 msgr2=0x55ca91bd5560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.605+0000 7f4654666740 1 -- 172.21.15.84:0/3037949771 shutdown_connections 2024-09-21T03:41:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.605+0000 7f4654666740 1 -- 172.21.15.84:0/3037949771 wait complete. 2024-09-21T03:41:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.606+0000 7f4654666740 1 -- start start 2024-09-21T03:41:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.606+0000 7f4654666740 1 Processor -- start 2024-09-21T03:41:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.606+0000 7f4654666740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca917fb0a0 0x55ca91be9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.606+0000 7f4654666740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91803280 0x55ca91bea330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.606+0000 7f4654666740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca91823f60 0x55ca91bea870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.606+0000 7f4654666740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ca91be7a30 con 0x55ca91823f60 2024-09-21T03:41:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.606+0000 7f4654666740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ca91be7360 con 0x55ca91803280 2024-09-21T03:41:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.606+0000 7f4654666740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ca91be8100 con 0x55ca917fb0a0 2024-09-21T03:41:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.606+0000 7f4654666740 10 client.0 _ll_register_callbacks cb 0x7f463800b670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.606+0000 7f4647fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca91823f60 0x55ca91bea870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.606+0000 7f4647fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca91823f60 0x55ca91bea870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46842/0 (socket says 172.21.15.84:46842) 2024-09-21T03:41:52.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.606+0000 7f4647fff640 1 -- 172.21.15.84:0/2088920035 learned_addr learned my addr 172.21.15.84:0/2088920035 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.606+0000 7f4646ffd640 1 --2- 172.21.15.84:0/2088920035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91803280 0x55ca91bea330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.607+0000 7f46477fe640 1 --2- 172.21.15.84:0/2088920035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca917fb0a0 0x55ca91be9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.607+0000 7f4647fff640 1 -- 172.21.15.84:0/2088920035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca917fb0a0 msgr2=0x55ca91be9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.607+0000 7f4647fff640 1 --2- 172.21.15.84:0/2088920035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca917fb0a0 0x55ca91be9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.607+0000 7f4647fff640 1 -- 172.21.15.84:0/2088920035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91803280 msgr2=0x55ca91bea330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.607+0000 7f4647fff640 1 --2- 172.21.15.84:0/2088920035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91803280 0x55ca91bea330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.607+0000 7f4647fff640 1 -- 172.21.15.84:0/2088920035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca91bef580 con 0x55ca91823f60 2024-09-21T03:41:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.607+0000 7f4647fff640 1 --2- 172.21.15.84:0/2088920035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca91823f60 0x55ca91bea870 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4640035000 tx=0x7f46400095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a386d7c3474567 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.607+0000 7f4626ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:41:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.607+0000 7f4626ffd640 1 -- 172.21.15.84:0/2088920035 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4640031470 con 0x55ca91823f60 2024-09-21T03:41:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.607+0000 7f4626ffd640 1 -- 172.21.15.84:0/2088920035 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f46400047c0 con 0x55ca91823f60 2024-09-21T03:41:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.607+0000 7f4654666740 1 -- 172.21.15.84:0/2088920035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4638019070 con 0x55ca91823f60 2024-09-21T03:41:52.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.607+0000 7f4626ffd640 1 -- 172.21.15.84:0/2088920035 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f46400305e0 con 0x55ca91823f60 2024-09-21T03:41:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.607+0000 7f4654666740 10 client.15270 fetch_fsmap learned FSMap version 24 2024-09-21T03:41:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.607+0000 7f4654666740 1 -- 172.21.15.84:0/2088920035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ca91c53220 con 0x55ca91823f60 2024-09-21T03:41:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.607+0000 7f4626ffd640 1 -- 172.21.15.84:0/2088920035 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4638019070 con 0x55ca91823f60 2024-09-21T03:41:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.608+0000 7f4626ffd640 1 -- 172.21.15.84:0/2088920035 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4640050020 con 0x55ca91823f60 2024-09-21T03:41:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.608+0000 7f4654666740 10 client.15270 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:41:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.608+0000 7f4654666740 10 client.15270 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:41:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.608+0000 7f4654666740 20 client.15270 populate_metadata read hostname 'smithi084' 2024-09-21T03:41:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.608+0000 7f4654666740 1 --2- 172.21.15.84:0/2088920035 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ca917b7c90 0x55ca91c56b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.608+0000 7f4654666740 4 client.15270 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:41:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.608+0000 7f4654666740 1 -- 172.21.15.84:0/2088920035 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "status"}) -- 0x55ca91b3f610 con 0x55ca917b7c90 2024-09-21T03:41:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.608+0000 7f46477fe640 1 --2- 172.21.15.84:0/2088920035 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ca917b7c90 0x55ca91c56b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.608+0000 7f46477fe640 1 --2- 172.21.15.84:0/2088920035 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ca917b7c90 0x55ca91c56b80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b115f84cee6bf018 server_cookie=f20a99f163dadeb8 in_seq=0 out_seq=0 2024-09-21T03:41:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.608+0000 7f4626ffd640 10 client.15270 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:41:52.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f4626ffd640 1 -- 172.21.15.84:0/2088920035 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ca91b3f610 con 0x55ca917b7c90 2024-09-21T03:41:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f4626ffd640 10 client.15270 handle_command_reply: tid=0 2024-09-21T03:41:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f4654666740 1 client.15270 shutdown 2024-09-21T03:41:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f4654666740 1 -- 172.21.15.84:0/2088920035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca91823f60 msgr2=0x55ca91bea870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f4654666740 1 --2- 172.21.15.84:0/2088920035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca91823f60 0x55ca91bea870 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4640035000 tx=0x7f46400095c0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f4654666740 1 -- 172.21.15.84:0/2088920035 shutdown_connections 2024-09-21T03:41:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f4654666740 1 --2- 172.21.15.84:0/2088920035 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ca917b7c90 0x55ca91c56b80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f4654666740 1 --2- 172.21.15.84:0/2088920035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ca91823f60 0x55ca91bea870 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f4654666740 1 --2- 172.21.15.84:0/2088920035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca91803280 0x55ca91bea330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f4626ffd640 0 client.15270 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:41:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f4654666740 1 --2- 172.21.15.84:0/2088920035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ca917fb0a0 0x55ca91be9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f4654666740 1 -- 172.21.15.84:0/2088920035 >> 172.21.15.84:0/2088920035 conn(0x55ca91818350 msgr2=0x55ca91bc7600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:52.629 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:41:52.629 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "e3f8c18e-77c9-11ef-baf5-efdc52797490", 2024-09-21T03:41:52.629 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2024-09-21T03:41:52.629 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24668, 2024-09-21T03:41:52.629 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T03:41:52.629 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T03:41:52.629 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T03:41:52.629 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 82.273636710999995, 2024-09-21T03:41:52.629 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 24, 2024-09-21T03:41:52.629 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 77, 2024-09-21T03:41:52.629 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T03:41:52.629 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 92.961366663999996 2024-09-21T03:41:52.629 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:41:52.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f4654666740 1 -- 172.21.15.84:0/2088920035 shutdown_connections 2024-09-21T03:41:52.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f4654666740 1 -- 172.21.15.84:0/2088920035 wait complete. 2024-09-21T03:41:52.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f4654666740 20 client.15270 trim_cache size 0 max 16384 2024-09-21T03:41:52.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f464e0f2640 1 -- 172.21.15.84:0/3235186117 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f46300b6560 msgr2=0x7f46300b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:52.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f464e0f2640 1 --2- 172.21.15.84:0/3235186117 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f46300b6560 0x7f46300b8a70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4640005cc0 tx=0x7f4640032f50 comp rx=0 tx=0).stop 2024-09-21T03:41:52.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f464e0f2640 1 -- 172.21.15.84:0/3235186117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46481094c0 msgr2=0x7f464819ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:52.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f464e0f2640 1 --2- 172.21.15.84:0/3235186117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46481094c0 0x7f464819ab40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f463c006fd0 tx=0x7f463c00b8e0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f464e0f2640 1 -- 172.21.15.84:0/3235186117 shutdown_connections 2024-09-21T03:41:52.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f464e0f2640 1 --2- 172.21.15.84:0/3235186117 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f46300b6560 0x7f46300b8a70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.609+0000 7f464e0f2640 1 --2- 172.21.15.84:0/3235186117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4648109e10 0x7f464819fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.610+0000 7f464e0f2640 1 --2- 172.21.15.84:0/3235186117 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46481094c0 0x7f464819ab40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.610+0000 7f464e0f2640 1 --2- 172.21.15.84:0/3235186117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4648103b80 0x7f464819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:52.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.610+0000 7f464e0f2640 1 -- 172.21.15.84:0/3235186117 >> 172.21.15.84:0/3235186117 conn(0x7f46480ff610 msgr2=0x7f4648101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:52.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.610+0000 7f464e0f2640 1 -- 172.21.15.84:0/3235186117 shutdown_connections 2024-09-21T03:41:52.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:52.610+0000 7f464e0f2640 1 -- 172.21.15.84:0/3235186117 wait complete. 2024-09-21T03:41:53.310 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T03:41:53.310 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T03:41:53.320 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T03:41:53.320 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T03:41:53.564 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:53.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:53 smithi084 ceph-mon[30941]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T03:41:53.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:53 smithi084 ceph-mon[30941]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T03:41:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:53 smithi172 ceph-mon[34821]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T03:41:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:53 smithi172 ceph-mon[34821]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T03:41:53.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:53 smithi174 ceph-mon[34403]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T03:41:53.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:53 smithi174 ceph-mon[34403]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T03:41:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.057+0000 7ff85492b640 1 -- 172.21.15.84:0/1507263613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff850105240 msgr2=0x7ff850105650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.057+0000 7ff85492b640 1 --2- 172.21.15.84:0/1507263613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff850105240 0x7ff850105650 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff844009900 tx=0x7ff84402a410 comp rx=0 tx=0).stop 2024-09-21T03:41:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.057+0000 7ff85492b640 1 -- 172.21.15.84:0/1507263613 shutdown_connections 2024-09-21T03:41:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.057+0000 7ff85492b640 1 --2- 172.21.15.84:0/1507263613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff850105b90 0x7ff85010f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.057+0000 7ff85492b640 1 --2- 172.21.15.84:0/1507263613 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff850105240 0x7ff850105650 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.057+0000 7ff85492b640 1 --2- 172.21.15.84:0/1507263613 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff850103270 0x7ff850103680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.057+0000 7ff85492b640 1 -- 172.21.15.84:0/1507263613 >> 172.21.15.84:0/1507263613 conn(0x7ff850079ec0 msgr2=0x7ff85007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.057+0000 7ff85492b640 1 -- 172.21.15.84:0/1507263613 shutdown_connections 2024-09-21T03:41:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.057+0000 7ff85492b640 1 -- 172.21.15.84:0/1507263613 wait complete. 2024-09-21T03:41:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.058+0000 7ff85492b640 1 Processor -- start 2024-09-21T03:41:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.058+0000 7ff85492b640 1 -- start start 2024-09-21T03:41:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.058+0000 7ff85492b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff850103270 0x7ff85019b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.058+0000 7ff85492b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff850105240 0x7ff85019b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.058+0000 7ff85492b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff850105b90 0x7ff85019be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.058+0000 7ff85492b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff850112a30 con 0x7ff850105b90 2024-09-21T03:41:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.058+0000 7ff85492b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff8501128b0 con 0x7ff850105240 2024-09-21T03:41:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.058+0000 7ff85492b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff850112bb0 con 0x7ff850103270 2024-09-21T03:41:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.059+0000 7ff84ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff850105b90 0x7ff85019be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.059+0000 7ff84ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff850105b90 0x7ff85019be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46870/0 (socket says 172.21.15.84:46870) 2024-09-21T03:41:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.059+0000 7ff84ed9d640 1 -- 172.21.15.84:0/1432154505 learned_addr learned my addr 172.21.15.84:0/1432154505 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.059+0000 7ff84e59c640 1 --2- 172.21.15.84:0/1432154505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff850103270 0x7ff85019b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.059+0000 7ff84dd9b640 1 --2- 172.21.15.84:0/1432154505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff850105240 0x7ff85019b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.059+0000 7ff84ed9d640 1 -- 172.21.15.84:0/1432154505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff850103270 msgr2=0x7ff85019b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.059+0000 7ff84ed9d640 1 --2- 172.21.15.84:0/1432154505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff850103270 0x7ff85019b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.059+0000 7ff84ed9d640 1 -- 172.21.15.84:0/1432154505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff850105240 msgr2=0x7ff85019b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.059+0000 7ff84ed9d640 1 --2- 172.21.15.84:0/1432154505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff850105240 0x7ff85019b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.059+0000 7ff84ed9d640 1 -- 172.21.15.84:0/1432154505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8501a65a0 con 0x7ff850105b90 2024-09-21T03:41:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.059+0000 7ff84ed9d640 1 --2- 172.21.15.84:0/1432154505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff850105b90 0x7ff85019be20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff84800cce0 tx=0x7ff84800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.059+0000 7ff83f7fe640 1 -- 172.21.15.84:0/1432154505 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84800f450 con 0x7ff850105b90 2024-09-21T03:41:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.059+0000 7ff83f7fe640 1 -- 172.21.15.84:0/1432154505 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff84800faa0 con 0x7ff850105b90 2024-09-21T03:41:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.059+0000 7ff85492b640 1 -- 172.21.15.84:0/1432154505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8501a6890 con 0x7ff850105b90 2024-09-21T03:41:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.059+0000 7ff83f7fe640 1 -- 172.21.15.84:0/1432154505 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848018b70 con 0x7ff850105b90 2024-09-21T03:41:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.059+0000 7ff85492b640 1 -- 172.21.15.84:0/1432154505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8501a6df0 con 0x7ff850105b90 2024-09-21T03:41:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.060+0000 7ff85492b640 1 -- 172.21.15.84:0/1432154505 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff850103680 con 0x7ff850105b90 2024-09-21T03:41:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.062+0000 7ff83f7fe640 1 -- 172.21.15.84:0/1432154505 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7ff848018d10 con 0x7ff850105b90 2024-09-21T03:41:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.062+0000 7ff83f7fe640 1 --2- 172.21.15.84:0/1432154505 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff8380b6610 0x7ff8380b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.063+0000 7ff84e59c640 1 --2- 172.21.15.84:0/1432154505 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff8380b6610 0x7ff8380b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.063+0000 7ff83f7fe640 1 -- 172.21.15.84:0/1432154505 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff8480e7980 con 0x7ff850105b90 2024-09-21T03:41:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.063+0000 7ff84e59c640 1 --2- 172.21.15.84:0/1432154505 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff8380b6610 0x7ff8380b8b20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff850102a30 tx=0x7ff84000b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.066+0000 7ff83f7fe640 1 -- 172.21.15.84:0/1432154505 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff848014030 con 0x7ff850105b90 2024-09-21T03:41:54.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.266+0000 7ff85492b640 1 -- 172.21.15.84:0/1432154505 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7ff850063800 con 0x7ff8380b6610 2024-09-21T03:41:54.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.267+0000 7ff83f7fe640 1 -- 172.21.15.84:0/1432154505 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7ff850063800 con 0x7ff8380b6610 2024-09-21T03:41:54.269 INFO:teuthology.orchestra.run.smithi084.stdout:Backend: cephadm 2024-09-21T03:41:54.269 INFO:teuthology.orchestra.run.smithi084.stdout:Available: Yes 2024-09-21T03:41:54.269 INFO:teuthology.orchestra.run.smithi084.stdout:Paused: No 2024-09-21T03:41:54.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.269+0000 7ff85492b640 1 -- 172.21.15.84:0/1432154505 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff8380b6610 msgr2=0x7ff8380b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:54.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.269+0000 7ff85492b640 1 --2- 172.21.15.84:0/1432154505 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff8380b6610 0x7ff8380b8b20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff850102a30 tx=0x7ff84000b390 comp rx=0 tx=0).stop 2024-09-21T03:41:54.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.269+0000 7ff85492b640 1 -- 172.21.15.84:0/1432154505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff850105b90 msgr2=0x7ff85019be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:54.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.269+0000 7ff85492b640 1 --2- 172.21.15.84:0/1432154505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff850105b90 0x7ff85019be20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff84800cce0 tx=0x7ff84800a620 comp rx=0 tx=0).stop 2024-09-21T03:41:54.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.269+0000 7ff85492b640 1 -- 172.21.15.84:0/1432154505 shutdown_connections 2024-09-21T03:41:54.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.269+0000 7ff85492b640 1 --2- 172.21.15.84:0/1432154505 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff8380b6610 0x7ff8380b8b20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:54.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.269+0000 7ff85492b640 1 --2- 172.21.15.84:0/1432154505 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff850105b90 0x7ff85019be20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:54.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.269+0000 7ff85492b640 1 --2- 172.21.15.84:0/1432154505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff850105240 0x7ff85019b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:54.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.269+0000 7ff85492b640 1 --2- 172.21.15.84:0/1432154505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff850103270 0x7ff85019b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:54.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.269+0000 7ff85492b640 1 -- 172.21.15.84:0/1432154505 >> 172.21.15.84:0/1432154505 conn(0x7ff850079ec0 msgr2=0x7ff850106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:54.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.269+0000 7ff85492b640 1 -- 172.21.15.84:0/1432154505 shutdown_connections 2024-09-21T03:41:54.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:54.269+0000 7ff85492b640 1 -- 172.21.15.84:0/1432154505 wait complete. 2024-09-21T03:41:54.989 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T03:41:55.238 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:55.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:55 smithi172 ceph-mon[34821]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:55.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:55 smithi172 ceph-mon[34821]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:41:55.691 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:55 smithi084 ceph-mon[30941]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:55.691 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:55 smithi084 ceph-mon[30941]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:41:55.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.779+0000 7f1606689640 1 -- 172.21.15.84:0/4213212175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1600108cf0 msgr2=0x7f160010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:55.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.779+0000 7f1606689640 1 --2- 172.21.15.84:0/4213212175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1600108cf0 0x7f160010f520 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009ca0 tx=0x7f15f802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:41:55.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.779+0000 7f1606689640 1 -- 172.21.15.84:0/4213212175 shutdown_connections 2024-09-21T03:41:55.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.779+0000 7f1606689640 1 --2- 172.21.15.84:0/4213212175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1600108cf0 0x7f160010f520 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:55.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.779+0000 7f1606689640 1 --2- 172.21.15.84:0/4213212175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f16001083a0 0x7f16001087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:55.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.779+0000 7f1606689640 1 --2- 172.21.15.84:0/4213212175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1600102a60 0x7f1600102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:55.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.779+0000 7f1606689640 1 -- 172.21.15.84:0/4213212175 >> 172.21.15.84:0/4213212175 conn(0x7f1600079730 msgr2=0x7f1600079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:55.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.779+0000 7f1606689640 1 -- 172.21.15.84:0/4213212175 shutdown_connections 2024-09-21T03:41:55.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.779+0000 7f1606689640 1 -- 172.21.15.84:0/4213212175 wait complete. 2024-09-21T03:41:55.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.780+0000 7f1606689640 1 Processor -- start 2024-09-21T03:41:55.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.780+0000 7f1606689640 1 -- start start 2024-09-21T03:41:55.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.780+0000 7f1606689640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1600102a60 0x7f160019b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:55.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.780+0000 7f1606689640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16001083a0 0x7f160019b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:55.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.780+0000 7f1606689640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1600108cf0 0x7f160019bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:55.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.780+0000 7f1606689640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1600112960 con 0x7f1600108cf0 2024-09-21T03:41:55.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.780+0000 7f1606689640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f16001127e0 con 0x7f16001083a0 2024-09-21T03:41:55.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.780+0000 7f1606689640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1600112ae0 con 0x7f1600102a60 2024-09-21T03:41:55.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.780+0000 7f1604c26640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1600108cf0 0x7f160019bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:55.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.780+0000 7f1604c26640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1600108cf0 0x7f160019bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46886/0 (socket says 172.21.15.84:46886) 2024-09-21T03:41:55.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.780+0000 7f1604c26640 1 -- 172.21.15.84:0/3506479781 learned_addr learned my addr 172.21.15.84:0/3506479781 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:55.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.781+0000 7f15fffff640 1 --2- 172.21.15.84:0/3506479781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1600102a60 0x7f160019b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:55.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.781+0000 7f15ff7fe640 1 --2- 172.21.15.84:0/3506479781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16001083a0 0x7f160019b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:55.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.781+0000 7f1604c26640 1 -- 172.21.15.84:0/3506479781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1600102a60 msgr2=0x7f160019b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:55.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.781+0000 7f1604c26640 1 --2- 172.21.15.84:0/3506479781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1600102a60 0x7f160019b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:55.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.781+0000 7f1604c26640 1 -- 172.21.15.84:0/3506479781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16001083a0 msgr2=0x7f160019b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:55.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.781+0000 7f1604c26640 1 --2- 172.21.15.84:0/3506479781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16001083a0 0x7f160019b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:55.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.781+0000 7f1604c26640 1 -- 172.21.15.84:0/3506479781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16001a6500 con 0x7f1600108cf0 2024-09-21T03:41:55.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.781+0000 7f15ff7fe640 1 --2- 172.21.15.84:0/3506479781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16001083a0 0x7f160019b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:55.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.781+0000 7f1604c26640 1 --2- 172.21.15.84:0/3506479781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1600108cf0 0x7f160019bcf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f15f8005cc0 tx=0x7f15f802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:55.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.781+0000 7f15fd7fa640 1 -- 172.21.15.84:0/3506479781 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f8003bf0 con 0x7f1600108cf0 2024-09-21T03:41:55.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.781+0000 7f1606689640 1 -- 172.21.15.84:0/3506479781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16001a6790 con 0x7f1600108cf0 2024-09-21T03:41:55.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.781+0000 7f15fd7fa640 1 -- 172.21.15.84:0/3506479781 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15f8003d90 con 0x7f1600108cf0 2024-09-21T03:41:55.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.781+0000 7f15fd7fa640 1 -- 172.21.15.84:0/3506479781 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f802fbc0 con 0x7f1600108cf0 2024-09-21T03:41:55.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.781+0000 7f1606689640 1 -- 172.21.15.84:0/3506479781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16001a6d20 con 0x7f1600108cf0 2024-09-21T03:41:55.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.782+0000 7f1606689640 1 -- 172.21.15.84:0/3506479781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1600102e70 con 0x7f1600108cf0 2024-09-21T03:41:55.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.784+0000 7f15fd7fa640 1 -- 172.21.15.84:0/3506479781 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f15f802fd60 con 0x7f1600108cf0 2024-09-21T03:41:55.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.784+0000 7f15fd7fa640 1 --2- 172.21.15.84:0/3506479781 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f15e80b6590 0x7f15e80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:55.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.785+0000 7f15fffff640 1 --2- 172.21.15.84:0/3506479781 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f15e80b6590 0x7f15e80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:55.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.785+0000 7f15fd7fa640 1 -- 172.21.15.84:0/3506479781 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f15f81088a0 con 0x7f1600108cf0 2024-09-21T03:41:55.797 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.785+0000 7f15fffff640 1 --2- 172.21.15.84:0/3506479781 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f15e80b6590 0x7f15e80b8aa0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f15f00058c0 tx=0x7f15f000a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:55.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.788+0000 7f15fd7fa640 1 -- 172.21.15.84:0/3506479781 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f15f80cf090 con 0x7f1600108cf0 2024-09-21T03:41:55.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:55 smithi174 ceph-mon[34403]: from='client.15276 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:55.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:55 smithi174 ceph-mon[34403]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:41:55.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.979+0000 7f1606689640 1 -- 172.21.15.84:0/3506479781 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1600063800 con 0x7f15e80b6590 2024-09-21T03:41:55.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.991+0000 7f15fd7fa640 1 -- 172.21.15.84:0/3506479781 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f1600063800 con 0x7f15e80b6590 2024-09-21T03:41:55.993 INFO:teuthology.orchestra.run.smithi084.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T03:41:55.993 INFO:teuthology.orchestra.run.smithi084.stdout:mds.a smithi084 running (99s) 18s ago 98s 82.3M - 19.3.0-5120-g18432218 ddce307e1f32 4f26f85aa857 2024-09-21T03:41:55.993 INFO:teuthology.orchestra.run.smithi084.stdout:mds.b smithi172 running (96s) 29s ago 96s 96.2M - 19.3.0-5120-g18432218 ddce307e1f32 da1787d847c2 2024-09-21T03:41:55.994 INFO:teuthology.orchestra.run.smithi084.stdout:mds.c smithi174 running (110s) 29s ago 110s 84.7M - 19.3.0-5120-g18432218 ddce307e1f32 35e798ffbeb4 2024-09-21T03:41:55.994 INFO:teuthology.orchestra.run.smithi084.stdout:mds.d smithi084 running (118s) 18s ago 118s 82.0M - 19.3.0-5120-g18432218 ddce307e1f32 92de886e57ec 2024-09-21T03:41:55.994 INFO:teuthology.orchestra.run.smithi084.stdout:mds.e smithi172 running (115s) 29s ago 115s 88.2M - 19.3.0-5120-g18432218 ddce307e1f32 7e79712f0bce 2024-09-21T03:41:55.994 INFO:teuthology.orchestra.run.smithi084.stdout:mds.f smithi174 running (113s) 29s ago 112s 84.7M - 19.3.0-5120-g18432218 ddce307e1f32 5dac4b014c19 2024-09-21T03:41:55.994 INFO:teuthology.orchestra.run.smithi084.stdout:mds.g smithi084 running (102s) 18s ago 102s 82.1M - 19.3.0-5120-g18432218 ddce307e1f32 4583dc2e82bd 2024-09-21T03:41:55.994 INFO:teuthology.orchestra.run.smithi084.stdout:mds.h smithi172 running (108s) 29s ago 107s 86.3M - 19.3.0-5120-g18432218 ddce307e1f32 8508fbba1072 2024-09-21T03:41:55.994 INFO:teuthology.orchestra.run.smithi084.stdout:mds.i smithi174 running (105s) 29s ago 104s 85.1M - 19.3.0-5120-g18432218 ddce307e1f32 ca5ebcfead0d 2024-09-21T03:41:55.994 INFO:teuthology.orchestra.run.smithi084.stdout:mds.j smithi084 running (2m) 18s ago 2m 82.1M - 19.3.0-5120-g18432218 ddce307e1f32 933e7baa77b2 2024-09-21T03:41:55.994 INFO:teuthology.orchestra.run.smithi084.stdout:mds.k smithi172 running (2m) 29s ago 2m 82.2M - 19.3.0-5120-g18432218 ddce307e1f32 819ba9e6e934 2024-09-21T03:41:55.994 INFO:teuthology.orchestra.run.smithi084.stdout:mds.l smithi174 running (2m) 29s ago 2m 83.3M - 19.3.0-5120-g18432218 ddce307e1f32 dc699578d1c8 2024-09-21T03:41:55.994 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.x smithi084 *:9283,8765 running (9m) 18s ago 9m 586M - 19.3.0-5120-g18432218 ddce307e1f32 705c1c35a60d 2024-09-21T03:41:55.994 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.y smithi172 *:8443,8765 running (7m) 29s ago 7m 525M - 19.3.0-5120-g18432218 ddce307e1f32 67575135f970 2024-09-21T03:41:55.994 INFO:teuthology.orchestra.run.smithi084.stdout:mgr.z smithi174 *:8443,8765 running (7m) 29s ago 7m 525M - 19.3.0-5120-g18432218 ddce307e1f32 213a207115e6 2024-09-21T03:41:55.994 INFO:teuthology.orchestra.run.smithi084.stdout:mon.a smithi084 running (9m) 18s ago 10m 119M 2048M 19.3.0-5120-g18432218 ddce307e1f32 6bb4acbb08a5 2024-09-21T03:41:55.995 INFO:teuthology.orchestra.run.smithi084.stdout:mon.b smithi172 running (8m) 29s ago 8m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 c615e4b57be2 2024-09-21T03:41:55.995 INFO:teuthology.orchestra.run.smithi084.stdout:mon.c smithi174 running (8m) 29s ago 8m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 f32840962726 2024-09-21T03:41:55.995 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 smithi084 running (7m) 18s ago 7m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 78d804c802e4 2024-09-21T03:41:55.995 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 smithi172 running (6m) 29s ago 6m 112M 4272M 19.3.0-5120-g18432218 ddce307e1f32 a6a834f29c70 2024-09-21T03:41:55.995 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 smithi174 running (6m) 29s ago 6m 125M 4272M 19.3.0-5120-g18432218 ddce307e1f32 5e5685e3d67e 2024-09-21T03:41:55.995 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 smithi084 running (5m) 18s ago 5m 121M 4272M 19.3.0-5120-g18432218 ddce307e1f32 e131548f30dc 2024-09-21T03:41:55.995 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 smithi172 running (5m) 29s ago 5m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 b1fb096e4497 2024-09-21T03:41:55.995 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 smithi174 running (4m) 29s ago 4m 126M 4272M 19.3.0-5120-g18432218 ddce307e1f32 5afbfc1801ff 2024-09-21T03:41:55.995 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 smithi084 running (4m) 18s ago 4m 109M 4272M 19.3.0-5120-g18432218 ddce307e1f32 e08850af22fa 2024-09-21T03:41:55.995 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 smithi172 running (4m) 29s ago 4m 120M 4272M 19.3.0-5120-g18432218 ddce307e1f32 266283fb1f82 2024-09-21T03:41:55.995 INFO:teuthology.orchestra.run.smithi084.stdout:osd.8 smithi174 running (3m) 29s ago 3m 120M 4272M 19.3.0-5120-g18432218 ddce307e1f32 6b4faf0fa399 2024-09-21T03:41:55.995 INFO:teuthology.orchestra.run.smithi084.stdout:osd.9 smithi084 running (3m) 18s ago 3m 118M 4272M 19.3.0-5120-g18432218 ddce307e1f32 ed595362d6fc 2024-09-21T03:41:55.995 INFO:teuthology.orchestra.run.smithi084.stdout:osd.10 smithi172 running (2m) 29s ago 2m 119M 4272M 19.3.0-5120-g18432218 ddce307e1f32 2c9b809ad3ce 2024-09-21T03:41:55.995 INFO:teuthology.orchestra.run.smithi084.stdout:osd.11 smithi174 running (2m) 29s ago 2m 117M 4272M 19.3.0-5120-g18432218 ddce307e1f32 13bc406ba9e3 2024-09-21T03:41:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.994+0000 7f1606689640 1 -- 172.21.15.84:0/3506479781 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f15e80b6590 msgr2=0x7f15e80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.994+0000 7f1606689640 1 --2- 172.21.15.84:0/3506479781 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f15e80b6590 0x7f15e80b8aa0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f15f00058c0 tx=0x7f15f000a2d0 comp rx=0 tx=0).stop 2024-09-21T03:41:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.994+0000 7f1606689640 1 -- 172.21.15.84:0/3506479781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1600108cf0 msgr2=0x7f160019bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.994+0000 7f1606689640 1 --2- 172.21.15.84:0/3506479781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1600108cf0 0x7f160019bcf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f15f8005cc0 tx=0x7f15f802f380 comp rx=0 tx=0).stop 2024-09-21T03:41:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.994+0000 7f1606689640 1 -- 172.21.15.84:0/3506479781 shutdown_connections 2024-09-21T03:41:55.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.994+0000 7f1606689640 1 --2- 172.21.15.84:0/3506479781 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f15e80b6590 0x7f15e80b8aa0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.994+0000 7f1606689640 1 --2- 172.21.15.84:0/3506479781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1600108cf0 0x7f160019bcf0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.994+0000 7f1606689640 1 --2- 172.21.15.84:0/3506479781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16001083a0 0x7f160019b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.994+0000 7f1606689640 1 --2- 172.21.15.84:0/3506479781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1600102a60 0x7f160019b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.994+0000 7f1606689640 1 -- 172.21.15.84:0/3506479781 >> 172.21.15.84:0/3506479781 conn(0x7f1600079730 msgr2=0x7f16001043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.994+0000 7f1606689640 1 -- 172.21.15.84:0/3506479781 shutdown_connections 2024-09-21T03:41:55.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:55.994+0000 7f1606689640 1 -- 172.21.15.84:0/3506479781 wait complete. 2024-09-21T03:41:56.776 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T03:41:57.019 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.525+0000 7f2c6688d640 1 -- 172.21.15.84:0/4034351663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c60108d00 msgr2=0x7f2c6010f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.525+0000 7f2c6688d640 1 --2- 172.21.15.84:0/4034351663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c60108d00 0x7f2c6010f530 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2c58009ca0 tx=0x7f2c5802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:41:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.525+0000 7f2c6688d640 1 -- 172.21.15.84:0/4034351663 shutdown_connections 2024-09-21T03:41:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.525+0000 7f2c6688d640 1 --2- 172.21.15.84:0/4034351663 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c60108d00 0x7f2c6010f530 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.525+0000 7f2c6688d640 1 --2- 172.21.15.84:0/4034351663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c601083b0 0x7f2c601087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.525+0000 7f2c6688d640 1 --2- 172.21.15.84:0/4034351663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c60102a70 0x7f2c60102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.525+0000 7f2c6688d640 1 -- 172.21.15.84:0/4034351663 >> 172.21.15.84:0/4034351663 conn(0x7f2c60079710 msgr2=0x7f2c60079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.525+0000 7f2c6688d640 1 -- 172.21.15.84:0/4034351663 shutdown_connections 2024-09-21T03:41:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.525+0000 7f2c6688d640 1 -- 172.21.15.84:0/4034351663 wait complete. 2024-09-21T03:41:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.525+0000 7f2c6688d640 1 Processor -- start 2024-09-21T03:41:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.525+0000 7f2c6688d640 1 -- start start 2024-09-21T03:41:57.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.526+0000 7f2c6688d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c60102a70 0x7f2c60199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:57.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.526+0000 7f2c6688d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c601083b0 0x7f2c601998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:57.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.526+0000 7f2c6688d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c60108d00 0x7f2c6019eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:57.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.526+0000 7f2c6688d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2c601129c0 con 0x7f2c60108d00 2024-09-21T03:41:57.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.526+0000 7f2c6688d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2c60112840 con 0x7f2c601083b0 2024-09-21T03:41:57.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.526+0000 7f2c6688d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2c60112b40 con 0x7f2c60102a70 2024-09-21T03:41:57.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.526+0000 7f2c64e2a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c60108d00 0x7f2c6019eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:57.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.526+0000 7f2c64e2a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c60108d00 0x7f2c6019eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46912/0 (socket says 172.21.15.84:46912) 2024-09-21T03:41:57.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.526+0000 7f2c64e2a640 1 -- 172.21.15.84:0/3989003637 learned_addr learned my addr 172.21.15.84:0/3989003637 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:57.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.526+0000 7f2c5ffff640 1 --2- 172.21.15.84:0/3989003637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c60102a70 0x7f2c60199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:57.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.526+0000 7f2c5f7fe640 1 --2- 172.21.15.84:0/3989003637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c601083b0 0x7f2c601998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:57.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.526+0000 7f2c64e2a640 1 -- 172.21.15.84:0/3989003637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c60102a70 msgr2=0x7f2c60199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:57.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.526+0000 7f2c64e2a640 1 --2- 172.21.15.84:0/3989003637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c60102a70 0x7f2c60199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:57.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.526+0000 7f2c64e2a640 1 -- 172.21.15.84:0/3989003637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c601083b0 msgr2=0x7f2c601998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:57.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.526+0000 7f2c64e2a640 1 --2- 172.21.15.84:0/3989003637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c601083b0 0x7f2c601998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:57.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.526+0000 7f2c64e2a640 1 -- 172.21.15.84:0/3989003637 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6019f200 con 0x7f2c60108d00 2024-09-21T03:41:57.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.526+0000 7f2c5ffff640 1 --2- 172.21.15.84:0/3989003637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c60102a70 0x7f2c60199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:57.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.527+0000 7f2c64e2a640 1 --2- 172.21.15.84:0/3989003637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c60108d00 0x7f2c6019eb90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2c58005cc0 tx=0x7f2c5802f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:57.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.527+0000 7f2c5d7fa640 1 -- 172.21.15.84:0/3989003637 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c58003cf0 con 0x7f2c60108d00 2024-09-21T03:41:57.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.527+0000 7f2c6688d640 1 -- 172.21.15.84:0/3989003637 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c6019f490 con 0x7f2c60108d00 2024-09-21T03:41:57.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.527+0000 7f2c5d7fa640 1 -- 172.21.15.84:0/3989003637 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c580044f0 con 0x7f2c60108d00 2024-09-21T03:41:57.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.527+0000 7f2c5d7fa640 1 -- 172.21.15.84:0/3989003637 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5802fd10 con 0x7f2c60108d00 2024-09-21T03:41:57.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.527+0000 7f2c6688d640 1 -- 172.21.15.84:0/3989003637 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c601a5d10 con 0x7f2c60108d00 2024-09-21T03:41:57.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.528+0000 7f2c6688d640 1 -- 172.21.15.84:0/3989003637 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c60103cf0 con 0x7f2c60108d00 2024-09-21T03:41:57.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.529+0000 7f2c5d7fa640 1 -- 172.21.15.84:0/3989003637 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f2c58004040 con 0x7f2c60108d00 2024-09-21T03:41:57.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.530+0000 7f2c5d7fa640 1 --2- 172.21.15.84:0/3989003637 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2c480b6590 0x7f2c480b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:57.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.530+0000 7f2c5ffff640 1 --2- 172.21.15.84:0/3989003637 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2c480b6590 0x7f2c480b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:57.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.530+0000 7f2c5d7fa640 1 -- 172.21.15.84:0/3989003637 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f2c58108af0 con 0x7f2c60108d00 2024-09-21T03:41:57.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.530+0000 7f2c5ffff640 1 --2- 172.21.15.84:0/3989003637 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2c480b6590 0x7f2c480b8aa0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2c5000abe0 tx=0x7f2c5000a5c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:57.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.533+0000 7f2c5d7fa640 1 -- 172.21.15.84:0/3989003637 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2c580cf2e0 con 0x7f2c60108d00 2024-09-21T03:41:57.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.720+0000 7f2c6688d640 1 -- 172.21.15.84:0/3989003637 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f2c6010ab20 con 0x7f2c480b6590 2024-09-21T03:41:57.723 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:57 smithi084 ceph-mon[30941]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:57.723 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:57 smithi084 ceph-mon[30941]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-21T03:41:57.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.727+0000 7f2c5d7fa640 1 -- 172.21.15.84:0/3989003637 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f2c6010ab20 con 0x7f2c480b6590 2024-09-21T03:41:57.729 INFO:teuthology.orchestra.run.smithi084.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T03:41:57.729 INFO:teuthology.orchestra.run.smithi084.stdout:mds.all 12/12 31s ago 2m smithi084=a;smithi084=d;smithi084=g;smithi084=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi174=c;smithi174=f;smithi174=i;smithi174=l;count:12 2024-09-21T03:41:57.729 INFO:teuthology.orchestra.run.smithi084.stdout:mgr 3/3 31s ago 8m smithi084=x;smithi172=y;smithi174=z;count:3 2024-09-21T03:41:57.729 INFO:teuthology.orchestra.run.smithi084.stdout:mon 3/3 31s ago 8m smithi084:172.21.15.84=a;smithi172:172.21.15.172=b;smithi174:172.21.15.174=c;count:3 2024-09-21T03:41:57.729 INFO:teuthology.orchestra.run.smithi084.stdout:osd 12 31s ago - 2024-09-21T03:41:57.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.729+0000 7f2c6688d640 1 -- 172.21.15.84:0/3989003637 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2c480b6590 msgr2=0x7f2c480b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:57.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.729+0000 7f2c6688d640 1 --2- 172.21.15.84:0/3989003637 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2c480b6590 0x7f2c480b8aa0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2c5000abe0 tx=0x7f2c5000a5c0 comp rx=0 tx=0).stop 2024-09-21T03:41:57.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.729+0000 7f2c6688d640 1 -- 172.21.15.84:0/3989003637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c60108d00 msgr2=0x7f2c6019eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:57.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.729+0000 7f2c6688d640 1 --2- 172.21.15.84:0/3989003637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c60108d00 0x7f2c6019eb90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2c58005cc0 tx=0x7f2c5802f470 comp rx=0 tx=0).stop 2024-09-21T03:41:57.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.729+0000 7f2c6688d640 1 -- 172.21.15.84:0/3989003637 shutdown_connections 2024-09-21T03:41:57.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.729+0000 7f2c6688d640 1 --2- 172.21.15.84:0/3989003637 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2c480b6590 0x7f2c480b8aa0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:57.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.729+0000 7f2c6688d640 1 --2- 172.21.15.84:0/3989003637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2c60108d00 0x7f2c6019eb90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:57.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.729+0000 7f2c6688d640 1 --2- 172.21.15.84:0/3989003637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c601083b0 0x7f2c601998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:57.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.729+0000 7f2c6688d640 1 --2- 172.21.15.84:0/3989003637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2c60102a70 0x7f2c60199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:57.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.730+0000 7f2c6688d640 1 -- 172.21.15.84:0/3989003637 >> 172.21.15.84:0/3989003637 conn(0x7f2c60079710 msgr2=0x7f2c60106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:57.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.730+0000 7f2c6688d640 1 -- 172.21.15.84:0/3989003637 shutdown_connections 2024-09-21T03:41:57.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:57.730+0000 7f2c6688d640 1 -- 172.21.15.84:0/3989003637 wait complete. 2024-09-21T03:41:57.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:57 smithi174 ceph-mon[34403]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:57.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:57 smithi174 ceph-mon[34403]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-21T03:41:57.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:57 smithi172 ceph-mon[34821]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:57.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:57 smithi172 ceph-mon[34821]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-21T03:41:58.477 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T03:41:58.719 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:59.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.224+0000 7fd924c0c640 1 -- 172.21.15.84:0/520677425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd920102ae0 msgr2=0x7fd920102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:59.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.224+0000 7fd924c0c640 1 --2- 172.21.15.84:0/520677425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd920102ae0 0x7fd920102ef0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd910009ca0 tx=0x7fd91002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:41:59.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.224+0000 7fd924c0c640 1 -- 172.21.15.84:0/520677425 shutdown_connections 2024-09-21T03:41:59.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.224+0000 7fd924c0c640 1 --2- 172.21.15.84:0/520677425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd920108d70 0x7fd92010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:59.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.224+0000 7fd924c0c640 1 --2- 172.21.15.84:0/520677425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd920108420 0x7fd920108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:59.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.224+0000 7fd924c0c640 1 --2- 172.21.15.84:0/520677425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd920102ae0 0x7fd920102ef0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:59.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.224+0000 7fd924c0c640 1 -- 172.21.15.84:0/520677425 >> 172.21.15.84:0/520677425 conn(0x7fd920079770 msgr2=0x7fd920079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:59.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.224+0000 7fd924c0c640 1 -- 172.21.15.84:0/520677425 shutdown_connections 2024-09-21T03:41:59.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.224+0000 7fd924c0c640 1 -- 172.21.15.84:0/520677425 wait complete. 2024-09-21T03:41:59.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.225+0000 7fd924c0c640 1 Processor -- start 2024-09-21T03:41:59.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.225+0000 7fd924c0c640 1 -- start start 2024-09-21T03:41:59.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.225+0000 7fd924c0c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd920102ae0 0x7fd9201994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:59.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.225+0000 7fd924c0c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd920108420 0x7fd920199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:59.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.225+0000 7fd924c0c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd920108d70 0x7fd92019ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:59.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.225+0000 7fd924c0c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd920112a30 con 0x7fd920108420 2024-09-21T03:41:59.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.225+0000 7fd924c0c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd9201128b0 con 0x7fd920102ae0 2024-09-21T03:41:59.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.225+0000 7fd924c0c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd920112bb0 con 0x7fd920108d70 2024-09-21T03:41:59.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.225+0000 7fd91dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd920108420 0x7fd920199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:59.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.225+0000 7fd91dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd920108420 0x7fd920199a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59670/0 (socket says 172.21.15.84:59670) 2024-09-21T03:41:59.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.225+0000 7fd91dd9b640 1 -- 172.21.15.84:0/4076634231 learned_addr learned my addr 172.21.15.84:0/4076634231 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:41:59.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.225+0000 7fd91e59c640 1 --2- 172.21.15.84:0/4076634231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd920102ae0 0x7fd9201994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.226+0000 7fd91ed9d640 1 --2- 172.21.15.84:0/4076634231 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd920108d70 0x7fd92019ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.226+0000 7fd91dd9b640 1 -- 172.21.15.84:0/4076634231 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd920108d70 msgr2=0x7fd92019ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.226+0000 7fd91dd9b640 1 --2- 172.21.15.84:0/4076634231 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd920108d70 0x7fd92019ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.226+0000 7fd91dd9b640 1 -- 172.21.15.84:0/4076634231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd920102ae0 msgr2=0x7fd9201994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.226+0000 7fd91dd9b640 1 --2- 172.21.15.84:0/4076634231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd920102ae0 0x7fd9201994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.226+0000 7fd91dd9b640 1 -- 172.21.15.84:0/4076634231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92019f450 con 0x7fd920108420 2024-09-21T03:41:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.226+0000 7fd91ed9d640 1 --2- 172.21.15.84:0/4076634231 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd920108d70 0x7fd92019ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.226+0000 7fd91dd9b640 1 --2- 172.21.15.84:0/4076634231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd920108420 0x7fd920199a80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd91400d950 tx=0x7fd91400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.226+0000 7fd90f7fe640 1 -- 172.21.15.84:0/4076634231 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd914017070 con 0x7fd920108420 2024-09-21T03:41:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.226+0000 7fd924c0c640 1 -- 172.21.15.84:0/4076634231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd92019f740 con 0x7fd920108420 2024-09-21T03:41:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.226+0000 7fd90f7fe640 1 -- 172.21.15.84:0/4076634231 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd914009c30 con 0x7fd920108420 2024-09-21T03:41:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.226+0000 7fd90f7fe640 1 -- 172.21.15.84:0/4076634231 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9140047a0 con 0x7fd920108420 2024-09-21T03:41:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.226+0000 7fd924c0c640 1 -- 172.21.15.84:0/4076634231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9201a5ea0 con 0x7fd920108420 2024-09-21T03:41:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.227+0000 7fd924c0c640 1 -- 172.21.15.84:0/4076634231 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd920103d60 con 0x7fd920108420 2024-09-21T03:41:59.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.229+0000 7fd90f7fe640 1 -- 172.21.15.84:0/4076634231 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fd914004020 con 0x7fd920108420 2024-09-21T03:41:59.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.229+0000 7fd90f7fe640 1 --2- 172.21.15.84:0/4076634231 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd9080b6560 0x7fd9080b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:59.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.229+0000 7fd91e59c640 1 --2- 172.21.15.84:0/4076634231 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd9080b6560 0x7fd9080b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:59.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.229+0000 7fd90f7fe640 1 -- 172.21.15.84:0/4076634231 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fd9140e74b0 con 0x7fd920108420 2024-09-21T03:41:59.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.230+0000 7fd91e59c640 1 --2- 172.21.15.84:0/4076634231 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd9080b6560 0x7fd9080b8a70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd910005e30 tx=0x7fd910009360 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:59.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.232+0000 7fd90f7fe640 1 -- 172.21.15.84:0/4076634231 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd914020020 con 0x7fd920108420 2024-09-21T03:41:59.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.418+0000 7fd924c0c640 1 -- 172.21.15.84:0/4076634231 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fd92010ab70 con 0x7fd9080b6560 2024-09-21T03:41:59.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.419+0000 7fd90f7fe640 1 -- 172.21.15.84:0/4076634231 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fd92010ab70 con 0x7fd9080b6560 2024-09-21T03:41:59.421 INFO:teuthology.orchestra.run.smithi084.stdout:HOST ADDR LABELS STATUS 2024-09-21T03:41:59.421 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084 172.21.15.84 2024-09-21T03:41:59.421 INFO:teuthology.orchestra.run.smithi084.stdout:smithi172 172.21.15.172 2024-09-21T03:41:59.421 INFO:teuthology.orchestra.run.smithi084.stdout:smithi174 172.21.15.174 2024-09-21T03:41:59.421 INFO:teuthology.orchestra.run.smithi084.stdout:3 hosts in cluster 2024-09-21T03:41:59.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.421+0000 7fd924c0c640 1 -- 172.21.15.84:0/4076634231 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd9080b6560 msgr2=0x7fd9080b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:59.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.421+0000 7fd924c0c640 1 --2- 172.21.15.84:0/4076634231 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd9080b6560 0x7fd9080b8a70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd910005e30 tx=0x7fd910009360 comp rx=0 tx=0).stop 2024-09-21T03:41:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.421+0000 7fd924c0c640 1 -- 172.21.15.84:0/4076634231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd920108420 msgr2=0x7fd920199a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.421+0000 7fd924c0c640 1 --2- 172.21.15.84:0/4076634231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd920108420 0x7fd920199a80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd91400d950 tx=0x7fd91400de10 comp rx=0 tx=0).stop 2024-09-21T03:41:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.421+0000 7fd924c0c640 1 -- 172.21.15.84:0/4076634231 shutdown_connections 2024-09-21T03:41:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.421+0000 7fd924c0c640 1 --2- 172.21.15.84:0/4076634231 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd9080b6560 0x7fd9080b8a70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.421+0000 7fd924c0c640 1 --2- 172.21.15.84:0/4076634231 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd920108d70 0x7fd92019ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.421+0000 7fd924c0c640 1 --2- 172.21.15.84:0/4076634231 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd920108420 0x7fd920199a80 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.421+0000 7fd924c0c640 1 --2- 172.21.15.84:0/4076634231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd920102ae0 0x7fd9201994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.421+0000 7fd924c0c640 1 -- 172.21.15.84:0/4076634231 >> 172.21.15.84:0/4076634231 conn(0x7fd920079770 msgr2=0x7fd920106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.422+0000 7fd924c0c640 1 -- 172.21.15.84:0/4076634231 shutdown_connections 2024-09-21T03:41:59.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:41:59.422+0000 7fd924c0c640 1 -- 172.21.15.84:0/4076634231 wait complete. 2024-09-21T03:41:59.814 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:59 smithi084 ceph-mon[30941]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:59.814 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:41:59 smithi084 ceph-mon[30941]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:41:59.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:59 smithi174 ceph-mon[34403]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:59.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:41:59 smithi174 ceph-mon[34403]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:41:59.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:59 smithi172 ceph-mon[34821]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:41:59.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:41:59 smithi172 ceph-mon[34821]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:42:00.172 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T03:42:00.424 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.964+0000 7f8e3e7df640 1 -- 172.21.15.84:0/1779038045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e381083a0 msgr2=0x7f8e381087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.964+0000 7f8e3e7df640 1 --2- 172.21.15.84:0/1779038045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e381083a0 0x7f8e381087b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8e20009900 tx=0x7f8e2002a410 comp rx=0 tx=0).stop 2024-09-21T03:42:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.964+0000 7f8e3e7df640 1 -- 172.21.15.84:0/1779038045 shutdown_connections 2024-09-21T03:42:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.964+0000 7f8e3e7df640 1 --2- 172.21.15.84:0/1779038045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e38108cf0 0x7f8e3810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.964+0000 7f8e3e7df640 1 --2- 172.21.15.84:0/1779038045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e381083a0 0x7f8e381087b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:00.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.964+0000 7f8e3e7df640 1 --2- 172.21.15.84:0/1779038045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e38102a60 0x7f8e38102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:00.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.964+0000 7f8e3e7df640 1 -- 172.21.15.84:0/1779038045 >> 172.21.15.84:0/1779038045 conn(0x7f8e38079730 msgr2=0x7f8e38079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:00.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.965+0000 7f8e3e7df640 1 -- 172.21.15.84:0/1779038045 shutdown_connections 2024-09-21T03:42:00.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.965+0000 7f8e3e7df640 1 -- 172.21.15.84:0/1779038045 wait complete. 2024-09-21T03:42:00.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.965+0000 7f8e3e7df640 1 Processor -- start 2024-09-21T03:42:00.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.965+0000 7f8e3e7df640 1 -- start start 2024-09-21T03:42:00.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.965+0000 7f8e3e7df640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e38102a60 0x7f8e3819b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:00.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.965+0000 7f8e3e7df640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e381083a0 0x7f8e3819b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:00.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.965+0000 7f8e3e7df640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e38108cf0 0x7f8e3819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:00.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.966+0000 7f8e3e7df640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8e381129c0 con 0x7f8e38108cf0 2024-09-21T03:42:00.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.966+0000 7f8e3e7df640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e38112840 con 0x7f8e381083a0 2024-09-21T03:42:00.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.966+0000 7f8e3e7df640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8e38112b40 con 0x7f8e38102a60 2024-09-21T03:42:00.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.966+0000 7f8e3cd7c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e38108cf0 0x7f8e3819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:00.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.966+0000 7f8e3cd7c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e38108cf0 0x7f8e3819bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59688/0 (socket says 172.21.15.84:59688) 2024-09-21T03:42:00.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.966+0000 7f8e3cd7c640 1 -- 172.21.15.84:0/4032520059 learned_addr learned my addr 172.21.15.84:0/4032520059 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:00.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.966+0000 7f8e37fff640 1 --2- 172.21.15.84:0/4032520059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e38102a60 0x7f8e3819b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:00.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.966+0000 7f8e2ffff640 1 --2- 172.21.15.84:0/4032520059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e381083a0 0x7f8e3819b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:00.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.966+0000 7f8e3cd7c640 1 -- 172.21.15.84:0/4032520059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e38102a60 msgr2=0x7f8e3819b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:00.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.966+0000 7f8e3cd7c640 1 --2- 172.21.15.84:0/4032520059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e38102a60 0x7f8e3819b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:00.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.966+0000 7f8e3cd7c640 1 -- 172.21.15.84:0/4032520059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e381083a0 msgr2=0x7f8e3819b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:00.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.966+0000 7f8e3cd7c640 1 --2- 172.21.15.84:0/4032520059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e381083a0 0x7f8e3819b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:00.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.966+0000 7f8e3cd7c640 1 -- 172.21.15.84:0/4032520059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e381a65a0 con 0x7f8e38108cf0 2024-09-21T03:42:00.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.966+0000 7f8e3cd7c640 1 --2- 172.21.15.84:0/4032520059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e38108cf0 0x7f8e3819bd90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000b970 tx=0x7f8e3000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:00.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.966+0000 7f8e35ffb640 1 -- 172.21.15.84:0/4032520059 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e30019070 con 0x7f8e38108cf0 2024-09-21T03:42:00.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.966+0000 7f8e35ffb640 1 -- 172.21.15.84:0/4032520059 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e30014440 con 0x7f8e38108cf0 2024-09-21T03:42:00.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.966+0000 7f8e3e7df640 1 -- 172.21.15.84:0/4032520059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e381a6890 con 0x7f8e38108cf0 2024-09-21T03:42:00.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.966+0000 7f8e35ffb640 1 -- 172.21.15.84:0/4032520059 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e300075d0 con 0x7f8e38108cf0 2024-09-21T03:42:00.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.966+0000 7f8e3e7df640 1 -- 172.21.15.84:0/4032520059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e381a6e20 con 0x7f8e38108cf0 2024-09-21T03:42:00.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.967+0000 7f8e3e7df640 1 -- 172.21.15.84:0/4032520059 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e38102e70 con 0x7f8e38108cf0 2024-09-21T03:42:00.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.969+0000 7f8e35ffb640 1 -- 172.21.15.84:0/4032520059 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f8e3001c070 con 0x7f8e38108cf0 2024-09-21T03:42:00.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.970+0000 7f8e35ffb640 1 --2- 172.21.15.84:0/4032520059 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8e240b6610 0x7f8e240b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:00.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.970+0000 7f8e37fff640 1 --2- 172.21.15.84:0/4032520059 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8e240b6610 0x7f8e240b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:00.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.970+0000 7f8e35ffb640 1 -- 172.21.15.84:0/4032520059 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8e300e6cd0 con 0x7f8e38108cf0 2024-09-21T03:42:00.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.970+0000 7f8e37fff640 1 --2- 172.21.15.84:0/4032520059 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8e240b6610 0x7f8e240b8b20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8e3806b9c0 tx=0x7f8e2800b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:00.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:00.973+0000 7f8e35ffb640 1 -- 172.21.15.84:0/4032520059 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8e300b18a0 con 0x7f8e38108cf0 2024-09-21T03:42:01.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:01.158+0000 7f8e3e7df640 1 -- 172.21.15.84:0/4032520059 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f8e38063800 con 0x7f8e240b6610 2024-09-21T03:42:01.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:01.161+0000 7f8e35ffb640 1 -- 172.21.15.84:0/4032520059 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f8e38063800 con 0x7f8e240b6610 2024-09-21T03:42:01.163 INFO:teuthology.orchestra.run.smithi084.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T03:42:01.163 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400WF400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T03:42:01.163 INFO:teuthology.orchestra.run.smithi084.stdout:smithi172 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233005M400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T03:42:01.163 INFO:teuthology.orchestra.run.smithi084.stdout:smithi174 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62050074400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T03:42:01.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:01.163+0000 7f8e3e7df640 1 -- 172.21.15.84:0/4032520059 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8e240b6610 msgr2=0x7f8e240b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:01.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:01.163+0000 7f8e3e7df640 1 --2- 172.21.15.84:0/4032520059 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8e240b6610 0x7f8e240b8b20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8e3806b9c0 tx=0x7f8e2800b390 comp rx=0 tx=0).stop 2024-09-21T03:42:01.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:01.163+0000 7f8e3e7df640 1 -- 172.21.15.84:0/4032520059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e38108cf0 msgr2=0x7f8e3819bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:01.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:01.163+0000 7f8e3e7df640 1 --2- 172.21.15.84:0/4032520059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e38108cf0 0x7f8e3819bd90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000b970 tx=0x7f8e3000be30 comp rx=0 tx=0).stop 2024-09-21T03:42:01.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:01.163+0000 7f8e3e7df640 1 -- 172.21.15.84:0/4032520059 shutdown_connections 2024-09-21T03:42:01.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:01.163+0000 7f8e3e7df640 1 --2- 172.21.15.84:0/4032520059 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8e240b6610 0x7f8e240b8b20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:01.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:01.163+0000 7f8e3e7df640 1 --2- 172.21.15.84:0/4032520059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e38108cf0 0x7f8e3819bd90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:01.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:01.163+0000 7f8e3e7df640 1 --2- 172.21.15.84:0/4032520059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e381083a0 0x7f8e3819b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:01.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:01.163+0000 7f8e3e7df640 1 --2- 172.21.15.84:0/4032520059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e38102a60 0x7f8e3819b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:01.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:01.163+0000 7f8e3e7df640 1 -- 172.21.15.84:0/4032520059 >> 172.21.15.84:0/4032520059 conn(0x7f8e38079730 msgr2=0x7f8e38104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:01.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:01.163+0000 7f8e3e7df640 1 -- 172.21.15.84:0/4032520059 shutdown_connections 2024-09-21T03:42:01.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:01.163+0000 7f8e3e7df640 1 -- 172.21.15.84:0/4032520059 wait complete. 2024-09-21T03:42:01.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:01 smithi084 ceph-mon[30941]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:01.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:01 smithi084 ceph-mon[30941]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:42:01.680 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:01 smithi174 ceph-mon[34403]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:01.680 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:01 smithi174 ceph-mon[34403]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:42:01.703 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:01 smithi172 ceph-mon[34821]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:01.703 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:01 smithi172 ceph-mon[34821]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:42:01.876 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T03:42:01.891 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T03:42:01.891 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T03:42:02.137 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:02.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:02 smithi084 ceph-mon[30941]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:02.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.696+0000 7f29b6eda640 1 -- 172.21.15.84:0/2833299758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29b0102a60 msgr2=0x7f29b0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:02.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.696+0000 7f29b6eda640 1 --2- 172.21.15.84:0/2833299758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29b0102a60 0x7f29b0102e70 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009900 tx=0x7f29ac02a410 comp rx=0 tx=0).stop 2024-09-21T03:42:02.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.696+0000 7f29b6eda640 1 -- 172.21.15.84:0/2833299758 shutdown_connections 2024-09-21T03:42:02.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.696+0000 7f29b6eda640 1 --2- 172.21.15.84:0/2833299758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29b0108cf0 0x7f29b010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:02.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.696+0000 7f29b6eda640 1 --2- 172.21.15.84:0/2833299758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29b01083a0 0x7f29b01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:02.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.696+0000 7f29b6eda640 1 --2- 172.21.15.84:0/2833299758 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29b0102a60 0x7f29b0102e70 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:02.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.696+0000 7f29b6eda640 1 -- 172.21.15.84:0/2833299758 >> 172.21.15.84:0/2833299758 conn(0x7f29b0079730 msgr2=0x7f29b0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:02.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.696+0000 7f29b6eda640 1 -- 172.21.15.84:0/2833299758 shutdown_connections 2024-09-21T03:42:02.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.696+0000 7f29b6eda640 1 -- 172.21.15.84:0/2833299758 wait complete. 2024-09-21T03:42:02.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.697+0000 7f29b6eda640 1 Processor -- start 2024-09-21T03:42:02.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.697+0000 7f29b6eda640 1 -- start start 2024-09-21T03:42:02.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.698+0000 7f29b6eda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29b0102a60 0x7f29b019b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:02.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.698+0000 7f29b6eda640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29b01083a0 0x7f29b019b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:02.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.698+0000 7f29b6eda640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29b0108cf0 0x7f29b019be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:02.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.698+0000 7f29b6eda640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0112a40 con 0x7f29b0102a60 2024-09-21T03:42:02.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.698+0000 7f29b6eda640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f29b01128c0 con 0x7f29b0108cf0 2024-09-21T03:42:02.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.698+0000 7f29b6eda640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0112bc0 con 0x7f29b01083a0 2024-09-21T03:42:02.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.698+0000 7f29b4c76640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29b0102a60 0x7f29b019b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:02.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.698+0000 7f29b4c76640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29b0102a60 0x7f29b019b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59700/0 (socket says 172.21.15.84:59700) 2024-09-21T03:42:02.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.698+0000 7f29b4c76640 1 -- 172.21.15.84:0/2543951746 learned_addr learned my addr 172.21.15.84:0/2543951746 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:02.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.698+0000 7f29a7fff640 1 --2- 172.21.15.84:0/2543951746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29b01083a0 0x7f29b019b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:02.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.698+0000 7f29b4c76640 1 -- 172.21.15.84:0/2543951746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29b01083a0 msgr2=0x7f29b019b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:02.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.698+0000 7f29b4c76640 1 --2- 172.21.15.84:0/2543951746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29b01083a0 0x7f29b019b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:02.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.698+0000 7f29b4c76640 1 -- 172.21.15.84:0/2543951746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29b0108cf0 msgr2=0x7f29b019be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.698+0000 7f29b5477640 1 --2- 172.21.15.84:0/2543951746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29b0108cf0 0x7f29b019be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.698+0000 7f29b4c76640 1 --2- 172.21.15.84:0/2543951746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29b0108cf0 0x7f29b019be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.698+0000 7f29b4c76640 1 -- 172.21.15.84:0/2543951746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b01a6680 con 0x7f29b0102a60 2024-09-21T03:42:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.698+0000 7f29b5477640 1 --2- 172.21.15.84:0/2543951746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29b0108cf0 0x7f29b019be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.698+0000 7f29b4c76640 1 --2- 172.21.15.84:0/2543951746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29b0102a60 0x7f29b019b3f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f29ac006010 tx=0x7f29ac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.699+0000 7f29a5ffb640 1 -- 172.21.15.84:0/2543951746 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac03f030 con 0x7f29b0102a60 2024-09-21T03:42:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.699+0000 7f29b6eda640 1 -- 172.21.15.84:0/2543951746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b01a6910 con 0x7f29b0102a60 2024-09-21T03:42:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.699+0000 7f29a5ffb640 1 -- 172.21.15.84:0/2543951746 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29ac003800 con 0x7f29b0102a60 2024-09-21T03:42:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.699+0000 7f29a5ffb640 1 -- 172.21.15.84:0/2543951746 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ac035070 con 0x7f29b0102a60 2024-09-21T03:42:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.699+0000 7f29b6eda640 1 -- 172.21.15.84:0/2543951746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b01a6e70 con 0x7f29b0102a60 2024-09-21T03:42:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.700+0000 7f29b6eda640 1 -- 172.21.15.84:0/2543951746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b0102ef0 con 0x7f29b0102a60 2024-09-21T03:42:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.701+0000 7f29a5ffb640 1 -- 172.21.15.84:0/2543951746 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f29ac003cb0 con 0x7f29b0102a60 2024-09-21T03:42:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.702+0000 7f29a5ffb640 1 --2- 172.21.15.84:0/2543951746 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29980b6590 0x7f29980b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.702+0000 7f29a7fff640 1 --2- 172.21.15.84:0/2543951746 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29980b6590 0x7f29980b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:02.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.702+0000 7f29a5ffb640 1 -- 172.21.15.84:0/2543951746 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f29ac108000 con 0x7f29b0102a60 2024-09-21T03:42:02.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.703+0000 7f29a7fff640 1 --2- 172.21.15.84:0/2543951746 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29980b6590 0x7f29980b8aa0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f29b0100b70 tx=0x7f29a0008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:02.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.705+0000 7f29a5ffb640 1 -- 172.21.15.84:0/2543951746 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f29ac0ce7f0 con 0x7f29b0102a60 2024-09-21T03:42:02.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:02 smithi174 ceph-mon[34403]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:02.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:02 smithi172 ceph-mon[34821]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:02.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.917+0000 7f29b6eda640 1 -- 172.21.15.84:0/2543951746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f29b002e640 con 0x7f29b0102a60 2024-09-21T03:42:02.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.918+0000 7f29a5ffb640 1 -- 172.21.15.84:0/2543951746 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3090 (secure 0 0 0) 0x7f29ac0d2bd0 con 0x7f29b0102a60 2024-09-21T03:42:02.920 INFO:teuthology.orchestra.run.smithi084.stdout:e24 2024-09-21T03:42:02.920 INFO:teuthology.orchestra.run.smithi084.stdout:btime 2024-09-21T03:40:41:408095+0000 2024-09-21T03:42:02.920 INFO:teuthology.orchestra.run.smithi084.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T03:42:02.920 INFO:teuthology.orchestra.run.smithi084.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T03:42:02.920 INFO:teuthology.orchestra.run.smithi084.stdout:legacy client fscid: 1 2024-09-21T03:42:02.920 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:42:02.920 INFO:teuthology.orchestra.run.smithi084.stdout:Filesystem 'cephfs' (1) 2024-09-21T03:42:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:fs_name cephfs 2024-09-21T03:42:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 24 2024-09-21T03:42:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T03:42:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-09-21T03:40:29.979744+0000 2024-09-21T03:42:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-09-21T03:40:41.132161+0000 2024-09-21T03:42:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:tableserver 0 2024-09-21T03:42:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:root 0 2024-09-21T03:42:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:session_timeout 300 2024-09-21T03:42:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:session_autoclose 300 2024-09-21T03:42:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:max_file_size 1099511627776 2024-09-21T03:42:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:max_xattr_size 65536 2024-09-21T03:42:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:required_client_features {} 2024-09-21T03:42:02.921 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure 0 2024-09-21T03:42:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:last_failure_osd_epoch 0 2024-09-21T03:42:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T03:42:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:max_mds 3 2024-09-21T03:42:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:in 0,1,2 2024-09-21T03:42:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:up {0=24668,1=24638,2=24634} 2024-09-21T03:42:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:failed 2024-09-21T03:42:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:damaged 2024-09-21T03:42:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:stopped 2024-09-21T03:42:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:data_pools [3] 2024-09-21T03:42:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:metadata_pool 2 2024-09-21T03:42:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:inline_data disabled 2024-09-21T03:42:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:balancer 2024-09-21T03:42:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:bal_rank_mask -1 2024-09-21T03:42:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:standby_count_wanted 0 2024-09-21T03:42:02.922 INFO:teuthology.orchestra.run.smithi084.stdout:qdb_cluster leader: 24668 members: 24634,24638,24668 2024-09-21T03:42:02.923 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.b{0:24668} state up:active seq 4 addr [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:42:02.923 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.e{0:24614} state up:standby-replay seq 1 addr [v2:172.21.15.172:6834/1309799170,v1:172.21.15.172:6835/1309799170] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:42:02.923 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.h{1:24638} state up:active seq 9 addr [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:42:02.923 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.c{1:24613} state up:standby-replay seq 1 addr [v2:172.21.15.174:6836/152508350,v1:172.21.15.174:6837/152508350] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:42:02.923 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.i{2:24634} state up:active seq 8 addr [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:42:02.923 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.f{2:24607} state up:standby-replay seq 1 addr [v2:172.21.15.174:6834/3726620036,v1:172.21.15.174:6835/3726620036] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:42:02.923 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:42:02.923 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:42:02.923 INFO:teuthology.orchestra.run.smithi084.stdout:Standby daemons: 2024-09-21T03:42:02.923 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:42:02.923 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.j{-1:14793} state up:standby seq 1 addr [v2:172.21.15.84:6834/416296973,v1:172.21.15.84:6835/416296973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:42:02.923 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.d{-1:14805} state up:standby seq 1 addr [v2:172.21.15.84:6836/1339085683,v1:172.21.15.84:6837/1339085683] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:42:02.923 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.g{-1:14853} state up:standby seq 1 addr [v2:172.21.15.84:6838/3243669807,v1:172.21.15.84:6839/3243669807] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:42:02.923 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.a{-1:14865} state up:standby seq 1 addr [v2:172.21.15.84:6840/4285519513,v1:172.21.15.84:6841/4285519513] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:42:02.924 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.l{-1:24580} state up:standby seq 1 addr [v2:172.21.15.174:6832/4033444564,v1:172.21.15.174:6833/4033444564] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:42:02.924 INFO:teuthology.orchestra.run.smithi084.stdout:[mds.k{-1:24581} state up:standby seq 1 addr [v2:172.21.15.172:6832/3292859704,v1:172.21.15.172:6833/3292859704] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:42:02.924 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 24 2024-09-21T03:42:02.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.921+0000 7f29b6eda640 1 -- 172.21.15.84:0/2543951746 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29980b6590 msgr2=0x7f29980b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:02.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.921+0000 7f29b6eda640 1 --2- 172.21.15.84:0/2543951746 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29980b6590 0x7f29980b8aa0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f29b0100b70 tx=0x7f29a0008040 comp rx=0 tx=0).stop 2024-09-21T03:42:02.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.921+0000 7f29b6eda640 1 -- 172.21.15.84:0/2543951746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29b0102a60 msgr2=0x7f29b019b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:02.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.921+0000 7f29b6eda640 1 --2- 172.21.15.84:0/2543951746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29b0102a60 0x7f29b019b3f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f29ac006010 tx=0x7f29ac0042f0 comp rx=0 tx=0).stop 2024-09-21T03:42:02.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.921+0000 7f29b6eda640 1 -- 172.21.15.84:0/2543951746 shutdown_connections 2024-09-21T03:42:02.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.921+0000 7f29b6eda640 1 --2- 172.21.15.84:0/2543951746 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29980b6590 0x7f29980b8aa0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:02.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.921+0000 7f29b6eda640 1 --2- 172.21.15.84:0/2543951746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29b0108cf0 0x7f29b019be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:02.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.921+0000 7f29b6eda640 1 --2- 172.21.15.84:0/2543951746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29b01083a0 0x7f29b019b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:02.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.921+0000 7f29b6eda640 1 --2- 172.21.15.84:0/2543951746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29b0102a60 0x7f29b019b3f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:02.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.921+0000 7f29b6eda640 1 -- 172.21.15.84:0/2543951746 >> 172.21.15.84:0/2543951746 conn(0x7f29b0079730 msgr2=0x7f29b01014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:02.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.921+0000 7f29b6eda640 1 -- 172.21.15.84:0/2543951746 shutdown_connections 2024-09-21T03:42:02.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:02.921+0000 7f29b6eda640 1 -- 172.21.15.84:0/2543951746 wait complete. 2024-09-21T03:42:03.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:03 smithi084 ceph-mon[30941]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:42:03.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:03 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2543951746' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T03:42:03.769 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T03:42:03.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:03 smithi174 ceph-mon[34403]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:42:03.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:03 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2543951746' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T03:42:03.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:03 smithi172 ceph-mon[34821]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T03:42:03.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:03 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2543951746' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T03:42:04.012 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:04.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.527+0000 7f03daec0640 1 -- 172.21.15.84:0/3299142578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03d4108d00 msgr2=0x7f03d410f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:04.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.527+0000 7f03daec0640 1 --2- 172.21.15.84:0/3299142578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03d4108d00 0x7f03d410f530 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f03cc009ca0 tx=0x7f03cc02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:42:04.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.527+0000 7f03daec0640 1 -- 172.21.15.84:0/3299142578 shutdown_connections 2024-09-21T03:42:04.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.527+0000 7f03daec0640 1 --2- 172.21.15.84:0/3299142578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03d4108d00 0x7f03d410f530 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:04.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.527+0000 7f03daec0640 1 --2- 172.21.15.84:0/3299142578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03d41083b0 0x7f03d41087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:04.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.527+0000 7f03daec0640 1 --2- 172.21.15.84:0/3299142578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03d4102a70 0x7f03d4102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:04.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.527+0000 7f03daec0640 1 -- 172.21.15.84:0/3299142578 >> 172.21.15.84:0/3299142578 conn(0x7f03d4079730 msgr2=0x7f03d4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:04.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.527+0000 7f03daec0640 1 -- 172.21.15.84:0/3299142578 shutdown_connections 2024-09-21T03:42:04.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.527+0000 7f03daec0640 1 -- 172.21.15.84:0/3299142578 wait complete. 2024-09-21T03:42:04.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.528+0000 7f03daec0640 1 Processor -- start 2024-09-21T03:42:04.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.528+0000 7f03daec0640 1 -- start start 2024-09-21T03:42:04.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.528+0000 7f03daec0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03d4102a70 0x7f03d419b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:04.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.528+0000 7f03daec0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03d41083b0 0x7f03d419b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:04.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.528+0000 7f03daec0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03d4108d00 0x7f03d419bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:04.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.528+0000 7f03daec0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f03d41129d0 con 0x7f03d4102a70 2024-09-21T03:42:04.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.528+0000 7f03daec0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f03d4112850 con 0x7f03d41083b0 2024-09-21T03:42:04.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.528+0000 7f03daec0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f03d4112b50 con 0x7f03d4108d00 2024-09-21T03:42:04.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.528+0000 7f03d8c5c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03d4102a70 0x7f03d419b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:04.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.528+0000 7f03d8c5c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03d4102a70 0x7f03d419b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59724/0 (socket says 172.21.15.84:59724) 2024-09-21T03:42:04.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.528+0000 7f03d8c5c640 1 -- 172.21.15.84:0/2899589498 learned_addr learned my addr 172.21.15.84:0/2899589498 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:04.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.528+0000 7f03d3fff640 1 --2- 172.21.15.84:0/2899589498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03d41083b0 0x7f03d419b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:04.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.529+0000 7f03d945d640 1 --2- 172.21.15.84:0/2899589498 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03d4108d00 0x7f03d419bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:04.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.529+0000 7f03d8c5c640 1 -- 172.21.15.84:0/2899589498 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03d4108d00 msgr2=0x7f03d419bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:04.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.529+0000 7f03d8c5c640 1 --2- 172.21.15.84:0/2899589498 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03d4108d00 0x7f03d419bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:04.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.529+0000 7f03d8c5c640 1 -- 172.21.15.84:0/2899589498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03d41083b0 msgr2=0x7f03d419b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:04.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.529+0000 7f03d8c5c640 1 --2- 172.21.15.84:0/2899589498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03d41083b0 0x7f03d419b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:04.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.529+0000 7f03d8c5c640 1 -- 172.21.15.84:0/2899589498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d41a64a0 con 0x7f03d4102a70 2024-09-21T03:42:04.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.529+0000 7f03d8c5c640 1 --2- 172.21.15.84:0/2899589498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03d4102a70 0x7f03d419b2a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f03c400c920 tx=0x7f03c400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:04.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.529+0000 7f03d1ffb640 1 -- 172.21.15.84:0/2899589498 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c4007c70 con 0x7f03d4102a70 2024-09-21T03:42:04.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.529+0000 7f03d1ffb640 1 -- 172.21.15.84:0/2899589498 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03c4007e10 con 0x7f03d4102a70 2024-09-21T03:42:04.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.529+0000 7f03d1ffb640 1 -- 172.21.15.84:0/2899589498 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c4018820 con 0x7f03d4102a70 2024-09-21T03:42:04.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.529+0000 7f03daec0640 1 -- 172.21.15.84:0/2899589498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d41a6790 con 0x7f03d4102a70 2024-09-21T03:42:04.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.529+0000 7f03daec0640 1 -- 172.21.15.84:0/2899589498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d41a6da0 con 0x7f03d4102a70 2024-09-21T03:42:04.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.530+0000 7f03daec0640 1 -- 172.21.15.84:0/2899589498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03d4103cf0 con 0x7f03d4102a70 2024-09-21T03:42:04.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.532+0000 7f03d1ffb640 1 -- 172.21.15.84:0/2899589498 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f03c400f450 con 0x7f03d4102a70 2024-09-21T03:42:04.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.533+0000 7f03d1ffb640 1 --2- 172.21.15.84:0/2899589498 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f03c00b6610 0x7f03c00b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:04.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.533+0000 7f03d3fff640 1 --2- 172.21.15.84:0/2899589498 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f03c00b6610 0x7f03c00b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:04.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.533+0000 7f03d1ffb640 1 -- 172.21.15.84:0/2899589498 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f03c40e7870 con 0x7f03d4102a70 2024-09-21T03:42:04.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.533+0000 7f03d3fff640 1 --2- 172.21.15.84:0/2899589498 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f03c00b6610 0x7f03c00b8b20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f03d4107a80 tx=0x7f03bc008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:04.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.536+0000 7f03d1ffb640 1 -- 172.21.15.84:0/2899589498 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f03c4014030 con 0x7f03d4102a70 2024-09-21T03:42:04.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.715+0000 7f03daec0640 1 -- 172.21.15.84:0/2899589498 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f03d406bef0 con 0x7f03d4102a70 2024-09-21T03:42:04.717 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:04 smithi084 ceph-mon[30941]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:42:04.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.716+0000 7f03d1ffb640 1 -- 172.21.15.84:0/2899589498 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v77) ==== 56+0+5653 (secure 0 0 0) 0x7f03c40ae110 con 0x7f03d4102a70 2024-09-21T03:42:04.718 INFO:teuthology.orchestra.run.smithi084.stdout:epoch 77 2024-09-21T03:42:04.718 INFO:teuthology.orchestra.run.smithi084.stdout:fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:42:04.718 INFO:teuthology.orchestra.run.smithi084.stdout:created 2024-09-21T03:31:55.307035+0000 2024-09-21T03:42:04.718 INFO:teuthology.orchestra.run.smithi084.stdout:modified 2024-09-21T03:40:51.455331+0000 2024-09-21T03:42:04.718 INFO:teuthology.orchestra.run.smithi084.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T03:42:04.718 INFO:teuthology.orchestra.run.smithi084.stdout:crush_version 26 2024-09-21T03:42:04.718 INFO:teuthology.orchestra.run.smithi084.stdout:full_ratio 0.95 2024-09-21T03:42:04.718 INFO:teuthology.orchestra.run.smithi084.stdout:backfillfull_ratio 0.9 2024-09-21T03:42:04.718 INFO:teuthology.orchestra.run.smithi084.stdout:nearfull_ratio 0.85 2024-09-21T03:42:04.719 INFO:teuthology.orchestra.run.smithi084.stdout:require_min_compat_client luminous 2024-09-21T03:42:04.719 INFO:teuthology.orchestra.run.smithi084.stdout:min_compat_client luminous 2024-09-21T03:42:04.719 INFO:teuthology.orchestra.run.smithi084.stdout:require_osd_release squid 2024-09-21T03:42:04.719 INFO:teuthology.orchestra.run.smithi084.stdout:stretch_mode_enabled false 2024-09-21T03:42:04.719 INFO:teuthology.orchestra.run.smithi084.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T03:42:04.719 INFO:teuthology.orchestra.run.smithi084.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-21T03:42:04.719 INFO:teuthology.orchestra.run.smithi084.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-21T03:42:04.719 INFO:teuthology.orchestra.run.smithi084.stdout:max_osd 12 2024-09-21T03:42:04.719 INFO:teuthology.orchestra.run.smithi084.stdout:osd.0 up in weight 1 up_from 9 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6802/508132562,v1:172.21.15.84:6803/508132562] [v2:172.21.15.84:6804/508132562,v1:172.21.15.84:6805/508132562] exists,up 9d283ba0-18f3-4668-90c4-884e9e957a88 2024-09-21T03:42:04.719 INFO:teuthology.orchestra.run.smithi084.stdout:osd.1 up in weight 1 up_from 13 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/2931872350,v1:172.21.15.172:6801/2931872350] [v2:172.21.15.172:6802/2931872350,v1:172.21.15.172:6803/2931872350] exists,up f115c5b6-812d-430f-9f0e-cb5311b7581e 2024-09-21T03:42:04.719 INFO:teuthology.orchestra.run.smithi084.stdout:osd.2 up in weight 1 up_from 18 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6800/1847612335,v1:172.21.15.174:6801/1847612335] [v2:172.21.15.174:6802/1847612335,v1:172.21.15.174:6803/1847612335] exists,up 36489240-e233-4aa7-ae9c-089d76683172 2024-09-21T03:42:04.719 INFO:teuthology.orchestra.run.smithi084.stdout:osd.3 up in weight 1 up_from 25 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6810/2230529863,v1:172.21.15.84:6811/2230529863] [v2:172.21.15.84:6812/2230529863,v1:172.21.15.84:6813/2230529863] exists,up 1f35b404-b658-4e94-a5f4-74a6431a6a8c 2024-09-21T03:42:04.720 INFO:teuthology.orchestra.run.smithi084.stdout:osd.4 up in weight 1 up_from 31 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6808/3069862739,v1:172.21.15.172:6809/3069862739] [v2:172.21.15.172:6810/3069862739,v1:172.21.15.172:6811/3069862739] exists,up 91a2f83b-4c7d-4661-86a1-63a09888939d 2024-09-21T03:42:04.720 INFO:teuthology.orchestra.run.smithi084.stdout:osd.5 up in weight 1 up_from 37 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6808/1987010600,v1:172.21.15.174:6809/1987010600] [v2:172.21.15.174:6810/1987010600,v1:172.21.15.174:6811/1987010600] exists,up e8f06b34-3956-499f-8073-09011cf1ce0a 2024-09-21T03:42:04.720 INFO:teuthology.orchestra.run.smithi084.stdout:osd.6 up in weight 1 up_from 43 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6818/3418459345,v1:172.21.15.84:6819/3418459345] [v2:172.21.15.84:6820/3418459345,v1:172.21.15.84:6821/3418459345] exists,up 23d55e96-4987-4cbe-8c6b-cece4de9269b 2024-09-21T03:42:04.720 INFO:teuthology.orchestra.run.smithi084.stdout:osd.7 up in weight 1 up_from 48 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6816/4056019738,v1:172.21.15.172:6817/4056019738] [v2:172.21.15.172:6818/4056019738,v1:172.21.15.172:6819/4056019738] exists,up ca91a34c-d8b1-48b8-93f4-72a5c15939d0 2024-09-21T03:42:04.720 INFO:teuthology.orchestra.run.smithi084.stdout:osd.8 up in weight 1 up_from 53 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6816/2162992546,v1:172.21.15.174:6817/2162992546] [v2:172.21.15.174:6818/2162992546,v1:172.21.15.174:6819/2162992546] exists,up 37da8c61-d72f-4b58-b10c-7c7539ecffd0 2024-09-21T03:42:04.720 INFO:teuthology.orchestra.run.smithi084.stdout:osd.9 up in weight 1 up_from 59 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.84:6826/3230873673,v1:172.21.15.84:6827/3230873673] [v2:172.21.15.84:6828/3230873673,v1:172.21.15.84:6829/3230873673] exists,up c9179f33-622d-44bd-9d8a-c92951afb1e4 2024-09-21T03:42:04.720 INFO:teuthology.orchestra.run.smithi084.stdout:osd.10 up in weight 1 up_from 64 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6824/2667099391,v1:172.21.15.172:6825/2667099391] [v2:172.21.15.172:6826/2667099391,v1:172.21.15.172:6827/2667099391] exists,up 9788fa2d-49fb-431b-a0e3-62d6e421e11e 2024-09-21T03:42:04.720 INFO:teuthology.orchestra.run.smithi084.stdout:osd.11 up in weight 1 up_from 69 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.174:6824/3452825924,v1:172.21.15.174:6825/3452825924] [v2:172.21.15.174:6826/3452825924,v1:172.21.15.174:6827/3452825924] exists,up a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69 2024-09-21T03:42:04.720 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 2.5 [8,11] 2024-09-21T03:42:04.720 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 2.10 [8,11] 2024-09-21T03:42:04.720 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 2.16 [2,4] 2024-09-21T03:42:04.720 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 2.1b [2,4] 2024-09-21T03:42:04.720 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 3.e [5,9] 2024-09-21T03:42:04.720 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 3.13 [4,9] 2024-09-21T03:42:04.721 INFO:teuthology.orchestra.run.smithi084.stdout:pg_upmap_items 3.36 [4,9] 2024-09-21T03:42:04.721 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:6801/3590728685 expires 2024-09-22T03:33:50.188998+0000 2024-09-21T03:42:04.721 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:6800/3590728685 expires 2024-09-22T03:33:50.188998+0000 2024-09-21T03:42:04.721 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/3308084314 expires 2024-09-22T03:32:17.033279+0000 2024-09-21T03:42:04.721 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/3663660709 expires 2024-09-22T03:32:17.033279+0000 2024-09-21T03:42:04.721 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/1794153935 expires 2024-09-22T03:32:49.459372+0000 2024-09-21T03:42:04.721 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:6800/3983018447 expires 2024-09-22T03:32:17.033279+0000 2024-09-21T03:42:04.721 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:6800/4082319115 expires 2024-09-22T03:32:49.459372+0000 2024-09-21T03:42:04.721 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/1874814897 expires 2024-09-22T03:32:17.033279+0000 2024-09-21T03:42:04.721 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:6801/4082319115 expires 2024-09-22T03:32:49.459372+0000 2024-09-21T03:42:04.721 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/390051797 expires 2024-09-22T03:32:49.459372+0000 2024-09-21T03:42:04.721 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/2148206075 expires 2024-09-22T03:32:49.459372+0000 2024-09-21T03:42:04.721 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/1916019809 expires 2024-09-22T03:33:50.188998+0000 2024-09-21T03:42:04.721 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:6801/3983018447 expires 2024-09-22T03:32:17.033279+0000 2024-09-21T03:42:04.721 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/3491731835 expires 2024-09-22T03:33:50.188998+0000 2024-09-21T03:42:04.722 INFO:teuthology.orchestra.run.smithi084.stdout:blocklist 172.21.15.84:0/3418048965 expires 2024-09-22T03:33:50.188998+0000 2024-09-21T03:42:04.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.718+0000 7f03daec0640 1 -- 172.21.15.84:0/2899589498 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f03c00b6610 msgr2=0x7f03c00b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:04.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.718+0000 7f03daec0640 1 --2- 172.21.15.84:0/2899589498 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f03c00b6610 0x7f03c00b8b20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f03d4107a80 tx=0x7f03bc008040 comp rx=0 tx=0).stop 2024-09-21T03:42:04.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.718+0000 7f03daec0640 1 -- 172.21.15.84:0/2899589498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03d4102a70 msgr2=0x7f03d419b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:04.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.718+0000 7f03daec0640 1 --2- 172.21.15.84:0/2899589498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03d4102a70 0x7f03d419b2a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f03c400c920 tx=0x7f03c400cde0 comp rx=0 tx=0).stop 2024-09-21T03:42:04.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.718+0000 7f03daec0640 1 -- 172.21.15.84:0/2899589498 shutdown_connections 2024-09-21T03:42:04.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.718+0000 7f03daec0640 1 --2- 172.21.15.84:0/2899589498 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f03c00b6610 0x7f03c00b8b20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:04.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.718+0000 7f03daec0640 1 --2- 172.21.15.84:0/2899589498 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f03d4108d00 0x7f03d419bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:04.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.718+0000 7f03daec0640 1 --2- 172.21.15.84:0/2899589498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03d41083b0 0x7f03d419b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:04.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.718+0000 7f03daec0640 1 --2- 172.21.15.84:0/2899589498 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f03d4102a70 0x7f03d419b2a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:04.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.718+0000 7f03daec0640 1 -- 172.21.15.84:0/2899589498 >> 172.21.15.84:0/2899589498 conn(0x7f03d4079730 msgr2=0x7f03d41052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:04.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.718+0000 7f03daec0640 1 -- 172.21.15.84:0/2899589498 shutdown_connections 2024-09-21T03:42:04.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:04.718+0000 7f03daec0640 1 -- 172.21.15.84:0/2899589498 wait complete. 2024-09-21T03:42:04.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:04 smithi174 ceph-mon[34403]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:42:04.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:04 smithi172 ceph-mon[34821]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:42:05.565 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T03:42:05.578 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:42:05.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:05 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2899589498' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T03:42:05.823 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:05.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:05 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2899589498' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T03:42:05.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:05 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2899589498' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T03:42:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.327+0000 7fd6c1c4d640 1 -- 172.21.15.84:0/4138621724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6bc108cf0 msgr2=0x7fd6bc10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.327+0000 7fd6c1c4d640 1 --2- 172.21.15.84:0/4138621724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6bc108cf0 0x7fd6bc10f520 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009ca0 tx=0x7fd6b402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:42:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.327+0000 7fd6c1c4d640 1 -- 172.21.15.84:0/4138621724 shutdown_connections 2024-09-21T03:42:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.327+0000 7fd6c1c4d640 1 --2- 172.21.15.84:0/4138621724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6bc108cf0 0x7fd6bc10f520 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.327+0000 7fd6c1c4d640 1 --2- 172.21.15.84:0/4138621724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6bc1083a0 0x7fd6bc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.327+0000 7fd6c1c4d640 1 --2- 172.21.15.84:0/4138621724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6bc102a60 0x7fd6bc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.327+0000 7fd6c1c4d640 1 -- 172.21.15.84:0/4138621724 >> 172.21.15.84:0/4138621724 conn(0x7fd6bc079730 msgr2=0x7fd6bc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.327+0000 7fd6c1c4d640 1 -- 172.21.15.84:0/4138621724 shutdown_connections 2024-09-21T03:42:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.327+0000 7fd6c1c4d640 1 -- 172.21.15.84:0/4138621724 wait complete. 2024-09-21T03:42:06.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.328+0000 7fd6c1c4d640 1 Processor -- start 2024-09-21T03:42:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.328+0000 7fd6c1c4d640 1 -- start start 2024-09-21T03:42:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.328+0000 7fd6c1c4d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6bc102a60 0x7fd6bc199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.328+0000 7fd6c1c4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6bc1083a0 0x7fd6bc199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.328+0000 7fd6c1c4d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6bc108cf0 0x7fd6bc19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.328+0000 7fd6c1c4d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc112960 con 0x7fd6bc1083a0 2024-09-21T03:42:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.328+0000 7fd6c1c4d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc1127e0 con 0x7fd6bc108cf0 2024-09-21T03:42:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.328+0000 7fd6c1c4d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd6bc112ae0 con 0x7fd6bc102a60 2024-09-21T03:42:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.328+0000 7fd6baffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6bc1083a0 0x7fd6bc199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.328+0000 7fd6baffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6bc1083a0 0x7fd6bc199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59742/0 (socket says 172.21.15.84:59742) 2024-09-21T03:42:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.328+0000 7fd6baffd640 1 -- 172.21.15.84:0/2398092264 learned_addr learned my addr 172.21.15.84:0/2398092264 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.329+0000 7fd6bb7fe640 1 --2- 172.21.15.84:0/2398092264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6bc102a60 0x7fd6bc199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.329+0000 7fd6bbfff640 1 --2- 172.21.15.84:0/2398092264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6bc108cf0 0x7fd6bc19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.329+0000 7fd6baffd640 1 -- 172.21.15.84:0/2398092264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6bc102a60 msgr2=0x7fd6bc199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.329+0000 7fd6baffd640 1 --2- 172.21.15.84:0/2398092264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6bc102a60 0x7fd6bc199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:06.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.329+0000 7fd6baffd640 1 -- 172.21.15.84:0/2398092264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6bc108cf0 msgr2=0x7fd6bc19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.329+0000 7fd6baffd640 1 --2- 172.21.15.84:0/2398092264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6bc108cf0 0x7fd6bc19ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.329+0000 7fd6baffd640 1 -- 172.21.15.84:0/2398092264 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6bc19f2e0 con 0x7fd6bc1083a0 2024-09-21T03:42:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.329+0000 7fd6bbfff640 1 --2- 172.21.15.84:0/2398092264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6bc108cf0 0x7fd6bc19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.329+0000 7fd6baffd640 1 --2- 172.21.15.84:0/2398092264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6bc1083a0 0x7fd6bc199910 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400d770 tx=0x7fd6a400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.329+0000 7fd6b8ff9640 1 -- 172.21.15.84:0/2398092264 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4017070 con 0x7fd6bc1083a0 2024-09-21T03:42:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.329+0000 7fd6b8ff9640 1 -- 172.21.15.84:0/2398092264 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6a4009c30 con 0x7fd6bc1083a0 2024-09-21T03:42:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.329+0000 7fd6c1c4d640 1 -- 172.21.15.84:0/2398092264 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6bc19f5d0 con 0x7fd6bc1083a0 2024-09-21T03:42:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.329+0000 7fd6b8ff9640 1 -- 172.21.15.84:0/2398092264 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a400f620 con 0x7fd6bc1083a0 2024-09-21T03:42:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.329+0000 7fd6c1c4d640 1 -- 172.21.15.84:0/2398092264 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6bc1a5d30 con 0x7fd6bc1083a0 2024-09-21T03:42:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.330+0000 7fd6c1c4d640 1 -- 172.21.15.84:0/2398092264 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6bc102e70 con 0x7fd6bc1083a0 2024-09-21T03:42:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.331+0000 7fd6b8ff9640 1 -- 172.21.15.84:0/2398092264 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fd6a401a070 con 0x7fd6bc1083a0 2024-09-21T03:42:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.332+0000 7fd6b8ff9640 1 --2- 172.21.15.84:0/2398092264 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd6a80b6560 0x7fd6a80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.332+0000 7fd6bb7fe640 1 --2- 172.21.15.84:0/2398092264 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd6a80b6560 0x7fd6a80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:06.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.332+0000 7fd6b8ff9640 1 -- 172.21.15.84:0/2398092264 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fd6a40e6f60 con 0x7fd6bc1083a0 2024-09-21T03:42:06.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.333+0000 7fd6bb7fe640 1 --2- 172.21.15.84:0/2398092264 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd6a80b6560 0x7fd6a80b8a70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac005fd0 tx=0x7fd6ac005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:06.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.335+0000 7fd6b8ff9640 1 -- 172.21.15.84:0/2398092264 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd6a4009de0 con 0x7fd6bc1083a0 2024-09-21T03:42:06.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.551+0000 7fd6c1c4d640 1 -- 172.21.15.84:0/2398092264 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6bc19a4a0 con 0x7fd6bc1083a0 2024-09-21T03:42:06.553 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:06 smithi084 ceph-mon[30941]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:42:06.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.552+0000 7fd6b8ff9640 1 -- 172.21.15.84:0/2398092264 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7fd6bc19a4a0 con 0x7fd6bc1083a0 2024-09-21T03:42:06.554 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:42:06.554 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"btime":"2024-09-21T03:40:41:408095+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:40:41.132161+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24634,24638,24668]},"id":1}]} 2024-09-21T03:42:06.554 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 24 2024-09-21T03:42:06.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.554+0000 7fd6c1c4d640 1 -- 172.21.15.84:0/2398092264 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd6a80b6560 msgr2=0x7fd6a80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:06.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.554+0000 7fd6c1c4d640 1 --2- 172.21.15.84:0/2398092264 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd6a80b6560 0x7fd6a80b8a70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac005fd0 tx=0x7fd6ac005850 comp rx=0 tx=0).stop 2024-09-21T03:42:06.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.554+0000 7fd6c1c4d640 1 -- 172.21.15.84:0/2398092264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6bc1083a0 msgr2=0x7fd6bc199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:06.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.554+0000 7fd6c1c4d640 1 --2- 172.21.15.84:0/2398092264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6bc1083a0 0x7fd6bc199910 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400d770 tx=0x7fd6a400dc30 comp rx=0 tx=0).stop 2024-09-21T03:42:06.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.554+0000 7fd6c1c4d640 1 -- 172.21.15.84:0/2398092264 shutdown_connections 2024-09-21T03:42:06.556 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.554+0000 7fd6c1c4d640 1 --2- 172.21.15.84:0/2398092264 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd6a80b6560 0x7fd6a80b8a70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:06.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.554+0000 7fd6c1c4d640 1 --2- 172.21.15.84:0/2398092264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6bc108cf0 0x7fd6bc19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:06.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.554+0000 7fd6c1c4d640 1 --2- 172.21.15.84:0/2398092264 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd6bc1083a0 0x7fd6bc199910 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:06.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.554+0000 7fd6c1c4d640 1 --2- 172.21.15.84:0/2398092264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd6bc102a60 0x7fd6bc199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:06.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.554+0000 7fd6c1c4d640 1 -- 172.21.15.84:0/2398092264 >> 172.21.15.84:0/2398092264 conn(0x7fd6bc079730 msgr2=0x7fd6bc104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:06.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.554+0000 7fd6c1c4d640 1 -- 172.21.15.84:0/2398092264 shutdown_connections 2024-09-21T03:42:06.557 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:06.554+0000 7fd6c1c4d640 1 -- 172.21.15.84:0/2398092264 wait complete. 2024-09-21T03:42:06.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:06 smithi174 ceph-mon[34403]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:42:06.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:06 smithi172 ceph-mon[34821]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:42:07.396 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:42:07.646 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:07.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:07 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2398092264' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:42:07.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:07 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2398092264' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:42:07.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:07 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2398092264' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:42:08.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.143+0000 7f57ad942640 1 -- 172.21.15.84:0/1508842681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a8108cf0 msgr2=0x7f57a810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:08.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.143+0000 7f57ad942640 1 --2- 172.21.15.84:0/1508842681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a8108cf0 0x7f57a810f520 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009900 tx=0x7f57a002a410 comp rx=0 tx=0).stop 2024-09-21T03:42:08.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.143+0000 7f57ad942640 1 -- 172.21.15.84:0/1508842681 shutdown_connections 2024-09-21T03:42:08.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.143+0000 7f57ad942640 1 --2- 172.21.15.84:0/1508842681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a8108cf0 0x7f57a810f520 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:08.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.143+0000 7f57ad942640 1 --2- 172.21.15.84:0/1508842681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57a81083a0 0x7f57a81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:08.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.143+0000 7f57ad942640 1 --2- 172.21.15.84:0/1508842681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57a8102a60 0x7f57a8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:08.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.143+0000 7f57ad942640 1 -- 172.21.15.84:0/1508842681 >> 172.21.15.84:0/1508842681 conn(0x7f57a8079730 msgr2=0x7f57a8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:08.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.143+0000 7f57ad942640 1 -- 172.21.15.84:0/1508842681 shutdown_connections 2024-09-21T03:42:08.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.143+0000 7f57ad942640 1 -- 172.21.15.84:0/1508842681 wait complete. 2024-09-21T03:42:08.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.144+0000 7f57ad942640 1 Processor -- start 2024-09-21T03:42:08.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.144+0000 7f57ad942640 1 -- start start 2024-09-21T03:42:08.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.144+0000 7f57ad942640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57a8102a60 0x7f57a81992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:08.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.144+0000 7f57ad942640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a81083a0 0x7f57a8199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:08.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.144+0000 7f57ad942640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57a8108cf0 0x7f57a819eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:08.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.144+0000 7f57ad942640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f57a8112960 con 0x7f57a81083a0 2024-09-21T03:42:08.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.144+0000 7f57ad942640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f57a81127e0 con 0x7f57a8108cf0 2024-09-21T03:42:08.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.144+0000 7f57ad942640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f57a8112ae0 con 0x7f57a8102a60 2024-09-21T03:42:08.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.144+0000 7f57a67fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a81083a0 0x7f57a8199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:08.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.144+0000 7f57a67fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a81083a0 0x7f57a8199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59760/0 (socket says 172.21.15.84:59760) 2024-09-21T03:42:08.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.144+0000 7f57a67fc640 1 -- 172.21.15.84:0/2878908274 learned_addr learned my addr 172.21.15.84:0/2878908274 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:08.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.144+0000 7f57a77fe640 1 --2- 172.21.15.84:0/2878908274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57a8108cf0 0x7f57a819eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:08.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.145+0000 7f57a6ffd640 1 --2- 172.21.15.84:0/2878908274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57a8102a60 0x7f57a81992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:08.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.145+0000 7f57a67fc640 1 -- 172.21.15.84:0/2878908274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57a8102a60 msgr2=0x7f57a81992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:08.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.145+0000 7f57a67fc640 1 --2- 172.21.15.84:0/2878908274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57a8102a60 0x7f57a81992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:08.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.145+0000 7f57a67fc640 1 -- 172.21.15.84:0/2878908274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57a8108cf0 msgr2=0x7f57a819eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:08.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.145+0000 7f57a67fc640 1 --2- 172.21.15.84:0/2878908274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57a8108cf0 0x7f57a819eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:08.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.145+0000 7f57a67fc640 1 -- 172.21.15.84:0/2878908274 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57a819f260 con 0x7f57a81083a0 2024-09-21T03:42:08.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.145+0000 7f57a67fc640 1 --2- 172.21.15.84:0/2878908274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a81083a0 0x7f57a8199890 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f579c00c970 tx=0x7f579c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:08.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.145+0000 7f57ac940640 1 -- 172.21.15.84:0/2878908274 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c007bb0 con 0x7f57a81083a0 2024-09-21T03:42:08.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.145+0000 7f57ad942640 1 -- 172.21.15.84:0/2878908274 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57a819f550 con 0x7f57a81083a0 2024-09-21T03:42:08.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.145+0000 7f57ac940640 1 -- 172.21.15.84:0/2878908274 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f579c007d50 con 0x7f57a81083a0 2024-09-21T03:42:08.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.145+0000 7f57ac940640 1 -- 172.21.15.84:0/2878908274 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c00f450 con 0x7f57a81083a0 2024-09-21T03:42:08.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.145+0000 7f57ad942640 1 -- 172.21.15.84:0/2878908274 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57a81a5cb0 con 0x7f57a81083a0 2024-09-21T03:42:08.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.146+0000 7f57ad942640 1 -- 172.21.15.84:0/2878908274 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57a8102e70 con 0x7f57a81083a0 2024-09-21T03:42:08.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.148+0000 7f57ac940640 1 -- 172.21.15.84:0/2878908274 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f579c004ea0 con 0x7f57a81083a0 2024-09-21T03:42:08.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.148+0000 7f57ac940640 1 --2- 172.21.15.84:0/2878908274 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f57900b6560 0x7f57900b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:08.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.148+0000 7f57a6ffd640 1 --2- 172.21.15.84:0/2878908274 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f57900b6560 0x7f57900b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:08.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.149+0000 7f57ac940640 1 -- 172.21.15.84:0/2878908274 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f579c0e7490 con 0x7f57a81083a0 2024-09-21T03:42:08.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.149+0000 7f57a6ffd640 1 --2- 172.21.15.84:0/2878908274 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f57900b6560 0x7f57900b8a70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5798005fd0 tx=0x7f5798009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:08.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.152+0000 7f57ac940640 1 -- 172.21.15.84:0/2878908274 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f579c014030 con 0x7f57a81083a0 2024-09-21T03:42:08.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.365+0000 7f57ad942640 1 -- 172.21.15.84:0/2878908274 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57a819a420 con 0x7f57a81083a0 2024-09-21T03:42:08.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.366+0000 7f57ac940640 1 -- 172.21.15.84:0/2878908274 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11917 (secure 0 0 0) 0x7f57a819a420 con 0x7f57a81083a0 2024-09-21T03:42:08.369 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:42:08.370 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":24,"btime":"2024-09-21T03:40:41:408095+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:40:41.132161+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24634,24638,24668]},"id":1}]} 2024-09-21T03:42:08.370 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 24 2024-09-21T03:42:08.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.368+0000 7f57ad942640 1 -- 172.21.15.84:0/2878908274 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f57900b6560 msgr2=0x7f57900b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:08.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.368+0000 7f57ad942640 1 --2- 172.21.15.84:0/2878908274 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f57900b6560 0x7f57900b8a70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5798005fd0 tx=0x7f5798009680 comp rx=0 tx=0).stop 2024-09-21T03:42:08.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.368+0000 7f57ad942640 1 -- 172.21.15.84:0/2878908274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a81083a0 msgr2=0x7f57a8199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:08.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.368+0000 7f57ad942640 1 --2- 172.21.15.84:0/2878908274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a81083a0 0x7f57a8199890 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f579c00c970 tx=0x7f579c00ce30 comp rx=0 tx=0).stop 2024-09-21T03:42:08.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.368+0000 7f57ad942640 1 -- 172.21.15.84:0/2878908274 shutdown_connections 2024-09-21T03:42:08.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.368+0000 7f57ad942640 1 --2- 172.21.15.84:0/2878908274 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f57900b6560 0x7f57900b8a70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:08.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.368+0000 7f57ad942640 1 --2- 172.21.15.84:0/2878908274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57a8108cf0 0x7f57a819eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:08.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.368+0000 7f57ad942640 1 --2- 172.21.15.84:0/2878908274 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f57a81083a0 0x7f57a8199890 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:08.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.368+0000 7f57ad942640 1 --2- 172.21.15.84:0/2878908274 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f57a8102a60 0x7f57a81992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:08.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.368+0000 7f57ad942640 1 -- 172.21.15.84:0/2878908274 >> 172.21.15.84:0/2878908274 conn(0x7f57a8079730 msgr2=0x7f57a81043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:08.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.369+0000 7f57ad942640 1 -- 172.21.15.84:0/2878908274 shutdown_connections 2024-09-21T03:42:08.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:08.369+0000 7f57ad942640 1 -- 172.21.15.84:0/2878908274 wait complete. 2024-09-21T03:42:08.815 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:08 smithi084 ceph-mon[30941]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:08.815 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:08 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2878908274' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:42:08.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:08 smithi174 ceph-mon[34403]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:08.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:08 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2878908274' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:42:08.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:08 smithi172 ceph-mon[34821]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:08.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:08 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2878908274' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:42:09.097 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:42:09.339 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:09.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.860+0000 7f2d4b528640 1 -- 172.21.15.84:0/1417324451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d44109df0 msgr2=0x7f2d44110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:09.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.860+0000 7f2d4b528640 1 --2- 172.21.15.84:0/1417324451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d44109df0 0x7f2d44110620 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009ca0 tx=0x7f2d3c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:42:09.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.860+0000 7f2d4b528640 1 -- 172.21.15.84:0/1417324451 shutdown_connections 2024-09-21T03:42:09.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.860+0000 7f2d4b528640 1 --2- 172.21.15.84:0/1417324451 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d44109df0 0x7f2d44110620 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:09.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.860+0000 7f2d4b528640 1 --2- 172.21.15.84:0/1417324451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d441094a0 0x7f2d441098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:09.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.860+0000 7f2d4b528640 1 --2- 172.21.15.84:0/1417324451 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2d44103b60 0x7f2d44103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:09.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.860+0000 7f2d4b528640 1 -- 172.21.15.84:0/1417324451 >> 172.21.15.84:0/1417324451 conn(0x7f2d4407b850 msgr2=0x7f2d4407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:09.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.860+0000 7f2d4b528640 1 -- 172.21.15.84:0/1417324451 shutdown_connections 2024-09-21T03:42:09.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.860+0000 7f2d4b528640 1 -- 172.21.15.84:0/1417324451 wait complete. 2024-09-21T03:42:09.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.861+0000 7f2d4b528640 1 Processor -- start 2024-09-21T03:42:09.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.861+0000 7f2d4b528640 1 -- start start 2024-09-21T03:42:09.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.861+0000 7f2d4b528640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d44103b60 0x7f2d4419c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:09.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.861+0000 7f2d4b528640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d441094a0 0x7f2d4419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:09.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.861+0000 7f2d4b528640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2d44109df0 0x7f2d441a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:09.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.861+0000 7f2d4b528640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2d44113ab0 con 0x7f2d441094a0 2024-09-21T03:42:09.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.861+0000 7f2d4b528640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2d44113930 con 0x7f2d44103b60 2024-09-21T03:42:09.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.861+0000 7f2d4b528640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2d44113c30 con 0x7f2d44109df0 2024-09-21T03:42:09.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.861+0000 7f2d48ac3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d441094a0 0x7f2d4419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:09.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.861+0000 7f2d48ac3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d441094a0 0x7f2d4419cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50404/0 (socket says 172.21.15.84:50404) 2024-09-21T03:42:09.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.862+0000 7f2d48ac3640 1 -- 172.21.15.84:0/3644598141 learned_addr learned my addr 172.21.15.84:0/3644598141 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:09.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.862+0000 7f2d49ac5640 1 --2- 172.21.15.84:0/3644598141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2d44109df0 0x7f2d441a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:09.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.862+0000 7f2d492c4640 1 --2- 172.21.15.84:0/3644598141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d44103b60 0x7f2d4419c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:09.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.862+0000 7f2d48ac3640 1 -- 172.21.15.84:0/3644598141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2d44109df0 msgr2=0x7f2d441a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:09.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.862+0000 7f2d48ac3640 1 --2- 172.21.15.84:0/3644598141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2d44109df0 0x7f2d441a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:09.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.862+0000 7f2d48ac3640 1 -- 172.21.15.84:0/3644598141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d44103b60 msgr2=0x7f2d4419c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:09.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.862+0000 7f2d48ac3640 1 --2- 172.21.15.84:0/3644598141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d44103b60 0x7f2d4419c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:09.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.862+0000 7f2d48ac3640 1 -- 172.21.15.84:0/3644598141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d441a2630 con 0x7f2d441094a0 2024-09-21T03:42:09.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.862+0000 7f2d48ac3640 1 --2- 172.21.15.84:0/3644598141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d441094a0 0x7f2d4419cc60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800d950 tx=0x7f2d3800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:09.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.862+0000 7f2d367fc640 1 -- 172.21.15.84:0/3644598141 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d38017070 con 0x7f2d441094a0 2024-09-21T03:42:09.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.862+0000 7f2d4b528640 1 -- 172.21.15.84:0/3644598141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d441a2920 con 0x7f2d441094a0 2024-09-21T03:42:09.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.862+0000 7f2d367fc640 1 -- 172.21.15.84:0/3644598141 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d38009c30 con 0x7f2d441094a0 2024-09-21T03:42:09.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.862+0000 7f2d367fc640 1 -- 172.21.15.84:0/3644598141 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d380047a0 con 0x7f2d441094a0 2024-09-21T03:42:09.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.862+0000 7f2d4b528640 1 -- 172.21.15.84:0/3644598141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d441a9080 con 0x7f2d441094a0 2024-09-21T03:42:09.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.863+0000 7f2d4b528640 1 -- 172.21.15.84:0/3644598141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d44103f70 con 0x7f2d441094a0 2024-09-21T03:42:09.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.865+0000 7f2d367fc640 1 -- 172.21.15.84:0/3644598141 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f2d38004020 con 0x7f2d441094a0 2024-09-21T03:42:09.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.865+0000 7f2d367fc640 1 --2- 172.21.15.84:0/3644598141 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2d300b6560 0x7f2d300b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:09.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.865+0000 7f2d492c4640 1 --2- 172.21.15.84:0/3644598141 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2d300b6560 0x7f2d300b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:09.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.865+0000 7f2d367fc640 1 -- 172.21.15.84:0/3644598141 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f2d380e74d0 con 0x7f2d441094a0 2024-09-21T03:42:09.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.866+0000 7f2d492c4640 1 --2- 172.21.15.84:0/3644598141 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2d300b6560 0x7f2d300b8a70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2d40009b60 tx=0x7f2d40005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:09.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:09.868+0000 7f2d367fc640 1 -- 172.21.15.84:0/3644598141 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2d38020020 con 0x7f2d441094a0 2024-09-21T03:42:10.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:10.047+0000 7f2d4b528640 1 -- 172.21.15.84:0/3644598141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d441a9280 con 0x7f2d441094a0 2024-09-21T03:42:10.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:10.048+0000 7f2d367fc640 1 -- 172.21.15.84:0/3644598141 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+23019 (secure 0 0 0) 0x7f2d380adcc0 con 0x7f2d441094a0 2024-09-21T03:42:10.050 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:42:10.050 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":77,"fsid":"e3f8c18e-77c9-11ef-baf5-efdc52797490","created":"2024-09-21T03:31:55.307035+0000","modified":"2024-09-21T03:40:51.455331+0000","last_up_change":"2024-09-21T03:39:38.786385+0000","last_in_change":"2024-09-21T03:39:15.267368+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:35:50.488653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:40:25.934375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:40:27.981681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d283ba0-18f3-4668-90c4-884e9e957a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6803","nonce":508132562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6805","nonce":508132562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6809","nonce":508132562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6807","nonce":508132562}]},"public_addr":"172.21.15.84:6803/508132562","cluster_addr":"172.21.15.84:6805/508132562","heartbeat_back_addr":"172.21.15.84:6809/508132562","heartbeat_front_addr":"172.21.15.84:6807/508132562","state":["exists","up"]},{"osd":1,"uuid":"f115c5b6-812d-430f-9f0e-cb5311b7581e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6801","nonce":2931872350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6803","nonce":2931872350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6807","nonce":2931872350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6805","nonce":2931872350}]},"public_addr":"172.21.15.172:6801/2931872350","cluster_addr":"172.21.15.172:6803/2931872350","heartbeat_back_addr":"172.21.15.172:6807/2931872350","heartbeat_front_addr":"172.21.15.172:6805/2931872350","state":["exists","up"]},{"osd":2,"uuid":"36489240-e233-4aa7-ae9c-089d76683172","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6801","nonce":1847612335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6803","nonce":1847612335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6807","nonce":1847612335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6805","nonce":1847612335}]},"public_addr":"172.21.15.174:6801/1847612335","cluster_addr":"172.21.15.174:6803/1847612335","heartbeat_back_addr":"172.21.15.174:6807/1847612335","heartbeat_front_addr":"172.21.15.174:6805/1847612335","state":["exists","up"]},{"osd":3,"uuid":"1f35b404-b658-4e94-a5f4-74a6431a6a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6811","nonce":2230529863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6813","nonce":2230529863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6817","nonce":2230529863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6815","nonce":2230529863}]},"public_addr":"172.21.15.84:6811/2230529863","cluster_addr":"172.21.15.84:6813/2230529863","heartbeat_back_addr":"172.21.15.84:6817/2230529863","heartbeat_front_addr":"172.21.15.84:6815/2230529863","state":["exists","up"]},{"osd":4,"uuid":"91a2f83b-4c7d-4661-86a1-63a09888939d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6809","nonce":3069862739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6811","nonce":3069862739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6815","nonce":3069862739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6813","nonce":3069862739}]},"public_addr":"172.21.15.172:6809/3069862739","cluster_addr":"172.21.15.172:6811/3069862739","heartbeat_back_addr":"172.21.15.172:6815/3069862739","heartbeat_front_addr":"172.21.15.172:6813/3069862739","state":["exists","up"]},{"osd":5,"uuid":"e8f06b34-3956-499f-8073-09011cf1ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6809","nonce":1987010600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6811","nonce":1987010600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6815","nonce":1987010600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6813","nonce":1987010600}]},"public_addr":"172.21.15.174:6809/1987010600","cluster_addr":"172.21.15.174:6811/1987010600","heartbeat_back_addr":"172.21.15.174:6815/1987010600","heartbeat_front_addr":"172.21.15.174:6813/1987010600","state":["exists","up"]},{"osd":6,"uuid":"23d55e96-4987-4cbe-8c6b-cece4de9269b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6819","nonce":3418459345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6821","nonce":3418459345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6825","nonce":3418459345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6823","nonce":3418459345}]},"public_addr":"172.21.15.84:6819/3418459345","cluster_addr":"172.21.15.84:6821/3418459345","heartbeat_back_addr":"172.21.15.84:6825/3418459345","heartbeat_front_addr":"172.21.15.84:6823/3418459345","state":["exists","up"]},{"osd":7,"uuid":"ca91a34c-d8b1-48b8-93f4-72a5c15939d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6817","nonce":4056019738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6819","nonce":4056019738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6823","nonce":4056019738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6821","nonce":4056019738}]},"public_addr":"172.21.15.172:6817/4056019738","cluster_addr":"172.21.15.172:6819/4056019738","heartbeat_back_addr":"172.21.15.172:6823/4056019738","heartbeat_front_addr":"172.21.15.172:6821/4056019738","state":["exists","up"]},{"osd":8,"uuid":"37da8c61-d72f-4b58-b10c-7c7539ecffd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6817","nonce":2162992546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6819","nonce":2162992546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6823","nonce":2162992546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6821","nonce":2162992546}]},"public_addr":"172.21.15.174:6817/2162992546","cluster_addr":"172.21.15.174:6819/2162992546","heartbeat_back_addr":"172.21.15.174:6823/2162992546","heartbeat_front_addr":"172.21.15.174:6821/2162992546","state":["exists","up"]},{"osd":9,"uuid":"c9179f33-622d-44bd-9d8a-c92951afb1e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6827","nonce":3230873673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6829","nonce":3230873673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6833","nonce":3230873673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6831","nonce":3230873673}]},"public_addr":"172.21.15.84:6827/3230873673","cluster_addr":"172.21.15.84:6829/3230873673","heartbeat_back_addr":"172.21.15.84:6833/3230873673","heartbeat_front_addr":"172.21.15.84:6831/3230873673","state":["exists","up"]},{"osd":10,"uuid":"9788fa2d-49fb-431b-a0e3-62d6e421e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6825","nonce":2667099391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6827","nonce":2667099391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6831","nonce":2667099391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6829","nonce":2667099391}]},"public_addr":"172.21.15.172:6825/2667099391","cluster_addr":"172.21.15.172:6827/2667099391","heartbeat_back_addr":"172.21.15.172:6831/2667099391","heartbeat_front_addr":"172.21.15.172:6829/2667099391","state":["exists","up"]},{"osd":11,"uuid":"a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6825","nonce":3452825924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6827","nonce":3452825924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6831","nonce":3452825924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6829","nonce":3452825924}]},"public_addr":"172.21.15.174:6825/3452825924","cluster_addr":"172.21.15.174:6827/3452825924","heartbeat_back_addr":"172.21.15.174:6831/3452825924","heartbeat_front_addr":"172.21.15.174:6829/3452825924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:34:57.413946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:22.813846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:47.074625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:12.871112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:38.705563+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:04.277966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:29.661290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:55.475432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:20.644247+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:46.151594+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:11.499623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:36.688459+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6800/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3308084314":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3663660709":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/1794153935":"2024-09-22T03:32:49.459372+0000","172.21.15.84:6800/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6800/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1874814897":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6801/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/390051797":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/2148206075":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1916019809":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6801/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3491731835":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3418048965":"2024-09-22T03:33:50.188998+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:42:10.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:10.050+0000 7f2d4b528640 1 -- 172.21.15.84:0/3644598141 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2d300b6560 msgr2=0x7f2d300b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:10.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:10.051+0000 7f2d4b528640 1 --2- 172.21.15.84:0/3644598141 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2d300b6560 0x7f2d300b8a70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2d40009b60 tx=0x7f2d40005f90 comp rx=0 tx=0).stop 2024-09-21T03:42:10.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:10.051+0000 7f2d4b528640 1 -- 172.21.15.84:0/3644598141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d441094a0 msgr2=0x7f2d4419cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:10.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:10.051+0000 7f2d4b528640 1 --2- 172.21.15.84:0/3644598141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d441094a0 0x7f2d4419cc60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800d950 tx=0x7f2d3800de10 comp rx=0 tx=0).stop 2024-09-21T03:42:10.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:10.051+0000 7f2d4b528640 1 -- 172.21.15.84:0/3644598141 shutdown_connections 2024-09-21T03:42:10.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:10.051+0000 7f2d4b528640 1 --2- 172.21.15.84:0/3644598141 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2d300b6560 0x7f2d300b8a70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:10.051+0000 7f2d4b528640 1 --2- 172.21.15.84:0/3644598141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2d44109df0 0x7f2d441a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:10.051+0000 7f2d4b528640 1 --2- 172.21.15.84:0/3644598141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2d441094a0 0x7f2d4419cc60 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:10.051+0000 7f2d4b528640 1 --2- 172.21.15.84:0/3644598141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d44103b60 0x7f2d4419c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:10.051+0000 7f2d4b528640 1 -- 172.21.15.84:0/3644598141 >> 172.21.15.84:0/3644598141 conn(0x7f2d4407b850 msgr2=0x7f2d44105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:10.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:10.051+0000 7f2d4b528640 1 -- 172.21.15.84:0/3644598141 shutdown_connections 2024-09-21T03:42:10.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:10.051+0000 7f2d4b528640 1 -- 172.21.15.84:0/3644598141 wait complete. 2024-09-21T03:42:10.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:10 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3644598141' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:42:10.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:10 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3644598141' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:42:10.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:10 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3644598141' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:42:10.805 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T03:40:29.979744+0000', 'modified': '2024-09-21T03:40:41.132161+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24668, 'mds_1': 24638, 'mds_2': 24634}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24607': {'gid': 24607, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.174:6835/3726620036', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6834', 'nonce': 3726620036}, {'type': 'v1', 'addr': '172.21.15.174:6835', 'nonce': 3726620036}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24613': {'gid': 24613, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.174:6837/152508350', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6836', 'nonce': 152508350}, {'type': 'v1', 'addr': '172.21.15.174:6837', 'nonce': 152508350}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24614': {'gid': 24614, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6835/1309799170', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 1309799170}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 1309799170}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24634': {'gid': 24634, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.174:6839/386916231', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6838', 'nonce': 386916231}, {'type': 'v1', 'addr': '172.21.15.174:6839', 'nonce': 386916231}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24638': {'gid': 24638, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.172:6837/2515764700', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 2515764700}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 2515764700}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24668': {'gid': 24668, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.172:6839/3909390777', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 3909390777}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 3909390777}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24668, 'qdb_cluster': [24634, 24638, 24668]} 2024-09-21T03:42:10.805 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T03:42:10.806 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T03:42:11.057 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:11.367 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:11 smithi084 ceph-mon[30941]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:42:11.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:11 smithi174 ceph-mon[34403]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:42:11.400 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:11 smithi172 ceph-mon[34821]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:42:11.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.582+0000 7fee3f10f640 1 -- 172.21.15.84:0/3930694547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee38109500 msgr2=0x7fee38109910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:11.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.582+0000 7fee3f10f640 1 --2- 172.21.15.84:0/3930694547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee38109500 0x7fee38109910 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fee28009900 tx=0x7fee2802a410 comp rx=0 tx=0).stop 2024-09-21T03:42:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.582+0000 7fee3f10f640 1 -- 172.21.15.84:0/3930694547 shutdown_connections 2024-09-21T03:42:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.582+0000 7fee3f10f640 1 --2- 172.21.15.84:0/3930694547 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee38109e50 0x7fee38110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.582+0000 7fee3f10f640 1 --2- 172.21.15.84:0/3930694547 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee38109500 0x7fee38109910 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.582+0000 7fee3f10f640 1 --2- 172.21.15.84:0/3930694547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee38101fc0 0x7fee381023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.582+0000 7fee3f10f640 1 -- 172.21.15.84:0/3930694547 >> 172.21.15.84:0/3930694547 conn(0x7fee38079f90 msgr2=0x7fee3807a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.582+0000 7fee3f10f640 1 -- 172.21.15.84:0/3930694547 shutdown_connections 2024-09-21T03:42:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.582+0000 7fee3f10f640 1 -- 172.21.15.84:0/3930694547 wait complete. 2024-09-21T03:42:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.583+0000 7fee3f10f640 1 Processor -- start 2024-09-21T03:42:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.583+0000 7fee3f10f640 1 -- start start 2024-09-21T03:42:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.583+0000 7fee3f10f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee38101fc0 0x7fee38102f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.583+0000 7fee3f10f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee38109500 0x7fee381034a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.583+0000 7fee3f10f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee38109e50 0x7fee381039e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.583+0000 7fee3f10f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fee38113b30 con 0x7fee38109500 2024-09-21T03:42:11.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.583+0000 7fee3f10f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fee381139b0 con 0x7fee38109e50 2024-09-21T03:42:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.583+0000 7fee3f10f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fee38113cb0 con 0x7fee38101fc0 2024-09-21T03:42:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.583+0000 7fee2ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee38109500 0x7fee381034a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.583+0000 7fee2ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee38109500 0x7fee381034a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50422/0 (socket says 172.21.15.84:50422) 2024-09-21T03:42:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.583+0000 7fee2ffff640 1 -- 172.21.15.84:0/745086475 learned_addr learned my addr 172.21.15.84:0/745086475 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.584+0000 7fee2ffff640 1 -- 172.21.15.84:0/745086475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee38101fc0 msgr2=0x7fee38102f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.584+0000 7fee3ceab640 1 --2- 172.21.15.84:0/745086475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee38101fc0 0x7fee38102f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.584+0000 7fee2ffff640 1 --2- 172.21.15.84:0/745086475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee38101fc0 0x7fee38102f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.584+0000 7fee3d6ac640 1 --2- 172.21.15.84:0/745086475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee38109e50 0x7fee381039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.584+0000 7fee2ffff640 1 -- 172.21.15.84:0/745086475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee38109e50 msgr2=0x7fee381039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.584+0000 7fee2ffff640 1 --2- 172.21.15.84:0/745086475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee38109e50 0x7fee381039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.584+0000 7fee2ffff640 1 -- 172.21.15.84:0/745086475 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee381a8880 con 0x7fee38109500 2024-09-21T03:42:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.584+0000 7fee2ffff640 1 --2- 172.21.15.84:0/745086475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee38109500 0x7fee381034a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fee2802a930 tx=0x7fee28004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.584+0000 7fee2dffb640 1 -- 172.21.15.84:0/745086475 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2803f030 con 0x7fee38109500 2024-09-21T03:42:11.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.584+0000 7fee3f10f640 1 -- 172.21.15.84:0/745086475 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee381a8b10 con 0x7fee38109500 2024-09-21T03:42:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.584+0000 7fee2dffb640 1 -- 172.21.15.84:0/745086475 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee28003aa0 con 0x7fee38109500 2024-09-21T03:42:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.584+0000 7fee2dffb640 1 -- 172.21.15.84:0/745086475 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee28035070 con 0x7fee38109500 2024-09-21T03:42:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.584+0000 7fee3f10f640 1 -- 172.21.15.84:0/745086475 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee381a9040 con 0x7fee38109500 2024-09-21T03:42:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.587+0000 7fee45683740 1 Processor -- start 2024-09-21T03:42:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.587+0000 7fee45683740 1 -- start start 2024-09-21T03:42:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.587+0000 7fee2dffb640 1 -- 172.21.15.84:0/745086475 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fee28042030 con 0x7fee38109500 2024-09-21T03:42:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.587+0000 7fee45683740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555cb8f71f60 0x555cb9317f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.587+0000 7fee45683740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f490a0 0x555cb9318440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.587+0000 7fee45683740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f51280 0x555cb9318980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.587+0000 7fee45683740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555cb928fc10 con 0x555cb8f490a0 2024-09-21T03:42:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.587+0000 7fee45683740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555cb927f040 con 0x555cb8f51280 2024-09-21T03:42:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.587+0000 7fee45683740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x555cb9282e50 con 0x555cb8f71f60 2024-09-21T03:42:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.587+0000 7fee3ceab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f490a0 0x555cb9318440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.587+0000 7fee3ceab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f490a0 0x555cb9318440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50430/0 (socket says 172.21.15.84:50430) 2024-09-21T03:42:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.587+0000 7fee3ceab640 1 -- 172.21.15.84:0/2714678741 learned_addr learned my addr 172.21.15.84:0/2714678741 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.587+0000 7fee2ffff640 1 --2- 172.21.15.84:0/2714678741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f51280 0x555cb9318980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.587+0000 7fee3d6ac640 1 --2- 172.21.15.84:0/2714678741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555cb8f71f60 0x555cb9317f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.588+0000 7fee3ceab640 1 -- 172.21.15.84:0/2714678741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555cb8f71f60 msgr2=0x555cb9317f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.588+0000 7fee3ceab640 1 --2- 172.21.15.84:0/2714678741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555cb8f71f60 0x555cb9317f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.588+0000 7fee3ceab640 1 -- 172.21.15.84:0/2714678741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f51280 msgr2=0x555cb9318980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.588+0000 7fee3ceab640 1 --2- 172.21.15.84:0/2714678741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f51280 0x555cb9318980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.588+0000 7fee3ceab640 1 -- 172.21.15.84:0/2714678741 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cb8fdd540 con 0x555cb8f490a0 2024-09-21T03:42:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.588+0000 7fee3ceab640 1 --2- 172.21.15.84:0/2714678741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f490a0 0x555cb9318440 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fee34009b90 tx=0x7fee3400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33aa5e921da4c47f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.588+0000 7fee2dffb640 1 --2- 172.21.15.84:0/745086475 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fee200b6560 0x7fee200b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.588+0000 7fee1effd640 1 -- 172.21.15.84:0/2714678741 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee34016070 con 0x555cb8f490a0 2024-09-21T03:42:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.588+0000 7fee3d6ac640 1 --2- 172.21.15.84:0/745086475 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fee200b6560 0x7fee200b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.588+0000 7fee1effd640 1 -- 172.21.15.84:0/2714678741 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee34011920 con 0x555cb8f490a0 2024-09-21T03:42:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.588+0000 7fee1effd640 1 -- 172.21.15.84:0/2714678741 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee34010730 con 0x555cb8f490a0 2024-09-21T03:42:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.588+0000 7fee2dffb640 1 -- 172.21.15.84:0/745086475 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fee28107be0 con 0x7fee38109500 2024-09-21T03:42:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.589+0000 7fee45683740 1 -- 172.21.15.84:0/2714678741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f490a0 msgr2=0x555cb9318440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.589+0000 7fee45683740 1 --2- 172.21.15.84:0/2714678741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f490a0 0x555cb9318440 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fee34009b90 tx=0x7fee3400e6c0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.589+0000 7fee3d6ac640 1 --2- 172.21.15.84:0/745086475 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fee200b6560 0x7fee200b8a70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fee30007ed0 tx=0x7fee300075c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.589+0000 7fee45683740 1 -- 172.21.15.84:0/2714678741 shutdown_connections 2024-09-21T03:42:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.589+0000 7fee45683740 1 --2- 172.21.15.84:0/2714678741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f51280 0x555cb9318980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.589+0000 7fee45683740 1 --2- 172.21.15.84:0/2714678741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f490a0 0x555cb9318440 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.589+0000 7fee45683740 1 --2- 172.21.15.84:0/2714678741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555cb8f71f60 0x555cb9317f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.589+0000 7fee45683740 1 -- 172.21.15.84:0/2714678741 >> 172.21.15.84:0/2714678741 conn(0x555cb8f66350 msgr2=0x555cb9315df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.589+0000 7fee45683740 1 -- 172.21.15.84:0/2714678741 shutdown_connections 2024-09-21T03:42:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.589+0000 7fee45683740 1 -- 172.21.15.84:0/2714678741 wait complete. 2024-09-21T03:42:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.589+0000 7fee45683740 1 -- start start 2024-09-21T03:42:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.590+0000 7fee45683740 1 Processor -- start 2024-09-21T03:42:11.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.590+0000 7fee45683740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f490a0 0x555cb93237d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.590+0000 7fee45683740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555cb8f51280 0x555cb9323db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.590+0000 7fee45683740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f71f60 0x555cb932fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.590+0000 7fee45683740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555cb90e05f0 con 0x555cb8f71f60 2024-09-21T03:42:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.590+0000 7fee45683740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555cb921a010 con 0x555cb8f490a0 2024-09-21T03:42:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.590+0000 7fee45683740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x555cb93266e0 con 0x555cb8f51280 2024-09-21T03:42:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.590+0000 7fee45683740 10 client.0 _ll_register_callbacks cb 0x555cb9279340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.590+0000 7fee3d6ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f71f60 0x555cb932fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.590+0000 7fee3d6ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f71f60 0x555cb932fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50444/0 (socket says 172.21.15.84:50444) 2024-09-21T03:42:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.590+0000 7fee3d6ac640 1 -- 172.21.15.84:0/939853981 learned_addr learned my addr 172.21.15.84:0/939853981 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.590+0000 7fee3ceab640 1 --2- 172.21.15.84:0/939853981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f490a0 0x555cb93237d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.590+0000 7fee2ffff640 1 --2- 172.21.15.84:0/939853981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555cb8f51280 0x555cb9323db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.590+0000 7fee3d6ac640 1 -- 172.21.15.84:0/939853981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555cb8f51280 msgr2=0x555cb9323db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.590+0000 7fee3d6ac640 1 --2- 172.21.15.84:0/939853981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555cb8f51280 0x555cb9323db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.590+0000 7fee3d6ac640 1 -- 172.21.15.84:0/939853981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f490a0 msgr2=0x555cb93237d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:11.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.591+0000 7fee3d6ac640 1 --2- 172.21.15.84:0/939853981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f490a0 0x555cb93237d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.591+0000 7fee3d6ac640 1 -- 172.21.15.84:0/939853981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cb9247a00 con 0x555cb8f71f60 2024-09-21T03:42:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.591+0000 7fee3d6ac640 1 --2- 172.21.15.84:0/939853981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f71f60 0x555cb932fa00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fee30012e00 tx=0x7fee30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ada14c7bbd2dc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.591+0000 7fee17fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:42:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.591+0000 7fee17fff640 1 -- 172.21.15.84:0/939853981 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee30023020 con 0x555cb8f71f60 2024-09-21T03:42:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.591+0000 7fee17fff640 1 -- 172.21.15.84:0/939853981 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fee3001f440 con 0x555cb8f71f60 2024-09-21T03:42:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.591+0000 7fee45683740 1 -- 172.21.15.84:0/939853981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee34011920 con 0x555cb8f71f60 2024-09-21T03:42:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.591+0000 7fee17fff640 1 -- 172.21.15.84:0/939853981 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fee3002e050 con 0x555cb8f71f60 2024-09-21T03:42:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.591+0000 7fee45683740 10 client.15342 fetch_fsmap learned FSMap version 24 2024-09-21T03:42:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.591+0000 7fee45683740 1 -- 172.21.15.84:0/939853981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555cb9332630 con 0x555cb8f71f60 2024-09-21T03:42:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.591+0000 7fee17fff640 1 -- 172.21.15.84:0/939853981 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee34011920 con 0x555cb8f71f60 2024-09-21T03:42:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.591+0000 7fee17fff640 1 -- 172.21.15.84:0/939853981 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fee30011040 con 0x555cb8f71f60 2024-09-21T03:42:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.592+0000 7fee45683740 10 client.15342 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:42:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.592+0000 7fee45683740 10 client.15342 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T03:42:11.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.592+0000 7fee45683740 20 client.15342 populate_metadata read hostname 'smithi084' 2024-09-21T03:42:11.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.592+0000 7fee45683740 1 --2- 172.21.15.84:0/939853981 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x555cb8f308e0 0x555cb9336170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.592+0000 7fee45683740 4 client.15342 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:42:11.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.592+0000 7fee45683740 1 -- 172.21.15.84:0/939853981 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cb9291b60 con 0x555cb8f308e0 2024-09-21T03:42:11.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.592+0000 7fee3ceab640 1 --2- 172.21.15.84:0/939853981 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x555cb8f308e0 0x555cb9336170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.592+0000 7fee17fff640 10 client.15342 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:42:11.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.592+0000 7fee3ceab640 1 --2- 172.21.15.84:0/939853981 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x555cb8f308e0 0x555cb9336170 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=86519d32970ba41 server_cookie=1dbba3d79d154497 in_seq=0 out_seq=0 2024-09-21T03:42:11.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.593+0000 7fee17fff640 1 -- 172.21.15.84:0/939853981 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555cb9291b60 con 0x555cb8f308e0 2024-09-21T03:42:11.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.593+0000 7fee17fff640 10 client.15342 handle_command_reply: tid=0 2024-09-21T03:42:11.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.593+0000 7fee45683740 1 client.15342 shutdown 2024-09-21T03:42:11.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.593+0000 7fee45683740 1 -- 172.21.15.84:0/939853981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f71f60 msgr2=0x555cb932fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:11.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.593+0000 7fee45683740 1 --2- 172.21.15.84:0/939853981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f71f60 0x555cb932fa00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fee30012e00 tx=0x7fee30004a40 comp rx=0 tx=0).stop 2024-09-21T03:42:11.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.593+0000 7fee45683740 1 -- 172.21.15.84:0/939853981 shutdown_connections 2024-09-21T03:42:11.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.593+0000 7fee45683740 1 --2- 172.21.15.84:0/939853981 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x555cb8f308e0 0x555cb9336170 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.593+0000 7fee45683740 1 --2- 172.21.15.84:0/939853981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f71f60 0x555cb932fa00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.593+0000 7fee17fff640 0 client.15342 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:42:11.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.593+0000 7fee45683740 1 --2- 172.21.15.84:0/939853981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555cb8f51280 0x555cb9323db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.593+0000 7fee45683740 1 --2- 172.21.15.84:0/939853981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f490a0 0x555cb93237d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.593+0000 7fee45683740 1 -- 172.21.15.84:0/939853981 >> 172.21.15.84:0/939853981 conn(0x555cb8f66350 msgr2=0x555cb931b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:11.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.594+0000 7fee45683740 1 -- 172.21.15.84:0/939853981 shutdown_connections 2024-09-21T03:42:11.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.594+0000 7fee45683740 1 -- 172.21.15.84:0/939853981 wait complete. 2024-09-21T03:42:11.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.594+0000 7fee45683740 20 client.15342 trim_cache size 0 max 16384 2024-09-21T03:42:11.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.611+0000 7fee45683740 1 Processor -- start 2024-09-21T03:42:11.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.611+0000 7fee45683740 1 -- start start 2024-09-21T03:42:11.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee45683740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f308e0 0x555cb931e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee45683740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555cb8f490a0 0x555cb9315d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee45683740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f51280 0x555cb932f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee45683740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555cb93344b0 con 0x555cb8f51280 2024-09-21T03:42:11.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee45683740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555cb9334b80 con 0x555cb8f308e0 2024-09-21T03:42:11.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee45683740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x555cb9335250 con 0x555cb8f490a0 2024-09-21T03:42:11.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee3d6ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f51280 0x555cb932f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee3d6ac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f51280 0x555cb932f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50456/0 (socket says 172.21.15.84:50456) 2024-09-21T03:42:11.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee3d6ac640 1 -- 172.21.15.84:0/4000705508 learned_addr learned my addr 172.21.15.84:0/4000705508 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:11.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee2ffff640 1 --2- 172.21.15.84:0/4000705508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555cb8f490a0 0x555cb9315d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee3d6ac640 1 -- 172.21.15.84:0/4000705508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555cb8f490a0 msgr2=0x555cb9315d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:11.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee3ceab640 1 --2- 172.21.15.84:0/4000705508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f308e0 0x555cb931e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee3d6ac640 1 --2- 172.21.15.84:0/4000705508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555cb8f490a0 0x555cb9315d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee3d6ac640 1 -- 172.21.15.84:0/4000705508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f308e0 msgr2=0x555cb931e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:11.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee3d6ac640 1 --2- 172.21.15.84:0/4000705508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f308e0 0x555cb931e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee3d6ac640 1 -- 172.21.15.84:0/4000705508 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cb931a790 con 0x555cb8f51280 2024-09-21T03:42:11.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee3ceab640 1 --2- 172.21.15.84:0/4000705508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f308e0 0x555cb931e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:11.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee3d6ac640 1 --2- 172.21.15.84:0/4000705508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f51280 0x555cb932f970 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fee30014040 tx=0x7fee3000fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb27b8494ccc6372 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:11.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee1e7fc640 1 -- 172.21.15.84:0/4000705508 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee30036020 con 0x555cb8f51280 2024-09-21T03:42:11.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee1e7fc640 1 -- 172.21.15.84:0/4000705508 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee30018030 con 0x555cb8f51280 2024-09-21T03:42:11.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.612+0000 7fee1e7fc640 1 -- 172.21.15.84:0/4000705508 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee30023070 con 0x555cb8f51280 2024-09-21T03:42:11.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.613+0000 7fee45683740 1 -- 172.21.15.84:0/4000705508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f51280 msgr2=0x555cb932f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:11.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.613+0000 7fee45683740 1 --2- 172.21.15.84:0/4000705508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f51280 0x555cb932f970 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fee30014040 tx=0x7fee3000fb60 comp rx=0 tx=0).stop 2024-09-21T03:42:11.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.613+0000 7fee45683740 1 -- 172.21.15.84:0/4000705508 shutdown_connections 2024-09-21T03:42:11.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.613+0000 7fee45683740 1 --2- 172.21.15.84:0/4000705508 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f51280 0x555cb932f970 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.613+0000 7fee45683740 1 --2- 172.21.15.84:0/4000705508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555cb8f490a0 0x555cb9315d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.613+0000 7fee45683740 1 --2- 172.21.15.84:0/4000705508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f308e0 0x555cb931e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.613+0000 7fee45683740 1 -- 172.21.15.84:0/4000705508 >> 172.21.15.84:0/4000705508 conn(0x555cb8f66350 msgr2=0x555cb9315600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:11.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.613+0000 7fee45683740 1 -- 172.21.15.84:0/4000705508 shutdown_connections 2024-09-21T03:42:11.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.613+0000 7fee45683740 1 -- 172.21.15.84:0/4000705508 wait complete. 2024-09-21T03:42:11.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.614+0000 7fee45683740 1 -- start start 2024-09-21T03:42:11.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.614+0000 7fee45683740 1 Processor -- start 2024-09-21T03:42:11.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.614+0000 7fee45683740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f308e0 0x555cb9338820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.614+0000 7fee45683740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555cb8f490a0 0x555cb9338dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.614+0000 7fee45683740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f51280 0x555cb933dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.614+0000 7fee45683740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555cb9335ff0 con 0x555cb8f308e0 2024-09-21T03:42:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.614+0000 7fee45683740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555cb9335920 con 0x555cb8f51280 2024-09-21T03:42:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.614+0000 7fee45683740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x555cb93366c0 con 0x555cb8f490a0 2024-09-21T03:42:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.614+0000 7fee3ceab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f308e0 0x555cb9338820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.614+0000 7fee45683740 10 client.0 _ll_register_callbacks cb 0x7fee30007b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.614+0000 7fee3ceab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f308e0 0x555cb9338820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50460/0 (socket says 172.21.15.84:50460) 2024-09-21T03:42:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.614+0000 7fee3ceab640 1 -- 172.21.15.84:0/2770466352 learned_addr learned my addr 172.21.15.84:0/2770466352 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.615+0000 7fee3d6ac640 1 --2- 172.21.15.84:0/2770466352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f51280 0x555cb933dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.615+0000 7fee3ceab640 1 -- 172.21.15.84:0/2770466352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555cb8f490a0 msgr2=0x555cb9338dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.615+0000 7fee3ceab640 1 --2- 172.21.15.84:0/2770466352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555cb8f490a0 0x555cb9338dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.615+0000 7fee3ceab640 1 -- 172.21.15.84:0/2770466352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f51280 msgr2=0x555cb933dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.615+0000 7fee3ceab640 1 --2- 172.21.15.84:0/2770466352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f51280 0x555cb933dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.615+0000 7fee3ceab640 1 -- 172.21.15.84:0/2770466352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cb9324120 con 0x555cb8f308e0 2024-09-21T03:42:11.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.615+0000 7fee3d6ac640 1 --2- 172.21.15.84:0/2770466352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f51280 0x555cb933dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:11.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.615+0000 7fee3ceab640 1 --2- 172.21.15.84:0/2770466352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f308e0 0x555cb9338820 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fee34009ab0 tx=0x7fee34009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c5d8f1a9380822 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:11.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.615+0000 7fee17fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:42:11.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.615+0000 7fee17fff640 1 -- 172.21.15.84:0/2770466352 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee34016040 con 0x555cb8f308e0 2024-09-21T03:42:11.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.615+0000 7fee17fff640 1 -- 172.21.15.84:0/2770466352 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fee34005230 con 0x555cb8f308e0 2024-09-21T03:42:11.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.615+0000 7fee45683740 1 -- 172.21.15.84:0/2770466352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee30018030 con 0x555cb8f308e0 2024-09-21T03:42:11.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.615+0000 7fee17fff640 1 -- 172.21.15.84:0/2770466352 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fee34005430 con 0x555cb8f308e0 2024-09-21T03:42:11.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.615+0000 7fee45683740 10 client.15348 fetch_fsmap learned FSMap version 24 2024-09-21T03:42:11.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.615+0000 7fee45683740 1 -- 172.21.15.84:0/2770466352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555cb93a1ac0 con 0x555cb8f308e0 2024-09-21T03:42:11.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.615+0000 7fee17fff640 1 -- 172.21.15.84:0/2770466352 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee30018030 con 0x555cb8f308e0 2024-09-21T03:42:11.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.616+0000 7fee17fff640 1 -- 172.21.15.84:0/2770466352 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fee3402d070 con 0x555cb8f308e0 2024-09-21T03:42:11.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.616+0000 7fee45683740 10 client.15348 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:42:11.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.616+0000 7fee45683740 10 client.15348 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T03:42:11.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.616+0000 7fee45683740 20 client.15348 populate_metadata read hostname 'smithi084' 2024-09-21T03:42:11.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.616+0000 7fee45683740 1 --2- 172.21.15.84:0/2770466352 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x555cb8f71f60 0x555cb93a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.616+0000 7fee45683740 4 client.15348 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:42:11.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.616+0000 7fee45683740 1 -- 172.21.15.84:0/2770466352 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "status"}) -- 0x555cb928d610 con 0x555cb8f71f60 2024-09-21T03:42:11.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.616+0000 7fee2ffff640 1 --2- 172.21.15.84:0/2770466352 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x555cb8f71f60 0x555cb93a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.616+0000 7fee17fff640 10 client.15348 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:42:11.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.616+0000 7fee2ffff640 1 --2- 172.21.15.84:0/2770466352 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x555cb8f71f60 0x555cb93a52a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=87eb6e22c36bd46f server_cookie=2c5e3dd08ce04094 in_seq=0 out_seq=0 2024-09-21T03:42:11.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.617+0000 7fee17fff640 1 -- 172.21.15.84:0/2770466352 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x555cb928d610 con 0x555cb8f71f60 2024-09-21T03:42:11.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.617+0000 7fee17fff640 10 client.15348 handle_command_reply: tid=0 2024-09-21T03:42:11.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.617+0000 7fee45683740 1 client.15348 shutdown 2024-09-21T03:42:11.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.617+0000 7fee45683740 1 -- 172.21.15.84:0/2770466352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f308e0 msgr2=0x555cb9338820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:11.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.617+0000 7fee45683740 1 --2- 172.21.15.84:0/2770466352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f308e0 0x555cb9338820 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fee34009ab0 tx=0x7fee34009330 comp rx=0 tx=0).stop 2024-09-21T03:42:11.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.617+0000 7fee45683740 1 -- 172.21.15.84:0/2770466352 shutdown_connections 2024-09-21T03:42:11.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.617+0000 7fee45683740 1 --2- 172.21.15.84:0/2770466352 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x555cb8f71f60 0x555cb93a52a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.617+0000 7fee45683740 1 --2- 172.21.15.84:0/2770466352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555cb8f51280 0x555cb933dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.617+0000 7fee45683740 1 --2- 172.21.15.84:0/2770466352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555cb8f490a0 0x555cb9338dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.617+0000 7fee45683740 1 --2- 172.21.15.84:0/2770466352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555cb8f308e0 0x555cb9338820 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.617+0000 7fee45683740 1 -- 172.21.15.84:0/2770466352 >> 172.21.15.84:0/2770466352 conn(0x555cb8f66350 msgr2=0x555cb9315d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:11.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.617+0000 7fee17fff640 0 client.15348 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:42:11.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.617+0000 7fee45683740 1 -- 172.21.15.84:0/2770466352 shutdown_connections 2024-09-21T03:42:11.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.617+0000 7fee45683740 1 -- 172.21.15.84:0/2770466352 wait complete. 2024-09-21T03:42:11.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.617+0000 7fee45683740 20 client.15348 trim_cache size 0 max 16384 2024-09-21T03:42:11.626 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:42:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "e3f8c18e-77c9-11ef-baf5-efdc52797490", 2024-09-21T03:42:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 2, 2024-09-21T03:42:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24634, 2024-09-21T03:42:11.626 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T03:42:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T03:42:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T03:42:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 93.215342436, 2024-09-21T03:42:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 24, 2024-09-21T03:42:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 77, 2024-09-21T03:42:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T03:42:11.627 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 120.671190389 2024-09-21T03:42:11.627 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:42:11.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.618+0000 7fee3f10f640 1 -- 172.21.15.84:0/745086475 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fee200b6560 msgr2=0x7fee200b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:11.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.618+0000 7fee3f10f640 1 --2- 172.21.15.84:0/745086475 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fee200b6560 0x7fee200b8a70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fee30007ed0 tx=0x7fee300075c0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.618+0000 7fee3f10f640 1 -- 172.21.15.84:0/745086475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee38109500 msgr2=0x7fee381034a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:11.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.618+0000 7fee3f10f640 1 --2- 172.21.15.84:0/745086475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee38109500 0x7fee381034a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fee2802a930 tx=0x7fee28004270 comp rx=0 tx=0).stop 2024-09-21T03:42:11.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.618+0000 7fee3f10f640 1 -- 172.21.15.84:0/745086475 shutdown_connections 2024-09-21T03:42:11.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.618+0000 7fee3f10f640 1 --2- 172.21.15.84:0/745086475 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fee200b6560 0x7fee200b8a70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.618+0000 7fee3f10f640 1 --2- 172.21.15.84:0/745086475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee38109e50 0x7fee381039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.618+0000 7fee3f10f640 1 --2- 172.21.15.84:0/745086475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fee38109500 0x7fee381034a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.618+0000 7fee3f10f640 1 --2- 172.21.15.84:0/745086475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fee38101fc0 0x7fee38102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.618+0000 7fee3f10f640 1 -- 172.21.15.84:0/745086475 >> 172.21.15.84:0/745086475 conn(0x7fee38079f90 msgr2=0x7fee38107600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:11.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.618+0000 7fee3f10f640 1 -- 172.21.15.84:0/745086475 shutdown_connections 2024-09-21T03:42:11.628 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:11.618+0000 7fee3f10f640 1 -- 172.21.15.84:0/745086475 wait complete. 2024-09-21T03:42:12.342 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T03:42:12.589 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:13.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.086+0000 7fea2bb12640 1 -- 172.21.15.84:0/2059283812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea241094a0 msgr2=0x7fea241098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:13.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.086+0000 7fea2bb12640 1 --2- 172.21.15.84:0/2059283812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea241094a0 0x7fea241098b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fea20009900 tx=0x7fea2002a410 comp rx=0 tx=0).stop 2024-09-21T03:42:13.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.086+0000 7fea2bb12640 1 -- 172.21.15.84:0/2059283812 shutdown_connections 2024-09-21T03:42:13.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.086+0000 7fea2bb12640 1 --2- 172.21.15.84:0/2059283812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea24109df0 0x7fea24110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.086+0000 7fea2bb12640 1 --2- 172.21.15.84:0/2059283812 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea241094a0 0x7fea241098b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.086+0000 7fea2bb12640 1 --2- 172.21.15.84:0/2059283812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea24103b60 0x7fea24103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.086+0000 7fea2bb12640 1 -- 172.21.15.84:0/2059283812 >> 172.21.15.84:0/2059283812 conn(0x7fea2407b850 msgr2=0x7fea2407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:13.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.086+0000 7fea2bb12640 1 -- 172.21.15.84:0/2059283812 shutdown_connections 2024-09-21T03:42:13.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.087+0000 7fea2bb12640 1 -- 172.21.15.84:0/2059283812 wait complete. 2024-09-21T03:42:13.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.087+0000 7fea2bb12640 1 Processor -- start 2024-09-21T03:42:13.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.087+0000 7fea2bb12640 1 -- start start 2024-09-21T03:42:13.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.087+0000 7fea2bb12640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea24103b60 0x7fea2419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.087+0000 7fea2bb12640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea241094a0 0x7fea2419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.087+0000 7fea2bb12640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea24109df0 0x7fea2419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.088+0000 7fea2bb12640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fea24113ab0 con 0x7fea241094a0 2024-09-21T03:42:13.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.088+0000 7fea2bb12640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fea24113930 con 0x7fea24103b60 2024-09-21T03:42:13.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.088+0000 7fea2bb12640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fea24113c30 con 0x7fea24109df0 2024-09-21T03:42:13.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.088+0000 7fea290ad640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea241094a0 0x7fea2419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.088+0000 7fea290ad640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea241094a0 0x7fea2419ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50488/0 (socket says 172.21.15.84:50488) 2024-09-21T03:42:13.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.088+0000 7fea290ad640 1 -- 172.21.15.84:0/2030698530 learned_addr learned my addr 172.21.15.84:0/2030698530 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:13.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.088+0000 7fea298ae640 1 --2- 172.21.15.84:0/2030698530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea24103b60 0x7fea2419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.088+0000 7fea2a0af640 1 --2- 172.21.15.84:0/2030698530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea24109df0 0x7fea2419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.088+0000 7fea290ad640 1 -- 172.21.15.84:0/2030698530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea24109df0 msgr2=0x7fea2419fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:13.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.088+0000 7fea290ad640 1 --2- 172.21.15.84:0/2030698530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea24109df0 0x7fea2419fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.088+0000 7fea290ad640 1 -- 172.21.15.84:0/2030698530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea24103b60 msgr2=0x7fea2419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:13.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.088+0000 7fea290ad640 1 --2- 172.21.15.84:0/2030698530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea24103b60 0x7fea2419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.088+0000 7fea290ad640 1 -- 172.21.15.84:0/2030698530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea241a0450 con 0x7fea241094a0 2024-09-21T03:42:13.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.088+0000 7fea298ae640 1 --2- 172.21.15.84:0/2030698530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea24103b60 0x7fea2419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:13.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.088+0000 7fea290ad640 1 --2- 172.21.15.84:0/2030698530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea241094a0 0x7fea2419ab40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fea2002a930 tx=0x7fea20004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:13.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.088+0000 7fea16ffd640 1 -- 172.21.15.84:0/2030698530 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea2003f030 con 0x7fea241094a0 2024-09-21T03:42:13.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.088+0000 7fea16ffd640 1 -- 172.21.15.84:0/2030698530 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea20003aa0 con 0x7fea241094a0 2024-09-21T03:42:13.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.088+0000 7fea2bb12640 1 -- 172.21.15.84:0/2030698530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea241a06e0 con 0x7fea241094a0 2024-09-21T03:42:13.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.088+0000 7fea16ffd640 1 -- 172.21.15.84:0/2030698530 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea20035070 con 0x7fea241094a0 2024-09-21T03:42:13.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.088+0000 7fea2bb12640 1 -- 172.21.15.84:0/2030698530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea241a0bc0 con 0x7fea241094a0 2024-09-21T03:42:13.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.091+0000 7fea16ffd640 1 -- 172.21.15.84:0/2030698530 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fea20042030 con 0x7fea241094a0 2024-09-21T03:42:13.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.091+0000 7fea32086740 1 Processor -- start 2024-09-21T03:42:13.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.091+0000 7fea32086740 1 -- start start 2024-09-21T03:42:13.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.091+0000 7fea32086740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b82ff60 0x55831bbd5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.091+0000 7fea32086740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b8070a0 0x55831bbd6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.091+0000 7fea32086740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b80f280 0x55831bbd6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.091+0000 7fea32086740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55831bb4dc10 con 0x55831b8070a0 2024-09-21T03:42:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.091+0000 7fea32086740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55831bb3d040 con 0x55831b82ff60 2024-09-21T03:42:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.091+0000 7fea32086740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55831bb40e50 con 0x55831b80f280 2024-09-21T03:42:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.091+0000 7fea298ae640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b8070a0 0x55831bbd6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.092+0000 7fea298ae640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b8070a0 0x55831bbd6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50498/0 (socket says 172.21.15.84:50498) 2024-09-21T03:42:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.092+0000 7fea298ae640 1 -- 172.21.15.84:0/3267851045 learned_addr learned my addr 172.21.15.84:0/3267851045 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.092+0000 7fea290ad640 1 --2- 172.21.15.84:0/3267851045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b80f280 0x55831bbd6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.092+0000 7fea2a0af640 1 --2- 172.21.15.84:0/3267851045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b82ff60 0x55831bbd5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.092+0000 7fea16ffd640 1 --2- 172.21.15.84:0/2030698530 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fea100b6590 0x7fea100b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.092+0000 7fea298ae640 1 -- 172.21.15.84:0/3267851045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b80f280 msgr2=0x55831bbd6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.092+0000 7fea298ae640 1 --2- 172.21.15.84:0/3267851045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b80f280 0x55831bbd6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.092+0000 7fea298ae640 1 -- 172.21.15.84:0/3267851045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b82ff60 msgr2=0x55831bbd5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.092+0000 7fea298ae640 1 --2- 172.21.15.84:0/3267851045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b82ff60 0x55831bbd5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.092+0000 7fea298ae640 1 -- 172.21.15.84:0/3267851045 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55831b89b540 con 0x55831b8070a0 2024-09-21T03:42:13.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.092+0000 7fea2a0af640 1 --2- 172.21.15.84:0/3267851045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b82ff60 0x55831bbd5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:13.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.092+0000 7fea2a0af640 1 --2- 172.21.15.84:0/2030698530 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fea100b6590 0x7fea100b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.092+0000 7fea290ad640 1 --2- 172.21.15.84:0/3267851045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b80f280 0x55831bbd6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:13.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.092+0000 7fea16ffd640 1 -- 172.21.15.84:0/2030698530 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fea20107860 con 0x7fea241094a0 2024-09-21T03:42:13.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.092+0000 7fea298ae640 1 --2- 172.21.15.84:0/3267851045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b8070a0 0x55831bbd6440 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fea1800bd40 tx=0x7fea1800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd76d2ec524b7185 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:13.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.092+0000 7fea0ffff640 1 -- 172.21.15.84:0/3267851045 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18015070 con 0x55831b8070a0 2024-09-21T03:42:13.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.092+0000 7fea0ffff640 1 -- 172.21.15.84:0/3267851045 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea1801a910 con 0x55831b8070a0 2024-09-21T03:42:13.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.092+0000 7fea0ffff640 1 -- 172.21.15.84:0/3267851045 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18011920 con 0x55831b8070a0 2024-09-21T03:42:13.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.093+0000 7fea32086740 1 -- 172.21.15.84:0/3267851045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b8070a0 msgr2=0x55831bbd6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:13.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.093+0000 7fea32086740 1 --2- 172.21.15.84:0/3267851045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b8070a0 0x55831bbd6440 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fea1800bd40 tx=0x7fea1800f730 comp rx=0 tx=0).stop 2024-09-21T03:42:13.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.093+0000 7fea2a0af640 1 --2- 172.21.15.84:0/2030698530 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fea100b6590 0x7fea100b8aa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fea1c00add0 tx=0x7fea1c004a40 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.093+0000 7fea32086740 1 -- 172.21.15.84:0/3267851045 shutdown_connections 2024-09-21T03:42:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.093+0000 7fea32086740 1 --2- 172.21.15.84:0/3267851045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b80f280 0x55831bbd6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.093+0000 7fea32086740 1 --2- 172.21.15.84:0/3267851045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b8070a0 0x55831bbd6440 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.093+0000 7fea32086740 1 --2- 172.21.15.84:0/3267851045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b82ff60 0x55831bbd5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.093+0000 7fea32086740 1 -- 172.21.15.84:0/3267851045 >> 172.21.15.84:0/3267851045 conn(0x55831b824350 msgr2=0x55831bbd3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.093+0000 7fea32086740 1 -- 172.21.15.84:0/3267851045 shutdown_connections 2024-09-21T03:42:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.094+0000 7fea32086740 1 -- 172.21.15.84:0/3267851045 wait complete. 2024-09-21T03:42:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.094+0000 7fea32086740 1 -- start start 2024-09-21T03:42:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.094+0000 7fea32086740 1 Processor -- start 2024-09-21T03:42:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.094+0000 7fea32086740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b8070a0 0x55831bbe5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.094+0000 7fea32086740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b80f280 0x55831bbe6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.094+0000 7fea32086740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b82ff60 0x55831bbf1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.094+0000 7fea32086740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55831b99e5f0 con 0x55831b82ff60 2024-09-21T03:42:13.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.094+0000 7fea32086740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55831bad8010 con 0x55831b80f280 2024-09-21T03:42:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.094+0000 7fea32086740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55831bbe8a40 con 0x55831b8070a0 2024-09-21T03:42:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.094+0000 7fea32086740 10 client.0 _ll_register_callbacks cb 0x55831bb37340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.095+0000 7fea2a0af640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b82ff60 0x55831bbf1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.095+0000 7fea2a0af640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b82ff60 0x55831bbf1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50514/0 (socket says 172.21.15.84:50514) 2024-09-21T03:42:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.095+0000 7fea2a0af640 1 -- 172.21.15.84:0/1402126164 learned_addr learned my addr 172.21.15.84:0/1402126164 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.095+0000 7fea298ae640 1 --2- 172.21.15.84:0/1402126164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b8070a0 0x55831bbe5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.095+0000 7fea290ad640 1 --2- 172.21.15.84:0/1402126164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b80f280 0x55831bbe6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.095+0000 7fea2a0af640 1 -- 172.21.15.84:0/1402126164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b8070a0 msgr2=0x55831bbe5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.095+0000 7fea2a0af640 1 --2- 172.21.15.84:0/1402126164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b8070a0 0x55831bbe5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.095+0000 7fea2a0af640 1 -- 172.21.15.84:0/1402126164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b80f280 msgr2=0x55831bbe6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.095+0000 7fea2a0af640 1 --2- 172.21.15.84:0/1402126164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b80f280 0x55831bbe6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.095+0000 7fea2a0af640 1 -- 172.21.15.84:0/1402126164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55831bb05a00 con 0x55831b82ff60 2024-09-21T03:42:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.095+0000 7fea2a0af640 1 --2- 172.21.15.84:0/1402126164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b82ff60 0x55831bbf1dd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fea1c010e30 tx=0x7fea1c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4cd20fe9b55271 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.095+0000 7fea0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:42:13.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.095+0000 7fea0d7fa640 1 -- 172.21.15.84:0/1402126164 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c026480 con 0x55831b82ff60 2024-09-21T03:42:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.095+0000 7fea0d7fa640 1 -- 172.21.15.84:0/1402126164 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fea1c01d420 con 0x55831b82ff60 2024-09-21T03:42:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.095+0000 7fea32086740 1 -- 172.21.15.84:0/1402126164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea1801a910 con 0x55831b82ff60 2024-09-21T03:42:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.095+0000 7fea0d7fa640 1 -- 172.21.15.84:0/1402126164 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fea1c026620 con 0x55831b82ff60 2024-09-21T03:42:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.095+0000 7fea32086740 10 client.15360 fetch_fsmap learned FSMap version 24 2024-09-21T03:42:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.095+0000 7fea32086740 1 -- 172.21.15.84:0/1402126164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55831bbf49a0 con 0x55831b82ff60 2024-09-21T03:42:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.096+0000 7fea0d7fa640 1 -- 172.21.15.84:0/1402126164 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea1801a910 con 0x55831b82ff60 2024-09-21T03:42:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.096+0000 7fea0d7fa640 1 -- 172.21.15.84:0/1402126164 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fea1c01c6b0 con 0x55831b82ff60 2024-09-21T03:42:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.096+0000 7fea32086740 10 client.15360 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:42:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.096+0000 7fea32086740 10 client.15360 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T03:42:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.096+0000 7fea32086740 20 client.15360 populate_metadata read hostname 'smithi084' 2024-09-21T03:42:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.096+0000 7fea32086740 1 --2- 172.21.15.84:0/1402126164 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55831b7ee8e0 0x55831bbf84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.096+0000 7fea32086740 4 client.15360 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:42:13.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.096+0000 7fea32086740 1 -- 172.21.15.84:0/1402126164 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55831bb4fb60 con 0x55831b7ee8e0 2024-09-21T03:42:13.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.096+0000 7fea298ae640 1 --2- 172.21.15.84:0/1402126164 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55831b7ee8e0 0x55831bbf84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.097+0000 7fea0d7fa640 10 client.15360 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:42:13.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.097+0000 7fea298ae640 1 --2- 172.21.15.84:0/1402126164 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55831b7ee8e0 0x55831bbf84d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=52af66b52843aabb server_cookie=42107b2c87ccaaba in_seq=0 out_seq=0 2024-09-21T03:42:13.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.097+0000 7fea0d7fa640 1 -- 172.21.15.84:0/1402126164 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55831bb4fb60 con 0x55831b7ee8e0 2024-09-21T03:42:13.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.097+0000 7fea0d7fa640 10 client.15360 handle_command_reply: tid=0 2024-09-21T03:42:13.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.097+0000 7fea32086740 1 client.15360 shutdown 2024-09-21T03:42:13.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.098+0000 7fea32086740 1 -- 172.21.15.84:0/1402126164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b82ff60 msgr2=0x55831bbf1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:13.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.098+0000 7fea32086740 1 --2- 172.21.15.84:0/1402126164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b82ff60 0x55831bbf1dd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fea1c010e30 tx=0x7fea1c004ab0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.098+0000 7fea32086740 1 -- 172.21.15.84:0/1402126164 shutdown_connections 2024-09-21T03:42:13.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.098+0000 7fea32086740 1 --2- 172.21.15.84:0/1402126164 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55831b7ee8e0 0x55831bbf84d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.098+0000 7fea32086740 1 --2- 172.21.15.84:0/1402126164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b82ff60 0x55831bbf1dd0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.098+0000 7fea32086740 1 --2- 172.21.15.84:0/1402126164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b80f280 0x55831bbe6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.098+0000 7fea0d7fa640 0 client.15360 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:42:13.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.098+0000 7fea32086740 1 --2- 172.21.15.84:0/1402126164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b8070a0 0x55831bbe5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.098+0000 7fea32086740 1 -- 172.21.15.84:0/1402126164 >> 172.21.15.84:0/1402126164 conn(0x55831b824350 msgr2=0x55831bbd78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:13.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.098+0000 7fea32086740 1 -- 172.21.15.84:0/1402126164 shutdown_connections 2024-09-21T03:42:13.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.098+0000 7fea32086740 1 -- 172.21.15.84:0/1402126164 wait complete. 2024-09-21T03:42:13.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.098+0000 7fea32086740 20 client.15360 trim_cache size 0 max 16384 2024-09-21T03:42:13.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.116+0000 7fea32086740 1 Processor -- start 2024-09-21T03:42:13.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.116+0000 7fea32086740 1 -- start start 2024-09-21T03:42:13.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.116+0000 7fea32086740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b824350 0x55831bbf1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.116+0000 7fea32086740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b8070a0 0x55831bbf2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.116+0000 7fea32086740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b80f280 0x55831bbd3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.116+0000 7fea32086740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55831bbf6810 con 0x55831b824350 2024-09-21T03:42:13.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.116+0000 7fea32086740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55831bbf6ee0 con 0x55831b80f280 2024-09-21T03:42:13.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.116+0000 7fea32086740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55831bbf75b0 con 0x55831b8070a0 2024-09-21T03:42:13.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.116+0000 7fea298ae640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b824350 0x55831bbf1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.116+0000 7fea298ae640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b824350 0x55831bbf1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50530/0 (socket says 172.21.15.84:50530) 2024-09-21T03:42:13.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.116+0000 7fea298ae640 1 -- 172.21.15.84:0/2901793251 learned_addr learned my addr 172.21.15.84:0/2901793251 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:13.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.116+0000 7fea2a0af640 1 --2- 172.21.15.84:0/2901793251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b80f280 0x55831bbd3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.117+0000 7fea290ad640 1 --2- 172.21.15.84:0/2901793251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b8070a0 0x55831bbf2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.117+0000 7fea298ae640 1 -- 172.21.15.84:0/2901793251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b8070a0 msgr2=0x55831bbf2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.117+0000 7fea298ae640 1 --2- 172.21.15.84:0/2901793251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b8070a0 0x55831bbf2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.117+0000 7fea298ae640 1 -- 172.21.15.84:0/2901793251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b80f280 msgr2=0x55831bbd3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.117+0000 7fea298ae640 1 --2- 172.21.15.84:0/2901793251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b80f280 0x55831bbd3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.117+0000 7fea298ae640 1 -- 172.21.15.84:0/2901793251 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55831bbd8cc0 con 0x55831b824350 2024-09-21T03:42:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.117+0000 7fea2a0af640 1 --2- 172.21.15.84:0/2901793251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b80f280 0x55831bbd3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.117+0000 7fea298ae640 1 --2- 172.21.15.84:0/2901793251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b824350 0x55831bbf1d40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x55831bbd4b80 tx=0x7fea180114e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e4e0f9694a74c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.117+0000 7fea0f7fe640 1 -- 172.21.15.84:0/2901793251 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18015040 con 0x55831b824350 2024-09-21T03:42:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.117+0000 7fea0f7fe640 1 -- 172.21.15.84:0/2901793251 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea18004450 con 0x55831b824350 2024-09-21T03:42:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.117+0000 7fea0f7fe640 1 -- 172.21.15.84:0/2901793251 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18011c60 con 0x55831b824350 2024-09-21T03:42:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.118+0000 7fea32086740 1 -- 172.21.15.84:0/2901793251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b824350 msgr2=0x55831bbf1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.118+0000 7fea32086740 1 --2- 172.21.15.84:0/2901793251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b824350 0x55831bbf1d40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x55831bbd4b80 tx=0x7fea180114e0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.118+0000 7fea32086740 1 -- 172.21.15.84:0/2901793251 shutdown_connections 2024-09-21T03:42:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.118+0000 7fea32086740 1 --2- 172.21.15.84:0/2901793251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b80f280 0x55831bbd3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.118+0000 7fea32086740 1 --2- 172.21.15.84:0/2901793251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b8070a0 0x55831bbf2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.118+0000 7fea32086740 1 --2- 172.21.15.84:0/2901793251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b824350 0x55831bbf1d40 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.118+0000 7fea32086740 1 -- 172.21.15.84:0/2901793251 >> 172.21.15.84:0/2901793251 conn(0x55831bbf6400 msgr2=0x55831bbe0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:13.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.118+0000 7fea32086740 1 -- 172.21.15.84:0/2901793251 shutdown_connections 2024-09-21T03:42:13.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.118+0000 7fea32086740 1 -- 172.21.15.84:0/2901793251 wait complete. 2024-09-21T03:42:13.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.118+0000 7fea32086740 1 -- start start 2024-09-21T03:42:13.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.118+0000 7fea32086740 1 Processor -- start 2024-09-21T03:42:13.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.119+0000 7fea32086740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b8070a0 0x55831bbfa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.119+0000 7fea32086740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b80f280 0x55831bbfad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.119+0000 7fea32086740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b824350 0x55831bbfb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.119+0000 7fea32086740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55831bbf8350 con 0x55831b8070a0 2024-09-21T03:42:13.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.119+0000 7fea32086740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55831bbf7c80 con 0x55831b824350 2024-09-21T03:42:13.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.119+0000 7fea32086740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55831bbf8a20 con 0x55831b80f280 2024-09-21T03:42:13.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.119+0000 7fea32086740 10 client.0 _ll_register_callbacks cb 0x7fea1c00a5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:13.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.119+0000 7fea298ae640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b8070a0 0x55831bbfa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.119+0000 7fea298ae640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b8070a0 0x55831bbfa7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50546/0 (socket says 172.21.15.84:50546) 2024-09-21T03:42:13.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.119+0000 7fea298ae640 1 -- 172.21.15.84:0/765867512 learned_addr learned my addr 172.21.15.84:0/765867512 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:13.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.119+0000 7fea2a0af640 1 --2- 172.21.15.84:0/765867512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b824350 0x55831bbfb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.119+0000 7fea290ad640 1 --2- 172.21.15.84:0/765867512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b80f280 0x55831bbfad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.119+0000 7fea298ae640 1 -- 172.21.15.84:0/765867512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b80f280 msgr2=0x55831bbfad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:13.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.119+0000 7fea298ae640 1 --2- 172.21.15.84:0/765867512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b80f280 0x55831bbfad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.119+0000 7fea298ae640 1 -- 172.21.15.84:0/765867512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b824350 msgr2=0x55831bbfb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:13.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.119+0000 7fea298ae640 1 --2- 172.21.15.84:0/765867512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b824350 0x55831bbfb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.119+0000 7fea298ae640 1 -- 172.21.15.84:0/765867512 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55831bbfffa0 con 0x55831b8070a0 2024-09-21T03:42:13.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.119+0000 7fea2a0af640 1 --2- 172.21.15.84:0/765867512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b824350 0x55831bbfb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:13.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.119+0000 7fea290ad640 1 --2- 172.21.15.84:0/765867512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b80f280 0x55831bbfad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:13.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.120+0000 7fea298ae640 1 --2- 172.21.15.84:0/765867512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b8070a0 0x55831bbfa7e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fea1800b980 tx=0x7fea1800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc707c4c885e672 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:13.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.120+0000 7fea0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:42:13.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.120+0000 7fea0d7fa640 1 -- 172.21.15.84:0/765867512 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18015040 con 0x55831b8070a0 2024-09-21T03:42:13.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.120+0000 7fea0d7fa640 1 -- 172.21.15.84:0/765867512 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fea180116e0 con 0x55831b8070a0 2024-09-21T03:42:13.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.120+0000 7fea32086740 1 -- 172.21.15.84:0/765867512 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea18004450 con 0x55831b8070a0 2024-09-21T03:42:13.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.120+0000 7fea0d7fa640 1 -- 172.21.15.84:0/765867512 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fea180119e0 con 0x55831b8070a0 2024-09-21T03:42:13.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.120+0000 7fea32086740 10 client.15366 fetch_fsmap learned FSMap version 24 2024-09-21T03:42:13.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.120+0000 7fea32086740 1 -- 172.21.15.84:0/765867512 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55831bc63c50 con 0x55831b8070a0 2024-09-21T03:42:13.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.120+0000 7fea0d7fa640 1 -- 172.21.15.84:0/765867512 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea18004450 con 0x55831b8070a0 2024-09-21T03:42:13.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.120+0000 7fea0d7fa640 1 -- 172.21.15.84:0/765867512 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fea1803e070 con 0x55831b8070a0 2024-09-21T03:42:13.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.120+0000 7fea32086740 10 client.15366 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:42:13.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.120+0000 7fea32086740 10 client.15366 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T03:42:13.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.120+0000 7fea32086740 20 client.15366 populate_metadata read hostname 'smithi084' 2024-09-21T03:42:13.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.120+0000 7fea32086740 1 --2- 172.21.15.84:0/765867512 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55831b82ff60 0x55831bc66e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.120+0000 7fea32086740 4 client.15366 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:42:13.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.120+0000 7fea32086740 1 -- 172.21.15.84:0/765867512 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "status"}) -- 0x55831bb4b610 con 0x55831b82ff60 2024-09-21T03:42:13.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.121+0000 7fea290ad640 1 --2- 172.21.15.84:0/765867512 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55831b82ff60 0x55831bc66e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.121+0000 7fea0d7fa640 10 client.15366 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:42:13.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.121+0000 7fea290ad640 1 --2- 172.21.15.84:0/765867512 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55831b82ff60 0x55831bc66e90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7ce3a21b15c2b6cd server_cookie=42e45191abbe53c5 in_seq=0 out_seq=0 2024-09-21T03:42:13.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.121+0000 7fea0d7fa640 1 -- 172.21.15.84:0/765867512 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55831bb4b610 con 0x55831b82ff60 2024-09-21T03:42:13.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.121+0000 7fea0d7fa640 10 client.15366 handle_command_reply: tid=0 2024-09-21T03:42:13.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.121+0000 7fea32086740 1 client.15366 shutdown 2024-09-21T03:42:13.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea32086740 1 -- 172.21.15.84:0/765867512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b8070a0 msgr2=0x55831bbfa7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:13.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea32086740 1 --2- 172.21.15.84:0/765867512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b8070a0 0x55831bbfa7e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fea1800b980 tx=0x7fea1800f730 comp rx=0 tx=0).stop 2024-09-21T03:42:13.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea32086740 1 -- 172.21.15.84:0/765867512 shutdown_connections 2024-09-21T03:42:13.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea32086740 1 --2- 172.21.15.84:0/765867512 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55831b82ff60 0x55831bc66e90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea32086740 1 --2- 172.21.15.84:0/765867512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55831b824350 0x55831bbfb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea32086740 1 --2- 172.21.15.84:0/765867512 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55831b80f280 0x55831bbfad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea32086740 1 --2- 172.21.15.84:0/765867512 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55831b8070a0 0x55831bbfa7e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea0d7fa640 0 client.15366 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:42:13.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea32086740 1 -- 172.21.15.84:0/765867512 >> 172.21.15.84:0/765867512 conn(0x55831bbf6400 msgr2=0x55831bbd3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:13.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea32086740 1 -- 172.21.15.84:0/765867512 shutdown_connections 2024-09-21T03:42:13.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea32086740 1 -- 172.21.15.84:0/765867512 wait complete. 2024-09-21T03:42:13.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea32086740 20 client.15366 trim_cache size 0 max 16384 2024-09-21T03:42:13.133 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:42:13.133 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "e3f8c18e-77c9-11ef-baf5-efdc52797490", 2024-09-21T03:42:13.133 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 1, 2024-09-21T03:42:13.133 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24638, 2024-09-21T03:42:13.133 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T03:42:13.133 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T03:42:13.133 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T03:42:13.133 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 95.734820747000001, 2024-09-21T03:42:13.133 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 24, 2024-09-21T03:42:13.134 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 77, 2024-09-21T03:42:13.134 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T03:42:13.134 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 124.72245775 2024-09-21T03:42:13.134 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:42:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea2bb12640 1 -- 172.21.15.84:0/2030698530 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fea100b6590 msgr2=0x7fea100b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea2bb12640 1 --2- 172.21.15.84:0/2030698530 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fea100b6590 0x7fea100b8aa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fea1c00add0 tx=0x7fea1c004a40 comp rx=0 tx=0).stop 2024-09-21T03:42:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea2bb12640 1 -- 172.21.15.84:0/2030698530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea241094a0 msgr2=0x7fea2419ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea2bb12640 1 --2- 172.21.15.84:0/2030698530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea241094a0 0x7fea2419ab40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fea2002a930 tx=0x7fea20004270 comp rx=0 tx=0).stop 2024-09-21T03:42:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea2bb12640 1 -- 172.21.15.84:0/2030698530 shutdown_connections 2024-09-21T03:42:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea2bb12640 1 --2- 172.21.15.84:0/2030698530 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fea100b6590 0x7fea100b8aa0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea2bb12640 1 --2- 172.21.15.84:0/2030698530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fea24109df0 0x7fea2419fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea2bb12640 1 --2- 172.21.15.84:0/2030698530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fea241094a0 0x7fea2419ab40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea2bb12640 1 --2- 172.21.15.84:0/2030698530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea24103b60 0x7fea2419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.122+0000 7fea2bb12640 1 -- 172.21.15.84:0/2030698530 >> 172.21.15.84:0/2030698530 conn(0x7fea2407b850 msgr2=0x7fea24105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:13.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.123+0000 7fea2bb12640 1 -- 172.21.15.84:0/2030698530 shutdown_connections 2024-09-21T03:42:13.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:13.123+0000 7fea2bb12640 1 -- 172.21.15.84:0/2030698530 wait complete. 2024-09-21T03:42:13.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:13 smithi174 ceph-mon[34403]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:13.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:13 smithi172 ceph-mon[34821]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:13.742 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:13 smithi084 ceph-mon[30941]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:14.045 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T03:42:14.288 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.818+0000 7f659c0e4640 1 -- 172.21.15.84:0/2422785367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6594077380 msgr2=0x7f65940757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.818+0000 7f659c0e4640 1 --2- 172.21.15.84:0/2422785367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6594077380 0x7f65940757b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6590009ca0 tx=0x7f659002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.818+0000 7f659c0e4640 1 -- 172.21.15.84:0/2422785367 shutdown_connections 2024-09-21T03:42:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.818+0000 7f659c0e4640 1 --2- 172.21.15.84:0/2422785367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6594114430 0x7f6594116900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.818+0000 7f659c0e4640 1 --2- 172.21.15.84:0/2422785367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6594075dd0 0x7f65940761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.818+0000 7f659c0e4640 1 --2- 172.21.15.84:0/2422785367 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6594077380 0x7f65940757b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.818+0000 7f659c0e4640 1 -- 172.21.15.84:0/2422785367 >> 172.21.15.84:0/2422785367 conn(0x7f659407b850 msgr2=0x7f659407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:14.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.818+0000 7f659c0e4640 1 -- 172.21.15.84:0/2422785367 shutdown_connections 2024-09-21T03:42:14.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.818+0000 7f659c0e4640 1 -- 172.21.15.84:0/2422785367 wait complete. 2024-09-21T03:42:14.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.818+0000 7f659c0e4640 1 Processor -- start 2024-09-21T03:42:14.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.818+0000 7f659c0e4640 1 -- start start 2024-09-21T03:42:14.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f659c0e4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6594075dd0 0x7f65941a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:14.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f659c0e4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6594077380 0x7f65941a1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:14.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f659c0e4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6594114430 0x7f65941a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:14.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f659c0e4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f659411a0d0 con 0x7f6594077380 2024-09-21T03:42:14.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f659c0e4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6594119f50 con 0x7f6594114430 2024-09-21T03:42:14.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f659c0e4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f659411a250 con 0x7f6594075dd0 2024-09-21T03:42:14.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f659967f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6594077380 0x7f65941a1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:14.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f659967f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6594077380 0x7f65941a1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50556/0 (socket says 172.21.15.84:50556) 2024-09-21T03:42:14.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f659967f640 1 -- 172.21.15.84:0/1137711666 learned_addr learned my addr 172.21.15.84:0/1137711666 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:14.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f6599e80640 1 --2- 172.21.15.84:0/1137711666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6594075dd0 0x7f65941a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:14.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f659a681640 1 --2- 172.21.15.84:0/1137711666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6594114430 0x7f65941a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:14.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f659967f640 1 -- 172.21.15.84:0/1137711666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6594075dd0 msgr2=0x7f65941a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:14.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f659967f640 1 --2- 172.21.15.84:0/1137711666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6594075dd0 0x7f65941a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f659967f640 1 -- 172.21.15.84:0/1137711666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6594114430 msgr2=0x7f65941a6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:14.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f659967f640 1 --2- 172.21.15.84:0/1137711666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6594114430 0x7f65941a6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f659967f640 1 -- 172.21.15.84:0/1137711666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65941a6a30 con 0x7f6594077380 2024-09-21T03:42:14.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f6599e80640 1 --2- 172.21.15.84:0/1137711666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6594075dd0 0x7f65941a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:14.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f659a681640 1 --2- 172.21.15.84:0/1137711666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6594114430 0x7f65941a6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:14.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f659967f640 1 --2- 172.21.15.84:0/1137711666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6594077380 0x7f65941a1060 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f658400d770 tx=0x7f658400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:14.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f658affd640 1 -- 172.21.15.84:0/1137711666 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6584017070 con 0x7f6594077380 2024-09-21T03:42:14.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f659c0e4640 1 -- 172.21.15.84:0/1137711666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65941a6d20 con 0x7f6594077380 2024-09-21T03:42:14.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f658affd640 1 -- 172.21.15.84:0/1137711666 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6584009c30 con 0x7f6594077380 2024-09-21T03:42:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.819+0000 7f658affd640 1 -- 172.21.15.84:0/1137711666 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658400f620 con 0x7f6594077380 2024-09-21T03:42:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.820+0000 7f659c0e4640 1 -- 172.21.15.84:0/1137711666 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65941ad500 con 0x7f6594077380 2024-09-21T03:42:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.822+0000 7f65a2658740 1 Processor -- start 2024-09-21T03:42:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.822+0000 7f65a2658740 1 -- start start 2024-09-21T03:42:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.822+0000 7f658affd640 1 -- 172.21.15.84:0/1137711666 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f658401a070 con 0x7f6594077380 2024-09-21T03:42:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f65a2658740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d40f60 0x5565790e6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f65a2658740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d180a0 0x5565790e7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f65a2658740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d20280 0x5565790e7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f65a2658740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55657905ec10 con 0x556578d180a0 2024-09-21T03:42:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f65a2658740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55657904e040 con 0x556578d20280 2024-09-21T03:42:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f65a2658740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x556579051e50 con 0x556578d40f60 2024-09-21T03:42:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f6599e80640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d180a0 0x5565790e7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f6599e80640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d180a0 0x5565790e7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50564/0 (socket says 172.21.15.84:50564) 2024-09-21T03:42:14.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f6599e80640 1 -- 172.21.15.84:0/2526930228 learned_addr learned my addr 172.21.15.84:0/2526930228 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f659a681640 1 --2- 172.21.15.84:0/2526930228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d40f60 0x5565790e6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f659967f640 1 --2- 172.21.15.84:0/2526930228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d20280 0x5565790e7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f6599e80640 1 -- 172.21.15.84:0/2526930228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d40f60 msgr2=0x5565790e6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f6599e80640 1 --2- 172.21.15.84:0/2526930228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d40f60 0x5565790e6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f6599e80640 1 -- 172.21.15.84:0/2526930228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d20280 msgr2=0x5565790e7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f6599e80640 1 --2- 172.21.15.84:0/2526930228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d20280 0x5565790e7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f6599e80640 1 -- 172.21.15.84:0/2526930228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556578dac540 con 0x556578d180a0 2024-09-21T03:42:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f659967f640 1 --2- 172.21.15.84:0/2526930228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d20280 0x5565790e7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f658affd640 1 --2- 172.21.15.84:0/1137711666 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f65800b6560 0x7f65800b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f6599e80640 1 --2- 172.21.15.84:0/2526930228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d180a0 0x5565790e7440 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f659002f4f0 tx=0x7f6590009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0475a67b7e67e8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f659a681640 1 --2- 172.21.15.84:0/1137711666 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f65800b6560 0x7f65800b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.823+0000 7f657ffff640 1 -- 172.21.15.84:0/2526930228 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590031450 con 0x556578d180a0 2024-09-21T03:42:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.824+0000 7f658affd640 1 -- 172.21.15.84:0/1137711666 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f65840e7010 con 0x7f6594077380 2024-09-21T03:42:14.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.824+0000 7f657ffff640 1 -- 172.21.15.84:0/2526930228 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6590036040 con 0x556578d180a0 2024-09-21T03:42:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.824+0000 7f657ffff640 1 -- 172.21.15.84:0/2526930228 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590004370 con 0x556578d180a0 2024-09-21T03:42:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.824+0000 7f65a2658740 1 -- 172.21.15.84:0/2526930228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d180a0 msgr2=0x5565790e7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.824+0000 7f659a681640 1 --2- 172.21.15.84:0/1137711666 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f65800b6560 0x7f65800b8a70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f658c00ba90 tx=0x7f658c008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.824+0000 7f65a2658740 1 --2- 172.21.15.84:0/2526930228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d180a0 0x5565790e7440 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f659002f4f0 tx=0x7f6590009a20 comp rx=0 tx=0).stop 2024-09-21T03:42:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.824+0000 7f65a2658740 1 -- 172.21.15.84:0/2526930228 shutdown_connections 2024-09-21T03:42:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.824+0000 7f65a2658740 1 --2- 172.21.15.84:0/2526930228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d20280 0x5565790e7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.824+0000 7f65a2658740 1 --2- 172.21.15.84:0/2526930228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d180a0 0x5565790e7440 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.824+0000 7f65a2658740 1 --2- 172.21.15.84:0/2526930228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d40f60 0x5565790e6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.824+0000 7f65a2658740 1 -- 172.21.15.84:0/2526930228 >> 172.21.15.84:0/2526930228 conn(0x556578d35350 msgr2=0x5565790e4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.825+0000 7f65a2658740 1 -- 172.21.15.84:0/2526930228 shutdown_connections 2024-09-21T03:42:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.825+0000 7f65a2658740 1 -- 172.21.15.84:0/2526930228 wait complete. 2024-09-21T03:42:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.825+0000 7f65a2658740 1 -- start start 2024-09-21T03:42:14.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.825+0000 7f65a2658740 1 Processor -- start 2024-09-21T03:42:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f65a2658740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d180a0 0x5565790f2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f65a2658740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d20280 0x5565790f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f65a2658740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d40f60 0x5565790fe9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f65a2658740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556578eaf5f0 con 0x556578d180a0 2024-09-21T03:42:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f65a2658740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556578fe9010 con 0x556578d20280 2024-09-21T03:42:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f65a2658740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5565790f5680 con 0x556578d40f60 2024-09-21T03:42:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f65a2658740 10 client.0 _ll_register_callbacks cb 0x556579048340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f6599e80640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d180a0 0x5565790f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f6599e80640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d180a0 0x5565790f2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50574/0 (socket says 172.21.15.84:50574) 2024-09-21T03:42:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f6599e80640 1 -- 172.21.15.84:0/1247898734 learned_addr learned my addr 172.21.15.84:0/1247898734 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f659967f640 1 --2- 172.21.15.84:0/1247898734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d20280 0x5565790f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f659a681640 1 --2- 172.21.15.84:0/1247898734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d40f60 0x5565790fe9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f6599e80640 1 -- 172.21.15.84:0/1247898734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d40f60 msgr2=0x5565790fe9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f6599e80640 1 --2- 172.21.15.84:0/1247898734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d40f60 0x5565790fe9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f6599e80640 1 -- 172.21.15.84:0/1247898734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d20280 msgr2=0x5565790f2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f6599e80640 1 --2- 172.21.15.84:0/1247898734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d20280 0x5565790f2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f6599e80640 1 -- 172.21.15.84:0/1247898734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556579016a00 con 0x556578d180a0 2024-09-21T03:42:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f6599e80640 1 --2- 172.21.15.84:0/1247898734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d180a0 0x5565790f2770 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f659002a900 tx=0x7f6590009910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6ca8ccb1ccd2ca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f657d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:42:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f657d7fa640 1 -- 172.21.15.84:0/1247898734 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590052020 con 0x556578d180a0 2024-09-21T03:42:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f657d7fa640 1 -- 172.21.15.84:0/1247898734 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f6590003b70 con 0x556578d180a0 2024-09-21T03:42:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.826+0000 7f65a2658740 1 -- 172.21.15.84:0/1247898734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6590036040 con 0x556578d180a0 2024-09-21T03:42:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.827+0000 7f657d7fa640 1 -- 172.21.15.84:0/1247898734 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f659005d050 con 0x556578d180a0 2024-09-21T03:42:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.827+0000 7f65a2658740 10 client.15378 fetch_fsmap learned FSMap version 24 2024-09-21T03:42:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.827+0000 7f65a2658740 1 -- 172.21.15.84:0/1247898734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556579101480 con 0x556578d180a0 2024-09-21T03:42:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.827+0000 7f657d7fa640 1 -- 172.21.15.84:0/1247898734 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6590036040 con 0x556578d180a0 2024-09-21T03:42:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.827+0000 7f657d7fa640 1 -- 172.21.15.84:0/1247898734 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f659004d030 con 0x556578d180a0 2024-09-21T03:42:14.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.827+0000 7f65a2658740 10 client.15378 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:42:14.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.827+0000 7f65a2658740 10 client.15378 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:42:14.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.827+0000 7f65a2658740 20 client.15378 populate_metadata read hostname 'smithi084' 2024-09-21T03:42:14.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.827+0000 7f65a2658740 1 --2- 172.21.15.84:0/1247898734 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556578cff8e0 0x556579104a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:14.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.827+0000 7f65a2658740 4 client.15378 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:42:14.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.827+0000 7f65a2658740 1 -- 172.21.15.84:0/1247898734 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556579060b60 con 0x556578cff8e0 2024-09-21T03:42:14.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.828+0000 7f659967f640 1 --2- 172.21.15.84:0/1247898734 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556578cff8e0 0x556579104a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:14.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.828+0000 7f659967f640 1 --2- 172.21.15.84:0/1247898734 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556578cff8e0 0x556579104a80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b944663e8e1a54cb server_cookie=30e2bbd927ab0d2b in_seq=0 out_seq=0 2024-09-21T03:42:14.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.828+0000 7f657d7fa640 10 client.15378 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:42:14.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.829+0000 7f657d7fa640 1 -- 172.21.15.84:0/1247898734 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556579060b60 con 0x556578cff8e0 2024-09-21T03:42:14.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.829+0000 7f657d7fa640 10 client.15378 handle_command_reply: tid=0 2024-09-21T03:42:14.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.829+0000 7f65a2658740 1 client.15378 shutdown 2024-09-21T03:42:14.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.829+0000 7f65a2658740 1 -- 172.21.15.84:0/1247898734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d180a0 msgr2=0x5565790f2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:14.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.829+0000 7f65a2658740 1 --2- 172.21.15.84:0/1247898734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d180a0 0x5565790f2770 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f659002a900 tx=0x7f6590009910 comp rx=0 tx=0).stop 2024-09-21T03:42:14.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.829+0000 7f65a2658740 1 -- 172.21.15.84:0/1247898734 shutdown_connections 2024-09-21T03:42:14.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.829+0000 7f65a2658740 1 --2- 172.21.15.84:0/1247898734 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556578cff8e0 0x556579104a80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.829+0000 7f65a2658740 1 --2- 172.21.15.84:0/1247898734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d40f60 0x5565790fe9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.829+0000 7f65a2658740 1 --2- 172.21.15.84:0/1247898734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d20280 0x5565790f2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.829+0000 7f65a2658740 1 --2- 172.21.15.84:0/1247898734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d180a0 0x5565790f2770 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.829+0000 7f657d7fa640 0 client.15378 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:42:14.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.829+0000 7f65a2658740 1 -- 172.21.15.84:0/1247898734 >> 172.21.15.84:0/1247898734 conn(0x556578d35350 msgr2=0x5565790ea090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:14.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.829+0000 7f65a2658740 1 -- 172.21.15.84:0/1247898734 shutdown_connections 2024-09-21T03:42:14.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.829+0000 7f65a2658740 1 -- 172.21.15.84:0/1247898734 wait complete. 2024-09-21T03:42:14.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.830+0000 7f65a2658740 20 client.15378 trim_cache size 0 max 16384 2024-09-21T03:42:14.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.847+0000 7f65a2658740 1 Processor -- start 2024-09-21T03:42:14.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.847+0000 7f65a2658740 1 -- start start 2024-09-21T03:42:14.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.847+0000 7f65a2658740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d180a0 0x5565790ed020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:14.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.847+0000 7f65a2658740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d20280 0x5565790dfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:14.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.847+0000 7f65a2658740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d40f60 0x5565790f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:14.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.847+0000 7f65a2658740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556579102dc0 con 0x556578d40f60 2024-09-21T03:42:14.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.847+0000 7f65a2658740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556579103490 con 0x556578d20280 2024-09-21T03:42:14.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.847+0000 7f65a2658740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x556579103b60 con 0x556578d180a0 2024-09-21T03:42:14.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.848+0000 7f659a681640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d40f60 0x5565790f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:14.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.848+0000 7f659a681640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d40f60 0x5565790f2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50586/0 (socket says 172.21.15.84:50586) 2024-09-21T03:42:14.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.848+0000 7f659a681640 1 -- 172.21.15.84:0/2561555979 learned_addr learned my addr 172.21.15.84:0/2561555979 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:14.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.848+0000 7f6599e80640 1 --2- 172.21.15.84:0/2561555979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d180a0 0x5565790ed020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:14.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.848+0000 7f659967f640 1 --2- 172.21.15.84:0/2561555979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d20280 0x5565790dfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:14.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.848+0000 7f659a681640 1 -- 172.21.15.84:0/2561555979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d180a0 msgr2=0x5565790ed020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:14.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.848+0000 7f659a681640 1 --2- 172.21.15.84:0/2561555979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d180a0 0x5565790ed020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.848+0000 7f659a681640 1 -- 172.21.15.84:0/2561555979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d20280 msgr2=0x5565790dfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:14.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.848+0000 7f659a681640 1 --2- 172.21.15.84:0/2561555979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d20280 0x5565790dfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.848+0000 7f659a681640 1 -- 172.21.15.84:0/2561555979 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565790e9b40 con 0x556578d40f60 2024-09-21T03:42:14.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.848+0000 7f6599e80640 1 --2- 172.21.15.84:0/2561555979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d180a0 0x5565790ed020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:14.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.848+0000 7f659967f640 1 --2- 172.21.15.84:0/2561555979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d20280 0x5565790dfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:14.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.848+0000 7f659a681640 1 --2- 172.21.15.84:0/2561555979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d40f60 0x5565790f2c30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f658c00b870 tx=0x7f658c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393ffabec9cef63c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:14.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.848+0000 7f657f7fe640 1 -- 172.21.15.84:0/2561555979 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c01b030 con 0x556578d40f60 2024-09-21T03:42:14.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.848+0000 7f657f7fe640 1 -- 172.21.15.84:0/2561555979 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f658c026070 con 0x556578d40f60 2024-09-21T03:42:14.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.848+0000 7f657f7fe640 1 -- 172.21.15.84:0/2561555979 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c015670 con 0x556578d40f60 2024-09-21T03:42:14.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.849+0000 7f65a2658740 1 -- 172.21.15.84:0/2561555979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d40f60 msgr2=0x5565790f2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:14.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.849+0000 7f65a2658740 1 --2- 172.21.15.84:0/2561555979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d40f60 0x5565790f2c30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f658c00b870 tx=0x7f658c012000 comp rx=0 tx=0).stop 2024-09-21T03:42:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.849+0000 7f65a2658740 1 -- 172.21.15.84:0/2561555979 shutdown_connections 2024-09-21T03:42:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.849+0000 7f65a2658740 1 --2- 172.21.15.84:0/2561555979 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d40f60 0x5565790f2c30 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.849+0000 7f65a2658740 1 --2- 172.21.15.84:0/2561555979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d20280 0x5565790dfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.849+0000 7f65a2658740 1 --2- 172.21.15.84:0/2561555979 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d180a0 0x5565790ed020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.849+0000 7f65a2658740 1 -- 172.21.15.84:0/2561555979 >> 172.21.15.84:0/2561555979 conn(0x556578d35350 msgr2=0x5565790f2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.849+0000 7f65a2658740 1 -- 172.21.15.84:0/2561555979 shutdown_connections 2024-09-21T03:42:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.849+0000 7f65a2658740 1 -- 172.21.15.84:0/2561555979 wait complete. 2024-09-21T03:42:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.850+0000 7f65a2658740 1 -- start start 2024-09-21T03:42:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.850+0000 7f65a2658740 1 Processor -- start 2024-09-21T03:42:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.850+0000 7f65a2658740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d180a0 0x55657910d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.850+0000 7f65a2658740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d20280 0x556579106b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:14.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.850+0000 7f65a2658740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d40f60 0x556579107230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:14.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.850+0000 7f65a2658740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556579104900 con 0x556578d40f60 2024-09-21T03:42:14.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.850+0000 7f65a2658740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556579104230 con 0x556578d180a0 2024-09-21T03:42:14.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.850+0000 7f65a2658740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x556579104fd0 con 0x556578d20280 2024-09-21T03:42:14.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.850+0000 7f65a2658740 10 client.0 _ll_register_callbacks cb 0x7f659002f3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:14.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.850+0000 7f659a681640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d40f60 0x556579107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:14.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.850+0000 7f659a681640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d40f60 0x556579107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50594/0 (socket says 172.21.15.84:50594) 2024-09-21T03:42:14.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.850+0000 7f659a681640 1 -- 172.21.15.84:0/690841464 learned_addr learned my addr 172.21.15.84:0/690841464 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:14.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.850+0000 7f6599e80640 1 --2- 172.21.15.84:0/690841464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d180a0 0x55657910d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:14.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.850+0000 7f659967f640 1 --2- 172.21.15.84:0/690841464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d20280 0x556579106b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:14.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.851+0000 7f659a681640 1 -- 172.21.15.84:0/690841464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d20280 msgr2=0x556579106b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:14.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.851+0000 7f659a681640 1 --2- 172.21.15.84:0/690841464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d20280 0x556579106b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.851+0000 7f659a681640 1 -- 172.21.15.84:0/690841464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d180a0 msgr2=0x55657910d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:14.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.851+0000 7f659a681640 1 --2- 172.21.15.84:0/690841464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d180a0 0x55657910d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.851+0000 7f659a681640 1 -- 172.21.15.84:0/690841464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565791079a0 con 0x556578d40f60 2024-09-21T03:42:14.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.851+0000 7f659a681640 1 --2- 172.21.15.84:0/690841464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d40f60 0x556579107230 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f658c00b430 tx=0x7f658c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28c75ad5cd54586 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:14.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.851+0000 7f657d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:42:14.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.851+0000 7f657d7fa640 1 -- 172.21.15.84:0/690841464 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c01b050 con 0x556578d40f60 2024-09-21T03:42:14.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.851+0000 7f657d7fa640 1 -- 172.21.15.84:0/690841464 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f658c034410 con 0x556578d40f60 2024-09-21T03:42:14.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.851+0000 7f65a2658740 1 -- 172.21.15.84:0/690841464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f658c026070 con 0x556578d40f60 2024-09-21T03:42:14.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.851+0000 7f657d7fa640 1 -- 172.21.15.84:0/690841464 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f658c021930 con 0x556578d40f60 2024-09-21T03:42:14.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.851+0000 7f65a2658740 10 client.15384 fetch_fsmap learned FSMap version 24 2024-09-21T03:42:14.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.851+0000 7f65a2658740 1 -- 172.21.15.84:0/690841464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55657916ff50 con 0x556578d40f60 2024-09-21T03:42:14.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.851+0000 7f657d7fa640 1 -- 172.21.15.84:0/690841464 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f658c026070 con 0x556578d40f60 2024-09-21T03:42:14.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.851+0000 7f657d7fa640 1 -- 172.21.15.84:0/690841464 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f658c03e830 con 0x556578d40f60 2024-09-21T03:42:14.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.852+0000 7f65a2658740 10 client.15384 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:42:14.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.852+0000 7f65a2658740 10 client.15384 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:42:14.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.852+0000 7f65a2658740 20 client.15384 populate_metadata read hostname 'smithi084' 2024-09-21T03:42:14.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.852+0000 7f65a2658740 1 --2- 172.21.15.84:0/690841464 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556578cd4c90 0x556579173420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.852+0000 7f65a2658740 4 client.15384 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:42:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.852+0000 7f65a2658740 1 -- 172.21.15.84:0/690841464 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "status"}) -- 0x55657905c610 con 0x556578cd4c90 2024-09-21T03:42:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.852+0000 7f6599e80640 1 --2- 172.21.15.84:0/690841464 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556578cd4c90 0x556579173420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.852+0000 7f657d7fa640 10 client.15384 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:42:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.852+0000 7f6599e80640 1 --2- 172.21.15.84:0/690841464 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556578cd4c90 0x556579173420 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88520215dec833bc server_cookie=742de6d692663ceb in_seq=0 out_seq=0 2024-09-21T03:42:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.853+0000 7f657d7fa640 1 -- 172.21.15.84:0/690841464 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55657905c610 con 0x556578cd4c90 2024-09-21T03:42:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.853+0000 7f657d7fa640 10 client.15384 handle_command_reply: tid=0 2024-09-21T03:42:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.853+0000 7f65a2658740 1 client.15384 shutdown 2024-09-21T03:42:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.853+0000 7f65a2658740 1 -- 172.21.15.84:0/690841464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d40f60 msgr2=0x556579107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.853+0000 7f65a2658740 1 --2- 172.21.15.84:0/690841464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d40f60 0x556579107230 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f658c00b430 tx=0x7f658c0046c0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.853+0000 7f65a2658740 1 -- 172.21.15.84:0/690841464 shutdown_connections 2024-09-21T03:42:14.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.853+0000 7f65a2658740 1 --2- 172.21.15.84:0/690841464 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556578cd4c90 0x556579173420 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.853+0000 7f65a2658740 1 --2- 172.21.15.84:0/690841464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556578d40f60 0x556579107230 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.853+0000 7f65a2658740 1 --2- 172.21.15.84:0/690841464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556578d20280 0x556579106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.853+0000 7f657d7fa640 0 client.15384 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:42:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.853+0000 7f65a2658740 1 --2- 172.21.15.84:0/690841464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556578d180a0 0x55657910d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.853+0000 7f65a2658740 1 -- 172.21.15.84:0/690841464 >> 172.21.15.84:0/690841464 conn(0x556578d35350 msgr2=0x5565790e7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.853+0000 7f65a2658740 1 -- 172.21.15.84:0/690841464 shutdown_connections 2024-09-21T03:42:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.853+0000 7f65a2658740 1 -- 172.21.15.84:0/690841464 wait complete. 2024-09-21T03:42:14.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.853+0000 7f65a2658740 20 client.15384 trim_cache size 0 max 16384 2024-09-21T03:42:14.862 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:42:14.862 INFO:teuthology.orchestra.run.smithi084.stdout: "cluster_fsid": "e3f8c18e-77c9-11ef-baf5-efdc52797490", 2024-09-21T03:42:14.862 INFO:teuthology.orchestra.run.smithi084.stdout: "whoami": 0, 2024-09-21T03:42:14.862 INFO:teuthology.orchestra.run.smithi084.stdout: "id": 24668, 2024-09-21T03:42:14.862 INFO:teuthology.orchestra.run.smithi084.stdout: "want_state": "up:active", 2024-09-21T03:42:14.862 INFO:teuthology.orchestra.run.smithi084.stdout: "state": "up:active", 2024-09-21T03:42:14.862 INFO:teuthology.orchestra.run.smithi084.stdout: "fs_name": "cephfs", 2024-09-21T03:42:14.862 INFO:teuthology.orchestra.run.smithi084.stdout: "rank_uptime": 104.51875446, 2024-09-21T03:42:14.862 INFO:teuthology.orchestra.run.smithi084.stdout: "mdsmap_epoch": 24, 2024-09-21T03:42:14.862 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch": 77, 2024-09-21T03:42:14.862 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T03:42:14.862 INFO:teuthology.orchestra.run.smithi084.stdout: "uptime": 115.206484081 2024-09-21T03:42:14.863 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:42:14.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.854+0000 7f659c0e4640 1 -- 172.21.15.84:0/1137711666 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f65800b6560 msgr2=0x7f65800b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:14.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.854+0000 7f659c0e4640 1 --2- 172.21.15.84:0/1137711666 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f65800b6560 0x7f65800b8a70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f658c00ba90 tx=0x7f658c008040 comp rx=0 tx=0).stop 2024-09-21T03:42:14.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.854+0000 7f659c0e4640 1 -- 172.21.15.84:0/1137711666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6594077380 msgr2=0x7f65941a1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:14.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.854+0000 7f659c0e4640 1 --2- 172.21.15.84:0/1137711666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6594077380 0x7f65941a1060 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f658400d770 tx=0x7f658400dc30 comp rx=0 tx=0).stop 2024-09-21T03:42:14.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.854+0000 7f659c0e4640 1 -- 172.21.15.84:0/1137711666 shutdown_connections 2024-09-21T03:42:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.854+0000 7f659c0e4640 1 --2- 172.21.15.84:0/1137711666 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f65800b6560 0x7f65800b8a70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.854+0000 7f659c0e4640 1 --2- 172.21.15.84:0/1137711666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6594114430 0x7f65941a6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.854+0000 7f659c0e4640 1 --2- 172.21.15.84:0/1137711666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6594077380 0x7f65941a1060 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.854+0000 7f659c0e4640 1 --2- 172.21.15.84:0/1137711666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6594075dd0 0x7f65941a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.854+0000 7f659c0e4640 1 -- 172.21.15.84:0/1137711666 >> 172.21.15.84:0/1137711666 conn(0x7f659407b850 msgr2=0x7f6594113060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.854+0000 7f659c0e4640 1 -- 172.21.15.84:0/1137711666 shutdown_connections 2024-09-21T03:42:14.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:14.854+0000 7f659c0e4640 1 -- 172.21.15.84:0/1137711666 wait complete. 2024-09-21T03:42:15.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:15 smithi084 ceph-mon[30941]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:42:15.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:15 smithi174 ceph-mon[34403]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:42:15.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:15 smithi172 ceph-mon[34821]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:42:15.713 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T03:42:15.741 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T03:42:15.741 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-21T03:42:15.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:42:15.742 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-09-21T03:42:15.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:42:15.759 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2024-09-21T03:42:15.826 INFO:teuthology.orchestra.run.smithi084.stderr:Cannot find device "ceph-brx" 2024-09-21T03:42:15.827 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:42:15.828 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-21T03:42:15.828 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T03:42:15.828 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:42:15.828 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T03:42:16.111 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:16.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.634+0000 7fb56cf30640 1 -- 172.21.15.84:0/2473585391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb568108d00 msgr2=0x7fb56810f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:16.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.634+0000 7fb56cf30640 1 --2- 172.21.15.84:0/2473585391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb568108d00 0x7fb56810f530 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fb560009ca0 tx=0x7fb56002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.635+0000 7fb56cf30640 1 -- 172.21.15.84:0/2473585391 shutdown_connections 2024-09-21T03:42:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.635+0000 7fb56cf30640 1 --2- 172.21.15.84:0/2473585391 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb568108d00 0x7fb56810f530 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.635+0000 7fb56cf30640 1 --2- 172.21.15.84:0/2473585391 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb5681083b0 0x7fb5681087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.635+0000 7fb56cf30640 1 --2- 172.21.15.84:0/2473585391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb568102a70 0x7fb568102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.635+0000 7fb56cf30640 1 -- 172.21.15.84:0/2473585391 >> 172.21.15.84:0/2473585391 conn(0x7fb568079710 msgr2=0x7fb568079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.635+0000 7fb56cf30640 1 -- 172.21.15.84:0/2473585391 shutdown_connections 2024-09-21T03:42:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.635+0000 7fb56cf30640 1 -- 172.21.15.84:0/2473585391 wait complete. 2024-09-21T03:42:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.635+0000 7fb56cf30640 1 Processor -- start 2024-09-21T03:42:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb56cf30640 1 -- start start 2024-09-21T03:42:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb56cf30640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb568102a70 0x7fb56819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb56cf30640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5681083b0 0x7fb56819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb56cf30640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb568108d00 0x7fb56819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb56cf30640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb5681129c0 con 0x7fb568102a70 2024-09-21T03:42:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb56cf30640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb568112840 con 0x7fb5681083b0 2024-09-21T03:42:16.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb56cf30640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb568112b40 con 0x7fb568108d00 2024-09-21T03:42:16.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb56659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb568102a70 0x7fb56819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:16.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb56659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb568102a70 0x7fb56819a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:50606/0 (socket says 172.21.15.84:50606) 2024-09-21T03:42:16.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb56659c640 1 -- 172.21.15.84:0/20191524 learned_addr learned my addr 172.21.15.84:0/20191524 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:16.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb566d9d640 1 --2- 172.21.15.84:0/20191524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb568108d00 0x7fb56819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:16.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb565d9b640 1 --2- 172.21.15.84:0/20191524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5681083b0 0x7fb56819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:16.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb56659c640 1 -- 172.21.15.84:0/20191524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb568108d00 msgr2=0x7fb56819fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:16.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb56659c640 1 --2- 172.21.15.84:0/20191524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb568108d00 0x7fb56819fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb56659c640 1 -- 172.21.15.84:0/20191524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5681083b0 msgr2=0x7fb56819aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:16.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb56659c640 1 --2- 172.21.15.84:0/20191524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5681083b0 0x7fb56819aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb56659c640 1 -- 172.21.15.84:0/20191524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5681a0470 con 0x7fb568102a70 2024-09-21T03:42:16.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb566d9d640 1 --2- 172.21.15.84:0/20191524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb568108d00 0x7fb56819fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:16.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb565d9b640 1 --2- 172.21.15.84:0/20191524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5681083b0 0x7fb56819aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:16.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb56659c640 1 --2- 172.21.15.84:0/20191524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb568102a70 0x7fb56819a500 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb55800e9f0 tx=0x7fb55800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:16.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.636+0000 7fb55f7fe640 1 -- 172.21.15.84:0/20191524 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55800cd80 con 0x7fb568102a70 2024-09-21T03:42:16.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.637+0000 7fb56cf30640 1 -- 172.21.15.84:0/20191524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5681a0760 con 0x7fb568102a70 2024-09-21T03:42:16.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.637+0000 7fb55f7fe640 1 -- 172.21.15.84:0/20191524 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5580108e0 con 0x7fb568102a70 2024-09-21T03:42:16.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.637+0000 7fb55f7fe640 1 -- 172.21.15.84:0/20191524 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb558018980 con 0x7fb568102a70 2024-09-21T03:42:16.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.637+0000 7fb56cf30640 1 -- 172.21.15.84:0/20191524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5681a6ec0 con 0x7fb568102a70 2024-09-21T03:42:16.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.638+0000 7fb56cf30640 1 -- 172.21.15.84:0/20191524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb568103cf0 con 0x7fb568102a70 2024-09-21T03:42:16.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.639+0000 7fb55f7fe640 1 -- 172.21.15.84:0/20191524 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fb558010430 con 0x7fb568102a70 2024-09-21T03:42:16.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.640+0000 7fb55f7fe640 1 --2- 172.21.15.84:0/20191524 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb5540b6560 0x7fb5540b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.640+0000 7fb565d9b640 1 --2- 172.21.15.84:0/20191524 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb5540b6560 0x7fb5540b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:16.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.640+0000 7fb55f7fe640 1 -- 172.21.15.84:0/20191524 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fb5580e7d20 con 0x7fb568102a70 2024-09-21T03:42:16.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.640+0000 7fb565d9b640 1 --2- 172.21.15.84:0/20191524 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb5540b6560 0x7fb5540b8a70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb568104a80 tx=0x7fb550005cb0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:16.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.643+0000 7fb55f7fe640 1 -- 172.21.15.84:0/20191524 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5580ae510 con 0x7fb568102a70 2024-09-21T03:42:16.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.857+0000 7fb56cf30640 1 -- 172.21.15.84:0/20191524 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb5681a7160 con 0x7fb568102a70 2024-09-21T03:42:16.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.858+0000 7fb55f7fe640 1 -- 172.21.15.84:0/20191524 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7fb5580cfe20 con 0x7fb568102a70 2024-09-21T03:42:16.861 INFO:teuthology.orchestra.run.smithi084.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:42:16.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.860+0000 7fb56cf30640 1 -- 172.21.15.84:0/20191524 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb5540b6560 msgr2=0x7fb5540b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:16.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.860+0000 7fb56cf30640 1 --2- 172.21.15.84:0/20191524 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb5540b6560 0x7fb5540b8a70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb568104a80 tx=0x7fb550005cb0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.860+0000 7fb56cf30640 1 -- 172.21.15.84:0/20191524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb568102a70 msgr2=0x7fb56819a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:16.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.860+0000 7fb56cf30640 1 --2- 172.21.15.84:0/20191524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb568102a70 0x7fb56819a500 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb55800e9f0 tx=0x7fb55800eeb0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.860+0000 7fb56cf30640 1 -- 172.21.15.84:0/20191524 shutdown_connections 2024-09-21T03:42:16.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.860+0000 7fb56cf30640 1 --2- 172.21.15.84:0/20191524 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb5540b6560 0x7fb5540b8a70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.860+0000 7fb56cf30640 1 --2- 172.21.15.84:0/20191524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb568108d00 0x7fb56819fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.860+0000 7fb56cf30640 1 --2- 172.21.15.84:0/20191524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5681083b0 0x7fb56819aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.860+0000 7fb56cf30640 1 --2- 172.21.15.84:0/20191524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb568102a70 0x7fb56819a500 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.860+0000 7fb56cf30640 1 -- 172.21.15.84:0/20191524 >> 172.21.15.84:0/20191524 conn(0x7fb568079710 msgr2=0x7fb568106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:16.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.860+0000 7fb56cf30640 1 -- 172.21.15.84:0/20191524 shutdown_connections 2024-09-21T03:42:16.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:16.860+0000 7fb56cf30640 1 -- 172.21.15.84:0/20191524 wait complete. 2024-09-21T03:42:17.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:17 smithi084 ceph-mon[30941]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:42:17.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:17 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/20191524' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T03:42:17.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:17 smithi174 ceph-mon[34403]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:42:17.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:17 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/20191524' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T03:42:17.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:17 smithi172 ceph-mon[34821]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:42:17.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:17 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/20191524' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T03:42:17.685 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T03:42:17.685 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:42:17.685 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi084.front.sepia.ceph.com 2024-09-21T03:42:17.685 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T03:42:17.685 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:42:17.686 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T03:42:17.686 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T03:42:17.686 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:42:17.686 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:42:17.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:42:17.686 DEBUG:teuthology.orchestra.run.smithi084:> ip addr 2024-09-21T03:42:17.704 INFO:teuthology.orchestra.run.smithi084.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:42:17.704 INFO:teuthology.orchestra.run.smithi084.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:42:17.705 INFO:teuthology.orchestra.run.smithi084.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:42:17.705 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:42:17.705 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 ::1/128 scope host 2024-09-21T03:42:17.705 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:42:17.705 INFO:teuthology.orchestra.run.smithi084.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:42:17.705 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:68 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:42:17.705 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f0 2024-09-21T03:42:17.705 INFO:teuthology.orchestra.run.smithi084.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:42:17.705 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:d8:da:69 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:42:17.705 INFO:teuthology.orchestra.run.smithi084.stdout: altname enp7s0f1 2024-09-21T03:42:17.705 INFO:teuthology.orchestra.run.smithi084.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:42:17.705 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:50 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:42:17.705 INFO:teuthology.orchestra.run.smithi084.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:42:17.706 INFO:teuthology.orchestra.run.smithi084.stdout: link/ether 0c:c4:7a:8f:d7:51 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:42:17.706 INFO:teuthology.orchestra.run.smithi084.stdout: inet 172.21.15.84/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:42:17.706 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft 42145sec preferred_lft 42145sec 2024-09-21T03:42:17.706 INFO:teuthology.orchestra.run.smithi084.stdout: inet6 fe80::ec4:7aff:fe8f:d751/64 scope link noprefixroute 2024-09-21T03:42:17.706 INFO:teuthology.orchestra.run.smithi084.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:42:17.706 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T03:42:17.706 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:42:17.707 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T03:42:17.707 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add name ceph-brx type bridge 2024-09-21T03:42:17.707 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr flush dev ceph-brx 2024-09-21T03:42:17.707 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set ceph-brx up 2024-09-21T03:42:17.707 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T03:42:17.707 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T03:42:17.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:42:17.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:42:17.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:42:17.910 DEBUG:teuthology.orchestra.run.smithi084:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:42:17.934 INFO:teuthology.orchestra.run.smithi084.stdout:1 2024-09-21T03:42:17.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:42:17.936 DEBUG:teuthology.orchestra.run.smithi084:> route 2024-09-21T03:42:18.006 INFO:teuthology.orchestra.run.smithi084.stdout:Kernel IP routing table 2024-09-21T03:42:18.006 INFO:teuthology.orchestra.run.smithi084.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:42:18.006 INFO:teuthology.orchestra.run.smithi084.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:42:18.006 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:42:18.006 INFO:teuthology.orchestra.run.smithi084.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:42:18.007 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:42:18.007 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T03:42:18.007 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:42:18.007 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:42:18.007 DEBUG:teuthology.orchestra.run.smithi084:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:42:18.007 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T03:42:18.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:42:18.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:42:18.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:42:18.315 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-09-21T03:42:18.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:42:18.331 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list-id 2024-09-21T03:42:18.386 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:42:18.386 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T03:42:18.386 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:42:18.387 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T03:42:18.387 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T03:42:18.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:42:18.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:42:18.503 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T03:42:18.503 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:42:18.503 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T03:42:18.504 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T03:42:18.504 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T03:42:18.504 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T03:42:18.504 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T03:42:18.504 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T03:42:18.504 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T03:42:18.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:42:18.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:42:18.652 DEBUG:teuthology.orchestra.run.smithi084:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:42:18.652 DEBUG:teuthology.orchestra.run.smithi084:> set -e 2024-09-21T03:42:18.652 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set brx.0 up 2024-09-21T03:42:18.653 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T03:42:18.653 DEBUG:teuthology.orchestra.run.smithi084:> ') 2024-09-21T03:42:18.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:42:18.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:42:18.729 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:42:18.729 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T03:42:18.744 INFO:teuthology.orchestra.run.smithi084.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:42:18.744 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:42:18.744 DEBUG:teuthology.orchestra.run.smithi084:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:42:18.798 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-21T03:42:18.798 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-21T03:42:18.798 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/1797eb52-0f11-4c8e-b4b4-dae56405551a 2024-09-21T03:42:18.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:42:18.799 DEBUG:teuthology.orchestra.run.smithi084:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/1797eb52-0f11-4c8e-b4b4-dae56405551a /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-21T03:42:18.902 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-21T03:42:18.902 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-21T03:42:19.038 INFO:teuthology.orchestra.run.smithi084.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-21T03:42:19.038 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-21T03:42:19.038 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: resolved to: "172.21.15.84:3300,172.21.15.172:3300,172.21.15.174:3300" 2024-09-21T03:42:19.038 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: trying mount with new device syntax: 0@e3f8c18e-77c9-11ef-baf5-efdc52797490.cephfs=/volumes/qa/sv_1/1797eb52-0f11-4c8e-b4b4-dae56405551a 2024-09-21T03:42:19.038 INFO:teuthology.orchestra.run.smithi084.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.84:3300/172.21.15.172:3300/172.21.15.174:3300" will pass to kernel 2024-09-21T03:42:19.039 INFO:teuthology.orchestra.run.smithi084.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T03:42:19.039 INFO:teuthology.orchestra.run.smithi084.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:42:19.039 INFO:teuthology.orchestra.run.smithi084.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:42:19.039 INFO:teuthology.orchestra.run.smithi084.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:42:19.039 INFO:teuthology.orchestra.run.smithi084.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:42:19.044 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:42:19.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:42:19.045 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:42:19.070 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:42:19.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:42:19.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:42:19.167 INFO:teuthology.orchestra.run.smithi084.stdout:client15393 2024-09-21T03:42:19.167 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T03:42:19.167 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:42:19.184 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:42:19.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:42:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:42:19.280 INFO:teuthology.orchestra.run.smithi084.stdout:client15393 2024-09-21T03:42:19.280 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:42:19.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:42:19.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:42:19.337 INFO:teuthology.orchestra.run.smithi084.stdout:client15393 2024-09-21T03:42:19.337 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490.client15393/status') 2024-09-21T03:42:19.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:42:19.396 INFO:teuthology.orchestra.run.smithi084.stdout:instance: client.15393 (3)192.168.0.1:0/1446063818 2024-09-21T03:42:19.396 INFO:teuthology.orchestra.run.smithi084.stdout:blocklisted: false 2024-09-21T03:42:19.396 INFO:teuthology.orchestra.run.smithi084.stderr:0+1 records in 2024-09-21T03:42:19.396 INFO:teuthology.orchestra.run.smithi084.stderr:0+1 records out 2024-09-21T03:42:19.396 INFO:teuthology.orchestra.run.smithi084.stderr:70 bytes copied, 3.7427e-05 s, 1.9 MB/s 2024-09-21T03:42:19.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:42:19.403 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T03:42:19.481 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T03:42:19.481 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T03:42:19.481 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-21T03:42:19.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.591+0000 7f6236157640 1 -- 172.21.15.84:0/2558268752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6230109d80 msgr2=0x7f62301105b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:19.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.591+0000 7f6236157640 1 --2- 172.21.15.84:0/2558268752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6230109d80 0x7f62301105b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6228009ca0 tx=0x7f622802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.591+0000 7f6236157640 1 -- 172.21.15.84:0/2558268752 shutdown_connections 2024-09-21T03:42:19.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.591+0000 7f6236157640 1 --2- 172.21.15.84:0/2558268752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6230109d80 0x7f62301105b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.591+0000 7f6236157640 1 --2- 172.21.15.84:0/2558268752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6230109430 0x7f6230109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.591+0000 7f6236157640 1 --2- 172.21.15.84:0/2558268752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6230103b00 0x7f6230103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.591+0000 7f6236157640 1 -- 172.21.15.84:0/2558268752 >> 172.21.15.84:0/2558268752 conn(0x7f62300ff500 msgr2=0x7f6230101950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:19.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.591+0000 7f6236157640 1 -- 172.21.15.84:0/2558268752 shutdown_connections 2024-09-21T03:42:19.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.591+0000 7f6236157640 1 -- 172.21.15.84:0/2558268752 wait complete. 2024-09-21T03:42:19.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.591+0000 7f6236157640 1 Processor -- start 2024-09-21T03:42:19.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.592+0000 7f6236157640 1 -- start start 2024-09-21T03:42:19.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.592+0000 7f6236157640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6230103b00 0x7f623019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.592+0000 7f6236157640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6230109430 0x7f623019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.592+0000 7f6236157640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6230109d80 0x7f623019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.592+0000 7f6236157640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6230113a40 con 0x7f6230109430 2024-09-21T03:42:19.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.592+0000 7f6236157640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f62301138c0 con 0x7f6230103b00 2024-09-21T03:42:19.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.592+0000 7f6236157640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6230113bc0 con 0x7f6230109d80 2024-09-21T03:42:19.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.592+0000 7f622effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6230109430 0x7f623019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.592+0000 7f622effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6230109430 0x7f623019aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33518/0 (socket says 172.21.15.84:33518) 2024-09-21T03:42:19.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.592+0000 7f622effd640 1 -- 172.21.15.84:0/2898307476 learned_addr learned my addr 172.21.15.84:0/2898307476 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:19.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.592+0000 7f622f7fe640 1 --2- 172.21.15.84:0/2898307476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6230103b00 0x7f623019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.592+0000 7f622ffff640 1 --2- 172.21.15.84:0/2898307476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6230109d80 0x7f623019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.592+0000 7f622effd640 1 -- 172.21.15.84:0/2898307476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6230109d80 msgr2=0x7f623019fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:19.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.592+0000 7f622effd640 1 --2- 172.21.15.84:0/2898307476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6230109d80 0x7f623019fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.592+0000 7f622effd640 1 -- 172.21.15.84:0/2898307476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6230103b00 msgr2=0x7f623019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:19.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.592+0000 7f622effd640 1 --2- 172.21.15.84:0/2898307476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6230103b00 0x7f623019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.592+0000 7f622effd640 1 -- 172.21.15.84:0/2898307476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62301a0320 con 0x7f6230109430 2024-09-21T03:42:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.593+0000 7f622effd640 1 --2- 172.21.15.84:0/2898307476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6230109430 0x7f623019aa20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f622400c8c0 tx=0x7f622400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.593+0000 7f622cff9640 1 -- 172.21.15.84:0/2898307476 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6224007bb0 con 0x7f6230109430 2024-09-21T03:42:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.593+0000 7f622cff9640 1 -- 172.21.15.84:0/2898307476 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6224007d50 con 0x7f6230109430 2024-09-21T03:42:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.593+0000 7f6236157640 1 -- 172.21.15.84:0/2898307476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62301a0610 con 0x7f6230109430 2024-09-21T03:42:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.593+0000 7f622cff9640 1 -- 172.21.15.84:0/2898307476 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62240187c0 con 0x7f6230109430 2024-09-21T03:42:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.593+0000 7f6236157640 1 -- 172.21.15.84:0/2898307476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62301a6e30 con 0x7f6230109430 2024-09-21T03:42:19.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.594+0000 7f6236157640 1 -- 172.21.15.84:0/2898307476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6230103f10 con 0x7f6230109430 2024-09-21T03:42:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.595+0000 7f622cff9640 1 -- 172.21.15.84:0/2898307476 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f622400fa20 con 0x7f6230109430 2024-09-21T03:42:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.596+0000 7f622cff9640 1 --2- 172.21.15.84:0/2898307476 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f62180b6560 0x7f62180b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.596+0000 7f622f7fe640 1 --2- 172.21.15.84:0/2898307476 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f62180b6560 0x7f62180b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.596+0000 7f622cff9640 1 -- 172.21.15.84:0/2898307476 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f62240e77f0 con 0x7f6230109430 2024-09-21T03:42:19.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.597+0000 7f622f7fe640 1 --2- 172.21.15.84:0/2898307476 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f62180b6560 0x7f62180b8a70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6220005fd0 tx=0x7f622000b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:19.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.599+0000 7f622cff9640 1 -- 172.21.15.84:0/2898307476 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6224014030 con 0x7f6230109430 2024-09-21T03:42:19.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:19 smithi174 ceph-mon[34403]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:19.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:19 smithi172 ceph-mon[34821]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:19.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:19.814+0000 7f6236157640 1 -- 172.21.15.84:0/2898307476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f623010bb70 con 0x7f6230109430 2024-09-21T03:42:19.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:19 smithi084 ceph-mon[30941]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:20.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.374+0000 7f622cff9640 1 -- 172.21.15.84:0/2898307476 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7f62240ae070 con 0x7f6230109430 2024-09-21T03:42:20.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.376+0000 7f6236157640 1 -- 172.21.15.84:0/2898307476 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f62180b6560 msgr2=0x7f62180b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.376+0000 7f6236157640 1 --2- 172.21.15.84:0/2898307476 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f62180b6560 0x7f62180b8a70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6220005fd0 tx=0x7f622000b390 comp rx=0 tx=0).stop 2024-09-21T03:42:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.376+0000 7f6236157640 1 -- 172.21.15.84:0/2898307476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6230109430 msgr2=0x7f623019aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.376+0000 7f6236157640 1 --2- 172.21.15.84:0/2898307476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6230109430 0x7f623019aa20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f622400c8c0 tx=0x7f622400cd80 comp rx=0 tx=0).stop 2024-09-21T03:42:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.376+0000 7f6236157640 1 -- 172.21.15.84:0/2898307476 shutdown_connections 2024-09-21T03:42:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.376+0000 7f6236157640 1 --2- 172.21.15.84:0/2898307476 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f62180b6560 0x7f62180b8a70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.376+0000 7f6236157640 1 --2- 172.21.15.84:0/2898307476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6230109d80 0x7f623019fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.376+0000 7f6236157640 1 --2- 172.21.15.84:0/2898307476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6230109430 0x7f623019aa20 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.376+0000 7f6236157640 1 --2- 172.21.15.84:0/2898307476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6230103b00 0x7f623019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.376+0000 7f6236157640 1 -- 172.21.15.84:0/2898307476 >> 172.21.15.84:0/2898307476 conn(0x7f62300ff500 msgr2=0x7f62301069e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.377+0000 7f6236157640 1 -- 172.21.15.84:0/2898307476 shutdown_connections 2024-09-21T03:42:20.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.377+0000 7f6236157640 1 -- 172.21.15.84:0/2898307476 wait complete. 2024-09-21T03:42:20.390 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-21T03:42:20.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.502+0000 7f501cacc640 1 -- 172.21.15.84:0/3443928616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5018108c50 msgr2=0x7f501810f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:20.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.502+0000 7f501cacc640 1 --2- 172.21.15.84:0/3443928616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5018108c50 0x7f501810f480 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5010009ca0 tx=0x7f501002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.502+0000 7f501cacc640 1 -- 172.21.15.84:0/3443928616 shutdown_connections 2024-09-21T03:42:20.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.502+0000 7f501cacc640 1 --2- 172.21.15.84:0/3443928616 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5018108c50 0x7f501810f480 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.502+0000 7f501cacc640 1 --2- 172.21.15.84:0/3443928616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5018108300 0x7f5018108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.502+0000 7f501cacc640 1 --2- 172.21.15.84:0/3443928616 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50181029d0 0x7f5018102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.502+0000 7f501cacc640 1 -- 172.21.15.84:0/3443928616 >> 172.21.15.84:0/3443928616 conn(0x7f50180fe3f0 msgr2=0x7f5018100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:20.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.502+0000 7f501cacc640 1 -- 172.21.15.84:0/3443928616 shutdown_connections 2024-09-21T03:42:20.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.502+0000 7f501cacc640 1 -- 172.21.15.84:0/3443928616 wait complete. 2024-09-21T03:42:20.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.503+0000 7f501cacc640 1 Processor -- start 2024-09-21T03:42:20.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.503+0000 7f501cacc640 1 -- start start 2024-09-21T03:42:20.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.503+0000 7f501cacc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50181029d0 0x7f50181992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.503+0000 7f501cacc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5018108300 0x7f5018199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.503+0000 7f501cacc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5018108c50 0x7f501819eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.503+0000 7f501cacc640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5018112910 con 0x7f5018108300 2024-09-21T03:42:20.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.503+0000 7f501cacc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5018112790 con 0x7f5018108c50 2024-09-21T03:42:20.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.503+0000 7f501cacc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5018112a90 con 0x7f50181029d0 2024-09-21T03:42:20.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.503+0000 7f5015d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5018108300 0x7f5018199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.503+0000 7f5015d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5018108300 0x7f5018199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33546/0 (socket says 172.21.15.84:33546) 2024-09-21T03:42:20.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.503+0000 7f5015d9b640 1 -- 172.21.15.84:0/2523926862 learned_addr learned my addr 172.21.15.84:0/2523926862 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:20.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.503+0000 7f501659c640 1 --2- 172.21.15.84:0/2523926862 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50181029d0 0x7f50181992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.503+0000 7f5016d9d640 1 --2- 172.21.15.84:0/2523926862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5018108c50 0x7f501819eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.503+0000 7f5015d9b640 1 -- 172.21.15.84:0/2523926862 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50181029d0 msgr2=0x7f50181992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:20.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.503+0000 7f5015d9b640 1 --2- 172.21.15.84:0/2523926862 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50181029d0 0x7f50181992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.503+0000 7f5015d9b640 1 -- 172.21.15.84:0/2523926862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5018108c50 msgr2=0x7f501819eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:20.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.503+0000 7f5015d9b640 1 --2- 172.21.15.84:0/2523926862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5018108c50 0x7f501819eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.503+0000 7f5015d9b640 1 -- 172.21.15.84:0/2523926862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501819f170 con 0x7f5018108300 2024-09-21T03:42:20.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.503+0000 7f5016d9d640 1 --2- 172.21.15.84:0/2523926862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5018108c50 0x7f501819eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:20.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.503+0000 7f5015d9b640 1 --2- 172.21.15.84:0/2523926862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5018108300 0x7f5018199870 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f500c00d740 tx=0x7f500c00db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:20.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.504+0000 7f50077fe640 1 -- 172.21.15.84:0/2523926862 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c017070 con 0x7f5018108300 2024-09-21T03:42:20.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.504+0000 7f501cacc640 1 -- 172.21.15.84:0/2523926862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f501819f460 con 0x7f5018108300 2024-09-21T03:42:20.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.504+0000 7f50077fe640 1 -- 172.21.15.84:0/2523926862 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f500c010460 con 0x7f5018108300 2024-09-21T03:42:20.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.504+0000 7f50077fe640 1 -- 172.21.15.84:0/2523926862 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c00f600 con 0x7f5018108300 2024-09-21T03:42:20.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.504+0000 7f501cacc640 1 -- 172.21.15.84:0/2523926862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50181a5c80 con 0x7f5018108300 2024-09-21T03:42:20.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.505+0000 7f501cacc640 1 -- 172.21.15.84:0/2523926862 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5018102de0 con 0x7f5018108300 2024-09-21T03:42:20.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.506+0000 7f50077fe640 1 -- 172.21.15.84:0/2523926862 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f500c01a070 con 0x7f5018108300 2024-09-21T03:42:20.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.507+0000 7f50077fe640 1 --2- 172.21.15.84:0/2523926862 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f50000b6560 0x7f50000b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.507+0000 7f501659c640 1 --2- 172.21.15.84:0/2523926862 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f50000b6560 0x7f50000b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.507+0000 7f50077fe640 1 -- 172.21.15.84:0/2523926862 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f500c0e6e00 con 0x7f5018108300 2024-09-21T03:42:20.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.508+0000 7f501659c640 1 --2- 172.21.15.84:0/2523926862 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f50000b6560 0x7f50000b8a70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f500800abe0 tx=0x7f500800a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:20.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.510+0000 7f50077fe640 1 -- 172.21.15.84:0/2523926862 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f500c0ad5f0 con 0x7f5018108300 2024-09-21T03:42:20.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:20 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2898307476' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T03:42:20.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:20 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2898307476' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T03:42:20.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.712+0000 7f501cacc640 1 -- 172.21.15.84:0/2523926862 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f5018063800 con 0x7f50000b6560 2024-09-21T03:42:20.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:20 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2898307476' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-21T03:42:20.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.734+0000 7f50077fe640 1 -- 172.21.15.84:0/2523926862 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f5018063800 con 0x7f50000b6560 2024-09-21T03:42:20.735 INFO:teuthology.orchestra.run.smithi084.stdout:{} 2024-09-21T03:42:20.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.736+0000 7f501cacc640 1 -- 172.21.15.84:0/2523926862 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f50000b6560 msgr2=0x7f50000b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:20.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.736+0000 7f501cacc640 1 --2- 172.21.15.84:0/2523926862 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f50000b6560 0x7f50000b8a70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f500800abe0 tx=0x7f500800a2d0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.736+0000 7f501cacc640 1 -- 172.21.15.84:0/2523926862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5018108300 msgr2=0x7f5018199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:20.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.736+0000 7f501cacc640 1 --2- 172.21.15.84:0/2523926862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5018108300 0x7f5018199870 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f500c00d740 tx=0x7f500c00db40 comp rx=0 tx=0).stop 2024-09-21T03:42:20.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.736+0000 7f501cacc640 1 -- 172.21.15.84:0/2523926862 shutdown_connections 2024-09-21T03:42:20.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.736+0000 7f501cacc640 1 --2- 172.21.15.84:0/2523926862 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f50000b6560 0x7f50000b8a70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.736+0000 7f501cacc640 1 --2- 172.21.15.84:0/2523926862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5018108c50 0x7f501819eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.736+0000 7f501cacc640 1 --2- 172.21.15.84:0/2523926862 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5018108300 0x7f5018199870 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.736+0000 7f501cacc640 1 --2- 172.21.15.84:0/2523926862 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f50181029d0 0x7f50181992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.736+0000 7f501cacc640 1 -- 172.21.15.84:0/2523926862 >> 172.21.15.84:0/2523926862 conn(0x7f50180fe3f0 msgr2=0x7f5018100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:20.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.736+0000 7f501cacc640 1 -- 172.21.15.84:0/2523926862 shutdown_connections 2024-09-21T03:42:20.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.736+0000 7f501cacc640 1 -- 172.21.15.84:0/2523926862 wait complete. 2024-09-21T03:42:20.749 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T03:42:20.759 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-21T03:42:20.803 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:42:20.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.910+0000 7f7072fdf640 1 -- 172.21.15.84:0/3813059475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706c10dd50 msgr2=0x7f706c110230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:20.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.910+0000 7f7072fdf640 1 --2- 172.21.15.84:0/3813059475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706c10dd50 0x7f706c110230 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7064009ca0 tx=0x7f706402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.910+0000 7f7072fdf640 1 -- 172.21.15.84:0/3813059475 shutdown_connections 2024-09-21T03:42:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.910+0000 7f7072fdf640 1 --2- 172.21.15.84:0/3813059475 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706c10dd50 0x7f706c110230 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.910+0000 7f7072fdf640 1 --2- 172.21.15.84:0/3813059475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f706c105280 0x7f706c10d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.910+0000 7f7072fdf640 1 --2- 172.21.15.84:0/3813059475 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f706c104930 0x7f706c104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.910+0000 7f7072fdf640 1 -- 172.21.15.84:0/3813059475 >> 172.21.15.84:0/3813059475 conn(0x7f706c0fe380 msgr2=0x7f706c1007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.910+0000 7f7072fdf640 1 -- 172.21.15.84:0/3813059475 shutdown_connections 2024-09-21T03:42:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.910+0000 7f7072fdf640 1 -- 172.21.15.84:0/3813059475 wait complete. 2024-09-21T03:42:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.911+0000 7f7072fdf640 1 Processor -- start 2024-09-21T03:42:20.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.911+0000 7f7072fdf640 1 -- start start 2024-09-21T03:42:20.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.911+0000 7f7072fdf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706c104930 0x7f706c19a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.911+0000 7f7072fdf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f706c105280 0x7f706c19a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.911+0000 7f7072fdf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f706c10dd50 0x7f706c19fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.911+0000 7f7072fdf640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f706c1139c0 con 0x7f706c104930 2024-09-21T03:42:20.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.911+0000 7f7072fdf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f706c113840 con 0x7f706c10dd50 2024-09-21T03:42:20.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.911+0000 7f7072fdf640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f706c113b40 con 0x7f706c105280 2024-09-21T03:42:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.911+0000 7f7070d7b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706c104930 0x7f706c19a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.911+0000 7f7070d7b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706c104930 0x7f706c19a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33588/0 (socket says 172.21.15.84:33588) 2024-09-21T03:42:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.911+0000 7f7070d7b640 1 -- 172.21.15.84:0/1909936057 learned_addr learned my addr 172.21.15.84:0/1909936057 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.911+0000 7f707157c640 1 --2- 172.21.15.84:0/1909936057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f706c10dd50 0x7f706c19fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.911+0000 7f706bfff640 1 --2- 172.21.15.84:0/1909936057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f706c105280 0x7f706c19a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.911+0000 7f7070d7b640 1 -- 172.21.15.84:0/1909936057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f706c105280 msgr2=0x7f706c19a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.911+0000 7f7070d7b640 1 --2- 172.21.15.84:0/1909936057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f706c105280 0x7f706c19a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.911+0000 7f7070d7b640 1 -- 172.21.15.84:0/1909936057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f706c10dd50 msgr2=0x7f706c19fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.911+0000 7f7070d7b640 1 --2- 172.21.15.84:0/1909936057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f706c10dd50 0x7f706c19fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.911+0000 7f7070d7b640 1 -- 172.21.15.84:0/1909936057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f706c1a0330 con 0x7f706c104930 2024-09-21T03:42:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.911+0000 7f706bfff640 1 --2- 172.21.15.84:0/1909936057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f706c105280 0x7f706c19a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.912+0000 7f7070d7b640 1 --2- 172.21.15.84:0/1909936057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706c104930 0x7f706c19a400 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f706000d770 tx=0x7f706000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.912+0000 7f7069ffb640 1 -- 172.21.15.84:0/1909936057 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7060017070 con 0x7f706c104930 2024-09-21T03:42:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.912+0000 7f7072fdf640 1 -- 172.21.15.84:0/1909936057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f706c1a0620 con 0x7f706c104930 2024-09-21T03:42:20.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.912+0000 7f7069ffb640 1 -- 172.21.15.84:0/1909936057 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70600054d0 con 0x7f706c104930 2024-09-21T03:42:20.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.912+0000 7f7069ffb640 1 -- 172.21.15.84:0/1909936057 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7060004c30 con 0x7f706c104930 2024-09-21T03:42:20.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.912+0000 7f7072fdf640 1 -- 172.21.15.84:0/1909936057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f706c1a6db0 con 0x7f706c104930 2024-09-21T03:42:20.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.913+0000 7f7072fdf640 1 -- 172.21.15.84:0/1909936057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f706c06adc0 con 0x7f706c104930 2024-09-21T03:42:20.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.915+0000 7f7069ffb640 1 -- 172.21.15.84:0/1909936057 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f7060004dd0 con 0x7f706c104930 2024-09-21T03:42:20.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.915+0000 7f7069ffb640 1 --2- 172.21.15.84:0/1909936057 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f705c0b6560 0x7f705c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.915+0000 7f706bfff640 1 --2- 172.21.15.84:0/1909936057 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f705c0b6560 0x7f705c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.915+0000 7f7069ffb640 1 -- 172.21.15.84:0/1909936057 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f70600e72b0 con 0x7f706c104930 2024-09-21T03:42:20.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.916+0000 7f706bfff640 1 --2- 172.21.15.84:0/1909936057 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f705c0b6560 0x7f705c0b8a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7058005fd0 tx=0x7f70580094d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:20.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:20.918+0000 7f7069ffb640 1 -- 172.21.15.84:0/1909936057 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f70600adaa0 con 0x7f706c104930 2024-09-21T03:42:21.068 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:42:20 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:42:20.717+0000 7fa4cd7bf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:42:21.068 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:42:20 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:42:20.717+0000 7fa4cd7bf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:42:21.068 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:42:20 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:42:20.717+0000 7fa4cd7bf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:42:21.068 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:42:20 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:42:20.717+0000 7fa4cd7bf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:42:21.068 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:42:20 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:42:20.717+0000 7fa4cd7bf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:42:21.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.096+0000 7f7072fdf640 1 -- 172.21.15.84:0/1909936057 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f706c1a7050 con 0x7f706c104930 2024-09-21T03:42:21.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.098+0000 7f7069ffb640 1 -- 172.21.15.84:0/1909936057 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+23019 (secure 0 0 0) 0x7f70600b1e80 con 0x7f706c104930 2024-09-21T03:42:21.100 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:42:21.100 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":77,"fsid":"e3f8c18e-77c9-11ef-baf5-efdc52797490","created":"2024-09-21T03:31:55.307035+0000","modified":"2024-09-21T03:40:51.455331+0000","last_up_change":"2024-09-21T03:39:38.786385+0000","last_in_change":"2024-09-21T03:39:15.267368+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:35:50.488653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:40:25.934375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:40:27.981681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d283ba0-18f3-4668-90c4-884e9e957a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6803","nonce":508132562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6805","nonce":508132562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6809","nonce":508132562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6807","nonce":508132562}]},"public_addr":"172.21.15.84:6803/508132562","cluster_addr":"172.21.15.84:6805/508132562","heartbeat_back_addr":"172.21.15.84:6809/508132562","heartbeat_front_addr":"172.21.15.84:6807/508132562","state":["exists","up"]},{"osd":1,"uuid":"f115c5b6-812d-430f-9f0e-cb5311b7581e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6801","nonce":2931872350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6803","nonce":2931872350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6807","nonce":2931872350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6805","nonce":2931872350}]},"public_addr":"172.21.15.172:6801/2931872350","cluster_addr":"172.21.15.172:6803/2931872350","heartbeat_back_addr":"172.21.15.172:6807/2931872350","heartbeat_front_addr":"172.21.15.172:6805/2931872350","state":["exists","up"]},{"osd":2,"uuid":"36489240-e233-4aa7-ae9c-089d76683172","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6801","nonce":1847612335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6803","nonce":1847612335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6807","nonce":1847612335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6805","nonce":1847612335}]},"public_addr":"172.21.15.174:6801/1847612335","cluster_addr":"172.21.15.174:6803/1847612335","heartbeat_back_addr":"172.21.15.174:6807/1847612335","heartbeat_front_addr":"172.21.15.174:6805/1847612335","state":["exists","up"]},{"osd":3,"uuid":"1f35b404-b658-4e94-a5f4-74a6431a6a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6811","nonce":2230529863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6813","nonce":2230529863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6817","nonce":2230529863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6815","nonce":2230529863}]},"public_addr":"172.21.15.84:6811/2230529863","cluster_addr":"172.21.15.84:6813/2230529863","heartbeat_back_addr":"172.21.15.84:6817/2230529863","heartbeat_front_addr":"172.21.15.84:6815/2230529863","state":["exists","up"]},{"osd":4,"uuid":"91a2f83b-4c7d-4661-86a1-63a09888939d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6809","nonce":3069862739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6811","nonce":3069862739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6815","nonce":3069862739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6813","nonce":3069862739}]},"public_addr":"172.21.15.172:6809/3069862739","cluster_addr":"172.21.15.172:6811/3069862739","heartbeat_back_addr":"172.21.15.172:6815/3069862739","heartbeat_front_addr":"172.21.15.172:6813/3069862739","state":["exists","up"]},{"osd":5,"uuid":"e8f06b34-3956-499f-8073-09011cf1ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6809","nonce":1987010600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6811","nonce":1987010600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6815","nonce":1987010600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6813","nonce":1987010600}]},"public_addr":"172.21.15.174:6809/1987010600","cluster_addr":"172.21.15.174:6811/1987010600","heartbeat_back_addr":"172.21.15.174:6815/1987010600","heartbeat_front_addr":"172.21.15.174:6813/1987010600","state":["exists","up"]},{"osd":6,"uuid":"23d55e96-4987-4cbe-8c6b-cece4de9269b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6819","nonce":3418459345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6821","nonce":3418459345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6825","nonce":3418459345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6823","nonce":3418459345}]},"public_addr":"172.21.15.84:6819/3418459345","cluster_addr":"172.21.15.84:6821/3418459345","heartbeat_back_addr":"172.21.15.84:6825/3418459345","heartbeat_front_addr":"172.21.15.84:6823/3418459345","state":["exists","up"]},{"osd":7,"uuid":"ca91a34c-d8b1-48b8-93f4-72a5c15939d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6817","nonce":4056019738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6819","nonce":4056019738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6823","nonce":4056019738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6821","nonce":4056019738}]},"public_addr":"172.21.15.172:6817/4056019738","cluster_addr":"172.21.15.172:6819/4056019738","heartbeat_back_addr":"172.21.15.172:6823/4056019738","heartbeat_front_addr":"172.21.15.172:6821/4056019738","state":["exists","up"]},{"osd":8,"uuid":"37da8c61-d72f-4b58-b10c-7c7539ecffd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6817","nonce":2162992546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6819","nonce":2162992546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6823","nonce":2162992546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6821","nonce":2162992546}]},"public_addr":"172.21.15.174:6817/2162992546","cluster_addr":"172.21.15.174:6819/2162992546","heartbeat_back_addr":"172.21.15.174:6823/2162992546","heartbeat_front_addr":"172.21.15.174:6821/2162992546","state":["exists","up"]},{"osd":9,"uuid":"c9179f33-622d-44bd-9d8a-c92951afb1e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6827","nonce":3230873673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6829","nonce":3230873673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6833","nonce":3230873673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6831","nonce":3230873673}]},"public_addr":"172.21.15.84:6827/3230873673","cluster_addr":"172.21.15.84:6829/3230873673","heartbeat_back_addr":"172.21.15.84:6833/3230873673","heartbeat_front_addr":"172.21.15.84:6831/3230873673","state":["exists","up"]},{"osd":10,"uuid":"9788fa2d-49fb-431b-a0e3-62d6e421e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6825","nonce":2667099391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6827","nonce":2667099391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6831","nonce":2667099391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6829","nonce":2667099391}]},"public_addr":"172.21.15.172:6825/2667099391","cluster_addr":"172.21.15.172:6827/2667099391","heartbeat_back_addr":"172.21.15.172:6831/2667099391","heartbeat_front_addr":"172.21.15.172:6829/2667099391","state":["exists","up"]},{"osd":11,"uuid":"a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6825","nonce":3452825924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6827","nonce":3452825924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6831","nonce":3452825924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6829","nonce":3452825924}]},"public_addr":"172.21.15.174:6825/3452825924","cluster_addr":"172.21.15.174:6827/3452825924","heartbeat_back_addr":"172.21.15.174:6831/3452825924","heartbeat_front_addr":"172.21.15.174:6829/3452825924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:34:57.413946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:22.813846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:47.074625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:12.871112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:38.705563+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:04.277966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:29.661290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:55.475432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:20.644247+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:46.151594+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:11.499623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:36.688459+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6800/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3308084314":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3663660709":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/1794153935":"2024-09-22T03:32:49.459372+0000","172.21.15.84:6800/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6800/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1874814897":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6801/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/390051797":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/2148206075":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1916019809":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6801/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3491731835":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3418048965":"2024-09-22T03:33:50.188998+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:42:21.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.100+0000 7f7072fdf640 1 -- 172.21.15.84:0/1909936057 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f705c0b6560 msgr2=0x7f705c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:21.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.100+0000 7f7072fdf640 1 --2- 172.21.15.84:0/1909936057 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f705c0b6560 0x7f705c0b8a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7058005fd0 tx=0x7f70580094d0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.100+0000 7f7072fdf640 1 -- 172.21.15.84:0/1909936057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706c104930 msgr2=0x7f706c19a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:21.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.100+0000 7f7072fdf640 1 --2- 172.21.15.84:0/1909936057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706c104930 0x7f706c19a400 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f706000d770 tx=0x7f706000dc30 comp rx=0 tx=0).stop 2024-09-21T03:42:21.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.100+0000 7f7072fdf640 1 -- 172.21.15.84:0/1909936057 shutdown_connections 2024-09-21T03:42:21.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.100+0000 7f7072fdf640 1 --2- 172.21.15.84:0/1909936057 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f705c0b6560 0x7f705c0b8a70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.100+0000 7f7072fdf640 1 --2- 172.21.15.84:0/1909936057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f706c10dd50 0x7f706c19fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.100+0000 7f7072fdf640 1 --2- 172.21.15.84:0/1909936057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f706c105280 0x7f706c19a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.100+0000 7f7072fdf640 1 --2- 172.21.15.84:0/1909936057 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f706c104930 0x7f706c19a400 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.100+0000 7f7072fdf640 1 -- 172.21.15.84:0/1909936057 >> 172.21.15.84:0/1909936057 conn(0x7f706c0fe380 msgr2=0x7f706c0ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:21.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.100+0000 7f7072fdf640 1 -- 172.21.15.84:0/1909936057 shutdown_connections 2024-09-21T03:42:21.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.100+0000 7f7072fdf640 1 -- 172.21.15.84:0/1909936057 wait complete. 2024-09-21T03:42:21.113 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:35:50.488653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T03:40:25.934375+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T03:40:27.981681+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T03:42:21.114 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T03:42:21.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.224+0000 7f13f36c4640 1 -- 172.21.15.84:0/2003413396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13ec105290 msgr2=0x7f13ec10d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:21.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.224+0000 7f13f36c4640 1 --2- 172.21.15.84:0/2003413396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13ec105290 0x7f13ec10d7d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f13e0009900 tx=0x7f13e002a410 comp rx=0 tx=0).stop 2024-09-21T03:42:21.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.224+0000 7f13f36c4640 1 -- 172.21.15.84:0/2003413396 shutdown_connections 2024-09-21T03:42:21.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.224+0000 7f13f36c4640 1 --2- 172.21.15.84:0/2003413396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13ec10dd60 0x7f13ec110240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.224+0000 7f13f36c4640 1 --2- 172.21.15.84:0/2003413396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13ec105290 0x7f13ec10d7d0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.224+0000 7f13f36c4640 1 --2- 172.21.15.84:0/2003413396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13ec104940 0x7f13ec104d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.224+0000 7f13f36c4640 1 -- 172.21.15.84:0/2003413396 >> 172.21.15.84:0/2003413396 conn(0x7f13ec0fe3b0 msgr2=0x7f13ec100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:21.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.224+0000 7f13f36c4640 1 -- 172.21.15.84:0/2003413396 shutdown_connections 2024-09-21T03:42:21.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.224+0000 7f13f36c4640 1 -- 172.21.15.84:0/2003413396 wait complete. 2024-09-21T03:42:21.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.225+0000 7f13f36c4640 1 Processor -- start 2024-09-21T03:42:21.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.225+0000 7f13f36c4640 1 -- start start 2024-09-21T03:42:21.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.225+0000 7f13f36c4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13ec104940 0x7f13ec19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:21.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.225+0000 7f13f36c4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13ec105290 0x7f13ec19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:21.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.225+0000 7f13f36c4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13ec10dd60 0x7f13ec19fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:21.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.225+0000 7f13f36c4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec1139b0 con 0x7f13ec105290 2024-09-21T03:42:21.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.225+0000 7f13f36c4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec113830 con 0x7f13ec10dd60 2024-09-21T03:42:21.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.225+0000 7f13f36c4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f13ec113b30 con 0x7f13ec104940 2024-09-21T03:42:21.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.225+0000 7f13f0c5f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13ec105290 0x7f13ec19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:21.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.225+0000 7f13f0c5f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13ec105290 0x7f13ec19a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33600/0 (socket says 172.21.15.84:33600) 2024-09-21T03:42:21.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.225+0000 7f13f0c5f640 1 -- 172.21.15.84:0/564288155 learned_addr learned my addr 172.21.15.84:0/564288155 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:21.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.225+0000 7f13f1c61640 1 --2- 172.21.15.84:0/564288155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13ec10dd60 0x7f13ec19fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:21.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.225+0000 7f13f1460640 1 --2- 172.21.15.84:0/564288155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13ec104940 0x7f13ec19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:21.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.225+0000 7f13f0c5f640 1 -- 172.21.15.84:0/564288155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13ec104940 msgr2=0x7f13ec19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:21.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.225+0000 7f13f0c5f640 1 --2- 172.21.15.84:0/564288155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13ec104940 0x7f13ec19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.225+0000 7f13f0c5f640 1 -- 172.21.15.84:0/564288155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13ec10dd60 msgr2=0x7f13ec19fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:21.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.225+0000 7f13f0c5f640 1 --2- 172.21.15.84:0/564288155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13ec10dd60 0x7f13ec19fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.225+0000 7f13f0c5f640 1 -- 172.21.15.84:0/564288155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13ec1a0360 con 0x7f13ec105290 2024-09-21T03:42:21.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.225+0000 7f13f1c61640 1 --2- 172.21.15.84:0/564288155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13ec10dd60 0x7f13ec19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:21.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.226+0000 7f13f0c5f640 1 --2- 172.21.15.84:0/564288155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13ec105290 0x7f13ec19a9d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f13e002a930 tx=0x7f13e0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:21.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.226+0000 7f13ea7fc640 1 -- 172.21.15.84:0/564288155 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e003f030 con 0x7f13ec105290 2024-09-21T03:42:21.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.226+0000 7f13ea7fc640 1 -- 172.21.15.84:0/564288155 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13e0003aa0 con 0x7f13ec105290 2024-09-21T03:42:21.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.226+0000 7f13f36c4640 1 -- 172.21.15.84:0/564288155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13ec1a05f0 con 0x7f13ec105290 2024-09-21T03:42:21.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.226+0000 7f13ea7fc640 1 -- 172.21.15.84:0/564288155 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e0035070 con 0x7f13ec105290 2024-09-21T03:42:21.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.226+0000 7f13f36c4640 1 -- 172.21.15.84:0/564288155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13ec1a6de0 con 0x7f13ec105290 2024-09-21T03:42:21.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.227+0000 7f13f36c4640 1 -- 172.21.15.84:0/564288155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13ec06adc0 con 0x7f13ec105290 2024-09-21T03:42:21.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.228+0000 7f13ea7fc640 1 -- 172.21.15.84:0/564288155 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f13e0042030 con 0x7f13ec105290 2024-09-21T03:42:21.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.229+0000 7f13ea7fc640 1 --2- 172.21.15.84:0/564288155 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f13d40b6560 0x7f13d40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:21.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.229+0000 7f13f1460640 1 --2- 172.21.15.84:0/564288155 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f13d40b6560 0x7f13d40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:21.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.229+0000 7f13ea7fc640 1 -- 172.21.15.84:0/564288155 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f13e0107be0 con 0x7f13ec105290 2024-09-21T03:42:21.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.229+0000 7f13f1460640 1 --2- 172.21.15.84:0/564288155 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f13d40b6560 0x7f13d40b8a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f13dc005fd0 tx=0x7f13dc009870 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:21.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.233+0000 7f13ea7fc640 1 -- 172.21.15.84:0/564288155 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f13e00ce3d0 con 0x7f13ec105290 2024-09-21T03:42:21.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.418+0000 7f13f36c4640 1 -- 172.21.15.84:0/564288155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f13ec1a6fb0 con 0x7f13ec105290 2024-09-21T03:42:21.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.418+0000 7f13ea7fc640 1 -- 172.21.15.84:0/564288155 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7f13e00d27b0 con 0x7f13ec105290 2024-09-21T03:42:21.420 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-09-21T03:42:21.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.421+0000 7f13f36c4640 1 -- 172.21.15.84:0/564288155 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f13d40b6560 msgr2=0x7f13d40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:21.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.421+0000 7f13f36c4640 1 --2- 172.21.15.84:0/564288155 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f13d40b6560 0x7f13d40b8a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f13dc005fd0 tx=0x7f13dc009870 comp rx=0 tx=0).stop 2024-09-21T03:42:21.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.421+0000 7f13f36c4640 1 -- 172.21.15.84:0/564288155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13ec105290 msgr2=0x7f13ec19a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:21.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.421+0000 7f13f36c4640 1 --2- 172.21.15.84:0/564288155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13ec105290 0x7f13ec19a9d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f13e002a930 tx=0x7f13e0004270 comp rx=0 tx=0).stop 2024-09-21T03:42:21.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.421+0000 7f13f36c4640 1 -- 172.21.15.84:0/564288155 shutdown_connections 2024-09-21T03:42:21.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.421+0000 7f13f36c4640 1 --2- 172.21.15.84:0/564288155 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f13d40b6560 0x7f13d40b8a70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.421+0000 7f13f36c4640 1 --2- 172.21.15.84:0/564288155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13ec10dd60 0x7f13ec19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.421+0000 7f13f36c4640 1 --2- 172.21.15.84:0/564288155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13ec105290 0x7f13ec19a9d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.421+0000 7f13f36c4640 1 --2- 172.21.15.84:0/564288155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13ec104940 0x7f13ec19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.421+0000 7f13f36c4640 1 -- 172.21.15.84:0/564288155 >> 172.21.15.84:0/564288155 conn(0x7f13ec0fe3b0 msgr2=0x7f13ec1067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:21.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.421+0000 7f13f36c4640 1 -- 172.21.15.84:0/564288155 shutdown_connections 2024-09-21T03:42:21.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.421+0000 7f13f36c4640 1 -- 172.21.15.84:0/564288155 wait complete. 2024-09-21T03:42:21.434 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T03:42:21.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.543+0000 7fd4c9a9b640 1 -- 172.21.15.84:0/1536620764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4c4108c20 msgr2=0x7fd4c410f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:21.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.543+0000 7fd4c9a9b640 1 --2- 172.21.15.84:0/1536620764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4c4108c20 0x7fd4c410f450 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009900 tx=0x7fd4bc02a410 comp rx=0 tx=0).stop 2024-09-21T03:42:21.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.544+0000 7fd4c9a9b640 1 -- 172.21.15.84:0/1536620764 shutdown_connections 2024-09-21T03:42:21.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.544+0000 7fd4c9a9b640 1 --2- 172.21.15.84:0/1536620764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4c4108c20 0x7fd4c410f450 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.544+0000 7fd4c9a9b640 1 --2- 172.21.15.84:0/1536620764 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4c41082d0 0x7fd4c41086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.544+0000 7fd4c9a9b640 1 --2- 172.21.15.84:0/1536620764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4c41029a0 0x7fd4c4102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.544+0000 7fd4c9a9b640 1 -- 172.21.15.84:0/1536620764 >> 172.21.15.84:0/1536620764 conn(0x7fd4c40fe3c0 msgr2=0x7fd4c4100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:21.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.544+0000 7fd4c9a9b640 1 -- 172.21.15.84:0/1536620764 shutdown_connections 2024-09-21T03:42:21.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.544+0000 7fd4c9a9b640 1 -- 172.21.15.84:0/1536620764 wait complete. 2024-09-21T03:42:21.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.544+0000 7fd4c9a9b640 1 Processor -- start 2024-09-21T03:42:21.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.544+0000 7fd4c9a9b640 1 -- start start 2024-09-21T03:42:21.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.545+0000 7fd4c9a9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4c41029a0 0x7fd4c419a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:21.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.545+0000 7fd4c9a9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4c41082d0 0x7fd4c419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:21.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.545+0000 7fd4c9a9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4c4108c20 0x7fd4c419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:21.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.545+0000 7fd4c9a9b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c4113a20 con 0x7fd4c41082d0 2024-09-21T03:42:21.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.545+0000 7fd4c9a9b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c41138a0 con 0x7fd4c41029a0 2024-09-21T03:42:21.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.545+0000 7fd4c9a9b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c4113ba0 con 0x7fd4c4108c20 2024-09-21T03:42:21.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.545+0000 7fd4c2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4c41082d0 0x7fd4c419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:21.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.545+0000 7fd4c2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4c41082d0 0x7fd4c419a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33610/0 (socket says 172.21.15.84:33610) 2024-09-21T03:42:21.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.545+0000 7fd4c2ffd640 1 -- 172.21.15.84:0/4139737585 learned_addr learned my addr 172.21.15.84:0/4139737585 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:21.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.545+0000 7fd4c37fe640 1 --2- 172.21.15.84:0/4139737585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4c41029a0 0x7fd4c419a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:21.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.545+0000 7fd4c3fff640 1 --2- 172.21.15.84:0/4139737585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4c4108c20 0x7fd4c419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:21.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.545+0000 7fd4c2ffd640 1 -- 172.21.15.84:0/4139737585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4c4108c20 msgr2=0x7fd4c419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:21.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.545+0000 7fd4c2ffd640 1 --2- 172.21.15.84:0/4139737585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4c4108c20 0x7fd4c419fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.545+0000 7fd4c2ffd640 1 -- 172.21.15.84:0/4139737585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4c41029a0 msgr2=0x7fd4c419a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:21.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.545+0000 7fd4c2ffd640 1 --2- 172.21.15.84:0/4139737585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4c41029a0 0x7fd4c419a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.545+0000 7fd4c2ffd640 1 -- 172.21.15.84:0/4139737585 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c41a0330 con 0x7fd4c41082d0 2024-09-21T03:42:21.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.545+0000 7fd4c2ffd640 1 --2- 172.21.15.84:0/4139737585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4c41082d0 0x7fd4c419a9a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8006fd0 tx=0x7fd4b800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:21.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.546+0000 7fd4c0ff9640 1 -- 172.21.15.84:0/4139737585 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8011830 con 0x7fd4c41082d0 2024-09-21T03:42:21.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.546+0000 7fd4c9a9b640 1 -- 172.21.15.84:0/4139737585 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c41a0620 con 0x7fd4c41082d0 2024-09-21T03:42:21.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.546+0000 7fd4c0ff9640 1 -- 172.21.15.84:0/4139737585 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4b8016070 con 0x7fd4c41082d0 2024-09-21T03:42:21.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.546+0000 7fd4c0ff9640 1 -- 172.21.15.84:0/4139737585 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8010e00 con 0x7fd4c41082d0 2024-09-21T03:42:21.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.546+0000 7fd4c9a9b640 1 -- 172.21.15.84:0/4139737585 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c41a6db0 con 0x7fd4c41082d0 2024-09-21T03:42:21.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.547+0000 7fd4c9a9b640 1 -- 172.21.15.84:0/4139737585 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4c4103c10 con 0x7fd4c41082d0 2024-09-21T03:42:21.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.548+0000 7fd4c0ff9640 1 -- 172.21.15.84:0/4139737585 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7fd4b80119d0 con 0x7fd4c41082d0 2024-09-21T03:42:21.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.549+0000 7fd4c0ff9640 1 --2- 172.21.15.84:0/4139737585 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4ac0b6560 0x7fd4ac0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:21.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.549+0000 7fd4c0ff9640 1 -- 172.21.15.84:0/4139737585 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fd4b80e7080 con 0x7fd4c41082d0 2024-09-21T03:42:21.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.549+0000 7fd4c37fe640 1 --2- 172.21.15.84:0/4139737585 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4ac0b6560 0x7fd4ac0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:21.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.549+0000 7fd4c37fe640 1 --2- 172.21.15.84:0/4139737585 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4ac0b6560 0x7fd4ac0b8a70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4005c40 tx=0x7fd4b400a590 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:21.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.552+0000 7fd4c0ff9640 1 -- 172.21.15.84:0/4139737585 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd4b80ad870 con 0x7fd4c41082d0 2024-09-21T03:42:21.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:21 smithi174 ceph-mon[34403]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:42:21.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:21 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2898307476' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T03:42:21.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:21 smithi174 ceph-mon[34403]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:42:21.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:21 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1909936057' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:42:21.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:21 smithi172 ceph-mon[34821]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:42:21.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:21 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2898307476' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T03:42:21.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:21 smithi172 ceph-mon[34821]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:42:21.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:21 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1909936057' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:42:21.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.734+0000 7fd4c9a9b640 1 -- 172.21.15.84:0/4139737585 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd4c419b520 con 0x7fd4c41082d0 2024-09-21T03:42:21.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.734+0000 7fd4c0ff9640 1 -- 172.21.15.84:0/4139737585 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) ==== 104+0+11 (secure 0 0 0) 0x7fd4b80b1c50 con 0x7fd4c41082d0 2024-09-21T03:42:21.736 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-09-21T03:42:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.737+0000 7fd4c9a9b640 1 -- 172.21.15.84:0/4139737585 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4ac0b6560 msgr2=0x7fd4ac0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.737+0000 7fd4c9a9b640 1 --2- 172.21.15.84:0/4139737585 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4ac0b6560 0x7fd4ac0b8a70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4005c40 tx=0x7fd4b400a590 comp rx=0 tx=0).stop 2024-09-21T03:42:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.737+0000 7fd4c9a9b640 1 -- 172.21.15.84:0/4139737585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4c41082d0 msgr2=0x7fd4c419a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.737+0000 7fd4c9a9b640 1 --2- 172.21.15.84:0/4139737585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4c41082d0 0x7fd4c419a9a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8006fd0 tx=0x7fd4b800b8e0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.737+0000 7fd4c9a9b640 1 -- 172.21.15.84:0/4139737585 shutdown_connections 2024-09-21T03:42:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.737+0000 7fd4c9a9b640 1 --2- 172.21.15.84:0/4139737585 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4ac0b6560 0x7fd4ac0b8a70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.737+0000 7fd4c9a9b640 1 --2- 172.21.15.84:0/4139737585 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4c4108c20 0x7fd4c419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.737+0000 7fd4c9a9b640 1 --2- 172.21.15.84:0/4139737585 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4c41082d0 0x7fd4c419a9a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.737+0000 7fd4c9a9b640 1 --2- 172.21.15.84:0/4139737585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4c41029a0 0x7fd4c419a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.737+0000 7fd4c9a9b640 1 -- 172.21.15.84:0/4139737585 >> 172.21.15.84:0/4139737585 conn(0x7fd4c40fe3c0 msgr2=0x7fd4c41007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.737+0000 7fd4c9a9b640 1 -- 172.21.15.84:0/4139737585 shutdown_connections 2024-09-21T03:42:21.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.737+0000 7fd4c9a9b640 1 -- 172.21.15.84:0/4139737585 wait complete. 2024-09-21T03:42:21.749 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:21 smithi084 ceph-mon[30941]: pgmap v320: 97 pgs: 97 active+clean; 643 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:42:21.749 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:21 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2898307476' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-21T03:42:21.749 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:21 smithi084 ceph-mon[30941]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:42:21.749 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:21 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1909936057' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:42:21.750 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T03:42:21.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.860+0000 7f0d27b7b640 1 -- 172.21.15.84:0/397651365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d201061c0 msgr2=0x7f0d201065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.860+0000 7f0d27b7b640 1 --2- 172.21.15.84:0/397651365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d201061c0 0x7f0d201065d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009900 tx=0x7f0d1c02a410 comp rx=0 tx=0).stop 2024-09-21T03:42:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.860+0000 7f0d27b7b640 1 -- 172.21.15.84:0/397651365 shutdown_connections 2024-09-21T03:42:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.860+0000 7f0d27b7b640 1 --2- 172.21.15.84:0/397651365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d20106b10 0x7f0d201105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.860+0000 7f0d27b7b640 1 --2- 172.21.15.84:0/397651365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d201061c0 0x7f0d201065d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.860+0000 7f0d27b7b640 1 --2- 172.21.15.84:0/397651365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d20101fe0 0x7f0d201023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.861+0000 7f0d27b7b640 1 -- 172.21.15.84:0/397651365 >> 172.21.15.84:0/397651365 conn(0x7f0d20079e10 msgr2=0x7f0d2007a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.861+0000 7f0d27b7b640 1 -- 172.21.15.84:0/397651365 shutdown_connections 2024-09-21T03:42:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.861+0000 7f0d27b7b640 1 -- 172.21.15.84:0/397651365 wait complete. 2024-09-21T03:42:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.861+0000 7f0d27b7b640 1 Processor -- start 2024-09-21T03:42:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.861+0000 7f0d27b7b640 1 -- start start 2024-09-21T03:42:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.861+0000 7f0d27b7b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d20101fe0 0x7f0d2019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.861+0000 7f0d27b7b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d201061c0 0x7f0d2019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d27b7b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d20106b10 0x7f0d2019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d27b7b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0d201139e0 con 0x7f0d20106b10 2024-09-21T03:42:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d27b7b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0d20113860 con 0x7f0d20101fe0 2024-09-21T03:42:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d27b7b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0d20113b60 con 0x7f0d201061c0 2024-09-21T03:42:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d26118640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d20106b10 0x7f0d2019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d26118640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d20106b10 0x7f0d2019fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33624/0 (socket says 172.21.15.84:33624) 2024-09-21T03:42:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d26118640 1 -- 172.21.15.84:0/2134798794 learned_addr learned my addr 172.21.15.84:0/2134798794 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d25116640 1 --2- 172.21.15.84:0/2134798794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d201061c0 0x7f0d2019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d25917640 1 --2- 172.21.15.84:0/2134798794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d20101fe0 0x7f0d2019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d26118640 1 -- 172.21.15.84:0/2134798794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d201061c0 msgr2=0x7f0d2019a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d26118640 1 --2- 172.21.15.84:0/2134798794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d201061c0 0x7f0d2019a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d26118640 1 -- 172.21.15.84:0/2134798794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d20101fe0 msgr2=0x7f0d2019a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d26118640 1 --2- 172.21.15.84:0/2134798794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d20101fe0 0x7f0d2019a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d26118640 1 -- 172.21.15.84:0/2134798794 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d201a0350 con 0x7f0d20106b10 2024-09-21T03:42:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d25917640 1 --2- 172.21.15.84:0/2134798794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d20101fe0 0x7f0d2019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d25116640 1 --2- 172.21.15.84:0/2134798794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d201061c0 0x7f0d2019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d26118640 1 --2- 172.21.15.84:0/2134798794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d20106b10 0x7f0d2019fc50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800cad0 tx=0x7f0d1800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d16ffd640 1 -- 172.21.15.84:0/2134798794 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1800ae20 con 0x7f0d20106b10 2024-09-21T03:42:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d27b7b640 1 -- 172.21.15.84:0/2134798794 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d201a0640 con 0x7f0d20106b10 2024-09-21T03:42:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d16ffd640 1 -- 172.21.15.84:0/2134798794 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d18005020 con 0x7f0d20106b10 2024-09-21T03:42:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d16ffd640 1 -- 172.21.15.84:0/2134798794 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1800f6b0 con 0x7f0d20106b10 2024-09-21T03:42:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.862+0000 7f0d27b7b640 1 -- 172.21.15.84:0/2134798794 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d201a6dd0 con 0x7f0d20106b10 2024-09-21T03:42:21.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.864+0000 7f0d27b7b640 1 -- 172.21.15.84:0/2134798794 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d201023f0 con 0x7f0d20106b10 2024-09-21T03:42:21.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.865+0000 7f0d16ffd640 1 -- 172.21.15.84:0/2134798794 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 23) ==== 154529+0+0 (secure 0 0 0) 0x7f0d180051d0 con 0x7f0d20106b10 2024-09-21T03:42:21.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.866+0000 7f0d16ffd640 1 --2- 172.21.15.84:0/2134798794 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0d0c0b6560 0x7f0d0c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:21.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.866+0000 7f0d25917640 1 --2- 172.21.15.84:0/2134798794 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0d0c0b6560 0x7f0d0c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:21.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.866+0000 7f0d16ffd640 1 -- 172.21.15.84:0/2134798794 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f0d180e78d0 con 0x7f0d20106b10 2024-09-21T03:42:21.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.866+0000 7f0d25917640 1 --2- 172.21.15.84:0/2134798794 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0d0c0b6560 0x7f0d0c0b8a70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0d2006b890 tx=0x7f0d10005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:21.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:21.869+0000 7f0d16ffd640 1 -- 172.21.15.84:0/2134798794 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0d18014030 con 0x7f0d20106b10 2024-09-21T03:42:22.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.045+0000 7f0d27b7b640 1 -- 172.21.15.84:0/2134798794 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0d2002e640 con 0x7f0d20106b10 2024-09-21T03:42:22.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.045+0000 7f0d16ffd640 1 -- 172.21.15.84:0/2134798794 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) ==== 100+0+11 (secure 0 0 0) 0x7f0d180ae0c0 con 0x7f0d20106b10 2024-09-21T03:42:22.047 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-09-21T03:42:22.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.047+0000 7f0d27b7b640 1 -- 172.21.15.84:0/2134798794 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0d0c0b6560 msgr2=0x7f0d0c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:22.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.047+0000 7f0d27b7b640 1 --2- 172.21.15.84:0/2134798794 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0d0c0b6560 0x7f0d0c0b8a70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0d2006b890 tx=0x7f0d10005f90 comp rx=0 tx=0).stop 2024-09-21T03:42:22.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.047+0000 7f0d27b7b640 1 -- 172.21.15.84:0/2134798794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d20106b10 msgr2=0x7f0d2019fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:22.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.047+0000 7f0d27b7b640 1 --2- 172.21.15.84:0/2134798794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d20106b10 0x7f0d2019fc50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800cad0 tx=0x7f0d1800cf90 comp rx=0 tx=0).stop 2024-09-21T03:42:22.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.047+0000 7f0d27b7b640 1 -- 172.21.15.84:0/2134798794 shutdown_connections 2024-09-21T03:42:22.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.048+0000 7f0d27b7b640 1 --2- 172.21.15.84:0/2134798794 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0d0c0b6560 0x7f0d0c0b8a70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:22.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.048+0000 7f0d27b7b640 1 --2- 172.21.15.84:0/2134798794 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d20106b10 0x7f0d2019fc50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:22.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.048+0000 7f0d27b7b640 1 --2- 172.21.15.84:0/2134798794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d201061c0 0x7f0d2019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:22.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.048+0000 7f0d27b7b640 1 --2- 172.21.15.84:0/2134798794 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d20101fe0 0x7f0d2019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:22.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.048+0000 7f0d27b7b640 1 -- 172.21.15.84:0/2134798794 >> 172.21.15.84:0/2134798794 conn(0x7f0d20079e10 msgr2=0x7f0d20109580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:22.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.048+0000 7f0d27b7b640 1 -- 172.21.15.84:0/2134798794 shutdown_connections 2024-09-21T03:42:22.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.048+0000 7f0d27b7b640 1 -- 172.21.15.84:0/2134798794 wait complete. 2024-09-21T03:42:22.061 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-21T03:42:22.061 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:42:22.308 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:22.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:22 smithi172 ceph-mon[34821]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:22.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:22 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/564288155' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:42:22.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:22 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/4139737585' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T03:42:22.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:22 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2134798794' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T03:42:22.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:22 smithi084 ceph-mon[30941]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:22.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:22 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/564288155' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:42:22.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:22 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/4139737585' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T03:42:22.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:22 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2134798794' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T03:42:22.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.844+0000 7f6135668640 1 -- 172.21.15.84:0/3907005331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61301083c0 msgr2=0x7f61301087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:22.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.844+0000 7f6135668640 1 --2- 172.21.15.84:0/3907005331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61301083c0 0x7f61301087d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6118009900 tx=0x7f611802a410 comp rx=0 tx=0).stop 2024-09-21T03:42:22.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.844+0000 7f6135668640 1 -- 172.21.15.84:0/3907005331 shutdown_connections 2024-09-21T03:42:22.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.844+0000 7f6135668640 1 --2- 172.21.15.84:0/3907005331 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6130108d10 0x7f613010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:22.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.844+0000 7f6135668640 1 --2- 172.21.15.84:0/3907005331 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f61301083c0 0x7f61301087d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:22.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.844+0000 7f6135668640 1 --2- 172.21.15.84:0/3907005331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6130102a80 0x7f6130102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:22.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.844+0000 7f6135668640 1 -- 172.21.15.84:0/3907005331 >> 172.21.15.84:0/3907005331 conn(0x7f6130079740 msgr2=0x7f6130079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:22.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.844+0000 7f6135668640 1 -- 172.21.15.84:0/3907005331 shutdown_connections 2024-09-21T03:42:22.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.844+0000 7f6135668640 1 -- 172.21.15.84:0/3907005331 wait complete. 2024-09-21T03:42:22.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.845+0000 7f6135668640 1 Processor -- start 2024-09-21T03:42:22.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.845+0000 7f6135668640 1 -- start start 2024-09-21T03:42:22.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.845+0000 7f6135668640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6130102a80 0x7f61300ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:22.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.845+0000 7f6135668640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61301083c0 0x7f61300ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:22.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.845+0000 7f6135668640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6130108d10 0x7f6130100110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:22.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.845+0000 7f6135668640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6130112980 con 0x7f6130102a80 2024-09-21T03:42:22.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.845+0000 7f6135668640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6130112800 con 0x7f61301083c0 2024-09-21T03:42:22.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.845+0000 7f6135668640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6130112b00 con 0x7f6130108d10 2024-09-21T03:42:22.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.846+0000 7f612effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6130102a80 0x7f61300ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:22.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.846+0000 7f612effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6130102a80 0x7f61300ff690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33632/0 (socket says 172.21.15.84:33632) 2024-09-21T03:42:22.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.846+0000 7f612effd640 1 -- 172.21.15.84:0/3465797248 learned_addr learned my addr 172.21.15.84:0/3465797248 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.846+0000 7f612e7fc640 1 --2- 172.21.15.84:0/3465797248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61301083c0 0x7f61300ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.846+0000 7f612f7fe640 1 --2- 172.21.15.84:0/3465797248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6130108d10 0x7f6130100110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.846+0000 7f612effd640 1 -- 172.21.15.84:0/3465797248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6130108d10 msgr2=0x7f6130100110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.846+0000 7f612effd640 1 --2- 172.21.15.84:0/3465797248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6130108d10 0x7f6130100110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.846+0000 7f612effd640 1 -- 172.21.15.84:0/3465797248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61301083c0 msgr2=0x7f61300ffbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.846+0000 7f612effd640 1 --2- 172.21.15.84:0/3465797248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61301083c0 0x7f61300ffbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.846+0000 7f612effd640 1 -- 172.21.15.84:0/3465797248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61301a87e0 con 0x7f6130102a80 2024-09-21T03:42:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.846+0000 7f612effd640 1 --2- 172.21.15.84:0/3465797248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6130102a80 0x7f61300ff690 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f612000c890 tx=0x7f612000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.846+0000 7f6127fff640 1 -- 172.21.15.84:0/3465797248 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6120004220 con 0x7f6130102a80 2024-09-21T03:42:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.846+0000 7f6127fff640 1 -- 172.21.15.84:0/3465797248 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61200043c0 con 0x7f6130102a80 2024-09-21T03:42:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.846+0000 7f6135668640 1 -- 172.21.15.84:0/3465797248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61301a8ad0 con 0x7f6130102a80 2024-09-21T03:42:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.846+0000 7f6127fff640 1 -- 172.21.15.84:0/3465797248 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6120004a00 con 0x7f6130102a80 2024-09-21T03:42:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.846+0000 7f6135668640 1 -- 172.21.15.84:0/3465797248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61301a8fe0 con 0x7f6130102a80 2024-09-21T03:42:22.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.847+0000 7f6135668640 1 -- 172.21.15.84:0/3465797248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6130103d00 con 0x7f6130102a80 2024-09-21T03:42:22.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.850+0000 7f6127fff640 1 -- 172.21.15.84:0/3465797248 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7f61200079b0 con 0x7f6130102a80 2024-09-21T03:42:22.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.850+0000 7f6127fff640 1 --2- 172.21.15.84:0/3465797248 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f611c0b65f0 0x7f611c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:22.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.851+0000 7f612e7fc640 1 --2- 172.21.15.84:0/3465797248 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f611c0b65f0 0x7f611c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:22.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.851+0000 7f6127fff640 1 -- 172.21.15.84:0/3465797248 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f61200e7720 con 0x7f6130102a80 2024-09-21T03:42:22.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.851+0000 7f612e7fc640 1 --2- 172.21.15.84:0/3465797248 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f611c0b65f0 0x7f611c0b8b00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6118000c00 tx=0x7f6118031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:22.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:22.854+0000 7f6127fff640 1 -- 172.21.15.84:0/3465797248 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6120014030 con 0x7f6130102a80 2024-09-21T03:42:22.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:22 smithi174 ceph-mon[34403]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:22.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:22 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/564288155' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:42:22.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:22 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/4139737585' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T03:42:22.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:22 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2134798794' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T03:42:23.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:23.071+0000 7f6135668640 1 -- 172.21.15.84:0/3465797248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6130102e90 con 0x7f6130102a80 2024-09-21T03:42:23.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:23.072+0000 7f6127fff640 1 -- 172.21.15.84:0/3465797248 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7f6130102e90 con 0x7f6130102a80 2024-09-21T03:42:23.074 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:42:23.074 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:42:23.074 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:42:23.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:23.074+0000 7f6135668640 1 -- 172.21.15.84:0/3465797248 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f611c0b65f0 msgr2=0x7f611c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:23.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:23.074+0000 7f6135668640 1 --2- 172.21.15.84:0/3465797248 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f611c0b65f0 0x7f611c0b8b00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6118000c00 tx=0x7f6118031400 comp rx=0 tx=0).stop 2024-09-21T03:42:23.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:23.074+0000 7f6135668640 1 -- 172.21.15.84:0/3465797248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6130102a80 msgr2=0x7f61300ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:23.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:23.074+0000 7f6135668640 1 --2- 172.21.15.84:0/3465797248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6130102a80 0x7f61300ff690 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f612000c890 tx=0x7f612000cd50 comp rx=0 tx=0).stop 2024-09-21T03:42:23.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:23.074+0000 7f6135668640 1 -- 172.21.15.84:0/3465797248 shutdown_connections 2024-09-21T03:42:23.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:23.074+0000 7f6135668640 1 --2- 172.21.15.84:0/3465797248 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f611c0b65f0 0x7f611c0b8b00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:23.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:23.074+0000 7f6135668640 1 --2- 172.21.15.84:0/3465797248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6130108d10 0x7f6130100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:23.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:23.074+0000 7f6135668640 1 --2- 172.21.15.84:0/3465797248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61301083c0 0x7f61300ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:23.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:23.074+0000 7f6135668640 1 --2- 172.21.15.84:0/3465797248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6130102a80 0x7f61300ff690 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:23.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:23.074+0000 7f6135668640 1 -- 172.21.15.84:0/3465797248 >> 172.21.15.84:0/3465797248 conn(0x7f6130079740 msgr2=0x7f6130101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:23.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:23.074+0000 7f6135668640 1 -- 172.21.15.84:0/3465797248 shutdown_connections 2024-09-21T03:42:23.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:23.074+0000 7f6135668640 1 -- 172.21.15.84:0/3465797248 wait complete. 2024-09-21T03:42:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:23 smithi172 ceph-mon[34821]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T03:42:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:23 smithi172 ceph-mon[34821]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T03:42:23.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:23 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3465797248' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:42:23.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:23 smithi084 ceph-mon[30941]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T03:42:23.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:23 smithi084 ceph-mon[30941]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T03:42:23.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:23 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3465797248' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:42:23.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:23 smithi174 ceph-mon[34403]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T03:42:23.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:23 smithi174 ceph-mon[34403]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T03:42:23.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:23 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3465797248' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:42:23.891 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-21T03:42:23.891 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-21T03:42:23.891 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:42:24.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.003+0000 7f12922bd640 1 -- 172.21.15.84:0/1322845044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f128c1082f0 msgr2=0x7f128c108700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:24.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.003+0000 7f12922bd640 1 --2- 172.21.15.84:0/1322845044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f128c1082f0 0x7f128c108700 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1280009900 tx=0x7f128002a410 comp rx=0 tx=0).stop 2024-09-21T03:42:24.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.003+0000 7f12922bd640 1 -- 172.21.15.84:0/1322845044 shutdown_connections 2024-09-21T03:42:24.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.003+0000 7f12922bd640 1 --2- 172.21.15.84:0/1322845044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f128c108c40 0x7f128c10f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.003+0000 7f12922bd640 1 --2- 172.21.15.84:0/1322845044 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f128c1082f0 0x7f128c108700 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.003+0000 7f12922bd640 1 --2- 172.21.15.84:0/1322845044 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f128c1029c0 0x7f128c102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.003+0000 7f12922bd640 1 -- 172.21.15.84:0/1322845044 >> 172.21.15.84:0/1322845044 conn(0x7f128c07a670 msgr2=0x7f128c07aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:24.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.003+0000 7f12922bd640 1 -- 172.21.15.84:0/1322845044 shutdown_connections 2024-09-21T03:42:24.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.003+0000 7f12922bd640 1 -- 172.21.15.84:0/1322845044 wait complete. 2024-09-21T03:42:24.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.003+0000 7f12922bd640 1 Processor -- start 2024-09-21T03:42:24.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.003+0000 7f12922bd640 1 -- start start 2024-09-21T03:42:24.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.004+0000 7f12922bd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f128c1029c0 0x7f128c198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:24.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.004+0000 7f12922bd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f128c1082f0 0x7f128c1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:24.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.004+0000 7f12922bd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f128c108c40 0x7f128c19da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:24.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.004+0000 7f12922bd640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f128c111800 con 0x7f128c1029c0 2024-09-21T03:42:24.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.004+0000 7f12922bd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f128c111680 con 0x7f128c1082f0 2024-09-21T03:42:24.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.004+0000 7f12922bd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f128c111980 con 0x7f128c108c40 2024-09-21T03:42:24.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.004+0000 7f128bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f128c1029c0 0x7f128c198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:24.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.004+0000 7f128bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f128c1029c0 0x7f128c198220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33652/0 (socket says 172.21.15.84:33652) 2024-09-21T03:42:24.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.004+0000 7f128bfff640 1 -- 172.21.15.84:0/2522245885 learned_addr learned my addr 172.21.15.84:0/2522245885 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:24.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.004+0000 7f128b7fe640 1 --2- 172.21.15.84:0/2522245885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f128c1082f0 0x7f128c1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:24.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.004+0000 7f129085a640 1 --2- 172.21.15.84:0/2522245885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f128c108c40 0x7f128c19da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:24.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.004+0000 7f128bfff640 1 -- 172.21.15.84:0/2522245885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f128c108c40 msgr2=0x7f128c19da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:24.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.004+0000 7f128bfff640 1 --2- 172.21.15.84:0/2522245885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f128c108c40 0x7f128c19da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.004+0000 7f128bfff640 1 -- 172.21.15.84:0/2522245885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f128c1082f0 msgr2=0x7f128c1987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:24.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.004+0000 7f128bfff640 1 --2- 172.21.15.84:0/2522245885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f128c1082f0 0x7f128c1987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.004+0000 7f128bfff640 1 -- 172.21.15.84:0/2522245885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128c19e150 con 0x7f128c1029c0 2024-09-21T03:42:24.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.004+0000 7f129085a640 1 --2- 172.21.15.84:0/2522245885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f128c108c40 0x7f128c19da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:24.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.004+0000 7f128bfff640 1 --2- 172.21.15.84:0/2522245885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f128c1029c0 0x7f128c198220 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f127c009de0 tx=0x7f127c00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:24.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.005+0000 7f12897fa640 1 -- 172.21.15.84:0/2522245885 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c005020 con 0x7f128c1029c0 2024-09-21T03:42:24.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.005+0000 7f12922bd640 1 -- 172.21.15.84:0/2522245885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f128c19e440 con 0x7f128c1029c0 2024-09-21T03:42:24.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.005+0000 7f12897fa640 1 -- 172.21.15.84:0/2522245885 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f127c0047a0 con 0x7f128c1029c0 2024-09-21T03:42:24.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.005+0000 7f12897fa640 1 -- 172.21.15.84:0/2522245885 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127c017660 con 0x7f128c1029c0 2024-09-21T03:42:24.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.005+0000 7f12922bd640 1 -- 172.21.15.84:0/2522245885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f128c1a4bd0 con 0x7f128c1029c0 2024-09-21T03:42:24.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.006+0000 7f12922bd640 1 -- 172.21.15.84:0/2522245885 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f128c102dd0 con 0x7f128c1029c0 2024-09-21T03:42:24.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.007+0000 7f12897fa640 1 -- 172.21.15.84:0/2522245885 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7f127c004950 con 0x7f128c1029c0 2024-09-21T03:42:24.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.008+0000 7f12897fa640 1 --2- 172.21.15.84:0/2522245885 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f12740b65f0 0x7f12740b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:24.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.008+0000 7f128b7fe640 1 --2- 172.21.15.84:0/2522245885 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f12740b65f0 0x7f12740b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:24.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.008+0000 7f12897fa640 1 -- 172.21.15.84:0/2522245885 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f127c0e9ad0 con 0x7f128c1029c0 2024-09-21T03:42:24.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.009+0000 7f128b7fe640 1 --2- 172.21.15.84:0/2522245885 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f12740b65f0 0x7f12740b8b00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1280009230 tx=0x7f1280031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:24.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.011+0000 7f12897fa640 1 -- 172.21.15.84:0/2522245885 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f127c012070 con 0x7f128c1029c0 2024-09-21T03:42:24.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.183+0000 7f12922bd640 1 -- 172.21.15.84:0/2522245885 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f128c063800 con 0x7f12740b65f0 2024-09-21T03:42:24.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.187+0000 7f12897fa640 1 -- 172.21.15.84:0/2522245885 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259094 (secure 0 0 0) 0x7f128c063800 con 0x7f12740b65f0 2024-09-21T03:42:24.192 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:42:24.193 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T03:42:24.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.190+0000 7f12922bd640 1 -- 172.21.15.84:0/2522245885 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f12740b65f0 msgr2=0x7f12740b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:24.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.190+0000 7f12922bd640 1 --2- 172.21.15.84:0/2522245885 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f12740b65f0 0x7f12740b8b00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1280009230 tx=0x7f1280031400 comp rx=0 tx=0).stop 2024-09-21T03:42:24.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.190+0000 7f12922bd640 1 -- 172.21.15.84:0/2522245885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f128c1029c0 msgr2=0x7f128c198220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:24.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.190+0000 7f12922bd640 1 --2- 172.21.15.84:0/2522245885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f128c1029c0 0x7f128c198220 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f127c009de0 tx=0x7f127c00f4a0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.190+0000 7f12922bd640 1 -- 172.21.15.84:0/2522245885 shutdown_connections 2024-09-21T03:42:24.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.190+0000 7f12922bd640 1 --2- 172.21.15.84:0/2522245885 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f12740b65f0 0x7f12740b8b00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.190+0000 7f12922bd640 1 --2- 172.21.15.84:0/2522245885 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f128c108c40 0x7f128c19da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.190+0000 7f12922bd640 1 --2- 172.21.15.84:0/2522245885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f128c1082f0 0x7f128c1987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.190+0000 7f12922bd640 1 --2- 172.21.15.84:0/2522245885 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f128c1029c0 0x7f128c198220 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.190+0000 7f12922bd640 1 -- 172.21.15.84:0/2522245885 >> 172.21.15.84:0/2522245885 conn(0x7f128c07a670 msgr2=0x7f128c1063e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:24.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.190+0000 7f12922bd640 1 -- 172.21.15.84:0/2522245885 shutdown_connections 2024-09-21T03:42:24.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.190+0000 7f12922bd640 1 -- 172.21.15.84:0/2522245885 wait complete. 2024-09-21T03:42:24.204 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2024-09-21T03:42:22.306696+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659124,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":705,"num_read_kb":454,"num_write":294,"num_write_kb":2273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":2952987,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":738,"ondisk_log_size":738,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384532,"kb_used_data":10324,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124557292,"statfs":{"total":1151940427776,"available":1151546667008,"internally_reserved":0,"allocated":10571776,"data_stored":6966628,"data_compressed":181959,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":782,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":36,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003320"},"pg_stats":[{"pgid":"3.3f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.547556+0000","last_change":"2024-09-21T03:40:29.337467+0000","last_active":"2024-09-21T03:41:50.547556+0000","last_peered":"2024-09-21T03:41:50.547556+0000","last_clean":"2024-09-21T03:41:50.547556+0000","last_became_active":"2024-09-21T03:40:29.337102+0000","last_became_peered":"2024-09-21T03:40:29.337102+0000","last_unstale":"2024-09-21T03:41:50.547556+0000","last_undegraded":"2024-09-21T03:41:50.547556+0000","last_fullsized":"2024-09-21T03:41:50.547556+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:53.798977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.532013+0000","last_change":"2024-09-21T03:40:29.336446+0000","last_active":"2024-09-21T03:41:50.532013+0000","last_peered":"2024-09-21T03:41:50.532013+0000","last_clean":"2024-09-21T03:41:50.532013+0000","last_became_active":"2024-09-21T03:40:29.336081+0000","last_became_peered":"2024-09-21T03:40:29.336081+0000","last_unstale":"2024-09-21T03:41:50.532013+0000","last_undegraded":"2024-09-21T03:41:50.532013+0000","last_fullsized":"2024-09-21T03:41:50.532013+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:23.892700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.545127+0000","last_change":"2024-09-21T03:40:29.342861+0000","last_active":"2024-09-21T03:41:50.545127+0000","last_peered":"2024-09-21T03:41:50.545127+0000","last_clean":"2024-09-21T03:41:50.545127+0000","last_became_active":"2024-09-21T03:40:29.342111+0000","last_became_peered":"2024-09-21T03:40:29.342111+0000","last_unstale":"2024-09-21T03:41:50.545127+0000","last_undegraded":"2024-09-21T03:41:50.545127+0000","last_fullsized":"2024-09-21T03:41:50.545127+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:30.012195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.538824+0000","last_change":"2024-09-21T03:40:29.339822+0000","last_active":"2024-09-21T03:41:50.538824+0000","last_peered":"2024-09-21T03:41:50.538824+0000","last_clean":"2024-09-21T03:41:50.538824+0000","last_became_active":"2024-09-21T03:40:29.339126+0000","last_became_peered":"2024-09-21T03:40:29.339126+0000","last_unstale":"2024-09-21T03:41:50.538824+0000","last_undegraded":"2024-09-21T03:41:50.538824+0000","last_fullsized":"2024-09-21T03:41:50.538824+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:44.874344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.522428+0000","last_change":"2024-09-21T03:40:29.333683+0000","last_active":"2024-09-21T03:41:50.522428+0000","last_peered":"2024-09-21T03:41:50.522428+0000","last_clean":"2024-09-21T03:41:50.522428+0000","last_became_active":"2024-09-21T03:40:29.333329+0000","last_became_peered":"2024-09-21T03:40:29.333329+0000","last_unstale":"2024-09-21T03:41:50.522428+0000","last_undegraded":"2024-09-21T03:41:50.522428+0000","last_fullsized":"2024-09-21T03:41:50.522428+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:42.655732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.527562+0000","last_change":"2024-09-21T03:40:29.346193+0000","last_active":"2024-09-21T03:41:50.527562+0000","last_peered":"2024-09-21T03:41:50.527562+0000","last_clean":"2024-09-21T03:41:50.527562+0000","last_became_active":"2024-09-21T03:40:29.345808+0000","last_became_peered":"2024-09-21T03:40:29.345808+0000","last_unstale":"2024-09-21T03:41:50.527562+0000","last_undegraded":"2024-09-21T03:41:50.527562+0000","last_fullsized":"2024-09-21T03:41:50.527562+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:59.621904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.535861+0000","last_change":"2024-09-21T03:40:29.337782+0000","last_active":"2024-09-21T03:41:50.535861+0000","last_peered":"2024-09-21T03:41:50.535861+0000","last_clean":"2024-09-21T03:41:50.535861+0000","last_became_active":"2024-09-21T03:40:29.337390+0000","last_became_peered":"2024-09-21T03:40:29.337390+0000","last_unstale":"2024-09-21T03:41:50.535861+0000","last_undegraded":"2024-09-21T03:41:50.535861+0000","last_fullsized":"2024-09-21T03:41:50.535861+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:49.924375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.535660+0000","last_change":"2024-09-21T03:40:29.340821+0000","last_active":"2024-09-21T03:41:50.535660+0000","last_peered":"2024-09-21T03:41:50.535660+0000","last_clean":"2024-09-21T03:41:50.535660+0000","last_became_active":"2024-09-21T03:40:29.340465+0000","last_became_peered":"2024-09-21T03:40:29.340465+0000","last_unstale":"2024-09-21T03:41:50.535660+0000","last_undegraded":"2024-09-21T03:41:50.535660+0000","last_fullsized":"2024-09-21T03:41:50.535660+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:18.600335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.541949+0000","last_change":"2024-09-21T03:40:29.345218+0000","last_active":"2024-09-21T03:41:50.541949+0000","last_peered":"2024-09-21T03:41:50.541949+0000","last_clean":"2024-09-21T03:41:50.541949+0000","last_became_active":"2024-09-21T03:40:29.344862+0000","last_became_peered":"2024-09-21T03:40:29.344862+0000","last_unstale":"2024-09-21T03:41:50.541949+0000","last_undegraded":"2024-09-21T03:41:50.541949+0000","last_fullsized":"2024-09-21T03:41:50.541949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:53.570489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"77'16","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.528972+0000","last_change":"2024-09-21T03:40:51.471622+0000","last_active":"2024-09-21T03:41:50.528972+0000","last_peered":"2024-09-21T03:41:50.528972+0000","last_clean":"2024-09-21T03:41:50.528972+0000","last_became_active":"2024-09-21T03:40:51.471276+0000","last_became_peered":"2024-09-21T03:40:51.471276+0000","last_unstale":"2024-09-21T03:41:50.528972+0000","last_undegraded":"2024-09-21T03:41:50.528972+0000","last_fullsized":"2024-09-21T03:41:50.528972+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:38.030634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.548357+0000","last_change":"2024-09-21T03:40:29.338353+0000","last_active":"2024-09-21T03:41:50.548357+0000","last_peered":"2024-09-21T03:41:50.548357+0000","last_clean":"2024-09-21T03:41:50.548357+0000","last_became_active":"2024-09-21T03:40:29.337976+0000","last_became_peered":"2024-09-21T03:40:29.337976+0000","last_unstale":"2024-09-21T03:41:50.548357+0000","last_undegraded":"2024-09-21T03:41:50.548357+0000","last_fullsized":"2024-09-21T03:41:50.548357+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:10.182045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.530870+0000","last_change":"2024-09-21T03:40:29.343617+0000","last_active":"2024-09-21T03:41:50.530870+0000","last_peered":"2024-09-21T03:41:50.530870+0000","last_clean":"2024-09-21T03:41:50.530870+0000","last_became_active":"2024-09-21T03:40:29.342586+0000","last_became_peered":"2024-09-21T03:40:29.342586+0000","last_unstale":"2024-09-21T03:41:50.530870+0000","last_undegraded":"2024-09-21T03:41:50.530870+0000","last_fullsized":"2024-09-21T03:41:50.530870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:06.823802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.533573+0000","last_change":"2024-09-21T03:40:29.338633+0000","last_active":"2024-09-21T03:41:50.533573+0000","last_peered":"2024-09-21T03:41:50.533573+0000","last_clean":"2024-09-21T03:41:50.533573+0000","last_became_active":"2024-09-21T03:40:29.337502+0000","last_became_peered":"2024-09-21T03:40:29.337502+0000","last_unstale":"2024-09-21T03:41:50.533573+0000","last_undegraded":"2024-09-21T03:41:50.533573+0000","last_fullsized":"2024-09-21T03:41:50.533573+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:04.121275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.534492+0000","last_change":"2024-09-21T03:40:29.335774+0000","last_active":"2024-09-21T03:41:50.534492+0000","last_peered":"2024-09-21T03:41:50.534492+0000","last_clean":"2024-09-21T03:41:50.534492+0000","last_became_active":"2024-09-21T03:40:29.335452+0000","last_became_peered":"2024-09-21T03:40:29.335452+0000","last_unstale":"2024-09-21T03:41:50.534492+0000","last_undegraded":"2024-09-21T03:41:50.534492+0000","last_fullsized":"2024-09-21T03:41:50.534492+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:37.427015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.540744+0000","last_change":"2024-09-21T03:40:29.342874+0000","last_active":"2024-09-21T03:41:50.540744+0000","last_peered":"2024-09-21T03:41:50.540744+0000","last_clean":"2024-09-21T03:41:50.540744+0000","last_became_active":"2024-09-21T03:40:29.342343+0000","last_became_peered":"2024-09-21T03:40:29.342343+0000","last_unstale":"2024-09-21T03:41:50.540744+0000","last_undegraded":"2024-09-21T03:41:50.540744+0000","last_fullsized":"2024-09-21T03:41:50.540744+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:52.473608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.550793+0000","last_change":"2024-09-21T03:40:29.339231+0000","last_active":"2024-09-21T03:41:50.550793+0000","last_peered":"2024-09-21T03:41:50.550793+0000","last_clean":"2024-09-21T03:41:50.550793+0000","last_became_active":"2024-09-21T03:40:29.338724+0000","last_became_peered":"2024-09-21T03:40:29.338724+0000","last_unstale":"2024-09-21T03:41:50.550793+0000","last_undegraded":"2024-09-21T03:41:50.550793+0000","last_fullsized":"2024-09-21T03:41:50.550793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:55.592713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.547802+0000","last_change":"2024-09-21T03:40:29.338480+0000","last_active":"2024-09-21T03:41:50.547802+0000","last_peered":"2024-09-21T03:41:50.547802+0000","last_clean":"2024-09-21T03:41:50.547802+0000","last_became_active":"2024-09-21T03:40:29.338092+0000","last_became_peered":"2024-09-21T03:40:29.338092+0000","last_unstale":"2024-09-21T03:41:50.547802+0000","last_undegraded":"2024-09-21T03:41:50.547802+0000","last_fullsized":"2024-09-21T03:41:50.547802+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:25.557502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.545250+0000","last_change":"2024-09-21T03:40:29.335557+0000","last_active":"2024-09-21T03:41:50.545250+0000","last_peered":"2024-09-21T03:41:50.545250+0000","last_clean":"2024-09-21T03:41:50.545250+0000","last_became_active":"2024-09-21T03:40:29.335214+0000","last_became_peered":"2024-09-21T03:40:29.335214+0000","last_unstale":"2024-09-21T03:41:50.545250+0000","last_undegraded":"2024-09-21T03:41:50.545250+0000","last_fullsized":"2024-09-21T03:41:50.545250+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:21.395995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.530848+0000","last_change":"2024-09-21T03:40:29.333041+0000","last_active":"2024-09-21T03:41:50.530848+0000","last_peered":"2024-09-21T03:41:50.530848+0000","last_clean":"2024-09-21T03:41:50.530848+0000","last_became_active":"2024-09-21T03:40:29.332187+0000","last_became_peered":"2024-09-21T03:40:29.332187+0000","last_unstale":"2024-09-21T03:41:50.530848+0000","last_undegraded":"2024-09-21T03:41:50.530848+0000","last_fullsized":"2024-09-21T03:41:50.530848+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:03.253594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.529370+0000","last_change":"2024-09-21T03:40:29.339152+0000","last_active":"2024-09-21T03:41:50.529370+0000","last_peered":"2024-09-21T03:41:50.529370+0000","last_clean":"2024-09-21T03:41:50.529370+0000","last_became_active":"2024-09-21T03:40:29.338722+0000","last_became_peered":"2024-09-21T03:40:29.338722+0000","last_unstale":"2024-09-21T03:41:50.529370+0000","last_undegraded":"2024-09-21T03:41:50.529370+0000","last_fullsized":"2024-09-21T03:41:50.529370+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:32.143498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.546810+0000","last_change":"2024-09-21T03:40:29.329169+0000","last_active":"2024-09-21T03:41:50.546810+0000","last_peered":"2024-09-21T03:41:50.546810+0000","last_clean":"2024-09-21T03:41:50.546810+0000","last_became_active":"2024-09-21T03:40:29.328805+0000","last_became_peered":"2024-09-21T03:40:29.328805+0000","last_unstale":"2024-09-21T03:41:50.546810+0000","last_undegraded":"2024-09-21T03:41:50.546810+0000","last_fullsized":"2024-09-21T03:41:50.546810+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:13.725038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.550737+0000","last_change":"2024-09-21T03:40:29.336699+0000","last_active":"2024-09-21T03:41:50.550737+0000","last_peered":"2024-09-21T03:41:50.550737+0000","last_clean":"2024-09-21T03:41:50.550737+0000","last_became_active":"2024-09-21T03:40:29.333649+0000","last_became_peered":"2024-09-21T03:40:29.333649+0000","last_unstale":"2024-09-21T03:41:50.550737+0000","last_undegraded":"2024-09-21T03:41:50.550737+0000","last_fullsized":"2024-09-21T03:41:50.550737+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:49.418205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.531010+0000","last_change":"2024-09-21T03:40:29.337936+0000","last_active":"2024-09-21T03:41:50.531010+0000","last_peered":"2024-09-21T03:41:50.531010+0000","last_clean":"2024-09-21T03:41:50.531010+0000","last_became_active":"2024-09-21T03:40:29.337521+0000","last_became_peered":"2024-09-21T03:40:29.337521+0000","last_unstale":"2024-09-21T03:41:50.531010+0000","last_undegraded":"2024-09-21T03:41:50.531010+0000","last_fullsized":"2024-09-21T03:41:50.531010+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:09.223634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.532926+0000","last_change":"2024-09-21T03:40:29.336866+0000","last_active":"2024-09-21T03:41:50.532926+0000","last_peered":"2024-09-21T03:41:50.532926+0000","last_clean":"2024-09-21T03:41:50.532926+0000","last_became_active":"2024-09-21T03:40:29.336447+0000","last_became_peered":"2024-09-21T03:40:29.336447+0000","last_unstale":"2024-09-21T03:41:50.532926+0000","last_undegraded":"2024-09-21T03:41:50.532926+0000","last_fullsized":"2024-09-21T03:41:50.532926+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:53.487678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.530414+0000","last_change":"2024-09-21T03:40:29.333666+0000","last_active":"2024-09-21T03:41:50.530414+0000","last_peered":"2024-09-21T03:41:50.530414+0000","last_clean":"2024-09-21T03:41:50.530414+0000","last_became_active":"2024-09-21T03:40:29.333248+0000","last_became_peered":"2024-09-21T03:40:29.333248+0000","last_unstale":"2024-09-21T03:41:50.530414+0000","last_undegraded":"2024-09-21T03:41:50.530414+0000","last_fullsized":"2024-09-21T03:41:50.530414+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:54.721926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.544878+0000","last_change":"2024-09-21T03:40:29.342165+0000","last_active":"2024-09-21T03:41:50.544878+0000","last_peered":"2024-09-21T03:41:50.544878+0000","last_clean":"2024-09-21T03:41:50.544878+0000","last_became_active":"2024-09-21T03:40:29.341744+0000","last_became_peered":"2024-09-21T03:40:29.341744+0000","last_unstale":"2024-09-21T03:41:50.544878+0000","last_undegraded":"2024-09-21T03:41:50.544878+0000","last_fullsized":"2024-09-21T03:41:50.544878+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:04.641927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.530032+0000","last_change":"2024-09-21T03:40:29.341728+0000","last_active":"2024-09-21T03:41:50.530032+0000","last_peered":"2024-09-21T03:41:50.530032+0000","last_clean":"2024-09-21T03:41:50.530032+0000","last_became_active":"2024-09-21T03:40:29.339252+0000","last_became_peered":"2024-09-21T03:40:29.339252+0000","last_unstale":"2024-09-21T03:41:50.530032+0000","last_undegraded":"2024-09-21T03:41:50.530032+0000","last_fullsized":"2024-09-21T03:41:50.530032+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:53.618128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.536386+0000","last_change":"2024-09-21T03:40:29.326893+0000","last_active":"2024-09-21T03:41:50.536386+0000","last_peered":"2024-09-21T03:41:50.536386+0000","last_clean":"2024-09-21T03:41:50.536386+0000","last_became_active":"2024-09-21T03:40:29.326427+0000","last_became_peered":"2024-09-21T03:40:29.326427+0000","last_unstale":"2024-09-21T03:41:50.536386+0000","last_undegraded":"2024-09-21T03:41:50.536386+0000","last_fullsized":"2024-09-21T03:41:50.536386+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:41.036179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.540804+0000","last_change":"2024-09-21T03:40:29.340410+0000","last_active":"2024-09-21T03:41:50.540804+0000","last_peered":"2024-09-21T03:41:50.540804+0000","last_clean":"2024-09-21T03:41:50.540804+0000","last_became_active":"2024-09-21T03:40:29.340062+0000","last_became_peered":"2024-09-21T03:40:29.340062+0000","last_unstale":"2024-09-21T03:41:50.540804+0000","last_undegraded":"2024-09-21T03:41:50.540804+0000","last_fullsized":"2024-09-21T03:41:50.540804+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:44.971145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.522052+0000","last_change":"2024-09-21T03:40:29.333387+0000","last_active":"2024-09-21T03:41:50.522052+0000","last_peered":"2024-09-21T03:41:50.522052+0000","last_clean":"2024-09-21T03:41:50.522052+0000","last_became_active":"2024-09-21T03:40:29.332511+0000","last_became_peered":"2024-09-21T03:40:29.332511+0000","last_unstale":"2024-09-21T03:41:50.522052+0000","last_undegraded":"2024-09-21T03:41:50.522052+0000","last_fullsized":"2024-09-21T03:41:50.522052+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:24.513267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"77'12","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.522801+0000","last_change":"2024-09-21T03:40:29.337845+0000","last_active":"2024-09-21T03:41:50.522801+0000","last_peered":"2024-09-21T03:41:50.522801+0000","last_clean":"2024-09-21T03:41:50.522801+0000","last_became_active":"2024-09-21T03:40:29.337387+0000","last_became_peered":"2024-09-21T03:40:29.337387+0000","last_unstale":"2024-09-21T03:41:50.522801+0000","last_undegraded":"2024-09-21T03:41:50.522801+0000","last_fullsized":"2024-09-21T03:41:50.522801+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:31.398337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.534904+0000","last_change":"2024-09-21T03:40:29.342691+0000","last_active":"2024-09-21T03:41:50.534904+0000","last_peered":"2024-09-21T03:41:50.534904+0000","last_clean":"2024-09-21T03:41:50.534904+0000","last_became_active":"2024-09-21T03:40:29.342294+0000","last_became_peered":"2024-09-21T03:40:29.342294+0000","last_unstale":"2024-09-21T03:41:50.534904+0000","last_undegraded":"2024-09-21T03:41:50.534904+0000","last_fullsized":"2024-09-21T03:41:50.534904+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:25.806074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.531577+0000","last_change":"2024-09-21T03:40:29.338280+0000","last_active":"2024-09-21T03:41:50.531577+0000","last_peered":"2024-09-21T03:41:50.531577+0000","last_clean":"2024-09-21T03:41:50.531577+0000","last_became_active":"2024-09-21T03:40:29.337825+0000","last_became_peered":"2024-09-21T03:40:29.337825+0000","last_unstale":"2024-09-21T03:41:50.531577+0000","last_undegraded":"2024-09-21T03:41:50.531577+0000","last_fullsized":"2024-09-21T03:41:50.531577+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:43.340248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'8","reported_seq":152,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:42:20.776838+0000","last_change":"2024-09-21T03:40:51.641130+0000","last_active":"2024-09-21T03:42:20.776838+0000","last_peered":"2024-09-21T03:42:20.776838+0000","last_clean":"2024-09-21T03:42:20.776838+0000","last_became_active":"2024-09-21T03:40:51.636641+0000","last_became_peered":"2024-09-21T03:40:51.636641+0000","last_unstale":"2024-09-21T03:42:20.776838+0000","last_undegraded":"2024-09-21T03:42:20.776838+0000","last_fullsized":"2024-09-21T03:42:20.776838+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:34.797959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.532959+0000","last_change":"2024-09-21T03:40:29.341830+0000","last_active":"2024-09-21T03:41:50.532959+0000","last_peered":"2024-09-21T03:41:50.532959+0000","last_clean":"2024-09-21T03:41:50.532959+0000","last_became_active":"2024-09-21T03:40:29.341112+0000","last_became_peered":"2024-09-21T03:40:29.341112+0000","last_unstale":"2024-09-21T03:41:50.532959+0000","last_undegraded":"2024-09-21T03:41:50.532959+0000","last_fullsized":"2024-09-21T03:41:50.532959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:31.560605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468958+0000","last_change":"2024-09-21T03:40:27.319393+0000","last_active":"2024-09-21T03:40:51.468958+0000","last_peered":"2024-09-21T03:40:51.468958+0000","last_clean":"2024-09-21T03:40:51.468958+0000","last_became_active":"2024-09-21T03:40:27.319000+0000","last_became_peered":"2024-09-21T03:40:27.319000+0000","last_unstale":"2024-09-21T03:40:51.468958+0000","last_undegraded":"2024-09-21T03:40:51.468958+0000","last_fullsized":"2024-09-21T03:40:51.468958+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:24.752295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780193+0000","last_change":"2024-09-21T03:40:27.317276+0000","last_active":"2024-09-21T03:40:51.780193+0000","last_peered":"2024-09-21T03:40:51.780193+0000","last_clean":"2024-09-21T03:40:51.780193+0000","last_became_active":"2024-09-21T03:40:27.316955+0000","last_became_peered":"2024-09-21T03:40:27.316955+0000","last_unstale":"2024-09-21T03:40:51.780193+0000","last_undegraded":"2024-09-21T03:40:51.780193+0000","last_fullsized":"2024-09-21T03:40:51.780193+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:23.208493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.531552+0000","last_change":"2024-09-21T03:40:29.324774+0000","last_active":"2024-09-21T03:41:50.531552+0000","last_peered":"2024-09-21T03:41:50.531552+0000","last_clean":"2024-09-21T03:41:50.531552+0000","last_became_active":"2024-09-21T03:40:29.324107+0000","last_became_peered":"2024-09-21T03:40:29.324107+0000","last_unstale":"2024-09-21T03:41:50.531552+0000","last_undegraded":"2024-09-21T03:41:50.531552+0000","last_fullsized":"2024-09-21T03:41:50.531552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:15.408620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464393+0000","last_change":"2024-09-21T03:40:27.316818+0000","last_active":"2024-09-21T03:40:51.464393+0000","last_peered":"2024-09-21T03:40:51.464393+0000","last_clean":"2024-09-21T03:40:51.464393+0000","last_became_active":"2024-09-21T03:40:27.316209+0000","last_became_peered":"2024-09-21T03:40:27.316209+0000","last_unstale":"2024-09-21T03:40:51.464393+0000","last_undegraded":"2024-09-21T03:40:51.464393+0000","last_fullsized":"2024-09-21T03:40:51.464393+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:01.869684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.526040+0000","last_change":"2024-09-21T03:40:29.335033+0000","last_active":"2024-09-21T03:41:50.526040+0000","last_peered":"2024-09-21T03:41:50.526040+0000","last_clean":"2024-09-21T03:41:50.526040+0000","last_became_active":"2024-09-21T03:40:29.334607+0000","last_became_peered":"2024-09-21T03:40:29.334607+0000","last_unstale":"2024-09-21T03:41:50.526040+0000","last_undegraded":"2024-09-21T03:41:50.526040+0000","last_fullsized":"2024-09-21T03:41:50.526040+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:05.892248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'4","reported_seq":126,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:42:16.768783+0000","last_change":"2024-09-21T03:40:27.319422+0000","last_active":"2024-09-21T03:42:16.768783+0000","last_peered":"2024-09-21T03:42:16.768783+0000","last_clean":"2024-09-21T03:42:16.768783+0000","last_became_active":"2024-09-21T03:40:27.318970+0000","last_became_peered":"2024-09-21T03:40:27.318970+0000","last_unstale":"2024-09-21T03:42:16.768783+0000","last_undegraded":"2024-09-21T03:42:16.768783+0000","last_fullsized":"2024-09-21T03:42:16.768783+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:04.263789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.549882+0000","last_change":"2024-09-21T03:40:29.334279+0000","last_active":"2024-09-21T03:41:50.549882+0000","last_peered":"2024-09-21T03:41:50.549882+0000","last_clean":"2024-09-21T03:41:50.549882+0000","last_became_active":"2024-09-21T03:40:29.333445+0000","last_became_peered":"2024-09-21T03:40:29.333445+0000","last_unstale":"2024-09-21T03:41:50.549882+0000","last_undegraded":"2024-09-21T03:41:50.549882+0000","last_fullsized":"2024-09-21T03:41:50.549882+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:10.445162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.643258+0000","last_change":"2024-09-21T03:40:51.643129+0000","last_active":"2024-09-21T03:40:51.643258+0000","last_peered":"2024-09-21T03:40:51.643258+0000","last_clean":"2024-09-21T03:40:51.643258+0000","last_became_active":"2024-09-21T03:40:51.637136+0000","last_became_peered":"2024-09-21T03:40:51.637136+0000","last_unstale":"2024-09-21T03:40:51.643258+0000","last_undegraded":"2024-09-21T03:40:51.643258+0000","last_fullsized":"2024-09-21T03:40:51.643258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:39.540452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.540817+0000","last_change":"2024-09-21T03:40:29.340393+0000","last_active":"2024-09-21T03:41:50.540817+0000","last_peered":"2024-09-21T03:41:50.540817+0000","last_clean":"2024-09-21T03:41:50.540817+0000","last_became_active":"2024-09-21T03:40:29.340042+0000","last_became_peered":"2024-09-21T03:40:29.340042+0000","last_unstale":"2024-09-21T03:41:50.540817+0000","last_undegraded":"2024-09-21T03:41:50.540817+0000","last_fullsized":"2024-09-21T03:41:50.540817+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:43.794252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464730+0000","last_change":"2024-09-21T03:40:27.526458+0000","last_active":"2024-09-21T03:40:51.464730+0000","last_peered":"2024-09-21T03:40:51.464730+0000","last_clean":"2024-09-21T03:40:51.464730+0000","last_became_active":"2024-09-21T03:40:27.525918+0000","last_became_peered":"2024-09-21T03:40:27.525918+0000","last_unstale":"2024-09-21T03:40:51.464730+0000","last_undegraded":"2024-09-21T03:40:51.464730+0000","last_fullsized":"2024-09-21T03:40:51.464730+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:47.286475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.549166+0000","last_change":"2024-09-21T03:40:29.338197+0000","last_active":"2024-09-21T03:41:50.549166+0000","last_peered":"2024-09-21T03:41:50.549166+0000","last_clean":"2024-09-21T03:41:50.549166+0000","last_became_active":"2024-09-21T03:40:29.337852+0000","last_became_peered":"2024-09-21T03:40:29.337852+0000","last_unstale":"2024-09-21T03:41:50.549166+0000","last_undegraded":"2024-09-21T03:41:50.549166+0000","last_fullsized":"2024-09-21T03:41:50.549166+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:09.132407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'29","reported_seq":259,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:42:17.770269+0000","last_change":"2024-09-21T03:40:27.320891+0000","last_active":"2024-09-21T03:42:17.770269+0000","last_peered":"2024-09-21T03:42:17.770269+0000","last_clean":"2024-09-21T03:42:17.770269+0000","last_became_active":"2024-09-21T03:40:27.320512+0000","last_became_peered":"2024-09-21T03:40:27.320512+0000","last_unstale":"2024-09-21T03:42:17.770269+0000","last_undegraded":"2024-09-21T03:42:17.770269+0000","last_fullsized":"2024-09-21T03:42:17.770269+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:27.181130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63598,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":165,"num_write":30,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.530637+0000","last_change":"2024-09-21T03:40:29.335570+0000","last_active":"2024-09-21T03:41:50.530637+0000","last_peered":"2024-09-21T03:41:50.530637+0000","last_clean":"2024-09-21T03:41:50.530637+0000","last_became_active":"2024-09-21T03:40:29.335226+0000","last_became_peered":"2024-09-21T03:40:29.335226+0000","last_unstale":"2024-09-21T03:41:50.530637+0000","last_undegraded":"2024-09-21T03:41:50.530637+0000","last_fullsized":"2024-09-21T03:41:50.530637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:56.434945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468293+0000","last_change":"2024-09-21T03:40:27.318436+0000","last_active":"2024-09-21T03:40:51.468293+0000","last_peered":"2024-09-21T03:40:51.468293+0000","last_clean":"2024-09-21T03:40:51.468293+0000","last_became_active":"2024-09-21T03:40:27.317969+0000","last_became_peered":"2024-09-21T03:40:27.317969+0000","last_unstale":"2024-09-21T03:40:51.468293+0000","last_undegraded":"2024-09-21T03:40:51.468293+0000","last_fullsized":"2024-09-21T03:40:51.468293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:43.137717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.547119+0000","last_change":"2024-09-21T03:40:29.325824+0000","last_active":"2024-09-21T03:41:50.547119+0000","last_peered":"2024-09-21T03:41:50.547119+0000","last_clean":"2024-09-21T03:41:50.547119+0000","last_became_active":"2024-09-21T03:40:29.325498+0000","last_became_peered":"2024-09-21T03:40:29.325498+0000","last_unstale":"2024-09-21T03:41:50.547119+0000","last_undegraded":"2024-09-21T03:41:50.547119+0000","last_fullsized":"2024-09-21T03:41:50.547119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:13.044835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464366+0000","last_change":"2024-09-21T03:40:27.308889+0000","last_active":"2024-09-21T03:40:51.464366+0000","last_peered":"2024-09-21T03:40:51.464366+0000","last_clean":"2024-09-21T03:40:51.464366+0000","last_became_active":"2024-09-21T03:40:27.308491+0000","last_became_peered":"2024-09-21T03:40:27.308491+0000","last_unstale":"2024-09-21T03:40:51.464366+0000","last_undegraded":"2024-09-21T03:40:51.464366+0000","last_fullsized":"2024-09-21T03:40:51.464366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:48.250898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"77'15","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.548242+0000","last_change":"2024-09-21T03:40:51.781287+0000","last_active":"2024-09-21T03:41:50.548242+0000","last_peered":"2024-09-21T03:41:50.548242+0000","last_clean":"2024-09-21T03:41:50.548242+0000","last_became_active":"2024-09-21T03:40:51.780925+0000","last_became_peered":"2024-09-21T03:40:51.780925+0000","last_unstale":"2024-09-21T03:41:50.548242+0000","last_undegraded":"2024-09-21T03:41:50.548242+0000","last_fullsized":"2024-09-21T03:41:50.548242+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:36.599949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'4","reported_seq":131,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:42:20.606215+0000","last_change":"2024-09-21T03:40:27.316066+0000","last_active":"2024-09-21T03:42:20.606215+0000","last_peered":"2024-09-21T03:42:20.606215+0000","last_clean":"2024-09-21T03:42:20.606215+0000","last_became_active":"2024-09-21T03:40:27.315580+0000","last_became_peered":"2024-09-21T03:40:27.315580+0000","last_unstale":"2024-09-21T03:42:20.606215+0000","last_undegraded":"2024-09-21T03:42:20.606215+0000","last_fullsized":"2024-09-21T03:42:20.606215+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:14.592824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.547163+0000","last_change":"2024-09-21T03:40:29.339736+0000","last_active":"2024-09-21T03:41:50.547163+0000","last_peered":"2024-09-21T03:41:50.547163+0000","last_clean":"2024-09-21T03:41:50.547163+0000","last_became_active":"2024-09-21T03:40:29.338343+0000","last_became_peered":"2024-09-21T03:40:29.338343+0000","last_unstale":"2024-09-21T03:41:50.547163+0000","last_undegraded":"2024-09-21T03:41:50.547163+0000","last_fullsized":"2024-09-21T03:41:50.547163+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:33.531580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.485664+0000","last_change":"2024-09-21T03:40:51.485123+0000","last_active":"2024-09-21T03:40:51.485664+0000","last_peered":"2024-09-21T03:40:51.485664+0000","last_clean":"2024-09-21T03:40:51.485664+0000","last_became_active":"2024-09-21T03:40:51.471029+0000","last_became_peered":"2024-09-21T03:40:51.471029+0000","last_unstale":"2024-09-21T03:40:51.485664+0000","last_undegraded":"2024-09-21T03:40:51.485664+0000","last_fullsized":"2024-09-21T03:40:51.485664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:32.870908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.537148+0000","last_change":"2024-09-21T03:40:29.340712+0000","last_active":"2024-09-21T03:41:50.537148+0000","last_peered":"2024-09-21T03:41:50.537148+0000","last_clean":"2024-09-21T03:41:50.537148+0000","last_became_active":"2024-09-21T03:40:29.340349+0000","last_became_peered":"2024-09-21T03:40:29.340349+0000","last_unstale":"2024-09-21T03:41:50.537148+0000","last_undegraded":"2024-09-21T03:41:50.537148+0000","last_fullsized":"2024-09-21T03:41:50.537148+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:29.980697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470772+0000","last_change":"2024-09-21T03:40:27.319689+0000","last_active":"2024-09-21T03:40:51.470772+0000","last_peered":"2024-09-21T03:40:51.470772+0000","last_clean":"2024-09-21T03:40:51.470772+0000","last_became_active":"2024-09-21T03:40:27.319010+0000","last_became_peered":"2024-09-21T03:40:27.319010+0000","last_unstale":"2024-09-21T03:40:51.470772+0000","last_undegraded":"2024-09-21T03:40:51.470772+0000","last_fullsized":"2024-09-21T03:40:51.470772+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:42.965205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"77'5","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.526836+0000","last_change":"2024-09-21T03:40:51.636790+0000","last_active":"2024-09-21T03:41:50.526836+0000","last_peered":"2024-09-21T03:41:50.526836+0000","last_clean":"2024-09-21T03:41:50.526836+0000","last_became_active":"2024-09-21T03:40:51.636333+0000","last_became_peered":"2024-09-21T03:40:51.636333+0000","last_unstale":"2024-09-21T03:41:50.526836+0000","last_undegraded":"2024-09-21T03:41:50.526836+0000","last_fullsized":"2024-09-21T03:41:50.526836+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:27.186564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780182+0000","last_change":"2024-09-21T03:40:27.316086+0000","last_active":"2024-09-21T03:40:51.780182+0000","last_peered":"2024-09-21T03:40:51.780182+0000","last_clean":"2024-09-21T03:40:51.780182+0000","last_became_active":"2024-09-21T03:40:27.315645+0000","last_became_peered":"2024-09-21T03:40:27.315645+0000","last_unstale":"2024-09-21T03:40:51.780182+0000","last_undegraded":"2024-09-21T03:40:51.780182+0000","last_fullsized":"2024-09-21T03:40:51.780182+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:41.536778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.545457+0000","last_change":"2024-09-21T03:40:29.339546+0000","last_active":"2024-09-21T03:41:50.545457+0000","last_peered":"2024-09-21T03:41:50.545457+0000","last_clean":"2024-09-21T03:41:50.545457+0000","last_became_active":"2024-09-21T03:40:29.339176+0000","last_became_peered":"2024-09-21T03:40:29.339176+0000","last_unstale":"2024-09-21T03:41:50.545457+0000","last_undegraded":"2024-09-21T03:41:50.545457+0000","last_fullsized":"2024-09-21T03:41:50.545457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:26.405624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464973+0000","last_change":"2024-09-21T03:40:27.315440+0000","last_active":"2024-09-21T03:40:51.464973+0000","last_peered":"2024-09-21T03:40:51.464973+0000","last_clean":"2024-09-21T03:40:51.464973+0000","last_became_active":"2024-09-21T03:40:27.314608+0000","last_became_peered":"2024-09-21T03:40:27.314608+0000","last_unstale":"2024-09-21T03:40:51.464973+0000","last_undegraded":"2024-09-21T03:40:51.464973+0000","last_fullsized":"2024-09-21T03:40:51.464973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:11.465078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.537525+0000","last_change":"2024-09-21T03:40:29.336631+0000","last_active":"2024-09-21T03:41:50.537525+0000","last_peered":"2024-09-21T03:41:50.537525+0000","last_clean":"2024-09-21T03:41:50.537525+0000","last_became_active":"2024-09-21T03:40:29.336201+0000","last_became_peered":"2024-09-21T03:40:29.336201+0000","last_unstale":"2024-09-21T03:41:50.537525+0000","last_undegraded":"2024-09-21T03:41:50.537525+0000","last_fullsized":"2024-09-21T03:41:50.537525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:29.514908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468161+0000","last_change":"2024-09-21T03:40:27.719183+0000","last_active":"2024-09-21T03:40:51.468161+0000","last_peered":"2024-09-21T03:40:51.468161+0000","last_clean":"2024-09-21T03:40:51.468161+0000","last_became_active":"2024-09-21T03:40:27.718658+0000","last_became_peered":"2024-09-21T03:40:27.718658+0000","last_unstale":"2024-09-21T03:40:51.468161+0000","last_undegraded":"2024-09-21T03:40:51.468161+0000","last_fullsized":"2024-09-21T03:40:51.468161+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:52.280654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.549141+0000","last_change":"2024-09-21T03:40:29.335258+0000","last_active":"2024-09-21T03:41:50.549141+0000","last_peered":"2024-09-21T03:41:50.549141+0000","last_clean":"2024-09-21T03:41:50.549141+0000","last_became_active":"2024-09-21T03:40:29.334897+0000","last_became_peered":"2024-09-21T03:40:29.334897+0000","last_unstale":"2024-09-21T03:41:50.549141+0000","last_undegraded":"2024-09-21T03:41:50.549141+0000","last_fullsized":"2024-09-21T03:41:50.549141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:27.040232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":96,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464438+0000","last_change":"2024-09-21T03:39:15.369567+0000","last_active":"2024-09-21T03:40:51.464438+0000","last_peered":"2024-09-21T03:40:51.464438+0000","last_clean":"2024-09-21T03:40:51.464438+0000","last_became_active":"2024-09-21T03:39:15.363960+0000","last_became_peered":"2024-09-21T03:39:15.363960+0000","last_unstale":"2024-09-21T03:40:51.464438+0000","last_undegraded":"2024-09-21T03:40:51.464438+0000","last_fullsized":"2024-09-21T03:40:51.464438+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:35:51.240165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:35:51.240165+0000","last_clean_scrub_stamp":"2024-09-21T03:35:51.240165+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:10.335425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.635844+0000","last_change":"2024-09-21T03:40:27.316831+0000","last_active":"2024-09-21T03:40:51.635844+0000","last_peered":"2024-09-21T03:40:51.635844+0000","last_clean":"2024-09-21T03:40:51.635844+0000","last_became_active":"2024-09-21T03:40:27.315547+0000","last_became_peered":"2024-09-21T03:40:27.315547+0000","last_unstale":"2024-09-21T03:40:51.635844+0000","last_undegraded":"2024-09-21T03:40:51.635844+0000","last_fullsized":"2024-09-21T03:40:51.635844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:02.727366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.545628+0000","last_change":"2024-09-21T03:40:29.339059+0000","last_active":"2024-09-21T03:41:50.545628+0000","last_peered":"2024-09-21T03:41:50.545628+0000","last_clean":"2024-09-21T03:41:50.545628+0000","last_became_active":"2024-09-21T03:40:29.338710+0000","last_became_peered":"2024-09-21T03:40:29.338710+0000","last_unstale":"2024-09-21T03:41:50.545628+0000","last_undegraded":"2024-09-21T03:41:50.545628+0000","last_fullsized":"2024-09-21T03:41:50.545628+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:50.390629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464355+0000","last_change":"2024-09-21T03:40:27.314666+0000","last_active":"2024-09-21T03:40:51.464355+0000","last_peered":"2024-09-21T03:40:51.464355+0000","last_clean":"2024-09-21T03:40:51.464355+0000","last_became_active":"2024-09-21T03:40:27.314254+0000","last_became_peered":"2024-09-21T03:40:27.314254+0000","last_unstale":"2024-09-21T03:40:51.464355+0000","last_undegraded":"2024-09-21T03:40:51.464355+0000","last_fullsized":"2024-09-21T03:40:51.464355+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:57.230420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.524644+0000","last_change":"2024-09-21T03:40:29.338249+0000","last_active":"2024-09-21T03:41:50.524644+0000","last_peered":"2024-09-21T03:41:50.524644+0000","last_clean":"2024-09-21T03:41:50.524644+0000","last_became_active":"2024-09-21T03:40:29.337901+0000","last_became_peered":"2024-09-21T03:40:29.337901+0000","last_unstale":"2024-09-21T03:41:50.524644+0000","last_undegraded":"2024-09-21T03:41:50.524644+0000","last_fullsized":"2024-09-21T03:41:50.524644+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:21.054734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'5","reported_seq":131,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:42:20.722297+0000","last_change":"2024-09-21T03:40:27.525651+0000","last_active":"2024-09-21T03:42:20.722297+0000","last_peered":"2024-09-21T03:42:20.722297+0000","last_clean":"2024-09-21T03:42:20.722297+0000","last_became_active":"2024-09-21T03:40:27.525299+0000","last_became_peered":"2024-09-21T03:40:27.525299+0000","last_unstale":"2024-09-21T03:42:20.722297+0000","last_undegraded":"2024-09-21T03:42:20.722297+0000","last_fullsized":"2024-09-21T03:42:20.722297+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:21.983937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.529796+0000","last_change":"2024-09-21T03:40:29.339021+0000","last_active":"2024-09-21T03:41:50.529796+0000","last_peered":"2024-09-21T03:41:50.529796+0000","last_clean":"2024-09-21T03:41:50.529796+0000","last_became_active":"2024-09-21T03:40:29.338660+0000","last_became_peered":"2024-09-21T03:40:29.338660+0000","last_unstale":"2024-09-21T03:41:50.529796+0000","last_undegraded":"2024-09-21T03:41:50.529796+0000","last_fullsized":"2024-09-21T03:41:50.529796+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:56.652048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.465111+0000","last_change":"2024-09-21T03:40:27.319650+0000","last_active":"2024-09-21T03:40:51.465111+0000","last_peered":"2024-09-21T03:40:51.465111+0000","last_clean":"2024-09-21T03:40:51.465111+0000","last_became_active":"2024-09-21T03:40:27.319188+0000","last_became_peered":"2024-09-21T03:40:27.319188+0000","last_unstale":"2024-09-21T03:40:51.465111+0000","last_undegraded":"2024-09-21T03:40:51.465111+0000","last_fullsized":"2024-09-21T03:40:51.465111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:12.905682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.523060+0000","last_change":"2024-09-21T03:40:29.340673+0000","last_active":"2024-09-21T03:41:50.523060+0000","last_peered":"2024-09-21T03:41:50.523060+0000","last_clean":"2024-09-21T03:41:50.523060+0000","last_became_active":"2024-09-21T03:40:29.340240+0000","last_became_peered":"2024-09-21T03:40:29.340240+0000","last_unstale":"2024-09-21T03:41:50.523060+0000","last_undegraded":"2024-09-21T03:41:50.523060+0000","last_fullsized":"2024-09-21T03:41:50.523060+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:02.989879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470390+0000","last_change":"2024-09-21T03:40:27.527803+0000","last_active":"2024-09-21T03:40:51.470390+0000","last_peered":"2024-09-21T03:40:51.470390+0000","last_clean":"2024-09-21T03:40:51.470390+0000","last_became_active":"2024-09-21T03:40:27.527419+0000","last_became_peered":"2024-09-21T03:40:27.527419+0000","last_unstale":"2024-09-21T03:40:51.470390+0000","last_undegraded":"2024-09-21T03:40:51.470390+0000","last_fullsized":"2024-09-21T03:40:51.470390+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:15:16.081458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.534523+0000","last_change":"2024-09-21T03:40:29.347927+0000","last_active":"2024-09-21T03:41:50.534523+0000","last_peered":"2024-09-21T03:41:50.534523+0000","last_clean":"2024-09-21T03:41:50.534523+0000","last_became_active":"2024-09-21T03:40:29.347574+0000","last_became_peered":"2024-09-21T03:40:29.347574+0000","last_unstale":"2024-09-21T03:41:50.534523+0000","last_undegraded":"2024-09-21T03:41:50.534523+0000","last_fullsized":"2024-09-21T03:41:50.534523+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:10.142931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.488011+0000","last_change":"2024-09-21T03:40:51.487492+0000","last_active":"2024-09-21T03:40:51.488011+0000","last_peered":"2024-09-21T03:40:51.488011+0000","last_clean":"2024-09-21T03:40:51.488011+0000","last_became_active":"2024-09-21T03:40:51.472023+0000","last_became_peered":"2024-09-21T03:40:51.472023+0000","last_unstale":"2024-09-21T03:40:51.488011+0000","last_undegraded":"2024-09-21T03:40:51.488011+0000","last_fullsized":"2024-09-21T03:40:51.488011+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:40.164056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.533879+0000","last_change":"2024-09-21T03:40:29.332539+0000","last_active":"2024-09-21T03:41:50.533879+0000","last_peered":"2024-09-21T03:41:50.533879+0000","last_clean":"2024-09-21T03:41:50.533879+0000","last_became_active":"2024-09-21T03:40:29.332178+0000","last_became_peered":"2024-09-21T03:40:29.332178+0000","last_unstale":"2024-09-21T03:41:50.533879+0000","last_undegraded":"2024-09-21T03:41:50.533879+0000","last_fullsized":"2024-09-21T03:41:50.533879+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:00.354558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'11","reported_seq":34,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:56.345147+0000","last_change":"2024-09-21T03:40:27.313942+0000","last_active":"2024-09-21T03:40:56.345147+0000","last_peered":"2024-09-21T03:40:56.345147+0000","last_clean":"2024-09-21T03:40:56.345147+0000","last_became_active":"2024-09-21T03:40:27.313541+0000","last_became_peered":"2024-09-21T03:40:27.313541+0000","last_unstale":"2024-09-21T03:40:56.345147+0000","last_undegraded":"2024-09-21T03:40:56.345147+0000","last_fullsized":"2024-09-21T03:40:56.345147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:58.572154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.532002+0000","last_change":"2024-09-21T03:40:29.330712+0000","last_active":"2024-09-21T03:41:50.532002+0000","last_peered":"2024-09-21T03:41:50.532002+0000","last_clean":"2024-09-21T03:41:50.532002+0000","last_became_active":"2024-09-21T03:40:29.330345+0000","last_became_peered":"2024-09-21T03:40:29.330345+0000","last_unstale":"2024-09-21T03:41:50.532002+0000","last_undegraded":"2024-09-21T03:41:50.532002+0000","last_fullsized":"2024-09-21T03:41:50.532002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:54.225288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.635760+0000","last_change":"2024-09-21T03:40:27.719239+0000","last_active":"2024-09-21T03:40:51.635760+0000","last_peered":"2024-09-21T03:40:51.635760+0000","last_clean":"2024-09-21T03:40:51.635760+0000","last_became_active":"2024-09-21T03:40:27.718834+0000","last_became_peered":"2024-09-21T03:40:27.718834+0000","last_unstale":"2024-09-21T03:40:51.635760+0000","last_undegraded":"2024-09-21T03:40:51.635760+0000","last_fullsized":"2024-09-21T03:40:51.635760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:47.357723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.541218+0000","last_change":"2024-09-21T03:40:29.338470+0000","last_active":"2024-09-21T03:41:50.541218+0000","last_peered":"2024-09-21T03:41:50.541218+0000","last_clean":"2024-09-21T03:41:50.541218+0000","last_became_active":"2024-09-21T03:40:29.338114+0000","last_became_peered":"2024-09-21T03:40:29.338114+0000","last_unstale":"2024-09-21T03:41:50.541218+0000","last_undegraded":"2024-09-21T03:41:50.541218+0000","last_fullsized":"2024-09-21T03:41:50.541218+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:23.715773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467223+0000","last_change":"2024-09-21T03:40:27.525544+0000","last_active":"2024-09-21T03:40:51.467223+0000","last_peered":"2024-09-21T03:40:51.467223+0000","last_clean":"2024-09-21T03:40:51.467223+0000","last_became_active":"2024-09-21T03:40:27.525196+0000","last_became_peered":"2024-09-21T03:40:27.525196+0000","last_unstale":"2024-09-21T03:40:51.467223+0000","last_undegraded":"2024-09-21T03:40:51.467223+0000","last_fullsized":"2024-09-21T03:40:51.467223+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:57:07.882351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.494418+0000","last_change":"2024-09-21T03:40:29.337774+0000","last_active":"2024-09-21T03:41:50.494418+0000","last_peered":"2024-09-21T03:41:50.494418+0000","last_clean":"2024-09-21T03:41:50.494418+0000","last_became_active":"2024-09-21T03:40:29.337393+0000","last_became_peered":"2024-09-21T03:40:29.337393+0000","last_unstale":"2024-09-21T03:41:50.494418+0000","last_undegraded":"2024-09-21T03:41:50.494418+0000","last_fullsized":"2024-09-21T03:41:50.494418+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:20.471042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463610+0000","last_change":"2024-09-21T03:40:27.312953+0000","last_active":"2024-09-21T03:40:51.463610+0000","last_peered":"2024-09-21T03:40:51.463610+0000","last_clean":"2024-09-21T03:40:51.463610+0000","last_became_active":"2024-09-21T03:40:27.312603+0000","last_became_peered":"2024-09-21T03:40:27.312603+0000","last_unstale":"2024-09-21T03:40:51.463610+0000","last_undegraded":"2024-09-21T03:40:51.463610+0000","last_fullsized":"2024-09-21T03:40:51.463610+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:18.102812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.533801+0000","last_change":"2024-09-21T03:40:29.330802+0000","last_active":"2024-09-21T03:41:50.533801+0000","last_peered":"2024-09-21T03:41:50.533801+0000","last_clean":"2024-09-21T03:41:50.533801+0000","last_became_active":"2024-09-21T03:40:29.330426+0000","last_became_peered":"2024-09-21T03:40:29.330426+0000","last_unstale":"2024-09-21T03:41:50.533801+0000","last_undegraded":"2024-09-21T03:41:50.533801+0000","last_fullsized":"2024-09-21T03:41:50.533801+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:08:18.552649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467619+0000","last_change":"2024-09-21T03:40:27.319829+0000","last_active":"2024-09-21T03:40:51.467619+0000","last_peered":"2024-09-21T03:40:51.467619+0000","last_clean":"2024-09-21T03:40:51.467619+0000","last_became_active":"2024-09-21T03:40:27.319410+0000","last_became_peered":"2024-09-21T03:40:27.319410+0000","last_unstale":"2024-09-21T03:40:51.467619+0000","last_undegraded":"2024-09-21T03:40:51.467619+0000","last_fullsized":"2024-09-21T03:40:51.467619+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:56.475721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.535764+0000","last_change":"2024-09-21T03:40:29.335897+0000","last_active":"2024-09-21T03:41:50.535764+0000","last_peered":"2024-09-21T03:41:50.535764+0000","last_clean":"2024-09-21T03:41:50.535764+0000","last_became_active":"2024-09-21T03:40:29.335549+0000","last_became_peered":"2024-09-21T03:40:29.335549+0000","last_unstale":"2024-09-21T03:41:50.535764+0000","last_undegraded":"2024-09-21T03:41:50.535764+0000","last_fullsized":"2024-09-21T03:41:50.535764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:01.401766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470266+0000","last_change":"2024-09-21T03:40:27.316678+0000","last_active":"2024-09-21T03:40:51.470266+0000","last_peered":"2024-09-21T03:40:51.470266+0000","last_clean":"2024-09-21T03:40:51.470266+0000","last_became_active":"2024-09-21T03:40:27.315980+0000","last_became_peered":"2024-09-21T03:40:27.315980+0000","last_unstale":"2024-09-21T03:40:51.470266+0000","last_undegraded":"2024-09-21T03:40:51.470266+0000","last_fullsized":"2024-09-21T03:40:51.470266+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:56.280077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.549639+0000","last_change":"2024-09-21T03:40:29.333638+0000","last_active":"2024-09-21T03:41:50.549639+0000","last_peered":"2024-09-21T03:41:50.549639+0000","last_clean":"2024-09-21T03:41:50.549639+0000","last_became_active":"2024-09-21T03:40:29.333268+0000","last_became_peered":"2024-09-21T03:40:29.333268+0000","last_unstale":"2024-09-21T03:41:50.549639+0000","last_undegraded":"2024-09-21T03:41:50.549639+0000","last_fullsized":"2024-09-21T03:41:50.549639+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:35:23.346837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.543689+0000","last_change":"2024-09-21T03:40:29.342199+0000","last_active":"2024-09-21T03:41:50.543689+0000","last_peered":"2024-09-21T03:41:50.543689+0000","last_clean":"2024-09-21T03:41:50.543689+0000","last_became_active":"2024-09-21T03:40:29.341675+0000","last_became_peered":"2024-09-21T03:40:29.341675+0000","last_unstale":"2024-09-21T03:41:50.543689+0000","last_undegraded":"2024-09-21T03:41:50.543689+0000","last_fullsized":"2024-09-21T03:41:50.543689+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:01.439058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470666+0000","last_change":"2024-09-21T03:40:27.319327+0000","last_active":"2024-09-21T03:40:51.470666+0000","last_peered":"2024-09-21T03:40:51.470666+0000","last_clean":"2024-09-21T03:40:51.470666+0000","last_became_active":"2024-09-21T03:40:27.318773+0000","last_became_peered":"2024-09-21T03:40:27.318773+0000","last_unstale":"2024-09-21T03:40:51.470666+0000","last_undegraded":"2024-09-21T03:40:51.470666+0000","last_fullsized":"2024-09-21T03:40:51.470666+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:42.444238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.550352+0000","last_change":"2024-09-21T03:40:29.336121+0000","last_active":"2024-09-21T03:41:50.550352+0000","last_peered":"2024-09-21T03:41:50.550352+0000","last_clean":"2024-09-21T03:41:50.550352+0000","last_became_active":"2024-09-21T03:40:29.333523+0000","last_became_peered":"2024-09-21T03:40:29.333523+0000","last_unstale":"2024-09-21T03:41:50.550352+0000","last_undegraded":"2024-09-21T03:41:50.550352+0000","last_fullsized":"2024-09-21T03:41:50.550352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:29.303410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470911+0000","last_change":"2024-09-21T03:40:27.316523+0000","last_active":"2024-09-21T03:40:51.470911+0000","last_peered":"2024-09-21T03:40:51.470911+0000","last_clean":"2024-09-21T03:40:51.470911+0000","last_became_active":"2024-09-21T03:40:27.316099+0000","last_became_peered":"2024-09-21T03:40:27.316099+0000","last_unstale":"2024-09-21T03:40:51.470911+0000","last_undegraded":"2024-09-21T03:40:51.470911+0000","last_fullsized":"2024-09-21T03:40:51.470911+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:44.091964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.545758+0000","last_change":"2024-09-21T03:40:29.333887+0000","last_active":"2024-09-21T03:41:50.545758+0000","last_peered":"2024-09-21T03:41:50.545758+0000","last_clean":"2024-09-21T03:41:50.545758+0000","last_became_active":"2024-09-21T03:40:29.333465+0000","last_became_peered":"2024-09-21T03:40:29.333465+0000","last_unstale":"2024-09-21T03:41:50.545758+0000","last_undegraded":"2024-09-21T03:41:50.545758+0000","last_fullsized":"2024-09-21T03:41:50.545758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:46.788188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464003+0000","last_change":"2024-09-21T03:40:27.525812+0000","last_active":"2024-09-21T03:40:51.464003+0000","last_peered":"2024-09-21T03:40:51.464003+0000","last_clean":"2024-09-21T03:40:51.464003+0000","last_became_active":"2024-09-21T03:40:27.525391+0000","last_became_peered":"2024-09-21T03:40:27.525391+0000","last_unstale":"2024-09-21T03:40:51.464003+0000","last_undegraded":"2024-09-21T03:40:51.464003+0000","last_fullsized":"2024-09-21T03:40:51.464003+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:07.856442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.534430+0000","last_change":"2024-09-21T03:40:29.339079+0000","last_active":"2024-09-21T03:41:50.534430+0000","last_peered":"2024-09-21T03:41:50.534430+0000","last_clean":"2024-09-21T03:41:50.534430+0000","last_became_active":"2024-09-21T03:40:29.338737+0000","last_became_peered":"2024-09-21T03:40:29.338737+0000","last_unstale":"2024-09-21T03:41:50.534430+0000","last_undegraded":"2024-09-21T03:41:50.534430+0000","last_fullsized":"2024-09-21T03:41:50.534430+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:14.863848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470639+0000","last_change":"2024-09-21T03:40:27.316037+0000","last_active":"2024-09-21T03:40:51.470639+0000","last_peered":"2024-09-21T03:40:51.470639+0000","last_clean":"2024-09-21T03:40:51.470639+0000","last_became_active":"2024-09-21T03:40:27.315604+0000","last_became_peered":"2024-09-21T03:40:27.315604+0000","last_unstale":"2024-09-21T03:40:51.470639+0000","last_undegraded":"2024-09-21T03:40:51.470639+0000","last_fullsized":"2024-09-21T03:40:51.470639+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:48.176252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68522,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":624,"num_read_kb":385,"num_write":169,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1147,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":210452,"data_compressed":5679,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247442,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743460,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":416171,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906984,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":1071116,"data_compressed":43442,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070510,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":416273,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266738,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":839680,"data_stored":416059,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430263,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":1008264,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593790,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":415662,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790019,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":1008339,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986248,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":417253,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":415973,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":917504,"data_stored":479781,"data_compressed":7630,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":484804,"data_compressed":7630,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705756,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":860160,"data_stored":416933,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34191,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34191,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":69349,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64634,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65176,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:42:24.208 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:42:24.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.351+0000 7fdbb1369640 1 -- 172.21.15.84:0/545165847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac103180 msgr2=0x7fdbac103590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:24.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.351+0000 7fdbb1369640 1 --2- 172.21.15.84:0/545165847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac103180 0x7fdbac103590 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009900 tx=0x7fdba402a410 comp rx=0 tx=0).stop 2024-09-21T03:42:24.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.351+0000 7fdbb1369640 1 -- 172.21.15.84:0/545165847 shutdown_connections 2024-09-21T03:42:24.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.351+0000 7fdbb1369640 1 --2- 172.21.15.84:0/545165847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbac108c60 0x7fdbac10f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.351+0000 7fdbb1369640 1 --2- 172.21.15.84:0/545165847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbac108310 0x7fdbac108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.351+0000 7fdbb1369640 1 --2- 172.21.15.84:0/545165847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac103180 0x7fdbac103590 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.351+0000 7fdbb1369640 1 -- 172.21.15.84:0/545165847 >> 172.21.15.84:0/545165847 conn(0x7fdbac079d00 msgr2=0x7fdbac07a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:24.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.351+0000 7fdbb1369640 1 -- 172.21.15.84:0/545165847 shutdown_connections 2024-09-21T03:42:24.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.351+0000 7fdbb1369640 1 -- 172.21.15.84:0/545165847 wait complete. 2024-09-21T03:42:24.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.352+0000 7fdbb1369640 1 Processor -- start 2024-09-21T03:42:24.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.352+0000 7fdbb1369640 1 -- start start 2024-09-21T03:42:24.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.352+0000 7fdbb1369640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbac103180 0x7fdbac19b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:24.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.352+0000 7fdbb1369640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbac108310 0x7fdbac19b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:24.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.352+0000 7fdbb1369640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac108c60 0x7fdbac19bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:24.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.352+0000 7fdbb1369640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac112920 con 0x7fdbac108c60 2024-09-21T03:42:24.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.352+0000 7fdbb1369640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac1127a0 con 0x7fdbac108310 2024-09-21T03:42:24.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.352+0000 7fdbb1369640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdbac112aa0 con 0x7fdbac103180 2024-09-21T03:42:24.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.352+0000 7fdbab7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac108c60 0x7fdbac19bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:24.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.352+0000 7fdbab7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac108c60 0x7fdbac19bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33672/0 (socket says 172.21.15.84:33672) 2024-09-21T03:42:24.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.353+0000 7fdbab7fe640 1 -- 172.21.15.84:0/369626708 learned_addr learned my addr 172.21.15.84:0/369626708 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:24.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.353+0000 7fdbaa7fc640 1 --2- 172.21.15.84:0/369626708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbac108310 0x7fdbac19b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:24.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.353+0000 7fdbaaffd640 1 --2- 172.21.15.84:0/369626708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbac103180 0x7fdbac19b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:24.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.353+0000 7fdbab7fe640 1 -- 172.21.15.84:0/369626708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbac103180 msgr2=0x7fdbac19b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:24.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.353+0000 7fdbab7fe640 1 --2- 172.21.15.84:0/369626708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbac103180 0x7fdbac19b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.353+0000 7fdbab7fe640 1 -- 172.21.15.84:0/369626708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbac108310 msgr2=0x7fdbac19b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:24.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.353+0000 7fdbab7fe640 1 --2- 172.21.15.84:0/369626708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbac108310 0x7fdbac19b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.353+0000 7fdbab7fe640 1 -- 172.21.15.84:0/369626708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbac1a64e0 con 0x7fdbac108c60 2024-09-21T03:42:24.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.353+0000 7fdbaa7fc640 1 --2- 172.21.15.84:0/369626708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbac108310 0x7fdbac19b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:24.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.353+0000 7fdbab7fe640 1 --2- 172.21.15.84:0/369626708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac108c60 0x7fdbac19bcd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00cad0 tx=0x7fdb9c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:24.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.353+0000 7fdba3fff640 1 -- 172.21.15.84:0/369626708 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c00ae20 con 0x7fdbac108c60 2024-09-21T03:42:24.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.353+0000 7fdba3fff640 1 -- 172.21.15.84:0/369626708 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb9c005020 con 0x7fdbac108c60 2024-09-21T03:42:24.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.353+0000 7fdbb1369640 1 -- 172.21.15.84:0/369626708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbac1a67d0 con 0x7fdbac108c60 2024-09-21T03:42:24.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.353+0000 7fdba3fff640 1 -- 172.21.15.84:0/369626708 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c00f6b0 con 0x7fdbac108c60 2024-09-21T03:42:24.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.353+0000 7fdbb1369640 1 -- 172.21.15.84:0/369626708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbac1a6d20 con 0x7fdbac108c60 2024-09-21T03:42:24.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.354+0000 7fdbb1369640 1 -- 172.21.15.84:0/369626708 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbac103590 con 0x7fdbac108c60 2024-09-21T03:42:24.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.357+0000 7fdba3fff640 1 -- 172.21.15.84:0/369626708 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7fdb9c0051d0 con 0x7fdbac108c60 2024-09-21T03:42:24.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.357+0000 7fdba3fff640 1 --2- 172.21.15.84:0/369626708 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdb980b6670 0x7fdb980b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:24.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.357+0000 7fdbaaffd640 1 --2- 172.21.15.84:0/369626708 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdb980b6670 0x7fdb980b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:24.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.357+0000 7fdba3fff640 1 -- 172.21.15.84:0/369626708 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fdb9c0e7a00 con 0x7fdbac108c60 2024-09-21T03:42:24.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.358+0000 7fdbaaffd640 1 --2- 172.21.15.84:0/369626708 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdb980b6670 0x7fdb980b8b80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdba4000c00 tx=0x7fdba4031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:24.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.361+0000 7fdba3fff640 1 -- 172.21.15.84:0/369626708 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdb9c014030 con 0x7fdbac108c60 2024-09-21T03:42:24.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.538+0000 7fdbb1369640 1 -- 172.21.15.84:0/369626708 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdbac063800 con 0x7fdb980b6670 2024-09-21T03:42:24.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.543+0000 7fdba3fff640 1 -- 172.21.15.84:0/369626708 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259099 (secure 0 0 0) 0x7fdbac063800 con 0x7fdb980b6670 2024-09-21T03:42:24.547 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:42:24.549 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T03:42:24.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.546+0000 7fdbb1369640 1 -- 172.21.15.84:0/369626708 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdb980b6670 msgr2=0x7fdb980b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:24.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.546+0000 7fdbb1369640 1 --2- 172.21.15.84:0/369626708 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdb980b6670 0x7fdb980b8b80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdba4000c00 tx=0x7fdba4031400 comp rx=0 tx=0).stop 2024-09-21T03:42:24.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.546+0000 7fdbb1369640 1 -- 172.21.15.84:0/369626708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac108c60 msgr2=0x7fdbac19bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:24.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.546+0000 7fdbb1369640 1 --2- 172.21.15.84:0/369626708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac108c60 0x7fdbac19bcd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c00cad0 tx=0x7fdb9c00cf90 comp rx=0 tx=0).stop 2024-09-21T03:42:24.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.546+0000 7fdbb1369640 1 -- 172.21.15.84:0/369626708 shutdown_connections 2024-09-21T03:42:24.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.546+0000 7fdbb1369640 1 --2- 172.21.15.84:0/369626708 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdb980b6670 0x7fdb980b8b80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.546+0000 7fdbb1369640 1 --2- 172.21.15.84:0/369626708 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdbac108c60 0x7fdbac19bcd0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.546+0000 7fdbb1369640 1 --2- 172.21.15.84:0/369626708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdbac108310 0x7fdbac19b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.546+0000 7fdbb1369640 1 --2- 172.21.15.84:0/369626708 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdbac103180 0x7fdbac19b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.546+0000 7fdbb1369640 1 -- 172.21.15.84:0/369626708 >> 172.21.15.84:0/369626708 conn(0x7fdbac079d00 msgr2=0x7fdbac106400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:24.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.546+0000 7fdbb1369640 1 -- 172.21.15.84:0/369626708 shutdown_connections 2024-09-21T03:42:24.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.546+0000 7fdbb1369640 1 -- 172.21.15.84:0/369626708 wait complete. 2024-09-21T03:42:24.560 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-09-21T03:42:24.307187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665266,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":722,"num_read_kb":471,"num_write":303,"num_write_kb":2285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":2952987,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":745,"ondisk_log_size":745,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384536,"kb_used_data":10328,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124557288,"statfs":{"total":1151940427776,"available":1151546662912,"internally_reserved":0,"allocated":10575872,"data_stored":6973943,"data_compressed":181959,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6924,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":48,"num_write":12,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003318"},"pg_stats":[{"pgid":"3.3f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.547556+0000","last_change":"2024-09-21T03:40:29.337467+0000","last_active":"2024-09-21T03:41:50.547556+0000","last_peered":"2024-09-21T03:41:50.547556+0000","last_clean":"2024-09-21T03:41:50.547556+0000","last_became_active":"2024-09-21T03:40:29.337102+0000","last_became_peered":"2024-09-21T03:40:29.337102+0000","last_unstale":"2024-09-21T03:41:50.547556+0000","last_undegraded":"2024-09-21T03:41:50.547556+0000","last_fullsized":"2024-09-21T03:41:50.547556+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:53.798977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.532013+0000","last_change":"2024-09-21T03:40:29.336446+0000","last_active":"2024-09-21T03:41:50.532013+0000","last_peered":"2024-09-21T03:41:50.532013+0000","last_clean":"2024-09-21T03:41:50.532013+0000","last_became_active":"2024-09-21T03:40:29.336081+0000","last_became_peered":"2024-09-21T03:40:29.336081+0000","last_unstale":"2024-09-21T03:41:50.532013+0000","last_undegraded":"2024-09-21T03:41:50.532013+0000","last_fullsized":"2024-09-21T03:41:50.532013+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:23.892700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.545127+0000","last_change":"2024-09-21T03:40:29.342861+0000","last_active":"2024-09-21T03:41:50.545127+0000","last_peered":"2024-09-21T03:41:50.545127+0000","last_clean":"2024-09-21T03:41:50.545127+0000","last_became_active":"2024-09-21T03:40:29.342111+0000","last_became_peered":"2024-09-21T03:40:29.342111+0000","last_unstale":"2024-09-21T03:41:50.545127+0000","last_undegraded":"2024-09-21T03:41:50.545127+0000","last_fullsized":"2024-09-21T03:41:50.545127+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:30.012195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.538824+0000","last_change":"2024-09-21T03:40:29.339822+0000","last_active":"2024-09-21T03:41:50.538824+0000","last_peered":"2024-09-21T03:41:50.538824+0000","last_clean":"2024-09-21T03:41:50.538824+0000","last_became_active":"2024-09-21T03:40:29.339126+0000","last_became_peered":"2024-09-21T03:40:29.339126+0000","last_unstale":"2024-09-21T03:41:50.538824+0000","last_undegraded":"2024-09-21T03:41:50.538824+0000","last_fullsized":"2024-09-21T03:41:50.538824+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:44.874344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.522428+0000","last_change":"2024-09-21T03:40:29.333683+0000","last_active":"2024-09-21T03:41:50.522428+0000","last_peered":"2024-09-21T03:41:50.522428+0000","last_clean":"2024-09-21T03:41:50.522428+0000","last_became_active":"2024-09-21T03:40:29.333329+0000","last_became_peered":"2024-09-21T03:40:29.333329+0000","last_unstale":"2024-09-21T03:41:50.522428+0000","last_undegraded":"2024-09-21T03:41:50.522428+0000","last_fullsized":"2024-09-21T03:41:50.522428+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:42.655732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.527562+0000","last_change":"2024-09-21T03:40:29.346193+0000","last_active":"2024-09-21T03:41:50.527562+0000","last_peered":"2024-09-21T03:41:50.527562+0000","last_clean":"2024-09-21T03:41:50.527562+0000","last_became_active":"2024-09-21T03:40:29.345808+0000","last_became_peered":"2024-09-21T03:40:29.345808+0000","last_unstale":"2024-09-21T03:41:50.527562+0000","last_undegraded":"2024-09-21T03:41:50.527562+0000","last_fullsized":"2024-09-21T03:41:50.527562+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:59.621904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.535861+0000","last_change":"2024-09-21T03:40:29.337782+0000","last_active":"2024-09-21T03:41:50.535861+0000","last_peered":"2024-09-21T03:41:50.535861+0000","last_clean":"2024-09-21T03:41:50.535861+0000","last_became_active":"2024-09-21T03:40:29.337390+0000","last_became_peered":"2024-09-21T03:40:29.337390+0000","last_unstale":"2024-09-21T03:41:50.535861+0000","last_undegraded":"2024-09-21T03:41:50.535861+0000","last_fullsized":"2024-09-21T03:41:50.535861+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:49.924375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.535660+0000","last_change":"2024-09-21T03:40:29.340821+0000","last_active":"2024-09-21T03:41:50.535660+0000","last_peered":"2024-09-21T03:41:50.535660+0000","last_clean":"2024-09-21T03:41:50.535660+0000","last_became_active":"2024-09-21T03:40:29.340465+0000","last_became_peered":"2024-09-21T03:40:29.340465+0000","last_unstale":"2024-09-21T03:41:50.535660+0000","last_undegraded":"2024-09-21T03:41:50.535660+0000","last_fullsized":"2024-09-21T03:41:50.535660+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:18.600335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.541949+0000","last_change":"2024-09-21T03:40:29.345218+0000","last_active":"2024-09-21T03:41:50.541949+0000","last_peered":"2024-09-21T03:41:50.541949+0000","last_clean":"2024-09-21T03:41:50.541949+0000","last_became_active":"2024-09-21T03:40:29.344862+0000","last_became_peered":"2024-09-21T03:40:29.344862+0000","last_unstale":"2024-09-21T03:41:50.541949+0000","last_undegraded":"2024-09-21T03:41:50.541949+0000","last_fullsized":"2024-09-21T03:41:50.541949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:53.570489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"77'16","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.528972+0000","last_change":"2024-09-21T03:40:51.471622+0000","last_active":"2024-09-21T03:41:50.528972+0000","last_peered":"2024-09-21T03:41:50.528972+0000","last_clean":"2024-09-21T03:41:50.528972+0000","last_became_active":"2024-09-21T03:40:51.471276+0000","last_became_peered":"2024-09-21T03:40:51.471276+0000","last_unstale":"2024-09-21T03:41:50.528972+0000","last_undegraded":"2024-09-21T03:41:50.528972+0000","last_fullsized":"2024-09-21T03:41:50.528972+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:38.030634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.548357+0000","last_change":"2024-09-21T03:40:29.338353+0000","last_active":"2024-09-21T03:41:50.548357+0000","last_peered":"2024-09-21T03:41:50.548357+0000","last_clean":"2024-09-21T03:41:50.548357+0000","last_became_active":"2024-09-21T03:40:29.337976+0000","last_became_peered":"2024-09-21T03:40:29.337976+0000","last_unstale":"2024-09-21T03:41:50.548357+0000","last_undegraded":"2024-09-21T03:41:50.548357+0000","last_fullsized":"2024-09-21T03:41:50.548357+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:10.182045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.530870+0000","last_change":"2024-09-21T03:40:29.343617+0000","last_active":"2024-09-21T03:41:50.530870+0000","last_peered":"2024-09-21T03:41:50.530870+0000","last_clean":"2024-09-21T03:41:50.530870+0000","last_became_active":"2024-09-21T03:40:29.342586+0000","last_became_peered":"2024-09-21T03:40:29.342586+0000","last_unstale":"2024-09-21T03:41:50.530870+0000","last_undegraded":"2024-09-21T03:41:50.530870+0000","last_fullsized":"2024-09-21T03:41:50.530870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:06.823802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.533573+0000","last_change":"2024-09-21T03:40:29.338633+0000","last_active":"2024-09-21T03:41:50.533573+0000","last_peered":"2024-09-21T03:41:50.533573+0000","last_clean":"2024-09-21T03:41:50.533573+0000","last_became_active":"2024-09-21T03:40:29.337502+0000","last_became_peered":"2024-09-21T03:40:29.337502+0000","last_unstale":"2024-09-21T03:41:50.533573+0000","last_undegraded":"2024-09-21T03:41:50.533573+0000","last_fullsized":"2024-09-21T03:41:50.533573+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:04.121275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.534492+0000","last_change":"2024-09-21T03:40:29.335774+0000","last_active":"2024-09-21T03:41:50.534492+0000","last_peered":"2024-09-21T03:41:50.534492+0000","last_clean":"2024-09-21T03:41:50.534492+0000","last_became_active":"2024-09-21T03:40:29.335452+0000","last_became_peered":"2024-09-21T03:40:29.335452+0000","last_unstale":"2024-09-21T03:41:50.534492+0000","last_undegraded":"2024-09-21T03:41:50.534492+0000","last_fullsized":"2024-09-21T03:41:50.534492+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:37.427015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.540744+0000","last_change":"2024-09-21T03:40:29.342874+0000","last_active":"2024-09-21T03:41:50.540744+0000","last_peered":"2024-09-21T03:41:50.540744+0000","last_clean":"2024-09-21T03:41:50.540744+0000","last_became_active":"2024-09-21T03:40:29.342343+0000","last_became_peered":"2024-09-21T03:40:29.342343+0000","last_unstale":"2024-09-21T03:41:50.540744+0000","last_undegraded":"2024-09-21T03:41:50.540744+0000","last_fullsized":"2024-09-21T03:41:50.540744+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:52.473608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.550793+0000","last_change":"2024-09-21T03:40:29.339231+0000","last_active":"2024-09-21T03:41:50.550793+0000","last_peered":"2024-09-21T03:41:50.550793+0000","last_clean":"2024-09-21T03:41:50.550793+0000","last_became_active":"2024-09-21T03:40:29.338724+0000","last_became_peered":"2024-09-21T03:40:29.338724+0000","last_unstale":"2024-09-21T03:41:50.550793+0000","last_undegraded":"2024-09-21T03:41:50.550793+0000","last_fullsized":"2024-09-21T03:41:50.550793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:55.592713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.547802+0000","last_change":"2024-09-21T03:40:29.338480+0000","last_active":"2024-09-21T03:41:50.547802+0000","last_peered":"2024-09-21T03:41:50.547802+0000","last_clean":"2024-09-21T03:41:50.547802+0000","last_became_active":"2024-09-21T03:40:29.338092+0000","last_became_peered":"2024-09-21T03:40:29.338092+0000","last_unstale":"2024-09-21T03:41:50.547802+0000","last_undegraded":"2024-09-21T03:41:50.547802+0000","last_fullsized":"2024-09-21T03:41:50.547802+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:25.557502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.545250+0000","last_change":"2024-09-21T03:40:29.335557+0000","last_active":"2024-09-21T03:41:50.545250+0000","last_peered":"2024-09-21T03:41:50.545250+0000","last_clean":"2024-09-21T03:41:50.545250+0000","last_became_active":"2024-09-21T03:40:29.335214+0000","last_became_peered":"2024-09-21T03:40:29.335214+0000","last_unstale":"2024-09-21T03:41:50.545250+0000","last_undegraded":"2024-09-21T03:41:50.545250+0000","last_fullsized":"2024-09-21T03:41:50.545250+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:21.395995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.530848+0000","last_change":"2024-09-21T03:40:29.333041+0000","last_active":"2024-09-21T03:41:50.530848+0000","last_peered":"2024-09-21T03:41:50.530848+0000","last_clean":"2024-09-21T03:41:50.530848+0000","last_became_active":"2024-09-21T03:40:29.332187+0000","last_became_peered":"2024-09-21T03:40:29.332187+0000","last_unstale":"2024-09-21T03:41:50.530848+0000","last_undegraded":"2024-09-21T03:41:50.530848+0000","last_fullsized":"2024-09-21T03:41:50.530848+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:03.253594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.529370+0000","last_change":"2024-09-21T03:40:29.339152+0000","last_active":"2024-09-21T03:41:50.529370+0000","last_peered":"2024-09-21T03:41:50.529370+0000","last_clean":"2024-09-21T03:41:50.529370+0000","last_became_active":"2024-09-21T03:40:29.338722+0000","last_became_peered":"2024-09-21T03:40:29.338722+0000","last_unstale":"2024-09-21T03:41:50.529370+0000","last_undegraded":"2024-09-21T03:41:50.529370+0000","last_fullsized":"2024-09-21T03:41:50.529370+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:32.143498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.546810+0000","last_change":"2024-09-21T03:40:29.329169+0000","last_active":"2024-09-21T03:41:50.546810+0000","last_peered":"2024-09-21T03:41:50.546810+0000","last_clean":"2024-09-21T03:41:50.546810+0000","last_became_active":"2024-09-21T03:40:29.328805+0000","last_became_peered":"2024-09-21T03:40:29.328805+0000","last_unstale":"2024-09-21T03:41:50.546810+0000","last_undegraded":"2024-09-21T03:41:50.546810+0000","last_fullsized":"2024-09-21T03:41:50.546810+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:13.725038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.550737+0000","last_change":"2024-09-21T03:40:29.336699+0000","last_active":"2024-09-21T03:41:50.550737+0000","last_peered":"2024-09-21T03:41:50.550737+0000","last_clean":"2024-09-21T03:41:50.550737+0000","last_became_active":"2024-09-21T03:40:29.333649+0000","last_became_peered":"2024-09-21T03:40:29.333649+0000","last_unstale":"2024-09-21T03:41:50.550737+0000","last_undegraded":"2024-09-21T03:41:50.550737+0000","last_fullsized":"2024-09-21T03:41:50.550737+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:49.418205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.531010+0000","last_change":"2024-09-21T03:40:29.337936+0000","last_active":"2024-09-21T03:41:50.531010+0000","last_peered":"2024-09-21T03:41:50.531010+0000","last_clean":"2024-09-21T03:41:50.531010+0000","last_became_active":"2024-09-21T03:40:29.337521+0000","last_became_peered":"2024-09-21T03:40:29.337521+0000","last_unstale":"2024-09-21T03:41:50.531010+0000","last_undegraded":"2024-09-21T03:41:50.531010+0000","last_fullsized":"2024-09-21T03:41:50.531010+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:09.223634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.532926+0000","last_change":"2024-09-21T03:40:29.336866+0000","last_active":"2024-09-21T03:41:50.532926+0000","last_peered":"2024-09-21T03:41:50.532926+0000","last_clean":"2024-09-21T03:41:50.532926+0000","last_became_active":"2024-09-21T03:40:29.336447+0000","last_became_peered":"2024-09-21T03:40:29.336447+0000","last_unstale":"2024-09-21T03:41:50.532926+0000","last_undegraded":"2024-09-21T03:41:50.532926+0000","last_fullsized":"2024-09-21T03:41:50.532926+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:53.487678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.530414+0000","last_change":"2024-09-21T03:40:29.333666+0000","last_active":"2024-09-21T03:41:50.530414+0000","last_peered":"2024-09-21T03:41:50.530414+0000","last_clean":"2024-09-21T03:41:50.530414+0000","last_became_active":"2024-09-21T03:40:29.333248+0000","last_became_peered":"2024-09-21T03:40:29.333248+0000","last_unstale":"2024-09-21T03:41:50.530414+0000","last_undegraded":"2024-09-21T03:41:50.530414+0000","last_fullsized":"2024-09-21T03:41:50.530414+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:54.721926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.544878+0000","last_change":"2024-09-21T03:40:29.342165+0000","last_active":"2024-09-21T03:41:50.544878+0000","last_peered":"2024-09-21T03:41:50.544878+0000","last_clean":"2024-09-21T03:41:50.544878+0000","last_became_active":"2024-09-21T03:40:29.341744+0000","last_became_peered":"2024-09-21T03:40:29.341744+0000","last_unstale":"2024-09-21T03:41:50.544878+0000","last_undegraded":"2024-09-21T03:41:50.544878+0000","last_fullsized":"2024-09-21T03:41:50.544878+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:04.641927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.530032+0000","last_change":"2024-09-21T03:40:29.341728+0000","last_active":"2024-09-21T03:41:50.530032+0000","last_peered":"2024-09-21T03:41:50.530032+0000","last_clean":"2024-09-21T03:41:50.530032+0000","last_became_active":"2024-09-21T03:40:29.339252+0000","last_became_peered":"2024-09-21T03:40:29.339252+0000","last_unstale":"2024-09-21T03:41:50.530032+0000","last_undegraded":"2024-09-21T03:41:50.530032+0000","last_fullsized":"2024-09-21T03:41:50.530032+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:53.618128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.536386+0000","last_change":"2024-09-21T03:40:29.326893+0000","last_active":"2024-09-21T03:41:50.536386+0000","last_peered":"2024-09-21T03:41:50.536386+0000","last_clean":"2024-09-21T03:41:50.536386+0000","last_became_active":"2024-09-21T03:40:29.326427+0000","last_became_peered":"2024-09-21T03:40:29.326427+0000","last_unstale":"2024-09-21T03:41:50.536386+0000","last_undegraded":"2024-09-21T03:41:50.536386+0000","last_fullsized":"2024-09-21T03:41:50.536386+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:41.036179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.540804+0000","last_change":"2024-09-21T03:40:29.340410+0000","last_active":"2024-09-21T03:41:50.540804+0000","last_peered":"2024-09-21T03:41:50.540804+0000","last_clean":"2024-09-21T03:41:50.540804+0000","last_became_active":"2024-09-21T03:40:29.340062+0000","last_became_peered":"2024-09-21T03:40:29.340062+0000","last_unstale":"2024-09-21T03:41:50.540804+0000","last_undegraded":"2024-09-21T03:41:50.540804+0000","last_fullsized":"2024-09-21T03:41:50.540804+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:44.971145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.522052+0000","last_change":"2024-09-21T03:40:29.333387+0000","last_active":"2024-09-21T03:41:50.522052+0000","last_peered":"2024-09-21T03:41:50.522052+0000","last_clean":"2024-09-21T03:41:50.522052+0000","last_became_active":"2024-09-21T03:40:29.332511+0000","last_became_peered":"2024-09-21T03:40:29.332511+0000","last_unstale":"2024-09-21T03:41:50.522052+0000","last_undegraded":"2024-09-21T03:41:50.522052+0000","last_fullsized":"2024-09-21T03:41:50.522052+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:24.513267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"77'12","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.522801+0000","last_change":"2024-09-21T03:40:29.337845+0000","last_active":"2024-09-21T03:41:50.522801+0000","last_peered":"2024-09-21T03:41:50.522801+0000","last_clean":"2024-09-21T03:41:50.522801+0000","last_became_active":"2024-09-21T03:40:29.337387+0000","last_became_peered":"2024-09-21T03:40:29.337387+0000","last_unstale":"2024-09-21T03:41:50.522801+0000","last_undegraded":"2024-09-21T03:41:50.522801+0000","last_fullsized":"2024-09-21T03:41:50.522801+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:31.398337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.534904+0000","last_change":"2024-09-21T03:40:29.342691+0000","last_active":"2024-09-21T03:41:50.534904+0000","last_peered":"2024-09-21T03:41:50.534904+0000","last_clean":"2024-09-21T03:41:50.534904+0000","last_became_active":"2024-09-21T03:40:29.342294+0000","last_became_peered":"2024-09-21T03:40:29.342294+0000","last_unstale":"2024-09-21T03:41:50.534904+0000","last_undegraded":"2024-09-21T03:41:50.534904+0000","last_fullsized":"2024-09-21T03:41:50.534904+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:25.806074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.531577+0000","last_change":"2024-09-21T03:40:29.338280+0000","last_active":"2024-09-21T03:41:50.531577+0000","last_peered":"2024-09-21T03:41:50.531577+0000","last_clean":"2024-09-21T03:41:50.531577+0000","last_became_active":"2024-09-21T03:40:29.337825+0000","last_became_peered":"2024-09-21T03:40:29.337825+0000","last_unstale":"2024-09-21T03:41:50.531577+0000","last_undegraded":"2024-09-21T03:41:50.531577+0000","last_fullsized":"2024-09-21T03:41:50.531577+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:43.340248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'8","reported_seq":152,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:42:20.776838+0000","last_change":"2024-09-21T03:40:51.641130+0000","last_active":"2024-09-21T03:42:20.776838+0000","last_peered":"2024-09-21T03:42:20.776838+0000","last_clean":"2024-09-21T03:42:20.776838+0000","last_became_active":"2024-09-21T03:40:51.636641+0000","last_became_peered":"2024-09-21T03:40:51.636641+0000","last_unstale":"2024-09-21T03:42:20.776838+0000","last_undegraded":"2024-09-21T03:42:20.776838+0000","last_fullsized":"2024-09-21T03:42:20.776838+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:34.797959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.532959+0000","last_change":"2024-09-21T03:40:29.341830+0000","last_active":"2024-09-21T03:41:50.532959+0000","last_peered":"2024-09-21T03:41:50.532959+0000","last_clean":"2024-09-21T03:41:50.532959+0000","last_became_active":"2024-09-21T03:40:29.341112+0000","last_became_peered":"2024-09-21T03:40:29.341112+0000","last_unstale":"2024-09-21T03:41:50.532959+0000","last_undegraded":"2024-09-21T03:41:50.532959+0000","last_fullsized":"2024-09-21T03:41:50.532959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:31.560605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468958+0000","last_change":"2024-09-21T03:40:27.319393+0000","last_active":"2024-09-21T03:40:51.468958+0000","last_peered":"2024-09-21T03:40:51.468958+0000","last_clean":"2024-09-21T03:40:51.468958+0000","last_became_active":"2024-09-21T03:40:27.319000+0000","last_became_peered":"2024-09-21T03:40:27.319000+0000","last_unstale":"2024-09-21T03:40:51.468958+0000","last_undegraded":"2024-09-21T03:40:51.468958+0000","last_fullsized":"2024-09-21T03:40:51.468958+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:24.752295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780193+0000","last_change":"2024-09-21T03:40:27.317276+0000","last_active":"2024-09-21T03:40:51.780193+0000","last_peered":"2024-09-21T03:40:51.780193+0000","last_clean":"2024-09-21T03:40:51.780193+0000","last_became_active":"2024-09-21T03:40:27.316955+0000","last_became_peered":"2024-09-21T03:40:27.316955+0000","last_unstale":"2024-09-21T03:40:51.780193+0000","last_undegraded":"2024-09-21T03:40:51.780193+0000","last_fullsized":"2024-09-21T03:40:51.780193+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:23.208493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.531552+0000","last_change":"2024-09-21T03:40:29.324774+0000","last_active":"2024-09-21T03:41:50.531552+0000","last_peered":"2024-09-21T03:41:50.531552+0000","last_clean":"2024-09-21T03:41:50.531552+0000","last_became_active":"2024-09-21T03:40:29.324107+0000","last_became_peered":"2024-09-21T03:40:29.324107+0000","last_unstale":"2024-09-21T03:41:50.531552+0000","last_undegraded":"2024-09-21T03:41:50.531552+0000","last_fullsized":"2024-09-21T03:41:50.531552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:15.408620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464393+0000","last_change":"2024-09-21T03:40:27.316818+0000","last_active":"2024-09-21T03:40:51.464393+0000","last_peered":"2024-09-21T03:40:51.464393+0000","last_clean":"2024-09-21T03:40:51.464393+0000","last_became_active":"2024-09-21T03:40:27.316209+0000","last_became_peered":"2024-09-21T03:40:27.316209+0000","last_unstale":"2024-09-21T03:40:51.464393+0000","last_undegraded":"2024-09-21T03:40:51.464393+0000","last_fullsized":"2024-09-21T03:40:51.464393+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:01.869684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.526040+0000","last_change":"2024-09-21T03:40:29.335033+0000","last_active":"2024-09-21T03:41:50.526040+0000","last_peered":"2024-09-21T03:41:50.526040+0000","last_clean":"2024-09-21T03:41:50.526040+0000","last_became_active":"2024-09-21T03:40:29.334607+0000","last_became_peered":"2024-09-21T03:40:29.334607+0000","last_unstale":"2024-09-21T03:41:50.526040+0000","last_undegraded":"2024-09-21T03:41:50.526040+0000","last_fullsized":"2024-09-21T03:41:50.526040+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:05.892248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'5","reported_seq":132,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:42:21.777673+0000","last_change":"2024-09-21T03:40:27.319422+0000","last_active":"2024-09-21T03:42:21.777673+0000","last_peered":"2024-09-21T03:42:21.777673+0000","last_clean":"2024-09-21T03:42:21.777673+0000","last_became_active":"2024-09-21T03:40:27.318970+0000","last_became_peered":"2024-09-21T03:40:27.318970+0000","last_unstale":"2024-09-21T03:42:21.777673+0000","last_undegraded":"2024-09-21T03:42:21.777673+0000","last_fullsized":"2024-09-21T03:42:21.777673+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:04.263789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.549882+0000","last_change":"2024-09-21T03:40:29.334279+0000","last_active":"2024-09-21T03:41:50.549882+0000","last_peered":"2024-09-21T03:41:50.549882+0000","last_clean":"2024-09-21T03:41:50.549882+0000","last_became_active":"2024-09-21T03:40:29.333445+0000","last_became_peered":"2024-09-21T03:40:29.333445+0000","last_unstale":"2024-09-21T03:41:50.549882+0000","last_undegraded":"2024-09-21T03:41:50.549882+0000","last_fullsized":"2024-09-21T03:41:50.549882+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:10.445162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.643258+0000","last_change":"2024-09-21T03:40:51.643129+0000","last_active":"2024-09-21T03:40:51.643258+0000","last_peered":"2024-09-21T03:40:51.643258+0000","last_clean":"2024-09-21T03:40:51.643258+0000","last_became_active":"2024-09-21T03:40:51.637136+0000","last_became_peered":"2024-09-21T03:40:51.637136+0000","last_unstale":"2024-09-21T03:40:51.643258+0000","last_undegraded":"2024-09-21T03:40:51.643258+0000","last_fullsized":"2024-09-21T03:40:51.643258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:39.540452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.540817+0000","last_change":"2024-09-21T03:40:29.340393+0000","last_active":"2024-09-21T03:41:50.540817+0000","last_peered":"2024-09-21T03:41:50.540817+0000","last_clean":"2024-09-21T03:41:50.540817+0000","last_became_active":"2024-09-21T03:40:29.340042+0000","last_became_peered":"2024-09-21T03:40:29.340042+0000","last_unstale":"2024-09-21T03:41:50.540817+0000","last_undegraded":"2024-09-21T03:41:50.540817+0000","last_fullsized":"2024-09-21T03:41:50.540817+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:43.794252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464730+0000","last_change":"2024-09-21T03:40:27.526458+0000","last_active":"2024-09-21T03:40:51.464730+0000","last_peered":"2024-09-21T03:40:51.464730+0000","last_clean":"2024-09-21T03:40:51.464730+0000","last_became_active":"2024-09-21T03:40:27.525918+0000","last_became_peered":"2024-09-21T03:40:27.525918+0000","last_unstale":"2024-09-21T03:40:51.464730+0000","last_undegraded":"2024-09-21T03:40:51.464730+0000","last_fullsized":"2024-09-21T03:40:51.464730+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:47.286475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.549166+0000","last_change":"2024-09-21T03:40:29.338197+0000","last_active":"2024-09-21T03:41:50.549166+0000","last_peered":"2024-09-21T03:41:50.549166+0000","last_clean":"2024-09-21T03:41:50.549166+0000","last_became_active":"2024-09-21T03:40:29.337852+0000","last_became_peered":"2024-09-21T03:40:29.337852+0000","last_unstale":"2024-09-21T03:41:50.549166+0000","last_undegraded":"2024-09-21T03:41:50.549166+0000","last_fullsized":"2024-09-21T03:41:50.549166+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:09.132407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'33","reported_seq":275,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:42:22.778612+0000","last_change":"2024-09-21T03:40:27.320891+0000","last_active":"2024-09-21T03:42:22.778612+0000","last_peered":"2024-09-21T03:42:22.778612+0000","last_clean":"2024-09-21T03:42:22.778612+0000","last_became_active":"2024-09-21T03:40:27.320512+0000","last_became_peered":"2024-09-21T03:40:27.320512+0000","last_unstale":"2024-09-21T03:42:22.778612+0000","last_undegraded":"2024-09-21T03:42:22.778612+0000","last_fullsized":"2024-09-21T03:42:22.778612+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:27.181130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69740,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":219,"num_read_kb":177,"num_write":34,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.530637+0000","last_change":"2024-09-21T03:40:29.335570+0000","last_active":"2024-09-21T03:41:50.530637+0000","last_peered":"2024-09-21T03:41:50.530637+0000","last_clean":"2024-09-21T03:41:50.530637+0000","last_became_active":"2024-09-21T03:40:29.335226+0000","last_became_peered":"2024-09-21T03:40:29.335226+0000","last_unstale":"2024-09-21T03:41:50.530637+0000","last_undegraded":"2024-09-21T03:41:50.530637+0000","last_fullsized":"2024-09-21T03:41:50.530637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:56.434945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468293+0000","last_change":"2024-09-21T03:40:27.318436+0000","last_active":"2024-09-21T03:40:51.468293+0000","last_peered":"2024-09-21T03:40:51.468293+0000","last_clean":"2024-09-21T03:40:51.468293+0000","last_became_active":"2024-09-21T03:40:27.317969+0000","last_became_peered":"2024-09-21T03:40:27.317969+0000","last_unstale":"2024-09-21T03:40:51.468293+0000","last_undegraded":"2024-09-21T03:40:51.468293+0000","last_fullsized":"2024-09-21T03:40:51.468293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:43.137717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.547119+0000","last_change":"2024-09-21T03:40:29.325824+0000","last_active":"2024-09-21T03:41:50.547119+0000","last_peered":"2024-09-21T03:41:50.547119+0000","last_clean":"2024-09-21T03:41:50.547119+0000","last_became_active":"2024-09-21T03:40:29.325498+0000","last_became_peered":"2024-09-21T03:40:29.325498+0000","last_unstale":"2024-09-21T03:41:50.547119+0000","last_undegraded":"2024-09-21T03:41:50.547119+0000","last_fullsized":"2024-09-21T03:41:50.547119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:13.044835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464366+0000","last_change":"2024-09-21T03:40:27.308889+0000","last_active":"2024-09-21T03:40:51.464366+0000","last_peered":"2024-09-21T03:40:51.464366+0000","last_clean":"2024-09-21T03:40:51.464366+0000","last_became_active":"2024-09-21T03:40:27.308491+0000","last_became_peered":"2024-09-21T03:40:27.308491+0000","last_unstale":"2024-09-21T03:40:51.464366+0000","last_undegraded":"2024-09-21T03:40:51.464366+0000","last_fullsized":"2024-09-21T03:40:51.464366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:48.250898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"77'15","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.548242+0000","last_change":"2024-09-21T03:40:51.781287+0000","last_active":"2024-09-21T03:41:50.548242+0000","last_peered":"2024-09-21T03:41:50.548242+0000","last_clean":"2024-09-21T03:41:50.548242+0000","last_became_active":"2024-09-21T03:40:51.780925+0000","last_became_peered":"2024-09-21T03:40:51.780925+0000","last_unstale":"2024-09-21T03:41:50.548242+0000","last_undegraded":"2024-09-21T03:41:50.548242+0000","last_fullsized":"2024-09-21T03:41:50.548242+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:36.599949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'4","reported_seq":131,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:42:20.606215+0000","last_change":"2024-09-21T03:40:27.316066+0000","last_active":"2024-09-21T03:42:20.606215+0000","last_peered":"2024-09-21T03:42:20.606215+0000","last_clean":"2024-09-21T03:42:20.606215+0000","last_became_active":"2024-09-21T03:40:27.315580+0000","last_became_peered":"2024-09-21T03:40:27.315580+0000","last_unstale":"2024-09-21T03:42:20.606215+0000","last_undegraded":"2024-09-21T03:42:20.606215+0000","last_fullsized":"2024-09-21T03:42:20.606215+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:14.592824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.547163+0000","last_change":"2024-09-21T03:40:29.339736+0000","last_active":"2024-09-21T03:41:50.547163+0000","last_peered":"2024-09-21T03:41:50.547163+0000","last_clean":"2024-09-21T03:41:50.547163+0000","last_became_active":"2024-09-21T03:40:29.338343+0000","last_became_peered":"2024-09-21T03:40:29.338343+0000","last_unstale":"2024-09-21T03:41:50.547163+0000","last_undegraded":"2024-09-21T03:41:50.547163+0000","last_fullsized":"2024-09-21T03:41:50.547163+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:33.531580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.485664+0000","last_change":"2024-09-21T03:40:51.485123+0000","last_active":"2024-09-21T03:40:51.485664+0000","last_peered":"2024-09-21T03:40:51.485664+0000","last_clean":"2024-09-21T03:40:51.485664+0000","last_became_active":"2024-09-21T03:40:51.471029+0000","last_became_peered":"2024-09-21T03:40:51.471029+0000","last_unstale":"2024-09-21T03:40:51.485664+0000","last_undegraded":"2024-09-21T03:40:51.485664+0000","last_fullsized":"2024-09-21T03:40:51.485664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:32.870908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.537148+0000","last_change":"2024-09-21T03:40:29.340712+0000","last_active":"2024-09-21T03:41:50.537148+0000","last_peered":"2024-09-21T03:41:50.537148+0000","last_clean":"2024-09-21T03:41:50.537148+0000","last_became_active":"2024-09-21T03:40:29.340349+0000","last_became_peered":"2024-09-21T03:40:29.340349+0000","last_unstale":"2024-09-21T03:41:50.537148+0000","last_undegraded":"2024-09-21T03:41:50.537148+0000","last_fullsized":"2024-09-21T03:41:50.537148+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:29.980697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470772+0000","last_change":"2024-09-21T03:40:27.319689+0000","last_active":"2024-09-21T03:40:51.470772+0000","last_peered":"2024-09-21T03:40:51.470772+0000","last_clean":"2024-09-21T03:40:51.470772+0000","last_became_active":"2024-09-21T03:40:27.319010+0000","last_became_peered":"2024-09-21T03:40:27.319010+0000","last_unstale":"2024-09-21T03:40:51.470772+0000","last_undegraded":"2024-09-21T03:40:51.470772+0000","last_fullsized":"2024-09-21T03:40:51.470772+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:42.965205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"77'5","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.526836+0000","last_change":"2024-09-21T03:40:51.636790+0000","last_active":"2024-09-21T03:41:50.526836+0000","last_peered":"2024-09-21T03:41:50.526836+0000","last_clean":"2024-09-21T03:41:50.526836+0000","last_became_active":"2024-09-21T03:40:51.636333+0000","last_became_peered":"2024-09-21T03:40:51.636333+0000","last_unstale":"2024-09-21T03:41:50.526836+0000","last_undegraded":"2024-09-21T03:41:50.526836+0000","last_fullsized":"2024-09-21T03:41:50.526836+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:27.186564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780182+0000","last_change":"2024-09-21T03:40:27.316086+0000","last_active":"2024-09-21T03:40:51.780182+0000","last_peered":"2024-09-21T03:40:51.780182+0000","last_clean":"2024-09-21T03:40:51.780182+0000","last_became_active":"2024-09-21T03:40:27.315645+0000","last_became_peered":"2024-09-21T03:40:27.315645+0000","last_unstale":"2024-09-21T03:40:51.780182+0000","last_undegraded":"2024-09-21T03:40:51.780182+0000","last_fullsized":"2024-09-21T03:40:51.780182+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:41.536778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.545457+0000","last_change":"2024-09-21T03:40:29.339546+0000","last_active":"2024-09-21T03:41:50.545457+0000","last_peered":"2024-09-21T03:41:50.545457+0000","last_clean":"2024-09-21T03:41:50.545457+0000","last_became_active":"2024-09-21T03:40:29.339176+0000","last_became_peered":"2024-09-21T03:40:29.339176+0000","last_unstale":"2024-09-21T03:41:50.545457+0000","last_undegraded":"2024-09-21T03:41:50.545457+0000","last_fullsized":"2024-09-21T03:41:50.545457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:26.405624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464973+0000","last_change":"2024-09-21T03:40:27.315440+0000","last_active":"2024-09-21T03:40:51.464973+0000","last_peered":"2024-09-21T03:40:51.464973+0000","last_clean":"2024-09-21T03:40:51.464973+0000","last_became_active":"2024-09-21T03:40:27.314608+0000","last_became_peered":"2024-09-21T03:40:27.314608+0000","last_unstale":"2024-09-21T03:40:51.464973+0000","last_undegraded":"2024-09-21T03:40:51.464973+0000","last_fullsized":"2024-09-21T03:40:51.464973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:11.465078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.537525+0000","last_change":"2024-09-21T03:40:29.336631+0000","last_active":"2024-09-21T03:41:50.537525+0000","last_peered":"2024-09-21T03:41:50.537525+0000","last_clean":"2024-09-21T03:41:50.537525+0000","last_became_active":"2024-09-21T03:40:29.336201+0000","last_became_peered":"2024-09-21T03:40:29.336201+0000","last_unstale":"2024-09-21T03:41:50.537525+0000","last_undegraded":"2024-09-21T03:41:50.537525+0000","last_fullsized":"2024-09-21T03:41:50.537525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:29.514908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468161+0000","last_change":"2024-09-21T03:40:27.719183+0000","last_active":"2024-09-21T03:40:51.468161+0000","last_peered":"2024-09-21T03:40:51.468161+0000","last_clean":"2024-09-21T03:40:51.468161+0000","last_became_active":"2024-09-21T03:40:27.718658+0000","last_became_peered":"2024-09-21T03:40:27.718658+0000","last_unstale":"2024-09-21T03:40:51.468161+0000","last_undegraded":"2024-09-21T03:40:51.468161+0000","last_fullsized":"2024-09-21T03:40:51.468161+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:52.280654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.549141+0000","last_change":"2024-09-21T03:40:29.335258+0000","last_active":"2024-09-21T03:41:50.549141+0000","last_peered":"2024-09-21T03:41:50.549141+0000","last_clean":"2024-09-21T03:41:50.549141+0000","last_became_active":"2024-09-21T03:40:29.334897+0000","last_became_peered":"2024-09-21T03:40:29.334897+0000","last_unstale":"2024-09-21T03:41:50.549141+0000","last_undegraded":"2024-09-21T03:41:50.549141+0000","last_fullsized":"2024-09-21T03:41:50.549141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:27.040232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":96,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464438+0000","last_change":"2024-09-21T03:39:15.369567+0000","last_active":"2024-09-21T03:40:51.464438+0000","last_peered":"2024-09-21T03:40:51.464438+0000","last_clean":"2024-09-21T03:40:51.464438+0000","last_became_active":"2024-09-21T03:39:15.363960+0000","last_became_peered":"2024-09-21T03:39:15.363960+0000","last_unstale":"2024-09-21T03:40:51.464438+0000","last_undegraded":"2024-09-21T03:40:51.464438+0000","last_fullsized":"2024-09-21T03:40:51.464438+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:35:51.240165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:35:51.240165+0000","last_clean_scrub_stamp":"2024-09-21T03:35:51.240165+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:10.335425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.635844+0000","last_change":"2024-09-21T03:40:27.316831+0000","last_active":"2024-09-21T03:40:51.635844+0000","last_peered":"2024-09-21T03:40:51.635844+0000","last_clean":"2024-09-21T03:40:51.635844+0000","last_became_active":"2024-09-21T03:40:27.315547+0000","last_became_peered":"2024-09-21T03:40:27.315547+0000","last_unstale":"2024-09-21T03:40:51.635844+0000","last_undegraded":"2024-09-21T03:40:51.635844+0000","last_fullsized":"2024-09-21T03:40:51.635844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:02.727366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.545628+0000","last_change":"2024-09-21T03:40:29.339059+0000","last_active":"2024-09-21T03:41:50.545628+0000","last_peered":"2024-09-21T03:41:50.545628+0000","last_clean":"2024-09-21T03:41:50.545628+0000","last_became_active":"2024-09-21T03:40:29.338710+0000","last_became_peered":"2024-09-21T03:40:29.338710+0000","last_unstale":"2024-09-21T03:41:50.545628+0000","last_undegraded":"2024-09-21T03:41:50.545628+0000","last_fullsized":"2024-09-21T03:41:50.545628+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:50.390629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464355+0000","last_change":"2024-09-21T03:40:27.314666+0000","last_active":"2024-09-21T03:40:51.464355+0000","last_peered":"2024-09-21T03:40:51.464355+0000","last_clean":"2024-09-21T03:40:51.464355+0000","last_became_active":"2024-09-21T03:40:27.314254+0000","last_became_peered":"2024-09-21T03:40:27.314254+0000","last_unstale":"2024-09-21T03:40:51.464355+0000","last_undegraded":"2024-09-21T03:40:51.464355+0000","last_fullsized":"2024-09-21T03:40:51.464355+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:57.230420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.524644+0000","last_change":"2024-09-21T03:40:29.338249+0000","last_active":"2024-09-21T03:41:50.524644+0000","last_peered":"2024-09-21T03:41:50.524644+0000","last_clean":"2024-09-21T03:41:50.524644+0000","last_became_active":"2024-09-21T03:40:29.337901+0000","last_became_peered":"2024-09-21T03:40:29.337901+0000","last_unstale":"2024-09-21T03:41:50.524644+0000","last_undegraded":"2024-09-21T03:41:50.524644+0000","last_fullsized":"2024-09-21T03:41:50.524644+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:21.054734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'5","reported_seq":131,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:42:20.722297+0000","last_change":"2024-09-21T03:40:27.525651+0000","last_active":"2024-09-21T03:42:20.722297+0000","last_peered":"2024-09-21T03:42:20.722297+0000","last_clean":"2024-09-21T03:42:20.722297+0000","last_became_active":"2024-09-21T03:40:27.525299+0000","last_became_peered":"2024-09-21T03:40:27.525299+0000","last_unstale":"2024-09-21T03:42:20.722297+0000","last_undegraded":"2024-09-21T03:42:20.722297+0000","last_fullsized":"2024-09-21T03:42:20.722297+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:21.983937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.529796+0000","last_change":"2024-09-21T03:40:29.339021+0000","last_active":"2024-09-21T03:41:50.529796+0000","last_peered":"2024-09-21T03:41:50.529796+0000","last_clean":"2024-09-21T03:41:50.529796+0000","last_became_active":"2024-09-21T03:40:29.338660+0000","last_became_peered":"2024-09-21T03:40:29.338660+0000","last_unstale":"2024-09-21T03:41:50.529796+0000","last_undegraded":"2024-09-21T03:41:50.529796+0000","last_fullsized":"2024-09-21T03:41:50.529796+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:56.652048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.465111+0000","last_change":"2024-09-21T03:40:27.319650+0000","last_active":"2024-09-21T03:40:51.465111+0000","last_peered":"2024-09-21T03:40:51.465111+0000","last_clean":"2024-09-21T03:40:51.465111+0000","last_became_active":"2024-09-21T03:40:27.319188+0000","last_became_peered":"2024-09-21T03:40:27.319188+0000","last_unstale":"2024-09-21T03:40:51.465111+0000","last_undegraded":"2024-09-21T03:40:51.465111+0000","last_fullsized":"2024-09-21T03:40:51.465111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:12.905682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.523060+0000","last_change":"2024-09-21T03:40:29.340673+0000","last_active":"2024-09-21T03:41:50.523060+0000","last_peered":"2024-09-21T03:41:50.523060+0000","last_clean":"2024-09-21T03:41:50.523060+0000","last_became_active":"2024-09-21T03:40:29.340240+0000","last_became_peered":"2024-09-21T03:40:29.340240+0000","last_unstale":"2024-09-21T03:41:50.523060+0000","last_undegraded":"2024-09-21T03:41:50.523060+0000","last_fullsized":"2024-09-21T03:41:50.523060+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:02.989879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470390+0000","last_change":"2024-09-21T03:40:27.527803+0000","last_active":"2024-09-21T03:40:51.470390+0000","last_peered":"2024-09-21T03:40:51.470390+0000","last_clean":"2024-09-21T03:40:51.470390+0000","last_became_active":"2024-09-21T03:40:27.527419+0000","last_became_peered":"2024-09-21T03:40:27.527419+0000","last_unstale":"2024-09-21T03:40:51.470390+0000","last_undegraded":"2024-09-21T03:40:51.470390+0000","last_fullsized":"2024-09-21T03:40:51.470390+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:15:16.081458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.534523+0000","last_change":"2024-09-21T03:40:29.347927+0000","last_active":"2024-09-21T03:41:50.534523+0000","last_peered":"2024-09-21T03:41:50.534523+0000","last_clean":"2024-09-21T03:41:50.534523+0000","last_became_active":"2024-09-21T03:40:29.347574+0000","last_became_peered":"2024-09-21T03:40:29.347574+0000","last_unstale":"2024-09-21T03:41:50.534523+0000","last_undegraded":"2024-09-21T03:41:50.534523+0000","last_fullsized":"2024-09-21T03:41:50.534523+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:10.142931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.488011+0000","last_change":"2024-09-21T03:40:51.487492+0000","last_active":"2024-09-21T03:40:51.488011+0000","last_peered":"2024-09-21T03:40:51.488011+0000","last_clean":"2024-09-21T03:40:51.488011+0000","last_became_active":"2024-09-21T03:40:51.472023+0000","last_became_peered":"2024-09-21T03:40:51.472023+0000","last_unstale":"2024-09-21T03:40:51.488011+0000","last_undegraded":"2024-09-21T03:40:51.488011+0000","last_fullsized":"2024-09-21T03:40:51.488011+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:40.164056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.533879+0000","last_change":"2024-09-21T03:40:29.332539+0000","last_active":"2024-09-21T03:41:50.533879+0000","last_peered":"2024-09-21T03:41:50.533879+0000","last_clean":"2024-09-21T03:41:50.533879+0000","last_became_active":"2024-09-21T03:40:29.332178+0000","last_became_peered":"2024-09-21T03:40:29.332178+0000","last_unstale":"2024-09-21T03:41:50.533879+0000","last_undegraded":"2024-09-21T03:41:50.533879+0000","last_fullsized":"2024-09-21T03:41:50.533879+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:00.354558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'13","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:42:19.356061+0000","last_change":"2024-09-21T03:40:27.313942+0000","last_active":"2024-09-21T03:42:19.356061+0000","last_peered":"2024-09-21T03:42:19.356061+0000","last_clean":"2024-09-21T03:42:19.356061+0000","last_became_active":"2024-09-21T03:40:27.313541+0000","last_became_peered":"2024-09-21T03:40:27.313541+0000","last_unstale":"2024-09-21T03:42:19.356061+0000","last_undegraded":"2024-09-21T03:42:19.356061+0000","last_fullsized":"2024-09-21T03:42:19.356061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:58.572154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.532002+0000","last_change":"2024-09-21T03:40:29.330712+0000","last_active":"2024-09-21T03:41:50.532002+0000","last_peered":"2024-09-21T03:41:50.532002+0000","last_clean":"2024-09-21T03:41:50.532002+0000","last_became_active":"2024-09-21T03:40:29.330345+0000","last_became_peered":"2024-09-21T03:40:29.330345+0000","last_unstale":"2024-09-21T03:41:50.532002+0000","last_undegraded":"2024-09-21T03:41:50.532002+0000","last_fullsized":"2024-09-21T03:41:50.532002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:54.225288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.635760+0000","last_change":"2024-09-21T03:40:27.719239+0000","last_active":"2024-09-21T03:40:51.635760+0000","last_peered":"2024-09-21T03:40:51.635760+0000","last_clean":"2024-09-21T03:40:51.635760+0000","last_became_active":"2024-09-21T03:40:27.718834+0000","last_became_peered":"2024-09-21T03:40:27.718834+0000","last_unstale":"2024-09-21T03:40:51.635760+0000","last_undegraded":"2024-09-21T03:40:51.635760+0000","last_fullsized":"2024-09-21T03:40:51.635760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:47.357723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.541218+0000","last_change":"2024-09-21T03:40:29.338470+0000","last_active":"2024-09-21T03:41:50.541218+0000","last_peered":"2024-09-21T03:41:50.541218+0000","last_clean":"2024-09-21T03:41:50.541218+0000","last_became_active":"2024-09-21T03:40:29.338114+0000","last_became_peered":"2024-09-21T03:40:29.338114+0000","last_unstale":"2024-09-21T03:41:50.541218+0000","last_undegraded":"2024-09-21T03:41:50.541218+0000","last_fullsized":"2024-09-21T03:41:50.541218+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:23.715773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467223+0000","last_change":"2024-09-21T03:40:27.525544+0000","last_active":"2024-09-21T03:40:51.467223+0000","last_peered":"2024-09-21T03:40:51.467223+0000","last_clean":"2024-09-21T03:40:51.467223+0000","last_became_active":"2024-09-21T03:40:27.525196+0000","last_became_peered":"2024-09-21T03:40:27.525196+0000","last_unstale":"2024-09-21T03:40:51.467223+0000","last_undegraded":"2024-09-21T03:40:51.467223+0000","last_fullsized":"2024-09-21T03:40:51.467223+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:57:07.882351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.494418+0000","last_change":"2024-09-21T03:40:29.337774+0000","last_active":"2024-09-21T03:41:50.494418+0000","last_peered":"2024-09-21T03:41:50.494418+0000","last_clean":"2024-09-21T03:41:50.494418+0000","last_became_active":"2024-09-21T03:40:29.337393+0000","last_became_peered":"2024-09-21T03:40:29.337393+0000","last_unstale":"2024-09-21T03:41:50.494418+0000","last_undegraded":"2024-09-21T03:41:50.494418+0000","last_fullsized":"2024-09-21T03:41:50.494418+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:20.471042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463610+0000","last_change":"2024-09-21T03:40:27.312953+0000","last_active":"2024-09-21T03:40:51.463610+0000","last_peered":"2024-09-21T03:40:51.463610+0000","last_clean":"2024-09-21T03:40:51.463610+0000","last_became_active":"2024-09-21T03:40:27.312603+0000","last_became_peered":"2024-09-21T03:40:27.312603+0000","last_unstale":"2024-09-21T03:40:51.463610+0000","last_undegraded":"2024-09-21T03:40:51.463610+0000","last_fullsized":"2024-09-21T03:40:51.463610+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:18.102812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.533801+0000","last_change":"2024-09-21T03:40:29.330802+0000","last_active":"2024-09-21T03:41:50.533801+0000","last_peered":"2024-09-21T03:41:50.533801+0000","last_clean":"2024-09-21T03:41:50.533801+0000","last_became_active":"2024-09-21T03:40:29.330426+0000","last_became_peered":"2024-09-21T03:40:29.330426+0000","last_unstale":"2024-09-21T03:41:50.533801+0000","last_undegraded":"2024-09-21T03:41:50.533801+0000","last_fullsized":"2024-09-21T03:41:50.533801+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:08:18.552649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467619+0000","last_change":"2024-09-21T03:40:27.319829+0000","last_active":"2024-09-21T03:40:51.467619+0000","last_peered":"2024-09-21T03:40:51.467619+0000","last_clean":"2024-09-21T03:40:51.467619+0000","last_became_active":"2024-09-21T03:40:27.319410+0000","last_became_peered":"2024-09-21T03:40:27.319410+0000","last_unstale":"2024-09-21T03:40:51.467619+0000","last_undegraded":"2024-09-21T03:40:51.467619+0000","last_fullsized":"2024-09-21T03:40:51.467619+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:56.475721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.535764+0000","last_change":"2024-09-21T03:40:29.335897+0000","last_active":"2024-09-21T03:41:50.535764+0000","last_peered":"2024-09-21T03:41:50.535764+0000","last_clean":"2024-09-21T03:41:50.535764+0000","last_became_active":"2024-09-21T03:40:29.335549+0000","last_became_peered":"2024-09-21T03:40:29.335549+0000","last_unstale":"2024-09-21T03:41:50.535764+0000","last_undegraded":"2024-09-21T03:41:50.535764+0000","last_fullsized":"2024-09-21T03:41:50.535764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:01.401766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470266+0000","last_change":"2024-09-21T03:40:27.316678+0000","last_active":"2024-09-21T03:40:51.470266+0000","last_peered":"2024-09-21T03:40:51.470266+0000","last_clean":"2024-09-21T03:40:51.470266+0000","last_became_active":"2024-09-21T03:40:27.315980+0000","last_became_peered":"2024-09-21T03:40:27.315980+0000","last_unstale":"2024-09-21T03:40:51.470266+0000","last_undegraded":"2024-09-21T03:40:51.470266+0000","last_fullsized":"2024-09-21T03:40:51.470266+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:56.280077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.549639+0000","last_change":"2024-09-21T03:40:29.333638+0000","last_active":"2024-09-21T03:41:50.549639+0000","last_peered":"2024-09-21T03:41:50.549639+0000","last_clean":"2024-09-21T03:41:50.549639+0000","last_became_active":"2024-09-21T03:40:29.333268+0000","last_became_peered":"2024-09-21T03:40:29.333268+0000","last_unstale":"2024-09-21T03:41:50.549639+0000","last_undegraded":"2024-09-21T03:41:50.549639+0000","last_fullsized":"2024-09-21T03:41:50.549639+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:35:23.346837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.543689+0000","last_change":"2024-09-21T03:40:29.342199+0000","last_active":"2024-09-21T03:41:50.543689+0000","last_peered":"2024-09-21T03:41:50.543689+0000","last_clean":"2024-09-21T03:41:50.543689+0000","last_became_active":"2024-09-21T03:40:29.341675+0000","last_became_peered":"2024-09-21T03:40:29.341675+0000","last_unstale":"2024-09-21T03:41:50.543689+0000","last_undegraded":"2024-09-21T03:41:50.543689+0000","last_fullsized":"2024-09-21T03:41:50.543689+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:01.439058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470666+0000","last_change":"2024-09-21T03:40:27.319327+0000","last_active":"2024-09-21T03:40:51.470666+0000","last_peered":"2024-09-21T03:40:51.470666+0000","last_clean":"2024-09-21T03:40:51.470666+0000","last_became_active":"2024-09-21T03:40:27.318773+0000","last_became_peered":"2024-09-21T03:40:27.318773+0000","last_unstale":"2024-09-21T03:40:51.470666+0000","last_undegraded":"2024-09-21T03:40:51.470666+0000","last_fullsized":"2024-09-21T03:40:51.470666+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:42.444238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.550352+0000","last_change":"2024-09-21T03:40:29.336121+0000","last_active":"2024-09-21T03:41:50.550352+0000","last_peered":"2024-09-21T03:41:50.550352+0000","last_clean":"2024-09-21T03:41:50.550352+0000","last_became_active":"2024-09-21T03:40:29.333523+0000","last_became_peered":"2024-09-21T03:40:29.333523+0000","last_unstale":"2024-09-21T03:41:50.550352+0000","last_undegraded":"2024-09-21T03:41:50.550352+0000","last_fullsized":"2024-09-21T03:41:50.550352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:29.303410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470911+0000","last_change":"2024-09-21T03:40:27.316523+0000","last_active":"2024-09-21T03:40:51.470911+0000","last_peered":"2024-09-21T03:40:51.470911+0000","last_clean":"2024-09-21T03:40:51.470911+0000","last_became_active":"2024-09-21T03:40:27.316099+0000","last_became_peered":"2024-09-21T03:40:27.316099+0000","last_unstale":"2024-09-21T03:40:51.470911+0000","last_undegraded":"2024-09-21T03:40:51.470911+0000","last_fullsized":"2024-09-21T03:40:51.470911+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:44.091964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.545758+0000","last_change":"2024-09-21T03:40:29.333887+0000","last_active":"2024-09-21T03:41:50.545758+0000","last_peered":"2024-09-21T03:41:50.545758+0000","last_clean":"2024-09-21T03:41:50.545758+0000","last_became_active":"2024-09-21T03:40:29.333465+0000","last_became_peered":"2024-09-21T03:40:29.333465+0000","last_unstale":"2024-09-21T03:41:50.545758+0000","last_undegraded":"2024-09-21T03:41:50.545758+0000","last_fullsized":"2024-09-21T03:41:50.545758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:46.788188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464003+0000","last_change":"2024-09-21T03:40:27.525812+0000","last_active":"2024-09-21T03:40:51.464003+0000","last_peered":"2024-09-21T03:40:51.464003+0000","last_clean":"2024-09-21T03:40:51.464003+0000","last_became_active":"2024-09-21T03:40:27.525391+0000","last_became_peered":"2024-09-21T03:40:27.525391+0000","last_unstale":"2024-09-21T03:40:51.464003+0000","last_undegraded":"2024-09-21T03:40:51.464003+0000","last_fullsized":"2024-09-21T03:40:51.464003+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:07.856442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.534430+0000","last_change":"2024-09-21T03:40:29.339079+0000","last_active":"2024-09-21T03:41:50.534430+0000","last_peered":"2024-09-21T03:41:50.534430+0000","last_clean":"2024-09-21T03:41:50.534430+0000","last_became_active":"2024-09-21T03:40:29.338737+0000","last_became_peered":"2024-09-21T03:40:29.338737+0000","last_unstale":"2024-09-21T03:41:50.534430+0000","last_undegraded":"2024-09-21T03:41:50.534430+0000","last_fullsized":"2024-09-21T03:41:50.534430+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:14.863848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470639+0000","last_change":"2024-09-21T03:40:27.316037+0000","last_active":"2024-09-21T03:40:51.470639+0000","last_peered":"2024-09-21T03:40:51.470639+0000","last_clean":"2024-09-21T03:40:51.470639+0000","last_became_active":"2024-09-21T03:40:27.315604+0000","last_became_peered":"2024-09-21T03:40:27.315604+0000","last_unstale":"2024-09-21T03:40:51.470639+0000","last_undegraded":"2024-09-21T03:40:51.470639+0000","last_fullsized":"2024-09-21T03:40:51.470639+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:48.176252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74664,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":641,"num_read_kb":402,"num_write":178,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1147,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":217767,"data_compressed":5679,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247442,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743460,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":416171,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906985,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":1077649,"data_compressed":43442,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070511,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":416273,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266739,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":839680,"data_stored":416059,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430264,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":1009046,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593790,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":415662,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790019,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":1008339,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986248,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":417253,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":415973,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":917504,"data_stored":479781,"data_compressed":7630,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":484804,"data_compressed":7630,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705756,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":860160,"data_stored":416933,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34191,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34191,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":69349,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64634,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":71709,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:42:24.563 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-21T03:42:24.563 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:42:24.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.707+0000 7fa445e1f640 1 -- 172.21.15.84:0/510951021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa440108c20 msgr2=0x7fa44010f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:24.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.707+0000 7fa445e1f640 1 --2- 172.21.15.84:0/510951021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa440108c20 0x7fa44010f450 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa438009ca0 tx=0x7fa43802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.707+0000 7fa445e1f640 1 -- 172.21.15.84:0/510951021 shutdown_connections 2024-09-21T03:42:24.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.707+0000 7fa445e1f640 1 --2- 172.21.15.84:0/510951021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa440108c20 0x7fa44010f450 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.707+0000 7fa445e1f640 1 --2- 172.21.15.84:0/510951021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4401082d0 0x7fa4401086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.707+0000 7fa445e1f640 1 --2- 172.21.15.84:0/510951021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4401029a0 0x7fa440102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.707+0000 7fa445e1f640 1 -- 172.21.15.84:0/510951021 >> 172.21.15.84:0/510951021 conn(0x7fa4400fe3e0 msgr2=0x7fa440100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.707+0000 7fa445e1f640 1 -- 172.21.15.84:0/510951021 shutdown_connections 2024-09-21T03:42:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.707+0000 7fa445e1f640 1 -- 172.21.15.84:0/510951021 wait complete. 2024-09-21T03:42:24.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.707+0000 7fa445e1f640 1 Processor -- start 2024-09-21T03:42:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.708+0000 7fa445e1f640 1 -- start start 2024-09-21T03:42:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.708+0000 7fa445e1f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4401029a0 0x7fa4401992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.708+0000 7fa445e1f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4401082d0 0x7fa440199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.708+0000 7fa445e1f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa440108c20 0x7fa44019ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.708+0000 7fa445e1f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa4401128e0 con 0x7fa4401029a0 2024-09-21T03:42:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.708+0000 7fa445e1f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa440112760 con 0x7fa4401082d0 2024-09-21T03:42:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.708+0000 7fa445e1f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa440112a60 con 0x7fa440108c20 2024-09-21T03:42:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.708+0000 7fa43f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4401029a0 0x7fa4401992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.708+0000 7fa43f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4401029a0 0x7fa4401992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33698/0 (socket says 172.21.15.84:33698) 2024-09-21T03:42:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.708+0000 7fa43f7fe640 1 -- 172.21.15.84:0/676359127 learned_addr learned my addr 172.21.15.84:0/676359127 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.708+0000 7fa43effd640 1 --2- 172.21.15.84:0/676359127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4401082d0 0x7fa440199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:24.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.708+0000 7fa43ffff640 1 --2- 172.21.15.84:0/676359127 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa440108c20 0x7fa44019ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.708+0000 7fa43f7fe640 1 -- 172.21.15.84:0/676359127 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa440108c20 msgr2=0x7fa44019ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.708+0000 7fa43f7fe640 1 --2- 172.21.15.84:0/676359127 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa440108c20 0x7fa44019ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.708+0000 7fa43f7fe640 1 -- 172.21.15.84:0/676359127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4401082d0 msgr2=0x7fa440199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.708+0000 7fa43f7fe640 1 --2- 172.21.15.84:0/676359127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4401082d0 0x7fa440199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.708+0000 7fa43f7fe640 1 -- 172.21.15.84:0/676359127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa44019f140 con 0x7fa4401029a0 2024-09-21T03:42:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.708+0000 7fa43effd640 1 --2- 172.21.15.84:0/676359127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4401082d0 0x7fa440199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.709+0000 7fa43f7fe640 1 --2- 172.21.15.84:0/676359127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4401029a0 0x7fa4401992a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa43000d770 tx=0x7fa43000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.709+0000 7fa43cff9640 1 -- 172.21.15.84:0/676359127 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa430017070 con 0x7fa4401029a0 2024-09-21T03:42:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.709+0000 7fa445e1f640 1 -- 172.21.15.84:0/676359127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa44019f430 con 0x7fa4401029a0 2024-09-21T03:42:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.709+0000 7fa43cff9640 1 -- 172.21.15.84:0/676359127 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4300054d0 con 0x7fa4401029a0 2024-09-21T03:42:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.709+0000 7fa43cff9640 1 -- 172.21.15.84:0/676359127 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa430004c30 con 0x7fa4401029a0 2024-09-21T03:42:24.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.709+0000 7fa445e1f640 1 -- 172.21.15.84:0/676359127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4401a5c50 con 0x7fa4401029a0 2024-09-21T03:42:24.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.710+0000 7fa445e1f640 1 -- 172.21.15.84:0/676359127 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa440103c10 con 0x7fa4401029a0 2024-09-21T03:42:24.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.711+0000 7fa43cff9640 1 -- 172.21.15.84:0/676359127 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7fa430004e10 con 0x7fa4401029a0 2024-09-21T03:42:24.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.712+0000 7fa43cff9640 1 --2- 172.21.15.84:0/676359127 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4280b65f0 0x7fa4280b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:24.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.712+0000 7fa43effd640 1 --2- 172.21.15.84:0/676359127 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4280b65f0 0x7fa4280b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:24.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.712+0000 7fa43cff9640 1 -- 172.21.15.84:0/676359127 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa4300e7140 con 0x7fa4401029a0 2024-09-21T03:42:24.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.712+0000 7fa43effd640 1 --2- 172.21.15.84:0/676359127 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4280b65f0 0x7fa4280b8b00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa440101c30 tx=0x7fa43400a5c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:24.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.716+0000 7fa43cff9640 1 -- 172.21.15.84:0/676359127 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa4300ad7d0 con 0x7fa4401029a0 2024-09-21T03:42:24.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.894+0000 7fa445e1f640 1 -- 172.21.15.84:0/676359127 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa440063800 con 0x7fa4280b65f0 2024-09-21T03:42:24.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.898+0000 7fa43cff9640 1 -- 172.21.15.84:0/676359127 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259099 (secure 0 0 0) 0x7fa440063800 con 0x7fa4280b65f0 2024-09-21T03:42:24.903 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:42:24.904 INFO:teuthology.orchestra.run.smithi084.stderr:dumped all 2024-09-21T03:42:24.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.902+0000 7fa445e1f640 1 -- 172.21.15.84:0/676359127 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4280b65f0 msgr2=0x7fa4280b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:24.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.902+0000 7fa445e1f640 1 --2- 172.21.15.84:0/676359127 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4280b65f0 0x7fa4280b8b00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa440101c30 tx=0x7fa43400a5c0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.902+0000 7fa445e1f640 1 -- 172.21.15.84:0/676359127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4401029a0 msgr2=0x7fa4401992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:24.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.902+0000 7fa445e1f640 1 --2- 172.21.15.84:0/676359127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4401029a0 0x7fa4401992a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa43000d770 tx=0x7fa43000dc30 comp rx=0 tx=0).stop 2024-09-21T03:42:24.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.902+0000 7fa445e1f640 1 -- 172.21.15.84:0/676359127 shutdown_connections 2024-09-21T03:42:24.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.902+0000 7fa445e1f640 1 --2- 172.21.15.84:0/676359127 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4280b65f0 0x7fa4280b8b00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.902+0000 7fa445e1f640 1 --2- 172.21.15.84:0/676359127 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa440108c20 0x7fa44019ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.902+0000 7fa445e1f640 1 --2- 172.21.15.84:0/676359127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4401082d0 0x7fa440199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.902+0000 7fa445e1f640 1 --2- 172.21.15.84:0/676359127 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4401029a0 0x7fa4401992a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.902+0000 7fa445e1f640 1 -- 172.21.15.84:0/676359127 >> 172.21.15.84:0/676359127 conn(0x7fa4400fe3e0 msgr2=0x7fa4401058a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.902+0000 7fa445e1f640 1 -- 172.21.15.84:0/676359127 shutdown_connections 2024-09-21T03:42:24.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:24.902+0000 7fa445e1f640 1 -- 172.21.15.84:0/676359127 wait complete. 2024-09-21T03:42:24.915 INFO:teuthology.orchestra.run.smithi084.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-09-21T03:42:24.307187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665266,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":722,"num_read_kb":471,"num_write":303,"num_write_kb":2285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":2952987,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":745,"ondisk_log_size":745,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384536,"kb_used_data":10328,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124557288,"statfs":{"total":1151940427776,"available":1151546662912,"internally_reserved":0,"allocated":10575872,"data_stored":6973943,"data_compressed":181959,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19142,"internal_metadata":382973242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6924,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":48,"num_write":12,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003318"},"pg_stats":[{"pgid":"3.3f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.547556+0000","last_change":"2024-09-21T03:40:29.337467+0000","last_active":"2024-09-21T03:41:50.547556+0000","last_peered":"2024-09-21T03:41:50.547556+0000","last_clean":"2024-09-21T03:41:50.547556+0000","last_became_active":"2024-09-21T03:40:29.337102+0000","last_became_peered":"2024-09-21T03:40:29.337102+0000","last_unstale":"2024-09-21T03:41:50.547556+0000","last_undegraded":"2024-09-21T03:41:50.547556+0000","last_fullsized":"2024-09-21T03:41:50.547556+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:55:53.798977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.532013+0000","last_change":"2024-09-21T03:40:29.336446+0000","last_active":"2024-09-21T03:41:50.532013+0000","last_peered":"2024-09-21T03:41:50.532013+0000","last_clean":"2024-09-21T03:41:50.532013+0000","last_became_active":"2024-09-21T03:40:29.336081+0000","last_became_peered":"2024-09-21T03:40:29.336081+0000","last_unstale":"2024-09-21T03:41:50.532013+0000","last_undegraded":"2024-09-21T03:41:50.532013+0000","last_fullsized":"2024-09-21T03:41:50.532013+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:38:23.892700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.545127+0000","last_change":"2024-09-21T03:40:29.342861+0000","last_active":"2024-09-21T03:41:50.545127+0000","last_peered":"2024-09-21T03:41:50.545127+0000","last_clean":"2024-09-21T03:41:50.545127+0000","last_became_active":"2024-09-21T03:40:29.342111+0000","last_became_peered":"2024-09-21T03:40:29.342111+0000","last_unstale":"2024-09-21T03:41:50.545127+0000","last_undegraded":"2024-09-21T03:41:50.545127+0000","last_fullsized":"2024-09-21T03:41:50.545127+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:01:30.012195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.538824+0000","last_change":"2024-09-21T03:40:29.339822+0000","last_active":"2024-09-21T03:41:50.538824+0000","last_peered":"2024-09-21T03:41:50.538824+0000","last_clean":"2024-09-21T03:41:50.538824+0000","last_became_active":"2024-09-21T03:40:29.339126+0000","last_became_peered":"2024-09-21T03:40:29.339126+0000","last_unstale":"2024-09-21T03:41:50.538824+0000","last_undegraded":"2024-09-21T03:41:50.538824+0000","last_fullsized":"2024-09-21T03:41:50.538824+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:00:44.874344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.522428+0000","last_change":"2024-09-21T03:40:29.333683+0000","last_active":"2024-09-21T03:41:50.522428+0000","last_peered":"2024-09-21T03:41:50.522428+0000","last_clean":"2024-09-21T03:41:50.522428+0000","last_became_active":"2024-09-21T03:40:29.333329+0000","last_became_peered":"2024-09-21T03:40:29.333329+0000","last_unstale":"2024-09-21T03:41:50.522428+0000","last_undegraded":"2024-09-21T03:41:50.522428+0000","last_fullsized":"2024-09-21T03:41:50.522428+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:16:42.655732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.527562+0000","last_change":"2024-09-21T03:40:29.346193+0000","last_active":"2024-09-21T03:41:50.527562+0000","last_peered":"2024-09-21T03:41:50.527562+0000","last_clean":"2024-09-21T03:41:50.527562+0000","last_became_active":"2024-09-21T03:40:29.345808+0000","last_became_peered":"2024-09-21T03:40:29.345808+0000","last_unstale":"2024-09-21T03:41:50.527562+0000","last_undegraded":"2024-09-21T03:41:50.527562+0000","last_fullsized":"2024-09-21T03:41:50.527562+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:59.621904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.535861+0000","last_change":"2024-09-21T03:40:29.337782+0000","last_active":"2024-09-21T03:41:50.535861+0000","last_peered":"2024-09-21T03:41:50.535861+0000","last_clean":"2024-09-21T03:41:50.535861+0000","last_became_active":"2024-09-21T03:40:29.337390+0000","last_became_peered":"2024-09-21T03:40:29.337390+0000","last_unstale":"2024-09-21T03:41:50.535861+0000","last_undegraded":"2024-09-21T03:41:50.535861+0000","last_fullsized":"2024-09-21T03:41:50.535861+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:18:49.924375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.535660+0000","last_change":"2024-09-21T03:40:29.340821+0000","last_active":"2024-09-21T03:41:50.535660+0000","last_peered":"2024-09-21T03:41:50.535660+0000","last_clean":"2024-09-21T03:41:50.535660+0000","last_became_active":"2024-09-21T03:40:29.340465+0000","last_became_peered":"2024-09-21T03:40:29.340465+0000","last_unstale":"2024-09-21T03:41:50.535660+0000","last_undegraded":"2024-09-21T03:41:50.535660+0000","last_fullsized":"2024-09-21T03:41:50.535660+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:18.600335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.541949+0000","last_change":"2024-09-21T03:40:29.345218+0000","last_active":"2024-09-21T03:41:50.541949+0000","last_peered":"2024-09-21T03:41:50.541949+0000","last_clean":"2024-09-21T03:41:50.541949+0000","last_became_active":"2024-09-21T03:40:29.344862+0000","last_became_peered":"2024-09-21T03:40:29.344862+0000","last_unstale":"2024-09-21T03:41:50.541949+0000","last_undegraded":"2024-09-21T03:41:50.541949+0000","last_fullsized":"2024-09-21T03:41:50.541949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:53.570489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"77'16","reported_seq":41,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.528972+0000","last_change":"2024-09-21T03:40:51.471622+0000","last_active":"2024-09-21T03:41:50.528972+0000","last_peered":"2024-09-21T03:41:50.528972+0000","last_clean":"2024-09-21T03:41:50.528972+0000","last_became_active":"2024-09-21T03:40:51.471276+0000","last_became_peered":"2024-09-21T03:40:51.471276+0000","last_unstale":"2024-09-21T03:41:50.528972+0000","last_undegraded":"2024-09-21T03:41:50.528972+0000","last_fullsized":"2024-09-21T03:41:50.528972+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:46:38.030634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.548357+0000","last_change":"2024-09-21T03:40:29.338353+0000","last_active":"2024-09-21T03:41:50.548357+0000","last_peered":"2024-09-21T03:41:50.548357+0000","last_clean":"2024-09-21T03:41:50.548357+0000","last_became_active":"2024-09-21T03:40:29.337976+0000","last_became_peered":"2024-09-21T03:40:29.337976+0000","last_unstale":"2024-09-21T03:41:50.548357+0000","last_undegraded":"2024-09-21T03:41:50.548357+0000","last_fullsized":"2024-09-21T03:41:50.548357+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:28:10.182045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.530870+0000","last_change":"2024-09-21T03:40:29.343617+0000","last_active":"2024-09-21T03:41:50.530870+0000","last_peered":"2024-09-21T03:41:50.530870+0000","last_clean":"2024-09-21T03:41:50.530870+0000","last_became_active":"2024-09-21T03:40:29.342586+0000","last_became_peered":"2024-09-21T03:40:29.342586+0000","last_unstale":"2024-09-21T03:41:50.530870+0000","last_undegraded":"2024-09-21T03:41:50.530870+0000","last_fullsized":"2024-09-21T03:41:50.530870+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:04:06.823802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.533573+0000","last_change":"2024-09-21T03:40:29.338633+0000","last_active":"2024-09-21T03:41:50.533573+0000","last_peered":"2024-09-21T03:41:50.533573+0000","last_clean":"2024-09-21T03:41:50.533573+0000","last_became_active":"2024-09-21T03:40:29.337502+0000","last_became_peered":"2024-09-21T03:40:29.337502+0000","last_unstale":"2024-09-21T03:41:50.533573+0000","last_undegraded":"2024-09-21T03:41:50.533573+0000","last_fullsized":"2024-09-21T03:41:50.533573+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:16:04.121275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.534492+0000","last_change":"2024-09-21T03:40:29.335774+0000","last_active":"2024-09-21T03:41:50.534492+0000","last_peered":"2024-09-21T03:41:50.534492+0000","last_clean":"2024-09-21T03:41:50.534492+0000","last_became_active":"2024-09-21T03:40:29.335452+0000","last_became_peered":"2024-09-21T03:40:29.335452+0000","last_unstale":"2024-09-21T03:41:50.534492+0000","last_undegraded":"2024-09-21T03:41:50.534492+0000","last_fullsized":"2024-09-21T03:41:50.534492+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:37.427015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.540744+0000","last_change":"2024-09-21T03:40:29.342874+0000","last_active":"2024-09-21T03:41:50.540744+0000","last_peered":"2024-09-21T03:41:50.540744+0000","last_clean":"2024-09-21T03:41:50.540744+0000","last_became_active":"2024-09-21T03:40:29.342343+0000","last_became_peered":"2024-09-21T03:40:29.342343+0000","last_unstale":"2024-09-21T03:41:50.540744+0000","last_undegraded":"2024-09-21T03:41:50.540744+0000","last_fullsized":"2024-09-21T03:41:50.540744+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:52.473608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.550793+0000","last_change":"2024-09-21T03:40:29.339231+0000","last_active":"2024-09-21T03:41:50.550793+0000","last_peered":"2024-09-21T03:41:50.550793+0000","last_clean":"2024-09-21T03:41:50.550793+0000","last_became_active":"2024-09-21T03:40:29.338724+0000","last_became_peered":"2024-09-21T03:40:29.338724+0000","last_unstale":"2024-09-21T03:41:50.550793+0000","last_undegraded":"2024-09-21T03:41:50.550793+0000","last_fullsized":"2024-09-21T03:41:50.550793+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:25:55.592713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.547802+0000","last_change":"2024-09-21T03:40:29.338480+0000","last_active":"2024-09-21T03:41:50.547802+0000","last_peered":"2024-09-21T03:41:50.547802+0000","last_clean":"2024-09-21T03:41:50.547802+0000","last_became_active":"2024-09-21T03:40:29.338092+0000","last_became_peered":"2024-09-21T03:40:29.338092+0000","last_unstale":"2024-09-21T03:41:50.547802+0000","last_undegraded":"2024-09-21T03:41:50.547802+0000","last_fullsized":"2024-09-21T03:41:50.547802+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:25.557502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.545250+0000","last_change":"2024-09-21T03:40:29.335557+0000","last_active":"2024-09-21T03:41:50.545250+0000","last_peered":"2024-09-21T03:41:50.545250+0000","last_clean":"2024-09-21T03:41:50.545250+0000","last_became_active":"2024-09-21T03:40:29.335214+0000","last_became_peered":"2024-09-21T03:40:29.335214+0000","last_unstale":"2024-09-21T03:41:50.545250+0000","last_undegraded":"2024-09-21T03:41:50.545250+0000","last_fullsized":"2024-09-21T03:41:50.545250+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:21.395995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.530848+0000","last_change":"2024-09-21T03:40:29.333041+0000","last_active":"2024-09-21T03:41:50.530848+0000","last_peered":"2024-09-21T03:41:50.530848+0000","last_clean":"2024-09-21T03:41:50.530848+0000","last_became_active":"2024-09-21T03:40:29.332187+0000","last_became_peered":"2024-09-21T03:40:29.332187+0000","last_unstale":"2024-09-21T03:41:50.530848+0000","last_undegraded":"2024-09-21T03:41:50.530848+0000","last_fullsized":"2024-09-21T03:41:50.530848+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:40:03.253594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.529370+0000","last_change":"2024-09-21T03:40:29.339152+0000","last_active":"2024-09-21T03:41:50.529370+0000","last_peered":"2024-09-21T03:41:50.529370+0000","last_clean":"2024-09-21T03:41:50.529370+0000","last_became_active":"2024-09-21T03:40:29.338722+0000","last_became_peered":"2024-09-21T03:40:29.338722+0000","last_unstale":"2024-09-21T03:41:50.529370+0000","last_undegraded":"2024-09-21T03:41:50.529370+0000","last_fullsized":"2024-09-21T03:41:50.529370+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:49:32.143498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.546810+0000","last_change":"2024-09-21T03:40:29.329169+0000","last_active":"2024-09-21T03:41:50.546810+0000","last_peered":"2024-09-21T03:41:50.546810+0000","last_clean":"2024-09-21T03:41:50.546810+0000","last_became_active":"2024-09-21T03:40:29.328805+0000","last_became_peered":"2024-09-21T03:40:29.328805+0000","last_unstale":"2024-09-21T03:41:50.546810+0000","last_undegraded":"2024-09-21T03:41:50.546810+0000","last_fullsized":"2024-09-21T03:41:50.546810+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:13.725038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.550737+0000","last_change":"2024-09-21T03:40:29.336699+0000","last_active":"2024-09-21T03:41:50.550737+0000","last_peered":"2024-09-21T03:41:50.550737+0000","last_clean":"2024-09-21T03:41:50.550737+0000","last_became_active":"2024-09-21T03:40:29.333649+0000","last_became_peered":"2024-09-21T03:40:29.333649+0000","last_unstale":"2024-09-21T03:41:50.550737+0000","last_undegraded":"2024-09-21T03:41:50.550737+0000","last_fullsized":"2024-09-21T03:41:50.550737+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:49.418205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.531010+0000","last_change":"2024-09-21T03:40:29.337936+0000","last_active":"2024-09-21T03:41:50.531010+0000","last_peered":"2024-09-21T03:41:50.531010+0000","last_clean":"2024-09-21T03:41:50.531010+0000","last_became_active":"2024-09-21T03:40:29.337521+0000","last_became_peered":"2024-09-21T03:40:29.337521+0000","last_unstale":"2024-09-21T03:41:50.531010+0000","last_undegraded":"2024-09-21T03:41:50.531010+0000","last_fullsized":"2024-09-21T03:41:50.531010+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:09.223634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.532926+0000","last_change":"2024-09-21T03:40:29.336866+0000","last_active":"2024-09-21T03:41:50.532926+0000","last_peered":"2024-09-21T03:41:50.532926+0000","last_clean":"2024-09-21T03:41:50.532926+0000","last_became_active":"2024-09-21T03:40:29.336447+0000","last_became_peered":"2024-09-21T03:40:29.336447+0000","last_unstale":"2024-09-21T03:41:50.532926+0000","last_undegraded":"2024-09-21T03:41:50.532926+0000","last_fullsized":"2024-09-21T03:41:50.532926+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:21:53.487678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.530414+0000","last_change":"2024-09-21T03:40:29.333666+0000","last_active":"2024-09-21T03:41:50.530414+0000","last_peered":"2024-09-21T03:41:50.530414+0000","last_clean":"2024-09-21T03:41:50.530414+0000","last_became_active":"2024-09-21T03:40:29.333248+0000","last_became_peered":"2024-09-21T03:40:29.333248+0000","last_unstale":"2024-09-21T03:41:50.530414+0000","last_undegraded":"2024-09-21T03:41:50.530414+0000","last_fullsized":"2024-09-21T03:41:50.530414+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:14:54.721926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.544878+0000","last_change":"2024-09-21T03:40:29.342165+0000","last_active":"2024-09-21T03:41:50.544878+0000","last_peered":"2024-09-21T03:41:50.544878+0000","last_clean":"2024-09-21T03:41:50.544878+0000","last_became_active":"2024-09-21T03:40:29.341744+0000","last_became_peered":"2024-09-21T03:40:29.341744+0000","last_unstale":"2024-09-21T03:41:50.544878+0000","last_undegraded":"2024-09-21T03:41:50.544878+0000","last_fullsized":"2024-09-21T03:41:50.544878+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:05:04.641927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.530032+0000","last_change":"2024-09-21T03:40:29.341728+0000","last_active":"2024-09-21T03:41:50.530032+0000","last_peered":"2024-09-21T03:41:50.530032+0000","last_clean":"2024-09-21T03:41:50.530032+0000","last_became_active":"2024-09-21T03:40:29.339252+0000","last_became_peered":"2024-09-21T03:40:29.339252+0000","last_unstale":"2024-09-21T03:41:50.530032+0000","last_undegraded":"2024-09-21T03:41:50.530032+0000","last_fullsized":"2024-09-21T03:41:50.530032+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:48:53.618128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"77'4","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.536386+0000","last_change":"2024-09-21T03:40:29.326893+0000","last_active":"2024-09-21T03:41:50.536386+0000","last_peered":"2024-09-21T03:41:50.536386+0000","last_clean":"2024-09-21T03:41:50.536386+0000","last_became_active":"2024-09-21T03:40:29.326427+0000","last_became_peered":"2024-09-21T03:40:29.326427+0000","last_unstale":"2024-09-21T03:41:50.536386+0000","last_undegraded":"2024-09-21T03:41:50.536386+0000","last_fullsized":"2024-09-21T03:41:50.536386+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:41.036179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.540804+0000","last_change":"2024-09-21T03:40:29.340410+0000","last_active":"2024-09-21T03:41:50.540804+0000","last_peered":"2024-09-21T03:41:50.540804+0000","last_clean":"2024-09-21T03:41:50.540804+0000","last_became_active":"2024-09-21T03:40:29.340062+0000","last_became_peered":"2024-09-21T03:40:29.340062+0000","last_unstale":"2024-09-21T03:41:50.540804+0000","last_undegraded":"2024-09-21T03:41:50.540804+0000","last_fullsized":"2024-09-21T03:41:50.540804+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:44.971145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.522052+0000","last_change":"2024-09-21T03:40:29.333387+0000","last_active":"2024-09-21T03:41:50.522052+0000","last_peered":"2024-09-21T03:41:50.522052+0000","last_clean":"2024-09-21T03:41:50.522052+0000","last_became_active":"2024-09-21T03:40:29.332511+0000","last_became_peered":"2024-09-21T03:40:29.332511+0000","last_unstale":"2024-09-21T03:41:50.522052+0000","last_undegraded":"2024-09-21T03:41:50.522052+0000","last_fullsized":"2024-09-21T03:41:50.522052+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:39:24.513267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"77'12","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.522801+0000","last_change":"2024-09-21T03:40:29.337845+0000","last_active":"2024-09-21T03:41:50.522801+0000","last_peered":"2024-09-21T03:41:50.522801+0000","last_clean":"2024-09-21T03:41:50.522801+0000","last_became_active":"2024-09-21T03:40:29.337387+0000","last_became_peered":"2024-09-21T03:40:29.337387+0000","last_unstale":"2024-09-21T03:41:50.522801+0000","last_undegraded":"2024-09-21T03:41:50.522801+0000","last_fullsized":"2024-09-21T03:41:50.522801+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:53:31.398337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.534904+0000","last_change":"2024-09-21T03:40:29.342691+0000","last_active":"2024-09-21T03:41:50.534904+0000","last_peered":"2024-09-21T03:41:50.534904+0000","last_clean":"2024-09-21T03:41:50.534904+0000","last_became_active":"2024-09-21T03:40:29.342294+0000","last_became_peered":"2024-09-21T03:40:29.342294+0000","last_unstale":"2024-09-21T03:41:50.534904+0000","last_undegraded":"2024-09-21T03:41:50.534904+0000","last_fullsized":"2024-09-21T03:41:50.534904+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:19:25.806074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.531577+0000","last_change":"2024-09-21T03:40:29.338280+0000","last_active":"2024-09-21T03:41:50.531577+0000","last_peered":"2024-09-21T03:41:50.531577+0000","last_clean":"2024-09-21T03:41:50.531577+0000","last_became_active":"2024-09-21T03:40:29.337825+0000","last_became_peered":"2024-09-21T03:40:29.337825+0000","last_unstale":"2024-09-21T03:41:50.531577+0000","last_undegraded":"2024-09-21T03:41:50.531577+0000","last_fullsized":"2024-09-21T03:41:50.531577+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:06:43.340248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'8","reported_seq":152,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:42:20.776838+0000","last_change":"2024-09-21T03:40:51.641130+0000","last_active":"2024-09-21T03:42:20.776838+0000","last_peered":"2024-09-21T03:42:20.776838+0000","last_clean":"2024-09-21T03:42:20.776838+0000","last_became_active":"2024-09-21T03:40:51.636641+0000","last_became_peered":"2024-09-21T03:40:51.636641+0000","last_unstale":"2024-09-21T03:42:20.776838+0000","last_undegraded":"2024-09-21T03:42:20.776838+0000","last_fullsized":"2024-09-21T03:42:20.776838+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:18:34.797959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1545,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1013,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.532959+0000","last_change":"2024-09-21T03:40:29.341830+0000","last_active":"2024-09-21T03:41:50.532959+0000","last_peered":"2024-09-21T03:41:50.532959+0000","last_clean":"2024-09-21T03:41:50.532959+0000","last_became_active":"2024-09-21T03:40:29.341112+0000","last_became_peered":"2024-09-21T03:40:29.341112+0000","last_unstale":"2024-09-21T03:41:50.532959+0000","last_undegraded":"2024-09-21T03:41:50.532959+0000","last_fullsized":"2024-09-21T03:41:50.532959+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:31.560605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468958+0000","last_change":"2024-09-21T03:40:27.319393+0000","last_active":"2024-09-21T03:40:51.468958+0000","last_peered":"2024-09-21T03:40:51.468958+0000","last_clean":"2024-09-21T03:40:51.468958+0000","last_became_active":"2024-09-21T03:40:27.319000+0000","last_became_peered":"2024-09-21T03:40:27.319000+0000","last_unstale":"2024-09-21T03:40:51.468958+0000","last_undegraded":"2024-09-21T03:40:51.468958+0000","last_fullsized":"2024-09-21T03:40:51.468958+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:35:24.752295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780193+0000","last_change":"2024-09-21T03:40:27.317276+0000","last_active":"2024-09-21T03:40:51.780193+0000","last_peered":"2024-09-21T03:40:51.780193+0000","last_clean":"2024-09-21T03:40:51.780193+0000","last_became_active":"2024-09-21T03:40:27.316955+0000","last_became_peered":"2024-09-21T03:40:27.316955+0000","last_unstale":"2024-09-21T03:40:51.780193+0000","last_undegraded":"2024-09-21T03:40:51.780193+0000","last_fullsized":"2024-09-21T03:40:51.780193+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:28:23.208493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.531552+0000","last_change":"2024-09-21T03:40:29.324774+0000","last_active":"2024-09-21T03:41:50.531552+0000","last_peered":"2024-09-21T03:41:50.531552+0000","last_clean":"2024-09-21T03:41:50.531552+0000","last_became_active":"2024-09-21T03:40:29.324107+0000","last_became_peered":"2024-09-21T03:40:29.324107+0000","last_unstale":"2024-09-21T03:41:50.531552+0000","last_undegraded":"2024-09-21T03:41:50.531552+0000","last_fullsized":"2024-09-21T03:41:50.531552+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:15.408620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464393+0000","last_change":"2024-09-21T03:40:27.316818+0000","last_active":"2024-09-21T03:40:51.464393+0000","last_peered":"2024-09-21T03:40:51.464393+0000","last_clean":"2024-09-21T03:40:51.464393+0000","last_became_active":"2024-09-21T03:40:27.316209+0000","last_became_peered":"2024-09-21T03:40:27.316209+0000","last_unstale":"2024-09-21T03:40:51.464393+0000","last_undegraded":"2024-09-21T03:40:51.464393+0000","last_fullsized":"2024-09-21T03:40:51.464393+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:01.869684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.526040+0000","last_change":"2024-09-21T03:40:29.335033+0000","last_active":"2024-09-21T03:41:50.526040+0000","last_peered":"2024-09-21T03:41:50.526040+0000","last_clean":"2024-09-21T03:41:50.526040+0000","last_became_active":"2024-09-21T03:40:29.334607+0000","last_became_peered":"2024-09-21T03:40:29.334607+0000","last_unstale":"2024-09-21T03:41:50.526040+0000","last_undegraded":"2024-09-21T03:41:50.526040+0000","last_fullsized":"2024-09-21T03:41:50.526040+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:05.892248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'5","reported_seq":132,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:42:21.777673+0000","last_change":"2024-09-21T03:40:27.319422+0000","last_active":"2024-09-21T03:42:21.777673+0000","last_peered":"2024-09-21T03:42:21.777673+0000","last_clean":"2024-09-21T03:42:21.777673+0000","last_became_active":"2024-09-21T03:40:27.318970+0000","last_became_peered":"2024-09-21T03:40:27.318970+0000","last_unstale":"2024-09-21T03:42:21.777673+0000","last_undegraded":"2024-09-21T03:42:21.777673+0000","last_fullsized":"2024-09-21T03:42:21.777673+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:04.263789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"77'10","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.549882+0000","last_change":"2024-09-21T03:40:29.334279+0000","last_active":"2024-09-21T03:41:50.549882+0000","last_peered":"2024-09-21T03:41:50.549882+0000","last_clean":"2024-09-21T03:41:50.549882+0000","last_became_active":"2024-09-21T03:40:29.333445+0000","last_became_peered":"2024-09-21T03:40:29.333445+0000","last_unstale":"2024-09-21T03:41:50.549882+0000","last_undegraded":"2024-09-21T03:41:50.549882+0000","last_fullsized":"2024-09-21T03:41:50.549882+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:10.445162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.643258+0000","last_change":"2024-09-21T03:40:51.643129+0000","last_active":"2024-09-21T03:40:51.643258+0000","last_peered":"2024-09-21T03:40:51.643258+0000","last_clean":"2024-09-21T03:40:51.643258+0000","last_became_active":"2024-09-21T03:40:51.637136+0000","last_became_peered":"2024-09-21T03:40:51.637136+0000","last_unstale":"2024-09-21T03:40:51.643258+0000","last_undegraded":"2024-09-21T03:40:51.643258+0000","last_fullsized":"2024-09-21T03:40:51.643258+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:58:39.540452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.540817+0000","last_change":"2024-09-21T03:40:29.340393+0000","last_active":"2024-09-21T03:41:50.540817+0000","last_peered":"2024-09-21T03:41:50.540817+0000","last_clean":"2024-09-21T03:41:50.540817+0000","last_became_active":"2024-09-21T03:40:29.340042+0000","last_became_peered":"2024-09-21T03:40:29.340042+0000","last_unstale":"2024-09-21T03:41:50.540817+0000","last_undegraded":"2024-09-21T03:41:50.540817+0000","last_fullsized":"2024-09-21T03:41:50.540817+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:43.794252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464730+0000","last_change":"2024-09-21T03:40:27.526458+0000","last_active":"2024-09-21T03:40:51.464730+0000","last_peered":"2024-09-21T03:40:51.464730+0000","last_clean":"2024-09-21T03:40:51.464730+0000","last_became_active":"2024-09-21T03:40:27.525918+0000","last_became_peered":"2024-09-21T03:40:27.525918+0000","last_unstale":"2024-09-21T03:40:51.464730+0000","last_undegraded":"2024-09-21T03:40:51.464730+0000","last_fullsized":"2024-09-21T03:40:51.464730+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:27:47.286475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"77'11","reported_seq":29,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.549166+0000","last_change":"2024-09-21T03:40:29.338197+0000","last_active":"2024-09-21T03:41:50.549166+0000","last_peered":"2024-09-21T03:41:50.549166+0000","last_clean":"2024-09-21T03:41:50.549166+0000","last_became_active":"2024-09-21T03:40:29.337852+0000","last_became_peered":"2024-09-21T03:40:29.337852+0000","last_unstale":"2024-09-21T03:41:50.549166+0000","last_undegraded":"2024-09-21T03:41:50.549166+0000","last_fullsized":"2024-09-21T03:41:50.549166+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:02:09.132407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'33","reported_seq":275,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:42:22.778612+0000","last_change":"2024-09-21T03:40:27.320891+0000","last_active":"2024-09-21T03:42:22.778612+0000","last_peered":"2024-09-21T03:42:22.778612+0000","last_clean":"2024-09-21T03:42:22.778612+0000","last_became_active":"2024-09-21T03:40:27.320512+0000","last_became_peered":"2024-09-21T03:40:27.320512+0000","last_unstale":"2024-09-21T03:42:22.778612+0000","last_undegraded":"2024-09-21T03:42:22.778612+0000","last_fullsized":"2024-09-21T03:42:22.778612+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:27.181130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69740,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":219,"num_read_kb":177,"num_write":34,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.530637+0000","last_change":"2024-09-21T03:40:29.335570+0000","last_active":"2024-09-21T03:41:50.530637+0000","last_peered":"2024-09-21T03:41:50.530637+0000","last_clean":"2024-09-21T03:41:50.530637+0000","last_became_active":"2024-09-21T03:40:29.335226+0000","last_became_peered":"2024-09-21T03:40:29.335226+0000","last_unstale":"2024-09-21T03:41:50.530637+0000","last_undegraded":"2024-09-21T03:41:50.530637+0000","last_fullsized":"2024-09-21T03:41:50.530637+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:56.434945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468293+0000","last_change":"2024-09-21T03:40:27.318436+0000","last_active":"2024-09-21T03:40:51.468293+0000","last_peered":"2024-09-21T03:40:51.468293+0000","last_clean":"2024-09-21T03:40:51.468293+0000","last_became_active":"2024-09-21T03:40:27.317969+0000","last_became_peered":"2024-09-21T03:40:27.317969+0000","last_unstale":"2024-09-21T03:40:51.468293+0000","last_undegraded":"2024-09-21T03:40:51.468293+0000","last_fullsized":"2024-09-21T03:40:51.468293+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:43.137717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.547119+0000","last_change":"2024-09-21T03:40:29.325824+0000","last_active":"2024-09-21T03:41:50.547119+0000","last_peered":"2024-09-21T03:41:50.547119+0000","last_clean":"2024-09-21T03:41:50.547119+0000","last_became_active":"2024-09-21T03:40:29.325498+0000","last_became_peered":"2024-09-21T03:40:29.325498+0000","last_unstale":"2024-09-21T03:41:50.547119+0000","last_undegraded":"2024-09-21T03:41:50.547119+0000","last_fullsized":"2024-09-21T03:41:50.547119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:13.044835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464366+0000","last_change":"2024-09-21T03:40:27.308889+0000","last_active":"2024-09-21T03:40:51.464366+0000","last_peered":"2024-09-21T03:40:51.464366+0000","last_clean":"2024-09-21T03:40:51.464366+0000","last_became_active":"2024-09-21T03:40:27.308491+0000","last_became_peered":"2024-09-21T03:40:27.308491+0000","last_unstale":"2024-09-21T03:40:51.464366+0000","last_undegraded":"2024-09-21T03:40:51.464366+0000","last_fullsized":"2024-09-21T03:40:51.464366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:03:48.250898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"77'15","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.548242+0000","last_change":"2024-09-21T03:40:51.781287+0000","last_active":"2024-09-21T03:41:50.548242+0000","last_peered":"2024-09-21T03:41:50.548242+0000","last_clean":"2024-09-21T03:41:50.548242+0000","last_became_active":"2024-09-21T03:40:51.780925+0000","last_became_peered":"2024-09-21T03:40:51.780925+0000","last_unstale":"2024-09-21T03:41:50.548242+0000","last_undegraded":"2024-09-21T03:41:50.548242+0000","last_fullsized":"2024-09-21T03:41:50.548242+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:36.599949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'4","reported_seq":131,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:42:20.606215+0000","last_change":"2024-09-21T03:40:27.316066+0000","last_active":"2024-09-21T03:42:20.606215+0000","last_peered":"2024-09-21T03:42:20.606215+0000","last_clean":"2024-09-21T03:42:20.606215+0000","last_became_active":"2024-09-21T03:40:27.315580+0000","last_became_peered":"2024-09-21T03:40:27.315580+0000","last_unstale":"2024-09-21T03:42:20.606215+0000","last_undegraded":"2024-09-21T03:42:20.606215+0000","last_fullsized":"2024-09-21T03:42:20.606215+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:14.592824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.547163+0000","last_change":"2024-09-21T03:40:29.339736+0000","last_active":"2024-09-21T03:41:50.547163+0000","last_peered":"2024-09-21T03:41:50.547163+0000","last_clean":"2024-09-21T03:41:50.547163+0000","last_became_active":"2024-09-21T03:40:29.338343+0000","last_became_peered":"2024-09-21T03:40:29.338343+0000","last_unstale":"2024-09-21T03:41:50.547163+0000","last_undegraded":"2024-09-21T03:41:50.547163+0000","last_fullsized":"2024-09-21T03:41:50.547163+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:31:33.531580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.485664+0000","last_change":"2024-09-21T03:40:51.485123+0000","last_active":"2024-09-21T03:40:51.485664+0000","last_peered":"2024-09-21T03:40:51.485664+0000","last_clean":"2024-09-21T03:40:51.485664+0000","last_became_active":"2024-09-21T03:40:51.471029+0000","last_became_peered":"2024-09-21T03:40:51.471029+0000","last_unstale":"2024-09-21T03:40:51.485664+0000","last_undegraded":"2024-09-21T03:40:51.485664+0000","last_fullsized":"2024-09-21T03:40:51.485664+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:32.870908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.537148+0000","last_change":"2024-09-21T03:40:29.340712+0000","last_active":"2024-09-21T03:41:50.537148+0000","last_peered":"2024-09-21T03:41:50.537148+0000","last_clean":"2024-09-21T03:41:50.537148+0000","last_became_active":"2024-09-21T03:40:29.340349+0000","last_became_peered":"2024-09-21T03:40:29.340349+0000","last_unstale":"2024-09-21T03:41:50.537148+0000","last_undegraded":"2024-09-21T03:41:50.537148+0000","last_fullsized":"2024-09-21T03:41:50.537148+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:46:29.980697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470772+0000","last_change":"2024-09-21T03:40:27.319689+0000","last_active":"2024-09-21T03:40:51.470772+0000","last_peered":"2024-09-21T03:40:51.470772+0000","last_clean":"2024-09-21T03:40:51.470772+0000","last_became_active":"2024-09-21T03:40:27.319010+0000","last_became_peered":"2024-09-21T03:40:27.319010+0000","last_unstale":"2024-09-21T03:40:51.470772+0000","last_undegraded":"2024-09-21T03:40:51.470772+0000","last_fullsized":"2024-09-21T03:40:51.470772+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:38:42.965205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"77'5","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.526836+0000","last_change":"2024-09-21T03:40:51.636790+0000","last_active":"2024-09-21T03:41:50.526836+0000","last_peered":"2024-09-21T03:41:50.526836+0000","last_clean":"2024-09-21T03:41:50.526836+0000","last_became_active":"2024-09-21T03:40:51.636333+0000","last_became_peered":"2024-09-21T03:40:51.636333+0000","last_unstale":"2024-09-21T03:41:50.526836+0000","last_undegraded":"2024-09-21T03:41:50.526836+0000","last_fullsized":"2024-09-21T03:41:50.526836+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:27.186564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.780182+0000","last_change":"2024-09-21T03:40:27.316086+0000","last_active":"2024-09-21T03:40:51.780182+0000","last_peered":"2024-09-21T03:40:51.780182+0000","last_clean":"2024-09-21T03:40:51.780182+0000","last_became_active":"2024-09-21T03:40:27.315645+0000","last_became_peered":"2024-09-21T03:40:27.315645+0000","last_unstale":"2024-09-21T03:40:51.780182+0000","last_undegraded":"2024-09-21T03:40:51.780182+0000","last_fullsized":"2024-09-21T03:40:51.780182+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:20:41.536778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.545457+0000","last_change":"2024-09-21T03:40:29.339546+0000","last_active":"2024-09-21T03:41:50.545457+0000","last_peered":"2024-09-21T03:41:50.545457+0000","last_clean":"2024-09-21T03:41:50.545457+0000","last_became_active":"2024-09-21T03:40:29.339176+0000","last_became_peered":"2024-09-21T03:40:29.339176+0000","last_unstale":"2024-09-21T03:41:50.545457+0000","last_undegraded":"2024-09-21T03:41:50.545457+0000","last_fullsized":"2024-09-21T03:41:50.545457+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:12:26.405624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464973+0000","last_change":"2024-09-21T03:40:27.315440+0000","last_active":"2024-09-21T03:40:51.464973+0000","last_peered":"2024-09-21T03:40:51.464973+0000","last_clean":"2024-09-21T03:40:51.464973+0000","last_became_active":"2024-09-21T03:40:27.314608+0000","last_became_peered":"2024-09-21T03:40:27.314608+0000","last_unstale":"2024-09-21T03:40:51.464973+0000","last_undegraded":"2024-09-21T03:40:51.464973+0000","last_fullsized":"2024-09-21T03:40:51.464973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:11.465078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.537525+0000","last_change":"2024-09-21T03:40:29.336631+0000","last_active":"2024-09-21T03:41:50.537525+0000","last_peered":"2024-09-21T03:41:50.537525+0000","last_clean":"2024-09-21T03:41:50.537525+0000","last_became_active":"2024-09-21T03:40:29.336201+0000","last_became_peered":"2024-09-21T03:40:29.336201+0000","last_unstale":"2024-09-21T03:41:50.537525+0000","last_undegraded":"2024-09-21T03:41:50.537525+0000","last_fullsized":"2024-09-21T03:41:50.537525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:54:29.514908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.468161+0000","last_change":"2024-09-21T03:40:27.719183+0000","last_active":"2024-09-21T03:40:51.468161+0000","last_peered":"2024-09-21T03:40:51.468161+0000","last_clean":"2024-09-21T03:40:51.468161+0000","last_became_active":"2024-09-21T03:40:27.718658+0000","last_became_peered":"2024-09-21T03:40:27.718658+0000","last_unstale":"2024-09-21T03:40:51.468161+0000","last_undegraded":"2024-09-21T03:40:51.468161+0000","last_fullsized":"2024-09-21T03:40:51.468161+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:38:52.280654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.549141+0000","last_change":"2024-09-21T03:40:29.335258+0000","last_active":"2024-09-21T03:41:50.549141+0000","last_peered":"2024-09-21T03:41:50.549141+0000","last_clean":"2024-09-21T03:41:50.549141+0000","last_became_active":"2024-09-21T03:40:29.334897+0000","last_became_peered":"2024-09-21T03:40:29.334897+0000","last_unstale":"2024-09-21T03:41:50.549141+0000","last_undegraded":"2024-09-21T03:41:50.549141+0000","last_fullsized":"2024-09-21T03:41:50.549141+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:11:27.040232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":96,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464438+0000","last_change":"2024-09-21T03:39:15.369567+0000","last_active":"2024-09-21T03:40:51.464438+0000","last_peered":"2024-09-21T03:40:51.464438+0000","last_clean":"2024-09-21T03:40:51.464438+0000","last_became_active":"2024-09-21T03:39:15.363960+0000","last_became_peered":"2024-09-21T03:39:15.363960+0000","last_unstale":"2024-09-21T03:40:51.464438+0000","last_undegraded":"2024-09-21T03:40:51.464438+0000","last_fullsized":"2024-09-21T03:40:51.464438+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:35:51.240165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:35:51.240165+0000","last_clean_scrub_stamp":"2024-09-21T03:35:51.240165+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:16:10.335425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.635844+0000","last_change":"2024-09-21T03:40:27.316831+0000","last_active":"2024-09-21T03:40:51.635844+0000","last_peered":"2024-09-21T03:40:51.635844+0000","last_clean":"2024-09-21T03:40:51.635844+0000","last_became_active":"2024-09-21T03:40:27.315547+0000","last_became_peered":"2024-09-21T03:40:27.315547+0000","last_unstale":"2024-09-21T03:40:51.635844+0000","last_undegraded":"2024-09-21T03:40:51.635844+0000","last_fullsized":"2024-09-21T03:40:51.635844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:51:02.727366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.545628+0000","last_change":"2024-09-21T03:40:29.339059+0000","last_active":"2024-09-21T03:41:50.545628+0000","last_peered":"2024-09-21T03:41:50.545628+0000","last_clean":"2024-09-21T03:41:50.545628+0000","last_became_active":"2024-09-21T03:40:29.338710+0000","last_became_peered":"2024-09-21T03:40:29.338710+0000","last_unstale":"2024-09-21T03:41:50.545628+0000","last_undegraded":"2024-09-21T03:41:50.545628+0000","last_fullsized":"2024-09-21T03:41:50.545628+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:58:50.390629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464355+0000","last_change":"2024-09-21T03:40:27.314666+0000","last_active":"2024-09-21T03:40:51.464355+0000","last_peered":"2024-09-21T03:40:51.464355+0000","last_clean":"2024-09-21T03:40:51.464355+0000","last_became_active":"2024-09-21T03:40:27.314254+0000","last_became_peered":"2024-09-21T03:40:27.314254+0000","last_unstale":"2024-09-21T03:40:51.464355+0000","last_undegraded":"2024-09-21T03:40:51.464355+0000","last_fullsized":"2024-09-21T03:40:51.464355+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:02:57.230420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.524644+0000","last_change":"2024-09-21T03:40:29.338249+0000","last_active":"2024-09-21T03:41:50.524644+0000","last_peered":"2024-09-21T03:41:50.524644+0000","last_clean":"2024-09-21T03:41:50.524644+0000","last_became_active":"2024-09-21T03:40:29.337901+0000","last_became_peered":"2024-09-21T03:40:29.337901+0000","last_unstale":"2024-09-21T03:41:50.524644+0000","last_undegraded":"2024-09-21T03:41:50.524644+0000","last_fullsized":"2024-09-21T03:41:50.524644+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:21.054734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'5","reported_seq":131,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:42:20.722297+0000","last_change":"2024-09-21T03:40:27.525651+0000","last_active":"2024-09-21T03:42:20.722297+0000","last_peered":"2024-09-21T03:42:20.722297+0000","last_clean":"2024-09-21T03:42:20.722297+0000","last_became_active":"2024-09-21T03:40:27.525299+0000","last_became_peered":"2024-09-21T03:40:27.525299+0000","last_unstale":"2024-09-21T03:42:20.722297+0000","last_undegraded":"2024-09-21T03:42:20.722297+0000","last_fullsized":"2024-09-21T03:42:20.722297+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:44:21.983937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.529796+0000","last_change":"2024-09-21T03:40:29.339021+0000","last_active":"2024-09-21T03:41:50.529796+0000","last_peered":"2024-09-21T03:41:50.529796+0000","last_clean":"2024-09-21T03:41:50.529796+0000","last_became_active":"2024-09-21T03:40:29.338660+0000","last_became_peered":"2024-09-21T03:40:29.338660+0000","last_unstale":"2024-09-21T03:41:50.529796+0000","last_undegraded":"2024-09-21T03:41:50.529796+0000","last_fullsized":"2024-09-21T03:41:50.529796+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:41:56.652048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.465111+0000","last_change":"2024-09-21T03:40:27.319650+0000","last_active":"2024-09-21T03:40:51.465111+0000","last_peered":"2024-09-21T03:40:51.465111+0000","last_clean":"2024-09-21T03:40:51.465111+0000","last_became_active":"2024-09-21T03:40:27.319188+0000","last_became_peered":"2024-09-21T03:40:27.319188+0000","last_unstale":"2024-09-21T03:40:51.465111+0000","last_undegraded":"2024-09-21T03:40:51.465111+0000","last_fullsized":"2024-09-21T03:40:51.465111+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:12.905682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.523060+0000","last_change":"2024-09-21T03:40:29.340673+0000","last_active":"2024-09-21T03:41:50.523060+0000","last_peered":"2024-09-21T03:41:50.523060+0000","last_clean":"2024-09-21T03:41:50.523060+0000","last_became_active":"2024-09-21T03:40:29.340240+0000","last_became_peered":"2024-09-21T03:40:29.340240+0000","last_unstale":"2024-09-21T03:41:50.523060+0000","last_undegraded":"2024-09-21T03:41:50.523060+0000","last_fullsized":"2024-09-21T03:41:50.523060+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:46:02.989879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470390+0000","last_change":"2024-09-21T03:40:27.527803+0000","last_active":"2024-09-21T03:40:51.470390+0000","last_peered":"2024-09-21T03:40:51.470390+0000","last_clean":"2024-09-21T03:40:51.470390+0000","last_became_active":"2024-09-21T03:40:27.527419+0000","last_became_peered":"2024-09-21T03:40:27.527419+0000","last_unstale":"2024-09-21T03:40:51.470390+0000","last_undegraded":"2024-09-21T03:40:51.470390+0000","last_fullsized":"2024-09-21T03:40:51.470390+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:15:16.081458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.534523+0000","last_change":"2024-09-21T03:40:29.347927+0000","last_active":"2024-09-21T03:41:50.534523+0000","last_peered":"2024-09-21T03:41:50.534523+0000","last_clean":"2024-09-21T03:41:50.534523+0000","last_became_active":"2024-09-21T03:40:29.347574+0000","last_became_peered":"2024-09-21T03:40:29.347574+0000","last_unstale":"2024-09-21T03:41:50.534523+0000","last_undegraded":"2024-09-21T03:41:50.534523+0000","last_fullsized":"2024-09-21T03:41:50.534523+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:51:10.142931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":16,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.488011+0000","last_change":"2024-09-21T03:40:51.487492+0000","last_active":"2024-09-21T03:40:51.488011+0000","last_peered":"2024-09-21T03:40:51.488011+0000","last_clean":"2024-09-21T03:40:51.488011+0000","last_became_active":"2024-09-21T03:40:51.472023+0000","last_became_peered":"2024-09-21T03:40:51.472023+0000","last_unstale":"2024-09-21T03:40:51.488011+0000","last_undegraded":"2024-09-21T03:40:51.488011+0000","last_fullsized":"2024-09-21T03:40:51.488011+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:34:40.164056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.533879+0000","last_change":"2024-09-21T03:40:29.332539+0000","last_active":"2024-09-21T03:41:50.533879+0000","last_peered":"2024-09-21T03:41:50.533879+0000","last_clean":"2024-09-21T03:41:50.533879+0000","last_became_active":"2024-09-21T03:40:29.332178+0000","last_became_peered":"2024-09-21T03:40:29.332178+0000","last_unstale":"2024-09-21T03:41:50.533879+0000","last_undegraded":"2024-09-21T03:41:50.533879+0000","last_fullsized":"2024-09-21T03:41:50.533879+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:57:00.354558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'13","reported_seq":36,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:42:19.356061+0000","last_change":"2024-09-21T03:40:27.313942+0000","last_active":"2024-09-21T03:42:19.356061+0000","last_peered":"2024-09-21T03:42:19.356061+0000","last_clean":"2024-09-21T03:42:19.356061+0000","last_became_active":"2024-09-21T03:40:27.313541+0000","last_became_peered":"2024-09-21T03:40:27.313541+0000","last_unstale":"2024-09-21T03:42:19.356061+0000","last_undegraded":"2024-09-21T03:42:19.356061+0000","last_fullsized":"2024-09-21T03:42:19.356061+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:40:58.572154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.532002+0000","last_change":"2024-09-21T03:40:29.330712+0000","last_active":"2024-09-21T03:41:50.532002+0000","last_peered":"2024-09-21T03:41:50.532002+0000","last_clean":"2024-09-21T03:41:50.532002+0000","last_became_active":"2024-09-21T03:40:29.330345+0000","last_became_peered":"2024-09-21T03:40:29.330345+0000","last_unstale":"2024-09-21T03:41:50.532002+0000","last_undegraded":"2024-09-21T03:41:50.532002+0000","last_fullsized":"2024-09-21T03:41:50.532002+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:54.225288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.635760+0000","last_change":"2024-09-21T03:40:27.719239+0000","last_active":"2024-09-21T03:40:51.635760+0000","last_peered":"2024-09-21T03:40:51.635760+0000","last_clean":"2024-09-21T03:40:51.635760+0000","last_became_active":"2024-09-21T03:40:27.718834+0000","last_became_peered":"2024-09-21T03:40:27.718834+0000","last_unstale":"2024-09-21T03:40:51.635760+0000","last_undegraded":"2024-09-21T03:40:51.635760+0000","last_fullsized":"2024-09-21T03:40:51.635760+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:09:47.357723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"77'7","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.541218+0000","last_change":"2024-09-21T03:40:29.338470+0000","last_active":"2024-09-21T03:41:50.541218+0000","last_peered":"2024-09-21T03:41:50.541218+0000","last_clean":"2024-09-21T03:41:50.541218+0000","last_became_active":"2024-09-21T03:40:29.338114+0000","last_became_peered":"2024-09-21T03:40:29.338114+0000","last_unstale":"2024-09-21T03:41:50.541218+0000","last_undegraded":"2024-09-21T03:41:50.541218+0000","last_fullsized":"2024-09-21T03:41:50.541218+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:23.715773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467223+0000","last_change":"2024-09-21T03:40:27.525544+0000","last_active":"2024-09-21T03:40:51.467223+0000","last_peered":"2024-09-21T03:40:51.467223+0000","last_clean":"2024-09-21T03:40:51.467223+0000","last_became_active":"2024-09-21T03:40:27.525196+0000","last_became_peered":"2024-09-21T03:40:27.525196+0000","last_unstale":"2024-09-21T03:40:51.467223+0000","last_undegraded":"2024-09-21T03:40:51.467223+0000","last_fullsized":"2024-09-21T03:40:51.467223+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:57:07.882351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"77'2","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.494418+0000","last_change":"2024-09-21T03:40:29.337774+0000","last_active":"2024-09-21T03:41:50.494418+0000","last_peered":"2024-09-21T03:41:50.494418+0000","last_clean":"2024-09-21T03:41:50.494418+0000","last_became_active":"2024-09-21T03:40:29.337393+0000","last_became_peered":"2024-09-21T03:40:29.337393+0000","last_unstale":"2024-09-21T03:41:50.494418+0000","last_undegraded":"2024-09-21T03:41:50.494418+0000","last_fullsized":"2024-09-21T03:41:50.494418+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:20.471042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.463610+0000","last_change":"2024-09-21T03:40:27.312953+0000","last_active":"2024-09-21T03:40:51.463610+0000","last_peered":"2024-09-21T03:40:51.463610+0000","last_clean":"2024-09-21T03:40:51.463610+0000","last_became_active":"2024-09-21T03:40:27.312603+0000","last_became_peered":"2024-09-21T03:40:27.312603+0000","last_unstale":"2024-09-21T03:40:51.463610+0000","last_undegraded":"2024-09-21T03:40:51.463610+0000","last_fullsized":"2024-09-21T03:40:51.463610+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:10:18.102812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.533801+0000","last_change":"2024-09-21T03:40:29.330802+0000","last_active":"2024-09-21T03:41:50.533801+0000","last_peered":"2024-09-21T03:41:50.533801+0000","last_clean":"2024-09-21T03:41:50.533801+0000","last_became_active":"2024-09-21T03:40:29.330426+0000","last_became_peered":"2024-09-21T03:40:29.330426+0000","last_unstale":"2024-09-21T03:41:50.533801+0000","last_undegraded":"2024-09-21T03:41:50.533801+0000","last_fullsized":"2024-09-21T03:41:50.533801+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:08:18.552649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.467619+0000","last_change":"2024-09-21T03:40:27.319829+0000","last_active":"2024-09-21T03:40:51.467619+0000","last_peered":"2024-09-21T03:40:51.467619+0000","last_clean":"2024-09-21T03:40:51.467619+0000","last_became_active":"2024-09-21T03:40:27.319410+0000","last_became_peered":"2024-09-21T03:40:27.319410+0000","last_unstale":"2024-09-21T03:40:51.467619+0000","last_undegraded":"2024-09-21T03:40:51.467619+0000","last_fullsized":"2024-09-21T03:40:51.467619+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:20:56.475721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"77'8","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.535764+0000","last_change":"2024-09-21T03:40:29.335897+0000","last_active":"2024-09-21T03:41:50.535764+0000","last_peered":"2024-09-21T03:41:50.535764+0000","last_clean":"2024-09-21T03:41:50.535764+0000","last_became_active":"2024-09-21T03:40:29.335549+0000","last_became_peered":"2024-09-21T03:40:29.335549+0000","last_unstale":"2024-09-21T03:41:50.535764+0000","last_undegraded":"2024-09-21T03:41:50.535764+0000","last_fullsized":"2024-09-21T03:41:50.535764+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:01.401766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470266+0000","last_change":"2024-09-21T03:40:27.316678+0000","last_active":"2024-09-21T03:40:51.470266+0000","last_peered":"2024-09-21T03:40:51.470266+0000","last_clean":"2024-09-21T03:40:51.470266+0000","last_became_active":"2024-09-21T03:40:27.315980+0000","last_became_peered":"2024-09-21T03:40:27.315980+0000","last_unstale":"2024-09-21T03:40:51.470266+0000","last_undegraded":"2024-09-21T03:40:51.470266+0000","last_fullsized":"2024-09-21T03:40:51.470266+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:17:56.280077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.549639+0000","last_change":"2024-09-21T03:40:29.333638+0000","last_active":"2024-09-21T03:41:50.549639+0000","last_peered":"2024-09-21T03:41:50.549639+0000","last_clean":"2024-09-21T03:41:50.549639+0000","last_became_active":"2024-09-21T03:40:29.333268+0000","last_became_peered":"2024-09-21T03:40:29.333268+0000","last_unstale":"2024-09-21T03:41:50.549639+0000","last_undegraded":"2024-09-21T03:41:50.549639+0000","last_fullsized":"2024-09-21T03:41:50.549639+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:35:23.346837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"77'15","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.543689+0000","last_change":"2024-09-21T03:40:29.342199+0000","last_active":"2024-09-21T03:41:50.543689+0000","last_peered":"2024-09-21T03:41:50.543689+0000","last_clean":"2024-09-21T03:41:50.543689+0000","last_became_active":"2024-09-21T03:40:29.341675+0000","last_became_peered":"2024-09-21T03:40:29.341675+0000","last_unstale":"2024-09-21T03:41:50.543689+0000","last_undegraded":"2024-09-21T03:41:50.543689+0000","last_fullsized":"2024-09-21T03:41:50.543689+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:01.439058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470666+0000","last_change":"2024-09-21T03:40:27.319327+0000","last_active":"2024-09-21T03:40:51.470666+0000","last_peered":"2024-09-21T03:40:51.470666+0000","last_clean":"2024-09-21T03:40:51.470666+0000","last_became_active":"2024-09-21T03:40:27.318773+0000","last_became_peered":"2024-09-21T03:40:27.318773+0000","last_unstale":"2024-09-21T03:40:51.470666+0000","last_undegraded":"2024-09-21T03:40:51.470666+0000","last_fullsized":"2024-09-21T03:40:51.470666+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:18:42.444238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"77'9","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.550352+0000","last_change":"2024-09-21T03:40:29.336121+0000","last_active":"2024-09-21T03:41:50.550352+0000","last_peered":"2024-09-21T03:41:50.550352+0000","last_clean":"2024-09-21T03:41:50.550352+0000","last_became_active":"2024-09-21T03:40:29.333523+0000","last_became_peered":"2024-09-21T03:40:29.333523+0000","last_unstale":"2024-09-21T03:41:50.550352+0000","last_undegraded":"2024-09-21T03:41:50.550352+0000","last_fullsized":"2024-09-21T03:41:50.550352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:34:29.303410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470911+0000","last_change":"2024-09-21T03:40:27.316523+0000","last_active":"2024-09-21T03:40:51.470911+0000","last_peered":"2024-09-21T03:40:51.470911+0000","last_clean":"2024-09-21T03:40:51.470911+0000","last_became_active":"2024-09-21T03:40:27.316099+0000","last_became_peered":"2024-09-21T03:40:27.316099+0000","last_unstale":"2024-09-21T03:40:51.470911+0000","last_undegraded":"2024-09-21T03:40:51.470911+0000","last_fullsized":"2024-09-21T03:40:51.470911+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:45:44.091964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"77'6","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.545758+0000","last_change":"2024-09-21T03:40:29.333887+0000","last_active":"2024-09-21T03:41:50.545758+0000","last_peered":"2024-09-21T03:41:50.545758+0000","last_clean":"2024-09-21T03:41:50.545758+0000","last_became_active":"2024-09-21T03:40:29.333465+0000","last_became_peered":"2024-09-21T03:40:29.333465+0000","last_unstale":"2024-09-21T03:41:50.545758+0000","last_undegraded":"2024-09-21T03:41:50.545758+0000","last_fullsized":"2024-09-21T03:41:50.545758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:55:46.788188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.464003+0000","last_change":"2024-09-21T03:40:27.525812+0000","last_active":"2024-09-21T03:40:51.464003+0000","last_peered":"2024-09-21T03:40:51.464003+0000","last_clean":"2024-09-21T03:40:51.464003+0000","last_became_active":"2024-09-21T03:40:27.525391+0000","last_became_peered":"2024-09-21T03:40:27.525391+0000","last_unstale":"2024-09-21T03:40:51.464003+0000","last_undegraded":"2024-09-21T03:40:51.464003+0000","last_fullsized":"2024-09-21T03:40:51.464003+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:07.856442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"77'5","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:41:50.534430+0000","last_change":"2024-09-21T03:40:29.339079+0000","last_active":"2024-09-21T03:41:50.534430+0000","last_peered":"2024-09-21T03:41:50.534430+0000","last_clean":"2024-09-21T03:41:50.534430+0000","last_became_active":"2024-09-21T03:40:29.338737+0000","last_became_peered":"2024-09-21T03:40:29.338737+0000","last_unstale":"2024-09-21T03:41:50.534430+0000","last_undegraded":"2024-09-21T03:41:50.534430+0000","last_fullsized":"2024-09-21T03:41:50.534430+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:28.304108+0000","last_clean_scrub_stamp":"2024-09-21T03:40:28.304108+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:14.863848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:40:51.470639+0000","last_change":"2024-09-21T03:40:27.316037+0000","last_active":"2024-09-21T03:40:51.470639+0000","last_peered":"2024-09-21T03:40:51.470639+0000","last_clean":"2024-09-21T03:40:51.470639+0000","last_became_active":"2024-09-21T03:40:27.315604+0000","last_became_peered":"2024-09-21T03:40:27.315604+0000","last_unstale":"2024-09-21T03:40:51.470639+0000","last_undegraded":"2024-09-21T03:40:51.470639+0000","last_fullsized":"2024-09-21T03:40:51.470639+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:40:26.287361+0000","last_clean_scrub_stamp":"2024-09-21T03:40:26.287361+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:48.176252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74664,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":641,"num_read_kb":402,"num_write":178,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1147,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":217767,"data_compressed":5679,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247442,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743460,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":416171,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906985,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":991232,"data_stored":1077649,"data_compressed":43442,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070511,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":416273,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266739,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":839680,"data_stored":416059,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430264,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":1009046,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593790,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":415662,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790019,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":913408,"data_stored":1008339,"data_compressed":41549,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986248,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":417253,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":856064,"data_stored":415973,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36240,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708912,"statfs":{"total":95995035648,"available":95957925888,"internally_reserved":0,"allocated":917504,"data_stored":479781,"data_compressed":7630,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":484804,"data_compressed":7630,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705756,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36184,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708968,"statfs":{"total":95995035648,"available":95957983232,"internally_reserved":0,"allocated":860160,"data_stored":416933,"data_compressed":5737,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34191,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34191,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35812,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":69349,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64634,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":71709,"data_compressed":1893,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:42:24.919 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:42:25.200 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:25.616 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:25 smithi084 ceph-mon[30941]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:42:25.616 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:25 smithi084 ceph-mon[30941]: pgmap v322: 97 pgs: 97 active+clean; 650 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-21T03:42:25.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:25 smithi172 ceph-mon[34821]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:42:25.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:25 smithi172 ceph-mon[34821]: pgmap v322: 97 pgs: 97 active+clean; 650 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-21T03:42:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.705+0000 7f8457bd6640 1 -- 172.21.15.84:0/3922840732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84501094f0 msgr2=0x7f8450109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.705+0000 7f8457bd6640 1 --2- 172.21.15.84:0/3922840732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84501094f0 0x7f8450109900 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8440009900 tx=0x7f844002a410 comp rx=0 tx=0).stop 2024-09-21T03:42:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.705+0000 7f8457bd6640 1 -- 172.21.15.84:0/3922840732 shutdown_connections 2024-09-21T03:42:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.705+0000 7f8457bd6640 1 --2- 172.21.15.84:0/3922840732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8450109e40 0x7f8450110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.705+0000 7f8457bd6640 1 --2- 172.21.15.84:0/3922840732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f84501094f0 0x7f8450109900 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.705+0000 7f8457bd6640 1 --2- 172.21.15.84:0/3922840732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8450103bb0 0x7f8450103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.705+0000 7f8457bd6640 1 -- 172.21.15.84:0/3922840732 >> 172.21.15.84:0/3922840732 conn(0x7f84500ff600 msgr2=0x7f8450101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.705+0000 7f8457bd6640 1 -- 172.21.15.84:0/3922840732 shutdown_connections 2024-09-21T03:42:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.705+0000 7f8457bd6640 1 -- 172.21.15.84:0/3922840732 wait complete. 2024-09-21T03:42:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.706+0000 7f8457bd6640 1 Processor -- start 2024-09-21T03:42:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.706+0000 7f8457bd6640 1 -- start start 2024-09-21T03:42:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.706+0000 7f8457bd6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8450103bb0 0x7f8450075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.706+0000 7f8457bd6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84501094f0 0x7f8450075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.706+0000 7f8457bd6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8450109e40 0x7f8450076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.706+0000 7f8457bd6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8450113ba0 con 0x7f8450103bb0 2024-09-21T03:42:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.706+0000 7f8457bd6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8450113a20 con 0x7f8450109e40 2024-09-21T03:42:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.706+0000 7f8457bd6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8450113d20 con 0x7f84501094f0 2024-09-21T03:42:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.706+0000 7f8455972640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8450103bb0 0x7f8450075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.706+0000 7f8455972640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8450103bb0 0x7f8450075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33718/0 (socket says 172.21.15.84:33718) 2024-09-21T03:42:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.706+0000 7f8455972640 1 -- 172.21.15.84:0/333710641 learned_addr learned my addr 172.21.15.84:0/333710641 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.706+0000 7f8456173640 1 --2- 172.21.15.84:0/333710641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8450109e40 0x7f8450076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.706+0000 7f8455972640 1 -- 172.21.15.84:0/333710641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84501094f0 msgr2=0x7f8450075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.706+0000 7f8455972640 1 --2- 172.21.15.84:0/333710641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84501094f0 0x7f8450075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.706+0000 7f8455972640 1 -- 172.21.15.84:0/333710641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8450109e40 msgr2=0x7f8450076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.706+0000 7f8455972640 1 --2- 172.21.15.84:0/333710641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8450109e40 0x7f8450076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.706+0000 7f8455972640 1 -- 172.21.15.84:0/333710641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84501a88d0 con 0x7f8450103bb0 2024-09-21T03:42:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.706+0000 7f8455972640 1 --2- 172.21.15.84:0/333710641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8450103bb0 0x7f8450075710 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f844c00b4a0 tx=0x7f844c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.707+0000 7f8446ffd640 1 -- 172.21.15.84:0/333710641 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844c014070 con 0x7f8450103bb0 2024-09-21T03:42:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.707+0000 7f8446ffd640 1 -- 172.21.15.84:0/333710641 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f844c010ac0 con 0x7f8450103bb0 2024-09-21T03:42:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.707+0000 7f8457bd6640 1 -- 172.21.15.84:0/333710641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84501a8bc0 con 0x7f8450103bb0 2024-09-21T03:42:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.707+0000 7f8446ffd640 1 -- 172.21.15.84:0/333710641 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f844c017c30 con 0x7f8450103bb0 2024-09-21T03:42:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.707+0000 7f8457bd6640 1 -- 172.21.15.84:0/333710641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84501a9100 con 0x7f8450103bb0 2024-09-21T03:42:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.708+0000 7f8457bd6640 1 -- 172.21.15.84:0/333710641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8450104040 con 0x7f8450103bb0 2024-09-21T03:42:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.710+0000 7f8446ffd640 1 -- 172.21.15.84:0/333710641 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7f844c017070 con 0x7f8450103bb0 2024-09-21T03:42:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.711+0000 7f8446ffd640 1 --2- 172.21.15.84:0/333710641 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f843c0b65f0 0x7f843c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.711+0000 7f8455171640 1 --2- 172.21.15.84:0/333710641 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f843c0b65f0 0x7f843c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.711+0000 7f8446ffd640 1 -- 172.21.15.84:0/333710641 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f844c0e6c00 con 0x7f8450103bb0 2024-09-21T03:42:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.711+0000 7f8455171640 1 --2- 172.21.15.84:0/333710641 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f843c0b65f0 0x7f843c0b8b00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f844002a930 tx=0x7f8440031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.714+0000 7f8446ffd640 1 -- 172.21.15.84:0/333710641 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f844c0ad290 con 0x7f8450103bb0 2024-09-21T03:42:25.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:25 smithi174 ceph-mon[34403]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:42:25.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:25 smithi174 ceph-mon[34403]: pgmap v322: 97 pgs: 97 active+clean; 650 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-21T03:42:25.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.928+0000 7f8457bd6640 1 -- 172.21.15.84:0/333710641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8450076a10 con 0x7f8450103bb0 2024-09-21T03:42:25.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.928+0000 7f8446ffd640 1 -- 172.21.15.84:0/333710641 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7f8450076a10 con 0x7f8450103bb0 2024-09-21T03:42:25.930 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:42:25.931 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:42:25.931 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:42:25.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.931+0000 7f8457bd6640 1 -- 172.21.15.84:0/333710641 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f843c0b65f0 msgr2=0x7f843c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:25.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.931+0000 7f8457bd6640 1 --2- 172.21.15.84:0/333710641 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f843c0b65f0 0x7f843c0b8b00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f844002a930 tx=0x7f8440031400 comp rx=0 tx=0).stop 2024-09-21T03:42:25.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.931+0000 7f8457bd6640 1 -- 172.21.15.84:0/333710641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8450103bb0 msgr2=0x7f8450075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:25.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.931+0000 7f8457bd6640 1 --2- 172.21.15.84:0/333710641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8450103bb0 0x7f8450075710 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f844c00b4a0 tx=0x7f844c00b960 comp rx=0 tx=0).stop 2024-09-21T03:42:25.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.931+0000 7f8457bd6640 1 -- 172.21.15.84:0/333710641 shutdown_connections 2024-09-21T03:42:25.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.931+0000 7f8457bd6640 1 --2- 172.21.15.84:0/333710641 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f843c0b65f0 0x7f843c0b8b00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:25.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.931+0000 7f8457bd6640 1 --2- 172.21.15.84:0/333710641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8450109e40 0x7f8450076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:25.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.931+0000 7f8457bd6640 1 --2- 172.21.15.84:0/333710641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f84501094f0 0x7f8450075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:25.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.931+0000 7f8457bd6640 1 --2- 172.21.15.84:0/333710641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8450103bb0 0x7f8450075710 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:25.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.931+0000 7f8457bd6640 1 -- 172.21.15.84:0/333710641 >> 172.21.15.84:0/333710641 conn(0x7f84500ff600 msgr2=0x7f8450101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:25.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.931+0000 7f8457bd6640 1 -- 172.21.15.84:0/333710641 shutdown_connections 2024-09-21T03:42:25.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:25.931+0000 7f8457bd6640 1 -- 172.21.15.84:0/333710641 wait complete. 2024-09-21T03:42:26.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:26 smithi172 ceph-mon[34821]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:42:26.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:26 smithi172 ceph-mon[34821]: from='client.15459 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:42:26.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:26 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/333710641' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:42:26.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:26 smithi084 ceph-mon[30941]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:42:26.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:26 smithi084 ceph-mon[30941]: from='client.15459 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:42:26.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:26 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/333710641' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:42:26.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:26 smithi174 ceph-mon[34403]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:42:26.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:26 smithi174 ceph-mon[34403]: from='client.15459 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:42:26.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:26 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/333710641' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:42:26.885 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:42:27.132 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:27.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:27 smithi084 ceph-mon[30941]: pgmap v323: 97 pgs: 97 active+clean; 650 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-21T03:42:27.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:27 smithi172 ceph-mon[34821]: pgmap v323: 97 pgs: 97 active+clean; 650 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-21T03:42:27.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.684+0000 7f1ed337f640 1 -- 172.21.15.84:0/1798132558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ecc108cf0 msgr2=0x7f1ecc10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:27.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.684+0000 7f1ed337f640 1 --2- 172.21.15.84:0/1798132558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ecc108cf0 0x7f1ecc10f520 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4009ca0 tx=0x7f1ec402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:42:27.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.684+0000 7f1ed337f640 1 -- 172.21.15.84:0/1798132558 shutdown_connections 2024-09-21T03:42:27.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.684+0000 7f1ed337f640 1 --2- 172.21.15.84:0/1798132558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ecc108cf0 0x7f1ecc10f520 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:27.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.684+0000 7f1ed337f640 1 --2- 172.21.15.84:0/1798132558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ecc1083a0 0x7f1ecc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:27.700 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.684+0000 7f1ed337f640 1 --2- 172.21.15.84:0/1798132558 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ecc102a60 0x7f1ecc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.684+0000 7f1ed337f640 1 -- 172.21.15.84:0/1798132558 >> 172.21.15.84:0/1798132558 conn(0x7f1ecc079720 msgr2=0x7f1ecc079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.684+0000 7f1ed337f640 1 -- 172.21.15.84:0/1798132558 shutdown_connections 2024-09-21T03:42:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.684+0000 7f1ed337f640 1 -- 172.21.15.84:0/1798132558 wait complete. 2024-09-21T03:42:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.684+0000 7f1ed337f640 1 Processor -- start 2024-09-21T03:42:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.685+0000 7f1ed337f640 1 -- start start 2024-09-21T03:42:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.685+0000 7f1ed337f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ecc102a60 0x7f1ecc19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.685+0000 7f1ed337f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ecc1083a0 0x7f1ecc19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.685+0000 7f1ed337f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ecc108cf0 0x7f1ecc19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.685+0000 7f1ed337f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc112960 con 0x7f1ecc108cf0 2024-09-21T03:42:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.685+0000 7f1ed337f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc1127e0 con 0x7f1ecc1083a0 2024-09-21T03:42:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.685+0000 7f1ed337f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1ecc112ae0 con 0x7f1ecc102a60 2024-09-21T03:42:27.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.685+0000 7f1ed191c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ecc108cf0 0x7f1ecc19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.685+0000 7f1ed191c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ecc108cf0 0x7f1ecc19fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33740/0 (socket says 172.21.15.84:33740) 2024-09-21T03:42:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.685+0000 7f1ed191c640 1 -- 172.21.15.84:0/3275579851 learned_addr learned my addr 172.21.15.84:0/3275579851 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.685+0000 7f1ed091a640 1 --2- 172.21.15.84:0/3275579851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ecc1083a0 0x7f1ecc19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.685+0000 7f1ed111b640 1 --2- 172.21.15.84:0/3275579851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ecc102a60 0x7f1ecc19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.685+0000 7f1ed191c640 1 -- 172.21.15.84:0/3275579851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ecc102a60 msgr2=0x7f1ecc19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.685+0000 7f1ed191c640 1 --2- 172.21.15.84:0/3275579851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ecc102a60 0x7f1ecc19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.685+0000 7f1ed191c640 1 -- 172.21.15.84:0/3275579851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ecc1083a0 msgr2=0x7f1ecc19a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.685+0000 7f1ed191c640 1 --2- 172.21.15.84:0/3275579851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ecc1083a0 0x7f1ecc19a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.685+0000 7f1ed191c640 1 -- 172.21.15.84:0/3275579851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ecc1a0350 con 0x7f1ecc108cf0 2024-09-21T03:42:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.685+0000 7f1ed091a640 1 --2- 172.21.15.84:0/3275579851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ecc1083a0 0x7f1ecc19a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:27.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.685+0000 7f1ed111b640 1 --2- 172.21.15.84:0/3275579851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ecc102a60 0x7f1ecc19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.686+0000 7f1ed191c640 1 --2- 172.21.15.84:0/3275579851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ecc108cf0 0x7f1ecc19fc20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4005cc0 tx=0x7f1ec402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.686+0000 7f1ec27fc640 1 -- 172.21.15.84:0/3275579851 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4003bf0 con 0x7f1ecc108cf0 2024-09-21T03:42:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.686+0000 7f1ed337f640 1 -- 172.21.15.84:0/3275579851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ecc1a05e0 con 0x7f1ecc108cf0 2024-09-21T03:42:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.686+0000 7f1ec27fc640 1 -- 172.21.15.84:0/3275579851 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ec4003d90 con 0x7f1ecc108cf0 2024-09-21T03:42:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.686+0000 7f1ec27fc640 1 -- 172.21.15.84:0/3275579851 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec402fbc0 con 0x7f1ecc108cf0 2024-09-21T03:42:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.686+0000 7f1ed337f640 1 -- 172.21.15.84:0/3275579851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ecc1a6da0 con 0x7f1ecc108cf0 2024-09-21T03:42:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.687+0000 7f1ed337f640 1 -- 172.21.15.84:0/3275579851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ecc103ce0 con 0x7f1ecc108cf0 2024-09-21T03:42:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.688+0000 7f1ec27fc640 1 -- 172.21.15.84:0/3275579851 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7f1ec402fd60 con 0x7f1ecc108cf0 2024-09-21T03:42:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.689+0000 7f1ec27fc640 1 --2- 172.21.15.84:0/3275579851 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1eb80b65f0 0x7f1eb80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.689+0000 7f1ed111b640 1 --2- 172.21.15.84:0/3275579851 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1eb80b65f0 0x7f1eb80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.689+0000 7f1ec27fc640 1 -- 172.21.15.84:0/3275579851 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f1ec4108cc0 con 0x7f1ecc108cf0 2024-09-21T03:42:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.690+0000 7f1ed111b640 1 --2- 172.21.15.84:0/3275579851 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1eb80b65f0 0x7f1eb80b8b00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009b40 tx=0x7f1ebc005e50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:27.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.692+0000 7f1ec27fc640 1 -- 172.21.15.84:0/3275579851 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1ec40cf350 con 0x7f1ecc108cf0 2024-09-21T03:42:27.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.875+0000 7f1ed337f640 1 -- 172.21.15.84:0/3275579851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ecc19b510 con 0x7f1ecc108cf0 2024-09-21T03:42:27.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:27 smithi174 ceph-mon[34403]: pgmap v323: 97 pgs: 97 active+clean; 650 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-21T03:42:27.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.877+0000 7f1ec27fc640 1 -- 172.21.15.84:0/3275579851 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+23019 (secure 0 0 0) 0x7f1ecc19b510 con 0x7f1ecc108cf0 2024-09-21T03:42:27.879 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:42:27.880 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":77,"fsid":"e3f8c18e-77c9-11ef-baf5-efdc52797490","created":"2024-09-21T03:31:55.307035+0000","modified":"2024-09-21T03:40:51.455331+0000","last_up_change":"2024-09-21T03:39:38.786385+0000","last_in_change":"2024-09-21T03:39:15.267368+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:35:50.488653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:40:25.934375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:40:27.981681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d283ba0-18f3-4668-90c4-884e9e957a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6803","nonce":508132562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6805","nonce":508132562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6809","nonce":508132562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6807","nonce":508132562}]},"public_addr":"172.21.15.84:6803/508132562","cluster_addr":"172.21.15.84:6805/508132562","heartbeat_back_addr":"172.21.15.84:6809/508132562","heartbeat_front_addr":"172.21.15.84:6807/508132562","state":["exists","up"]},{"osd":1,"uuid":"f115c5b6-812d-430f-9f0e-cb5311b7581e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6801","nonce":2931872350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6803","nonce":2931872350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6807","nonce":2931872350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6805","nonce":2931872350}]},"public_addr":"172.21.15.172:6801/2931872350","cluster_addr":"172.21.15.172:6803/2931872350","heartbeat_back_addr":"172.21.15.172:6807/2931872350","heartbeat_front_addr":"172.21.15.172:6805/2931872350","state":["exists","up"]},{"osd":2,"uuid":"36489240-e233-4aa7-ae9c-089d76683172","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6801","nonce":1847612335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6803","nonce":1847612335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6807","nonce":1847612335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6805","nonce":1847612335}]},"public_addr":"172.21.15.174:6801/1847612335","cluster_addr":"172.21.15.174:6803/1847612335","heartbeat_back_addr":"172.21.15.174:6807/1847612335","heartbeat_front_addr":"172.21.15.174:6805/1847612335","state":["exists","up"]},{"osd":3,"uuid":"1f35b404-b658-4e94-a5f4-74a6431a6a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6811","nonce":2230529863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6813","nonce":2230529863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6817","nonce":2230529863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6815","nonce":2230529863}]},"public_addr":"172.21.15.84:6811/2230529863","cluster_addr":"172.21.15.84:6813/2230529863","heartbeat_back_addr":"172.21.15.84:6817/2230529863","heartbeat_front_addr":"172.21.15.84:6815/2230529863","state":["exists","up"]},{"osd":4,"uuid":"91a2f83b-4c7d-4661-86a1-63a09888939d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6809","nonce":3069862739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6811","nonce":3069862739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6815","nonce":3069862739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6813","nonce":3069862739}]},"public_addr":"172.21.15.172:6809/3069862739","cluster_addr":"172.21.15.172:6811/3069862739","heartbeat_back_addr":"172.21.15.172:6815/3069862739","heartbeat_front_addr":"172.21.15.172:6813/3069862739","state":["exists","up"]},{"osd":5,"uuid":"e8f06b34-3956-499f-8073-09011cf1ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6809","nonce":1987010600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6811","nonce":1987010600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6815","nonce":1987010600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6813","nonce":1987010600}]},"public_addr":"172.21.15.174:6809/1987010600","cluster_addr":"172.21.15.174:6811/1987010600","heartbeat_back_addr":"172.21.15.174:6815/1987010600","heartbeat_front_addr":"172.21.15.174:6813/1987010600","state":["exists","up"]},{"osd":6,"uuid":"23d55e96-4987-4cbe-8c6b-cece4de9269b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6819","nonce":3418459345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6821","nonce":3418459345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6825","nonce":3418459345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6823","nonce":3418459345}]},"public_addr":"172.21.15.84:6819/3418459345","cluster_addr":"172.21.15.84:6821/3418459345","heartbeat_back_addr":"172.21.15.84:6825/3418459345","heartbeat_front_addr":"172.21.15.84:6823/3418459345","state":["exists","up"]},{"osd":7,"uuid":"ca91a34c-d8b1-48b8-93f4-72a5c15939d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6817","nonce":4056019738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6819","nonce":4056019738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6823","nonce":4056019738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6821","nonce":4056019738}]},"public_addr":"172.21.15.172:6817/4056019738","cluster_addr":"172.21.15.172:6819/4056019738","heartbeat_back_addr":"172.21.15.172:6823/4056019738","heartbeat_front_addr":"172.21.15.172:6821/4056019738","state":["exists","up"]},{"osd":8,"uuid":"37da8c61-d72f-4b58-b10c-7c7539ecffd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6817","nonce":2162992546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6819","nonce":2162992546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6823","nonce":2162992546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6821","nonce":2162992546}]},"public_addr":"172.21.15.174:6817/2162992546","cluster_addr":"172.21.15.174:6819/2162992546","heartbeat_back_addr":"172.21.15.174:6823/2162992546","heartbeat_front_addr":"172.21.15.174:6821/2162992546","state":["exists","up"]},{"osd":9,"uuid":"c9179f33-622d-44bd-9d8a-c92951afb1e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6827","nonce":3230873673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6829","nonce":3230873673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6833","nonce":3230873673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6831","nonce":3230873673}]},"public_addr":"172.21.15.84:6827/3230873673","cluster_addr":"172.21.15.84:6829/3230873673","heartbeat_back_addr":"172.21.15.84:6833/3230873673","heartbeat_front_addr":"172.21.15.84:6831/3230873673","state":["exists","up"]},{"osd":10,"uuid":"9788fa2d-49fb-431b-a0e3-62d6e421e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6825","nonce":2667099391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6827","nonce":2667099391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6831","nonce":2667099391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6829","nonce":2667099391}]},"public_addr":"172.21.15.172:6825/2667099391","cluster_addr":"172.21.15.172:6827/2667099391","heartbeat_back_addr":"172.21.15.172:6831/2667099391","heartbeat_front_addr":"172.21.15.172:6829/2667099391","state":["exists","up"]},{"osd":11,"uuid":"a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6825","nonce":3452825924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6827","nonce":3452825924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6831","nonce":3452825924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6829","nonce":3452825924}]},"public_addr":"172.21.15.174:6825/3452825924","cluster_addr":"172.21.15.174:6827/3452825924","heartbeat_back_addr":"172.21.15.174:6831/3452825924","heartbeat_front_addr":"172.21.15.174:6829/3452825924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:34:57.413946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:22.813846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:47.074625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:12.871112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:38.705563+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:04.277966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:29.661290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:55.475432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:20.644247+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:46.151594+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:11.499623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:36.688459+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6800/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3308084314":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3663660709":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/1794153935":"2024-09-22T03:32:49.459372+0000","172.21.15.84:6800/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6800/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1874814897":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6801/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/390051797":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/2148206075":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1916019809":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6801/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3491731835":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3418048965":"2024-09-22T03:33:50.188998+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:42:27.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.879+0000 7f1ed337f640 1 -- 172.21.15.84:0/3275579851 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1eb80b65f0 msgr2=0x7f1eb80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:27.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.879+0000 7f1ed337f640 1 --2- 172.21.15.84:0/3275579851 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1eb80b65f0 0x7f1eb80b8b00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009b40 tx=0x7f1ebc005e50 comp rx=0 tx=0).stop 2024-09-21T03:42:27.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.879+0000 7f1ed337f640 1 -- 172.21.15.84:0/3275579851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ecc108cf0 msgr2=0x7f1ecc19fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:27.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.879+0000 7f1ed337f640 1 --2- 172.21.15.84:0/3275579851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ecc108cf0 0x7f1ecc19fc20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4005cc0 tx=0x7f1ec402f380 comp rx=0 tx=0).stop 2024-09-21T03:42:27.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.879+0000 7f1ed337f640 1 -- 172.21.15.84:0/3275579851 shutdown_connections 2024-09-21T03:42:27.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.880+0000 7f1ed337f640 1 --2- 172.21.15.84:0/3275579851 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1eb80b65f0 0x7f1eb80b8b00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:27.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.880+0000 7f1ed337f640 1 --2- 172.21.15.84:0/3275579851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1ecc108cf0 0x7f1ecc19fc20 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:27.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.880+0000 7f1ed337f640 1 --2- 172.21.15.84:0/3275579851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ecc1083a0 0x7f1ecc19a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:27.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.880+0000 7f1ed337f640 1 --2- 172.21.15.84:0/3275579851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1ecc102a60 0x7f1ecc19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:27.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.880+0000 7f1ed337f640 1 -- 172.21.15.84:0/3275579851 >> 172.21.15.84:0/3275579851 conn(0x7f1ecc079720 msgr2=0x7f1ecc101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:27.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.880+0000 7f1ed337f640 1 -- 172.21.15.84:0/3275579851 shutdown_connections 2024-09-21T03:42:27.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:27.880+0000 7f1ed337f640 1 -- 172.21.15.84:0/3275579851 wait complete. 2024-09-21T03:42:28.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:28 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3275579851' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:42:28.726 DEBUG:tasks.fwd_scrub:Yielding 2024-09-21T03:42:28.726 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T03:42:28.737 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T03:42:28.737 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T03:42:28.737 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-21T03:42:28.737 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-21T03:42:28.737 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:42:28.737 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:42:28.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.852+0000 7fe052a70640 1 -- 172.21.15.84:0/4022298037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe04c109d50 msgr2=0x7fe04c110580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:28.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.852+0000 7fe052a70640 1 --2- 172.21.15.84:0/4022298037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe04c109d50 0x7fe04c110580 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe044009ca0 tx=0x7fe04402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:42:28.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.852+0000 7fe052a70640 1 -- 172.21.15.84:0/4022298037 shutdown_connections 2024-09-21T03:42:28.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.852+0000 7fe052a70640 1 --2- 172.21.15.84:0/4022298037 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe04c109d50 0x7fe04c110580 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:28.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.852+0000 7fe052a70640 1 --2- 172.21.15.84:0/4022298037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe04c109400 0x7fe04c109810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:28.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.852+0000 7fe052a70640 1 --2- 172.21.15.84:0/4022298037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe04c103ad0 0x7fe04c103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:28.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.852+0000 7fe052a70640 1 -- 172.21.15.84:0/4022298037 >> 172.21.15.84:0/4022298037 conn(0x7fe04c0ff510 msgr2=0x7fe04c101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:28.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.852+0000 7fe052a70640 1 -- 172.21.15.84:0/4022298037 shutdown_connections 2024-09-21T03:42:28.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.852+0000 7fe052a70640 1 -- 172.21.15.84:0/4022298037 wait complete. 2024-09-21T03:42:28.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.852+0000 7fe052a70640 1 Processor -- start 2024-09-21T03:42:28.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.853+0000 7fe052a70640 1 -- start start 2024-09-21T03:42:28.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.853+0000 7fe052a70640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe04c103ad0 0x7fe04c19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:28.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.853+0000 7fe052a70640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe04c109400 0x7fe04c19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:28.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.853+0000 7fe052a70640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe04c109d50 0x7fe04c19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:28.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.853+0000 7fe052a70640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c113a10 con 0x7fe04c109400 2024-09-21T03:42:28.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.853+0000 7fe052a70640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c113890 con 0x7fe04c103ad0 2024-09-21T03:42:28.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.853+0000 7fe052a70640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe04c113b90 con 0x7fe04c109d50 2024-09-21T03:42:28.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.853+0000 7fe04bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe04c109400 0x7fe04c19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:28.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.853+0000 7fe04bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe04c109400 0x7fe04c19a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38956/0 (socket says 172.21.15.84:38956) 2024-09-21T03:42:28.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.853+0000 7fe04bfff640 1 -- 172.21.15.84:0/358612825 learned_addr learned my addr 172.21.15.84:0/358612825 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:28.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.853+0000 7fe05080c640 1 --2- 172.21.15.84:0/358612825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe04c103ad0 0x7fe04c19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:28.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.853+0000 7fe05100d640 1 --2- 172.21.15.84:0/358612825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe04c109d50 0x7fe04c19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:28.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.853+0000 7fe04bfff640 1 -- 172.21.15.84:0/358612825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe04c109d50 msgr2=0x7fe04c19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.853+0000 7fe04bfff640 1 --2- 172.21.15.84:0/358612825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe04c109d50 0x7fe04c19fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.853+0000 7fe04bfff640 1 -- 172.21.15.84:0/358612825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe04c103ad0 msgr2=0x7fe04c19a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.853+0000 7fe04bfff640 1 --2- 172.21.15.84:0/358612825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe04c103ad0 0x7fe04c19a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.853+0000 7fe04bfff640 1 -- 172.21.15.84:0/358612825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04c1a0340 con 0x7fe04c109400 2024-09-21T03:42:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.853+0000 7fe05080c640 1 --2- 172.21.15.84:0/358612825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe04c103ad0 0x7fe04c19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.853+0000 7fe05100d640 1 --2- 172.21.15.84:0/358612825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe04c109d50 0x7fe04c19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.853+0000 7fe04bfff640 1 --2- 172.21.15.84:0/358612825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe04c109400 0x7fe04c19a9b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe03800d950 tx=0x7fe03800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.854+0000 7fe049ffb640 1 -- 172.21.15.84:0/358612825 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe038017070 con 0x7fe04c109400 2024-09-21T03:42:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.854+0000 7fe052a70640 1 -- 172.21.15.84:0/358612825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe04c1a0630 con 0x7fe04c109400 2024-09-21T03:42:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.854+0000 7fe049ffb640 1 -- 172.21.15.84:0/358612825 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe038009c30 con 0x7fe04c109400 2024-09-21T03:42:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.854+0000 7fe049ffb640 1 -- 172.21.15.84:0/358612825 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0380047a0 con 0x7fe04c109400 2024-09-21T03:42:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.854+0000 7fe052a70640 1 -- 172.21.15.84:0/358612825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe04c1a6dc0 con 0x7fe04c109400 2024-09-21T03:42:28.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.855+0000 7fe052a70640 1 -- 172.21.15.84:0/358612825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe04c103ee0 con 0x7fe04c109400 2024-09-21T03:42:28.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.856+0000 7fe049ffb640 1 -- 172.21.15.84:0/358612825 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7fe038004020 con 0x7fe04c109400 2024-09-21T03:42:28.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.857+0000 7fe049ffb640 1 --2- 172.21.15.84:0/358612825 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe03c0b65f0 0x7fe03c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:28.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.858+0000 7fe05080c640 1 --2- 172.21.15.84:0/358612825 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe03c0b65f0 0x7fe03c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:28.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.858+0000 7fe049ffb640 1 -- 172.21.15.84:0/358612825 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe0380e72e0 con 0x7fe04c109400 2024-09-21T03:42:28.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.858+0000 7fe05080c640 1 --2- 172.21.15.84:0/358612825 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe03c0b65f0 0x7fe03c0b8b00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe040009b40 tx=0x7fe040005e50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:28.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:28.862+0000 7fe049ffb640 1 -- 172.21.15.84:0/358612825 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe038020020 con 0x7fe04c109400 2024-09-21T03:42:28.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:28 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3275579851' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:42:28.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:28 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3275579851' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:42:28.997 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:29.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.082+0000 7fe052a70640 1 -- 172.21.15.84:0/358612825 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fe04c063800 con 0x7fe03c0b65f0 2024-09-21T03:42:29.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.242+0000 7fe049ffb640 1 -- 172.21.15.84:0/358612825 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe04c063800 con 0x7fe03c0b65f0 2024-09-21T03:42:29.244 INFO:teuthology.orchestra.run.smithi084.stdout:Schedule set for path / 2024-09-21T03:42:29.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.244+0000 7fe052a70640 1 -- 172.21.15.84:0/358612825 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe03c0b65f0 msgr2=0x7fe03c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.244+0000 7fe052a70640 1 --2- 172.21.15.84:0/358612825 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe03c0b65f0 0x7fe03c0b8b00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe040009b40 tx=0x7fe040005e50 comp rx=0 tx=0).stop 2024-09-21T03:42:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.244+0000 7fe052a70640 1 -- 172.21.15.84:0/358612825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe04c109400 msgr2=0x7fe04c19a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.244+0000 7fe052a70640 1 --2- 172.21.15.84:0/358612825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe04c109400 0x7fe04c19a9b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe03800d950 tx=0x7fe03800de10 comp rx=0 tx=0).stop 2024-09-21T03:42:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.244+0000 7fe052a70640 1 -- 172.21.15.84:0/358612825 shutdown_connections 2024-09-21T03:42:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.245+0000 7fe052a70640 1 --2- 172.21.15.84:0/358612825 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe03c0b65f0 0x7fe03c0b8b00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.245+0000 7fe052a70640 1 --2- 172.21.15.84:0/358612825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe04c109d50 0x7fe04c19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.245+0000 7fe052a70640 1 --2- 172.21.15.84:0/358612825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe04c109400 0x7fe04c19a9b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.245+0000 7fe052a70640 1 --2- 172.21.15.84:0/358612825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe04c103ad0 0x7fe04c19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.245+0000 7fe052a70640 1 -- 172.21.15.84:0/358612825 >> 172.21.15.84:0/358612825 conn(0x7fe04c0ff510 msgr2=0x7fe04c101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.245+0000 7fe052a70640 1 -- 172.21.15.84:0/358612825 shutdown_connections 2024-09-21T03:42:29.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.245+0000 7fe052a70640 1 -- 172.21.15.84:0/358612825 wait complete. 2024-09-21T03:42:29.258 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-21T03:42:29.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.375+0000 7efe53b89640 1 -- 172.21.15.84:0/1364333996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe4c108310 msgr2=0x7efe4c108720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:29.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.375+0000 7efe53b89640 1 --2- 172.21.15.84:0/1364333996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe4c108310 0x7efe4c108720 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efe3c009900 tx=0x7efe3c02a410 comp rx=0 tx=0).stop 2024-09-21T03:42:29.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.375+0000 7efe53b89640 1 -- 172.21.15.84:0/1364333996 shutdown_connections 2024-09-21T03:42:29.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.375+0000 7efe53b89640 1 --2- 172.21.15.84:0/1364333996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe4c108c60 0x7efe4c10f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.375+0000 7efe53b89640 1 --2- 172.21.15.84:0/1364333996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe4c108310 0x7efe4c108720 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.375+0000 7efe53b89640 1 --2- 172.21.15.84:0/1364333996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe4c1029e0 0x7efe4c102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.375+0000 7efe53b89640 1 -- 172.21.15.84:0/1364333996 >> 172.21.15.84:0/1364333996 conn(0x7efe4c0fe3c0 msgr2=0x7efe4c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:29.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.375+0000 7efe53b89640 1 -- 172.21.15.84:0/1364333996 shutdown_connections 2024-09-21T03:42:29.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.375+0000 7efe53b89640 1 -- 172.21.15.84:0/1364333996 wait complete. 2024-09-21T03:42:29.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.375+0000 7efe53b89640 1 Processor -- start 2024-09-21T03:42:29.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.376+0000 7efe53b89640 1 -- start start 2024-09-21T03:42:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.376+0000 7efe53b89640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe4c1029e0 0x7efe4c199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.376+0000 7efe53b89640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe4c108310 0x7efe4c199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.376+0000 7efe53b89640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe4c108c60 0x7efe4c19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.376+0000 7efe53b89640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efe4c112920 con 0x7efe4c108310 2024-09-21T03:42:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.376+0000 7efe53b89640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efe4c1127a0 con 0x7efe4c108c60 2024-09-21T03:42:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.376+0000 7efe53b89640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efe4c112aa0 con 0x7efe4c1029e0 2024-09-21T03:42:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.376+0000 7efe51124640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe4c108310 0x7efe4c199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.376+0000 7efe51124640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe4c108310 0x7efe4c199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:38994/0 (socket says 172.21.15.84:38994) 2024-09-21T03:42:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.376+0000 7efe51124640 1 -- 172.21.15.84:0/157118393 learned_addr learned my addr 172.21.15.84:0/157118393 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.376+0000 7efe51925640 1 --2- 172.21.15.84:0/157118393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe4c1029e0 0x7efe4c199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.376+0000 7efe52126640 1 --2- 172.21.15.84:0/157118393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe4c108c60 0x7efe4c19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.376+0000 7efe51124640 1 -- 172.21.15.84:0/157118393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe4c1029e0 msgr2=0x7efe4c199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.376+0000 7efe51124640 1 --2- 172.21.15.84:0/157118393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe4c1029e0 0x7efe4c199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.376+0000 7efe51124640 1 -- 172.21.15.84:0/157118393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe4c108c60 msgr2=0x7efe4c19eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.376+0000 7efe51124640 1 --2- 172.21.15.84:0/157118393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe4c108c60 0x7efe4c19eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.376+0000 7efe51124640 1 -- 172.21.15.84:0/157118393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4c19f290 con 0x7efe4c108310 2024-09-21T03:42:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.376+0000 7efe51124640 1 --2- 172.21.15.84:0/157118393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe4c108310 0x7efe4c199900 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7efe3c02a930 tx=0x7efe3c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.377+0000 7efe42ffd640 1 -- 172.21.15.84:0/157118393 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c046070 con 0x7efe4c108310 2024-09-21T03:42:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.377+0000 7efe53b89640 1 -- 172.21.15.84:0/157118393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe4c19f520 con 0x7efe4c108310 2024-09-21T03:42:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.377+0000 7efe42ffd640 1 -- 172.21.15.84:0/157118393 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe3c003aa0 con 0x7efe4c108310 2024-09-21T03:42:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.377+0000 7efe42ffd640 1 -- 172.21.15.84:0/157118393 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3c035050 con 0x7efe4c108310 2024-09-21T03:42:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.377+0000 7efe53b89640 1 -- 172.21.15.84:0/157118393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe4c06b9a0 con 0x7efe4c108310 2024-09-21T03:42:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.378+0000 7efe53b89640 1 -- 172.21.15.84:0/157118393 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe4c103c50 con 0x7efe4c108310 2024-09-21T03:42:29.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.379+0000 7efe42ffd640 1 -- 172.21.15.84:0/157118393 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7efe3c049070 con 0x7efe4c108310 2024-09-21T03:42:29.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.380+0000 7efe42ffd640 1 --2- 172.21.15.84:0/157118393 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efe380b65f0 0x7efe380b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.380+0000 7efe51925640 1 --2- 172.21.15.84:0/157118393 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efe380b65f0 0x7efe380b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.380+0000 7efe42ffd640 1 -- 172.21.15.84:0/157118393 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7efe3c109090 con 0x7efe4c108310 2024-09-21T03:42:29.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.380+0000 7efe51925640 1 --2- 172.21.15.84:0/157118393 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efe380b65f0 0x7efe380b8b00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efe4800bbe0 tx=0x7efe4800b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.384+0000 7efe42ffd640 1 -- 172.21.15.84:0/157118393 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efe3c0d3b00 con 0x7efe4c108310 2024-09-21T03:42:29.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.525+0000 7eff01fab640 1 -- 172.21.15.84:0/1881938881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efefc1083c0 msgr2=0x7efefc1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:29.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.525+0000 7eff01fab640 1 --2- 172.21.15.84:0/1881938881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efefc1083c0 0x7efefc1087d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7efef0009900 tx=0x7efef002a410 comp rx=0 tx=0).stop 2024-09-21T03:42:29.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.525+0000 7eff01fab640 1 -- 172.21.15.84:0/1881938881 shutdown_connections 2024-09-21T03:42:29.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.525+0000 7eff01fab640 1 --2- 172.21.15.84:0/1881938881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efefc108d10 0x7efefc10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.525+0000 7eff01fab640 1 --2- 172.21.15.84:0/1881938881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efefc1083c0 0x7efefc1087d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.525+0000 7eff01fab640 1 --2- 172.21.15.84:0/1881938881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efefc102a80 0x7efefc102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.525+0000 7eff01fab640 1 -- 172.21.15.84:0/1881938881 >> 172.21.15.84:0/1881938881 conn(0x7efefc079740 msgr2=0x7efefc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:29.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.525+0000 7eff01fab640 1 -- 172.21.15.84:0/1881938881 shutdown_connections 2024-09-21T03:42:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.526+0000 7eff01fab640 1 -- 172.21.15.84:0/1881938881 wait complete. 2024-09-21T03:42:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.526+0000 7eff01fab640 1 Processor -- start 2024-09-21T03:42:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.526+0000 7eff01fab640 1 -- start start 2024-09-21T03:42:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.527+0000 7eff01fab640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efefc102a80 0x7efefc105100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.527+0000 7eff01fab640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efefc1083c0 0x7efefc105640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.527+0000 7eff01fab640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efefc108d10 0x7efefc105b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.527+0000 7eff01fab640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efefc112a40 con 0x7efefc1083c0 2024-09-21T03:42:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.527+0000 7eff01fab640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efefc1128c0 con 0x7efefc108d10 2024-09-21T03:42:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.527+0000 7eff01fab640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efefc112bc0 con 0x7efefc102a80 2024-09-21T03:42:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.527+0000 7efefaffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efefc1083c0 0x7efefc105640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.527+0000 7efefaffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efefc1083c0 0x7efefc105640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39008/0 (socket says 172.21.15.84:39008) 2024-09-21T03:42:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.527+0000 7efefaffd640 1 -- 172.21.15.84:0/322504283 learned_addr learned my addr 172.21.15.84:0/322504283 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.527+0000 7efefb7fe640 1 --2- 172.21.15.84:0/322504283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efefc102a80 0x7efefc105100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.527+0000 7efefbfff640 1 --2- 172.21.15.84:0/322504283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efefc108d10 0x7efefc105b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.527+0000 7efefaffd640 1 -- 172.21.15.84:0/322504283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efefc102a80 msgr2=0x7efefc105100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:29.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.527+0000 7efefaffd640 1 --2- 172.21.15.84:0/322504283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efefc102a80 0x7efefc105100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.527+0000 7efefaffd640 1 -- 172.21.15.84:0/322504283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efefc108d10 msgr2=0x7efefc105b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:29.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.527+0000 7efefaffd640 1 --2- 172.21.15.84:0/322504283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efefc108d10 0x7efefc105b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.527+0000 7efefaffd640 1 -- 172.21.15.84:0/322504283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efefc1a8890 con 0x7efefc1083c0 2024-09-21T03:42:29.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.527+0000 7efefaffd640 1 --2- 172.21.15.84:0/322504283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efefc1083c0 0x7efefc105640 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7efef0031a90 tx=0x7efef0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:29.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.528+0000 7efef8ff9640 1 -- 172.21.15.84:0/322504283 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef003f030 con 0x7efefc1083c0 2024-09-21T03:42:29.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.528+0000 7eff01fab640 1 -- 172.21.15.84:0/322504283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efefc1a8b20 con 0x7efefc1083c0 2024-09-21T03:42:29.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.528+0000 7efef8ff9640 1 -- 172.21.15.84:0/322504283 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efef0004490 con 0x7efefc1083c0 2024-09-21T03:42:29.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.528+0000 7efef8ff9640 1 -- 172.21.15.84:0/322504283 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef0035070 con 0x7efefc1083c0 2024-09-21T03:42:29.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.528+0000 7eff01fab640 1 -- 172.21.15.84:0/322504283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efefc1a9000 con 0x7efefc1083c0 2024-09-21T03:42:29.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.530+0000 7eff0851f740 1 Processor -- start 2024-09-21T03:42:29.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.531+0000 7eff0851f740 1 -- start start 2024-09-21T03:42:29.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.531+0000 7efef8ff9640 1 -- 172.21.15.84:0/322504283 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7efef0042030 con 0x7efefc1083c0 2024-09-21T03:42:29.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.531+0000 7eff0851f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db623c350 0x560db65e3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.531+0000 7eff0851f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db6213490 0x560db65e3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.531+0000 7eff0851f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db621b670 0x560db65e3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.531+0000 7eff0851f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560db6559e60 con 0x560db6213490 2024-09-21T03:42:29.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.531+0000 7eff0851f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560db6549290 con 0x560db623c350 2024-09-21T03:42:29.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.531+0000 7eff0851f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560db654d0a0 con 0x560db621b670 2024-09-21T03:42:29.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.531+0000 7efefb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db6213490 0x560db65e3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.531+0000 7efefb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db6213490 0x560db65e3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39024/0 (socket says 172.21.15.84:39024) 2024-09-21T03:42:29.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.531+0000 7efefb7fe640 1 -- 172.21.15.84:0/1734985389 learned_addr learned my addr 172.21.15.84:0/1734985389 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:29.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.531+0000 7efefbfff640 1 --2- 172.21.15.84:0/1734985389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db623c350 0x560db65e3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.531+0000 7efefaffd640 1 --2- 172.21.15.84:0/1734985389 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db621b670 0x560db65e3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.531+0000 7efefb7fe640 1 -- 172.21.15.84:0/1734985389 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db621b670 msgr2=0x560db65e3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:29.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.531+0000 7efefb7fe640 1 --2- 172.21.15.84:0/1734985389 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db621b670 0x560db65e3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.531+0000 7efefb7fe640 1 -- 172.21.15.84:0/1734985389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db623c350 msgr2=0x560db65e3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:29.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.531+0000 7efefb7fe640 1 --2- 172.21.15.84:0/1734985389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db623c350 0x560db65e3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.531+0000 7efefb7fe640 1 -- 172.21.15.84:0/1734985389 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560db62a7930 con 0x560db6213490 2024-09-21T03:42:29.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.531+0000 7efefbfff640 1 --2- 172.21.15.84:0/1734985389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db623c350 0x560db65e3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:29.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.532+0000 7efef8ff9640 1 --2- 172.21.15.84:0/322504283 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efee40b65f0 0x7efee40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.532+0000 7efefb7fe640 1 --2- 172.21.15.84:0/1734985389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db6213490 0x560db65e3970 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7efeec009a40 tx=0x7efeec009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97a9ac4baa60555 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:29.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.532+0000 7efefbfff640 1 --2- 172.21.15.84:0/322504283 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efee40b65f0 0x7efee40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.532+0000 7efef8ff9640 1 -- 172.21.15.84:0/322504283 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7efef0107800 con 0x7efefc1083c0 2024-09-21T03:42:29.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.532+0000 7efee1ffb640 1 -- 172.21.15.84:0/1734985389 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec017070 con 0x560db6213490 2024-09-21T03:42:29.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.532+0000 7efee1ffb640 1 -- 172.21.15.84:0/1734985389 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efeec013470 con 0x560db6213490 2024-09-21T03:42:29.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.532+0000 7efee1ffb640 1 -- 172.21.15.84:0/1734985389 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec012610 con 0x560db6213490 2024-09-21T03:42:29.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.533+0000 7eff0851f740 1 -- 172.21.15.84:0/1734985389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db6213490 msgr2=0x560db65e3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:29.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.533+0000 7eff0851f740 1 --2- 172.21.15.84:0/1734985389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db6213490 0x560db65e3970 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7efeec009a40 tx=0x7efeec009f00 comp rx=0 tx=0).stop 2024-09-21T03:42:29.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.533+0000 7efefbfff640 1 --2- 172.21.15.84:0/322504283 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efee40b65f0 0x7efee40b8b00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efef4009fd0 tx=0x7efef400e040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:29.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.533+0000 7eff0851f740 1 -- 172.21.15.84:0/1734985389 shutdown_connections 2024-09-21T03:42:29.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.533+0000 7eff0851f740 1 --2- 172.21.15.84:0/1734985389 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db621b670 0x560db65e3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.533+0000 7eff0851f740 1 --2- 172.21.15.84:0/1734985389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db6213490 0x560db65e3970 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.533+0000 7eff0851f740 1 --2- 172.21.15.84:0/1734985389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db623c350 0x560db65e3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.533+0000 7eff0851f740 1 -- 172.21.15.84:0/1734985389 >> 172.21.15.84:0/1734985389 conn(0x560db6230740 msgr2=0x560db65e1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:29.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.533+0000 7eff0851f740 1 -- 172.21.15.84:0/1734985389 shutdown_connections 2024-09-21T03:42:29.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.533+0000 7eff0851f740 1 -- 172.21.15.84:0/1734985389 wait complete. 2024-09-21T03:42:29.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.533+0000 7eff0851f740 1 -- start start 2024-09-21T03:42:29.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.534+0000 7eff0851f740 1 Processor -- start 2024-09-21T03:42:29.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.534+0000 7eff0851f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db6213490 0x560db65ef080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.534+0000 7eff0851f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db621b670 0x560db65ef600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.534+0000 7eff0851f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db623c350 0x560db65faf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.534+0000 7eff0851f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560db63aa890 con 0x560db623c350 2024-09-21T03:42:29.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.534+0000 7eff0851f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560db64e3d40 con 0x560db6213490 2024-09-21T03:42:29.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.534+0000 7eff0851f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560db65f1c10 con 0x560db621b670 2024-09-21T03:42:29.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.534+0000 7eff0851f740 10 client.0 _ll_register_callbacks cb 0x560db6547c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.534+0000 7efefbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db623c350 0x560db65faf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.534+0000 7efefbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db623c350 0x560db65faf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39040/0 (socket says 172.21.15.84:39040) 2024-09-21T03:42:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.534+0000 7efefbfff640 1 -- 172.21.15.84:0/1223599256 learned_addr learned my addr 172.21.15.84:0/1223599256 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.534+0000 7efefaffd640 1 --2- 172.21.15.84:0/1223599256 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db621b670 0x560db65ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.534+0000 7efefb7fe640 1 --2- 172.21.15.84:0/1223599256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db6213490 0x560db65ef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.534+0000 7efefbfff640 1 -- 172.21.15.84:0/1223599256 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db621b670 msgr2=0x560db65ef600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.534+0000 7efefbfff640 1 --2- 172.21.15.84:0/1223599256 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db621b670 0x560db65ef600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.534+0000 7efefbfff640 1 -- 172.21.15.84:0/1223599256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db6213490 msgr2=0x560db65ef080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.534+0000 7efefbfff640 1 --2- 172.21.15.84:0/1223599256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db6213490 0x560db65ef080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.534+0000 7efefbfff640 1 -- 172.21.15.84:0/1223599256 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560db65fb540 con 0x560db623c350 2024-09-21T03:42:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.535+0000 7efefbfff640 1 --2- 172.21.15.84:0/1223599256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db623c350 0x560db65faf30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7efef4007e20 tx=0x7efef4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5fc36ddeafee228 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.535+0000 7efedaffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:42:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.535+0000 7efedaffd640 1 -- 172.21.15.84:0/1223599256 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4028060 con 0x560db623c350 2024-09-21T03:42:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.535+0000 7efedaffd640 1 -- 172.21.15.84:0/1223599256 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7efef4018da0 con 0x560db623c350 2024-09-21T03:42:29.548 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.535+0000 7eff0851f740 1 -- 172.21.15.84:0/1223599256 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efeec013470 con 0x560db623c350 2024-09-21T03:42:29.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.535+0000 7efedaffd640 1 -- 172.21.15.84:0/1223599256 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efef402d430 con 0x560db623c350 2024-09-21T03:42:29.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.535+0000 7eff0851f740 10 client.15501 fetch_fsmap learned FSMap version 25 2024-09-21T03:42:29.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.535+0000 7eff0851f740 1 -- 172.21.15.84:0/1223599256 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560db65fded0 con 0x560db623c350 2024-09-21T03:42:29.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.535+0000 7efedaffd640 1 -- 172.21.15.84:0/1223599256 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efeec013470 con 0x560db623c350 2024-09-21T03:42:29.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.535+0000 7efedaffd640 1 -- 172.21.15.84:0/1223599256 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efef4016070 con 0x560db623c350 2024-09-21T03:42:29.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.536+0000 7eff0851f740 10 client.15501 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:42:29.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.536+0000 7eff0851f740 10 client.15501 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:42:29.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.536+0000 7eff0851f740 20 client.15501 populate_metadata read hostname 'smithi084' 2024-09-21T03:42:29.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.536+0000 7eff0851f740 1 --2- 172.21.15.84:0/1223599256 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560db61facd0 0x560db6601400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.536+0000 7eff0851f740 4 client.15501 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:42:29.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.536+0000 7eff0851f740 1 -- 172.21.15.84:0/1223599256 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560db655bdb0 con 0x560db61facd0 2024-09-21T03:42:29.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.536+0000 7efefb7fe640 1 --2- 172.21.15.84:0/1223599256 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560db61facd0 0x560db6601400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.536+0000 7efefb7fe640 1 --2- 172.21.15.84:0/1223599256 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560db61facd0 0x560db6601400 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3668ee676c89b0d server_cookie=98f766bd511913ba in_seq=0 out_seq=0 2024-09-21T03:42:29.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.536+0000 7efedaffd640 10 client.15501 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:42:29.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.537+0000 7efedaffd640 1 -- 172.21.15.84:0/1223599256 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560db655bdb0 con 0x560db61facd0 2024-09-21T03:42:29.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.537+0000 7efedaffd640 10 client.15501 handle_command_reply: tid=0 2024-09-21T03:42:29.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.537+0000 7eff0851f740 1 client.15501 shutdown 2024-09-21T03:42:29.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.537+0000 7eff0851f740 1 -- 172.21.15.84:0/1223599256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db623c350 msgr2=0x560db65faf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:29.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.537+0000 7eff0851f740 1 --2- 172.21.15.84:0/1223599256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db623c350 0x560db65faf30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7efef4007e20 tx=0x7efef4004a40 comp rx=0 tx=0).stop 2024-09-21T03:42:29.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.537+0000 7eff0851f740 1 -- 172.21.15.84:0/1223599256 shutdown_connections 2024-09-21T03:42:29.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.537+0000 7eff0851f740 1 --2- 172.21.15.84:0/1223599256 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560db61facd0 0x560db6601400 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.537+0000 7eff0851f740 1 --2- 172.21.15.84:0/1223599256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db623c350 0x560db65faf30 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.537+0000 7eff0851f740 1 --2- 172.21.15.84:0/1223599256 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db621b670 0x560db65ef600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.537+0000 7eff0851f740 1 --2- 172.21.15.84:0/1223599256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db6213490 0x560db65ef080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.537+0000 7eff0851f740 1 -- 172.21.15.84:0/1223599256 >> 172.21.15.84:0/1223599256 conn(0x560db6230740 msgr2=0x560db65e65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:29.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.537+0000 7efedaffd640 0 client.15501 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:42:29.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.538+0000 7eff0851f740 1 -- 172.21.15.84:0/1223599256 shutdown_connections 2024-09-21T03:42:29.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.538+0000 7eff0851f740 1 -- 172.21.15.84:0/1223599256 wait complete. 2024-09-21T03:42:29.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.538+0000 7eff0851f740 20 client.15501 trim_cache size 0 max 16384 2024-09-21T03:42:29.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.555+0000 7eff0851f740 1 Processor -- start 2024-09-21T03:42:29.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.555+0000 7eff0851f740 1 -- start start 2024-09-21T03:42:29.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.555+0000 7eff0851f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db6213490 0x560db65e8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.555+0000 7eff0851f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db621b670 0x560db65e8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.555+0000 7eff0851f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db623c350 0x560db65e6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.555+0000 7eff0851f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efefc1b4110 con 0x560db623c350 2024-09-21T03:42:29.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.555+0000 7eff0851f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efefc1b19e0 con 0x560db6213490 2024-09-21T03:42:29.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.555+0000 7eff0851f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efefc1af850 con 0x560db621b670 2024-09-21T03:42:29.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.555+0000 7efefbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db623c350 0x560db65e6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.555+0000 7efefbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db623c350 0x560db65e6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39046/0 (socket says 172.21.15.84:39046) 2024-09-21T03:42:29.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.555+0000 7efefbfff640 1 -- 172.21.15.84:0/3293919969 learned_addr learned my addr 172.21.15.84:0/3293919969 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:29.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.555+0000 7efefb7fe640 1 --2- 172.21.15.84:0/3293919969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db6213490 0x560db65e8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.555+0000 7efefaffd640 1 --2- 172.21.15.84:0/3293919969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db621b670 0x560db65e8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.556+0000 7efefbfff640 1 -- 172.21.15.84:0/3293919969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db621b670 msgr2=0x560db65e8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:29.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.556+0000 7efefbfff640 1 --2- 172.21.15.84:0/3293919969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db621b670 0x560db65e8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.556+0000 7efefbfff640 1 -- 172.21.15.84:0/3293919969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db6213490 msgr2=0x560db65e8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:29.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.556+0000 7efefbfff640 1 --2- 172.21.15.84:0/3293919969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db6213490 0x560db65e8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.556+0000 7efefbfff640 1 -- 172.21.15.84:0/3293919969 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560db65e1860 con 0x560db623c350 2024-09-21T03:42:29.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.556+0000 7efefbfff640 1 --2- 172.21.15.84:0/3293919969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db623c350 0x560db65e6530 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7efef4004b90 tx=0x7efef4009730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7fcb058dd6ea1c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:29.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.556+0000 7efee17fa640 1 -- 172.21.15.84:0/3293919969 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4018c70 con 0x560db623c350 2024-09-21T03:42:29.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.556+0000 7efee17fa640 1 -- 172.21.15.84:0/3293919969 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efef4018e10 con 0x560db623c350 2024-09-21T03:42:29.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.556+0000 7efee17fa640 1 -- 172.21.15.84:0/3293919969 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4035630 con 0x560db623c350 2024-09-21T03:42:29.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.557+0000 7eff0851f740 1 -- 172.21.15.84:0/3293919969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db623c350 msgr2=0x560db65e6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:29.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.557+0000 7eff0851f740 1 --2- 172.21.15.84:0/3293919969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db623c350 0x560db65e6530 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7efef4004b90 tx=0x7efef4009730 comp rx=0 tx=0).stop 2024-09-21T03:42:29.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.557+0000 7eff0851f740 1 -- 172.21.15.84:0/3293919969 shutdown_connections 2024-09-21T03:42:29.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.557+0000 7eff0851f740 1 --2- 172.21.15.84:0/3293919969 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db623c350 0x560db65e6530 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.557+0000 7eff0851f740 1 --2- 172.21.15.84:0/3293919969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db621b670 0x560db65e8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.557+0000 7eff0851f740 1 --2- 172.21.15.84:0/3293919969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db6213490 0x560db65e8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.557+0000 7eff0851f740 1 -- 172.21.15.84:0/3293919969 >> 172.21.15.84:0/3293919969 conn(0x560db6230740 msgr2=0x560db65ed700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:29.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.557+0000 7eff0851f740 1 -- 172.21.15.84:0/3293919969 shutdown_connections 2024-09-21T03:42:29.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.557+0000 7eff0851f740 1 -- 172.21.15.84:0/3293919969 wait complete. 2024-09-21T03:42:29.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.557+0000 7eff0851f740 1 -- start start 2024-09-21T03:42:29.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.558+0000 7eff0851f740 1 Processor -- start 2024-09-21T03:42:29.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.558+0000 7eff0851f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db6213490 0x560db65f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.558+0000 7eff0851f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db621b670 0x560db65f3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.558+0000 7eff0851f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db623c350 0x560db666ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.558+0000 7eff0851f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efefc1afea0 con 0x560db621b670 2024-09-21T03:42:29.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.558+0000 7eff0851f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efefc1b1310 con 0x560db623c350 2024-09-21T03:42:29.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.558+0000 7eff0851f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efefc1b0570 con 0x560db6213490 2024-09-21T03:42:29.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.558+0000 7eff0851f740 10 client.0 _ll_register_callbacks cb 0x7efef4009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:29.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.558+0000 7efefaffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db621b670 0x560db65f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.558+0000 7efefaffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db621b670 0x560db65f3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39056/0 (socket says 172.21.15.84:39056) 2024-09-21T03:42:29.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.558+0000 7efefaffd640 1 -- 172.21.15.84:0/2516124137 learned_addr learned my addr 172.21.15.84:0/2516124137 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:29.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.558+0000 7efefb7fe640 1 --2- 172.21.15.84:0/2516124137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db6213490 0x560db65f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.558+0000 7efefbfff640 1 --2- 172.21.15.84:0/2516124137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db623c350 0x560db666ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.559+0000 7efefb7fe640 1 -- 172.21.15.84:0/2516124137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db623c350 msgr2=0x560db666ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:29.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.559+0000 7efefb7fe640 1 --2- 172.21.15.84:0/2516124137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db623c350 0x560db666ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.559+0000 7efefb7fe640 1 -- 172.21.15.84:0/2516124137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db621b670 msgr2=0x560db65f3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:29.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.559+0000 7efefb7fe640 1 --2- 172.21.15.84:0/2516124137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db621b670 0x560db65f3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.559+0000 7efefb7fe640 1 -- 172.21.15.84:0/2516124137 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560db65f3ff0 con 0x560db6213490 2024-09-21T03:42:29.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.559+0000 7efefaffd640 1 --2- 172.21.15.84:0/2516124137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db621b670 0x560db65f3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:42:29.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.559+0000 7efefb7fe640 1 --2- 172.21.15.84:0/2516124137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db6213490 0x560db65f31c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x560db65f16d0 tx=0x7efeec013e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=906d711840849a46 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:29.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.559+0000 7efedaffd640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-21T03:42:29.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.559+0000 7efedaffd640 1 -- 172.21.15.84:0/2516124137 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec017040 con 0x560db6213490 2024-09-21T03:42:29.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.559+0000 7eff0851f740 1 -- 172.21.15.84:0/2516124137 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efef4018e10 con 0x560db6213490 2024-09-21T03:42:29.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.559+0000 7efedaffd640 1 -- 172.21.15.84:0/2516124137 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7efeec005bc0 con 0x560db6213490 2024-09-21T03:42:29.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.559+0000 7efedaffd640 1 -- 172.21.15.84:0/2516124137 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efeec004680 con 0x560db6213490 2024-09-21T03:42:29.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.559+0000 7eff0851f740 10 client.25036 fetch_fsmap learned FSMap version 25 2024-09-21T03:42:29.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.559+0000 7eff0851f740 1 -- 172.21.15.84:0/2516124137 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560db666c430 con 0x560db6213490 2024-09-21T03:42:29.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.559+0000 7efedaffd640 1 -- 172.21.15.84:0/2516124137 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efef4018e10 con 0x560db6213490 2024-09-21T03:42:29.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.560+0000 7efedaffd640 1 -- 172.21.15.84:0/2516124137 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efeec0061e0 con 0x560db6213490 2024-09-21T03:42:29.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.560+0000 7eff0851f740 10 client.25036 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:42:29.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.560+0000 7eff0851f740 10 client.25036 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:42:29.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.560+0000 7eff0851f740 20 client.25036 populate_metadata read hostname 'smithi084' 2024-09-21T03:42:29.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.560+0000 7eff0851f740 1 --2- 172.21.15.84:0/2516124137 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560db61d0080 0x560db666e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.560+0000 7eff0851f740 4 client.25036 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:42:29.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.560+0000 7eff0851f740 1 -- 172.21.15.84:0/2516124137 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560db6557860 con 0x560db61d0080 2024-09-21T03:42:29.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.560+0000 7efefaffd640 1 --2- 172.21.15.84:0/2516124137 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560db61d0080 0x560db666e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.560+0000 7efedaffd640 10 client.25036 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:42:29.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.560+0000 7efefaffd640 1 --2- 172.21.15.84:0/2516124137 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560db61d0080 0x560db666e940 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2681c20f07d07022 server_cookie=6a4bd2ec06db717f in_seq=0 out_seq=0 2024-09-21T03:42:29.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.562+0000 7efedaffd640 1 -- 172.21.15.84:0/2516124137 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560db6557860 con 0x560db61d0080 2024-09-21T03:42:29.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.562+0000 7efedaffd640 10 client.25036 handle_command_reply: tid=0 2024-09-21T03:42:29.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.562+0000 7eff0851f740 1 client.25036 shutdown 2024-09-21T03:42:29.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.562+0000 7eff0851f740 1 -- 172.21.15.84:0/2516124137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db6213490 msgr2=0x560db65f31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:29.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.562+0000 7eff0851f740 1 --2- 172.21.15.84:0/2516124137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db6213490 0x560db65f31c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x560db65f16d0 tx=0x7efeec013e20 comp rx=0 tx=0).stop 2024-09-21T03:42:29.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.562+0000 7eff0851f740 1 -- 172.21.15.84:0/2516124137 shutdown_connections 2024-09-21T03:42:29.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.562+0000 7eff0851f740 1 --2- 172.21.15.84:0/2516124137 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560db61d0080 0x560db666e940 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.562+0000 7eff0851f740 1 --2- 172.21.15.84:0/2516124137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560db623c350 0x560db666ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.562+0000 7eff0851f740 1 --2- 172.21.15.84:0/2516124137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560db621b670 0x560db65f3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.562+0000 7eff0851f740 1 --2- 172.21.15.84:0/2516124137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560db6213490 0x560db65f31c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.562+0000 7eff0851f740 1 -- 172.21.15.84:0/2516124137 >> 172.21.15.84:0/2516124137 conn(0x560db6230740 msgr2=0x560db65f0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:29.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.563+0000 7efedaffd640 0 client.25036 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:42:29.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.563+0000 7eff0851f740 1 -- 172.21.15.84:0/2516124137 shutdown_connections 2024-09-21T03:42:29.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.563+0000 7eff0851f740 1 -- 172.21.15.84:0/2516124137 wait complete. 2024-09-21T03:42:29.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.563+0000 7eff0851f740 20 client.25036 trim_cache size 0 max 16384 2024-09-21T03:42:29.568 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:42:29.568 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T03:42:29.568 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "e42cb821-db94-475b-a21a-8d8d086f7207", 2024-09-21T03:42:29.568 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T03:42:29.569 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:42:29.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.563+0000 7eff01fab640 1 -- 172.21.15.84:0/322504283 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efee40b65f0 msgr2=0x7efee40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:29.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.563+0000 7eff01fab640 1 --2- 172.21.15.84:0/322504283 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efee40b65f0 0x7efee40b8b00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efef4009fd0 tx=0x7efef400e040 comp rx=0 tx=0).stop 2024-09-21T03:42:29.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.563+0000 7eff01fab640 1 -- 172.21.15.84:0/322504283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efefc1083c0 msgr2=0x7efefc105640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:29.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.563+0000 7eff01fab640 1 --2- 172.21.15.84:0/322504283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efefc1083c0 0x7efefc105640 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7efef0031a90 tx=0x7efef0004270 comp rx=0 tx=0).stop 2024-09-21T03:42:29.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.564+0000 7eff01fab640 1 -- 172.21.15.84:0/322504283 shutdown_connections 2024-09-21T03:42:29.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.564+0000 7eff01fab640 1 --2- 172.21.15.84:0/322504283 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efee40b65f0 0x7efee40b8b00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.564+0000 7eff01fab640 1 --2- 172.21.15.84:0/322504283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efefc108d10 0x7efefc105b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.564+0000 7eff01fab640 1 --2- 172.21.15.84:0/322504283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efefc1083c0 0x7efefc105640 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.564+0000 7eff01fab640 1 --2- 172.21.15.84:0/322504283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efefc102a80 0x7efefc105100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.564+0000 7eff01fab640 1 -- 172.21.15.84:0/322504283 >> 172.21.15.84:0/322504283 conn(0x7efefc079740 msgr2=0x7efefc06bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:29.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.564+0000 7eff01fab640 1 -- 172.21.15.84:0/322504283 shutdown_connections 2024-09-21T03:42:29.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.564+0000 7eff01fab640 1 -- 172.21.15.84:0/322504283 wait complete. 2024-09-21T03:42:29.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.607+0000 7efe53b89640 1 -- 172.21.15.84:0/157118393 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7efe4c105170 con 0x7efe380b65f0 2024-09-21T03:42:29.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.671+0000 7efe42ffd640 1 -- 172.21.15.84:0/157118393 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7efe4c105170 con 0x7efe380b65f0 2024-09-21T03:42:29.673 INFO:teuthology.orchestra.run.smithi084.stdout:Retention added to path / 2024-09-21T03:42:29.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.673+0000 7efe53b89640 1 -- 172.21.15.84:0/157118393 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efe380b65f0 msgr2=0x7efe380b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:29.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.673+0000 7efe53b89640 1 --2- 172.21.15.84:0/157118393 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efe380b65f0 0x7efe380b8b00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efe4800bbe0 tx=0x7efe4800b390 comp rx=0 tx=0).stop 2024-09-21T03:42:29.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.673+0000 7efe53b89640 1 -- 172.21.15.84:0/157118393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe4c108310 msgr2=0x7efe4c199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:29.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.673+0000 7efe53b89640 1 --2- 172.21.15.84:0/157118393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe4c108310 0x7efe4c199900 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7efe3c02a930 tx=0x7efe3c004270 comp rx=0 tx=0).stop 2024-09-21T03:42:29.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.673+0000 7efe53b89640 1 -- 172.21.15.84:0/157118393 shutdown_connections 2024-09-21T03:42:29.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.673+0000 7efe53b89640 1 --2- 172.21.15.84:0/157118393 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efe380b65f0 0x7efe380b8b00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.673+0000 7efe53b89640 1 --2- 172.21.15.84:0/157118393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe4c108c60 0x7efe4c19eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.673+0000 7efe53b89640 1 --2- 172.21.15.84:0/157118393 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe4c108310 0x7efe4c199900 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.673+0000 7efe53b89640 1 --2- 172.21.15.84:0/157118393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe4c1029e0 0x7efe4c199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.673+0000 7efe53b89640 1 -- 172.21.15.84:0/157118393 >> 172.21.15.84:0/157118393 conn(0x7efe4c0fe3c0 msgr2=0x7efe4c104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:29.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.674+0000 7efe53b89640 1 -- 172.21.15.84:0/157118393 shutdown_connections 2024-09-21T03:42:29.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.674+0000 7efe53b89640 1 -- 172.21.15.84:0/157118393 wait complete. 2024-09-21T03:42:29.685 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:29 smithi084 ceph-mon[30941]: pgmap v324: 97 pgs: 97 active+clean; 650 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-21T03:42:29.687 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T03:42:29.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.796+0000 7f13ef0f4640 1 -- 172.21.15.84:0/3842884424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e81082e0 msgr2=0x7f13e81086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:29.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.796+0000 7f13ef0f4640 1 --2- 172.21.15.84:0/3842884424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e81082e0 0x7f13e81086f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009900 tx=0x7f13dc02a410 comp rx=0 tx=0).stop 2024-09-21T03:42:29.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.796+0000 7f13ef0f4640 1 -- 172.21.15.84:0/3842884424 shutdown_connections 2024-09-21T03:42:29.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.796+0000 7f13ef0f4640 1 --2- 172.21.15.84:0/3842884424 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13e8108c30 0x7f13e810f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.796+0000 7f13ef0f4640 1 --2- 172.21.15.84:0/3842884424 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e81082e0 0x7f13e81086f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.796+0000 7f13ef0f4640 1 --2- 172.21.15.84:0/3842884424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13e81029b0 0x7f13e8102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.796+0000 7f13ef0f4640 1 -- 172.21.15.84:0/3842884424 >> 172.21.15.84:0/3842884424 conn(0x7f13e807a740 msgr2=0x7f13e807ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:29.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.796+0000 7f13ef0f4640 1 -- 172.21.15.84:0/3842884424 shutdown_connections 2024-09-21T03:42:29.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.796+0000 7f13ef0f4640 1 -- 172.21.15.84:0/3842884424 wait complete. 2024-09-21T03:42:29.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.797+0000 7f13ef0f4640 1 Processor -- start 2024-09-21T03:42:29.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.797+0000 7f13ef0f4640 1 -- start start 2024-09-21T03:42:29.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.797+0000 7f13ef0f4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13e81029b0 0x7f13e819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.797+0000 7f13ef0f4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13e81082e0 0x7f13e819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.797+0000 7f13ef0f4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e8108c30 0x7f13e819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.797+0000 7f13ef0f4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f13e81128f0 con 0x7f13e8108c30 2024-09-21T03:42:29.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.797+0000 7f13ef0f4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f13e8112770 con 0x7f13e81029b0 2024-09-21T03:42:29.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.797+0000 7f13ef0f4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f13e8112a70 con 0x7f13e81082e0 2024-09-21T03:42:29.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.797+0000 7f13ed691640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e8108c30 0x7f13e819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.797+0000 7f13ed691640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e8108c30 0x7f13e819fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39070/0 (socket says 172.21.15.84:39070) 2024-09-21T03:42:29.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.797+0000 7f13ed691640 1 -- 172.21.15.84:0/1763433583 learned_addr learned my addr 172.21.15.84:0/1763433583 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:29.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.797+0000 7f13ece90640 1 --2- 172.21.15.84:0/1763433583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13e81029b0 0x7f13e819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.798+0000 7f13e7fff640 1 --2- 172.21.15.84:0/1763433583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13e81082e0 0x7f13e819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.798+0000 7f13ed691640 1 -- 172.21.15.84:0/1763433583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13e81082e0 msgr2=0x7f13e819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:29.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.798+0000 7f13ed691640 1 --2- 172.21.15.84:0/1763433583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13e81082e0 0x7f13e819a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.798+0000 7f13ed691640 1 -- 172.21.15.84:0/1763433583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13e81029b0 msgr2=0x7f13e819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:29.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.798+0000 7f13ed691640 1 --2- 172.21.15.84:0/1763433583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13e81029b0 0x7f13e819a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:29.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.798+0000 7f13ed691640 1 -- 172.21.15.84:0/1763433583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e81a0370 con 0x7f13e8108c30 2024-09-21T03:42:29.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.798+0000 7f13ed691640 1 --2- 172.21.15.84:0/1763433583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e8108c30 0x7f13e819fc70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f13e000e970 tx=0x7f13e000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:29.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.798+0000 7f13e5ffb640 1 -- 172.21.15.84:0/1763433583 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e000ccc0 con 0x7f13e8108c30 2024-09-21T03:42:29.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.798+0000 7f13e5ffb640 1 -- 172.21.15.84:0/1763433583 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13e000ce60 con 0x7f13e8108c30 2024-09-21T03:42:29.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.798+0000 7f13ef0f4640 1 -- 172.21.15.84:0/1763433583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e81a0660 con 0x7f13e8108c30 2024-09-21T03:42:29.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.798+0000 7f13e5ffb640 1 -- 172.21.15.84:0/1763433583 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e0010430 con 0x7f13e8108c30 2024-09-21T03:42:29.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.798+0000 7f13ef0f4640 1 -- 172.21.15.84:0/1763433583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e81a6df0 con 0x7f13e8108c30 2024-09-21T03:42:29.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.799+0000 7f13ef0f4640 1 -- 172.21.15.84:0/1763433583 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e8102dc0 con 0x7f13e8108c30 2024-09-21T03:42:29.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.800+0000 7f13e5ffb640 1 -- 172.21.15.84:0/1763433583 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7f13e0004f90 con 0x7f13e8108c30 2024-09-21T03:42:29.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.801+0000 7f13e5ffb640 1 --2- 172.21.15.84:0/1763433583 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f13d00b65f0 0x7f13d00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:29.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.801+0000 7f13ece90640 1 --2- 172.21.15.84:0/1763433583 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f13d00b65f0 0x7f13d00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:29.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.801+0000 7f13e5ffb640 1 -- 172.21.15.84:0/1763433583 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f13e00e7a10 con 0x7f13e8108c30 2024-09-21T03:42:29.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.802+0000 7f13ece90640 1 --2- 172.21.15.84:0/1763433583 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f13d00b65f0 0x7f13d00b8b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f13d8005fd0 tx=0x7f13d8009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:29.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:29.805+0000 7f13e5ffb640 1 -- 172.21.15.84:0/1763433583 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f13e00ae0a0 con 0x7f13e8108c30 2024-09-21T03:42:29.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:29 smithi174 ceph-mon[34403]: pgmap v324: 97 pgs: 97 active+clean; 650 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-21T03:42:29.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:29 smithi172 ceph-mon[34821]: pgmap v324: 97 pgs: 97 active+clean; 650 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-09-21T03:42:30.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.010+0000 7f13ef0f4640 1 -- 172.21.15.84:0/1763433583 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f13e81060d0 con 0x7f13d00b65f0 2024-09-21T03:42:30.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.017+0000 7f13e5ffb640 1 -- 172.21.15.84:0/1763433583 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f13e81060d0 con 0x7f13d00b65f0 2024-09-21T03:42:30.019 INFO:teuthology.orchestra.run.smithi084.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T03:42:29", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-21T03:42:30.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.019+0000 7f13ef0f4640 1 -- 172.21.15.84:0/1763433583 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f13d00b65f0 msgr2=0x7f13d00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:30.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.019+0000 7f13ef0f4640 1 --2- 172.21.15.84:0/1763433583 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f13d00b65f0 0x7f13d00b8b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f13d8005fd0 tx=0x7f13d8009500 comp rx=0 tx=0).stop 2024-09-21T03:42:30.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.019+0000 7f13ef0f4640 1 -- 172.21.15.84:0/1763433583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e8108c30 msgr2=0x7f13e819fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:30.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.019+0000 7f13ef0f4640 1 --2- 172.21.15.84:0/1763433583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e8108c30 0x7f13e819fc70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f13e000e970 tx=0x7f13e000ed70 comp rx=0 tx=0).stop 2024-09-21T03:42:30.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.019+0000 7f13ef0f4640 1 -- 172.21.15.84:0/1763433583 shutdown_connections 2024-09-21T03:42:30.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.019+0000 7f13ef0f4640 1 --2- 172.21.15.84:0/1763433583 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f13d00b65f0 0x7f13d00b8b00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:30.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.019+0000 7f13ef0f4640 1 --2- 172.21.15.84:0/1763433583 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f13e8108c30 0x7f13e819fc70 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:30.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.019+0000 7f13ef0f4640 1 --2- 172.21.15.84:0/1763433583 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f13e81082e0 0x7f13e819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:30.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.019+0000 7f13ef0f4640 1 --2- 172.21.15.84:0/1763433583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13e81029b0 0x7f13e819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:30.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.019+0000 7f13ef0f4640 1 -- 172.21.15.84:0/1763433583 >> 172.21.15.84:0/1763433583 conn(0x7f13e807a740 msgr2=0x7f13e8101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:30.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.019+0000 7f13ef0f4640 1 -- 172.21.15.84:0/1763433583 shutdown_connections 2024-09-21T03:42:30.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.019+0000 7f13ef0f4640 1 -- 172.21.15.84:0/1763433583 wait complete. 2024-09-21T03:42:30.032 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T03:42:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.141+0000 7f11213b0640 1 -- 172.21.15.84:0/949241633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f111c105280 msgr2=0x7f111c10d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.141+0000 7f11213b0640 1 --2- 172.21.15.84:0/949241633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f111c105280 0x7f111c10d7c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1104009900 tx=0x7f110402a410 comp rx=0 tx=0).stop 2024-09-21T03:42:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.142+0000 7f11213b0640 1 -- 172.21.15.84:0/949241633 shutdown_connections 2024-09-21T03:42:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.142+0000 7f11213b0640 1 --2- 172.21.15.84:0/949241633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f111c10dd90 0x7f111c110280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.142+0000 7f11213b0640 1 --2- 172.21.15.84:0/949241633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f111c105280 0x7f111c10d7c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.142+0000 7f11213b0640 1 --2- 172.21.15.84:0/949241633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f111c104930 0x7f111c104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.142+0000 7f11213b0640 1 -- 172.21.15.84:0/949241633 >> 172.21.15.84:0/949241633 conn(0x7f111c0fe3c0 msgr2=0x7f111c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.142+0000 7f11213b0640 1 -- 172.21.15.84:0/949241633 shutdown_connections 2024-09-21T03:42:30.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.142+0000 7f11213b0640 1 -- 172.21.15.84:0/949241633 wait complete. 2024-09-21T03:42:30.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.142+0000 7f11213b0640 1 Processor -- start 2024-09-21T03:42:30.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.142+0000 7f11213b0640 1 -- start start 2024-09-21T03:42:30.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.143+0000 7f11213b0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f111c104930 0x7f111c102660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.143+0000 7f11213b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f111c105280 0x7f111c102ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.143+0000 7f11213b0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f111c10dd90 0x7f111c1030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.143+0000 7f11213b0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f111c1139b0 con 0x7f111c105280 2024-09-21T03:42:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.143+0000 7f11213b0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f111c113830 con 0x7f111c104930 2024-09-21T03:42:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.143+0000 7f11213b0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f111c113b30 con 0x7f111c10dd90 2024-09-21T03:42:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.143+0000 7f111a7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f111c105280 0x7f111c102ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.143+0000 7f111a7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f111c105280 0x7f111c102ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39090/0 (socket says 172.21.15.84:39090) 2024-09-21T03:42:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.143+0000 7f111a7fc640 1 -- 172.21.15.84:0/1406861783 learned_addr learned my addr 172.21.15.84:0/1406861783 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.143+0000 7f111b7fe640 1 --2- 172.21.15.84:0/1406861783 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f111c10dd90 0x7f111c1030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.143+0000 7f111a7fc640 1 -- 172.21.15.84:0/1406861783 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f111c10dd90 msgr2=0x7f111c1030e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.143+0000 7f111affd640 1 --2- 172.21.15.84:0/1406861783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f111c104930 0x7f111c102660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.143+0000 7f111a7fc640 1 --2- 172.21.15.84:0/1406861783 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f111c10dd90 0x7f111c1030e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.143+0000 7f111a7fc640 1 -- 172.21.15.84:0/1406861783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f111c104930 msgr2=0x7f111c102660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:30.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.143+0000 7f111a7fc640 1 --2- 172.21.15.84:0/1406861783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f111c104930 0x7f111c102660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:30.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.143+0000 7f111a7fc640 1 -- 172.21.15.84:0/1406861783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111c1a8660 con 0x7f111c105280 2024-09-21T03:42:30.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.143+0000 7f111a7fc640 1 --2- 172.21.15.84:0/1406861783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f111c105280 0x7f111c102ba0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1104006010 tx=0x7f1104004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:30.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.143+0000 7f1113fff640 1 -- 172.21.15.84:0/1406861783 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110403f030 con 0x7f111c105280 2024-09-21T03:42:30.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.144+0000 7f11213b0640 1 -- 172.21.15.84:0/1406861783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111c1a88f0 con 0x7f111c105280 2024-09-21T03:42:30.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.144+0000 7f1113fff640 1 -- 172.21.15.84:0/1406861783 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1104003aa0 con 0x7f111c105280 2024-09-21T03:42:30.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.144+0000 7f1113fff640 1 -- 172.21.15.84:0/1406861783 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104035070 con 0x7f111c105280 2024-09-21T03:42:30.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.144+0000 7f11213b0640 1 -- 172.21.15.84:0/1406861783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f111c1a8e30 con 0x7f111c105280 2024-09-21T03:42:30.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.145+0000 7f11213b0640 1 -- 172.21.15.84:0/1406861783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f111c104d40 con 0x7f111c105280 2024-09-21T03:42:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.146+0000 7f1113fff640 1 -- 172.21.15.84:0/1406861783 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 24) ==== 154580+0+0 (secure 0 0 0) 0x7f1104042030 con 0x7f111c105280 2024-09-21T03:42:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.147+0000 7f1113fff640 1 --2- 172.21.15.84:0/1406861783 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f11080b65f0 0x7f11080b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.147+0000 7f111affd640 1 --2- 172.21.15.84:0/1406861783 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f11080b65f0 0x7f11080b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.147+0000 7f1113fff640 1 -- 172.21.15.84:0/1406861783 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f1104107af0 con 0x7f111c105280 2024-09-21T03:42:30.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.147+0000 7f111affd640 1 --2- 172.21.15.84:0/1406861783 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f11080b65f0 0x7f11080b8b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f111c1040b0 tx=0x7f110c005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:30.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.151+0000 7f1113fff640 1 -- 172.21.15.84:0/1406861783 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f11040ce180 con 0x7f111c105280 2024-09-21T03:42:30.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.351+0000 7f11213b0640 1 -- 172.21.15.84:0/1406861783 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f111c106ea0 con 0x7f11080b65f0 2024-09-21T03:42:30.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.359+0000 7f1113fff640 1 -- 172.21.15.84:0/1406861783 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f111c106ea0 con 0x7f11080b65f0 2024-09-21T03:42:30.361 INFO:teuthology.orchestra.run.smithi084.stdout:/ 1m 6m3h 2024-09-21T03:42:30.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.361+0000 7f11213b0640 1 -- 172.21.15.84:0/1406861783 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f11080b65f0 msgr2=0x7f11080b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:30.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.361+0000 7f11213b0640 1 --2- 172.21.15.84:0/1406861783 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f11080b65f0 0x7f11080b8b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f111c1040b0 tx=0x7f110c005f90 comp rx=0 tx=0).stop 2024-09-21T03:42:30.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.361+0000 7f11213b0640 1 -- 172.21.15.84:0/1406861783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f111c105280 msgr2=0x7f111c102ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:30.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.361+0000 7f11213b0640 1 --2- 172.21.15.84:0/1406861783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f111c105280 0x7f111c102ba0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f1104006010 tx=0x7f1104004060 comp rx=0 tx=0).stop 2024-09-21T03:42:30.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.361+0000 7f11213b0640 1 -- 172.21.15.84:0/1406861783 shutdown_connections 2024-09-21T03:42:30.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.361+0000 7f11213b0640 1 --2- 172.21.15.84:0/1406861783 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f11080b65f0 0x7f11080b8b00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:30.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.361+0000 7f11213b0640 1 --2- 172.21.15.84:0/1406861783 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f111c10dd90 0x7f111c1030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:30.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.361+0000 7f11213b0640 1 --2- 172.21.15.84:0/1406861783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f111c105280 0x7f111c102ba0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:30.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.361+0000 7f11213b0640 1 --2- 172.21.15.84:0/1406861783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f111c104930 0x7f111c102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:30.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.361+0000 7f11213b0640 1 -- 172.21.15.84:0/1406861783 >> 172.21.15.84:0/1406861783 conn(0x7f111c0fe3c0 msgr2=0x7f111c106790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:30.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.361+0000 7f11213b0640 1 -- 172.21.15.84:0/1406861783 shutdown_connections 2024-09-21T03:42:30.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:30.361+0000 7f11213b0640 1 -- 172.21.15.84:0/1406861783 wait complete. 2024-09-21T03:42:30.374 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-21T03:42:30.400 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-21T03:42:30.411 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T03:42:30.463 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:42:30.463 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T03:42:30.463 INFO:tasks.workunit:timeout=3h 2024-09-21T03:42:30.464 INFO:tasks.workunit:cleanup=True 2024-09-21T03:42:30.464 DEBUG:teuthology.orchestra.run.smithi084:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T03:42:30.479 INFO:teuthology.orchestra.run.smithi084.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T03:42:30.479 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T03:42:30.480 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-21T03:42:30.480 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:42:30.480 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T03:42:30.480 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-09-21 03:40:48.558001567 +0000 2024-09-21T03:42:30.480 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-09-21 03:40:48.558001567 +0000 2024-09-21T03:42:30.480 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-09-21 03:42:19.066838546 +0000 2024-09-21T03:42:30.480 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-09-21 03:40:48.558001567 +0000 2024-09-21T03:42:30.480 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T03:42:30.480 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T03:42:30.515 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:42:30.589 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:42:30.645 INFO:tasks.workunit.client.0.smithi084.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T03:42:30.809 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:30.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:30 smithi084 ceph-mon[30941]: from='client.15477 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:30.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:30 smithi084 ceph-mon[30941]: scrub queued for path: / 2024-09-21T03:42:30.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:30 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:42:30.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:30 smithi084 ceph-mon[30941]: scrub summary: active paths [/] 2024-09-21T03:42:30.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:30 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:42:30.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:30 smithi174 ceph-mon[34403]: from='client.15477 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:30.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:30 smithi174 ceph-mon[34403]: scrub queued for path: / 2024-09-21T03:42:30.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:30 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:42:30.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:30 smithi174 ceph-mon[34403]: scrub summary: active paths [/] 2024-09-21T03:42:30.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:30 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:42:30.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:30 smithi172 ceph-mon[34821]: from='client.15477 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:30.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:30 smithi172 ceph-mon[34821]: scrub queued for path: / 2024-09-21T03:42:30.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:30 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:42:30.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:30 smithi172 ceph-mon[34821]: scrub summary: active paths [/] 2024-09-21T03:42:30.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:30 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:42:31.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.307+0000 7f87fac0a640 1 -- 172.21.15.84:0/2052712416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87f4102ae0 msgr2=0x7f87f4102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:31.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.307+0000 7f87fac0a640 1 --2- 172.21.15.84:0/2052712416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87f4102ae0 0x7f87f4102ef0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009900 tx=0x7f87ec02a410 comp rx=0 tx=0).stop 2024-09-21T03:42:31.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.308+0000 7f87fac0a640 1 -- 172.21.15.84:0/2052712416 shutdown_connections 2024-09-21T03:42:31.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.308+0000 7f87fac0a640 1 --2- 172.21.15.84:0/2052712416 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87f4108d20 0x7f87f410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.308+0000 7f87fac0a640 1 --2- 172.21.15.84:0/2052712416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f41083d0 0x7f87f41087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.308+0000 7f87fac0a640 1 --2- 172.21.15.84:0/2052712416 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87f4102ae0 0x7f87f4102ef0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.308+0000 7f87fac0a640 1 -- 172.21.15.84:0/2052712416 >> 172.21.15.84:0/2052712416 conn(0x7f87f4079790 msgr2=0x7f87f4079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:31.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.308+0000 7f87fac0a640 1 -- 172.21.15.84:0/2052712416 shutdown_connections 2024-09-21T03:42:31.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.308+0000 7f87fac0a640 1 -- 172.21.15.84:0/2052712416 wait complete. 2024-09-21T03:42:31.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.308+0000 7f87fac0a640 1 Processor -- start 2024-09-21T03:42:31.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.308+0000 7f87fac0a640 1 -- start start 2024-09-21T03:42:31.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.308+0000 7f87fac0a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87f4102ae0 0x7f87f419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:31.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.308+0000 7f87fac0a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87f41083d0 0x7f87f419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:31.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.308+0000 7f87fac0a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f4108d20 0x7f87f419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:31.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.308+0000 7f87fac0a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f87f4113b00 con 0x7f87f4102ae0 2024-09-21T03:42:31.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.308+0000 7f87fac0a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f87f4113980 con 0x7f87f4108d20 2024-09-21T03:42:31.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.309+0000 7f87fac0a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f87f4113c80 con 0x7f87f41083d0 2024-09-21T03:42:31.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.309+0000 7f87f89a6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87f4102ae0 0x7f87f419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:31.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.309+0000 7f87f89a6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87f4102ae0 0x7f87f419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39102/0 (socket says 172.21.15.84:39102) 2024-09-21T03:42:31.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.309+0000 7f87f89a6640 1 -- 172.21.15.84:0/426509835 learned_addr learned my addr 172.21.15.84:0/426509835 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:31.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.309+0000 7f87f3fff640 1 --2- 172.21.15.84:0/426509835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87f41083d0 0x7f87f419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:31.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.309+0000 7f87f91a7640 1 --2- 172.21.15.84:0/426509835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f4108d20 0x7f87f419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:31.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.309+0000 7f87f89a6640 1 -- 172.21.15.84:0/426509835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87f41083d0 msgr2=0x7f87f419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:31.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.309+0000 7f87f89a6640 1 --2- 172.21.15.84:0/426509835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87f41083d0 0x7f87f419aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.309+0000 7f87f89a6640 1 -- 172.21.15.84:0/426509835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f4108d20 msgr2=0x7f87f419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:31.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.309+0000 7f87f89a6640 1 --2- 172.21.15.84:0/426509835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f4108d20 0x7f87f419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.309+0000 7f87f89a6640 1 -- 172.21.15.84:0/426509835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f41a0460 con 0x7f87f4102ae0 2024-09-21T03:42:31.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.309+0000 7f87f91a7640 1 --2- 172.21.15.84:0/426509835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f4108d20 0x7f87f419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:31.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.309+0000 7f87f89a6640 1 --2- 172.21.15.84:0/426509835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87f4102ae0 0x7f87f419a4f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f87ec006010 tx=0x7f87ec0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:31.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.309+0000 7f87f1ffb640 1 -- 172.21.15.84:0/426509835 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec03f030 con 0x7f87f4102ae0 2024-09-21T03:42:31.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.309+0000 7f87f1ffb640 1 -- 172.21.15.84:0/426509835 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87ec003800 con 0x7f87f4102ae0 2024-09-21T03:42:31.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.309+0000 7f87fac0a640 1 -- 172.21.15.84:0/426509835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f41a06f0 con 0x7f87f4102ae0 2024-09-21T03:42:31.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.309+0000 7f87f1ffb640 1 -- 172.21.15.84:0/426509835 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec035070 con 0x7f87f4102ae0 2024-09-21T03:42:31.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.310+0000 7f87fac0a640 1 -- 172.21.15.84:0/426509835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f41a6eb0 con 0x7f87f4102ae0 2024-09-21T03:42:31.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.313+0000 7f880117e740 1 Processor -- start 2024-09-21T03:42:31.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.313+0000 7f880117e740 1 -- start start 2024-09-21T03:42:31.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.313+0000 7f880117e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cf2070 0x560512099650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:31.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.313+0000 7f880117e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cc91b0 0x560512099b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:31.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.313+0000 7f87f1ffb640 1 -- 172.21.15.84:0/426509835 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 25) ==== 154637+0+0 (secure 0 0 0) 0x7f87ec003cb0 con 0x7f87f4102ae0 2024-09-21T03:42:31.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.313+0000 7f880117e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cd1390 0x56051209a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:31.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.313+0000 7f880117e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56051200fe50 con 0x560511cc91b0 2024-09-21T03:42:31.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.313+0000 7f880117e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560511fff280 con 0x560511cd1390 2024-09-21T03:42:31.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.313+0000 7f880117e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560512003090 con 0x560511cf2070 2024-09-21T03:42:31.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.313+0000 7f87f89a6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cc91b0 0x560512099b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:31.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.313+0000 7f87f89a6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cc91b0 0x560512099b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39116/0 (socket says 172.21.15.84:39116) 2024-09-21T03:42:31.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.313+0000 7f87f89a6640 1 -- 172.21.15.84:0/2005693399 learned_addr learned my addr 172.21.15.84:0/2005693399 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:31.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.313+0000 7f87f91a7640 1 --2- 172.21.15.84:0/2005693399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cf2070 0x560512099650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:31.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.313+0000 7f87f3fff640 1 --2- 172.21.15.84:0/2005693399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cd1390 0x56051209a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:31.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.313+0000 7f87f89a6640 1 -- 172.21.15.84:0/2005693399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cf2070 msgr2=0x560512099650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:31.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.313+0000 7f87f89a6640 1 --2- 172.21.15.84:0/2005693399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cf2070 0x560512099650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.314+0000 7f87f89a6640 1 -- 172.21.15.84:0/2005693399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cd1390 msgr2=0x56051209a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:31.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.314+0000 7f87f89a6640 1 --2- 172.21.15.84:0/2005693399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cd1390 0x56051209a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.314+0000 7f87f89a6640 1 -- 172.21.15.84:0/2005693399 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560511d5d650 con 0x560511cc91b0 2024-09-21T03:42:31.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.314+0000 7f87f3fff640 1 --2- 172.21.15.84:0/2005693399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cd1390 0x56051209a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:31.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.314+0000 7f87f89a6640 1 --2- 172.21.15.84:0/2005693399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cc91b0 0x560512099b90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f87ec1057c0 tx=0x7f87ec1103b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec02060941c14c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:31.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.314+0000 7f87f1ffb640 1 --2- 172.21.15.84:0/426509835 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f87e00b6680 0x7f87e00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.314+0000 7f87eaffd640 1 -- 172.21.15.84:0/2005693399 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec0ca5a0 con 0x560511cc91b0 2024-09-21T03:42:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.314+0000 7f87f91a7640 1 --2- 172.21.15.84:0/426509835 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f87e00b6680 0x7f87e00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.314+0000 7f87eaffd640 1 -- 172.21.15.84:0/2005693399 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87ec115030 con 0x560511cc91b0 2024-09-21T03:42:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.314+0000 7f87eaffd640 1 -- 172.21.15.84:0/2005693399 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ec0cd8a0 con 0x560511cc91b0 2024-09-21T03:42:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.314+0000 7f87f1ffb640 1 -- 172.21.15.84:0/426509835 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f87ec108080 con 0x7f87f4102ae0 2024-09-21T03:42:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.315+0000 7f880117e740 1 -- 172.21.15.84:0/2005693399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cc91b0 msgr2=0x560512099b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.315+0000 7f87f91a7640 1 --2- 172.21.15.84:0/426509835 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f87e00b6680 0x7f87e00b8b90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00bbf0 tx=0x7f87dc00b340 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.315+0000 7f880117e740 1 --2- 172.21.15.84:0/2005693399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cc91b0 0x560512099b90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f87ec1057c0 tx=0x7f87ec1103b0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.315+0000 7f880117e740 1 -- 172.21.15.84:0/2005693399 shutdown_connections 2024-09-21T03:42:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.315+0000 7f880117e740 1 --2- 172.21.15.84:0/2005693399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cd1390 0x56051209a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.315+0000 7f880117e740 1 --2- 172.21.15.84:0/2005693399 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cc91b0 0x560512099b90 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.315+0000 7f880117e740 1 --2- 172.21.15.84:0/2005693399 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cf2070 0x560512099650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.315+0000 7f880117e740 1 -- 172.21.15.84:0/2005693399 >> 172.21.15.84:0/2005693399 conn(0x560511ce6460 msgr2=0x560512097540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:31.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.315+0000 7f880117e740 1 -- 172.21.15.84:0/2005693399 shutdown_connections 2024-09-21T03:42:31.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.315+0000 7f880117e740 1 -- 172.21.15.84:0/2005693399 wait complete. 2024-09-21T03:42:31.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.315+0000 7f880117e740 1 -- start start 2024-09-21T03:42:31.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.316+0000 7f880117e740 1 Processor -- start 2024-09-21T03:42:31.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.316+0000 7f880117e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cc91b0 0x5605120a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:31.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.316+0000 7f880117e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cd1390 0x5605120a5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:31.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.316+0000 7f880117e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cf2070 0x5605120b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:31.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.316+0000 7f880117e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560511e60700 con 0x560511cf2070 2024-09-21T03:42:31.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.316+0000 7f880117e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560511f9a110 con 0x560511cd1390 2024-09-21T03:42:31.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.316+0000 7f880117e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5605120a7bf0 con 0x560511cc91b0 2024-09-21T03:42:31.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.316+0000 7f880117e740 10 client.0 _ll_register_callbacks cb 0x560511fb3990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:31.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.316+0000 7f87f91a7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cf2070 0x5605120b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:31.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.316+0000 7f87f91a7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cf2070 0x5605120b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39122/0 (socket says 172.21.15.84:39122) 2024-09-21T03:42:31.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.316+0000 7f87f91a7640 1 -- 172.21.15.84:0/3621965427 learned_addr learned my addr 172.21.15.84:0/3621965427 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:31.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.316+0000 7f87f89a6640 1 --2- 172.21.15.84:0/3621965427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cc91b0 0x5605120a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:31.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.316+0000 7f87f3fff640 1 --2- 172.21.15.84:0/3621965427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cd1390 0x5605120a5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:31.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.316+0000 7f87f91a7640 1 -- 172.21.15.84:0/3621965427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cc91b0 msgr2=0x5605120a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:31.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.316+0000 7f87f91a7640 1 --2- 172.21.15.84:0/3621965427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cc91b0 0x5605120a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.316+0000 7f87f91a7640 1 -- 172.21.15.84:0/3621965427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cd1390 msgr2=0x5605120a5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:31.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.316+0000 7f87f91a7640 1 --2- 172.21.15.84:0/3621965427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cd1390 0x5605120a5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.316+0000 7f87f91a7640 1 -- 172.21.15.84:0/3621965427 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560511fc7c40 con 0x560511cf2070 2024-09-21T03:42:31.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.317+0000 7f87f91a7640 1 --2- 172.21.15.84:0/3621965427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cf2070 0x5605120b0e50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00ee30 tx=0x7f87dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3dc811333f3351 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:31.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.317+0000 7f87d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:42:31.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.317+0000 7f87d3fff640 1 -- 172.21.15.84:0/3621965427 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87dc01d620 con 0x560511cf2070 2024-09-21T03:42:31.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.317+0000 7f87d3fff640 1 -- 172.21.15.84:0/3621965427 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f87dc01d7c0 con 0x560511cf2070 2024-09-21T03:42:31.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.317+0000 7f880117e740 1 -- 172.21.15.84:0/3621965427 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87ec115030 con 0x560511cf2070 2024-09-21T03:42:31.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.317+0000 7f87d3fff640 1 -- 172.21.15.84:0/3621965427 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f87dc01d9c0 con 0x560511cf2070 2024-09-21T03:42:31.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.317+0000 7f880117e740 10 client.15531 fetch_fsmap learned FSMap version 25 2024-09-21T03:42:31.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.317+0000 7f880117e740 1 -- 172.21.15.84:0/3621965427 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5605120b3870 con 0x560511cf2070 2024-09-21T03:42:31.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.317+0000 7f87d3fff640 1 -- 172.21.15.84:0/3621965427 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87ec115030 con 0x560511cf2070 2024-09-21T03:42:31.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.317+0000 7f87d3fff640 1 -- 172.21.15.84:0/3621965427 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f87dc02fc00 con 0x560511cf2070 2024-09-21T03:42:31.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.317+0000 7f880117e740 10 client.15531 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:42:31.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.317+0000 7f880117e740 10 client.15531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:42:31.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.317+0000 7f880117e740 20 client.15531 populate_metadata read hostname 'smithi084' 2024-09-21T03:42:31.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.317+0000 7f880117e740 1 --2- 172.21.15.84:0/3621965427 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560511cb09f0 0x5605120b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:31.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.317+0000 7f880117e740 4 client.15531 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:42:31.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.317+0000 7f880117e740 1 -- 172.21.15.84:0/3621965427 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560512011da0 con 0x560511cb09f0 2024-09-21T03:42:31.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.318+0000 7f87f89a6640 1 --2- 172.21.15.84:0/3621965427 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560511cb09f0 0x5605120b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:31.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.318+0000 7f87d3fff640 10 client.15531 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:42:31.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.318+0000 7f87f89a6640 1 --2- 172.21.15.84:0/3621965427 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560511cb09f0 0x5605120b6dc0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8883ac76d78d4d3 server_cookie=14ccf04ee2363ad3 in_seq=0 out_seq=0 2024-09-21T03:42:31.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.319+0000 7f87d3fff640 1 -- 172.21.15.84:0/3621965427 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560512011da0 con 0x560511cb09f0 2024-09-21T03:42:31.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.319+0000 7f87d3fff640 10 client.15531 handle_command_reply: tid=0 2024-09-21T03:42:31.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.319+0000 7f880117e740 1 client.15531 shutdown 2024-09-21T03:42:31.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.319+0000 7f880117e740 1 -- 172.21.15.84:0/3621965427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cf2070 msgr2=0x5605120b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:31.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.319+0000 7f880117e740 1 --2- 172.21.15.84:0/3621965427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cf2070 0x5605120b0e50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00ee30 tx=0x7f87dc0046c0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.319+0000 7f880117e740 1 -- 172.21.15.84:0/3621965427 shutdown_connections 2024-09-21T03:42:31.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.319+0000 7f880117e740 1 --2- 172.21.15.84:0/3621965427 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560511cb09f0 0x5605120b6dc0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.319+0000 7f880117e740 1 --2- 172.21.15.84:0/3621965427 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cf2070 0x5605120b0e50 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.319+0000 7f880117e740 1 --2- 172.21.15.84:0/3621965427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cd1390 0x5605120a5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.319+0000 7f87d3fff640 0 client.15531 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:42:31.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.319+0000 7f880117e740 1 --2- 172.21.15.84:0/3621965427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cc91b0 0x5605120a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.319+0000 7f880117e740 1 -- 172.21.15.84:0/3621965427 >> 172.21.15.84:0/3621965427 conn(0x560511ce6460 msgr2=0x56051209c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:31.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.319+0000 7f880117e740 1 -- 172.21.15.84:0/3621965427 shutdown_connections 2024-09-21T03:42:31.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.319+0000 7f880117e740 1 -- 172.21.15.84:0/3621965427 wait complete. 2024-09-21T03:42:31.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.319+0000 7f880117e740 20 client.15531 trim_cache size 0 max 16384 2024-09-21T03:42:31.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.336+0000 7f880117e740 1 Processor -- start 2024-09-21T03:42:31.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.337+0000 7f880117e740 1 -- start start 2024-09-21T03:42:31.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.337+0000 7f880117e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cc91b0 0x5605120a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:31.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.337+0000 7f880117e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cd1390 0x5605120b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:31.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.337+0000 7f880117e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cf2070 0x5605120a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:31.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.337+0000 7f880117e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41b1ec0 con 0x560511cf2070 2024-09-21T03:42:31.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.337+0000 7f880117e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41af790 con 0x560511cd1390 2024-09-21T03:42:31.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.337+0000 7f880117e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41ad5e0 con 0x560511cc91b0 2024-09-21T03:42:31.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.337+0000 7f87f91a7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cf2070 0x5605120a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:31.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.337+0000 7f87f91a7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cf2070 0x5605120a1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39126/0 (socket says 172.21.15.84:39126) 2024-09-21T03:42:31.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.337+0000 7f87f91a7640 1 -- 172.21.15.84:0/291945163 learned_addr learned my addr 172.21.15.84:0/291945163 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:31.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.337+0000 7f87f89a6640 1 --2- 172.21.15.84:0/291945163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cc91b0 0x5605120a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:31.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.337+0000 7f87f3fff640 1 --2- 172.21.15.84:0/291945163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cd1390 0x5605120b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:31.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.337+0000 7f87f91a7640 1 -- 172.21.15.84:0/291945163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cc91b0 msgr2=0x5605120a51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:31.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.337+0000 7f87f91a7640 1 --2- 172.21.15.84:0/291945163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cc91b0 0x5605120a51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.337+0000 7f87f91a7640 1 -- 172.21.15.84:0/291945163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cd1390 msgr2=0x5605120b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:31.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.337+0000 7f87f91a7640 1 --2- 172.21.15.84:0/291945163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cd1390 0x5605120b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.337+0000 7f87f91a7640 1 -- 172.21.15.84:0/291945163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56051209c4b0 con 0x560511cf2070 2024-09-21T03:42:31.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.337+0000 7f87f89a6640 1 --2- 172.21.15.84:0/291945163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cc91b0 0x5605120a51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:31.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.337+0000 7f87f91a7640 1 --2- 172.21.15.84:0/291945163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cf2070 0x5605120a1f00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f87dc015040 tx=0x7f87dc005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae9f8acc1e63c85 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:31.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.338+0000 7f87ea7fc640 1 -- 172.21.15.84:0/291945163 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87dc034070 con 0x560511cf2070 2024-09-21T03:42:31.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.338+0000 7f87ea7fc640 1 -- 172.21.15.84:0/291945163 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87dc01b840 con 0x560511cf2070 2024-09-21T03:42:31.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.338+0000 7f87ea7fc640 1 -- 172.21.15.84:0/291945163 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87dc025400 con 0x560511cf2070 2024-09-21T03:42:31.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.338+0000 7f880117e740 1 -- 172.21.15.84:0/291945163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cf2070 msgr2=0x5605120a1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:31.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.338+0000 7f880117e740 1 --2- 172.21.15.84:0/291945163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cf2070 0x5605120a1f00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f87dc015040 tx=0x7f87dc005d50 comp rx=0 tx=0).stop 2024-09-21T03:42:31.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.338+0000 7f880117e740 1 -- 172.21.15.84:0/291945163 shutdown_connections 2024-09-21T03:42:31.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.338+0000 7f880117e740 1 --2- 172.21.15.84:0/291945163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cf2070 0x5605120a1f00 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.338+0000 7f880117e740 1 --2- 172.21.15.84:0/291945163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cd1390 0x5605120b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.338+0000 7f880117e740 1 --2- 172.21.15.84:0/291945163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cc91b0 0x5605120a51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.338+0000 7f880117e740 1 -- 172.21.15.84:0/291945163 >> 172.21.15.84:0/291945163 conn(0x560511ce6460 msgr2=0x5605120a4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:31.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.339+0000 7f880117e740 1 -- 172.21.15.84:0/291945163 shutdown_connections 2024-09-21T03:42:31.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.339+0000 7f880117e740 1 -- 172.21.15.84:0/291945163 wait complete. 2024-09-21T03:42:31.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.339+0000 7f880117e740 1 -- start start 2024-09-21T03:42:31.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.339+0000 7f880117e740 1 Processor -- start 2024-09-21T03:42:31.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.339+0000 7f880117e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cc91b0 0x5605120a9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:31.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.339+0000 7f880117e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cd1390 0x5605120a95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:31.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.339+0000 7f880117e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cf2070 0x5605121207a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:31.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.339+0000 7f880117e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41adc50 con 0x560511cd1390 2024-09-21T03:42:31.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.339+0000 7f880117e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41af0c0 con 0x560511cf2070 2024-09-21T03:42:31.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.339+0000 7f880117e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41ae320 con 0x560511cc91b0 2024-09-21T03:42:31.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.339+0000 7f880117e740 10 client.0 _ll_register_callbacks cb 0x7f87dc00b880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:31.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.339+0000 7f87f3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cd1390 0x5605120a95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:31.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.340+0000 7f87f3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cd1390 0x5605120a95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39142/0 (socket says 172.21.15.84:39142) 2024-09-21T03:42:31.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.340+0000 7f87f3fff640 1 -- 172.21.15.84:0/1373708940 learned_addr learned my addr 172.21.15.84:0/1373708940 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:42:31.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.340+0000 7f87f91a7640 1 --2- 172.21.15.84:0/1373708940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cf2070 0x5605121207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:31.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.340+0000 7f87f89a6640 1 --2- 172.21.15.84:0/1373708940 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cc91b0 0x5605120a9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:31.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.340+0000 7f87f3fff640 1 -- 172.21.15.84:0/1373708940 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cc91b0 msgr2=0x5605120a9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:31.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.340+0000 7f87f3fff640 1 --2- 172.21.15.84:0/1373708940 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cc91b0 0x5605120a9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.340+0000 7f87f3fff640 1 -- 172.21.15.84:0/1373708940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cf2070 msgr2=0x5605121207a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:31.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.340+0000 7f87f3fff640 1 --2- 172.21.15.84:0/1373708940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cf2070 0x5605121207a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.340+0000 7f87f3fff640 1 -- 172.21.15.84:0/1373708940 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605120a9e40 con 0x560511cd1390 2024-09-21T03:42:31.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.340+0000 7f87f3fff640 1 --2- 172.21.15.84:0/1373708940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cd1390 0x5605120a95a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f87f406b7e0 tx=0x7f87e400f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa582126f6745d33 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:31.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.340+0000 7f87d3fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:42:31.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.340+0000 7f87d3fff640 1 -- 172.21.15.84:0/1373708940 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e401b3f0 con 0x560511cd1390 2024-09-21T03:42:31.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.340+0000 7f87d3fff640 1 -- 172.21.15.84:0/1373708940 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f87e401b590 con 0x560511cd1390 2024-09-21T03:42:31.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.340+0000 7f880117e740 1 -- 172.21.15.84:0/1373708940 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87dc01b840 con 0x560511cd1390 2024-09-21T03:42:31.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.340+0000 7f87d3fff640 1 -- 172.21.15.84:0/1373708940 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f87e401b790 con 0x560511cd1390 2024-09-21T03:42:31.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.340+0000 7f880117e740 10 client.15537 fetch_fsmap learned FSMap version 25 2024-09-21T03:42:31.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.341+0000 7f880117e740 1 -- 172.21.15.84:0/1373708940 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560512121da0 con 0x560511cd1390 2024-09-21T03:42:31.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.341+0000 7f87d3fff640 1 -- 172.21.15.84:0/1373708940 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87dc01b840 con 0x560511cd1390 2024-09-21T03:42:31.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.341+0000 7f87d3fff640 1 -- 172.21.15.84:0/1373708940 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f87e4025a80 con 0x560511cd1390 2024-09-21T03:42:31.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.341+0000 7f880117e740 10 client.15537 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:42:31.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.341+0000 7f880117e740 10 client.15537 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:42:31.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.341+0000 7f880117e740 20 client.15537 populate_metadata read hostname 'smithi084' 2024-09-21T03:42:31.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.341+0000 7f880117e740 1 --2- 172.21.15.84:0/1373708940 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560511c85da0 0x560512124610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:31.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.341+0000 7f880117e740 4 client.15537 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:42:31.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.341+0000 7f880117e740 1 -- 172.21.15.84:0/1373708940 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56051200d850 con 0x560511c85da0 2024-09-21T03:42:31.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.341+0000 7f87f89a6640 1 --2- 172.21.15.84:0/1373708940 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560511c85da0 0x560512124610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:31.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.342+0000 7f87d3fff640 10 client.15537 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:42:31.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.342+0000 7f87f89a6640 1 --2- 172.21.15.84:0/1373708940 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560511c85da0 0x560512124610 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec38c2d3d41e91b9 server_cookie=bbb92ab00461349f in_seq=0 out_seq=0 2024-09-21T03:42:31.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.342+0000 7f87d3fff640 1 -- 172.21.15.84:0/1373708940 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x56051200d850 con 0x560511c85da0 2024-09-21T03:42:31.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.342+0000 7f87d3fff640 10 client.15537 handle_command_reply: tid=0 2024-09-21T03:42:31.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.342+0000 7f880117e740 1 client.15537 shutdown 2024-09-21T03:42:31.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.342+0000 7f880117e740 1 -- 172.21.15.84:0/1373708940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cd1390 msgr2=0x5605120a95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:31.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.342+0000 7f880117e740 1 --2- 172.21.15.84:0/1373708940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cd1390 0x5605120a95a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f87f406b7e0 tx=0x7f87e400f3c0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.342+0000 7f880117e740 1 -- 172.21.15.84:0/1373708940 shutdown_connections 2024-09-21T03:42:31.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.342+0000 7f880117e740 1 --2- 172.21.15.84:0/1373708940 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560511c85da0 0x560512124610 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.342+0000 7f880117e740 1 --2- 172.21.15.84:0/1373708940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560511cf2070 0x5605121207a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.342+0000 7f880117e740 1 --2- 172.21.15.84:0/1373708940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560511cd1390 0x5605120a95a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.342+0000 7f880117e740 1 --2- 172.21.15.84:0/1373708940 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560511cc91b0 0x5605120a9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.342+0000 7f880117e740 1 -- 172.21.15.84:0/1373708940 >> 172.21.15.84:0/1373708940 conn(0x560511ce6460 msgr2=0x56051209a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:31.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.342+0000 7f87d3fff640 0 client.15537 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:42:31.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.342+0000 7f880117e740 1 -- 172.21.15.84:0/1373708940 shutdown_connections 2024-09-21T03:42:31.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.342+0000 7f880117e740 1 -- 172.21.15.84:0/1373708940 wait complete. 2024-09-21T03:42:31.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.342+0000 7f880117e740 20 client.15537 trim_cache size 0 max 16384 2024-09-21T03:42:31.349 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:42:31.349 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:42:31.349 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T03:42:31.349 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:42:31.349 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:42:31.349 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "e42cb821-db94-475b-a21a-8d8d086f7207", 2024-09-21T03:42:31.349 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T03:42:31.349 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:42:31.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:42:31.349 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:42:31.350 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:42:31.350 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:42:31.350 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:42:31.350 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:42:31.350 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:42:31.350 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:42:31.350 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:42:31.350 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:42:31.351 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:42:31.351 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:42:31.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.343+0000 7f87fac0a640 1 -- 172.21.15.84:0/426509835 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f87e00b6680 msgr2=0x7f87e00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:31.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.343+0000 7f87fac0a640 1 --2- 172.21.15.84:0/426509835 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f87e00b6680 0x7f87e00b8b90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00bbf0 tx=0x7f87dc00b340 comp rx=0 tx=0).stop 2024-09-21T03:42:31.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.343+0000 7f87fac0a640 1 -- 172.21.15.84:0/426509835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87f4102ae0 msgr2=0x7f87f419a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:31.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.343+0000 7f87fac0a640 1 --2- 172.21.15.84:0/426509835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87f4102ae0 0x7f87f419a4f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f87ec006010 tx=0x7f87ec0042f0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.343+0000 7f87fac0a640 1 -- 172.21.15.84:0/426509835 shutdown_connections 2024-09-21T03:42:31.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.343+0000 7f87fac0a640 1 --2- 172.21.15.84:0/426509835 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f87e00b6680 0x7f87e00b8b90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.343+0000 7f87fac0a640 1 --2- 172.21.15.84:0/426509835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f4108d20 0x7f87f419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.343+0000 7f87fac0a640 1 --2- 172.21.15.84:0/426509835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f87f41083d0 0x7f87f419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.343+0000 7f87fac0a640 1 --2- 172.21.15.84:0/426509835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f87f4102ae0 0x7f87f419a4f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:31.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.343+0000 7f87fac0a640 1 -- 172.21.15.84:0/426509835 >> 172.21.15.84:0/426509835 conn(0x7f87f4079790 msgr2=0x7f87f4106460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:31.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.343+0000 7f87fac0a640 1 -- 172.21.15.84:0/426509835 shutdown_connections 2024-09-21T03:42:31.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:42:31.343+0000 7f87fac0a640 1 -- 172.21.15.84:0/426509835 wait complete. 2024-09-21T03:42:31.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:31 smithi084 ceph-mon[30941]: from='client.15489 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:31.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:31 smithi084 ceph-mon[30941]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:31.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:31 smithi084 ceph-mon[30941]: pgmap v325: 97 pgs: 97 active+clean; 652 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-21T03:42:31.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:31 smithi084 ceph-mon[30941]: from='client.15519 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:31.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:31 smithi084 ceph-mon[30941]: mgrmap e25: x(active, since 8m), standbys: z, y 2024-09-21T03:42:31.779 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:31 smithi174 ceph-mon[34403]: from='client.15489 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:31.779 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:31 smithi174 ceph-mon[34403]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:31.779 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:31 smithi174 ceph-mon[34403]: pgmap v325: 97 pgs: 97 active+clean; 652 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-21T03:42:31.780 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:31 smithi174 ceph-mon[34403]: from='client.15519 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:31.780 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:31 smithi174 ceph-mon[34403]: mgrmap e25: x(active, since 8m), standbys: z, y 2024-09-21T03:42:31.802 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:31 smithi172 ceph-mon[34821]: from='client.15489 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:31.802 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:31 smithi172 ceph-mon[34821]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:31.802 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:31 smithi172 ceph-mon[34821]: pgmap v325: 97 pgs: 97 active+clean; 652 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-09-21T03:42:31.802 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:31 smithi172 ceph-mon[34821]: from='client.15519 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:42:31.802 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:31 smithi172 ceph-mon[34821]: mgrmap e25: x(active, since 8m), standbys: z, y 2024-09-21T03:42:32.093 INFO:tasks.cephfs.filesystem:scrub status for tag:e42cb821-db94-475b-a21a-8d8d086f7207 - {'path': '/', 'tag': 'e42cb821-db94-475b-a21a-8d8d086f7207', 'options': 'recursive,force'} 2024-09-21T03:42:33.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:33 smithi084 ceph-mon[30941]: pgmap v326: 97 pgs: 97 active+clean; 1.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 74 KiB/s wr, 16 op/s 2024-09-21T03:42:33.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:33 smithi174 ceph-mon[34403]: pgmap v326: 97 pgs: 97 active+clean; 1.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 74 KiB/s wr, 16 op/s 2024-09-21T03:42:33.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:33 smithi172 ceph-mon[34821]: pgmap v326: 97 pgs: 97 active+clean; 1.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 74 KiB/s wr, 16 op/s 2024-09-21T03:42:35.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:35 smithi084 ceph-mon[30941]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 176 KiB/s wr, 54 op/s 2024-09-21T03:42:35.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:35 smithi174 ceph-mon[34403]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 176 KiB/s wr, 54 op/s 2024-09-21T03:42:35.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:35 smithi172 ceph-mon[34821]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 176 KiB/s wr, 54 op/s 2024-09-21T03:42:36.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:36 smithi084 ceph-mon[30941]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T03:42:36.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:36 smithi174 ceph-mon[34403]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T03:42:36.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:36 smithi172 ceph-mon[34821]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T03:42:39.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:39 smithi172 ceph-mon[34821]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T03:42:39.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:39 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:42:39.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:39 smithi084 ceph-mon[30941]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T03:42:39.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:39 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:42:39.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:39 smithi174 ceph-mon[34403]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T03:42:39.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:39 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:42:40.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:40 smithi174 ceph-mon[34403]: scrub summary: idle 2024-09-21T03:42:40.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:40 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:40.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:40 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:40.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:40 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:40.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:40 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:40.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:40 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:40.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:40 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:40.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:40 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:42:40.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:40 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:42:40.629 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:40 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:40 smithi172 ceph-mon[34821]: scrub summary: idle 2024-09-21T03:42:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:40 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:40 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:40 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:40 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:40 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:40 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:40 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:42:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:40 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:42:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:40 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:40.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:40 smithi084 ceph-mon[30941]: scrub summary: idle 2024-09-21T03:42:40.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:40 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:40.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:40 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:40.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:40 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:40.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:40 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:40.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:40 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:40.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:40 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:40.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:40 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:42:40.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:40 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:42:40.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:40 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:42:41.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:41 smithi174 ceph-mon[34403]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T03:42:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:41 smithi172 ceph-mon[34821]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T03:42:41.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:41 smithi084 ceph-mon[30941]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T03:42:43.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:43 smithi174 ceph-mon[34403]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T03:42:43.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:43 smithi172 ceph-mon[34821]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T03:42:43.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:43 smithi084 ceph-mon[30941]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T03:42:45.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:45 smithi174 ceph-mon[34403]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 102 KiB/s wr, 44 op/s 2024-09-21T03:42:45.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:45 smithi172 ceph-mon[34821]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 102 KiB/s wr, 44 op/s 2024-09-21T03:42:45.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:45 smithi084 ceph-mon[30941]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 102 KiB/s wr, 44 op/s 2024-09-21T03:42:47.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:47 smithi172 ceph-mon[34821]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:42:47.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:47 smithi084 ceph-mon[30941]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:42:47.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:47 smithi174 ceph-mon[34403]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:42:49.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:49 smithi172 ceph-mon[34821]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:49.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:49 smithi084 ceph-mon[30941]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:49.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:49 smithi174 ceph-mon[34403]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:51.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:51 smithi172 ceph-mon[34821]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:42:51.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:51 smithi084 ceph-mon[30941]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:42:51.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:51 smithi174 ceph-mon[34403]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:42:53.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:53 smithi172 ceph-mon[34821]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:53.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:53 smithi084 ceph-mon[30941]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:53.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:53 smithi174 ceph-mon[34403]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:55.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:55 smithi172 ceph-mon[34821]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:42:55.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:55 smithi084 ceph-mon[30941]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:42:55.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:55 smithi174 ceph-mon[34403]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:42:57.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:57 smithi172 ceph-mon[34821]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:42:57.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:57 smithi084 ceph-mon[30941]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:42:57.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:57 smithi174 ceph-mon[34403]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:42:59.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:42:59 smithi084 ceph-mon[30941]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:59.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:42:59 smithi174 ceph-mon[34403]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:59.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:42:59 smithi172 ceph-mon[34821]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:43:01.068 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:43:00 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:43:00.683+0000 7fa4acbc4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:43:01.068 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:43:00 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:43:00.683+0000 7fa4acbc4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:43:01.068 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:43:00 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:43:00.683+0000 7fa4acbc4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:43:01.068 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:43:00 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:43:00.683+0000 7fa4acbc4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:43:01.068 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:43:00 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:43:00.683+0000 7fa4acbc4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:43:01.680 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:01 smithi174 ceph-mon[34403]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:43:01.702 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:01 smithi172 ceph-mon[34821]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:43:01.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:01 smithi084 ceph-mon[30941]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T03:43:02.093 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:43:02.449 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:03.019 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.010+0000 7ffa9ae30640 1 -- 172.21.15.84:0/3361057525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa94101f70 msgr2=0x7ffa94102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:03.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.010+0000 7ffa9ae30640 1 --2- 172.21.15.84:0/3361057525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa94101f70 0x7ffa94102380 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009900 tx=0x7ffa8802a410 comp rx=0 tx=0).stop 2024-09-21T03:43:03.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.010+0000 7ffa9ae30640 1 -- 172.21.15.84:0/3361057525 shutdown_connections 2024-09-21T03:43:03.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.010+0000 7ffa9ae30640 1 --2- 172.21.15.84:0/3361057525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa94109e00 0x7ffa94110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.010+0000 7ffa9ae30640 1 --2- 172.21.15.84:0/3361057525 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa941094b0 0x7ffa941098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.010+0000 7ffa9ae30640 1 --2- 172.21.15.84:0/3361057525 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa94101f70 0x7ffa94102380 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.010+0000 7ffa9ae30640 1 -- 172.21.15.84:0/3361057525 >> 172.21.15.84:0/3361057525 conn(0x7ffa94077c60 msgr2=0x7ffa940780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:03.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.010+0000 7ffa9ae30640 1 -- 172.21.15.84:0/3361057525 shutdown_connections 2024-09-21T03:43:03.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.010+0000 7ffa9ae30640 1 -- 172.21.15.84:0/3361057525 wait complete. 2024-09-21T03:43:03.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.012+0000 7ffa9ae30640 1 Processor -- start 2024-09-21T03:43:03.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.012+0000 7ffa9ae30640 1 -- start start 2024-09-21T03:43:03.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.012+0000 7ffa9ae30640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa94101f70 0x7ffa94104920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:03.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.012+0000 7ffa9ae30640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa941094b0 0x7ffa94102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:03.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.012+0000 7ffa9ae30640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa94109e00 0x7ffa94103450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:03.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.012+0000 7ffa9ae30640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ffa94113ac0 con 0x7ffa94101f70 2024-09-21T03:43:03.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.012+0000 7ffa9ae30640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa94113940 con 0x7ffa941094b0 2024-09-21T03:43:03.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.012+0000 7ffa9ae30640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffa94113c40 con 0x7ffa94109e00 2024-09-21T03:43:03.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.012+0000 7ffa93fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa941094b0 0x7ffa94102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:03.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.012+0000 7ffa93fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa941094b0 0x7ffa94102f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:57700/0 (socket says 172.21.15.84:57700) 2024-09-21T03:43:03.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.012+0000 7ffa93fff640 1 -- 172.21.15.84:0/3350147538 learned_addr learned my addr 172.21.15.84:0/3350147538 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:03.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.013+0000 7ffa993cd640 1 --2- 172.21.15.84:0/3350147538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa94109e00 0x7ffa94103450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:03.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.013+0000 7ffa93fff640 1 -- 172.21.15.84:0/3350147538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa94109e00 msgr2=0x7ffa94103450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:03.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.013+0000 7ffa93fff640 1 --2- 172.21.15.84:0/3350147538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa94109e00 0x7ffa94103450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.013+0000 7ffa93fff640 1 -- 172.21.15.84:0/3350147538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa94101f70 msgr2=0x7ffa94104920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:03.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.013+0000 7ffa93fff640 1 --2- 172.21.15.84:0/3350147538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa94101f70 0x7ffa94104920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.013+0000 7ffa93fff640 1 -- 172.21.15.84:0/3350147538 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa94103be0 con 0x7ffa941094b0 2024-09-21T03:43:03.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.013+0000 7ffa93fff640 1 --2- 172.21.15.84:0/3350147538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa941094b0 0x7ffa94102f10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffa8000c8c0 tx=0x7ffa8000cd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:03.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.013+0000 7ffa91ffb640 1 -- 172.21.15.84:0/3350147538 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa80007bb0 con 0x7ffa941094b0 2024-09-21T03:43:03.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.013+0000 7ffa91ffb640 1 -- 172.21.15.84:0/3350147538 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa80007d50 con 0x7ffa941094b0 2024-09-21T03:43:03.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.014+0000 7ffa9ae30640 1 -- 172.21.15.84:0/3350147538 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa941ace50 con 0x7ffa941094b0 2024-09-21T03:43:03.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.014+0000 7ffa91ffb640 1 -- 172.21.15.84:0/3350147538 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa800187c0 con 0x7ffa941094b0 2024-09-21T03:43:03.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.014+0000 7ffa9ae30640 1 -- 172.21.15.84:0/3350147538 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa941ad2a0 con 0x7ffa941094b0 2024-09-21T03:43:03.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.017+0000 7ffaa13a4740 1 Processor -- start 2024-09-21T03:43:03.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.017+0000 7ffaa13a4740 1 -- start start 2024-09-21T03:43:03.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.018+0000 7ffa91ffb640 1 -- 172.21.15.84:0/3350147538 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7ffa8000fab0 con 0x7ffa941094b0 2024-09-21T03:43:03.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.018+0000 7ffaa13a4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10f2070 0x556ca1499650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:03.022 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.018+0000 7ffaa13a4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10c91b0 0x556ca1499b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:03.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.018+0000 7ffaa13a4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10d1390 0x556ca149a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:03.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.018+0000 7ffaa13a4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556ca140fe50 con 0x556ca10c91b0 2024-09-21T03:43:03.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.018+0000 7ffaa13a4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556ca13ff280 con 0x556ca10f2070 2024-09-21T03:43:03.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.018+0000 7ffaa13a4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x556ca1403090 con 0x556ca10d1390 2024-09-21T03:43:03.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.018+0000 7ffa98bcc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10c91b0 0x556ca1499b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:03.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.018+0000 7ffa98bcc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10c91b0 0x556ca1499b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47736/0 (socket says 172.21.15.84:47736) 2024-09-21T03:43:03.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.018+0000 7ffa98bcc640 1 -- 172.21.15.84:0/3839298729 learned_addr learned my addr 172.21.15.84:0/3839298729 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:03.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.018+0000 7ffa93fff640 1 --2- 172.21.15.84:0/3839298729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10d1390 0x556ca149a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:03.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.018+0000 7ffa993cd640 1 --2- 172.21.15.84:0/3839298729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10f2070 0x556ca1499650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:03.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.018+0000 7ffa93fff640 1 -- 172.21.15.84:0/3839298729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10f2070 msgr2=0x556ca1499650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:03.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.018+0000 7ffa93fff640 1 --2- 172.21.15.84:0/3839298729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10f2070 0x556ca1499650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.018+0000 7ffa93fff640 1 -- 172.21.15.84:0/3839298729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10c91b0 msgr2=0x556ca1499b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:03.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.018+0000 7ffa93fff640 1 --2- 172.21.15.84:0/3839298729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10c91b0 0x556ca1499b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.018+0000 7ffa93fff640 1 -- 172.21.15.84:0/3839298729 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ca115d650 con 0x556ca10d1390 2024-09-21T03:43:03.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.018+0000 7ffa98bcc640 1 --2- 172.21.15.84:0/3839298729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10c91b0 0x556ca1499b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:43:03.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.018+0000 7ffa993cd640 1 --2- 172.21.15.84:0/3839298729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10f2070 0x556ca1499650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:03.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.019+0000 7ffa93fff640 1 --2- 172.21.15.84:0/3839298729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10d1390 0x556ca149a0d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffa800e4fb0 tx=0x7ffa800edc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4d06cab6bddf2bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:03.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.019+0000 7ffa91ffb640 1 --2- 172.21.15.84:0/3350147538 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ffa840b6790 0x7ffa840b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:03.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.019+0000 7ffa7effd640 1 -- 172.21.15.84:0/3839298729 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa800f6070 con 0x556ca10d1390 2024-09-21T03:43:03.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.019+0000 7ffa7effd640 1 -- 172.21.15.84:0/3839298729 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa800ede50 con 0x556ca10d1390 2024-09-21T03:43:03.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.019+0000 7ffa7effd640 1 -- 172.21.15.84:0/3839298729 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa80099e40 con 0x556ca10d1390 2024-09-21T03:43:03.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.019+0000 7ffa993cd640 1 --2- 172.21.15.84:0/3350147538 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ffa840b6790 0x7ffa840b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:03.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.019+0000 7ffa91ffb640 1 -- 172.21.15.84:0/3350147538 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ffa800e7900 con 0x7ffa941094b0 2024-09-21T03:43:03.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.020+0000 7ffaa13a4740 1 -- 172.21.15.84:0/3839298729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10d1390 msgr2=0x556ca149a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:03.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.020+0000 7ffaa13a4740 1 --2- 172.21.15.84:0/3839298729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10d1390 0x556ca149a0d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffa800e4fb0 tx=0x7ffa800edc00 comp rx=0 tx=0).stop 2024-09-21T03:43:03.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.020+0000 7ffa993cd640 1 --2- 172.21.15.84:0/3350147538 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ffa840b6790 0x7ffa840b8ca0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffa94104fd0 tx=0x7ffa8c009600 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:03.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.021+0000 7ffaa13a4740 1 -- 172.21.15.84:0/3839298729 shutdown_connections 2024-09-21T03:43:03.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.021+0000 7ffaa13a4740 1 --2- 172.21.15.84:0/3839298729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10d1390 0x556ca149a0d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.021+0000 7ffaa13a4740 1 --2- 172.21.15.84:0/3839298729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10c91b0 0x556ca1499b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.021+0000 7ffaa13a4740 1 --2- 172.21.15.84:0/3839298729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10f2070 0x556ca1499650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.021+0000 7ffaa13a4740 1 -- 172.21.15.84:0/3839298729 >> 172.21.15.84:0/3839298729 conn(0x556ca10e6460 msgr2=0x556ca1497540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:03.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.021+0000 7ffaa13a4740 1 -- 172.21.15.84:0/3839298729 shutdown_connections 2024-09-21T03:43:03.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.021+0000 7ffaa13a4740 1 -- 172.21.15.84:0/3839298729 wait complete. 2024-09-21T03:43:03.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.021+0000 7ffaa13a4740 1 -- start start 2024-09-21T03:43:03.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.022+0000 7ffaa13a4740 1 Processor -- start 2024-09-21T03:43:03.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.022+0000 7ffaa13a4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10c91b0 0x556ca14a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:03.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.022+0000 7ffaa13a4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10d1390 0x556ca14a5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:03.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.022+0000 7ffaa13a4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10f2070 0x556ca14a56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:03.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.022+0000 7ffaa13a4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556ca1260700 con 0x556ca10f2070 2024-09-21T03:43:03.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.022+0000 7ffaa13a4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556ca139a110 con 0x556ca10d1390 2024-09-21T03:43:03.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.022+0000 7ffaa13a4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x556ca14a7e30 con 0x556ca10c91b0 2024-09-21T03:43:03.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.023+0000 7ffaa13a4740 10 client.0 _ll_register_callbacks cb 0x556ca13b3990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:03.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.023+0000 7ffa993cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10f2070 0x556ca14a56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:03.030 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.023+0000 7ffa993cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10f2070 0x556ca14a56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47744/0 (socket says 172.21.15.84:47744) 2024-09-21T03:43:03.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.023+0000 7ffa993cd640 1 -- 172.21.15.84:0/1755284453 learned_addr learned my addr 172.21.15.84:0/1755284453 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:03.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.023+0000 7ffa98bcc640 1 --2- 172.21.15.84:0/1755284453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10c91b0 0x556ca14a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:03.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.023+0000 7ffa93fff640 1 --2- 172.21.15.84:0/1755284453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10d1390 0x556ca14a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:03.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.023+0000 7ffa993cd640 1 -- 172.21.15.84:0/1755284453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10c91b0 msgr2=0x556ca14a4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:03.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.023+0000 7ffa993cd640 1 --2- 172.21.15.84:0/1755284453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10c91b0 0x556ca14a4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.023+0000 7ffa993cd640 1 -- 172.21.15.84:0/1755284453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10d1390 msgr2=0x556ca14a5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:03.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.023+0000 7ffa993cd640 1 --2- 172.21.15.84:0/1755284453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10d1390 0x556ca14a5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.023+0000 7ffa993cd640 1 -- 172.21.15.84:0/1755284453 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ca13c7c40 con 0x556ca10f2070 2024-09-21T03:43:03.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.023+0000 7ffa93fff640 1 --2- 172.21.15.84:0/1755284453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10d1390 0x556ca14a5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:03.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.023+0000 7ffa993cd640 1 --2- 172.21.15.84:0/1755284453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10f2070 0x556ca14a56d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c01d6b0 tx=0x7ffa8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3137bca9bfd1c80 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:03.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.023+0000 7ffa73fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:43:03.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.024+0000 7ffa73fff640 1 -- 172.21.15.84:0/1755284453 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c004d20 con 0x556ca10f2070 2024-09-21T03:43:03.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.024+0000 7ffa73fff640 1 -- 172.21.15.84:0/1755284453 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ffa8c0105f0 con 0x556ca10f2070 2024-09-21T03:43:03.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.024+0000 7ffaa13a4740 1 -- 172.21.15.84:0/1755284453 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa800ede50 con 0x556ca10f2070 2024-09-21T03:43:03.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.024+0000 7ffa73fff640 1 -- 172.21.15.84:0/1755284453 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ffa8c0107f0 con 0x556ca10f2070 2024-09-21T03:43:03.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.024+0000 7ffaa13a4740 10 client.15552 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:03.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.024+0000 7ffaa13a4740 1 -- 172.21.15.84:0/1755284453 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556ca14b3a90 con 0x556ca10f2070 2024-09-21T03:43:03.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.024+0000 7ffa73fff640 1 -- 172.21.15.84:0/1755284453 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa800ede50 con 0x556ca10f2070 2024-09-21T03:43:03.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.025+0000 7ffa73fff640 1 -- 172.21.15.84:0/1755284453 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ffa8c00f040 con 0x556ca10f2070 2024-09-21T03:43:03.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.025+0000 7ffaa13a4740 10 client.15552 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:03.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.025+0000 7ffaa13a4740 10 client.15552 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:43:03.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.025+0000 7ffaa13a4740 20 client.15552 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:03.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.025+0000 7ffaa13a4740 1 --2- 172.21.15.84:0/1755284453 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556ca10b09f0 0x556ca14b70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:03.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.025+0000 7ffaa13a4740 4 client.15552 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:03.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.025+0000 7ffaa13a4740 1 -- 172.21.15.84:0/1755284453 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ca1411da0 con 0x556ca10b09f0 2024-09-21T03:43:03.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.026+0000 7ffa98bcc640 1 --2- 172.21.15.84:0/1755284453 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556ca10b09f0 0x556ca14b70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:03.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.026+0000 7ffa98bcc640 1 --2- 172.21.15.84:0/1755284453 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556ca10b09f0 0x556ca14b70b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33a97578a619569f server_cookie=3190129a0d2ae4a7 in_seq=0 out_seq=0 2024-09-21T03:43:03.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.026+0000 7ffa73fff640 10 client.15552 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:03.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.027+0000 7ffa73fff640 1 -- 172.21.15.84:0/1755284453 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ca1411da0 con 0x556ca10b09f0 2024-09-21T03:43:03.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.027+0000 7ffa73fff640 10 client.15552 handle_command_reply: tid=0 2024-09-21T03:43:03.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.027+0000 7ffaa13a4740 1 client.15552 shutdown 2024-09-21T03:43:03.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.027+0000 7ffaa13a4740 1 -- 172.21.15.84:0/1755284453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10f2070 msgr2=0x556ca14a56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:03.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.027+0000 7ffaa13a4740 1 --2- 172.21.15.84:0/1755284453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10f2070 0x556ca14a56d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c01d6b0 tx=0x7ffa8c004a40 comp rx=0 tx=0).stop 2024-09-21T03:43:03.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.027+0000 7ffaa13a4740 1 -- 172.21.15.84:0/1755284453 shutdown_connections 2024-09-21T03:43:03.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.027+0000 7ffaa13a4740 1 --2- 172.21.15.84:0/1755284453 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556ca10b09f0 0x556ca14b70b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.027+0000 7ffa73fff640 0 client.15552 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:03.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.028+0000 7ffaa13a4740 1 --2- 172.21.15.84:0/1755284453 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10f2070 0x556ca14a56d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.028+0000 7ffaa13a4740 1 --2- 172.21.15.84:0/1755284453 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10d1390 0x556ca14a5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.028+0000 7ffaa13a4740 1 --2- 172.21.15.84:0/1755284453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10c91b0 0x556ca14a4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.028+0000 7ffaa13a4740 1 -- 172.21.15.84:0/1755284453 >> 172.21.15.84:0/1755284453 conn(0x556ca10e6460 msgr2=0x556ca149c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:03.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.028+0000 7ffaa13a4740 1 -- 172.21.15.84:0/1755284453 shutdown_connections 2024-09-21T03:43:03.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.028+0000 7ffaa13a4740 1 -- 172.21.15.84:0/1755284453 wait complete. 2024-09-21T03:43:03.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.028+0000 7ffaa13a4740 20 client.15552 trim_cache size 0 max 16384 2024-09-21T03:43:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.065+0000 7ffaa13a4740 1 Processor -- start 2024-09-21T03:43:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.065+0000 7ffaa13a4740 1 -- start start 2024-09-21T03:43:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.066+0000 7ffaa13a4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10b09f0 0x556ca14a6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.066+0000 7ffaa13a4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10c91b0 0x556ca14a5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.066+0000 7ffaa13a4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10d1390 0x556ca14a5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.066+0000 7ffaa13a4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ffa941b84c0 con 0x556ca10d1390 2024-09-21T03:43:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.066+0000 7ffaa13a4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa941b5d90 con 0x556ca10b09f0 2024-09-21T03:43:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.066+0000 7ffaa13a4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffa941b3be0 con 0x556ca10c91b0 2024-09-21T03:43:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.066+0000 7ffa993cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10d1390 0x556ca14a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:03.068 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.066+0000 7ffa993cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10d1390 0x556ca14a5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47760/0 (socket says 172.21.15.84:47760) 2024-09-21T03:43:03.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.066+0000 7ffa993cd640 1 -- 172.21.15.84:0/2928653178 learned_addr learned my addr 172.21.15.84:0/2928653178 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:03.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.066+0000 7ffa98bcc640 1 --2- 172.21.15.84:0/2928653178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10b09f0 0x556ca14a6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:03.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.066+0000 7ffa93fff640 1 --2- 172.21.15.84:0/2928653178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10c91b0 0x556ca14a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:03.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.067+0000 7ffa98bcc640 1 -- 172.21.15.84:0/2928653178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10c91b0 msgr2=0x556ca14a5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:03.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.067+0000 7ffa98bcc640 1 --2- 172.21.15.84:0/2928653178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10c91b0 0x556ca14a5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.067+0000 7ffa98bcc640 1 -- 172.21.15.84:0/2928653178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10d1390 msgr2=0x556ca14a5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:03.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.067+0000 7ffa98bcc640 1 --2- 172.21.15.84:0/2928653178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10d1390 0x556ca14a5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.067+0000 7ffa98bcc640 1 -- 172.21.15.84:0/2928653178 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ca1497a80 con 0x556ca10b09f0 2024-09-21T03:43:03.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.067+0000 7ffa93fff640 1 --2- 172.21.15.84:0/2928653178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10c91b0 0x556ca14a5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:03.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.067+0000 7ffa993cd640 1 --2- 172.21.15.84:0/2928653178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10d1390 0x556ca14a5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:43:03.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.067+0000 7ffa98bcc640 1 --2- 172.21.15.84:0/2928653178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10b09f0 0x556ca14a6b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x556ca1489760 tx=0x7ffa88031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c6df99afe85dd36 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:03.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.067+0000 7ffa7e7fc640 1 -- 172.21.15.84:0/2928653178 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa88035040 con 0x556ca10b09f0 2024-09-21T03:43:03.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.067+0000 7ffa7e7fc640 1 -- 172.21.15.84:0/2928653178 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa88049070 con 0x556ca10b09f0 2024-09-21T03:43:03.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.067+0000 7ffa7e7fc640 1 -- 172.21.15.84:0/2928653178 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa88003b10 con 0x556ca10b09f0 2024-09-21T03:43:03.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.069+0000 7ffaa13a4740 1 -- 172.21.15.84:0/2928653178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10b09f0 msgr2=0x556ca14a6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:03.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.069+0000 7ffaa13a4740 1 --2- 172.21.15.84:0/2928653178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10b09f0 0x556ca14a6b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x556ca1489760 tx=0x7ffa88031400 comp rx=0 tx=0).stop 2024-09-21T03:43:03.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.069+0000 7ffaa13a4740 1 -- 172.21.15.84:0/2928653178 shutdown_connections 2024-09-21T03:43:03.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.069+0000 7ffaa13a4740 1 --2- 172.21.15.84:0/2928653178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10d1390 0x556ca14a5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.069+0000 7ffaa13a4740 1 --2- 172.21.15.84:0/2928653178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10c91b0 0x556ca14a5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.069+0000 7ffaa13a4740 1 --2- 172.21.15.84:0/2928653178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10b09f0 0x556ca14a6b30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.069+0000 7ffaa13a4740 1 -- 172.21.15.84:0/2928653178 >> 172.21.15.84:0/2928653178 conn(0x556ca10e6460 msgr2=0x556ca14a4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:03.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.069+0000 7ffaa13a4740 1 -- 172.21.15.84:0/2928653178 shutdown_connections 2024-09-21T03:43:03.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.069+0000 7ffaa13a4740 1 -- 172.21.15.84:0/2928653178 wait complete. 2024-09-21T03:43:03.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.069+0000 7ffaa13a4740 1 -- start start 2024-09-21T03:43:03.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.069+0000 7ffaa13a4740 1 Processor -- start 2024-09-21T03:43:03.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.070+0000 7ffaa13a4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10b09f0 0x556ca14ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:03.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.070+0000 7ffaa13a4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10c91b0 0x556ca14a8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:03.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.070+0000 7ffaa13a4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10d1390 0x556ca14a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:03.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.070+0000 7ffa93fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10c91b0 0x556ca14a8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:03.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.070+0000 7ffa93fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10c91b0 0x556ca14a8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:57730/0 (socket says 172.21.15.84:57730) 2024-09-21T03:43:03.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.070+0000 7ffa98bcc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10b09f0 0x556ca14ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:03.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.070+0000 7ffa993cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10d1390 0x556ca14a91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:03.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.070+0000 7ffa993cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10d1390 0x556ca14a91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47762/0 (socket says 172.21.15.84:47762) 2024-09-21T03:43:03.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.070+0000 7ffa93fff640 1 -- 172.21.15.84:0/3129214576 learned_addr learned my addr 172.21.15.84:0/3129214576 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:03.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.071+0000 7ffaa13a4740 1 -- 172.21.15.84:0/3129214576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ffa941b4250 con 0x556ca10d1390 2024-09-21T03:43:03.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.071+0000 7ffaa13a4740 1 -- 172.21.15.84:0/3129214576 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa941b56c0 con 0x556ca10c91b0 2024-09-21T03:43:03.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.071+0000 7ffaa13a4740 1 -- 172.21.15.84:0/3129214576 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ffa941b4920 con 0x556ca10b09f0 2024-09-21T03:43:03.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.071+0000 7ffaa13a4740 10 client.0 _ll_register_callbacks cb 0x7ffa8c01d570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:03.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.071+0000 7ffa993cd640 1 -- 172.21.15.84:0/3129214576 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10b09f0 msgr2=0x556ca14ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:03.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.071+0000 7ffa993cd640 1 --2- 172.21.15.84:0/3129214576 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10b09f0 0x556ca14ad7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.071+0000 7ffa993cd640 1 -- 172.21.15.84:0/3129214576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10c91b0 msgr2=0x556ca14a8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:03.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.071+0000 7ffa993cd640 1 --2- 172.21.15.84:0/3129214576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10c91b0 0x556ca14a8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.071+0000 7ffa993cd640 1 -- 172.21.15.84:0/3129214576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ca14a98a0 con 0x556ca10d1390 2024-09-21T03:43:03.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.071+0000 7ffa993cd640 1 --2- 172.21.15.84:0/3129214576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10d1390 0x556ca14a91b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c006010 tx=0x7ffa8c010670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149ebaedaf8a299a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:03.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.071+0000 7ffa73fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:43:03.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.072+0000 7ffa73fff640 1 -- 172.21.15.84:0/3129214576 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c03e060 con 0x556ca10d1390 2024-09-21T03:43:03.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.072+0000 7ffa73fff640 1 -- 172.21.15.84:0/3129214576 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ffa8c031ae0 con 0x556ca10d1390 2024-09-21T03:43:03.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.072+0000 7ffaa13a4740 1 -- 172.21.15.84:0/3129214576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa88049070 con 0x556ca10d1390 2024-09-21T03:43:03.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.072+0000 7ffa73fff640 1 -- 172.21.15.84:0/3129214576 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ffa8c031d20 con 0x556ca10d1390 2024-09-21T03:43:03.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.072+0000 7ffaa13a4740 10 client.15558 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:03.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.072+0000 7ffaa13a4740 1 -- 172.21.15.84:0/3129214576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556ca1521920 con 0x556ca10d1390 2024-09-21T03:43:03.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.073+0000 7ffa73fff640 1 -- 172.21.15.84:0/3129214576 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa88049070 con 0x556ca10d1390 2024-09-21T03:43:03.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.073+0000 7ffa73fff640 1 -- 172.21.15.84:0/3129214576 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ffa8c043610 con 0x556ca10d1390 2024-09-21T03:43:03.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.073+0000 7ffaa13a4740 10 client.15558 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:03.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.073+0000 7ffaa13a4740 10 client.15558 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:43:03.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.073+0000 7ffaa13a4740 20 client.15558 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:03.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.073+0000 7ffaa13a4740 1 --2- 172.21.15.84:0/3129214576 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556ca10f2070 0x556ca1524060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:03.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.073+0000 7ffaa13a4740 4 client.15558 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:43:03.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.073+0000 7ffaa13a4740 1 -- 172.21.15.84:0/3129214576 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556ca140d850 con 0x556ca10f2070 2024-09-21T03:43:03.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.073+0000 7ffa98bcc640 1 --2- 172.21.15.84:0/3129214576 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556ca10f2070 0x556ca1524060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:03.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.074+0000 7ffa73fff640 10 client.15558 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:03.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.074+0000 7ffa98bcc640 1 --2- 172.21.15.84:0/3129214576 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556ca10f2070 0x556ca1524060 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59147670b88771a3 server_cookie=61e0163cf6290fa0 in_seq=0 out_seq=0 2024-09-21T03:43:03.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.074+0000 7ffa73fff640 1 -- 172.21.15.84:0/3129214576 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x556ca140d850 con 0x556ca10f2070 2024-09-21T03:43:03.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.074+0000 7ffa73fff640 10 client.15558 handle_command_reply: tid=0 2024-09-21T03:43:03.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.074+0000 7ffaa13a4740 1 client.15558 shutdown 2024-09-21T03:43:03.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.074+0000 7ffaa13a4740 1 -- 172.21.15.84:0/3129214576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10d1390 msgr2=0x556ca14a91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:03.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.074+0000 7ffaa13a4740 1 --2- 172.21.15.84:0/3129214576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10d1390 0x556ca14a91b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c006010 tx=0x7ffa8c010670 comp rx=0 tx=0).stop 2024-09-21T03:43:03.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.075+0000 7ffaa13a4740 1 -- 172.21.15.84:0/3129214576 shutdown_connections 2024-09-21T03:43:03.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.075+0000 7ffaa13a4740 1 --2- 172.21.15.84:0/3129214576 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556ca10f2070 0x556ca1524060 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.075+0000 7ffaa13a4740 1 --2- 172.21.15.84:0/3129214576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556ca10d1390 0x556ca14a91b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.075+0000 7ffaa13a4740 1 --2- 172.21.15.84:0/3129214576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556ca10c91b0 0x556ca14a8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.075+0000 7ffaa13a4740 1 --2- 172.21.15.84:0/3129214576 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556ca10b09f0 0x556ca14ad7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.075+0000 7ffaa13a4740 1 -- 172.21.15.84:0/3129214576 >> 172.21.15.84:0/3129214576 conn(0x556ca10e6460 msgr2=0x556ca14a6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:03.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.075+0000 7ffa73fff640 0 client.15558 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:03.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.075+0000 7ffaa13a4740 1 -- 172.21.15.84:0/3129214576 shutdown_connections 2024-09-21T03:43:03.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.075+0000 7ffaa13a4740 1 -- 172.21.15.84:0/3129214576 wait complete. 2024-09-21T03:43:03.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.075+0000 7ffaa13a4740 20 client.15558 trim_cache size 0 max 16384 2024-09-21T03:43:03.078 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:43:03.078 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T03:43:03.078 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T03:43:03.078 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:43:03.079 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:43:03.079 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:43:03.079 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:43:03.079 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:43:03.079 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:43:03.079 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:43:03.079 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:43:03.079 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:43:03.079 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:43:03.079 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:43:03.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.076+0000 7ffa9ae30640 1 -- 172.21.15.84:0/3350147538 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ffa840b6790 msgr2=0x7ffa840b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:03.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.076+0000 7ffa9ae30640 1 --2- 172.21.15.84:0/3350147538 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ffa840b6790 0x7ffa840b8ca0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffa94104fd0 tx=0x7ffa8c009600 comp rx=0 tx=0).stop 2024-09-21T03:43:03.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.076+0000 7ffa9ae30640 1 -- 172.21.15.84:0/3350147538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa941094b0 msgr2=0x7ffa94102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:03.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.076+0000 7ffa9ae30640 1 --2- 172.21.15.84:0/3350147538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa941094b0 0x7ffa94102f10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ffa8000c8c0 tx=0x7ffa8000cd80 comp rx=0 tx=0).stop 2024-09-21T03:43:03.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.076+0000 7ffa9ae30640 1 -- 172.21.15.84:0/3350147538 shutdown_connections 2024-09-21T03:43:03.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.076+0000 7ffa9ae30640 1 --2- 172.21.15.84:0/3350147538 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ffa840b6790 0x7ffa840b8ca0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.076+0000 7ffa9ae30640 1 --2- 172.21.15.84:0/3350147538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ffa94109e00 0x7ffa94103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.076+0000 7ffa9ae30640 1 --2- 172.21.15.84:0/3350147538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa941094b0 0x7ffa94102f10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.076+0000 7ffa9ae30640 1 --2- 172.21.15.84:0/3350147538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ffa94101f70 0x7ffa94104920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:03.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.076+0000 7ffa9ae30640 1 -- 172.21.15.84:0/3350147538 >> 172.21.15.84:0/3350147538 conn(0x7ffa94077c60 msgr2=0x7ffa941075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:03.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.077+0000 7ffa9ae30640 1 -- 172.21.15.84:0/3350147538 shutdown_connections 2024-09-21T03:43:03.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:03.077+0000 7ffa9ae30640 1 -- 172.21.15.84:0/3350147538 wait complete. 2024-09-21T03:43:03.498 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:03 smithi084 ceph-mon[30941]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-09-21T03:43:03.498 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:03 smithi084 ceph-mon[30941]: mgrmap e26: x(active, since 9m), standbys: z, y 2024-09-21T03:43:03.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:03 smithi174 ceph-mon[34403]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-09-21T03:43:03.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:03 smithi174 ceph-mon[34403]: mgrmap e26: x(active, since 9m), standbys: z, y 2024-09-21T03:43:03.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:03 smithi172 ceph-mon[34821]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-09-21T03:43:03.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:03 smithi172 ceph-mon[34821]: mgrmap e26: x(active, since 9m), standbys: z, y 2024-09-21T03:43:03.901 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:43:03.902 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:43:04.270 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:04.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.827+0000 7f5f5bc74640 1 -- 172.21.15.84:0/1992889269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f541083a0 msgr2=0x7f5f541087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:04.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.827+0000 7f5f5bc74640 1 --2- 172.21.15.84:0/1992889269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f541083a0 0x7f5f541087b0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009900 tx=0x7f5f4402a410 comp rx=0 tx=0).stop 2024-09-21T03:43:04.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.827+0000 7f5f5bc74640 1 -- 172.21.15.84:0/1992889269 shutdown_connections 2024-09-21T03:43:04.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.827+0000 7f5f5bc74640 1 --2- 172.21.15.84:0/1992889269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f54108cf0 0x7f5f5410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:04.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.827+0000 7f5f5bc74640 1 --2- 172.21.15.84:0/1992889269 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f541083a0 0x7f5f541087b0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:04.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.827+0000 7f5f5bc74640 1 --2- 172.21.15.84:0/1992889269 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f54102a60 0x7f5f54102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:04.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.827+0000 7f5f5bc74640 1 -- 172.21.15.84:0/1992889269 >> 172.21.15.84:0/1992889269 conn(0x7f5f54079730 msgr2=0x7f5f54079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:04.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.827+0000 7f5f5bc74640 1 -- 172.21.15.84:0/1992889269 shutdown_connections 2024-09-21T03:43:04.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.827+0000 7f5f5bc74640 1 -- 172.21.15.84:0/1992889269 wait complete. 2024-09-21T03:43:04.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.828+0000 7f5f5bc74640 1 Processor -- start 2024-09-21T03:43:04.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.828+0000 7f5f5bc74640 1 -- start start 2024-09-21T03:43:04.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.829+0000 7f5f5bc74640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f54102a60 0x7f5f54074f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:04.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.829+0000 7f5f5bc74640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f541083a0 0x7f5f5406e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:04.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.829+0000 7f5f59a10640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f54102a60 0x7f5f54074f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:04.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.829+0000 7f5f59a10640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f54102a60 0x7f5f54074f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47784/0 (socket says 172.21.15.84:47784) 2024-09-21T03:43:04.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.829+0000 7f5f5bc74640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f54108cf0 0x7f5f5406e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:04.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.829+0000 7f5f5bc74640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5f54113b20 con 0x7f5f54102a60 2024-09-21T03:43:04.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.829+0000 7f5f5bc74640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5f541139a0 con 0x7f5f541083a0 2024-09-21T03:43:04.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.829+0000 7f5f5bc74640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5f54113ca0 con 0x7f5f54108cf0 2024-09-21T03:43:04.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.829+0000 7f5f59a10640 1 -- 172.21.15.84:0/1482963309 learned_addr learned my addr 172.21.15.84:0/1482963309 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:04.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.829+0000 7f5f5920f640 1 --2- 172.21.15.84:0/1482963309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f541083a0 0x7f5f5406e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:04.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.829+0000 7f5f5a211640 1 --2- 172.21.15.84:0/1482963309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f54108cf0 0x7f5f5406e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:04.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.830+0000 7f5f59a10640 1 -- 172.21.15.84:0/1482963309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f54108cf0 msgr2=0x7f5f5406e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:04.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.830+0000 7f5f59a10640 1 --2- 172.21.15.84:0/1482963309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f54108cf0 0x7f5f5406e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:04.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.830+0000 7f5f59a10640 1 -- 172.21.15.84:0/1482963309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f541083a0 msgr2=0x7f5f5406e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:04.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.830+0000 7f5f59a10640 1 --2- 172.21.15.84:0/1482963309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f541083a0 0x7f5f5406e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:04.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.830+0000 7f5f59a10640 1 -- 172.21.15.84:0/1482963309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f54073bf0 con 0x7f5f54102a60 2024-09-21T03:43:04.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.830+0000 7f5f59a10640 1 --2- 172.21.15.84:0/1482963309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f54102a60 0x7f5f54074f80 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000b4a0 tx=0x7f5f5000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:04.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.830+0000 7f5f4affd640 1 -- 172.21.15.84:0/1482963309 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f50014070 con 0x7f5f54102a60 2024-09-21T03:43:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.830+0000 7f5f5bc74640 1 -- 172.21.15.84:0/1482963309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f54073ee0 con 0x7f5f54102a60 2024-09-21T03:43:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.830+0000 7f5f4affd640 1 -- 172.21.15.84:0/1482963309 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f50010ac0 con 0x7f5f54102a60 2024-09-21T03:43:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.830+0000 7f5f5bc74640 1 -- 172.21.15.84:0/1482963309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f540743f0 con 0x7f5f54102a60 2024-09-21T03:43:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.831+0000 7f5f4affd640 1 -- 172.21.15.84:0/1482963309 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f50014070 con 0x7f5f54102a60 2024-09-21T03:43:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.831+0000 7f5f5bc74640 1 -- 172.21.15.84:0/1482963309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f54103ce0 con 0x7f5f54102a60 2024-09-21T03:43:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.835+0000 7f5f4affd640 1 -- 172.21.15.84:0/1482963309 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7f5f50017070 con 0x7f5f54102a60 2024-09-21T03:43:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.836+0000 7f5f4affd640 1 --2- 172.21.15.84:0/1482963309 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f400b6910 0x7f5f400b8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.836+0000 7f5f5920f640 1 --2- 172.21.15.84:0/1482963309 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f400b6910 0x7f5f400b8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.836+0000 7f5f4affd640 1 -- 172.21.15.84:0/1482963309 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f5f500e6b50 con 0x7f5f54102a60 2024-09-21T03:43:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.837+0000 7f5f5920f640 1 --2- 172.21.15.84:0/1482963309 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f400b6910 0x7f5f400b8e20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5f44000c00 tx=0x7f5f44031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:04.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:04.839+0000 7f5f4affd640 1 -- 172.21.15.84:0/1482963309 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5f5001e030 con 0x7f5f54102a60 2024-09-21T03:43:05.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:05.076+0000 7f5f5bc74640 1 -- 172.21.15.84:0/1482963309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f54102ef0 con 0x7f5f54102a60 2024-09-21T03:43:05.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:05.076+0000 7f5f4affd640 1 -- 172.21.15.84:0/1482963309 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7f5f500acfb0 con 0x7f5f54102a60 2024-09-21T03:43:05.079 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:43:05.079 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:43:05.079 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:43:05.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:05.079+0000 7f5f5bc74640 1 -- 172.21.15.84:0/1482963309 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f400b6910 msgr2=0x7f5f400b8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:05.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:05.079+0000 7f5f5bc74640 1 --2- 172.21.15.84:0/1482963309 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f400b6910 0x7f5f400b8e20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5f44000c00 tx=0x7f5f44031400 comp rx=0 tx=0).stop 2024-09-21T03:43:05.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:05.079+0000 7f5f5bc74640 1 -- 172.21.15.84:0/1482963309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f54102a60 msgr2=0x7f5f54074f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:05.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:05.079+0000 7f5f5bc74640 1 --2- 172.21.15.84:0/1482963309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f54102a60 0x7f5f54074f80 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000b4a0 tx=0x7f5f5000b960 comp rx=0 tx=0).stop 2024-09-21T03:43:05.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:05.079+0000 7f5f5bc74640 1 -- 172.21.15.84:0/1482963309 shutdown_connections 2024-09-21T03:43:05.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:05.079+0000 7f5f5bc74640 1 --2- 172.21.15.84:0/1482963309 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f400b6910 0x7f5f400b8e20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:05.079+0000 7f5f5bc74640 1 --2- 172.21.15.84:0/1482963309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f54108cf0 0x7f5f5406e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:05.079+0000 7f5f5bc74640 1 --2- 172.21.15.84:0/1482963309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f541083a0 0x7f5f5406e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:05.079+0000 7f5f5bc74640 1 --2- 172.21.15.84:0/1482963309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f54102a60 0x7f5f54074f80 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:05.079+0000 7f5f5bc74640 1 -- 172.21.15.84:0/1482963309 >> 172.21.15.84:0/1482963309 conn(0x7f5f54079730 msgr2=0x7f5f54105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:05.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:05.079+0000 7f5f5bc74640 1 -- 172.21.15.84:0/1482963309 shutdown_connections 2024-09-21T03:43:05.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:05.079+0000 7f5f5bc74640 1 -- 172.21.15.84:0/1482963309 wait complete. 2024-09-21T03:43:05.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:05 smithi084 ceph-mon[30941]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-09-21T03:43:05.419 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:05 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1482963309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:43:05.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:05 smithi174 ceph-mon[34403]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-09-21T03:43:05.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:05 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1482963309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:43:05.880 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:43:05.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:05 smithi172 ceph-mon[34821]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-09-21T03:43:05.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:05 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1482963309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:43:06.221 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:06.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.789+0000 7f798ee07640 1 -- 172.21.15.84:0/4255734376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7988102a60 msgr2=0x7f7988102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:06.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.789+0000 7f798ee07640 1 --2- 172.21.15.84:0/4255734376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7988102a60 0x7f7988102e70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f797c009900 tx=0x7f797c02a410 comp rx=0 tx=0).stop 2024-09-21T03:43:06.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.789+0000 7f798ee07640 1 -- 172.21.15.84:0/4255734376 shutdown_connections 2024-09-21T03:43:06.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.789+0000 7f798ee07640 1 --2- 172.21.15.84:0/4255734376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7988108cf0 0x7f798810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.789+0000 7f798ee07640 1 --2- 172.21.15.84:0/4255734376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79881083a0 0x7f79881087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.789+0000 7f798ee07640 1 --2- 172.21.15.84:0/4255734376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7988102a60 0x7f7988102e70 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.789+0000 7f798ee07640 1 -- 172.21.15.84:0/4255734376 >> 172.21.15.84:0/4255734376 conn(0x7f7988079730 msgr2=0x7f7988079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:06.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.789+0000 7f798ee07640 1 -- 172.21.15.84:0/4255734376 shutdown_connections 2024-09-21T03:43:06.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.789+0000 7f798ee07640 1 -- 172.21.15.84:0/4255734376 wait complete. 2024-09-21T03:43:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.790+0000 7f798ee07640 1 Processor -- start 2024-09-21T03:43:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.790+0000 7f798ee07640 1 -- start start 2024-09-21T03:43:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.790+0000 7f798ee07640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7988102a60 0x7f79881982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.790+0000 7f798ee07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79881083a0 0x7f7988198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.790+0000 7f798ee07640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7988108cf0 0x7f798819daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.790+0000 7f798ee07640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7988111860 con 0x7f7988102a60 2024-09-21T03:43:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.790+0000 7f798ee07640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79881116e0 con 0x7f79881083a0 2024-09-21T03:43:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.790+0000 7f798ee07640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f79881119e0 con 0x7f7988108cf0 2024-09-21T03:43:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.791+0000 7f7987fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79881083a0 0x7f7988198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.791+0000 7f7987fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79881083a0 0x7f7988198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:57776/0 (socket says 172.21.15.84:57776) 2024-09-21T03:43:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.791+0000 7f7987fff640 1 -- 172.21.15.84:0/3867794629 learned_addr learned my addr 172.21.15.84:0/3867794629 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:06.795 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.791+0000 7f798d3a4640 1 --2- 172.21.15.84:0/3867794629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7988108cf0 0x7f798819daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:06.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.791+0000 7f798cba3640 1 --2- 172.21.15.84:0/3867794629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7988102a60 0x7f79881982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:06.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.791+0000 7f7987fff640 1 -- 172.21.15.84:0/3867794629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7988108cf0 msgr2=0x7f798819daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:06.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.791+0000 7f7987fff640 1 --2- 172.21.15.84:0/3867794629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7988108cf0 0x7f798819daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.791+0000 7f7987fff640 1 -- 172.21.15.84:0/3867794629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7988102a60 msgr2=0x7f79881982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:06.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.791+0000 7f7987fff640 1 --2- 172.21.15.84:0/3867794629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7988102a60 0x7f79881982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.791+0000 7f7987fff640 1 -- 172.21.15.84:0/3867794629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f798819e220 con 0x7f79881083a0 2024-09-21T03:43:06.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.791+0000 7f798cba3640 1 --2- 172.21.15.84:0/3867794629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7988102a60 0x7f79881982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:06.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.791+0000 7f7987fff640 1 --2- 172.21.15.84:0/3867794629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79881083a0 0x7f7988198850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7974009db0 tx=0x7f797400f4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:06.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.792+0000 7f7985ffb640 1 -- 172.21.15.84:0/3867794629 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797400fdc0 con 0x7f79881083a0 2024-09-21T03:43:06.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.792+0000 7f798ee07640 1 -- 172.21.15.84:0/3867794629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f798819e510 con 0x7f79881083a0 2024-09-21T03:43:06.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.792+0000 7f7985ffb640 1 -- 172.21.15.84:0/3867794629 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79740054d0 con 0x7f79881083a0 2024-09-21T03:43:06.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.792+0000 7f7985ffb640 1 -- 172.21.15.84:0/3867794629 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7974017660 con 0x7f79881083a0 2024-09-21T03:43:06.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.792+0000 7f798ee07640 1 -- 172.21.15.84:0/3867794629 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79881a4c70 con 0x7f79881083a0 2024-09-21T03:43:06.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.795+0000 7f799537b740 1 Processor -- start 2024-09-21T03:43:06.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.795+0000 7f799537b740 1 -- start start 2024-09-21T03:43:06.798 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.795+0000 7f799537b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58ea0e070 0x55f58edb52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.795+0000 7f799537b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58e9e51b0 0x55f58edb5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.795+0000 7f799537b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9ed390 0x55f58edb5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.795+0000 7f799537b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f58ed2bea0 con 0x55f58ea0e070 2024-09-21T03:43:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.795+0000 7f799537b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f58ed1b2d0 con 0x55f58e9ed390 2024-09-21T03:43:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.796+0000 7f799537b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f58ed1f0e0 con 0x55f58e9e51b0 2024-09-21T03:43:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.796+0000 7f798cba3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58e9e51b0 0x55f58edb5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.796+0000 7f798d3a4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58ea0e070 0x55f58edb52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.796+0000 7f798cba3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58e9e51b0 0x55f58edb5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.84:39394/0 (socket says 172.21.15.84:39394) 2024-09-21T03:43:06.799 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.796+0000 7f798cba3640 1 -- 172.21.15.84:0/328205095 learned_addr learned my addr 172.21.15.84:0/328205095 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.797+0000 7f798d3a4640 1 -- 172.21.15.84:0/328205095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58e9e51b0 msgr2=0x55f58edb5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.797+0000 7f798d3a4640 1 --2- 172.21.15.84:0/328205095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58e9e51b0 0x55f58edb5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.797+0000 7f798d3a4640 1 -- 172.21.15.84:0/328205095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9ed390 msgr2=0x55f58edb5d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T03:43:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.797+0000 7f798d3a4640 1 --2- 172.21.15.84:0/328205095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9ed390 0x55f58edb5d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.797+0000 7f798d3a4640 1 -- 172.21.15.84:0/328205095 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f58ea79650 con 0x55f58ea0e070 2024-09-21T03:43:06.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.797+0000 7f798d3a4640 1 --2- 172.21.15.84:0/328205095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58ea0e070 0x55f58edb52c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7980009f50 tx=0x7f7980003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675f37c91b13ad61 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:06.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.797+0000 7f7985ffb640 1 -- 172.21.15.84:0/3867794629 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7f79740048c0 con 0x7f79881083a0 2024-09-21T03:43:06.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.797+0000 7f7972ffd640 1 -- 172.21.15.84:0/328205095 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7980011440 con 0x55f58ea0e070 2024-09-21T03:43:06.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.797+0000 7f7972ffd640 1 -- 172.21.15.84:0/328205095 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7980015030 con 0x55f58ea0e070 2024-09-21T03:43:06.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.797+0000 7f7972ffd640 1 -- 172.21.15.84:0/328205095 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7980010800 con 0x55f58ea0e070 2024-09-21T03:43:06.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.798+0000 7f7985ffb640 1 --2- 172.21.15.84:0/3867794629 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f79780b6790 0x7f79780b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:06.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.798+0000 7f7985ffb640 1 -- 172.21.15.84:0/3867794629 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f79740e7090 con 0x7f79881083a0 2024-09-21T03:43:06.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.798+0000 7f798cba3640 1 --2- 172.21.15.84:0/3867794629 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f79780b6790 0x7f79780b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:06.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.798+0000 7f799537b740 1 -- 172.21.15.84:0/328205095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58ea0e070 msgr2=0x55f58edb52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:06.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.798+0000 7f799537b740 1 --2- 172.21.15.84:0/328205095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58ea0e070 0x55f58edb52c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7980009f50 tx=0x7f7980003e00 comp rx=0 tx=0).stop 2024-09-21T03:43:06.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.799+0000 7f799537b740 1 -- 172.21.15.84:0/328205095 shutdown_connections 2024-09-21T03:43:06.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.799+0000 7f799537b740 1 --2- 172.21.15.84:0/328205095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9ed390 0x55f58edb5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.799+0000 7f799537b740 1 --2- 172.21.15.84:0/328205095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58e9e51b0 0x55f58edb5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.799+0000 7f799537b740 1 --2- 172.21.15.84:0/328205095 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58ea0e070 0x55f58edb52c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.799+0000 7f799537b740 1 -- 172.21.15.84:0/328205095 >> 172.21.15.84:0/328205095 conn(0x55f58ea02460 msgr2=0x55f58edb31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:06.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.799+0000 7f799537b740 1 -- 172.21.15.84:0/328205095 shutdown_connections 2024-09-21T03:43:06.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.799+0000 7f799537b740 1 -- 172.21.15.84:0/328205095 wait complete. 2024-09-21T03:43:06.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.799+0000 7f798cba3640 1 --2- 172.21.15.84:0/3867794629 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f79780b6790 0x7f79780b8ca0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55f58edb3f40 tx=0x7f797c0058b0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:06.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.799+0000 7f799537b740 1 -- start start 2024-09-21T03:43:06.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.800+0000 7f799537b740 1 Processor -- start 2024-09-21T03:43:06.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.800+0000 7f799537b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58e9e51b0 0x55f58edc0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:06.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.800+0000 7f799537b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9ed390 0x55f58edc0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:06.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.800+0000 7f799537b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58ea0e070 0x55f58edd11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.800+0000 7f798d3a4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58ea0e070 0x55f58edd11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.800+0000 7f799537b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f58eb7c700 con 0x55f58ea0e070 2024-09-21T03:43:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.800+0000 7f799537b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f58ecb6160 con 0x55f58e9ed390 2024-09-21T03:43:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.800+0000 7f799537b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f58edc7eb0 con 0x55f58e9e51b0 2024-09-21T03:43:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.800+0000 7f798d3a4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58ea0e070 0x55f58edd11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47844/0 (socket says 172.21.15.84:47844) 2024-09-21T03:43:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.800+0000 7f798d3a4640 1 -- 172.21.15.84:0/4289541191 learned_addr learned my addr 172.21.15.84:0/4289541191 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.801+0000 7f798d3a4640 1 -- 172.21.15.84:0/4289541191 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58e9e51b0 msgr2=0x55f58edc0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:06.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.801+0000 7f798cba3640 1 --2- 172.21.15.84:0/4289541191 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58e9e51b0 0x55f58edc0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.801+0000 7f7987fff640 1 --2- 172.21.15.84:0/4289541191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9ed390 0x55f58edc0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.800+0000 7f799537b740 10 client.0 _ll_register_callbacks cb 0x55f58eccf9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.801+0000 7f798d3a4640 1 --2- 172.21.15.84:0/4289541191 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58e9e51b0 0x55f58edc0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.801+0000 7f798d3a4640 1 -- 172.21.15.84:0/4289541191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9ed390 msgr2=0x55f58edc0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.801+0000 7f798d3a4640 1 --2- 172.21.15.84:0/4289541191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9ed390 0x55f58edc0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.801+0000 7f798d3a4640 1 -- 172.21.15.84:0/4289541191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f58ece3c90 con 0x55f58ea0e070 2024-09-21T03:43:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.801+0000 7f798d3a4640 1 --2- 172.21.15.84:0/4289541191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58ea0e070 0x55f58edd11d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7980010480 tx=0x7f7980011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4e3f555707d373 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.801+0000 7f7967fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:43:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.802+0000 7f798cba3640 1 --2- 172.21.15.84:0/4289541191 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58e9e51b0 0x55f58edc0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.802+0000 7f799537b740 1 -- 172.21.15.84:0/4289541191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7980015030 con 0x55f58ea0e070 2024-09-21T03:43:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.802+0000 7f7967fff640 1 -- 172.21.15.84:0/4289541191 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7980029060 con 0x55f58ea0e070 2024-09-21T03:43:06.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.802+0000 7f7967fff640 1 -- 172.21.15.84:0/4289541191 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f7980011870 con 0x55f58ea0e070 2024-09-21T03:43:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.802+0000 7f7967fff640 1 -- 172.21.15.84:0/4289541191 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7980011a70 con 0x55f58ea0e070 2024-09-21T03:43:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.802+0000 7f799537b740 10 client.15576 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.802+0000 7f799537b740 1 -- 172.21.15.84:0/4289541191 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55f58edd3b40 con 0x55f58ea0e070 2024-09-21T03:43:06.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.802+0000 7f7967fff640 1 -- 172.21.15.84:0/4289541191 <== mon.0 v2:172.21.15.84:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7980023070 con 0x55f58ea0e070 2024-09-21T03:43:06.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.802+0000 7f799537b740 10 client.15576 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:06.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.802+0000 7f799537b740 10 client.15576 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:43:06.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.802+0000 7f799537b740 20 client.15576 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:06.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.802+0000 7f799537b740 1 --2- 172.21.15.84:0/4289541191 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55f58e9cc9f0 0x55f58edd6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:06.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.802+0000 7f799537b740 4 client.15576 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:06.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.802+0000 7f799537b740 1 -- 172.21.15.84:0/4289541191 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f58ed2ddf0 con 0x55f58e9cc9f0 2024-09-21T03:43:06.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.803+0000 7f798cba3640 1 --2- 172.21.15.84:0/4289541191 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55f58e9cc9f0 0x55f58edd6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:06.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.803+0000 7f798cba3640 1 --2- 172.21.15.84:0/4289541191 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55f58e9cc9f0 0x55f58edd6ea0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ff6a1a1a200af34a server_cookie=6133e8f42937de7b in_seq=0 out_seq=0 2024-09-21T03:43:06.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.803+0000 7f7967fff640 10 client.15576 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:43:06.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.804+0000 7f7967fff640 1 -- 172.21.15.84:0/4289541191 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f58ed2ddf0 con 0x55f58e9cc9f0 2024-09-21T03:43:06.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.804+0000 7f7967fff640 10 client.15576 handle_command_reply: tid=0 2024-09-21T03:43:06.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.804+0000 7f799537b740 1 client.15576 shutdown 2024-09-21T03:43:06.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.806+0000 7f799537b740 1 -- 172.21.15.84:0/4289541191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58ea0e070 msgr2=0x55f58edd11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:06.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.806+0000 7f799537b740 1 --2- 172.21.15.84:0/4289541191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58ea0e070 0x55f58edd11d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7980010480 tx=0x7f7980011440 comp rx=0 tx=0).stop 2024-09-21T03:43:06.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.806+0000 7f799537b740 1 -- 172.21.15.84:0/4289541191 shutdown_connections 2024-09-21T03:43:06.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.806+0000 7f799537b740 1 --2- 172.21.15.84:0/4289541191 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55f58e9cc9f0 0x55f58edd6ea0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.806+0000 7f799537b740 1 --2- 172.21.15.84:0/4289541191 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58ea0e070 0x55f58edd11d0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.806+0000 7f799537b740 1 --2- 172.21.15.84:0/4289541191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9ed390 0x55f58edc0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.806+0000 7f799537b740 1 --2- 172.21.15.84:0/4289541191 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58e9e51b0 0x55f58edc0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.806+0000 7f7967fff640 0 client.15576 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:43:06.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.806+0000 7f799537b740 1 -- 172.21.15.84:0/4289541191 >> 172.21.15.84:0/4289541191 conn(0x55f58ea02460 msgr2=0x55f58edb84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:06.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.807+0000 7f799537b740 1 -- 172.21.15.84:0/4289541191 shutdown_connections 2024-09-21T03:43:06.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.807+0000 7f799537b740 1 -- 172.21.15.84:0/4289541191 wait complete. 2024-09-21T03:43:06.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.807+0000 7f799537b740 20 client.15576 trim_cache size 0 max 16384 2024-09-21T03:43:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.832+0000 7f799537b740 1 Processor -- start 2024-09-21T03:43:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.832+0000 7f799537b740 1 -- start start 2024-09-21T03:43:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.832+0000 7f799537b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58e9e51b0 0x55f58edb6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.832+0000 7f799537b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9ed390 0x55f58edd1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.832+0000 7f799537b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58ea0e070 0x55f58edbdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.832+0000 7f799537b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f79881afc10 con 0x55f58e9e51b0 2024-09-21T03:43:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.832+0000 7f799537b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79881ad4e0 con 0x55f58e9ed390 2024-09-21T03:43:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.832+0000 7f799537b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f79881ab330 con 0x55f58ea0e070 2024-09-21T03:43:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.832+0000 7f798cba3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58e9e51b0 0x55f58edb6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.832+0000 7f798cba3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58e9e51b0 0x55f58edb6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47852/0 (socket says 172.21.15.84:47852) 2024-09-21T03:43:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.832+0000 7f798cba3640 1 -- 172.21.15.84:0/773827976 learned_addr learned my addr 172.21.15.84:0/773827976 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.832+0000 7f798d3a4640 1 --2- 172.21.15.84:0/773827976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58ea0e070 0x55f58edbdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.833+0000 7f798cba3640 1 -- 172.21.15.84:0/773827976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58ea0e070 msgr2=0x55f58edbdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.833+0000 7f798cba3640 1 --2- 172.21.15.84:0/773827976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58ea0e070 0x55f58edbdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.833+0000 7f798cba3640 1 -- 172.21.15.84:0/773827976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9ed390 msgr2=0x55f58edd1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.833+0000 7f7987fff640 1 --2- 172.21.15.84:0/773827976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9ed390 0x55f58edd1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.833+0000 7f798cba3640 1 --2- 172.21.15.84:0/773827976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9ed390 0x55f58edd1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.833+0000 7f798cba3640 1 -- 172.21.15.84:0/773827976 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f58edb3d70 con 0x55f58e9e51b0 2024-09-21T03:43:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.833+0000 7f798cba3640 1 --2- 172.21.15.84:0/773827976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58e9e51b0 0x55f58edb6a00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f797c005f40 tx=0x7f797c03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2355d0a520d0f1e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.833+0000 7f79727fc640 1 -- 172.21.15.84:0/773827976 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c035040 con 0x55f58e9e51b0 2024-09-21T03:43:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.833+0000 7f79727fc640 1 -- 172.21.15.84:0/773827976 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f797c005040 con 0x55f58e9e51b0 2024-09-21T03:43:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.833+0000 7f79727fc640 1 -- 172.21.15.84:0/773827976 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c004750 con 0x55f58e9e51b0 2024-09-21T03:43:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.834+0000 7f799537b740 1 -- 172.21.15.84:0/773827976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58e9e51b0 msgr2=0x55f58edb6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.834+0000 7f799537b740 1 --2- 172.21.15.84:0/773827976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58e9e51b0 0x55f58edb6a00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f797c005f40 tx=0x7f797c03e000 comp rx=0 tx=0).stop 2024-09-21T03:43:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.835+0000 7f799537b740 1 -- 172.21.15.84:0/773827976 shutdown_connections 2024-09-21T03:43:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.835+0000 7f799537b740 1 --2- 172.21.15.84:0/773827976 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58ea0e070 0x55f58edbdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.835+0000 7f799537b740 1 --2- 172.21.15.84:0/773827976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9ed390 0x55f58edd1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.835+0000 7f799537b740 1 --2- 172.21.15.84:0/773827976 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58e9e51b0 0x55f58edb6a00 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.835+0000 7f799537b740 1 -- 172.21.15.84:0/773827976 >> 172.21.15.84:0/773827976 conn(0x55f58ea02460 msgr2=0x55f58edb62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.835+0000 7f799537b740 1 -- 172.21.15.84:0/773827976 shutdown_connections 2024-09-21T03:43:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.835+0000 7f799537b740 1 -- 172.21.15.84:0/773827976 wait complete. 2024-09-21T03:43:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.836+0000 7f799537b740 1 -- start start 2024-09-21T03:43:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.836+0000 7f799537b740 1 Processor -- start 2024-09-21T03:43:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.837+0000 7f799537b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9e51b0 0x55f58edd57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.837+0000 7f799537b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58e9ed390 0x55f58edd5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.837+0000 7f799537b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58ea0e070 0x55f58ee395d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.837+0000 7f799537b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f79881ab9a0 con 0x55f58e9ed390 2024-09-21T03:43:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.837+0000 7f799537b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79881ace10 con 0x55f58e9e51b0 2024-09-21T03:43:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.837+0000 7f799537b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f79881ac070 con 0x55f58ea0e070 2024-09-21T03:43:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.837+0000 7f798cba3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9e51b0 0x55f58edd57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.837+0000 7f798cba3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9e51b0 0x55f58edd57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:57810/0 (socket says 172.21.15.84:57810) 2024-09-21T03:43:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.837+0000 7f798cba3640 1 -- 172.21.15.84:0/3474198619 learned_addr learned my addr 172.21.15.84:0/3474198619 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.837+0000 7f799537b740 10 client.0 _ll_register_callbacks cb 0x7f797c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.837+0000 7f798cba3640 1 -- 172.21.15.84:0/3474198619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58ea0e070 msgr2=0x55f58ee395d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T03:43:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.837+0000 7f798cba3640 1 --2- 172.21.15.84:0/3474198619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58ea0e070 0x55f58ee395d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.837+0000 7f798cba3640 1 -- 172.21.15.84:0/3474198619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58e9ed390 msgr2=0x55f58edd5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.837+0000 7f798cba3640 1 --2- 172.21.15.84:0/3474198619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58e9ed390 0x55f58edd5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.837+0000 7f798cba3640 1 -- 172.21.15.84:0/3474198619 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f58ee39c40 con 0x55f58e9e51b0 2024-09-21T03:43:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.838+0000 7f798cba3640 1 --2- 172.21.15.84:0/3474198619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9e51b0 0x55f58edd57e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f797c005d00 tx=0x7f797c005530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=202536d855d306b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.838+0000 7f7967fff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T03:43:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.838+0000 7f7967fff640 1 -- 172.21.15.84:0/3474198619 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c05e060 con 0x55f58e9e51b0 2024-09-21T03:43:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.838+0000 7f799537b740 1 -- 172.21.15.84:0/3474198619 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f797c005040 con 0x55f58e9e51b0 2024-09-21T03:43:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.838+0000 7f7967fff640 1 -- 172.21.15.84:0/3474198619 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f797c04f040 con 0x55f58e9e51b0 2024-09-21T03:43:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.838+0000 7f7967fff640 1 -- 172.21.15.84:0/3474198619 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f797c035070 con 0x55f58e9e51b0 2024-09-21T03:43:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.838+0000 7f799537b740 10 client.25142 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.838+0000 7f799537b740 1 -- 172.21.15.84:0/3474198619 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f58ee40f90 con 0x55f58e9e51b0 2024-09-21T03:43:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.839+0000 7f7967fff640 1 -- 172.21.15.84:0/3474198619 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f797c005040 con 0x55f58e9e51b0 2024-09-21T03:43:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.839+0000 7f7967fff640 1 -- 172.21.15.84:0/3474198619 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f797c0035f0 con 0x55f58e9e51b0 2024-09-21T03:43:06.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.839+0000 7f799537b740 10 client.25142 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.839+0000 7f799537b740 10 client.25142 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:43:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.839+0000 7f799537b740 20 client.25142 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.839+0000 7f799537b740 1 --2- 172.21.15.84:0/3474198619 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55f58e9a1da0 0x55f58ee43670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.839+0000 7f799537b740 4 client.25142 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:43:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.839+0000 7f799537b740 1 -- 172.21.15.84:0/3474198619 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f58ed298a0 con 0x55f58e9a1da0 2024-09-21T03:43:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.840+0000 7f7987fff640 1 --2- 172.21.15.84:0/3474198619 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55f58e9a1da0 0x55f58ee43670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.840+0000 7f7967fff640 10 client.25142 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:43:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.840+0000 7f7987fff640 1 --2- 172.21.15.84:0/3474198619 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55f58e9a1da0 0x55f58ee43670 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=95ccbd82922af46c server_cookie=bcdc57a4d88d939c in_seq=0 out_seq=0 2024-09-21T03:43:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.840+0000 7f7967fff640 1 -- 172.21.15.84:0/3474198619 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f58ed298a0 con 0x55f58e9a1da0 2024-09-21T03:43:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.840+0000 7f7967fff640 10 client.25142 handle_command_reply: tid=0 2024-09-21T03:43:06.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.840+0000 7f799537b740 1 client.25142 shutdown 2024-09-21T03:43:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.841+0000 7f799537b740 1 -- 172.21.15.84:0/3474198619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9e51b0 msgr2=0x55f58edd57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.841+0000 7f799537b740 1 --2- 172.21.15.84:0/3474198619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9e51b0 0x55f58edd57e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f797c005d00 tx=0x7f797c005530 comp rx=0 tx=0).stop 2024-09-21T03:43:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.841+0000 7f799537b740 1 -- 172.21.15.84:0/3474198619 shutdown_connections 2024-09-21T03:43:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.841+0000 7f799537b740 1 --2- 172.21.15.84:0/3474198619 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55f58e9a1da0 0x55f58ee43670 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.841+0000 7f7967fff640 0 client.25142 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:43:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.841+0000 7f799537b740 1 --2- 172.21.15.84:0/3474198619 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f58ea0e070 0x55f58ee395d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.841+0000 7f799537b740 1 --2- 172.21.15.84:0/3474198619 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f58e9ed390 0x55f58edd5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.841+0000 7f799537b740 1 --2- 172.21.15.84:0/3474198619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f58e9e51b0 0x55f58edd57e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.841+0000 7f799537b740 1 -- 172.21.15.84:0/3474198619 >> 172.21.15.84:0/3474198619 conn(0x55f58ea02460 msgr2=0x55f58edc0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.841+0000 7f799537b740 1 -- 172.21.15.84:0/3474198619 shutdown_connections 2024-09-21T03:43:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.841+0000 7f799537b740 1 -- 172.21.15.84:0/3474198619 wait complete. 2024-09-21T03:43:06.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.842+0000 7f799537b740 20 client.25142 trim_cache size 0 max 16384 2024-09-21T03:43:06.848 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:43:06.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.842+0000 7f798ee07640 1 -- 172.21.15.84:0/3867794629 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f79780b6790 msgr2=0x7f79780b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:06.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.842+0000 7f798ee07640 1 --2- 172.21.15.84:0/3867794629 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f79780b6790 0x7f79780b8ca0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55f58edb3f40 tx=0x7f797c0058b0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.842+0000 7f798ee07640 1 -- 172.21.15.84:0/3867794629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79881083a0 msgr2=0x7f7988198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:06.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.843+0000 7f798ee07640 1 --2- 172.21.15.84:0/3867794629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79881083a0 0x7f7988198850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7974009db0 tx=0x7f797400f4a0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.843+0000 7f798ee07640 1 -- 172.21.15.84:0/3867794629 shutdown_connections 2024-09-21T03:43:06.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.843+0000 7f798ee07640 1 --2- 172.21.15.84:0/3867794629 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f79780b6790 0x7f79780b8ca0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.843+0000 7f798ee07640 1 --2- 172.21.15.84:0/3867794629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7988108cf0 0x7f798819daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.843+0000 7f798ee07640 1 --2- 172.21.15.84:0/3867794629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79881083a0 0x7f7988198850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.843+0000 7f798ee07640 1 --2- 172.21.15.84:0/3867794629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7988102a60 0x7f79881982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.843+0000 7f798ee07640 1 -- 172.21.15.84:0/3867794629 >> 172.21.15.84:0/3867794629 conn(0x7f7988079730 msgr2=0x7f7988101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.843+0000 7f798ee07640 1 -- 172.21.15.84:0/3867794629 shutdown_connections 2024-09-21T03:43:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:06.843+0000 7f798ee07640 1 -- 172.21.15.84:0/3867794629 wait complete. 2024-09-21T03:43:07.572 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:43:07.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:07 smithi084 ceph-mon[30941]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-09-21T03:43:07.861 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:07.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:07 smithi174 ceph-mon[34403]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-09-21T03:43:07.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:07 smithi172 ceph-mon[34821]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-09-21T03:43:08.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.432+0000 7fe1b6517640 1 -- 172.21.15.84:0/1883494211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1b0108d20 msgr2=0x7fe1b010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:08.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.432+0000 7fe1b6517640 1 --2- 172.21.15.84:0/1883494211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1b0108d20 0x7fe1b010f550 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009ca0 tx=0x7fe1a802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.433+0000 7fe1b6517640 1 -- 172.21.15.84:0/1883494211 shutdown_connections 2024-09-21T03:43:08.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.433+0000 7fe1b6517640 1 --2- 172.21.15.84:0/1883494211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1b0108d20 0x7fe1b010f550 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.433+0000 7fe1b6517640 1 --2- 172.21.15.84:0/1883494211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1b01083d0 0x7fe1b01087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.433+0000 7fe1b6517640 1 --2- 172.21.15.84:0/1883494211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1b0102ae0 0x7fe1b0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.433+0000 7fe1b6517640 1 -- 172.21.15.84:0/1883494211 >> 172.21.15.84:0/1883494211 conn(0x7fe1b0079760 msgr2=0x7fe1b0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:08.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.433+0000 7fe1b6517640 1 -- 172.21.15.84:0/1883494211 shutdown_connections 2024-09-21T03:43:08.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.433+0000 7fe1b6517640 1 -- 172.21.15.84:0/1883494211 wait complete. 2024-09-21T03:43:08.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.434+0000 7fe1b6517640 1 Processor -- start 2024-09-21T03:43:08.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.434+0000 7fe1b6517640 1 -- start start 2024-09-21T03:43:08.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.435+0000 7fe1b6517640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1b0102ae0 0x7fe1b019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.435+0000 7fe1b6517640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1b01083d0 0x7fe1b019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.435+0000 7fe1b6517640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1b0108d20 0x7fe1b019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.435+0000 7fe1b6517640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b0112990 con 0x7fe1b0108d20 2024-09-21T03:43:08.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.435+0000 7fe1b6517640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b0112810 con 0x7fe1b0102ae0 2024-09-21T03:43:08.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.435+0000 7fe1b6517640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b0112b10 con 0x7fe1b01083d0 2024-09-21T03:43:08.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.435+0000 7fe1af7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1b01083d0 0x7fe1b019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.435+0000 7fe1af7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1b01083d0 0x7fe1b019aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.84:50676/0 (socket says 172.21.15.84:50676) 2024-09-21T03:43:08.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.435+0000 7fe1af7fe640 1 -- 172.21.15.84:0/3385852411 learned_addr learned my addr 172.21.15.84:0/3385852411 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:08.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.435+0000 7fe1b4ab4640 1 --2- 172.21.15.84:0/3385852411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1b0108d20 0x7fe1b019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.435+0000 7fe1affff640 1 --2- 172.21.15.84:0/3385852411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1b0102ae0 0x7fe1b019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.435+0000 7fe1af7fe640 1 -- 172.21.15.84:0/3385852411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1b0102ae0 msgr2=0x7fe1b019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:08.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.435+0000 7fe1af7fe640 1 --2- 172.21.15.84:0/3385852411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1b0102ae0 0x7fe1b019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.435+0000 7fe1af7fe640 1 -- 172.21.15.84:0/3385852411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1b0108d20 msgr2=0x7fe1b019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:08.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.435+0000 7fe1af7fe640 1 --2- 172.21.15.84:0/3385852411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1b0108d20 0x7fe1b019fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.435+0000 7fe1af7fe640 1 -- 172.21.15.84:0/3385852411 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b01a0400 con 0x7fe1b01083d0 2024-09-21T03:43:08.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.436+0000 7fe1af7fe640 1 --2- 172.21.15.84:0/3385852411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1b01083d0 0x7fe1b019aa30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400d770 tx=0x7fe1a400dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:08.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.436+0000 7fe1ad7fa640 1 -- 172.21.15.84:0/3385852411 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4017070 con 0x7fe1b01083d0 2024-09-21T03:43:08.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.436+0000 7fe1ad7fa640 1 -- 172.21.15.84:0/3385852411 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1a4009c30 con 0x7fe1b01083d0 2024-09-21T03:43:08.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.436+0000 7fe1ad7fa640 1 -- 172.21.15.84:0/3385852411 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a400f620 con 0x7fe1b01083d0 2024-09-21T03:43:08.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.436+0000 7fe1b6517640 1 -- 172.21.15.84:0/3385852411 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b01a06f0 con 0x7fe1b01083d0 2024-09-21T03:43:08.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.436+0000 7fe1b6517640 1 -- 172.21.15.84:0/3385852411 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1b00ff550 con 0x7fe1b01083d0 2024-09-21T03:43:08.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.439+0000 7fe1bca8b740 1 Processor -- start 2024-09-21T03:43:08.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.439+0000 7fe1bca8b740 1 -- start start 2024-09-21T03:43:08.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.439+0000 7fe1bca8b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c19a1070 0x5575c1d486a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.439+0000 7fe1bca8b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c19781b0 0x5575c1d48be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.439+0000 7fe1bca8b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c1980390 0x5575c1d49120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.439+0000 7fe1bca8b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5575c1cbeea0 con 0x5575c1980390 2024-09-21T03:43:08.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.439+0000 7fe1bca8b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5575c1cae2d0 con 0x5575c19781b0 2024-09-21T03:43:08.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.439+0000 7fe1bca8b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5575c1cb20e0 con 0x5575c19a1070 2024-09-21T03:43:08.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.439+0000 7fe1affff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c19781b0 0x5575c1d48be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.439+0000 7fe1affff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c19781b0 0x5575c1d48be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:53962/0 (socket says 172.21.15.84:53962) 2024-09-21T03:43:08.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.439+0000 7fe1affff640 1 -- 172.21.15.84:0/3287268522 learned_addr learned my addr 172.21.15.84:0/3287268522 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:08.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.440+0000 7fe1b4ab4640 1 --2- 172.21.15.84:0/3287268522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c19a1070 0x5575c1d486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.440+0000 7fe1affff640 1 -- 172.21.15.84:0/3287268522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c19a1070 msgr2=0x5575c1d486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:08.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.440+0000 7fe1affff640 1 --2- 172.21.15.84:0/3287268522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c19a1070 0x5575c1d486a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.440+0000 7fe1affff640 1 -- 172.21.15.84:0/3287268522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c1980390 msgr2=0x5575c1d49120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T03:43:08.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.440+0000 7fe1affff640 1 --2- 172.21.15.84:0/3287268522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c1980390 0x5575c1d49120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.440+0000 7fe1affff640 1 -- 172.21.15.84:0/3287268522 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575c1a0c650 con 0x5575c19781b0 2024-09-21T03:43:08.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.440+0000 7fe1ad7fa640 1 -- 172.21.15.84:0/3385852411 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7fe1a401a070 con 0x7fe1b01083d0 2024-09-21T03:43:08.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.441+0000 7fe1affff640 1 --2- 172.21.15.84:0/3287268522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c19781b0 0x5575c1d48be0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000b760 tx=0x7fe1a000bc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b169811dc5946fd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:08.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.441+0000 7fe1ad7fa640 1 --2- 172.21.15.84:0/3385852411 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe1980b6710 0x7fe1980b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.441+0000 7fe1b4ab4640 1 --2- 172.21.15.84:0/3385852411 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe1980b6710 0x7fe1980b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.441+0000 7fe1ad7fa640 1 -- 172.21.15.84:0/3385852411 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe1a40e72c0 con 0x7fe1b01083d0 2024-09-21T03:43:08.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.441+0000 7fe1967fc640 1 -- 172.21.15.84:0/3287268522 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0003dd0 con 0x5575c19781b0 2024-09-21T03:43:08.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.441+0000 7fe1967fc640 1 -- 172.21.15.84:0/3287268522 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1a0015070 con 0x5575c19781b0 2024-09-21T03:43:08.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.441+0000 7fe1967fc640 1 -- 172.21.15.84:0/3287268522 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0004e00 con 0x5575c19781b0 2024-09-21T03:43:08.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.443+0000 7fe1b4ab4640 1 --2- 172.21.15.84:0/3385852411 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe1980b6710 0x7fe1980b8c20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe1a802f500 tx=0x7fe1a802f370 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:08.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.443+0000 7fe1bca8b740 1 -- 172.21.15.84:0/3287268522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c19781b0 msgr2=0x5575c1d48be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:08.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.443+0000 7fe1bca8b740 1 --2- 172.21.15.84:0/3287268522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c19781b0 0x5575c1d48be0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000b760 tx=0x7fe1a000bc20 comp rx=0 tx=0).stop 2024-09-21T03:43:08.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.443+0000 7fe1bca8b740 1 -- 172.21.15.84:0/3287268522 shutdown_connections 2024-09-21T03:43:08.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.443+0000 7fe1bca8b740 1 --2- 172.21.15.84:0/3287268522 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c1980390 0x5575c1d49120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.443+0000 7fe1bca8b740 1 --2- 172.21.15.84:0/3287268522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c19781b0 0x5575c1d48be0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.443+0000 7fe1bca8b740 1 --2- 172.21.15.84:0/3287268522 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c19a1070 0x5575c1d486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.443+0000 7fe1bca8b740 1 -- 172.21.15.84:0/3287268522 >> 172.21.15.84:0/3287268522 conn(0x5575c1995460 msgr2=0x5575c1d46590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:08.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.443+0000 7fe1bca8b740 1 -- 172.21.15.84:0/3287268522 shutdown_connections 2024-09-21T03:43:08.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.443+0000 7fe1bca8b740 1 -- 172.21.15.84:0/3287268522 wait complete. 2024-09-21T03:43:08.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.444+0000 7fe1bca8b740 1 -- start start 2024-09-21T03:43:08.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.444+0000 7fe1bca8b740 1 Processor -- start 2024-09-21T03:43:08.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.444+0000 7fe1bca8b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c19781b0 0x5575c1d53e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.444+0000 7fe1bca8b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c1980390 0x5575c1d54380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.444+0000 7fe1bca8b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c19a1070 0x5575c1d60170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.445+0000 7fe1bca8b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5575c1b0f700 con 0x5575c19a1070 2024-09-21T03:43:08.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.445+0000 7fe1affff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c19781b0 0x5575c1d53e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.445+0000 7fe1affff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c19781b0 0x5575c1d53e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.84:50702/0 (socket says 172.21.15.84:50702) 2024-09-21T03:43:08.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.445+0000 7fe1affff640 1 -- 172.21.15.84:0/1422832684 learned_addr learned my addr 172.21.15.84:0/1422832684 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:08.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.445+0000 7fe1bca8b740 1 -- 172.21.15.84:0/1422832684 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5575c1c49160 con 0x5575c1980390 2024-09-21T03:43:08.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.445+0000 7fe1bca8b740 1 -- 172.21.15.84:0/1422832684 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5575c1d56e80 con 0x5575c19781b0 2024-09-21T03:43:08.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.445+0000 7fe1af7fe640 1 --2- 172.21.15.84:0/1422832684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c1980390 0x5575c1d54380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.445+0000 7fe1bca8b740 10 client.0 _ll_register_callbacks cb 0x5575c1c629e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:08.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.445+0000 7fe1affff640 1 -- 172.21.15.84:0/1422832684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c1980390 msgr2=0x5575c1d54380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:08.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.445+0000 7fe1affff640 1 --2- 172.21.15.84:0/1422832684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c1980390 0x5575c1d54380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.445+0000 7fe1affff640 1 -- 172.21.15.84:0/1422832684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c19a1070 msgr2=0x5575c1d60170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:08.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.445+0000 7fe1affff640 1 --2- 172.21.15.84:0/1422832684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c19a1070 0x5575c1d60170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.445+0000 7fe1affff640 1 -- 172.21.15.84:0/1422832684 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575c1c76c90 con 0x5575c19781b0 2024-09-21T03:43:08.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.445+0000 7fe1affff640 1 --2- 172.21.15.84:0/1422832684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c19781b0 0x5575c1d53e40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000bfd0 tx=0x7fe1a00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98086af9c12f41c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:08.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.445+0000 7fe18f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-21T03:43:08.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.446+0000 7fe18f7fe640 1 -- 172.21.15.84:0/1422832684 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0003ea0 con 0x5575c19781b0 2024-09-21T03:43:08.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.446+0000 7fe1bca8b740 1 -- 172.21.15.84:0/1422832684 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1a0015070 con 0x5575c19781b0 2024-09-21T03:43:08.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.446+0000 7fe18f7fe640 1 -- 172.21.15.84:0/1422832684 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe1a0011440 con 0x5575c19781b0 2024-09-21T03:43:08.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.446+0000 7fe18f7fe640 1 -- 172.21.15.84:0/1422832684 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe1a0011640 con 0x5575c19781b0 2024-09-21T03:43:08.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.446+0000 7fe1bca8b740 10 client.25108 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:08.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.446+0000 7fe1bca8b740 1 -- 172.21.15.84:0/1422832684 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5575c1d62c60 con 0x5575c19781b0 2024-09-21T03:43:08.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.446+0000 7fe18f7fe640 1 -- 172.21.15.84:0/1422832684 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1a0015070 con 0x5575c19781b0 2024-09-21T03:43:08.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.447+0000 7fe18f7fe640 1 -- 172.21.15.84:0/1422832684 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe1a002f8e0 con 0x5575c19781b0 2024-09-21T03:43:08.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.447+0000 7fe1bca8b740 10 client.25108 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:08.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.447+0000 7fe1bca8b740 10 client.25108 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:43:08.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.447+0000 7fe1bca8b740 20 client.25108 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:08.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.447+0000 7fe1bca8b740 1 --2- 172.21.15.84:0/1422832684 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5575c195f9f0 0x5575c1d65fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.447+0000 7fe1bca8b740 4 client.25108 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:08.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.447+0000 7fe1bca8b740 1 -- 172.21.15.84:0/1422832684 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575c1cc0df0 con 0x5575c195f9f0 2024-09-21T03:43:08.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.447+0000 7fe1af7fe640 1 --2- 172.21.15.84:0/1422832684 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5575c195f9f0 0x5575c1d65fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.447+0000 7fe1af7fe640 1 --2- 172.21.15.84:0/1422832684 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5575c195f9f0 0x5575c1d65fc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=80edf08c06e17c43 server_cookie=89f1dd1924100d44 in_seq=0 out_seq=0 2024-09-21T03:43:08.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.447+0000 7fe18f7fe640 10 client.25108 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:43:08.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.448+0000 7fe18f7fe640 1 -- 172.21.15.84:0/1422832684 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5575c1cc0df0 con 0x5575c195f9f0 2024-09-21T03:43:08.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.448+0000 7fe18f7fe640 10 client.25108 handle_command_reply: tid=0 2024-09-21T03:43:08.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.448+0000 7fe1bca8b740 1 client.25108 shutdown 2024-09-21T03:43:08.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.448+0000 7fe1bca8b740 1 -- 172.21.15.84:0/1422832684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c19781b0 msgr2=0x5575c1d53e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:08.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.448+0000 7fe1bca8b740 1 --2- 172.21.15.84:0/1422832684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c19781b0 0x5575c1d53e40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000bfd0 tx=0x7fe1a00046c0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.449+0000 7fe1bca8b740 1 -- 172.21.15.84:0/1422832684 shutdown_connections 2024-09-21T03:43:08.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.449+0000 7fe1bca8b740 1 --2- 172.21.15.84:0/1422832684 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5575c195f9f0 0x5575c1d65fc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.449+0000 7fe1bca8b740 1 --2- 172.21.15.84:0/1422832684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c19a1070 0x5575c1d60170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.449+0000 7fe1bca8b740 1 --2- 172.21.15.84:0/1422832684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c1980390 0x5575c1d54380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.449+0000 7fe1bca8b740 1 --2- 172.21.15.84:0/1422832684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c19781b0 0x5575c1d53e40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.449+0000 7fe18f7fe640 0 client.25108 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:43:08.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.449+0000 7fe1bca8b740 1 -- 172.21.15.84:0/1422832684 >> 172.21.15.84:0/1422832684 conn(0x5575c1995460 msgr2=0x5575c1d4b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:08.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.449+0000 7fe1bca8b740 1 -- 172.21.15.84:0/1422832684 shutdown_connections 2024-09-21T03:43:08.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.449+0000 7fe1bca8b740 1 -- 172.21.15.84:0/1422832684 wait complete. 2024-09-21T03:43:08.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.449+0000 7fe1bca8b740 20 client.25108 trim_cache size 0 max 16384 2024-09-21T03:43:08.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.474+0000 7fe1bca8b740 1 Processor -- start 2024-09-21T03:43:08.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.474+0000 7fe1bca8b740 1 -- start start 2024-09-21T03:43:08.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.474+0000 7fe1bca8b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c195f9f0 0x5575c1d55d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.474+0000 7fe1bca8b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c19781b0 0x5575c1d49de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.474+0000 7fe1bca8b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c1980390 0x5575c1d60070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.474+0000 7fe1bca8b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b01b4040 con 0x5575c1980390 2024-09-21T03:43:08.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.474+0000 7fe1bca8b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b01b1910 con 0x5575c19781b0 2024-09-21T03:43:08.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.474+0000 7fe1bca8b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b01af760 con 0x5575c195f9f0 2024-09-21T03:43:08.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.475+0000 7fe1affff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c195f9f0 0x5575c1d55d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.475+0000 7fe1affff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c195f9f0 0x5575c1d55d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.84:50718/0 (socket says 172.21.15.84:50718) 2024-09-21T03:43:08.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.475+0000 7fe1affff640 1 -- 172.21.15.84:0/2292204036 learned_addr learned my addr 172.21.15.84:0/2292204036 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:08.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.475+0000 7fe1af7fe640 1 --2- 172.21.15.84:0/2292204036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c19781b0 0x5575c1d49de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.475+0000 7fe1affff640 1 -- 172.21.15.84:0/2292204036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c19781b0 msgr2=0x5575c1d49de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:08.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.475+0000 7fe1affff640 1 --2- 172.21.15.84:0/2292204036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c19781b0 0x5575c1d49de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.475+0000 7fe1b4ab4640 1 --2- 172.21.15.84:0/2292204036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c1980390 0x5575c1d60070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.475+0000 7fe1affff640 1 -- 172.21.15.84:0/2292204036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c1980390 msgr2=0x5575c1d60070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:08.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.475+0000 7fe1affff640 1 --2- 172.21.15.84:0/2292204036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c1980390 0x5575c1d60070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.475+0000 7fe1affff640 1 -- 172.21.15.84:0/2292204036 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575c1d56580 con 0x5575c195f9f0 2024-09-21T03:43:08.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.475+0000 7fe1b4ab4640 1 --2- 172.21.15.84:0/2292204036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c1980390 0x5575c1d60070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:08.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.475+0000 7fe1affff640 1 --2- 172.21.15.84:0/2292204036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c195f9f0 0x5575c1d55d20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000b760 tx=0x7fe1a0004590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8eea70afc7710104 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:08.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.475+0000 7fe195ffb640 1 -- 172.21.15.84:0/2292204036 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0003ea0 con 0x5575c195f9f0 2024-09-21T03:43:08.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.475+0000 7fe195ffb640 1 -- 172.21.15.84:0/2292204036 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1a0015070 con 0x5575c195f9f0 2024-09-21T03:43:08.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.475+0000 7fe195ffb640 1 -- 172.21.15.84:0/2292204036 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a002f430 con 0x5575c195f9f0 2024-09-21T03:43:08.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.477+0000 7fe1bca8b740 1 -- 172.21.15.84:0/2292204036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c195f9f0 msgr2=0x5575c1d55d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:08.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.477+0000 7fe1bca8b740 1 --2- 172.21.15.84:0/2292204036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c195f9f0 0x5575c1d55d20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000b760 tx=0x7fe1a0004590 comp rx=0 tx=0).stop 2024-09-21T03:43:08.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.477+0000 7fe1bca8b740 1 -- 172.21.15.84:0/2292204036 shutdown_connections 2024-09-21T03:43:08.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.477+0000 7fe1bca8b740 1 --2- 172.21.15.84:0/2292204036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c1980390 0x5575c1d60070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.477+0000 7fe1bca8b740 1 --2- 172.21.15.84:0/2292204036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c19781b0 0x5575c1d49de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.477+0000 7fe1bca8b740 1 --2- 172.21.15.84:0/2292204036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c195f9f0 0x5575c1d55d20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.477+0000 7fe1bca8b740 1 -- 172.21.15.84:0/2292204036 >> 172.21.15.84:0/2292204036 conn(0x5575c1995460 msgr2=0x5575c1d496d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:08.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.477+0000 7fe1bca8b740 1 -- 172.21.15.84:0/2292204036 shutdown_connections 2024-09-21T03:43:08.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.477+0000 7fe1bca8b740 1 -- 172.21.15.84:0/2292204036 wait complete. 2024-09-21T03:43:08.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.477+0000 7fe1bca8b740 1 -- start start 2024-09-21T03:43:08.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.478+0000 7fe1bca8b740 1 Processor -- start 2024-09-21T03:43:08.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.478+0000 7fe1bca8b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c195f9f0 0x5575c1d5a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.478+0000 7fe1bca8b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c19781b0 0x5575c1d5a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.478+0000 7fe1bca8b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c1980390 0x5575c1d5abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.478+0000 7fe1af7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c19781b0 0x5575c1d5a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.478+0000 7fe1af7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c19781b0 0x5575c1d5a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59090/0 (socket says 172.21.15.84:59090) 2024-09-21T03:43:08.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.478+0000 7fe1af7fe640 1 -- 172.21.15.84:0/828935473 learned_addr learned my addr 172.21.15.84:0/828935473 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:08.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.478+0000 7fe1bca8b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b01afdd0 con 0x5575c19781b0 2024-09-21T03:43:08.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.478+0000 7fe1bca8b740 1 -- 172.21.15.84:0/828935473 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b01b1240 con 0x5575c195f9f0 2024-09-21T03:43:08.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.478+0000 7fe1bca8b740 1 -- 172.21.15.84:0/828935473 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b01b04a0 con 0x5575c1980390 2024-09-21T03:43:08.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.479+0000 7fe1affff640 1 --2- 172.21.15.84:0/828935473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c195f9f0 0x5575c1d5a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.479+0000 7fe1bca8b740 10 client.0 _ll_register_callbacks cb 0x7fe1a8009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:08.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.479+0000 7fe1af7fe640 1 -- 172.21.15.84:0/828935473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c1980390 msgr2=0x5575c1d5abf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T03:43:08.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.479+0000 7fe1af7fe640 1 --2- 172.21.15.84:0/828935473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c1980390 0x5575c1d5abf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.479+0000 7fe1af7fe640 1 -- 172.21.15.84:0/828935473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c195f9f0 msgr2=0x5575c1d5a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:08.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.479+0000 7fe1af7fe640 1 --2- 172.21.15.84:0/828935473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c195f9f0 0x5575c1d5a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.479+0000 7fe1af7fe640 1 -- 172.21.15.84:0/828935473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575c1dcf920 con 0x5575c19781b0 2024-09-21T03:43:08.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.479+0000 7fe1af7fe640 1 --2- 172.21.15.84:0/828935473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c19781b0 0x5575c1d5a6b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe1a40a9640 tx=0x7fe1a4010b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2962e1e3102d225e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:08.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.479+0000 7fe18f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:43:08.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.479+0000 7fe18f7fe640 1 -- 172.21.15.84:0/828935473 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40d4020 con 0x5575c19781b0 2024-09-21T03:43:08.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.479+0000 7fe18f7fe640 1 -- 172.21.15.84:0/828935473 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe1a40ac2d0 con 0x5575c19781b0 2024-09-21T03:43:08.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.479+0000 7fe1bca8b740 1 -- 172.21.15.84:0/828935473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1a0015070 con 0x5575c19781b0 2024-09-21T03:43:08.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.480+0000 7fe18f7fe640 1 -- 172.21.15.84:0/828935473 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe1a40c4030 con 0x5575c19781b0 2024-09-21T03:43:08.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.480+0000 7fe1bca8b740 10 client.15588 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:08.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.480+0000 7fe1bca8b740 1 -- 172.21.15.84:0/828935473 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5575c1dd0b70 con 0x5575c19781b0 2024-09-21T03:43:08.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.480+0000 7fe18f7fe640 1 -- 172.21.15.84:0/828935473 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1a40e6040 con 0x5575c19781b0 2024-09-21T03:43:08.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.480+0000 7fe18f7fe640 1 -- 172.21.15.84:0/828935473 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe1a40af070 con 0x5575c19781b0 2024-09-21T03:43:08.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.480+0000 7fe1bca8b740 10 client.15588 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:08.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.480+0000 7fe1bca8b740 10 client.15588 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:43:08.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.480+0000 7fe1bca8b740 20 client.15588 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:08.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.480+0000 7fe1bca8b740 1 --2- 172.21.15.84:0/828935473 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5575c19a1070 0x5575c1dd3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.480+0000 7fe1bca8b740 4 client.15588 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:43:08.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.480+0000 7fe1bca8b740 1 -- 172.21.15.84:0/828935473 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fe1a0015070 con 0x5575c19a1070 2024-09-21T03:43:08.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.481+0000 7fe1affff640 1 --2- 172.21.15.84:0/828935473 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5575c19a1070 0x5575c1dd3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.481+0000 7fe18f7fe640 10 client.15588 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:43:08.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.481+0000 7fe1affff640 1 --2- 172.21.15.84:0/828935473 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5575c19a1070 0x5575c1dd3300 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4928dfe590647a7b server_cookie=562e6b0caa33f7c2 in_seq=0 out_seq=0 2024-09-21T03:43:08.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.481+0000 7fe18f7fe640 1 -- 172.21.15.84:0/828935473 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fe1a0015070 con 0x5575c19a1070 2024-09-21T03:43:08.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.481+0000 7fe18f7fe640 10 client.15588 handle_command_reply: tid=0 2024-09-21T03:43:08.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.481+0000 7fe1bca8b740 1 client.15588 shutdown 2024-09-21T03:43:08.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.482+0000 7fe1bca8b740 1 -- 172.21.15.84:0/828935473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c19781b0 msgr2=0x5575c1d5a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:08.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.482+0000 7fe1bca8b740 1 --2- 172.21.15.84:0/828935473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c19781b0 0x5575c1d5a6b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe1a40a9640 tx=0x7fe1a4010b20 comp rx=0 tx=0).stop 2024-09-21T03:43:08.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.482+0000 7fe1bca8b740 1 -- 172.21.15.84:0/828935473 shutdown_connections 2024-09-21T03:43:08.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.482+0000 7fe1bca8b740 1 --2- 172.21.15.84:0/828935473 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5575c19a1070 0x5575c1dd3300 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.482+0000 7fe1bca8b740 1 --2- 172.21.15.84:0/828935473 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5575c1980390 0x5575c1d5abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.482+0000 7fe1bca8b740 1 --2- 172.21.15.84:0/828935473 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5575c19781b0 0x5575c1d5a6b0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.482+0000 7fe1bca8b740 1 --2- 172.21.15.84:0/828935473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575c195f9f0 0x5575c1d5a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.482+0000 7fe1bca8b740 1 -- 172.21.15.84:0/828935473 >> 172.21.15.84:0/828935473 conn(0x5575c1995460 msgr2=0x5575c1d55cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:08.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.482+0000 7fe18f7fe640 0 client.15588 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:43:08.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.482+0000 7fe1bca8b740 1 -- 172.21.15.84:0/828935473 shutdown_connections 2024-09-21T03:43:08.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.482+0000 7fe1bca8b740 1 -- 172.21.15.84:0/828935473 wait complete. 2024-09-21T03:43:08.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.483+0000 7fe1bca8b740 20 client.15588 trim_cache size 0 max 16384 2024-09-21T03:43:08.488 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:43:08.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.484+0000 7fe1b6517640 1 -- 172.21.15.84:0/3385852411 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe1980b6710 msgr2=0x7fe1980b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:08.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.484+0000 7fe1b6517640 1 --2- 172.21.15.84:0/3385852411 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe1980b6710 0x7fe1980b8c20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe1a802f500 tx=0x7fe1a802f370 comp rx=0 tx=0).stop 2024-09-21T03:43:08.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.484+0000 7fe1b6517640 1 -- 172.21.15.84:0/3385852411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1b01083d0 msgr2=0x7fe1b019aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:08.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.484+0000 7fe1b6517640 1 --2- 172.21.15.84:0/3385852411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1b01083d0 0x7fe1b019aa30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400d770 tx=0x7fe1a400dc30 comp rx=0 tx=0).stop 2024-09-21T03:43:08.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.484+0000 7fe1b6517640 1 -- 172.21.15.84:0/3385852411 shutdown_connections 2024-09-21T03:43:08.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.484+0000 7fe1b6517640 1 --2- 172.21.15.84:0/3385852411 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe1980b6710 0x7fe1980b8c20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.484+0000 7fe1b6517640 1 --2- 172.21.15.84:0/3385852411 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1b0108d20 0x7fe1b019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.484+0000 7fe1b6517640 1 --2- 172.21.15.84:0/3385852411 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1b01083d0 0x7fe1b019aa30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.484+0000 7fe1b6517640 1 --2- 172.21.15.84:0/3385852411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1b0102ae0 0x7fe1b019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.484+0000 7fe1b6517640 1 -- 172.21.15.84:0/3385852411 >> 172.21.15.84:0/3385852411 conn(0x7fe1b0079760 msgr2=0x7fe1b0101b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:08.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.484+0000 7fe1b6517640 1 -- 172.21.15.84:0/3385852411 shutdown_connections 2024-09-21T03:43:08.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:08.484+0000 7fe1b6517640 1 -- 172.21.15.84:0/3385852411 wait complete. 2024-09-21T03:43:08.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:08 smithi084 ceph-mon[30941]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-09-21T03:43:08.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:08 smithi174 ceph-mon[34403]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-09-21T03:43:08.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:08 smithi172 ceph-mon[34821]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-09-21T03:43:09.326 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:43:09.635 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:10.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.199+0000 7f9dbcbea640 1 -- 172.21.15.84:0/191340408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9db8108d30 msgr2=0x7f9db810f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:10.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.199+0000 7f9dbcbea640 1 --2- 172.21.15.84:0/191340408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9db8108d30 0x7f9db810f560 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009ca0 tx=0x7f9db002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.199+0000 7f9dbcbea640 1 -- 172.21.15.84:0/191340408 shutdown_connections 2024-09-21T03:43:10.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.199+0000 7f9dbcbea640 1 --2- 172.21.15.84:0/191340408 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9db8108d30 0x7f9db810f560 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.199+0000 7f9dbcbea640 1 --2- 172.21.15.84:0/191340408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9db81083e0 0x7f9db81087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.199+0000 7f9dbcbea640 1 --2- 172.21.15.84:0/191340408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9db8103100 0x7f9db8103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.199+0000 7f9dbcbea640 1 -- 172.21.15.84:0/191340408 >> 172.21.15.84:0/191340408 conn(0x7f9db8077cc0 msgr2=0x7f9db8078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:10.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.199+0000 7f9dbcbea640 1 -- 172.21.15.84:0/191340408 shutdown_connections 2024-09-21T03:43:10.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.199+0000 7f9dbcbea640 1 -- 172.21.15.84:0/191340408 wait complete. 2024-09-21T03:43:10.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.200+0000 7f9dbcbea640 1 Processor -- start 2024-09-21T03:43:10.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.201+0000 7f9dbcbea640 1 -- start start 2024-09-21T03:43:10.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.201+0000 7f9dbcbea640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9db8103100 0x7f9db8074c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:10.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.201+0000 7f9dbcbea640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9db81083e0 0x7f9db806df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:10.204 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.201+0000 7f9dbcbea640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9db8108d30 0x7f9db806e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:10.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.201+0000 7f9dbcbea640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9db8111930 con 0x7f9db81083e0 2024-09-21T03:43:10.205 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.201+0000 7f9dbcbea640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9db81117b0 con 0x7f9db8108d30 2024-09-21T03:43:10.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.201+0000 7f9dbcbea640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9db8111ab0 con 0x7f9db8103100 2024-09-21T03:43:10.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.201+0000 7f9daffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9db81083e0 0x7f9db806df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:10.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.202+0000 7f9daffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9db81083e0 0x7f9db806df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59104/0 (socket says 172.21.15.84:59104) 2024-09-21T03:43:10.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.202+0000 7f9daffff640 1 -- 172.21.15.84:0/532157077 learned_addr learned my addr 172.21.15.84:0/532157077 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:10.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.202+0000 7f9db659c640 1 --2- 172.21.15.84:0/532157077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9db8103100 0x7f9db8074c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:10.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.202+0000 7f9db6d9d640 1 --2- 172.21.15.84:0/532157077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9db8108d30 0x7f9db806e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:10.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.202+0000 7f9daffff640 1 -- 172.21.15.84:0/532157077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9db8103100 msgr2=0x7f9db8074c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:10.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.202+0000 7f9daffff640 1 --2- 172.21.15.84:0/532157077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9db8103100 0x7f9db8074c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.202+0000 7f9daffff640 1 -- 172.21.15.84:0/532157077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9db8108d30 msgr2=0x7f9db806e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:10.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.202+0000 7f9daffff640 1 --2- 172.21.15.84:0/532157077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9db8108d30 0x7f9db806e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.202+0000 7f9daffff640 1 -- 172.21.15.84:0/532157077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db806ea90 con 0x7f9db81083e0 2024-09-21T03:43:10.206 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.202+0000 7f9daffff640 1 --2- 172.21.15.84:0/532157077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9db81083e0 0x7f9db806df10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9da0009b80 tx=0x7f9da000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:10.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.203+0000 7f9daf7fe640 1 -- 172.21.15.84:0/532157077 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da001a070 con 0x7f9db81083e0 2024-09-21T03:43:10.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.203+0000 7f9daf7fe640 1 -- 172.21.15.84:0/532157077 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da000fdb0 con 0x7f9db81083e0 2024-09-21T03:43:10.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.203+0000 7f9dbcbea640 1 -- 172.21.15.84:0/532157077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db80738b0 con 0x7f9db81083e0 2024-09-21T03:43:10.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.203+0000 7f9dbcbea640 1 -- 172.21.15.84:0/532157077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db8073df0 con 0x7f9db81083e0 2024-09-21T03:43:10.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.203+0000 7f9daf7fe640 1 -- 172.21.15.84:0/532157077 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0014550 con 0x7f9db81083e0 2024-09-21T03:43:10.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.206+0000 7f9dc315e740 1 Processor -- start 2024-09-21T03:43:10.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.207+0000 7f9dc315e740 1 -- start start 2024-09-21T03:43:10.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.207+0000 7f9dc315e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d31b070 0x55658d6c2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:10.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.207+0000 7f9dc315e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2f21b0 0x55658d6c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:10.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.207+0000 7f9dc315e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55658d2fa390 0x55658d6c2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:10.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.207+0000 7f9dc315e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55658d638ea0 con 0x55658d31b070 2024-09-21T03:43:10.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.207+0000 7f9dc315e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55658d6282d0 con 0x55658d2f21b0 2024-09-21T03:43:10.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.207+0000 7f9dc315e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55658d62c0e0 con 0x55658d2fa390 2024-09-21T03:43:10.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.207+0000 7f9daf7fe640 1 -- 172.21.15.84:0/532157077 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7f9da00146f0 con 0x7f9db81083e0 2024-09-21T03:43:10.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.208+0000 7f9db659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2f21b0 0x55658d6c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:10.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.208+0000 7f9db659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2f21b0 0x55658d6c27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:54010/0 (socket says 172.21.15.84:54010) 2024-09-21T03:43:10.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.208+0000 7f9db659c640 1 -- 172.21.15.84:0/413935773 learned_addr learned my addr 172.21.15.84:0/413935773 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:10.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.208+0000 7f9db6d9d640 1 --2- 172.21.15.84:0/413935773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d31b070 0x55658d6c2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:10.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.208+0000 7f9db659c640 1 -- 172.21.15.84:0/413935773 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55658d2fa390 msgr2=0x55658d6c2d10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T03:43:10.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.208+0000 7f9db659c640 1 --2- 172.21.15.84:0/413935773 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55658d2fa390 0x55658d6c2d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.208+0000 7f9db659c640 1 -- 172.21.15.84:0/413935773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d31b070 msgr2=0x55658d6c2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:10.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.208+0000 7f9db659c640 1 --2- 172.21.15.84:0/413935773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d31b070 0x55658d6c2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.208+0000 7f9db659c640 1 -- 172.21.15.84:0/413935773 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55658d386650 con 0x55658d2f21b0 2024-09-21T03:43:10.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.208+0000 7f9db659c640 1 --2- 172.21.15.84:0/413935773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2f21b0 0x55658d6c27d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9da800bd10 tx=0x7f9da80107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20cabda9b9a9346e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:10.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.209+0000 7f9dacff9640 1 -- 172.21.15.84:0/413935773 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8004030 con 0x55658d2f21b0 2024-09-21T03:43:10.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.209+0000 7f9dacff9640 1 -- 172.21.15.84:0/413935773 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da80035f0 con 0x55658d2f21b0 2024-09-21T03:43:10.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.209+0000 7f9dacff9640 1 -- 172.21.15.84:0/413935773 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da80117b0 con 0x55658d2f21b0 2024-09-21T03:43:10.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.209+0000 7f9daf7fe640 1 --2- 172.21.15.84:0/532157077 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9da40b6810 0x7f9da40b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:10.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.209+0000 7f9daf7fe640 1 -- 172.21.15.84:0/532157077 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f9da00eaf40 con 0x7f9db81083e0 2024-09-21T03:43:10.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.209+0000 7f9db6d9d640 1 --2- 172.21.15.84:0/532157077 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9da40b6810 0x7f9da40b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:10.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.210+0000 7f9dc315e740 1 -- 172.21.15.84:0/413935773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2f21b0 msgr2=0x55658d6c27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:10.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.210+0000 7f9dc315e740 1 --2- 172.21.15.84:0/413935773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2f21b0 0x55658d6c27d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9da800bd10 tx=0x7f9da80107a0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.214 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.210+0000 7f9dc315e740 1 -- 172.21.15.84:0/413935773 shutdown_connections 2024-09-21T03:43:10.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.210+0000 7f9dc315e740 1 --2- 172.21.15.84:0/413935773 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55658d2fa390 0x55658d6c2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.210+0000 7f9dc315e740 1 --2- 172.21.15.84:0/413935773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2f21b0 0x55658d6c27d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.210+0000 7f9dc315e740 1 --2- 172.21.15.84:0/413935773 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d31b070 0x55658d6c2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.210+0000 7f9dc315e740 1 -- 172.21.15.84:0/413935773 >> 172.21.15.84:0/413935773 conn(0x55658d30f460 msgr2=0x55658d6c0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:10.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.210+0000 7f9db6d9d640 1 --2- 172.21.15.84:0/532157077 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9da40b6810 0x7f9da40b8d20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9db0004af0 tx=0x7f9db0004a60 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:10.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.210+0000 7f9dc315e740 1 -- 172.21.15.84:0/413935773 shutdown_connections 2024-09-21T03:43:10.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.210+0000 7f9dc315e740 1 -- 172.21.15.84:0/413935773 wait complete. 2024-09-21T03:43:10.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.211+0000 7f9dc315e740 1 -- start start 2024-09-21T03:43:10.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.211+0000 7f9dc315e740 1 Processor -- start 2024-09-21T03:43:10.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.211+0000 7f9dc315e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2fa390 0x55658d6cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:10.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.211+0000 7f9dc315e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55658d31b070 0x55658d6ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:10.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.211+0000 7f9dc315e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2d99f0 0x55658d6d9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:10.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.211+0000 7f9dc315e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55658d489700 con 0x55658d2d99f0 2024-09-21T03:43:10.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.211+0000 7f9dc315e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55658d5c3160 con 0x55658d2fa390 2024-09-21T03:43:10.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.211+0000 7f9dc315e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55658d6d0a70 con 0x55658d31b070 2024-09-21T03:43:10.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.211+0000 7f9dc315e740 10 client.0 _ll_register_callbacks cb 0x55658d5dc9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:10.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.211+0000 7f9db6d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2d99f0 0x55658d6d9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:10.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.211+0000 7f9db6d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2d99f0 0x55658d6d9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59130/0 (socket says 172.21.15.84:59130) 2024-09-21T03:43:10.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.211+0000 7f9db6d9d640 1 -- 172.21.15.84:0/3322673950 learned_addr learned my addr 172.21.15.84:0/3322673950 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:10.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.211+0000 7f9db659c640 1 --2- 172.21.15.84:0/3322673950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2fa390 0x55658d6cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:10.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.212+0000 7f9daffff640 1 --2- 172.21.15.84:0/3322673950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55658d31b070 0x55658d6ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:10.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.212+0000 7f9db6d9d640 1 -- 172.21.15.84:0/3322673950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55658d31b070 msgr2=0x55658d6ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:10.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.212+0000 7f9db6d9d640 1 --2- 172.21.15.84:0/3322673950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55658d31b070 0x55658d6ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.212+0000 7f9db6d9d640 1 -- 172.21.15.84:0/3322673950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2fa390 msgr2=0x55658d6cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.212+0000 7f9db6d9d640 1 --2- 172.21.15.84:0/3322673950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2fa390 0x55658d6cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.212+0000 7f9db6d9d640 1 -- 172.21.15.84:0/3322673950 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55658d5f0c90 con 0x55658d2d99f0 2024-09-21T03:43:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.212+0000 7f9db659c640 1 --2- 172.21.15.84:0/3322673950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2fa390 0x55658d6cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:43:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.212+0000 7f9db6d9d640 1 --2- 172.21.15.84:0/3322673950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2d99f0 0x55658d6d9d60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009ca0 tx=0x7f9db002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b4fd59f1f8a9fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:10.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.212+0000 7f9d9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:43:10.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.213+0000 7f9d9dffb640 1 -- 172.21.15.84:0/3322673950 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db002f310 con 0x55658d2d99f0 2024-09-21T03:43:10.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.213+0000 7f9d9dffb640 1 -- 172.21.15.84:0/3322673950 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f9db002f610 con 0x55658d2d99f0 2024-09-21T03:43:10.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.213+0000 7f9dc315e740 1 -- 172.21.15.84:0/3322673950 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9da80035f0 con 0x55658d2d99f0 2024-09-21T03:43:10.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.213+0000 7f9d9dffb640 1 -- 172.21.15.84:0/3322673950 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9db002f810 con 0x55658d2d99f0 2024-09-21T03:43:10.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.213+0000 7f9dc315e740 10 client.15600 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:10.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.213+0000 7f9dc315e740 1 -- 172.21.15.84:0/3322673950 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55658d6da2a0 con 0x55658d2d99f0 2024-09-21T03:43:10.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.213+0000 7f9d9dffb640 1 -- 172.21.15.84:0/3322673950 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da80035f0 con 0x55658d2d99f0 2024-09-21T03:43:10.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.213+0000 7f9d9dffb640 1 -- 172.21.15.84:0/3322673950 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9db0062070 con 0x55658d2d99f0 2024-09-21T03:43:10.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.214+0000 7f9dc315e740 10 client.15600 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:10.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.214+0000 7f9dc315e740 10 client.15600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:43:10.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.214+0000 7f9dc315e740 20 client.15600 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:10.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.214+0000 7f9dc315e740 1 --2- 172.21.15.84:0/3322673950 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55658d2aeda0 0x55658d6dd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:10.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.214+0000 7f9dc315e740 4 client.15600 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:10.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.214+0000 7f9dc315e740 1 -- 172.21.15.84:0/3322673950 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55658d63adf0 con 0x55658d2aeda0 2024-09-21T03:43:10.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.214+0000 7f9db659c640 1 --2- 172.21.15.84:0/3322673950 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55658d2aeda0 0x55658d6dd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:10.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.214+0000 7f9d9dffb640 10 client.15600 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:10.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.215+0000 7f9db659c640 1 --2- 172.21.15.84:0/3322673950 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55658d2aeda0 0x55658d6dd810 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=709a925d2595a1a1 server_cookie=f3f782ce2d8154d in_seq=0 out_seq=0 2024-09-21T03:43:10.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.216+0000 7f9d9dffb640 1 -- 172.21.15.84:0/3322673950 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55658d63adf0 con 0x55658d2aeda0 2024-09-21T03:43:10.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.216+0000 7f9d9dffb640 10 client.15600 handle_command_reply: tid=0 2024-09-21T03:43:10.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.216+0000 7f9dc315e740 1 client.15600 shutdown 2024-09-21T03:43:10.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.216+0000 7f9dc315e740 1 -- 172.21.15.84:0/3322673950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2d99f0 msgr2=0x55658d6d9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:10.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.216+0000 7f9dc315e740 1 --2- 172.21.15.84:0/3322673950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2d99f0 0x55658d6d9d60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009ca0 tx=0x7f9db002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.216+0000 7f9dc315e740 1 -- 172.21.15.84:0/3322673950 shutdown_connections 2024-09-21T03:43:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.216+0000 7f9dc315e740 1 --2- 172.21.15.84:0/3322673950 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55658d2aeda0 0x55658d6dd810 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.216+0000 7f9d9dffb640 0 client.15600 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.216+0000 7f9dc315e740 1 --2- 172.21.15.84:0/3322673950 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2d99f0 0x55658d6d9d60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.216+0000 7f9dc315e740 1 --2- 172.21.15.84:0/3322673950 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55658d31b070 0x55658d6ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.216+0000 7f9dc315e740 1 --2- 172.21.15.84:0/3322673950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2fa390 0x55658d6cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.216+0000 7f9dc315e740 1 -- 172.21.15.84:0/3322673950 >> 172.21.15.84:0/3322673950 conn(0x55658d30f460 msgr2=0x55658d6c5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:10.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.216+0000 7f9dc315e740 1 -- 172.21.15.84:0/3322673950 shutdown_connections 2024-09-21T03:43:10.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.216+0000 7f9dc315e740 1 -- 172.21.15.84:0/3322673950 wait complete. 2024-09-21T03:43:10.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.216+0000 7f9dc315e740 20 client.15600 trim_cache size 0 max 16384 2024-09-21T03:43:10.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.233+0000 7f9dc315e740 1 Processor -- start 2024-09-21T03:43:10.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.233+0000 7f9dc315e740 1 -- start start 2024-09-21T03:43:10.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.233+0000 7f9dc315e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2aeda0 0x55658d6e2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:10.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.233+0000 7f9dc315e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55658d2d99f0 0x55658d6c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:10.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.233+0000 7f9dc315e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2fa390 0x55658d6cad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:10.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.233+0000 7f9dc315e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9db81b84c0 con 0x55658d2aeda0 2024-09-21T03:43:10.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.233+0000 7f9dc315e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9db81b5d90 con 0x55658d2fa390 2024-09-21T03:43:10.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.233+0000 7f9dc315e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9db81b3be0 con 0x55658d2d99f0 2024-09-21T03:43:10.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.233+0000 7f9db659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2aeda0 0x55658d6e2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:10.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.233+0000 7f9db659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2aeda0 0x55658d6e2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59134/0 (socket says 172.21.15.84:59134) 2024-09-21T03:43:10.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.233+0000 7f9db659c640 1 -- 172.21.15.84:0/4257902807 learned_addr learned my addr 172.21.15.84:0/4257902807 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:10.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.233+0000 7f9db6d9d640 1 --2- 172.21.15.84:0/4257902807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2fa390 0x55658d6cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:10.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.233+0000 7f9daffff640 1 --2- 172.21.15.84:0/4257902807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55658d2d99f0 0x55658d6c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:10.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.234+0000 7f9db659c640 1 -- 172.21.15.84:0/4257902807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55658d2d99f0 msgr2=0x55658d6c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.234+0000 7f9db659c640 1 --2- 172.21.15.84:0/4257902807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55658d2d99f0 0x55658d6c39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.234+0000 7f9db659c640 1 -- 172.21.15.84:0/4257902807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2fa390 msgr2=0x55658d6cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.234+0000 7f9db659c640 1 --2- 172.21.15.84:0/4257902807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2fa390 0x55658d6cad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.234+0000 7f9db659c640 1 -- 172.21.15.84:0/4257902807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55658d6cc030 con 0x55658d2aeda0 2024-09-21T03:43:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.234+0000 7f9daffff640 1 --2- 172.21.15.84:0/4257902807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55658d2d99f0 0x55658d6c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.234+0000 7f9db659c640 1 --2- 172.21.15.84:0/4257902807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2aeda0 0x55658d6e2940 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9da8011010 tx=0x7f9da8010dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124c8556725a22ed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.234+0000 7f9d9ffff640 1 -- 172.21.15.84:0/4257902807 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da80037f0 con 0x55658d2aeda0 2024-09-21T03:43:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.234+0000 7f9d9ffff640 1 -- 172.21.15.84:0/4257902807 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da80054f0 con 0x55658d2aeda0 2024-09-21T03:43:10.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.234+0000 7f9d9ffff640 1 -- 172.21.15.84:0/4257902807 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da802e690 con 0x55658d2aeda0 2024-09-21T03:43:10.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.235+0000 7f9dc315e740 1 -- 172.21.15.84:0/4257902807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2aeda0 msgr2=0x55658d6e2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:10.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.235+0000 7f9dc315e740 1 --2- 172.21.15.84:0/4257902807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2aeda0 0x55658d6e2940 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9da8011010 tx=0x7f9da8010dd0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.236+0000 7f9dc315e740 1 -- 172.21.15.84:0/4257902807 shutdown_connections 2024-09-21T03:43:10.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.236+0000 7f9dc315e740 1 --2- 172.21.15.84:0/4257902807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2fa390 0x55658d6cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.236+0000 7f9dc315e740 1 --2- 172.21.15.84:0/4257902807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55658d2d99f0 0x55658d6c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.236+0000 7f9dc315e740 1 --2- 172.21.15.84:0/4257902807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2aeda0 0x55658d6e2940 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.236+0000 7f9dc315e740 1 -- 172.21.15.84:0/4257902807 >> 172.21.15.84:0/4257902807 conn(0x55658d30f460 msgr2=0x55658d6c32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:10.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.236+0000 7f9dc315e740 1 -- 172.21.15.84:0/4257902807 shutdown_connections 2024-09-21T03:43:10.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.236+0000 7f9dc315e740 1 -- 172.21.15.84:0/4257902807 wait complete. 2024-09-21T03:43:10.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.236+0000 7f9dc315e740 1 -- start start 2024-09-21T03:43:10.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.237+0000 7f9dc315e740 1 Processor -- start 2024-09-21T03:43:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.237+0000 7f9dc315e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2aeda0 0x55658d6e9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.237+0000 7f9dc315e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55658d2d99f0 0x55658d6ea000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.237+0000 7f9dc315e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2fa390 0x55658d743310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.237+0000 7f9dc315e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9db81b4250 con 0x55658d2fa390 2024-09-21T03:43:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.237+0000 7f9dc315e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9db81b56c0 con 0x55658d2aeda0 2024-09-21T03:43:10.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.237+0000 7f9dc315e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9db81b4920 con 0x55658d2d99f0 2024-09-21T03:43:10.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.237+0000 7f9dc315e740 10 client.0 _ll_register_callbacks cb 0x7f9db00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:10.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.237+0000 7f9db659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2aeda0 0x55658d6e9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:10.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.237+0000 7f9db6d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2fa390 0x55658d743310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:10.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.237+0000 7f9db659c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2aeda0 0x55658d6e9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:54028/0 (socket says 172.21.15.84:54028) 2024-09-21T03:43:10.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.237+0000 7f9db6d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2fa390 0x55658d743310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59142/0 (socket says 172.21.15.84:59142) 2024-09-21T03:43:10.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.237+0000 7f9db659c640 1 -- 172.21.15.84:0/2868930985 learned_addr learned my addr 172.21.15.84:0/2868930985 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:10.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.237+0000 7f9daffff640 1 --2- 172.21.15.84:0/2868930985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55658d2d99f0 0x55658d6ea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:10.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.238+0000 7f9db659c640 1 -- 172.21.15.84:0/2868930985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55658d2d99f0 msgr2=0x55658d6ea000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:10.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.238+0000 7f9db659c640 1 --2- 172.21.15.84:0/2868930985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55658d2d99f0 0x55658d6ea000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.238+0000 7f9db659c640 1 -- 172.21.15.84:0/2868930985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2fa390 msgr2=0x55658d743310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:10.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.238+0000 7f9db659c640 1 --2- 172.21.15.84:0/2868930985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2fa390 0x55658d743310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.238+0000 7f9db659c640 1 -- 172.21.15.84:0/2868930985 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55658d743980 con 0x55658d2aeda0 2024-09-21T03:43:10.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.238+0000 7f9db6d9d640 1 --2- 172.21.15.84:0/2868930985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2fa390 0x55658d743310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:43:10.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.238+0000 7f9db659c640 1 --2- 172.21.15.84:0/2868930985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2aeda0 0x55658d6e9a20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9da8003c10 tx=0x7f9da80107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25db833bc59c0bd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:10.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.238+0000 7f9d9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T03:43:10.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.238+0000 7f9d9dffb640 1 -- 172.21.15.84:0/2868930985 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da803b070 con 0x55658d2aeda0 2024-09-21T03:43:10.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.238+0000 7f9d9dffb640 1 -- 172.21.15.84:0/2868930985 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f9da80035f0 con 0x55658d2aeda0 2024-09-21T03:43:10.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.238+0000 7f9dc315e740 1 -- 172.21.15.84:0/2868930985 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9da80054f0 con 0x55658d2aeda0 2024-09-21T03:43:10.244 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.239+0000 7f9d9dffb640 1 -- 172.21.15.84:0/2868930985 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9da8047050 con 0x55658d2aeda0 2024-09-21T03:43:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.239+0000 7f9dc315e740 10 client.25178 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.239+0000 7f9dc315e740 1 -- 172.21.15.84:0/2868930985 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55658d74aca0 con 0x55658d2aeda0 2024-09-21T03:43:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.239+0000 7f9d9dffb640 1 -- 172.21.15.84:0/2868930985 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da80054f0 con 0x55658d2aeda0 2024-09-21T03:43:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.239+0000 7f9d9dffb640 1 -- 172.21.15.84:0/2868930985 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9da8037cc0 con 0x55658d2aeda0 2024-09-21T03:43:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.239+0000 7f9dc315e740 10 client.25178 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.239+0000 7f9dc315e740 10 client.25178 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:43:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.239+0000 7f9dc315e740 20 client.25178 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.239+0000 7f9dc315e740 1 --2- 172.21.15.84:0/2868930985 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55658d31b070 0x55658d74d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.239+0000 7f9dc315e740 4 client.25178 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:43:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.239+0000 7f9dc315e740 1 -- 172.21.15.84:0/2868930985 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55658d6368a0 con 0x55658d31b070 2024-09-21T03:43:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.240+0000 7f9daffff640 1 --2- 172.21.15.84:0/2868930985 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55658d31b070 0x55658d74d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:10.245 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.241+0000 7f9daffff640 1 --2- 172.21.15.84:0/2868930985 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55658d31b070 0x55658d74d1c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a28650a7b635a15 server_cookie=15976c07ba0daa1d in_seq=0 out_seq=0 2024-09-21T03:43:10.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.241+0000 7f9d9dffb640 10 client.25178 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:10.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.241+0000 7f9d9dffb640 1 -- 172.21.15.84:0/2868930985 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55658d6368a0 con 0x55658d31b070 2024-09-21T03:43:10.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.241+0000 7f9d9dffb640 10 client.25178 handle_command_reply: tid=0 2024-09-21T03:43:10.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.241+0000 7f9dc315e740 1 client.25178 shutdown 2024-09-21T03:43:10.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.241+0000 7f9dc315e740 1 -- 172.21.15.84:0/2868930985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2aeda0 msgr2=0x55658d6e9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:10.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.241+0000 7f9dc315e740 1 --2- 172.21.15.84:0/2868930985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2aeda0 0x55658d6e9a20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9da8003c10 tx=0x7f9da80107a0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.241+0000 7f9dc315e740 1 -- 172.21.15.84:0/2868930985 shutdown_connections 2024-09-21T03:43:10.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.241+0000 7f9dc315e740 1 --2- 172.21.15.84:0/2868930985 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55658d31b070 0x55658d74d1c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.241+0000 7f9dc315e740 1 --2- 172.21.15.84:0/2868930985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55658d2fa390 0x55658d743310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.241+0000 7f9d9dffb640 0 client.25178 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:10.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.241+0000 7f9dc315e740 1 --2- 172.21.15.84:0/2868930985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55658d2d99f0 0x55658d6ea000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.241+0000 7f9dc315e740 1 --2- 172.21.15.84:0/2868930985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55658d2aeda0 0x55658d6e9a20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.241+0000 7f9dc315e740 1 -- 172.21.15.84:0/2868930985 >> 172.21.15.84:0/2868930985 conn(0x55658d30f460 msgr2=0x55658d6e2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:10.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.242+0000 7f9dc315e740 1 -- 172.21.15.84:0/2868930985 shutdown_connections 2024-09-21T03:43:10.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.242+0000 7f9dc315e740 1 -- 172.21.15.84:0/2868930985 wait complete. 2024-09-21T03:43:10.247 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.242+0000 7f9dc315e740 20 client.25178 trim_cache size 0 max 16384 2024-09-21T03:43:10.247 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:43:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.242+0000 7f9dbcbea640 1 -- 172.21.15.84:0/532157077 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9da40b6810 msgr2=0x7f9da40b8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.242+0000 7f9dbcbea640 1 --2- 172.21.15.84:0/532157077 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9da40b6810 0x7f9da40b8d20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9db0004af0 tx=0x7f9db0004a60 comp rx=0 tx=0).stop 2024-09-21T03:43:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.243+0000 7f9dbcbea640 1 -- 172.21.15.84:0/532157077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9db81083e0 msgr2=0x7f9db806df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.243+0000 7f9dbcbea640 1 --2- 172.21.15.84:0/532157077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9db81083e0 0x7f9db806df10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9da0009b80 tx=0x7f9da000f4a0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.243+0000 7f9dbcbea640 1 -- 172.21.15.84:0/532157077 shutdown_connections 2024-09-21T03:43:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.243+0000 7f9dbcbea640 1 --2- 172.21.15.84:0/532157077 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9da40b6810 0x7f9da40b8d20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.243+0000 7f9dbcbea640 1 --2- 172.21.15.84:0/532157077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9db8108d30 0x7f9db806e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.243+0000 7f9dbcbea640 1 --2- 172.21.15.84:0/532157077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9db81083e0 0x7f9db806df10 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.243+0000 7f9dbcbea640 1 --2- 172.21.15.84:0/532157077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9db8103100 0x7f9db8074c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.243+0000 7f9dbcbea640 1 -- 172.21.15.84:0/532157077 >> 172.21.15.84:0/532157077 conn(0x7f9db8077cc0 msgr2=0x7f9db8109410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.243+0000 7f9dbcbea640 1 -- 172.21.15.84:0/532157077 shutdown_connections 2024-09-21T03:43:10.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:10.243+0000 7f9dbcbea640 1 -- 172.21.15.84:0/532157077 wait complete. 2024-09-21T03:43:11.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:11 smithi174 ceph-mon[34403]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-21T03:43:11.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:11 smithi172 ceph-mon[34821]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-21T03:43:11.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:11 smithi084 ceph-mon[30941]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-21T03:43:12.099 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:43:12.099 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:43:12.464 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:13.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.000+0000 7fb2c6c64640 1 -- 172.21.15.84:0/3291738086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2c0105ac0 msgr2=0x7fb2c010f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:13.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.000+0000 7fb2c6c64640 1 --2- 172.21.15.84:0/3291738086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2c0105ac0 0x7fb2c010f530 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009ca0 tx=0x7fb2b802a8e0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.000+0000 7fb2c6c64640 1 -- 172.21.15.84:0/3291738086 shutdown_connections 2024-09-21T03:43:13.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.000+0000 7fb2c6c64640 1 --2- 172.21.15.84:0/3291738086 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2c0105ac0 0x7fb2c010f530 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.000+0000 7fb2c6c64640 1 --2- 172.21.15.84:0/3291738086 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2c0105170 0x7fb2c0105580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.000+0000 7fb2c6c64640 1 --2- 172.21.15.84:0/3291738086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2c0103080 0x7fb2c0103490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.000+0000 7fb2c6c64640 1 -- 172.21.15.84:0/3291738086 >> 172.21.15.84:0/3291738086 conn(0x7fb2c0077c60 msgr2=0x7fb2c00780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.000+0000 7fb2c6c64640 1 -- 172.21.15.84:0/3291738086 shutdown_connections 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.000+0000 7fb2c6c64640 1 -- 172.21.15.84:0/3291738086 wait complete. 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.001+0000 7fb2c6c64640 1 Processor -- start 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.001+0000 7fb2c6c64640 1 -- start start 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.002+0000 7fb2c6c64640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2c0103080 0x7fb2c019b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.002+0000 7fb2c6c64640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2c0105170 0x7fb2c019b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.002+0000 7fb2c6c64640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2c0105ac0 0x7fb2c019be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.002+0000 7fb2c6c64640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c0112a80 con 0x7fb2c0105ac0 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.002+0000 7fb2c6c64640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c0112900 con 0x7fb2c0105170 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.002+0000 7fb2c6c64640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c0112c00 con 0x7fb2c0103080 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.002+0000 7fb2c5201640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2c0105ac0 0x7fb2c019be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.002+0000 7fb2c5201640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2c0105ac0 0x7fb2c019be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59164/0 (socket says 172.21.15.84:59164) 2024-09-21T03:43:13.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.002+0000 7fb2c5201640 1 -- 172.21.15.84:0/3216154775 learned_addr learned my addr 172.21.15.84:0/3216154775 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.002+0000 7fb2bffff640 1 --2- 172.21.15.84:0/3216154775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2c0105170 0x7fb2c019b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.002+0000 7fb2c5201640 1 -- 172.21.15.84:0/3216154775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2c0103080 msgr2=0x7fb2c019b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.002+0000 7fb2c5201640 1 --2- 172.21.15.84:0/3216154775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2c0103080 0x7fb2c019b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.002+0000 7fb2c5201640 1 -- 172.21.15.84:0/3216154775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2c0105170 msgr2=0x7fb2c019b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.002+0000 7fb2c5201640 1 --2- 172.21.15.84:0/3216154775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2c0105170 0x7fb2c019b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.002+0000 7fb2c5201640 1 -- 172.21.15.84:0/3216154775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c01a6680 con 0x7fb2c0105ac0 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.003+0000 7fb2c5201640 1 --2- 172.21.15.84:0/3216154775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2c0105ac0 0x7fb2c019be70 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8005cc0 tx=0x7fb2b8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.003+0000 7fb2bdffb640 1 -- 172.21.15.84:0/3216154775 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b803f810 con 0x7fb2c0105ac0 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.003+0000 7fb2bdffb640 1 -- 172.21.15.84:0/3216154775 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2b8004040 con 0x7fb2c0105ac0 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.003+0000 7fb2bdffb640 1 -- 172.21.15.84:0/3216154775 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b803fe60 con 0x7fb2c0105ac0 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.003+0000 7fb2c6c64640 1 -- 172.21.15.84:0/3216154775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c01991e0 con 0x7fb2c0105ac0 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.004+0000 7fb2c6c64640 1 -- 172.21.15.84:0/3216154775 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c0199610 con 0x7fb2c0105ac0 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.007+0000 7fb2cd1d8740 1 Processor -- start 2024-09-21T03:43:13.057 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.007+0000 7fb2bdffb640 1 -- 172.21.15.84:0/3216154775 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7fb2b80044c0 con 0x7fb2c0105ac0 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.008+0000 7fb2cd1d8740 1 -- start start 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.008+0000 7fb2cd1d8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dd5fc0d350 0x55dd5ffbcc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.008+0000 7fb2cd1d8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbe4490 0x55dd5ffbd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.008+0000 7fb2cd1d8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbec670 0x55dd5ffbd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.008+0000 7fb2cd1d8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55dd5ff2ae60 con 0x55dd5fbe4490 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.008+0000 7fb2cd1d8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dd5ff1a290 con 0x55dd5fbec670 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.008+0000 7fb2cd1d8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55dd5ff1e0a0 con 0x55dd5fc0d350 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.008+0000 7fb2bffff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dd5fc0d350 0x55dd5ffbcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.008+0000 7fb2bffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbec670 0x55dd5ffbd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.008+0000 7fb2bffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbec670 0x55dd5ffbd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:54050/0 (socket says 172.21.15.84:54050) 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.008+0000 7fb2bffff640 1 -- 172.21.15.84:0/2861312756 learned_addr learned my addr 172.21.15.84:0/2861312756 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.008+0000 7fb2bdffb640 1 --2- 172.21.15.84:0/3216154775 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2a80b67c0 0x7fb2a80b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.008+0000 7fb2c4a00640 1 --2- 172.21.15.84:0/2861312756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbe4490 0x55dd5ffbd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:13.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.009+0000 7fb2bffff640 1 -- 172.21.15.84:0/2861312756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dd5fc0d350 msgr2=0x55dd5ffbcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.009+0000 7fb2bffff640 1 --2- 172.21.15.84:0/2861312756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dd5fc0d350 0x55dd5ffbcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.009+0000 7fb2bffff640 1 -- 172.21.15.84:0/2861312756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbe4490 msgr2=0x55dd5ffbd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.009+0000 7fb2bffff640 1 --2- 172.21.15.84:0/2861312756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbe4490 0x55dd5ffbd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.009+0000 7fb2bffff640 1 -- 172.21.15.84:0/2861312756 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd5fc78930 con 0x55dd5fbec670 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.009+0000 7fb2bffff640 1 --2- 172.21.15.84:0/2861312756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbec670 0x55dd5ffbd6c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4017700 tx=0x7fb2b4009110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6be03fb46f6d7e93 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.009+0000 7fb2c5201640 1 --2- 172.21.15.84:0/3216154775 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2a80b67c0 0x7fb2a80b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.009+0000 7fb2a6ffd640 1 -- 172.21.15.84:0/2861312756 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b401c020 con 0x55dd5fbec670 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.010+0000 7fb2a6ffd640 1 -- 172.21.15.84:0/2861312756 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2b4015e10 con 0x55dd5fbec670 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.010+0000 7fb2a6ffd640 1 -- 172.21.15.84:0/2861312756 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4018b50 con 0x55dd5fbec670 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.010+0000 7fb2bdffb640 1 -- 172.21.15.84:0/3216154775 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fb2b8108bd0 con 0x7fb2c0105ac0 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.011+0000 7fb2c5201640 1 --2- 172.21.15.84:0/3216154775 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2a80b67c0 0x7fb2a80b8cd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8106340 tx=0x7fb2b80ba040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.011+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2861312756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbec670 msgr2=0x55dd5ffbd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.011+0000 7fb2cd1d8740 1 --2- 172.21.15.84:0/2861312756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbec670 0x55dd5ffbd6c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4017700 tx=0x7fb2b4009110 comp rx=0 tx=0).stop 2024-09-21T03:43:13.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.011+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2861312756 shutdown_connections 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.011+0000 7fb2cd1d8740 1 --2- 172.21.15.84:0/2861312756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbec670 0x55dd5ffbd6c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.011+0000 7fb2cd1d8740 1 --2- 172.21.15.84:0/2861312756 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbe4490 0x55dd5ffbd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.011+0000 7fb2cd1d8740 1 --2- 172.21.15.84:0/2861312756 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dd5fc0d350 0x55dd5ffbcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.011+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2861312756 >> 172.21.15.84:0/2861312756 conn(0x55dd5fc01740 msgr2=0x55dd5ffbab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.011+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2861312756 shutdown_connections 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.011+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2861312756 wait complete. 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.011+0000 7fb2cd1d8740 1 -- start start 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.012+0000 7fb2cd1d8740 1 Processor -- start 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.012+0000 7fb2cd1d8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbe4490 0x55dd5ffc8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.012+0000 7fb2cd1d8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbec670 0x55dd5ffc8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.012+0000 7fb2bffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbe4490 0x55dd5ffc8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.012+0000 7fb2bffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbe4490 0x55dd5ffc8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59178/0 (socket says 172.21.15.84:59178) 2024-09-21T03:43:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.012+0000 7fb2cd1d8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dd5fc0d350 0x55dd5ffce710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.012+0000 7fb2bffff640 1 -- 172.21.15.84:0/2930255538 learned_addr learned my addr 172.21.15.84:0/2930255538 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.012+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2930255538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55dd5fd7b890 con 0x55dd5fbe4490 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.012+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2930255538 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dd5feb4d40 con 0x55dd5fbec670 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.012+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2930255538 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55dd5ffcb420 con 0x55dd5fc0d350 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.013+0000 7fb2bffff640 1 -- 172.21.15.84:0/2930255538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dd5fc0d350 msgr2=0x55dd5ffce710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.013+0000 7fb2bffff640 1 --2- 172.21.15.84:0/2930255538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dd5fc0d350 0x55dd5ffce710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.013+0000 7fb2bffff640 1 -- 172.21.15.84:0/2930255538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbec670 msgr2=0x55dd5ffc8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.013+0000 7fb2bffff640 1 --2- 172.21.15.84:0/2930255538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbec670 0x55dd5ffc8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.013+0000 7fb2bffff640 1 -- 172.21.15.84:0/2930255538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd5ffced80 con 0x55dd5fbe4490 2024-09-21T03:43:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.013+0000 7fb29ffff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.013+0000 7fb2bffff640 1 --2- 172.21.15.84:0/2930255538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbe4490 0x55dd5ffc8950 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4004700 tx=0x7fb2b4009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975c71c90ef525e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.013+0000 7fb29ffff640 1 -- 172.21.15.84:0/2930255538 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4015b70 con 0x55dd5fbe4490 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.013+0000 7fb2cd1d8740 10 client.0 _ll_register_callbacks cb 0x55dd5ff18c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.014+0000 7fb29ffff640 1 -- 172.21.15.84:0/2930255538 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fb2b40188d0 con 0x55dd5fbe4490 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.014+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2930255538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2b4015e10 con 0x55dd5fbe4490 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.014+0000 7fb29ffff640 1 -- 172.21.15.84:0/2930255538 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb2b4018ad0 con 0x55dd5fbe4490 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.014+0000 7fb2cd1d8740 10 client.15618 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.014+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2930255538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55dd5ffd7350 con 0x55dd5fbe4490 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.014+0000 7fb29ffff640 1 -- 172.21.15.84:0/2930255538 <== mon.0 v2:172.21.15.84:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb2b4018c70 con 0x55dd5fbe4490 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.014+0000 7fb2cd1d8740 10 client.15618 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.014+0000 7fb2cd1d8740 10 client.15618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.014+0000 7fb2cd1d8740 20 client.15618 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.014+0000 7fb2cd1d8740 1 --2- 172.21.15.84:0/2930255538 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55dd5fbcbcd0 0x55dd5ffda710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.014+0000 7fb2cd1d8740 4 client.15618 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.014+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2930255538 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb2b4015e10 con 0x55dd5fbcbcd0 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.015+0000 7fb2c4a00640 1 --2- 172.21.15.84:0/2930255538 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55dd5fbcbcd0 0x55dd5ffda710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.015+0000 7fb29ffff640 10 client.15618 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.015+0000 7fb2c4a00640 1 --2- 172.21.15.84:0/2930255538 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55dd5fbcbcd0 0x55dd5ffda710 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64fbe19c1543baec server_cookie=5de673e811f1b3d in_seq=0 out_seq=0 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.016+0000 7fb29ffff640 1 -- 172.21.15.84:0/2930255538 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fb2b4015e10 con 0x55dd5fbcbcd0 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.016+0000 7fb29ffff640 10 client.15618 handle_command_reply: tid=0 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.016+0000 7fb2cd1d8740 1 client.15618 shutdown 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.016+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2930255538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbe4490 msgr2=0x55dd5ffc8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.016+0000 7fb2cd1d8740 1 --2- 172.21.15.84:0/2930255538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbe4490 0x55dd5ffc8950 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4004700 tx=0x7fb2b4009540 comp rx=0 tx=0).stop 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.016+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2930255538 shutdown_connections 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.016+0000 7fb2cd1d8740 1 --2- 172.21.15.84:0/2930255538 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55dd5fbcbcd0 0x55dd5ffda710 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.016+0000 7fb29ffff640 0 client.15618 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.016+0000 7fb2cd1d8740 1 --2- 172.21.15.84:0/2930255538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dd5fc0d350 0x55dd5ffce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.016+0000 7fb2cd1d8740 1 --2- 172.21.15.84:0/2930255538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbec670 0x55dd5ffc8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.016+0000 7fb2cd1d8740 1 --2- 172.21.15.84:0/2930255538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbe4490 0x55dd5ffc8950 secure :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4004700 tx=0x7fb2b4009540 comp rx=0 tx=0).stop 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.016+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2930255538 >> 172.21.15.84:0/2930255538 conn(0x55dd5fc01740 msgr2=0x55dd5ffbfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.017+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2930255538 shutdown_connections 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.017+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2930255538 wait complete. 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.017+0000 7fb2cd1d8740 20 client.15618 trim_cache size 0 max 16384 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.051+0000 7fb2cd1d8740 1 Processor -- start 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.051+0000 7fb2cd1d8740 1 -- start start 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.051+0000 7fb2cd1d8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dd5fc01740 0x55dd5ffce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.051+0000 7fb2cd1d8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbcbcd0 0x55dd5ffc22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.051+0000 7fb2cd1d8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbec670 0x55dd5ffc5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.051+0000 7fb2cd1d8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c01afc90 con 0x55dd5fbec670 2024-09-21T03:43:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.051+0000 7fb2cd1d8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c01ad560 con 0x55dd5fbcbcd0 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.051+0000 7fb2cd1d8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c01ab3b0 con 0x55dd5fc01740 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.052+0000 7fb2bffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbec670 0x55dd5ffc5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.052+0000 7fb2bffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbec670 0x55dd5ffc5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59186/0 (socket says 172.21.15.84:59186) 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.052+0000 7fb2bffff640 1 -- 172.21.15.84:0/4081209112 learned_addr learned my addr 172.21.15.84:0/4081209112 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.052+0000 7fb2bffff640 1 --2- 172.21.15.84:0/4081209112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dd5fc01740 0x55dd5ffce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.052+0000 7fb2c4a00640 1 --2- 172.21.15.84:0/4081209112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbcbcd0 0x55dd5ffc22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.052+0000 7fb2bffff640 1 -- 172.21.15.84:0/4081209112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dd5fc01740 msgr2=0x55dd5ffce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.052+0000 7fb2bffff640 1 --2- 172.21.15.84:0/4081209112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dd5fc01740 0x55dd5ffce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.052+0000 7fb2bffff640 1 -- 172.21.15.84:0/4081209112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbcbcd0 msgr2=0x55dd5ffc22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.052+0000 7fb2bffff640 1 --2- 172.21.15.84:0/4081209112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbcbcd0 0x55dd5ffc22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.053+0000 7fb2bffff640 1 -- 172.21.15.84:0/4081209112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd5ffcf4f0 con 0x55dd5fbec670 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.053+0000 7fb2c4a00640 1 --2- 172.21.15.84:0/4081209112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbcbcd0 0x55dd5ffc22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:43:13.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.053+0000 7fb2bffff640 1 --2- 172.21.15.84:0/4081209112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbec670 0x55dd5ffc5940 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4006d80 tx=0x7fb2b4023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750581dba50c9c3a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:13.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.053+0000 7fb2a67fc640 1 -- 172.21.15.84:0/4081209112 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b401c070 con 0x55dd5fbec670 2024-09-21T03:43:13.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.053+0000 7fb2a67fc640 1 -- 172.21.15.84:0/4081209112 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2b403d040 con 0x55dd5fbec670 2024-09-21T03:43:13.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.053+0000 7fb2a67fc640 1 -- 172.21.15.84:0/4081209112 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b403c070 con 0x55dd5fbec670 2024-09-21T03:43:13.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.054+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/4081209112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbec670 msgr2=0x55dd5ffc5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:13.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.054+0000 7fb2cd1d8740 1 --2- 172.21.15.84:0/4081209112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbec670 0x55dd5ffc5940 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4006d80 tx=0x7fb2b4023000 comp rx=0 tx=0).stop 2024-09-21T03:43:13.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.054+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/4081209112 shutdown_connections 2024-09-21T03:43:13.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.054+0000 7fb2cd1d8740 1 --2- 172.21.15.84:0/4081209112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbec670 0x55dd5ffc5940 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.054+0000 7fb2cd1d8740 1 --2- 172.21.15.84:0/4081209112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbcbcd0 0x55dd5ffc22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.054+0000 7fb2cd1d8740 1 --2- 172.21.15.84:0/4081209112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dd5fc01740 0x55dd5ffce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.069 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.055+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/4081209112 >> 172.21.15.84:0/4081209112 conn(0x55dd5ffc9100 msgr2=0x55dd5ffc1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:13.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.055+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/4081209112 shutdown_connections 2024-09-21T03:43:13.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.055+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/4081209112 wait complete. 2024-09-21T03:43:13.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.055+0000 7fb2cd1d8740 1 -- start start 2024-09-21T03:43:13.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.056+0000 7fb2cd1d8740 1 Processor -- start 2024-09-21T03:43:13.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.056+0000 7fb2cd1d8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbcbcd0 0x55dd5ffd5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:13.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.056+0000 7fb2cd1d8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbec670 0x55dd5ffcf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:13.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.057+0000 7fb2cd1d8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dd5fc01740 0x55dd5ffcfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:13.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.057+0000 7fb2c4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbec670 0x55dd5ffcf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:13.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.057+0000 7fb2c4a00640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbec670 0x55dd5ffcf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59188/0 (socket says 172.21.15.84:59188) 2024-09-21T03:43:13.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.057+0000 7fb2c4a00640 1 -- 172.21.15.84:0/2089980214 learned_addr learned my addr 172.21.15.84:0/2089980214 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:13.070 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.057+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2089980214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c01aba20 con 0x55dd5fbec670 2024-09-21T03:43:13.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.057+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2089980214 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c01ace90 con 0x55dd5fbcbcd0 2024-09-21T03:43:13.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.057+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2089980214 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c01ac0f0 con 0x55dd5fc01740 2024-09-21T03:43:13.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.057+0000 7fb2bffff640 1 --2- 172.21.15.84:0/2089980214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dd5fc01740 0x55dd5ffcfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:13.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.057+0000 7fb2bffff640 1 --2- 172.21.15.84:0/2089980214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbcbcd0 0x55dd5ffd5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:13.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.057+0000 7fb2cd1d8740 10 client.0 _ll_register_callbacks cb 0x7fb2b0006f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:13.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.057+0000 7fb2c4a00640 1 -- 172.21.15.84:0/2089980214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dd5fc01740 msgr2=0x55dd5ffcfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:13.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.057+0000 7fb2c4a00640 1 --2- 172.21.15.84:0/2089980214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dd5fc01740 0x55dd5ffcfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.057+0000 7fb2c4a00640 1 -- 172.21.15.84:0/2089980214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbcbcd0 msgr2=0x55dd5ffd5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:13.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.057+0000 7fb2c4a00640 1 --2- 172.21.15.84:0/2089980214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbcbcd0 0x55dd5ffd5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.057+0000 7fb2c4a00640 1 -- 172.21.15.84:0/2089980214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd5ffd0590 con 0x55dd5fbec670 2024-09-21T03:43:13.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.058+0000 7fb2c4a00640 1 --2- 172.21.15.84:0/2089980214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbec670 0x55dd5ffcf7b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0006b10 tx=0x7fb2b0009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9964bd0563dadcfa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:13.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.058+0000 7fb29ffff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:43:13.071 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.058+0000 7fb29ffff640 1 -- 172.21.15.84:0/2089980214 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0021020 con 0x55dd5fbec670 2024-09-21T03:43:13.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.058+0000 7fb29ffff640 1 -- 172.21.15.84:0/2089980214 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fb2b0016d20 con 0x55dd5fbec670 2024-09-21T03:43:13.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.058+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2089980214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dd5ffc4300 con 0x55dd5fbec670 2024-09-21T03:43:13.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.058+0000 7fb29ffff640 1 -- 172.21.15.84:0/2089980214 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb2b002c050 con 0x55dd5fbec670 2024-09-21T03:43:13.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.058+0000 7fb2cd1d8740 10 client.15624 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:13.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.058+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2089980214 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dd60045f10 con 0x55dd5fbec670 2024-09-21T03:43:13.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.059+0000 7fb29ffff640 1 -- 172.21.15.84:0/2089980214 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55dd5ffc4300 con 0x55dd5fbec670 2024-09-21T03:43:13.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.060+0000 7fb29ffff640 1 -- 172.21.15.84:0/2089980214 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb2b001b040 con 0x55dd5fbec670 2024-09-21T03:43:13.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.060+0000 7fb2cd1d8740 10 client.15624 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:13.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.060+0000 7fb2cd1d8740 10 client.15624 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:43:13.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.060+0000 7fb2cd1d8740 20 client.15624 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:13.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.060+0000 7fb2cd1d8740 1 --2- 172.21.15.84:0/2089980214 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55dd5fc0d350 0x55dd60048670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:13.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.060+0000 7fb2cd1d8740 4 client.15624 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:43:13.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.060+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2089980214 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55dd5ff2cdb0 con 0x55dd5fc0d350 2024-09-21T03:43:13.072 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.060+0000 7fb2bffff640 1 --2- 172.21.15.84:0/2089980214 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55dd5fc0d350 0x55dd60048670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:13.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.061+0000 7fb29ffff640 10 client.15624 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:13.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.061+0000 7fb2bffff640 1 --2- 172.21.15.84:0/2089980214 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55dd5fc0d350 0x55dd60048670 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9b7fa18742c33fc server_cookie=d95c11b3f1afa97a in_seq=0 out_seq=0 2024-09-21T03:43:13.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.063+0000 7fb29ffff640 1 -- 172.21.15.84:0/2089980214 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55dd5ff2cdb0 con 0x55dd5fc0d350 2024-09-21T03:43:13.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.063+0000 7fb29ffff640 10 client.15624 handle_command_reply: tid=0 2024-09-21T03:43:13.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.063+0000 7fb2cd1d8740 1 client.15624 shutdown 2024-09-21T03:43:13.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.064+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2089980214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbec670 msgr2=0x55dd5ffcf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:13.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.064+0000 7fb2cd1d8740 1 --2- 172.21.15.84:0/2089980214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbec670 0x55dd5ffcf7b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0006b10 tx=0x7fb2b0009f30 comp rx=0 tx=0).stop 2024-09-21T03:43:13.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.064+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2089980214 shutdown_connections 2024-09-21T03:43:13.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.064+0000 7fb2cd1d8740 1 --2- 172.21.15.84:0/2089980214 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55dd5fc0d350 0x55dd60048670 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.064+0000 7fb29ffff640 0 client.15624 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:13.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.064+0000 7fb2cd1d8740 1 --2- 172.21.15.84:0/2089980214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55dd5fc01740 0x55dd5ffcfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.064+0000 7fb2cd1d8740 1 --2- 172.21.15.84:0/2089980214 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55dd5fbec670 0x55dd5ffcf7b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.064+0000 7fb2cd1d8740 1 --2- 172.21.15.84:0/2089980214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd5fbcbcd0 0x55dd5ffd5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.064+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2089980214 >> 172.21.15.84:0/2089980214 conn(0x55dd5ffc9100 msgr2=0x55dd5ffbab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:13.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.064+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2089980214 shutdown_connections 2024-09-21T03:43:13.073 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.064+0000 7fb2cd1d8740 1 -- 172.21.15.84:0/2089980214 wait complete. 2024-09-21T03:43:13.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.064+0000 7fb2cd1d8740 20 client.15624 trim_cache size 0 max 16384 2024-09-21T03:43:13.074 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:43:13.074 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T03:43:13.074 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "e4317214-6a95-4e1b-9027-1cadb386ea43", 2024-09-21T03:43:13.074 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T03:43:13.074 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:43:13.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.065+0000 7fb2c6c64640 1 -- 172.21.15.84:0/3216154775 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2a80b67c0 msgr2=0x7fb2a80b8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:13.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.065+0000 7fb2c6c64640 1 --2- 172.21.15.84:0/3216154775 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2a80b67c0 0x7fb2a80b8cd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8106340 tx=0x7fb2b80ba040 comp rx=0 tx=0).stop 2024-09-21T03:43:13.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.065+0000 7fb2c6c64640 1 -- 172.21.15.84:0/3216154775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2c0105ac0 msgr2=0x7fb2c019be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:13.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.065+0000 7fb2c6c64640 1 --2- 172.21.15.84:0/3216154775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2c0105ac0 0x7fb2c019be70 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8005cc0 tx=0x7fb2b8003ba0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.065+0000 7fb2c6c64640 1 -- 172.21.15.84:0/3216154775 shutdown_connections 2024-09-21T03:43:13.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.065+0000 7fb2c6c64640 1 --2- 172.21.15.84:0/3216154775 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2a80b67c0 0x7fb2a80b8cd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.065+0000 7fb2c6c64640 1 --2- 172.21.15.84:0/3216154775 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2c0105ac0 0x7fb2c019be70 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.065+0000 7fb2c6c64640 1 --2- 172.21.15.84:0/3216154775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2c0105170 0x7fb2c019b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.065+0000 7fb2c6c64640 1 --2- 172.21.15.84:0/3216154775 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2c0103080 0x7fb2c019b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:13.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.065+0000 7fb2c6c64640 1 -- 172.21.15.84:0/3216154775 >> 172.21.15.84:0/3216154775 conn(0x7fb2c0077c60 msgr2=0x7fb2c0106400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:13.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.065+0000 7fb2c6c64640 1 -- 172.21.15.84:0/3216154775 shutdown_connections 2024-09-21T03:43:13.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:13.065+0000 7fb2c6c64640 1 -- 172.21.15.84:0/3216154775 wait complete. 2024-09-21T03:43:13.622 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:13 smithi084 ceph-mon[30941]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-21T03:43:13.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:13 smithi174 ceph-mon[34403]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-21T03:43:13.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:13 smithi172 ceph-mon[34821]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-21T03:43:13.878 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:43:14.154 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:14.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:14 smithi084 ceph-mon[30941]: scrub queued for path: / 2024-09-21T03:43:14.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:14 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:14.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:14 smithi084 ceph-mon[30941]: scrub summary: active paths [/] 2024-09-21T03:43:14.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:14 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:14 smithi172 ceph-mon[34821]: scrub queued for path: / 2024-09-21T03:43:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:14 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:14 smithi172 ceph-mon[34821]: scrub summary: active paths [/] 2024-09-21T03:43:14.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:14 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:14.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.716+0000 7f0a92940640 1 -- 172.21.15.84:0/1202238531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a8c110180 msgr2=0x7f0a8c1125a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:14.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.716+0000 7f0a92940640 1 --2- 172.21.15.84:0/1202238531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a8c110180 0x7f0a8c1125a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009ca0 tx=0x7f0a8402a950 comp rx=0 tx=0).stop 2024-09-21T03:43:14.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.716+0000 7f0a92940640 1 -- 172.21.15.84:0/1202238531 shutdown_connections 2024-09-21T03:43:14.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.716+0000 7f0a92940640 1 --2- 172.21.15.84:0/1202238531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a8c110180 0x7f0a8c1125a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.716+0000 7f0a92940640 1 --2- 172.21.15.84:0/1202238531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0a8c102f20 0x7f0a8c10fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.716+0000 7f0a92940640 1 --2- 172.21.15.84:0/1202238531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c1025d0 0x7f0a8c1029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.716+0000 7f0a92940640 1 -- 172.21.15.84:0/1202238531 >> 172.21.15.84:0/1202238531 conn(0x7f0a8c079730 msgr2=0x7f0a8c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:14.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.716+0000 7f0a92940640 1 -- 172.21.15.84:0/1202238531 shutdown_connections 2024-09-21T03:43:14.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.716+0000 7f0a92940640 1 -- 172.21.15.84:0/1202238531 wait complete. 2024-09-21T03:43:14.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.717+0000 7f0a92940640 1 Processor -- start 2024-09-21T03:43:14.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.717+0000 7f0a92940640 1 -- start start 2024-09-21T03:43:14.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.718+0000 7f0a92940640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a8c1025d0 0x7f0a8c19c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.718+0000 7f0a92940640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0a8c102f20 0x7f0a8c19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.718+0000 7f0a92940640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c110180 0x7f0a8c1a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.718+0000 7f0a92940640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c115c70 con 0x7f0a8c1025d0 2024-09-21T03:43:14.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.718+0000 7f0a8bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a8c1025d0 0x7f0a8c19c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.718+0000 7f0a92940640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c115af0 con 0x7f0a8c110180 2024-09-21T03:43:14.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.718+0000 7f0a92940640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c115df0 con 0x7f0a8c102f20 2024-09-21T03:43:14.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.718+0000 7f0a8b7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0a8c102f20 0x7f0a8c19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.718+0000 7f0a8b7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0a8c102f20 0x7f0a8c19cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.84:50832/0 (socket says 172.21.15.84:50832) 2024-09-21T03:43:14.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.718+0000 7f0a8bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a8c1025d0 0x7f0a8c19c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59206/0 (socket says 172.21.15.84:59206) 2024-09-21T03:43:14.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.718+0000 7f0a8b7fe640 1 -- 172.21.15.84:0/1704053693 learned_addr learned my addr 172.21.15.84:0/1704053693 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:14.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.718+0000 7f0a90edd640 1 --2- 172.21.15.84:0/1704053693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c110180 0x7f0a8c1a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.718+0000 7f0a8bfff640 1 -- 172.21.15.84:0/1704053693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0a8c102f20 msgr2=0x7f0a8c19cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:14.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.718+0000 7f0a8bfff640 1 --2- 172.21.15.84:0/1704053693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0a8c102f20 0x7f0a8c19cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.718+0000 7f0a8bfff640 1 -- 172.21.15.84:0/1704053693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c110180 msgr2=0x7f0a8c1a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:14.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.718+0000 7f0a8bfff640 1 --2- 172.21.15.84:0/1704053693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c110180 0x7f0a8c1a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.719+0000 7f0a8bfff640 1 -- 172.21.15.84:0/1704053693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8c1a2550 con 0x7f0a8c1025d0 2024-09-21T03:43:14.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.719+0000 7f0a8bfff640 1 --2- 172.21.15.84:0/1704053693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a8c1025d0 0x7f0a8c19c5e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00e9f0 tx=0x7f0a7c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:14.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.719+0000 7f0a897fa640 1 -- 172.21.15.84:0/1704053693 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c00ccc0 con 0x7f0a8c1025d0 2024-09-21T03:43:14.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.719+0000 7f0a897fa640 1 -- 172.21.15.84:0/1704053693 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a7c0108e0 con 0x7f0a8c1025d0 2024-09-21T03:43:14.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.719+0000 7f0a92940640 1 -- 172.21.15.84:0/1704053693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a8c1a2840 con 0x7f0a8c1025d0 2024-09-21T03:43:14.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.719+0000 7f0a897fa640 1 -- 172.21.15.84:0/1704053693 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c018880 con 0x7f0a8c1025d0 2024-09-21T03:43:14.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.719+0000 7f0a92940640 1 -- 172.21.15.84:0/1704053693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a8c1a8fa0 con 0x7f0a8c1025d0 2024-09-21T03:43:14.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.723+0000 7f0a98eb4740 1 Processor -- start 2024-09-21T03:43:14.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.723+0000 7f0a98eb4740 1 -- start start 2024-09-21T03:43:14.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.723+0000 7f0a98eb4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564053295070 0x56405363c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.723+0000 7f0a98eb4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56405326c1b0 0x56405363cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.723+0000 7f0a98eb4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564053274390 0x56405363d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.723+0000 7f0a98eb4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5640535b2e50 con 0x564053274390 2024-09-21T03:43:14.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.723+0000 7f0a98eb4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5640535a2280 con 0x564053295070 2024-09-21T03:43:14.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.723+0000 7f0a98eb4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5640535a6090 con 0x56405326c1b0 2024-09-21T03:43:14.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.723+0000 7f0a897fa640 1 -- 172.21.15.84:0/1704053693 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7f0a7c010430 con 0x7f0a8c1025d0 2024-09-21T03:43:14.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.724+0000 7f0a90edd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564053295070 0x56405363c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.724+0000 7f0a90edd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564053295070 0x56405363c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:54098/0 (socket says 172.21.15.84:54098) 2024-09-21T03:43:14.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.724+0000 7f0a90edd640 1 -- 172.21.15.84:0/2877948459 learned_addr learned my addr 172.21.15.84:0/2877948459 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:14.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.724+0000 7f0a8b7fe640 1 --2- 172.21.15.84:0/2877948459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564053274390 0x56405363d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.724+0000 7f0a90edd640 1 -- 172.21.15.84:0/2877948459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56405326c1b0 msgr2=0x56405363cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:14.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.724+0000 7f0a897fa640 1 --2- 172.21.15.84:0/1704053693 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0a740b68e0 0x7f0a740b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.725+0000 7f0a8bfff640 1 --2- 172.21.15.84:0/2877948459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56405326c1b0 0x56405363cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.725+0000 7f0a90edd640 1 --2- 172.21.15.84:0/2877948459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56405326c1b0 0x56405363cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.725+0000 7f0a90edd640 1 -- 172.21.15.84:0/2877948459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564053274390 msgr2=0x56405363d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:14.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.725+0000 7f0a90edd640 1 --2- 172.21.15.84:0/2877948459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564053274390 0x56405363d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.725+0000 7f0a90edd640 1 -- 172.21.15.84:0/2877948459 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564053300650 con 0x564053295070 2024-09-21T03:43:14.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.725+0000 7f0a8b7fe640 1 --2- 172.21.15.84:0/2877948459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564053274390 0x56405363d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:14.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.725+0000 7f0a897fa640 1 -- 172.21.15.84:0/1704053693 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f0a7c0e7b70 con 0x7f0a8c1025d0 2024-09-21T03:43:14.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.725+0000 7f0a90edd640 1 --2- 172.21.15.84:0/1704053693 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0a740b68e0 0x7f0a740b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.725+0000 7f0a90edd640 1 --2- 172.21.15.84:0/2877948459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564053295070 0x56405363c650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009440 tx=0x7f0a84009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae6c9333fab8e923 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:14.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.726+0000 7f0a90edd640 1 --2- 172.21.15.84:0/1704053693 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0a740b68e0 0x7f0a740b8df0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0a84005e30 tx=0x7f0a8404c000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:14.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.726+0000 7f0a727fc640 1 -- 172.21.15.84:0/2877948459 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a84034040 con 0x564053295070 2024-09-21T03:43:14.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.726+0000 7f0a727fc640 1 -- 172.21.15.84:0/2877948459 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a84003c30 con 0x564053295070 2024-09-21T03:43:14.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.726+0000 7f0a727fc640 1 -- 172.21.15.84:0/2877948459 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a84030730 con 0x564053295070 2024-09-21T03:43:14.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.726+0000 7f0a98eb4740 1 -- 172.21.15.84:0/2877948459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564053295070 msgr2=0x56405363c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:14.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.726+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/2877948459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564053295070 0x56405363c650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009440 tx=0x7f0a84009a20 comp rx=0 tx=0).stop 2024-09-21T03:43:14.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.727+0000 7f0a98eb4740 1 -- 172.21.15.84:0/2877948459 shutdown_connections 2024-09-21T03:43:14.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.727+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/2877948459 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564053274390 0x56405363d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.735 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.727+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/2877948459 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56405326c1b0 0x56405363cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.727+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/2877948459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564053295070 0x56405363c650 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.727+0000 7f0a98eb4740 1 -- 172.21.15.84:0/2877948459 >> 172.21.15.84:0/2877948459 conn(0x564053289460 msgr2=0x56405363a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:14.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.727+0000 7f0a98eb4740 1 -- 172.21.15.84:0/2877948459 shutdown_connections 2024-09-21T03:43:14.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.727+0000 7f0a98eb4740 1 -- 172.21.15.84:0/2877948459 wait complete. 2024-09-21T03:43:14.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.727+0000 7f0a98eb4740 1 -- start start 2024-09-21T03:43:14.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.727+0000 7f0a98eb4740 1 Processor -- start 2024-09-21T03:43:14.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.728+0000 7f0a98eb4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56405326c1b0 0x564053647d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.728+0000 7f0a98eb4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564053274390 0x564053648280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.728+0000 7f0a98eb4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564053295070 0x564053654120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.728+0000 7f0a98eb4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564053403700 con 0x564053295070 2024-09-21T03:43:14.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.728+0000 7f0a98eb4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56405353d110 con 0x56405326c1b0 2024-09-21T03:43:14.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.728+0000 7f0a98eb4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56405364ae30 con 0x564053274390 2024-09-21T03:43:14.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.728+0000 7f0a90edd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564053295070 0x564053654120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.736 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.728+0000 7f0a90edd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564053295070 0x564053654120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59220/0 (socket says 172.21.15.84:59220) 2024-09-21T03:43:14.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.728+0000 7f0a90edd640 1 -- 172.21.15.84:0/1146131825 learned_addr learned my addr 172.21.15.84:0/1146131825 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:14.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.728+0000 7f0a8b7fe640 1 --2- 172.21.15.84:0/1146131825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564053274390 0x564053648280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.728+0000 7f0a98eb4740 10 client.0 _ll_register_callbacks cb 0x564053556990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:14.738 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.728+0000 7f0a90edd640 1 -- 172.21.15.84:0/1146131825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564053274390 msgr2=0x564053648280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:14.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.728+0000 7f0a90edd640 1 --2- 172.21.15.84:0/1146131825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564053274390 0x564053648280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.728+0000 7f0a90edd640 1 -- 172.21.15.84:0/1146131825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56405326c1b0 msgr2=0x564053647d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:14.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.728+0000 7f0a90edd640 1 --2- 172.21.15.84:0/1146131825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56405326c1b0 0x564053647d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.728+0000 7f0a90edd640 1 -- 172.21.15.84:0/1146131825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56405356ac40 con 0x564053295070 2024-09-21T03:43:14.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.729+0000 7f0a90edd640 1 --2- 172.21.15.84:0/1146131825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564053295070 0x564053654120 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0a8402f810 tx=0x7f0a84005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98681852d28be8de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:14.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.729+0000 7f0a6b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:43:14.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.729+0000 7f0a6b7fe640 1 -- 172.21.15.84:0/1146131825 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a84070060 con 0x564053295070 2024-09-21T03:43:14.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.729+0000 7f0a98eb4740 1 -- 172.21.15.84:0/1146131825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a84003c30 con 0x564053295070 2024-09-21T03:43:14.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.729+0000 7f0a6b7fe640 1 -- 172.21.15.84:0/1146131825 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f0a84003de0 con 0x564053295070 2024-09-21T03:43:14.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.729+0000 7f0a6b7fe640 1 -- 172.21.15.84:0/1146131825 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0a84034040 con 0x564053295070 2024-09-21T03:43:14.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.729+0000 7f0a98eb4740 10 client.15633 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:14.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.729+0000 7f0a98eb4740 1 -- 172.21.15.84:0/1146131825 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564053655070 con 0x564053295070 2024-09-21T03:43:14.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.729+0000 7f0a6b7fe640 1 -- 172.21.15.84:0/1146131825 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a84003c30 con 0x564053295070 2024-09-21T03:43:14.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.730+0000 7f0a6b7fe640 1 -- 172.21.15.84:0/1146131825 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0a84052500 con 0x564053295070 2024-09-21T03:43:14.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.730+0000 7f0a98eb4740 10 client.15633 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:14.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.730+0000 7f0a98eb4740 10 client.15633 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:43:14.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.730+0000 7f0a98eb4740 20 client.15633 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:14.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.730+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/1146131825 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5640532539f0 0x564053658430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.730+0000 7f0a98eb4740 4 client.15633 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:14.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.730+0000 7f0a98eb4740 1 -- 172.21.15.84:0/1146131825 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640535b4da0 con 0x5640532539f0 2024-09-21T03:43:14.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.730+0000 7f0a8bfff640 1 --2- 172.21.15.84:0/1146131825 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5640532539f0 0x564053658430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.730+0000 7f0a6b7fe640 10 client.15633 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:14.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.730+0000 7f0a8bfff640 1 --2- 172.21.15.84:0/1146131825 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5640532539f0 0x564053658430 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72e99bcc42426cbb server_cookie=6da29536e35bff9a in_seq=0 out_seq=0 2024-09-21T03:43:14.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.731+0000 7f0a6b7fe640 1 -- 172.21.15.84:0/1146131825 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5640535b4da0 con 0x5640532539f0 2024-09-21T03:43:14.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.731+0000 7f0a6b7fe640 10 client.15633 handle_command_reply: tid=0 2024-09-21T03:43:14.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.731+0000 7f0a98eb4740 1 client.15633 shutdown 2024-09-21T03:43:14.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.731+0000 7f0a98eb4740 1 -- 172.21.15.84:0/1146131825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564053295070 msgr2=0x564053654120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:14.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.731+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/1146131825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564053295070 0x564053654120 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f0a8402f810 tx=0x7f0a84005c30 comp rx=0 tx=0).stop 2024-09-21T03:43:14.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.731+0000 7f0a98eb4740 1 -- 172.21.15.84:0/1146131825 shutdown_connections 2024-09-21T03:43:14.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.732+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/1146131825 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5640532539f0 0x564053658430 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.732+0000 7f0a6b7fe640 0 client.15633 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:14.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.732+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/1146131825 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564053295070 0x564053654120 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.732+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/1146131825 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564053274390 0x564053648280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.732+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/1146131825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56405326c1b0 0x564053647d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.732+0000 7f0a98eb4740 1 -- 172.21.15.84:0/1146131825 >> 172.21.15.84:0/1146131825 conn(0x564053289460 msgr2=0x56405363f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:14.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.732+0000 7f0a98eb4740 1 -- 172.21.15.84:0/1146131825 shutdown_connections 2024-09-21T03:43:14.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.732+0000 7f0a98eb4740 1 -- 172.21.15.84:0/1146131825 wait complete. 2024-09-21T03:43:14.741 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.732+0000 7f0a98eb4740 20 client.15633 trim_cache size 0 max 16384 2024-09-21T03:43:14.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.766+0000 7f0a98eb4740 1 Processor -- start 2024-09-21T03:43:14.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.766+0000 7f0a98eb4740 1 -- start start 2024-09-21T03:43:14.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.766+0000 7f0a98eb4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640532539f0 0x56405363e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.766+0000 7f0a98eb4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56405326c1b0 0x564053649260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.766+0000 7f0a98eb4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564053274390 0x56405365cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.766+0000 7f0a98eb4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c1afac0 con 0x564053274390 2024-09-21T03:43:14.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.766+0000 7f0a98eb4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c1ad390 con 0x56405326c1b0 2024-09-21T03:43:14.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.766+0000 7f0a98eb4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c1ab220 con 0x5640532539f0 2024-09-21T03:43:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.766+0000 7f0a90edd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564053274390 0x56405365cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.766+0000 7f0a90edd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564053274390 0x56405365cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59230/0 (socket says 172.21.15.84:59230) 2024-09-21T03:43:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.766+0000 7f0a90edd640 1 -- 172.21.15.84:0/802030403 learned_addr learned my addr 172.21.15.84:0/802030403 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.766+0000 7f0a8b7fe640 1 --2- 172.21.15.84:0/802030403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56405326c1b0 0x564053649260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.767+0000 7f0a8bfff640 1 --2- 172.21.15.84:0/802030403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640532539f0 0x56405363e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.767+0000 7f0a8b7fe640 1 -- 172.21.15.84:0/802030403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640532539f0 msgr2=0x56405363e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:14.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.767+0000 7f0a8b7fe640 1 --2- 172.21.15.84:0/802030403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640532539f0 0x56405363e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.767+0000 7f0a8b7fe640 1 -- 172.21.15.84:0/802030403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564053274390 msgr2=0x56405365cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:14.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.767+0000 7f0a8b7fe640 1 --2- 172.21.15.84:0/802030403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564053274390 0x56405365cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.767+0000 7f0a8b7fe640 1 -- 172.21.15.84:0/802030403 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56405363eda0 con 0x56405326c1b0 2024-09-21T03:43:14.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.767+0000 7f0a90edd640 1 --2- 172.21.15.84:0/802030403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564053274390 0x56405365cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:43:14.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.767+0000 7f0a8b7fe640 1 --2- 172.21.15.84:0/802030403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56405326c1b0 0x564053649260 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009e60 tx=0x7f0a80013830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7449553723f9d67 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:14.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.767+0000 7f0a71ffb640 1 -- 172.21.15.84:0/802030403 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a80005020 con 0x56405326c1b0 2024-09-21T03:43:14.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.767+0000 7f0a71ffb640 1 -- 172.21.15.84:0/802030403 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a80005670 con 0x56405326c1b0 2024-09-21T03:43:14.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.767+0000 7f0a71ffb640 1 -- 172.21.15.84:0/802030403 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a800107b0 con 0x56405326c1b0 2024-09-21T03:43:14.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.769+0000 7f0a98eb4740 1 -- 172.21.15.84:0/802030403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56405326c1b0 msgr2=0x564053649260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:14.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.769+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/802030403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56405326c1b0 0x564053649260 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009e60 tx=0x7f0a80013830 comp rx=0 tx=0).stop 2024-09-21T03:43:14.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.769+0000 7f0a98eb4740 1 -- 172.21.15.84:0/802030403 shutdown_connections 2024-09-21T03:43:14.771 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.769+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/802030403 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564053274390 0x56405365cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.769+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/802030403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56405326c1b0 0x564053649260 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.769+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/802030403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5640532539f0 0x56405363e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.769+0000 7f0a98eb4740 1 -- 172.21.15.84:0/802030403 >> 172.21.15.84:0/802030403 conn(0x564053289460 msgr2=0x56405365c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:14.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.769+0000 7f0a98eb4740 1 -- 172.21.15.84:0/802030403 shutdown_connections 2024-09-21T03:43:14.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.769+0000 7f0a98eb4740 1 -- 172.21.15.84:0/802030403 wait complete. 2024-09-21T03:43:14.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.769+0000 7f0a98eb4740 1 -- start start 2024-09-21T03:43:14.772 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.770+0000 7f0a98eb4740 1 Processor -- start 2024-09-21T03:43:14.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.770+0000 7f0a98eb4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640532539f0 0x5640536616a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.770+0000 7f0a8bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640532539f0 0x5640536616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.770+0000 7f0a8bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640532539f0 0x5640536616a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59234/0 (socket says 172.21.15.84:59234) 2024-09-21T03:43:14.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.770+0000 7f0a98eb4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56405326c1b0 0x564053661c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.770+0000 7f0a8bfff640 1 -- 172.21.15.84:0/1101603549 learned_addr learned my addr 172.21.15.84:0/1101603549 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:14.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.770+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/1101603549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564053274390 0x5640536c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.770+0000 7f0a98eb4740 1 -- 172.21.15.84:0/1101603549 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c1ab870 con 0x5640532539f0 2024-09-21T03:43:14.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.770+0000 7f0a98eb4740 1 -- 172.21.15.84:0/1101603549 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c1accc0 con 0x56405326c1b0 2024-09-21T03:43:14.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.770+0000 7f0a98eb4740 1 -- 172.21.15.84:0/1101603549 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c1abf20 con 0x564053274390 2024-09-21T03:43:14.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.771+0000 7f0a8b7fe640 1 --2- 172.21.15.84:0/1101603549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56405326c1b0 0x564053661c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.771+0000 7f0a90edd640 1 --2- 172.21.15.84:0/1101603549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564053274390 0x5640536c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.771+0000 7f0a8b7fe640 1 -- 172.21.15.84:0/1101603549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564053274390 msgr2=0x5640536c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:14.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.771+0000 7f0a8b7fe640 1 --2- 172.21.15.84:0/1101603549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564053274390 0x5640536c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.771+0000 7f0a8b7fe640 1 -- 172.21.15.84:0/1101603549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640532539f0 msgr2=0x5640536616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:14.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.771+0000 7f0a8b7fe640 1 --2- 172.21.15.84:0/1101603549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640532539f0 0x5640536616a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.771+0000 7f0a8b7fe640 1 -- 172.21.15.84:0/1101603549 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640536c3a00 con 0x56405326c1b0 2024-09-21T03:43:14.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.771+0000 7f0a98eb4740 10 client.0 _ll_register_callbacks cb 0x7f0a80005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:14.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.771+0000 7f0a98eb4740 1 -- 172.21.15.84:0/1101603549 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a80005670 con 0x56405326c1b0 2024-09-21T03:43:14.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.771+0000 7f0a8b7fe640 1 --2- 172.21.15.84:0/1101603549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56405326c1b0 0x564053661c40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0a80004fd0 tx=0x7f0a80004970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b6e25202ad875d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:14.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.771+0000 7f0a6b7fe640 10 client.25205 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T03:43:14.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.771+0000 7f0a6b7fe640 1 -- 172.21.15.84:0/1101603549 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a8002a020 con 0x56405326c1b0 2024-09-21T03:43:14.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.772+0000 7f0a6b7fe640 1 -- 172.21.15.84:0/1101603549 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f0a80025440 con 0x56405326c1b0 2024-09-21T03:43:14.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.772+0000 7f0a6b7fe640 1 -- 172.21.15.84:0/1101603549 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0a800256a0 con 0x56405326c1b0 2024-09-21T03:43:14.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.772+0000 7f0a98eb4740 10 client.25205 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:14.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.772+0000 7f0a98eb4740 1 -- 172.21.15.84:0/1101603549 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5640536c49a0 con 0x56405326c1b0 2024-09-21T03:43:14.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.772+0000 7f0a6b7fe640 1 -- 172.21.15.84:0/1101603549 <== mon.2 v2:172.21.15.172:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0a80025840 con 0x56405326c1b0 2024-09-21T03:43:14.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.772+0000 7f0a98eb4740 10 client.25205 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:14.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.772+0000 7f0a98eb4740 10 client.25205 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:43:14.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.772+0000 7f0a98eb4740 20 client.25205 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:14.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.772+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/1101603549 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564053295070 0x5640536c7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.772+0000 7f0a98eb4740 4 client.25205 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:43:14.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.772+0000 7f0a98eb4740 1 -- 172.21.15.84:0/1101603549 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5640535b0850 con 0x564053295070 2024-09-21T03:43:14.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.773+0000 7f0a8bfff640 1 --2- 172.21.15.84:0/1101603549 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564053295070 0x5640536c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.773+0000 7f0a6b7fe640 10 client.25205 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:14.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.773+0000 7f0a8bfff640 1 --2- 172.21.15.84:0/1101603549 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564053295070 0x5640536c7020 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f44b0ec10642d382 server_cookie=fa04e21f45234e33 in_seq=0 out_seq=0 2024-09-21T03:43:14.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.773+0000 7f0a6b7fe640 1 -- 172.21.15.84:0/1101603549 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x5640535b0850 con 0x564053295070 2024-09-21T03:43:14.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.773+0000 7f0a6b7fe640 10 client.25205 handle_command_reply: tid=0 2024-09-21T03:43:14.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.773+0000 7f0a98eb4740 1 client.25205 shutdown 2024-09-21T03:43:14.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.774+0000 7f0a98eb4740 1 -- 172.21.15.84:0/1101603549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56405326c1b0 msgr2=0x564053661c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:14.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.774+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/1101603549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56405326c1b0 0x564053661c40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0a80004fd0 tx=0x7f0a80004970 comp rx=0 tx=0).stop 2024-09-21T03:43:14.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.774+0000 7f0a98eb4740 1 -- 172.21.15.84:0/1101603549 shutdown_connections 2024-09-21T03:43:14.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.774+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/1101603549 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564053295070 0x5640536c7020 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.774+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/1101603549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564053274390 0x5640536c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.774+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/1101603549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56405326c1b0 0x564053661c40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.774+0000 7f0a6b7fe640 0 client.25205 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:14.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.774+0000 7f0a98eb4740 1 --2- 172.21.15.84:0/1101603549 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5640532539f0 0x5640536616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.774+0000 7f0a98eb4740 1 -- 172.21.15.84:0/1101603549 >> 172.21.15.84:0/1101603549 conn(0x564053289460 msgr2=0x56405363de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:14.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.774+0000 7f0a98eb4740 1 -- 172.21.15.84:0/1101603549 shutdown_connections 2024-09-21T03:43:14.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.774+0000 7f0a98eb4740 1 -- 172.21.15.84:0/1101603549 wait complete. 2024-09-21T03:43:14.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.774+0000 7f0a98eb4740 20 client.25205 trim_cache size 0 max 16384 2024-09-21T03:43:14.778 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:43:14.778 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T03:43:14.778 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T03:43:14.778 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:43:14.779 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:43:14.780 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:43:14.780 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:43:14.780 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:43:14.780 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:43:14.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.775+0000 7f0a92940640 1 -- 172.21.15.84:0/1704053693 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0a740b68e0 msgr2=0x7f0a740b8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:14.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.775+0000 7f0a92940640 1 --2- 172.21.15.84:0/1704053693 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0a740b68e0 0x7f0a740b8df0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0a84005e30 tx=0x7f0a8404c000 comp rx=0 tx=0).stop 2024-09-21T03:43:14.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.775+0000 7f0a92940640 1 -- 172.21.15.84:0/1704053693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a8c1025d0 msgr2=0x7f0a8c19c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:14.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.775+0000 7f0a92940640 1 --2- 172.21.15.84:0/1704053693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a8c1025d0 0x7f0a8c19c5e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c00e9f0 tx=0x7f0a7c00eeb0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.775+0000 7f0a92940640 1 -- 172.21.15.84:0/1704053693 shutdown_connections 2024-09-21T03:43:14.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.775+0000 7f0a92940640 1 --2- 172.21.15.84:0/1704053693 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0a740b68e0 0x7f0a740b8df0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.775+0000 7f0a92940640 1 --2- 172.21.15.84:0/1704053693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c110180 0x7f0a8c1a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.775+0000 7f0a92940640 1 --2- 172.21.15.84:0/1704053693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0a8c102f20 0x7f0a8c19cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.775+0000 7f0a92940640 1 --2- 172.21.15.84:0/1704053693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0a8c1025d0 0x7f0a8c19c5e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.775+0000 7f0a92940640 1 -- 172.21.15.84:0/1704053693 >> 172.21.15.84:0/1704053693 conn(0x7f0a8c079730 msgr2=0x7f0a8c109d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:14.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.775+0000 7f0a92940640 1 -- 172.21.15.84:0/1704053693 shutdown_connections 2024-09-21T03:43:14.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:14.775+0000 7f0a92940640 1 -- 172.21.15.84:0/1704053693 wait complete. 2024-09-21T03:43:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:14 smithi174 ceph-mon[34403]: scrub queued for path: / 2024-09-21T03:43:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:14 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:14 smithi174 ceph-mon[34403]: scrub summary: active paths [/] 2024-09-21T03:43:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:14 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:15.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:15 smithi084 ceph-mon[30941]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 20 op/s 2024-09-21T03:43:15.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:15 smithi084 ceph-mon[30941]: scrub summary: idle 2024-09-21T03:43:15.625 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:43:15.626 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:43:15.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:15 smithi172 ceph-mon[34821]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 20 op/s 2024-09-21T03:43:15.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:15 smithi172 ceph-mon[34821]: scrub summary: idle 2024-09-21T03:43:15.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:15 smithi174 ceph-mon[34403]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 20 op/s 2024-09-21T03:43:15.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:15 smithi174 ceph-mon[34403]: scrub summary: idle 2024-09-21T03:43:16.018 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:16.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.634+0000 7f43beb42640 1 -- 172.21.15.84:0/749707752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43b8101f70 msgr2=0x7f43b8102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:16.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.634+0000 7f43beb42640 1 --2- 172.21.15.84:0/749707752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43b8101f70 0x7f43b8102380 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f43ac009900 tx=0x7f43ac02a410 comp rx=0 tx=0).stop 2024-09-21T03:43:16.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.634+0000 7f43beb42640 1 -- 172.21.15.84:0/749707752 shutdown_connections 2024-09-21T03:43:16.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.634+0000 7f43beb42640 1 --2- 172.21.15.84:0/749707752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43b8109e00 0x7f43b8110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:16.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.634+0000 7f43beb42640 1 --2- 172.21.15.84:0/749707752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b81094b0 0x7f43b81098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:16.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.634+0000 7f43beb42640 1 --2- 172.21.15.84:0/749707752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43b8101f70 0x7f43b8102380 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:16.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.634+0000 7f43beb42640 1 -- 172.21.15.84:0/749707752 >> 172.21.15.84:0/749707752 conn(0x7f43b8077c60 msgr2=0x7f43b80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:16.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.634+0000 7f43beb42640 1 -- 172.21.15.84:0/749707752 shutdown_connections 2024-09-21T03:43:16.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.634+0000 7f43beb42640 1 -- 172.21.15.84:0/749707752 wait complete. 2024-09-21T03:43:16.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.635+0000 7f43beb42640 1 Processor -- start 2024-09-21T03:43:16.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.635+0000 7f43beb42640 1 -- start start 2024-09-21T03:43:16.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.636+0000 7f43beb42640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43b8101f70 0x7f43b8074bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:16.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.636+0000 7f43bc8de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43b8101f70 0x7f43b8074bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:16.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.636+0000 7f43bc8de640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43b8101f70 0x7f43b8074bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:59240/0 (socket says 172.21.15.84:59240) 2024-09-21T03:43:16.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.636+0000 7f43beb42640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b81094b0 0x7f43b806dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:16.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.636+0000 7f43bc8de640 1 -- 172.21.15.84:0/4130898604 learned_addr learned my addr 172.21.15.84:0/4130898604 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:16.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.636+0000 7f43beb42640 1 --2- 172.21.15.84:0/4130898604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43b8109e00 0x7f43b806e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:16.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.636+0000 7f43b7fff640 1 --2- 172.21.15.84:0/4130898604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b81094b0 0x7f43b806dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:16.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.636+0000 7f43beb42640 1 -- 172.21.15.84:0/4130898604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f43b8113b10 con 0x7f43b8101f70 2024-09-21T03:43:16.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.637+0000 7f43beb42640 1 -- 172.21.15.84:0/4130898604 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f43b8113990 con 0x7f43b81094b0 2024-09-21T03:43:16.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.637+0000 7f43bd0df640 1 --2- 172.21.15.84:0/4130898604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43b8109e00 0x7f43b806e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:16.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.637+0000 7f43beb42640 1 -- 172.21.15.84:0/4130898604 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f43b8113c90 con 0x7f43b8109e00 2024-09-21T03:43:16.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.637+0000 7f43bc8de640 1 -- 172.21.15.84:0/4130898604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43b8109e00 msgr2=0x7f43b806e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:16.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.637+0000 7f43bc8de640 1 --2- 172.21.15.84:0/4130898604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43b8109e00 0x7f43b806e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:16.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.637+0000 7f43bc8de640 1 -- 172.21.15.84:0/4130898604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b81094b0 msgr2=0x7f43b806dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:16.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.637+0000 7f43bc8de640 1 --2- 172.21.15.84:0/4130898604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b81094b0 0x7f43b806dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:16.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.637+0000 7f43bc8de640 1 -- 172.21.15.84:0/4130898604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b806e9d0 con 0x7f43b8101f70 2024-09-21T03:43:16.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.638+0000 7f43bc8de640 1 --2- 172.21.15.84:0/4130898604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43b8101f70 0x7f43b8074bd0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f43ac009850 tx=0x7f43ac005e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:16.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.638+0000 7f43b5ffb640 1 -- 172.21.15.84:0/4130898604 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac035030 con 0x7f43b8101f70 2024-09-21T03:43:16.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.638+0000 7f43b5ffb640 1 -- 172.21.15.84:0/4130898604 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43ac041070 con 0x7f43b8101f70 2024-09-21T03:43:16.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.638+0000 7f43b5ffb640 1 -- 172.21.15.84:0/4130898604 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac030d80 con 0x7f43b8101f70 2024-09-21T03:43:16.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.638+0000 7f43beb42640 1 -- 172.21.15.84:0/4130898604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b806ec60 con 0x7f43b8101f70 2024-09-21T03:43:16.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.639+0000 7f43beb42640 1 -- 172.21.15.84:0/4130898604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b8073a10 con 0x7f43b8101f70 2024-09-21T03:43:16.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.640+0000 7f43beb42640 1 -- 172.21.15.84:0/4130898604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b806ac50 con 0x7f43b8101f70 2024-09-21T03:43:16.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.642+0000 7f43b5ffb640 1 -- 172.21.15.84:0/4130898604 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7f43ac0035f0 con 0x7f43b8101f70 2024-09-21T03:43:16.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.643+0000 7f43b5ffb640 1 --2- 172.21.15.84:0/4130898604 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f43a80b6860 0x7f43a80b8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:16.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.644+0000 7f43b5ffb640 1 -- 172.21.15.84:0/4130898604 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f43ac10c230 con 0x7f43b8101f70 2024-09-21T03:43:16.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.644+0000 7f43b7fff640 1 --2- 172.21.15.84:0/4130898604 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f43a80b6860 0x7f43a80b8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:16.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.645+0000 7f43b7fff640 1 --2- 172.21.15.84:0/4130898604 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f43a80b6860 0x7f43a80b8d70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f43b8106470 tx=0x7f43a4005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:16.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.652+0000 7f43b5ffb640 1 -- 172.21.15.84:0/4130898604 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f43ac004460 con 0x7f43b8101f70 2024-09-21T03:43:16.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.908+0000 7f43beb42640 1 -- 172.21.15.84:0/4130898604 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43b8074000 con 0x7f43b8101f70 2024-09-21T03:43:16.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.909+0000 7f43b5ffb640 1 -- 172.21.15.84:0/4130898604 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7f43ac0d2630 con 0x7f43b8101f70 2024-09-21T03:43:16.912 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:43:16.912 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:43:16.912 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:43:16.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.913+0000 7f43beb42640 1 -- 172.21.15.84:0/4130898604 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f43a80b6860 msgr2=0x7f43a80b8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:16.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.913+0000 7f43beb42640 1 --2- 172.21.15.84:0/4130898604 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f43a80b6860 0x7f43a80b8d70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f43b8106470 tx=0x7f43a4005f90 comp rx=0 tx=0).stop 2024-09-21T03:43:16.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.913+0000 7f43beb42640 1 -- 172.21.15.84:0/4130898604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43b8101f70 msgr2=0x7f43b8074bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:16.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.913+0000 7f43beb42640 1 --2- 172.21.15.84:0/4130898604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43b8101f70 0x7f43b8074bd0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f43ac009850 tx=0x7f43ac005e10 comp rx=0 tx=0).stop 2024-09-21T03:43:16.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.913+0000 7f43beb42640 1 -- 172.21.15.84:0/4130898604 shutdown_connections 2024-09-21T03:43:16.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.913+0000 7f43beb42640 1 --2- 172.21.15.84:0/4130898604 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f43a80b6860 0x7f43a80b8d70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:16.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.913+0000 7f43beb42640 1 --2- 172.21.15.84:0/4130898604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f43b8109e00 0x7f43b806e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:16.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.913+0000 7f43beb42640 1 --2- 172.21.15.84:0/4130898604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43b81094b0 0x7f43b806dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:16.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.913+0000 7f43beb42640 1 --2- 172.21.15.84:0/4130898604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f43b8101f70 0x7f43b8074bd0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:16.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.913+0000 7f43beb42640 1 -- 172.21.15.84:0/4130898604 >> 172.21.15.84:0/4130898604 conn(0x7f43b8077c60 msgr2=0x7f43b81082e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:16.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.914+0000 7f43beb42640 1 -- 172.21.15.84:0/4130898604 shutdown_connections 2024-09-21T03:43:16.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:16.914+0000 7f43beb42640 1 -- 172.21.15.84:0/4130898604 wait complete. 2024-09-21T03:43:17.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:17 smithi084 ceph-mon[30941]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:43:17.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:17 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/4130898604' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:43:17.624 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:43:17.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:17 smithi172 ceph-mon[34821]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:43:17.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:17 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/4130898604' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:43:17.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:17 smithi174 ceph-mon[34403]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T03:43:17.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:17 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/4130898604' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:43:18.002 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:18.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.620+0000 7f4c821ca640 1 -- 172.21.15.84:0/2910818047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c7c106c00 msgr2=0x7f4c7c110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:18.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.620+0000 7f4c821ca640 1 --2- 172.21.15.84:0/2910818047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c7c106c00 0x7f4c7c110670 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009ca0 tx=0x7f4c7402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.620+0000 7f4c821ca640 1 -- 172.21.15.84:0/2910818047 shutdown_connections 2024-09-21T03:43:18.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.620+0000 7f4c821ca640 1 --2- 172.21.15.84:0/2910818047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c7c106c00 0x7f4c7c110670 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.620+0000 7f4c821ca640 1 --2- 172.21.15.84:0/2910818047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c7c1062b0 0x7f4c7c1066c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.620+0000 7f4c821ca640 1 --2- 172.21.15.84:0/2910818047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c101fd0 0x7f4c7c1023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.620+0000 7f4c821ca640 1 -- 172.21.15.84:0/2910818047 >> 172.21.15.84:0/2910818047 conn(0x7f4c7c079e10 msgr2=0x7f4c7c07a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:18.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.620+0000 7f4c821ca640 1 -- 172.21.15.84:0/2910818047 shutdown_connections 2024-09-21T03:43:18.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.620+0000 7f4c821ca640 1 -- 172.21.15.84:0/2910818047 wait complete. 2024-09-21T03:43:18.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.621+0000 7f4c821ca640 1 Processor -- start 2024-09-21T03:43:18.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.621+0000 7f4c821ca640 1 -- start start 2024-09-21T03:43:18.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.622+0000 7f4c821ca640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c101fd0 0x7f4c7c19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.622+0000 7f4c821ca640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c7c1062b0 0x7f4c7c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.622+0000 7f4c821ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c7c106c00 0x7f4c7c1a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.622+0000 7f4c821ca640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c113b00 con 0x7f4c7c106c00 2024-09-21T03:43:18.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.622+0000 7f4c821ca640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c113980 con 0x7f4c7c101fd0 2024-09-21T03:43:18.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.622+0000 7f4c821ca640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c113c80 con 0x7f4c7c1062b0 2024-09-21T03:43:18.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.622+0000 7f4c7bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c7c106c00 0x7f4c7c1a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.622+0000 7f4c7bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c7c106c00 0x7f4c7c1a1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54956/0 (socket says 172.21.15.84:54956) 2024-09-21T03:43:18.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.622+0000 7f4c7bfff640 1 -- 172.21.15.84:0/1957160833 learned_addr learned my addr 172.21.15.84:0/1957160833 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:18.625 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.622+0000 7f4c7affd640 1 --2- 172.21.15.84:0/1957160833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c7c1062b0 0x7f4c7c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.622+0000 7f4c7b7fe640 1 --2- 172.21.15.84:0/1957160833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c101fd0 0x7f4c7c19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.622+0000 7f4c7affd640 1 -- 172.21.15.84:0/1957160833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c101fd0 msgr2=0x7f4c7c19c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:18.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.623+0000 7f4c7affd640 1 --2- 172.21.15.84:0/1957160833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c101fd0 0x7f4c7c19c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.623+0000 7f4c7affd640 1 -- 172.21.15.84:0/1957160833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c7c106c00 msgr2=0x7f4c7c1a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:18.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.623+0000 7f4c7affd640 1 --2- 172.21.15.84:0/1957160833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c7c106c00 0x7f4c7c1a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.623+0000 7f4c7affd640 1 -- 172.21.15.84:0/1957160833 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7c1a25e0 con 0x7f4c7c1062b0 2024-09-21T03:43:18.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.623+0000 7f4c7bfff640 1 --2- 172.21.15.84:0/1957160833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c7c106c00 0x7f4c7c1a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:43:18.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.623+0000 7f4c7b7fe640 1 --2- 172.21.15.84:0/1957160833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c101fd0 0x7f4c7c19c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:18.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.623+0000 7f4c7affd640 1 --2- 172.21.15.84:0/1957160833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c7c1062b0 0x7f4c7c19cc10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c075ab0 tx=0x7f4c7000db30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:18.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.623+0000 7f4c78ff9640 1 -- 172.21.15.84:0/1957160833 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70017070 con 0x7f4c7c1062b0 2024-09-21T03:43:18.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.623+0000 7f4c78ff9640 1 -- 172.21.15.84:0/1957160833 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c70009820 con 0x7f4c7c1062b0 2024-09-21T03:43:18.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.623+0000 7f4c821ca640 1 -- 172.21.15.84:0/1957160833 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7c1a28d0 con 0x7f4c7c1062b0 2024-09-21T03:43:18.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.623+0000 7f4c78ff9640 1 -- 172.21.15.84:0/1957160833 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70004bc0 con 0x7f4c7c1062b0 2024-09-21T03:43:18.627 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.623+0000 7f4c821ca640 1 -- 172.21.15.84:0/1957160833 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c7c1a9030 con 0x7f4c7c1062b0 2024-09-21T03:43:18.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.627+0000 7f4c8873e740 1 Processor -- start 2024-09-21T03:43:18.629 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.627+0000 7f4c8873e740 1 -- start start 2024-09-21T03:43:18.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.627+0000 7f4c78ff9640 1 -- 172.21.15.84:0/1957160833 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7f4c70005220 con 0x7f4c7c1062b0 2024-09-21T03:43:18.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.628+0000 7f4c8873e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c1185070 0x5599c152c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.628+0000 7f4c8873e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c115c1b0 0x5599c152cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.628+0000 7f4c8873e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1164390 0x5599c152d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.628+0000 7f4c8873e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5599c14a2ea0 con 0x5599c1164390 2024-09-21T03:43:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.628+0000 7f4c8873e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5599c14922d0 con 0x5599c1185070 2024-09-21T03:43:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.628+0000 7f4c8873e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5599c14960e0 con 0x5599c115c1b0 2024-09-21T03:43:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.628+0000 7f4c7affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1164390 0x5599c152d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.628+0000 7f4c7affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1164390 0x5599c152d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54964/0 (socket says 172.21.15.84:54964) 2024-09-21T03:43:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.628+0000 7f4c7bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c1185070 0x5599c152c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.628+0000 7f4c7affd640 1 -- 172.21.15.84:0/3575102916 learned_addr learned my addr 172.21.15.84:0/3575102916 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:18.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.628+0000 7f4c7b7fe640 1 --2- 172.21.15.84:0/3575102916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c115c1b0 0x5599c152cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.629+0000 7f4c78ff9640 1 --2- 172.21.15.84:0/1957160833 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4c640b6810 0x7f4c640b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.629+0000 7f4c7bfff640 1 -- 172.21.15.84:0/3575102916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c115c1b0 msgr2=0x5599c152cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:18.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.629+0000 7f4c7bfff640 1 --2- 172.21.15.84:0/3575102916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c115c1b0 0x5599c152cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.629+0000 7f4c7bfff640 1 -- 172.21.15.84:0/3575102916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1164390 msgr2=0x5599c152d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:18.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.629+0000 7f4c7bfff640 1 --2- 172.21.15.84:0/3575102916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1164390 0x5599c152d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.629+0000 7f4c7bfff640 1 -- 172.21.15.84:0/3575102916 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599c11f0650 con 0x5599c1185070 2024-09-21T03:43:18.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.629+0000 7f4c7b7fe640 1 --2- 172.21.15.84:0/3575102916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c115c1b0 0x5599c152cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:18.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.630+0000 7f4c78ff9640 1 -- 172.21.15.84:0/1957160833 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4c700e6760 con 0x7f4c7c1062b0 2024-09-21T03:43:18.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.630+0000 7f4c7bfff640 1 --2- 172.21.15.84:0/1957160833 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4c640b6810 0x7f4c640b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.630+0000 7f4c7bfff640 1 --2- 172.21.15.84:0/3575102916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c1185070 0x5599c152c6a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4c74005cc0 tx=0x7f4c7402f390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=624bedd044a5db32 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:18.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.630+0000 7f4c7affd640 1 --2- 172.21.15.84:0/3575102916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1164390 0x5599c152d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:43:18.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.630+0000 7f4c61ffb640 1 -- 172.21.15.84:0/3575102916 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7404b070 con 0x5599c1185070 2024-09-21T03:43:18.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.630+0000 7f4c61ffb640 1 -- 172.21.15.84:0/3575102916 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c74036040 con 0x5599c1185070 2024-09-21T03:43:18.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.630+0000 7f4c61ffb640 1 -- 172.21.15.84:0/3575102916 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7402f660 con 0x5599c1185070 2024-09-21T03:43:18.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.631+0000 7f4c7bfff640 1 --2- 172.21.15.84:0/1957160833 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4c640b6810 0x7f4c640b8d20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4c74048000 tx=0x7f4c7402f960 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:18.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.631+0000 7f4c8873e740 1 -- 172.21.15.84:0/3575102916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c1185070 msgr2=0x5599c152c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:18.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.631+0000 7f4c8873e740 1 --2- 172.21.15.84:0/3575102916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c1185070 0x5599c152c6a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4c74005cc0 tx=0x7f4c7402f390 comp rx=0 tx=0).stop 2024-09-21T03:43:18.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.631+0000 7f4c8873e740 1 -- 172.21.15.84:0/3575102916 shutdown_connections 2024-09-21T03:43:18.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.631+0000 7f4c8873e740 1 --2- 172.21.15.84:0/3575102916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1164390 0x5599c152d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.631+0000 7f4c8873e740 1 --2- 172.21.15.84:0/3575102916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c115c1b0 0x5599c152cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.631+0000 7f4c8873e740 1 --2- 172.21.15.84:0/3575102916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c1185070 0x5599c152c6a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.631+0000 7f4c8873e740 1 -- 172.21.15.84:0/3575102916 >> 172.21.15.84:0/3575102916 conn(0x5599c1179460 msgr2=0x5599c152a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.632+0000 7f4c8873e740 1 -- 172.21.15.84:0/3575102916 shutdown_connections 2024-09-21T03:43:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.632+0000 7f4c8873e740 1 -- 172.21.15.84:0/3575102916 wait complete. 2024-09-21T03:43:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.632+0000 7f4c8873e740 1 -- start start 2024-09-21T03:43:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.632+0000 7f4c8873e740 1 Processor -- start 2024-09-21T03:43:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.633+0000 7f4c8873e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c115c1b0 0x5599c1540510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.633+0000 7f4c8873e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1164390 0x5599c1540a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.633+0000 7f4c8873e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c1185070 0x5599c154c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.633+0000 7f4c8873e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5599c12f3700 con 0x5599c1164390 2024-09-21T03:43:18.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.633+0000 7f4c8873e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5599c142d160 con 0x5599c1185070 2024-09-21T03:43:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.633+0000 7f4c8873e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5599c1543430 con 0x5599c115c1b0 2024-09-21T03:43:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.633+0000 7f4c7affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1164390 0x5599c1540a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.633+0000 7f4c7b7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c115c1b0 0x5599c1540510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.633+0000 7f4c7b7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c115c1b0 0x5599c1540510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.84:39034/0 (socket says 172.21.15.84:39034) 2024-09-21T03:43:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.633+0000 7f4c7b7fe640 1 -- 172.21.15.84:0/313765199 learned_addr learned my addr 172.21.15.84:0/313765199 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.633+0000 7f4c8873e740 10 client.0 _ll_register_callbacks cb 0x5599c14469e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.633+0000 7f4c7bfff640 1 --2- 172.21.15.84:0/313765199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c1185070 0x5599c154c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.634+0000 7f4c7b7fe640 1 -- 172.21.15.84:0/313765199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c1185070 msgr2=0x5599c154c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.634+0000 7f4c7b7fe640 1 --2- 172.21.15.84:0/313765199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c1185070 0x5599c154c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.634+0000 7f4c7b7fe640 1 -- 172.21.15.84:0/313765199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1164390 msgr2=0x5599c1540a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.634+0000 7f4c7b7fe640 1 --2- 172.21.15.84:0/313765199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1164390 0x5599c1540a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.634+0000 7f4c7b7fe640 1 -- 172.21.15.84:0/313765199 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599c145ac90 con 0x5599c115c1b0 2024-09-21T03:43:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.634+0000 7f4c7affd640 1 --2- 172.21.15.84:0/313765199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1164390 0x5599c1540a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:18.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.634+0000 7f4c7b7fe640 1 --2- 172.21.15.84:0/313765199 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c115c1b0 0x5599c1540510 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c011690 tx=0x7f4c6c011b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38c29eeeff96fb9b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.634+0000 7f4c5affd640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-21T03:43:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.634+0000 7f4c5affd640 1 -- 172.21.15.84:0/313765199 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c004220 con 0x5599c115c1b0 2024-09-21T03:43:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.634+0000 7f4c5affd640 1 -- 172.21.15.84:0/313765199 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4c6c0043c0 con 0x5599c115c1b0 2024-09-21T03:43:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.634+0000 7f4c8873e740 1 -- 172.21.15.84:0/313765199 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c74036040 con 0x5599c115c1b0 2024-09-21T03:43:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.634+0000 7f4c5affd640 1 -- 172.21.15.84:0/313765199 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4c6c011e90 con 0x5599c115c1b0 2024-09-21T03:43:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.634+0000 7f4c8873e740 10 client.25165 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:18.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.634+0000 7f4c8873e740 1 -- 172.21.15.84:0/313765199 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5599c154f0d0 con 0x5599c115c1b0 2024-09-21T03:43:18.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.635+0000 7f4c5affd640 1 -- 172.21.15.84:0/313765199 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c6c00fdf0 con 0x5599c115c1b0 2024-09-21T03:43:18.641 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.635+0000 7f4c5affd640 1 -- 172.21.15.84:0/313765199 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4c6c012450 con 0x5599c115c1b0 2024-09-21T03:43:18.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.635+0000 7f4c8873e740 10 client.25165 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:18.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.635+0000 7f4c8873e740 10 client.25165 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:43:18.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.635+0000 7f4c8873e740 20 client.25165 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:18.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.635+0000 7f4c8873e740 1 --2- 172.21.15.84:0/313765199 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5599c11439f0 0x5599c1552af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.635+0000 7f4c8873e740 4 client.25165 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:18.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.635+0000 7f4c8873e740 1 -- 172.21.15.84:0/313765199 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4c74036040 con 0x5599c11439f0 2024-09-21T03:43:18.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.635+0000 7f4c7affd640 1 --2- 172.21.15.84:0/313765199 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5599c11439f0 0x5599c1552af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.636+0000 7f4c5affd640 10 client.25165 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:43:18.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.636+0000 7f4c7affd640 1 --2- 172.21.15.84:0/313765199 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5599c11439f0 0x5599c1552af0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a3af19e3eadf9b59 server_cookie=fa2f1e06ee0015c9 in_seq=0 out_seq=0 2024-09-21T03:43:18.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.637+0000 7f4c5affd640 1 -- 172.21.15.84:0/313765199 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f4c74036040 con 0x5599c11439f0 2024-09-21T03:43:18.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.637+0000 7f4c5affd640 10 client.25165 handle_command_reply: tid=0 2024-09-21T03:43:18.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.637+0000 7f4c8873e740 1 client.25165 shutdown 2024-09-21T03:43:18.642 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.638+0000 7f4c8873e740 1 -- 172.21.15.84:0/313765199 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c115c1b0 msgr2=0x5599c1540510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:18.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.638+0000 7f4c8873e740 1 --2- 172.21.15.84:0/313765199 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c115c1b0 0x5599c1540510 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c011690 tx=0x7f4c6c011b50 comp rx=0 tx=0).stop 2024-09-21T03:43:18.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.638+0000 7f4c8873e740 1 -- 172.21.15.84:0/313765199 shutdown_connections 2024-09-21T03:43:18.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.638+0000 7f4c8873e740 1 --2- 172.21.15.84:0/313765199 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5599c11439f0 0x5599c1552af0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.638+0000 7f4c5affd640 0 client.25165 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:43:18.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.638+0000 7f4c8873e740 1 --2- 172.21.15.84:0/313765199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c1185070 0x5599c154c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.638+0000 7f4c8873e740 1 --2- 172.21.15.84:0/313765199 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1164390 0x5599c1540a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.638+0000 7f4c8873e740 1 --2- 172.21.15.84:0/313765199 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c115c1b0 0x5599c1540510 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.638+0000 7f4c8873e740 1 -- 172.21.15.84:0/313765199 >> 172.21.15.84:0/313765199 conn(0x5599c1179460 msgr2=0x5599c1528bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:18.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.638+0000 7f4c8873e740 1 -- 172.21.15.84:0/313765199 shutdown_connections 2024-09-21T03:43:18.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.638+0000 7f4c8873e740 1 -- 172.21.15.84:0/313765199 wait complete. 2024-09-21T03:43:18.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.638+0000 7f4c8873e740 20 client.25165 trim_cache size 0 max 16384 2024-09-21T03:43:18.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.664+0000 7f4c8873e740 1 Processor -- start 2024-09-21T03:43:18.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.664+0000 7f4c8873e740 1 -- start start 2024-09-21T03:43:18.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.664+0000 7f4c8873e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c115c1b0 0x5599c153f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.664+0000 7f4c8873e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c1164390 0x5599c1531e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.664+0000 7f4c8873e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1185070 0x5599c153d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.664+0000 7f4c8873e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1afd30 con 0x5599c1185070 2024-09-21T03:43:18.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.664+0000 7f4c8873e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1ad600 con 0x5599c115c1b0 2024-09-21T03:43:18.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.664+0000 7f4c8873e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1ab470 con 0x5599c1164390 2024-09-21T03:43:18.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.665+0000 7f4c7b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c115c1b0 0x5599c153f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.665+0000 7f4c7b7fe640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c115c1b0 0x5599c153f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:49082/0 (socket says 172.21.15.84:49082) 2024-09-21T03:43:18.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.665+0000 7f4c7b7fe640 1 -- 172.21.15.84:0/990235925 learned_addr learned my addr 172.21.15.84:0/990235925 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:18.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.665+0000 7f4c7affd640 1 --2- 172.21.15.84:0/990235925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c1164390 0x5599c1531e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.665+0000 7f4c7bfff640 1 --2- 172.21.15.84:0/990235925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1185070 0x5599c153d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.665+0000 7f4c7b7fe640 1 -- 172.21.15.84:0/990235925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c1164390 msgr2=0x5599c1531e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:18.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.665+0000 7f4c7b7fe640 1 --2- 172.21.15.84:0/990235925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c1164390 0x5599c1531e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.665+0000 7f4c7b7fe640 1 -- 172.21.15.84:0/990235925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1185070 msgr2=0x5599c153d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:18.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.665+0000 7f4c7b7fe640 1 --2- 172.21.15.84:0/990235925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1185070 0x5599c153d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.665+0000 7f4c7b7fe640 1 -- 172.21.15.84:0/990235925 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599c152ebc0 con 0x5599c115c1b0 2024-09-21T03:43:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.665+0000 7f4c7bfff640 1 --2- 172.21.15.84:0/990235925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1185070 0x5599c153d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.666+0000 7f4c7b7fe640 1 --2- 172.21.15.84:0/990235925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c115c1b0 0x5599c153f400 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c009da0 tx=0x7f4c6c00f7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5be875858556adf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.666+0000 7f4c617fa640 1 -- 172.21.15.84:0/990235925 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c012b30 con 0x5599c115c1b0 2024-09-21T03:43:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.666+0000 7f4c617fa640 1 -- 172.21.15.84:0/990235925 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c6c031070 con 0x5599c115c1b0 2024-09-21T03:43:18.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.666+0000 7f4c617fa640 1 -- 172.21.15.84:0/990235925 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c0035f0 con 0x5599c115c1b0 2024-09-21T03:43:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.667+0000 7f4c8873e740 1 -- 172.21.15.84:0/990235925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c115c1b0 msgr2=0x5599c153f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.667+0000 7f4c8873e740 1 --2- 172.21.15.84:0/990235925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c115c1b0 0x5599c153f400 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c009da0 tx=0x7f4c6c00f7e0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.667+0000 7f4c8873e740 1 -- 172.21.15.84:0/990235925 shutdown_connections 2024-09-21T03:43:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.667+0000 7f4c8873e740 1 --2- 172.21.15.84:0/990235925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1185070 0x5599c153d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.667+0000 7f4c8873e740 1 --2- 172.21.15.84:0/990235925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c1164390 0x5599c1531e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.667+0000 7f4c8873e740 1 --2- 172.21.15.84:0/990235925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c115c1b0 0x5599c153f400 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.667+0000 7f4c8873e740 1 -- 172.21.15.84:0/990235925 >> 172.21.15.84:0/990235925 conn(0x5599c1179460 msgr2=0x5599c1531760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.667+0000 7f4c8873e740 1 -- 172.21.15.84:0/990235925 shutdown_connections 2024-09-21T03:43:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.667+0000 7f4c8873e740 1 -- 172.21.15.84:0/990235925 wait complete. 2024-09-21T03:43:18.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.668+0000 7f4c8873e740 1 -- start start 2024-09-21T03:43:18.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.668+0000 7f4c8873e740 1 Processor -- start 2024-09-21T03:43:18.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.668+0000 7f4c8873e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c115c1b0 0x5599c1544a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.669+0000 7f4c8873e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c1164390 0x5599c1544f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.669+0000 7f4c8873e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1185070 0x5599c15bc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.669+0000 7f4c7bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1185070 0x5599c15bc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.669+0000 7f4c7bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1185070 0x5599c15bc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54996/0 (socket says 172.21.15.84:54996) 2024-09-21T03:43:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.669+0000 7f4c7bfff640 1 -- 172.21.15.84:0/1770905056 learned_addr learned my addr 172.21.15.84:0/1770905056 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.669+0000 7f4c7b7fe640 1 --2- 172.21.15.84:0/1770905056 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c115c1b0 0x5599c1544a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.669+0000 7f4c7affd640 1 --2- 172.21.15.84:0/1770905056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c1164390 0x5599c1544f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.669+0000 7f4c8873e740 1 -- 172.21.15.84:0/1770905056 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1abac0 con 0x5599c1185070 2024-09-21T03:43:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.669+0000 7f4c8873e740 1 -- 172.21.15.84:0/1770905056 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1acf30 con 0x5599c1164390 2024-09-21T03:43:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.669+0000 7f4c8873e740 1 -- 172.21.15.84:0/1770905056 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1ac190 con 0x5599c115c1b0 2024-09-21T03:43:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.669+0000 7f4c8873e740 10 client.0 _ll_register_callbacks cb 0x7f4c6c0095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.669+0000 7f4c7b7fe640 1 -- 172.21.15.84:0/1770905056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c1164390 msgr2=0x5599c1544f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.669+0000 7f4c7b7fe640 1 --2- 172.21.15.84:0/1770905056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c1164390 0x5599c1544f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.669+0000 7f4c7b7fe640 1 -- 172.21.15.84:0/1770905056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1185070 msgr2=0x5599c15bc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.669+0000 7f4c7b7fe640 1 --2- 172.21.15.84:0/1770905056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1185070 0x5599c15bc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.669+0000 7f4c7b7fe640 1 -- 172.21.15.84:0/1770905056 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599c15bca30 con 0x5599c115c1b0 2024-09-21T03:43:18.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.670+0000 7f4c7b7fe640 1 --2- 172.21.15.84:0/1770905056 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c115c1b0 0x5599c1544a20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c001eb0 tx=0x7f4c6c012dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63f759eff8877e29 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:18.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.670+0000 7f4c5affd640 10 client.25171 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-21T03:43:18.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.670+0000 7f4c8873e740 1 -- 172.21.15.84:0/1770905056 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c6c031070 con 0x5599c115c1b0 2024-09-21T03:43:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.670+0000 7f4c5affd640 1 -- 172.21.15.84:0/1770905056 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c012740 con 0x5599c115c1b0 2024-09-21T03:43:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.670+0000 7f4c5affd640 1 -- 172.21.15.84:0/1770905056 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4c6c00f940 con 0x5599c115c1b0 2024-09-21T03:43:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.670+0000 7f4c5affd640 1 -- 172.21.15.84:0/1770905056 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4c6c00fba0 con 0x5599c115c1b0 2024-09-21T03:43:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.670+0000 7f4c8873e740 10 client.25171 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.670+0000 7f4c8873e740 1 -- 172.21.15.84:0/1770905056 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5599c15bd970 con 0x5599c115c1b0 2024-09-21T03:43:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.671+0000 7f4c5affd640 1 -- 172.21.15.84:0/1770905056 <== mon.1 v2:172.21.15.174:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4c6c0035f0 con 0x5599c115c1b0 2024-09-21T03:43:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.671+0000 7f4c8873e740 10 client.25171 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.671+0000 7f4c8873e740 10 client.25171 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:43:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.671+0000 7f4c8873e740 20 client.25171 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:18.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.671+0000 7f4c8873e740 1 --2- 172.21.15.84:0/1770905056 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5599c1118da0 0x5599c15c0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.671+0000 7f4c8873e740 4 client.25171 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:43:18.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.671+0000 7f4c8873e740 1 -- 172.21.15.84:0/1770905056 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f4c6c031070 con 0x5599c1118da0 2024-09-21T03:43:18.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.671+0000 7f4c7affd640 1 --2- 172.21.15.84:0/1770905056 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5599c1118da0 0x5599c15c0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.671+0000 7f4c5affd640 10 client.25171 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:43:18.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.671+0000 7f4c7affd640 1 --2- 172.21.15.84:0/1770905056 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5599c1118da0 0x5599c15c0010 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2f83c298a8aafd9e server_cookie=1216e686f2960c3b in_seq=0 out_seq=0 2024-09-21T03:43:18.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.672+0000 7f4c5affd640 1 -- 172.21.15.84:0/1770905056 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f4c6c031070 con 0x5599c1118da0 2024-09-21T03:43:18.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.672+0000 7f4c5affd640 10 client.25171 handle_command_reply: tid=0 2024-09-21T03:43:18.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.672+0000 7f4c8873e740 1 client.25171 shutdown 2024-09-21T03:43:18.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.672+0000 7f4c8873e740 1 -- 172.21.15.84:0/1770905056 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c115c1b0 msgr2=0x5599c1544a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:18.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.672+0000 7f4c8873e740 1 --2- 172.21.15.84:0/1770905056 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c115c1b0 0x5599c1544a20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c001eb0 tx=0x7f4c6c012dc0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.672+0000 7f4c8873e740 1 -- 172.21.15.84:0/1770905056 shutdown_connections 2024-09-21T03:43:18.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.672+0000 7f4c8873e740 1 --2- 172.21.15.84:0/1770905056 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5599c1118da0 0x5599c15c0010 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.672+0000 7f4c8873e740 1 --2- 172.21.15.84:0/1770905056 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c1185070 0x5599c15bc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.672+0000 7f4c5affd640 0 client.25171 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:43:18.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.672+0000 7f4c8873e740 1 --2- 172.21.15.84:0/1770905056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c1164390 0x5599c1544f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.672+0000 7f4c8873e740 1 --2- 172.21.15.84:0/1770905056 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c115c1b0 0x5599c1544a20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.672+0000 7f4c8873e740 1 -- 172.21.15.84:0/1770905056 >> 172.21.15.84:0/1770905056 conn(0x5599c1179460 msgr2=0x5599c152e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:18.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.672+0000 7f4c8873e740 1 -- 172.21.15.84:0/1770905056 shutdown_connections 2024-09-21T03:43:18.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.672+0000 7f4c8873e740 1 -- 172.21.15.84:0/1770905056 wait complete. 2024-09-21T03:43:18.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.673+0000 7f4c8873e740 20 client.25171 trim_cache size 0 max 16384 2024-09-21T03:43:18.677 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:43:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.673+0000 7f4c821ca640 1 -- 172.21.15.84:0/1957160833 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4c640b6810 msgr2=0x7f4c640b8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.673+0000 7f4c821ca640 1 --2- 172.21.15.84:0/1957160833 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4c640b6810 0x7f4c640b8d20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4c74048000 tx=0x7f4c7402f960 comp rx=0 tx=0).stop 2024-09-21T03:43:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.673+0000 7f4c821ca640 1 -- 172.21.15.84:0/1957160833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c7c1062b0 msgr2=0x7f4c7c19cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.673+0000 7f4c821ca640 1 --2- 172.21.15.84:0/1957160833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c7c1062b0 0x7f4c7c19cc10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c075ab0 tx=0x7f4c7000db30 comp rx=0 tx=0).stop 2024-09-21T03:43:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.674+0000 7f4c821ca640 1 -- 172.21.15.84:0/1957160833 shutdown_connections 2024-09-21T03:43:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.674+0000 7f4c821ca640 1 --2- 172.21.15.84:0/1957160833 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4c640b6810 0x7f4c640b8d20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.674+0000 7f4c821ca640 1 --2- 172.21.15.84:0/1957160833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4c7c106c00 0x7f4c7c1a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.674+0000 7f4c821ca640 1 --2- 172.21.15.84:0/1957160833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c7c1062b0 0x7f4c7c19cc10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.674+0000 7f4c821ca640 1 --2- 172.21.15.84:0/1957160833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c101fd0 0x7f4c7c19c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.674+0000 7f4c821ca640 1 -- 172.21.15.84:0/1957160833 >> 172.21.15.84:0/1957160833 conn(0x7f4c7c079e10 msgr2=0x7f4c7c107300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.674+0000 7f4c821ca640 1 -- 172.21.15.84:0/1957160833 shutdown_connections 2024-09-21T03:43:18.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:18.674+0000 7f4c821ca640 1 -- 172.21.15.84:0/1957160833 wait complete. 2024-09-21T03:43:19.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:19 smithi084 ceph-mon[30941]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:43:19.658 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:43:19.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:19 smithi174 ceph-mon[34403]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:43:19.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:19 smithi172 ceph-mon[34821]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:43:19.941 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:20.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.518+0000 7efe3e9df640 1 -- 172.21.15.84:0/2564013418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe38109e00 msgr2=0x7efe38110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:20.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.518+0000 7efe3e9df640 1 --2- 172.21.15.84:0/2564013418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe38109e00 0x7efe38110630 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7efe30009ca0 tx=0x7efe3002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.518+0000 7efe3e9df640 1 -- 172.21.15.84:0/2564013418 shutdown_connections 2024-09-21T03:43:20.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.518+0000 7efe3e9df640 1 --2- 172.21.15.84:0/2564013418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe38109e00 0x7efe38110630 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.518+0000 7efe3e9df640 1 --2- 172.21.15.84:0/2564013418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe381094b0 0x7efe381098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.518+0000 7efe3e9df640 1 --2- 172.21.15.84:0/2564013418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe38101f70 0x7efe38102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.518+0000 7efe3e9df640 1 -- 172.21.15.84:0/2564013418 >> 172.21.15.84:0/2564013418 conn(0x7efe38077c60 msgr2=0x7efe380780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:20.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.518+0000 7efe3e9df640 1 -- 172.21.15.84:0/2564013418 shutdown_connections 2024-09-21T03:43:20.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.519+0000 7efe3e9df640 1 -- 172.21.15.84:0/2564013418 wait complete. 2024-09-21T03:43:20.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.519+0000 7efe3e9df640 1 Processor -- start 2024-09-21T03:43:20.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.519+0000 7efe3e9df640 1 -- start start 2024-09-21T03:43:20.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.520+0000 7efe3e9df640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe38101f70 0x7efe38102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:20.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.520+0000 7efe3e9df640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe381094b0 0x7efe38103450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:20.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.520+0000 7efe3e9df640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe38109e00 0x7efe38103990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:20.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.520+0000 7efe3e9df640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efe38113ac0 con 0x7efe381094b0 2024-09-21T03:43:20.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.520+0000 7efe3e9df640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efe38113940 con 0x7efe38101f70 2024-09-21T03:43:20.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.520+0000 7efe3e9df640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efe38113c40 con 0x7efe38109e00 2024-09-21T03:43:20.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.520+0000 7efe377fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe381094b0 0x7efe38103450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:20.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.520+0000 7efe377fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe381094b0 0x7efe38103450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55014/0 (socket says 172.21.15.84:55014) 2024-09-21T03:43:20.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.520+0000 7efe377fe640 1 -- 172.21.15.84:0/1044103499 learned_addr learned my addr 172.21.15.84:0/1044103499 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:20.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.520+0000 7efe37fff640 1 --2- 172.21.15.84:0/1044103499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe38101f70 0x7efe38102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:20.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.521+0000 7efe377fe640 1 -- 172.21.15.84:0/1044103499 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe38109e00 msgr2=0x7efe38103990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:20.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.521+0000 7efe377fe640 1 --2- 172.21.15.84:0/1044103499 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe38109e00 0x7efe38103990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.521+0000 7efe377fe640 1 -- 172.21.15.84:0/1044103499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe38101f70 msgr2=0x7efe38102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:20.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.521+0000 7efe377fe640 1 --2- 172.21.15.84:0/1044103499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe38101f70 0x7efe38102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.521+0000 7efe377fe640 1 -- 172.21.15.84:0/1044103499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe381a87b0 con 0x7efe381094b0 2024-09-21T03:43:20.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.521+0000 7efe377fe640 1 --2- 172.21.15.84:0/1044103499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe381094b0 0x7efe38103450 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00d740 tx=0x7efe2c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:20.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.521+0000 7efe357fa640 1 -- 172.21.15.84:0/1044103499 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c017070 con 0x7efe381094b0 2024-09-21T03:43:20.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.521+0000 7efe357fa640 1 -- 172.21.15.84:0/1044103499 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe2c00de50 con 0x7efe381094b0 2024-09-21T03:43:20.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.521+0000 7efe3e9df640 1 -- 172.21.15.84:0/1044103499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe381a8aa0 con 0x7efe381094b0 2024-09-21T03:43:20.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.521+0000 7efe357fa640 1 -- 172.21.15.84:0/1044103499 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c00f620 con 0x7efe381094b0 2024-09-21T03:43:20.525 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.522+0000 7efe3e9df640 1 -- 172.21.15.84:0/1044103499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe381a8f70 con 0x7efe381094b0 2024-09-21T03:43:20.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.525+0000 7efe44f53740 1 Processor -- start 2024-09-21T03:43:20.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.525+0000 7efe44f53740 1 -- start start 2024-09-21T03:43:20.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.525+0000 7efe44f53740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe1a2070 0x5627fe5496a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:20.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.525+0000 7efe44f53740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe1791b0 0x5627fe549be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:20.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.525+0000 7efe44f53740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5627fe181390 0x5627fe54a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:20.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.525+0000 7efe44f53740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5627fe4bfea0 con 0x5627fe1791b0 2024-09-21T03:43:20.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.525+0000 7efe44f53740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5627fe4af2d0 con 0x5627fe1a2070 2024-09-21T03:43:20.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.525+0000 7efe44f53740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5627fe4b30e0 con 0x5627fe181390 2024-09-21T03:43:20.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.526+0000 7efe37fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe1791b0 0x5627fe549be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:20.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.526+0000 7efe37fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe1791b0 0x5627fe549be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55028/0 (socket says 172.21.15.84:55028) 2024-09-21T03:43:20.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.526+0000 7efe37fff640 1 -- 172.21.15.84:0/3577084119 learned_addr learned my addr 172.21.15.84:0/3577084119 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:20.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.526+0000 7efe357fa640 1 -- 172.21.15.84:0/1044103499 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7efe2c01a070 con 0x7efe381094b0 2024-09-21T03:43:20.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.526+0000 7efe37fff640 1 -- 172.21.15.84:0/3577084119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5627fe181390 msgr2=0x5627fe54a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:20.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.526+0000 7efe37fff640 1 --2- 172.21.15.84:0/3577084119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5627fe181390 0x5627fe54a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.526+0000 7efe37fff640 1 -- 172.21.15.84:0/3577084119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe1a2070 msgr2=0x5627fe5496a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T03:43:20.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.526+0000 7efe37fff640 1 --2- 172.21.15.84:0/3577084119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe1a2070 0x5627fe5496a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.526+0000 7efe37fff640 1 -- 172.21.15.84:0/3577084119 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627fe20d650 con 0x5627fe1791b0 2024-09-21T03:43:20.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.526+0000 7efe37fff640 1 --2- 172.21.15.84:0/3577084119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe1791b0 0x5627fe549be0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7efe2800bcb0 tx=0x7efe280107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10beabc5e9044c10 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:20.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.527+0000 7efe1e7fc640 1 -- 172.21.15.84:0/3577084119 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2801c480 con 0x5627fe1791b0 2024-09-21T03:43:20.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.527+0000 7efe357fa640 1 --2- 172.21.15.84:0/1044103499 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efe200b6810 0x7efe200b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:20.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.527+0000 7efe3cf7c640 1 --2- 172.21.15.84:0/1044103499 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efe200b6810 0x7efe200b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:20.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.527+0000 7efe1e7fc640 1 -- 172.21.15.84:0/3577084119 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe2801cad0 con 0x5627fe1791b0 2024-09-21T03:43:20.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.527+0000 7efe1e7fc640 1 -- 172.21.15.84:0/3577084119 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe28011c30 con 0x5627fe1791b0 2024-09-21T03:43:20.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.527+0000 7efe357fa640 1 -- 172.21.15.84:0/1044103499 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7efe2c0e68f0 con 0x7efe381094b0 2024-09-21T03:43:20.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.528+0000 7efe44f53740 1 -- 172.21.15.84:0/3577084119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe1791b0 msgr2=0x5627fe549be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:20.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.528+0000 7efe3cf7c640 1 --2- 172.21.15.84:0/1044103499 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efe200b6810 0x7efe200b8d20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efe3002ade0 tx=0x7efe300093f0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:20.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.528+0000 7efe44f53740 1 --2- 172.21.15.84:0/3577084119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe1791b0 0x5627fe549be0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7efe2800bcb0 tx=0x7efe280107a0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.528+0000 7efe44f53740 1 -- 172.21.15.84:0/3577084119 shutdown_connections 2024-09-21T03:43:20.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.528+0000 7efe44f53740 1 --2- 172.21.15.84:0/3577084119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5627fe181390 0x5627fe54a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.528+0000 7efe44f53740 1 --2- 172.21.15.84:0/3577084119 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe1791b0 0x5627fe549be0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.528+0000 7efe44f53740 1 --2- 172.21.15.84:0/3577084119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe1a2070 0x5627fe5496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.528+0000 7efe44f53740 1 -- 172.21.15.84:0/3577084119 >> 172.21.15.84:0/3577084119 conn(0x5627fe196460 msgr2=0x5627fe547590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:20.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.528+0000 7efe44f53740 1 -- 172.21.15.84:0/3577084119 shutdown_connections 2024-09-21T03:43:20.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.528+0000 7efe44f53740 1 -- 172.21.15.84:0/3577084119 wait complete. 2024-09-21T03:43:20.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.529+0000 7efe44f53740 1 -- start start 2024-09-21T03:43:20.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.529+0000 7efe44f53740 1 Processor -- start 2024-09-21T03:43:20.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.530+0000 7efe44f53740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5627fe1791b0 0x5627fe554e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:20.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.530+0000 7efe44f53740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe181390 0x5627fe555390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:20.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.530+0000 7efe44f53740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe1a2070 0x5627fe5611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:20.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.530+0000 7efe44f53740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5627fe310700 con 0x5627fe181390 2024-09-21T03:43:20.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.530+0000 7efe44f53740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5627fe44a160 con 0x5627fe1a2070 2024-09-21T03:43:20.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.530+0000 7efe44f53740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5627fe557e80 con 0x5627fe1791b0 2024-09-21T03:43:20.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.530+0000 7efe44f53740 10 client.0 _ll_register_callbacks cb 0x5627fe4639e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:20.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.530+0000 7efe377fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe181390 0x5627fe555390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:20.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.530+0000 7efe377fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe181390 0x5627fe555390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55030/0 (socket says 172.21.15.84:55030) 2024-09-21T03:43:20.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.530+0000 7efe377fe640 1 -- 172.21.15.84:0/1550697185 learned_addr learned my addr 172.21.15.84:0/1550697185 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:20.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.530+0000 7efe37fff640 1 --2- 172.21.15.84:0/1550697185 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5627fe1791b0 0x5627fe554e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:20.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.530+0000 7efe3cf7c640 1 --2- 172.21.15.84:0/1550697185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe1a2070 0x5627fe5611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:20.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.531+0000 7efe37fff640 1 -- 172.21.15.84:0/1550697185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe1a2070 msgr2=0x5627fe5611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:20.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.531+0000 7efe37fff640 1 --2- 172.21.15.84:0/1550697185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe1a2070 0x5627fe5611a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.531+0000 7efe37fff640 1 -- 172.21.15.84:0/1550697185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe181390 msgr2=0x5627fe555390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:20.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.531+0000 7efe37fff640 1 --2- 172.21.15.84:0/1550697185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe181390 0x5627fe555390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.531+0000 7efe37fff640 1 -- 172.21.15.84:0/1550697185 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627fe477c90 con 0x5627fe1791b0 2024-09-21T03:43:20.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.531+0000 7efe377fe640 1 --2- 172.21.15.84:0/1550697185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe181390 0x5627fe555390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:43:20.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.531+0000 7efe37fff640 1 --2- 172.21.15.84:0/1550697185 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5627fe1791b0 0x5627fe554e50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efe280117d0 tx=0x7efe2801cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f426fb4305dbb6f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:20.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.531+0000 7efe177fe640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-21T03:43:20.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.531+0000 7efe177fe640 1 -- 172.21.15.84:0/1550697185 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2802b060 con 0x5627fe1791b0 2024-09-21T03:43:20.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.531+0000 7efe177fe640 1 -- 172.21.15.84:0/1550697185 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7efe2801c890 con 0x5627fe1791b0 2024-09-21T03:43:20.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.531+0000 7efe44f53740 1 -- 172.21.15.84:0/1550697185 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe2801cad0 con 0x5627fe1791b0 2024-09-21T03:43:20.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.531+0000 7efe177fe640 1 -- 172.21.15.84:0/1550697185 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efe28011930 con 0x5627fe1791b0 2024-09-21T03:43:20.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.531+0000 7efe44f53740 10 client.25177 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:20.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.531+0000 7efe44f53740 1 -- 172.21.15.84:0/1550697185 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5627fe563c60 con 0x5627fe1791b0 2024-09-21T03:43:20.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.532+0000 7efe177fe640 1 -- 172.21.15.84:0/1550697185 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe2801cad0 con 0x5627fe1791b0 2024-09-21T03:43:20.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.532+0000 7efe177fe640 1 -- 172.21.15.84:0/1550697185 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efe28025070 con 0x5627fe1791b0 2024-09-21T03:43:20.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.532+0000 7efe44f53740 10 client.25177 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:20.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.532+0000 7efe44f53740 10 client.25177 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:43:20.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.532+0000 7efe44f53740 20 client.25177 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:20.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.532+0000 7efe44f53740 1 --2- 172.21.15.84:0/1550697185 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5627fe1609f0 0x5627fe567070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:20.537 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.532+0000 7efe44f53740 4 client.25177 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:20.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.532+0000 7efe44f53740 1 -- 172.21.15.84:0/1550697185 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627fe4c1df0 con 0x5627fe1609f0 2024-09-21T03:43:20.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.532+0000 7efe377fe640 1 --2- 172.21.15.84:0/1550697185 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5627fe1609f0 0x5627fe567070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:20.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.533+0000 7efe177fe640 10 client.25177 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:43:20.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.533+0000 7efe377fe640 1 --2- 172.21.15.84:0/1550697185 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5627fe1609f0 0x5627fe567070 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d7bfc45f7eef0fe6 server_cookie=a61e4ebb070f2aa4 in_seq=0 out_seq=0 2024-09-21T03:43:20.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.534+0000 7efe177fe640 1 -- 172.21.15.84:0/1550697185 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5627fe4c1df0 con 0x5627fe1609f0 2024-09-21T03:43:20.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.534+0000 7efe177fe640 10 client.25177 handle_command_reply: tid=0 2024-09-21T03:43:20.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.534+0000 7efe44f53740 1 client.25177 shutdown 2024-09-21T03:43:20.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.534+0000 7efe44f53740 1 -- 172.21.15.84:0/1550697185 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5627fe1791b0 msgr2=0x5627fe554e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:20.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.534+0000 7efe44f53740 1 --2- 172.21.15.84:0/1550697185 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5627fe1791b0 0x5627fe554e50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efe280117d0 tx=0x7efe2801cc80 comp rx=0 tx=0).stop 2024-09-21T03:43:20.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.534+0000 7efe44f53740 1 -- 172.21.15.84:0/1550697185 shutdown_connections 2024-09-21T03:43:20.538 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.534+0000 7efe44f53740 1 --2- 172.21.15.84:0/1550697185 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5627fe1609f0 0x5627fe567070 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.534+0000 7efe44f53740 1 --2- 172.21.15.84:0/1550697185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe1a2070 0x5627fe5611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.534+0000 7efe177fe640 0 client.25177 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:43:20.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.534+0000 7efe44f53740 1 --2- 172.21.15.84:0/1550697185 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe181390 0x5627fe555390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.534+0000 7efe44f53740 1 --2- 172.21.15.84:0/1550697185 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5627fe1791b0 0x5627fe554e50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.534+0000 7efe44f53740 1 -- 172.21.15.84:0/1550697185 >> 172.21.15.84:0/1550697185 conn(0x5627fe196460 msgr2=0x5627fe54c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:20.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.535+0000 7efe44f53740 1 -- 172.21.15.84:0/1550697185 shutdown_connections 2024-09-21T03:43:20.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.535+0000 7efe44f53740 1 -- 172.21.15.84:0/1550697185 wait complete. 2024-09-21T03:43:20.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.535+0000 7efe44f53740 20 client.25177 trim_cache size 0 max 16384 2024-09-21T03:43:20.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.560+0000 7efe44f53740 1 Processor -- start 2024-09-21T03:43:20.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.560+0000 7efe44f53740 1 -- start start 2024-09-21T03:43:20.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.560+0000 7efe44f53740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5627fe1609f0 0x5627fe5475c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:20.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.560+0000 7efe44f53740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe181390 0x5627fe561110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:20.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.560+0000 7efe44f53740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe1a2070 0x5627fe54c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:20.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.560+0000 7efe44f53740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efe381b4140 con 0x5627fe1a2070 2024-09-21T03:43:20.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.560+0000 7efe44f53740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efe381b1a10 con 0x5627fe181390 2024-09-21T03:43:20.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.560+0000 7efe44f53740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efe381af840 con 0x5627fe1609f0 2024-09-21T03:43:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.561+0000 7efe3cf7c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe1a2070 0x5627fe54c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.561+0000 7efe3cf7c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe1a2070 0x5627fe54c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55046/0 (socket says 172.21.15.84:55046) 2024-09-21T03:43:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.561+0000 7efe3cf7c640 1 -- 172.21.15.84:0/1738643125 learned_addr learned my addr 172.21.15.84:0/1738643125 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.561+0000 7efe37fff640 1 --2- 172.21.15.84:0/1738643125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5627fe1609f0 0x5627fe5475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.561+0000 7efe377fe640 1 --2- 172.21.15.84:0/1738643125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe181390 0x5627fe561110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.561+0000 7efe3cf7c640 1 -- 172.21.15.84:0/1738643125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5627fe1609f0 msgr2=0x5627fe5475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.561+0000 7efe3cf7c640 1 --2- 172.21.15.84:0/1738643125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5627fe1609f0 0x5627fe5475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.561+0000 7efe3cf7c640 1 -- 172.21.15.84:0/1738643125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe181390 msgr2=0x5627fe561110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.561+0000 7efe3cf7c640 1 --2- 172.21.15.84:0/1738643125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe181390 0x5627fe561110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.561+0000 7efe3cf7c640 1 -- 172.21.15.84:0/1738643125 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627fe5506e0 con 0x5627fe1a2070 2024-09-21T03:43:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.561+0000 7efe3cf7c640 1 --2- 172.21.15.84:0/1738643125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe1a2070 0x5627fe54c7a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efe30032c70 tx=0x7efe3003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db957d20f85917f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.562+0000 7efe1dffb640 1 -- 172.21.15.84:0/1738643125 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe30003c30 con 0x5627fe1a2070 2024-09-21T03:43:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.562+0000 7efe1dffb640 1 -- 172.21.15.84:0/1738643125 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe30036050 con 0x5627fe1a2070 2024-09-21T03:43:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.562+0000 7efe1dffb640 1 -- 172.21.15.84:0/1738643125 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe3002fa20 con 0x5627fe1a2070 2024-09-21T03:43:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.563+0000 7efe44f53740 1 -- 172.21.15.84:0/1738643125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe1a2070 msgr2=0x5627fe54c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.563+0000 7efe44f53740 1 --2- 172.21.15.84:0/1738643125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe1a2070 0x5627fe54c7a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efe30032c70 tx=0x7efe3003d000 comp rx=0 tx=0).stop 2024-09-21T03:43:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.563+0000 7efe44f53740 1 -- 172.21.15.84:0/1738643125 shutdown_connections 2024-09-21T03:43:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.563+0000 7efe44f53740 1 --2- 172.21.15.84:0/1738643125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe1a2070 0x5627fe54c7a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.563+0000 7efe44f53740 1 --2- 172.21.15.84:0/1738643125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe181390 0x5627fe561110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.563+0000 7efe44f53740 1 --2- 172.21.15.84:0/1738643125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5627fe1609f0 0x5627fe5475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.563+0000 7efe44f53740 1 -- 172.21.15.84:0/1738643125 >> 172.21.15.84:0/1738643125 conn(0x5627fe196460 msgr2=0x5627fe546eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.563+0000 7efe44f53740 1 -- 172.21.15.84:0/1738643125 shutdown_connections 2024-09-21T03:43:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.563+0000 7efe44f53740 1 -- 172.21.15.84:0/1738643125 wait complete. 2024-09-21T03:43:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.563+0000 7efe44f53740 1 -- start start 2024-09-21T03:43:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.564+0000 7efe44f53740 1 Processor -- start 2024-09-21T03:43:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.564+0000 7efe44f53740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe1609f0 0x5627fe56a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.564+0000 7efe44f53740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5627fe181390 0x5627fe567e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.564+0000 7efe44f53740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe1a2070 0x5627fe568470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.564+0000 7efe37fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe1609f0 0x5627fe56a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.564+0000 7efe37fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe1609f0 0x5627fe56a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:49154/0 (socket says 172.21.15.84:49154) 2024-09-21T03:43:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.564+0000 7efe44f53740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efe381afed0 con 0x5627fe1a2070 2024-09-21T03:43:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.564+0000 7efe44f53740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efe381b1340 con 0x5627fe1609f0 2024-09-21T03:43:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.564+0000 7efe44f53740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efe381b05a0 con 0x5627fe181390 2024-09-21T03:43:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.564+0000 7efe3cf7c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe1a2070 0x5627fe568470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.564+0000 7efe37fff640 1 -- 172.21.15.84:0/1484923097 learned_addr learned my addr 172.21.15.84:0/1484923097 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.564+0000 7efe44f53740 10 client.0 _ll_register_callbacks cb 0x7efe2800bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.565+0000 7efe377fe640 1 --2- 172.21.15.84:0/1484923097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5627fe181390 0x5627fe567e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.565+0000 7efe37fff640 1 -- 172.21.15.84:0/1484923097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5627fe181390 msgr2=0x5627fe567e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.565+0000 7efe37fff640 1 --2- 172.21.15.84:0/1484923097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5627fe181390 0x5627fe567e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.565+0000 7efe37fff640 1 -- 172.21.15.84:0/1484923097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe1a2070 msgr2=0x5627fe568470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.565+0000 7efe37fff640 1 --2- 172.21.15.84:0/1484923097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe1a2070 0x5627fe568470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.565+0000 7efe37fff640 1 -- 172.21.15.84:0/1484923097 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627fe568c00 con 0x5627fe1609f0 2024-09-21T03:43:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.565+0000 7efe37fff640 1 --2- 172.21.15.84:0/1484923097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe1609f0 0x5627fe56a950 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efe280056f0 tx=0x7efe2800b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2b544fc6ab5eafd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.565+0000 7efe177fe640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T03:43:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.565+0000 7efe177fe640 1 -- 172.21.15.84:0/1484923097 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2802b040 con 0x5627fe1609f0 2024-09-21T03:43:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.565+0000 7efe177fe640 1 -- 172.21.15.84:0/1484923097 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7efe28011cd0 con 0x5627fe1609f0 2024-09-21T03:43:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.566+0000 7efe44f53740 1 -- 172.21.15.84:0/1484923097 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe30036050 con 0x5627fe1609f0 2024-09-21T03:43:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.566+0000 7efe177fe640 1 -- 172.21.15.84:0/1484923097 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efe28040050 con 0x5627fe1609f0 2024-09-21T03:43:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.566+0000 7efe44f53740 10 client.25241 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.566+0000 7efe44f53740 1 -- 172.21.15.84:0/1484923097 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5627fe5da010 con 0x5627fe1609f0 2024-09-21T03:43:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.566+0000 7efe177fe640 1 -- 172.21.15.84:0/1484923097 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe30036050 con 0x5627fe1609f0 2024-09-21T03:43:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.566+0000 7efe177fe640 1 -- 172.21.15.84:0/1484923097 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efe28025070 con 0x5627fe1609f0 2024-09-21T03:43:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.567+0000 7efe44f53740 10 client.25241 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.567+0000 7efe44f53740 10 client.25241 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:43:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.567+0000 7efe44f53740 20 client.25241 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.567+0000 7efe44f53740 1 --2- 172.21.15.84:0/1484923097 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5627fe135da0 0x5627fe5dc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.567+0000 7efe44f53740 4 client.25241 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:43:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.567+0000 7efe44f53740 1 -- 172.21.15.84:0/1484923097 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5627fe4bd8a0 con 0x5627fe135da0 2024-09-21T03:43:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.567+0000 7efe377fe640 1 --2- 172.21.15.84:0/1484923097 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5627fe135da0 0x5627fe5dc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.567+0000 7efe177fe640 10 client.25241 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:43:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.568+0000 7efe377fe640 1 --2- 172.21.15.84:0/1484923097 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5627fe135da0 0x5627fe5dc6e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6d33177735c865a7 server_cookie=94a72e99852e68e5 in_seq=0 out_seq=0 2024-09-21T03:43:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.568+0000 7efe177fe640 1 -- 172.21.15.84:0/1484923097 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5627fe4bd8a0 con 0x5627fe135da0 2024-09-21T03:43:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.568+0000 7efe177fe640 10 client.25241 handle_command_reply: tid=0 2024-09-21T03:43:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.568+0000 7efe44f53740 1 client.25241 shutdown 2024-09-21T03:43:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.568+0000 7efe44f53740 1 -- 172.21.15.84:0/1484923097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe1609f0 msgr2=0x5627fe56a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.568+0000 7efe44f53740 1 --2- 172.21.15.84:0/1484923097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe1609f0 0x5627fe56a950 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efe280056f0 tx=0x7efe2800b390 comp rx=0 tx=0).stop 2024-09-21T03:43:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.568+0000 7efe44f53740 1 -- 172.21.15.84:0/1484923097 shutdown_connections 2024-09-21T03:43:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.568+0000 7efe44f53740 1 --2- 172.21.15.84:0/1484923097 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5627fe135da0 0x5627fe5dc6e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.568+0000 7efe177fe640 0 client.25241 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:43:20.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.568+0000 7efe44f53740 1 --2- 172.21.15.84:0/1484923097 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5627fe1a2070 0x5627fe568470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.568+0000 7efe44f53740 1 --2- 172.21.15.84:0/1484923097 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5627fe181390 0x5627fe567e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.568+0000 7efe44f53740 1 --2- 172.21.15.84:0/1484923097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627fe1609f0 0x5627fe56a950 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.568+0000 7efe44f53740 1 -- 172.21.15.84:0/1484923097 >> 172.21.15.84:0/1484923097 conn(0x5627fe196460 msgr2=0x5627fe554c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:20.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.568+0000 7efe44f53740 1 -- 172.21.15.84:0/1484923097 shutdown_connections 2024-09-21T03:43:20.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.568+0000 7efe44f53740 1 -- 172.21.15.84:0/1484923097 wait complete. 2024-09-21T03:43:20.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.569+0000 7efe44f53740 20 client.25241 trim_cache size 0 max 16384 2024-09-21T03:43:20.575 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:43:20.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.569+0000 7efe3e9df640 1 -- 172.21.15.84:0/1044103499 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efe200b6810 msgr2=0x7efe200b8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:20.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.569+0000 7efe3e9df640 1 --2- 172.21.15.84:0/1044103499 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efe200b6810 0x7efe200b8d20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efe3002ade0 tx=0x7efe300093f0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.569+0000 7efe3e9df640 1 -- 172.21.15.84:0/1044103499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe381094b0 msgr2=0x7efe38103450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:20.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.569+0000 7efe3e9df640 1 --2- 172.21.15.84:0/1044103499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe381094b0 0x7efe38103450 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00d740 tx=0x7efe2c00dc00 comp rx=0 tx=0).stop 2024-09-21T03:43:20.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.570+0000 7efe3e9df640 1 -- 172.21.15.84:0/1044103499 shutdown_connections 2024-09-21T03:43:20.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.570+0000 7efe3e9df640 1 --2- 172.21.15.84:0/1044103499 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efe200b6810 0x7efe200b8d20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.570+0000 7efe3e9df640 1 --2- 172.21.15.84:0/1044103499 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe38109e00 0x7efe38103990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.570+0000 7efe3e9df640 1 --2- 172.21.15.84:0/1044103499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efe381094b0 0x7efe38103450 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.570+0000 7efe3e9df640 1 --2- 172.21.15.84:0/1044103499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efe38101f70 0x7efe38102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:20.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.570+0000 7efe3e9df640 1 -- 172.21.15.84:0/1044103499 >> 172.21.15.84:0/1044103499 conn(0x7efe38077c60 msgr2=0x7efe38107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:20.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.570+0000 7efe3e9df640 1 -- 172.21.15.84:0/1044103499 shutdown_connections 2024-09-21T03:43:20.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:20.570+0000 7efe3e9df640 1 -- 172.21.15.84:0/1044103499 wait complete. 2024-09-21T03:43:21.455 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:43:21.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:21 smithi084 ceph-mon[30941]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:43:21.844 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:21.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:21 smithi174 ceph-mon[34403]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:43:21.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:21 smithi172 ceph-mon[34821]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T03:43:22.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.389+0000 7fdb86eba640 1 -- 172.21.15.84:0/338986499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb80103100 msgr2=0x7fdb80103510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:22.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.389+0000 7fdb86eba640 1 --2- 172.21.15.84:0/338986499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb80103100 0x7fdb80103510 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009980 tx=0x7fdb7402c620 comp rx=0 tx=0).stop 2024-09-21T03:43:22.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.390+0000 7fdb86eba640 1 -- 172.21.15.84:0/338986499 shutdown_connections 2024-09-21T03:43:22.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.390+0000 7fdb86eba640 1 --2- 172.21.15.84:0/338986499 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb80105ad0 0x7fdb8010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.390+0000 7fdb86eba640 1 --2- 172.21.15.84:0/338986499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb80105180 0x7fdb80105590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.390+0000 7fdb86eba640 1 --2- 172.21.15.84:0/338986499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb80103100 0x7fdb80103510 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.390+0000 7fdb86eba640 1 -- 172.21.15.84:0/338986499 >> 172.21.15.84:0/338986499 conn(0x7fdb80077c60 msgr2=0x7fdb800780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:22.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.390+0000 7fdb86eba640 1 -- 172.21.15.84:0/338986499 shutdown_connections 2024-09-21T03:43:22.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.390+0000 7fdb86eba640 1 -- 172.21.15.84:0/338986499 wait complete. 2024-09-21T03:43:22.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.391+0000 7fdb86eba640 1 Processor -- start 2024-09-21T03:43:22.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.391+0000 7fdb86eba640 1 -- start start 2024-09-21T03:43:22.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.391+0000 7fdb86eba640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb80103100 0x7fdb801982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:22.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.391+0000 7fdb86eba640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb80105180 0x7fdb80198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:22.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.392+0000 7fdb86eba640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb80105ad0 0x7fdb8019db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:22.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.392+0000 7fdb86eba640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdb80111890 con 0x7fdb80103100 2024-09-21T03:43:22.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.392+0000 7fdb86eba640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdb80111710 con 0x7fdb80105ad0 2024-09-21T03:43:22.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.392+0000 7fdb86eba640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdb80111a10 con 0x7fdb80105180 2024-09-21T03:43:22.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.392+0000 7fdb84c56640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb80103100 0x7fdb801982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:22.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.392+0000 7fdb85457640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb80105ad0 0x7fdb8019db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:22.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.392+0000 7fdb84c56640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb80103100 0x7fdb801982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55082/0 (socket says 172.21.15.84:55082) 2024-09-21T03:43:22.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.392+0000 7fdb84c56640 1 -- 172.21.15.84:0/2187501362 learned_addr learned my addr 172.21.15.84:0/2187501362 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:22.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.393+0000 7fdb85457640 1 -- 172.21.15.84:0/2187501362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb80105180 msgr2=0x7fdb80198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:22.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.393+0000 7fdb85457640 1 --2- 172.21.15.84:0/2187501362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb80105180 0x7fdb80198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.393+0000 7fdb85457640 1 -- 172.21.15.84:0/2187501362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb80103100 msgr2=0x7fdb801982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:22.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.393+0000 7fdb85457640 1 --2- 172.21.15.84:0/2187501362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb80103100 0x7fdb801982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.393+0000 7fdb85457640 1 -- 172.21.15.84:0/2187501362 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8019e190 con 0x7fdb80105ad0 2024-09-21T03:43:22.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.393+0000 7fdb85457640 1 --2- 172.21.15.84:0/2187501362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb80105ad0 0x7fdb8019db20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb78007db0 tx=0x7fdb78010420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:22.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.394+0000 7fdb7dffb640 1 -- 172.21.15.84:0/2187501362 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb78010d40 con 0x7fdb80105ad0 2024-09-21T03:43:22.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.394+0000 7fdb86eba640 1 -- 172.21.15.84:0/2187501362 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb8019e480 con 0x7fdb80105ad0 2024-09-21T03:43:22.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.394+0000 7fdb7dffb640 1 -- 172.21.15.84:0/2187501362 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb7800c640 con 0x7fdb80105ad0 2024-09-21T03:43:22.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.394+0000 7fdb7dffb640 1 -- 172.21.15.84:0/2187501362 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb78017650 con 0x7fdb80105ad0 2024-09-21T03:43:22.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.394+0000 7fdb86eba640 1 -- 172.21.15.84:0/2187501362 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb801a4ca0 con 0x7fdb80105ad0 2024-09-21T03:43:22.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.398+0000 7fdb8d42e740 1 Processor -- start 2024-09-21T03:43:22.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.398+0000 7fdb7dffb640 1 -- 172.21.15.84:0/2187501362 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7fdb78020400 con 0x7fdb80105ad0 2024-09-21T03:43:22.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.398+0000 7fdb8d42e740 1 -- start start 2024-09-21T03:43:22.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.398+0000 7fdb8d42e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269ae9070 0x559269e98ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:22.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.398+0000 7fdb8d42e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269ac01b0 0x559269e99010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:22.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.398+0000 7fdb8d42e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559269ac8390 0x559269e99550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:22.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.398+0000 7fdb8d42e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559269e06ea0 con 0x559269ae9070 2024-09-21T03:43:22.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.398+0000 7fdb8d42e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559269df62d0 con 0x559269ac01b0 2024-09-21T03:43:22.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.398+0000 7fdb8d42e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559269dfa0e0 con 0x559269ac8390 2024-09-21T03:43:22.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.399+0000 7fdb7ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269ae9070 0x559269e98ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:22.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.399+0000 7fdb7dffb640 1 --2- 172.21.15.84:0/2187501362 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdb700b67c0 0x7fdb700b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:22.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.399+0000 7fdb7ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269ae9070 0x559269e98ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55088/0 (socket says 172.21.15.84:55088) 2024-09-21T03:43:22.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.399+0000 7fdb7ffff640 1 -- 172.21.15.84:0/706533993 learned_addr learned my addr 172.21.15.84:0/706533993 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:22.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.399+0000 7fdb84c56640 1 --2- 172.21.15.84:0/706533993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269ac01b0 0x559269e99010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:22.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.399+0000 7fdb85457640 1 --2- 172.21.15.84:0/2187501362 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdb700b67c0 0x7fdb700b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:22.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.399+0000 7fdb7dffb640 1 -- 172.21.15.84:0/2187501362 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fdb780e7260 con 0x7fdb80105ad0 2024-09-21T03:43:22.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.399+0000 7fdb84c56640 1 -- 172.21.15.84:0/706533993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559269ac8390 msgr2=0x559269e99550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T03:43:22.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.399+0000 7fdb84c56640 1 --2- 172.21.15.84:0/706533993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559269ac8390 0x559269e99550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.399+0000 7fdb84c56640 1 -- 172.21.15.84:0/706533993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269ae9070 msgr2=0x559269e98ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:22.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.399+0000 7fdb84c56640 1 --2- 172.21.15.84:0/706533993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269ae9070 0x559269e98ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.400+0000 7fdb84c56640 1 -- 172.21.15.84:0/706533993 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559269b54650 con 0x559269ac01b0 2024-09-21T03:43:22.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.400+0000 7fdb7ffff640 1 --2- 172.21.15.84:0/706533993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269ae9070 0x559269e98ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:43:22.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.400+0000 7fdb84c56640 1 --2- 172.21.15.84:0/706533993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269ac01b0 0x559269e99010 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009230 tx=0x7fdb74033b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2c4ad4f518d92a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:22.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.400+0000 7fdb85457640 1 --2- 172.21.15.84:0/2187501362 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdb700b67c0 0x7fdb700b8cd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdb780e4970 tx=0x7fdb7800cd60 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:22.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.400+0000 7fdb6affd640 1 -- 172.21.15.84:0/706533993 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74041070 con 0x559269ac01b0 2024-09-21T03:43:22.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.400+0000 7fdb6affd640 1 -- 172.21.15.84:0/706533993 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb74004030 con 0x559269ac01b0 2024-09-21T03:43:22.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.401+0000 7fdb6affd640 1 -- 172.21.15.84:0/706533993 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74037040 con 0x559269ac01b0 2024-09-21T03:43:22.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.402+0000 7fdb8d42e740 1 -- 172.21.15.84:0/706533993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269ac01b0 msgr2=0x559269e99010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:22.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.402+0000 7fdb8d42e740 1 --2- 172.21.15.84:0/706533993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269ac01b0 0x559269e99010 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdb74009230 tx=0x7fdb74033b20 comp rx=0 tx=0).stop 2024-09-21T03:43:22.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.402+0000 7fdb8d42e740 1 -- 172.21.15.84:0/706533993 shutdown_connections 2024-09-21T03:43:22.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.402+0000 7fdb8d42e740 1 --2- 172.21.15.84:0/706533993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559269ac8390 0x559269e99550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.402+0000 7fdb8d42e740 1 --2- 172.21.15.84:0/706533993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269ac01b0 0x559269e99010 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.402+0000 7fdb8d42e740 1 --2- 172.21.15.84:0/706533993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269ae9070 0x559269e98ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.402+0000 7fdb8d42e740 1 -- 172.21.15.84:0/706533993 >> 172.21.15.84:0/706533993 conn(0x559269add460 msgr2=0x559269e969c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:22.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.402+0000 7fdb8d42e740 1 -- 172.21.15.84:0/706533993 shutdown_connections 2024-09-21T03:43:22.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.402+0000 7fdb8d42e740 1 -- 172.21.15.84:0/706533993 wait complete. 2024-09-21T03:43:22.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.403+0000 7fdb8d42e740 1 -- start start 2024-09-21T03:43:22.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.403+0000 7fdb8d42e740 1 Processor -- start 2024-09-21T03:43:22.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.404+0000 7fdb8d42e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559269ac01b0 0x559269ea41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:22.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.404+0000 7fdb8d42e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269ac8390 0x559269ea46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:22.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.404+0000 7fdb8d42e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269ae9070 0x559269eb0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:22.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.404+0000 7fdb8d42e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559269c57700 con 0x559269ae9070 2024-09-21T03:43:22.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.404+0000 7fdb8d42e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559269d91160 con 0x559269ac8390 2024-09-21T03:43:22.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.404+0000 7fdb8d42e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559269ea72f0 con 0x559269ac01b0 2024-09-21T03:43:22.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.404+0000 7fdb84c56640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269ac8390 0x559269ea46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:22.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.404+0000 7fdb84c56640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269ac8390 0x559269ea46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:49166/0 (socket says 172.21.15.84:49166) 2024-09-21T03:43:22.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.404+0000 7fdb84c56640 1 -- 172.21.15.84:0/2707774439 learned_addr learned my addr 172.21.15.84:0/2707774439 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:22.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.404+0000 7fdb8d42e740 10 client.0 _ll_register_callbacks cb 0x559269daa9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:22.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.404+0000 7fdb7ffff640 1 --2- 172.21.15.84:0/2707774439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559269ac01b0 0x559269ea41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:22.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.404+0000 7fdb7ffff640 1 --2- 172.21.15.84:0/2707774439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269ae9070 0x559269eb0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:22.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.405+0000 7fdb84c56640 1 -- 172.21.15.84:0/2707774439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559269ac01b0 msgr2=0x559269ea41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:22.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.405+0000 7fdb84c56640 1 --2- 172.21.15.84:0/2707774439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559269ac01b0 0x559269ea41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.405+0000 7fdb84c56640 1 -- 172.21.15.84:0/2707774439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269ae9070 msgr2=0x559269eb0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:22.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.405+0000 7fdb84c56640 1 --2- 172.21.15.84:0/2707774439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269ae9070 0x559269eb0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.405+0000 7fdb84c56640 1 -- 172.21.15.84:0/2707774439 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559269dbec90 con 0x559269ac8390 2024-09-21T03:43:22.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.405+0000 7fdb7ffff640 1 --2- 172.21.15.84:0/2707774439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269ae9070 0x559269eb0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:22.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.405+0000 7fdb84c56640 1 --2- 172.21.15.84:0/2707774439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269ac8390 0x559269ea46e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdb74033fd0 tx=0x7fdb74033660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b667d277dab906fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:22.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.405+0000 7fdb5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T03:43:22.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.408+0000 7fdb5ffff640 1 -- 172.21.15.84:0/2707774439 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74037070 con 0x559269ac8390 2024-09-21T03:43:22.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.408+0000 7fdb5ffff640 1 -- 172.21.15.84:0/2707774439 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fdb74005230 con 0x559269ac8390 2024-09-21T03:43:22.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.408+0000 7fdb8d42e740 1 -- 172.21.15.84:0/2707774439 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb74004030 con 0x559269ac8390 2024-09-21T03:43:22.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.408+0000 7fdb5ffff640 1 -- 172.21.15.84:0/2707774439 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdb74041040 con 0x559269ac8390 2024-09-21T03:43:22.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.408+0000 7fdb8d42e740 10 client.25253 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:22.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.408+0000 7fdb8d42e740 1 -- 172.21.15.84:0/2707774439 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559269eb2ff0 con 0x559269ac8390 2024-09-21T03:43:22.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.408+0000 7fdb5ffff640 1 -- 172.21.15.84:0/2707774439 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb74004030 con 0x559269ac8390 2024-09-21T03:43:22.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.409+0000 7fdb5ffff640 1 -- 172.21.15.84:0/2707774439 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdb740035f0 con 0x559269ac8390 2024-09-21T03:43:22.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.409+0000 7fdb8d42e740 10 client.25253 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:22.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.409+0000 7fdb8d42e740 10 client.25253 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:43:22.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.409+0000 7fdb8d42e740 20 client.25253 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:22.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.409+0000 7fdb8d42e740 1 --2- 172.21.15.84:0/2707774439 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x559269aa79f0 0x559269eb6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:22.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.409+0000 7fdb8d42e740 4 client.25253 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:22.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.409+0000 7fdb8d42e740 1 -- 172.21.15.84:0/2707774439 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559269e08df0 con 0x559269aa79f0 2024-09-21T03:43:22.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.409+0000 7fdb7ffff640 1 --2- 172.21.15.84:0/2707774439 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x559269aa79f0 0x559269eb6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:22.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.409+0000 7fdb5ffff640 10 client.25253 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:22.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.410+0000 7fdb7ffff640 1 --2- 172.21.15.84:0/2707774439 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x559269aa79f0 0x559269eb6350 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=632046fc2ba926c4 server_cookie=3e0b6b044710ffbe in_seq=0 out_seq=0 2024-09-21T03:43:22.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.410+0000 7fdb5ffff640 1 -- 172.21.15.84:0/2707774439 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559269e08df0 con 0x559269aa79f0 2024-09-21T03:43:22.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.410+0000 7fdb5ffff640 10 client.25253 handle_command_reply: tid=0 2024-09-21T03:43:22.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.410+0000 7fdb8d42e740 1 client.25253 shutdown 2024-09-21T03:43:22.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.411+0000 7fdb8d42e740 1 -- 172.21.15.84:0/2707774439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269ac8390 msgr2=0x559269ea46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:22.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.411+0000 7fdb8d42e740 1 --2- 172.21.15.84:0/2707774439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269ac8390 0x559269ea46e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdb74033fd0 tx=0x7fdb74033660 comp rx=0 tx=0).stop 2024-09-21T03:43:22.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.411+0000 7fdb8d42e740 1 -- 172.21.15.84:0/2707774439 shutdown_connections 2024-09-21T03:43:22.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.411+0000 7fdb8d42e740 1 --2- 172.21.15.84:0/2707774439 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x559269aa79f0 0x559269eb6350 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.411+0000 7fdb5ffff640 0 client.25253 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:22.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.411+0000 7fdb8d42e740 1 --2- 172.21.15.84:0/2707774439 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269ae9070 0x559269eb0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.411+0000 7fdb8d42e740 1 --2- 172.21.15.84:0/2707774439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269ac8390 0x559269ea46e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.411+0000 7fdb8d42e740 1 --2- 172.21.15.84:0/2707774439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559269ac01b0 0x559269ea41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.411+0000 7fdb8d42e740 1 -- 172.21.15.84:0/2707774439 >> 172.21.15.84:0/2707774439 conn(0x559269add460 msgr2=0x559269e9bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:22.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.411+0000 7fdb8d42e740 1 -- 172.21.15.84:0/2707774439 shutdown_connections 2024-09-21T03:43:22.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.411+0000 7fdb8d42e740 1 -- 172.21.15.84:0/2707774439 wait complete. 2024-09-21T03:43:22.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.411+0000 7fdb8d42e740 20 client.25253 trim_cache size 0 max 16384 2024-09-21T03:43:22.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.424+0000 7fdb8d42e740 1 Processor -- start 2024-09-21T03:43:22.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.424+0000 7fdb8d42e740 1 -- start start 2024-09-21T03:43:22.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.425+0000 7fdb8d42e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269aa79f0 0x559269ea4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:22.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.425+0000 7fdb8d42e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269ac01b0 0x559269eb05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:22.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.425+0000 7fdb8d42e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559269ac8390 0x559269ea1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:22.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.425+0000 7fdb8d42e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdb801afb00 con 0x559269aa79f0 2024-09-21T03:43:22.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.425+0000 7fdb8d42e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdb801ad3d0 con 0x559269ac01b0 2024-09-21T03:43:22.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.425+0000 7fdb8d42e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdb801ab220 con 0x559269ac8390 2024-09-21T03:43:22.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.425+0000 7fdb7ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269aa79f0 0x559269ea4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:22.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.425+0000 7fdb7ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269aa79f0 0x559269ea4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55110/0 (socket says 172.21.15.84:55110) 2024-09-21T03:43:22.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.425+0000 7fdb7ffff640 1 -- 172.21.15.84:0/2984248631 learned_addr learned my addr 172.21.15.84:0/2984248631 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:22.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.425+0000 7fdb84c56640 1 --2- 172.21.15.84:0/2984248631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269ac01b0 0x559269eb05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:22.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.425+0000 7fdb7ffff640 1 -- 172.21.15.84:0/2984248631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559269ac8390 msgr2=0x559269ea1390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T03:43:22.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.425+0000 7fdb7ffff640 1 --2- 172.21.15.84:0/2984248631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559269ac8390 0x559269ea1390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.425+0000 7fdb7ffff640 1 -- 172.21.15.84:0/2984248631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269ac01b0 msgr2=0x559269eb05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:22.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.425+0000 7fdb7ffff640 1 --2- 172.21.15.84:0/2984248631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269ac01b0 0x559269eb05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.425+0000 7fdb7ffff640 1 -- 172.21.15.84:0/2984248631 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559269e972b0 con 0x559269aa79f0 2024-09-21T03:43:22.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.426+0000 7fdb7ffff640 1 --2- 172.21.15.84:0/2984248631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269aa79f0 0x559269ea4660 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c005d00 tx=0x7fdb6c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43578e4ac5208cb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:22.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.426+0000 7fdb6a7fc640 1 -- 172.21.15.84:0/2984248631 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c005220 con 0x559269aa79f0 2024-09-21T03:43:22.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.426+0000 7fdb6a7fc640 1 -- 172.21.15.84:0/2984248631 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb6c004c50 con 0x559269aa79f0 2024-09-21T03:43:22.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.426+0000 7fdb6a7fc640 1 -- 172.21.15.84:0/2984248631 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c0119e0 con 0x559269aa79f0 2024-09-21T03:43:22.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.427+0000 7fdb8d42e740 1 -- 172.21.15.84:0/2984248631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269aa79f0 msgr2=0x559269ea4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.427+0000 7fdb8d42e740 1 --2- 172.21.15.84:0/2984248631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269aa79f0 0x559269ea4660 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c005d00 tx=0x7fdb6c00b390 comp rx=0 tx=0).stop 2024-09-21T03:43:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.427+0000 7fdb8d42e740 1 -- 172.21.15.84:0/2984248631 shutdown_connections 2024-09-21T03:43:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.427+0000 7fdb8d42e740 1 --2- 172.21.15.84:0/2984248631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559269ac8390 0x559269ea1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.427+0000 7fdb8d42e740 1 --2- 172.21.15.84:0/2984248631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269ac01b0 0x559269eb05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.427+0000 7fdb8d42e740 1 --2- 172.21.15.84:0/2984248631 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269aa79f0 0x559269ea4660 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.427+0000 7fdb8d42e740 1 -- 172.21.15.84:0/2984248631 >> 172.21.15.84:0/2984248631 conn(0x559269add460 msgr2=0x559269ea3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.427+0000 7fdb8d42e740 1 -- 172.21.15.84:0/2984248631 shutdown_connections 2024-09-21T03:43:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.427+0000 7fdb8d42e740 1 -- 172.21.15.84:0/2984248631 wait complete. 2024-09-21T03:43:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.427+0000 7fdb8d42e740 1 -- start start 2024-09-21T03:43:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.427+0000 7fdb8d42e740 1 Processor -- start 2024-09-21T03:43:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.428+0000 7fdb8d42e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269aa79f0 0x559269eb76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.428+0000 7fdb8d42e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269ac01b0 0x559269eb7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:22.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.428+0000 7fdb8d42e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559269ac8390 0x559269f1fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:22.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.428+0000 7fdb8d42e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdb801ab890 con 0x559269ac01b0 2024-09-21T03:43:22.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.428+0000 7fdb8d42e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdb801acd00 con 0x559269aa79f0 2024-09-21T03:43:22.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.428+0000 7fdb8d42e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdb801abf60 con 0x559269ac8390 2024-09-21T03:43:22.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.428+0000 7fdb8d42e740 10 client.0 _ll_register_callbacks cb 0x7fdb6c00b260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:22.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.428+0000 7fdb7ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269aa79f0 0x559269eb76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:22.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.428+0000 7fdb84c56640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269ac01b0 0x559269eb7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:22.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.428+0000 7fdb7ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269aa79f0 0x559269eb76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:49196/0 (socket says 172.21.15.84:49196) 2024-09-21T03:43:22.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.428+0000 7fdb7ffff640 1 -- 172.21.15.84:0/342625256 learned_addr learned my addr 172.21.15.84:0/342625256 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:22.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.428+0000 7fdb7ffff640 1 --2- 172.21.15.84:0/342625256 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559269ac8390 0x559269f1fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:22.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.429+0000 7fdb7ffff640 1 -- 172.21.15.84:0/342625256 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559269ac8390 msgr2=0x559269f1fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:22.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.429+0000 7fdb7ffff640 1 --2- 172.21.15.84:0/342625256 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559269ac8390 0x559269f1fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.429+0000 7fdb7ffff640 1 -- 172.21.15.84:0/342625256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269ac01b0 msgr2=0x559269eb7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:22.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.429+0000 7fdb7ffff640 1 --2- 172.21.15.84:0/342625256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269ac01b0 0x559269eb7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.429+0000 7fdb7ffff640 1 -- 172.21.15.84:0/342625256 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559269eb8460 con 0x559269aa79f0 2024-09-21T03:43:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.429+0000 7fdb84c56640 1 --2- 172.21.15.84:0/342625256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269ac01b0 0x559269eb7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:43:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.429+0000 7fdb7ffff640 1 --2- 172.21.15.84:0/342625256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269aa79f0 0x559269eb76a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c004c10 tx=0x7fdb6c011680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2a32c0662b575ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.429+0000 7fdb5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T03:43:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.429+0000 7fdb5ffff640 1 -- 172.21.15.84:0/342625256 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c038060 con 0x559269aa79f0 2024-09-21T03:43:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.429+0000 7fdb8d42e740 1 -- 172.21.15.84:0/342625256 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb6c004c50 con 0x559269aa79f0 2024-09-21T03:43:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.429+0000 7fdb5ffff640 1 -- 172.21.15.84:0/342625256 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fdb6c02b040 con 0x559269aa79f0 2024-09-21T03:43:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.429+0000 7fdb5ffff640 1 -- 172.21.15.84:0/342625256 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdb6c005210 con 0x559269aa79f0 2024-09-21T03:43:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.429+0000 7fdb8d42e740 10 client.25259 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.429+0000 7fdb8d42e740 1 -- 172.21.15.84:0/342625256 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559269f21020 con 0x559269aa79f0 2024-09-21T03:43:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.430+0000 7fdb5ffff640 1 -- 172.21.15.84:0/342625256 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb6c004c50 con 0x559269aa79f0 2024-09-21T03:43:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.430+0000 7fdb5ffff640 1 -- 172.21.15.84:0/342625256 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdb6c023480 con 0x559269aa79f0 2024-09-21T03:43:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.430+0000 7fdb8d42e740 10 client.25259 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.430+0000 7fdb8d42e740 10 client.25259 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:43:22.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.430+0000 7fdb8d42e740 20 client.25259 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:22.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.430+0000 7fdb8d42e740 1 --2- 172.21.15.84:0/342625256 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x559269ae9070 0x559269f23710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:22.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.430+0000 7fdb8d42e740 4 client.25259 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:43:22.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.430+0000 7fdb8d42e740 1 -- 172.21.15.84:0/342625256 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559269e9fd50 con 0x559269ae9070 2024-09-21T03:43:22.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.430+0000 7fdb84c56640 1 --2- 172.21.15.84:0/342625256 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x559269ae9070 0x559269f23710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:22.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.431+0000 7fdb5ffff640 10 client.25259 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:22.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.431+0000 7fdb84c56640 1 --2- 172.21.15.84:0/342625256 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x559269ae9070 0x559269f23710 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d132838851ec4608 server_cookie=436582076ce276c0 in_seq=0 out_seq=0 2024-09-21T03:43:22.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.431+0000 7fdb5ffff640 1 -- 172.21.15.84:0/342625256 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559269e9fd50 con 0x559269ae9070 2024-09-21T03:43:22.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.431+0000 7fdb5ffff640 10 client.25259 handle_command_reply: tid=0 2024-09-21T03:43:22.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.431+0000 7fdb8d42e740 1 client.25259 shutdown 2024-09-21T03:43:22.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.431+0000 7fdb8d42e740 1 -- 172.21.15.84:0/342625256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269aa79f0 msgr2=0x559269eb76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:22.437 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:43:22.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.431+0000 7fdb8d42e740 1 --2- 172.21.15.84:0/342625256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269aa79f0 0x559269eb76a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c004c10 tx=0x7fdb6c011680 comp rx=0 tx=0).stop 2024-09-21T03:43:22.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.431+0000 7fdb8d42e740 1 -- 172.21.15.84:0/342625256 shutdown_connections 2024-09-21T03:43:22.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.431+0000 7fdb8d42e740 1 --2- 172.21.15.84:0/342625256 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x559269ae9070 0x559269f23710 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.431+0000 7fdb8d42e740 1 --2- 172.21.15.84:0/342625256 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559269ac8390 0x559269f1fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.431+0000 7fdb5ffff640 0 client.25259 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:22.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.431+0000 7fdb8d42e740 1 --2- 172.21.15.84:0/342625256 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559269ac01b0 0x559269eb7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.431+0000 7fdb8d42e740 1 --2- 172.21.15.84:0/342625256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559269aa79f0 0x559269eb76a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.431+0000 7fdb8d42e740 1 -- 172.21.15.84:0/342625256 >> 172.21.15.84:0/342625256 conn(0x559269add460 msgr2=0x559269e99b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:22.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.432+0000 7fdb8d42e740 1 -- 172.21.15.84:0/342625256 shutdown_connections 2024-09-21T03:43:22.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.432+0000 7fdb8d42e740 1 -- 172.21.15.84:0/342625256 wait complete. 2024-09-21T03:43:22.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.432+0000 7fdb8d42e740 20 client.25259 trim_cache size 0 max 16384 2024-09-21T03:43:22.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.432+0000 7fdb86eba640 1 -- 172.21.15.84:0/2187501362 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdb700b67c0 msgr2=0x7fdb700b8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:22.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.432+0000 7fdb86eba640 1 --2- 172.21.15.84:0/2187501362 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdb700b67c0 0x7fdb700b8cd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdb780e4970 tx=0x7fdb7800cd60 comp rx=0 tx=0).stop 2024-09-21T03:43:22.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.432+0000 7fdb86eba640 1 -- 172.21.15.84:0/2187501362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb80105ad0 msgr2=0x7fdb8019db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.432+0000 7fdb86eba640 1 --2- 172.21.15.84:0/2187501362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb80105ad0 0x7fdb8019db20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb78007db0 tx=0x7fdb78010420 comp rx=0 tx=0).stop 2024-09-21T03:43:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.432+0000 7fdb86eba640 1 -- 172.21.15.84:0/2187501362 shutdown_connections 2024-09-21T03:43:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.432+0000 7fdb86eba640 1 --2- 172.21.15.84:0/2187501362 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdb700b67c0 0x7fdb700b8cd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.432+0000 7fdb86eba640 1 --2- 172.21.15.84:0/2187501362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb80105ad0 0x7fdb8019db20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.432+0000 7fdb86eba640 1 --2- 172.21.15.84:0/2187501362 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb80105180 0x7fdb80198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.432+0000 7fdb86eba640 1 --2- 172.21.15.84:0/2187501362 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb80103100 0x7fdb801982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.432+0000 7fdb86eba640 1 -- 172.21.15.84:0/2187501362 >> 172.21.15.84:0/2187501362 conn(0x7fdb80077c60 msgr2=0x7fdb80106450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.432+0000 7fdb86eba640 1 -- 172.21.15.84:0/2187501362 shutdown_connections 2024-09-21T03:43:22.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:22.432+0000 7fdb86eba640 1 -- 172.21.15.84:0/2187501362 wait complete. 2024-09-21T03:43:23.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:23 smithi084 ceph-mon[30941]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:43:23.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:23 smithi174 ceph-mon[34403]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:43:23.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:23 smithi172 ceph-mon[34821]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:43:24.281 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:43:24.282 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:43:24.669 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:25.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.257+0000 7f81fb8d1640 1 -- 172.21.15.84:0/3232821677 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81f4108d10 msgr2=0x7f81f410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:25.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.257+0000 7f81fb8d1640 1 --2- 172.21.15.84:0/3232821677 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81f4108d10 0x7f81f410f540 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009ca0 tx=0x7f81ec02a8e0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.257+0000 7f81fb8d1640 1 -- 172.21.15.84:0/3232821677 shutdown_connections 2024-09-21T03:43:25.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.257+0000 7f81fb8d1640 1 --2- 172.21.15.84:0/3232821677 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81f4108d10 0x7f81f410f540 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.257+0000 7f81fb8d1640 1 --2- 172.21.15.84:0/3232821677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81f41083c0 0x7f81f41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.257+0000 7f81fb8d1640 1 --2- 172.21.15.84:0/3232821677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81f4102a80 0x7f81f4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.257+0000 7f81fb8d1640 1 -- 172.21.15.84:0/3232821677 >> 172.21.15.84:0/3232821677 conn(0x7f81f4079740 msgr2=0x7f81f4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:25.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.258+0000 7f81fb8d1640 1 -- 172.21.15.84:0/3232821677 shutdown_connections 2024-09-21T03:43:25.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.258+0000 7f81fb8d1640 1 -- 172.21.15.84:0/3232821677 wait complete. 2024-09-21T03:43:25.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.259+0000 7f81fb8d1640 1 Processor -- start 2024-09-21T03:43:25.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.259+0000 7f81fb8d1640 1 -- start start 2024-09-21T03:43:25.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.259+0000 7f81fb8d1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81f4102a80 0x7f81f4198ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:25.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.259+0000 7f81fb8d1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81f41083c0 0x7f81f4199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:25.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.259+0000 7f81fb8d1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81f4108d10 0x7f81f4199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:25.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.259+0000 7f81fb8d1640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f81f41129d0 con 0x7f81f41083c0 2024-09-21T03:43:25.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.259+0000 7f81fb8d1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f81f4112850 con 0x7f81f4102a80 2024-09-21T03:43:25.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.259+0000 7f81fb8d1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f81f4112b50 con 0x7f81f4108d10 2024-09-21T03:43:25.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.260+0000 7f81f966d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81f4102a80 0x7f81f4198ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:25.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.260+0000 7f81f8e6c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81f41083c0 0x7f81f4199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:25.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.260+0000 7f81f8e6c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81f41083c0 0x7f81f4199530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55130/0 (socket says 172.21.15.84:55130) 2024-09-21T03:43:25.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.260+0000 7f81f966d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81f4102a80 0x7f81f4198ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:49204/0 (socket says 172.21.15.84:49204) 2024-09-21T03:43:25.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.260+0000 7f81f8e6c640 1 -- 172.21.15.84:0/2824028417 learned_addr learned my addr 172.21.15.84:0/2824028417 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:25.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.260+0000 7f81f9e6e640 1 --2- 172.21.15.84:0/2824028417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81f4108d10 0x7f81f4199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:25.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.260+0000 7f81f8e6c640 1 -- 172.21.15.84:0/2824028417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81f4108d10 msgr2=0x7f81f4199a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:25.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.260+0000 7f81f8e6c640 1 --2- 172.21.15.84:0/2824028417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81f4108d10 0x7f81f4199a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.260+0000 7f81f8e6c640 1 -- 172.21.15.84:0/2824028417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81f4102a80 msgr2=0x7f81f4198ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:25.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.260+0000 7f81f8e6c640 1 --2- 172.21.15.84:0/2824028417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81f4102a80 0x7f81f4198ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.260+0000 7f81f8e6c640 1 -- 172.21.15.84:0/2824028417 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f41a86f0 con 0x7f81f41083c0 2024-09-21T03:43:25.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.260+0000 7f81f8e6c640 1 --2- 172.21.15.84:0/2824028417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81f41083c0 0x7f81f4199530 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f81e400e9f0 tx=0x7f81e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:25.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.261+0000 7f81ea7fc640 1 -- 172.21.15.84:0/2824028417 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e400cd80 con 0x7f81f41083c0 2024-09-21T03:43:25.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.261+0000 7f81fb8d1640 1 -- 172.21.15.84:0/2824028417 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f41a89e0 con 0x7f81f41083c0 2024-09-21T03:43:25.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.261+0000 7f81fb8d1640 1 -- 172.21.15.84:0/2824028417 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f41a8f70 con 0x7f81f41083c0 2024-09-21T03:43:25.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.261+0000 7f81ea7fc640 1 -- 172.21.15.84:0/2824028417 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81e40054d0 con 0x7f81f41083c0 2024-09-21T03:43:25.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.262+0000 7f81ea7fc640 1 -- 172.21.15.84:0/2824028417 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e4021440 con 0x7f81f41083c0 2024-09-21T03:43:25.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.264+0000 7f81ea7fc640 1 -- 172.21.15.84:0/2824028417 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7f81e40215e0 con 0x7f81f41083c0 2024-09-21T03:43:25.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.265+0000 7f8201e45740 1 Processor -- start 2024-09-21T03:43:25.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.265+0000 7f8201e45740 1 -- start start 2024-09-21T03:43:25.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.265+0000 7f81ea7fc640 1 --2- 172.21.15.84:0/2824028417 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f81e00b6710 0x7f81e00b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:25.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.265+0000 7f81f9e6e640 1 --2- 172.21.15.84:0/2824028417 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f81e00b6710 0x7f81e00b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:25.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.265+0000 7f8201e45740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd7629d350 0x55bd76644430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:25.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.265+0000 7f8201e45740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd76274490 0x55bd76644970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:25.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.265+0000 7f8201e45740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7627c670 0x55bd76644eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:25.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.265+0000 7f8201e45740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55bd765bae60 con 0x55bd7627c670 2024-09-21T03:43:25.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.265+0000 7f81ea7fc640 1 -- 172.21.15.84:0/2824028417 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f81e40e7b00 con 0x7f81f41083c0 2024-09-21T03:43:25.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.265+0000 7f8201e45740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bd765aa290 con 0x55bd76274490 2024-09-21T03:43:25.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.266+0000 7f8201e45740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55bd765ae0a0 con 0x55bd7629d350 2024-09-21T03:43:25.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.266+0000 7f81f966d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd7629d350 0x55bd76644430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:25.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.266+0000 7f81f9e6e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7627c670 0x55bd76644eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:25.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.266+0000 7f81f9e6e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7627c670 0x55bd76644eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55138/0 (socket says 172.21.15.84:55138) 2024-09-21T03:43:25.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.266+0000 7f81f9e6e640 1 -- 172.21.15.84:0/4275185324 learned_addr learned my addr 172.21.15.84:0/4275185324 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:25.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.266+0000 7f81f9e6e640 1 --2- 172.21.15.84:0/2824028417 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f81e00b6710 0x7f81e00b8c20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f81ec006010 tx=0x7f81ec031550 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:25.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.266+0000 7f81f8e6c640 1 --2- 172.21.15.84:0/4275185324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd76274490 0x55bd76644970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:25.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.266+0000 7f81f9e6e640 1 -- 172.21.15.84:0/4275185324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd7629d350 msgr2=0x55bd76644430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:25.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.266+0000 7f81f9e6e640 1 --2- 172.21.15.84:0/4275185324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd7629d350 0x55bd76644430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.266+0000 7f81f9e6e640 1 -- 172.21.15.84:0/4275185324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd76274490 msgr2=0x55bd76644970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:25.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.266+0000 7f81f9e6e640 1 --2- 172.21.15.84:0/4275185324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd76274490 0x55bd76644970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.266+0000 7f81f9e6e640 1 -- 172.21.15.84:0/4275185324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd76308930 con 0x55bd7627c670 2024-09-21T03:43:25.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.267+0000 7f81f9e6e640 1 --2- 172.21.15.84:0/4275185324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7627c670 0x55bd76644eb0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009ca0 tx=0x7f81ec046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b51cce2c1a0e23 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:25.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.267+0000 7f81df7fe640 1 -- 172.21.15.84:0/4275185324 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec041040 con 0x55bd7627c670 2024-09-21T03:43:25.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.267+0000 7f81df7fe640 1 -- 172.21.15.84:0/4275185324 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81ec04c070 con 0x55bd7627c670 2024-09-21T03:43:25.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.267+0000 7f81df7fe640 1 -- 172.21.15.84:0/4275185324 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec030c50 con 0x55bd7627c670 2024-09-21T03:43:25.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.268+0000 7f8201e45740 1 -- 172.21.15.84:0/4275185324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7627c670 msgr2=0x55bd76644eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:25.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.268+0000 7f8201e45740 1 --2- 172.21.15.84:0/4275185324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7627c670 0x55bd76644eb0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f81ec009ca0 tx=0x7f81ec046000 comp rx=0 tx=0).stop 2024-09-21T03:43:25.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.268+0000 7f8201e45740 1 -- 172.21.15.84:0/4275185324 shutdown_connections 2024-09-21T03:43:25.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.268+0000 7f8201e45740 1 --2- 172.21.15.84:0/4275185324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7627c670 0x55bd76644eb0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.268+0000 7f8201e45740 1 --2- 172.21.15.84:0/4275185324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd76274490 0x55bd76644970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.268+0000 7f8201e45740 1 --2- 172.21.15.84:0/4275185324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd7629d350 0x55bd76644430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.268+0000 7f8201e45740 1 -- 172.21.15.84:0/4275185324 >> 172.21.15.84:0/4275185324 conn(0x55bd76291740 msgr2=0x55bd76642320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:25.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.269+0000 7f8201e45740 1 -- 172.21.15.84:0/4275185324 shutdown_connections 2024-09-21T03:43:25.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.269+0000 7f8201e45740 1 -- 172.21.15.84:0/4275185324 wait complete. 2024-09-21T03:43:25.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.269+0000 7f8201e45740 1 -- start start 2024-09-21T03:43:25.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.269+0000 7f8201e45740 1 Processor -- start 2024-09-21T03:43:25.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.270+0000 7f8201e45740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd76274490 0x55bd7664fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:25.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.270+0000 7f8201e45740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd7627c670 0x55bd76650530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:25.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.270+0000 7f8201e45740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd7629d350 0x55bd7665bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:25.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.270+0000 7f8201e45740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55bd7640b890 con 0x55bd76274490 2024-09-21T03:43:25.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.270+0000 7f8201e45740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bd76544d40 con 0x55bd7629d350 2024-09-21T03:43:25.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.270+0000 7f8201e45740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55bd76652bb0 con 0x55bd7627c670 2024-09-21T03:43:25.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.270+0000 7f8201e45740 10 client.0 _ll_register_callbacks cb 0x55bd765a8c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:25.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.270+0000 7f81f966d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd76274490 0x55bd7664fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:25.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.270+0000 7f81f966d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd76274490 0x55bd7664fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55146/0 (socket says 172.21.15.84:55146) 2024-09-21T03:43:25.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.270+0000 7f81f966d640 1 -- 172.21.15.84:0/348056058 learned_addr learned my addr 172.21.15.84:0/348056058 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:25.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.270+0000 7f81f8e6c640 1 --2- 172.21.15.84:0/348056058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd7627c670 0x55bd76650530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:25.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.270+0000 7f81f966d640 1 -- 172.21.15.84:0/348056058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd7627c670 msgr2=0x55bd76650530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:25.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.270+0000 7f81f966d640 1 --2- 172.21.15.84:0/348056058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd7627c670 0x55bd76650530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.270+0000 7f81f966d640 1 -- 172.21.15.84:0/348056058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd7629d350 msgr2=0x55bd7665bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:25.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.270+0000 7f81f966d640 1 --2- 172.21.15.84:0/348056058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd7629d350 0x55bd7665bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.270+0000 7f81f966d640 1 -- 172.21.15.84:0/348056058 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd7665c470 con 0x55bd76274490 2024-09-21T03:43:25.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.270+0000 7f81f8e6c640 1 --2- 172.21.15.84:0/348056058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd7627c670 0x55bd76650530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:25.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.271+0000 7f81f966d640 1 --2- 172.21.15.84:0/348056058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd76274490 0x55bd7664fff0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f81f0010820 tx=0x7f81f0010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ad16f0f6c7a534 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:25.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.271+0000 7f81dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:43:25.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.271+0000 7f81dcff9640 1 -- 172.21.15.84:0/348056058 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f001e060 con 0x55bd76274490 2024-09-21T03:43:25.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.271+0000 7f81dcff9640 1 -- 172.21.15.84:0/348056058 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f81f000fb30 con 0x55bd76274490 2024-09-21T03:43:25.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.271+0000 7f8201e45740 1 -- 172.21.15.84:0/348056058 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81ec04c070 con 0x55bd76274490 2024-09-21T03:43:25.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.271+0000 7f81dcff9640 1 -- 172.21.15.84:0/348056058 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f81f000fd70 con 0x55bd76274490 2024-09-21T03:43:25.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.271+0000 7f8201e45740 10 client.15705 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:25.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.272+0000 7f8201e45740 1 -- 172.21.15.84:0/348056058 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bd7665ee30 con 0x55bd76274490 2024-09-21T03:43:25.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.272+0000 7f81dcff9640 1 -- 172.21.15.84:0/348056058 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81ec04c070 con 0x55bd76274490 2024-09-21T03:43:25.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.272+0000 7f81dcff9640 1 -- 172.21.15.84:0/348056058 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f81f000e4d0 con 0x55bd76274490 2024-09-21T03:43:25.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.272+0000 7f8201e45740 10 client.15705 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:25.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.272+0000 7f8201e45740 10 client.15705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:43:25.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.272+0000 7f8201e45740 20 client.15705 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:25.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.272+0000 7f8201e45740 1 --2- 172.21.15.84:0/348056058 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bd7625bcd0 0x55bd76662510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:25.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.272+0000 7f8201e45740 4 client.15705 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:25.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.272+0000 7f8201e45740 1 -- 172.21.15.84:0/348056058 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd765bcdb0 con 0x55bd7625bcd0 2024-09-21T03:43:25.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.273+0000 7f81f8e6c640 1 --2- 172.21.15.84:0/348056058 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bd7625bcd0 0x55bd76662510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:25.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.273+0000 7f81f8e6c640 1 --2- 172.21.15.84:0/348056058 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bd7625bcd0 0x55bd76662510 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bccfbf07e2d11f2d server_cookie=f521921b097bda62 in_seq=0 out_seq=0 2024-09-21T03:43:25.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.273+0000 7f81dcff9640 10 client.15705 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:25.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.274+0000 7f81dcff9640 1 -- 172.21.15.84:0/348056058 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bd765bcdb0 con 0x55bd7625bcd0 2024-09-21T03:43:25.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.274+0000 7f81dcff9640 10 client.15705 handle_command_reply: tid=0 2024-09-21T03:43:25.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.274+0000 7f8201e45740 1 client.15705 shutdown 2024-09-21T03:43:25.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.275+0000 7f8201e45740 1 -- 172.21.15.84:0/348056058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd76274490 msgr2=0x55bd7664fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:25.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.275+0000 7f8201e45740 1 --2- 172.21.15.84:0/348056058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd76274490 0x55bd7664fff0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f81f0010820 tx=0x7f81f0010ce0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.275+0000 7f8201e45740 1 -- 172.21.15.84:0/348056058 shutdown_connections 2024-09-21T03:43:25.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.275+0000 7f8201e45740 1 --2- 172.21.15.84:0/348056058 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bd7625bcd0 0x55bd76662510 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.275+0000 7f8201e45740 1 --2- 172.21.15.84:0/348056058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd7629d350 0x55bd7665bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.275+0000 7f8201e45740 1 --2- 172.21.15.84:0/348056058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd7627c670 0x55bd76650530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.275+0000 7f81dcff9640 0 client.15705 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:25.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.275+0000 7f8201e45740 1 --2- 172.21.15.84:0/348056058 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd76274490 0x55bd7664fff0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.275+0000 7f8201e45740 1 -- 172.21.15.84:0/348056058 >> 172.21.15.84:0/348056058 conn(0x55bd76291740 msgr2=0x55bd766475c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:25.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.275+0000 7f8201e45740 1 -- 172.21.15.84:0/348056058 shutdown_connections 2024-09-21T03:43:25.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.275+0000 7f8201e45740 1 -- 172.21.15.84:0/348056058 wait complete. 2024-09-21T03:43:25.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.275+0000 7f8201e45740 20 client.15705 trim_cache size 0 max 16384 2024-09-21T03:43:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.309+0000 7f8201e45740 1 Processor -- start 2024-09-21T03:43:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.310+0000 7f8201e45740 1 -- start start 2024-09-21T03:43:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.310+0000 7f8201e45740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd76274490 0x55bd7665be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.310+0000 7f8201e45740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd7627c670 0x55bd7664f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.310+0000 7f8201e45740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7629d350 0x55bd76651a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.310+0000 7f8201e45740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f81d8010eb0 con 0x55bd7629d350 2024-09-21T03:43:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.310+0000 7f8201e45740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f81d800e780 con 0x55bd7627c670 2024-09-21T03:43:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.310+0000 7f8201e45740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f81d800c5d0 con 0x55bd76274490 2024-09-21T03:43:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.310+0000 7f81f9e6e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7629d350 0x55bd76651a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:25.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.310+0000 7f81f9e6e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7629d350 0x55bd76651a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55154/0 (socket says 172.21.15.84:55154) 2024-09-21T03:43:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.310+0000 7f81f9e6e640 1 -- 172.21.15.84:0/148168996 learned_addr learned my addr 172.21.15.84:0/148168996 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.310+0000 7f81f8e6c640 1 --2- 172.21.15.84:0/148168996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd7627c670 0x55bd7664f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.310+0000 7f81f966d640 1 --2- 172.21.15.84:0/148168996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd76274490 0x55bd7665be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.311+0000 7f81f9e6e640 1 -- 172.21.15.84:0/148168996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd76274490 msgr2=0x55bd7665be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.311+0000 7f81f9e6e640 1 --2- 172.21.15.84:0/148168996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd76274490 0x55bd7665be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.311+0000 7f81f9e6e640 1 -- 172.21.15.84:0/148168996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd7627c670 msgr2=0x55bd7664f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.311+0000 7f81f9e6e640 1 --2- 172.21.15.84:0/148168996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd7627c670 0x55bd7664f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.311+0000 7f81f9e6e640 1 -- 172.21.15.84:0/148168996 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd76646720 con 0x55bd7629d350 2024-09-21T03:43:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.311+0000 7f81f9e6e640 1 --2- 172.21.15.84:0/148168996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7629d350 0x55bd76651a20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f81ec02ae00 tx=0x7f81ec02af80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3587b2a3e9a5d39 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.311+0000 7f81deffd640 1 -- 172.21.15.84:0/148168996 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec041050 con 0x55bd7629d350 2024-09-21T03:43:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.311+0000 7f81deffd640 1 -- 172.21.15.84:0/148168996 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81ec055070 con 0x55bd7629d350 2024-09-21T03:43:25.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.311+0000 7f81deffd640 1 -- 172.21.15.84:0/148168996 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ec004470 con 0x55bd7629d350 2024-09-21T03:43:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.312+0000 7f8201e45740 1 -- 172.21.15.84:0/148168996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7629d350 msgr2=0x55bd76651a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.313+0000 7f8201e45740 1 --2- 172.21.15.84:0/148168996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7629d350 0x55bd76651a20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f81ec02ae00 tx=0x7f81ec02af80 comp rx=0 tx=0).stop 2024-09-21T03:43:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.313+0000 7f8201e45740 1 -- 172.21.15.84:0/148168996 shutdown_connections 2024-09-21T03:43:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.313+0000 7f8201e45740 1 --2- 172.21.15.84:0/148168996 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7629d350 0x55bd76651a20 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.313+0000 7f8201e45740 1 --2- 172.21.15.84:0/148168996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd7627c670 0x55bd7664f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.313+0000 7f8201e45740 1 --2- 172.21.15.84:0/148168996 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd76274490 0x55bd7665be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.313+0000 7f8201e45740 1 -- 172.21.15.84:0/148168996 >> 172.21.15.84:0/148168996 conn(0x55bd76291740 msgr2=0x55bd76651310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.313+0000 7f8201e45740 1 -- 172.21.15.84:0/148168996 shutdown_connections 2024-09-21T03:43:25.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.313+0000 7f8201e45740 1 -- 172.21.15.84:0/148168996 wait complete. 2024-09-21T03:43:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.313+0000 7f8201e45740 1 -- start start 2024-09-21T03:43:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.314+0000 7f8201e45740 1 Processor -- start 2024-09-21T03:43:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.314+0000 7f8201e45740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd76274490 0x55bd76654770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.315+0000 7f8201e45740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7627c670 0x55bd76654d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.315+0000 7f81f8e6c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7627c670 0x55bd76654d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.315+0000 7f81f8e6c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7627c670 0x55bd76654d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55162/0 (socket says 172.21.15.84:55162) 2024-09-21T03:43:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.315+0000 7f81f8e6c640 1 -- 172.21.15.84:0/2494187785 learned_addr learned my addr 172.21.15.84:0/2494187785 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.315+0000 7f8201e45740 1 --2- 172.21.15.84:0/2494187785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd7629d350 0x55bd766c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.315+0000 7f8201e45740 1 -- 172.21.15.84:0/2494187785 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f81d800cc40 con 0x55bd7627c670 2024-09-21T03:43:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.315+0000 7f81f966d640 1 --2- 172.21.15.84:0/2494187785 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd76274490 0x55bd76654770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.315+0000 7f8201e45740 1 -- 172.21.15.84:0/2494187785 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f81d800e0b0 con 0x55bd7629d350 2024-09-21T03:43:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.315+0000 7f8201e45740 1 -- 172.21.15.84:0/2494187785 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f81d800d310 con 0x55bd76274490 2024-09-21T03:43:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.315+0000 7f81f9e6e640 1 --2- 172.21.15.84:0/2494187785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd7629d350 0x55bd766c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.315+0000 7f81f8e6c640 1 -- 172.21.15.84:0/2494187785 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd76274490 msgr2=0x55bd76654770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:25.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.315+0000 7f81f8e6c640 1 --2- 172.21.15.84:0/2494187785 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd76274490 0x55bd76654770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.315+0000 7f81f8e6c640 1 -- 172.21.15.84:0/2494187785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd7629d350 msgr2=0x55bd766c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.315+0000 7f81f8e6c640 1 --2- 172.21.15.84:0/2494187785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd7629d350 0x55bd766c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.315+0000 7f81f8e6c640 1 -- 172.21.15.84:0/2494187785 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd766c6580 con 0x55bd7627c670 2024-09-21T03:43:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.316+0000 7f8201e45740 10 client.0 _ll_register_callbacks cb 0x7f81f000a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.316+0000 7f81f8e6c640 1 --2- 172.21.15.84:0/2494187785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7627c670 0x55bd76654d30 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f81e4004ad0 tx=0x7f81e40ad090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f188099a6e57312 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.316+0000 7f8201e45740 1 -- 172.21.15.84:0/2494187785 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81ec055070 con 0x55bd7627c670 2024-09-21T03:43:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.316+0000 7f81dcff9640 10 client.15711 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:43:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.316+0000 7f81dcff9640 1 -- 172.21.15.84:0/2494187785 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e40048c0 con 0x55bd7627c670 2024-09-21T03:43:25.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.316+0000 7f81dcff9640 1 -- 172.21.15.84:0/2494187785 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f81e40e54c0 con 0x55bd7627c670 2024-09-21T03:43:25.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.316+0000 7f81dcff9640 1 -- 172.21.15.84:0/2494187785 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f81e40b2340 con 0x55bd7627c670 2024-09-21T03:43:25.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.317+0000 7f8201e45740 10 client.15711 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:25.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.317+0000 7f8201e45740 1 -- 172.21.15.84:0/2494187785 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55bd766cd820 con 0x55bd7627c670 2024-09-21T03:43:25.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.317+0000 7f81dcff9640 1 -- 172.21.15.84:0/2494187785 <== mon.0 v2:172.21.15.84:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f81e40aeb90 con 0x55bd7627c670 2024-09-21T03:43:25.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.317+0000 7f8201e45740 10 client.15711 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:25.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.317+0000 7f8201e45740 10 client.15711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:43:25.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.318+0000 7f8201e45740 20 client.15711 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:25.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.318+0000 7f8201e45740 1 --2- 172.21.15.84:0/2494187785 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bd76231080 0x55bd766cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:25.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.318+0000 7f8201e45740 4 client.15711 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:43:25.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.318+0000 7f8201e45740 1 -- 172.21.15.84:0/2494187785 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f81ec055070 con 0x55bd76231080 2024-09-21T03:43:25.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.318+0000 7f81f966d640 1 --2- 172.21.15.84:0/2494187785 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bd76231080 0x55bd766cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:25.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.319+0000 7f81dcff9640 10 client.15711 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:25.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.319+0000 7f81f966d640 1 --2- 172.21.15.84:0/2494187785 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bd76231080 0x55bd766cfed0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7eb7adc71f071c65 server_cookie=f6172222792b5409 in_seq=0 out_seq=0 2024-09-21T03:43:25.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.320+0000 7f81dcff9640 1 -- 172.21.15.84:0/2494187785 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f81ec055070 con 0x55bd76231080 2024-09-21T03:43:25.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.320+0000 7f81dcff9640 10 client.15711 handle_command_reply: tid=0 2024-09-21T03:43:25.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.320+0000 7f8201e45740 1 client.15711 shutdown 2024-09-21T03:43:25.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.321+0000 7f8201e45740 1 -- 172.21.15.84:0/2494187785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7627c670 msgr2=0x55bd76654d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:25.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.321+0000 7f8201e45740 1 --2- 172.21.15.84:0/2494187785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7627c670 0x55bd76654d30 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f81e4004ad0 tx=0x7f81e40ad090 comp rx=0 tx=0).stop 2024-09-21T03:43:25.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.321+0000 7f8201e45740 1 -- 172.21.15.84:0/2494187785 shutdown_connections 2024-09-21T03:43:25.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.321+0000 7f8201e45740 1 --2- 172.21.15.84:0/2494187785 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bd76231080 0x55bd766cfed0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.321+0000 7f8201e45740 1 --2- 172.21.15.84:0/2494187785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bd7629d350 0x55bd766c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.321+0000 7f8201e45740 1 --2- 172.21.15.84:0/2494187785 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bd7627c670 0x55bd76654d30 secure :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f81e4004ad0 tx=0x7f81e40ad090 comp rx=0 tx=0).stop 2024-09-21T03:43:25.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.321+0000 7f8201e45740 1 --2- 172.21.15.84:0/2494187785 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bd76274490 0x55bd76654770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.321+0000 7f8201e45740 1 -- 172.21.15.84:0/2494187785 >> 172.21.15.84:0/2494187785 conn(0x55bd76291740 msgr2=0x55bd76651c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:25.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.321+0000 7f81dcff9640 0 client.15711 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:25.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.322+0000 7f8201e45740 1 -- 172.21.15.84:0/2494187785 shutdown_connections 2024-09-21T03:43:25.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.322+0000 7f8201e45740 1 -- 172.21.15.84:0/2494187785 wait complete. 2024-09-21T03:43:25.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.322+0000 7f8201e45740 20 client.15711 trim_cache size 0 max 16384 2024-09-21T03:43:25.325 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:43:25.325 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T03:43:25.325 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "a134896d-df56-4c5c-9871-49e10f1f62c3", 2024-09-21T03:43:25.325 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T03:43:25.325 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:43:25.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.323+0000 7f81fb8d1640 1 -- 172.21.15.84:0/2824028417 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f81e00b6710 msgr2=0x7f81e00b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:25.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.323+0000 7f81fb8d1640 1 --2- 172.21.15.84:0/2824028417 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f81e00b6710 0x7f81e00b8c20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f81ec006010 tx=0x7f81ec031550 comp rx=0 tx=0).stop 2024-09-21T03:43:25.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.323+0000 7f81fb8d1640 1 -- 172.21.15.84:0/2824028417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81f41083c0 msgr2=0x7f81f4199530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:25.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.323+0000 7f81fb8d1640 1 --2- 172.21.15.84:0/2824028417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81f41083c0 0x7f81f4199530 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f81e400e9f0 tx=0x7f81e400eeb0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.323+0000 7f81fb8d1640 1 -- 172.21.15.84:0/2824028417 shutdown_connections 2024-09-21T03:43:25.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.323+0000 7f81fb8d1640 1 --2- 172.21.15.84:0/2824028417 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f81e00b6710 0x7f81e00b8c20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.323+0000 7f81fb8d1640 1 --2- 172.21.15.84:0/2824028417 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f81f4108d10 0x7f81f4199a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.323+0000 7f81fb8d1640 1 --2- 172.21.15.84:0/2824028417 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f81f41083c0 0x7f81f4199530 secure :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f81e400e9f0 tx=0x7f81e400eeb0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.323+0000 7f81fb8d1640 1 --2- 172.21.15.84:0/2824028417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81f4102a80 0x7f81f4198ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.323+0000 7f81fb8d1640 1 -- 172.21.15.84:0/2824028417 >> 172.21.15.84:0/2824028417 conn(0x7f81f4079740 msgr2=0x7f81f41043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.326+0000 7f81fb8d1640 1 -- 172.21.15.84:0/2824028417 shutdown_connections 2024-09-21T03:43:25.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:25.326+0000 7f81fb8d1640 1 -- 172.21.15.84:0/2824028417 wait complete. 2024-09-21T03:43:25.410 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:25 smithi084 ceph-mon[30941]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T03:43:25.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:25 smithi174 ceph-mon[34403]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T03:43:25.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:25 smithi172 ceph-mon[34821]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T03:43:26.418 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:43:26.674 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:26.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:26 smithi084 ceph-mon[30941]: scrub queued for path: / 2024-09-21T03:43:26.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:26 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:26.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:26 smithi084 ceph-mon[30941]: scrub summary: active paths [/] 2024-09-21T03:43:26.681 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:26 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:26.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:26 smithi174 ceph-mon[34403]: scrub queued for path: / 2024-09-21T03:43:26.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:26 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:26.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:26 smithi174 ceph-mon[34403]: scrub summary: active paths [/] 2024-09-21T03:43:26.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:26 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:26.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:26 smithi172 ceph-mon[34821]: scrub queued for path: / 2024-09-21T03:43:26.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:26 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:26.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:26 smithi172 ceph-mon[34821]: scrub summary: active paths [/] 2024-09-21T03:43:26.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:26 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:27.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.246+0000 7fdf011e0640 1 -- 172.21.15.84:0/2081611273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdefc103180 msgr2=0x7fdefc103590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:27.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.246+0000 7fdf011e0640 1 --2- 172.21.15.84:0/2081611273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdefc103180 0x7fdefc103590 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009900 tx=0x7fdeec02a410 comp rx=0 tx=0).stop 2024-09-21T03:43:27.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.246+0000 7fdf011e0640 1 -- 172.21.15.84:0/2081611273 shutdown_connections 2024-09-21T03:43:27.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.246+0000 7fdf011e0640 1 --2- 172.21.15.84:0/2081611273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdefc108d00 0x7fdefc10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.246+0000 7fdf011e0640 1 --2- 172.21.15.84:0/2081611273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdefc1083b0 0x7fdefc1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.246+0000 7fdf011e0640 1 --2- 172.21.15.84:0/2081611273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdefc103180 0x7fdefc103590 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.246+0000 7fdf011e0640 1 -- 172.21.15.84:0/2081611273 >> 172.21.15.84:0/2081611273 conn(0x7fdefc077c60 msgr2=0x7fdefc0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:27.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.246+0000 7fdf011e0640 1 -- 172.21.15.84:0/2081611273 shutdown_connections 2024-09-21T03:43:27.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.246+0000 7fdf011e0640 1 -- 172.21.15.84:0/2081611273 wait complete. 2024-09-21T03:43:27.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.248+0000 7fdf011e0640 1 Processor -- start 2024-09-21T03:43:27.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.249+0000 7fdf011e0640 1 -- start start 2024-09-21T03:43:27.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.249+0000 7fdf011e0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdefc103180 0x7fdefc1993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:27.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.249+0000 7fdf011e0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdefc1083b0 0x7fdefc199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:27.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.250+0000 7fdf011e0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdefc108d00 0x7fdefc19ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:27.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.250+0000 7fdf011e0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc112a10 con 0x7fdefc108d00 2024-09-21T03:43:27.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.250+0000 7fdf011e0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc112890 con 0x7fdefc1083b0 2024-09-21T03:43:27.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.250+0000 7fdf011e0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc112b90 con 0x7fdefc103180 2024-09-21T03:43:27.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.250+0000 7fdefad9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdefc103180 0x7fdefc1993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:27.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.250+0000 7fdefad9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdefc103180 0x7fdefc1993e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.84:39210/0 (socket says 172.21.15.84:39210) 2024-09-21T03:43:27.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.250+0000 7fdefad9d640 1 -- 172.21.15.84:0/2284761658 learned_addr learned my addr 172.21.15.84:0/2284761658 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:27.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.250+0000 7fdefa59c640 1 --2- 172.21.15.84:0/2284761658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdefc1083b0 0x7fdefc199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:27.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.250+0000 7fdefb59e640 1 --2- 172.21.15.84:0/2284761658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdefc108d00 0x7fdefc19ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:27.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.250+0000 7fdefa59c640 1 -- 172.21.15.84:0/2284761658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdefc103180 msgr2=0x7fdefc1993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:27.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.250+0000 7fdefa59c640 1 --2- 172.21.15.84:0/2284761658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdefc103180 0x7fdefc1993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.250+0000 7fdefa59c640 1 -- 172.21.15.84:0/2284761658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdefc108d00 msgr2=0x7fdefc19ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:27.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.250+0000 7fdefa59c640 1 --2- 172.21.15.84:0/2284761658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdefc108d00 0x7fdefc19ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.250+0000 7fdefa59c640 1 -- 172.21.15.84:0/2284761658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdefc19f350 con 0x7fdefc1083b0 2024-09-21T03:43:27.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.251+0000 7fdefa59c640 1 --2- 172.21.15.84:0/2284761658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdefc1083b0 0x7fdefc199980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdefc075ab0 tx=0x7fdef000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:27.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.251+0000 7fdee3fff640 1 -- 172.21.15.84:0/2284761658 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef000cc40 con 0x7fdefc1083b0 2024-09-21T03:43:27.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.251+0000 7fdf011e0640 1 -- 172.21.15.84:0/2284761658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdefc19f640 con 0x7fdefc1083b0 2024-09-21T03:43:27.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.251+0000 7fdee3fff640 1 -- 172.21.15.84:0/2284761658 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdef000cde0 con 0x7fdefc1083b0 2024-09-21T03:43:27.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.251+0000 7fdee3fff640 1 -- 172.21.15.84:0/2284761658 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef0018760 con 0x7fdefc1083b0 2024-09-21T03:43:27.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.251+0000 7fdf011e0640 1 -- 172.21.15.84:0/2284761658 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdefc1a5da0 con 0x7fdefc1083b0 2024-09-21T03:43:27.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.255+0000 7fdf07754740 1 Processor -- start 2024-09-21T03:43:27.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.255+0000 7fdf07754740 1 -- start start 2024-09-21T03:43:27.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.256+0000 7fdf07754740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe74b6070 0x55bfe785d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:27.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.256+0000 7fdf07754740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe748d1b0 0x55bfe785d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:27.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.256+0000 7fdf07754740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfe7495390 0x55bfe785dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:27.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.256+0000 7fdf07754740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55bfe77d3e50 con 0x55bfe748d1b0 2024-09-21T03:43:27.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.256+0000 7fdf07754740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bfe77c3280 con 0x55bfe7495390 2024-09-21T03:43:27.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.256+0000 7fdf07754740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55bfe77c7090 con 0x55bfe74b6070 2024-09-21T03:43:27.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.256+0000 7fdefad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe748d1b0 0x55bfe785d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:27.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.256+0000 7fdefad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe748d1b0 0x55bfe785d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55200/0 (socket says 172.21.15.84:55200) 2024-09-21T03:43:27.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.256+0000 7fdefad9d640 1 -- 172.21.15.84:0/2316966722 learned_addr learned my addr 172.21.15.84:0/2316966722 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:27.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.256+0000 7fdefb59e640 1 --2- 172.21.15.84:0/2316966722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe74b6070 0x55bfe785d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:27.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.257+0000 7fdefad9d640 1 -- 172.21.15.84:0/2316966722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe74b6070 msgr2=0x55bfe785d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:27.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.257+0000 7fdefad9d640 1 --2- 172.21.15.84:0/2316966722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe74b6070 0x55bfe785d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.257+0000 7fdefad9d640 1 -- 172.21.15.84:0/2316966722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfe7495390 msgr2=0x55bfe785dcf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T03:43:27.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.257+0000 7fdefad9d640 1 --2- 172.21.15.84:0/2316966722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfe7495390 0x55bfe785dcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.257+0000 7fdefad9d640 1 -- 172.21.15.84:0/2316966722 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfe7521650 con 0x55bfe748d1b0 2024-09-21T03:43:27.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.257+0000 7fdee3fff640 1 -- 172.21.15.84:0/2284761658 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 26) ==== 154694+0+0 (secure 0 0 0) 0x7fdef0010a90 con 0x7fdefc1083b0 2024-09-21T03:43:27.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.257+0000 7fdefad9d640 1 --2- 172.21.15.84:0/2316966722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe748d1b0 0x55bfe785d7b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fdeec006010 tx=0x7fdeec004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414361f6589c7ca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:27.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.257+0000 7fdee17fa640 1 -- 172.21.15.84:0/2316966722 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec035040 con 0x55bfe748d1b0 2024-09-21T03:43:27.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.257+0000 7fdee17fa640 1 -- 172.21.15.84:0/2316966722 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdeec0054d0 con 0x55bfe748d1b0 2024-09-21T03:43:27.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.257+0000 7fdee17fa640 1 -- 172.21.15.84:0/2316966722 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec03d840 con 0x55bfe748d1b0 2024-09-21T03:43:27.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.259+0000 7fdf07754740 1 -- 172.21.15.84:0/2316966722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe748d1b0 msgr2=0x55bfe785d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:27.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.259+0000 7fdf07754740 1 --2- 172.21.15.84:0/2316966722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe748d1b0 0x55bfe785d7b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fdeec006010 tx=0x7fdeec004180 comp rx=0 tx=0).stop 2024-09-21T03:43:27.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.259+0000 7fdee3fff640 1 --2- 172.21.15.84:0/2284761658 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdee40b6850 0x7fdee40b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:27.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.259+0000 7fdefb59e640 1 --2- 172.21.15.84:0/2284761658 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdee40b6850 0x7fdee40b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:27.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.259+0000 7fdf07754740 1 -- 172.21.15.84:0/2316966722 shutdown_connections 2024-09-21T03:43:27.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.259+0000 7fdf07754740 1 --2- 172.21.15.84:0/2316966722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfe7495390 0x55bfe785dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.259+0000 7fdf07754740 1 --2- 172.21.15.84:0/2316966722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe748d1b0 0x55bfe785d7b0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.259+0000 7fdf07754740 1 --2- 172.21.15.84:0/2316966722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe74b6070 0x55bfe785d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.259+0000 7fdf07754740 1 -- 172.21.15.84:0/2316966722 >> 172.21.15.84:0/2316966722 conn(0x55bfe74aa460 msgr2=0x55bfe785b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:27.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.259+0000 7fdee3fff640 1 -- 172.21.15.84:0/2284761658 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fdef00e7c40 con 0x7fdefc1083b0 2024-09-21T03:43:27.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.260+0000 7fdf07754740 1 -- 172.21.15.84:0/2316966722 shutdown_connections 2024-09-21T03:43:27.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.260+0000 7fdefb59e640 1 --2- 172.21.15.84:0/2284761658 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdee40b6850 0x7fdee40b8d60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdef4005fd0 tx=0x7fdef4009600 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:27.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.260+0000 7fdf07754740 1 -- 172.21.15.84:0/2316966722 wait complete. 2024-09-21T03:43:27.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.260+0000 7fdf07754740 1 -- start start 2024-09-21T03:43:27.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.261+0000 7fdf07754740 1 Processor -- start 2024-09-21T03:43:27.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.261+0000 7fdf07754740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe748d1b0 0x55bfe7868940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:27.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.261+0000 7fdf07754740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfe7495390 0x55bfe7868e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:27.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.261+0000 7fdf07754740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe74b6070 0x55bfe7872cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:27.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.261+0000 7fdefb59e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe74b6070 0x55bfe7872cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:27.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.261+0000 7fdefb59e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe74b6070 0x55bfe7872cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55208/0 (socket says 172.21.15.84:55208) 2024-09-21T03:43:27.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.261+0000 7fdefa59c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfe7495390 0x55bfe7868e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:27.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.261+0000 7fdefb59e640 1 -- 172.21.15.84:0/4137124718 learned_addr learned my addr 172.21.15.84:0/4137124718 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:27.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.261+0000 7fdf07754740 1 -- 172.21.15.84:0/4137124718 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55bfe7624700 con 0x55bfe74b6070 2024-09-21T03:43:27.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.261+0000 7fdefad9d640 1 --2- 172.21.15.84:0/4137124718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe748d1b0 0x55bfe7868940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:27.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.261+0000 7fdf07754740 1 -- 172.21.15.84:0/4137124718 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bfe775e110 con 0x55bfe7495390 2024-09-21T03:43:27.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.261+0000 7fdf07754740 1 -- 172.21.15.84:0/4137124718 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55bfe786b9f0 con 0x55bfe748d1b0 2024-09-21T03:43:27.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.262+0000 7fdefa59c640 1 -- 172.21.15.84:0/4137124718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe748d1b0 msgr2=0x55bfe7868940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:27.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.262+0000 7fdefa59c640 1 --2- 172.21.15.84:0/4137124718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe748d1b0 0x55bfe7868940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.262+0000 7fdefa59c640 1 -- 172.21.15.84:0/4137124718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe74b6070 msgr2=0x55bfe7872cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:27.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.262+0000 7fdefa59c640 1 --2- 172.21.15.84:0/4137124718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe74b6070 0x55bfe7872cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.262+0000 7fdefa59c640 1 -- 172.21.15.84:0/4137124718 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfe778bc40 con 0x55bfe7495390 2024-09-21T03:43:27.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.262+0000 7fdefb59e640 1 --2- 172.21.15.84:0/4137124718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe74b6070 0x55bfe7872cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:43:27.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.262+0000 7fdefad9d640 1 --2- 172.21.15.84:0/4137124718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe748d1b0 0x55bfe7868940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:27.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.262+0000 7fdf07754740 10 client.0 _ll_register_callbacks cb 0x55bfe7777990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:27.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.262+0000 7fdf07754740 1 -- 172.21.15.84:0/4137124718 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdeec0054d0 con 0x55bfe7495390 2024-09-21T03:43:27.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.262+0000 7fdefa59c640 1 --2- 172.21.15.84:0/4137124718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfe7495390 0x55bfe7868e80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdef00e52f0 tx=0x7fdef00acf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd01f632238fd12a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:27.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.262+0000 7fdedeff5640 10 client.25283 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T03:43:27.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.262+0000 7fdedeff5640 1 -- 172.21.15.84:0/4137124718 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef0098050 con 0x55bfe7495390 2024-09-21T03:43:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.262+0000 7fdedeff5640 1 -- 172.21.15.84:0/4137124718 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fdef00e5d10 con 0x55bfe7495390 2024-09-21T03:43:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.263+0000 7fdedeff5640 1 -- 172.21.15.84:0/4137124718 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdef00ad710 con 0x55bfe7495390 2024-09-21T03:43:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.263+0000 7fdf07754740 10 client.25283 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:27.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.263+0000 7fdf07754740 1 -- 172.21.15.84:0/4137124718 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55bfe7899640 con 0x55bfe7495390 2024-09-21T03:43:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.263+0000 7fdedeff5640 1 -- 172.21.15.84:0/4137124718 <== mon.2 v2:172.21.15.172:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdef00c3af0 con 0x55bfe7495390 2024-09-21T03:43:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.263+0000 7fdf07754740 10 client.25283 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.263+0000 7fdf07754740 10 client.25283 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:43:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.263+0000 7fdf07754740 20 client.25283 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.263+0000 7fdf07754740 1 --2- 172.21.15.84:0/4137124718 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bfe74749f0 0x55bfe789cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.263+0000 7fdf07754740 4 client.25283 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.263+0000 7fdf07754740 1 -- 172.21.15.84:0/4137124718 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfe77d5da0 con 0x55bfe74749f0 2024-09-21T03:43:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.264+0000 7fdefad9d640 1 --2- 172.21.15.84:0/4137124718 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bfe74749f0 0x55bfe789cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.264+0000 7fdefad9d640 1 --2- 172.21.15.84:0/4137124718 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bfe74749f0 0x55bfe789cad0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9188db2519b5a885 server_cookie=49194ee814b2d8a4 in_seq=0 out_seq=0 2024-09-21T03:43:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.264+0000 7fdedeff5640 10 client.25283 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:27.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.265+0000 7fdedeff5640 1 -- 172.21.15.84:0/4137124718 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bfe77d5da0 con 0x55bfe74749f0 2024-09-21T03:43:27.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.265+0000 7fdedeff5640 10 client.25283 handle_command_reply: tid=0 2024-09-21T03:43:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.265+0000 7fdf07754740 1 client.25283 shutdown 2024-09-21T03:43:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.265+0000 7fdf07754740 1 -- 172.21.15.84:0/4137124718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfe7495390 msgr2=0x55bfe7868e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.265+0000 7fdf07754740 1 --2- 172.21.15.84:0/4137124718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfe7495390 0x55bfe7868e80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdef00e52f0 tx=0x7fdef00acf70 comp rx=0 tx=0).stop 2024-09-21T03:43:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.265+0000 7fdf07754740 1 -- 172.21.15.84:0/4137124718 shutdown_connections 2024-09-21T03:43:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.265+0000 7fdf07754740 1 --2- 172.21.15.84:0/4137124718 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bfe74749f0 0x55bfe789cad0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.265+0000 7fdf07754740 1 --2- 172.21.15.84:0/4137124718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe74b6070 0x55bfe7872cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.265+0000 7fdf07754740 1 --2- 172.21.15.84:0/4137124718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfe7495390 0x55bfe7868e80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.265+0000 7fdedeff5640 0 client.25283 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.265+0000 7fdf07754740 1 --2- 172.21.15.84:0/4137124718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe748d1b0 0x55bfe7868940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.265+0000 7fdf07754740 1 -- 172.21.15.84:0/4137124718 >> 172.21.15.84:0/4137124718 conn(0x55bfe74aa460 msgr2=0x55bfe7860400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.265+0000 7fdf07754740 1 -- 172.21.15.84:0/4137124718 shutdown_connections 2024-09-21T03:43:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.265+0000 7fdf07754740 1 -- 172.21.15.84:0/4137124718 wait complete. 2024-09-21T03:43:27.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.265+0000 7fdf07754740 20 client.25283 trim_cache size 0 max 16384 2024-09-21T03:43:27.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.299+0000 7fdf07754740 1 Processor -- start 2024-09-21T03:43:27.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.299+0000 7fdf07754740 1 -- start start 2024-09-21T03:43:27.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.299+0000 7fdf07754740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe748d1b0 0x55bfe786a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:27.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.299+0000 7fdf07754740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe7495390 0x55bfe7865b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.299+0000 7fdf07754740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfe74b6070 0x55bfe7866070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:27.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.299+0000 7fdf07754740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc071ac0 con 0x55bfe7495390 2024-09-21T03:43:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.299+0000 7fdf07754740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc06f390 con 0x55bfe74b6070 2024-09-21T03:43:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.299+0000 7fdf07754740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc06d1e0 con 0x55bfe748d1b0 2024-09-21T03:43:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.300+0000 7fdefad9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe748d1b0 0x55bfe786a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.300+0000 7fdefad9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe748d1b0 0x55bfe786a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.84:39246/0 (socket says 172.21.15.84:39246) 2024-09-21T03:43:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.300+0000 7fdefad9d640 1 -- 172.21.15.84:0/4234395484 learned_addr learned my addr 172.21.15.84:0/4234395484 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.300+0000 7fdefa59c640 1 --2- 172.21.15.84:0/4234395484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe7495390 0x55bfe7865b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.300+0000 7fdefb59e640 1 --2- 172.21.15.84:0/4234395484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfe74b6070 0x55bfe7866070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.300+0000 7fdefad9d640 1 -- 172.21.15.84:0/4234395484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfe74b6070 msgr2=0x55bfe7866070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.300+0000 7fdefad9d640 1 --2- 172.21.15.84:0/4234395484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfe74b6070 0x55bfe7866070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.300+0000 7fdefad9d640 1 -- 172.21.15.84:0/4234395484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe7495390 msgr2=0x55bfe7865b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.300+0000 7fdefad9d640 1 --2- 172.21.15.84:0/4234395484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe7495390 0x55bfe7865b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.300+0000 7fdefad9d640 1 -- 172.21.15.84:0/4234395484 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfe78635a0 con 0x55bfe748d1b0 2024-09-21T03:43:27.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.300+0000 7fdefad9d640 1 --2- 172.21.15.84:0/4234395484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe748d1b0 0x55bfe786a930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdeec005ab0 tx=0x7fdeec004d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a6b2b911a478051 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:27.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.301+0000 7fdee0ff9640 1 -- 172.21.15.84:0/4234395484 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec035040 con 0x55bfe748d1b0 2024-09-21T03:43:27.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.301+0000 7fdee0ff9640 1 -- 172.21.15.84:0/4234395484 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdeec005220 con 0x55bfe748d1b0 2024-09-21T03:43:27.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.301+0000 7fdee0ff9640 1 -- 172.21.15.84:0/4234395484 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec003c30 con 0x55bfe748d1b0 2024-09-21T03:43:27.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.302+0000 7fdf07754740 1 -- 172.21.15.84:0/4234395484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe748d1b0 msgr2=0x55bfe786a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:27.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.302+0000 7fdf07754740 1 --2- 172.21.15.84:0/4234395484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe748d1b0 0x55bfe786a930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdeec005ab0 tx=0x7fdeec004d00 comp rx=0 tx=0).stop 2024-09-21T03:43:27.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.302+0000 7fdf07754740 1 -- 172.21.15.84:0/4234395484 shutdown_connections 2024-09-21T03:43:27.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.302+0000 7fdf07754740 1 --2- 172.21.15.84:0/4234395484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfe74b6070 0x55bfe7866070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.302+0000 7fdf07754740 1 --2- 172.21.15.84:0/4234395484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe7495390 0x55bfe7865b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.302+0000 7fdf07754740 1 --2- 172.21.15.84:0/4234395484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe748d1b0 0x55bfe786a930 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.302+0000 7fdf07754740 1 -- 172.21.15.84:0/4234395484 >> 172.21.15.84:0/4234395484 conn(0x55bfe74aa460 msgr2=0x55bfe785ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:27.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.302+0000 7fdf07754740 1 -- 172.21.15.84:0/4234395484 shutdown_connections 2024-09-21T03:43:27.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.302+0000 7fdf07754740 1 -- 172.21.15.84:0/4234395484 wait complete. 2024-09-21T03:43:27.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.302+0000 7fdf07754740 1 -- start start 2024-09-21T03:43:27.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.303+0000 7fdf07754740 1 Processor -- start 2024-09-21T03:43:27.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.303+0000 7fdf07754740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfe748d1b0 0x55bfe786ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:27.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.303+0000 7fdf07754740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe7495390 0x55bfe786efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:27.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.303+0000 7fdefa59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe7495390 0x55bfe786efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:27.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.303+0000 7fdefa59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe7495390 0x55bfe786efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55224/0 (socket says 172.21.15.84:55224) 2024-09-21T03:43:27.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.303+0000 7fdefa59c640 1 -- 172.21.15.84:0/3602092693 learned_addr learned my addr 172.21.15.84:0/3602092693 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:27.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.303+0000 7fdf07754740 1 --2- 172.21.15.84:0/3602092693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe74b6070 0x55bfe786f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:27.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.303+0000 7fdf07754740 1 -- 172.21.15.84:0/3602092693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc06d850 con 0x55bfe7495390 2024-09-21T03:43:27.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.303+0000 7fdf07754740 1 -- 172.21.15.84:0/3602092693 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc06ecc0 con 0x55bfe748d1b0 2024-09-21T03:43:27.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.303+0000 7fdf07754740 1 -- 172.21.15.84:0/3602092693 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc06df20 con 0x55bfe74b6070 2024-09-21T03:43:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.303+0000 7fdf07754740 10 client.0 _ll_register_callbacks cb 0x7fdef00e5180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.304+0000 7fdefa59c640 1 -- 172.21.15.84:0/3602092693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe74b6070 msgr2=0x55bfe786f530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T03:43:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.304+0000 7fdefa59c640 1 --2- 172.21.15.84:0/3602092693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe74b6070 0x55bfe786f530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.304+0000 7fdefa59c640 1 -- 172.21.15.84:0/3602092693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfe748d1b0 msgr2=0x55bfe786ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.304+0000 7fdefa59c640 1 --2- 172.21.15.84:0/3602092693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfe748d1b0 0x55bfe786ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.304+0000 7fdefa59c640 1 -- 172.21.15.84:0/3602092693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfe79066c0 con 0x55bfe7495390 2024-09-21T03:43:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.304+0000 7fdefa59c640 1 --2- 172.21.15.84:0/3602092693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe7495390 0x55bfe786efd0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fdef0009740 tx=0x7fdef0010e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d75aad61aa6d91 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.304+0000 7fdedeff5640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:43:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.304+0000 7fdedeff5640 1 -- 172.21.15.84:0/3602092693 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef0098040 con 0x55bfe7495390 2024-09-21T03:43:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.304+0000 7fdf07754740 1 -- 172.21.15.84:0/3602092693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdeec005220 con 0x55bfe7495390 2024-09-21T03:43:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.304+0000 7fdedeff5640 1 -- 172.21.15.84:0/3602092693 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fdef00b37c0 con 0x55bfe7495390 2024-09-21T03:43:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.305+0000 7fdedeff5640 1 -- 172.21.15.84:0/3602092693 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdef00c8060 con 0x55bfe7495390 2024-09-21T03:43:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.305+0000 7fdf07754740 10 client.15729 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:27.308 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.305+0000 7fdf07754740 1 -- 172.21.15.84:0/3602092693 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bfe7907950 con 0x55bfe7495390 2024-09-21T03:43:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.305+0000 7fdedeff5640 1 -- 172.21.15.84:0/3602092693 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdeec005220 con 0x55bfe7495390 2024-09-21T03:43:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.305+0000 7fdedeff5640 1 -- 172.21.15.84:0/3602092693 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdef00b68a0 con 0x55bfe7495390 2024-09-21T03:43:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.306+0000 7fdf07754740 10 client.15729 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.306+0000 7fdf07754740 10 client.15729 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:43:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.306+0000 7fdf07754740 20 client.15729 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.306+0000 7fdf07754740 1 --2- 172.21.15.84:0/3602092693 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bfe7449da0 0x55bfe790a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.306+0000 7fdf07754740 4 client.15729 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:43:27.309 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.306+0000 7fdf07754740 1 -- 172.21.15.84:0/3602092693 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bfe77d1850 con 0x55bfe7449da0 2024-09-21T03:43:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.306+0000 7fdefad9d640 1 --2- 172.21.15.84:0/3602092693 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bfe7449da0 0x55bfe790a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.306+0000 7fdedeff5640 10 client.15729 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.306+0000 7fdefad9d640 1 --2- 172.21.15.84:0/3602092693 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bfe7449da0 0x55bfe790a110 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcf89f9bd98eccb7 server_cookie=d7fafc67ddb99c18 in_seq=0 out_seq=0 2024-09-21T03:43:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.307+0000 7fdedeff5640 1 -- 172.21.15.84:0/3602092693 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x55bfe77d1850 con 0x55bfe7449da0 2024-09-21T03:43:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.307+0000 7fdedeff5640 10 client.15729 handle_command_reply: tid=0 2024-09-21T03:43:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.307+0000 7fdf07754740 1 client.15729 shutdown 2024-09-21T03:43:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.307+0000 7fdf07754740 1 -- 172.21.15.84:0/3602092693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe7495390 msgr2=0x55bfe786efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.307+0000 7fdf07754740 1 --2- 172.21.15.84:0/3602092693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe7495390 0x55bfe786efd0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fdef0009740 tx=0x7fdef0010e30 comp rx=0 tx=0).stop 2024-09-21T03:43:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.307+0000 7fdf07754740 1 -- 172.21.15.84:0/3602092693 shutdown_connections 2024-09-21T03:43:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.307+0000 7fdf07754740 1 --2- 172.21.15.84:0/3602092693 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bfe7449da0 0x55bfe790a110 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.307+0000 7fdf07754740 1 --2- 172.21.15.84:0/3602092693 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bfe74b6070 0x55bfe786f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.307+0000 7fdf07754740 1 --2- 172.21.15.84:0/3602092693 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bfe7495390 0x55bfe786efd0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.307+0000 7fdedeff5640 0 client.15729 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.307+0000 7fdf07754740 1 --2- 172.21.15.84:0/3602092693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bfe748d1b0 0x55bfe786ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.307+0000 7fdf07754740 1 -- 172.21.15.84:0/3602092693 >> 172.21.15.84:0/3602092693 conn(0x55bfe74aa460 msgr2=0x55bfe785ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.308+0000 7fdf07754740 1 -- 172.21.15.84:0/3602092693 shutdown_connections 2024-09-21T03:43:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.308+0000 7fdf07754740 1 -- 172.21.15.84:0/3602092693 wait complete. 2024-09-21T03:43:27.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.308+0000 7fdf07754740 20 client.15729 trim_cache size 0 max 16384 2024-09-21T03:43:27.312 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:43:27.312 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:43:27.312 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T03:43:27.312 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:43:27.313 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:43:27.313 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "a134896d-df56-4c5c-9871-49e10f1f62c3", 2024-09-21T03:43:27.313 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T03:43:27.313 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:43:27.313 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:43:27.313 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:43:27.313 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:43:27.313 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:43:27.313 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:43:27.313 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:43:27.313 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:43:27.313 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:43:27.314 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:43:27.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:43:27.314 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:43:27.314 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:43:27.314 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:43:27.314 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:43:27.314 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:43:27.314 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:43:27.314 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:43:27.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:43:27.314 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:43:27.314 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:43:27.314 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:43:27.314 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:43:27.315 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:43:27.315 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:43:27.315 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:43:27.315 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:43:27.315 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:43:27.315 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:43:27.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.309+0000 7fdf011e0640 1 -- 172.21.15.84:0/2284761658 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdee40b6850 msgr2=0x7fdee40b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.309+0000 7fdf011e0640 1 --2- 172.21.15.84:0/2284761658 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdee40b6850 0x7fdee40b8d60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdef4005fd0 tx=0x7fdef4009600 comp rx=0 tx=0).stop 2024-09-21T03:43:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.309+0000 7fdf011e0640 1 -- 172.21.15.84:0/2284761658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdefc1083b0 msgr2=0x7fdefc199980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.309+0000 7fdf011e0640 1 --2- 172.21.15.84:0/2284761658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdefc1083b0 0x7fdefc199980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdefc075ab0 tx=0x7fdef000ee50 comp rx=0 tx=0).stop 2024-09-21T03:43:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.309+0000 7fdf011e0640 1 -- 172.21.15.84:0/2284761658 shutdown_connections 2024-09-21T03:43:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.309+0000 7fdf011e0640 1 --2- 172.21.15.84:0/2284761658 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdee40b6850 0x7fdee40b8d60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.309+0000 7fdf011e0640 1 --2- 172.21.15.84:0/2284761658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdefc108d00 0x7fdefc19ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.309+0000 7fdf011e0640 1 --2- 172.21.15.84:0/2284761658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdefc1083b0 0x7fdefc199980 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.316 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.309+0000 7fdf011e0640 1 --2- 172.21.15.84:0/2284761658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdefc103180 0x7fdefc1993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.309+0000 7fdf011e0640 1 -- 172.21.15.84:0/2284761658 >> 172.21.15.84:0/2284761658 conn(0x7fdefc077c60 msgr2=0x7fdefc1064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.309+0000 7fdf011e0640 1 -- 172.21.15.84:0/2284761658 shutdown_connections 2024-09-21T03:43:27.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:27.309+0000 7fdf011e0640 1 -- 172.21.15.84:0/2284761658 wait complete. 2024-09-21T03:43:27.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:27 smithi084 ceph-mon[30941]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:43:27.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:27 smithi174 ceph-mon[34403]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:43:27.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:27 smithi172 ceph-mon[34821]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:43:28.118 INFO:tasks.cephfs.filesystem:scrub status for tag:a134896d-df56-4c5c-9871-49e10f1f62c3 - {'path': '/', 'tag': 'a134896d-df56-4c5c-9871-49e10f1f62c3', 'options': 'recursive,force'} 2024-09-21T03:43:29.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:29 smithi084 ceph-mon[30941]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:43:29.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:29 smithi174 ceph-mon[34403]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:43:29.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:29 smithi172 ceph-mon[34821]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:43:30.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:30 smithi084 ceph-mon[30941]: scrub summary: idle 2024-09-21T03:43:30.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:30 smithi174 ceph-mon[34403]: scrub summary: idle 2024-09-21T03:43:30.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:30 smithi172 ceph-mon[34821]: scrub summary: idle 2024-09-21T03:43:31.779 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:31 smithi174 ceph-mon[34403]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T03:43:31.802 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:31 smithi172 ceph-mon[34821]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T03:43:31.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:31 smithi084 ceph-mon[30941]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T03:43:32.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:32 smithi084 ceph-mon[30941]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:43:32.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:32 smithi174 ceph-mon[34403]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:43:32.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:32 smithi172 ceph-mon[34821]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:43:34.370 INFO:tasks.workunit.client.0.smithi084.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T03:43:34.371 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T03:43:34.371 INFO:tasks.workunit.client.0.smithi084.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T03:43:34.371 INFO:tasks.workunit.client.0.smithi084.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T03:43:34.371 INFO:tasks.workunit.client.0.smithi084.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T03:43:34.371 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T03:43:34.371 INFO:tasks.workunit.client.0.smithi084.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T03:43:34.371 INFO:tasks.workunit.client.0.smithi084.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T03:43:34.371 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T03:43:34.371 INFO:tasks.workunit.client.0.smithi084.stderr: git switch -c 2024-09-21T03:43:34.371 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T03:43:34.371 INFO:tasks.workunit.client.0.smithi084.stderr:Or undo this operation with: 2024-09-21T03:43:34.371 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T03:43:34.371 INFO:tasks.workunit.client.0.smithi084.stderr: git switch - 2024-09-21T03:43:34.371 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T03:43:34.372 INFO:tasks.workunit.client.0.smithi084.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T03:43:34.372 INFO:tasks.workunit.client.0.smithi084.stderr: 2024-09-21T03:43:34.372 INFO:tasks.workunit.client.0.smithi084.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T03:43:34.376 DEBUG:teuthology.orchestra.run.smithi084:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T03:43:34.497 INFO:tasks.workunit.client.0.smithi084.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T03:43:34.500 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T03:43:34.500 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T03:43:35.229 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T03:43:35.300 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T03:43:35.341 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T03:43:35.343 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T03:43:35.343 INFO:tasks.workunit.client.0.smithi084.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T03:43:35.382 INFO:tasks.workunit.client.0.smithi084.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T03:43:35.387 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T03:43:35.387 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T03:43:35.402 INFO:tasks.workunit:Running workunits matching fs/test_o_trunc.sh on client.0... 2024-09-21T03:43:35.404 INFO:tasks.workunit:Running workunit fs/test_o_trunc.sh... 2024-09-21T03:43:35.404 DEBUG:teuthology.orchestra.run.smithi084:workunit test fs/test_o_trunc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-21T03:43:35.464 INFO:tasks.workunit.client.0.smithi084.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-21T03:43:35.464 INFO:tasks.workunit.client.0.smithi084.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs 2024-09-21T03:43:35.464 INFO:tasks.workunit.client.0.smithi084.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc trunc.foo 600 2024-09-21T03:43:35.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:35 smithi172 ceph-mon[34821]: pgmap v357: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T03:43:35.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:35 smithi084 ceph-mon[30941]: pgmap v357: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T03:43:35.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:35 smithi174 ceph-mon[34403]: pgmap v357: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T03:43:37.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:37 smithi172 ceph-mon[34821]: pgmap v358: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T03:43:37.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:37 smithi084 ceph-mon[30941]: pgmap v358: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T03:43:37.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:37 smithi174 ceph-mon[34403]: pgmap v358: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T03:43:39.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:39 smithi172 ceph-mon[34821]: pgmap v359: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T03:43:39.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:39 smithi084 ceph-mon[30941]: pgmap v359: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T03:43:39.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:39 smithi174 ceph-mon[34403]: pgmap v359: 97 pgs: 97 active+clean; 1.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T03:43:40.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:40 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:43:40.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:40 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:43:40.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:40 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:43:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:41 smithi172 ceph-mon[34821]: pgmap v360: 97 pgs: 97 active+clean; 1.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.9 KiB/s wr, 7 op/s 2024-09-21T03:43:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:41 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:41 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:41 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:41 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:41 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:41 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:41 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:43:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:41 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:43:41.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:41 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:41.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:41 smithi084 ceph-mon[30941]: pgmap v360: 97 pgs: 97 active+clean; 1.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.9 KiB/s wr, 7 op/s 2024-09-21T03:43:41.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:41 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:41.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:41 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:41.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:41 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:41.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:41 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:41.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:41 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:41.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:41 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:41.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:41 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:43:41.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:41 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:43:41.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:41 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:41.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:41 smithi174 ceph-mon[34403]: pgmap v360: 97 pgs: 97 active+clean; 1.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.9 KiB/s wr, 7 op/s 2024-09-21T03:43:41.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:41 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:41.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:41 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:41.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:41 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:41.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:41 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:41.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:41 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:41.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:41 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:41.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:41 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:43:41.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:41 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:43:41.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:41 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:43:43.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:43 smithi172 ceph-mon[34821]: pgmap v361: 97 pgs: 97 active+clean; 1.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 KiB/s wr, 7 op/s 2024-09-21T03:43:43.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:43 smithi084 ceph-mon[30941]: pgmap v361: 97 pgs: 97 active+clean; 1.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 KiB/s wr, 7 op/s 2024-09-21T03:43:43.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:43 smithi174 ceph-mon[34403]: pgmap v361: 97 pgs: 97 active+clean; 1.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.0 KiB/s wr, 7 op/s 2024-09-21T03:43:45.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:45 smithi084 ceph-mon[30941]: pgmap v362: 97 pgs: 97 active+clean; 1.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-21T03:43:45.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:45 smithi174 ceph-mon[34403]: pgmap v362: 97 pgs: 97 active+clean; 1.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-21T03:43:45.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:45 smithi172 ceph-mon[34821]: pgmap v362: 97 pgs: 97 active+clean; 1.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-21T03:43:47.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:47 smithi084 ceph-mon[30941]: pgmap v363: 97 pgs: 97 active+clean; 1.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-09-21T03:43:47.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:47 smithi174 ceph-mon[34403]: pgmap v363: 97 pgs: 97 active+clean; 1.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-09-21T03:43:47.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:47 smithi172 ceph-mon[34821]: pgmap v363: 97 pgs: 97 active+clean; 1.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-09-21T03:43:49.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:49 smithi084 ceph-mon[30941]: pgmap v364: 97 pgs: 97 active+clean; 1.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-09-21T03:43:49.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:49 smithi174 ceph-mon[34403]: pgmap v364: 97 pgs: 97 active+clean; 1.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-09-21T03:43:49.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:49 smithi172 ceph-mon[34821]: pgmap v364: 97 pgs: 97 active+clean; 1.5 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-09-21T03:43:51.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:51 smithi084 ceph-mon[30941]: pgmap v365: 97 pgs: 97 active+clean; 1.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:43:51.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:51 smithi174 ceph-mon[34403]: pgmap v365: 97 pgs: 97 active+clean; 1.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:43:51.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:51 smithi172 ceph-mon[34821]: pgmap v365: 97 pgs: 97 active+clean; 1.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:43:53.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:53 smithi084 ceph-mon[30941]: pgmap v366: 97 pgs: 97 active+clean; 1.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-21T03:43:53.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:53 smithi084 ceph-mon[30941]: mgrmap e27: x(active, since 10m), standbys: z, y 2024-09-21T03:43:53.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:53 smithi174 ceph-mon[34403]: pgmap v366: 97 pgs: 97 active+clean; 1.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-21T03:43:53.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:53 smithi174 ceph-mon[34403]: mgrmap e27: x(active, since 10m), standbys: z, y 2024-09-21T03:43:53.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:53 smithi172 ceph-mon[34821]: pgmap v366: 97 pgs: 97 active+clean; 1.6 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-21T03:43:53.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:53 smithi172 ceph-mon[34821]: mgrmap e27: x(active, since 10m), standbys: z, y 2024-09-21T03:43:55.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:55 smithi084 ceph-mon[30941]: pgmap v367: 97 pgs: 97 active+clean; 1.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-21T03:43:55.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:55 smithi174 ceph-mon[34403]: pgmap v367: 97 pgs: 97 active+clean; 1.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-21T03:43:55.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:55 smithi172 ceph-mon[34821]: pgmap v367: 97 pgs: 97 active+clean; 1.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-21T03:43:57.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:57 smithi084 ceph-mon[30941]: pgmap v368: 97 pgs: 97 active+clean; 1.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-21T03:43:57.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:57 smithi174 ceph-mon[34403]: pgmap v368: 97 pgs: 97 active+clean; 1.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-21T03:43:57.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:57 smithi172 ceph-mon[34821]: pgmap v368: 97 pgs: 97 active+clean; 1.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-21T03:43:58.118 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:43:58.381 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:58.807 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:43:58 smithi084 ceph-mon[30941]: pgmap v369: 97 pgs: 97 active+clean; 1.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-21T03:43:58.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:43:58 smithi174 ceph-mon[34403]: pgmap v369: 97 pgs: 97 active+clean; 1.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-21T03:43:58.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:43:58 smithi172 ceph-mon[34821]: pgmap v369: 97 pgs: 97 active+clean; 1.7 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-21T03:43:58.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.901+0000 7f822f180640 1 -- 172.21.15.84:0/1667968992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82281083a0 msgr2=0x7f82281087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:58.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.901+0000 7f822f180640 1 --2- 172.21.15.84:0/1667968992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82281083a0 0x7f82281087b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8214009900 tx=0x7f821402a410 comp rx=0 tx=0).stop 2024-09-21T03:43:58.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.901+0000 7f822f180640 1 -- 172.21.15.84:0/1667968992 shutdown_connections 2024-09-21T03:43:58.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.901+0000 7f822f180640 1 --2- 172.21.15.84:0/1667968992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8228108cf0 0x7f822810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.901+0000 7f822f180640 1 --2- 172.21.15.84:0/1667968992 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f82281083a0 0x7f82281087b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.901+0000 7f822f180640 1 --2- 172.21.15.84:0/1667968992 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8228102a60 0x7f8228102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.901+0000 7f822f180640 1 -- 172.21.15.84:0/1667968992 >> 172.21.15.84:0/1667968992 conn(0x7f8228079730 msgr2=0x7f8228079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:58.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.901+0000 7f822f180640 1 -- 172.21.15.84:0/1667968992 shutdown_connections 2024-09-21T03:43:58.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.901+0000 7f822f180640 1 -- 172.21.15.84:0/1667968992 wait complete. 2024-09-21T03:43:58.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.902+0000 7f822f180640 1 Processor -- start 2024-09-21T03:43:58.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.902+0000 7f822f180640 1 -- start start 2024-09-21T03:43:58.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.902+0000 7f822f180640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8228102a60 0x7f822819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:58.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.902+0000 7f822f180640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82281083a0 0x7f822819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:58.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.902+0000 7f822f180640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8228108cf0 0x7f822819fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:58.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.902+0000 7f822f180640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8228113a80 con 0x7f8228102a60 2024-09-21T03:43:58.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.902+0000 7f822f180640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8228113900 con 0x7f82281083a0 2024-09-21T03:43:58.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.902+0000 7f822f180640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8228113c00 con 0x7f8228108cf0 2024-09-21T03:43:58.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.902+0000 7f822cf1c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8228102a60 0x7f822819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:58.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.902+0000 7f822cf1c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8228102a60 0x7f822819a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57062/0 (socket says 172.21.15.84:57062) 2024-09-21T03:43:58.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.902+0000 7f822cf1c640 1 -- 172.21.15.84:0/1632940474 learned_addr learned my addr 172.21.15.84:0/1632940474 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:58.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.902+0000 7f822d71d640 1 --2- 172.21.15.84:0/1632940474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8228108cf0 0x7f822819fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:58.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.903+0000 7f8227fff640 1 --2- 172.21.15.84:0/1632940474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82281083a0 0x7f822819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:58.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.903+0000 7f822cf1c640 1 -- 172.21.15.84:0/1632940474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8228108cf0 msgr2=0x7f822819fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:58.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.903+0000 7f822cf1c640 1 --2- 172.21.15.84:0/1632940474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8228108cf0 0x7f822819fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.903+0000 7f822cf1c640 1 -- 172.21.15.84:0/1632940474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82281083a0 msgr2=0x7f822819aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:58.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.903+0000 7f822cf1c640 1 --2- 172.21.15.84:0/1632940474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82281083a0 0x7f822819aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.903+0000 7f822cf1c640 1 -- 172.21.15.84:0/1632940474 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82281a04a0 con 0x7f8228102a60 2024-09-21T03:43:58.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.903+0000 7f822d71d640 1 --2- 172.21.15.84:0/1632940474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8228108cf0 0x7f822819fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:58.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.903+0000 7f8227fff640 1 --2- 172.21.15.84:0/1632940474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82281083a0 0x7f822819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:58.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.903+0000 7f822cf1c640 1 --2- 172.21.15.84:0/1632940474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8228102a60 0x7f822819a530 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f821c00d770 tx=0x7f821c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:58.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.903+0000 7f8225ffb640 1 -- 172.21.15.84:0/1632940474 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c017070 con 0x7f8228102a60 2024-09-21T03:43:58.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.903+0000 7f822f180640 1 -- 172.21.15.84:0/1632940474 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82281a0790 con 0x7f8228102a60 2024-09-21T03:43:58.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.903+0000 7f8225ffb640 1 -- 172.21.15.84:0/1632940474 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f821c0054d0 con 0x7f8228102a60 2024-09-21T03:43:58.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.903+0000 7f8225ffb640 1 -- 172.21.15.84:0/1632940474 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c004c30 con 0x7f8228102a60 2024-09-21T03:43:58.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.903+0000 7f822f180640 1 -- 172.21.15.84:0/1632940474 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82281a6ef0 con 0x7f8228102a60 2024-09-21T03:43:58.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.906+0000 7f8225ffb640 1 -- 172.21.15.84:0/1632940474 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f821c004eb0 con 0x7f8228102a60 2024-09-21T03:43:58.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.907+0000 7f8225ffb640 1 --2- 172.21.15.84:0/1632940474 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f82180b6680 0x7f82180b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:58.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.907+0000 7f8227fff640 1 --2- 172.21.15.84:0/1632940474 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f82180b6680 0x7f82180b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:58.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.907+0000 7f82356f4740 1 Processor -- start 2024-09-21T03:43:58.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.907+0000 7f8225ffb640 1 -- 172.21.15.84:0/1632940474 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f821c0e7210 con 0x7f8228102a60 2024-09-21T03:43:58.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.907+0000 7f82356f4740 1 -- start start 2024-09-21T03:43:58.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.907+0000 7f82356f4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29184070 0x558d2952b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:58.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.907+0000 7f82356f4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d2915b1b0 0x558d2952bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:58.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.907+0000 7f82356f4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29163390 0x558d2952c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:58.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.907+0000 7f82356f4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558d294a1e50 con 0x558d29184070 2024-09-21T03:43:58.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.907+0000 7f82356f4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558d29491280 con 0x558d29163390 2024-09-21T03:43:58.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.907+0000 7f82356f4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558d29495090 con 0x558d2915b1b0 2024-09-21T03:43:58.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.907+0000 7f822cf1c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29184070 0x558d2952b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:58.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.907+0000 7f822cf1c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29184070 0x558d2952b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57066/0 (socket says 172.21.15.84:57066) 2024-09-21T03:43:58.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.907+0000 7f822cf1c640 1 -- 172.21.15.84:0/699441277 learned_addr learned my addr 172.21.15.84:0/699441277 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:58.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.908+0000 7f8227fff640 1 --2- 172.21.15.84:0/1632940474 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f82180b6680 0x7f82180b8b90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8214000c00 tx=0x7f8214032cc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:58.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.908+0000 7f8227fff640 1 --2- 172.21.15.84:0/699441277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d2915b1b0 0x558d2952bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:58.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.908+0000 7f822d71d640 1 --2- 172.21.15.84:0/699441277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29163390 0x558d2952c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:58.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.908+0000 7f822cf1c640 1 -- 172.21.15.84:0/699441277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d2915b1b0 msgr2=0x558d2952bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:58.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.908+0000 7f822cf1c640 1 --2- 172.21.15.84:0/699441277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d2915b1b0 0x558d2952bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.908+0000 7f822cf1c640 1 -- 172.21.15.84:0/699441277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29163390 msgr2=0x558d2952c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:58.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.908+0000 7f822cf1c640 1 --2- 172.21.15.84:0/699441277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29163390 0x558d2952c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.908+0000 7f822cf1c640 1 -- 172.21.15.84:0/699441277 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d291ef650 con 0x558d29184070 2024-09-21T03:43:58.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.908+0000 7f822cf1c640 1 --2- 172.21.15.84:0/699441277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29184070 0x558d2952b650 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f821c0a96b0 tx=0x7f821c0ac920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5d2f2dc0169c4f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:58.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.908+0000 7f8212ffd640 1 -- 172.21.15.84:0/699441277 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c020070 con 0x558d29184070 2024-09-21T03:43:58.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.908+0000 7f8212ffd640 1 -- 172.21.15.84:0/699441277 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f821c0ad7e0 con 0x558d29184070 2024-09-21T03:43:58.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.908+0000 7f8212ffd640 1 -- 172.21.15.84:0/699441277 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c005330 con 0x558d29184070 2024-09-21T03:43:58.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.909+0000 7f82356f4740 1 -- 172.21.15.84:0/699441277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29184070 msgr2=0x558d2952b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:58.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.909+0000 7f82356f4740 1 --2- 172.21.15.84:0/699441277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29184070 0x558d2952b650 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f821c0a96b0 tx=0x7f821c0ac920 comp rx=0 tx=0).stop 2024-09-21T03:43:58.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.909+0000 7f82356f4740 1 -- 172.21.15.84:0/699441277 shutdown_connections 2024-09-21T03:43:58.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.909+0000 7f82356f4740 1 --2- 172.21.15.84:0/699441277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29163390 0x558d2952c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.909+0000 7f82356f4740 1 --2- 172.21.15.84:0/699441277 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d2915b1b0 0x558d2952bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.909+0000 7f82356f4740 1 --2- 172.21.15.84:0/699441277 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29184070 0x558d2952b650 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.909+0000 7f82356f4740 1 -- 172.21.15.84:0/699441277 >> 172.21.15.84:0/699441277 conn(0x558d29178460 msgr2=0x558d29529540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:58.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.909+0000 7f82356f4740 1 -- 172.21.15.84:0/699441277 shutdown_connections 2024-09-21T03:43:58.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.909+0000 7f82356f4740 1 -- 172.21.15.84:0/699441277 wait complete. 2024-09-21T03:43:58.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.910+0000 7f82356f4740 1 -- start start 2024-09-21T03:43:58.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.910+0000 7f82356f4740 1 Processor -- start 2024-09-21T03:43:58.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.910+0000 7f82356f4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d2915b1b0 0x558d29536d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:58.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.910+0000 7f82356f4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d29163390 0x558d295372d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:58.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.910+0000 7f82356f4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29184070 0x558d29543120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:58.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.910+0000 7f82356f4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558d292f2700 con 0x558d2915b1b0 2024-09-21T03:43:58.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.910+0000 7f82356f4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558d2942c110 con 0x558d29184070 2024-09-21T03:43:58.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.910+0000 7f82356f4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558d29539e30 con 0x558d29163390 2024-09-21T03:43:58.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.910+0000 7f82356f4740 10 client.0 _ll_register_callbacks cb 0x558d29445990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:58.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.910+0000 7f822cf1c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d2915b1b0 0x558d29536d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:58.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.910+0000 7f822cf1c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d2915b1b0 0x558d29536d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57072/0 (socket says 172.21.15.84:57072) 2024-09-21T03:43:58.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.910+0000 7f822cf1c640 1 -- 172.21.15.84:0/1747612192 learned_addr learned my addr 172.21.15.84:0/1747612192 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:58.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.910+0000 7f8227fff640 1 --2- 172.21.15.84:0/1747612192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d29163390 0x558d295372d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:58.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.911+0000 7f822d71d640 1 --2- 172.21.15.84:0/1747612192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29184070 0x558d29543120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:58.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.911+0000 7f822cf1c640 1 -- 172.21.15.84:0/1747612192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d29163390 msgr2=0x558d295372d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:58.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.911+0000 7f822cf1c640 1 --2- 172.21.15.84:0/1747612192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d29163390 0x558d295372d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.911+0000 7f822cf1c640 1 -- 172.21.15.84:0/1747612192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29184070 msgr2=0x558d29543120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:58.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.911+0000 7f822cf1c640 1 --2- 172.21.15.84:0/1747612192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29184070 0x558d29543120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.911+0000 7f822cf1c640 1 -- 172.21.15.84:0/1747612192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d29459c40 con 0x558d2915b1b0 2024-09-21T03:43:58.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.911+0000 7f822d71d640 1 --2- 172.21.15.84:0/1747612192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29184070 0x558d29543120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:58.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.911+0000 7f822cf1c640 1 --2- 172.21.15.84:0/1747612192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d2915b1b0 0x558d29536d90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f821c0e4fe0 tx=0x7f821c0e4e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430af0be7a5c5def server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:58.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.911+0000 7f8207fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:43:58.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.911+0000 7f8207fff640 1 -- 172.21.15.84:0/1747612192 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c020050 con 0x558d2915b1b0 2024-09-21T03:43:58.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.911+0000 7f8207fff640 1 -- 172.21.15.84:0/1747612192 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f821c098400 con 0x558d2915b1b0 2024-09-21T03:43:58.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.911+0000 7f82356f4740 1 -- 172.21.15.84:0/1747612192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f821c0ad7e0 con 0x558d2915b1b0 2024-09-21T03:43:58.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.911+0000 7f8207fff640 1 -- 172.21.15.84:0/1747612192 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f821c005310 con 0x558d2915b1b0 2024-09-21T03:43:58.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.911+0000 7f82356f4740 10 client.15741 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:58.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.911+0000 7f82356f4740 1 -- 172.21.15.84:0/1747612192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558d29545bc0 con 0x558d2915b1b0 2024-09-21T03:43:58.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.911+0000 7f8207fff640 1 -- 172.21.15.84:0/1747612192 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f821c0ad7e0 con 0x558d2915b1b0 2024-09-21T03:43:58.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.912+0000 7f8207fff640 1 -- 172.21.15.84:0/1747612192 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f821c0c5070 con 0x558d2915b1b0 2024-09-21T03:43:58.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.912+0000 7f82356f4740 10 client.15741 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:58.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.912+0000 7f82356f4740 10 client.15741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:43:58.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.912+0000 7f82356f4740 20 client.15741 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:58.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.912+0000 7f82356f4740 1 --2- 172.21.15.84:0/1747612192 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558d291429f0 0x558d29548f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:58.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.912+0000 7f82356f4740 4 client.15741 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:58.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.912+0000 7f82356f4740 1 -- 172.21.15.84:0/1747612192 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d294a3da0 con 0x558d291429f0 2024-09-21T03:43:58.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.912+0000 7f8227fff640 1 --2- 172.21.15.84:0/1747612192 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558d291429f0 0x558d29548f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:58.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.913+0000 7f8227fff640 1 --2- 172.21.15.84:0/1747612192 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558d291429f0 0x558d29548f20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=319f5c34e4407c85 server_cookie=6681c09f0714bc5a in_seq=0 out_seq=0 2024-09-21T03:43:58.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.913+0000 7f8207fff640 10 client.15741 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:58.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.913+0000 7f8207fff640 1 -- 172.21.15.84:0/1747612192 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558d294a3da0 con 0x558d291429f0 2024-09-21T03:43:58.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.913+0000 7f8207fff640 10 client.15741 handle_command_reply: tid=0 2024-09-21T03:43:58.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.913+0000 7f82356f4740 1 client.15741 shutdown 2024-09-21T03:43:58.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.914+0000 7f82356f4740 1 -- 172.21.15.84:0/1747612192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d2915b1b0 msgr2=0x558d29536d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:58.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.914+0000 7f82356f4740 1 --2- 172.21.15.84:0/1747612192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d2915b1b0 0x558d29536d90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f821c0e4fe0 tx=0x7f821c0e4e90 comp rx=0 tx=0).stop 2024-09-21T03:43:58.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.914+0000 7f82356f4740 1 -- 172.21.15.84:0/1747612192 shutdown_connections 2024-09-21T03:43:58.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.914+0000 7f82356f4740 1 --2- 172.21.15.84:0/1747612192 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558d291429f0 0x558d29548f20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.914+0000 7f82356f4740 1 --2- 172.21.15.84:0/1747612192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29184070 0x558d29543120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.914+0000 7f82356f4740 1 --2- 172.21.15.84:0/1747612192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d29163390 0x558d295372d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.914+0000 7f82356f4740 1 --2- 172.21.15.84:0/1747612192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d2915b1b0 0x558d29536d90 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.914+0000 7f82356f4740 1 -- 172.21.15.84:0/1747612192 >> 172.21.15.84:0/1747612192 conn(0x558d29178460 msgr2=0x558d2952e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:58.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.914+0000 7f8207fff640 0 client.15741 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:58.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.914+0000 7f82356f4740 1 -- 172.21.15.84:0/1747612192 shutdown_connections 2024-09-21T03:43:58.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.914+0000 7f82356f4740 1 -- 172.21.15.84:0/1747612192 wait complete. 2024-09-21T03:43:58.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.914+0000 7f82356f4740 20 client.15741 trim_cache size 0 max 16384 2024-09-21T03:43:58.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.931+0000 7f82356f4740 1 Processor -- start 2024-09-21T03:43:58.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.931+0000 7f82356f4740 1 -- start start 2024-09-21T03:43:58.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.932+0000 7f82356f4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d2915b1b0 0x558d29537250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:58.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.932+0000 7f82356f4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29163390 0x558d2952e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:58.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.932+0000 7f82356f4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29184070 0x558d2952ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:58.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.932+0000 7f82356f4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f82281b1ef0 con 0x558d29163390 2024-09-21T03:43:58.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.932+0000 7f82356f4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f82281af7c0 con 0x558d29184070 2024-09-21T03:43:58.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.932+0000 7f82356f4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f82281ad630 con 0x558d2915b1b0 2024-09-21T03:43:58.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.932+0000 7f8227fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29163390 0x558d2952e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:58.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.932+0000 7f8227fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29163390 0x558d2952e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57078/0 (socket says 172.21.15.84:57078) 2024-09-21T03:43:58.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.932+0000 7f8227fff640 1 -- 172.21.15.84:0/2402800171 learned_addr learned my addr 172.21.15.84:0/2402800171 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:58.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.932+0000 7f822cf1c640 1 --2- 172.21.15.84:0/2402800171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d2915b1b0 0x558d29537250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:58.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.932+0000 7f822d71d640 1 --2- 172.21.15.84:0/2402800171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29184070 0x558d2952ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:58.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.932+0000 7f8227fff640 1 -- 172.21.15.84:0/2402800171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d2915b1b0 msgr2=0x558d29537250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:58.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.932+0000 7f8227fff640 1 --2- 172.21.15.84:0/2402800171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d2915b1b0 0x558d29537250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.932+0000 7f8227fff640 1 -- 172.21.15.84:0/2402800171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29184070 msgr2=0x558d2952ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:58.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.932+0000 7f8227fff640 1 --2- 172.21.15.84:0/2402800171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29184070 0x558d2952ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.932+0000 7f8227fff640 1 -- 172.21.15.84:0/2402800171 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d2954f210 con 0x558d29163390 2024-09-21T03:43:58.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.932+0000 7f822d71d640 1 --2- 172.21.15.84:0/2402800171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29184070 0x558d2952ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:58.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.932+0000 7f8227fff640 1 --2- 172.21.15.84:0/2402800171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29163390 0x558d2952e750 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f822806aaa0 tx=0x7f821403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5859408035cfc7de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:58.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.933+0000 7f82127fc640 1 -- 172.21.15.84:0/2402800171 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8214056070 con 0x558d29163390 2024-09-21T03:43:58.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.933+0000 7f82127fc640 1 -- 172.21.15.84:0/2402800171 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82140054f0 con 0x558d29163390 2024-09-21T03:43:58.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.933+0000 7f82127fc640 1 -- 172.21.15.84:0/2402800171 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8214035050 con 0x558d29163390 2024-09-21T03:43:58.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.933+0000 7f82356f4740 1 -- 172.21.15.84:0/2402800171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29163390 msgr2=0x558d2952e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:58.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.933+0000 7f82356f4740 1 --2- 172.21.15.84:0/2402800171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29163390 0x558d2952e750 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f822806aaa0 tx=0x7f821403f000 comp rx=0 tx=0).stop 2024-09-21T03:43:58.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.933+0000 7f82356f4740 1 -- 172.21.15.84:0/2402800171 shutdown_connections 2024-09-21T03:43:58.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.933+0000 7f82356f4740 1 --2- 172.21.15.84:0/2402800171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29184070 0x558d2952ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.933+0000 7f82356f4740 1 --2- 172.21.15.84:0/2402800171 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29163390 0x558d2952e750 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.933+0000 7f82356f4740 1 --2- 172.21.15.84:0/2402800171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d2915b1b0 0x558d29537250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.934+0000 7f82356f4740 1 -- 172.21.15.84:0/2402800171 >> 172.21.15.84:0/2402800171 conn(0x558d29178460 msgr2=0x558d29536b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:58.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.934+0000 7f82356f4740 1 -- 172.21.15.84:0/2402800171 shutdown_connections 2024-09-21T03:43:58.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.934+0000 7f82356f4740 1 -- 172.21.15.84:0/2402800171 wait complete. 2024-09-21T03:43:58.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.934+0000 7f82356f4740 1 -- start start 2024-09-21T03:43:58.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.934+0000 7f82356f4740 1 Processor -- start 2024-09-21T03:43:58.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f82356f4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d2915b1b0 0x558d2954c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:58.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f82356f4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29163390 0x558d29549c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:58.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f82356f4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29184070 0x558d2954a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:58.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f82356f4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f82281adc80 con 0x558d29163390 2024-09-21T03:43:58.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f82356f4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f82281af0f0 con 0x558d29184070 2024-09-21T03:43:58.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f82356f4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f82281ae350 con 0x558d2915b1b0 2024-09-21T03:43:58.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f82356f4740 10 client.0 _ll_register_callbacks cb 0x7f821c0b1070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:58.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f8227fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29163390 0x558d29549c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:58.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f8227fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29163390 0x558d29549c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57084/0 (socket says 172.21.15.84:57084) 2024-09-21T03:43:58.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f8227fff640 1 -- 172.21.15.84:0/355729035 learned_addr learned my addr 172.21.15.84:0/355729035 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:43:58.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f822d71d640 1 --2- 172.21.15.84:0/355729035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29184070 0x558d2954a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:58.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f822cf1c640 1 --2- 172.21.15.84:0/355729035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d2915b1b0 0x558d2954c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:58.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f8227fff640 1 -- 172.21.15.84:0/355729035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d2915b1b0 msgr2=0x558d2954c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:58.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f8227fff640 1 --2- 172.21.15.84:0/355729035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d2915b1b0 0x558d2954c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f8227fff640 1 -- 172.21.15.84:0/355729035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29184070 msgr2=0x558d2954a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:58.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f8227fff640 1 --2- 172.21.15.84:0/355729035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29184070 0x558d2954a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f8227fff640 1 -- 172.21.15.84:0/355729035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d2954a910 con 0x558d29163390 2024-09-21T03:43:58.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f822cf1c640 1 --2- 172.21.15.84:0/355729035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d2915b1b0 0x558d2954c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:58.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f822d71d640 1 --2- 172.21.15.84:0/355729035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29184070 0x558d2954a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:58.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f8227fff640 1 --2- 172.21.15.84:0/355729035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29163390 0x558d29549c20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8214031440 tx=0x7f8214004900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a310c83cb9538b71 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:58.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f8207fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:43:58.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.935+0000 7f8207fff640 1 -- 172.21.15.84:0/355729035 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8214062070 con 0x558d29163390 2024-09-21T03:43:58.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.936+0000 7f8207fff640 1 -- 172.21.15.84:0/355729035 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f8214005040 con 0x558d29163390 2024-09-21T03:43:58.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.936+0000 7f82356f4740 1 -- 172.21.15.84:0/355729035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82140054f0 con 0x558d29163390 2024-09-21T03:43:58.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.936+0000 7f8207fff640 1 -- 172.21.15.84:0/355729035 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8214035070 con 0x558d29163390 2024-09-21T03:43:58.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.936+0000 7f82356f4740 10 client.15747 fetch_fsmap learned FSMap version 25 2024-09-21T03:43:58.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.936+0000 7f82356f4740 1 -- 172.21.15.84:0/355729035 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558d295b3580 con 0x558d29163390 2024-09-21T03:43:58.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.936+0000 7f8207fff640 1 -- 172.21.15.84:0/355729035 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82140054f0 con 0x558d29163390 2024-09-21T03:43:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.936+0000 7f8207fff640 1 -- 172.21.15.84:0/355729035 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8214003990 con 0x558d29163390 2024-09-21T03:43:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.936+0000 7f82356f4740 10 client.15747 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:43:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.936+0000 7f82356f4740 10 client.15747 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:43:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.936+0000 7f82356f4740 20 client.15747 populate_metadata read hostname 'smithi084' 2024-09-21T03:43:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.936+0000 7f82356f4740 1 --2- 172.21.15.84:0/355729035 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558d29117da0 0x558d295b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.936+0000 7f82356f4740 4 client.15747 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:43:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.936+0000 7f82356f4740 1 -- 172.21.15.84:0/355729035 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558d2949f850 con 0x558d29117da0 2024-09-21T03:43:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.937+0000 7f822cf1c640 1 --2- 172.21.15.84:0/355729035 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558d29117da0 0x558d295b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.937+0000 7f822cf1c640 1 --2- 172.21.15.84:0/355729035 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558d29117da0 0x558d295b5c50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c07740a6a8b5620 server_cookie=624fb349b3ca1cd5 in_seq=0 out_seq=0 2024-09-21T03:43:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.937+0000 7f8207fff640 10 client.15747 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.937+0000 7f8207fff640 1 -- 172.21.15.84:0/355729035 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x558d2949f850 con 0x558d29117da0 2024-09-21T03:43:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.937+0000 7f8207fff640 10 client.15747 handle_command_reply: tid=0 2024-09-21T03:43:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.937+0000 7f82356f4740 1 client.15747 shutdown 2024-09-21T03:43:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.937+0000 7f82356f4740 1 -- 172.21.15.84:0/355729035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29163390 msgr2=0x558d29549c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.937+0000 7f82356f4740 1 --2- 172.21.15.84:0/355729035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29163390 0x558d29549c20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8214031440 tx=0x7f8214004900 comp rx=0 tx=0).stop 2024-09-21T03:43:58.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.938+0000 7f82356f4740 1 -- 172.21.15.84:0/355729035 shutdown_connections 2024-09-21T03:43:58.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.938+0000 7f82356f4740 1 --2- 172.21.15.84:0/355729035 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558d29117da0 0x558d295b5c50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.938+0000 7f8207fff640 0 client.15747 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:43:58.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.938+0000 7f82356f4740 1 --2- 172.21.15.84:0/355729035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d29184070 0x558d2954a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.938+0000 7f82356f4740 1 --2- 172.21.15.84:0/355729035 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d29163390 0x558d29549c20 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.938+0000 7f82356f4740 1 --2- 172.21.15.84:0/355729035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d2915b1b0 0x558d2954c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.938+0000 7f82356f4740 1 -- 172.21.15.84:0/355729035 >> 172.21.15.84:0/355729035 conn(0x558d29178460 msgr2=0x558d2952e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:58.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.938+0000 7f82356f4740 1 -- 172.21.15.84:0/355729035 shutdown_connections 2024-09-21T03:43:58.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.938+0000 7f82356f4740 1 -- 172.21.15.84:0/355729035 wait complete. 2024-09-21T03:43:58.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.938+0000 7f82356f4740 20 client.15747 trim_cache size 0 max 16384 2024-09-21T03:43:58.945 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:43:58.945 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T03:43:58.946 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T03:43:58.946 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:43:58.946 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:43:58.946 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:43:58.946 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:43:58.946 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:43:58.946 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:43:58.946 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:43:58.946 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:43:58.946 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:43:58.946 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:43:58.946 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:43:58.946 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:43:58.947 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:43:58.947 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:43:58.947 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:43:58.947 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:43:58.947 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:43:58.947 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:43:58.947 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:43:58.947 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:43:58.947 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:43:58.947 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:43:58.947 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:43:58.947 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:43:58.947 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:43:58.947 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:43:58.947 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:43:58.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.938+0000 7f822f180640 1 -- 172.21.15.84:0/1632940474 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f82180b6680 msgr2=0x7f82180b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:58.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.938+0000 7f822f180640 1 --2- 172.21.15.84:0/1632940474 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f82180b6680 0x7f82180b8b90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8214000c00 tx=0x7f8214032cc0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.938+0000 7f822f180640 1 -- 172.21.15.84:0/1632940474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8228102a60 msgr2=0x7f822819a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:58.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.938+0000 7f822f180640 1 --2- 172.21.15.84:0/1632940474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8228102a60 0x7f822819a530 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f821c00d770 tx=0x7f821c00dc30 comp rx=0 tx=0).stop 2024-09-21T03:43:58.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.939+0000 7f822f180640 1 -- 172.21.15.84:0/1632940474 shutdown_connections 2024-09-21T03:43:58.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.939+0000 7f822f180640 1 --2- 172.21.15.84:0/1632940474 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f82180b6680 0x7f82180b8b90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.939+0000 7f822f180640 1 --2- 172.21.15.84:0/1632940474 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8228108cf0 0x7f822819fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.939+0000 7f822f180640 1 --2- 172.21.15.84:0/1632940474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82281083a0 0x7f822819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.939+0000 7f822f180640 1 --2- 172.21.15.84:0/1632940474 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8228102a60 0x7f822819a530 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:58.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.939+0000 7f822f180640 1 -- 172.21.15.84:0/1632940474 >> 172.21.15.84:0/1632940474 conn(0x7f8228079730 msgr2=0x7f8228104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:58.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.939+0000 7f822f180640 1 -- 172.21.15.84:0/1632940474 shutdown_connections 2024-09-21T03:43:58.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:43:58.939+0000 7f822f180640 1 -- 172.21.15.84:0/1632940474 wait complete. 2024-09-21T03:43:59.885 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:43:59.885 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:44:00.138 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:00.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.637+0000 7f6623fff640 1 -- 172.21.15.84:0/3624923962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6624103990 msgr2=0x7f6624103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:00.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.637+0000 7f6623fff640 1 --2- 172.21.15.84:0/3624923962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6624103990 0x7f6624103da0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6614009900 tx=0x7f661402a410 comp rx=0 tx=0).stop 2024-09-21T03:44:00.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.637+0000 7f6623fff640 1 -- 172.21.15.84:0/3624923962 shutdown_connections 2024-09-21T03:44:00.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.637+0000 7f6623fff640 1 --2- 172.21.15.84:0/3624923962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6624109c20 0x7f6624110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:00.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.637+0000 7f6623fff640 1 --2- 172.21.15.84:0/3624923962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66241092d0 0x7f66241096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:00.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.637+0000 7f6623fff640 1 --2- 172.21.15.84:0/3624923962 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6624103990 0x7f6624103da0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:00.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.637+0000 7f6623fff640 1 -- 172.21.15.84:0/3624923962 >> 172.21.15.84:0/3624923962 conn(0x7f66240ff3e0 msgr2=0x7f6624101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:00.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.637+0000 7f6623fff640 1 -- 172.21.15.84:0/3624923962 shutdown_connections 2024-09-21T03:44:00.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.637+0000 7f6623fff640 1 -- 172.21.15.84:0/3624923962 wait complete. 2024-09-21T03:44:00.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.638+0000 7f6623fff640 1 Processor -- start 2024-09-21T03:44:00.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.638+0000 7f6623fff640 1 -- start start 2024-09-21T03:44:00.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.638+0000 7f6623fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6624103990 0x7f662419a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:00.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.638+0000 7f6623fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66241092d0 0x7f662419a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:00.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.638+0000 7f6623fff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6624109c20 0x7f662419fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:00.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.638+0000 7f6623fff640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f66241138e0 con 0x7f6624103990 2024-09-21T03:44:00.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.638+0000 7f6623fff640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6624113760 con 0x7f66241092d0 2024-09-21T03:44:00.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.638+0000 7f6623fff640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6624113a60 con 0x7f6624109c20 2024-09-21T03:44:00.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.638+0000 7f6622ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6624103990 0x7f662419a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:00.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.638+0000 7f6622ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6624103990 0x7f662419a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57100/0 (socket says 172.21.15.84:57100) 2024-09-21T03:44:00.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.638+0000 7f6622ffd640 1 -- 172.21.15.84:0/4150755469 learned_addr learned my addr 172.21.15.84:0/4150755469 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:00.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.639+0000 7f66227fc640 1 --2- 172.21.15.84:0/4150755469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66241092d0 0x7f662419a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:00.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.639+0000 7f66237fe640 1 --2- 172.21.15.84:0/4150755469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6624109c20 0x7f662419fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:00.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.639+0000 7f6622ffd640 1 -- 172.21.15.84:0/4150755469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6624109c20 msgr2=0x7f662419fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:00.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.639+0000 7f6622ffd640 1 --2- 172.21.15.84:0/4150755469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6624109c20 0x7f662419fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:00.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.639+0000 7f6622ffd640 1 -- 172.21.15.84:0/4150755469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66241092d0 msgr2=0x7f662419a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:00.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.639+0000 7f6622ffd640 1 --2- 172.21.15.84:0/4150755469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66241092d0 0x7f662419a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:00.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.639+0000 7f6622ffd640 1 -- 172.21.15.84:0/4150755469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66241a01c0 con 0x7f6624103990 2024-09-21T03:44:00.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.639+0000 7f66237fe640 1 --2- 172.21.15.84:0/4150755469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6624109c20 0x7f662419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:00.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.639+0000 7f6622ffd640 1 --2- 172.21.15.84:0/4150755469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6624103990 0x7f662419a310 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6614006010 tx=0x7f66140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:00.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.639+0000 7f661bfff640 1 -- 172.21.15.84:0/4150755469 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661403f030 con 0x7f6624103990 2024-09-21T03:44:00.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.639+0000 7f661bfff640 1 -- 172.21.15.84:0/4150755469 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6614003800 con 0x7f6624103990 2024-09-21T03:44:00.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.639+0000 7f661bfff640 1 -- 172.21.15.84:0/4150755469 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6614035070 con 0x7f6624103990 2024-09-21T03:44:00.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.639+0000 7f6623fff640 1 -- 172.21.15.84:0/4150755469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66241a0450 con 0x7f6624103990 2024-09-21T03:44:00.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.639+0000 7f6623fff640 1 -- 172.21.15.84:0/4150755469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66241a0930 con 0x7f6624103990 2024-09-21T03:44:00.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.640+0000 7f6623fff640 1 -- 172.21.15.84:0/4150755469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6624103da0 con 0x7f6624103990 2024-09-21T03:44:00.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.642+0000 7f661bfff640 1 -- 172.21.15.84:0/4150755469 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f6614003cb0 con 0x7f6624103990 2024-09-21T03:44:00.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.642+0000 7f661bfff640 1 --2- 172.21.15.84:0/4150755469 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f66100b66b0 0x7f66100b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:00.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.642+0000 7f66227fc640 1 --2- 172.21.15.84:0/4150755469 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f66100b66b0 0x7f66100b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:00.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.642+0000 7f661bfff640 1 -- 172.21.15.84:0/4150755469 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f66141080f0 con 0x7f6624103990 2024-09-21T03:44:00.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.643+0000 7f66227fc640 1 --2- 172.21.15.84:0/4150755469 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f66100b66b0 0x7f66100b8bc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f660c005e10 tx=0x7f660c005da0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:00.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.647+0000 7f661bfff640 1 -- 172.21.15.84:0/4150755469 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f66140ce6e0 con 0x7f6624103990 2024-09-21T03:44:00.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.877+0000 7f6623fff640 1 -- 172.21.15.84:0/4150755469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f662402e640 con 0x7f6624103990 2024-09-21T03:44:00.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.878+0000 7f661bfff640 1 -- 172.21.15.84:0/4150755469 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7f66140d2ac0 con 0x7f6624103990 2024-09-21T03:44:00.883 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:44:00.883 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:44:00.883 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:44:00.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.880+0000 7f6623fff640 1 -- 172.21.15.84:0/4150755469 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f66100b66b0 msgr2=0x7f66100b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:00.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.880+0000 7f6623fff640 1 --2- 172.21.15.84:0/4150755469 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f66100b66b0 0x7f66100b8bc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f660c005e10 tx=0x7f660c005da0 comp rx=0 tx=0).stop 2024-09-21T03:44:00.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.880+0000 7f6623fff640 1 -- 172.21.15.84:0/4150755469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6624103990 msgr2=0x7f662419a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:00.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.880+0000 7f6623fff640 1 --2- 172.21.15.84:0/4150755469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6624103990 0x7f662419a310 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6614006010 tx=0x7f66140042f0 comp rx=0 tx=0).stop 2024-09-21T03:44:00.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.880+0000 7f6623fff640 1 -- 172.21.15.84:0/4150755469 shutdown_connections 2024-09-21T03:44:00.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.880+0000 7f6623fff640 1 --2- 172.21.15.84:0/4150755469 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f66100b66b0 0x7f66100b8bc0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:00.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.880+0000 7f6623fff640 1 --2- 172.21.15.84:0/4150755469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6624109c20 0x7f662419fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:00.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.880+0000 7f6623fff640 1 --2- 172.21.15.84:0/4150755469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66241092d0 0x7f662419a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:00.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.880+0000 7f6623fff640 1 --2- 172.21.15.84:0/4150755469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6624103990 0x7f662419a310 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:00.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.880+0000 7f6623fff640 1 -- 172.21.15.84:0/4150755469 >> 172.21.15.84:0/4150755469 conn(0x7f66240ff3e0 msgr2=0x7f6624101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:00.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.880+0000 7f6623fff640 1 -- 172.21.15.84:0/4150755469 shutdown_connections 2024-09-21T03:44:00.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:00.880+0000 7f6623fff640 1 -- 172.21.15.84:0/4150755469 wait complete. 2024-09-21T03:44:01.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:01 smithi084 ceph-mon[30941]: pgmap v370: 97 pgs: 97 active+clean; 1.7 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-21T03:44:01.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:01 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/4150755469' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:44:01.581 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:01 smithi174 ceph-mon[34403]: pgmap v370: 97 pgs: 97 active+clean; 1.7 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-21T03:44:01.581 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:01 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/4150755469' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:44:01.604 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:01 smithi172 ceph-mon[34821]: pgmap v370: 97 pgs: 97 active+clean; 1.7 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-21T03:44:01.604 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:01 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/4150755469' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:44:01.618 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:44:01.868 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:02.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.356+0000 7f0d2c78f640 1 -- 172.21.15.84:0/2820753138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d24108cf0 msgr2=0x7f0d2410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:02.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.356+0000 7f0d2c78f640 1 --2- 172.21.15.84:0/2820753138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d24108cf0 0x7f0d2410f520 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009ca0 tx=0x7f0d1c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.356+0000 7f0d2c78f640 1 -- 172.21.15.84:0/2820753138 shutdown_connections 2024-09-21T03:44:02.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.356+0000 7f0d2c78f640 1 --2- 172.21.15.84:0/2820753138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d24108cf0 0x7f0d2410f520 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.356+0000 7f0d2c78f640 1 --2- 172.21.15.84:0/2820753138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d241083a0 0x7f0d241087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.356+0000 7f0d2c78f640 1 --2- 172.21.15.84:0/2820753138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d24102a60 0x7f0d24102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.356+0000 7f0d2c78f640 1 -- 172.21.15.84:0/2820753138 >> 172.21.15.84:0/2820753138 conn(0x7f0d24079730 msgr2=0x7f0d24079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:02.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.356+0000 7f0d2c78f640 1 -- 172.21.15.84:0/2820753138 shutdown_connections 2024-09-21T03:44:02.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.356+0000 7f0d2c78f640 1 -- 172.21.15.84:0/2820753138 wait complete. 2024-09-21T03:44:02.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.356+0000 7f0d2c78f640 1 Processor -- start 2024-09-21T03:44:02.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.357+0000 7f0d2c78f640 1 -- start start 2024-09-21T03:44:02.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.357+0000 7f0d2c78f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d24102a60 0x7f0d24199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:02.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.357+0000 7f0d2c78f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d241083a0 0x7f0d24199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:02.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.357+0000 7f0d2c78f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d24108cf0 0x7f0d2419ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:02.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.357+0000 7f0d2c78f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0d24112960 con 0x7f0d241083a0 2024-09-21T03:44:02.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.357+0000 7f0d2c78f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0d241127e0 con 0x7f0d24102a60 2024-09-21T03:44:02.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.357+0000 7f0d2c78f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0d24112ae0 con 0x7f0d24108cf0 2024-09-21T03:44:02.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.357+0000 7f0d29d2a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d241083a0 0x7f0d24199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:02.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.357+0000 7f0d29d2a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d241083a0 0x7f0d24199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57120/0 (socket says 172.21.15.84:57120) 2024-09-21T03:44:02.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.357+0000 7f0d29d2a640 1 -- 172.21.15.84:0/198999826 learned_addr learned my addr 172.21.15.84:0/198999826 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:02.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.357+0000 7f0d2a52b640 1 --2- 172.21.15.84:0/198999826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d24102a60 0x7f0d24199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:02.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.357+0000 7f0d2ad2c640 1 --2- 172.21.15.84:0/198999826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d24108cf0 0x7f0d2419ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:02.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.357+0000 7f0d29d2a640 1 -- 172.21.15.84:0/198999826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d24108cf0 msgr2=0x7f0d2419ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:02.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.357+0000 7f0d29d2a640 1 --2- 172.21.15.84:0/198999826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d24108cf0 0x7f0d2419ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.357+0000 7f0d29d2a640 1 -- 172.21.15.84:0/198999826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d24102a60 msgr2=0x7f0d24199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:02.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.357+0000 7f0d29d2a640 1 --2- 172.21.15.84:0/198999826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d24102a60 0x7f0d24199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.357+0000 7f0d29d2a640 1 -- 172.21.15.84:0/198999826 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2419f2e0 con 0x7f0d241083a0 2024-09-21T03:44:02.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.358+0000 7f0d29d2a640 1 --2- 172.21.15.84:0/198999826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d241083a0 0x7f0d24199910 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400c970 tx=0x7f0d1400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:02.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.358+0000 7f0d1b7fe640 1 -- 172.21.15.84:0/198999826 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d14007bb0 con 0x7f0d241083a0 2024-09-21T03:44:02.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.358+0000 7f0d1b7fe640 1 -- 172.21.15.84:0/198999826 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d14007d50 con 0x7f0d241083a0 2024-09-21T03:44:02.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.358+0000 7f0d2c78f640 1 -- 172.21.15.84:0/198999826 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d2419f5d0 con 0x7f0d241083a0 2024-09-21T03:44:02.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.358+0000 7f0d1b7fe640 1 -- 172.21.15.84:0/198999826 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1400f450 con 0x7f0d241083a0 2024-09-21T03:44:02.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.358+0000 7f0d2c78f640 1 -- 172.21.15.84:0/198999826 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d241a5d30 con 0x7f0d241083a0 2024-09-21T03:44:02.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.360+0000 7f0d32d03740 1 Processor -- start 2024-09-21T03:44:02.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.361+0000 7f0d32d03740 1 -- start start 2024-09-21T03:44:02.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.361+0000 7f0d1b7fe640 1 -- 172.21.15.84:0/198999826 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f0d14004f20 con 0x7f0d241083a0 2024-09-21T03:44:02.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.361+0000 7f0d32d03740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f440a4070 0x564f4444b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:02.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.361+0000 7f0d32d03740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f4407b1b0 0x564f4444bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:02.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.361+0000 7f0d32d03740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f44083390 0x564f4444c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:02.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.361+0000 7f0d32d03740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564f443c1ea0 con 0x564f44083390 2024-09-21T03:44:02.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.361+0000 7f0d32d03740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564f443b12d0 con 0x564f440a4070 2024-09-21T03:44:02.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.361+0000 7f0d32d03740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564f443b50e0 con 0x564f4407b1b0 2024-09-21T03:44:02.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.361+0000 7f0d29d2a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f44083390 0x564f4444c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:02.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.361+0000 7f0d29d2a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f44083390 0x564f4444c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57132/0 (socket says 172.21.15.84:57132) 2024-09-21T03:44:02.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.361+0000 7f0d29d2a640 1 -- 172.21.15.84:0/2858259192 learned_addr learned my addr 172.21.15.84:0/2858259192 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:02.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.361+0000 7f0d2ad2c640 1 --2- 172.21.15.84:0/2858259192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f440a4070 0x564f4444b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:02.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.361+0000 7f0d2a52b640 1 --2- 172.21.15.84:0/2858259192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f4407b1b0 0x564f4444bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:02.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.361+0000 7f0d29d2a640 1 -- 172.21.15.84:0/2858259192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f4407b1b0 msgr2=0x564f4444bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:02.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.361+0000 7f0d29d2a640 1 --2- 172.21.15.84:0/2858259192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f4407b1b0 0x564f4444bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.361+0000 7f0d29d2a640 1 -- 172.21.15.84:0/2858259192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f440a4070 msgr2=0x564f4444b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:02.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.361+0000 7f0d29d2a640 1 --2- 172.21.15.84:0/2858259192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f440a4070 0x564f4444b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.362+0000 7f0d29d2a640 1 -- 172.21.15.84:0/2858259192 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f4410f650 con 0x564f44083390 2024-09-21T03:44:02.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.362+0000 7f0d2ad2c640 1 --2- 172.21.15.84:0/2858259192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f440a4070 0x564f4444b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:02.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.362+0000 7f0d29d2a640 1 --2- 172.21.15.84:0/2858259192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f44083390 0x564f4444c120 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0d140e4cd0 tx=0x7f0d140edcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790207848470be2b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:02.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.362+0000 7f0d1b7fe640 1 --2- 172.21.15.84:0/198999826 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0d100b6680 0x7f0d100b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:02.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.362+0000 7f0d18ff9640 1 -- 172.21.15.84:0/2858259192 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d140f6070 con 0x564f44083390 2024-09-21T03:44:02.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.362+0000 7f0d2ad2c640 1 --2- 172.21.15.84:0/198999826 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0d100b6680 0x7f0d100b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:02.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.362+0000 7f0d18ff9640 1 -- 172.21.15.84:0/2858259192 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d140d3a40 con 0x564f44083390 2024-09-21T03:44:02.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.362+0000 7f0d18ff9640 1 -- 172.21.15.84:0/2858259192 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d140acc80 con 0x564f44083390 2024-09-21T03:44:02.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.362+0000 7f0d1b7fe640 1 -- 172.21.15.84:0/198999826 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f0d140e7590 con 0x7f0d241083a0 2024-09-21T03:44:02.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.363+0000 7f0d32d03740 1 -- 172.21.15.84:0/2858259192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f44083390 msgr2=0x564f4444c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:02.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.363+0000 7f0d32d03740 1 --2- 172.21.15.84:0/2858259192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f44083390 0x564f4444c120 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0d140e4cd0 tx=0x7f0d140edcd0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.363+0000 7f0d2ad2c640 1 --2- 172.21.15.84:0/198999826 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0d100b6680 0x7f0d100b8b90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c02f500 tx=0x7f0d1c02f370 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:02.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.363+0000 7f0d32d03740 1 -- 172.21.15.84:0/2858259192 shutdown_connections 2024-09-21T03:44:02.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.363+0000 7f0d32d03740 1 --2- 172.21.15.84:0/2858259192 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f44083390 0x564f4444c120 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.363+0000 7f0d32d03740 1 --2- 172.21.15.84:0/2858259192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f4407b1b0 0x564f4444bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.363+0000 7f0d32d03740 1 --2- 172.21.15.84:0/2858259192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f440a4070 0x564f4444b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.363+0000 7f0d32d03740 1 -- 172.21.15.84:0/2858259192 >> 172.21.15.84:0/2858259192 conn(0x564f44098460 msgr2=0x564f44449590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:02.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.363+0000 7f0d32d03740 1 -- 172.21.15.84:0/2858259192 shutdown_connections 2024-09-21T03:44:02.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.363+0000 7f0d32d03740 1 -- 172.21.15.84:0/2858259192 wait complete. 2024-09-21T03:44:02.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.363+0000 7f0d32d03740 1 -- start start 2024-09-21T03:44:02.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.364+0000 7f0d32d03740 1 Processor -- start 2024-09-21T03:44:02.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.364+0000 7f0d32d03740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f4407b1b0 0x564f44456d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:02.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.364+0000 7f0d32d03740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f44083390 0x564f44457260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:02.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.364+0000 7f0d32d03740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f440a4070 0x564f444631a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:02.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.364+0000 7f0d32d03740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564f44212700 con 0x564f440a4070 2024-09-21T03:44:02.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.364+0000 7f0d32d03740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564f4434c160 con 0x564f44083390 2024-09-21T03:44:02.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.364+0000 7f0d32d03740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564f44459e80 con 0x564f4407b1b0 2024-09-21T03:44:02.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.364+0000 7f0d32d03740 10 client.0 _ll_register_callbacks cb 0x564f443659e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:02.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.364+0000 7f0d2ad2c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f440a4070 0x564f444631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:02.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.364+0000 7f0d2ad2c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f440a4070 0x564f444631a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57146/0 (socket says 172.21.15.84:57146) 2024-09-21T03:44:02.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.364+0000 7f0d2ad2c640 1 -- 172.21.15.84:0/2955832573 learned_addr learned my addr 172.21.15.84:0/2955832573 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:02.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.364+0000 7f0d29d2a640 1 --2- 172.21.15.84:0/2955832573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f44083390 0x564f44457260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:02.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.364+0000 7f0d2a52b640 1 --2- 172.21.15.84:0/2955832573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f4407b1b0 0x564f44456d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:02.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.364+0000 7f0d2ad2c640 1 -- 172.21.15.84:0/2955832573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f4407b1b0 msgr2=0x564f44456d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:02.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.364+0000 7f0d2ad2c640 1 --2- 172.21.15.84:0/2955832573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f4407b1b0 0x564f44456d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.364+0000 7f0d2ad2c640 1 -- 172.21.15.84:0/2955832573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f44083390 msgr2=0x564f44457260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:02.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.364+0000 7f0d2ad2c640 1 --2- 172.21.15.84:0/2955832573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f44083390 0x564f44457260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.364+0000 7f0d2ad2c640 1 -- 172.21.15.84:0/2955832573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f44379c90 con 0x564f440a4070 2024-09-21T03:44:02.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.365+0000 7f0d2ad2c640 1 --2- 172.21.15.84:0/2955832573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f440a4070 0x564f444631a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c035000 tx=0x7f0d1c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f36db831838d84 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:02.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.365+0000 7f0d0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:02.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.365+0000 7f0d0dffb640 1 -- 172.21.15.84:0/2955832573 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c058060 con 0x564f440a4070 2024-09-21T03:44:02.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.365+0000 7f0d0dffb640 1 -- 172.21.15.84:0/2955832573 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f0d1c042030 con 0x564f440a4070 2024-09-21T03:44:02.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.365+0000 7f0d32d03740 1 -- 172.21.15.84:0/2955832573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d140d3a40 con 0x564f440a4070 2024-09-21T03:44:02.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.365+0000 7f0d0dffb640 1 -- 172.21.15.84:0/2955832573 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0d1c004040 con 0x564f440a4070 2024-09-21T03:44:02.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.365+0000 7f0d32d03740 10 client.15765 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:02.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.365+0000 7f0d32d03740 1 -- 172.21.15.84:0/2955832573 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564f44465b80 con 0x564f440a4070 2024-09-21T03:44:02.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.365+0000 7f0d0dffb640 1 -- 172.21.15.84:0/2955832573 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d140d3a40 con 0x564f440a4070 2024-09-21T03:44:02.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.365+0000 7f0d0dffb640 1 -- 172.21.15.84:0/2955832573 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0d1c02f880 con 0x564f440a4070 2024-09-21T03:44:02.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.365+0000 7f0d32d03740 10 client.15765 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:02.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.365+0000 7f0d32d03740 10 client.15765 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:44:02.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.365+0000 7f0d32d03740 20 client.15765 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:02.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.365+0000 7f0d32d03740 1 --2- 172.21.15.84:0/2955832573 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x564f440629f0 0x564f44469170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:02.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.365+0000 7f0d32d03740 4 client.15765 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:44:02.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.366+0000 7f0d32d03740 1 -- 172.21.15.84:0/2955832573 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f443c3df0 con 0x564f440629f0 2024-09-21T03:44:02.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.366+0000 7f0d2a52b640 1 --2- 172.21.15.84:0/2955832573 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x564f440629f0 0x564f44469170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:02.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.366+0000 7f0d0dffb640 10 client.15765 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:44:02.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.366+0000 7f0d2a52b640 1 --2- 172.21.15.84:0/2955832573 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x564f440629f0 0x564f44469170 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bdb349bd94925ab3 server_cookie=e0d414e50402f1f3 in_seq=0 out_seq=0 2024-09-21T03:44:02.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.367+0000 7f0d0dffb640 1 -- 172.21.15.84:0/2955832573 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564f443c3df0 con 0x564f440629f0 2024-09-21T03:44:02.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.367+0000 7f0d0dffb640 10 client.15765 handle_command_reply: tid=0 2024-09-21T03:44:02.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.367+0000 7f0d32d03740 1 client.15765 shutdown 2024-09-21T03:44:02.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.367+0000 7f0d32d03740 1 -- 172.21.15.84:0/2955832573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f440a4070 msgr2=0x564f444631a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:02.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.367+0000 7f0d32d03740 1 --2- 172.21.15.84:0/2955832573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f440a4070 0x564f444631a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c035000 tx=0x7f0d1c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.367+0000 7f0d32d03740 1 -- 172.21.15.84:0/2955832573 shutdown_connections 2024-09-21T03:44:02.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.367+0000 7f0d32d03740 1 --2- 172.21.15.84:0/2955832573 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x564f440629f0 0x564f44469170 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.367+0000 7f0d32d03740 1 --2- 172.21.15.84:0/2955832573 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f440a4070 0x564f444631a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.367+0000 7f0d32d03740 1 --2- 172.21.15.84:0/2955832573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f44083390 0x564f44457260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.367+0000 7f0d0dffb640 0 client.15765 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:44:02.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.367+0000 7f0d32d03740 1 --2- 172.21.15.84:0/2955832573 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f4407b1b0 0x564f44456d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.367+0000 7f0d32d03740 1 -- 172.21.15.84:0/2955832573 >> 172.21.15.84:0/2955832573 conn(0x564f44098460 msgr2=0x564f4444c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:02.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.367+0000 7f0d32d03740 1 -- 172.21.15.84:0/2955832573 shutdown_connections 2024-09-21T03:44:02.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.368+0000 7f0d32d03740 1 -- 172.21.15.84:0/2955832573 wait complete. 2024-09-21T03:44:02.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.368+0000 7f0d32d03740 20 client.15765 trim_cache size 0 max 16384 2024-09-21T03:44:02.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.381+0000 7f0d32d03740 1 Processor -- start 2024-09-21T03:44:02.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.381+0000 7f0d32d03740 1 -- start start 2024-09-21T03:44:02.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.381+0000 7f0d32d03740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f4407b1b0 0x564f44458950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:02.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.381+0000 7f0d32d03740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f44083390 0x564f444630a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:02.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.381+0000 7f0d32d03740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f440a4070 0x564f44453f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:02.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.381+0000 7f0d32d03740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0d241afbc0 con 0x564f4407b1b0 2024-09-21T03:44:02.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.381+0000 7f0d32d03740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0d241ad490 con 0x564f44083390 2024-09-21T03:44:02.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.381+0000 7f0d32d03740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0d241ab300 con 0x564f440a4070 2024-09-21T03:44:02.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.381+0000 7f0d2a52b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f4407b1b0 0x564f44458950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:02.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.381+0000 7f0d2a52b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f4407b1b0 0x564f44458950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57150/0 (socket says 172.21.15.84:57150) 2024-09-21T03:44:02.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.381+0000 7f0d2a52b640 1 -- 172.21.15.84:0/1259614947 learned_addr learned my addr 172.21.15.84:0/1259614947 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:02.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.381+0000 7f0d2ad2c640 1 --2- 172.21.15.84:0/1259614947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f440a4070 0x564f44453f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:02.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.381+0000 7f0d29d2a640 1 --2- 172.21.15.84:0/1259614947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f44083390 0x564f444630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:02.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.381+0000 7f0d2a52b640 1 -- 172.21.15.84:0/1259614947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f440a4070 msgr2=0x564f44453f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:02.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.381+0000 7f0d2a52b640 1 --2- 172.21.15.84:0/1259614947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f440a4070 0x564f44453f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.381+0000 7f0d2a52b640 1 -- 172.21.15.84:0/1259614947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f44083390 msgr2=0x564f444630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:02.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.381+0000 7f0d2a52b640 1 --2- 172.21.15.84:0/1259614947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f44083390 0x564f444630a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.381+0000 7f0d2a52b640 1 -- 172.21.15.84:0/1259614947 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f44457fe0 con 0x564f4407b1b0 2024-09-21T03:44:02.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.381+0000 7f0d29d2a640 1 --2- 172.21.15.84:0/1259614947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f44083390 0x564f444630a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:02.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.382+0000 7f0d2a52b640 1 --2- 172.21.15.84:0/1259614947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f4407b1b0 0x564f44458950 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x564f4444a320 tx=0x7f0d2000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf634561bf42656 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:02.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.382+0000 7f0d0ffff640 1 -- 172.21.15.84:0/1259614947 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d20005020 con 0x564f4407b1b0 2024-09-21T03:44:02.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.382+0000 7f0d0ffff640 1 -- 172.21.15.84:0/1259614947 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d200047a0 con 0x564f4407b1b0 2024-09-21T03:44:02.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.382+0000 7f0d0ffff640 1 -- 172.21.15.84:0/1259614947 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d200116a0 con 0x564f4407b1b0 2024-09-21T03:44:02.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.383+0000 7f0d32d03740 1 -- 172.21.15.84:0/1259614947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f4407b1b0 msgr2=0x564f44458950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:02.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.383+0000 7f0d32d03740 1 --2- 172.21.15.84:0/1259614947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f4407b1b0 0x564f44458950 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x564f4444a320 tx=0x7f0d2000b390 comp rx=0 tx=0).stop 2024-09-21T03:44:02.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.383+0000 7f0d32d03740 1 -- 172.21.15.84:0/1259614947 shutdown_connections 2024-09-21T03:44:02.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.383+0000 7f0d32d03740 1 --2- 172.21.15.84:0/1259614947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f440a4070 0x564f44453f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.383+0000 7f0d32d03740 1 --2- 172.21.15.84:0/1259614947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f44083390 0x564f444630a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.383+0000 7f0d32d03740 1 --2- 172.21.15.84:0/1259614947 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f4407b1b0 0x564f44458950 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.383+0000 7f0d32d03740 1 -- 172.21.15.84:0/1259614947 >> 172.21.15.84:0/1259614947 conn(0x564f44098460 msgr2=0x564f44458240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:02.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.383+0000 7f0d32d03740 1 -- 172.21.15.84:0/1259614947 shutdown_connections 2024-09-21T03:44:02.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.383+0000 7f0d32d03740 1 -- 172.21.15.84:0/1259614947 wait complete. 2024-09-21T03:44:02.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.383+0000 7f0d32d03740 1 -- start start 2024-09-21T03:44:02.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.383+0000 7f0d32d03740 1 Processor -- start 2024-09-21T03:44:02.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d32d03740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f4407b1b0 0x564f4445b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:02.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d32d03740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f44083390 0x564f4445b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:02.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d32d03740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f440a4070 0x564f4445bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:02.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d32d03740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0d241ab950 con 0x564f44083390 2024-09-21T03:44:02.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d32d03740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0d241acdc0 con 0x564f4407b1b0 2024-09-21T03:44:02.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d32d03740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0d241ac020 con 0x564f440a4070 2024-09-21T03:44:02.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d32d03740 10 client.0 _ll_register_callbacks cb 0x7f0d1c031bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:02.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d29d2a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f44083390 0x564f4445b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:02.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d29d2a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f44083390 0x564f4445b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57158/0 (socket says 172.21.15.84:57158) 2024-09-21T03:44:02.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d29d2a640 1 -- 172.21.15.84:0/1294500430 learned_addr learned my addr 172.21.15.84:0/1294500430 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:02.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d2a52b640 1 --2- 172.21.15.84:0/1294500430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f4407b1b0 0x564f4445b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:02.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d2ad2c640 1 --2- 172.21.15.84:0/1294500430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f440a4070 0x564f4445bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:02.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d29d2a640 1 -- 172.21.15.84:0/1294500430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f440a4070 msgr2=0x564f4445bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:02.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d29d2a640 1 --2- 172.21.15.84:0/1294500430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f440a4070 0x564f4445bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d29d2a640 1 -- 172.21.15.84:0/1294500430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f4407b1b0 msgr2=0x564f4445b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:02.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d29d2a640 1 --2- 172.21.15.84:0/1294500430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f4407b1b0 0x564f4445b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d29d2a640 1 -- 172.21.15.84:0/1294500430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f444d7140 con 0x564f44083390 2024-09-21T03:44:02.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d2ad2c640 1 --2- 172.21.15.84:0/1294500430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f440a4070 0x564f4445bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:02.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d29d2a640 1 --2- 172.21.15.84:0/1294500430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f44083390 0x564f4445b7e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0d140e5360 tx=0x7f0d140e7900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8aec39dd0a236e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:02.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:02.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d0dffb640 1 -- 172.21.15.84:0/1294500430 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d140922a0 con 0x564f44083390 2024-09-21T03:44:02.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d0dffb640 1 -- 172.21.15.84:0/1294500430 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f0d140e4fe0 con 0x564f44083390 2024-09-21T03:44:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.384+0000 7f0d32d03740 1 -- 172.21.15.84:0/1294500430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d200047a0 con 0x564f44083390 2024-09-21T03:44:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.385+0000 7f0d0dffb640 1 -- 172.21.15.84:0/1294500430 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0d140930c0 con 0x564f44083390 2024-09-21T03:44:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.385+0000 7f0d32d03740 10 client.15771 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.385+0000 7f0d32d03740 1 -- 172.21.15.84:0/1294500430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564f444d82f0 con 0x564f44083390 2024-09-21T03:44:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.385+0000 7f0d0dffb640 1 -- 172.21.15.84:0/1294500430 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d200047a0 con 0x564f44083390 2024-09-21T03:44:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.385+0000 7f0d0dffb640 1 -- 172.21.15.84:0/1294500430 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0d140a9780 con 0x564f44083390 2024-09-21T03:44:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.385+0000 7f0d32d03740 10 client.15771 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.385+0000 7f0d32d03740 10 client.15771 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:44:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.385+0000 7f0d32d03740 20 client.15771 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.385+0000 7f0d32d03740 1 --2- 172.21.15.84:0/1294500430 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x564f44037da0 0x564f444da680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.385+0000 7f0d32d03740 4 client.15771 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:44:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.385+0000 7f0d32d03740 1 -- 172.21.15.84:0/1294500430 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564f443bf8a0 con 0x564f44037da0 2024-09-21T03:44:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.385+0000 7f0d2a52b640 1 --2- 172.21.15.84:0/1294500430 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x564f44037da0 0x564f444da680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:02.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.386+0000 7f0d2a52b640 1 --2- 172.21.15.84:0/1294500430 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x564f44037da0 0x564f444da680 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=62518689236aabb2 server_cookie=8950bf31832ff134 in_seq=0 out_seq=0 2024-09-21T03:44:02.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.386+0000 7f0d0dffb640 10 client.15771 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:44:02.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.386+0000 7f0d0dffb640 1 -- 172.21.15.84:0/1294500430 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564f443bf8a0 con 0x564f44037da0 2024-09-21T03:44:02.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.386+0000 7f0d0dffb640 10 client.15771 handle_command_reply: tid=0 2024-09-21T03:44:02.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.386+0000 7f0d32d03740 1 client.15771 shutdown 2024-09-21T03:44:02.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.386+0000 7f0d32d03740 1 -- 172.21.15.84:0/1294500430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f44083390 msgr2=0x564f4445b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:02.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.386+0000 7f0d32d03740 1 --2- 172.21.15.84:0/1294500430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f44083390 0x564f4445b7e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0d140e5360 tx=0x7f0d140e7900 comp rx=0 tx=0).stop 2024-09-21T03:44:02.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.386+0000 7f0d32d03740 1 -- 172.21.15.84:0/1294500430 shutdown_connections 2024-09-21T03:44:02.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.386+0000 7f0d32d03740 1 --2- 172.21.15.84:0/1294500430 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x564f44037da0 0x564f444da680 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.386+0000 7f0d32d03740 1 --2- 172.21.15.84:0/1294500430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f440a4070 0x564f4445bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.386+0000 7f0d32d03740 1 --2- 172.21.15.84:0/1294500430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564f44083390 0x564f4445b7e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.386+0000 7f0d0dffb640 0 client.15771 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:44:02.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.386+0000 7f0d32d03740 1 --2- 172.21.15.84:0/1294500430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f4407b1b0 0x564f4445b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.386+0000 7f0d32d03740 1 -- 172.21.15.84:0/1294500430 >> 172.21.15.84:0/1294500430 conn(0x564f44098460 msgr2=0x564f4444c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:02.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.386+0000 7f0d32d03740 1 -- 172.21.15.84:0/1294500430 shutdown_connections 2024-09-21T03:44:02.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.386+0000 7f0d32d03740 1 -- 172.21.15.84:0/1294500430 wait complete. 2024-09-21T03:44:02.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.387+0000 7f0d32d03740 20 client.15771 trim_cache size 0 max 16384 2024-09-21T03:44:02.403 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:44:02.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.387+0000 7f0d2c78f640 1 -- 172.21.15.84:0/198999826 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0d100b6680 msgr2=0x7f0d100b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:02.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.387+0000 7f0d2c78f640 1 --2- 172.21.15.84:0/198999826 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0d100b6680 0x7f0d100b8b90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c02f500 tx=0x7f0d1c02f370 comp rx=0 tx=0).stop 2024-09-21T03:44:02.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.387+0000 7f0d2c78f640 1 -- 172.21.15.84:0/198999826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d241083a0 msgr2=0x7f0d24199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:02.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.387+0000 7f0d2c78f640 1 --2- 172.21.15.84:0/198999826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d241083a0 0x7f0d24199910 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400c970 tx=0x7f0d1400ce30 comp rx=0 tx=0).stop 2024-09-21T03:44:02.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.387+0000 7f0d2c78f640 1 -- 172.21.15.84:0/198999826 shutdown_connections 2024-09-21T03:44:02.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.387+0000 7f0d2c78f640 1 --2- 172.21.15.84:0/198999826 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0d100b6680 0x7f0d100b8b90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.387+0000 7f0d2c78f640 1 --2- 172.21.15.84:0/198999826 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d24108cf0 0x7f0d2419ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.387+0000 7f0d2c78f640 1 --2- 172.21.15.84:0/198999826 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0d241083a0 0x7f0d24199910 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.387+0000 7f0d2c78f640 1 --2- 172.21.15.84:0/198999826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d24102a60 0x7f0d24199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:02.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.387+0000 7f0d2c78f640 1 -- 172.21.15.84:0/198999826 >> 172.21.15.84:0/198999826 conn(0x7f0d24079730 msgr2=0x7f0d24104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:02.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.387+0000 7f0d2c78f640 1 -- 172.21.15.84:0/198999826 shutdown_connections 2024-09-21T03:44:02.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:02.387+0000 7f0d2c78f640 1 -- 172.21.15.84:0/198999826 wait complete. 2024-09-21T03:44:03.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:03 smithi172 ceph-mon[34821]: pgmap v371: 97 pgs: 97 active+clean; 1.7 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-09-21T03:44:03.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:03 smithi084 ceph-mon[30941]: pgmap v371: 97 pgs: 97 active+clean; 1.7 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-09-21T03:44:03.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:03 smithi174 ceph-mon[34403]: pgmap v371: 97 pgs: 97 active+clean; 1.7 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-09-21T03:44:04.600 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:44:04.852 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:05.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.375+0000 7fcbd8234640 1 -- 172.21.15.84:0/2737529383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd010de10 msgr2=0x7fcbd0110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:05.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.375+0000 7fcbd8234640 1 --2- 172.21.15.84:0/2737529383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd010de10 0x7fcbd0110300 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009ca0 tx=0x7fcbc802a8e0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.375+0000 7fcbd8234640 1 -- 172.21.15.84:0/2737529383 shutdown_connections 2024-09-21T03:44:05.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.375+0000 7fcbd8234640 1 --2- 172.21.15.84:0/2737529383 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd010de10 0x7fcbd0110300 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.375+0000 7fcbd8234640 1 --2- 172.21.15.84:0/2737529383 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbd0105300 0x7fcbd010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.375+0000 7fcbd8234640 1 --2- 172.21.15.84:0/2737529383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbd01049b0 0x7fcbd0104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.375+0000 7fcbd8234640 1 -- 172.21.15.84:0/2737529383 >> 172.21.15.84:0/2737529383 conn(0x7fcbd0079730 msgr2=0x7fcbd0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:05.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.375+0000 7fcbd8234640 1 -- 172.21.15.84:0/2737529383 shutdown_connections 2024-09-21T03:44:05.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.375+0000 7fcbd8234640 1 -- 172.21.15.84:0/2737529383 wait complete. 2024-09-21T03:44:05.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.376+0000 7fcbd8234640 1 Processor -- start 2024-09-21T03:44:05.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.376+0000 7fcbd8234640 1 -- start start 2024-09-21T03:44:05.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.376+0000 7fcbd8234640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbd01049b0 0x7fcbd01026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.376+0000 7fcbd8234640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd0105300 0x7fcbd0102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.376+0000 7fcbd8234640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbd010de10 0x7fcbd0103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.376+0000 7fcbd8234640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd0113b70 con 0x7fcbd0105300 2024-09-21T03:44:05.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.376+0000 7fcbd8234640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01139f0 con 0x7fcbd01049b0 2024-09-21T03:44:05.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.376+0000 7fcbd8234640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd0113cf0 con 0x7fcbd010de10 2024-09-21T03:44:05.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.376+0000 7fcbd57cf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd0105300 0x7fcbd0102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.376+0000 7fcbd57cf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd0105300 0x7fcbd0102c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57174/0 (socket says 172.21.15.84:57174) 2024-09-21T03:44:05.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.376+0000 7fcbd57cf640 1 -- 172.21.15.84:0/1836335843 learned_addr learned my addr 172.21.15.84:0/1836335843 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:05.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.376+0000 7fcbd5fd0640 1 --2- 172.21.15.84:0/1836335843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbd01049b0 0x7fcbd01026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.376+0000 7fcbd67d1640 1 --2- 172.21.15.84:0/1836335843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbd010de10 0x7fcbd0103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.376+0000 7fcbd57cf640 1 -- 172.21.15.84:0/1836335843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbd010de10 msgr2=0x7fcbd0103170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:05.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.376+0000 7fcbd57cf640 1 --2- 172.21.15.84:0/1836335843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbd010de10 0x7fcbd0103170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.376+0000 7fcbd57cf640 1 -- 172.21.15.84:0/1836335843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbd01049b0 msgr2=0x7fcbd01026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:05.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.376+0000 7fcbd57cf640 1 --2- 172.21.15.84:0/1836335843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbd01049b0 0x7fcbd01026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.376+0000 7fcbd57cf640 1 -- 172.21.15.84:0/1836335843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd01a8920 con 0x7fcbd0105300 2024-09-21T03:44:05.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.377+0000 7fcbd5fd0640 1 --2- 172.21.15.84:0/1836335843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbd01049b0 0x7fcbd01026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:05.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.377+0000 7fcbd57cf640 1 --2- 172.21.15.84:0/1836335843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd0105300 0x7fcbd0102c30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0006fd0 tx=0x7fcbc000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:05.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.377+0000 7fcbc6ffd640 1 -- 172.21.15.84:0/1836335843 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0011830 con 0x7fcbd0105300 2024-09-21T03:44:05.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.377+0000 7fcbc6ffd640 1 -- 172.21.15.84:0/1836335843 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbc0016070 con 0x7fcbd0105300 2024-09-21T03:44:05.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.377+0000 7fcbc6ffd640 1 -- 172.21.15.84:0/1836335843 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0010e00 con 0x7fcbd0105300 2024-09-21T03:44:05.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.377+0000 7fcbd8234640 1 -- 172.21.15.84:0/1836335843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd01a8c10 con 0x7fcbd0105300 2024-09-21T03:44:05.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.377+0000 7fcbd8234640 1 -- 172.21.15.84:0/1836335843 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd01a9100 con 0x7fcbd0105300 2024-09-21T03:44:05.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.379+0000 7fcbde7a8740 1 Processor -- start 2024-09-21T03:44:05.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.380+0000 7fcbde7a8740 1 -- start start 2024-09-21T03:44:05.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.380+0000 7fcbc6ffd640 1 -- 172.21.15.84:0/1836335843 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fcbc001b480 con 0x7fcbd0105300 2024-09-21T03:44:05.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.380+0000 7fcbde7a8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 0x55ff14c792c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.380+0000 7fcbde7a8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148a91b0 0x55ff14c79800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.380+0000 7fcbde7a8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff148b1390 0x55ff14c79d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.380+0000 7fcbde7a8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ff14befea0 con 0x55ff148d2070 2024-09-21T03:44:05.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.380+0000 7fcbde7a8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ff14bdf2d0 con 0x55ff148a91b0 2024-09-21T03:44:05.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.380+0000 7fcbde7a8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ff14be30e0 con 0x55ff148b1390 2024-09-21T03:44:05.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.380+0000 7fcbd67d1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 0x55ff14c792c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.380+0000 7fcbd67d1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 0x55ff14c792c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57190/0 (socket says 172.21.15.84:57190) 2024-09-21T03:44:05.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.380+0000 7fcbd67d1640 1 -- 172.21.15.84:0/3349052580 learned_addr learned my addr 172.21.15.84:0/3349052580 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:05.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.380+0000 7fcbd57cf640 1 --2- 172.21.15.84:0/3349052580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff148b1390 0x55ff14c79d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.380+0000 7fcbd5fd0640 1 --2- 172.21.15.84:0/3349052580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148a91b0 0x55ff14c79800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.381+0000 7fcbd67d1640 1 -- 172.21.15.84:0/3349052580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff148b1390 msgr2=0x55ff14c79d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:05.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.381+0000 7fcbd67d1640 1 --2- 172.21.15.84:0/3349052580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff148b1390 0x55ff14c79d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.381+0000 7fcbd67d1640 1 -- 172.21.15.84:0/3349052580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148a91b0 msgr2=0x55ff14c79800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:05.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.381+0000 7fcbd67d1640 1 --2- 172.21.15.84:0/3349052580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148a91b0 0x55ff14c79800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.381+0000 7fcbd67d1640 1 -- 172.21.15.84:0/3349052580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff1493d650 con 0x55ff148d2070 2024-09-21T03:44:05.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.381+0000 7fcbd5fd0640 1 --2- 172.21.15.84:0/3349052580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148a91b0 0x55ff14c79800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:05.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.381+0000 7fcbd67d1640 1 --2- 172.21.15.84:0/3349052580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 0x55ff14c792c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8031550 tx=0x7fcbc8031580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b174c1bc0e75de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:05.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.381+0000 7fcbc6ffd640 1 --2- 172.21.15.84:0/1836335843 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcbbc0b6680 0x7fcbbc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.381+0000 7fcbd5fd0640 1 --2- 172.21.15.84:0/1836335843 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcbbc0b6680 0x7fcbbc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.381+0000 7fcbbbfff640 1 -- 172.21.15.84:0/3349052580 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc803f070 con 0x55ff148d2070 2024-09-21T03:44:05.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.381+0000 7fcbc6ffd640 1 -- 172.21.15.84:0/1836335843 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fcbc00e6d00 con 0x7fcbd0105300 2024-09-21T03:44:05.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.381+0000 7fcbbbfff640 1 -- 172.21.15.84:0/3349052580 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbc8036040 con 0x55ff148d2070 2024-09-21T03:44:05.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.381+0000 7fcbbbfff640 1 -- 172.21.15.84:0/3349052580 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8004360 con 0x55ff148d2070 2024-09-21T03:44:05.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.382+0000 7fcbde7a8740 1 -- 172.21.15.84:0/3349052580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 msgr2=0x55ff14c792c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:05.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.382+0000 7fcbde7a8740 1 --2- 172.21.15.84:0/3349052580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 0x55ff14c792c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8031550 tx=0x7fcbc8031580 comp rx=0 tx=0).stop 2024-09-21T03:44:05.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.382+0000 7fcbd5fd0640 1 --2- 172.21.15.84:0/1836335843 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcbbc0b6680 0x7fcbbc0b8b90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55ff14c77f40 tx=0x7fcbcc008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:05.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.382+0000 7fcbde7a8740 1 -- 172.21.15.84:0/3349052580 shutdown_connections 2024-09-21T03:44:05.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.382+0000 7fcbde7a8740 1 --2- 172.21.15.84:0/3349052580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff148b1390 0x55ff14c79d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.382+0000 7fcbde7a8740 1 --2- 172.21.15.84:0/3349052580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148a91b0 0x55ff14c79800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.382+0000 7fcbde7a8740 1 --2- 172.21.15.84:0/3349052580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 0x55ff14c792c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.382+0000 7fcbde7a8740 1 -- 172.21.15.84:0/3349052580 >> 172.21.15.84:0/3349052580 conn(0x55ff148c6460 msgr2=0x55ff14c771b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:05.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.382+0000 7fcbde7a8740 1 -- 172.21.15.84:0/3349052580 shutdown_connections 2024-09-21T03:44:05.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.382+0000 7fcbde7a8740 1 -- 172.21.15.84:0/3349052580 wait complete. 2024-09-21T03:44:05.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.382+0000 7fcbde7a8740 1 -- start start 2024-09-21T03:44:05.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.383+0000 7fcbde7a8740 1 Processor -- start 2024-09-21T03:44:05.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.383+0000 7fcbde7a8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff148a91b0 0x55ff14c849c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.383+0000 7fcbde7a8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148b1390 0x55ff14c84f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.383+0000 7fcbde7a8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 0x55ff14c90d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.383+0000 7fcbde7a8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ff14a40700 con 0x55ff148d2070 2024-09-21T03:44:05.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.383+0000 7fcbde7a8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ff14b7a160 con 0x55ff148b1390 2024-09-21T03:44:05.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.383+0000 7fcbde7a8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ff14c87a40 con 0x55ff148a91b0 2024-09-21T03:44:05.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.383+0000 7fcbde7a8740 10 client.0 _ll_register_callbacks cb 0x55ff14b939e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:05.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.383+0000 7fcbd67d1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 0x55ff14c90d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.383+0000 7fcbd67d1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 0x55ff14c90d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57194/0 (socket says 172.21.15.84:57194) 2024-09-21T03:44:05.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.383+0000 7fcbd67d1640 1 -- 172.21.15.84:0/3632991346 learned_addr learned my addr 172.21.15.84:0/3632991346 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:05.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.383+0000 7fcbd57cf640 1 --2- 172.21.15.84:0/3632991346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148b1390 0x55ff14c84f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.383+0000 7fcbd5fd0640 1 --2- 172.21.15.84:0/3632991346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff148a91b0 0x55ff14c849c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.384+0000 7fcbd67d1640 1 -- 172.21.15.84:0/3632991346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff148a91b0 msgr2=0x55ff14c849c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.384+0000 7fcbd67d1640 1 --2- 172.21.15.84:0/3632991346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff148a91b0 0x55ff14c849c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.384+0000 7fcbd67d1640 1 -- 172.21.15.84:0/3632991346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148b1390 msgr2=0x55ff14c84f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.384+0000 7fcbd67d1640 1 --2- 172.21.15.84:0/3632991346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148b1390 0x55ff14c84f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.384+0000 7fcbd67d1640 1 -- 172.21.15.84:0/3632991346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff14ba7c90 con 0x55ff148d2070 2024-09-21T03:44:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.384+0000 7fcbd67d1640 1 --2- 172.21.15.84:0/3632991346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 0x55ff14c90d60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009dc0 tx=0x7fcbc8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60692b68af9eb0d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.384+0000 7fcbb97fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.384+0000 7fcbb97fa640 1 -- 172.21.15.84:0/3632991346 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc804d020 con 0x55ff148d2070 2024-09-21T03:44:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.384+0000 7fcbb97fa640 1 -- 172.21.15.84:0/3632991346 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fcbc8004320 con 0x55ff148d2070 2024-09-21T03:44:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.384+0000 7fcbde7a8740 1 -- 172.21.15.84:0/3632991346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbc8036040 con 0x55ff148d2070 2024-09-21T03:44:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.384+0000 7fcbb97fa640 1 -- 172.21.15.84:0/3632991346 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcbc8058050 con 0x55ff148d2070 2024-09-21T03:44:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.384+0000 7fcbde7a8740 10 client.15783 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:05.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.384+0000 7fcbde7a8740 1 -- 172.21.15.84:0/3632991346 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ff14c93790 con 0x55ff148d2070 2024-09-21T03:44:05.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.384+0000 7fcbb97fa640 1 -- 172.21.15.84:0/3632991346 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbc8036040 con 0x55ff148d2070 2024-09-21T03:44:05.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.385+0000 7fcbb97fa640 1 -- 172.21.15.84:0/3632991346 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcbc8030c20 con 0x55ff148d2070 2024-09-21T03:44:05.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.385+0000 7fcbde7a8740 10 client.15783 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:05.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.385+0000 7fcbde7a8740 10 client.15783 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:44:05.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.385+0000 7fcbde7a8740 20 client.15783 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:05.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.385+0000 7fcbde7a8740 1 --2- 172.21.15.84:0/3632991346 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55ff148909f0 0x55ff14c96af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.385+0000 7fcbde7a8740 4 client.15783 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:44:05.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.385+0000 7fcbde7a8740 1 -- 172.21.15.84:0/3632991346 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff14bf1df0 con 0x55ff148909f0 2024-09-21T03:44:05.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.385+0000 7fcbd5fd0640 1 --2- 172.21.15.84:0/3632991346 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55ff148909f0 0x55ff14c96af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.385+0000 7fcbb97fa640 10 client.15783 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:44:05.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.385+0000 7fcbd5fd0640 1 --2- 172.21.15.84:0/3632991346 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55ff148909f0 0x55ff14c96af0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d013ac8736fc59f2 server_cookie=f795b1c52b4143b0 in_seq=0 out_seq=0 2024-09-21T03:44:05.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.386+0000 7fcbb97fa640 1 -- 172.21.15.84:0/3632991346 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ff14bf1df0 con 0x55ff148909f0 2024-09-21T03:44:05.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.386+0000 7fcbb97fa640 10 client.15783 handle_command_reply: tid=0 2024-09-21T03:44:05.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.386+0000 7fcbde7a8740 1 client.15783 shutdown 2024-09-21T03:44:05.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.387+0000 7fcbde7a8740 1 -- 172.21.15.84:0/3632991346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 msgr2=0x55ff14c90d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:05.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.387+0000 7fcbde7a8740 1 --2- 172.21.15.84:0/3632991346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 0x55ff14c90d60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8009dc0 tx=0x7fcbc8003c20 comp rx=0 tx=0).stop 2024-09-21T03:44:05.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.387+0000 7fcbde7a8740 1 -- 172.21.15.84:0/3632991346 shutdown_connections 2024-09-21T03:44:05.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.387+0000 7fcbde7a8740 1 --2- 172.21.15.84:0/3632991346 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55ff148909f0 0x55ff14c96af0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.387+0000 7fcbde7a8740 1 --2- 172.21.15.84:0/3632991346 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 0x55ff14c90d60 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.387+0000 7fcbde7a8740 1 --2- 172.21.15.84:0/3632991346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148b1390 0x55ff14c84f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.387+0000 7fcbde7a8740 1 --2- 172.21.15.84:0/3632991346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff148a91b0 0x55ff14c849c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.387+0000 7fcbb97fa640 0 client.15783 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:44:05.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.387+0000 7fcbde7a8740 1 -- 172.21.15.84:0/3632991346 >> 172.21.15.84:0/3632991346 conn(0x55ff148c6460 msgr2=0x55ff14c7c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:05.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.387+0000 7fcbde7a8740 1 -- 172.21.15.84:0/3632991346 shutdown_connections 2024-09-21T03:44:05.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.387+0000 7fcbde7a8740 1 -- 172.21.15.84:0/3632991346 wait complete. 2024-09-21T03:44:05.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.387+0000 7fcbde7a8740 20 client.15783 trim_cache size 0 max 16384 2024-09-21T03:44:05.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.401+0000 7fcbde7a8740 1 Processor -- start 2024-09-21T03:44:05.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.401+0000 7fcbde7a8740 1 -- start start 2024-09-21T03:44:05.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.401+0000 7fcbde7a8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148a91b0 0x55ff14c90cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.401+0000 7fcbde7a8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff148b1390 0x55ff14c865f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.401+0000 7fcbde7a8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 0x55ff14c81bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.401+0000 7fcbde7a8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01b4160 con 0x55ff148d2070 2024-09-21T03:44:05.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.401+0000 7fcbde7a8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01b1a30 con 0x55ff148a91b0 2024-09-21T03:44:05.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.401+0000 7fcbde7a8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01af880 con 0x55ff148b1390 2024-09-21T03:44:05.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.401+0000 7fcbd67d1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 0x55ff14c81bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.401+0000 7fcbd67d1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 0x55ff14c81bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57196/0 (socket says 172.21.15.84:57196) 2024-09-21T03:44:05.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.401+0000 7fcbd67d1640 1 -- 172.21.15.84:0/2704286372 learned_addr learned my addr 172.21.15.84:0/2704286372 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:05.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.401+0000 7fcbd5fd0640 1 --2- 172.21.15.84:0/2704286372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148a91b0 0x55ff14c90cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.401+0000 7fcbd57cf640 1 --2- 172.21.15.84:0/2704286372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff148b1390 0x55ff14c865f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.402+0000 7fcbd67d1640 1 -- 172.21.15.84:0/2704286372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff148b1390 msgr2=0x55ff14c865f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:05.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.402+0000 7fcbd67d1640 1 --2- 172.21.15.84:0/2704286372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff148b1390 0x55ff14c865f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.402+0000 7fcbd67d1640 1 -- 172.21.15.84:0/2704286372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148a91b0 msgr2=0x55ff14c90cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:05.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.402+0000 7fcbd67d1640 1 --2- 172.21.15.84:0/2704286372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148a91b0 0x55ff14c90cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.402+0000 7fcbd67d1640 1 -- 172.21.15.84:0/2704286372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff14c85c80 con 0x55ff148d2070 2024-09-21T03:44:05.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.402+0000 7fcbd67d1640 1 --2- 172.21.15.84:0/2704286372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 0x55ff14c81bb0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fcbc802ae00 tx=0x7fcbc8009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec134cbe1df60d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:05.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.402+0000 7fcbbb7fe640 1 -- 172.21.15.84:0/2704286372 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc804d070 con 0x55ff148d2070 2024-09-21T03:44:05.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.402+0000 7fcbbb7fe640 1 -- 172.21.15.84:0/2704286372 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbc8036040 con 0x55ff148d2070 2024-09-21T03:44:05.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.402+0000 7fcbbb7fe640 1 -- 172.21.15.84:0/2704286372 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc803f040 con 0x55ff148d2070 2024-09-21T03:44:05.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.403+0000 7fcbde7a8740 1 -- 172.21.15.84:0/2704286372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 msgr2=0x55ff14c81bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:05.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.403+0000 7fcbde7a8740 1 --2- 172.21.15.84:0/2704286372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 0x55ff14c81bb0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fcbc802ae00 tx=0x7fcbc8009a20 comp rx=0 tx=0).stop 2024-09-21T03:44:05.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.403+0000 7fcbde7a8740 1 -- 172.21.15.84:0/2704286372 shutdown_connections 2024-09-21T03:44:05.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.403+0000 7fcbde7a8740 1 --2- 172.21.15.84:0/2704286372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148d2070 0x55ff14c81bb0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.403+0000 7fcbde7a8740 1 --2- 172.21.15.84:0/2704286372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff148b1390 0x55ff14c865f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.403+0000 7fcbde7a8740 1 --2- 172.21.15.84:0/2704286372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148a91b0 0x55ff14c90cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.403+0000 7fcbde7a8740 1 -- 172.21.15.84:0/2704286372 >> 172.21.15.84:0/2704286372 conn(0x55ff148c6460 msgr2=0x55ff14c85ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:05.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.403+0000 7fcbde7a8740 1 -- 172.21.15.84:0/2704286372 shutdown_connections 2024-09-21T03:44:05.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.403+0000 7fcbde7a8740 1 -- 172.21.15.84:0/2704286372 wait complete. 2024-09-21T03:44:05.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.403+0000 7fcbde7a8740 1 -- start start 2024-09-21T03:44:05.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.404+0000 7fcbde7a8740 1 Processor -- start 2024-09-21T03:44:05.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.404+0000 7fcbde7a8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff148a91b0 0x55ff14c97e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.404+0000 7fcbde7a8740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148b1390 0x55ff14c98360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.404+0000 7fcbde7a8740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148d2070 0x55ff14d00270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.404+0000 7fcbde7a8740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01afef0 con 0x55ff148b1390 2024-09-21T03:44:05.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.404+0000 7fcbde7a8740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01b1360 con 0x55ff148d2070 2024-09-21T03:44:05.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.404+0000 7fcbde7a8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd01b05c0 con 0x55ff148a91b0 2024-09-21T03:44:05.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.404+0000 7fcbde7a8740 10 client.0 _ll_register_callbacks cb 0x7fcbc00ea720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:05.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.404+0000 7fcbd57cf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148b1390 0x55ff14c98360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.404+0000 7fcbd57cf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148b1390 0x55ff14c98360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57202/0 (socket says 172.21.15.84:57202) 2024-09-21T03:44:05.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.404+0000 7fcbd57cf640 1 -- 172.21.15.84:0/290653201 learned_addr learned my addr 172.21.15.84:0/290653201 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:05.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.404+0000 7fcbd67d1640 1 --2- 172.21.15.84:0/290653201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148d2070 0x55ff14d00270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.404+0000 7fcbd5fd0640 1 --2- 172.21.15.84:0/290653201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff148a91b0 0x55ff14c97e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.404+0000 7fcbd57cf640 1 -- 172.21.15.84:0/290653201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff148a91b0 msgr2=0x55ff14c97e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:05.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.404+0000 7fcbd57cf640 1 --2- 172.21.15.84:0/290653201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff148a91b0 0x55ff14c97e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.404+0000 7fcbd57cf640 1 -- 172.21.15.84:0/290653201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148d2070 msgr2=0x55ff14d00270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:05.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.404+0000 7fcbd57cf640 1 --2- 172.21.15.84:0/290653201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148d2070 0x55ff14d00270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.404+0000 7fcbd57cf640 1 -- 172.21.15.84:0/290653201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff14c98c00 con 0x55ff148b1390 2024-09-21T03:44:05.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.405+0000 7fcbd57cf640 1 --2- 172.21.15.84:0/290653201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148b1390 0x55ff14c98360 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000bde0 tx=0x7fcbc0010820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90bcedb18440e9d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:05.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.405+0000 7fcbb97fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:05.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.405+0000 7fcbb97fa640 1 -- 172.21.15.84:0/290653201 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc00ac9a0 con 0x55ff148b1390 2024-09-21T03:44:05.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.405+0000 7fcbb97fa640 1 -- 172.21.15.84:0/290653201 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fcbc00abe30 con 0x55ff148b1390 2024-09-21T03:44:05.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.405+0000 7fcbde7a8740 1 -- 172.21.15.84:0/290653201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbc8036040 con 0x55ff148b1390 2024-09-21T03:44:05.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.405+0000 7fcbb97fa640 1 -- 172.21.15.84:0/290653201 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcbc00a8340 con 0x55ff148b1390 2024-09-21T03:44:05.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.405+0000 7fcbde7a8740 10 client.15789 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:05.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.405+0000 7fcbde7a8740 1 -- 172.21.15.84:0/290653201 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ff14d01860 con 0x55ff148b1390 2024-09-21T03:44:05.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.405+0000 7fcbb97fa640 1 -- 172.21.15.84:0/290653201 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbc8036040 con 0x55ff148b1390 2024-09-21T03:44:05.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.405+0000 7fcbb97fa640 1 -- 172.21.15.84:0/290653201 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcbc00ab8a0 con 0x55ff148b1390 2024-09-21T03:44:05.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.405+0000 7fcbde7a8740 10 client.15789 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:05.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.405+0000 7fcbde7a8740 10 client.15789 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:44:05.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.405+0000 7fcbde7a8740 20 client.15789 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:05.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.405+0000 7fcbde7a8740 1 --2- 172.21.15.84:0/290653201 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55ff14865da0 0x55ff14d03fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.405+0000 7fcbde7a8740 4 client.15789 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:44:05.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.405+0000 7fcbde7a8740 1 -- 172.21.15.84:0/290653201 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ff14bed8a0 con 0x55ff14865da0 2024-09-21T03:44:05.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.406+0000 7fcbd5fd0640 1 --2- 172.21.15.84:0/290653201 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55ff14865da0 0x55ff14d03fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.406+0000 7fcbd5fd0640 1 --2- 172.21.15.84:0/290653201 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55ff14865da0 0x55ff14d03fa0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=701066bd49526679 server_cookie=e488a4be7bd0d71f in_seq=0 out_seq=0 2024-09-21T03:44:05.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.406+0000 7fcbb97fa640 10 client.15789 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:44:05.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.406+0000 7fcbb97fa640 1 -- 172.21.15.84:0/290653201 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ff14bed8a0 con 0x55ff14865da0 2024-09-21T03:44:05.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.406+0000 7fcbb97fa640 10 client.15789 handle_command_reply: tid=0 2024-09-21T03:44:05.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.406+0000 7fcbde7a8740 1 client.15789 shutdown 2024-09-21T03:44:05.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbde7a8740 1 -- 172.21.15.84:0/290653201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148b1390 msgr2=0x55ff14c98360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:05.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbde7a8740 1 --2- 172.21.15.84:0/290653201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148b1390 0x55ff14c98360 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000bde0 tx=0x7fcbc0010820 comp rx=0 tx=0).stop 2024-09-21T03:44:05.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbde7a8740 1 -- 172.21.15.84:0/290653201 shutdown_connections 2024-09-21T03:44:05.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbde7a8740 1 --2- 172.21.15.84:0/290653201 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55ff14865da0 0x55ff14d03fa0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbde7a8740 1 --2- 172.21.15.84:0/290653201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ff148d2070 0x55ff14d00270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbde7a8740 1 --2- 172.21.15.84:0/290653201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ff148b1390 0x55ff14c98360 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbde7a8740 1 --2- 172.21.15.84:0/290653201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ff148a91b0 0x55ff14c97e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbb97fa640 0 client.15789 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:44:05.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbde7a8740 1 -- 172.21.15.84:0/290653201 >> 172.21.15.84:0/290653201 conn(0x55ff148c6460 msgr2=0x55ff14c84f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:05.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbde7a8740 1 -- 172.21.15.84:0/290653201 shutdown_connections 2024-09-21T03:44:05.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbde7a8740 1 -- 172.21.15.84:0/290653201 wait complete. 2024-09-21T03:44:05.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbde7a8740 20 client.15789 trim_cache size 0 max 16384 2024-09-21T03:44:05.414 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:44:05.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbd8234640 1 -- 172.21.15.84:0/1836335843 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcbbc0b6680 msgr2=0x7fcbbc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:05.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbd8234640 1 --2- 172.21.15.84:0/1836335843 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcbbc0b6680 0x7fcbbc0b8b90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55ff14c77f40 tx=0x7fcbcc008040 comp rx=0 tx=0).stop 2024-09-21T03:44:05.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbd8234640 1 -- 172.21.15.84:0/1836335843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd0105300 msgr2=0x7fcbd0102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:05.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbd8234640 1 --2- 172.21.15.84:0/1836335843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd0105300 0x7fcbd0102c30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0006fd0 tx=0x7fcbc000b8e0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbd8234640 1 -- 172.21.15.84:0/1836335843 shutdown_connections 2024-09-21T03:44:05.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbd8234640 1 --2- 172.21.15.84:0/1836335843 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fcbbc0b6680 0x7fcbbc0b8b90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbd8234640 1 --2- 172.21.15.84:0/1836335843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcbd010de10 0x7fcbd0103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbd8234640 1 --2- 172.21.15.84:0/1836335843 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fcbd0105300 0x7fcbd0102c30 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbd8234640 1 --2- 172.21.15.84:0/1836335843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcbd01049b0 0x7fcbd01026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.407+0000 7fcbd8234640 1 -- 172.21.15.84:0/1836335843 >> 172.21.15.84:0/1836335843 conn(0x7fcbd0079730 msgr2=0x7fcbd0100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:05.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.408+0000 7fcbd8234640 1 -- 172.21.15.84:0/1836335843 shutdown_connections 2024-09-21T03:44:05.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:05.408+0000 7fcbd8234640 1 -- 172.21.15.84:0/1836335843 wait complete. 2024-09-21T03:44:05.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:05 smithi084 ceph-mon[30941]: pgmap v372: 97 pgs: 97 active+clean; 1.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-21T03:44:05.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:05 smithi172 ceph-mon[34821]: pgmap v372: 97 pgs: 97 active+clean; 1.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-21T03:44:05.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:05 smithi174 ceph-mon[34403]: pgmap v372: 97 pgs: 97 active+clean; 1.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 45 KiB/s wr, 28 op/s 2024-09-21T03:44:06.117 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:44:06.361 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:06.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.850+0000 7fb8c76d4640 1 -- 172.21.15.84:0/3812238925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8c0103bb0 msgr2=0x7fb8c0103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.850+0000 7fb8c76d4640 1 --2- 172.21.15.84:0/3812238925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8c0103bb0 0x7fb8c0103fc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc009900 tx=0x7fb8bc02a410 comp rx=0 tx=0).stop 2024-09-21T03:44:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.850+0000 7fb8c76d4640 1 -- 172.21.15.84:0/3812238925 shutdown_connections 2024-09-21T03:44:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.850+0000 7fb8c76d4640 1 --2- 172.21.15.84:0/3812238925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8c0109e40 0x7fb8c0110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.850+0000 7fb8c76d4640 1 --2- 172.21.15.84:0/3812238925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8c01094f0 0x7fb8c0109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.850+0000 7fb8c76d4640 1 --2- 172.21.15.84:0/3812238925 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8c0103bb0 0x7fb8c0103fc0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.850+0000 7fb8c76d4640 1 -- 172.21.15.84:0/3812238925 >> 172.21.15.84:0/3812238925 conn(0x7fb8c00ff600 msgr2=0x7fb8c0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.851+0000 7fb8c76d4640 1 -- 172.21.15.84:0/3812238925 shutdown_connections 2024-09-21T03:44:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.851+0000 7fb8c76d4640 1 -- 172.21.15.84:0/3812238925 wait complete. 2024-09-21T03:44:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.851+0000 7fb8c76d4640 1 Processor -- start 2024-09-21T03:44:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.851+0000 7fb8c76d4640 1 -- start start 2024-09-21T03:44:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8c76d4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8c0103bb0 0x7fb8c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:06.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8c76d4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8c01094f0 0x7fb8c0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:06.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8c76d4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8c0109e40 0x7fb8c0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:06.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8c76d4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c0113b00 con 0x7fb8c0109e40 2024-09-21T03:44:06.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8c76d4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c0113980 con 0x7fb8c01094f0 2024-09-21T03:44:06.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8c76d4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c0113c80 con 0x7fb8c0103bb0 2024-09-21T03:44:06.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8c5c71640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8c0109e40 0x7fb8c0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:06.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8c5c71640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8c0109e40 0x7fb8c0076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57226/0 (socket says 172.21.15.84:57226) 2024-09-21T03:44:06.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8c5c71640 1 -- 172.21.15.84:0/1879031609 learned_addr learned my addr 172.21.15.84:0/1879031609 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:06.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8c5470640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8c0103bb0 0x7fb8c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:06.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8c4c6f640 1 --2- 172.21.15.84:0/1879031609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8c01094f0 0x7fb8c0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:06.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8c5c71640 1 -- 172.21.15.84:0/1879031609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8c0103bb0 msgr2=0x7fb8c0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:06.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8c5c71640 1 --2- 172.21.15.84:0/1879031609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8c0103bb0 0x7fb8c0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8c5c71640 1 -- 172.21.15.84:0/1879031609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8c01094f0 msgr2=0x7fb8c0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:06.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8c5c71640 1 --2- 172.21.15.84:0/1879031609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8c01094f0 0x7fb8c0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8c5c71640 1 -- 172.21.15.84:0/1879031609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c01a8700 con 0x7fb8c0109e40 2024-09-21T03:44:06.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8c5c71640 1 --2- 172.21.15.84:0/1879031609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8c0109e40 0x7fb8c0076190 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800cce0 tx=0x7fb8b800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:06.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8b67fc640 1 -- 172.21.15.84:0/1879031609 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b800f450 con 0x7fb8c0109e40 2024-09-21T03:44:06.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8b67fc640 1 -- 172.21.15.84:0/1879031609 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8b800faa0 con 0x7fb8c0109e40 2024-09-21T03:44:06.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8c76d4640 1 -- 172.21.15.84:0/1879031609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8c01a89f0 con 0x7fb8c0109e40 2024-09-21T03:44:06.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.852+0000 7fb8b67fc640 1 -- 172.21.15.84:0/1879031609 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8018b70 con 0x7fb8c0109e40 2024-09-21T03:44:06.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.853+0000 7fb8c76d4640 1 -- 172.21.15.84:0/1879031609 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8c01a8f30 con 0x7fb8c0109e40 2024-09-21T03:44:06.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.855+0000 7fb8cdc48740 1 Processor -- start 2024-09-21T03:44:06.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.855+0000 7fb8b67fc640 1 -- 172.21.15.84:0/1879031609 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fb8b8018d10 con 0x7fb8c0109e40 2024-09-21T03:44:06.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.855+0000 7fb8cdc48740 1 -- start start 2024-09-21T03:44:06.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.855+0000 7fb8cdc48740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ddfb9ee070 0x55ddfbd952c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:06.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.855+0000 7fb8cdc48740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 0x55ddfbd95800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:06.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.855+0000 7fb8cdc48740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9cd390 0x55ddfbd95d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:06.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.856+0000 7fb8cdc48740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ddfbd0bea0 con 0x55ddfb9c51b0 2024-09-21T03:44:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.856+0000 7fb8cdc48740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ddfbcfb2d0 con 0x55ddfb9cd390 2024-09-21T03:44:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.856+0000 7fb8cdc48740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ddfbcff0e0 con 0x55ddfb9ee070 2024-09-21T03:44:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.856+0000 7fb8c5470640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 0x55ddfbd95800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.856+0000 7fb8c5470640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 0x55ddfbd95800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57230/0 (socket says 172.21.15.84:57230) 2024-09-21T03:44:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.856+0000 7fb8c5470640 1 -- 172.21.15.84:0/4258035514 learned_addr learned my addr 172.21.15.84:0/4258035514 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.856+0000 7fb8c4c6f640 1 --2- 172.21.15.84:0/4258035514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ddfb9ee070 0x55ddfbd952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.856+0000 7fb8c4c6f640 1 --2- 172.21.15.84:0/4258035514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9cd390 0x55ddfbd95d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.856+0000 7fb8c5470640 1 -- 172.21.15.84:0/4258035514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ddfb9ee070 msgr2=0x55ddfbd952c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.856+0000 7fb8c5470640 1 --2- 172.21.15.84:0/4258035514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ddfb9ee070 0x55ddfbd952c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.856+0000 7fb8c5470640 1 -- 172.21.15.84:0/4258035514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9cd390 msgr2=0x55ddfbd95d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.856+0000 7fb8c5470640 1 --2- 172.21.15.84:0/4258035514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9cd390 0x55ddfbd95d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.856+0000 7fb8c5470640 1 -- 172.21.15.84:0/4258035514 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddfba59650 con 0x55ddfb9c51b0 2024-09-21T03:44:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.856+0000 7fb8b67fc640 1 --2- 172.21.15.84:0/1879031609 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb8ac0b6700 0x7fb8ac0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.856+0000 7fb8c4c6f640 1 --2- 172.21.15.84:0/4258035514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9cd390 0x55ddfbd95d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.856+0000 7fb8c5470640 1 --2- 172.21.15.84:0/4258035514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 0x55ddfbd95800 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc009900 tx=0x7fb8bc032df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c18e3b81bb9fdc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.856+0000 7fb8c4c6f640 1 --2- 172.21.15.84:0/1879031609 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb8ac0b6700 0x7fb8ac0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.856+0000 7fb8b67fc640 1 -- 172.21.15.84:0/1879031609 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fb8b80e7b00 con 0x7fb8c0109e40 2024-09-21T03:44:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.856+0000 7fb8ab7fe640 1 -- 172.21.15.84:0/4258035514 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc040070 con 0x55ddfb9c51b0 2024-09-21T03:44:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.856+0000 7fb8ab7fe640 1 -- 172.21.15.84:0/4258035514 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8bc005db0 con 0x55ddfb9c51b0 2024-09-21T03:44:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.857+0000 7fb8ab7fe640 1 -- 172.21.15.84:0/4258035514 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc035040 con 0x55ddfb9c51b0 2024-09-21T03:44:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.857+0000 7fb8cdc48740 1 -- 172.21.15.84:0/4258035514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 msgr2=0x55ddfbd95800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.857+0000 7fb8c4c6f640 1 --2- 172.21.15.84:0/1879031609 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb8ac0b6700 0x7fb8ac0b8c10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0109050 tx=0x7fb8b00046c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.857+0000 7fb8cdc48740 1 --2- 172.21.15.84:0/4258035514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 0x55ddfbd95800 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc009900 tx=0x7fb8bc032df0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.857+0000 7fb8cdc48740 1 -- 172.21.15.84:0/4258035514 shutdown_connections 2024-09-21T03:44:06.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.857+0000 7fb8cdc48740 1 --2- 172.21.15.84:0/4258035514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9cd390 0x55ddfbd95d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.857+0000 7fb8cdc48740 1 --2- 172.21.15.84:0/4258035514 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 0x55ddfbd95800 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.857+0000 7fb8cdc48740 1 --2- 172.21.15.84:0/4258035514 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ddfb9ee070 0x55ddfbd952c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.857+0000 7fb8cdc48740 1 -- 172.21.15.84:0/4258035514 >> 172.21.15.84:0/4258035514 conn(0x55ddfb9e2460 msgr2=0x55ddfbd931b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.857+0000 7fb8cdc48740 1 -- 172.21.15.84:0/4258035514 shutdown_connections 2024-09-21T03:44:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.857+0000 7fb8cdc48740 1 -- 172.21.15.84:0/4258035514 wait complete. 2024-09-21T03:44:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.858+0000 7fb8cdc48740 1 -- start start 2024-09-21T03:44:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.858+0000 7fb8cdc48740 1 Processor -- start 2024-09-21T03:44:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.859+0000 7fb8cdc48740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 0x55ddfbda0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.859+0000 7fb8cdc48740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9cd390 0x55ddfbda0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.859+0000 7fb8cdc48740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ddfb9ee070 0x55ddfbdacd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.859+0000 7fb8cdc48740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ddfbb5c700 con 0x55ddfb9c51b0 2024-09-21T03:44:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.859+0000 7fb8cdc48740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ddfbc96160 con 0x55ddfb9cd390 2024-09-21T03:44:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.859+0000 7fb8cdc48740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ddfbda3a40 con 0x55ddfb9ee070 2024-09-21T03:44:06.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.859+0000 7fb8cdc48740 10 client.0 _ll_register_callbacks cb 0x55ddfbcaf9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.859+0000 7fb8c5470640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 0x55ddfbda0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.859+0000 7fb8c5470640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 0x55ddfbda0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57246/0 (socket says 172.21.15.84:57246) 2024-09-21T03:44:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.859+0000 7fb8c5470640 1 -- 172.21.15.84:0/396482741 learned_addr learned my addr 172.21.15.84:0/396482741 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.859+0000 7fb8c5c71640 1 --2- 172.21.15.84:0/396482741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ddfb9ee070 0x55ddfbdacd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.859+0000 7fb8c4c6f640 1 --2- 172.21.15.84:0/396482741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9cd390 0x55ddfbda0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.859+0000 7fb8c5470640 1 -- 172.21.15.84:0/396482741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ddfb9ee070 msgr2=0x55ddfbdacd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.859+0000 7fb8c5470640 1 --2- 172.21.15.84:0/396482741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ddfb9ee070 0x55ddfbdacd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.859+0000 7fb8c5470640 1 -- 172.21.15.84:0/396482741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9cd390 msgr2=0x55ddfbda0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.859+0000 7fb8c5470640 1 --2- 172.21.15.84:0/396482741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9cd390 0x55ddfbda0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.859+0000 7fb8c5470640 1 -- 172.21.15.84:0/396482741 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddfbcc3c90 con 0x55ddfb9c51b0 2024-09-21T03:44:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.859+0000 7fb8c5470640 1 --2- 172.21.15.84:0/396482741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 0x55ddfbda0980 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc02a930 tx=0x7fb8bc0051c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6f39c320b735ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.859+0000 7fb8a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:06.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.860+0000 7fb8a8ff9640 1 -- 172.21.15.84:0/396482741 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc04b030 con 0x55ddfb9c51b0 2024-09-21T03:44:06.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.860+0000 7fb8a8ff9640 1 -- 172.21.15.84:0/396482741 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fb8bc0316b0 con 0x55ddfb9c51b0 2024-09-21T03:44:06.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.860+0000 7fb8cdc48740 1 -- 172.21.15.84:0/396482741 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8bc005db0 con 0x55ddfb9c51b0 2024-09-21T03:44:06.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.860+0000 7fb8a8ff9640 1 -- 172.21.15.84:0/396482741 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb8bc055050 con 0x55ddfb9c51b0 2024-09-21T03:44:06.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.860+0000 7fb8cdc48740 10 client.15801 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:06.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.860+0000 7fb8cdc48740 1 -- 172.21.15.84:0/396482741 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ddfbdaf690 con 0x55ddfb9c51b0 2024-09-21T03:44:06.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.860+0000 7fb8a8ff9640 1 -- 172.21.15.84:0/396482741 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8bc005db0 con 0x55ddfb9c51b0 2024-09-21T03:44:06.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.860+0000 7fb8a8ff9640 1 -- 172.21.15.84:0/396482741 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb8bc003c30 con 0x55ddfb9c51b0 2024-09-21T03:44:06.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.860+0000 7fb8cdc48740 10 client.15801 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:06.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.860+0000 7fb8cdc48740 10 client.15801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:44:06.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.860+0000 7fb8cdc48740 20 client.15801 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:06.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.860+0000 7fb8cdc48740 1 --2- 172.21.15.84:0/396482741 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ddfb9ac9f0 0x55ddfbdb29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:06.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.860+0000 7fb8cdc48740 4 client.15801 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:44:06.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.860+0000 7fb8cdc48740 1 -- 172.21.15.84:0/396482741 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddfbd0ddf0 con 0x55ddfb9ac9f0 2024-09-21T03:44:06.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.861+0000 7fb8c4c6f640 1 --2- 172.21.15.84:0/396482741 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ddfb9ac9f0 0x55ddfbdb29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:06.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.861+0000 7fb8a8ff9640 10 client.15801 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:06.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.861+0000 7fb8c4c6f640 1 --2- 172.21.15.84:0/396482741 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ddfb9ac9f0 0x55ddfbdb29f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=511ad4a32c9239e8 server_cookie=17a2e498b010b920 in_seq=0 out_seq=0 2024-09-21T03:44:06.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.862+0000 7fb8a8ff9640 1 -- 172.21.15.84:0/396482741 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ddfbd0ddf0 con 0x55ddfb9ac9f0 2024-09-21T03:44:06.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.862+0000 7fb8a8ff9640 10 client.15801 handle_command_reply: tid=0 2024-09-21T03:44:06.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.862+0000 7fb8cdc48740 1 client.15801 shutdown 2024-09-21T03:44:06.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.862+0000 7fb8cdc48740 1 -- 172.21.15.84:0/396482741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 msgr2=0x55ddfbda0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:06.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.862+0000 7fb8cdc48740 1 --2- 172.21.15.84:0/396482741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 0x55ddfbda0980 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc02a930 tx=0x7fb8bc0051c0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.862+0000 7fb8cdc48740 1 -- 172.21.15.84:0/396482741 shutdown_connections 2024-09-21T03:44:06.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.862+0000 7fb8cdc48740 1 --2- 172.21.15.84:0/396482741 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ddfb9ac9f0 0x55ddfbdb29f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.862+0000 7fb8cdc48740 1 --2- 172.21.15.84:0/396482741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ddfb9ee070 0x55ddfbdacd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.862+0000 7fb8cdc48740 1 --2- 172.21.15.84:0/396482741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9cd390 0x55ddfbda0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.862+0000 7fb8a8ff9640 0 client.15801 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:06.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.862+0000 7fb8cdc48740 1 --2- 172.21.15.84:0/396482741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 0x55ddfbda0980 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.862+0000 7fb8cdc48740 1 -- 172.21.15.84:0/396482741 >> 172.21.15.84:0/396482741 conn(0x55ddfb9e2460 msgr2=0x55ddfbd98450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:06.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.862+0000 7fb8cdc48740 1 -- 172.21.15.84:0/396482741 shutdown_connections 2024-09-21T03:44:06.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.862+0000 7fb8cdc48740 1 -- 172.21.15.84:0/396482741 wait complete. 2024-09-21T03:44:06.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.862+0000 7fb8cdc48740 20 client.15801 trim_cache size 0 max 16384 2024-09-21T03:44:06.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.875+0000 7fb8cdc48740 1 Processor -- start 2024-09-21T03:44:06.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.875+0000 7fb8cdc48740 1 -- start start 2024-09-21T03:44:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.876+0000 7fb8cdc48740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9ac9f0 0x55ddfbd9f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.876+0000 7fb8cdc48740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ddfb9c51b0 0x55ddfbda25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.876+0000 7fb8cdc48740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9cd390 0x55ddfbd92760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.876+0000 7fb8cdc48740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01b3f60 con 0x55ddfb9ac9f0 2024-09-21T03:44:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.876+0000 7fb8cdc48740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01b1830 con 0x55ddfb9cd390 2024-09-21T03:44:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.876+0000 7fb8cdc48740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01af6a0 con 0x55ddfb9c51b0 2024-09-21T03:44:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.876+0000 7fb8c5470640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9ac9f0 0x55ddfbd9f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.876+0000 7fb8c5470640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9ac9f0 0x55ddfbd9f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57258/0 (socket says 172.21.15.84:57258) 2024-09-21T03:44:06.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.876+0000 7fb8c5470640 1 -- 172.21.15.84:0/2080563023 learned_addr learned my addr 172.21.15.84:0/2080563023 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:06.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.876+0000 7fb8c5470640 1 -- 172.21.15.84:0/2080563023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ddfb9c51b0 msgr2=0x55ddfbda25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:06.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.876+0000 7fb8c5470640 1 --2- 172.21.15.84:0/2080563023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ddfb9c51b0 0x55ddfbda25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.876+0000 7fb8c5470640 1 -- 172.21.15.84:0/2080563023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9cd390 msgr2=0x55ddfbd92760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:06.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.876+0000 7fb8c5c71640 1 --2- 172.21.15.84:0/2080563023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9cd390 0x55ddfbd92760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:06.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.876+0000 7fb8c5470640 1 --2- 172.21.15.84:0/2080563023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9cd390 0x55ddfbd92760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.876+0000 7fb8c5470640 1 -- 172.21.15.84:0/2080563023 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddfbd98120 con 0x55ddfb9ac9f0 2024-09-21T03:44:06.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.876+0000 7fb8c5470640 1 --2- 172.21.15.84:0/2080563023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9ac9f0 0x55ddfbd9f870 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc02ac00 tx=0x7fb8bc032ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531e9d9b31813ba9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:06.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.876+0000 7fb8aaffd640 1 -- 172.21.15.84:0/2080563023 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc04b070 con 0x55ddfb9ac9f0 2024-09-21T03:44:06.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.876+0000 7fb8aaffd640 1 -- 172.21.15.84:0/2080563023 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8bc004480 con 0x55ddfb9ac9f0 2024-09-21T03:44:06.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.876+0000 7fb8aaffd640 1 -- 172.21.15.84:0/2080563023 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc035070 con 0x55ddfb9ac9f0 2024-09-21T03:44:06.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.877+0000 7fb8cdc48740 1 -- 172.21.15.84:0/2080563023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9ac9f0 msgr2=0x55ddfbd9f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:06.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.877+0000 7fb8cdc48740 1 --2- 172.21.15.84:0/2080563023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9ac9f0 0x55ddfbd9f870 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc02ac00 tx=0x7fb8bc032ee0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.877+0000 7fb8cdc48740 1 -- 172.21.15.84:0/2080563023 shutdown_connections 2024-09-21T03:44:06.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.877+0000 7fb8cdc48740 1 --2- 172.21.15.84:0/2080563023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9cd390 0x55ddfbd92760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.877+0000 7fb8cdc48740 1 --2- 172.21.15.84:0/2080563023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ddfb9c51b0 0x55ddfbda25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.877+0000 7fb8cdc48740 1 --2- 172.21.15.84:0/2080563023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9ac9f0 0x55ddfbd9f870 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.877+0000 7fb8cdc48740 1 -- 172.21.15.84:0/2080563023 >> 172.21.15.84:0/2080563023 conn(0x55ddfb9e2460 msgr2=0x55ddfbda1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:06.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.877+0000 7fb8cdc48740 1 -- 172.21.15.84:0/2080563023 shutdown_connections 2024-09-21T03:44:06.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.877+0000 7fb8cdc48740 1 -- 172.21.15.84:0/2080563023 wait complete. 2024-09-21T03:44:06.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.878+0000 7fb8cdc48740 1 -- start start 2024-09-21T03:44:06.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.878+0000 7fb8cdc48740 1 Processor -- start 2024-09-21T03:44:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.878+0000 7fb8cdc48740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9ac9f0 0x55ddfbda93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.878+0000 7fb8cdc48740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 0x55ddfbda48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.878+0000 7fb8cdc48740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ddfb9cd390 0x55ddfbda4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.878+0000 7fb8cdc48740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01afcf0 con 0x55ddfb9c51b0 2024-09-21T03:44:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.878+0000 7fb8cdc48740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01b1160 con 0x55ddfb9ac9f0 2024-09-21T03:44:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.878+0000 7fb8cdc48740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01b03c0 con 0x55ddfb9cd390 2024-09-21T03:44:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.878+0000 7fb8cdc48740 10 client.0 _ll_register_callbacks cb 0x7fb8b000c4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.878+0000 7fb8c4c6f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 0x55ddfbda48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.878+0000 7fb8c4c6f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 0x55ddfbda48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57264/0 (socket says 172.21.15.84:57264) 2024-09-21T03:44:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.878+0000 7fb8c4c6f640 1 -- 172.21.15.84:0/3929415510 learned_addr learned my addr 172.21.15.84:0/3929415510 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:06.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.878+0000 7fb8c5470640 1 --2- 172.21.15.84:0/3929415510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9ac9f0 0x55ddfbda93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:06.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.879+0000 7fb8c5c71640 1 --2- 172.21.15.84:0/3929415510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ddfb9cd390 0x55ddfbda4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:06.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.879+0000 7fb8c4c6f640 1 -- 172.21.15.84:0/3929415510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ddfb9cd390 msgr2=0x55ddfbda4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:06.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.879+0000 7fb8c4c6f640 1 --2- 172.21.15.84:0/3929415510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ddfb9cd390 0x55ddfbda4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.879+0000 7fb8c4c6f640 1 -- 172.21.15.84:0/3929415510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9ac9f0 msgr2=0x55ddfbda93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:06.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.879+0000 7fb8c4c6f640 1 --2- 172.21.15.84:0/3929415510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9ac9f0 0x55ddfbda93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.879+0000 7fb8c4c6f640 1 -- 172.21.15.84:0/3929415510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddfbda54d0 con 0x55ddfb9c51b0 2024-09-21T03:44:06.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.879+0000 7fb8c4c6f640 1 --2- 172.21.15.84:0/3929415510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 0x55ddfbda48a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb8b000ca80 tx=0x7fb8b000c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4faad94bf4960c49 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:06.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.879+0000 7fb8a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:06.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.879+0000 7fb8a8ff9640 1 -- 172.21.15.84:0/3929415510 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0004030 con 0x55ddfb9c51b0 2024-09-21T03:44:06.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.879+0000 7fb8a8ff9640 1 -- 172.21.15.84:0/3929415510 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fb8b00041d0 con 0x55ddfb9c51b0 2024-09-21T03:44:06.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.879+0000 7fb8cdc48740 1 -- 172.21.15.84:0/3929415510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8bc004480 con 0x55ddfb9c51b0 2024-09-21T03:44:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.879+0000 7fb8a8ff9640 1 -- 172.21.15.84:0/3929415510 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb8b0035050 con 0x55ddfb9c51b0 2024-09-21T03:44:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.879+0000 7fb8cdc48740 10 client.15807 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.879+0000 7fb8cdc48740 1 -- 172.21.15.84:0/3929415510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ddfbe1d0e0 con 0x55ddfb9c51b0 2024-09-21T03:44:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.879+0000 7fb8a8ff9640 1 -- 172.21.15.84:0/3929415510 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8bc004480 con 0x55ddfb9c51b0 2024-09-21T03:44:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.880+0000 7fb8a8ff9640 1 -- 172.21.15.84:0/3929415510 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb8b0019040 con 0x55ddfb9c51b0 2024-09-21T03:44:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.880+0000 7fb8cdc48740 10 client.15807 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.880+0000 7fb8cdc48740 10 client.15807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:44:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.880+0000 7fb8cdc48740 20 client.15807 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.880+0000 7fb8cdc48740 1 --2- 172.21.15.84:0/3929415510 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ddfb9ee070 0x55ddfbe1f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.880+0000 7fb8cdc48740 4 client.15807 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:44:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.880+0000 7fb8cdc48740 1 -- 172.21.15.84:0/3929415510 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ddfbd098a0 con 0x55ddfb9ee070 2024-09-21T03:44:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.880+0000 7fb8c5470640 1 --2- 172.21.15.84:0/3929415510 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ddfb9ee070 0x55ddfbe1f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.880+0000 7fb8a8ff9640 10 client.15807 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:06.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.880+0000 7fb8c5470640 1 --2- 172.21.15.84:0/3929415510 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ddfb9ee070 0x55ddfbe1f8d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b203fa9e7e68511b server_cookie=86417e5a5298e945 in_seq=0 out_seq=0 2024-09-21T03:44:06.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.881+0000 7fb8a8ff9640 1 -- 172.21.15.84:0/3929415510 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ddfbd098a0 con 0x55ddfb9ee070 2024-09-21T03:44:06.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.881+0000 7fb8a8ff9640 10 client.15807 handle_command_reply: tid=0 2024-09-21T03:44:06.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.881+0000 7fb8cdc48740 1 client.15807 shutdown 2024-09-21T03:44:06.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.881+0000 7fb8cdc48740 1 -- 172.21.15.84:0/3929415510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 msgr2=0x55ddfbda48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:06.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.881+0000 7fb8cdc48740 1 --2- 172.21.15.84:0/3929415510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 0x55ddfbda48a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb8b000ca80 tx=0x7fb8b000c610 comp rx=0 tx=0).stop 2024-09-21T03:44:06.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.881+0000 7fb8cdc48740 1 -- 172.21.15.84:0/3929415510 shutdown_connections 2024-09-21T03:44:06.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.881+0000 7fb8cdc48740 1 --2- 172.21.15.84:0/3929415510 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ddfb9ee070 0x55ddfbe1f8d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.881+0000 7fb8cdc48740 1 --2- 172.21.15.84:0/3929415510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ddfb9cd390 0x55ddfbda4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.881+0000 7fb8cdc48740 1 --2- 172.21.15.84:0/3929415510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ddfb9c51b0 0x55ddfbda48a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.881+0000 7fb8cdc48740 1 --2- 172.21.15.84:0/3929415510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ddfb9ac9f0 0x55ddfbda93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.881+0000 7fb8cdc48740 1 -- 172.21.15.84:0/3929415510 >> 172.21.15.84:0/3929415510 conn(0x55ddfb9e2460 msgr2=0x55ddfbda1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:06.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.881+0000 7fb8a8ff9640 0 client.15807 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:06.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.881+0000 7fb8cdc48740 1 -- 172.21.15.84:0/3929415510 shutdown_connections 2024-09-21T03:44:06.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.881+0000 7fb8cdc48740 1 -- 172.21.15.84:0/3929415510 wait complete. 2024-09-21T03:44:06.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.881+0000 7fb8cdc48740 20 client.15807 trim_cache size 0 max 16384 2024-09-21T03:44:06.888 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:44:06.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.882+0000 7fb8c76d4640 1 -- 172.21.15.84:0/1879031609 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb8ac0b6700 msgr2=0x7fb8ac0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.882+0000 7fb8c76d4640 1 --2- 172.21.15.84:0/1879031609 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb8ac0b6700 0x7fb8ac0b8c10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0109050 tx=0x7fb8b00046c0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.882+0000 7fb8c76d4640 1 -- 172.21.15.84:0/1879031609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8c0109e40 msgr2=0x7fb8c0076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.882+0000 7fb8c76d4640 1 --2- 172.21.15.84:0/1879031609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8c0109e40 0x7fb8c0076190 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800cce0 tx=0x7fb8b800a620 comp rx=0 tx=0).stop 2024-09-21T03:44:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.882+0000 7fb8c76d4640 1 -- 172.21.15.84:0/1879031609 shutdown_connections 2024-09-21T03:44:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.882+0000 7fb8c76d4640 1 --2- 172.21.15.84:0/1879031609 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb8ac0b6700 0x7fb8ac0b8c10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.882+0000 7fb8c76d4640 1 --2- 172.21.15.84:0/1879031609 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb8c0109e40 0x7fb8c0076190 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.882+0000 7fb8c76d4640 1 --2- 172.21.15.84:0/1879031609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8c01094f0 0x7fb8c0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.882+0000 7fb8c76d4640 1 --2- 172.21.15.84:0/1879031609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb8c0103bb0 0x7fb8c0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.882+0000 7fb8c76d4640 1 -- 172.21.15.84:0/1879031609 >> 172.21.15.84:0/1879031609 conn(0x7fb8c00ff600 msgr2=0x7fb8c0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.882+0000 7fb8c76d4640 1 -- 172.21.15.84:0/1879031609 shutdown_connections 2024-09-21T03:44:06.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:06.882+0000 7fb8c76d4640 1 -- 172.21.15.84:0/1879031609 wait complete. 2024-09-21T03:44:07.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:07 smithi084 ceph-mon[30941]: pgmap v373: 97 pgs: 97 active+clean; 1.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 KiB/s wr, 24 op/s 2024-09-21T03:44:07.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:07 smithi172 ceph-mon[34821]: pgmap v373: 97 pgs: 97 active+clean; 1.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 KiB/s wr, 24 op/s 2024-09-21T03:44:07.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:07 smithi174 ceph-mon[34403]: pgmap v373: 97 pgs: 97 active+clean; 1.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 KiB/s wr, 24 op/s 2024-09-21T03:44:08.647 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:44:08.647 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:44:08.904 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:09.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.392+0000 7febb6c3e640 1 -- 172.21.15.84:0/3947126521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febb01031b0 msgr2=0x7febb01035c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:09.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.392+0000 7febb6c3e640 1 --2- 172.21.15.84:0/3947126521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febb01031b0 0x7febb01035c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7feba4009900 tx=0x7feba402a410 comp rx=0 tx=0).stop 2024-09-21T03:44:09.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.392+0000 7febb6c3e640 1 -- 172.21.15.84:0/3947126521 shutdown_connections 2024-09-21T03:44:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.392+0000 7febb6c3e640 1 --2- 172.21.15.84:0/3947126521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febb0105b10 0x7febb010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.392+0000 7febb6c3e640 1 --2- 172.21.15.84:0/3947126521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febb01051c0 0x7febb01055d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.392+0000 7febb6c3e640 1 --2- 172.21.15.84:0/3947126521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febb01031b0 0x7febb01035c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.393+0000 7febb6c3e640 1 -- 172.21.15.84:0/3947126521 >> 172.21.15.84:0/3947126521 conn(0x7febb0079e40 msgr2=0x7febb007a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.393+0000 7febb6c3e640 1 -- 172.21.15.84:0/3947126521 shutdown_connections 2024-09-21T03:44:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.393+0000 7febb6c3e640 1 -- 172.21.15.84:0/3947126521 wait complete. 2024-09-21T03:44:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.393+0000 7febb6c3e640 1 Processor -- start 2024-09-21T03:44:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.393+0000 7febb6c3e640 1 -- start start 2024-09-21T03:44:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.393+0000 7febb6c3e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febb01031b0 0x7febb0199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.393+0000 7febb6c3e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febb01051c0 0x7febb01999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.394+0000 7febb6c3e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febb0105b10 0x7febb019ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.394+0000 7febb6c3e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7febb0112a00 con 0x7febb01051c0 2024-09-21T03:44:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.394+0000 7febb6c3e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7febb0112880 con 0x7febb01031b0 2024-09-21T03:44:09.420 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.394+0000 7febb6c3e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7febb0112b80 con 0x7febb0105b10 2024-09-21T03:44:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.394+0000 7febaffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febb01051c0 0x7febb01999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.394+0000 7febaffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febb01051c0 0x7febb01999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42260/0 (socket says 172.21.15.84:42260) 2024-09-21T03:44:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.394+0000 7febaffff640 1 -- 172.21.15.84:0/3483957858 learned_addr learned my addr 172.21.15.84:0/3483957858 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.394+0000 7febb49da640 1 --2- 172.21.15.84:0/3483957858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febb01031b0 0x7febb0199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.394+0000 7febb51db640 1 --2- 172.21.15.84:0/3483957858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febb0105b10 0x7febb019ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.394+0000 7febaffff640 1 -- 172.21.15.84:0/3483957858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febb0105b10 msgr2=0x7febb019ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.394+0000 7febaffff640 1 --2- 172.21.15.84:0/3483957858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febb0105b10 0x7febb019ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.394+0000 7febaffff640 1 -- 172.21.15.84:0/3483957858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febb01031b0 msgr2=0x7febb0199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.394+0000 7febaffff640 1 --2- 172.21.15.84:0/3483957858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febb01031b0 0x7febb0199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.394+0000 7febaffff640 1 -- 172.21.15.84:0/3483957858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb019f3c0 con 0x7febb01051c0 2024-09-21T03:44:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.394+0000 7febaffff640 1 --2- 172.21.15.84:0/3483957858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febb01051c0 0x7febb01999f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00d740 tx=0x7feb9c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.394+0000 7febadffb640 1 -- 172.21.15.84:0/3483957858 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c017070 con 0x7febb01051c0 2024-09-21T03:44:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.394+0000 7febb6c3e640 1 -- 172.21.15.84:0/3483957858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb019f6b0 con 0x7febb01051c0 2024-09-21T03:44:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.394+0000 7febadffb640 1 -- 172.21.15.84:0/3483957858 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb9c00de50 con 0x7febb01051c0 2024-09-21T03:44:09.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.394+0000 7febadffb640 1 -- 172.21.15.84:0/3483957858 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00f620 con 0x7febb01051c0 2024-09-21T03:44:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.395+0000 7febb6c3e640 1 -- 172.21.15.84:0/3483957858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb0101e10 con 0x7febb01051c0 2024-09-21T03:44:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.398+0000 7febbd1b2740 1 Processor -- start 2024-09-21T03:44:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.398+0000 7febbd1b2740 1 -- start start 2024-09-21T03:44:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.398+0000 7febbd1b2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db279350 0x55a0db620430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.398+0000 7febbd1b2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db250490 0x55a0db620970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.398+0000 7febbd1b2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db258670 0x55a0db620eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.398+0000 7febbd1b2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a0db596e60 con 0x55a0db250490 2024-09-21T03:44:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.398+0000 7febbd1b2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a0db586290 con 0x55a0db258670 2024-09-21T03:44:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.398+0000 7febbd1b2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a0db58a0a0 con 0x55a0db279350 2024-09-21T03:44:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.398+0000 7febadffb640 1 -- 172.21.15.84:0/3483957858 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7feb9c01a070 con 0x7febb01051c0 2024-09-21T03:44:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.398+0000 7febb49da640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db250490 0x55a0db620970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.398+0000 7febb49da640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db250490 0x55a0db620970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42264/0 (socket says 172.21.15.84:42264) 2024-09-21T03:44:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.398+0000 7febb49da640 1 -- 172.21.15.84:0/2995769260 learned_addr learned my addr 172.21.15.84:0/2995769260 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:09.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.398+0000 7febb51db640 1 --2- 172.21.15.84:0/2995769260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db279350 0x55a0db620430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.399+0000 7febb49da640 1 -- 172.21.15.84:0/2995769260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db279350 msgr2=0x55a0db620430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.399+0000 7febb49da640 1 --2- 172.21.15.84:0/2995769260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db279350 0x55a0db620430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.399+0000 7febb49da640 1 -- 172.21.15.84:0/2995769260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db258670 msgr2=0x55a0db620eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.399+0000 7febb49da640 1 --2- 172.21.15.84:0/2995769260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db258670 0x55a0db620eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.399+0000 7febb49da640 1 -- 172.21.15.84:0/2995769260 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0db2e4930 con 0x55a0db250490 2024-09-21T03:44:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.399+0000 7febb51db640 1 --2- 172.21.15.84:0/2995769260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db279350 0x55a0db620430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:44:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.399+0000 7febb49da640 1 --2- 172.21.15.84:0/2995769260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db250490 0x55a0db620970 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7feba4009230 tx=0x7feba4031df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24cd6eb44308c514 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.399+0000 7febadffb640 1 --2- 172.21.15.84:0/3483957858 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7feba00b6680 0x7feba00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.399+0000 7febb51db640 1 --2- 172.21.15.84:0/3483957858 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7feba00b6680 0x7feba00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.399+0000 7febadffb640 1 -- 172.21.15.84:0/3483957858 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7feb9c0e6ff0 con 0x7febb01051c0 2024-09-21T03:44:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.400+0000 7febb51db640 1 --2- 172.21.15.84:0/3483957858 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7feba00b6680 0x7feba00b8b90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7feba800afd0 tx=0x7feba800a4d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.401+0000 7feb9affd640 1 -- 172.21.15.84:0/2995769260 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4040070 con 0x55a0db250490 2024-09-21T03:44:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.401+0000 7feb9affd640 1 -- 172.21.15.84:0/2995769260 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba4031630 con 0x55a0db250490 2024-09-21T03:44:09.423 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.401+0000 7feb9affd640 1 -- 172.21.15.84:0/2995769260 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4035040 con 0x55a0db250490 2024-09-21T03:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.401+0000 7febbd1b2740 1 -- 172.21.15.84:0/2995769260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db250490 msgr2=0x55a0db620970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.401+0000 7febbd1b2740 1 --2- 172.21.15.84:0/2995769260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db250490 0x55a0db620970 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7feba4009230 tx=0x7feba4031df0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.402+0000 7febbd1b2740 1 -- 172.21.15.84:0/2995769260 shutdown_connections 2024-09-21T03:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.402+0000 7febbd1b2740 1 --2- 172.21.15.84:0/2995769260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db258670 0x55a0db620eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.402+0000 7febbd1b2740 1 --2- 172.21.15.84:0/2995769260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db250490 0x55a0db620970 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.402+0000 7febbd1b2740 1 --2- 172.21.15.84:0/2995769260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db279350 0x55a0db620430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.402+0000 7febbd1b2740 1 -- 172.21.15.84:0/2995769260 >> 172.21.15.84:0/2995769260 conn(0x55a0db26d740 msgr2=0x55a0db61e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.402+0000 7febbd1b2740 1 -- 172.21.15.84:0/2995769260 shutdown_connections 2024-09-21T03:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.402+0000 7febbd1b2740 1 -- 172.21.15.84:0/2995769260 wait complete. 2024-09-21T03:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.402+0000 7febbd1b2740 1 -- start start 2024-09-21T03:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.402+0000 7febbd1b2740 1 Processor -- start 2024-09-21T03:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.402+0000 7febbd1b2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db250490 0x55a0db62c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7febbd1b2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db258670 0x55a0db62c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7febbd1b2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db279350 0x55a0db637ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:09.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7febbd1b2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a0db3e7890 con 0x55a0db258670 2024-09-21T03:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7febbd1b2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a0db520d40 con 0x55a0db279350 2024-09-21T03:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7febbd1b2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a0db62ebb0 con 0x55a0db250490 2024-09-21T03:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7febbd1b2740 10 client.0 _ll_register_callbacks cb 0x55a0db584c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7febaffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db258670 0x55a0db62c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7febaffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db258670 0x55a0db62c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42276/0 (socket says 172.21.15.84:42276) 2024-09-21T03:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7febaffff640 1 -- 172.21.15.84:0/2986385981 learned_addr learned my addr 172.21.15.84:0/2986385981 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7febb49da640 1 --2- 172.21.15.84:0/2986385981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db250490 0x55a0db62c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7febb51db640 1 --2- 172.21.15.84:0/2986385981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db279350 0x55a0db637ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7febaffff640 1 -- 172.21.15.84:0/2986385981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db250490 msgr2=0x55a0db62c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7febaffff640 1 --2- 172.21.15.84:0/2986385981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db250490 0x55a0db62c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7febaffff640 1 -- 172.21.15.84:0/2986385981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db279350 msgr2=0x55a0db637ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7febaffff640 1 --2- 172.21.15.84:0/2986385981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db279350 0x55a0db637ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7febaffff640 1 -- 172.21.15.84:0/2986385981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0db6384b0 con 0x55a0db258670 2024-09-21T03:44:09.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7febaffff640 1 --2- 172.21.15.84:0/2986385981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db258670 0x55a0db62c5a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0acf00 tx=0x7feb9c0a8f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78f1ea7cc12a4a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7feb8ffff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7feb8ffff640 1 -- 172.21.15.84:0/2986385981 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c021030 con 0x55a0db258670 2024-09-21T03:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7feb8ffff640 1 -- 172.21.15.84:0/2986385981 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7feb9c094110 con 0x55a0db258670 2024-09-21T03:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7febbd1b2740 1 -- 172.21.15.84:0/2986385981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feba4031630 con 0x55a0db258670 2024-09-21T03:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.403+0000 7feb8ffff640 1 -- 172.21.15.84:0/2986385981 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7feb9c0ac6e0 con 0x55a0db258670 2024-09-21T03:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.404+0000 7febbd1b2740 10 client.15819 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.404+0000 7febbd1b2740 1 -- 172.21.15.84:0/2986385981 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a0db63ade0 con 0x55a0db258670 2024-09-21T03:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.404+0000 7feb8ffff640 1 -- 172.21.15.84:0/2986385981 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba4031630 con 0x55a0db258670 2024-09-21T03:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.404+0000 7feb8ffff640 1 -- 172.21.15.84:0/2986385981 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7feb9c0abc40 con 0x55a0db258670 2024-09-21T03:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.404+0000 7febbd1b2740 10 client.15819 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.404+0000 7febbd1b2740 10 client.15819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.404+0000 7febbd1b2740 20 client.15819 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.404+0000 7febbd1b2740 1 --2- 172.21.15.84:0/2986385981 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55a0db237cd0 0x55a0db63e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:09.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.404+0000 7febbd1b2740 4 client.15819 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:44:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.404+0000 7febbd1b2740 1 -- 172.21.15.84:0/2986385981 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0db598db0 con 0x55a0db237cd0 2024-09-21T03:44:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.404+0000 7febb49da640 1 --2- 172.21.15.84:0/2986385981 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55a0db237cd0 0x55a0db63e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.405+0000 7feb8ffff640 10 client.15819 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.405+0000 7febb49da640 1 --2- 172.21.15.84:0/2986385981 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55a0db237cd0 0x55a0db63e250 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d1188235fbdf16b server_cookie=18b334f5d7e78c19 in_seq=0 out_seq=0 2024-09-21T03:44:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.406+0000 7feb8ffff640 1 -- 172.21.15.84:0/2986385981 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a0db598db0 con 0x55a0db237cd0 2024-09-21T03:44:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.406+0000 7feb8ffff640 10 client.15819 handle_command_reply: tid=0 2024-09-21T03:44:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.406+0000 7febbd1b2740 1 client.15819 shutdown 2024-09-21T03:44:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.406+0000 7febbd1b2740 1 -- 172.21.15.84:0/2986385981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db258670 msgr2=0x55a0db62c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.406+0000 7febbd1b2740 1 --2- 172.21.15.84:0/2986385981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db258670 0x55a0db62c5a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0acf00 tx=0x7feb9c0a8f20 comp rx=0 tx=0).stop 2024-09-21T03:44:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.406+0000 7febbd1b2740 1 -- 172.21.15.84:0/2986385981 shutdown_connections 2024-09-21T03:44:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.406+0000 7febbd1b2740 1 --2- 172.21.15.84:0/2986385981 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55a0db237cd0 0x55a0db63e250 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.406+0000 7febbd1b2740 1 --2- 172.21.15.84:0/2986385981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db279350 0x55a0db637ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.406+0000 7feb8ffff640 0 client.15819 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.406+0000 7febbd1b2740 1 --2- 172.21.15.84:0/2986385981 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db258670 0x55a0db62c5a0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.406+0000 7febbd1b2740 1 --2- 172.21.15.84:0/2986385981 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db250490 0x55a0db62c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.406+0000 7febbd1b2740 1 -- 172.21.15.84:0/2986385981 >> 172.21.15.84:0/2986385981 conn(0x55a0db26d740 msgr2=0x55a0db6235c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:09.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.406+0000 7febbd1b2740 1 -- 172.21.15.84:0/2986385981 shutdown_connections 2024-09-21T03:44:09.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.406+0000 7febbd1b2740 1 -- 172.21.15.84:0/2986385981 wait complete. 2024-09-21T03:44:09.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.406+0000 7febbd1b2740 20 client.15819 trim_cache size 0 max 16384 2024-09-21T03:44:09.431 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.424+0000 7febbd1b2740 1 Processor -- start 2024-09-21T03:44:09.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.424+0000 7febbd1b2740 1 -- start start 2024-09-21T03:44:09.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.424+0000 7febbd1b2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db250490 0x55a0db62b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:09.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.424+0000 7febbd1b2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db258670 0x55a0db62da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:09.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.424+0000 7febbd1b2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db279350 0x55a0db6254c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:09.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.424+0000 7febbd1b2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7febb01b1f10 con 0x55a0db250490 2024-09-21T03:44:09.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.424+0000 7febbd1b2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7febb01af7e0 con 0x55a0db258670 2024-09-21T03:44:09.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.424+0000 7febbd1b2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7febb01ad630 con 0x55a0db279350 2024-09-21T03:44:09.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.425+0000 7febb49da640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db250490 0x55a0db62b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:09.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.425+0000 7febb49da640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db250490 0x55a0db62b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42286/0 (socket says 172.21.15.84:42286) 2024-09-21T03:44:09.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.425+0000 7febb49da640 1 -- 172.21.15.84:0/2754255632 learned_addr learned my addr 172.21.15.84:0/2754255632 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:09.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.425+0000 7febb51db640 1 --2- 172.21.15.84:0/2754255632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db279350 0x55a0db6254c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:09.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.425+0000 7febaffff640 1 --2- 172.21.15.84:0/2754255632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db258670 0x55a0db62da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:09.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.425+0000 7febb49da640 1 -- 172.21.15.84:0/2754255632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db279350 msgr2=0x55a0db6254c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:09.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.425+0000 7febb49da640 1 --2- 172.21.15.84:0/2754255632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db279350 0x55a0db6254c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.425+0000 7febb49da640 1 -- 172.21.15.84:0/2754255632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db258670 msgr2=0x55a0db62da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:09.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.425+0000 7febb49da640 1 --2- 172.21.15.84:0/2754255632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db258670 0x55a0db62da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.425+0000 7febb49da640 1 -- 172.21.15.84:0/2754255632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0db62c910 con 0x55a0db250490 2024-09-21T03:44:09.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.425+0000 7febb51db640 1 --2- 172.21.15.84:0/2754255632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db279350 0x55a0db6254c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:09.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.425+0000 7febaffff640 1 --2- 172.21.15.84:0/2754255632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db258670 0x55a0db62da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:09.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.425+0000 7febb49da640 1 --2- 172.21.15.84:0/2754255632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db250490 0x55a0db62b6b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7feba4009900 tx=0x7feba4005360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af1d388c927005d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:09.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.425+0000 7feb9a7fc640 1 -- 172.21.15.84:0/2754255632 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4040070 con 0x55a0db250490 2024-09-21T03:44:09.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.425+0000 7feb9a7fc640 1 -- 172.21.15.84:0/2754255632 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba40053d0 con 0x55a0db250490 2024-09-21T03:44:09.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.425+0000 7feb9a7fc640 1 -- 172.21.15.84:0/2754255632 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4035040 con 0x55a0db250490 2024-09-21T03:44:09.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.426+0000 7febbd1b2740 1 -- 172.21.15.84:0/2754255632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db250490 msgr2=0x55a0db62b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:09.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.426+0000 7febbd1b2740 1 --2- 172.21.15.84:0/2754255632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db250490 0x55a0db62b6b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7feba4009900 tx=0x7feba4005360 comp rx=0 tx=0).stop 2024-09-21T03:44:09.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.426+0000 7febbd1b2740 1 -- 172.21.15.84:0/2754255632 shutdown_connections 2024-09-21T03:44:09.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.426+0000 7febbd1b2740 1 --2- 172.21.15.84:0/2754255632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db279350 0x55a0db6254c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.426+0000 7febbd1b2740 1 --2- 172.21.15.84:0/2754255632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db258670 0x55a0db62da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.426+0000 7febbd1b2740 1 --2- 172.21.15.84:0/2754255632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db250490 0x55a0db62b6b0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.426+0000 7febbd1b2740 1 -- 172.21.15.84:0/2754255632 >> 172.21.15.84:0/2754255632 conn(0x55a0db26d740 msgr2=0x55a0db62d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:09.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.426+0000 7febbd1b2740 1 -- 172.21.15.84:0/2754255632 shutdown_connections 2024-09-21T03:44:09.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.426+0000 7febbd1b2740 1 -- 172.21.15.84:0/2754255632 wait complete. 2024-09-21T03:44:09.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.427+0000 7febbd1b2740 1 -- start start 2024-09-21T03:44:09.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.427+0000 7febbd1b2740 1 Processor -- start 2024-09-21T03:44:09.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.427+0000 7febbd1b2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db250490 0x55a0db633e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:09.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.427+0000 7febbd1b2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db258670 0x55a0db6343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:09.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.427+0000 7febbd1b2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db279350 0x55a0db62edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:09.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.427+0000 7febbd1b2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7febb01adca0 con 0x55a0db279350 2024-09-21T03:44:09.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.427+0000 7febbd1b2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7febb01af110 con 0x55a0db258670 2024-09-21T03:44:09.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.427+0000 7febbd1b2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7febb01ae370 con 0x55a0db250490 2024-09-21T03:44:09.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.427+0000 7febbd1b2740 10 client.0 _ll_register_callbacks cb 0x7feb9c009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:09.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.427+0000 7febb51db640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db279350 0x55a0db62edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:09.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.427+0000 7febb51db640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db279350 0x55a0db62edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42288/0 (socket says 172.21.15.84:42288) 2024-09-21T03:44:09.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.427+0000 7febb51db640 1 -- 172.21.15.84:0/3412880815 learned_addr learned my addr 172.21.15.84:0/3412880815 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:09.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.428+0000 7febb49da640 1 --2- 172.21.15.84:0/3412880815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db250490 0x55a0db633e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:09.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.428+0000 7febaffff640 1 --2- 172.21.15.84:0/3412880815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db258670 0x55a0db6343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:09.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.428+0000 7febb51db640 1 -- 172.21.15.84:0/3412880815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db250490 msgr2=0x55a0db633e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:09.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.428+0000 7febb51db640 1 --2- 172.21.15.84:0/3412880815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db250490 0x55a0db633e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.428+0000 7febb51db640 1 -- 172.21.15.84:0/3412880815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db258670 msgr2=0x55a0db6343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:09.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.428+0000 7febb51db640 1 --2- 172.21.15.84:0/3412880815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db258670 0x55a0db6343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.428+0000 7febb51db640 1 -- 172.21.15.84:0/3412880815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0db62f300 con 0x55a0db279350 2024-09-21T03:44:09.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.428+0000 7febaffff640 1 --2- 172.21.15.84:0/3412880815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db258670 0x55a0db6343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:09.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.428+0000 7febb49da640 1 --2- 172.21.15.84:0/3412880815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db250490 0x55a0db633e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:09.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.428+0000 7febb51db640 1 --2- 172.21.15.84:0/3412880815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db279350 0x55a0db62edc0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7feba800fed0 tx=0x7feba8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d45dd6b36b3ad0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:09.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.428+0000 7feb8ffff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:09.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.428+0000 7feb8ffff640 1 -- 172.21.15.84:0/3412880815 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba801bb60 con 0x55a0db279350 2024-09-21T03:44:09.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.428+0000 7feb8ffff640 1 -- 172.21.15.84:0/3412880815 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7feba801bd00 con 0x55a0db279350 2024-09-21T03:44:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.428+0000 7febbd1b2740 1 -- 172.21.15.84:0/3412880815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feba40053d0 con 0x55a0db279350 2024-09-21T03:44:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.428+0000 7feb8ffff640 1 -- 172.21.15.84:0/3412880815 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7feba8003970 con 0x55a0db279350 2024-09-21T03:44:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.428+0000 7febbd1b2740 10 client.15825 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.428+0000 7febbd1b2740 1 -- 172.21.15.84:0/3412880815 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a0db6a9290 con 0x55a0db279350 2024-09-21T03:44:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.429+0000 7feb8ffff640 1 -- 172.21.15.84:0/3412880815 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba40053d0 con 0x55a0db279350 2024-09-21T03:44:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.429+0000 7feb8ffff640 1 -- 172.21.15.84:0/3412880815 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7feba8027410 con 0x55a0db279350 2024-09-21T03:44:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.429+0000 7febbd1b2740 10 client.15825 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.429+0000 7febbd1b2740 10 client.15825 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:44:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.429+0000 7febbd1b2740 20 client.15825 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.429+0000 7febbd1b2740 1 --2- 172.21.15.84:0/3412880815 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55a0db20d080 0x55a0db6abb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.429+0000 7febbd1b2740 4 client.15825 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:44:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.429+0000 7febbd1b2740 1 -- 172.21.15.84:0/3412880815 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a0db594860 con 0x55a0db20d080 2024-09-21T03:44:09.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.429+0000 7febb49da640 1 --2- 172.21.15.84:0/3412880815 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55a0db20d080 0x55a0db6abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:09.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.429+0000 7feb8ffff640 10 client.15825 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:09.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.429+0000 7febb49da640 1 --2- 172.21.15.84:0/3412880815 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55a0db20d080 0x55a0db6abb00 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=154cfbf68d305041 server_cookie=365cdc3a3b8a5379 in_seq=0 out_seq=0 2024-09-21T03:44:09.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.431+0000 7feb8ffff640 1 -- 172.21.15.84:0/3412880815 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a0db594860 con 0x55a0db20d080 2024-09-21T03:44:09.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.431+0000 7feb8ffff640 10 client.15825 handle_command_reply: tid=0 2024-09-21T03:44:09.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.431+0000 7febbd1b2740 1 client.15825 shutdown 2024-09-21T03:44:09.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.431+0000 7febbd1b2740 1 -- 172.21.15.84:0/3412880815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db279350 msgr2=0x55a0db62edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:09.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.431+0000 7febbd1b2740 1 --2- 172.21.15.84:0/3412880815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db279350 0x55a0db62edc0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7feba800fed0 tx=0x7feba8004ab0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.431+0000 7febbd1b2740 1 -- 172.21.15.84:0/3412880815 shutdown_connections 2024-09-21T03:44:09.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.431+0000 7febbd1b2740 1 --2- 172.21.15.84:0/3412880815 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55a0db20d080 0x55a0db6abb00 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.431+0000 7febbd1b2740 1 --2- 172.21.15.84:0/3412880815 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a0db279350 0x55a0db62edc0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.431+0000 7feb8ffff640 0 client.15825 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:09.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.431+0000 7febbd1b2740 1 --2- 172.21.15.84:0/3412880815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a0db258670 0x55a0db6343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.431+0000 7febbd1b2740 1 --2- 172.21.15.84:0/3412880815 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a0db250490 0x55a0db633e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.431+0000 7febbd1b2740 1 -- 172.21.15.84:0/3412880815 >> 172.21.15.84:0/3412880815 conn(0x55a0db26d740 msgr2=0x55a0db62a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:09.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.432+0000 7febbd1b2740 1 -- 172.21.15.84:0/3412880815 shutdown_connections 2024-09-21T03:44:09.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.432+0000 7febbd1b2740 1 -- 172.21.15.84:0/3412880815 wait complete. 2024-09-21T03:44:09.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.432+0000 7febbd1b2740 20 client.15825 trim_cache size 0 max 16384 2024-09-21T03:44:09.439 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:44:09.439 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T03:44:09.439 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "40ac7eb4-6391-480d-a65f-40f0a2621b24", 2024-09-21T03:44:09.439 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T03:44:09.439 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:44:09.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.432+0000 7febb6c3e640 1 -- 172.21.15.84:0/3483957858 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7feba00b6680 msgr2=0x7feba00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:09.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.432+0000 7febb6c3e640 1 --2- 172.21.15.84:0/3483957858 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7feba00b6680 0x7feba00b8b90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7feba800afd0 tx=0x7feba800a4d0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.432+0000 7febb6c3e640 1 -- 172.21.15.84:0/3483957858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febb01051c0 msgr2=0x7febb01999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:09.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.432+0000 7febb6c3e640 1 --2- 172.21.15.84:0/3483957858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febb01051c0 0x7febb01999f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00d740 tx=0x7feb9c00dc00 comp rx=0 tx=0).stop 2024-09-21T03:44:09.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.432+0000 7febb6c3e640 1 -- 172.21.15.84:0/3483957858 shutdown_connections 2024-09-21T03:44:09.440 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.432+0000 7febb6c3e640 1 --2- 172.21.15.84:0/3483957858 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7feba00b6680 0x7feba00b8b90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.432+0000 7febb6c3e640 1 --2- 172.21.15.84:0/3483957858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febb0105b10 0x7febb019ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.432+0000 7febb6c3e640 1 --2- 172.21.15.84:0/3483957858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febb01051c0 0x7febb01999f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.432+0000 7febb6c3e640 1 --2- 172.21.15.84:0/3483957858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febb01031b0 0x7febb0199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.432+0000 7febb6c3e640 1 -- 172.21.15.84:0/3483957858 >> 172.21.15.84:0/3483957858 conn(0x7febb0079e40 msgr2=0x7febb0106490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.433+0000 7febb6c3e640 1 -- 172.21.15.84:0/3483957858 shutdown_connections 2024-09-21T03:44:09.441 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:09.433+0000 7febb6c3e640 1 -- 172.21.15.84:0/3483957858 wait complete. 2024-09-21T03:44:09.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:09 smithi084 ceph-mon[30941]: pgmap v374: 97 pgs: 97 active+clean; 1.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 KiB/s wr, 26 op/s 2024-09-21T03:44:09.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:09 smithi172 ceph-mon[34821]: pgmap v374: 97 pgs: 97 active+clean; 1.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 KiB/s wr, 26 op/s 2024-09-21T03:44:09.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:09 smithi174 ceph-mon[34403]: pgmap v374: 97 pgs: 97 active+clean; 1.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 38 KiB/s wr, 26 op/s 2024-09-21T03:44:10.152 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:44:10.396 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:10.692 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:10 smithi084 ceph-mon[30941]: scrub queued for path: / 2024-09-21T03:44:10.692 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:10 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:44:10.692 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:10 smithi084 ceph-mon[30941]: scrub summary: active paths [/] 2024-09-21T03:44:10.692 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:10 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:44:10.692 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:10 smithi084 ceph-mon[30941]: scrub summary: idle 2024-09-21T03:44:10.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:10 smithi174 ceph-mon[34403]: scrub queued for path: / 2024-09-21T03:44:10.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:10 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:44:10.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:10 smithi174 ceph-mon[34403]: scrub summary: active paths [/] 2024-09-21T03:44:10.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:10 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:44:10.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:10 smithi174 ceph-mon[34403]: scrub summary: idle 2024-09-21T03:44:10.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:10 smithi172 ceph-mon[34821]: scrub queued for path: / 2024-09-21T03:44:10.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:10 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:44:10.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:10 smithi172 ceph-mon[34821]: scrub summary: active paths [/] 2024-09-21T03:44:10.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:10 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:44:10.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:10 smithi172 ceph-mon[34821]: scrub summary: idle 2024-09-21T03:44:10.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.932+0000 7efdd348a640 1 -- 172.21.15.84:0/2778735671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdcc108d10 msgr2=0x7efdcc10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:10.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.932+0000 7efdd348a640 1 --2- 172.21.15.84:0/2778735671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdcc108d10 0x7efdcc10f540 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009ca0 tx=0x7efdc402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.932+0000 7efdd348a640 1 -- 172.21.15.84:0/2778735671 shutdown_connections 2024-09-21T03:44:10.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.932+0000 7efdd348a640 1 --2- 172.21.15.84:0/2778735671 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdcc108d10 0x7efdcc10f540 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.932+0000 7efdd348a640 1 --2- 172.21.15.84:0/2778735671 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdcc1083c0 0x7efdcc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.932+0000 7efdd348a640 1 --2- 172.21.15.84:0/2778735671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdcc102a80 0x7efdcc102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.932+0000 7efdd348a640 1 -- 172.21.15.84:0/2778735671 >> 172.21.15.84:0/2778735671 conn(0x7efdcc079740 msgr2=0x7efdcc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:10.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.932+0000 7efdd348a640 1 -- 172.21.15.84:0/2778735671 shutdown_connections 2024-09-21T03:44:10.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.932+0000 7efdd348a640 1 -- 172.21.15.84:0/2778735671 wait complete. 2024-09-21T03:44:10.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.933+0000 7efdd348a640 1 Processor -- start 2024-09-21T03:44:10.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.933+0000 7efdd348a640 1 -- start start 2024-09-21T03:44:10.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.933+0000 7efdd348a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdcc102a80 0x7efdcc199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.933+0000 7efdd348a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdcc1083c0 0x7efdcc1998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.933+0000 7efdd348a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdcc108d10 0x7efdcc19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.933+0000 7efdd348a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc112980 con 0x7efdcc1083c0 2024-09-21T03:44:10.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.933+0000 7efdd348a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc112800 con 0x7efdcc108d10 2024-09-21T03:44:10.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.933+0000 7efdd348a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc112b00 con 0x7efdcc102a80 2024-09-21T03:44:10.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.933+0000 7efdd0a25640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdcc1083c0 0x7efdcc1998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.933+0000 7efdd0a25640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdcc1083c0 0x7efdcc1998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42292/0 (socket says 172.21.15.84:42292) 2024-09-21T03:44:10.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.933+0000 7efdd0a25640 1 -- 172.21.15.84:0/446568544 learned_addr learned my addr 172.21.15.84:0/446568544 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:10.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.933+0000 7efdd1a27640 1 --2- 172.21.15.84:0/446568544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdcc108d10 0x7efdcc19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.933+0000 7efdd1226640 1 --2- 172.21.15.84:0/446568544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdcc102a80 0x7efdcc199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.933+0000 7efdd0a25640 1 -- 172.21.15.84:0/446568544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdcc102a80 msgr2=0x7efdcc199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:10.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.933+0000 7efdd0a25640 1 --2- 172.21.15.84:0/446568544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdcc102a80 0x7efdcc199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.933+0000 7efdd0a25640 1 -- 172.21.15.84:0/446568544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdcc108d10 msgr2=0x7efdcc19eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:10.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.933+0000 7efdd0a25640 1 --2- 172.21.15.84:0/446568544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdcc108d10 0x7efdcc19eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.933+0000 7efdd0a25640 1 -- 172.21.15.84:0/446568544 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdcc19f2c0 con 0x7efdcc1083c0 2024-09-21T03:44:10.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.933+0000 7efdd1a27640 1 --2- 172.21.15.84:0/446568544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdcc108d10 0x7efdcc19eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:10.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.934+0000 7efdd0a25640 1 --2- 172.21.15.84:0/446568544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdcc1083c0 0x7efdcc1998f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7efdc000d740 tx=0x7efdc000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:10.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.934+0000 7efdca7fc640 1 -- 172.21.15.84:0/446568544 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc0017070 con 0x7efdcc1083c0 2024-09-21T03:44:10.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.934+0000 7efdd348a640 1 -- 172.21.15.84:0/446568544 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdcc19f5b0 con 0x7efdcc1083c0 2024-09-21T03:44:10.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.934+0000 7efdca7fc640 1 -- 172.21.15.84:0/446568544 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdc000de50 con 0x7efdcc1083c0 2024-09-21T03:44:10.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.934+0000 7efdca7fc640 1 -- 172.21.15.84:0/446568544 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc0004ce0 con 0x7efdcc1083c0 2024-09-21T03:44:10.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.934+0000 7efdd348a640 1 -- 172.21.15.84:0/446568544 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdcc1a5d10 con 0x7efdcc1083c0 2024-09-21T03:44:10.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.936+0000 7efdd99fe740 1 Processor -- start 2024-09-21T03:44:10.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.937+0000 7efdd99fe740 1 -- start start 2024-09-21T03:44:10.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.937+0000 7efdca7fc640 1 -- 172.21.15.84:0/446568544 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7efdc0010460 con 0x7efdcc1083c0 2024-09-21T03:44:10.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.937+0000 7efdd99fe740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c460070 0x55e04c807650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.937+0000 7efdd99fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c4371b0 0x55e04c807b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.937+0000 7efdd99fe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c43f390 0x55e04c8080d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.937+0000 7efdd99fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e04c77de50 con 0x55e04c4371b0 2024-09-21T03:44:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.937+0000 7efdd99fe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e04c76d280 con 0x55e04c43f390 2024-09-21T03:44:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.937+0000 7efdd99fe740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e04c771090 con 0x55e04c460070 2024-09-21T03:44:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.937+0000 7efdd1226640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c4371b0 0x55e04c807b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.937+0000 7efdd1226640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c4371b0 0x55e04c807b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42302/0 (socket says 172.21.15.84:42302) 2024-09-21T03:44:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.937+0000 7efdd1226640 1 -- 172.21.15.84:0/3654777069 learned_addr learned my addr 172.21.15.84:0/3654777069 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.937+0000 7efdd1a27640 1 --2- 172.21.15.84:0/3654777069 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c460070 0x55e04c807650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.937+0000 7efdd0a25640 1 --2- 172.21.15.84:0/3654777069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c43f390 0x55e04c8080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.937+0000 7efdd1226640 1 -- 172.21.15.84:0/3654777069 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c460070 msgr2=0x55e04c807650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.937+0000 7efdd1226640 1 --2- 172.21.15.84:0/3654777069 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c460070 0x55e04c807650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.937+0000 7efdd1226640 1 -- 172.21.15.84:0/3654777069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c43f390 msgr2=0x55e04c8080d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:10.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.937+0000 7efdd1226640 1 --2- 172.21.15.84:0/3654777069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c43f390 0x55e04c8080d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.937+0000 7efdd1226640 1 -- 172.21.15.84:0/3654777069 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e04c4cb650 con 0x55e04c4371b0 2024-09-21T03:44:10.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.937+0000 7efdd0a25640 1 --2- 172.21.15.84:0/3654777069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c43f390 0x55e04c8080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:10.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.938+0000 7efdd1226640 1 --2- 172.21.15.84:0/3654777069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c4371b0 0x55e04c807b90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00cbf0 tx=0x7efdbc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20776e7c80104a17 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:10.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.938+0000 7efdb37fe640 1 -- 172.21.15.84:0/3654777069 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdbc010630 con 0x55e04c4371b0 2024-09-21T03:44:10.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.938+0000 7efdb37fe640 1 -- 172.21.15.84:0/3654777069 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdbc010c80 con 0x55e04c4371b0 2024-09-21T03:44:10.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.938+0000 7efdb37fe640 1 -- 172.21.15.84:0/3654777069 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdbc019b40 con 0x55e04c4371b0 2024-09-21T03:44:10.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.938+0000 7efdca7fc640 1 --2- 172.21.15.84:0/446568544 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efdb40b6680 0x7efdb40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.938+0000 7efdd1a27640 1 --2- 172.21.15.84:0/446568544 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efdb40b6680 0x7efdb40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.938+0000 7efdca7fc640 1 -- 172.21.15.84:0/446568544 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7efdc00e7170 con 0x7efdcc1083c0 2024-09-21T03:44:10.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.939+0000 7efdd99fe740 1 -- 172.21.15.84:0/3654777069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c4371b0 msgr2=0x55e04c807b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:10.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.939+0000 7efdd1a27640 1 --2- 172.21.15.84:0/446568544 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efdb40b6680 0x7efdb40b8b90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efdc4005cc0 tx=0x7efdc4005c30 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:10.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.939+0000 7efdd99fe740 1 --2- 172.21.15.84:0/3654777069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c4371b0 0x55e04c807b90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00cbf0 tx=0x7efdbc00e720 comp rx=0 tx=0).stop 2024-09-21T03:44:10.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.939+0000 7efdd99fe740 1 -- 172.21.15.84:0/3654777069 shutdown_connections 2024-09-21T03:44:10.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.939+0000 7efdd99fe740 1 --2- 172.21.15.84:0/3654777069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c43f390 0x55e04c8080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.939+0000 7efdd99fe740 1 --2- 172.21.15.84:0/3654777069 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c4371b0 0x55e04c807b90 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.939+0000 7efdd99fe740 1 --2- 172.21.15.84:0/3654777069 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c460070 0x55e04c807650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.939+0000 7efdd99fe740 1 -- 172.21.15.84:0/3654777069 >> 172.21.15.84:0/3654777069 conn(0x55e04c454460 msgr2=0x55e04c805540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:10.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.939+0000 7efdd99fe740 1 -- 172.21.15.84:0/3654777069 shutdown_connections 2024-09-21T03:44:10.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.939+0000 7efdd99fe740 1 -- 172.21.15.84:0/3654777069 wait complete. 2024-09-21T03:44:10.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.939+0000 7efdd99fe740 1 -- start start 2024-09-21T03:44:10.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.939+0000 7efdd99fe740 1 Processor -- start 2024-09-21T03:44:10.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.940+0000 7efdd99fe740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c4371b0 0x55e04c814f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.940+0000 7efdd99fe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c43f390 0x55e04c815460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.940+0000 7efdd99fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c460070 0x55e04c8212c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.940+0000 7efdd99fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e04c5ce700 con 0x55e04c460070 2024-09-21T03:44:10.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.940+0000 7efdd99fe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e04c708110 con 0x55e04c43f390 2024-09-21T03:44:10.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.940+0000 7efdd99fe740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e04c817f90 con 0x55e04c4371b0 2024-09-21T03:44:10.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.940+0000 7efdd99fe740 10 client.0 _ll_register_callbacks cb 0x55e04c721990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:10.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.940+0000 7efdd1a27640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c460070 0x55e04c8212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.940+0000 7efdd1a27640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c460070 0x55e04c8212c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42308/0 (socket says 172.21.15.84:42308) 2024-09-21T03:44:10.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.940+0000 7efdd1a27640 1 -- 172.21.15.84:0/3324380630 learned_addr learned my addr 172.21.15.84:0/3324380630 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:10.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.940+0000 7efdd1226640 1 --2- 172.21.15.84:0/3324380630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c4371b0 0x55e04c814f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.940+0000 7efdd0a25640 1 --2- 172.21.15.84:0/3324380630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c43f390 0x55e04c815460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.940+0000 7efdd1a27640 1 -- 172.21.15.84:0/3324380630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c4371b0 msgr2=0x55e04c814f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:10.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.940+0000 7efdd1a27640 1 --2- 172.21.15.84:0/3324380630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c4371b0 0x55e04c814f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.940+0000 7efdd1a27640 1 -- 172.21.15.84:0/3324380630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c43f390 msgr2=0x55e04c815460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:10.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.940+0000 7efdd1a27640 1 --2- 172.21.15.84:0/3324380630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c43f390 0x55e04c815460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.940+0000 7efdd1a27640 1 -- 172.21.15.84:0/3324380630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e04c735c40 con 0x55e04c460070 2024-09-21T03:44:10.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.940+0000 7efdd1a27640 1 --2- 172.21.15.84:0/3324380630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c460070 0x55e04c8212c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7efdc4035000 tx=0x7efdc402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a8eeb01cfa0ef7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:10.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.940+0000 7efdb0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:10.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.941+0000 7efdb0ff9640 1 -- 172.21.15.84:0/3324380630 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc4003d80 con 0x55e04c460070 2024-09-21T03:44:10.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.941+0000 7efdb0ff9640 1 -- 172.21.15.84:0/3324380630 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7efdc4004040 con 0x55e04c460070 2024-09-21T03:44:10.950 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.941+0000 7efdd99fe740 1 -- 172.21.15.84:0/3324380630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdbc010c80 con 0x55e04c460070 2024-09-21T03:44:10.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.941+0000 7efdb0ff9640 1 -- 172.21.15.84:0/3324380630 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efdc4004240 con 0x55e04c460070 2024-09-21T03:44:10.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.941+0000 7efdd99fe740 10 client.15837 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:10.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.941+0000 7efdd99fe740 1 -- 172.21.15.84:0/3324380630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e04c80d980 con 0x55e04c460070 2024-09-21T03:44:10.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.941+0000 7efdb0ff9640 1 -- 172.21.15.84:0/3324380630 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdbc010c80 con 0x55e04c460070 2024-09-21T03:44:10.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.941+0000 7efdb0ff9640 1 -- 172.21.15.84:0/3324380630 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efdc4051070 con 0x55e04c460070 2024-09-21T03:44:10.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.941+0000 7efdd99fe740 10 client.15837 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:10.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.941+0000 7efdd99fe740 10 client.15837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:44:10.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.941+0000 7efdd99fe740 20 client.15837 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:10.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.941+0000 7efdd99fe740 1 --2- 172.21.15.84:0/3324380630 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55e04c41e9f0 0x55e04c80eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.941+0000 7efdd99fe740 4 client.15837 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:44:10.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.941+0000 7efdd99fe740 1 -- 172.21.15.84:0/3324380630 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e04c77fda0 con 0x55e04c41e9f0 2024-09-21T03:44:10.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.942+0000 7efdd1226640 1 --2- 172.21.15.84:0/3324380630 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55e04c41e9f0 0x55e04c80eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.942+0000 7efdd1226640 1 --2- 172.21.15.84:0/3324380630 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55e04c41e9f0 0x55e04c80eec0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9720e47d84a78c2 server_cookie=604acfc51df388f6 in_seq=0 out_seq=0 2024-09-21T03:44:10.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.942+0000 7efdb0ff9640 10 client.15837 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:10.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.943+0000 7efdb0ff9640 1 -- 172.21.15.84:0/3324380630 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e04c77fda0 con 0x55e04c41e9f0 2024-09-21T03:44:10.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.943+0000 7efdb0ff9640 10 client.15837 handle_command_reply: tid=0 2024-09-21T03:44:10.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.943+0000 7efdd99fe740 1 client.15837 shutdown 2024-09-21T03:44:10.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.943+0000 7efdd99fe740 1 -- 172.21.15.84:0/3324380630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c460070 msgr2=0x55e04c8212c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:10.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.943+0000 7efdd99fe740 1 --2- 172.21.15.84:0/3324380630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c460070 0x55e04c8212c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7efdc4035000 tx=0x7efdc402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.943+0000 7efdd99fe740 1 -- 172.21.15.84:0/3324380630 shutdown_connections 2024-09-21T03:44:10.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.943+0000 7efdd99fe740 1 --2- 172.21.15.84:0/3324380630 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55e04c41e9f0 0x55e04c80eec0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.943+0000 7efdb0ff9640 0 client.15837 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:10.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.943+0000 7efdd99fe740 1 --2- 172.21.15.84:0/3324380630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c460070 0x55e04c8212c0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.943+0000 7efdd99fe740 1 --2- 172.21.15.84:0/3324380630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c43f390 0x55e04c815460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.943+0000 7efdd99fe740 1 --2- 172.21.15.84:0/3324380630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c4371b0 0x55e04c814f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.943+0000 7efdd99fe740 1 -- 172.21.15.84:0/3324380630 >> 172.21.15.84:0/3324380630 conn(0x55e04c454460 msgr2=0x55e04c809040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:10.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.943+0000 7efdd99fe740 1 -- 172.21.15.84:0/3324380630 shutdown_connections 2024-09-21T03:44:10.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.943+0000 7efdd99fe740 1 -- 172.21.15.84:0/3324380630 wait complete. 2024-09-21T03:44:10.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.944+0000 7efdd99fe740 20 client.15837 trim_cache size 0 max 16384 2024-09-21T03:44:10.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.961+0000 7efdd99fe740 1 Processor -- start 2024-09-21T03:44:10.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.961+0000 7efdd99fe740 1 -- start start 2024-09-21T03:44:10.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.961+0000 7efdd99fe740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c41e9f0 0x55e04c821230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.961+0000 7efdd99fe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c4371b0 0x55e04c814cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.961+0000 7efdd99fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c43f390 0x55e04c815210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.961+0000 7efdd99fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc1afc00 con 0x55e04c43f390 2024-09-21T03:44:10.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.961+0000 7efdd99fe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc1ad4d0 con 0x55e04c4371b0 2024-09-21T03:44:10.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.961+0000 7efdd99fe740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc1ab320 con 0x55e04c41e9f0 2024-09-21T03:44:10.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.961+0000 7efdd1a27640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c43f390 0x55e04c815210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.961+0000 7efdd1a27640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c43f390 0x55e04c815210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42322/0 (socket says 172.21.15.84:42322) 2024-09-21T03:44:10.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.961+0000 7efdd1a27640 1 -- 172.21.15.84:0/3642127355 learned_addr learned my addr 172.21.15.84:0/3642127355 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:10.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.961+0000 7efdd1226640 1 --2- 172.21.15.84:0/3642127355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c41e9f0 0x55e04c821230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.961+0000 7efdd0a25640 1 --2- 172.21.15.84:0/3642127355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c4371b0 0x55e04c814cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.962+0000 7efdd1a27640 1 -- 172.21.15.84:0/3642127355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c41e9f0 msgr2=0x55e04c821230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:10.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.962+0000 7efdd1a27640 1 --2- 172.21.15.84:0/3642127355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c41e9f0 0x55e04c821230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.962+0000 7efdd1a27640 1 -- 172.21.15.84:0/3642127355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c4371b0 msgr2=0x55e04c814cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:10.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.962+0000 7efdd1a27640 1 --2- 172.21.15.84:0/3642127355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c4371b0 0x55e04c814cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.962+0000 7efdd1a27640 1 -- 172.21.15.84:0/3642127355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e04c80d7b0 con 0x55e04c43f390 2024-09-21T03:44:10.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.962+0000 7efdd1a27640 1 --2- 172.21.15.84:0/3642127355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c43f390 0x55e04c815210 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7efdc4006010 tx=0x7efdc40041d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf5ecd22d48fa57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:10.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.962+0000 7efdb2ffd640 1 -- 172.21.15.84:0/3642127355 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc4060070 con 0x55e04c43f390 2024-09-21T03:44:10.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.962+0000 7efdb2ffd640 1 -- 172.21.15.84:0/3642127355 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdc4036040 con 0x55e04c43f390 2024-09-21T03:44:10.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.962+0000 7efdb2ffd640 1 -- 172.21.15.84:0/3642127355 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc402f660 con 0x55e04c43f390 2024-09-21T03:44:10.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.963+0000 7efdd99fe740 1 -- 172.21.15.84:0/3642127355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c43f390 msgr2=0x55e04c815210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:10.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.963+0000 7efdd99fe740 1 --2- 172.21.15.84:0/3642127355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c43f390 0x55e04c815210 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7efdc4006010 tx=0x7efdc40041d0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.963+0000 7efdd99fe740 1 -- 172.21.15.84:0/3642127355 shutdown_connections 2024-09-21T03:44:10.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.963+0000 7efdd99fe740 1 --2- 172.21.15.84:0/3642127355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c43f390 0x55e04c815210 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.963+0000 7efdd99fe740 1 --2- 172.21.15.84:0/3642127355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c4371b0 0x55e04c814cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.963+0000 7efdd99fe740 1 --2- 172.21.15.84:0/3642127355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c41e9f0 0x55e04c821230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.963+0000 7efdd99fe740 1 -- 172.21.15.84:0/3642127355 >> 172.21.15.84:0/3642127355 conn(0x55e04c454460 msgr2=0x55e04c8137a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:10.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.963+0000 7efdd99fe740 1 -- 172.21.15.84:0/3642127355 shutdown_connections 2024-09-21T03:44:10.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.963+0000 7efdd99fe740 1 -- 172.21.15.84:0/3642127355 wait complete. 2024-09-21T03:44:10.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.963+0000 7efdd99fe740 1 -- start start 2024-09-21T03:44:10.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.963+0000 7efdd99fe740 1 Processor -- start 2024-09-21T03:44:10.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.964+0000 7efdd99fe740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c41e9f0 0x55e04c826f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.964+0000 7efdd99fe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c4371b0 0x55e04c827480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.964+0000 7efdd99fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c43f390 0x55e04c88ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.964+0000 7efdd99fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc1ab990 con 0x55e04c43f390 2024-09-21T03:44:10.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.964+0000 7efdd99fe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc1ace00 con 0x55e04c4371b0 2024-09-21T03:44:10.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.964+0000 7efdd99fe740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc1ac060 con 0x55e04c41e9f0 2024-09-21T03:44:10.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.964+0000 7efdd99fe740 10 client.0 _ll_register_callbacks cb 0x7efdc402f330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:10.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.964+0000 7efdd1a27640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c43f390 0x55e04c88ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.964+0000 7efdd1a27640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c43f390 0x55e04c88ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42326/0 (socket says 172.21.15.84:42326) 2024-09-21T03:44:10.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.964+0000 7efdd1a27640 1 -- 172.21.15.84:0/1085073204 learned_addr learned my addr 172.21.15.84:0/1085073204 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:10.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.964+0000 7efdd0a25640 1 --2- 172.21.15.84:0/1085073204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c4371b0 0x55e04c827480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.964+0000 7efdd1226640 1 --2- 172.21.15.84:0/1085073204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c41e9f0 0x55e04c826f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.964+0000 7efdd1a27640 1 -- 172.21.15.84:0/1085073204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c41e9f0 msgr2=0x55e04c826f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:10.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.964+0000 7efdd1a27640 1 --2- 172.21.15.84:0/1085073204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c41e9f0 0x55e04c826f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.964+0000 7efdd1a27640 1 -- 172.21.15.84:0/1085073204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c4371b0 msgr2=0x55e04c827480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:10.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.964+0000 7efdd1a27640 1 --2- 172.21.15.84:0/1085073204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c4371b0 0x55e04c827480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.964+0000 7efdd1a27640 1 -- 172.21.15.84:0/1085073204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e04c827d50 con 0x55e04c43f390 2024-09-21T03:44:10.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.964+0000 7efdd1226640 1 --2- 172.21.15.84:0/1085073204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c41e9f0 0x55e04c826f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:10.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.965+0000 7efdd0a25640 1 --2- 172.21.15.84:0/1085073204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c4371b0 0x55e04c827480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:44:10.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.965+0000 7efdd1a27640 1 --2- 172.21.15.84:0/1085073204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c43f390 0x55e04c88ef00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7efdc40045c0 tx=0x7efdc4004010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=effe8d27a1d3cc3a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:10.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.965+0000 7efdb0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:10.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.965+0000 7efdb0ff9640 1 -- 172.21.15.84:0/1085073204 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc4060040 con 0x55e04c43f390 2024-09-21T03:44:10.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.965+0000 7efdb0ff9640 1 -- 172.21.15.84:0/1085073204 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7efdc402f660 con 0x55e04c43f390 2024-09-21T03:44:10.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.965+0000 7efdd99fe740 1 -- 172.21.15.84:0/1085073204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdc4036040 con 0x55e04c43f390 2024-09-21T03:44:10.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.965+0000 7efdb0ff9640 1 -- 172.21.15.84:0/1085073204 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efdc402fed0 con 0x55e04c43f390 2024-09-21T03:44:10.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.965+0000 7efdd99fe740 10 client.15843 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:10.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.965+0000 7efdd99fe740 1 -- 172.21.15.84:0/1085073204 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e04c8904d0 con 0x55e04c43f390 2024-09-21T03:44:10.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.965+0000 7efdb0ff9640 1 -- 172.21.15.84:0/1085073204 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdc4036040 con 0x55e04c43f390 2024-09-21T03:44:10.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.965+0000 7efdb0ff9640 1 -- 172.21.15.84:0/1085073204 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efdc4051070 con 0x55e04c43f390 2024-09-21T03:44:10.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.966+0000 7efdd99fe740 10 client.15843 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:10.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.966+0000 7efdd99fe740 10 client.15843 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:44:10.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.966+0000 7efdd99fe740 20 client.15843 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:10.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.966+0000 7efdd99fe740 1 --2- 172.21.15.84:0/1085073204 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55e04c460070 0x55e04c892b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.966+0000 7efdd99fe740 4 client.15843 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:44:10.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.966+0000 7efdd99fe740 1 -- 172.21.15.84:0/1085073204 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e04c77b850 con 0x55e04c460070 2024-09-21T03:44:10.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.966+0000 7efdd1226640 1 --2- 172.21.15.84:0/1085073204 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55e04c460070 0x55e04c892b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.966+0000 7efdb0ff9640 10 client.15843 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:10.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.966+0000 7efdd1226640 1 --2- 172.21.15.84:0/1085073204 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55e04c460070 0x55e04c892b20 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9063f448e3111de server_cookie=4362f2ec1cea47f0 in_seq=0 out_seq=0 2024-09-21T03:44:10.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.966+0000 7efdb0ff9640 1 -- 172.21.15.84:0/1085073204 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x55e04c77b850 con 0x55e04c460070 2024-09-21T03:44:10.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.966+0000 7efdb0ff9640 10 client.15843 handle_command_reply: tid=0 2024-09-21T03:44:10.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.966+0000 7efdd99fe740 1 client.15843 shutdown 2024-09-21T03:44:10.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.967+0000 7efdd99fe740 1 -- 172.21.15.84:0/1085073204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c43f390 msgr2=0x55e04c88ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:10.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.967+0000 7efdd99fe740 1 --2- 172.21.15.84:0/1085073204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c43f390 0x55e04c88ef00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7efdc40045c0 tx=0x7efdc4004010 comp rx=0 tx=0).stop 2024-09-21T03:44:10.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.967+0000 7efdd99fe740 1 -- 172.21.15.84:0/1085073204 shutdown_connections 2024-09-21T03:44:10.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.967+0000 7efdd99fe740 1 --2- 172.21.15.84:0/1085073204 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55e04c460070 0x55e04c892b20 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.967+0000 7efdd99fe740 1 --2- 172.21.15.84:0/1085073204 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e04c43f390 0x55e04c88ef00 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.967+0000 7efdb0ff9640 0 client.15843 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:10.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.967+0000 7efdd99fe740 1 --2- 172.21.15.84:0/1085073204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e04c4371b0 0x55e04c827480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.967+0000 7efdd99fe740 1 --2- 172.21.15.84:0/1085073204 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e04c41e9f0 0x55e04c826f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.967+0000 7efdd99fe740 1 -- 172.21.15.84:0/1085073204 >> 172.21.15.84:0/1085073204 conn(0x55e04c454460 msgr2=0x55e04c814cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:10.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.967+0000 7efdd99fe740 1 -- 172.21.15.84:0/1085073204 shutdown_connections 2024-09-21T03:44:10.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.967+0000 7efdd99fe740 1 -- 172.21.15.84:0/1085073204 wait complete. 2024-09-21T03:44:10.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.967+0000 7efdd99fe740 20 client.15843 trim_cache size 0 max 16384 2024-09-21T03:44:10.975 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:44:10.975 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T03:44:10.975 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T03:44:10.975 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:44:10.975 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:44:10.975 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:44:10.975 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:44:10.975 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:44:10.976 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:44:10.976 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:44:10.976 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:44:10.976 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:44:10.976 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:44:10.976 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:44:10.976 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:44:10.976 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:44:10.976 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:44:10.976 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:44:10.976 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:44:10.977 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:44:10.977 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:44:10.977 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:44:10.977 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:44:10.977 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:44:10.977 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:44:10.977 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:44:10.977 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:44:10.977 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:44:10.977 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:44:10.977 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:44:10.978 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:44:10.978 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:44:10.978 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:44:10.978 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:44:10.978 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:44:10.978 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:44:10.978 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:44:10.978 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:44:10.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.968+0000 7efdd348a640 1 -- 172.21.15.84:0/446568544 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efdb40b6680 msgr2=0x7efdb40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:10.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.968+0000 7efdd348a640 1 --2- 172.21.15.84:0/446568544 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efdb40b6680 0x7efdb40b8b90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efdc4005cc0 tx=0x7efdc4005c30 comp rx=0 tx=0).stop 2024-09-21T03:44:10.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.968+0000 7efdd348a640 1 -- 172.21.15.84:0/446568544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdcc1083c0 msgr2=0x7efdcc1998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:10.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.968+0000 7efdd348a640 1 --2- 172.21.15.84:0/446568544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdcc1083c0 0x7efdcc1998f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7efdc000d740 tx=0x7efdc000dc00 comp rx=0 tx=0).stop 2024-09-21T03:44:10.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.968+0000 7efdd348a640 1 -- 172.21.15.84:0/446568544 shutdown_connections 2024-09-21T03:44:10.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.968+0000 7efdd348a640 1 --2- 172.21.15.84:0/446568544 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7efdb40b6680 0x7efdb40b8b90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.968+0000 7efdd348a640 1 --2- 172.21.15.84:0/446568544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdcc108d10 0x7efdcc19eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.968+0000 7efdd348a640 1 --2- 172.21.15.84:0/446568544 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7efdcc1083c0 0x7efdcc1998f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.968+0000 7efdd348a640 1 --2- 172.21.15.84:0/446568544 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdcc102a80 0x7efdcc199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.968+0000 7efdd348a640 1 -- 172.21.15.84:0/446568544 >> 172.21.15.84:0/446568544 conn(0x7efdcc079740 msgr2=0x7efdcc1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:10.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.968+0000 7efdd348a640 1 -- 172.21.15.84:0/446568544 shutdown_connections 2024-09-21T03:44:10.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:10.968+0000 7efdd348a640 1 -- 172.21.15.84:0/446568544 wait complete. 2024-09-21T03:44:11.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:11 smithi084 ceph-mon[30941]: pgmap v375: 97 pgs: 97 active+clean; 1.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-09-21T03:44:11.692 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:44:11.693 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:44:11.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:11 smithi174 ceph-mon[34403]: pgmap v375: 97 pgs: 97 active+clean; 1.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-09-21T03:44:11.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:11 smithi172 ceph-mon[34821]: pgmap v375: 97 pgs: 97 active+clean; 1.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-09-21T03:44:11.937 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:12.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.430+0000 7fe1aed51640 1 -- 172.21.15.84:0/3424210151 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a8102090 msgr2=0x7fe1a81024a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:12.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.430+0000 7fe1aed51640 1 --2- 172.21.15.84:0/3424210151 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a8102090 0x7fe1a81024a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009900 tx=0x7fe1a402a410 comp rx=0 tx=0).stop 2024-09-21T03:44:12.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.430+0000 7fe1aed51640 1 -- 172.21.15.84:0/3424210151 shutdown_connections 2024-09-21T03:44:12.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.430+0000 7fe1aed51640 1 --2- 172.21.15.84:0/3424210151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a8109e30 0x7fe1a8110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.430+0000 7fe1aed51640 1 --2- 172.21.15.84:0/3424210151 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1a81094e0 0x7fe1a81098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.430+0000 7fe1aed51640 1 --2- 172.21.15.84:0/3424210151 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a8102090 0x7fe1a81024a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.430+0000 7fe1aed51640 1 -- 172.21.15.84:0/3424210151 >> 172.21.15.84:0/3424210151 conn(0x7fe1a8079e30 msgr2=0x7fe1a807a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:12.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.430+0000 7fe1aed51640 1 -- 172.21.15.84:0/3424210151 shutdown_connections 2024-09-21T03:44:12.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.430+0000 7fe1aed51640 1 -- 172.21.15.84:0/3424210151 wait complete. 2024-09-21T03:44:12.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.431+0000 7fe1aed51640 1 Processor -- start 2024-09-21T03:44:12.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.431+0000 7fe1aed51640 1 -- start start 2024-09-21T03:44:12.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.431+0000 7fe1aed51640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a8102090 0x7fe1a819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.431+0000 7fe1aed51640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1a81094e0 0x7fe1a819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.431+0000 7fe1aed51640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a8109e30 0x7fe1a819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.431+0000 7fe1aed51640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a8113b50 con 0x7fe1a8109e30 2024-09-21T03:44:12.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.431+0000 7fe1aed51640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a81139d0 con 0x7fe1a8102090 2024-09-21T03:44:12.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.431+0000 7fe1aed51640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a8113cd0 con 0x7fe1a81094e0 2024-09-21T03:44:12.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.431+0000 7fe1ad2ee640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a8109e30 0x7fe1a819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.431+0000 7fe1ad2ee640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a8109e30 0x7fe1a819fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42342/0 (socket says 172.21.15.84:42342) 2024-09-21T03:44:12.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.431+0000 7fe1ad2ee640 1 -- 172.21.15.84:0/4012949242 learned_addr learned my addr 172.21.15.84:0/4012949242 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:12.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.431+0000 7fe1acaed640 1 --2- 172.21.15.84:0/4012949242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a8102090 0x7fe1a819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.431+0000 7fe19ffff640 1 --2- 172.21.15.84:0/4012949242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1a81094e0 0x7fe1a819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.432+0000 7fe1ad2ee640 1 -- 172.21.15.84:0/4012949242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1a81094e0 msgr2=0x7fe1a819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:12.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.432+0000 7fe1ad2ee640 1 --2- 172.21.15.84:0/4012949242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1a81094e0 0x7fe1a819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.432+0000 7fe1ad2ee640 1 -- 172.21.15.84:0/4012949242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a8102090 msgr2=0x7fe1a819a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:12.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.432+0000 7fe1ad2ee640 1 --2- 172.21.15.84:0/4012949242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a8102090 0x7fe1a819a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.432+0000 7fe1ad2ee640 1 -- 172.21.15.84:0/4012949242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a81a04d0 con 0x7fe1a8109e30 2024-09-21T03:44:12.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.432+0000 7fe1ad2ee640 1 --2- 172.21.15.84:0/4012949242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a8109e30 0x7fe1a819fda0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000b970 tx=0x7fe1a000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:12.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.432+0000 7fe19dffb640 1 -- 172.21.15.84:0/4012949242 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0019070 con 0x7fe1a8109e30 2024-09-21T03:44:12.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.432+0000 7fe19dffb640 1 -- 172.21.15.84:0/4012949242 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1a0014440 con 0x7fe1a8109e30 2024-09-21T03:44:12.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.432+0000 7fe1aed51640 1 -- 172.21.15.84:0/4012949242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a81a07c0 con 0x7fe1a8109e30 2024-09-21T03:44:12.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.432+0000 7fe19dffb640 1 -- 172.21.15.84:0/4012949242 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a00075d0 con 0x7fe1a8109e30 2024-09-21T03:44:12.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.432+0000 7fe1aed51640 1 -- 172.21.15.84:0/4012949242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a81a6f20 con 0x7fe1a8109e30 2024-09-21T03:44:12.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.433+0000 7fe1aed51640 1 -- 172.21.15.84:0/4012949242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a81024a0 con 0x7fe1a8109e30 2024-09-21T03:44:12.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.435+0000 7fe19dffb640 1 -- 172.21.15.84:0/4012949242 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fe1a001c070 con 0x7fe1a8109e30 2024-09-21T03:44:12.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.435+0000 7fe19dffb640 1 --2- 172.21.15.84:0/4012949242 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe1900b6680 0x7fe1900b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.436+0000 7fe1acaed640 1 --2- 172.21.15.84:0/4012949242 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe1900b6680 0x7fe1900b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.436+0000 7fe19dffb640 1 -- 172.21.15.84:0/4012949242 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe1a00e6ff0 con 0x7fe1a8109e30 2024-09-21T03:44:12.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.436+0000 7fe1acaed640 1 --2- 172.21.15.84:0/4012949242 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe1900b6680 0x7fe1900b8b90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4031440 tx=0x7fe1a4005e80 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:12.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.439+0000 7fe19dffb640 1 -- 172.21.15.84:0/4012949242 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe1a00b19a0 con 0x7fe1a8109e30 2024-09-21T03:44:12.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.650+0000 7fe1aed51640 1 -- 172.21.15.84:0/4012949242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1a819b690 con 0x7fe1a8109e30 2024-09-21T03:44:12.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.651+0000 7fe19dffb640 1 -- 172.21.15.84:0/4012949242 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7fe1a819b690 con 0x7fe1a8109e30 2024-09-21T03:44:12.653 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:44:12.653 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:44:12.654 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:44:12.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.653+0000 7fe1aed51640 1 -- 172.21.15.84:0/4012949242 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe1900b6680 msgr2=0x7fe1900b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:12.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.653+0000 7fe1aed51640 1 --2- 172.21.15.84:0/4012949242 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe1900b6680 0x7fe1900b8b90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4031440 tx=0x7fe1a4005e80 comp rx=0 tx=0).stop 2024-09-21T03:44:12.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.653+0000 7fe1aed51640 1 -- 172.21.15.84:0/4012949242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a8109e30 msgr2=0x7fe1a819fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:12.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.653+0000 7fe1aed51640 1 --2- 172.21.15.84:0/4012949242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a8109e30 0x7fe1a819fda0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000b970 tx=0x7fe1a000be30 comp rx=0 tx=0).stop 2024-09-21T03:44:12.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.654+0000 7fe1aed51640 1 -- 172.21.15.84:0/4012949242 shutdown_connections 2024-09-21T03:44:12.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.654+0000 7fe1aed51640 1 --2- 172.21.15.84:0/4012949242 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe1900b6680 0x7fe1900b8b90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.654+0000 7fe1aed51640 1 --2- 172.21.15.84:0/4012949242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1a8109e30 0x7fe1a819fda0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.654+0000 7fe1aed51640 1 --2- 172.21.15.84:0/4012949242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1a81094e0 0x7fe1a819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.654+0000 7fe1aed51640 1 --2- 172.21.15.84:0/4012949242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1a8102090 0x7fe1a819a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.654+0000 7fe1aed51640 1 -- 172.21.15.84:0/4012949242 >> 172.21.15.84:0/4012949242 conn(0x7fe1a8079e30 msgr2=0x7fe1a8107570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:12.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.654+0000 7fe1aed51640 1 -- 172.21.15.84:0/4012949242 shutdown_connections 2024-09-21T03:44:12.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:12.654+0000 7fe1aed51640 1 -- 172.21.15.84:0/4012949242 wait complete. 2024-09-21T03:44:13.318 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:44:13.564 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:13.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:13 smithi084 ceph-mon[30941]: pgmap v376: 97 pgs: 97 active+clean; 1.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 39 KiB/s wr, 26 op/s 2024-09-21T03:44:13.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:13 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/4012949242' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:44:13.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:13 smithi174 ceph-mon[34403]: pgmap v376: 97 pgs: 97 active+clean; 1.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 39 KiB/s wr, 26 op/s 2024-09-21T03:44:13.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:13 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/4012949242' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:44:13.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:13 smithi172 ceph-mon[34821]: pgmap v376: 97 pgs: 97 active+clean; 1.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 39 KiB/s wr, 26 op/s 2024-09-21T03:44:13.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:13 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/4012949242' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:44:14.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.074+0000 7f6fa6908640 1 -- 172.21.15.84:0/1768764741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa01083c0 msgr2=0x7f6fa01087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:14.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.074+0000 7f6fa6908640 1 --2- 172.21.15.84:0/1768764741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa01083c0 0x7f6fa01087d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009900 tx=0x7f6f9402a410 comp rx=0 tx=0).stop 2024-09-21T03:44:14.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.074+0000 7f6fa6908640 1 -- 172.21.15.84:0/1768764741 shutdown_connections 2024-09-21T03:44:14.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.074+0000 7f6fa6908640 1 --2- 172.21.15.84:0/1768764741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa0108d10 0x7f6fa010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.074+0000 7f6fa6908640 1 --2- 172.21.15.84:0/1768764741 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa01083c0 0x7f6fa01087d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.074+0000 7f6fa6908640 1 --2- 172.21.15.84:0/1768764741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6fa0102a80 0x7f6fa0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.074+0000 7f6fa6908640 1 -- 172.21.15.84:0/1768764741 >> 172.21.15.84:0/1768764741 conn(0x7f6fa0079740 msgr2=0x7f6fa0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:14.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.074+0000 7f6fa6908640 1 -- 172.21.15.84:0/1768764741 shutdown_connections 2024-09-21T03:44:14.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.074+0000 7f6fa6908640 1 -- 172.21.15.84:0/1768764741 wait complete. 2024-09-21T03:44:14.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.074+0000 7f6fa6908640 1 Processor -- start 2024-09-21T03:44:14.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.074+0000 7f6fa6908640 1 -- start start 2024-09-21T03:44:14.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.075+0000 7f6fa6908640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa0102a80 0x7f6fa019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.075+0000 7f6fa6908640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6fa01083c0 0x7f6fa019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.075+0000 7f6fa6908640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa0108d10 0x7f6fa019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.075+0000 7f6fa6908640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa0113ac0 con 0x7f6fa0108d10 2024-09-21T03:44:14.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.075+0000 7f6fa6908640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa0113940 con 0x7f6fa0102a80 2024-09-21T03:44:14.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.075+0000 7f6fa6908640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa0113c40 con 0x7f6fa01083c0 2024-09-21T03:44:14.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.075+0000 7f6fa4ea5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa0108d10 0x7f6fa019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.075+0000 7f6fa4ea5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa0108d10 0x7f6fa019fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42364/0 (socket says 172.21.15.84:42364) 2024-09-21T03:44:14.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.075+0000 7f6fa4ea5640 1 -- 172.21.15.84:0/975958905 learned_addr learned my addr 172.21.15.84:0/975958905 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:14.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.075+0000 7f6f9ffff640 1 --2- 172.21.15.84:0/975958905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa0102a80 0x7f6fa019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.075+0000 7f6f9f7fe640 1 --2- 172.21.15.84:0/975958905 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6fa01083c0 0x7f6fa019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.075+0000 7f6fa4ea5640 1 -- 172.21.15.84:0/975958905 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6fa01083c0 msgr2=0x7f6fa019aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:14.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.075+0000 7f6fa4ea5640 1 --2- 172.21.15.84:0/975958905 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6fa01083c0 0x7f6fa019aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.075+0000 7f6fa4ea5640 1 -- 172.21.15.84:0/975958905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa0102a80 msgr2=0x7f6fa019a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:14.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.075+0000 7f6fa4ea5640 1 --2- 172.21.15.84:0/975958905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa0102a80 0x7f6fa019a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.075+0000 7f6fa4ea5640 1 -- 172.21.15.84:0/975958905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa01a0380 con 0x7f6fa0108d10 2024-09-21T03:44:14.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.075+0000 7f6f9ffff640 1 --2- 172.21.15.84:0/975958905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa0102a80 0x7f6fa019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:14.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.076+0000 7f6fa4ea5640 1 --2- 172.21.15.84:0/975958905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa0108d10 0x7f6fa019fd10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6f9800b970 tx=0x7f6f9800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:14.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.076+0000 7f6f9d7fa640 1 -- 172.21.15.84:0/975958905 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f98019070 con 0x7f6fa0108d10 2024-09-21T03:44:14.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.076+0000 7f6fa6908640 1 -- 172.21.15.84:0/975958905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa01a0670 con 0x7f6fa0108d10 2024-09-21T03:44:14.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.076+0000 7f6f9d7fa640 1 -- 172.21.15.84:0/975958905 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f98014440 con 0x7f6fa0108d10 2024-09-21T03:44:14.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.076+0000 7f6f9d7fa640 1 -- 172.21.15.84:0/975958905 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f980075d0 con 0x7f6fa0108d10 2024-09-21T03:44:14.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.076+0000 7f6fa6908640 1 -- 172.21.15.84:0/975958905 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa01a6e90 con 0x7f6fa0108d10 2024-09-21T03:44:14.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.079+0000 7f6face7c740 1 Processor -- start 2024-09-21T03:44:14.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.079+0000 7f6f9d7fa640 1 -- 172.21.15.84:0/975958905 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f6f9801c070 con 0x7f6fa0108d10 2024-09-21T03:44:14.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.079+0000 7f6face7c740 1 -- start start 2024-09-21T03:44:14.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.079+0000 7f6face7c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc8f070 0x560a2c0362c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.079+0000 7f6face7c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc661b0 0x560a2c036800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.079+0000 7f6face7c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc6e390 0x560a2c036d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.079+0000 7f6face7c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560a2bfacea0 con 0x560a2bc8f070 2024-09-21T03:44:14.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.079+0000 7f6face7c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560a2bf9c2d0 con 0x560a2bc6e390 2024-09-21T03:44:14.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.079+0000 7f6face7c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560a2bfa00e0 con 0x560a2bc661b0 2024-09-21T03:44:14.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.079+0000 7f6f9f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc8f070 0x560a2c0362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.079+0000 7f6f9f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc8f070 0x560a2c0362c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42366/0 (socket says 172.21.15.84:42366) 2024-09-21T03:44:14.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.079+0000 7f6f9f7fe640 1 -- 172.21.15.84:0/335812894 learned_addr learned my addr 172.21.15.84:0/335812894 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:14.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.079+0000 7f6f9f7fe640 1 --2- 172.21.15.84:0/335812894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc6e390 0x560a2c036d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.079+0000 7f6f9ffff640 1 --2- 172.21.15.84:0/335812894 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc661b0 0x560a2c036800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.080+0000 7f6f9f7fe640 1 -- 172.21.15.84:0/335812894 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc661b0 msgr2=0x560a2c036800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:14.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.080+0000 7f6f9f7fe640 1 --2- 172.21.15.84:0/335812894 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc661b0 0x560a2c036800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.080+0000 7f6f9f7fe640 1 -- 172.21.15.84:0/335812894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc6e390 msgr2=0x560a2c036d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:14.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.080+0000 7f6f9f7fe640 1 --2- 172.21.15.84:0/335812894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc6e390 0x560a2c036d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.080+0000 7f6f9f7fe640 1 -- 172.21.15.84:0/335812894 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a2bcfa650 con 0x560a2bc8f070 2024-09-21T03:44:14.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.080+0000 7f6f9d7fa640 1 --2- 172.21.15.84:0/975958905 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6f880b66b0 0x7f6f880b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.080+0000 7f6f9f7fe640 1 --2- 172.21.15.84:0/335812894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc8f070 0x560a2c0362c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6f94005ab0 tx=0x7f6f94005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8adf71defbde6174 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:14.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.080+0000 7f6f9ffff640 1 --2- 172.21.15.84:0/975958905 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6f880b66b0 0x7f6f880b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.080+0000 7f6f9d7fa640 1 -- 172.21.15.84:0/975958905 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f6f980e6c00 con 0x7f6fa0108d10 2024-09-21T03:44:14.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.080+0000 7f6f867fc640 1 -- 172.21.15.84:0/335812894 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94043020 con 0x560a2bc8f070 2024-09-21T03:44:14.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.080+0000 7f6f867fc640 1 -- 172.21.15.84:0/335812894 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f94031870 con 0x560a2bc8f070 2024-09-21T03:44:14.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.080+0000 7f6f867fc640 1 -- 172.21.15.84:0/335812894 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94035050 con 0x560a2bc8f070 2024-09-21T03:44:14.090 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.081+0000 7f6face7c740 1 -- 172.21.15.84:0/335812894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc8f070 msgr2=0x560a2c0362c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.081+0000 7f6face7c740 1 --2- 172.21.15.84:0/335812894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc8f070 0x560a2c0362c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6f94005ab0 tx=0x7f6f94005a20 comp rx=0 tx=0).stop 2024-09-21T03:44:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.081+0000 7f6f9ffff640 1 --2- 172.21.15.84:0/975958905 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6f880b66b0 0x7f6f880b8bc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6f90005fd0 tx=0x7f6f90005f40 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.081+0000 7f6face7c740 1 -- 172.21.15.84:0/335812894 shutdown_connections 2024-09-21T03:44:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.081+0000 7f6face7c740 1 --2- 172.21.15.84:0/335812894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc6e390 0x560a2c036d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.081+0000 7f6face7c740 1 --2- 172.21.15.84:0/335812894 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc661b0 0x560a2c036800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.081+0000 7f6face7c740 1 --2- 172.21.15.84:0/335812894 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc8f070 0x560a2c0362c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.081+0000 7f6face7c740 1 -- 172.21.15.84:0/335812894 >> 172.21.15.84:0/335812894 conn(0x560a2bc83460 msgr2=0x560a2c0341b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.081+0000 7f6face7c740 1 -- 172.21.15.84:0/335812894 shutdown_connections 2024-09-21T03:44:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.081+0000 7f6face7c740 1 -- 172.21.15.84:0/335812894 wait complete. 2024-09-21T03:44:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.081+0000 7f6face7c740 1 -- start start 2024-09-21T03:44:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.082+0000 7f6face7c740 1 Processor -- start 2024-09-21T03:44:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.082+0000 7f6face7c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc661b0 0x560a2c045d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.082+0000 7f6face7c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc6e390 0x560a2c046260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.082+0000 7f6face7c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc8f070 0x560a2c0467c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.082+0000 7f6face7c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560a2bdfd700 con 0x560a2bc6e390 2024-09-21T03:44:14.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.082+0000 7f6face7c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560a2bf37160 con 0x560a2bc8f070 2024-09-21T03:44:14.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.082+0000 7f6face7c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560a2c048da0 con 0x560a2bc661b0 2024-09-21T03:44:14.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.082+0000 7f6face7c740 10 client.0 _ll_register_callbacks cb 0x560a2bf509e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:14.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.082+0000 7f6f9f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc6e390 0x560a2c046260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.082+0000 7f6f9f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc6e390 0x560a2c046260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42378/0 (socket says 172.21.15.84:42378) 2024-09-21T03:44:14.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.082+0000 7f6f9f7fe640 1 -- 172.21.15.84:0/408215028 learned_addr learned my addr 172.21.15.84:0/408215028 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:14.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.082+0000 7f6f9f7fe640 1 -- 172.21.15.84:0/408215028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc661b0 msgr2=0x560a2c045d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:14.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.082+0000 7f6f9ffff640 1 --2- 172.21.15.84:0/408215028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc661b0 0x560a2c045d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.082+0000 7f6fa4ea5640 1 --2- 172.21.15.84:0/408215028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc8f070 0x560a2c0467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.082+0000 7f6f9f7fe640 1 --2- 172.21.15.84:0/408215028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc661b0 0x560a2c045d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.082+0000 7f6f9f7fe640 1 -- 172.21.15.84:0/408215028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc8f070 msgr2=0x560a2c0467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:14.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.082+0000 7f6f9f7fe640 1 --2- 172.21.15.84:0/408215028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc8f070 0x560a2c0467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.082+0000 7f6f9f7fe640 1 -- 172.21.15.84:0/408215028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a2bf64c90 con 0x560a2bc6e390 2024-09-21T03:44:14.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.082+0000 7f6fa4ea5640 1 --2- 172.21.15.84:0/408215028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc8f070 0x560a2c0467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:14.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.083+0000 7f6f9f7fe640 1 --2- 172.21.15.84:0/408215028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc6e390 0x560a2c046260 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6f9402a930 tx=0x7f6f94031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15432ab40444cb7e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:14.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.083+0000 7f6f7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:14.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.083+0000 7f6f7f7fe640 1 -- 172.21.15.84:0/408215028 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94043030 con 0x560a2bc6e390 2024-09-21T03:44:14.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.083+0000 7f6face7c740 1 -- 172.21.15.84:0/408215028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f94031870 con 0x560a2bc6e390 2024-09-21T03:44:14.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.083+0000 7f6f7f7fe640 1 -- 172.21.15.84:0/408215028 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f6f94004bb0 con 0x560a2bc6e390 2024-09-21T03:44:14.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.083+0000 7f6f7f7fe640 1 -- 172.21.15.84:0/408215028 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6f94035040 con 0x560a2bc6e390 2024-09-21T03:44:14.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.083+0000 7f6face7c740 10 client.15861 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:14.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.083+0000 7f6face7c740 1 -- 172.21.15.84:0/408215028 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560a2c054a60 con 0x560a2bc6e390 2024-09-21T03:44:14.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.083+0000 7f6f7f7fe640 1 -- 172.21.15.84:0/408215028 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f94031870 con 0x560a2bc6e390 2024-09-21T03:44:14.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.083+0000 7f6f7f7fe640 1 -- 172.21.15.84:0/408215028 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6f9403d450 con 0x560a2bc6e390 2024-09-21T03:44:14.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.084+0000 7f6face7c740 10 client.15861 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:14.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.084+0000 7f6face7c740 10 client.15861 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:44:14.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.084+0000 7f6face7c740 20 client.15861 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:14.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.084+0000 7f6face7c740 1 --2- 172.21.15.84:0/408215028 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x560a2bc4d9f0 0x560a2c057dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.084+0000 7f6face7c740 4 client.15861 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:44:14.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.084+0000 7f6face7c740 1 -- 172.21.15.84:0/408215028 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a2bfaedf0 con 0x560a2bc4d9f0 2024-09-21T03:44:14.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.084+0000 7f6f9ffff640 1 --2- 172.21.15.84:0/408215028 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x560a2bc4d9f0 0x560a2c057dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.084+0000 7f6f7f7fe640 10 client.15861 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:44:14.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.084+0000 7f6f9ffff640 1 --2- 172.21.15.84:0/408215028 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x560a2bc4d9f0 0x560a2c057dc0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=573b84b7ac1fe544 server_cookie=1c8e4a33111a2c55 in_seq=0 out_seq=0 2024-09-21T03:44:14.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.085+0000 7f6f7f7fe640 1 -- 172.21.15.84:0/408215028 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560a2bfaedf0 con 0x560a2bc4d9f0 2024-09-21T03:44:14.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.085+0000 7f6f7f7fe640 10 client.15861 handle_command_reply: tid=0 2024-09-21T03:44:14.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.085+0000 7f6face7c740 1 client.15861 shutdown 2024-09-21T03:44:14.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.086+0000 7f6face7c740 1 -- 172.21.15.84:0/408215028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc6e390 msgr2=0x560a2c046260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:14.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.086+0000 7f6face7c740 1 --2- 172.21.15.84:0/408215028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc6e390 0x560a2c046260 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6f9402a930 tx=0x7f6f94031400 comp rx=0 tx=0).stop 2024-09-21T03:44:14.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.086+0000 7f6face7c740 1 -- 172.21.15.84:0/408215028 shutdown_connections 2024-09-21T03:44:14.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.086+0000 7f6face7c740 1 --2- 172.21.15.84:0/408215028 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x560a2bc4d9f0 0x560a2c057dc0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.086+0000 7f6face7c740 1 --2- 172.21.15.84:0/408215028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc8f070 0x560a2c0467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.086+0000 7f6face7c740 1 --2- 172.21.15.84:0/408215028 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc6e390 0x560a2c046260 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.086+0000 7f6face7c740 1 --2- 172.21.15.84:0/408215028 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc661b0 0x560a2c045d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.086+0000 7f6face7c740 1 -- 172.21.15.84:0/408215028 >> 172.21.15.84:0/408215028 conn(0x560a2bc83460 msgr2=0x560a2c032750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:14.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.086+0000 7f6f7f7fe640 0 client.15861 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:44:14.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.086+0000 7f6face7c740 1 -- 172.21.15.84:0/408215028 shutdown_connections 2024-09-21T03:44:14.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.086+0000 7f6face7c740 1 -- 172.21.15.84:0/408215028 wait complete. 2024-09-21T03:44:14.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.086+0000 7f6face7c740 20 client.15861 trim_cache size 0 max 16384 2024-09-21T03:44:14.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.099+0000 7f6face7c740 1 Processor -- start 2024-09-21T03:44:14.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.099+0000 7f6face7c740 1 -- start start 2024-09-21T03:44:14.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.099+0000 7f6face7c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc661b0 0x560a2c03bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.099+0000 7f6face7c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc6e390 0x560a2c042f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.099+0000 7f6face7c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc8f070 0x560a2c043450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.099+0000 7f6face7c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa01afa60 con 0x560a2bc8f070 2024-09-21T03:44:14.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.099+0000 7f6face7c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa01ad330 con 0x560a2bc661b0 2024-09-21T03:44:14.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.099+0000 7f6face7c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa01ab180 con 0x560a2bc6e390 2024-09-21T03:44:14.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.099+0000 7f6fa4ea5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc8f070 0x560a2c043450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.099+0000 7f6fa4ea5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc8f070 0x560a2c043450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42394/0 (socket says 172.21.15.84:42394) 2024-09-21T03:44:14.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.099+0000 7f6fa4ea5640 1 -- 172.21.15.84:0/3890633106 learned_addr learned my addr 172.21.15.84:0/3890633106 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:14.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.099+0000 7f6f9f7fe640 1 --2- 172.21.15.84:0/3890633106 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc6e390 0x560a2c042f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.099+0000 7f6f9ffff640 1 --2- 172.21.15.84:0/3890633106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc661b0 0x560a2c03bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.099+0000 7f6fa4ea5640 1 -- 172.21.15.84:0/3890633106 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc6e390 msgr2=0x560a2c042f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:14.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.099+0000 7f6fa4ea5640 1 --2- 172.21.15.84:0/3890633106 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc6e390 0x560a2c042f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.099+0000 7f6fa4ea5640 1 -- 172.21.15.84:0/3890633106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc661b0 msgr2=0x560a2c03bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:14.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.099+0000 7f6fa4ea5640 1 --2- 172.21.15.84:0/3890633106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc661b0 0x560a2c03bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.099+0000 7f6fa4ea5640 1 -- 172.21.15.84:0/3890633106 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a2c048a80 con 0x560a2bc8f070 2024-09-21T03:44:14.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.100+0000 7f6fa4ea5640 1 --2- 172.21.15.84:0/3890633106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc8f070 0x560a2c043450 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6f980e4430 tx=0x7f6f980ac4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee1734aab2dd7bb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:14.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.100+0000 7f6f85ffb640 1 -- 172.21.15.84:0/3890633106 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f980ad1d0 con 0x560a2bc8f070 2024-09-21T03:44:14.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.100+0000 7f6f85ffb640 1 -- 172.21.15.84:0/3890633106 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f980b15b0 con 0x560a2bc8f070 2024-09-21T03:44:14.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.100+0000 7f6f85ffb640 1 -- 172.21.15.84:0/3890633106 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f980e4720 con 0x560a2bc8f070 2024-09-21T03:44:14.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.101+0000 7f6face7c740 1 -- 172.21.15.84:0/3890633106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc8f070 msgr2=0x560a2c043450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:14.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.101+0000 7f6face7c740 1 --2- 172.21.15.84:0/3890633106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc8f070 0x560a2c043450 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6f980e4430 tx=0x7f6f980ac4e0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.101+0000 7f6face7c740 1 -- 172.21.15.84:0/3890633106 shutdown_connections 2024-09-21T03:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.101+0000 7f6face7c740 1 --2- 172.21.15.84:0/3890633106 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc8f070 0x560a2c043450 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.101+0000 7f6face7c740 1 --2- 172.21.15.84:0/3890633106 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc6e390 0x560a2c042f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.101+0000 7f6face7c740 1 --2- 172.21.15.84:0/3890633106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc661b0 0x560a2c03bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.101+0000 7f6face7c740 1 -- 172.21.15.84:0/3890633106 >> 172.21.15.84:0/3890633106 conn(0x560a2bc83460 msgr2=0x560a2c03b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.101+0000 7f6face7c740 1 -- 172.21.15.84:0/3890633106 shutdown_connections 2024-09-21T03:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.101+0000 7f6face7c740 1 -- 172.21.15.84:0/3890633106 wait complete. 2024-09-21T03:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.101+0000 7f6face7c740 1 -- start start 2024-09-21T03:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.101+0000 7f6face7c740 1 Processor -- start 2024-09-21T03:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.102+0000 7f6face7c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc661b0 0x560a2c056620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.102+0000 7f6face7c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc6e390 0x560a2c056c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.102+0000 7f6face7c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc8f070 0x560a2c0c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.102+0000 7f6face7c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa01ab7f0 con 0x560a2bc6e390 2024-09-21T03:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.102+0000 7f6face7c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa01acc60 con 0x560a2bc661b0 2024-09-21T03:44:14.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.102+0000 7f6face7c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa01abec0 con 0x560a2bc8f070 2024-09-21T03:44:14.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.102+0000 7f6face7c740 10 client.0 _ll_register_callbacks cb 0x7f6f940314a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:14.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.102+0000 7f6f9f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc6e390 0x560a2c056c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.102+0000 7f6f9f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc6e390 0x560a2c056c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42398/0 (socket says 172.21.15.84:42398) 2024-09-21T03:44:14.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.102+0000 7f6f9f7fe640 1 -- 172.21.15.84:0/3391674634 learned_addr learned my addr 172.21.15.84:0/3391674634 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:14.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.102+0000 7f6f9ffff640 1 --2- 172.21.15.84:0/3391674634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc661b0 0x560a2c056620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.102+0000 7f6fa4ea5640 1 --2- 172.21.15.84:0/3391674634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc8f070 0x560a2c0c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.102+0000 7f6f9f7fe640 1 -- 172.21.15.84:0/3391674634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc8f070 msgr2=0x560a2c0c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:14.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.102+0000 7f6f9f7fe640 1 --2- 172.21.15.84:0/3391674634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc8f070 0x560a2c0c4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.102+0000 7f6f9f7fe640 1 -- 172.21.15.84:0/3391674634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc661b0 msgr2=0x560a2c056620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:14.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.102+0000 7f6f9f7fe640 1 --2- 172.21.15.84:0/3391674634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc661b0 0x560a2c056620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.102+0000 7f6f9f7fe640 1 -- 172.21.15.84:0/3391674634 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a2c0c5380 con 0x560a2bc6e390 2024-09-21T03:44:14.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.102+0000 7f6fa4ea5640 1 --2- 172.21.15.84:0/3391674634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc8f070 0x560a2c0c4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:14.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.103+0000 7f6f9f7fe640 1 --2- 172.21.15.84:0/3391674634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc6e390 0x560a2c056c20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6f94005510 tx=0x7f6f9403dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0a641ad83b1d2b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:14.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.103+0000 7f6f7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:14.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.103+0000 7f6f7f7fe640 1 -- 172.21.15.84:0/3391674634 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9405f060 con 0x560a2bc6e390 2024-09-21T03:44:14.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.103+0000 7f6f7f7fe640 1 -- 172.21.15.84:0/3391674634 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f6f940049b0 con 0x560a2bc6e390 2024-09-21T03:44:14.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.103+0000 7f6face7c740 1 -- 172.21.15.84:0/3391674634 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f980b15b0 con 0x560a2bc6e390 2024-09-21T03:44:14.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.103+0000 7f6f7f7fe640 1 -- 172.21.15.84:0/3391674634 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6f94043040 con 0x560a2bc6e390 2024-09-21T03:44:14.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.103+0000 7f6face7c740 10 client.15867 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:14.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.103+0000 7f6face7c740 1 -- 172.21.15.84:0/3391674634 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560a2c0c6600 con 0x560a2bc6e390 2024-09-21T03:44:14.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.103+0000 7f6f7f7fe640 1 -- 172.21.15.84:0/3391674634 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f980b15b0 con 0x560a2bc6e390 2024-09-21T03:44:14.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.103+0000 7f6f7f7fe640 1 -- 172.21.15.84:0/3391674634 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6f9405ab30 con 0x560a2bc6e390 2024-09-21T03:44:14.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.103+0000 7f6face7c740 10 client.15867 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:14.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.103+0000 7f6face7c740 10 client.15867 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:44:14.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.103+0000 7f6face7c740 20 client.15867 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:14.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.103+0000 7f6face7c740 1 --2- 172.21.15.84:0/3391674634 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x560a2bc22da0 0x560a2c0c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.103+0000 7f6face7c740 4 client.15867 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:44:14.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.103+0000 7f6face7c740 1 -- 172.21.15.84:0/3391674634 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560a2bfaa8a0 con 0x560a2bc22da0 2024-09-21T03:44:14.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.104+0000 7f6f9ffff640 1 --2- 172.21.15.84:0/3391674634 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x560a2bc22da0 0x560a2c0c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.104+0000 7f6f7f7fe640 10 client.15867 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:44:14.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.104+0000 7f6f9ffff640 1 --2- 172.21.15.84:0/3391674634 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x560a2bc22da0 0x560a2c0c8d90 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9593bcd05655aabe server_cookie=ef3787b19080d552 in_seq=0 out_seq=0 2024-09-21T03:44:14.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.105+0000 7f6f7f7fe640 1 -- 172.21.15.84:0/3391674634 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560a2bfaa8a0 con 0x560a2bc22da0 2024-09-21T03:44:14.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.105+0000 7f6f7f7fe640 10 client.15867 handle_command_reply: tid=0 2024-09-21T03:44:14.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.105+0000 7f6face7c740 1 client.15867 shutdown 2024-09-21T03:44:14.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.105+0000 7f6face7c740 1 -- 172.21.15.84:0/3391674634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc6e390 msgr2=0x560a2c056c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:14.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.105+0000 7f6face7c740 1 --2- 172.21.15.84:0/3391674634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc6e390 0x560a2c056c20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6f94005510 tx=0x7f6f9403dde0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.105+0000 7f6face7c740 1 -- 172.21.15.84:0/3391674634 shutdown_connections 2024-09-21T03:44:14.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.105+0000 7f6face7c740 1 --2- 172.21.15.84:0/3391674634 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x560a2bc22da0 0x560a2c0c8d90 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.105+0000 7f6face7c740 1 --2- 172.21.15.84:0/3391674634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560a2bc8f070 0x560a2c0c4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.105+0000 7f6face7c740 1 --2- 172.21.15.84:0/3391674634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560a2bc6e390 0x560a2c056c20 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.105+0000 7f6face7c740 1 --2- 172.21.15.84:0/3391674634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a2bc661b0 0x560a2c056620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.105+0000 7f6face7c740 1 -- 172.21.15.84:0/3391674634 >> 172.21.15.84:0/3391674634 conn(0x560a2bc83460 msgr2=0x560a2c051030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:14.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.105+0000 7f6f7f7fe640 0 client.15867 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:44:14.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.105+0000 7f6face7c740 1 -- 172.21.15.84:0/3391674634 shutdown_connections 2024-09-21T03:44:14.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.105+0000 7f6face7c740 1 -- 172.21.15.84:0/3391674634 wait complete. 2024-09-21T03:44:14.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.105+0000 7f6face7c740 20 client.15867 trim_cache size 0 max 16384 2024-09-21T03:44:14.112 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:44:14.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.106+0000 7f6fa6908640 1 -- 172.21.15.84:0/975958905 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6f880b66b0 msgr2=0x7f6f880b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:14.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.106+0000 7f6fa6908640 1 --2- 172.21.15.84:0/975958905 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6f880b66b0 0x7f6f880b8bc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6f90005fd0 tx=0x7f6f90005f40 comp rx=0 tx=0).stop 2024-09-21T03:44:14.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.106+0000 7f6fa6908640 1 -- 172.21.15.84:0/975958905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa0108d10 msgr2=0x7f6fa019fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:14.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.106+0000 7f6fa6908640 1 --2- 172.21.15.84:0/975958905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa0108d10 0x7f6fa019fd10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f6f9800b970 tx=0x7f6f9800be30 comp rx=0 tx=0).stop 2024-09-21T03:44:14.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.106+0000 7f6fa6908640 1 -- 172.21.15.84:0/975958905 shutdown_connections 2024-09-21T03:44:14.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.106+0000 7f6fa6908640 1 --2- 172.21.15.84:0/975958905 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6f880b66b0 0x7f6f880b8bc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.106+0000 7f6fa6908640 1 --2- 172.21.15.84:0/975958905 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6fa0108d10 0x7f6fa019fd10 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.106+0000 7f6fa6908640 1 --2- 172.21.15.84:0/975958905 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6fa01083c0 0x7f6fa019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.106+0000 7f6fa6908640 1 --2- 172.21.15.84:0/975958905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6fa0102a80 0x7f6fa019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.106+0000 7f6fa6908640 1 -- 172.21.15.84:0/975958905 >> 172.21.15.84:0/975958905 conn(0x7f6fa0079740 msgr2=0x7f6fa01052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:14.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.106+0000 7f6fa6908640 1 -- 172.21.15.84:0/975958905 shutdown_connections 2024-09-21T03:44:14.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:14.106+0000 7f6fa6908640 1 -- 172.21.15.84:0/975958905 wait complete. 2024-09-21T03:44:14.836 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:44:15.087 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:15.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:15 smithi084 ceph-mon[30941]: pgmap v377: 97 pgs: 97 active+clean; 2.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 37 KiB/s wr, 26 op/s 2024-09-21T03:44:15.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.649+0000 7f9bc9575640 1 -- 172.21.15.84:0/1947874216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bc4109e00 msgr2=0x7f9bc4110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:15.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.649+0000 7f9bc9575640 1 --2- 172.21.15.84:0/1947874216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bc4109e00 0x7f9bc4110630 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009900 tx=0x7f9bbc02a3f0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.649+0000 7f9bc9575640 1 -- 172.21.15.84:0/1947874216 shutdown_connections 2024-09-21T03:44:15.701 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.649+0000 7f9bc9575640 1 --2- 172.21.15.84:0/1947874216 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bc4109e00 0x7f9bc4110630 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.649+0000 7f9bc9575640 1 --2- 172.21.15.84:0/1947874216 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bc41094b0 0x7f9bc41098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.649+0000 7f9bc9575640 1 --2- 172.21.15.84:0/1947874216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bc4101f70 0x7f9bc4102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.649+0000 7f9bc9575640 1 -- 172.21.15.84:0/1947874216 >> 172.21.15.84:0/1947874216 conn(0x7f9bc4077c60 msgr2=0x7f9bc40780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.649+0000 7f9bc9575640 1 -- 172.21.15.84:0/1947874216 shutdown_connections 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.649+0000 7f9bc9575640 1 -- 172.21.15.84:0/1947874216 wait complete. 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.649+0000 7f9bc9575640 1 Processor -- start 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.650+0000 7f9bc9575640 1 -- start start 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.650+0000 7f9bc9575640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bc4101f70 0x7f9bc419a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.650+0000 7f9bc9575640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bc41094b0 0x7f9bc419a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.650+0000 7f9bc9575640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bc4109e00 0x7f9bc419fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.650+0000 7f9bc9575640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc4113ac0 con 0x7f9bc41094b0 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.650+0000 7f9bc9575640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc4113940 con 0x7f9bc4101f70 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.650+0000 7f9bc9575640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc4113c40 con 0x7f9bc4109e00 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.650+0000 7f9bc27fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bc41094b0 0x7f9bc419a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.650+0000 7f9bc27fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bc41094b0 0x7f9bc419a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42416/0 (socket says 172.21.15.84:42416) 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.650+0000 7f9bc27fc640 1 -- 172.21.15.84:0/2811618273 learned_addr learned my addr 172.21.15.84:0/2811618273 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.650+0000 7f9bc2ffd640 1 --2- 172.21.15.84:0/2811618273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bc4101f70 0x7f9bc419a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.650+0000 7f9bc37fe640 1 --2- 172.21.15.84:0/2811618273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bc4109e00 0x7f9bc419fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.650+0000 7f9bc27fc640 1 -- 172.21.15.84:0/2811618273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bc4109e00 msgr2=0x7f9bc419fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.650+0000 7f9bc27fc640 1 --2- 172.21.15.84:0/2811618273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bc4109e00 0x7f9bc419fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.650+0000 7f9bc27fc640 1 -- 172.21.15.84:0/2811618273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bc4101f70 msgr2=0x7f9bc419a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.650+0000 7f9bc27fc640 1 --2- 172.21.15.84:0/2811618273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bc4101f70 0x7f9bc419a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.650+0000 7f9bc27fc640 1 -- 172.21.15.84:0/2811618273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc41a0240 con 0x7f9bc41094b0 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.651+0000 7f9bc2ffd640 1 --2- 172.21.15.84:0/2811618273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bc4101f70 0x7f9bc419a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.651+0000 7f9bc27fc640 1 --2- 172.21.15.84:0/2811618273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bc41094b0 0x7f9bc419a930 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800c8c0 tx=0x7f9bb800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.651+0000 7f9babfff640 1 -- 172.21.15.84:0/2811618273 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8007bb0 con 0x7f9bc41094b0 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.651+0000 7f9bc9575640 1 -- 172.21.15.84:0/2811618273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc41a0530 con 0x7f9bc41094b0 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.651+0000 7f9babfff640 1 -- 172.21.15.84:0/2811618273 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bb8007d50 con 0x7f9bc41094b0 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.651+0000 7f9babfff640 1 -- 172.21.15.84:0/2811618273 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb80187c0 con 0x7f9bc41094b0 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.651+0000 7f9bc9575640 1 -- 172.21.15.84:0/2811618273 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc41a6d50 con 0x7f9bc41094b0 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.653+0000 7f9bcfae9740 1 Processor -- start 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.653+0000 7f9bcfae9740 1 -- start start 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.654+0000 7f9bcfae9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f6e070 0x55b0a23152c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.654+0000 7f9bcfae9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f451b0 0x55b0a2315800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.654+0000 7f9bcfae9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f4d390 0x55b0a2315d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.654+0000 7f9babfff640 1 -- 172.21.15.84:0/2811618273 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f9bb800fa20 con 0x7f9bc41094b0 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.654+0000 7f9bcfae9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b0a228bea0 con 0x55b0a1f6e070 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.654+0000 7f9bcfae9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b0a227b2d0 con 0x55b0a1f4d390 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.654+0000 7f9bcfae9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b0a227f0e0 con 0x55b0a1f451b0 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.654+0000 7f9bc37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f6e070 0x55b0a23152c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.654+0000 7f9bc37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f6e070 0x55b0a23152c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42418/0 (socket says 172.21.15.84:42418) 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.654+0000 7f9bc37fe640 1 -- 172.21.15.84:0/1241468511 learned_addr learned my addr 172.21.15.84:0/1241468511 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.654+0000 7f9bc2ffd640 1 --2- 172.21.15.84:0/1241468511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f451b0 0x55b0a2315800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.654+0000 7f9bc27fc640 1 --2- 172.21.15.84:0/1241468511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f4d390 0x55b0a2315d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.654+0000 7f9bc37fe640 1 -- 172.21.15.84:0/1241468511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f451b0 msgr2=0x55b0a2315800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.654+0000 7f9bc37fe640 1 --2- 172.21.15.84:0/1241468511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f451b0 0x55b0a2315800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.654+0000 7f9bc37fe640 1 -- 172.21.15.84:0/1241468511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f4d390 msgr2=0x55b0a2315d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.654+0000 7f9bc37fe640 1 --2- 172.21.15.84:0/1241468511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f4d390 0x55b0a2315d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.654+0000 7f9bc37fe640 1 -- 172.21.15.84:0/1241468511 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0a1fd9650 con 0x55b0a1f6e070 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.654+0000 7f9bc27fc640 1 --2- 172.21.15.84:0/1241468511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f4d390 0x55b0a2315d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.654+0000 7f9bc37fe640 1 --2- 172.21.15.84:0/1241468511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f6e070 0x55b0a23152c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009900 tx=0x7f9bbc031c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7130373264308872 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.655+0000 7f9ba97fa640 1 -- 172.21.15.84:0/1241468511 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc03f070 con 0x55b0a1f6e070 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.655+0000 7f9ba97fa640 1 -- 172.21.15.84:0/1241468511 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bbc031e30 con 0x55b0a1f6e070 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.655+0000 7f9ba97fa640 1 -- 172.21.15.84:0/1241468511 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc035070 con 0x55b0a1f6e070 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.655+0000 7f9babfff640 1 --2- 172.21.15.84:0/2811618273 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9bac0b66b0 0x7f9bac0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.655+0000 7f9bc2ffd640 1 --2- 172.21.15.84:0/2811618273 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9bac0b66b0 0x7f9bac0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.655+0000 7f9babfff640 1 -- 172.21.15.84:0/2811618273 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f9bb80e77f0 con 0x7f9bc41094b0 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.655+0000 7f9bcfae9740 1 -- 172.21.15.84:0/1241468511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f6e070 msgr2=0x55b0a23152c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.655+0000 7f9bc2ffd640 1 --2- 172.21.15.84:0/2811618273 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9bac0b66b0 0x7f9bac0b8bc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55b0a2313f40 tx=0x7f9bb40077a0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.655+0000 7f9bcfae9740 1 --2- 172.21.15.84:0/1241468511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f6e070 0x55b0a23152c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009900 tx=0x7f9bbc031c40 comp rx=0 tx=0).stop 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.656+0000 7f9bcfae9740 1 -- 172.21.15.84:0/1241468511 shutdown_connections 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.656+0000 7f9bcfae9740 1 --2- 172.21.15.84:0/1241468511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f4d390 0x55b0a2315d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.656+0000 7f9bcfae9740 1 --2- 172.21.15.84:0/1241468511 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f451b0 0x55b0a2315800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.656+0000 7f9bcfae9740 1 --2- 172.21.15.84:0/1241468511 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f6e070 0x55b0a23152c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.656+0000 7f9bcfae9740 1 -- 172.21.15.84:0/1241468511 >> 172.21.15.84:0/1241468511 conn(0x55b0a1f62460 msgr2=0x55b0a23131b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.656+0000 7f9bcfae9740 1 -- 172.21.15.84:0/1241468511 shutdown_connections 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.656+0000 7f9bcfae9740 1 -- 172.21.15.84:0/1241468511 wait complete. 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.656+0000 7f9bcfae9740 1 -- start start 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.656+0000 7f9bcfae9740 1 Processor -- start 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.656+0000 7f9bcfae9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f451b0 0x55b0a2320990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.656+0000 7f9bcfae9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f4d390 0x55b0a2320ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.656+0000 7f9bcfae9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f6e070 0x55b0a232cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.656+0000 7f9bcfae9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b0a20dc700 con 0x55b0a1f4d390 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.656+0000 7f9bcfae9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b0a2216160 con 0x55b0a1f451b0 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.656+0000 7f9bcfae9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b0a2323a40 con 0x55b0a1f6e070 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.656+0000 7f9bcfae9740 10 client.0 _ll_register_callbacks cb 0x55b0a222f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.657+0000 7f9bc27fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f4d390 0x55b0a2320ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.657+0000 7f9bc27fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f4d390 0x55b0a2320ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42424/0 (socket says 172.21.15.84:42424) 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.657+0000 7f9bc27fc640 1 -- 172.21.15.84:0/3587733594 learned_addr learned my addr 172.21.15.84:0/3587733594 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.657+0000 7f9bc2ffd640 1 --2- 172.21.15.84:0/3587733594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f451b0 0x55b0a2320990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.657+0000 7f9bc37fe640 1 --2- 172.21.15.84:0/3587733594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f6e070 0x55b0a232cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.657+0000 7f9bc27fc640 1 -- 172.21.15.84:0/3587733594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f6e070 msgr2=0x55b0a232cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.657+0000 7f9bc27fc640 1 --2- 172.21.15.84:0/3587733594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f6e070 0x55b0a232cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.657+0000 7f9bc27fc640 1 -- 172.21.15.84:0/3587733594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f451b0 msgr2=0x55b0a2320990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.657+0000 7f9bc27fc640 1 --2- 172.21.15.84:0/3587733594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f451b0 0x55b0a2320990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.657+0000 7f9bc27fc640 1 -- 172.21.15.84:0/3587733594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0a2243c90 con 0x55b0a1f4d390 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.657+0000 7f9bc37fe640 1 --2- 172.21.15.84:0/3587733594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f6e070 0x55b0a232cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.657+0000 7f9bc27fc640 1 --2- 172.21.15.84:0/3587733594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f4d390 0x55b0a2320ed0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80ad3c0 tx=0x7f9bb801f600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9863b60e12fe31e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.657+0000 7f9ba6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.657+0000 7f9ba6ff5640 1 -- 172.21.15.84:0/3587733594 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb80ad1d0 con 0x55b0a1f4d390 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.657+0000 7f9ba6ff5640 1 -- 172.21.15.84:0/3587733594 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f9bb80acb30 con 0x55b0a1f4d390 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.657+0000 7f9bcfae9740 1 -- 172.21.15.84:0/3587733594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bbc031e30 con 0x55b0a1f4d390 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.657+0000 7f9ba6ff5640 1 -- 172.21.15.84:0/3587733594 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9bb80addc0 con 0x55b0a1f4d390 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.657+0000 7f9bcfae9740 10 client.15879 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.657+0000 7f9bcfae9740 1 -- 172.21.15.84:0/3587733594 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b0a232f760 con 0x55b0a1f4d390 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.657+0000 7f9ba6ff5640 1 -- 172.21.15.84:0/3587733594 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bbc031e30 con 0x55b0a1f4d390 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.658+0000 7f9ba6ff5640 1 -- 172.21.15.84:0/3587733594 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9bb80ac590 con 0x55b0a1f4d390 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.658+0000 7f9bcfae9740 10 client.15879 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.658+0000 7f9bcfae9740 10 client.15879 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.658+0000 7f9bcfae9740 20 client.15879 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.658+0000 7f9bcfae9740 1 --2- 172.21.15.84:0/3587733594 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55b0a1f2c9f0 0x55b0a2332c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.658+0000 7f9bcfae9740 4 client.15879 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.658+0000 7f9bcfae9740 1 -- 172.21.15.84:0/3587733594 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0a228ddf0 con 0x55b0a1f2c9f0 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.658+0000 7f9bc2ffd640 1 --2- 172.21.15.84:0/3587733594 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55b0a1f2c9f0 0x55b0a2332c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.658+0000 7f9ba6ff5640 10 client.15879 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.658+0000 7f9bc2ffd640 1 --2- 172.21.15.84:0/3587733594 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55b0a1f2c9f0 0x55b0a2332c30 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=73a85c1795cc642c server_cookie=b9441173629df11d in_seq=0 out_seq=0 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.659+0000 7f9ba6ff5640 1 -- 172.21.15.84:0/3587733594 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b0a228ddf0 con 0x55b0a1f2c9f0 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.659+0000 7f9ba6ff5640 10 client.15879 handle_command_reply: tid=0 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.659+0000 7f9bcfae9740 1 client.15879 shutdown 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.659+0000 7f9bcfae9740 1 -- 172.21.15.84:0/3587733594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f4d390 msgr2=0x55b0a2320ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.659+0000 7f9bcfae9740 1 --2- 172.21.15.84:0/3587733594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f4d390 0x55b0a2320ed0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80ad3c0 tx=0x7f9bb801f600 comp rx=0 tx=0).stop 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.659+0000 7f9bcfae9740 1 -- 172.21.15.84:0/3587733594 shutdown_connections 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.659+0000 7f9bcfae9740 1 --2- 172.21.15.84:0/3587733594 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55b0a1f2c9f0 0x55b0a2332c30 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.660+0000 7f9bcfae9740 1 --2- 172.21.15.84:0/3587733594 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f6e070 0x55b0a232cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.660+0000 7f9bcfae9740 1 --2- 172.21.15.84:0/3587733594 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f4d390 0x55b0a2320ed0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.660+0000 7f9ba6ff5640 0 client.15879 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.660+0000 7f9bcfae9740 1 --2- 172.21.15.84:0/3587733594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f451b0 0x55b0a2320990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.660+0000 7f9bcfae9740 1 -- 172.21.15.84:0/3587733594 >> 172.21.15.84:0/3587733594 conn(0x55b0a1f62460 msgr2=0x55b0a23184a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.660+0000 7f9bcfae9740 1 -- 172.21.15.84:0/3587733594 shutdown_connections 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.660+0000 7f9bcfae9740 1 -- 172.21.15.84:0/3587733594 wait complete. 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.660+0000 7f9bcfae9740 20 client.15879 trim_cache size 0 max 16384 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.673+0000 7f9bcfae9740 1 Processor -- start 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.673+0000 7f9bcfae9740 1 -- start start 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.673+0000 7f9bcfae9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f2c9f0 0x55b0a23225c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.673+0000 7f9bcfae9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f451b0 0x55b0a232cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.673+0000 7f9bcfae9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f4d390 0x55b0a231db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.673+0000 7f9bcfae9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc41b1c70 con 0x55b0a1f2c9f0 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.673+0000 7f9bcfae9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc41af540 con 0x55b0a1f451b0 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.673+0000 7f9bcfae9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc41ad390 con 0x55b0a1f4d390 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.673+0000 7f9bc2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f2c9f0 0x55b0a23225c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.673+0000 7f9bc2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f2c9f0 0x55b0a23225c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42430/0 (socket says 172.21.15.84:42430) 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.673+0000 7f9bc2ffd640 1 -- 172.21.15.84:0/4198496489 learned_addr learned my addr 172.21.15.84:0/4198496489 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.673+0000 7f9bc37fe640 1 --2- 172.21.15.84:0/4198496489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f4d390 0x55b0a231db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.673+0000 7f9bc27fc640 1 --2- 172.21.15.84:0/4198496489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f451b0 0x55b0a232cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.673+0000 7f9bc2ffd640 1 -- 172.21.15.84:0/4198496489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f4d390 msgr2=0x55b0a231db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.673+0000 7f9bc2ffd640 1 --2- 172.21.15.84:0/4198496489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f4d390 0x55b0a231db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.673+0000 7f9bc2ffd640 1 -- 172.21.15.84:0/4198496489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f451b0 msgr2=0x55b0a232cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.673+0000 7f9bc2ffd640 1 --2- 172.21.15.84:0/4198496489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f451b0 0x55b0a232cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.673+0000 7f9bc2ffd640 1 -- 172.21.15.84:0/4198496489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0a2317800 con 0x55b0a1f2c9f0 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.673+0000 7f9bc2ffd640 1 --2- 172.21.15.84:0/4198496489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f2c9f0 0x55b0a23225c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4011cf0 tx=0x7f9bb4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0e5de36235fe6c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.674+0000 7f9ba8ff9640 1 -- 172.21.15.84:0/4198496489 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4004d20 con 0x55b0a1f2c9f0 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.674+0000 7f9ba8ff9640 1 -- 172.21.15.84:0/4198496489 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bb400fd30 con 0x55b0a1f2c9f0 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.674+0000 7f9ba8ff9640 1 -- 172.21.15.84:0/4198496489 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb4005020 con 0x55b0a1f2c9f0 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.674+0000 7f9bcfae9740 1 -- 172.21.15.84:0/4198496489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f2c9f0 msgr2=0x55b0a23225c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.674+0000 7f9bcfae9740 1 --2- 172.21.15.84:0/4198496489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f2c9f0 0x55b0a23225c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4011cf0 tx=0x7f9bb4014000 comp rx=0 tx=0).stop 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.674+0000 7f9bcfae9740 1 -- 172.21.15.84:0/4198496489 shutdown_connections 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.674+0000 7f9bcfae9740 1 --2- 172.21.15.84:0/4198496489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f4d390 0x55b0a231db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.674+0000 7f9bcfae9740 1 --2- 172.21.15.84:0/4198496489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f451b0 0x55b0a232cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.674+0000 7f9bcfae9740 1 --2- 172.21.15.84:0/4198496489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f2c9f0 0x55b0a23225c0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.674+0000 7f9bcfae9740 1 -- 172.21.15.84:0/4198496489 >> 172.21.15.84:0/4198496489 conn(0x55b0a1f62460 msgr2=0x55b0a2321eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.674+0000 7f9bcfae9740 1 -- 172.21.15.84:0/4198496489 shutdown_connections 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.674+0000 7f9bcfae9740 1 -- 172.21.15.84:0/4198496489 wait complete. 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.675+0000 7f9bcfae9740 1 -- start start 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.675+0000 7f9bcfae9740 1 Processor -- start 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.675+0000 7f9bcfae9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f2c9f0 0x55b0a2325640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.675+0000 7f9bcfae9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f451b0 0x55b0a2325be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.675+0000 7f9bcfae9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f4d390 0x55b0a23964e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.675+0000 7f9bcfae9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc41ada00 con 0x55b0a1f451b0 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.675+0000 7f9bcfae9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc41aee70 con 0x55b0a1f4d390 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.675+0000 7f9bcfae9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc41ae0d0 con 0x55b0a1f2c9f0 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.675+0000 7f9bcfae9740 10 client.0 _ll_register_callbacks cb 0x7f9bb80a9b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.675+0000 7f9bc27fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f451b0 0x55b0a2325be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.675+0000 7f9bc27fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f451b0 0x55b0a2325be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42432/0 (socket says 172.21.15.84:42432) 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.675+0000 7f9bc27fc640 1 -- 172.21.15.84:0/2086239445 learned_addr learned my addr 172.21.15.84:0/2086239445 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.675+0000 7f9bc2ffd640 1 --2- 172.21.15.84:0/2086239445 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f2c9f0 0x55b0a2325640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.675+0000 7f9bc37fe640 1 --2- 172.21.15.84:0/2086239445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f4d390 0x55b0a23964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9bc27fc640 1 -- 172.21.15.84:0/2086239445 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f2c9f0 msgr2=0x55b0a2325640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9bc27fc640 1 --2- 172.21.15.84:0/2086239445 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f2c9f0 0x55b0a2325640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9bc27fc640 1 -- 172.21.15.84:0/2086239445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f4d390 msgr2=0x55b0a23964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9bc27fc640 1 --2- 172.21.15.84:0/2086239445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f4d390 0x55b0a23964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9bc27fc640 1 -- 172.21.15.84:0/2086239445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0a2396b50 con 0x55b0a1f451b0 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9bc2ffd640 1 --2- 172.21.15.84:0/2086239445 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f2c9f0 0x55b0a2325640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9bc37fe640 1 --2- 172.21.15.84:0/2086239445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f4d390 0x55b0a23964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9bc27fc640 1 --2- 172.21.15.84:0/2086239445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f451b0 0x55b0a2325be0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80aa930 tx=0x7f9bb80acd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a706f75ad8c0412 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9ba6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9ba6ff5640 1 -- 172.21.15.84:0/2086239445 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb805c020 con 0x55b0a1f451b0 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9ba6ff5640 1 -- 172.21.15.84:0/2086239445 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f9bb80a9220 con 0x55b0a1f451b0 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9bcfae9740 1 -- 172.21.15.84:0/2086239445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bb400fd30 con 0x55b0a1f451b0 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9ba6ff5640 1 -- 172.21.15.84:0/2086239445 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9bb80ad010 con 0x55b0a1f451b0 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9bcfae9740 10 client.15885 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9bcfae9740 1 -- 172.21.15.84:0/2086239445 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b0a239df20 con 0x55b0a1f451b0 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9ba6ff5640 1 -- 172.21.15.84:0/2086239445 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bb400fd30 con 0x55b0a1f451b0 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9ba6ff5640 1 -- 172.21.15.84:0/2086239445 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9bb80b3330 con 0x55b0a1f451b0 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9bcfae9740 10 client.15885 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9bcfae9740 10 client.15885 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9bcfae9740 20 client.15885 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9bcfae9740 1 --2- 172.21.15.84:0/2086239445 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55b0a1f6e070 0x55b0a23a0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9bcfae9740 4 client.15885 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.676+0000 7f9bcfae9740 1 -- 172.21.15.84:0/2086239445 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b0a22898a0 con 0x55b0a1f6e070 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.677+0000 7f9bc2ffd640 1 --2- 172.21.15.84:0/2086239445 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55b0a1f6e070 0x55b0a23a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.677+0000 7f9ba6ff5640 10 client.15885 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.677+0000 7f9bc2ffd640 1 --2- 172.21.15.84:0/2086239445 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55b0a1f6e070 0x55b0a23a0730 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f33cfd7c055b857b server_cookie=75a0ea1dd852c793 in_seq=0 out_seq=0 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.677+0000 7f9ba6ff5640 1 -- 172.21.15.84:0/2086239445 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b0a22898a0 con 0x55b0a1f6e070 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.677+0000 7f9ba6ff5640 10 client.15885 handle_command_reply: tid=0 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.677+0000 7f9bcfae9740 1 client.15885 shutdown 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.678+0000 7f9bcfae9740 1 -- 172.21.15.84:0/2086239445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f451b0 msgr2=0x55b0a2325be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.678+0000 7f9bcfae9740 1 --2- 172.21.15.84:0/2086239445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f451b0 0x55b0a2325be0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80aa930 tx=0x7f9bb80acd60 comp rx=0 tx=0).stop 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.678+0000 7f9bcfae9740 1 -- 172.21.15.84:0/2086239445 shutdown_connections 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.678+0000 7f9bcfae9740 1 --2- 172.21.15.84:0/2086239445 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55b0a1f6e070 0x55b0a23a0730 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.678+0000 7f9bcfae9740 1 --2- 172.21.15.84:0/2086239445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0a1f4d390 0x55b0a23964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.678+0000 7f9ba6ff5640 0 client.15885 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.678+0000 7f9bcfae9740 1 --2- 172.21.15.84:0/2086239445 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0a1f451b0 0x55b0a2325be0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.678+0000 7f9bcfae9740 1 --2- 172.21.15.84:0/2086239445 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0a1f2c9f0 0x55b0a2325640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.678+0000 7f9bcfae9740 1 -- 172.21.15.84:0/2086239445 >> 172.21.15.84:0/2086239445 conn(0x55b0a1f62460 msgr2=0x55b0a2321c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.678+0000 7f9bcfae9740 1 -- 172.21.15.84:0/2086239445 shutdown_connections 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.678+0000 7f9bcfae9740 1 -- 172.21.15.84:0/2086239445 wait complete. 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.678+0000 7f9bcfae9740 20 client.15885 trim_cache size 0 max 16384 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.678+0000 7f9bc9575640 1 -- 172.21.15.84:0/2811618273 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9bac0b66b0 msgr2=0x7f9bac0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.678+0000 7f9bc9575640 1 --2- 172.21.15.84:0/2811618273 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9bac0b66b0 0x7f9bac0b8bc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55b0a2313f40 tx=0x7f9bb40077a0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.678+0000 7f9bc9575640 1 -- 172.21.15.84:0/2811618273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bc41094b0 msgr2=0x7f9bc419a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.678+0000 7f9bc9575640 1 --2- 172.21.15.84:0/2811618273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bc41094b0 0x7f9bc419a930 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800c8c0 tx=0x7f9bb800cd80 comp rx=0 tx=0).stop 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.679+0000 7f9bc9575640 1 -- 172.21.15.84:0/2811618273 shutdown_connections 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.679+0000 7f9bc9575640 1 --2- 172.21.15.84:0/2811618273 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9bac0b66b0 0x7f9bac0b8bc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.679+0000 7f9bc9575640 1 --2- 172.21.15.84:0/2811618273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9bc4109e00 0x7f9bc419fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.679+0000 7f9bc9575640 1 --2- 172.21.15.84:0/2811618273 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9bc41094b0 0x7f9bc419a930 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.679+0000 7f9bc9575640 1 --2- 172.21.15.84:0/2811618273 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bc4101f70 0x7f9bc419a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.679+0000 7f9bc9575640 1 -- 172.21.15.84:0/2811618273 >> 172.21.15.84:0/2811618273 conn(0x7f9bc4077c60 msgr2=0x7f9bc4107460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:15.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.679+0000 7f9bc9575640 1 -- 172.21.15.84:0/2811618273 shutdown_connections 2024-09-21T03:44:15.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:15.679+0000 7f9bc9575640 1 -- 172.21.15.84:0/2811618273 wait complete. 2024-09-21T03:44:15.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:15 smithi174 ceph-mon[34403]: pgmap v377: 97 pgs: 97 active+clean; 2.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 37 KiB/s wr, 26 op/s 2024-09-21T03:44:15.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:15 smithi172 ceph-mon[34821]: pgmap v377: 97 pgs: 97 active+clean; 2.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 37 KiB/s wr, 26 op/s 2024-09-21T03:44:16.496 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:44:16.743 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:17.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.268+0000 7f2924f47640 1 -- 172.21.15.84:0/1857460361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2920106c20 msgr2=0x7f2920110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:17.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.268+0000 7f2924f47640 1 --2- 172.21.15.84:0/1857460361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2920106c20 0x7f2920110670 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2918009900 tx=0x7f291802a410 comp rx=0 tx=0).stop 2024-09-21T03:44:17.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.268+0000 7f2924f47640 1 -- 172.21.15.84:0/1857460361 shutdown_connections 2024-09-21T03:44:17.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.268+0000 7f2924f47640 1 --2- 172.21.15.84:0/1857460361 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2920106c20 0x7f2920110670 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.268+0000 7f2924f47640 1 --2- 172.21.15.84:0/1857460361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29201062d0 0x7f29201066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.268+0000 7f2924f47640 1 --2- 172.21.15.84:0/1857460361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2920101ff0 0x7f2920102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.268+0000 7f2924f47640 1 -- 172.21.15.84:0/1857460361 >> 172.21.15.84:0/1857460361 conn(0x7f2920079e30 msgr2=0x7f292007a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:17.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.268+0000 7f2924f47640 1 -- 172.21.15.84:0/1857460361 shutdown_connections 2024-09-21T03:44:17.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.268+0000 7f2924f47640 1 -- 172.21.15.84:0/1857460361 wait complete. 2024-09-21T03:44:17.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.269+0000 7f2924f47640 1 Processor -- start 2024-09-21T03:44:17.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.269+0000 7f2924f47640 1 -- start start 2024-09-21T03:44:17.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.269+0000 7f2924f47640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2920101ff0 0x7f292019c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:17.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.269+0000 7f2924f47640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29201062d0 0x7f292019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:17.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.269+0000 7f2924f47640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2920106c20 0x7f29201a2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:17.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.269+0000 7f2924f47640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2920113ba0 con 0x7f29201062d0 2024-09-21T03:44:17.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.269+0000 7f2924f47640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2920113a20 con 0x7f2920101ff0 2024-09-21T03:44:17.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.269+0000 7f2924f47640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2920113d20 con 0x7f2920106c20 2024-09-21T03:44:17.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.269+0000 7f291dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29201062d0 0x7f292019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:17.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.269+0000 7f291dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29201062d0 0x7f292019cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42458/0 (socket says 172.21.15.84:42458) 2024-09-21T03:44:17.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.269+0000 7f291dd9b640 1 -- 172.21.15.84:0/2156665858 learned_addr learned my addr 172.21.15.84:0/2156665858 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:17.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.269+0000 7f291e59c640 1 --2- 172.21.15.84:0/2156665858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2920101ff0 0x7f292019c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:17.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.269+0000 7f291ed9d640 1 --2- 172.21.15.84:0/2156665858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2920106c20 0x7f29201a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:17.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.269+0000 7f291dd9b640 1 -- 172.21.15.84:0/2156665858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2920106c20 msgr2=0x7f29201a2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:17.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.269+0000 7f291dd9b640 1 --2- 172.21.15.84:0/2156665858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2920106c20 0x7f29201a2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.269+0000 7f291dd9b640 1 -- 172.21.15.84:0/2156665858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2920101ff0 msgr2=0x7f292019c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:17.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.269+0000 7f291dd9b640 1 --2- 172.21.15.84:0/2156665858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2920101ff0 0x7f292019c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.269+0000 7f291dd9b640 1 -- 172.21.15.84:0/2156665858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29201a27c0 con 0x7f29201062d0 2024-09-21T03:44:17.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.269+0000 7f291e59c640 1 --2- 172.21.15.84:0/2156665858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2920101ff0 0x7f292019c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:17.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.270+0000 7f291dd9b640 1 --2- 172.21.15.84:0/2156665858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29201062d0 0x7f292019cdf0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f291400b450 tx=0x7f291400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:17.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.270+0000 7f290f7fe640 1 -- 172.21.15.84:0/2156665858 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2914015020 con 0x7f29201062d0 2024-09-21T03:44:17.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.270+0000 7f290f7fe640 1 -- 172.21.15.84:0/2156665858 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2914011d40 con 0x7f29201062d0 2024-09-21T03:44:17.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.270+0000 7f2924f47640 1 -- 172.21.15.84:0/2156665858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29201a2ab0 con 0x7f29201062d0 2024-09-21T03:44:17.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.270+0000 7f290f7fe640 1 -- 172.21.15.84:0/2156665858 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291400f340 con 0x7f29201062d0 2024-09-21T03:44:17.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.270+0000 7f2924f47640 1 -- 172.21.15.84:0/2156665858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29201a9210 con 0x7f29201062d0 2024-09-21T03:44:17.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.273+0000 7f292b4bb740 1 Processor -- start 2024-09-21T03:44:17.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.273+0000 7f292b4bb740 1 -- start start 2024-09-21T03:44:17.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.273+0000 7f290f7fe640 1 -- 172.21.15.84:0/2156665858 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f2914018020 con 0x7f29201062d0 2024-09-21T03:44:17.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.273+0000 7f292b4bb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9da1c070 0x55cb9ddc36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:17.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.273+0000 7f292b4bb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9f31b0 0x55cb9ddc3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:17.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.273+0000 7f292b4bb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9d9fb390 0x55cb9ddc4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:17.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.273+0000 7f292b4bb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cb9dd39ea0 con 0x55cb9d9f31b0 2024-09-21T03:44:17.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.273+0000 7f292b4bb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cb9dd292d0 con 0x55cb9d9fb390 2024-09-21T03:44:17.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.273+0000 7f292b4bb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55cb9dd2d0e0 con 0x55cb9da1c070 2024-09-21T03:44:17.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.273+0000 7f291e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9f31b0 0x55cb9ddc3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:17.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.273+0000 7f291e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9f31b0 0x55cb9ddc3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42468/0 (socket says 172.21.15.84:42468) 2024-09-21T03:44:17.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.273+0000 7f291e59c640 1 -- 172.21.15.84:0/649905012 learned_addr learned my addr 172.21.15.84:0/649905012 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:17.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.273+0000 7f291ed9d640 1 --2- 172.21.15.84:0/649905012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9da1c070 0x55cb9ddc36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:17.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.273+0000 7f291dd9b640 1 --2- 172.21.15.84:0/649905012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9d9fb390 0x55cb9ddc4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:17.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.273+0000 7f291e59c640 1 -- 172.21.15.84:0/649905012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9da1c070 msgr2=0x55cb9ddc36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:17.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.273+0000 7f291e59c640 1 --2- 172.21.15.84:0/649905012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9da1c070 0x55cb9ddc36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.274+0000 7f291e59c640 1 -- 172.21.15.84:0/649905012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9d9fb390 msgr2=0x55cb9ddc4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:17.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.274+0000 7f291e59c640 1 --2- 172.21.15.84:0/649905012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9d9fb390 0x55cb9ddc4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.274+0000 7f291e59c640 1 -- 172.21.15.84:0/649905012 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb9da87650 con 0x55cb9d9f31b0 2024-09-21T03:44:17.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.274+0000 7f291dd9b640 1 --2- 172.21.15.84:0/649905012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9d9fb390 0x55cb9ddc4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:17.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.274+0000 7f291e59c640 1 --2- 172.21.15.84:0/649905012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9f31b0 0x55cb9ddc3be0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f291000c4a0 tx=0x7f291000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d29d2345ca7c6cc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:17.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.274+0000 7f290cff9640 1 -- 172.21.15.84:0/649905012 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291001a070 con 0x55cb9d9f31b0 2024-09-21T03:44:17.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.274+0000 7f290f7fe640 1 --2- 172.21.15.84:0/2156665858 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29080b6680 0x7f29080b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:17.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.274+0000 7f290cff9640 1 -- 172.21.15.84:0/649905012 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29100158c0 con 0x55cb9d9f31b0 2024-09-21T03:44:17.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.274+0000 7f290cff9640 1 -- 172.21.15.84:0/649905012 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291000a820 con 0x55cb9d9f31b0 2024-09-21T03:44:17.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.274+0000 7f291ed9d640 1 --2- 172.21.15.84:0/2156665858 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29080b6680 0x7f29080b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:17.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.274+0000 7f290f7fe640 1 -- 172.21.15.84:0/2156665858 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f29140e7190 con 0x7f29201062d0 2024-09-21T03:44:17.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.275+0000 7f292b4bb740 1 -- 172.21.15.84:0/649905012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9f31b0 msgr2=0x55cb9ddc3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:17.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.275+0000 7f291ed9d640 1 --2- 172.21.15.84:0/2156665858 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29080b6680 0x7f29080b8b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f29180096c0 tx=0x7f2918005e60 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:17.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.275+0000 7f292b4bb740 1 --2- 172.21.15.84:0/649905012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9f31b0 0x55cb9ddc3be0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f291000c4a0 tx=0x7f291000c8a0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.275+0000 7f292b4bb740 1 -- 172.21.15.84:0/649905012 shutdown_connections 2024-09-21T03:44:17.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.275+0000 7f292b4bb740 1 --2- 172.21.15.84:0/649905012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9d9fb390 0x55cb9ddc4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.275+0000 7f292b4bb740 1 --2- 172.21.15.84:0/649905012 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9f31b0 0x55cb9ddc3be0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.275+0000 7f292b4bb740 1 --2- 172.21.15.84:0/649905012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9da1c070 0x55cb9ddc36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.275+0000 7f292b4bb740 1 -- 172.21.15.84:0/649905012 >> 172.21.15.84:0/649905012 conn(0x55cb9da10460 msgr2=0x55cb9ddc1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:17.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.275+0000 7f292b4bb740 1 -- 172.21.15.84:0/649905012 shutdown_connections 2024-09-21T03:44:17.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.275+0000 7f292b4bb740 1 -- 172.21.15.84:0/649905012 wait complete. 2024-09-21T03:44:17.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.275+0000 7f292b4bb740 1 -- start start 2024-09-21T03:44:17.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.276+0000 7f292b4bb740 1 Processor -- start 2024-09-21T03:44:17.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.276+0000 7f292b4bb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9d9f31b0 0x55cb9ddcecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:17.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.276+0000 7f292b4bb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 0x55cb9ddcf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:17.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.276+0000 7f292b4bb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9da1c070 0x55cb9ddcf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:17.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.276+0000 7f292b4bb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cb9db8a700 con 0x55cb9d9fb390 2024-09-21T03:44:17.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.276+0000 7f292b4bb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cb9dcc4160 con 0x55cb9da1c070 2024-09-21T03:44:17.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.276+0000 7f292b4bb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55cb9ddd1e80 con 0x55cb9d9f31b0 2024-09-21T03:44:17.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.276+0000 7f292b4bb740 10 client.0 _ll_register_callbacks cb 0x55cb9dcdd9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:17.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.277+0000 7f291dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 0x55cb9ddcf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:17.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.277+0000 7f291dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 0x55cb9ddcf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42470/0 (socket says 172.21.15.84:42470) 2024-09-21T03:44:17.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.277+0000 7f291dd9b640 1 -- 172.21.15.84:0/2503016209 learned_addr learned my addr 172.21.15.84:0/2503016209 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:17.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.277+0000 7f291e59c640 1 --2- 172.21.15.84:0/2503016209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9d9f31b0 0x55cb9ddcecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:17.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.277+0000 7f291ed9d640 1 --2- 172.21.15.84:0/2503016209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9da1c070 0x55cb9ddcf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:17.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.277+0000 7f291dd9b640 1 -- 172.21.15.84:0/2503016209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9d9f31b0 msgr2=0x55cb9ddcecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:17.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.277+0000 7f291dd9b640 1 --2- 172.21.15.84:0/2503016209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9d9f31b0 0x55cb9ddcecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.277+0000 7f291dd9b640 1 -- 172.21.15.84:0/2503016209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9da1c070 msgr2=0x55cb9ddcf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:17.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.277+0000 7f291dd9b640 1 --2- 172.21.15.84:0/2503016209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9da1c070 0x55cb9ddcf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.277+0000 7f291dd9b640 1 -- 172.21.15.84:0/2503016209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb9dcf1c90 con 0x55cb9d9fb390 2024-09-21T03:44:17.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.277+0000 7f291dd9b640 1 --2- 172.21.15.84:0/2503016209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 0x55cb9ddcf210 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2914009fd0 tx=0x7f2914017f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca46d434b7440d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:17.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.277+0000 7f2905ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:17.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.277+0000 7f2905ffb640 1 -- 172.21.15.84:0/2503016209 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2914009280 con 0x55cb9d9fb390 2024-09-21T03:44:17.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.277+0000 7f2905ffb640 1 -- 172.21.15.84:0/2503016209 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f29140ac4c0 con 0x55cb9d9fb390 2024-09-21T03:44:17.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.277+0000 7f292b4bb740 1 -- 172.21.15.84:0/2503016209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29100158c0 con 0x55cb9d9fb390 2024-09-21T03:44:17.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.278+0000 7f2905ffb640 1 -- 172.21.15.84:0/2503016209 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f29140acb70 con 0x55cb9d9fb390 2024-09-21T03:44:17.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.278+0000 7f292b4bb740 10 client.15897 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:17.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.278+0000 7f292b4bb740 1 -- 172.21.15.84:0/2503016209 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cb9dddda50 con 0x55cb9d9fb390 2024-09-21T03:44:17.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.278+0000 7f2905ffb640 1 -- 172.21.15.84:0/2503016209 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29100158c0 con 0x55cb9d9fb390 2024-09-21T03:44:17.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.278+0000 7f2905ffb640 1 -- 172.21.15.84:0/2503016209 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f29140a89b0 con 0x55cb9d9fb390 2024-09-21T03:44:17.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.278+0000 7f292b4bb740 10 client.15897 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:17.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.278+0000 7f292b4bb740 10 client.15897 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:44:17.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.278+0000 7f292b4bb740 20 client.15897 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:17.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.278+0000 7f292b4bb740 1 --2- 172.21.15.84:0/2503016209 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55cb9d9da9f0 0x55cb9dde0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:17.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.278+0000 7f292b4bb740 4 client.15897 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:44:17.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.278+0000 7f292b4bb740 1 -- 172.21.15.84:0/2503016209 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb9dd3bdf0 con 0x55cb9d9da9f0 2024-09-21T03:44:17.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.278+0000 7f291e59c640 1 --2- 172.21.15.84:0/2503016209 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55cb9d9da9f0 0x55cb9dde0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:17.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.279+0000 7f2905ffb640 10 client.15897 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:17.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.279+0000 7f291e59c640 1 --2- 172.21.15.84:0/2503016209 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55cb9d9da9f0 0x55cb9dde0ec0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90b117a6724d6997 server_cookie=7524bc642907614f in_seq=0 out_seq=0 2024-09-21T03:44:17.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.280+0000 7f2905ffb640 1 -- 172.21.15.84:0/2503016209 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cb9dd3bdf0 con 0x55cb9d9da9f0 2024-09-21T03:44:17.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.280+0000 7f2905ffb640 10 client.15897 handle_command_reply: tid=0 2024-09-21T03:44:17.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.280+0000 7f292b4bb740 1 client.15897 shutdown 2024-09-21T03:44:17.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.280+0000 7f292b4bb740 1 -- 172.21.15.84:0/2503016209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 msgr2=0x55cb9ddcf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:17.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.280+0000 7f292b4bb740 1 --2- 172.21.15.84:0/2503016209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 0x55cb9ddcf210 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2914009fd0 tx=0x7f2914017f60 comp rx=0 tx=0).stop 2024-09-21T03:44:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.280+0000 7f292b4bb740 1 -- 172.21.15.84:0/2503016209 shutdown_connections 2024-09-21T03:44:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.280+0000 7f292b4bb740 1 --2- 172.21.15.84:0/2503016209 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55cb9d9da9f0 0x55cb9dde0ec0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.280+0000 7f292b4bb740 1 --2- 172.21.15.84:0/2503016209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9da1c070 0x55cb9ddcf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.280+0000 7f292b4bb740 1 --2- 172.21.15.84:0/2503016209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 0x55cb9ddcf210 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.280+0000 7f292b4bb740 1 --2- 172.21.15.84:0/2503016209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9d9f31b0 0x55cb9ddcecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.280+0000 7f292b4bb740 1 -- 172.21.15.84:0/2503016209 >> 172.21.15.84:0/2503016209 conn(0x55cb9da10460 msgr2=0x55cb9ddc6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.280+0000 7f2905ffb640 0 client.15897 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.280+0000 7f292b4bb740 1 -- 172.21.15.84:0/2503016209 shutdown_connections 2024-09-21T03:44:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.280+0000 7f292b4bb740 1 -- 172.21.15.84:0/2503016209 wait complete. 2024-09-21T03:44:17.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.280+0000 7f292b4bb740 20 client.15897 trim_cache size 0 max 16384 2024-09-21T03:44:17.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.293+0000 7f292b4bb740 1 Processor -- start 2024-09-21T03:44:17.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.293+0000 7f292b4bb740 1 -- start start 2024-09-21T03:44:17.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.293+0000 7f292b4bb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9d9f31b0 0x55cb9ddc7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:17.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.293+0000 7f292b4bb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 0x55cb9ddc4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:17.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.293+0000 7f292b4bb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9da1c070 0x55cb9ddcbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:17.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.293+0000 7f292b4bb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f29201b4060 con 0x55cb9d9fb390 2024-09-21T03:44:17.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.293+0000 7f292b4bb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f29201b1930 con 0x55cb9da1c070 2024-09-21T03:44:17.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.293+0000 7f292b4bb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f29201af780 con 0x55cb9d9f31b0 2024-09-21T03:44:17.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.293+0000 7f291dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 0x55cb9ddc4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:17.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.293+0000 7f291dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 0x55cb9ddc4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42474/0 (socket says 172.21.15.84:42474) 2024-09-21T03:44:17.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.293+0000 7f291dd9b640 1 -- 172.21.15.84:0/2442634041 learned_addr learned my addr 172.21.15.84:0/2442634041 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:17.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.294+0000 7f291e59c640 1 --2- 172.21.15.84:0/2442634041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9d9f31b0 0x55cb9ddc7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:17.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.294+0000 7f291ed9d640 1 --2- 172.21.15.84:0/2442634041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9da1c070 0x55cb9ddcbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:17.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.294+0000 7f291dd9b640 1 -- 172.21.15.84:0/2442634041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9d9f31b0 msgr2=0x55cb9ddc7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:17.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.294+0000 7f291dd9b640 1 --2- 172.21.15.84:0/2442634041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9d9f31b0 0x55cb9ddc7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.294+0000 7f291dd9b640 1 -- 172.21.15.84:0/2442634041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9da1c070 msgr2=0x55cb9ddcbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:17.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.294+0000 7f291dd9b640 1 --2- 172.21.15.84:0/2442634041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9da1c070 0x55cb9ddcbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.294+0000 7f291dd9b640 1 -- 172.21.15.84:0/2442634041 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb9ddc6500 con 0x55cb9d9fb390 2024-09-21T03:44:17.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.294+0000 7f291ed9d640 1 --2- 172.21.15.84:0/2442634041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9da1c070 0x55cb9ddcbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:17.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.294+0000 7f291dd9b640 1 --2- 172.21.15.84:0/2442634041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 0x55cb9ddc4de0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f29140aa2d0 tx=0x7f29140047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82039d516eb7037 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:17.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.294+0000 7f2907fff640 1 -- 172.21.15.84:0/2442634041 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2914009280 con 0x55cb9d9fb390 2024-09-21T03:44:17.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.294+0000 7f2907fff640 1 -- 172.21.15.84:0/2442634041 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29140ad760 con 0x55cb9d9fb390 2024-09-21T03:44:17.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.294+0000 7f2907fff640 1 -- 172.21.15.84:0/2442634041 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29140c82d0 con 0x55cb9d9fb390 2024-09-21T03:44:17.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.295+0000 7f292b4bb740 1 -- 172.21.15.84:0/2442634041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 msgr2=0x55cb9ddc4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:17.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.295+0000 7f292b4bb740 1 --2- 172.21.15.84:0/2442634041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 0x55cb9ddc4de0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f29140aa2d0 tx=0x7f29140047d0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.295+0000 7f292b4bb740 1 -- 172.21.15.84:0/2442634041 shutdown_connections 2024-09-21T03:44:17.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.295+0000 7f292b4bb740 1 --2- 172.21.15.84:0/2442634041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9da1c070 0x55cb9ddcbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.295+0000 7f292b4bb740 1 --2- 172.21.15.84:0/2442634041 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 0x55cb9ddc4de0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.295+0000 7f292b4bb740 1 --2- 172.21.15.84:0/2442634041 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9d9f31b0 0x55cb9ddc7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.295+0000 7f292b4bb740 1 -- 172.21.15.84:0/2442634041 >> 172.21.15.84:0/2442634041 conn(0x55cb9da10460 msgr2=0x55cb9ddc46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:17.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.295+0000 7f292b4bb740 1 -- 172.21.15.84:0/2442634041 shutdown_connections 2024-09-21T03:44:17.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.295+0000 7f292b4bb740 1 -- 172.21.15.84:0/2442634041 wait complete. 2024-09-21T03:44:17.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.295+0000 7f292b4bb740 1 -- start start 2024-09-21T03:44:17.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.295+0000 7f292b4bb740 1 Processor -- start 2024-09-21T03:44:17.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f292b4bb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9d9f31b0 0x55cb9ddd3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:17.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f292b4bb740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 0x55cb9ddd3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:17.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f292b4bb740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9da1c070 0x55cb9ddd3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:17.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f292b4bb740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f29201afdf0 con 0x55cb9d9fb390 2024-09-21T03:44:17.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f292b4bb740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f29201b1260 con 0x55cb9da1c070 2024-09-21T03:44:17.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f292b4bb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f29201b04c0 con 0x55cb9d9f31b0 2024-09-21T03:44:17.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f292b4bb740 10 client.0 _ll_register_callbacks cb 0x7f2914011ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:17.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f291dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 0x55cb9ddd3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:17.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f291dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 0x55cb9ddd3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:42490/0 (socket says 172.21.15.84:42490) 2024-09-21T03:44:17.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f291dd9b640 1 -- 172.21.15.84:0/2764981919 learned_addr learned my addr 172.21.15.84:0/2764981919 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:17.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f291e59c640 1 --2- 172.21.15.84:0/2764981919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9d9f31b0 0x55cb9ddd3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:17.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f291ed9d640 1 --2- 172.21.15.84:0/2764981919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9da1c070 0x55cb9ddd3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:17.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f291dd9b640 1 -- 172.21.15.84:0/2764981919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9d9f31b0 msgr2=0x55cb9ddd3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:17.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f291dd9b640 1 --2- 172.21.15.84:0/2764981919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9d9f31b0 0x55cb9ddd3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f291dd9b640 1 -- 172.21.15.84:0/2764981919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9da1c070 msgr2=0x55cb9ddd3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:17.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f291dd9b640 1 --2- 172.21.15.84:0/2764981919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9da1c070 0x55cb9ddd3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f291dd9b640 1 -- 172.21.15.84:0/2764981919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb9de4a890 con 0x55cb9d9fb390 2024-09-21T03:44:17.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f291ed9d640 1 --2- 172.21.15.84:0/2764981919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9da1c070 0x55cb9ddd3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:17.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f291dd9b640 1 --2- 172.21.15.84:0/2764981919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 0x55cb9ddd3640 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f29140e7160 tx=0x7f29140103e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc22ef7782dae00 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:17.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f2905ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:17.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f2905ffb640 1 -- 172.21.15.84:0/2764981919 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2914009280 con 0x55cb9d9fb390 2024-09-21T03:44:17.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.296+0000 7f2905ffb640 1 -- 172.21.15.84:0/2764981919 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f29140ac2c0 con 0x55cb9d9fb390 2024-09-21T03:44:17.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.297+0000 7f292b4bb740 1 -- 172.21.15.84:0/2764981919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29140ad760 con 0x55cb9d9fb390 2024-09-21T03:44:17.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.297+0000 7f2905ffb640 1 -- 172.21.15.84:0/2764981919 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f29140b6a80 con 0x55cb9d9fb390 2024-09-21T03:44:17.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.297+0000 7f292b4bb740 10 client.15903 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:17.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.297+0000 7f292b4bb740 1 -- 172.21.15.84:0/2764981919 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cb9de4a890 con 0x55cb9d9fb390 2024-09-21T03:44:17.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.297+0000 7f2905ffb640 1 -- 172.21.15.84:0/2764981919 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29140ad760 con 0x55cb9d9fb390 2024-09-21T03:44:17.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.297+0000 7f2905ffb640 1 -- 172.21.15.84:0/2764981919 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f29140b2cd0 con 0x55cb9d9fb390 2024-09-21T03:44:17.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.297+0000 7f292b4bb740 10 client.15903 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:17.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.297+0000 7f292b4bb740 10 client.15903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:44:17.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.297+0000 7f292b4bb740 20 client.15903 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:17.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.297+0000 7f292b4bb740 1 --2- 172.21.15.84:0/2764981919 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55cb9d9afda0 0x55cb9de4ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:17.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.297+0000 7f292b4bb740 4 client.15903 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:44:17.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.297+0000 7f292b4bb740 1 -- 172.21.15.84:0/2764981919 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cb9dd378a0 con 0x55cb9d9afda0 2024-09-21T03:44:17.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.297+0000 7f291e59c640 1 --2- 172.21.15.84:0/2764981919 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55cb9d9afda0 0x55cb9de4ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:17.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.298+0000 7f2905ffb640 10 client.15903 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:17.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.298+0000 7f291e59c640 1 --2- 172.21.15.84:0/2764981919 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55cb9d9afda0 0x55cb9de4ddc0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e2bbd971aaabb7d server_cookie=7081b6e1e6163efa in_seq=0 out_seq=0 2024-09-21T03:44:17.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.298+0000 7f2905ffb640 1 -- 172.21.15.84:0/2764981919 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cb9dd378a0 con 0x55cb9d9afda0 2024-09-21T03:44:17.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.298+0000 7f2905ffb640 10 client.15903 handle_command_reply: tid=0 2024-09-21T03:44:17.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.298+0000 7f292b4bb740 1 client.15903 shutdown 2024-09-21T03:44:17.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.298+0000 7f292b4bb740 1 -- 172.21.15.84:0/2764981919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 msgr2=0x55cb9ddd3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:17.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.298+0000 7f292b4bb740 1 --2- 172.21.15.84:0/2764981919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 0x55cb9ddd3640 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f29140e7160 tx=0x7f29140103e0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.298+0000 7f292b4bb740 1 -- 172.21.15.84:0/2764981919 shutdown_connections 2024-09-21T03:44:17.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.298+0000 7f292b4bb740 1 --2- 172.21.15.84:0/2764981919 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55cb9d9afda0 0x55cb9de4ddc0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.298+0000 7f292b4bb740 1 --2- 172.21.15.84:0/2764981919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb9da1c070 0x55cb9ddd3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.298+0000 7f292b4bb740 1 --2- 172.21.15.84:0/2764981919 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cb9d9fb390 0x55cb9ddd3640 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.298+0000 7f2905ffb640 0 client.15903 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:17.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.298+0000 7f292b4bb740 1 --2- 172.21.15.84:0/2764981919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cb9d9f31b0 0x55cb9ddd3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.298+0000 7f292b4bb740 1 -- 172.21.15.84:0/2764981919 >> 172.21.15.84:0/2764981919 conn(0x55cb9da10460 msgr2=0x55cb9ddc6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:17.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.298+0000 7f292b4bb740 1 -- 172.21.15.84:0/2764981919 shutdown_connections 2024-09-21T03:44:17.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.298+0000 7f292b4bb740 1 -- 172.21.15.84:0/2764981919 wait complete. 2024-09-21T03:44:17.305 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.299+0000 7f292b4bb740 20 client.15903 trim_cache size 0 max 16384 2024-09-21T03:44:17.306 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:44:17.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.299+0000 7f2924f47640 1 -- 172.21.15.84:0/2156665858 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29080b6680 msgr2=0x7f29080b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:17.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.299+0000 7f2924f47640 1 --2- 172.21.15.84:0/2156665858 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29080b6680 0x7f29080b8b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f29180096c0 tx=0x7f2918005e60 comp rx=0 tx=0).stop 2024-09-21T03:44:17.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.299+0000 7f2924f47640 1 -- 172.21.15.84:0/2156665858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29201062d0 msgr2=0x7f292019cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:17.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.299+0000 7f2924f47640 1 --2- 172.21.15.84:0/2156665858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29201062d0 0x7f292019cdf0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f291400b450 tx=0x7f291400b910 comp rx=0 tx=0).stop 2024-09-21T03:44:17.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.299+0000 7f2924f47640 1 -- 172.21.15.84:0/2156665858 shutdown_connections 2024-09-21T03:44:17.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.299+0000 7f2924f47640 1 --2- 172.21.15.84:0/2156665858 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29080b6680 0x7f29080b8b90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.299+0000 7f2924f47640 1 --2- 172.21.15.84:0/2156665858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2920106c20 0x7f29201a2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.299+0000 7f2924f47640 1 --2- 172.21.15.84:0/2156665858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29201062d0 0x7f292019cdf0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.299+0000 7f2924f47640 1 --2- 172.21.15.84:0/2156665858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2920101ff0 0x7f292019c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:17.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.299+0000 7f2924f47640 1 -- 172.21.15.84:0/2156665858 >> 172.21.15.84:0/2156665858 conn(0x7f2920079e30 msgr2=0x7f2920107300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:17.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.299+0000 7f2924f47640 1 -- 172.21.15.84:0/2156665858 shutdown_connections 2024-09-21T03:44:17.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:17.299+0000 7f2924f47640 1 -- 172.21.15.84:0/2156665858 wait complete. 2024-09-21T03:44:17.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:17 smithi084 ceph-mon[30941]: pgmap v378: 97 pgs: 97 active+clean; 2.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 10 op/s 2024-09-21T03:44:17.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:17 smithi174 ceph-mon[34403]: pgmap v378: 97 pgs: 97 active+clean; 2.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 10 op/s 2024-09-21T03:44:17.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:17 smithi172 ceph-mon[34821]: pgmap v378: 97 pgs: 97 active+clean; 2.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 10 op/s 2024-09-21T03:44:19.101 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:44:19.101 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:44:19.358 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:19.777 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:19 smithi084 ceph-mon[30941]: pgmap v379: 97 pgs: 97 active+clean; 2.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:44:19.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:19 smithi174 ceph-mon[34403]: pgmap v379: 97 pgs: 97 active+clean; 2.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:44:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.869+0000 7f1f3cb67640 1 -- 172.21.15.84:0/2321081379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f38102a60 msgr2=0x7f1f38102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.869+0000 7f1f3cb67640 1 --2- 172.21.15.84:0/2321081379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f38102a60 0x7f1f38102e70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1f28009900 tx=0x7f1f2802a410 comp rx=0 tx=0).stop 2024-09-21T03:44:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.869+0000 7f1f3cb67640 1 -- 172.21.15.84:0/2321081379 shutdown_connections 2024-09-21T03:44:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.869+0000 7f1f3cb67640 1 --2- 172.21.15.84:0/2321081379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f38108cf0 0x7f1f3810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.869+0000 7f1f3cb67640 1 --2- 172.21.15.84:0/2321081379 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f381083a0 0x7f1f381087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.869+0000 7f1f3cb67640 1 --2- 172.21.15.84:0/2321081379 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f38102a60 0x7f1f38102e70 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.869+0000 7f1f3cb67640 1 -- 172.21.15.84:0/2321081379 >> 172.21.15.84:0/2321081379 conn(0x7f1f38079730 msgr2=0x7f1f38079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.869+0000 7f1f3cb67640 1 -- 172.21.15.84:0/2321081379 shutdown_connections 2024-09-21T03:44:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.869+0000 7f1f3cb67640 1 -- 172.21.15.84:0/2321081379 wait complete. 2024-09-21T03:44:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.870+0000 7f1f3cb67640 1 Processor -- start 2024-09-21T03:44:19.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.870+0000 7f1f3cb67640 1 -- start start 2024-09-21T03:44:19.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.870+0000 7f1f3cb67640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f38102a60 0x7f1f3819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:19.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.870+0000 7f1f3cb67640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f381083a0 0x7f1f3819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:19.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.870+0000 7f1f3cb67640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f38108cf0 0x7f1f3819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:19.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.870+0000 7f1f3cb67640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f381129c0 con 0x7f1f38108cf0 2024-09-21T03:44:19.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.870+0000 7f1f3cb67640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1f38112840 con 0x7f1f381083a0 2024-09-21T03:44:19.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.870+0000 7f1f3cb67640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1f38112b40 con 0x7f1f38102a60 2024-09-21T03:44:19.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.870+0000 7f1f36d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f38108cf0 0x7f1f3819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:19.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.870+0000 7f1f36d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f38108cf0 0x7f1f3819fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40712/0 (socket says 172.21.15.84:40712) 2024-09-21T03:44:19.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.870+0000 7f1f36d9d640 1 -- 172.21.15.84:0/230101951 learned_addr learned my addr 172.21.15.84:0/230101951 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:19.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.871+0000 7f1f3659c640 1 --2- 172.21.15.84:0/230101951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f38102a60 0x7f1f3819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:19.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.871+0000 7f1f2ffff640 1 --2- 172.21.15.84:0/230101951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f381083a0 0x7f1f3819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:19.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.871+0000 7f1f36d9d640 1 -- 172.21.15.84:0/230101951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f38102a60 msgr2=0x7f1f3819a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:19.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.871+0000 7f1f36d9d640 1 --2- 172.21.15.84:0/230101951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f38102a60 0x7f1f3819a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.871+0000 7f1f36d9d640 1 -- 172.21.15.84:0/230101951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f381083a0 msgr2=0x7f1f3819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:19.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.871+0000 7f1f36d9d640 1 --2- 172.21.15.84:0/230101951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f381083a0 0x7f1f3819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.871+0000 7f1f36d9d640 1 -- 172.21.15.84:0/230101951 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f381a0430 con 0x7f1f38108cf0 2024-09-21T03:44:19.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.871+0000 7f1f36d9d640 1 --2- 172.21.15.84:0/230101951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f38108cf0 0x7f1f3819fd00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1f3000cad0 tx=0x7f1f3000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:19.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.871+0000 7f1f2f7fe640 1 -- 172.21.15.84:0/230101951 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3000ad60 con 0x7f1f38108cf0 2024-09-21T03:44:19.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.871+0000 7f1f2f7fe640 1 -- 172.21.15.84:0/230101951 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f30005020 con 0x7f1f38108cf0 2024-09-21T03:44:19.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.871+0000 7f1f3cb67640 1 -- 172.21.15.84:0/230101951 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f381a0720 con 0x7f1f38108cf0 2024-09-21T03:44:19.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.871+0000 7f1f2f7fe640 1 -- 172.21.15.84:0/230101951 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3000f6b0 con 0x7f1f38108cf0 2024-09-21T03:44:19.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.871+0000 7f1f3cb67640 1 -- 172.21.15.84:0/230101951 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f381a6e80 con 0x7f1f38108cf0 2024-09-21T03:44:19.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.874+0000 7f1f430db740 1 Processor -- start 2024-09-21T03:44:19.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.874+0000 7f1f2f7fe640 1 -- 172.21.15.84:0/230101951 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f1f300051d0 con 0x7f1f38108cf0 2024-09-21T03:44:19.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.874+0000 7f1f430db740 1 -- start start 2024-09-21T03:44:19.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.874+0000 7f1f430db740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dd0cd350 0x55b0dd474430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:19.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.874+0000 7f1f430db740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 0x55b0dd474970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:19.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.874+0000 7f1f430db740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0ac670 0x55b0dd474eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:19.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.874+0000 7f1f430db740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b0dd3eae60 con 0x55b0dd0a4490 2024-09-21T03:44:19.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.874+0000 7f1f430db740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b0dd3da290 con 0x55b0dd0ac670 2024-09-21T03:44:19.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.874+0000 7f1f430db740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b0dd3de0a0 con 0x55b0dd0cd350 2024-09-21T03:44:19.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.875+0000 7f1f3659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 0x55b0dd474970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:19.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.875+0000 7f1f3659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 0x55b0dd474970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40720/0 (socket says 172.21.15.84:40720) 2024-09-21T03:44:19.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.875+0000 7f1f3659c640 1 -- 172.21.15.84:0/2818273022 learned_addr learned my addr 172.21.15.84:0/2818273022 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:19.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.875+0000 7f1f2ffff640 1 --2- 172.21.15.84:0/2818273022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dd0cd350 0x55b0dd474430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:19.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.875+0000 7f1f2ffff640 1 --2- 172.21.15.84:0/2818273022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0ac670 0x55b0dd474eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:19.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.875+0000 7f1f2f7fe640 1 --2- 172.21.15.84:0/230101951 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1f240b6680 0x7f1f240b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:19.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.875+0000 7f1f3659c640 1 -- 172.21.15.84:0/2818273022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dd0cd350 msgr2=0x55b0dd474430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:19.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.875+0000 7f1f3659c640 1 --2- 172.21.15.84:0/2818273022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dd0cd350 0x55b0dd474430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.875+0000 7f1f3659c640 1 -- 172.21.15.84:0/2818273022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0ac670 msgr2=0x55b0dd474eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:19.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.875+0000 7f1f3659c640 1 --2- 172.21.15.84:0/2818273022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0ac670 0x55b0dd474eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.875+0000 7f1f3659c640 1 -- 172.21.15.84:0/2818273022 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0dd138930 con 0x55b0dd0a4490 2024-09-21T03:44:19.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.875+0000 7f1f36d9d640 1 --2- 172.21.15.84:0/230101951 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1f240b6680 0x7f1f240b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:19.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.875+0000 7f1f2f7fe640 1 -- 172.21.15.84:0/230101951 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f1f300e7630 con 0x7f1f38108cf0 2024-09-21T03:44:19.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.875+0000 7f1f3659c640 1 --2- 172.21.15.84:0/2818273022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 0x55b0dd474970 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1f28009900 tx=0x7f1f28031e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8afed57814e876ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:19.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.876+0000 7f1f2cff9640 1 -- 172.21.15.84:0/2818273022 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28040070 con 0x55b0dd0a4490 2024-09-21T03:44:19.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.876+0000 7f1f2cff9640 1 -- 172.21.15.84:0/2818273022 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f280316a0 con 0x55b0dd0a4490 2024-09-21T03:44:19.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.876+0000 7f1f2cff9640 1 -- 172.21.15.84:0/2818273022 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28035040 con 0x55b0dd0a4490 2024-09-21T03:44:19.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.877+0000 7f1f430db740 1 -- 172.21.15.84:0/2818273022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 msgr2=0x55b0dd474970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:19.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.877+0000 7f1f430db740 1 --2- 172.21.15.84:0/2818273022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 0x55b0dd474970 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1f28009900 tx=0x7f1f28031e50 comp rx=0 tx=0).stop 2024-09-21T03:44:19.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.877+0000 7f1f36d9d640 1 --2- 172.21.15.84:0/230101951 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1f240b6680 0x7f1f240b8b90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1f300e4eb0 tx=0x7f1f30076020 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:19.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.877+0000 7f1f430db740 1 -- 172.21.15.84:0/2818273022 shutdown_connections 2024-09-21T03:44:19.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.877+0000 7f1f430db740 1 --2- 172.21.15.84:0/2818273022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0ac670 0x55b0dd474eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.877+0000 7f1f430db740 1 --2- 172.21.15.84:0/2818273022 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 0x55b0dd474970 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.877+0000 7f1f430db740 1 --2- 172.21.15.84:0/2818273022 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dd0cd350 0x55b0dd474430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.877+0000 7f1f430db740 1 -- 172.21.15.84:0/2818273022 >> 172.21.15.84:0/2818273022 conn(0x55b0dd0c1740 msgr2=0x55b0dd472320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:19.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.877+0000 7f1f430db740 1 -- 172.21.15.84:0/2818273022 shutdown_connections 2024-09-21T03:44:19.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.877+0000 7f1f430db740 1 -- 172.21.15.84:0/2818273022 wait complete. 2024-09-21T03:44:19.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.877+0000 7f1f430db740 1 -- start start 2024-09-21T03:44:19.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.877+0000 7f1f430db740 1 Processor -- start 2024-09-21T03:44:19.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f430db740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0a4490 0x55b0dd480020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:19.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f430db740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0ac670 0x55b0dd480560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:19.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f430db740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dd0cd350 0x55b0dd48bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:19.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f430db740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55b0dd23b890 con 0x55b0dd0ac670 2024-09-21T03:44:19.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f430db740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b0dd374d40 con 0x55b0dd0a4490 2024-09-21T03:44:19.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f430db740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55b0dd482bb0 con 0x55b0dd0cd350 2024-09-21T03:44:19.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f430db740 10 client.0 _ll_register_callbacks cb 0x55b0dd3d8c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:19.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f3659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0ac670 0x55b0dd480560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:19.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f2ffff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dd0cd350 0x55b0dd48bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:19.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f3659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0ac670 0x55b0dd480560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40728/0 (socket says 172.21.15.84:40728) 2024-09-21T03:44:19.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f3659c640 1 -- 172.21.15.84:0/3195026468 learned_addr learned my addr 172.21.15.84:0/3195026468 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:19.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f2ffff640 1 --2- 172.21.15.84:0/3195026468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0a4490 0x55b0dd480020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:19.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f3659c640 1 -- 172.21.15.84:0/3195026468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dd0cd350 msgr2=0x55b0dd48bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:19.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f3659c640 1 --2- 172.21.15.84:0/3195026468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dd0cd350 0x55b0dd48bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f3659c640 1 -- 172.21.15.84:0/3195026468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0a4490 msgr2=0x55b0dd480020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:19.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f3659c640 1 --2- 172.21.15.84:0/3195026468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0a4490 0x55b0dd480020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f3659c640 1 -- 172.21.15.84:0/3195026468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0dd48c460 con 0x55b0dd0ac670 2024-09-21T03:44:19.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f2ffff640 1 --2- 172.21.15.84:0/3195026468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0a4490 0x55b0dd480020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:19.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f3659c640 1 --2- 172.21.15.84:0/3195026468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0ac670 0x55b0dd480560 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1f28000c00 tx=0x7f1f2802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78529c4b0e1b1fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:19.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:19.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.878+0000 7f1f1dffb640 1 -- 172.21.15.84:0/3195026468 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f2804c070 con 0x55b0dd0ac670 2024-09-21T03:44:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.879+0000 7f1f1dffb640 1 -- 172.21.15.84:0/3195026468 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f1f280047a0 con 0x55b0dd0ac670 2024-09-21T03:44:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.879+0000 7f1f430db740 1 -- 172.21.15.84:0/3195026468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f280316a0 con 0x55b0dd0ac670 2024-09-21T03:44:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.879+0000 7f1f1dffb640 1 -- 172.21.15.84:0/3195026468 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1f28058050 con 0x55b0dd0ac670 2024-09-21T03:44:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.879+0000 7f1f430db740 10 client.15915 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.879+0000 7f1f430db740 1 -- 172.21.15.84:0/3195026468 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b0dd48ed90 con 0x55b0dd0ac670 2024-09-21T03:44:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.879+0000 7f1f1dffb640 1 -- 172.21.15.84:0/3195026468 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f280316a0 con 0x55b0dd0ac670 2024-09-21T03:44:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.879+0000 7f1f1dffb640 1 -- 172.21.15.84:0/3195026468 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1f2803c8a0 con 0x55b0dd0ac670 2024-09-21T03:44:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.879+0000 7f1f430db740 10 client.15915 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.879+0000 7f1f430db740 10 client.15915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:44:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.879+0000 7f1f430db740 20 client.15915 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.879+0000 7f1f430db740 1 --2- 172.21.15.84:0/3195026468 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55b0dd08bcd0 0x55b0dd4920f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.879+0000 7f1f430db740 4 client.15915 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:44:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.879+0000 7f1f430db740 1 -- 172.21.15.84:0/3195026468 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0dd3ecdb0 con 0x55b0dd08bcd0 2024-09-21T03:44:19.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.880+0000 7f1f2ffff640 1 --2- 172.21.15.84:0/3195026468 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55b0dd08bcd0 0x55b0dd4920f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:19.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.880+0000 7f1f2ffff640 1 --2- 172.21.15.84:0/3195026468 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55b0dd08bcd0 0x55b0dd4920f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c6e32c71bdb7f1 server_cookie=72fc83c87472003 in_seq=0 out_seq=0 2024-09-21T03:44:19.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.880+0000 7f1f1dffb640 10 client.15915 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:19.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.881+0000 7f1f1dffb640 1 -- 172.21.15.84:0/3195026468 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b0dd3ecdb0 con 0x55b0dd08bcd0 2024-09-21T03:44:19.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.881+0000 7f1f1dffb640 10 client.15915 handle_command_reply: tid=0 2024-09-21T03:44:19.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.881+0000 7f1f430db740 1 client.15915 shutdown 2024-09-21T03:44:19.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.881+0000 7f1f430db740 1 -- 172.21.15.84:0/3195026468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0ac670 msgr2=0x55b0dd480560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:19.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.881+0000 7f1f430db740 1 --2- 172.21.15.84:0/3195026468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0ac670 0x55b0dd480560 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f1f28000c00 tx=0x7f1f2802a410 comp rx=0 tx=0).stop 2024-09-21T03:44:19.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.881+0000 7f1f430db740 1 -- 172.21.15.84:0/3195026468 shutdown_connections 2024-09-21T03:44:19.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.881+0000 7f1f430db740 1 --2- 172.21.15.84:0/3195026468 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55b0dd08bcd0 0x55b0dd4920f0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.881+0000 7f1f430db740 1 --2- 172.21.15.84:0/3195026468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dd0cd350 0x55b0dd48bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.881+0000 7f1f430db740 1 --2- 172.21.15.84:0/3195026468 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0ac670 0x55b0dd480560 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.881+0000 7f1f430db740 1 --2- 172.21.15.84:0/3195026468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0a4490 0x55b0dd480020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.881+0000 7f1f1dffb640 0 client.15915 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:19.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.881+0000 7f1f430db740 1 -- 172.21.15.84:0/3195026468 >> 172.21.15.84:0/3195026468 conn(0x55b0dd0c1740 msgr2=0x55b0dd4775c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:19.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.881+0000 7f1f430db740 1 -- 172.21.15.84:0/3195026468 shutdown_connections 2024-09-21T03:44:19.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.881+0000 7f1f430db740 1 -- 172.21.15.84:0/3195026468 wait complete. 2024-09-21T03:44:19.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.881+0000 7f1f430db740 20 client.15915 trim_cache size 0 max 16384 2024-09-21T03:44:19.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.898+0000 7f1f430db740 1 Processor -- start 2024-09-21T03:44:19.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.898+0000 7f1f430db740 1 -- start start 2024-09-21T03:44:19.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.899+0000 7f1f430db740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 0x55b0dd48be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:19.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.899+0000 7f1f430db740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0ac670 0x55b0dd479690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:19.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.899+0000 7f1f430db740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dd0cd350 0x55b0dd479bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:19.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.899+0000 7f1f430db740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f381b1e70 con 0x55b0dd0a4490 2024-09-21T03:44:19.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.899+0000 7f1f430db740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1f381af740 con 0x55b0dd0ac670 2024-09-21T03:44:19.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.899+0000 7f1f430db740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1f381ad590 con 0x55b0dd0cd350 2024-09-21T03:44:19.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.899+0000 7f1f2ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 0x55b0dd48be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:19.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.899+0000 7f1f2ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 0x55b0dd48be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40734/0 (socket says 172.21.15.84:40734) 2024-09-21T03:44:19.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.899+0000 7f1f2ffff640 1 -- 172.21.15.84:0/4197645222 learned_addr learned my addr 172.21.15.84:0/4197645222 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:19.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.899+0000 7f1f3659c640 1 --2- 172.21.15.84:0/4197645222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0ac670 0x55b0dd479690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:19.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.899+0000 7f1f2ffff640 1 -- 172.21.15.84:0/4197645222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dd0cd350 msgr2=0x55b0dd479bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:19.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.899+0000 7f1f2ffff640 1 --2- 172.21.15.84:0/4197645222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dd0cd350 0x55b0dd479bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.899+0000 7f1f2ffff640 1 -- 172.21.15.84:0/4197645222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0ac670 msgr2=0x55b0dd479690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:19.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.899+0000 7f1f2ffff640 1 --2- 172.21.15.84:0/4197645222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0ac670 0x55b0dd479690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.899+0000 7f1f2ffff640 1 -- 172.21.15.84:0/4197645222 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0dd4809e0 con 0x55b0dd0a4490 2024-09-21T03:44:19.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.899+0000 7f1f3659c640 1 --2- 172.21.15.84:0/4197645222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0ac670 0x55b0dd479690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:19.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.899+0000 7f1f2ffff640 1 --2- 172.21.15.84:0/4197645222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 0x55b0dd48be40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x55b0dd482bb0 tx=0x7f1f20009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27ef2874ed0da13 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:19.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.899+0000 7f1f1ffff640 1 -- 172.21.15.84:0/4197645222 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f20024070 con 0x55b0dd0a4490 2024-09-21T03:44:19.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.899+0000 7f1f1ffff640 1 -- 172.21.15.84:0/4197645222 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f20017a70 con 0x55b0dd0a4490 2024-09-21T03:44:19.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.899+0000 7f1f1ffff640 1 -- 172.21.15.84:0/4197645222 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f20020a80 con 0x55b0dd0a4490 2024-09-21T03:44:19.903 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:19 smithi172 ceph-mon[34821]: pgmap v379: 97 pgs: 97 active+clean; 2.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:44:19.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.900+0000 7f1f430db740 1 -- 172.21.15.84:0/4197645222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 msgr2=0x55b0dd48be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:19.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.900+0000 7f1f430db740 1 --2- 172.21.15.84:0/4197645222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 0x55b0dd48be40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x55b0dd482bb0 tx=0x7f1f20009470 comp rx=0 tx=0).stop 2024-09-21T03:44:19.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.900+0000 7f1f430db740 1 -- 172.21.15.84:0/4197645222 shutdown_connections 2024-09-21T03:44:19.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.900+0000 7f1f430db740 1 --2- 172.21.15.84:0/4197645222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dd0cd350 0x55b0dd479bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.900+0000 7f1f430db740 1 --2- 172.21.15.84:0/4197645222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0ac670 0x55b0dd479690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.900+0000 7f1f430db740 1 --2- 172.21.15.84:0/4197645222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 0x55b0dd48be40 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.900+0000 7f1f430db740 1 -- 172.21.15.84:0/4197645222 >> 172.21.15.84:0/4197645222 conn(0x55b0dd0c1740 msgr2=0x55b0dd47af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:19.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.900+0000 7f1f430db740 1 -- 172.21.15.84:0/4197645222 shutdown_connections 2024-09-21T03:44:19.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.900+0000 7f1f430db740 1 -- 172.21.15.84:0/4197645222 wait complete. 2024-09-21T03:44:19.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.901+0000 7f1f430db740 1 -- start start 2024-09-21T03:44:19.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.901+0000 7f1f430db740 1 Processor -- start 2024-09-21T03:44:19.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.901+0000 7f1f430db740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 0x55b0dd491380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:19.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.901+0000 7f1f430db740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0ac670 0x55b0dd4918c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:19.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.901+0000 7f1f430db740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dd0cd350 0x55b0dd491e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:19.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.901+0000 7f1f430db740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f381adc00 con 0x55b0dd0a4490 2024-09-21T03:44:19.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.901+0000 7f1f430db740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1f381af070 con 0x55b0dd0ac670 2024-09-21T03:44:19.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.901+0000 7f1f430db740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1f381ae2d0 con 0x55b0dd0cd350 2024-09-21T03:44:19.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.901+0000 7f1f430db740 10 client.0 _ll_register_callbacks cb 0x7f1f200097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:19.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.901+0000 7f1f2ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 0x55b0dd491380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:19.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.901+0000 7f1f2ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 0x55b0dd491380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40744/0 (socket says 172.21.15.84:40744) 2024-09-21T03:44:19.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.901+0000 7f1f2ffff640 1 -- 172.21.15.84:0/1505154462 learned_addr learned my addr 172.21.15.84:0/1505154462 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:19.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.901+0000 7f1f3659c640 1 --2- 172.21.15.84:0/1505154462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0ac670 0x55b0dd4918c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:19.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.901+0000 7f1f2ffff640 1 --2- 172.21.15.84:0/1505154462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dd0cd350 0x55b0dd491e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:19.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.901+0000 7f1f2ffff640 1 -- 172.21.15.84:0/1505154462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dd0cd350 msgr2=0x55b0dd491e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:19.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.901+0000 7f1f2ffff640 1 --2- 172.21.15.84:0/1505154462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dd0cd350 0x55b0dd491e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.901+0000 7f1f2ffff640 1 -- 172.21.15.84:0/1505154462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0ac670 msgr2=0x55b0dd4918c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:19.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.901+0000 7f1f2ffff640 1 --2- 172.21.15.84:0/1505154462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0ac670 0x55b0dd4918c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.901+0000 7f1f2ffff640 1 -- 172.21.15.84:0/1505154462 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0dd4fbab0 con 0x55b0dd0a4490 2024-09-21T03:44:19.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.901+0000 7f1f3659c640 1 --2- 172.21.15.84:0/1505154462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0ac670 0x55b0dd4918c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:19.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.902+0000 7f1f2ffff640 1 --2- 172.21.15.84:0/1505154462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 0x55b0dd491380 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1f20009400 tx=0x7f1f20020700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491b2d8d0a2ba358 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:19.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.902+0000 7f1f1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:19.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.902+0000 7f1f1dffb640 1 -- 172.21.15.84:0/1505154462 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f20024050 con 0x55b0dd0a4490 2024-09-21T03:44:19.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.902+0000 7f1f1dffb640 1 -- 172.21.15.84:0/1505154462 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f1f20005bc0 con 0x55b0dd0a4490 2024-09-21T03:44:19.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.902+0000 7f1f430db740 1 -- 172.21.15.84:0/1505154462 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f20017a70 con 0x55b0dd0a4490 2024-09-21T03:44:19.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.902+0000 7f1f1dffb640 1 -- 172.21.15.84:0/1505154462 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1f20005dc0 con 0x55b0dd0a4490 2024-09-21T03:44:19.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.902+0000 7f1f430db740 10 client.15921 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:19.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.902+0000 7f1f430db740 1 -- 172.21.15.84:0/1505154462 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b0dd4fcd10 con 0x55b0dd0a4490 2024-09-21T03:44:19.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.902+0000 7f1f1dffb640 1 -- 172.21.15.84:0/1505154462 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f20017a70 con 0x55b0dd0a4490 2024-09-21T03:44:19.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.902+0000 7f1f1dffb640 1 -- 172.21.15.84:0/1505154462 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1f200064c0 con 0x55b0dd0a4490 2024-09-21T03:44:19.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.902+0000 7f1f430db740 10 client.15921 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:19.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.902+0000 7f1f430db740 10 client.15921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:44:19.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.902+0000 7f1f430db740 20 client.15921 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:19.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.902+0000 7f1f430db740 1 --2- 172.21.15.84:0/1505154462 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55b0dd061080 0x55b0dd4ff500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:19.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.902+0000 7f1f430db740 4 client.15921 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:44:19.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.902+0000 7f1f430db740 1 -- 172.21.15.84:0/1505154462 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b0dd3e8860 con 0x55b0dd061080 2024-09-21T03:44:19.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.903+0000 7f1f3659c640 1 --2- 172.21.15.84:0/1505154462 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55b0dd061080 0x55b0dd4ff500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:19.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.903+0000 7f1f3659c640 1 --2- 172.21.15.84:0/1505154462 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55b0dd061080 0x55b0dd4ff500 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2bd0899a60e7186 server_cookie=3b12dde5bb019661 in_seq=0 out_seq=0 2024-09-21T03:44:19.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.903+0000 7f1f1dffb640 10 client.15921 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:19.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.905+0000 7f1f1dffb640 1 -- 172.21.15.84:0/1505154462 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b0dd3e8860 con 0x55b0dd061080 2024-09-21T03:44:19.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.905+0000 7f1f1dffb640 10 client.15921 handle_command_reply: tid=0 2024-09-21T03:44:19.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.905+0000 7f1f430db740 1 client.15921 shutdown 2024-09-21T03:44:19.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.905+0000 7f1f430db740 1 -- 172.21.15.84:0/1505154462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 msgr2=0x55b0dd491380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:19.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.905+0000 7f1f430db740 1 --2- 172.21.15.84:0/1505154462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 0x55b0dd491380 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1f20009400 tx=0x7f1f20020700 comp rx=0 tx=0).stop 2024-09-21T03:44:19.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.905+0000 7f1f430db740 1 -- 172.21.15.84:0/1505154462 shutdown_connections 2024-09-21T03:44:19.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.905+0000 7f1f430db740 1 --2- 172.21.15.84:0/1505154462 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55b0dd061080 0x55b0dd4ff500 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.905+0000 7f1f430db740 1 --2- 172.21.15.84:0/1505154462 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b0dd0cd350 0x55b0dd491e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.905+0000 7f1f430db740 1 --2- 172.21.15.84:0/1505154462 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b0dd0ac670 0x55b0dd4918c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.905+0000 7f1f430db740 1 --2- 172.21.15.84:0/1505154462 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55b0dd0a4490 0x55b0dd491380 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.905+0000 7f1f430db740 1 -- 172.21.15.84:0/1505154462 >> 172.21.15.84:0/1505154462 conn(0x55b0dd0c1740 msgr2=0x55b0dd47e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:19.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.905+0000 7f1f1dffb640 0 client.15921 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:19.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.905+0000 7f1f430db740 1 -- 172.21.15.84:0/1505154462 shutdown_connections 2024-09-21T03:44:19.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.905+0000 7f1f430db740 1 -- 172.21.15.84:0/1505154462 wait complete. 2024-09-21T03:44:19.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.905+0000 7f1f430db740 20 client.15921 trim_cache size 0 max 16384 2024-09-21T03:44:19.911 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:44:19.911 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T03:44:19.911 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed", 2024-09-21T03:44:19.911 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T03:44:19.911 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:44:19.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.906+0000 7f1f3cb67640 1 -- 172.21.15.84:0/230101951 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1f240b6680 msgr2=0x7f1f240b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:19.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.906+0000 7f1f3cb67640 1 --2- 172.21.15.84:0/230101951 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1f240b6680 0x7f1f240b8b90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1f300e4eb0 tx=0x7f1f30076020 comp rx=0 tx=0).stop 2024-09-21T03:44:19.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.906+0000 7f1f3cb67640 1 -- 172.21.15.84:0/230101951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f38108cf0 msgr2=0x7f1f3819fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:19.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.906+0000 7f1f3cb67640 1 --2- 172.21.15.84:0/230101951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f38108cf0 0x7f1f3819fd00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1f3000cad0 tx=0x7f1f3000ced0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.906+0000 7f1f3cb67640 1 -- 172.21.15.84:0/230101951 shutdown_connections 2024-09-21T03:44:19.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.906+0000 7f1f3cb67640 1 --2- 172.21.15.84:0/230101951 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1f240b6680 0x7f1f240b8b90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.906+0000 7f1f3cb67640 1 --2- 172.21.15.84:0/230101951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f38108cf0 0x7f1f3819fd00 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.906+0000 7f1f3cb67640 1 --2- 172.21.15.84:0/230101951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f381083a0 0x7f1f3819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.906+0000 7f1f3cb67640 1 --2- 172.21.15.84:0/230101951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f38102a60 0x7f1f3819a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:19.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.906+0000 7f1f3cb67640 1 -- 172.21.15.84:0/230101951 >> 172.21.15.84:0/230101951 conn(0x7f1f38079730 msgr2=0x7f1f38101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:19.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.906+0000 7f1f3cb67640 1 -- 172.21.15.84:0/230101951 shutdown_connections 2024-09-21T03:44:19.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:19.906+0000 7f1f3cb67640 1 -- 172.21.15.84:0/230101951 wait complete. 2024-09-21T03:44:20.770 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:44:21.015 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:21.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.550+0000 7f411fada640 1 -- 172.21.15.84:0/906952718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41181094e0 msgr2=0x7f41181098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:21.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.550+0000 7f411fada640 1 --2- 172.21.15.84:0/906952718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41181094e0 0x7f41181098f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f410c009900 tx=0x7f410c02a410 comp rx=0 tx=0).stop 2024-09-21T03:44:21.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.550+0000 7f411fada640 1 -- 172.21.15.84:0/906952718 shutdown_connections 2024-09-21T03:44:21.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.550+0000 7f411fada640 1 --2- 172.21.15.84:0/906952718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4118109e30 0x7f4118110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.550+0000 7f411fada640 1 --2- 172.21.15.84:0/906952718 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f41181094e0 0x7f41181098f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.550+0000 7f411fada640 1 --2- 172.21.15.84:0/906952718 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4118103ba0 0x7f4118103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.550+0000 7f411fada640 1 -- 172.21.15.84:0/906952718 >> 172.21.15.84:0/906952718 conn(0x7f41180ff630 msgr2=0x7f4118101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:21.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.550+0000 7f411fada640 1 -- 172.21.15.84:0/906952718 shutdown_connections 2024-09-21T03:44:21.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.550+0000 7f411fada640 1 -- 172.21.15.84:0/906952718 wait complete. 2024-09-21T03:44:21.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.551+0000 7f411fada640 1 Processor -- start 2024-09-21T03:44:21.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.551+0000 7f411fada640 1 -- start start 2024-09-21T03:44:21.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.551+0000 7f411fada640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4118103ba0 0x7f411819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:21.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.551+0000 7f411fada640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41181094e0 0x7f411819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:21.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.551+0000 7f411fada640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4118109e30 0x7f411819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:21.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.551+0000 7f411fada640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4118113b10 con 0x7f4118103ba0 2024-09-21T03:44:21.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.551+0000 7f411fada640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4118113990 con 0x7f4118109e30 2024-09-21T03:44:21.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.551+0000 7f411fada640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4118113c90 con 0x7f41181094e0 2024-09-21T03:44:21.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.551+0000 7f411d876640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4118103ba0 0x7f411819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:21.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.551+0000 7f411d876640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4118103ba0 0x7f411819a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40762/0 (socket says 172.21.15.84:40762) 2024-09-21T03:44:21.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.551+0000 7f411d876640 1 -- 172.21.15.84:0/405531817 learned_addr learned my addr 172.21.15.84:0/405531817 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:21.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.551+0000 7f411e077640 1 --2- 172.21.15.84:0/405531817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4118109e30 0x7f411819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:21.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.551+0000 7f411d075640 1 --2- 172.21.15.84:0/405531817 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41181094e0 0x7f411819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:21.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.551+0000 7f411d876640 1 -- 172.21.15.84:0/405531817 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41181094e0 msgr2=0x7f411819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:21.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.551+0000 7f411d876640 1 --2- 172.21.15.84:0/405531817 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41181094e0 0x7f411819aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.551+0000 7f411d876640 1 -- 172.21.15.84:0/405531817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4118109e30 msgr2=0x7f411819fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:21.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.551+0000 7f411d876640 1 --2- 172.21.15.84:0/405531817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4118109e30 0x7f411819fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.552+0000 7f411d876640 1 -- 172.21.15.84:0/405531817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41181a04b0 con 0x7f4118103ba0 2024-09-21T03:44:21.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.552+0000 7f411d876640 1 --2- 172.21.15.84:0/405531817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4118103ba0 0x7f411819a540 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f411400b4a0 tx=0x7f411400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:21.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.552+0000 7f410affd640 1 -- 172.21.15.84:0/405531817 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4114014070 con 0x7f4118103ba0 2024-09-21T03:44:21.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.552+0000 7f410affd640 1 -- 172.21.15.84:0/405531817 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4114010ac0 con 0x7f4118103ba0 2024-09-21T03:44:21.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.552+0000 7f411fada640 1 -- 172.21.15.84:0/405531817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41181a07a0 con 0x7f4118103ba0 2024-09-21T03:44:21.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.552+0000 7f410affd640 1 -- 172.21.15.84:0/405531817 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4114017c30 con 0x7f4118103ba0 2024-09-21T03:44:21.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.552+0000 7f411fada640 1 -- 172.21.15.84:0/405531817 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41181a6f00 con 0x7f4118103ba0 2024-09-21T03:44:21.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.554+0000 7f412604e740 1 Processor -- start 2024-09-21T03:44:21.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.555+0000 7f412604e740 1 -- start start 2024-09-21T03:44:21.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.555+0000 7f412604e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 0x55f6f0500270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:21.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.555+0000 7f412604e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f6f01301b0 0x55f6f05007b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:21.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.555+0000 7f412604e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f0138390 0x55f6f0500cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:21.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.555+0000 7f412604e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f6f0476e50 con 0x55f6f0159070 2024-09-21T03:44:21.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.555+0000 7f412604e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f6f0466280 con 0x55f6f01301b0 2024-09-21T03:44:21.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.555+0000 7f412604e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f6f046a090 con 0x55f6f0138390 2024-09-21T03:44:21.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.555+0000 7f410affd640 1 -- 172.21.15.84:0/405531817 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f4114017070 con 0x7f4118103ba0 2024-09-21T03:44:21.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.555+0000 7f411e077640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 0x55f6f0500270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:21.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.555+0000 7f411e077640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 0x55f6f0500270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40766/0 (socket says 172.21.15.84:40766) 2024-09-21T03:44:21.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.555+0000 7f411e077640 1 -- 172.21.15.84:0/1608719061 learned_addr learned my addr 172.21.15.84:0/1608719061 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:21.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.555+0000 7f411d876640 1 --2- 172.21.15.84:0/1608719061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f6f01301b0 0x55f6f05007b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:21.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.555+0000 7f411d075640 1 --2- 172.21.15.84:0/1608719061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f0138390 0x55f6f0500cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:21.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.555+0000 7f411e077640 1 -- 172.21.15.84:0/1608719061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f0138390 msgr2=0x55f6f0500cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.555+0000 7f411e077640 1 --2- 172.21.15.84:0/1608719061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f0138390 0x55f6f0500cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.555+0000 7f411e077640 1 -- 172.21.15.84:0/1608719061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f6f01301b0 msgr2=0x55f6f05007b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.555+0000 7f411e077640 1 --2- 172.21.15.84:0/1608719061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f6f01301b0 0x55f6f05007b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.555+0000 7f411e077640 1 -- 172.21.15.84:0/1608719061 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6f01c4650 con 0x55f6f0159070 2024-09-21T03:44:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.556+0000 7f411e077640 1 --2- 172.21.15.84:0/1608719061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 0x55f6f0500270 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f411000ae90 tx=0x7f411000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc8b64c9151efb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.556+0000 7f410affd640 1 --2- 172.21.15.84:0/405531817 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f41040b6680 0x7f41040b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.556+0000 7f4103fff640 1 -- 172.21.15.84:0/1608719061 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110003b70 con 0x55f6f0159070 2024-09-21T03:44:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.556+0000 7f4103fff640 1 -- 172.21.15.84:0/1608719061 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4110003d10 con 0x55f6f0159070 2024-09-21T03:44:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.556+0000 7f411d876640 1 --2- 172.21.15.84:0/405531817 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f41040b6680 0x7f41040b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.556+0000 7f4103fff640 1 -- 172.21.15.84:0/1608719061 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110010b00 con 0x55f6f0159070 2024-09-21T03:44:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.556+0000 7f410affd640 1 -- 172.21.15.84:0/405531817 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f41140e69d0 con 0x7f4118103ba0 2024-09-21T03:44:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.557+0000 7f412604e740 1 -- 172.21.15.84:0/1608719061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 msgr2=0x55f6f0500270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.557+0000 7f411d876640 1 --2- 172.21.15.84:0/405531817 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f41040b6680 0x7f41040b8b90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55f6f04feef0 tx=0x7f4114010f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:21.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.557+0000 7f412604e740 1 --2- 172.21.15.84:0/1608719061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 0x55f6f0500270 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f411000ae90 tx=0x7f411000f790 comp rx=0 tx=0).stop 2024-09-21T03:44:21.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.557+0000 7f412604e740 1 -- 172.21.15.84:0/1608719061 shutdown_connections 2024-09-21T03:44:21.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.557+0000 7f412604e740 1 --2- 172.21.15.84:0/1608719061 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f0138390 0x55f6f0500cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.557+0000 7f412604e740 1 --2- 172.21.15.84:0/1608719061 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f6f01301b0 0x55f6f05007b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.557+0000 7f412604e740 1 --2- 172.21.15.84:0/1608719061 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 0x55f6f0500270 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.557+0000 7f412604e740 1 -- 172.21.15.84:0/1608719061 >> 172.21.15.84:0/1608719061 conn(0x55f6f014d460 msgr2=0x55f6f04fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:21.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.557+0000 7f412604e740 1 -- 172.21.15.84:0/1608719061 shutdown_connections 2024-09-21T03:44:21.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.557+0000 7f412604e740 1 -- 172.21.15.84:0/1608719061 wait complete. 2024-09-21T03:44:21.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.557+0000 7f412604e740 1 -- start start 2024-09-21T03:44:21.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.557+0000 7f412604e740 1 Processor -- start 2024-09-21T03:44:21.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.558+0000 7f412604e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f01301b0 0x55f6f050b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:21.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.558+0000 7f412604e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f6f0138390 0x55f6f050bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:21.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.558+0000 7f412604e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 0x55f6f050c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:21.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.558+0000 7f412604e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f6f02c7700 con 0x55f6f0159070 2024-09-21T03:44:21.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.558+0000 7f412604e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f6f0401110 con 0x55f6f0138390 2024-09-21T03:44:21.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.558+0000 7f412604e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f6f050eaa0 con 0x55f6f01301b0 2024-09-21T03:44:21.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.558+0000 7f412604e740 10 client.0 _ll_register_callbacks cb 0x55f6f041a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:21.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.558+0000 7f411e077640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 0x55f6f050c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:21.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.558+0000 7f411e077640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 0x55f6f050c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40770/0 (socket says 172.21.15.84:40770) 2024-09-21T03:44:21.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.558+0000 7f411e077640 1 -- 172.21.15.84:0/4073745702 learned_addr learned my addr 172.21.15.84:0/4073745702 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:21.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.558+0000 7f411d075640 1 --2- 172.21.15.84:0/4073745702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f6f0138390 0x55f6f050bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:21.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.558+0000 7f411e077640 1 --2- 172.21.15.84:0/4073745702 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f01301b0 0x55f6f050b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:21.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.558+0000 7f411e077640 1 -- 172.21.15.84:0/4073745702 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f01301b0 msgr2=0x55f6f050b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:21.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.558+0000 7f411e077640 1 --2- 172.21.15.84:0/4073745702 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f01301b0 0x55f6f050b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.558+0000 7f411e077640 1 -- 172.21.15.84:0/4073745702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f6f0138390 msgr2=0x55f6f050bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:21.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.558+0000 7f411e077640 1 --2- 172.21.15.84:0/4073745702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f6f0138390 0x55f6f050bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.558+0000 7f411e077640 1 -- 172.21.15.84:0/4073745702 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6f042ec40 con 0x55f6f0159070 2024-09-21T03:44:21.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.558+0000 7f411d075640 1 --2- 172.21.15.84:0/4073745702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f6f0138390 0x55f6f050bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:21.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.559+0000 7f411e077640 1 --2- 172.21.15.84:0/4073745702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 0x55f6f050c310 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4110010720 tx=0x7f4110005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f391307db3cc4a66 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:21.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.559+0000 7f41017fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:21.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.560+0000 7f41017fa640 1 -- 172.21.15.84:0/4073745702 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411001d040 con 0x55f6f0159070 2024-09-21T03:44:21.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.560+0000 7f41017fa640 1 -- 172.21.15.84:0/4073745702 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4110004c00 con 0x55f6f0159070 2024-09-21T03:44:21.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.560+0000 7f412604e740 1 -- 172.21.15.84:0/4073745702 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4110003d10 con 0x55f6f0159070 2024-09-21T03:44:21.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.560+0000 7f41017fa640 1 -- 172.21.15.84:0/4073745702 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4110004e00 con 0x55f6f0159070 2024-09-21T03:44:21.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.560+0000 7f412604e740 10 client.15933 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:21.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.560+0000 7f412604e740 1 -- 172.21.15.84:0/4073745702 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f6f051a720 con 0x55f6f0159070 2024-09-21T03:44:21.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.560+0000 7f41017fa640 1 -- 172.21.15.84:0/4073745702 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4110003d10 con 0x55f6f0159070 2024-09-21T03:44:21.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.560+0000 7f41017fa640 1 -- 172.21.15.84:0/4073745702 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4110005400 con 0x55f6f0159070 2024-09-21T03:44:21.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.560+0000 7f412604e740 10 client.15933 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:21.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.560+0000 7f412604e740 10 client.15933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:44:21.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.560+0000 7f412604e740 20 client.15933 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:21.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.560+0000 7f412604e740 1 --2- 172.21.15.84:0/4073745702 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55f6f01179f0 0x55f6f051db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:21.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.560+0000 7f412604e740 4 client.15933 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:44:21.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.560+0000 7f412604e740 1 -- 172.21.15.84:0/4073745702 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6f0478da0 con 0x55f6f01179f0 2024-09-21T03:44:21.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.561+0000 7f411d075640 1 --2- 172.21.15.84:0/4073745702 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55f6f01179f0 0x55f6f051db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:21.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.561+0000 7f41017fa640 10 client.15933 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:21.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.561+0000 7f411d075640 1 --2- 172.21.15.84:0/4073745702 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55f6f01179f0 0x55f6f051db30 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afa4d901a0b5404a server_cookie=acd937f61e6fcd99 in_seq=0 out_seq=0 2024-09-21T03:44:21.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.562+0000 7f41017fa640 1 -- 172.21.15.84:0/4073745702 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f6f0478da0 con 0x55f6f01179f0 2024-09-21T03:44:21.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.562+0000 7f41017fa640 10 client.15933 handle_command_reply: tid=0 2024-09-21T03:44:21.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.562+0000 7f412604e740 1 client.15933 shutdown 2024-09-21T03:44:21.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.562+0000 7f412604e740 1 -- 172.21.15.84:0/4073745702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 msgr2=0x55f6f050c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:21.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.562+0000 7f412604e740 1 --2- 172.21.15.84:0/4073745702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 0x55f6f050c310 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4110010720 tx=0x7f4110005bd0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.562+0000 7f412604e740 1 -- 172.21.15.84:0/4073745702 shutdown_connections 2024-09-21T03:44:21.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.562+0000 7f412604e740 1 --2- 172.21.15.84:0/4073745702 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55f6f01179f0 0x55f6f051db30 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.562+0000 7f412604e740 1 --2- 172.21.15.84:0/4073745702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 0x55f6f050c310 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.562+0000 7f41017fa640 0 client.15933 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.562+0000 7f412604e740 1 --2- 172.21.15.84:0/4073745702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f6f0138390 0x55f6f050bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.562+0000 7f412604e740 1 --2- 172.21.15.84:0/4073745702 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f01301b0 0x55f6f050b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.562+0000 7f412604e740 1 -- 172.21.15.84:0/4073745702 >> 172.21.15.84:0/4073745702 conn(0x55f6f014d460 msgr2=0x55f6f05012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.562+0000 7f412604e740 1 -- 172.21.15.84:0/4073745702 shutdown_connections 2024-09-21T03:44:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.562+0000 7f412604e740 1 -- 172.21.15.84:0/4073745702 wait complete. 2024-09-21T03:44:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.562+0000 7f412604e740 20 client.15933 trim_cache size 0 max 16384 2024-09-21T03:44:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.579+0000 7f412604e740 1 Processor -- start 2024-09-21T03:44:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.579+0000 7f412604e740 1 -- start start 2024-09-21T03:44:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.580+0000 7f412604e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f01301b0 0x55f6f05019b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.580+0000 7f412604e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0138390 0x55f6f0508a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.580+0000 7f412604e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f6f0159070 0x55f6f0508fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:21.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.580+0000 7f412604e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f41181b1f80 con 0x55f6f0138390 2024-09-21T03:44:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.580+0000 7f412604e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f41181af850 con 0x55f6f0159070 2024-09-21T03:44:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.580+0000 7f412604e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f41181ad6a0 con 0x55f6f01301b0 2024-09-21T03:44:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.580+0000 7f411d075640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0138390 0x55f6f0508a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.580+0000 7f411d075640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0138390 0x55f6f0508a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40782/0 (socket says 172.21.15.84:40782) 2024-09-21T03:44:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.580+0000 7f411d075640 1 -- 172.21.15.84:0/2553639754 learned_addr learned my addr 172.21.15.84:0/2553639754 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.580+0000 7f411e077640 1 --2- 172.21.15.84:0/2553639754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f01301b0 0x55f6f05019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.580+0000 7f411d075640 1 -- 172.21.15.84:0/2553639754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f01301b0 msgr2=0x55f6f05019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.580+0000 7f411d075640 1 --2- 172.21.15.84:0/2553639754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f01301b0 0x55f6f05019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.580+0000 7f411d075640 1 -- 172.21.15.84:0/2553639754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f6f0159070 msgr2=0x55f6f0508fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.580+0000 7f411d075640 1 --2- 172.21.15.84:0/2553639754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f6f0159070 0x55f6f0508fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.580+0000 7f411d075640 1 -- 172.21.15.84:0/2553639754 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6f050cb50 con 0x55f6f0138390 2024-09-21T03:44:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.580+0000 7f411e077640 1 --2- 172.21.15.84:0/2553639754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f01301b0 0x55f6f05019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.580+0000 7f411d075640 1 --2- 172.21.15.84:0/2553639754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0138390 0x55f6f0508a80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f410c005f70 tx=0x7f410c004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02eb2af52f33dbc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:21.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.580+0000 7f41037fe640 1 -- 172.21.15.84:0/2553639754 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410c049070 con 0x55f6f0138390 2024-09-21T03:44:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.580+0000 7f41037fe640 1 -- 172.21.15.84:0/2553639754 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f410c0054f0 con 0x55f6f0138390 2024-09-21T03:44:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.581+0000 7f41037fe640 1 -- 172.21.15.84:0/2553639754 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410c035040 con 0x55f6f0138390 2024-09-21T03:44:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.581+0000 7f412604e740 1 -- 172.21.15.84:0/2553639754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0138390 msgr2=0x55f6f0508a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.581+0000 7f412604e740 1 --2- 172.21.15.84:0/2553639754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0138390 0x55f6f0508a80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f410c005f70 tx=0x7f410c004260 comp rx=0 tx=0).stop 2024-09-21T03:44:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.581+0000 7f412604e740 1 -- 172.21.15.84:0/2553639754 shutdown_connections 2024-09-21T03:44:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.581+0000 7f412604e740 1 --2- 172.21.15.84:0/2553639754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f6f0159070 0x55f6f0508fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.581+0000 7f412604e740 1 --2- 172.21.15.84:0/2553639754 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0138390 0x55f6f0508a80 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.581+0000 7f412604e740 1 --2- 172.21.15.84:0/2553639754 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f01301b0 0x55f6f05019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.581+0000 7f412604e740 1 -- 172.21.15.84:0/2553639754 >> 172.21.15.84:0/2553639754 conn(0x55f6f014d460 msgr2=0x55f6f05012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.581+0000 7f412604e740 1 -- 172.21.15.84:0/2553639754 shutdown_connections 2024-09-21T03:44:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.581+0000 7f412604e740 1 -- 172.21.15.84:0/2553639754 wait complete. 2024-09-21T03:44:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.582+0000 7f412604e740 1 -- start start 2024-09-21T03:44:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.582+0000 7f412604e740 1 Processor -- start 2024-09-21T03:44:21.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.582+0000 7f412604e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f01301b0 0x55f6f0514490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.582+0000 7f412604e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f6f0138390 0x55f6f050f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.582+0000 7f412604e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 0x55f6f050fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.582+0000 7f412604e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f41181add10 con 0x55f6f0159070 2024-09-21T03:44:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.582+0000 7f412604e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f41181af180 con 0x55f6f0138390 2024-09-21T03:44:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.582+0000 7f412604e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f41181ae3e0 con 0x55f6f01301b0 2024-09-21T03:44:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.582+0000 7f412604e740 10 client.0 _ll_register_callbacks cb 0x7f411000ace0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.582+0000 7f411e077640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 0x55f6f050fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.582+0000 7f411e077640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 0x55f6f050fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40784/0 (socket says 172.21.15.84:40784) 2024-09-21T03:44:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.582+0000 7f411e077640 1 -- 172.21.15.84:0/3821569230 learned_addr learned my addr 172.21.15.84:0/3821569230 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.582+0000 7f411e077640 1 --2- 172.21.15.84:0/3821569230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f01301b0 0x55f6f0514490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.583+0000 7f411d075640 1 --2- 172.21.15.84:0/3821569230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f6f0138390 0x55f6f050f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.583+0000 7f411e077640 1 -- 172.21.15.84:0/3821569230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f01301b0 msgr2=0x55f6f0514490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.583+0000 7f411e077640 1 --2- 172.21.15.84:0/3821569230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f01301b0 0x55f6f0514490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.583+0000 7f411e077640 1 -- 172.21.15.84:0/3821569230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f6f0138390 msgr2=0x55f6f050f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.583+0000 7f411e077640 1 --2- 172.21.15.84:0/3821569230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f6f0138390 0x55f6f050f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.583+0000 7f411e077640 1 -- 172.21.15.84:0/3821569230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6f05105e0 con 0x55f6f0159070 2024-09-21T03:44:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.583+0000 7f411e077640 1 --2- 172.21.15.84:0/3821569230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 0x55f6f050fed0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f411000a640 tx=0x7f411000a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873875f47ab08c6c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.583+0000 7f41017fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.583+0000 7f41017fa640 1 -- 172.21.15.84:0/3821569230 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4110003f80 con 0x55f6f0159070 2024-09-21T03:44:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.583+0000 7f41017fa640 1 -- 172.21.15.84:0/3821569230 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4110004120 con 0x55f6f0159070 2024-09-21T03:44:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.583+0000 7f412604e740 1 -- 172.21.15.84:0/3821569230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f410c0054f0 con 0x55f6f0159070 2024-09-21T03:44:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.583+0000 7f41017fa640 1 -- 172.21.15.84:0/3821569230 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4110042050 con 0x55f6f0159070 2024-09-21T03:44:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.583+0000 7f412604e740 10 client.15939 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.583+0000 7f412604e740 1 -- 172.21.15.84:0/3821569230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f6f05881d0 con 0x55f6f0159070 2024-09-21T03:44:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.584+0000 7f41017fa640 1 -- 172.21.15.84:0/3821569230 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f410c0054f0 con 0x55f6f0159070 2024-09-21T03:44:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.584+0000 7f41017fa640 1 -- 172.21.15.84:0/3821569230 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f41100187b0 con 0x55f6f0159070 2024-09-21T03:44:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.584+0000 7f412604e740 10 client.15939 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:21.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.584+0000 7f412604e740 10 client.15939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:44:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.584+0000 7f412604e740 20 client.15939 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.584+0000 7f412604e740 1 --2- 172.21.15.84:0/3821569230 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55f6f00ecda0 0x55f6f058a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.584+0000 7f412604e740 4 client.15939 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:44:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.584+0000 7f412604e740 1 -- 172.21.15.84:0/3821569230 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f6f0474850 con 0x55f6f00ecda0 2024-09-21T03:44:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.584+0000 7f411d075640 1 --2- 172.21.15.84:0/3821569230 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55f6f00ecda0 0x55f6f058a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.584+0000 7f411d075640 1 --2- 172.21.15.84:0/3821569230 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55f6f00ecda0 0x55f6f058a8d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=997ed33244be4d17 server_cookie=fc0d5cd5b2622c8a in_seq=0 out_seq=0 2024-09-21T03:44:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.584+0000 7f41017fa640 10 client.15939 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.585+0000 7f41017fa640 1 -- 172.21.15.84:0/3821569230 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x55f6f0474850 con 0x55f6f00ecda0 2024-09-21T03:44:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.585+0000 7f41017fa640 10 client.15939 handle_command_reply: tid=0 2024-09-21T03:44:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.585+0000 7f412604e740 1 client.15939 shutdown 2024-09-21T03:44:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.585+0000 7f412604e740 1 -- 172.21.15.84:0/3821569230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 msgr2=0x55f6f050fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.585+0000 7f412604e740 1 --2- 172.21.15.84:0/3821569230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 0x55f6f050fed0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f411000a640 tx=0x7f411000a4d0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.585+0000 7f412604e740 1 -- 172.21.15.84:0/3821569230 shutdown_connections 2024-09-21T03:44:21.620 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.585+0000 7f412604e740 1 --2- 172.21.15.84:0/3821569230 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55f6f00ecda0 0x55f6f058a8d0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.585+0000 7f412604e740 1 --2- 172.21.15.84:0/3821569230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f6f0159070 0x55f6f050fed0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.585+0000 7f412604e740 1 --2- 172.21.15.84:0/3821569230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f6f0138390 0x55f6f050f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.585+0000 7f41017fa640 0 client.15939 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:21.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.585+0000 7f412604e740 1 --2- 172.21.15.84:0/3821569230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f6f01301b0 0x55f6f0514490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.585+0000 7f412604e740 1 -- 172.21.15.84:0/3821569230 >> 172.21.15.84:0/3821569230 conn(0x55f6f014d460 msgr2=0x55f6f0501a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:21.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.585+0000 7f412604e740 1 -- 172.21.15.84:0/3821569230 shutdown_connections 2024-09-21T03:44:21.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.585+0000 7f412604e740 1 -- 172.21.15.84:0/3821569230 wait complete. 2024-09-21T03:44:21.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.585+0000 7f412604e740 20 client.15939 trim_cache size 0 max 16384 2024-09-21T03:44:21.621 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:44:21.621 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:44:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T03:44:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:44:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:44:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed", 2024-09-21T03:44:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T03:44:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:44:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:44:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:44:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:44:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:44:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:44:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:44:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:44:21.622 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:44:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:44:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:44:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:44:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:44:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:44:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:44:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:44:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:44:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:44:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:44:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:44:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:44:21.623 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:44:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:44:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:44:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:44:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:44:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:44:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:44:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:44:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:44:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:44:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:44:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:44:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:44:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:44:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:44:21.624 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:44:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:44:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:44:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:44:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:44:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:44:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:44:21.625 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:44:21.625 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:44:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.586+0000 7f411fada640 1 -- 172.21.15.84:0/405531817 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f41040b6680 msgr2=0x7f41040b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.586+0000 7f411fada640 1 --2- 172.21.15.84:0/405531817 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f41040b6680 0x7f41040b8b90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55f6f04feef0 tx=0x7f4114010f90 comp rx=0 tx=0).stop 2024-09-21T03:44:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.586+0000 7f411fada640 1 -- 172.21.15.84:0/405531817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4118103ba0 msgr2=0x7f411819a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.586+0000 7f411fada640 1 --2- 172.21.15.84:0/405531817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4118103ba0 0x7f411819a540 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f411400b4a0 tx=0x7f411400b960 comp rx=0 tx=0).stop 2024-09-21T03:44:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.586+0000 7f411fada640 1 -- 172.21.15.84:0/405531817 shutdown_connections 2024-09-21T03:44:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.586+0000 7f411fada640 1 --2- 172.21.15.84:0/405531817 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f41040b6680 0x7f41040b8b90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.586+0000 7f411fada640 1 --2- 172.21.15.84:0/405531817 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4118109e30 0x7f411819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.586+0000 7f411fada640 1 --2- 172.21.15.84:0/405531817 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41181094e0 0x7f411819aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.586+0000 7f411fada640 1 --2- 172.21.15.84:0/405531817 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4118103ba0 0x7f411819a540 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.586+0000 7f411fada640 1 -- 172.21.15.84:0/405531817 >> 172.21.15.84:0/405531817 conn(0x7f41180ff630 msgr2=0x7f4118101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.586+0000 7f411fada640 1 -- 172.21.15.84:0/405531817 shutdown_connections 2024-09-21T03:44:21.626 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:21.586+0000 7f411fada640 1 -- 172.21.15.84:0/405531817 wait complete. 2024-09-21T03:44:21.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:21 smithi084 ceph-mon[30941]: scrub queued for path: / 2024-09-21T03:44:21.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:21 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:44:21.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:21 smithi084 ceph-mon[30941]: scrub summary: active paths [/] 2024-09-21T03:44:21.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:21 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:44:21.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:21 smithi084 ceph-mon[30941]: pgmap v380: 97 pgs: 97 active+clean; 2.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T03:44:21.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:21 smithi174 ceph-mon[34403]: scrub queued for path: / 2024-09-21T03:44:21.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:21 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:44:21.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:21 smithi174 ceph-mon[34403]: scrub summary: active paths [/] 2024-09-21T03:44:21.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:21 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:44:21.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:21 smithi174 ceph-mon[34403]: pgmap v380: 97 pgs: 97 active+clean; 2.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T03:44:21.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:21 smithi172 ceph-mon[34821]: scrub queued for path: / 2024-09-21T03:44:21.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:21 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:44:21.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:21 smithi172 ceph-mon[34821]: scrub summary: active paths [/] 2024-09-21T03:44:21.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:21 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:44:21.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:21 smithi172 ceph-mon[34821]: pgmap v380: 97 pgs: 97 active+clean; 2.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T03:44:22.308 INFO:tasks.cephfs.filesystem:scrub status for tag:d1c765c2-f7d2-44d4-9027-7b22ad50e3ed - {'path': '/', 'tag': 'd1c765c2-f7d2-44d4-9027-7b22ad50e3ed', 'options': 'recursive,force'} 2024-09-21T03:44:23.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:23 smithi084 ceph-mon[30941]: pgmap v381: 97 pgs: 97 active+clean; 2.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-21T03:44:23.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:23 smithi174 ceph-mon[34403]: pgmap v381: 97 pgs: 97 active+clean; 2.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-21T03:44:23.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:23 smithi172 ceph-mon[34821]: pgmap v381: 97 pgs: 97 active+clean; 2.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-21T03:44:25.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:25 smithi084 ceph-mon[30941]: pgmap v382: 97 pgs: 97 active+clean; 2.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T03:44:25.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:25 smithi084 ceph-mon[30941]: scrub summary: idle 2024-09-21T03:44:25.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:25 smithi174 ceph-mon[34403]: pgmap v382: 97 pgs: 97 active+clean; 2.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T03:44:25.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:25 smithi174 ceph-mon[34403]: scrub summary: idle 2024-09-21T03:44:25.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:25 smithi172 ceph-mon[34821]: pgmap v382: 97 pgs: 97 active+clean; 2.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T03:44:25.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:25 smithi172 ceph-mon[34821]: scrub summary: idle 2024-09-21T03:44:27.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:27 smithi084 ceph-mon[30941]: pgmap v383: 97 pgs: 97 active+clean; 2.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-09-21T03:44:27.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:27 smithi174 ceph-mon[34403]: pgmap v383: 97 pgs: 97 active+clean; 2.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-09-21T03:44:27.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:27 smithi172 ceph-mon[34821]: pgmap v383: 97 pgs: 97 active+clean; 2.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 10 op/s 2024-09-21T03:44:28.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:28 smithi084 ceph-mon[30941]: pgmap v384: 97 pgs: 97 active+clean; 2.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-21T03:44:28.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:28 smithi174 ceph-mon[34403]: pgmap v384: 97 pgs: 97 active+clean; 2.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-21T03:44:28.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:28 smithi172 ceph-mon[34821]: pgmap v384: 97 pgs: 97 active+clean; 2.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-21T03:44:31.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:31 smithi172 ceph-mon[34821]: pgmap v385: 97 pgs: 97 active+clean; 2.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T03:44:31.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:31 smithi084 ceph-mon[30941]: pgmap v385: 97 pgs: 97 active+clean; 2.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T03:44:31.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:31 smithi174 ceph-mon[34403]: pgmap v385: 97 pgs: 97 active+clean; 2.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T03:44:33.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:33 smithi084 ceph-mon[30941]: pgmap v386: 97 pgs: 97 active+clean; 2.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:44:33.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:33 smithi174 ceph-mon[34403]: pgmap v386: 97 pgs: 97 active+clean; 2.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:44:33.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:33 smithi172 ceph-mon[34821]: pgmap v386: 97 pgs: 97 active+clean; 2.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:44:35.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:35 smithi084 ceph-mon[30941]: pgmap v387: 97 pgs: 97 active+clean; 2.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-21T03:44:35.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:35 smithi174 ceph-mon[34403]: pgmap v387: 97 pgs: 97 active+clean; 2.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-21T03:44:35.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:35 smithi172 ceph-mon[34821]: pgmap v387: 97 pgs: 97 active+clean; 2.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-21T03:44:37.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:37 smithi084 ceph-mon[30941]: pgmap v388: 97 pgs: 97 active+clean; 2.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-21T03:44:37.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:37 smithi174 ceph-mon[34403]: pgmap v388: 97 pgs: 97 active+clean; 2.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-21T03:44:37.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:37 smithi172 ceph-mon[34821]: pgmap v388: 97 pgs: 97 active+clean; 2.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-21T03:44:38.960 INFO:tasks.workunit.client.0.smithi084.stdout:1/600: open fd = 3 2024-09-21T03:44:38.960 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.960 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.960 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.960 INFO:tasks.workunit.client.0.smithi084.stdout:2/600: open fd = 3 2024-09-21T03:44:38.960 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.960 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.960 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.961 INFO:tasks.workunit.client.0.smithi084.stdout:3/600: open fd = 3 2024-09-21T03:44:38.961 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.961 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.961 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.961 INFO:tasks.workunit.client.0.smithi084.stdout:4/600: open fd = 3 2024-09-21T03:44:38.961 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.961 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.961 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.961 INFO:tasks.workunit.client.0.smithi084.stdout:5/600: open fd = 3 2024-09-21T03:44:38.961 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.961 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.961 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.961 INFO:tasks.workunit.client.0.smithi084.stdout:6/600: open fd = 3 2024-09-21T03:44:38.961 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.961 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.962 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.962 INFO:tasks.workunit.client.0.smithi084.stdout:7/600: open fd = 3 2024-09-21T03:44:38.962 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.962 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.962 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.962 INFO:tasks.workunit.client.0.smithi084.stdout:8/600: open fd = 3 2024-09-21T03:44:38.962 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.962 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.962 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.962 INFO:tasks.workunit.client.0.smithi084.stdout:9/600: open fd = 3 2024-09-21T03:44:38.962 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.962 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.962 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.963 INFO:tasks.workunit.client.0.smithi084.stdout:10/600: open fd = 3 2024-09-21T03:44:38.963 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.963 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.963 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.963 INFO:tasks.workunit.client.0.smithi084.stdout:11/600: open fd = 3 2024-09-21T03:44:38.963 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.963 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.963 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.963 INFO:tasks.workunit.client.0.smithi084.stdout:12/600: open fd = 3 2024-09-21T03:44:38.963 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.963 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.963 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.963 INFO:tasks.workunit.client.0.smithi084.stdout:13/600: open fd = 3 2024-09-21T03:44:38.963 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.963 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.964 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.964 INFO:tasks.workunit.client.0.smithi084.stdout:14/600: open fd = 3 2024-09-21T03:44:38.964 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.964 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.964 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.964 INFO:tasks.workunit.client.0.smithi084.stdout:15/600: open fd = 3 2024-09-21T03:44:38.964 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.964 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.964 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.964 INFO:tasks.workunit.client.0.smithi084.stdout:16/600: open fd = 3 2024-09-21T03:44:38.965 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.965 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.965 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.965 INFO:tasks.workunit.client.0.smithi084.stdout:17/600: open fd = 3 2024-09-21T03:44:38.965 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.965 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.965 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.965 INFO:tasks.workunit.client.0.smithi084.stdout:18/600: open fd = 3 2024-09-21T03:44:38.965 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.965 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.965 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.965 INFO:tasks.workunit.client.0.smithi084.stdout:19/600: open fd = 3 2024-09-21T03:44:38.965 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.965 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.966 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.966 INFO:tasks.workunit.client.0.smithi084.stdout:20/600: open fd = 3 2024-09-21T03:44:38.966 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.966 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.966 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.966 INFO:tasks.workunit.client.0.smithi084.stdout:21/600: open fd = 3 2024-09-21T03:44:38.966 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.966 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.966 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.966 INFO:tasks.workunit.client.0.smithi084.stdout:22/600: open fd = 3 2024-09-21T03:44:38.966 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.967 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.967 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.967 INFO:tasks.workunit.client.0.smithi084.stdout:23/600: open fd = 3 2024-09-21T03:44:38.967 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.967 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.967 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.967 INFO:tasks.workunit.client.0.smithi084.stdout:24/600: open fd = 3 2024-09-21T03:44:38.967 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.967 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.967 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.967 INFO:tasks.workunit.client.0.smithi084.stdout:25/600: open fd = 3 2024-09-21T03:44:38.967 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.967 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.967 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.968 INFO:tasks.workunit.client.0.smithi084.stdout:26/600: open fd = 3 2024-09-21T03:44:38.968 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.968 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.968 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.968 INFO:tasks.workunit.client.0.smithi084.stdout:27/600: open fd = 3 2024-09-21T03:44:38.968 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.968 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.968 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.968 INFO:tasks.workunit.client.0.smithi084.stdout:28/600: open fd = 3 2024-09-21T03:44:38.968 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.968 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.968 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.968 INFO:tasks.workunit.client.0.smithi084.stdout:29/600: open fd = 3 2024-09-21T03:44:38.968 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.969 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.969 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.969 INFO:tasks.workunit.client.0.smithi084.stdout:30/600: open fd = 3 2024-09-21T03:44:38.969 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.969 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.969 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.969 INFO:tasks.workunit.client.0.smithi084.stdout:31/600: open fd = 3 2024-09-21T03:44:38.969 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.969 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.969 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.969 INFO:tasks.workunit.client.0.smithi084.stdout:32/600: open fd = 3 2024-09-21T03:44:38.969 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.969 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.969 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.970 INFO:tasks.workunit.client.0.smithi084.stdout:33/600: open fd = 3 2024-09-21T03:44:38.970 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.970 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.970 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.970 INFO:tasks.workunit.client.0.smithi084.stdout:34/600: open fd = 3 2024-09-21T03:44:38.970 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.970 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.970 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.970 INFO:tasks.workunit.client.0.smithi084.stdout:35/600: open fd = 3 2024-09-21T03:44:38.970 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.970 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.970 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.970 INFO:tasks.workunit.client.0.smithi084.stdout:36/600: open fd = 3 2024-09-21T03:44:38.971 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.971 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.971 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.971 INFO:tasks.workunit.client.0.smithi084.stdout:37/600: open fd = 3 2024-09-21T03:44:38.971 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.971 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.971 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.971 INFO:tasks.workunit.client.0.smithi084.stdout:38/600: open fd = 3 2024-09-21T03:44:38.971 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.971 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.971 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.971 INFO:tasks.workunit.client.0.smithi084.stdout:39/600: open fd = 3 2024-09-21T03:44:38.971 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.971 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.972 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.972 INFO:tasks.workunit.client.0.smithi084.stdout:40/600: open fd = 3 2024-09-21T03:44:38.972 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.972 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.972 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.972 INFO:tasks.workunit.client.0.smithi084.stdout:41/600: open fd = 3 2024-09-21T03:44:38.972 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.972 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.972 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.972 INFO:tasks.workunit.client.0.smithi084.stdout:42/600: open fd = 3 2024-09-21T03:44:38.972 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.972 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.972 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.972 INFO:tasks.workunit.client.0.smithi084.stdout:43/600: open fd = 3 2024-09-21T03:44:38.972 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.973 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.973 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.973 INFO:tasks.workunit.client.0.smithi084.stdout:44/600: open fd = 3 2024-09-21T03:44:38.973 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.973 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.973 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.973 INFO:tasks.workunit.client.0.smithi084.stdout:45/600: open fd = 3 2024-09-21T03:44:38.973 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.973 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.973 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.973 INFO:tasks.workunit.client.0.smithi084.stdout:46/600: open fd = 3 2024-09-21T03:44:38.973 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.974 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.974 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.974 INFO:tasks.workunit.client.0.smithi084.stdout:47/600: open fd = 3 2024-09-21T03:44:38.974 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.974 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.974 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.974 INFO:tasks.workunit.client.0.smithi084.stdout:48/600: open fd = 3 2024-09-21T03:44:38.974 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.974 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.974 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.974 INFO:tasks.workunit.client.0.smithi084.stdout:49/600: open fd = 3 2024-09-21T03:44:38.974 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.974 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.974 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.975 INFO:tasks.workunit.client.0.smithi084.stdout:50/600: open fd = 3 2024-09-21T03:44:38.975 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.975 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.975 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.975 INFO:tasks.workunit.client.0.smithi084.stdout:51/600: open fd = 3 2024-09-21T03:44:38.975 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.975 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.975 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.975 INFO:tasks.workunit.client.0.smithi084.stdout:52/600: open fd = 3 2024-09-21T03:44:38.975 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.975 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.975 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.975 INFO:tasks.workunit.client.0.smithi084.stdout:53/600: open fd = 3 2024-09-21T03:44:38.975 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.976 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.976 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.976 INFO:tasks.workunit.client.0.smithi084.stdout:54/600: open fd = 3 2024-09-21T03:44:38.976 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.976 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.976 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.976 INFO:tasks.workunit.client.0.smithi084.stdout:55/600: open fd = 3 2024-09-21T03:44:38.976 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.976 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.976 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.976 INFO:tasks.workunit.client.0.smithi084.stdout:56/600: open fd = 3 2024-09-21T03:44:38.976 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.976 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.976 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.977 INFO:tasks.workunit.client.0.smithi084.stdout:57/600: open fd = 3 2024-09-21T03:44:38.977 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.977 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.977 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.977 INFO:tasks.workunit.client.0.smithi084.stdout:58/600: open fd = 3 2024-09-21T03:44:38.977 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.977 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.977 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.977 INFO:tasks.workunit.client.0.smithi084.stdout:59/600: open fd = 3 2024-09-21T03:44:38.977 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.977 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.977 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.977 INFO:tasks.workunit.client.0.smithi084.stdout:60/600: open fd = 3 2024-09-21T03:44:38.978 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.978 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.978 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.978 INFO:tasks.workunit.client.0.smithi084.stdout:61/600: open fd = 3 2024-09-21T03:44:38.978 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.978 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.978 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.978 INFO:tasks.workunit.client.0.smithi084.stdout:62/600: open fd = 3 2024-09-21T03:44:38.978 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.978 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.978 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:38.978 INFO:tasks.workunit.client.0.smithi084.stdout:63/600: open fd = 3 2024-09-21T03:44:38.978 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.978 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:44:38.979 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:44:39.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:39 smithi084 ceph-mon[30941]: pgmap v389: 97 pgs: 97 active+clean; 2.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:44:39.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:39 smithi174 ceph-mon[34403]: pgmap v389: 97 pgs: 97 active+clean; 2.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:44:39.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:39 smithi172 ceph-mon[34821]: pgmap v389: 97 pgs: 97 active+clean; 2.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:44:41.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:41 smithi084 ceph-mon[30941]: pgmap v390: 97 pgs: 97 active+clean; 2.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T03:44:41.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:41 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:44:41.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:41 smithi174 ceph-mon[34403]: pgmap v390: 97 pgs: 97 active+clean; 2.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T03:44:41.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:41 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:44:41.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:41 smithi172 ceph-mon[34821]: pgmap v390: 97 pgs: 97 active+clean; 2.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T03:44:41.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:41 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:44:42.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:44:42.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:44:42.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:44:42.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:44:42.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:44:42.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:44:42.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:44:42.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:44:42.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:44:43.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:43 smithi084 ceph-mon[30941]: pgmap v391: 97 pgs: 97 active+clean; 2.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:44:43.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:43 smithi174 ceph-mon[34403]: pgmap v391: 97 pgs: 97 active+clean; 2.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:44:43.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:43 smithi172 ceph-mon[34821]: pgmap v391: 97 pgs: 97 active+clean; 2.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:44:45.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:45 smithi084 ceph-mon[30941]: pgmap v392: 97 pgs: 97 active+clean; 2.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-21T03:44:45.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:45 smithi174 ceph-mon[34403]: pgmap v392: 97 pgs: 97 active+clean; 2.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-21T03:44:45.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:45 smithi172 ceph-mon[34821]: pgmap v392: 97 pgs: 97 active+clean; 2.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-21T03:44:47.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:47 smithi084 ceph-mon[30941]: pgmap v393: 97 pgs: 97 active+clean; 2.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-21T03:44:47.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:47 smithi174 ceph-mon[34403]: pgmap v393: 97 pgs: 97 active+clean; 2.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-21T03:44:47.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:47 smithi172 ceph-mon[34821]: pgmap v393: 97 pgs: 97 active+clean; 2.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-21T03:44:49.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:49 smithi084 ceph-mon[30941]: pgmap v394: 97 pgs: 97 active+clean; 2.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:44:49.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:49 smithi174 ceph-mon[34403]: pgmap v394: 97 pgs: 97 active+clean; 2.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:44:49.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:49 smithi172 ceph-mon[34821]: pgmap v394: 97 pgs: 97 active+clean; 2.6 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:44:51.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:51 smithi084 ceph-mon[30941]: pgmap v395: 97 pgs: 97 active+clean; 2.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T03:44:51.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:51 smithi174 ceph-mon[34403]: pgmap v395: 97 pgs: 97 active+clean; 2.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T03:44:51.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:51 smithi172 ceph-mon[34821]: pgmap v395: 97 pgs: 97 active+clean; 2.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T03:44:52.310 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:44:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:53.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.123+0000 7ff56851b640 1 -- 172.21.15.84:0/115006125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff560103b60 msgr2=0x7ff560103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:53.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.123+0000 7ff56851b640 1 --2- 172.21.15.84:0/115006125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff560103b60 0x7ff560103f70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009900 tx=0x7ff55c02a410 comp rx=0 tx=0).stop 2024-09-21T03:44:53.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.123+0000 7ff56851b640 1 -- 172.21.15.84:0/115006125 shutdown_connections 2024-09-21T03:44:53.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.123+0000 7ff56851b640 1 --2- 172.21.15.84:0/115006125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff560109df0 0x7ff560110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.123+0000 7ff56851b640 1 --2- 172.21.15.84:0/115006125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5601094a0 0x7ff5601098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.123+0000 7ff56851b640 1 --2- 172.21.15.84:0/115006125 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff560103b60 0x7ff560103f70 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.123+0000 7ff56851b640 1 -- 172.21.15.84:0/115006125 >> 172.21.15.84:0/115006125 conn(0x7ff56007b850 msgr2=0x7ff56007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:53.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.123+0000 7ff56851b640 1 -- 172.21.15.84:0/115006125 shutdown_connections 2024-09-21T03:44:53.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.123+0000 7ff56851b640 1 -- 172.21.15.84:0/115006125 wait complete. 2024-09-21T03:44:53.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.124+0000 7ff56851b640 1 Processor -- start 2024-09-21T03:44:53.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.124+0000 7ff56851b640 1 -- start start 2024-09-21T03:44:53.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.124+0000 7ff56851b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff560103b60 0x7ff56019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:53.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.124+0000 7ff56851b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5601094a0 0x7ff56019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:53.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.124+0000 7ff56851b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff560109df0 0x7ff56019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:53.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.124+0000 7ff56851b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff560113af0 con 0x7ff560109df0 2024-09-21T03:44:53.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.124+0000 7ff56851b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff560113970 con 0x7ff560103b60 2024-09-21T03:44:53.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.124+0000 7ff56851b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff560113c70 con 0x7ff5601094a0 2024-09-21T03:44:53.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.124+0000 7ff566ab8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff560109df0 0x7ff56019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:53.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.124+0000 7ff566ab8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff560109df0 0x7ff56019fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33182/0 (socket says 172.21.15.84:33182) 2024-09-21T03:44:53.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.124+0000 7ff566ab8640 1 -- 172.21.15.84:0/814802420 learned_addr learned my addr 172.21.15.84:0/814802420 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:53.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.124+0000 7ff5662b7640 1 --2- 172.21.15.84:0/814802420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff560103b60 0x7ff56019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:53.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.124+0000 7ff565ab6640 1 --2- 172.21.15.84:0/814802420 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5601094a0 0x7ff56019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:53.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.124+0000 7ff566ab8640 1 -- 172.21.15.84:0/814802420 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5601094a0 msgr2=0x7ff56019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:53.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.124+0000 7ff566ab8640 1 --2- 172.21.15.84:0/814802420 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5601094a0 0x7ff56019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.124+0000 7ff566ab8640 1 -- 172.21.15.84:0/814802420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff560103b60 msgr2=0x7ff56019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:53.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.124+0000 7ff566ab8640 1 --2- 172.21.15.84:0/814802420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff560103b60 0x7ff56019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.124+0000 7ff566ab8640 1 -- 172.21.15.84:0/814802420 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5601a0450 con 0x7ff560109df0 2024-09-21T03:44:53.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.125+0000 7ff566ab8640 1 --2- 172.21.15.84:0/814802420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff560109df0 0x7ff56019fd20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff55800eaa0 tx=0x7ff55800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:53.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.125+0000 7ff5577fe640 1 -- 172.21.15.84:0/814802420 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55800cdb0 con 0x7ff560109df0 2024-09-21T03:44:53.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.125+0000 7ff5577fe640 1 -- 172.21.15.84:0/814802420 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff558005020 con 0x7ff560109df0 2024-09-21T03:44:53.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.125+0000 7ff56851b640 1 -- 172.21.15.84:0/814802420 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5601a0740 con 0x7ff560109df0 2024-09-21T03:44:53.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.125+0000 7ff5577fe640 1 -- 172.21.15.84:0/814802420 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5580116d0 con 0x7ff560109df0 2024-09-21T03:44:53.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.125+0000 7ff56851b640 1 -- 172.21.15.84:0/814802420 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5601a6ea0 con 0x7ff560109df0 2024-09-21T03:44:53.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.127+0000 7ff5577fe640 1 -- 172.21.15.84:0/814802420 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7ff5580051d0 con 0x7ff560109df0 2024-09-21T03:44:53.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.127+0000 7ff56ea8f740 1 Processor -- start 2024-09-21T03:44:53.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.128+0000 7ff56ea8f740 1 -- start start 2024-09-21T03:44:53.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.128+0000 7ff56ea8f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad478a3070 0x55ad47c4a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:53.154 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.128+0000 7ff56ea8f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad4787a1b0 0x55ad47c4ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:53.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.128+0000 7ff56ea8f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad47882390 0x55ad47c4b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:53.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.128+0000 7ff56ea8f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ad47bc0e50 con 0x55ad478a3070 2024-09-21T03:44:53.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.128+0000 7ff56ea8f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ad47bb0280 con 0x55ad4787a1b0 2024-09-21T03:44:53.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.128+0000 7ff56ea8f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ad47bb4090 con 0x55ad47882390 2024-09-21T03:44:53.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.128+0000 7ff565ab6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad478a3070 0x55ad47c4a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:53.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.128+0000 7ff565ab6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad478a3070 0x55ad47c4a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33184/0 (socket says 172.21.15.84:33184) 2024-09-21T03:44:53.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.128+0000 7ff565ab6640 1 -- 172.21.15.84:0/391767997 learned_addr learned my addr 172.21.15.84:0/391767997 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:53.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.128+0000 7ff5662b7640 1 --2- 172.21.15.84:0/391767997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad4787a1b0 0x55ad47c4ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:53.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.128+0000 7ff5577fe640 1 --2- 172.21.15.84:0/814802420 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff54c0b6680 0x7ff54c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:53.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.128+0000 7ff565ab6640 1 --2- 172.21.15.84:0/391767997 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad47882390 0x55ad47c4b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:53.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.128+0000 7ff565ab6640 1 -- 172.21.15.84:0/391767997 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad47882390 msgr2=0x55ad47c4b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:53.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.128+0000 7ff565ab6640 1 --2- 172.21.15.84:0/391767997 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad47882390 0x55ad47c4b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.129+0000 7ff565ab6640 1 -- 172.21.15.84:0/391767997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad4787a1b0 msgr2=0x55ad47c4ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:53.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.129+0000 7ff565ab6640 1 --2- 172.21.15.84:0/391767997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad4787a1b0 0x55ad47c4ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.129+0000 7ff566ab8640 1 --2- 172.21.15.84:0/814802420 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff54c0b6680 0x7ff54c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:53.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.129+0000 7ff565ab6640 1 -- 172.21.15.84:0/391767997 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad4790e650 con 0x55ad478a3070 2024-09-21T03:44:53.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.129+0000 7ff5577fe640 1 -- 172.21.15.84:0/814802420 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff5580e7900 con 0x7ff560109df0 2024-09-21T03:44:53.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.129+0000 7ff565ab6640 1 --2- 172.21.15.84:0/391767997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad478a3070 0x55ad47c4a650 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff550006aa0 tx=0x7ff55000b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b15030b54a38a52 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:53.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.129+0000 7ff554ff9640 1 -- 172.21.15.84:0/391767997 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5500173f0 con 0x55ad478a3070 2024-09-21T03:44:53.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.129+0000 7ff554ff9640 1 -- 172.21.15.84:0/391767997 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff550010040 con 0x55ad478a3070 2024-09-21T03:44:53.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.129+0000 7ff554ff9640 1 -- 172.21.15.84:0/391767997 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5500169e0 con 0x55ad478a3070 2024-09-21T03:44:53.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.130+0000 7ff56ea8f740 1 -- 172.21.15.84:0/391767997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad478a3070 msgr2=0x55ad47c4a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:53.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.130+0000 7ff566ab8640 1 --2- 172.21.15.84:0/814802420 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff54c0b6680 0x7ff54c0b8b90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff5580ad700 tx=0x7ff5580de210 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:53.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.130+0000 7ff56ea8f740 1 --2- 172.21.15.84:0/391767997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad478a3070 0x55ad47c4a650 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff550006aa0 tx=0x7ff55000b400 comp rx=0 tx=0).stop 2024-09-21T03:44:53.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.130+0000 7ff56ea8f740 1 -- 172.21.15.84:0/391767997 shutdown_connections 2024-09-21T03:44:53.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.130+0000 7ff56ea8f740 1 --2- 172.21.15.84:0/391767997 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad47882390 0x55ad47c4b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.130+0000 7ff56ea8f740 1 --2- 172.21.15.84:0/391767997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad4787a1b0 0x55ad47c4ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.130+0000 7ff56ea8f740 1 --2- 172.21.15.84:0/391767997 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad478a3070 0x55ad47c4a650 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.130+0000 7ff56ea8f740 1 -- 172.21.15.84:0/391767997 >> 172.21.15.84:0/391767997 conn(0x55ad47897460 msgr2=0x55ad47c48540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:53.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.130+0000 7ff56ea8f740 1 -- 172.21.15.84:0/391767997 shutdown_connections 2024-09-21T03:44:53.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.130+0000 7ff56ea8f740 1 -- 172.21.15.84:0/391767997 wait complete. 2024-09-21T03:44:53.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.130+0000 7ff56ea8f740 1 -- start start 2024-09-21T03:44:53.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.130+0000 7ff56ea8f740 1 Processor -- start 2024-09-21T03:44:53.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.131+0000 7ff56ea8f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad4787a1b0 0x55ad47c55d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:53.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.131+0000 7ff56ea8f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad47882390 0x55ad47c562a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:53.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.131+0000 7ff56ea8f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad478a3070 0x55ad47c620c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:53.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.131+0000 7ff56ea8f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ad47a11700 con 0x55ad47882390 2024-09-21T03:44:53.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.131+0000 7ff56ea8f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ad47b4b110 con 0x55ad478a3070 2024-09-21T03:44:53.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.131+0000 7ff56ea8f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ad47c58dd0 con 0x55ad4787a1b0 2024-09-21T03:44:53.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.131+0000 7ff56ea8f740 10 client.0 _ll_register_callbacks cb 0x55ad47b64990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:53.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.131+0000 7ff5662b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad47882390 0x55ad47c562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:53.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.131+0000 7ff5662b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad47882390 0x55ad47c562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33194/0 (socket says 172.21.15.84:33194) 2024-09-21T03:44:53.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.131+0000 7ff5662b7640 1 -- 172.21.15.84:0/3862120303 learned_addr learned my addr 172.21.15.84:0/3862120303 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:53.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.131+0000 7ff565ab6640 1 --2- 172.21.15.84:0/3862120303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad478a3070 0x55ad47c620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:53.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.131+0000 7ff565ab6640 1 --2- 172.21.15.84:0/3862120303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad4787a1b0 0x55ad47c55d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:53.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.131+0000 7ff5662b7640 1 -- 172.21.15.84:0/3862120303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad4787a1b0 msgr2=0x55ad47c55d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:53.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.131+0000 7ff5662b7640 1 --2- 172.21.15.84:0/3862120303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad4787a1b0 0x55ad47c55d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.131+0000 7ff5662b7640 1 -- 172.21.15.84:0/3862120303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad478a3070 msgr2=0x55ad47c620c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:53.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.131+0000 7ff5662b7640 1 --2- 172.21.15.84:0/3862120303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad478a3070 0x55ad47c620c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.131+0000 7ff5662b7640 1 -- 172.21.15.84:0/3862120303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad47b78c40 con 0x55ad47882390 2024-09-21T03:44:53.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.132+0000 7ff5662b7640 1 --2- 172.21.15.84:0/3862120303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad47882390 0x55ad47c562a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009900 tx=0x7ff55c0314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc2f0dd1b9dc85e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:53.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.132+0000 7ff549ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:53.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.132+0000 7ff549ffb640 1 -- 172.21.15.84:0/3862120303 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c035040 con 0x55ad47882390 2024-09-21T03:44:53.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.132+0000 7ff549ffb640 1 -- 172.21.15.84:0/3862120303 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff55c031790 con 0x55ad47882390 2024-09-21T03:44:53.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.132+0000 7ff56ea8f740 1 -- 172.21.15.84:0/3862120303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff550010040 con 0x55ad47882390 2024-09-21T03:44:53.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.132+0000 7ff549ffb640 1 -- 172.21.15.84:0/3862120303 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff55c004040 con 0x55ad47882390 2024-09-21T03:44:53.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.132+0000 7ff56ea8f740 10 client.15951 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:53.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.132+0000 7ff56ea8f740 1 -- 172.21.15.84:0/3862120303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ad47c64ae0 con 0x55ad47882390 2024-09-21T03:44:53.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.132+0000 7ff549ffb640 1 -- 172.21.15.84:0/3862120303 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff550010040 con 0x55ad47882390 2024-09-21T03:44:53.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.132+0000 7ff549ffb640 1 -- 172.21.15.84:0/3862120303 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff55c0047e0 con 0x55ad47882390 2024-09-21T03:44:53.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.132+0000 7ff56ea8f740 10 client.15951 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:53.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.132+0000 7ff56ea8f740 10 client.15951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:44:53.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.132+0000 7ff56ea8f740 20 client.15951 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:53.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.132+0000 7ff56ea8f740 1 --2- 172.21.15.84:0/3862120303 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ad478619f0 0x55ad47c67ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:53.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.132+0000 7ff56ea8f740 4 client.15951 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:44:53.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.132+0000 7ff56ea8f740 1 -- 172.21.15.84:0/3862120303 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad47bc2da0 con 0x55ad478619f0 2024-09-21T03:44:53.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.133+0000 7ff565ab6640 1 --2- 172.21.15.84:0/3862120303 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ad478619f0 0x55ad47c67ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:53.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.133+0000 7ff549ffb640 10 client.15951 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:53.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.133+0000 7ff565ab6640 1 --2- 172.21.15.84:0/3862120303 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ad478619f0 0x55ad47c67ff0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=424b7ef54bcb5c6b server_cookie=1113652cdc61992d in_seq=0 out_seq=0 2024-09-21T03:44:53.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.134+0000 7ff549ffb640 1 -- 172.21.15.84:0/3862120303 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ad47bc2da0 con 0x55ad478619f0 2024-09-21T03:44:53.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.134+0000 7ff549ffb640 10 client.15951 handle_command_reply: tid=0 2024-09-21T03:44:53.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.134+0000 7ff56ea8f740 1 client.15951 shutdown 2024-09-21T03:44:53.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.134+0000 7ff56ea8f740 1 -- 172.21.15.84:0/3862120303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad47882390 msgr2=0x55ad47c562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:53.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.134+0000 7ff56ea8f740 1 --2- 172.21.15.84:0/3862120303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad47882390 0x55ad47c562a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009900 tx=0x7ff55c0314a0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.134+0000 7ff56ea8f740 1 -- 172.21.15.84:0/3862120303 shutdown_connections 2024-09-21T03:44:53.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.134+0000 7ff56ea8f740 1 --2- 172.21.15.84:0/3862120303 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ad478619f0 0x55ad47c67ff0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.134+0000 7ff56ea8f740 1 --2- 172.21.15.84:0/3862120303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad478a3070 0x55ad47c620c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.134+0000 7ff549ffb640 0 client.15951 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:53.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.134+0000 7ff56ea8f740 1 --2- 172.21.15.84:0/3862120303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad47882390 0x55ad47c562a0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.134+0000 7ff56ea8f740 1 --2- 172.21.15.84:0/3862120303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad4787a1b0 0x55ad47c55d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.134+0000 7ff56ea8f740 1 -- 172.21.15.84:0/3862120303 >> 172.21.15.84:0/3862120303 conn(0x55ad47897460 msgr2=0x55ad47c4d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:53.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.134+0000 7ff56ea8f740 1 -- 172.21.15.84:0/3862120303 shutdown_connections 2024-09-21T03:44:53.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.134+0000 7ff56ea8f740 1 -- 172.21.15.84:0/3862120303 wait complete. 2024-09-21T03:44:53.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.135+0000 7ff56ea8f740 20 client.15951 trim_cache size 0 max 16384 2024-09-21T03:44:53.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.152+0000 7ff56ea8f740 1 Processor -- start 2024-09-21T03:44:53.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.152+0000 7ff56ea8f740 1 -- start start 2024-09-21T03:44:53.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.152+0000 7ff56ea8f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad478619f0 0x55ad47c4bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:53.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.152+0000 7ff56ea8f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad4787a1b0 0x55ad47c61fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:53.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.152+0000 7ff56ea8f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad47882390 0x55ad47c52f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:53.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.152+0000 7ff56ea8f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff5601b1f10 con 0x55ad47882390 2024-09-21T03:44:53.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.152+0000 7ff56ea8f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff5601af7e0 con 0x55ad478619f0 2024-09-21T03:44:53.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.152+0000 7ff56ea8f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff5601ad630 con 0x55ad4787a1b0 2024-09-21T03:44:53.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.152+0000 7ff565ab6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad47882390 0x55ad47c52f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:53.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.152+0000 7ff565ab6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad47882390 0x55ad47c52f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33204/0 (socket says 172.21.15.84:33204) 2024-09-21T03:44:53.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.152+0000 7ff565ab6640 1 -- 172.21.15.84:0/4041291637 learned_addr learned my addr 172.21.15.84:0/4041291637 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:53.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.153+0000 7ff565ab6640 1 --2- 172.21.15.84:0/4041291637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad478619f0 0x55ad47c4bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:53.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.153+0000 7ff5662b7640 1 --2- 172.21.15.84:0/4041291637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad4787a1b0 0x55ad47c61fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:53.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.153+0000 7ff565ab6640 1 -- 172.21.15.84:0/4041291637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad4787a1b0 msgr2=0x55ad47c61fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:53.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.153+0000 7ff565ab6640 1 --2- 172.21.15.84:0/4041291637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad4787a1b0 0x55ad47c61fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.153+0000 7ff565ab6640 1 -- 172.21.15.84:0/4041291637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad478619f0 msgr2=0x55ad47c4bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:53.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.153+0000 7ff565ab6640 1 --2- 172.21.15.84:0/4041291637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad478619f0 0x55ad47c4bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.153+0000 7ff565ab6640 1 -- 172.21.15.84:0/4041291637 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad47c584a0 con 0x55ad47882390 2024-09-21T03:44:53.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.153+0000 7ff565ab6640 1 --2- 172.21.15.84:0/4041291637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad47882390 0x55ad47c52f50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff55000f9e0 tx=0x7ff5500165c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16797912a84bc42 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:53.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.153+0000 7ff54bfff640 1 -- 172.21.15.84:0/4041291637 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff550032070 con 0x55ad47882390 2024-09-21T03:44:53.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.153+0000 7ff54bfff640 1 -- 172.21.15.84:0/4041291637 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff55002a070 con 0x55ad47882390 2024-09-21T03:44:53.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.153+0000 7ff54bfff640 1 -- 172.21.15.84:0/4041291637 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff550037bc0 con 0x55ad47882390 2024-09-21T03:44:53.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.154+0000 7ff56ea8f740 1 -- 172.21.15.84:0/4041291637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad47882390 msgr2=0x55ad47c52f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:53.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.154+0000 7ff56ea8f740 1 --2- 172.21.15.84:0/4041291637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad47882390 0x55ad47c52f50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff55000f9e0 tx=0x7ff5500165c0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.154+0000 7ff56ea8f740 1 -- 172.21.15.84:0/4041291637 shutdown_connections 2024-09-21T03:44:53.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.154+0000 7ff56ea8f740 1 --2- 172.21.15.84:0/4041291637 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad47882390 0x55ad47c52f50 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.154+0000 7ff56ea8f740 1 --2- 172.21.15.84:0/4041291637 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad4787a1b0 0x55ad47c61fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.154+0000 7ff56ea8f740 1 --2- 172.21.15.84:0/4041291637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad478619f0 0x55ad47c4bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.154+0000 7ff56ea8f740 1 -- 172.21.15.84:0/4041291637 >> 172.21.15.84:0/4041291637 conn(0x55ad47897460 msgr2=0x55ad47c4b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:53.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.154+0000 7ff56ea8f740 1 -- 172.21.15.84:0/4041291637 shutdown_connections 2024-09-21T03:44:53.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.154+0000 7ff56ea8f740 1 -- 172.21.15.84:0/4041291637 wait complete. 2024-09-21T03:44:53.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.154+0000 7ff56ea8f740 1 -- start start 2024-09-21T03:44:53.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.154+0000 7ff56ea8f740 1 Processor -- start 2024-09-21T03:44:53.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.155+0000 7ff56ea8f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad478619f0 0x55ad47c5dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:53.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.155+0000 7ff56ea8f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad4787a1b0 0x55ad47c5e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:53.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.155+0000 7ff56ea8f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad47882390 0x55ad47ccba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:53.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.155+0000 7ff56ea8f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff5601adca0 con 0x55ad478619f0 2024-09-21T03:44:53.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.155+0000 7ff56ea8f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff5601af110 con 0x55ad47882390 2024-09-21T03:44:53.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.155+0000 7ff56ea8f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff5601ae370 con 0x55ad4787a1b0 2024-09-21T03:44:53.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.155+0000 7ff56ea8f740 10 client.0 _ll_register_callbacks cb 0x7ff55c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:53.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.155+0000 7ff565ab6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad478619f0 0x55ad47c5dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:53.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.155+0000 7ff565ab6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad478619f0 0x55ad47c5dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33218/0 (socket says 172.21.15.84:33218) 2024-09-21T03:44:53.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.155+0000 7ff565ab6640 1 -- 172.21.15.84:0/2774596835 learned_addr learned my addr 172.21.15.84:0/2774596835 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:53.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.155+0000 7ff5662b7640 1 --2- 172.21.15.84:0/2774596835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad4787a1b0 0x55ad47c5e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:53.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.155+0000 7ff565ab6640 1 -- 172.21.15.84:0/2774596835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad4787a1b0 msgr2=0x55ad47c5e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:53.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.155+0000 7ff565ab6640 1 --2- 172.21.15.84:0/2774596835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad4787a1b0 0x55ad47c5e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.155+0000 7ff565ab6640 1 -- 172.21.15.84:0/2774596835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad47882390 msgr2=0x55ad47ccba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:53.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.155+0000 7ff565ab6640 1 --2- 172.21.15.84:0/2774596835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad47882390 0x55ad47ccba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.155+0000 7ff565ab6640 1 -- 172.21.15.84:0/2774596835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad47c5ea70 con 0x55ad478619f0 2024-09-21T03:44:53.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.155+0000 7ff5662b7640 1 --2- 172.21.15.84:0/2774596835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad4787a1b0 0x55ad47c5e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:53.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.155+0000 7ff565ab6640 1 --2- 172.21.15.84:0/2774596835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad478619f0 0x55ad47c5dff0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff550019040 tx=0x7ff55000ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac2209472ccc8e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:53.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.155+0000 7ff549ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:53.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.156+0000 7ff549ffb640 1 -- 172.21.15.84:0/2774596835 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff550032040 con 0x55ad478619f0 2024-09-21T03:44:53.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.156+0000 7ff549ffb640 1 -- 172.21.15.84:0/2774596835 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff550037b40 con 0x55ad478619f0 2024-09-21T03:44:53.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.156+0000 7ff56ea8f740 1 -- 172.21.15.84:0/2774596835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff55002a070 con 0x55ad478619f0 2024-09-21T03:44:53.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.156+0000 7ff549ffb640 1 -- 172.21.15.84:0/2774596835 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff550049050 con 0x55ad478619f0 2024-09-21T03:44:53.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.156+0000 7ff56ea8f740 10 client.15957 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:53.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.156+0000 7ff56ea8f740 1 -- 172.21.15.84:0/2774596835 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ad47cd7050 con 0x55ad478619f0 2024-09-21T03:44:53.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.156+0000 7ff549ffb640 1 -- 172.21.15.84:0/2774596835 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff55002a070 con 0x55ad478619f0 2024-09-21T03:44:53.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.156+0000 7ff549ffb640 1 -- 172.21.15.84:0/2774596835 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff5500254d0 con 0x55ad478619f0 2024-09-21T03:44:53.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.156+0000 7ff56ea8f740 10 client.15957 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:53.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.156+0000 7ff56ea8f740 10 client.15957 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:44:53.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.156+0000 7ff56ea8f740 20 client.15957 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:53.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.156+0000 7ff56ea8f740 1 --2- 172.21.15.84:0/2774596835 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ad478a3070 0x55ad47cd94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.156+0000 7ff56ea8f740 4 client.15957 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:44:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.156+0000 7ff56ea8f740 1 -- 172.21.15.84:0/2774596835 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ad47bbe850 con 0x55ad478a3070 2024-09-21T03:44:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.156+0000 7ff5662b7640 1 --2- 172.21.15.84:0/2774596835 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ad478a3070 0x55ad47cd94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.157+0000 7ff549ffb640 10 client.15957 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.157+0000 7ff5662b7640 1 --2- 172.21.15.84:0/2774596835 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ad478a3070 0x55ad47cd94f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4aab2be72d1dcaa server_cookie=f1d8e235e476cfd2 in_seq=0 out_seq=0 2024-09-21T03:44:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.157+0000 7ff549ffb640 1 -- 172.21.15.84:0/2774596835 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x55ad47bbe850 con 0x55ad478a3070 2024-09-21T03:44:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.157+0000 7ff549ffb640 10 client.15957 handle_command_reply: tid=0 2024-09-21T03:44:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.157+0000 7ff56ea8f740 1 client.15957 shutdown 2024-09-21T03:44:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.157+0000 7ff56ea8f740 1 -- 172.21.15.84:0/2774596835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad478619f0 msgr2=0x55ad47c5dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.157+0000 7ff56ea8f740 1 --2- 172.21.15.84:0/2774596835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad478619f0 0x55ad47c5dff0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff550019040 tx=0x7ff55000ff50 comp rx=0 tx=0).stop 2024-09-21T03:44:53.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.157+0000 7ff56ea8f740 1 -- 172.21.15.84:0/2774596835 shutdown_connections 2024-09-21T03:44:53.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.157+0000 7ff56ea8f740 1 --2- 172.21.15.84:0/2774596835 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ad478a3070 0x55ad47cd94f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.157+0000 7ff56ea8f740 1 --2- 172.21.15.84:0/2774596835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad47882390 0x55ad47ccba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.157+0000 7ff56ea8f740 1 --2- 172.21.15.84:0/2774596835 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ad4787a1b0 0x55ad47c5e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.157+0000 7ff549ffb640 0 client.15957 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:53.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.157+0000 7ff56ea8f740 1 --2- 172.21.15.84:0/2774596835 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ad478619f0 0x55ad47c5dff0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.157+0000 7ff56ea8f740 1 -- 172.21.15.84:0/2774596835 >> 172.21.15.84:0/2774596835 conn(0x55ad47897460 msgr2=0x55ad47c4d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:53.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.157+0000 7ff56ea8f740 1 -- 172.21.15.84:0/2774596835 shutdown_connections 2024-09-21T03:44:53.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.157+0000 7ff56ea8f740 1 -- 172.21.15.84:0/2774596835 wait complete. 2024-09-21T03:44:53.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.158+0000 7ff56ea8f740 20 client.15957 trim_cache size 0 max 16384 2024-09-21T03:44:53.183 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:44:53.183 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T03:44:53.183 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T03:44:53.183 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:44:53.183 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:44:53.183 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:44:53.183 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:44:53.184 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:44:53.184 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:44:53.184 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:44:53.184 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:44:53.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:44:53.184 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:44:53.184 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:44:53.184 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:44:53.184 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:44:53.184 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:44:53.185 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:44:53.185 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:44:53.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:44:53.185 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:44:53.185 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:44:53.185 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:44:53.185 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:44:53.185 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:44:53.185 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:44:53.185 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:44:53.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:44:53.186 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:44:53.186 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:44:53.186 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:44:53.186 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:44:53.186 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:44:53.186 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:44:53.186 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:44:53.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:44:53.187 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:44:53.187 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:44:53.187 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:44:53.187 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:44:53.187 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:44:53.187 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:44:53.187 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:44:53.187 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:44:53.187 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:44:53.187 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:44:53.188 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.158+0000 7ff56851b640 1 -- 172.21.15.84:0/814802420 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff54c0b6680 msgr2=0x7ff54c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:53.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.158+0000 7ff56851b640 1 --2- 172.21.15.84:0/814802420 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff54c0b6680 0x7ff54c0b8b90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff5580ad700 tx=0x7ff5580de210 comp rx=0 tx=0).stop 2024-09-21T03:44:53.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.158+0000 7ff56851b640 1 -- 172.21.15.84:0/814802420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff560109df0 msgr2=0x7ff56019fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:53.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.158+0000 7ff56851b640 1 --2- 172.21.15.84:0/814802420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff560109df0 0x7ff56019fd20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff55800eaa0 tx=0x7ff55800ef60 comp rx=0 tx=0).stop 2024-09-21T03:44:53.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.158+0000 7ff56851b640 1 -- 172.21.15.84:0/814802420 shutdown_connections 2024-09-21T03:44:53.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.158+0000 7ff56851b640 1 --2- 172.21.15.84:0/814802420 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff54c0b6680 0x7ff54c0b8b90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.158+0000 7ff56851b640 1 --2- 172.21.15.84:0/814802420 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff560109df0 0x7ff56019fd20 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.158+0000 7ff56851b640 1 --2- 172.21.15.84:0/814802420 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5601094a0 0x7ff56019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.158+0000 7ff56851b640 1 --2- 172.21.15.84:0/814802420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff560103b60 0x7ff56019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:53.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.158+0000 7ff56851b640 1 -- 172.21.15.84:0/814802420 >> 172.21.15.84:0/814802420 conn(0x7ff56007b850 msgr2=0x7ff560107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:53.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.158+0000 7ff56851b640 1 -- 172.21.15.84:0/814802420 shutdown_connections 2024-09-21T03:44:53.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:53.158+0000 7ff56851b640 1 -- 172.21.15.84:0/814802420 wait complete. 2024-09-21T03:44:53.739 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:53 smithi084 ceph-mon[30941]: pgmap v396: 97 pgs: 97 active+clean; 2.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:44:53.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:53 smithi174 ceph-mon[34403]: pgmap v396: 97 pgs: 97 active+clean; 2.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:44:53.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:53 smithi172 ceph-mon[34821]: pgmap v396: 97 pgs: 97 active+clean; 2.7 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:44:53.963 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:44:53.964 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:44:54.211 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:54.648 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:54 smithi084 ceph-mon[30941]: pgmap v397: 97 pgs: 97 active+clean; 2.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-21T03:44:54.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.733+0000 7fe8d6cb4640 1 -- 172.21.15.84:0/1816313731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d0109df0 msgr2=0x7fe8d0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.733+0000 7fe8d6cb4640 1 --2- 172.21.15.84:0/1816313731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d0109df0 0x7fe8d0110620 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8009ca0 tx=0x7fe8c802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:44:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.733+0000 7fe8d6cb4640 1 -- 172.21.15.84:0/1816313731 shutdown_connections 2024-09-21T03:44:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.733+0000 7fe8d6cb4640 1 --2- 172.21.15.84:0/1816313731 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d0109df0 0x7fe8d0110620 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.733+0000 7fe8d6cb4640 1 --2- 172.21.15.84:0/1816313731 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8d01094a0 0x7fe8d01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.733+0000 7fe8d6cb4640 1 --2- 172.21.15.84:0/1816313731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8d0103b60 0x7fe8d0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.733+0000 7fe8d6cb4640 1 -- 172.21.15.84:0/1816313731 >> 172.21.15.84:0/1816313731 conn(0x7fe8d007b850 msgr2=0x7fe8d007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.733+0000 7fe8d6cb4640 1 -- 172.21.15.84:0/1816313731 shutdown_connections 2024-09-21T03:44:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.733+0000 7fe8d6cb4640 1 -- 172.21.15.84:0/1816313731 wait complete. 2024-09-21T03:44:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.734+0000 7fe8d6cb4640 1 Processor -- start 2024-09-21T03:44:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.734+0000 7fe8d6cb4640 1 -- start start 2024-09-21T03:44:54.756 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.734+0000 7fe8d6cb4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8d0103b60 0x7fe8d019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:54.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.734+0000 7fe8d6cb4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d01094a0 0x7fe8d019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:54.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.734+0000 7fe8d6cb4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8d0109df0 0x7fe8d019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:54.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.734+0000 7fe8d6cb4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d0113ab0 con 0x7fe8d01094a0 2024-09-21T03:44:54.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.734+0000 7fe8d6cb4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d0113930 con 0x7fe8d0109df0 2024-09-21T03:44:54.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.734+0000 7fe8d6cb4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d0113c30 con 0x7fe8d0103b60 2024-09-21T03:44:54.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.734+0000 7fe8cffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d01094a0 0x7fe8d019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:54.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.734+0000 7fe8cffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d01094a0 0x7fe8d019aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33232/0 (socket says 172.21.15.84:33232) 2024-09-21T03:44:54.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.734+0000 7fe8cffff640 1 -- 172.21.15.84:0/351999605 learned_addr learned my addr 172.21.15.84:0/351999605 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:54.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.734+0000 7fe8d5251640 1 --2- 172.21.15.84:0/351999605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8d0109df0 0x7fe8d019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:54.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.734+0000 7fe8d4a50640 1 --2- 172.21.15.84:0/351999605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8d0103b60 0x7fe8d019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:54.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.734+0000 7fe8cffff640 1 -- 172.21.15.84:0/351999605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8d0103b60 msgr2=0x7fe8d019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:54.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.734+0000 7fe8cffff640 1 --2- 172.21.15.84:0/351999605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8d0103b60 0x7fe8d019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:54.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.734+0000 7fe8cffff640 1 -- 172.21.15.84:0/351999605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8d0109df0 msgr2=0x7fe8d019fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:54.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.734+0000 7fe8cffff640 1 --2- 172.21.15.84:0/351999605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8d0109df0 0x7fe8d019fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:54.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.734+0000 7fe8cffff640 1 -- 172.21.15.84:0/351999605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d01a03d0 con 0x7fe8d01094a0 2024-09-21T03:44:54.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.735+0000 7fe8cffff640 1 --2- 172.21.15.84:0/351999605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d01094a0 0x7fe8d019aa00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00d750 tx=0x7fe8bc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:54.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.735+0000 7fe8cdffb640 1 -- 172.21.15.84:0/351999605 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc017070 con 0x7fe8d01094a0 2024-09-21T03:44:54.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.735+0000 7fe8d6cb4640 1 -- 172.21.15.84:0/351999605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8d01a06c0 con 0x7fe8d01094a0 2024-09-21T03:44:54.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.735+0000 7fe8cdffb640 1 -- 172.21.15.84:0/351999605 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8bc0054d0 con 0x7fe8d01094a0 2024-09-21T03:44:54.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.735+0000 7fe8cdffb640 1 -- 172.21.15.84:0/351999605 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc004c30 con 0x7fe8d01094a0 2024-09-21T03:44:54.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.735+0000 7fe8d6cb4640 1 -- 172.21.15.84:0/351999605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8d01a6e20 con 0x7fe8d01094a0 2024-09-21T03:44:54.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.736+0000 7fe8d6cb4640 1 -- 172.21.15.84:0/351999605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8d0103f70 con 0x7fe8d01094a0 2024-09-21T03:44:54.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.738+0000 7fe8cdffb640 1 -- 172.21.15.84:0/351999605 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fe8bc004dd0 con 0x7fe8d01094a0 2024-09-21T03:44:54.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.738+0000 7fe8cdffb640 1 --2- 172.21.15.84:0/351999605 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe8c00b6680 0x7fe8c00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:54.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.739+0000 7fe8d4a50640 1 --2- 172.21.15.84:0/351999605 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe8c00b6680 0x7fe8c00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:54.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.739+0000 7fe8cdffb640 1 -- 172.21.15.84:0/351999605 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe8bc0e7480 con 0x7fe8d01094a0 2024-09-21T03:44:54.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.739+0000 7fe8d4a50640 1 --2- 172.21.15.84:0/351999605 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe8c00b6680 0x7fe8c00b8b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe8c40058c0 tx=0x7fe8c400a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:54.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.742+0000 7fe8cdffb640 1 -- 172.21.15.84:0/351999605 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe8bc0b1e30 con 0x7fe8d01094a0 2024-09-21T03:44:54.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:54 smithi174 ceph-mon[34403]: pgmap v397: 97 pgs: 97 active+clean; 2.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-21T03:44:54.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:54 smithi172 ceph-mon[34821]: pgmap v397: 97 pgs: 97 active+clean; 2.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-09-21T03:44:54.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.956+0000 7fe8d6cb4640 1 -- 172.21.15.84:0/351999605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8d010bc10 con 0x7fe8d01094a0 2024-09-21T03:44:54.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.957+0000 7fe8cdffb640 1 -- 172.21.15.84:0/351999605 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7fe8bc0b6020 con 0x7fe8d01094a0 2024-09-21T03:44:54.961 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:44:54.961 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:44:54.961 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:44:54.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.960+0000 7fe8d6cb4640 1 -- 172.21.15.84:0/351999605 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe8c00b6680 msgr2=0x7fe8c00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:54.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.960+0000 7fe8d6cb4640 1 --2- 172.21.15.84:0/351999605 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe8c00b6680 0x7fe8c00b8b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe8c40058c0 tx=0x7fe8c400a2d0 comp rx=0 tx=0).stop 2024-09-21T03:44:54.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.960+0000 7fe8d6cb4640 1 -- 172.21.15.84:0/351999605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d01094a0 msgr2=0x7fe8d019aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:54.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.960+0000 7fe8d6cb4640 1 --2- 172.21.15.84:0/351999605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d01094a0 0x7fe8d019aa00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00d750 tx=0x7fe8bc00dc10 comp rx=0 tx=0).stop 2024-09-21T03:44:54.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.960+0000 7fe8d6cb4640 1 -- 172.21.15.84:0/351999605 shutdown_connections 2024-09-21T03:44:54.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.960+0000 7fe8d6cb4640 1 --2- 172.21.15.84:0/351999605 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe8c00b6680 0x7fe8c00b8b90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:54.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.960+0000 7fe8d6cb4640 1 --2- 172.21.15.84:0/351999605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8d0109df0 0x7fe8d019fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:54.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.960+0000 7fe8d6cb4640 1 --2- 172.21.15.84:0/351999605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe8d01094a0 0x7fe8d019aa00 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:54.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.960+0000 7fe8d6cb4640 1 --2- 172.21.15.84:0/351999605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe8d0103b60 0x7fe8d019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:54.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.960+0000 7fe8d6cb4640 1 -- 172.21.15.84:0/351999605 >> 172.21.15.84:0/351999605 conn(0x7fe8d007b850 msgr2=0x7fe8d01074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:54.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.960+0000 7fe8d6cb4640 1 -- 172.21.15.84:0/351999605 shutdown_connections 2024-09-21T03:44:54.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:54.960+0000 7fe8d6cb4640 1 -- 172.21.15.84:0/351999605 wait complete. 2024-09-21T03:44:55.752 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:55 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/351999605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:44:55.779 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:44:55.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:55 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/351999605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:44:55.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:55 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/351999605' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:44:56.033 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:56.556 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:56 smithi084 ceph-mon[30941]: pgmap v398: 97 pgs: 97 active+clean; 2.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-21T03:44:56.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.552+0000 7f77f26aa640 1 -- 172.21.15.84:0/387523148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77ec102140 msgr2=0x7f77ec102550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:56.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.552+0000 7f77f26aa640 1 --2- 172.21.15.84:0/387523148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77ec102140 0x7f77ec102550 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f77dc009900 tx=0x7f77dc02a410 comp rx=0 tx=0).stop 2024-09-21T03:44:56.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.552+0000 7f77f26aa640 1 -- 172.21.15.84:0/387523148 shutdown_connections 2024-09-21T03:44:56.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.552+0000 7f77f26aa640 1 --2- 172.21.15.84:0/387523148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77ec106c80 0x7f77ec110710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.552+0000 7f77f26aa640 1 --2- 172.21.15.84:0/387523148 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77ec106330 0x7f77ec106740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.552+0000 7f77f26aa640 1 --2- 172.21.15.84:0/387523148 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77ec102140 0x7f77ec102550 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.552+0000 7f77f26aa640 1 -- 172.21.15.84:0/387523148 >> 172.21.15.84:0/387523148 conn(0x7f77ec079ec0 msgr2=0x7f77ec07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:56.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.552+0000 7f77f26aa640 1 -- 172.21.15.84:0/387523148 shutdown_connections 2024-09-21T03:44:56.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.552+0000 7f77f26aa640 1 -- 172.21.15.84:0/387523148 wait complete. 2024-09-21T03:44:56.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.553+0000 7f77f26aa640 1 Processor -- start 2024-09-21T03:44:56.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.553+0000 7f77f26aa640 1 -- start start 2024-09-21T03:44:56.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.554+0000 7f77f26aa640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77ec102140 0x7f77ec19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:56.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.554+0000 7f77f26aa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77ec106330 0x7f77ec19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:56.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.554+0000 7f77f26aa640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77ec106c80 0x7f77ec19fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:56.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.554+0000 7f77f26aa640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec113bb0 con 0x7f77ec102140 2024-09-21T03:44:56.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.554+0000 7f77f26aa640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec113a30 con 0x7f77ec106330 2024-09-21T03:44:56.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.554+0000 7f77f26aa640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec113d30 con 0x7f77ec106c80 2024-09-21T03:44:56.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.554+0000 7f77ebfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77ec102140 0x7f77ec19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:56.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.554+0000 7f77ebfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77ec102140 0x7f77ec19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33254/0 (socket says 172.21.15.84:33254) 2024-09-21T03:44:56.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.554+0000 7f77ebfff640 1 -- 172.21.15.84:0/3272977770 learned_addr learned my addr 172.21.15.84:0/3272977770 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:56.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.554+0000 7f77f0c47640 1 --2- 172.21.15.84:0/3272977770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77ec106c80 0x7f77ec19fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:56.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.554+0000 7f77eb7fe640 1 --2- 172.21.15.84:0/3272977770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77ec106330 0x7f77ec19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:56.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.554+0000 7f77ebfff640 1 -- 172.21.15.84:0/3272977770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77ec106c80 msgr2=0x7f77ec19fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:56.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.554+0000 7f77ebfff640 1 --2- 172.21.15.84:0/3272977770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77ec106c80 0x7f77ec19fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.554+0000 7f77ebfff640 1 -- 172.21.15.84:0/3272977770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77ec106330 msgr2=0x7f77ec19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:56.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.554+0000 7f77ebfff640 1 --2- 172.21.15.84:0/3272977770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77ec106330 0x7f77ec19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.554+0000 7f77ebfff640 1 -- 172.21.15.84:0/3272977770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ec1a0550 con 0x7f77ec102140 2024-09-21T03:44:56.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.554+0000 7f77f0c47640 1 --2- 172.21.15.84:0/3272977770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77ec106c80 0x7f77ec19fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:56.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.554+0000 7f77ebfff640 1 --2- 172.21.15.84:0/3272977770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77ec102140 0x7f77ec19a5e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f77dc005940 tx=0x7f77dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:56.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.555+0000 7f77e97fa640 1 -- 172.21.15.84:0/3272977770 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc03f030 con 0x7f77ec102140 2024-09-21T03:44:56.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.555+0000 7f77e97fa640 1 -- 172.21.15.84:0/3272977770 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77dc003cb0 con 0x7f77ec102140 2024-09-21T03:44:56.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.555+0000 7f77f26aa640 1 -- 172.21.15.84:0/3272977770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77ec1a07e0 con 0x7f77ec102140 2024-09-21T03:44:56.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.555+0000 7f77e97fa640 1 -- 172.21.15.84:0/3272977770 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc035070 con 0x7f77ec102140 2024-09-21T03:44:56.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.555+0000 7f77f26aa640 1 -- 172.21.15.84:0/3272977770 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77ec1a6fa0 con 0x7f77ec102140 2024-09-21T03:44:56.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.557+0000 7f77f8c1e740 1 Processor -- start 2024-09-21T03:44:56.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.557+0000 7f77f8c1e740 1 -- start start 2024-09-21T03:44:56.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.557+0000 7f77e97fa640 1 -- 172.21.15.84:0/3272977770 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f77dc042030 con 0x7f77ec102140 2024-09-21T03:44:56.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.558+0000 7f77f8c1e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef89070 0x55c5cf3306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:56.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.558+0000 7f77f8c1e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef601b0 0x55c5cf330be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:56.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.558+0000 7f77f8c1e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c5cef68390 0x55c5cf331120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:56.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.558+0000 7f77f8c1e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c5cf2a6ea0 con 0x55c5cef601b0 2024-09-21T03:44:56.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.558+0000 7f77f8c1e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c5cf2962d0 con 0x55c5cef89070 2024-09-21T03:44:56.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.558+0000 7f77f8c1e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c5cf29a0e0 con 0x55c5cef68390 2024-09-21T03:44:56.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.558+0000 7f77ebfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef601b0 0x55c5cf330be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:56.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.558+0000 7f77ebfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef601b0 0x55c5cf330be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33264/0 (socket says 172.21.15.84:33264) 2024-09-21T03:44:56.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.558+0000 7f77ebfff640 1 -- 172.21.15.84:0/284001324 learned_addr learned my addr 172.21.15.84:0/284001324 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:56.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.558+0000 7f77f0c47640 1 --2- 172.21.15.84:0/284001324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef89070 0x55c5cf3306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:56.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.558+0000 7f77eb7fe640 1 --2- 172.21.15.84:0/284001324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c5cef68390 0x55c5cf331120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:56.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.558+0000 7f77ebfff640 1 -- 172.21.15.84:0/284001324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c5cef68390 msgr2=0x55c5cf331120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:56.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.558+0000 7f77ebfff640 1 --2- 172.21.15.84:0/284001324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c5cef68390 0x55c5cf331120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.558+0000 7f77ebfff640 1 -- 172.21.15.84:0/284001324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef89070 msgr2=0x55c5cf3306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:56.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.558+0000 7f77ebfff640 1 --2- 172.21.15.84:0/284001324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef89070 0x55c5cf3306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.558+0000 7f77ebfff640 1 -- 172.21.15.84:0/284001324 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5ceff4650 con 0x55c5cef601b0 2024-09-21T03:44:56.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.558+0000 7f77e97fa640 1 --2- 172.21.15.84:0/3272977770 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f77d80b6680 0x7f77d80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:56.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.558+0000 7f77ebfff640 1 --2- 172.21.15.84:0/284001324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef601b0 0x55c5cf330be0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f77dc105520 tx=0x7f77dc1101a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16886695cfecc220 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:56.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.559+0000 7f77f0c47640 1 --2- 172.21.15.84:0/3272977770 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f77d80b6680 0x7f77d80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:56.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.559+0000 7f77e97fa640 1 -- 172.21.15.84:0/3272977770 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f77dc107de0 con 0x7f77ec102140 2024-09-21T03:44:56.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.559+0000 7f77e27fc640 1 -- 172.21.15.84:0/284001324 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc0ca300 con 0x55c5cef601b0 2024-09-21T03:44:56.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.559+0000 7f77e27fc640 1 -- 172.21.15.84:0/284001324 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77dc115070 con 0x55c5cef601b0 2024-09-21T03:44:56.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.559+0000 7f77e27fc640 1 -- 172.21.15.84:0/284001324 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc003e60 con 0x55c5cef601b0 2024-09-21T03:44:56.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.560+0000 7f77f8c1e740 1 -- 172.21.15.84:0/284001324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef601b0 msgr2=0x55c5cf330be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:56.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.560+0000 7f77f8c1e740 1 --2- 172.21.15.84:0/284001324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef601b0 0x55c5cf330be0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f77dc105520 tx=0x7f77dc1101a0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.560+0000 7f77f0c47640 1 --2- 172.21.15.84:0/3272977770 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f77d80b6680 0x7f77d80b8b90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f77e400af80 tx=0x7f77e400a730 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:56.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.560+0000 7f77f8c1e740 1 -- 172.21.15.84:0/284001324 shutdown_connections 2024-09-21T03:44:56.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.560+0000 7f77f8c1e740 1 --2- 172.21.15.84:0/284001324 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c5cef68390 0x55c5cf331120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.576 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.560+0000 7f77f8c1e740 1 --2- 172.21.15.84:0/284001324 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef601b0 0x55c5cf330be0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.560+0000 7f77f8c1e740 1 --2- 172.21.15.84:0/284001324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef89070 0x55c5cf3306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.560+0000 7f77f8c1e740 1 -- 172.21.15.84:0/284001324 >> 172.21.15.84:0/284001324 conn(0x55c5cef7d460 msgr2=0x55c5cf32e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:56.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.560+0000 7f77f8c1e740 1 -- 172.21.15.84:0/284001324 shutdown_connections 2024-09-21T03:44:56.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.560+0000 7f77f8c1e740 1 -- 172.21.15.84:0/284001324 wait complete. 2024-09-21T03:44:56.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.560+0000 7f77f8c1e740 1 -- start start 2024-09-21T03:44:56.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.560+0000 7f77f8c1e740 1 Processor -- start 2024-09-21T03:44:56.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.561+0000 7f77f8c1e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef601b0 0x55c5cf33bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:56.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.561+0000 7f77f8c1e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c5cef68390 0x55c5cf33c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:56.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.561+0000 7f77f8c1e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef89070 0x55c5cf347ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:56.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.561+0000 7f77f8c1e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c5cf0f7700 con 0x55c5cef601b0 2024-09-21T03:44:56.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.561+0000 7f77f8c1e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c5cf231160 con 0x55c5cef89070 2024-09-21T03:44:56.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.561+0000 7f77f8c1e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c5cf33ec40 con 0x55c5cef68390 2024-09-21T03:44:56.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.561+0000 7f77f8c1e740 10 client.0 _ll_register_callbacks cb 0x55c5cf24a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:56.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.561+0000 7f77ebfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef601b0 0x55c5cf33bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:56.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.561+0000 7f77ebfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef601b0 0x55c5cf33bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33274/0 (socket says 172.21.15.84:33274) 2024-09-21T03:44:56.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.561+0000 7f77ebfff640 1 -- 172.21.15.84:0/2414605113 learned_addr learned my addr 172.21.15.84:0/2414605113 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:56.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.561+0000 7f77eb7fe640 1 --2- 172.21.15.84:0/2414605113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c5cef68390 0x55c5cf33c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:56.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.561+0000 7f77f0c47640 1 --2- 172.21.15.84:0/2414605113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef89070 0x55c5cf347ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:56.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.561+0000 7f77ebfff640 1 -- 172.21.15.84:0/2414605113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c5cef68390 msgr2=0x55c5cf33c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:56.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.561+0000 7f77ebfff640 1 --2- 172.21.15.84:0/2414605113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c5cef68390 0x55c5cf33c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.561+0000 7f77ebfff640 1 -- 172.21.15.84:0/2414605113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef89070 msgr2=0x55c5cf347ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:56.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.561+0000 7f77ebfff640 1 --2- 172.21.15.84:0/2414605113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef89070 0x55c5cf347ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.561+0000 7f77ebfff640 1 -- 172.21.15.84:0/2414605113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5cf25ec90 con 0x55c5cef601b0 2024-09-21T03:44:56.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.561+0000 7f77f0c47640 1 --2- 172.21.15.84:0/2414605113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef89070 0x55c5cf347ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:56.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.562+0000 7f77ebfff640 1 --2- 172.21.15.84:0/2414605113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef601b0 0x55c5cf33bdb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0ca280 tx=0x7f77dc108150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46259e858726ade server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:56.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.562+0000 7f77cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:56.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.562+0000 7f77cb7fe640 1 -- 172.21.15.84:0/2414605113 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77dc049050 con 0x55c5cef601b0 2024-09-21T03:44:56.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.562+0000 7f77cb7fe640 1 -- 172.21.15.84:0/2414605113 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f77dc0d7240 con 0x55c5cef601b0 2024-09-21T03:44:56.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.562+0000 7f77f8c1e740 1 -- 172.21.15.84:0/2414605113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77dc115070 con 0x55c5cef601b0 2024-09-21T03:44:56.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.562+0000 7f77cb7fe640 1 -- 172.21.15.84:0/2414605113 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f77dc0044e0 con 0x55c5cef601b0 2024-09-21T03:44:56.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.562+0000 7f77f8c1e740 10 client.15975 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:56.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.562+0000 7f77f8c1e740 1 -- 172.21.15.84:0/2414605113 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c5cf34a910 con 0x55c5cef601b0 2024-09-21T03:44:56.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.562+0000 7f77cb7fe640 1 -- 172.21.15.84:0/2414605113 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77dc115070 con 0x55c5cef601b0 2024-09-21T03:44:56.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.562+0000 7f77cb7fe640 1 -- 172.21.15.84:0/2414605113 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f77dc10a070 con 0x55c5cef601b0 2024-09-21T03:44:56.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.562+0000 7f77f8c1e740 10 client.15975 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:56.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.562+0000 7f77f8c1e740 10 client.15975 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:44:56.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.562+0000 7f77f8c1e740 20 client.15975 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:56.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.562+0000 7f77f8c1e740 1 --2- 172.21.15.84:0/2414605113 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55c5cef479f0 0x55c5cf34ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:56.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.562+0000 7f77f8c1e740 4 client.15975 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:44:56.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.562+0000 7f77f8c1e740 1 -- 172.21.15.84:0/2414605113 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5cf2a8df0 con 0x55c5cef479f0 2024-09-21T03:44:56.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.563+0000 7f77eb7fe640 1 --2- 172.21.15.84:0/2414605113 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55c5cef479f0 0x55c5cf34ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:56.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.563+0000 7f77cb7fe640 10 client.15975 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:44:56.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.563+0000 7f77eb7fe640 1 --2- 172.21.15.84:0/2414605113 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55c5cef479f0 0x55c5cf34ddf0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5a512e16260e393f server_cookie=2dd2e854abdb183a in_seq=0 out_seq=0 2024-09-21T03:44:56.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.564+0000 7f77cb7fe640 1 -- 172.21.15.84:0/2414605113 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c5cf2a8df0 con 0x55c5cef479f0 2024-09-21T03:44:56.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.564+0000 7f77cb7fe640 10 client.15975 handle_command_reply: tid=0 2024-09-21T03:44:56.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.564+0000 7f77f8c1e740 1 client.15975 shutdown 2024-09-21T03:44:56.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.564+0000 7f77f8c1e740 1 -- 172.21.15.84:0/2414605113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef601b0 msgr2=0x55c5cf33bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:56.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.564+0000 7f77f8c1e740 1 --2- 172.21.15.84:0/2414605113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef601b0 0x55c5cf33bdb0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f77dc0ca280 tx=0x7f77dc108150 comp rx=0 tx=0).stop 2024-09-21T03:44:56.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.564+0000 7f77f8c1e740 1 -- 172.21.15.84:0/2414605113 shutdown_connections 2024-09-21T03:44:56.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.564+0000 7f77f8c1e740 1 --2- 172.21.15.84:0/2414605113 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55c5cef479f0 0x55c5cf34ddf0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.564+0000 7f77f8c1e740 1 --2- 172.21.15.84:0/2414605113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef89070 0x55c5cf347ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.564+0000 7f77f8c1e740 1 --2- 172.21.15.84:0/2414605113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c5cef68390 0x55c5cf33c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.564+0000 7f77f8c1e740 1 --2- 172.21.15.84:0/2414605113 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef601b0 0x55c5cf33bdb0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.564+0000 7f77f8c1e740 1 -- 172.21.15.84:0/2414605113 >> 172.21.15.84:0/2414605113 conn(0x55c5cef7d460 msgr2=0x55c5cf333830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:56.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.564+0000 7f77cb7fe640 0 client.15975 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:44:56.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.564+0000 7f77f8c1e740 1 -- 172.21.15.84:0/2414605113 shutdown_connections 2024-09-21T03:44:56.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.565+0000 7f77f8c1e740 1 -- 172.21.15.84:0/2414605113 wait complete. 2024-09-21T03:44:56.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.565+0000 7f77f8c1e740 20 client.15975 trim_cache size 0 max 16384 2024-09-21T03:44:56.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.578+0000 7f77f8c1e740 1 Processor -- start 2024-09-21T03:44:56.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.578+0000 7f77f8c1e740 1 -- start start 2024-09-21T03:44:56.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.578+0000 7f77f8c1e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c5cef68390 0x55c5cf33aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:56.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.578+0000 7f77f8c1e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef89070 0x55c5cf347ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:56.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.578+0000 7f77f8c1e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef1cda0 0x55c5cf33d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.578+0000 7f77f8c1e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec1b1e70 con 0x55c5cef89070 2024-09-21T03:44:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.578+0000 7f77f8c1e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec1af740 con 0x55c5cef1cda0 2024-09-21T03:44:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.578+0000 7f77f8c1e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec1ad590 con 0x55c5cef68390 2024-09-21T03:44:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.578+0000 7f77eb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef89070 0x55c5cf347ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.578+0000 7f77eb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef89070 0x55c5cf347ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33282/0 (socket says 172.21.15.84:33282) 2024-09-21T03:44:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.578+0000 7f77eb7fe640 1 -- 172.21.15.84:0/3969640023 learned_addr learned my addr 172.21.15.84:0/3969640023 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.578+0000 7f77f0c47640 1 --2- 172.21.15.84:0/3969640023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef1cda0 0x55c5cf33d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.578+0000 7f77ebfff640 1 --2- 172.21.15.84:0/3969640023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c5cef68390 0x55c5cf33aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:56.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.578+0000 7f77eb7fe640 1 -- 172.21.15.84:0/3969640023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c5cef68390 msgr2=0x55c5cf33aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:56.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.578+0000 7f77eb7fe640 1 --2- 172.21.15.84:0/3969640023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c5cef68390 0x55c5cf33aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.578+0000 7f77eb7fe640 1 -- 172.21.15.84:0/3969640023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef1cda0 msgr2=0x55c5cf33d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:56.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.578+0000 7f77eb7fe640 1 --2- 172.21.15.84:0/3969640023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef1cda0 0x55c5cf33d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.578+0000 7f77eb7fe640 1 -- 172.21.15.84:0/3969640023 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5cf33e390 con 0x55c5cef89070 2024-09-21T03:44:56.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.578+0000 7f77f0c47640 1 --2- 172.21.15.84:0/3969640023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef1cda0 0x55c5cf33d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:56.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.578+0000 7f77eb7fe640 1 --2- 172.21.15.84:0/3969640023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef89070 0x55c5cf347ea0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f77d4006e10 tx=0x7f77d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7067860d77b8a08 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:56.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.579+0000 7f77e1ffb640 1 -- 172.21.15.84:0/3969640023 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d4020070 con 0x55c5cef89070 2024-09-21T03:44:56.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.579+0000 7f77e1ffb640 1 -- 172.21.15.84:0/3969640023 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77d4015d90 con 0x55c5cef89070 2024-09-21T03:44:56.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.579+0000 7f77e1ffb640 1 -- 172.21.15.84:0/3969640023 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d4023360 con 0x55c5cef89070 2024-09-21T03:44:56.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.579+0000 7f77f8c1e740 1 -- 172.21.15.84:0/3969640023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef89070 msgr2=0x55c5cf347ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:56.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.579+0000 7f77f8c1e740 1 --2- 172.21.15.84:0/3969640023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef89070 0x55c5cf347ea0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f77d4006e10 tx=0x7f77d4008040 comp rx=0 tx=0).stop 2024-09-21T03:44:56.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.579+0000 7f77f8c1e740 1 -- 172.21.15.84:0/3969640023 shutdown_connections 2024-09-21T03:44:56.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.579+0000 7f77f8c1e740 1 --2- 172.21.15.84:0/3969640023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef1cda0 0x55c5cf33d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.579+0000 7f77f8c1e740 1 --2- 172.21.15.84:0/3969640023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef89070 0x55c5cf347ea0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.579+0000 7f77f8c1e740 1 --2- 172.21.15.84:0/3969640023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c5cef68390 0x55c5cf33aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.580+0000 7f77f8c1e740 1 -- 172.21.15.84:0/3969640023 >> 172.21.15.84:0/3969640023 conn(0x55c5cef7d460 msgr2=0x55c5cf33d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:56.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.580+0000 7f77f8c1e740 1 -- 172.21.15.84:0/3969640023 shutdown_connections 2024-09-21T03:44:56.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.580+0000 7f77f8c1e740 1 -- 172.21.15.84:0/3969640023 wait complete. 2024-09-21T03:44:56.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.580+0000 7f77f8c1e740 1 -- start start 2024-09-21T03:44:56.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.580+0000 7f77f8c1e740 1 Processor -- start 2024-09-21T03:44:56.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77f8c1e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef1cda0 0x55c5cf3516f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:56.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77f8c1e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c5cef68390 0x55c5cf34ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:56.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77f8c1e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef89070 0x55c5cf34f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:56.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77f8c1e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec1adc00 con 0x55c5cef89070 2024-09-21T03:44:56.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77f8c1e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec1af070 con 0x55c5cef1cda0 2024-09-21T03:44:56.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77f8c1e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec1ae2d0 con 0x55c5cef68390 2024-09-21T03:44:56.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77f8c1e740 10 client.0 _ll_register_callbacks cb 0x7f77e400a5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:56.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77f0c47640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef89070 0x55c5cf34f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:56.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77f0c47640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef89070 0x55c5cf34f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33290/0 (socket says 172.21.15.84:33290) 2024-09-21T03:44:56.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77f0c47640 1 -- 172.21.15.84:0/1143259163 learned_addr learned my addr 172.21.15.84:0/1143259163 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:56.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77ebfff640 1 --2- 172.21.15.84:0/1143259163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef1cda0 0x55c5cf3516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:56.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77eb7fe640 1 --2- 172.21.15.84:0/1143259163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c5cef68390 0x55c5cf34ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:56.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77f0c47640 1 -- 172.21.15.84:0/1143259163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c5cef68390 msgr2=0x55c5cf34ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:56.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77f0c47640 1 --2- 172.21.15.84:0/1143259163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c5cef68390 0x55c5cf34ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77f0c47640 1 -- 172.21.15.84:0/1143259163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef1cda0 msgr2=0x55c5cf3516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:56.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77f0c47640 1 --2- 172.21.15.84:0/1143259163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef1cda0 0x55c5cf3516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77f0c47640 1 -- 172.21.15.84:0/1143259163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5cf34f9f0 con 0x55c5cef89070 2024-09-21T03:44:56.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77f0c47640 1 --2- 172.21.15.84:0/1143259163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef89070 0x55c5cf34f260 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f77e400ff30 tx=0x7f77e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5c99751f4c3eb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:56.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:56.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77cb7fe640 1 -- 172.21.15.84:0/1143259163 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e402b060 con 0x55c5cef89070 2024-09-21T03:44:56.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77cb7fe640 1 -- 172.21.15.84:0/1143259163 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f77e401a660 con 0x55c5cef89070 2024-09-21T03:44:56.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.581+0000 7f77f8c1e740 1 -- 172.21.15.84:0/1143259163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77d4015d90 con 0x55c5cef89070 2024-09-21T03:44:56.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.582+0000 7f77cb7fe640 1 -- 172.21.15.84:0/1143259163 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f77e401a860 con 0x55c5cef89070 2024-09-21T03:44:56.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.582+0000 7f77f8c1e740 10 client.15981 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:56.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.582+0000 7f77f8c1e740 1 -- 172.21.15.84:0/1143259163 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c5cf3b8720 con 0x55c5cef89070 2024-09-21T03:44:56.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.582+0000 7f77cb7fe640 1 -- 172.21.15.84:0/1143259163 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77d4015d90 con 0x55c5cef89070 2024-09-21T03:44:56.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.582+0000 7f77cb7fe640 1 -- 172.21.15.84:0/1143259163 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f77e4025070 con 0x55c5cef89070 2024-09-21T03:44:56.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.582+0000 7f77f8c1e740 10 client.15981 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:56.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.582+0000 7f77f8c1e740 10 client.15981 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:44:56.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.582+0000 7f77f8c1e740 20 client.15981 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:56.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.582+0000 7f77f8c1e740 1 --2- 172.21.15.84:0/1143259163 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55c5cf3b8ed0 0x55c5cf3bb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:56.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.582+0000 7f77f8c1e740 4 client.15981 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:44:56.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.582+0000 7f77f8c1e740 1 -- 172.21.15.84:0/1143259163 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c5cf2a48a0 con 0x55c5cf3b8ed0 2024-09-21T03:44:56.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.582+0000 7f77ebfff640 1 --2- 172.21.15.84:0/1143259163 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55c5cf3b8ed0 0x55c5cf3bb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:56.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.583+0000 7f77cb7fe640 10 client.15981 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:44:56.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.583+0000 7f77ebfff640 1 --2- 172.21.15.84:0/1143259163 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55c5cf3b8ed0 0x55c5cf3bb2f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3cef899eb0aae6c4 server_cookie=139ed2227170bb40 in_seq=0 out_seq=0 2024-09-21T03:44:56.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.583+0000 7f77cb7fe640 1 -- 172.21.15.84:0/1143259163 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c5cf2a48a0 con 0x55c5cf3b8ed0 2024-09-21T03:44:56.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.583+0000 7f77cb7fe640 10 client.15981 handle_command_reply: tid=0 2024-09-21T03:44:56.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.583+0000 7f77f8c1e740 1 client.15981 shutdown 2024-09-21T03:44:56.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.583+0000 7f77f8c1e740 1 -- 172.21.15.84:0/1143259163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef89070 msgr2=0x55c5cf34f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:56.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.583+0000 7f77f8c1e740 1 --2- 172.21.15.84:0/1143259163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef89070 0x55c5cf34f260 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f77e400ff30 tx=0x7f77e4004a40 comp rx=0 tx=0).stop 2024-09-21T03:44:56.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.583+0000 7f77f8c1e740 1 -- 172.21.15.84:0/1143259163 shutdown_connections 2024-09-21T03:44:56.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.583+0000 7f77f8c1e740 1 --2- 172.21.15.84:0/1143259163 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55c5cf3b8ed0 0x55c5cf3bb2f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.583+0000 7f77f8c1e740 1 --2- 172.21.15.84:0/1143259163 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c5cef89070 0x55c5cf34f260 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.583+0000 7f77f8c1e740 1 --2- 172.21.15.84:0/1143259163 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c5cef68390 0x55c5cf34ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.583+0000 7f77f8c1e740 1 --2- 172.21.15.84:0/1143259163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c5cef1cda0 0x55c5cf3516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.583+0000 7f77f8c1e740 1 -- 172.21.15.84:0/1143259163 >> 172.21.15.84:0/1143259163 conn(0x55c5cef7d460 msgr2=0x55c5cf331560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:56.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.583+0000 7f77cb7fe640 0 client.15981 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:44:56.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.583+0000 7f77f8c1e740 1 -- 172.21.15.84:0/1143259163 shutdown_connections 2024-09-21T03:44:56.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.583+0000 7f77f8c1e740 1 -- 172.21.15.84:0/1143259163 wait complete. 2024-09-21T03:44:56.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.583+0000 7f77f8c1e740 20 client.15981 trim_cache size 0 max 16384 2024-09-21T03:44:56.603 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:44:56.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.584+0000 7f77f26aa640 1 -- 172.21.15.84:0/3272977770 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f77d80b6680 msgr2=0x7f77d80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:56.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.584+0000 7f77f26aa640 1 --2- 172.21.15.84:0/3272977770 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f77d80b6680 0x7f77d80b8b90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f77e400af80 tx=0x7f77e400a730 comp rx=0 tx=0).stop 2024-09-21T03:44:56.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.584+0000 7f77f26aa640 1 -- 172.21.15.84:0/3272977770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77ec102140 msgr2=0x7f77ec19a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:56.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.584+0000 7f77f26aa640 1 --2- 172.21.15.84:0/3272977770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77ec102140 0x7f77ec19a5e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f77dc005940 tx=0x7f77dc0042f0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.584+0000 7f77f26aa640 1 -- 172.21.15.84:0/3272977770 shutdown_connections 2024-09-21T03:44:56.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.584+0000 7f77f26aa640 1 --2- 172.21.15.84:0/3272977770 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f77d80b6680 0x7f77d80b8b90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.584+0000 7f77f26aa640 1 --2- 172.21.15.84:0/3272977770 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77ec106c80 0x7f77ec19fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.584+0000 7f77f26aa640 1 --2- 172.21.15.84:0/3272977770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77ec106330 0x7f77ec19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.584+0000 7f77f26aa640 1 --2- 172.21.15.84:0/3272977770 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f77ec102140 0x7f77ec19a5e0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:56.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.584+0000 7f77f26aa640 1 -- 172.21.15.84:0/3272977770 >> 172.21.15.84:0/3272977770 conn(0x7f77ec079ec0 msgr2=0x7f77ec107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:56.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.584+0000 7f77f26aa640 1 -- 172.21.15.84:0/3272977770 shutdown_connections 2024-09-21T03:44:56.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:56.584+0000 7f77f26aa640 1 -- 172.21.15.84:0/3272977770 wait complete. 2024-09-21T03:44:56.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:56 smithi174 ceph-mon[34403]: pgmap v398: 97 pgs: 97 active+clean; 2.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-21T03:44:56.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:56 smithi172 ceph-mon[34821]: pgmap v398: 97 pgs: 97 active+clean; 2.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-21T03:44:57.317 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:44:57.567 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:58.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.101+0000 7f1019af6640 1 -- 172.21.15.84:0/2501345071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f101410de60 msgr2=0x7f1014110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:58.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.101+0000 7f1019af6640 1 --2- 172.21.15.84:0/2501345071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f101410de60 0x7f1014110330 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f100c009ca0 tx=0x7f100c02a8e0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.101+0000 7f1019af6640 1 -- 172.21.15.84:0/2501345071 shutdown_connections 2024-09-21T03:44:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.101+0000 7f1019af6640 1 --2- 172.21.15.84:0/2501345071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f101410de60 0x7f1014110330 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.101+0000 7f1019af6640 1 --2- 172.21.15.84:0/2501345071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1014105380 0x7f101410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.101+0000 7f1019af6640 1 --2- 172.21.15.84:0/2501345071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1014104a30 0x7f1014104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.101+0000 7f1019af6640 1 -- 172.21.15.84:0/2501345071 >> 172.21.15.84:0/2501345071 conn(0x7f10140797b0 msgr2=0x7f1014079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.101+0000 7f1019af6640 1 -- 172.21.15.84:0/2501345071 shutdown_connections 2024-09-21T03:44:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.101+0000 7f1019af6640 1 -- 172.21.15.84:0/2501345071 wait complete. 2024-09-21T03:44:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.102+0000 7f1019af6640 1 Processor -- start 2024-09-21T03:44:58.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.102+0000 7f1019af6640 1 -- start start 2024-09-21T03:44:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.102+0000 7f1019af6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1014104a30 0x7f101419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.102+0000 7f1019af6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1014105380 0x7f101419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.102+0000 7f1019af6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f101410de60 0x7f101419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.102+0000 7f1019af6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1014113b00 con 0x7f101410de60 2024-09-21T03:44:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.102+0000 7f1019af6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1014113980 con 0x7f1014104a30 2024-09-21T03:44:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.102+0000 7f1019af6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1014113c80 con 0x7f1014105380 2024-09-21T03:44:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.102+0000 7f1013fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f101410de60 0x7f101419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.102+0000 7f1013fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f101410de60 0x7f101419fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33304/0 (socket says 172.21.15.84:33304) 2024-09-21T03:44:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.102+0000 7f1013fff640 1 -- 172.21.15.84:0/10041665 learned_addr learned my addr 172.21.15.84:0/10041665 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.102+0000 7f10137fe640 1 --2- 172.21.15.84:0/10041665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1014104a30 0x7f101419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.102+0000 7f100bfff640 1 --2- 172.21.15.84:0/10041665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1014105380 0x7f101419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.102+0000 7f1013fff640 1 -- 172.21.15.84:0/10041665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1014105380 msgr2=0x7f101419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:58.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.102+0000 7f1013fff640 1 --2- 172.21.15.84:0/10041665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1014105380 0x7f101419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.102+0000 7f1013fff640 1 -- 172.21.15.84:0/10041665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1014104a30 msgr2=0x7f101419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:58.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.103+0000 7f1013fff640 1 --2- 172.21.15.84:0/10041665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1014104a30 0x7f101419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.103+0000 7f1013fff640 1 -- 172.21.15.84:0/10041665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10141a0400 con 0x7f101410de60 2024-09-21T03:44:58.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.103+0000 7f100bfff640 1 --2- 172.21.15.84:0/10041665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1014105380 0x7f101419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:58.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.103+0000 7f1013fff640 1 --2- 172.21.15.84:0/10041665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f101410de60 0x7f101419fcd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f100c005cc0 tx=0x7f100c0039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:58.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.103+0000 7f10117fa640 1 -- 172.21.15.84:0/10041665 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c003de0 con 0x7f101410de60 2024-09-21T03:44:58.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.103+0000 7f10117fa640 1 -- 172.21.15.84:0/10041665 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f100c0044f0 con 0x7f101410de60 2024-09-21T03:44:58.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.103+0000 7f1019af6640 1 -- 172.21.15.84:0/10041665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10141a0690 con 0x7f101410de60 2024-09-21T03:44:58.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.103+0000 7f10117fa640 1 -- 172.21.15.84:0/10041665 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100c030d90 con 0x7f101410de60 2024-09-21T03:44:58.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.103+0000 7f1019af6640 1 -- 172.21.15.84:0/10041665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10141a6e50 con 0x7f101410de60 2024-09-21T03:44:58.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.106+0000 7f10117fa640 1 -- 172.21.15.84:0/10041665 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f100c004040 con 0x7f101410de60 2024-09-21T03:44:58.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.106+0000 7f102006a740 1 Processor -- start 2024-09-21T03:44:58.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.106+0000 7f102006a740 1 -- start start 2024-09-21T03:44:58.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.106+0000 7f102006a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e5153a070 0x561e518e16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:58.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.106+0000 7f102006a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e515111b0 0x561e518e1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:58.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.106+0000 7f102006a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e51519390 0x561e518e2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:58.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.106+0000 7f102006a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561e51857ea0 con 0x561e5153a070 2024-09-21T03:44:58.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.106+0000 7f102006a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561e518472d0 con 0x561e51519390 2024-09-21T03:44:58.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.106+0000 7f102006a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561e5184b0e0 con 0x561e515111b0 2024-09-21T03:44:58.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.106+0000 7f100bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e5153a070 0x561e518e16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:58.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.106+0000 7f100bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e5153a070 0x561e518e16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33314/0 (socket says 172.21.15.84:33314) 2024-09-21T03:44:58.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.106+0000 7f100bfff640 1 -- 172.21.15.84:0/87976641 learned_addr learned my addr 172.21.15.84:0/87976641 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:58.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.106+0000 7f10137fe640 1 --2- 172.21.15.84:0/87976641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e515111b0 0x561e518e1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:58.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.106+0000 7f10117fa640 1 --2- 172.21.15.84:0/10041665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f10000b6680 0x7f10000b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:58.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.106+0000 7f100bfff640 1 --2- 172.21.15.84:0/87976641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e51519390 0x561e518e2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:58.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.106+0000 7f100bfff640 1 -- 172.21.15.84:0/87976641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e515111b0 msgr2=0x561e518e1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:58.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.106+0000 7f100bfff640 1 --2- 172.21.15.84:0/87976641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e515111b0 0x561e518e1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.107+0000 7f100bfff640 1 -- 172.21.15.84:0/87976641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e51519390 msgr2=0x561e518e2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:58.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.107+0000 7f100bfff640 1 --2- 172.21.15.84:0/87976641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e51519390 0x561e518e2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.107+0000 7f100bfff640 1 -- 172.21.15.84:0/87976641 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e515a5650 con 0x561e5153a070 2024-09-21T03:44:58.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.107+0000 7f1013fff640 1 --2- 172.21.15.84:0/10041665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f10000b6680 0x7f10000b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:58.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.107+0000 7f10117fa640 1 -- 172.21.15.84:0/10041665 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f100c108b30 con 0x7f101410de60 2024-09-21T03:44:58.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.107+0000 7f100bfff640 1 --2- 172.21.15.84:0/87976641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e5153a070 0x561e518e16a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc007ed0 tx=0x7f0ffc0073c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd875b168cc0efd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:58.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.107+0000 7f1009ffb640 1 -- 172.21.15.84:0/87976641 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc01c070 con 0x561e5153a070 2024-09-21T03:44:58.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.107+0000 7f1013fff640 1 --2- 172.21.15.84:0/10041665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f10000b6680 0x7f10000b8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f100c1063b0 tx=0x7f100c0c3260 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:58.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.107+0000 7f1009ffb640 1 -- 172.21.15.84:0/87976641 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ffc010040 con 0x561e5153a070 2024-09-21T03:44:58.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.107+0000 7f1009ffb640 1 -- 172.21.15.84:0/87976641 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc014610 con 0x561e5153a070 2024-09-21T03:44:58.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.108+0000 7f102006a740 1 -- 172.21.15.84:0/87976641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e5153a070 msgr2=0x561e518e16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:58.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.108+0000 7f102006a740 1 --2- 172.21.15.84:0/87976641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e5153a070 0x561e518e16a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc007ed0 tx=0x7f0ffc0073c0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.108+0000 7f102006a740 1 -- 172.21.15.84:0/87976641 shutdown_connections 2024-09-21T03:44:58.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.108+0000 7f102006a740 1 --2- 172.21.15.84:0/87976641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e51519390 0x561e518e2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.108+0000 7f102006a740 1 --2- 172.21.15.84:0/87976641 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e515111b0 0x561e518e1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.108+0000 7f102006a740 1 --2- 172.21.15.84:0/87976641 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e5153a070 0x561e518e16a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.108+0000 7f102006a740 1 -- 172.21.15.84:0/87976641 >> 172.21.15.84:0/87976641 conn(0x561e5152e460 msgr2=0x561e518df590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:58.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.108+0000 7f102006a740 1 -- 172.21.15.84:0/87976641 shutdown_connections 2024-09-21T03:44:58.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.108+0000 7f102006a740 1 -- 172.21.15.84:0/87976641 wait complete. 2024-09-21T03:44:58.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.108+0000 7f102006a740 1 -- start start 2024-09-21T03:44:58.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.109+0000 7f102006a740 1 Processor -- start 2024-09-21T03:44:58.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.109+0000 7f102006a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e515111b0 0x561e518ecd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:58.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.109+0000 7f102006a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e51519390 0x561e518ed280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.109+0000 7f102006a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e5153a070 0x561e518ed800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.109+0000 7f102006a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561e516a8700 con 0x561e51519390 2024-09-21T03:44:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.109+0000 7f102006a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561e517e2160 con 0x561e515111b0 2024-09-21T03:44:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.109+0000 7f102006a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561e518efed0 con 0x561e5153a070 2024-09-21T03:44:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.109+0000 7f102006a740 10 client.0 _ll_register_callbacks cb 0x561e517fb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.109+0000 7f10137fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e51519390 0x561e518ed280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.109+0000 7f100bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e515111b0 0x561e518ecd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.109+0000 7f10137fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e51519390 0x561e518ed280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33324/0 (socket says 172.21.15.84:33324) 2024-09-21T03:44:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.109+0000 7f10137fe640 1 -- 172.21.15.84:0/1266945051 learned_addr learned my addr 172.21.15.84:0/1266945051 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.109+0000 7f100bfff640 1 --2- 172.21.15.84:0/1266945051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e5153a070 0x561e518ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.109+0000 7f10137fe640 1 -- 172.21.15.84:0/1266945051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e5153a070 msgr2=0x561e518ed800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.109+0000 7f10137fe640 1 --2- 172.21.15.84:0/1266945051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e5153a070 0x561e518ed800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.109+0000 7f10137fe640 1 -- 172.21.15.84:0/1266945051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e515111b0 msgr2=0x561e518ecd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.109+0000 7f10137fe640 1 --2- 172.21.15.84:0/1266945051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e515111b0 0x561e518ecd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.109+0000 7f10137fe640 1 -- 172.21.15.84:0/1266945051 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e5180fc90 con 0x561e51519390 2024-09-21T03:44:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.110+0000 7f10137fe640 1 --2- 172.21.15.84:0/1266945051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e51519390 0x561e518ed280 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f100400bad0 tx=0x7f100400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2cf8ae2041323a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.110+0000 7f0ff2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.110+0000 7f0ff2ffd640 1 -- 172.21.15.84:0/1266945051 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004005020 con 0x561e51519390 2024-09-21T03:44:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.110+0000 7f0ff2ffd640 1 -- 172.21.15.84:0/1266945051 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f10040051c0 con 0x561e51519390 2024-09-21T03:44:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.110+0000 7f102006a740 1 -- 172.21.15.84:0/1266945051 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ffc010040 con 0x561e51519390 2024-09-21T03:44:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.110+0000 7f0ff2ffd640 1 -- 172.21.15.84:0/1266945051 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f10040053c0 con 0x561e51519390 2024-09-21T03:44:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.110+0000 7f102006a740 10 client.15993 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.110+0000 7f102006a740 1 -- 172.21.15.84:0/1266945051 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561e51900010 con 0x561e51519390 2024-09-21T03:44:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.110+0000 7f0ff2ffd640 1 -- 172.21.15.84:0/1266945051 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ffc010040 con 0x561e51519390 2024-09-21T03:44:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.110+0000 7f0ff2ffd640 1 -- 172.21.15.84:0/1266945051 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f100401b6a0 con 0x561e51519390 2024-09-21T03:44:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.110+0000 7f102006a740 10 client.15993 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:58.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.110+0000 7f102006a740 10 client.15993 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:44:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.110+0000 7f102006a740 20 client.15993 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.110+0000 7f102006a740 1 --2- 172.21.15.84:0/1266945051 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x561e514f89f0 0x561e519035a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.110+0000 7f102006a740 4 client.15993 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:44:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.110+0000 7f102006a740 1 -- 172.21.15.84:0/1266945051 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e51859df0 con 0x561e514f89f0 2024-09-21T03:44:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.111+0000 7f100bfff640 1 --2- 172.21.15.84:0/1266945051 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x561e514f89f0 0x561e519035a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.111+0000 7f100bfff640 1 --2- 172.21.15.84:0/1266945051 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x561e514f89f0 0x561e519035a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6f6d31be16065576 server_cookie=38d1460a83565c1d in_seq=0 out_seq=0 2024-09-21T03:44:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.111+0000 7f0ff2ffd640 10 client.15993 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:44:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.112+0000 7f0ff2ffd640 1 -- 172.21.15.84:0/1266945051 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561e51859df0 con 0x561e514f89f0 2024-09-21T03:44:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.112+0000 7f0ff2ffd640 10 client.15993 handle_command_reply: tid=0 2024-09-21T03:44:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.112+0000 7f102006a740 1 client.15993 shutdown 2024-09-21T03:44:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.112+0000 7f102006a740 1 -- 172.21.15.84:0/1266945051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e51519390 msgr2=0x561e518ed280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.112+0000 7f102006a740 1 --2- 172.21.15.84:0/1266945051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e51519390 0x561e518ed280 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f100400bad0 tx=0x7f100400bed0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.112+0000 7f102006a740 1 -- 172.21.15.84:0/1266945051 shutdown_connections 2024-09-21T03:44:58.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.112+0000 7f102006a740 1 --2- 172.21.15.84:0/1266945051 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x561e514f89f0 0x561e519035a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.112+0000 7f102006a740 1 --2- 172.21.15.84:0/1266945051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e5153a070 0x561e518ed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.112+0000 7f102006a740 1 --2- 172.21.15.84:0/1266945051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e51519390 0x561e518ed280 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.112+0000 7f102006a740 1 --2- 172.21.15.84:0/1266945051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e515111b0 0x561e518ecd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.112+0000 7f102006a740 1 -- 172.21.15.84:0/1266945051 >> 172.21.15.84:0/1266945051 conn(0x561e5152e460 msgr2=0x561e518e26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:58.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.112+0000 7f0ff2ffd640 0 client.15993 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:44:58.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.112+0000 7f102006a740 1 -- 172.21.15.84:0/1266945051 shutdown_connections 2024-09-21T03:44:58.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.112+0000 7f102006a740 1 -- 172.21.15.84:0/1266945051 wait complete. 2024-09-21T03:44:58.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.112+0000 7f102006a740 20 client.15993 trim_cache size 0 max 16384 2024-09-21T03:44:58.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.126+0000 7f102006a740 1 Processor -- start 2024-09-21T03:44:58.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.126+0000 7f102006a740 1 -- start start 2024-09-21T03:44:58.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.126+0000 7f102006a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e515111b0 0x561e518ec250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:58.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.126+0000 7f102006a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e51519390 0x561e518ee970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:58.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.126+0000 7f102006a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e5153a070 0x561e518e9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:58.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.126+0000 7f102006a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f10141afc00 con 0x561e5153a070 2024-09-21T03:44:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.126+0000 7f102006a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f10141ad4d0 con 0x561e515111b0 2024-09-21T03:44:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.126+0000 7f102006a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f10141ab340 con 0x561e51519390 2024-09-21T03:44:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.126+0000 7f100bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e5153a070 0x561e518e9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.126+0000 7f100bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e5153a070 0x561e518e9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33328/0 (socket says 172.21.15.84:33328) 2024-09-21T03:44:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.126+0000 7f100bfff640 1 -- 172.21.15.84:0/4250696291 learned_addr learned my addr 172.21.15.84:0/4250696291 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.127+0000 7f100bfff640 1 --2- 172.21.15.84:0/4250696291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e515111b0 0x561e518ec250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.127+0000 7f10137fe640 1 --2- 172.21.15.84:0/4250696291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e51519390 0x561e518ee970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.127+0000 7f100bfff640 1 -- 172.21.15.84:0/4250696291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e51519390 msgr2=0x561e518ee970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.127+0000 7f100bfff640 1 --2- 172.21.15.84:0/4250696291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e51519390 0x561e518ee970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.127+0000 7f100bfff640 1 -- 172.21.15.84:0/4250696291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e515111b0 msgr2=0x561e518ec250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.127+0000 7f100bfff640 1 --2- 172.21.15.84:0/4250696291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e515111b0 0x561e518ec250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.127+0000 7f100bfff640 1 -- 172.21.15.84:0/4250696291 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e518ee000 con 0x561e5153a070 2024-09-21T03:44:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.127+0000 7f100bfff640 1 --2- 172.21.15.84:0/4250696291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e5153a070 0x561e518e9f30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc007ed0 tx=0x7f0ffc017e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a95a5d7c31fd55c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:58.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.127+0000 7f10097fa640 1 -- 172.21.15.84:0/4250696291 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc01c040 con 0x561e5153a070 2024-09-21T03:44:58.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.127+0000 7f10097fa640 1 -- 172.21.15.84:0/4250696291 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ffc026400 con 0x561e5153a070 2024-09-21T03:44:58.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.127+0000 7f10097fa640 1 -- 172.21.15.84:0/4250696291 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc025650 con 0x561e5153a070 2024-09-21T03:44:58.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.128+0000 7f102006a740 1 -- 172.21.15.84:0/4250696291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e5153a070 msgr2=0x561e518e9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:58.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.128+0000 7f102006a740 1 --2- 172.21.15.84:0/4250696291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e5153a070 0x561e518e9f30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc007ed0 tx=0x7f0ffc017e10 comp rx=0 tx=0).stop 2024-09-21T03:44:58.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.128+0000 7f102006a740 1 -- 172.21.15.84:0/4250696291 shutdown_connections 2024-09-21T03:44:58.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.128+0000 7f102006a740 1 --2- 172.21.15.84:0/4250696291 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e5153a070 0x561e518e9f30 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.128+0000 7f102006a740 1 --2- 172.21.15.84:0/4250696291 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e51519390 0x561e518ee970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.128+0000 7f102006a740 1 --2- 172.21.15.84:0/4250696291 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e515111b0 0x561e518ec250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.128+0000 7f102006a740 1 -- 172.21.15.84:0/4250696291 >> 172.21.15.84:0/4250696291 conn(0x561e5152e460 msgr2=0x561e518ee260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:58.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.128+0000 7f102006a740 1 -- 172.21.15.84:0/4250696291 shutdown_connections 2024-09-21T03:44:58.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.128+0000 7f102006a740 1 -- 172.21.15.84:0/4250696291 wait complete. 2024-09-21T03:44:58.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.128+0000 7f102006a740 1 -- start start 2024-09-21T03:44:58.146 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.129+0000 7f102006a740 1 Processor -- start 2024-09-21T03:44:58.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.129+0000 7f102006a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e515111b0 0x561e518f9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:58.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.129+0000 7f102006a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e51519390 0x561e518f5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:58.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.129+0000 7f102006a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e5153a070 0x561e518f5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:58.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.129+0000 7f102006a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f10141ab990 con 0x561e51519390 2024-09-21T03:44:58.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.129+0000 7f102006a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f10141ace00 con 0x561e515111b0 2024-09-21T03:44:58.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.129+0000 7f102006a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f10141ac060 con 0x561e5153a070 2024-09-21T03:44:58.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.129+0000 7f102006a740 10 client.0 _ll_register_callbacks cb 0x7f10040040a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:58.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.129+0000 7f10137fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e51519390 0x561e518f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:58.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.129+0000 7f100bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e515111b0 0x561e518f9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:58.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.129+0000 7f10137fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e51519390 0x561e518f5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33336/0 (socket says 172.21.15.84:33336) 2024-09-21T03:44:58.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.129+0000 7f100bfff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e515111b0 0x561e518f9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:40136/0 (socket says 172.21.15.84:40136) 2024-09-21T03:44:58.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.129+0000 7f10137fe640 1 -- 172.21.15.84:0/2630775841 learned_addr learned my addr 172.21.15.84:0/2630775841 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:58.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.129+0000 7f100bfff640 1 --2- 172.21.15.84:0/2630775841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e5153a070 0x561e518f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:58.147 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.129+0000 7f10137fe640 1 -- 172.21.15.84:0/2630775841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e5153a070 msgr2=0x561e518f5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:58.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.129+0000 7f10137fe640 1 --2- 172.21.15.84:0/2630775841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e5153a070 0x561e518f5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.129+0000 7f10137fe640 1 -- 172.21.15.84:0/2630775841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e515111b0 msgr2=0x561e518f9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:58.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.129+0000 7f10137fe640 1 --2- 172.21.15.84:0/2630775841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e515111b0 0x561e518f9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.130+0000 7f10137fe640 1 -- 172.21.15.84:0/2630775841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e518f5ca0 con 0x561e51519390 2024-09-21T03:44:58.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.130+0000 7f10137fe640 1 --2- 172.21.15.84:0/2630775841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e51519390 0x561e518f5120 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f100400b620 tx=0x7f10040043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7f0f8a55b0cba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:58.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.130+0000 7f0ff2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:58.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.130+0000 7f0ff2ffd640 1 -- 172.21.15.84:0/2630775841 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100402a070 con 0x561e51519390 2024-09-21T03:44:58.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.130+0000 7f0ff2ffd640 1 -- 172.21.15.84:0/2630775841 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f100401b680 con 0x561e51519390 2024-09-21T03:44:58.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.130+0000 7f102006a740 1 -- 172.21.15.84:0/2630775841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ffc026400 con 0x561e51519390 2024-09-21T03:44:58.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.130+0000 7f0ff2ffd640 1 -- 172.21.15.84:0/2630775841 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1004011440 con 0x561e51519390 2024-09-21T03:44:58.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.130+0000 7f102006a740 10 client.15999 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:58.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.130+0000 7f102006a740 1 -- 172.21.15.84:0/2630775841 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561e5196dd50 con 0x561e51519390 2024-09-21T03:44:58.148 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.130+0000 7f0ff2ffd640 1 -- 172.21.15.84:0/2630775841 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ffc026400 con 0x561e51519390 2024-09-21T03:44:58.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.130+0000 7f0ff2ffd640 1 -- 172.21.15.84:0/2630775841 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1004036070 con 0x561e51519390 2024-09-21T03:44:58.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.130+0000 7f102006a740 10 client.15999 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:58.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.131+0000 7f102006a740 10 client.15999 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:44:58.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.131+0000 7f102006a740 20 client.15999 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:58.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.131+0000 7f102006a740 1 --2- 172.21.15.84:0/2630775841 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x561e514cdda0 0x561e519704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:58.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.131+0000 7f102006a740 4 client.15999 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:44:58.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.131+0000 7f102006a740 1 -- 172.21.15.84:0/2630775841 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561e518558a0 con 0x561e514cdda0 2024-09-21T03:44:58.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.131+0000 7f100bfff640 1 --2- 172.21.15.84:0/2630775841 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x561e514cdda0 0x561e519704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:58.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.131+0000 7f100bfff640 1 --2- 172.21.15.84:0/2630775841 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x561e514cdda0 0x561e519704a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=282db47f809417de server_cookie=87d0891a78728804 in_seq=0 out_seq=0 2024-09-21T03:44:58.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.131+0000 7f0ff2ffd640 10 client.15999 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:44:58.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.131+0000 7f0ff2ffd640 1 -- 172.21.15.84:0/2630775841 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561e518558a0 con 0x561e514cdda0 2024-09-21T03:44:58.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.131+0000 7f0ff2ffd640 10 client.15999 handle_command_reply: tid=0 2024-09-21T03:44:58.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.132+0000 7f102006a740 1 client.15999 shutdown 2024-09-21T03:44:58.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.132+0000 7f102006a740 1 -- 172.21.15.84:0/2630775841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e51519390 msgr2=0x561e518f5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:58.149 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.132+0000 7f102006a740 1 --2- 172.21.15.84:0/2630775841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e51519390 0x561e518f5120 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f100400b620 tx=0x7f10040043c0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.132+0000 7f102006a740 1 -- 172.21.15.84:0/2630775841 shutdown_connections 2024-09-21T03:44:58.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.132+0000 7f102006a740 1 --2- 172.21.15.84:0/2630775841 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x561e514cdda0 0x561e519704a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.132+0000 7f102006a740 1 --2- 172.21.15.84:0/2630775841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e5153a070 0x561e518f5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.132+0000 7f102006a740 1 --2- 172.21.15.84:0/2630775841 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e51519390 0x561e518f5120 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.132+0000 7f0ff2ffd640 0 client.15999 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:44:58.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.132+0000 7f102006a740 1 --2- 172.21.15.84:0/2630775841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e515111b0 0x561e518f9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.132+0000 7f102006a740 1 -- 172.21.15.84:0/2630775841 >> 172.21.15.84:0/2630775841 conn(0x561e5152e460 msgr2=0x561e518fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:58.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.132+0000 7f102006a740 1 -- 172.21.15.84:0/2630775841 shutdown_connections 2024-09-21T03:44:58.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.132+0000 7f102006a740 1 -- 172.21.15.84:0/2630775841 wait complete. 2024-09-21T03:44:58.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.132+0000 7f102006a740 20 client.15999 trim_cache size 0 max 16384 2024-09-21T03:44:58.151 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:44:58.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.132+0000 7f1019af6640 1 -- 172.21.15.84:0/10041665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f10000b6680 msgr2=0x7f10000b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:58.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.132+0000 7f1019af6640 1 --2- 172.21.15.84:0/10041665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f10000b6680 0x7f10000b8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f100c1063b0 tx=0x7f100c0c3260 comp rx=0 tx=0).stop 2024-09-21T03:44:58.151 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.132+0000 7f1019af6640 1 -- 172.21.15.84:0/10041665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f101410de60 msgr2=0x7f101419fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:58.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.132+0000 7f1019af6640 1 --2- 172.21.15.84:0/10041665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f101410de60 0x7f101419fcd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f100c005cc0 tx=0x7f100c0039f0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.133+0000 7f1019af6640 1 -- 172.21.15.84:0/10041665 shutdown_connections 2024-09-21T03:44:58.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.133+0000 7f1019af6640 1 --2- 172.21.15.84:0/10041665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f10000b6680 0x7f10000b8b90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.133+0000 7f1019af6640 1 --2- 172.21.15.84:0/10041665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f101410de60 0x7f101419fcd0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.133+0000 7f1019af6640 1 --2- 172.21.15.84:0/10041665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1014105380 0x7f101419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.133+0000 7f1019af6640 1 --2- 172.21.15.84:0/10041665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1014104a30 0x7f101419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:58.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.133+0000 7f1019af6640 1 -- 172.21.15.84:0/10041665 >> 172.21.15.84:0/10041665 conn(0x7f10140797b0 msgr2=0x7f10140ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:58.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.133+0000 7f1019af6640 1 -- 172.21.15.84:0/10041665 shutdown_connections 2024-09-21T03:44:58.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:58.133+0000 7f1019af6640 1 -- 172.21.15.84:0/10041665 wait complete. 2024-09-21T03:44:58.870 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:44:59.114 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:59.545 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:44:59 smithi084 ceph-mon[30941]: pgmap v399: 97 pgs: 97 active+clean; 2.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:44:59.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.633+0000 7f56eed18640 1 -- 172.21.15.84:0/969419833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e8109df0 msgr2=0x7f56e8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:59.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.633+0000 7f56eed18640 1 --2- 172.21.15.84:0/969419833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e8109df0 0x7f56e8110620 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009ca0 tx=0x7f56e002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.633+0000 7f56eed18640 1 -- 172.21.15.84:0/969419833 shutdown_connections 2024-09-21T03:44:59.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.633+0000 7f56eed18640 1 --2- 172.21.15.84:0/969419833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e8109df0 0x7f56e8110620 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.634+0000 7f56eed18640 1 --2- 172.21.15.84:0/969419833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56e81094a0 0x7f56e81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.634+0000 7f56eed18640 1 --2- 172.21.15.84:0/969419833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56e8103b60 0x7f56e8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.634+0000 7f56eed18640 1 -- 172.21.15.84:0/969419833 >> 172.21.15.84:0/969419833 conn(0x7f56e807b850 msgr2=0x7f56e807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:59.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.634+0000 7f56eed18640 1 -- 172.21.15.84:0/969419833 shutdown_connections 2024-09-21T03:44:59.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.634+0000 7f56eed18640 1 -- 172.21.15.84:0/969419833 wait complete. 2024-09-21T03:44:59.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.634+0000 7f56eed18640 1 Processor -- start 2024-09-21T03:44:59.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.634+0000 7f56eed18640 1 -- start start 2024-09-21T03:44:59.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.634+0000 7f56eed18640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56e8103b60 0x7f56e819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:59.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.634+0000 7f56eed18640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e81094a0 0x7f56e819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:59.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.635+0000 7f56eed18640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56e8109df0 0x7f56e819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:59.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.635+0000 7f56eed18640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f56e8113ab0 con 0x7f56e81094a0 2024-09-21T03:44:59.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.635+0000 7f56eed18640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f56e8113930 con 0x7f56e8103b60 2024-09-21T03:44:59.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.635+0000 7f56eed18640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f56e8113c30 con 0x7f56e8109df0 2024-09-21T03:44:59.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.635+0000 7f56dffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e81094a0 0x7f56e819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:59.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.635+0000 7f56dffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e81094a0 0x7f56e819aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54468/0 (socket says 172.21.15.84:54468) 2024-09-21T03:44:59.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.635+0000 7f56dffff640 1 -- 172.21.15.84:0/1503597375 learned_addr learned my addr 172.21.15.84:0/1503597375 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:59.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.635+0000 7f56ed2b5640 1 --2- 172.21.15.84:0/1503597375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56e8109df0 0x7f56e819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:59.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.635+0000 7f56ecab4640 1 --2- 172.21.15.84:0/1503597375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56e8103b60 0x7f56e819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:59.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.635+0000 7f56dffff640 1 -- 172.21.15.84:0/1503597375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56e8109df0 msgr2=0x7f56e819fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:59.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.635+0000 7f56dffff640 1 --2- 172.21.15.84:0/1503597375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56e8109df0 0x7f56e819fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.635+0000 7f56dffff640 1 -- 172.21.15.84:0/1503597375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56e8103b60 msgr2=0x7f56e819a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:59.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.635+0000 7f56dffff640 1 --2- 172.21.15.84:0/1503597375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56e8103b60 0x7f56e819a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.635+0000 7f56dffff640 1 -- 172.21.15.84:0/1503597375 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e81a03d0 con 0x7f56e81094a0 2024-09-21T03:44:59.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.635+0000 7f56dffff640 1 --2- 172.21.15.84:0/1503597375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e81094a0 0x7f56e819aa00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f56d800d750 tx=0x7f56d800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:59.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.635+0000 7f56ddffb640 1 -- 172.21.15.84:0/1503597375 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d8017070 con 0x7f56e81094a0 2024-09-21T03:44:59.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.635+0000 7f56ddffb640 1 -- 172.21.15.84:0/1503597375 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56d80054d0 con 0x7f56e81094a0 2024-09-21T03:44:59.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.636+0000 7f56eed18640 1 -- 172.21.15.84:0/1503597375 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e81a06c0 con 0x7f56e81094a0 2024-09-21T03:44:59.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.636+0000 7f56ddffb640 1 -- 172.21.15.84:0/1503597375 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d8004c30 con 0x7f56e81094a0 2024-09-21T03:44:59.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.636+0000 7f56eed18640 1 -- 172.21.15.84:0/1503597375 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e81a6e20 con 0x7f56e81094a0 2024-09-21T03:44:59.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.638+0000 7f56f528c740 1 Processor -- start 2024-09-21T03:44:59.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.638+0000 7f56ddffb640 1 -- 172.21.15.84:0/1503597375 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f56d8004dd0 con 0x7f56e81094a0 2024-09-21T03:44:59.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.638+0000 7f56f528c740 1 -- start start 2024-09-21T03:44:59.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.639+0000 7f56f528c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586b1e070 0x555586ec56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:59.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.639+0000 7f56f528c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586af51b0 0x555586ec5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:59.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.639+0000 7f56f528c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586afd390 0x555586ec6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:59.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.639+0000 7f56f528c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555586e3bea0 con 0x555586b1e070 2024-09-21T03:44:59.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.639+0000 7f56f528c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555586e2b2d0 con 0x555586af51b0 2024-09-21T03:44:59.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.639+0000 7f56f528c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x555586e2f0e0 con 0x555586afd390 2024-09-21T03:44:59.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.639+0000 7f56ed2b5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586b1e070 0x555586ec56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:59.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.639+0000 7f56ed2b5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586b1e070 0x555586ec56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54478/0 (socket says 172.21.15.84:54478) 2024-09-21T03:44:59.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.639+0000 7f56ed2b5640 1 -- 172.21.15.84:0/3045367722 learned_addr learned my addr 172.21.15.84:0/3045367722 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:59.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.639+0000 7f56ecab4640 1 --2- 172.21.15.84:0/3045367722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586af51b0 0x555586ec5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:59.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.639+0000 7f56dffff640 1 --2- 172.21.15.84:0/3045367722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586afd390 0x555586ec6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:59.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.639+0000 7f56ed2b5640 1 -- 172.21.15.84:0/3045367722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586afd390 msgr2=0x555586ec6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:59.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.639+0000 7f56ed2b5640 1 --2- 172.21.15.84:0/3045367722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586afd390 0x555586ec6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.639+0000 7f56ed2b5640 1 -- 172.21.15.84:0/3045367722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586af51b0 msgr2=0x555586ec5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:59.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.639+0000 7f56ed2b5640 1 --2- 172.21.15.84:0/3045367722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586af51b0 0x555586ec5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.639+0000 7f56ddffb640 1 --2- 172.21.15.84:0/1503597375 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f56d00b6700 0x7f56d00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:59.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.639+0000 7f56ed2b5640 1 -- 172.21.15.84:0/3045367722 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555586b89650 con 0x555586b1e070 2024-09-21T03:44:59.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.639+0000 7f56dffff640 1 --2- 172.21.15.84:0/1503597375 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f56d00b6700 0x7f56d00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:59.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.639+0000 7f56ed2b5640 1 --2- 172.21.15.84:0/3045367722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586b1e070 0x555586ec56a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f56e00098b0 tx=0x7f56e00098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ad167fa28d0b5f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:59.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.639+0000 7f56ddffb640 1 -- 172.21.15.84:0/1503597375 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f56d80e6f20 con 0x7f56e81094a0 2024-09-21T03:44:59.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.640+0000 7f56ceffd640 1 -- 172.21.15.84:0/3045367722 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0031cf0 con 0x555586b1e070 2024-09-21T03:44:59.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.640+0000 7f56ceffd640 1 -- 172.21.15.84:0/3045367722 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56e0036030 con 0x555586b1e070 2024-09-21T03:44:59.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.640+0000 7f56ceffd640 1 -- 172.21.15.84:0/3045367722 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0004280 con 0x555586b1e070 2024-09-21T03:44:59.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.640+0000 7f56f528c740 1 -- 172.21.15.84:0/3045367722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586b1e070 msgr2=0x555586ec56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:59.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.640+0000 7f56dffff640 1 --2- 172.21.15.84:0/1503597375 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f56d00b6700 0x7f56d00b8c10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f56d80e47a0 tx=0x7f56d8009f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:59.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.640+0000 7f56f528c740 1 --2- 172.21.15.84:0/3045367722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586b1e070 0x555586ec56a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f56e00098b0 tx=0x7f56e00098e0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.641+0000 7f56f528c740 1 -- 172.21.15.84:0/3045367722 shutdown_connections 2024-09-21T03:44:59.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.641+0000 7f56f528c740 1 --2- 172.21.15.84:0/3045367722 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586afd390 0x555586ec6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.641+0000 7f56f528c740 1 --2- 172.21.15.84:0/3045367722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586af51b0 0x555586ec5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.641+0000 7f56f528c740 1 --2- 172.21.15.84:0/3045367722 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586b1e070 0x555586ec56a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.641+0000 7f56f528c740 1 -- 172.21.15.84:0/3045367722 >> 172.21.15.84:0/3045367722 conn(0x555586b12460 msgr2=0x555586ec3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:59.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.641+0000 7f56f528c740 1 -- 172.21.15.84:0/3045367722 shutdown_connections 2024-09-21T03:44:59.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.641+0000 7f56f528c740 1 -- 172.21.15.84:0/3045367722 wait complete. 2024-09-21T03:44:59.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.641+0000 7f56f528c740 1 -- start start 2024-09-21T03:44:59.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.641+0000 7f56f528c740 1 Processor -- start 2024-09-21T03:44:59.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56f528c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586af51b0 0x555586ed0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:59.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56f528c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586afd390 0x555586ed12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:59.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56f528c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586b1e070 0x555586edcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:59.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56f528c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x555586c8c700 con 0x555586af51b0 2024-09-21T03:44:59.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56f528c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555586dc6160 con 0x555586b1e070 2024-09-21T03:44:59.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56f528c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x555586ed3ca0 con 0x555586afd390 2024-09-21T03:44:59.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56f528c740 10 client.0 _ll_register_callbacks cb 0x555586ddf9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:59.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56ed2b5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586af51b0 0x555586ed0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:59.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56ed2b5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586af51b0 0x555586ed0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54480/0 (socket says 172.21.15.84:54480) 2024-09-21T03:44:59.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56ed2b5640 1 -- 172.21.15.84:0/3783314491 learned_addr learned my addr 172.21.15.84:0/3783314491 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:59.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56ed2b5640 1 --2- 172.21.15.84:0/3783314491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586b1e070 0x555586edcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:59.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56ecab4640 1 --2- 172.21.15.84:0/3783314491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586afd390 0x555586ed12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:59.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56ed2b5640 1 -- 172.21.15.84:0/3783314491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586afd390 msgr2=0x555586ed12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:59.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56ed2b5640 1 --2- 172.21.15.84:0/3783314491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586afd390 0x555586ed12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56ed2b5640 1 -- 172.21.15.84:0/3783314491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586b1e070 msgr2=0x555586edcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:59.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56ed2b5640 1 --2- 172.21.15.84:0/3783314491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586b1e070 0x555586edcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56ed2b5640 1 -- 172.21.15.84:0/3783314491 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555586df3c90 con 0x555586af51b0 2024-09-21T03:44:59.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56ecab4640 1 --2- 172.21.15.84:0/3783314491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586afd390 0x555586ed12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:59.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56ed2b5640 1 --2- 172.21.15.84:0/3783314491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586af51b0 0x555586ed0d70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009620 tx=0x7f56e0003e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43e58dba1815bbc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:59.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:59.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56c7fff640 1 -- 172.21.15.84:0/3783314491 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e0058060 con 0x555586af51b0 2024-09-21T03:44:59.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56c7fff640 1 -- 172.21.15.84:0/3783314491 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f56e002f860 con 0x555586af51b0 2024-09-21T03:44:59.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56f528c740 1 -- 172.21.15.84:0/3783314491 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56e0036030 con 0x555586af51b0 2024-09-21T03:44:59.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56c7fff640 1 -- 172.21.15.84:0/3783314491 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f56e002fa60 con 0x555586af51b0 2024-09-21T03:44:59.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56f528c740 10 client.16011 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:59.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.642+0000 7f56f528c740 1 -- 172.21.15.84:0/3783314491 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555586edf9a0 con 0x555586af51b0 2024-09-21T03:44:59.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.643+0000 7f56c7fff640 1 -- 172.21.15.84:0/3783314491 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56e0036030 con 0x555586af51b0 2024-09-21T03:44:59.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.643+0000 7f56c7fff640 1 -- 172.21.15.84:0/3783314491 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f56e0043070 con 0x555586af51b0 2024-09-21T03:44:59.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.643+0000 7f56f528c740 10 client.16011 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:59.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.643+0000 7f56f528c740 10 client.16011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:44:59.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.643+0000 7f56f528c740 20 client.16011 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:59.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.643+0000 7f56f528c740 1 --2- 172.21.15.84:0/3783314491 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x555586adc9f0 0x555586ee2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:59.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.643+0000 7f56f528c740 4 client.16011 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:44:59.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.643+0000 7f56f528c740 1 -- 172.21.15.84:0/3783314491 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555586e3ddf0 con 0x555586adc9f0 2024-09-21T03:44:59.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.643+0000 7f56ecab4640 1 --2- 172.21.15.84:0/3783314491 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x555586adc9f0 0x555586ee2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:59.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.644+0000 7f56c7fff640 10 client.16011 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:59.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.644+0000 7f56ecab4640 1 --2- 172.21.15.84:0/3783314491 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x555586adc9f0 0x555586ee2d00 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2caf87ecbd4c00ff server_cookie=381df2c50be3b8ce in_seq=0 out_seq=0 2024-09-21T03:44:59.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.644+0000 7f56c7fff640 1 -- 172.21.15.84:0/3783314491 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555586e3ddf0 con 0x555586adc9f0 2024-09-21T03:44:59.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.644+0000 7f56c7fff640 10 client.16011 handle_command_reply: tid=0 2024-09-21T03:44:59.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.644+0000 7f56f528c740 1 client.16011 shutdown 2024-09-21T03:44:59.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.644+0000 7f56f528c740 1 -- 172.21.15.84:0/3783314491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586af51b0 msgr2=0x555586ed0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:59.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.645+0000 7f56f528c740 1 --2- 172.21.15.84:0/3783314491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586af51b0 0x555586ed0d70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009620 tx=0x7f56e0003e80 comp rx=0 tx=0).stop 2024-09-21T03:44:59.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.645+0000 7f56f528c740 1 -- 172.21.15.84:0/3783314491 shutdown_connections 2024-09-21T03:44:59.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.645+0000 7f56f528c740 1 --2- 172.21.15.84:0/3783314491 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x555586adc9f0 0x555586ee2d00 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.645+0000 7f56f528c740 1 --2- 172.21.15.84:0/3783314491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586b1e070 0x555586edcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.645+0000 7f56f528c740 1 --2- 172.21.15.84:0/3783314491 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586afd390 0x555586ed12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.645+0000 7f56c7fff640 0 client.16011 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:59.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.645+0000 7f56f528c740 1 --2- 172.21.15.84:0/3783314491 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586af51b0 0x555586ed0d70 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.645+0000 7f56f528c740 1 -- 172.21.15.84:0/3783314491 >> 172.21.15.84:0/3783314491 conn(0x555586b12460 msgr2=0x555586ec8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:59.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.645+0000 7f56f528c740 1 -- 172.21.15.84:0/3783314491 shutdown_connections 2024-09-21T03:44:59.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.645+0000 7f56f528c740 1 -- 172.21.15.84:0/3783314491 wait complete. 2024-09-21T03:44:59.663 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.645+0000 7f56f528c740 20 client.16011 trim_cache size 0 max 16384 2024-09-21T03:44:59.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.658+0000 7f56f528c740 1 Processor -- start 2024-09-21T03:44:59.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.658+0000 7f56f528c740 1 -- start start 2024-09-21T03:44:59.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.658+0000 7f56f528c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586af51b0 0x555586ec7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:59.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.658+0000 7f56f528c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586afd390 0x555586ed29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:59.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.658+0000 7f56f528c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586b1e070 0x555586ec2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:59.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.658+0000 7f56f528c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81b1d20 con 0x555586afd390 2024-09-21T03:44:59.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.658+0000 7f56f528c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81af5f0 con 0x555586af51b0 2024-09-21T03:44:59.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.658+0000 7f56f528c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81ad440 con 0x555586b1e070 2024-09-21T03:44:59.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.658+0000 7f56ecab4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586afd390 0x555586ed29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:59.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.658+0000 7f56ecab4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586afd390 0x555586ed29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54496/0 (socket says 172.21.15.84:54496) 2024-09-21T03:44:59.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.658+0000 7f56ecab4640 1 -- 172.21.15.84:0/3521848696 learned_addr learned my addr 172.21.15.84:0/3521848696 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:59.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.658+0000 7f56ed2b5640 1 --2- 172.21.15.84:0/3521848696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586af51b0 0x555586ec7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:59.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.658+0000 7f56ed2b5640 1 --2- 172.21.15.84:0/3521848696 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586b1e070 0x555586ec2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:59.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.659+0000 7f56ecab4640 1 -- 172.21.15.84:0/3521848696 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586b1e070 msgr2=0x555586ec2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:59.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.659+0000 7f56ecab4640 1 --2- 172.21.15.84:0/3521848696 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586b1e070 0x555586ec2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.659+0000 7f56ecab4640 1 -- 172.21.15.84:0/3521848696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586af51b0 msgr2=0x555586ec7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:59.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.659+0000 7f56ecab4640 1 --2- 172.21.15.84:0/3521848696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586af51b0 0x555586ec7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.659+0000 7f56ecab4640 1 -- 172.21.15.84:0/3521848696 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555586ec8500 con 0x555586afd390 2024-09-21T03:44:59.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.659+0000 7f56ed2b5640 1 --2- 172.21.15.84:0/3521848696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586af51b0 0x555586ec7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:59.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.659+0000 7f56ecab4640 1 --2- 172.21.15.84:0/3521848696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586afd390 0x555586ed29a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x555586ee3240 tx=0x7f56e400b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963c3ade3f8b4577 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:59.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.659+0000 7f56ce7fc640 1 -- 172.21.15.84:0/3521848696 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e40142d0 con 0x555586afd390 2024-09-21T03:44:59.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.659+0000 7f56ce7fc640 1 -- 172.21.15.84:0/3521848696 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56e401f030 con 0x555586afd390 2024-09-21T03:44:59.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.659+0000 7f56ce7fc640 1 -- 172.21.15.84:0/3521848696 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4003e40 con 0x555586afd390 2024-09-21T03:44:59.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.660+0000 7f56f528c740 1 -- 172.21.15.84:0/3521848696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586afd390 msgr2=0x555586ed29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:59.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.660+0000 7f56f528c740 1 --2- 172.21.15.84:0/3521848696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586afd390 0x555586ed29a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x555586ee3240 tx=0x7f56e400b410 comp rx=0 tx=0).stop 2024-09-21T03:44:59.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.660+0000 7f56f528c740 1 -- 172.21.15.84:0/3521848696 shutdown_connections 2024-09-21T03:44:59.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.660+0000 7f56f528c740 1 --2- 172.21.15.84:0/3521848696 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586b1e070 0x555586ec2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.660+0000 7f56f528c740 1 --2- 172.21.15.84:0/3521848696 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586afd390 0x555586ed29a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.660+0000 7f56f528c740 1 --2- 172.21.15.84:0/3521848696 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586af51b0 0x555586ec7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.660+0000 7f56f528c740 1 -- 172.21.15.84:0/3521848696 >> 172.21.15.84:0/3521848696 conn(0x555586b12460 msgr2=0x555586ed2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:59.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.660+0000 7f56f528c740 1 -- 172.21.15.84:0/3521848696 shutdown_connections 2024-09-21T03:44:59.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.660+0000 7f56f528c740 1 -- 172.21.15.84:0/3521848696 wait complete. 2024-09-21T03:44:59.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.660+0000 7f56f528c740 1 -- start start 2024-09-21T03:44:59.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.660+0000 7f56f528c740 1 Processor -- start 2024-09-21T03:44:59.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.661+0000 7f56f528c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586af51b0 0x555586ed9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:59.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.661+0000 7f56f528c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586afd390 0x555586ed4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:59.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.661+0000 7f56f528c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586b1e070 0x555586ed5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:59.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.661+0000 7f56f528c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81adab0 con 0x555586afd390 2024-09-21T03:44:59.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.661+0000 7f56f528c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81aef20 con 0x555586af51b0 2024-09-21T03:44:59.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.661+0000 7f56f528c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81ae180 con 0x555586b1e070 2024-09-21T03:44:59.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.661+0000 7f56f528c740 10 client.0 _ll_register_callbacks cb 0x7f56e0009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:59.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.661+0000 7f56ecab4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586afd390 0x555586ed4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:59.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.661+0000 7f56ecab4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586afd390 0x555586ed4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54512/0 (socket says 172.21.15.84:54512) 2024-09-21T03:44:59.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.661+0000 7f56ecab4640 1 -- 172.21.15.84:0/1231694568 learned_addr learned my addr 172.21.15.84:0/1231694568 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:44:59.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.661+0000 7f56ed2b5640 1 --2- 172.21.15.84:0/1231694568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586af51b0 0x555586ed9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:59.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.661+0000 7f56ed2b5640 1 --2- 172.21.15.84:0/1231694568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586b1e070 0x555586ed5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:59.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.661+0000 7f56ecab4640 1 -- 172.21.15.84:0/1231694568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586b1e070 msgr2=0x555586ed5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:59.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.661+0000 7f56ecab4640 1 --2- 172.21.15.84:0/1231694568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586b1e070 0x555586ed5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.661+0000 7f56ecab4640 1 -- 172.21.15.84:0/1231694568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586af51b0 msgr2=0x555586ed9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:59.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.661+0000 7f56ecab4640 1 --2- 172.21.15.84:0/1231694568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586af51b0 0x555586ed9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.661+0000 7f56ecab4640 1 -- 172.21.15.84:0/1231694568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555586f4c4a0 con 0x555586afd390 2024-09-21T03:44:59.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.661+0000 7f56ed2b5640 1 --2- 172.21.15.84:0/1231694568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586b1e070 0x555586ed5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:59.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.661+0000 7f56ecab4640 1 --2- 172.21.15.84:0/1231694568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586afd390 0x555586ed4e00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f56e400bcb0 tx=0x7f56e4014390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abfba942fe5ef3f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:59.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.661+0000 7f56c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:44:59.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.662+0000 7f56c7fff640 1 -- 172.21.15.84:0/1231694568 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e40035f0 con 0x555586afd390 2024-09-21T03:44:59.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.662+0000 7f56c7fff640 1 -- 172.21.15.84:0/1231694568 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f56e4003790 con 0x555586afd390 2024-09-21T03:44:59.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.662+0000 7f56f528c740 1 -- 172.21.15.84:0/1231694568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56e401f030 con 0x555586afd390 2024-09-21T03:44:59.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.662+0000 7f56c7fff640 1 -- 172.21.15.84:0/1231694568 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f56e4003990 con 0x555586afd390 2024-09-21T03:44:59.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.662+0000 7f56f528c740 10 client.16017 fetch_fsmap learned FSMap version 25 2024-09-21T03:44:59.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.662+0000 7f56f528c740 1 -- 172.21.15.84:0/1231694568 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555586f4d5f0 con 0x555586afd390 2024-09-21T03:44:59.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.662+0000 7f56c7fff640 1 -- 172.21.15.84:0/1231694568 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56e401f030 con 0x555586afd390 2024-09-21T03:44:59.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.662+0000 7f56c7fff640 1 -- 172.21.15.84:0/1231694568 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f56e40249b0 con 0x555586afd390 2024-09-21T03:44:59.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.662+0000 7f56f528c740 10 client.16017 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:44:59.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.662+0000 7f56f528c740 10 client.16017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:44:59.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.662+0000 7f56f528c740 20 client.16017 populate_metadata read hostname 'smithi084' 2024-09-21T03:44:59.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.662+0000 7f56f528c740 1 --2- 172.21.15.84:0/1231694568 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x555586ab1da0 0x555586f4fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:59.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.662+0000 7f56f528c740 4 client.16017 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:44:59.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.662+0000 7f56f528c740 1 -- 172.21.15.84:0/1231694568 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555586e398a0 con 0x555586ab1da0 2024-09-21T03:44:59.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.663+0000 7f56ed2b5640 1 --2- 172.21.15.84:0/1231694568 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x555586ab1da0 0x555586f4fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:59.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.663+0000 7f56c7fff640 10 client.16017 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:59.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.663+0000 7f56ed2b5640 1 --2- 172.21.15.84:0/1231694568 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x555586ab1da0 0x555586f4fd70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=954091932f2b772 server_cookie=4b79a0800e4b3904 in_seq=0 out_seq=0 2024-09-21T03:44:59.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.663+0000 7f56c7fff640 1 -- 172.21.15.84:0/1231694568 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555586e398a0 con 0x555586ab1da0 2024-09-21T03:44:59.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.663+0000 7f56c7fff640 10 client.16017 handle_command_reply: tid=0 2024-09-21T03:44:59.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.663+0000 7f56f528c740 1 client.16017 shutdown 2024-09-21T03:44:59.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.663+0000 7f56f528c740 1 -- 172.21.15.84:0/1231694568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586afd390 msgr2=0x555586ed4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:59.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.663+0000 7f56f528c740 1 --2- 172.21.15.84:0/1231694568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586afd390 0x555586ed4e00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f56e400bcb0 tx=0x7f56e4014390 comp rx=0 tx=0).stop 2024-09-21T03:44:59.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.663+0000 7f56f528c740 1 -- 172.21.15.84:0/1231694568 shutdown_connections 2024-09-21T03:44:59.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.663+0000 7f56f528c740 1 --2- 172.21.15.84:0/1231694568 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x555586ab1da0 0x555586f4fd70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.663+0000 7f56f528c740 1 --2- 172.21.15.84:0/1231694568 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x555586b1e070 0x555586ed5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.663+0000 7f56f528c740 1 --2- 172.21.15.84:0/1231694568 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x555586afd390 0x555586ed4e00 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.663+0000 7f56c7fff640 0 client.16017 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:44:59.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.663+0000 7f56f528c740 1 --2- 172.21.15.84:0/1231694568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555586af51b0 0x555586ed9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.663+0000 7f56f528c740 1 -- 172.21.15.84:0/1231694568 >> 172.21.15.84:0/1231694568 conn(0x555586b12460 msgr2=0x555586ec6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:59.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.664+0000 7f56f528c740 1 -- 172.21.15.84:0/1231694568 shutdown_connections 2024-09-21T03:44:59.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.664+0000 7f56f528c740 1 -- 172.21.15.84:0/1231694568 wait complete. 2024-09-21T03:44:59.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.664+0000 7f56f528c740 20 client.16017 trim_cache size 0 max 16384 2024-09-21T03:44:59.675 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:44:59.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.664+0000 7f56eed18640 1 -- 172.21.15.84:0/1503597375 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f56d00b6700 msgr2=0x7f56d00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:59.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.664+0000 7f56eed18640 1 --2- 172.21.15.84:0/1503597375 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f56d00b6700 0x7f56d00b8c10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f56d80e47a0 tx=0x7f56d8009f90 comp rx=0 tx=0).stop 2024-09-21T03:44:59.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.664+0000 7f56eed18640 1 -- 172.21.15.84:0/1503597375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e81094a0 msgr2=0x7f56e819aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:59.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.664+0000 7f56eed18640 1 --2- 172.21.15.84:0/1503597375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e81094a0 0x7f56e819aa00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f56d800d750 tx=0x7f56d800dc10 comp rx=0 tx=0).stop 2024-09-21T03:44:59.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.664+0000 7f56eed18640 1 -- 172.21.15.84:0/1503597375 shutdown_connections 2024-09-21T03:44:59.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.664+0000 7f56eed18640 1 --2- 172.21.15.84:0/1503597375 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f56d00b6700 0x7f56d00b8c10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.664+0000 7f56eed18640 1 --2- 172.21.15.84:0/1503597375 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f56e8109df0 0x7f56e819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.664+0000 7f56eed18640 1 --2- 172.21.15.84:0/1503597375 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f56e81094a0 0x7f56e819aa00 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.664+0000 7f56eed18640 1 --2- 172.21.15.84:0/1503597375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56e8103b60 0x7f56e819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:59.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.664+0000 7f56eed18640 1 -- 172.21.15.84:0/1503597375 >> 172.21.15.84:0/1503597375 conn(0x7f56e807b850 msgr2=0x7f56e81074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:59.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.664+0000 7f56eed18640 1 -- 172.21.15.84:0/1503597375 shutdown_connections 2024-09-21T03:44:59.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:44:59.664+0000 7f56eed18640 1 -- 172.21.15.84:0/1503597375 wait complete. 2024-09-21T03:44:59.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:44:59 smithi174 ceph-mon[34403]: pgmap v399: 97 pgs: 97 active+clean; 2.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:44:59.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:44:59 smithi172 ceph-mon[34821]: pgmap v399: 97 pgs: 97 active+clean; 2.8 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T03:45:01.546 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:45:01.546 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:45:01.680 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:01 smithi174 ceph-mon[34403]: pgmap v400: 97 pgs: 97 active+clean; 2.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T03:45:01.703 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:01 smithi172 ceph-mon[34821]: pgmap v400: 97 pgs: 97 active+clean; 2.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T03:45:01.795 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:45:01.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:01 smithi084 ceph-mon[30941]: pgmap v400: 97 pgs: 97 active+clean; 2.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T03:45:02.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.336+0000 7fa6e23a7640 1 -- 172.21.15.84:0/2663820664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6dc109ea0 msgr2=0x7fa6dc1106d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:02.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.336+0000 7fa6e23a7640 1 --2- 172.21.15.84:0/2663820664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6dc109ea0 0x7fa6dc1106d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4009ca0 tx=0x7fa6d402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.336+0000 7fa6e23a7640 1 -- 172.21.15.84:0/2663820664 shutdown_connections 2024-09-21T03:45:02.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.336+0000 7fa6e23a7640 1 --2- 172.21.15.84:0/2663820664 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6dc109ea0 0x7fa6dc1106d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.336+0000 7fa6e23a7640 1 --2- 172.21.15.84:0/2663820664 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6dc109550 0x7fa6dc109960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.336+0000 7fa6e23a7640 1 --2- 172.21.15.84:0/2663820664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6dc102100 0x7fa6dc102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.336+0000 7fa6e23a7640 1 -- 172.21.15.84:0/2663820664 >> 172.21.15.84:0/2663820664 conn(0x7fa6dc079ea0 msgr2=0x7fa6dc07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:02.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.336+0000 7fa6e23a7640 1 -- 172.21.15.84:0/2663820664 shutdown_connections 2024-09-21T03:45:02.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.336+0000 7fa6e23a7640 1 -- 172.21.15.84:0/2663820664 wait complete. 2024-09-21T03:45:02.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.336+0000 7fa6e23a7640 1 Processor -- start 2024-09-21T03:45:02.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.336+0000 7fa6e23a7640 1 -- start start 2024-09-21T03:45:02.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.337+0000 7fa6e23a7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6dc102100 0x7fa6dc1030a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:02.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.337+0000 7fa6e23a7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6dc109550 0x7fa6dc1035e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:02.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.337+0000 7fa6e23a7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6dc109ea0 0x7fa6dc103b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:02.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.337+0000 7fa6e23a7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc113be0 con 0x7fa6dc109550 2024-09-21T03:45:02.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.337+0000 7fa6e23a7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc113a60 con 0x7fa6dc109ea0 2024-09-21T03:45:02.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.337+0000 7fa6e23a7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc113d60 con 0x7fa6dc102100 2024-09-21T03:45:02.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.337+0000 7fa6db7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6dc109550 0x7fa6dc1035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:02.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.337+0000 7fa6db7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6dc109550 0x7fa6dc1035e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54534/0 (socket says 172.21.15.84:54534) 2024-09-21T03:45:02.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.337+0000 7fa6db7fe640 1 -- 172.21.15.84:0/1674712558 learned_addr learned my addr 172.21.15.84:0/1674712558 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.337+0000 7fa6e0944640 1 --2- 172.21.15.84:0/1674712558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6dc109ea0 0x7fa6dc103b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.337+0000 7fa6dbfff640 1 --2- 172.21.15.84:0/1674712558 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6dc102100 0x7fa6dc1030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.337+0000 7fa6db7fe640 1 -- 172.21.15.84:0/1674712558 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6dc102100 msgr2=0x7fa6dc1030a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.337+0000 7fa6db7fe640 1 --2- 172.21.15.84:0/1674712558 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6dc102100 0x7fa6dc1030a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.337+0000 7fa6db7fe640 1 -- 172.21.15.84:0/1674712558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6dc109ea0 msgr2=0x7fa6dc103b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.337+0000 7fa6db7fe640 1 --2- 172.21.15.84:0/1674712558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6dc109ea0 0x7fa6dc103b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.337+0000 7fa6db7fe640 1 -- 172.21.15.84:0/1674712558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6dc1a8850 con 0x7fa6dc109550 2024-09-21T03:45:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.337+0000 7fa6db7fe640 1 --2- 172.21.15.84:0/1674712558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6dc109550 0x7fa6dc1035e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000d750 tx=0x7fa6d000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.338+0000 7fa6d97fa640 1 -- 172.21.15.84:0/1674712558 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0017070 con 0x7fa6dc109550 2024-09-21T03:45:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.338+0000 7fa6e23a7640 1 -- 172.21.15.84:0/1674712558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6dc1a8b40 con 0x7fa6dc109550 2024-09-21T03:45:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.338+0000 7fa6d97fa640 1 -- 172.21.15.84:0/1674712558 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6d00054d0 con 0x7fa6dc109550 2024-09-21T03:45:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.338+0000 7fa6d97fa640 1 -- 172.21.15.84:0/1674712558 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0004c30 con 0x7fa6dc109550 2024-09-21T03:45:02.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.338+0000 7fa6e23a7640 1 -- 172.21.15.84:0/1674712558 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6dc1a9080 con 0x7fa6dc109550 2024-09-21T03:45:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.340+0000 7fa6e891b740 1 Processor -- start 2024-09-21T03:45:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.340+0000 7fa6e891b740 1 -- start start 2024-09-21T03:45:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.340+0000 7fa6d97fa640 1 -- 172.21.15.84:0/1674712558 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fa6d0010460 con 0x7fa6dc109550 2024-09-21T03:45:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.340+0000 7fa6e891b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dcd14350 0x5641dd0bb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.340+0000 7fa6e891b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dcceb490 0x5641dd0bb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.341+0000 7fa6e891b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dccf3670 0x5641dd0bbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.341+0000 7fa6e891b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5641dd031e60 con 0x5641dcceb490 2024-09-21T03:45:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.341+0000 7fa6e891b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5641dd021290 con 0x5641dccf3670 2024-09-21T03:45:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.341+0000 7fa6e891b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5641dd0250a0 con 0x5641dcd14350 2024-09-21T03:45:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.341+0000 7fa6dbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dcceb490 0x5641dd0bb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.341+0000 7fa6dbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dcceb490 0x5641dd0bb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54542/0 (socket says 172.21.15.84:54542) 2024-09-21T03:45:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.341+0000 7fa6dbfff640 1 -- 172.21.15.84:0/3048932344 learned_addr learned my addr 172.21.15.84:0/3048932344 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.341+0000 7fa6e0944640 1 --2- 172.21.15.84:0/3048932344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dcd14350 0x5641dd0bb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:02.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.341+0000 7fa6dbfff640 1 -- 172.21.15.84:0/3048932344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dcd14350 msgr2=0x5641dd0bb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:02.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.341+0000 7fa6dbfff640 1 --2- 172.21.15.84:0/3048932344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dcd14350 0x5641dd0bb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.341+0000 7fa6dbfff640 1 -- 172.21.15.84:0/3048932344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dccf3670 msgr2=0x5641dd0bbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:02.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.341+0000 7fa6db7fe640 1 --2- 172.21.15.84:0/3048932344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dccf3670 0x5641dd0bbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:02.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.341+0000 7fa6dbfff640 1 --2- 172.21.15.84:0/3048932344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dccf3670 0x5641dd0bbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.341+0000 7fa6dbfff640 1 -- 172.21.15.84:0/3048932344 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641dcd7f930 con 0x5641dcceb490 2024-09-21T03:45:02.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.341+0000 7fa6db7fe640 1 --2- 172.21.15.84:0/3048932344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dccf3670 0x5641dd0bbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:45:02.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.341+0000 7fa6dbfff640 1 --2- 172.21.15.84:0/3048932344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dcceb490 0x5641dd0bb970 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc00b7f0 tx=0x7fa6cc00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78f9d486d03501e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:02.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.341+0000 7fa6c27fc640 1 -- 172.21.15.84:0/3048932344 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc00d950 con 0x5641dcceb490 2024-09-21T03:45:02.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.341+0000 7fa6d97fa640 1 --2- 172.21.15.84:0/1674712558 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa6c40b6680 0x7fa6c40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:02.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.341+0000 7fa6c27fc640 1 -- 172.21.15.84:0/3048932344 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6cc018070 con 0x5641dcceb490 2024-09-21T03:45:02.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.341+0000 7fa6c27fc640 1 -- 172.21.15.84:0/3048932344 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc0123e0 con 0x5641dcceb490 2024-09-21T03:45:02.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.342+0000 7fa6e0944640 1 --2- 172.21.15.84:0/1674712558 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa6c40b6680 0x7fa6c40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:02.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.342+0000 7fa6d97fa640 1 -- 172.21.15.84:0/1674712558 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa6d00e71a0 con 0x7fa6dc109550 2024-09-21T03:45:02.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.342+0000 7fa6e891b740 1 -- 172.21.15.84:0/3048932344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dcceb490 msgr2=0x5641dd0bb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:02.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.342+0000 7fa6e0944640 1 --2- 172.21.15.84:0/1674712558 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa6c40b6680 0x7fa6c40b8b90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40094e0 tx=0x7fa6d402f3a0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:02.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.342+0000 7fa6e891b740 1 --2- 172.21.15.84:0/3048932344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dcceb490 0x5641dd0bb970 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc00b7f0 tx=0x7fa6cc00bcb0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.342+0000 7fa6e891b740 1 -- 172.21.15.84:0/3048932344 shutdown_connections 2024-09-21T03:45:02.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.342+0000 7fa6e891b740 1 --2- 172.21.15.84:0/3048932344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dccf3670 0x5641dd0bbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.342+0000 7fa6e891b740 1 --2- 172.21.15.84:0/3048932344 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dcceb490 0x5641dd0bb970 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.342+0000 7fa6e891b740 1 --2- 172.21.15.84:0/3048932344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dcd14350 0x5641dd0bb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.342+0000 7fa6e891b740 1 -- 172.21.15.84:0/3048932344 >> 172.21.15.84:0/3048932344 conn(0x5641dcd08740 msgr2=0x5641dd0b9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:02.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.342+0000 7fa6e891b740 1 -- 172.21.15.84:0/3048932344 shutdown_connections 2024-09-21T03:45:02.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.342+0000 7fa6e891b740 1 -- 172.21.15.84:0/3048932344 wait complete. 2024-09-21T03:45:02.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.343+0000 7fa6e891b740 1 -- start start 2024-09-21T03:45:02.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.343+0000 7fa6e891b740 1 Processor -- start 2024-09-21T03:45:02.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.343+0000 7fa6e891b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dcceb490 0x5641dd0c7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:02.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.343+0000 7fa6e891b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dccf3670 0x5641dd0c7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:02.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.343+0000 7fa6e891b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dcd14350 0x5641dd0d2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:02.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.343+0000 7fa6e891b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5641dce82890 con 0x5641dccf3670 2024-09-21T03:45:02.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.343+0000 7fa6e891b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5641dcfbbd40 con 0x5641dcceb490 2024-09-21T03:45:02.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.343+0000 7fa6e891b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5641dd0c9c10 con 0x5641dcd14350 2024-09-21T03:45:02.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.343+0000 7fa6db7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dccf3670 0x5641dd0c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:02.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.343+0000 7fa6e891b740 10 client.0 _ll_register_callbacks cb 0x5641dd01fc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:45:02.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.343+0000 7fa6db7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dccf3670 0x5641dd0c7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54556/0 (socket says 172.21.15.84:54556) 2024-09-21T03:45:02.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.343+0000 7fa6db7fe640 1 -- 172.21.15.84:0/1776654755 learned_addr learned my addr 172.21.15.84:0/1776654755 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:02.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.344+0000 7fa6dbfff640 1 --2- 172.21.15.84:0/1776654755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dcceb490 0x5641dd0c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:02.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.344+0000 7fa6db7fe640 1 -- 172.21.15.84:0/1776654755 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dcd14350 msgr2=0x5641dd0d2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:02.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.344+0000 7fa6e0944640 1 --2- 172.21.15.84:0/1776654755 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dcd14350 0x5641dd0d2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:02.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.344+0000 7fa6db7fe640 1 --2- 172.21.15.84:0/1776654755 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dcd14350 0x5641dd0d2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.344+0000 7fa6db7fe640 1 -- 172.21.15.84:0/1776654755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dcceb490 msgr2=0x5641dd0c7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:02.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.344+0000 7fa6db7fe640 1 --2- 172.21.15.84:0/1776654755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dcceb490 0x5641dd0c7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.344+0000 7fa6db7fe640 1 -- 172.21.15.84:0/1776654755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641dd0d34c0 con 0x5641dccf3670 2024-09-21T03:45:02.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.344+0000 7fa6dbfff640 1 --2- 172.21.15.84:0/1776654755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dcceb490 0x5641dd0c7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:45:02.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.344+0000 7fa6e0944640 1 --2- 172.21.15.84:0/1776654755 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dcd14350 0x5641dd0d2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:45:02.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.344+0000 7fa6db7fe640 1 --2- 172.21.15.84:0/1776654755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dccf3670 0x5641dd0c7540 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0009610 tx=0x7fa6d00acf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da595426d3eded8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:02.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.344+0000 7fa6bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:45:02.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.344+0000 7fa6bb7fe640 1 -- 172.21.15.84:0/1776654755 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0020050 con 0x5641dccf3670 2024-09-21T03:45:02.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.344+0000 7fa6bb7fe640 1 -- 172.21.15.84:0/1776654755 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa6d00a89c0 con 0x5641dccf3670 2024-09-21T03:45:02.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.344+0000 7fa6e891b740 1 -- 172.21.15.84:0/1776654755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6cc018070 con 0x5641dccf3670 2024-09-21T03:45:02.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.344+0000 7fa6bb7fe640 1 -- 172.21.15.84:0/1776654755 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa6d00acb80 con 0x5641dccf3670 2024-09-21T03:45:02.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.344+0000 7fa6e891b740 10 client.16029 fetch_fsmap learned FSMap version 25 2024-09-21T03:45:02.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.344+0000 7fa6e891b740 1 -- 172.21.15.84:0/1776654755 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5641dd0d5df0 con 0x5641dccf3670 2024-09-21T03:45:02.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.344+0000 7fa6bb7fe640 1 -- 172.21.15.84:0/1776654755 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6cc018070 con 0x5641dccf3670 2024-09-21T03:45:02.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.345+0000 7fa6bb7fe640 1 -- 172.21.15.84:0/1776654755 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa6d00a8bc0 con 0x5641dccf3670 2024-09-21T03:45:02.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.345+0000 7fa6e891b740 10 client.16029 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:45:02.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.345+0000 7fa6e891b740 10 client.16029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:45:02.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.345+0000 7fa6e891b740 20 client.16029 populate_metadata read hostname 'smithi084' 2024-09-21T03:45:02.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.345+0000 7fa6e891b740 1 --2- 172.21.15.84:0/1776654755 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5641dccd2cd0 0x5641dd0d92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:02.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.345+0000 7fa6e891b740 4 client.16029 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:45:02.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.345+0000 7fa6e891b740 1 -- 172.21.15.84:0/1776654755 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641dd033db0 con 0x5641dccd2cd0 2024-09-21T03:45:02.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.345+0000 7fa6dbfff640 1 --2- 172.21.15.84:0/1776654755 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5641dccd2cd0 0x5641dd0d92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:02.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.345+0000 7fa6bb7fe640 10 client.16029 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:02.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.345+0000 7fa6dbfff640 1 --2- 172.21.15.84:0/1776654755 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5641dccd2cd0 0x5641dd0d92c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2826bd1cedf92dde server_cookie=e7e5ec5bb06ce4f4 in_seq=0 out_seq=0 2024-09-21T03:45:02.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.346+0000 7fa6bb7fe640 1 -- 172.21.15.84:0/1776654755 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5641dd033db0 con 0x5641dccd2cd0 2024-09-21T03:45:02.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.346+0000 7fa6bb7fe640 10 client.16029 handle_command_reply: tid=0 2024-09-21T03:45:02.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.346+0000 7fa6e891b740 1 client.16029 shutdown 2024-09-21T03:45:02.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.346+0000 7fa6e891b740 1 -- 172.21.15.84:0/1776654755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dccf3670 msgr2=0x5641dd0c7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:02.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.346+0000 7fa6e891b740 1 --2- 172.21.15.84:0/1776654755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dccf3670 0x5641dd0c7540 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0009610 tx=0x7fa6d00acf00 comp rx=0 tx=0).stop 2024-09-21T03:45:02.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.346+0000 7fa6e891b740 1 -- 172.21.15.84:0/1776654755 shutdown_connections 2024-09-21T03:45:02.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.346+0000 7fa6e891b740 1 --2- 172.21.15.84:0/1776654755 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5641dccd2cd0 0x5641dd0d92c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.346+0000 7fa6e891b740 1 --2- 172.21.15.84:0/1776654755 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dcd14350 0x5641dd0d2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.346+0000 7fa6bb7fe640 0 client.16029 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:02.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.346+0000 7fa6e891b740 1 --2- 172.21.15.84:0/1776654755 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dccf3670 0x5641dd0c7540 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.346+0000 7fa6e891b740 1 --2- 172.21.15.84:0/1776654755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dcceb490 0x5641dd0c7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.346+0000 7fa6e891b740 1 -- 172.21.15.84:0/1776654755 >> 172.21.15.84:0/1776654755 conn(0x5641dcd08740 msgr2=0x5641dd0be5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:02.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.347+0000 7fa6e891b740 1 -- 172.21.15.84:0/1776654755 shutdown_connections 2024-09-21T03:45:02.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.347+0000 7fa6e891b740 1 -- 172.21.15.84:0/1776654755 wait complete. 2024-09-21T03:45:02.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.347+0000 7fa6e891b740 20 client.16029 trim_cache size 0 max 16384 2024-09-21T03:45:02.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.365+0000 7fa6e891b740 1 Processor -- start 2024-09-21T03:45:02.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.365+0000 7fa6e891b740 1 -- start start 2024-09-21T03:45:02.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.365+0000 7fa6e891b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dcceb490 0x5641dd0d2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:02.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.365+0000 7fa6e891b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dccf3670 0x5641dd0c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:02.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.365+0000 7fa6e891b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dcd14350 0x5641dd0c4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:02.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.365+0000 7fa6e891b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc1b4090 con 0x5641dccf3670 2024-09-21T03:45:02.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.365+0000 7fa6e891b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc1b1960 con 0x5641dcd14350 2024-09-21T03:45:02.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.365+0000 7fa6e891b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc1af7b0 con 0x5641dcceb490 2024-09-21T03:45:02.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.365+0000 7fa6db7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dccf3670 0x5641dd0c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:02.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.365+0000 7fa6db7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dccf3670 0x5641dd0c3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54572/0 (socket says 172.21.15.84:54572) 2024-09-21T03:45:02.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.365+0000 7fa6db7fe640 1 -- 172.21.15.84:0/3872098164 learned_addr learned my addr 172.21.15.84:0/3872098164 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:02.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.365+0000 7fa6e0944640 1 --2- 172.21.15.84:0/3872098164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dcd14350 0x5641dd0c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:02.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.365+0000 7fa6db7fe640 1 -- 172.21.15.84:0/3872098164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dcceb490 msgr2=0x5641dd0d2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:02.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.365+0000 7fa6dbfff640 1 --2- 172.21.15.84:0/3872098164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dcceb490 0x5641dd0d2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:02.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.365+0000 7fa6db7fe640 1 --2- 172.21.15.84:0/3872098164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dcceb490 0x5641dd0d2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.365+0000 7fa6db7fe640 1 -- 172.21.15.84:0/3872098164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dcd14350 msgr2=0x5641dd0c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:02.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.365+0000 7fa6db7fe640 1 --2- 172.21.15.84:0/3872098164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dcd14350 0x5641dd0c4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.366+0000 7fa6db7fe640 1 -- 172.21.15.84:0/3872098164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641dd0d9630 con 0x5641dccf3670 2024-09-21T03:45:02.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.366+0000 7fa6db7fe640 1 --2- 172.21.15.84:0/3872098164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dccf3670 0x5641dd0c3ff0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00a9640 tx=0x7fa6d000b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960bc22663c23815 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:02.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.366+0000 7fa6c1ffb640 1 -- 172.21.15.84:0/3872098164 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0014020 con 0x5641dccf3670 2024-09-21T03:45:02.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.366+0000 7fa6c1ffb640 1 -- 172.21.15.84:0/3872098164 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6d00ad770 con 0x5641dccf3670 2024-09-21T03:45:02.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.366+0000 7fa6c1ffb640 1 -- 172.21.15.84:0/3872098164 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0020070 con 0x5641dccf3670 2024-09-21T03:45:02.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.367+0000 7fa6e891b740 1 -- 172.21.15.84:0/3872098164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dccf3670 msgr2=0x5641dd0c3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:02.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.367+0000 7fa6e891b740 1 --2- 172.21.15.84:0/3872098164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dccf3670 0x5641dd0c3ff0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa6d00a9640 tx=0x7fa6d000b420 comp rx=0 tx=0).stop 2024-09-21T03:45:02.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.367+0000 7fa6e891b740 1 -- 172.21.15.84:0/3872098164 shutdown_connections 2024-09-21T03:45:02.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.367+0000 7fa6e891b740 1 --2- 172.21.15.84:0/3872098164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dcd14350 0x5641dd0c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.367+0000 7fa6e891b740 1 --2- 172.21.15.84:0/3872098164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dccf3670 0x5641dd0c3ff0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.367+0000 7fa6e891b740 1 --2- 172.21.15.84:0/3872098164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dcceb490 0x5641dd0d2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.367+0000 7fa6e891b740 1 -- 172.21.15.84:0/3872098164 >> 172.21.15.84:0/3872098164 conn(0x5641dcd08740 msgr2=0x5641dd0c5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:02.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.367+0000 7fa6e891b740 1 -- 172.21.15.84:0/3872098164 shutdown_connections 2024-09-21T03:45:02.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.367+0000 7fa6e891b740 1 -- 172.21.15.84:0/3872098164 wait complete. 2024-09-21T03:45:02.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.367+0000 7fa6e891b740 1 -- start start 2024-09-21T03:45:02.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.367+0000 7fa6e891b740 1 Processor -- start 2024-09-21T03:45:02.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.368+0000 7fa6e891b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dcceb490 0x5641dd0cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:02.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.368+0000 7fa6e891b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dccf3670 0x5641dd0cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:02.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.368+0000 7fa6e891b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dcd14350 0x5641dd142bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:02.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.368+0000 7fa6e891b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc1afe20 con 0x5641dcceb490 2024-09-21T03:45:02.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.368+0000 7fa6e891b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc1b1290 con 0x5641dcd14350 2024-09-21T03:45:02.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.368+0000 7fa6e891b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc1b04f0 con 0x5641dccf3670 2024-09-21T03:45:02.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.368+0000 7fa6dbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dcceb490 0x5641dd0cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:02.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.368+0000 7fa6dbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dcceb490 0x5641dd0cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54584/0 (socket says 172.21.15.84:54584) 2024-09-21T03:45:02.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.368+0000 7fa6dbfff640 1 -- 172.21.15.84:0/782816021 learned_addr learned my addr 172.21.15.84:0/782816021 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:02.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.368+0000 7fa6e891b740 10 client.0 _ll_register_callbacks cb 0x7fa6d00046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:45:02.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.368+0000 7fa6db7fe640 1 --2- 172.21.15.84:0/782816021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dccf3670 0x5641dd0cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:02.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.368+0000 7fa6e0944640 1 --2- 172.21.15.84:0/782816021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dcd14350 0x5641dd142bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:02.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.368+0000 7fa6dbfff640 1 -- 172.21.15.84:0/782816021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dccf3670 msgr2=0x5641dd0cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:02.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.368+0000 7fa6dbfff640 1 --2- 172.21.15.84:0/782816021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dccf3670 0x5641dd0cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.368+0000 7fa6dbfff640 1 -- 172.21.15.84:0/782816021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dcd14350 msgr2=0x5641dd142bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:02.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.368+0000 7fa6dbfff640 1 --2- 172.21.15.84:0/782816021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dcd14350 0x5641dd142bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.368+0000 7fa6dbfff640 1 -- 172.21.15.84:0/782816021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641dd143130 con 0x5641dcceb490 2024-09-21T03:45:02.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.368+0000 7fa6dbfff640 1 --2- 172.21.15.84:0/782816021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dcceb490 0x5641dd0cb520 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc004810 tx=0x7fa6cc006dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5acdeb3d1ee7dc05 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:02.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.368+0000 7fa6bb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:45:02.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.369+0000 7fa6bb7fe640 1 -- 172.21.15.84:0/782816021 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc00db50 con 0x5641dcceb490 2024-09-21T03:45:02.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.369+0000 7fa6bb7fe640 1 -- 172.21.15.84:0/782816021 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa6cc00dcf0 con 0x5641dcceb490 2024-09-21T03:45:02.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.369+0000 7fa6e891b740 1 -- 172.21.15.84:0/782816021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6d00ad770 con 0x5641dcceb490 2024-09-21T03:45:02.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.369+0000 7fa6bb7fe640 1 -- 172.21.15.84:0/782816021 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa6cc034050 con 0x5641dcceb490 2024-09-21T03:45:02.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.369+0000 7fa6e891b740 10 client.16035 fetch_fsmap learned FSMap version 25 2024-09-21T03:45:02.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.369+0000 7fa6e891b740 1 -- 172.21.15.84:0/782816021 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5641dd144360 con 0x5641dcceb490 2024-09-21T03:45:02.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.369+0000 7fa6bb7fe640 1 -- 172.21.15.84:0/782816021 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6d00ad770 con 0x5641dcceb490 2024-09-21T03:45:02.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.369+0000 7fa6bb7fe640 1 -- 172.21.15.84:0/782816021 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa6cc026c40 con 0x5641dcceb490 2024-09-21T03:45:02.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.369+0000 7fa6e891b740 10 client.16035 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:45:02.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.369+0000 7fa6e891b740 10 client.16035 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:45:02.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.369+0000 7fa6e891b740 20 client.16035 populate_metadata read hostname 'smithi084' 2024-09-21T03:45:02.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.369+0000 7fa6e891b740 1 --2- 172.21.15.84:0/782816021 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5641dcca8080 0x5641dd146a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:02.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.369+0000 7fa6e891b740 4 client.16035 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:45:02.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.369+0000 7fa6e891b740 1 -- 172.21.15.84:0/782816021 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5641dd02f860 con 0x5641dcca8080 2024-09-21T03:45:02.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.370+0000 7fa6db7fe640 1 --2- 172.21.15.84:0/782816021 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5641dcca8080 0x5641dd146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:02.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.370+0000 7fa6bb7fe640 10 client.16035 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:02.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.370+0000 7fa6db7fe640 1 --2- 172.21.15.84:0/782816021 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5641dcca8080 0x5641dd146a10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=faec82d98f56f2e4 server_cookie=d546bf5a5a620aeb in_seq=0 out_seq=0 2024-09-21T03:45:02.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.372+0000 7fa6bb7fe640 1 -- 172.21.15.84:0/782816021 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5641dd02f860 con 0x5641dcca8080 2024-09-21T03:45:02.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.372+0000 7fa6bb7fe640 10 client.16035 handle_command_reply: tid=0 2024-09-21T03:45:02.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.372+0000 7fa6e891b740 1 client.16035 shutdown 2024-09-21T03:45:02.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.373+0000 7fa6e891b740 1 -- 172.21.15.84:0/782816021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dcceb490 msgr2=0x5641dd0cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:02.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.373+0000 7fa6e891b740 1 --2- 172.21.15.84:0/782816021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dcceb490 0x5641dd0cb520 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc004810 tx=0x7fa6cc006dc0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.373+0000 7fa6e891b740 1 -- 172.21.15.84:0/782816021 shutdown_connections 2024-09-21T03:45:02.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.373+0000 7fa6e891b740 1 --2- 172.21.15.84:0/782816021 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5641dcca8080 0x5641dd146a10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.373+0000 7fa6e891b740 1 --2- 172.21.15.84:0/782816021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641dcd14350 0x5641dd142bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.373+0000 7fa6e891b740 1 --2- 172.21.15.84:0/782816021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5641dccf3670 0x5641dd0cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.373+0000 7fa6e891b740 1 --2- 172.21.15.84:0/782816021 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5641dcceb490 0x5641dd0cb520 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.373+0000 7fa6e891b740 1 -- 172.21.15.84:0/782816021 >> 172.21.15.84:0/782816021 conn(0x5641dcd08740 msgr2=0x5641dd0bc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:02.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.373+0000 7fa6bb7fe640 0 client.16035 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:02.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.373+0000 7fa6e891b740 1 -- 172.21.15.84:0/782816021 shutdown_connections 2024-09-21T03:45:02.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.373+0000 7fa6e891b740 1 -- 172.21.15.84:0/782816021 wait complete. 2024-09-21T03:45:02.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.373+0000 7fa6e891b740 20 client.16035 trim_cache size 0 max 16384 2024-09-21T03:45:02.378 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:45:02.378 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T03:45:02.378 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3", 2024-09-21T03:45:02.378 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T03:45:02.378 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:45:02.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.374+0000 7fa6e23a7640 1 -- 172.21.15.84:0/1674712558 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa6c40b6680 msgr2=0x7fa6c40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:02.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.374+0000 7fa6e23a7640 1 --2- 172.21.15.84:0/1674712558 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa6c40b6680 0x7fa6c40b8b90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa6d40094e0 tx=0x7fa6d402f3a0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.374+0000 7fa6e23a7640 1 -- 172.21.15.84:0/1674712558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6dc109550 msgr2=0x7fa6dc1035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:02.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.374+0000 7fa6e23a7640 1 --2- 172.21.15.84:0/1674712558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6dc109550 0x7fa6dc1035e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000d750 tx=0x7fa6d000dc10 comp rx=0 tx=0).stop 2024-09-21T03:45:02.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.374+0000 7fa6e23a7640 1 -- 172.21.15.84:0/1674712558 shutdown_connections 2024-09-21T03:45:02.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.374+0000 7fa6e23a7640 1 --2- 172.21.15.84:0/1674712558 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa6c40b6680 0x7fa6c40b8b90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.374+0000 7fa6e23a7640 1 --2- 172.21.15.84:0/1674712558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6dc109ea0 0x7fa6dc103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.374+0000 7fa6e23a7640 1 --2- 172.21.15.84:0/1674712558 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa6dc109550 0x7fa6dc1035e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.374+0000 7fa6e23a7640 1 --2- 172.21.15.84:0/1674712558 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6dc102100 0x7fa6dc1030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:02.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.374+0000 7fa6e23a7640 1 -- 172.21.15.84:0/1674712558 >> 172.21.15.84:0/1674712558 conn(0x7fa6dc079ea0 msgr2=0x7fa6dc1075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:02.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.374+0000 7fa6e23a7640 1 -- 172.21.15.84:0/1674712558 shutdown_connections 2024-09-21T03:45:02.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:02.374+0000 7fa6e23a7640 1 -- 172.21.15.84:0/1674712558 wait complete. 2024-09-21T03:45:03.085 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:45:03.332 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:45:03.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:03 smithi084 ceph-mon[30941]: pgmap v401: 97 pgs: 97 active+clean; 2.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-21T03:45:03.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:03 smithi084 ceph-mon[30941]: scrub queued for path: / 2024-09-21T03:45:03.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:03 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:45:03.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:03 smithi084 ceph-mon[30941]: scrub summary: active paths [/] 2024-09-21T03:45:03.753 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:03 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:45:03.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.842+0000 7fa4c33c9640 1 -- 172.21.15.84:0/2678945332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4bc102f90 msgr2=0x7fa4bc1033a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:03.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.842+0000 7fa4c33c9640 1 --2- 172.21.15.84:0/2678945332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4bc102f90 0x7fa4bc1033a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009900 tx=0x7fa4b002a3f0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.842+0000 7fa4c33c9640 1 -- 172.21.15.84:0/2678945332 shutdown_connections 2024-09-21T03:45:03.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.842+0000 7fa4c33c9640 1 --2- 172.21.15.84:0/2678945332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4bc1038e0 0x7fa4bc10f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.842+0000 7fa4c33c9640 1 --2- 172.21.15.84:0/2678945332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4bc102f90 0x7fa4bc1033a0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.842+0000 7fa4c33c9640 1 --2- 172.21.15.84:0/2678945332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4bc107620 0x7fa4bc107a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.842+0000 7fa4c33c9640 1 -- 172.21.15.84:0/2678945332 >> 172.21.15.84:0/2678945332 conn(0x7fa4bc079e30 msgr2=0x7fa4bc07a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:03.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.842+0000 7fa4c33c9640 1 -- 172.21.15.84:0/2678945332 shutdown_connections 2024-09-21T03:45:03.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.842+0000 7fa4c33c9640 1 -- 172.21.15.84:0/2678945332 wait complete. 2024-09-21T03:45:03.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.842+0000 7fa4c33c9640 1 Processor -- start 2024-09-21T03:45:03.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.843+0000 7fa4c33c9640 1 -- start start 2024-09-21T03:45:03.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.843+0000 7fa4c33c9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4bc102f90 0x7fa4bc19b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:03.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.843+0000 7fa4c33c9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4bc1038e0 0x7fa4bc19b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:03.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.843+0000 7fa4c33c9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4bc107620 0x7fa4bc19be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:03.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.843+0000 7fa4c33c9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc1129d0 con 0x7fa4bc107620 2024-09-21T03:45:03.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.843+0000 7fa4c33c9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc112850 con 0x7fa4bc102f90 2024-09-21T03:45:03.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.843+0000 7fa4c33c9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc112b50 con 0x7fa4bc1038e0 2024-09-21T03:45:03.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.843+0000 7fa4c1966640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4bc107620 0x7fa4bc19be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:03.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.843+0000 7fa4c1966640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4bc107620 0x7fa4bc19be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54610/0 (socket says 172.21.15.84:54610) 2024-09-21T03:45:03.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.843+0000 7fa4c1966640 1 -- 172.21.15.84:0/3043159813 learned_addr learned my addr 172.21.15.84:0/3043159813 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:03.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.843+0000 7fa4c1165640 1 --2- 172.21.15.84:0/3043159813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4bc102f90 0x7fa4bc19b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:03.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.843+0000 7fa4c0964640 1 --2- 172.21.15.84:0/3043159813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4bc1038e0 0x7fa4bc19b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:03.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.843+0000 7fa4c1966640 1 -- 172.21.15.84:0/3043159813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4bc1038e0 msgr2=0x7fa4bc19b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:03.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.843+0000 7fa4c1966640 1 --2- 172.21.15.84:0/3043159813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4bc1038e0 0x7fa4bc19b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.843+0000 7fa4c1966640 1 -- 172.21.15.84:0/3043159813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4bc102f90 msgr2=0x7fa4bc19b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:03.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.843+0000 7fa4c1966640 1 --2- 172.21.15.84:0/3043159813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4bc102f90 0x7fa4bc19b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.843+0000 7fa4c1966640 1 -- 172.21.15.84:0/3043159813 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4bc1a65a0 con 0x7fa4bc107620 2024-09-21T03:45:03.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.843+0000 7fa4c1966640 1 --2- 172.21.15.84:0/3043159813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4bc107620 0x7fa4bc19be20 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400cce0 tx=0x7fa4b400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:03.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.844+0000 7fa4ae7fc640 1 -- 172.21.15.84:0/3043159813 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b400f450 con 0x7fa4bc107620 2024-09-21T03:45:03.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.844+0000 7fa4ae7fc640 1 -- 172.21.15.84:0/3043159813 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4b400faa0 con 0x7fa4bc107620 2024-09-21T03:45:03.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.844+0000 7fa4c33c9640 1 -- 172.21.15.84:0/3043159813 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4bc1a6890 con 0x7fa4bc107620 2024-09-21T03:45:03.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.844+0000 7fa4ae7fc640 1 -- 172.21.15.84:0/3043159813 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4018b70 con 0x7fa4bc107620 2024-09-21T03:45:03.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.844+0000 7fa4c33c9640 1 -- 172.21.15.84:0/3043159813 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4bc1a6d80 con 0x7fa4bc107620 2024-09-21T03:45:03.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.847+0000 7fa4c993d740 1 Processor -- start 2024-09-21T03:45:03.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.847+0000 7fa4ae7fc640 1 -- 172.21.15.84:0/3043159813 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fa4b4018d10 con 0x7fa4bc107620 2024-09-21T03:45:03.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.847+0000 7fa4c993d740 1 -- start start 2024-09-21T03:45:03.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.847+0000 7fa4c993d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ce6534070 0x558ce68db270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:03.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.847+0000 7fa4c993d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 0x558ce68db7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:03.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.847+0000 7fa4c993d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce6513390 0x558ce68dbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:03.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.847+0000 7fa4c993d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558ce6851e50 con 0x558ce650b1b0 2024-09-21T03:45:03.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.847+0000 7fa4c993d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558ce6841280 con 0x558ce6513390 2024-09-21T03:45:03.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.847+0000 7fa4c993d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558ce6845090 con 0x558ce6534070 2024-09-21T03:45:03.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.848+0000 7fa4c1165640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 0x558ce68db7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:03.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.848+0000 7fa4c1165640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 0x558ce68db7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54626/0 (socket says 172.21.15.84:54626) 2024-09-21T03:45:03.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.848+0000 7fa4c1165640 1 -- 172.21.15.84:0/3578619120 learned_addr learned my addr 172.21.15.84:0/3578619120 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:03.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.848+0000 7fa4c0964640 1 --2- 172.21.15.84:0/3578619120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce6513390 0x558ce68dbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:03.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.848+0000 7fa4c0964640 1 --2- 172.21.15.84:0/3578619120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ce6534070 0x558ce68db270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:03.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.848+0000 7fa4ae7fc640 1 --2- 172.21.15.84:0/3043159813 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4a80b66b0 0x7fa4a80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:03.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.848+0000 7fa4c1165640 1 -- 172.21.15.84:0/3578619120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ce6534070 msgr2=0x558ce68db270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:03.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.848+0000 7fa4c1165640 1 --2- 172.21.15.84:0/3578619120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ce6534070 0x558ce68db270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.848+0000 7fa4c1165640 1 -- 172.21.15.84:0/3578619120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce6513390 msgr2=0x558ce68dbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:03.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.848+0000 7fa4c1165640 1 --2- 172.21.15.84:0/3578619120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce6513390 0x558ce68dbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.848+0000 7fa4c1165640 1 -- 172.21.15.84:0/3578619120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ce659f650 con 0x558ce650b1b0 2024-09-21T03:45:03.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.848+0000 7fa4c0964640 1 --2- 172.21.15.84:0/3578619120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ce6534070 0x558ce68db270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:45:03.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.848+0000 7fa4c1966640 1 --2- 172.21.15.84:0/3043159813 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4a80b66b0 0x7fa4a80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:03.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.848+0000 7fa4c1165640 1 --2- 172.21.15.84:0/3578619120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 0x558ce68db7b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa4b800cb90 tx=0x7fa4b800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7391f2d09772a08f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:03.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.848+0000 7fa4ae7fc640 1 -- 172.21.15.84:0/3043159813 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa4b40e7ba0 con 0x7fa4bc107620 2024-09-21T03:45:03.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.848+0000 7fa4a77fe640 1 -- 172.21.15.84:0/3578619120 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8010630 con 0x558ce650b1b0 2024-09-21T03:45:03.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.849+0000 7fa4a77fe640 1 -- 172.21.15.84:0/3578619120 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4b8010c80 con 0x558ce650b1b0 2024-09-21T03:45:03.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.849+0000 7fa4a77fe640 1 -- 172.21.15.84:0/3578619120 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b800fa80 con 0x558ce650b1b0 2024-09-21T03:45:03.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.849+0000 7fa4c993d740 1 -- 172.21.15.84:0/3578619120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 msgr2=0x558ce68db7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:03.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.849+0000 7fa4c1966640 1 --2- 172.21.15.84:0/3043159813 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4a80b66b0 0x7fa4a80b8bc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40e5970 tx=0x7fa4b407a720 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:03.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.849+0000 7fa4c993d740 1 --2- 172.21.15.84:0/3578619120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 0x558ce68db7b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa4b800cb90 tx=0x7fa4b800e720 comp rx=0 tx=0).stop 2024-09-21T03:45:03.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.849+0000 7fa4c993d740 1 -- 172.21.15.84:0/3578619120 shutdown_connections 2024-09-21T03:45:03.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.849+0000 7fa4c993d740 1 --2- 172.21.15.84:0/3578619120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce6513390 0x558ce68dbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.849+0000 7fa4c993d740 1 --2- 172.21.15.84:0/3578619120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 0x558ce68db7b0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.849+0000 7fa4c993d740 1 --2- 172.21.15.84:0/3578619120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ce6534070 0x558ce68db270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.849+0000 7fa4c993d740 1 -- 172.21.15.84:0/3578619120 >> 172.21.15.84:0/3578619120 conn(0x558ce6528460 msgr2=0x558ce68d9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:03.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.849+0000 7fa4c993d740 1 -- 172.21.15.84:0/3578619120 shutdown_connections 2024-09-21T03:45:03.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.850+0000 7fa4c993d740 1 -- 172.21.15.84:0/3578619120 wait complete. 2024-09-21T03:45:03.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.850+0000 7fa4c993d740 1 -- start start 2024-09-21T03:45:03.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.850+0000 7fa4c993d740 1 Processor -- start 2024-09-21T03:45:03.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.850+0000 7fa4c993d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 0x558ce68e6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:03.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.850+0000 7fa4c993d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ce6513390 0x558ce68e6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:03.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.850+0000 7fa4c993d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce6534070 0x558ce68f2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:03.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.850+0000 7fa4c993d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558ce66a2700 con 0x558ce650b1b0 2024-09-21T03:45:03.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.850+0000 7fa4c993d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558ce67dc110 con 0x558ce6534070 2024-09-21T03:45:03.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.850+0000 7fa4c993d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558ce68e9a50 con 0x558ce6513390 2024-09-21T03:45:03.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.851+0000 7fa4c993d740 10 client.0 _ll_register_callbacks cb 0x558ce67f5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:45:03.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.851+0000 7fa4c0964640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 0x558ce68e6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:03.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.851+0000 7fa4c0964640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 0x558ce68e6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54640/0 (socket says 172.21.15.84:54640) 2024-09-21T03:45:03.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.851+0000 7fa4c0964640 1 -- 172.21.15.84:0/3966029592 learned_addr learned my addr 172.21.15.84:0/3966029592 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:03.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.851+0000 7fa4c1165640 1 --2- 172.21.15.84:0/3966029592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ce6513390 0x558ce68e6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:03.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.851+0000 7fa4c0964640 1 --2- 172.21.15.84:0/3966029592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce6534070 0x558ce68f2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:03.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.851+0000 7fa4c0964640 1 -- 172.21.15.84:0/3966029592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ce6513390 msgr2=0x558ce68e6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:03.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.851+0000 7fa4c0964640 1 --2- 172.21.15.84:0/3966029592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ce6513390 0x558ce68e6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.851+0000 7fa4c0964640 1 -- 172.21.15.84:0/3966029592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce6534070 msgr2=0x558ce68f2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:03.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.851+0000 7fa4c0964640 1 --2- 172.21.15.84:0/3966029592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce6534070 0x558ce68f2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.851+0000 7fa4c0964640 1 -- 172.21.15.84:0/3966029592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ce6809c40 con 0x558ce650b1b0 2024-09-21T03:45:03.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.851+0000 7fa4c0964640 1 --2- 172.21.15.84:0/3966029592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 0x558ce68e6980 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009900 tx=0x7fa4b002a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dab88f03aaac23c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:03.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.851+0000 7fa4a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:45:03.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.851+0000 7fa4a4ff9640 1 -- 172.21.15.84:0/3966029592 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0035040 con 0x558ce650b1b0 2024-09-21T03:45:03.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.851+0000 7fa4a4ff9640 1 -- 172.21.15.84:0/3966029592 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa4b0004240 con 0x558ce650b1b0 2024-09-21T03:45:03.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.851+0000 7fa4c993d740 1 -- 172.21.15.84:0/3966029592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4b8010c80 con 0x558ce650b1b0 2024-09-21T03:45:03.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.852+0000 7fa4a4ff9640 1 -- 172.21.15.84:0/3966029592 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa4b0004440 con 0x558ce650b1b0 2024-09-21T03:45:03.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.852+0000 7fa4c993d740 10 client.16047 fetch_fsmap learned FSMap version 25 2024-09-21T03:45:03.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.852+0000 7fa4c993d740 1 -- 172.21.15.84:0/3966029592 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558ce68f57c0 con 0x558ce650b1b0 2024-09-21T03:45:03.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.852+0000 7fa4a4ff9640 1 -- 172.21.15.84:0/3966029592 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4b8010c80 con 0x558ce650b1b0 2024-09-21T03:45:03.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.852+0000 7fa4a4ff9640 1 -- 172.21.15.84:0/3966029592 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa4b003a070 con 0x558ce650b1b0 2024-09-21T03:45:03.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.852+0000 7fa4c993d740 10 client.16047 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:45:03.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.852+0000 7fa4c993d740 10 client.16047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:45:03.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.852+0000 7fa4c993d740 20 client.16047 populate_metadata read hostname 'smithi084' 2024-09-21T03:45:03.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.852+0000 7fa4c993d740 1 --2- 172.21.15.84:0/3966029592 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558ce64f29f0 0x558ce68f8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:03.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.852+0000 7fa4c993d740 4 client.16047 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:45:03.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.852+0000 7fa4c993d740 1 -- 172.21.15.84:0/3966029592 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ce6853da0 con 0x558ce64f29f0 2024-09-21T03:45:03.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.852+0000 7fa4c1165640 1 --2- 172.21.15.84:0/3966029592 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558ce64f29f0 0x558ce68f8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:03.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.853+0000 7fa4a4ff9640 10 client.16047 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:03.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.853+0000 7fa4c1165640 1 --2- 172.21.15.84:0/3966029592 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558ce64f29f0 0x558ce68f8c00 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5204e5b0b6f5113f server_cookie=8ff7fc9e03f63ee4 in_seq=0 out_seq=0 2024-09-21T03:45:03.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.853+0000 7fa4a4ff9640 1 -- 172.21.15.84:0/3966029592 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558ce6853da0 con 0x558ce64f29f0 2024-09-21T03:45:03.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.853+0000 7fa4a4ff9640 10 client.16047 handle_command_reply: tid=0 2024-09-21T03:45:03.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.853+0000 7fa4c993d740 1 client.16047 shutdown 2024-09-21T03:45:03.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.854+0000 7fa4c993d740 1 -- 172.21.15.84:0/3966029592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 msgr2=0x558ce68e6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.854+0000 7fa4c993d740 1 --2- 172.21.15.84:0/3966029592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 0x558ce68e6980 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009900 tx=0x7fa4b002a3f0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.854+0000 7fa4c993d740 1 -- 172.21.15.84:0/3966029592 shutdown_connections 2024-09-21T03:45:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.854+0000 7fa4c993d740 1 --2- 172.21.15.84:0/3966029592 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558ce64f29f0 0x558ce68f8c00 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.854+0000 7fa4c993d740 1 --2- 172.21.15.84:0/3966029592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce6534070 0x558ce68f2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.854+0000 7fa4a4ff9640 0 client.16047 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.854+0000 7fa4c993d740 1 --2- 172.21.15.84:0/3966029592 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ce6513390 0x558ce68e6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.854+0000 7fa4c993d740 1 --2- 172.21.15.84:0/3966029592 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 0x558ce68e6980 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.854+0000 7fa4c993d740 1 -- 172.21.15.84:0/3966029592 >> 172.21.15.84:0/3966029592 conn(0x558ce6528460 msgr2=0x558ce68de400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.854+0000 7fa4c993d740 1 -- 172.21.15.84:0/3966029592 shutdown_connections 2024-09-21T03:45:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.854+0000 7fa4c993d740 1 -- 172.21.15.84:0/3966029592 wait complete. 2024-09-21T03:45:03.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.854+0000 7fa4c993d740 20 client.16047 trim_cache size 0 max 16384 2024-09-21T03:45:03.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.871+0000 7fa4c993d740 1 Processor -- start 2024-09-21T03:45:03.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.871+0000 7fa4c993d740 1 -- start start 2024-09-21T03:45:03.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.871+0000 7fa4c993d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce650b1b0 0x558ce68e5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:03.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.871+0000 7fa4c993d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce6513390 0x558ce68dea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:03.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.871+0000 7fa4c993d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ce6534070 0x558ce68e3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:03.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.871+0000 7fa4c993d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc1b1e50 con 0x558ce6513390 2024-09-21T03:45:03.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.871+0000 7fa4c993d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc1af720 con 0x558ce650b1b0 2024-09-21T03:45:03.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.871+0000 7fa4c993d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc1ad570 con 0x558ce6534070 2024-09-21T03:45:03.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.871+0000 7fa4c1165640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce6513390 0x558ce68dea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:03.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.872+0000 7fa4c1165640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce6513390 0x558ce68dea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54648/0 (socket says 172.21.15.84:54648) 2024-09-21T03:45:03.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.872+0000 7fa4c1165640 1 -- 172.21.15.84:0/3211308337 learned_addr learned my addr 172.21.15.84:0/3211308337 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:03.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.872+0000 7fa4c0964640 1 --2- 172.21.15.84:0/3211308337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ce6534070 0x558ce68e3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:03.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.872+0000 7fa4c0964640 1 --2- 172.21.15.84:0/3211308337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce650b1b0 0x558ce68e5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:03.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.872+0000 7fa4c1165640 1 -- 172.21.15.84:0/3211308337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ce6534070 msgr2=0x558ce68e3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:03.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.872+0000 7fa4c1165640 1 --2- 172.21.15.84:0/3211308337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ce6534070 0x558ce68e3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.872+0000 7fa4c1165640 1 -- 172.21.15.84:0/3211308337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce650b1b0 msgr2=0x558ce68e5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:03.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.872+0000 7fa4c1165640 1 --2- 172.21.15.84:0/3211308337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce650b1b0 0x558ce68e5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.872+0000 7fa4c1165640 1 -- 172.21.15.84:0/3211308337 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ce68de0d0 con 0x558ce6513390 2024-09-21T03:45:03.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.872+0000 7fa4c0964640 1 --2- 172.21.15.84:0/3211308337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce650b1b0 0x558ce68e5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:45:03.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.872+0000 7fa4c1165640 1 --2- 172.21.15.84:0/3211308337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce6513390 0x558ce68dea80 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fa4b800f010 tx=0x7fa4b800c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b449bb13d80e15e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:03.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.872+0000 7fa4a6ffd640 1 -- 172.21.15.84:0/3211308337 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b80052b0 con 0x558ce6513390 2024-09-21T03:45:03.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.872+0000 7fa4a6ffd640 1 -- 172.21.15.84:0/3211308337 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4b8005450 con 0x558ce6513390 2024-09-21T03:45:03.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.872+0000 7fa4a6ffd640 1 -- 172.21.15.84:0/3211308337 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8003850 con 0x558ce6513390 2024-09-21T03:45:03.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.873+0000 7fa4c993d740 1 -- 172.21.15.84:0/3211308337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce6513390 msgr2=0x558ce68dea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:03.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.873+0000 7fa4c993d740 1 --2- 172.21.15.84:0/3211308337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce6513390 0x558ce68dea80 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fa4b800f010 tx=0x7fa4b800c4b0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.873+0000 7fa4c993d740 1 -- 172.21.15.84:0/3211308337 shutdown_connections 2024-09-21T03:45:03.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.873+0000 7fa4c993d740 1 --2- 172.21.15.84:0/3211308337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ce6534070 0x558ce68e3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.873+0000 7fa4c993d740 1 --2- 172.21.15.84:0/3211308337 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce6513390 0x558ce68dea80 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.873+0000 7fa4c993d740 1 --2- 172.21.15.84:0/3211308337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce650b1b0 0x558ce68e5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.873+0000 7fa4c993d740 1 -- 172.21.15.84:0/3211308337 >> 172.21.15.84:0/3211308337 conn(0x558ce6528460 msgr2=0x558ce68de370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.873+0000 7fa4c993d740 1 -- 172.21.15.84:0/3211308337 shutdown_connections 2024-09-21T03:45:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.873+0000 7fa4c993d740 1 -- 172.21.15.84:0/3211308337 wait complete. 2024-09-21T03:45:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.873+0000 7fa4c993d740 1 -- start start 2024-09-21T03:45:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.874+0000 7fa4c993d740 1 Processor -- start 2024-09-21T03:45:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.874+0000 7fa4c993d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 0x558ce68eb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.874+0000 7fa4c993d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce6513390 0x558ce68ebab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.874+0000 7fa4c993d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ce6534070 0x558ce695c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.874+0000 7fa4c993d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc1adbe0 con 0x558ce650b1b0 2024-09-21T03:45:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.874+0000 7fa4c993d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc1af050 con 0x558ce6513390 2024-09-21T03:45:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.874+0000 7fa4c993d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa4bc1ae2b0 con 0x558ce6534070 2024-09-21T03:45:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.874+0000 7fa4c993d740 10 client.0 _ll_register_callbacks cb 0x7fa4b0032f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:45:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.874+0000 7fa4c0964640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 0x558ce68eb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.874+0000 7fa4c0964640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 0x558ce68eb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54662/0 (socket says 172.21.15.84:54662) 2024-09-21T03:45:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.874+0000 7fa4c0964640 1 -- 172.21.15.84:0/670877146 learned_addr learned my addr 172.21.15.84:0/670877146 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:03.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.874+0000 7fa4c1165640 1 --2- 172.21.15.84:0/670877146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce6513390 0x558ce68ebab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:03.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.874+0000 7fa4c0964640 1 -- 172.21.15.84:0/670877146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ce6534070 msgr2=0x558ce695c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:03.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.874+0000 7fa4c0964640 1 --2- 172.21.15.84:0/670877146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ce6534070 0x558ce695c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.874+0000 7fa4c0964640 1 -- 172.21.15.84:0/670877146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce6513390 msgr2=0x558ce68ebab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:03.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.874+0000 7fa4c0964640 1 --2- 172.21.15.84:0/670877146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce6513390 0x558ce68ebab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.874+0000 7fa4c0964640 1 -- 172.21.15.84:0/670877146 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ce695cbd0 con 0x558ce650b1b0 2024-09-21T03:45:03.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.875+0000 7fa4c0964640 1 --2- 172.21.15.84:0/670877146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 0x558ce68eb510 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009900 tx=0x7fa4b0032780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375c755fd0cac9d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:03.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.875+0000 7fa4a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:45:03.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.875+0000 7fa4a4ff9640 1 -- 172.21.15.84:0/670877146 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b0035040 con 0x558ce650b1b0 2024-09-21T03:45:03.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.875+0000 7fa4c993d740 1 -- 172.21.15.84:0/670877146 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4b8005450 con 0x558ce650b1b0 2024-09-21T03:45:03.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.875+0000 7fa4a4ff9640 1 -- 172.21.15.84:0/670877146 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa4b004a830 con 0x558ce650b1b0 2024-09-21T03:45:03.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.875+0000 7fa4a4ff9640 1 -- 172.21.15.84:0/670877146 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa4b0032040 con 0x558ce650b1b0 2024-09-21T03:45:03.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.875+0000 7fa4c993d740 10 client.16053 fetch_fsmap learned FSMap version 25 2024-09-21T03:45:03.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.875+0000 7fa4c993d740 1 -- 172.21.15.84:0/670877146 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558ce6963e80 con 0x558ce650b1b0 2024-09-21T03:45:03.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.875+0000 7fa4a4ff9640 1 -- 172.21.15.84:0/670877146 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4b8005450 con 0x558ce650b1b0 2024-09-21T03:45:03.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.875+0000 7fa4a4ff9640 1 -- 172.21.15.84:0/670877146 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa4b003a070 con 0x558ce650b1b0 2024-09-21T03:45:03.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.875+0000 7fa4c993d740 10 client.16053 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:45:03.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.875+0000 7fa4c993d740 10 client.16053 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:45:03.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.875+0000 7fa4c993d740 20 client.16053 populate_metadata read hostname 'smithi084' 2024-09-21T03:45:03.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.875+0000 7fa4c993d740 1 --2- 172.21.15.84:0/670877146 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558ce64c7da0 0x558ce6966610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:03.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.875+0000 7fa4c993d740 4 client.16053 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:45:03.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.875+0000 7fa4c993d740 1 -- 172.21.15.84:0/670877146 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558ce68e2530 con 0x558ce64c7da0 2024-09-21T03:45:03.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.876+0000 7fa4c1165640 1 --2- 172.21.15.84:0/670877146 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558ce64c7da0 0x558ce6966610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:03.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.876+0000 7fa4c1165640 1 --2- 172.21.15.84:0/670877146 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558ce64c7da0 0x558ce6966610 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e295b8821cb59622 server_cookie=7b2cbb507eca1d5c in_seq=0 out_seq=0 2024-09-21T03:45:03.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.876+0000 7fa4a4ff9640 10 client.16053 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:03.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.876+0000 7fa4a4ff9640 1 -- 172.21.15.84:0/670877146 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x558ce68e2530 con 0x558ce64c7da0 2024-09-21T03:45:03.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.876+0000 7fa4a4ff9640 10 client.16053 handle_command_reply: tid=0 2024-09-21T03:45:03.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.876+0000 7fa4c993d740 1 client.16053 shutdown 2024-09-21T03:45:03.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.876+0000 7fa4c993d740 1 -- 172.21.15.84:0/670877146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 msgr2=0x558ce68eb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:03.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.876+0000 7fa4c993d740 1 --2- 172.21.15.84:0/670877146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 0x558ce68eb510 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0009900 tx=0x7fa4b0032780 comp rx=0 tx=0).stop 2024-09-21T03:45:03.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.877+0000 7fa4c993d740 1 -- 172.21.15.84:0/670877146 shutdown_connections 2024-09-21T03:45:03.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.877+0000 7fa4c993d740 1 --2- 172.21.15.84:0/670877146 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558ce64c7da0 0x558ce6966610 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.877+0000 7fa4c993d740 1 --2- 172.21.15.84:0/670877146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558ce6534070 0x558ce695c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.877+0000 7fa4c993d740 1 --2- 172.21.15.84:0/670877146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558ce6513390 0x558ce68ebab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.877+0000 7fa4c993d740 1 --2- 172.21.15.84:0/670877146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558ce650b1b0 0x558ce68eb510 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.877+0000 7fa4c993d740 1 -- 172.21.15.84:0/670877146 >> 172.21.15.84:0/670877146 conn(0x558ce6528460 msgr2=0x558ce68e7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:03.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.877+0000 7fa4a4ff9640 0 client.16053 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:03.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.877+0000 7fa4c993d740 1 -- 172.21.15.84:0/670877146 shutdown_connections 2024-09-21T03:45:03.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.877+0000 7fa4c993d740 1 -- 172.21.15.84:0/670877146 wait complete. 2024-09-21T03:45:03.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.877+0000 7fa4c993d740 20 client.16053 trim_cache size 0 max 16384 2024-09-21T03:45:03.884 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:45:03.884 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:45:03.884 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T03:45:03.884 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:45:03.884 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:03.885 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3", 2024-09-21T03:45:03.885 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T03:45:03.885 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:45:03.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:45:03.885 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:45:03.885 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:45:03.885 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:45:03.885 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:03.885 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:45:03.885 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:45:03.885 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:45:03.885 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:45:03.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:45:03.885 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:45:03.886 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:45:03.886 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:03.886 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:45:03.886 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:45:03.886 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:45:03.886 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:45:03.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:45:03.886 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:45:03.886 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:45:03.886 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:03.886 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:45:03.886 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:45:03.886 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:45:03.886 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:45:03.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:45:03.887 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:45:03.887 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:45:03.887 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:03.887 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:45:03.887 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:45:03.887 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:45:03.887 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:45:03.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:45:03.887 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:45:03.887 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:45:03.887 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:03.887 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:45:03.887 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:45:03.888 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:45:03.888 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:45:03.888 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:45:03.888 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:45:03.888 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:45:03.888 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:03.888 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:45:03.888 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:45:03.888 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:45:03.888 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:45:03.888 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:45:03.888 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:45:03.888 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:45:03.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.877+0000 7fa4c33c9640 1 -- 172.21.15.84:0/3043159813 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4a80b66b0 msgr2=0x7fa4a80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:03.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.877+0000 7fa4c33c9640 1 --2- 172.21.15.84:0/3043159813 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4a80b66b0 0x7fa4a80b8bc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40e5970 tx=0x7fa4b407a720 comp rx=0 tx=0).stop 2024-09-21T03:45:03.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.877+0000 7fa4c33c9640 1 -- 172.21.15.84:0/3043159813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4bc107620 msgr2=0x7fa4bc19be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:03.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.877+0000 7fa4c33c9640 1 --2- 172.21.15.84:0/3043159813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4bc107620 0x7fa4bc19be20 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa4b400cce0 tx=0x7fa4b400a620 comp rx=0 tx=0).stop 2024-09-21T03:45:03.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.877+0000 7fa4c33c9640 1 -- 172.21.15.84:0/3043159813 shutdown_connections 2024-09-21T03:45:03.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.877+0000 7fa4c33c9640 1 --2- 172.21.15.84:0/3043159813 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4a80b66b0 0x7fa4a80b8bc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.877+0000 7fa4c33c9640 1 --2- 172.21.15.84:0/3043159813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa4bc107620 0x7fa4bc19be20 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.877+0000 7fa4c33c9640 1 --2- 172.21.15.84:0/3043159813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4bc1038e0 0x7fa4bc19b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.877+0000 7fa4c33c9640 1 --2- 172.21.15.84:0/3043159813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4bc102f90 0x7fa4bc19b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:03.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.877+0000 7fa4c33c9640 1 -- 172.21.15.84:0/3043159813 >> 172.21.15.84:0/3043159813 conn(0x7fa4bc079e30 msgr2=0x7fa4bc104310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:03.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.878+0000 7fa4c33c9640 1 -- 172.21.15.84:0/3043159813 shutdown_connections 2024-09-21T03:45:03.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:03.878+0000 7fa4c33c9640 1 -- 172.21.15.84:0/3043159813 wait complete. 2024-09-21T03:45:03.890 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:03 smithi174 ceph-mon[34403]: pgmap v401: 97 pgs: 97 active+clean; 2.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-21T03:45:03.890 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:03 smithi174 ceph-mon[34403]: scrub queued for path: / 2024-09-21T03:45:03.890 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:03 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:45:03.890 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:03 smithi174 ceph-mon[34403]: scrub summary: active paths [/] 2024-09-21T03:45:03.890 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:03 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:45:03.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:03 smithi172 ceph-mon[34821]: pgmap v401: 97 pgs: 97 active+clean; 2.9 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-21T03:45:03.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:03 smithi172 ceph-mon[34821]: scrub queued for path: / 2024-09-21T03:45:03.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:03 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:45:03.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:03 smithi172 ceph-mon[34821]: scrub summary: active paths [/] 2024-09-21T03:45:03.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:03 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:45:04.810 INFO:tasks.cephfs.filesystem:scrub status for tag:da2f3db0-feaa-467d-a9dc-66ee7b9e5de3 - {'path': '/', 'tag': 'da2f3db0-feaa-467d-a9dc-66ee7b9e5de3', 'options': 'recursive,force'} 2024-09-21T03:45:05.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:05 smithi084 ceph-mon[30941]: pgmap v402: 97 pgs: 97 active+clean; 3.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 51 KiB/s wr, 28 op/s 2024-09-21T03:45:05.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:05 smithi084 ceph-mon[30941]: scrub summary: idle 2024-09-21T03:45:05.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:05 smithi174 ceph-mon[34403]: pgmap v402: 97 pgs: 97 active+clean; 3.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 51 KiB/s wr, 28 op/s 2024-09-21T03:45:05.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:05 smithi174 ceph-mon[34403]: scrub summary: idle 2024-09-21T03:45:05.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:05 smithi172 ceph-mon[34821]: pgmap v402: 97 pgs: 97 active+clean; 3.0 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 51 KiB/s wr, 28 op/s 2024-09-21T03:45:05.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:05 smithi172 ceph-mon[34821]: scrub summary: idle 2024-09-21T03:45:07.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:07 smithi084 ceph-mon[30941]: pgmap v403: 97 pgs: 97 active+clean; 3.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 43 KiB/s wr, 24 op/s 2024-09-21T03:45:07.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:07 smithi174 ceph-mon[34403]: pgmap v403: 97 pgs: 97 active+clean; 3.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 43 KiB/s wr, 24 op/s 2024-09-21T03:45:07.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:07 smithi172 ceph-mon[34821]: pgmap v403: 97 pgs: 97 active+clean; 3.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 43 KiB/s wr, 24 op/s 2024-09-21T03:45:09.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:09 smithi084 ceph-mon[30941]: pgmap v404: 97 pgs: 97 active+clean; 3.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 43 KiB/s wr, 26 op/s 2024-09-21T03:45:09.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:09 smithi174 ceph-mon[34403]: pgmap v404: 97 pgs: 97 active+clean; 3.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 43 KiB/s wr, 26 op/s 2024-09-21T03:45:09.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:09 smithi172 ceph-mon[34821]: pgmap v404: 97 pgs: 97 active+clean; 3.0 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 43 KiB/s wr, 26 op/s 2024-09-21T03:45:11.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:11 smithi084 ceph-mon[30941]: pgmap v405: 97 pgs: 97 active+clean; 3.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 54 KiB/s wr, 28 op/s 2024-09-21T03:45:11.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:11 smithi174 ceph-mon[34403]: pgmap v405: 97 pgs: 97 active+clean; 3.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 54 KiB/s wr, 28 op/s 2024-09-21T03:45:11.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:11 smithi172 ceph-mon[34821]: pgmap v405: 97 pgs: 97 active+clean; 3.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 54 KiB/s wr, 28 op/s 2024-09-21T03:45:13.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:13 smithi084 ceph-mon[30941]: pgmap v406: 97 pgs: 97 active+clean; 3.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T03:45:13.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:13 smithi174 ceph-mon[34403]: pgmap v406: 97 pgs: 97 active+clean; 3.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T03:45:13.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:13 smithi172 ceph-mon[34821]: pgmap v406: 97 pgs: 97 active+clean; 3.1 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T03:45:15.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:15 smithi084 ceph-mon[30941]: pgmap v407: 97 pgs: 97 active+clean; 3.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T03:45:15.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:15 smithi174 ceph-mon[34403]: pgmap v407: 97 pgs: 97 active+clean; 3.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T03:45:15.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:15 smithi172 ceph-mon[34821]: pgmap v407: 97 pgs: 97 active+clean; 3.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-09-21T03:45:16.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:16 smithi084 ceph-mon[30941]: pgmap v408: 97 pgs: 97 active+clean; 3.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-09-21T03:45:16.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:16 smithi174 ceph-mon[34403]: pgmap v408: 97 pgs: 97 active+clean; 3.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-09-21T03:45:16.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:16 smithi172 ceph-mon[34821]: pgmap v408: 97 pgs: 97 active+clean; 3.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-09-21T03:45:19.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:19 smithi084 ceph-mon[30941]: pgmap v409: 97 pgs: 97 active+clean; 3.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-09-21T03:45:19.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:19 smithi174 ceph-mon[34403]: pgmap v409: 97 pgs: 97 active+clean; 3.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-09-21T03:45:19.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:19 smithi172 ceph-mon[34821]: pgmap v409: 97 pgs: 97 active+clean; 3.2 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-09-21T03:45:21.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:21 smithi084 ceph-mon[30941]: pgmap v410: 97 pgs: 97 active+clean; 3.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-21T03:45:21.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:21 smithi174 ceph-mon[34403]: pgmap v410: 97 pgs: 97 active+clean; 3.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-21T03:45:21.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:21 smithi172 ceph-mon[34821]: pgmap v410: 97 pgs: 97 active+clean; 3.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-21T03:45:23.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:23 smithi084 ceph-mon[30941]: pgmap v411: 97 pgs: 97 active+clean; 3.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T03:45:23.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:23 smithi174 ceph-mon[34403]: pgmap v411: 97 pgs: 97 active+clean; 3.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T03:45:23.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:23 smithi172 ceph-mon[34821]: pgmap v411: 97 pgs: 97 active+clean; 3.4 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T03:45:25.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:25 smithi084 ceph-mon[30941]: pgmap v412: 97 pgs: 97 active+clean; 3.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-09-21T03:45:25.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:25 smithi174 ceph-mon[34403]: pgmap v412: 97 pgs: 97 active+clean; 3.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-09-21T03:45:25.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:25 smithi172 ceph-mon[34821]: pgmap v412: 97 pgs: 97 active+clean; 3.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-09-21T03:45:27.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:27 smithi084 ceph-mon[30941]: pgmap v413: 97 pgs: 97 active+clean; 3.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-09-21T03:45:27.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:27 smithi174 ceph-mon[34403]: pgmap v413: 97 pgs: 97 active+clean; 3.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-09-21T03:45:27.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:27 smithi172 ceph-mon[34821]: pgmap v413: 97 pgs: 97 active+clean; 3.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-09-21T03:45:29.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:29 smithi084 ceph-mon[30941]: pgmap v414: 97 pgs: 97 active+clean; 3.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T03:45:29.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:29 smithi174 ceph-mon[34403]: pgmap v414: 97 pgs: 97 active+clean; 3.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T03:45:29.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:29 smithi172 ceph-mon[34821]: pgmap v414: 97 pgs: 97 active+clean; 3.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T03:45:31.703 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:31 smithi172 ceph-mon[34821]: pgmap v415: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-21T03:45:31.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:31 smithi084 ceph-mon[30941]: pgmap v415: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-21T03:45:31.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:31 smithi174 ceph-mon[34403]: pgmap v415: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-21T03:45:33.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:33 smithi084 ceph-mon[30941]: pgmap v416: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-09-21T03:45:33.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:33 smithi174 ceph-mon[34403]: pgmap v416: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-09-21T03:45:33.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:33 smithi172 ceph-mon[34821]: pgmap v416: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-09-21T03:45:34.812 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:45:35.074 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:45:35.489 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:35 smithi084 ceph-mon[30941]: pgmap v417: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-09-21T03:45:35.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.583+0000 7fb2188a3640 1 -- 172.21.15.84:0/2100695863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2141094d0 msgr2=0x7fb2141098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:35.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.583+0000 7fb2188a3640 1 --2- 172.21.15.84:0/2100695863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2141094d0 0x7fb2141098e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc009900 tx=0x7fb1fc02a410 comp rx=0 tx=0).stop 2024-09-21T03:45:35.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.583+0000 7fb2188a3640 1 -- 172.21.15.84:0/2100695863 shutdown_connections 2024-09-21T03:45:35.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.583+0000 7fb2188a3640 1 --2- 172.21.15.84:0/2100695863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb214109e20 0x7fb214110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.583+0000 7fb2188a3640 1 --2- 172.21.15.84:0/2100695863 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb2141094d0 0x7fb2141098e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.583+0000 7fb2188a3640 1 --2- 172.21.15.84:0/2100695863 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb214103b90 0x7fb214103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.583+0000 7fb2188a3640 1 -- 172.21.15.84:0/2100695863 >> 172.21.15.84:0/2100695863 conn(0x7fb2140ff600 msgr2=0x7fb214101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:35.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.583+0000 7fb2188a3640 1 -- 172.21.15.84:0/2100695863 shutdown_connections 2024-09-21T03:45:35.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.583+0000 7fb2188a3640 1 -- 172.21.15.84:0/2100695863 wait complete. 2024-09-21T03:45:35.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.584+0000 7fb2188a3640 1 Processor -- start 2024-09-21T03:45:35.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.584+0000 7fb2188a3640 1 -- start start 2024-09-21T03:45:35.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.584+0000 7fb2188a3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb214103b90 0x7fb21419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:35.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.584+0000 7fb2188a3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2141094d0 0x7fb21419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:35.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.585+0000 7fb2188a3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb214109e20 0x7fb21419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:35.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.585+0000 7fb2188a3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb214113ae0 con 0x7fb214109e20 2024-09-21T03:45:35.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.585+0000 7fb2188a3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb214113960 con 0x7fb214103b90 2024-09-21T03:45:35.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.585+0000 7fb2188a3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb214113c60 con 0x7fb2141094d0 2024-09-21T03:45:35.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.585+0000 7fb212d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb214109e20 0x7fb21419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:35.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.585+0000 7fb212d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb214109e20 0x7fb21419fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57764/0 (socket says 172.21.15.84:57764) 2024-09-21T03:45:35.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.585+0000 7fb212d9d640 1 -- 172.21.15.84:0/3999165281 learned_addr learned my addr 172.21.15.84:0/3999165281 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:35.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.585+0000 7fb211d9b640 1 --2- 172.21.15.84:0/3999165281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2141094d0 0x7fb21419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:35.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.585+0000 7fb21259c640 1 --2- 172.21.15.84:0/3999165281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb214103b90 0x7fb21419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:35.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.585+0000 7fb212d9d640 1 -- 172.21.15.84:0/3999165281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2141094d0 msgr2=0x7fb21419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:35.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.585+0000 7fb212d9d640 1 --2- 172.21.15.84:0/3999165281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2141094d0 0x7fb21419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.585+0000 7fb212d9d640 1 -- 172.21.15.84:0/3999165281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb214103b90 msgr2=0x7fb21419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:35.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.585+0000 7fb212d9d640 1 --2- 172.21.15.84:0/3999165281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb214103b90 0x7fb21419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.585+0000 7fb212d9d640 1 -- 172.21.15.84:0/3999165281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2141a0400 con 0x7fb214109e20 2024-09-21T03:45:35.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.585+0000 7fb212d9d640 1 --2- 172.21.15.84:0/3999165281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb214109e20 0x7fb21419fcd0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00eaa0 tx=0x7fb20c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:35.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.585+0000 7fb20b7fe640 1 -- 172.21.15.84:0/3999165281 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c00cdb0 con 0x7fb214109e20 2024-09-21T03:45:35.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.585+0000 7fb2188a3640 1 -- 172.21.15.84:0/3999165281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2141a06f0 con 0x7fb214109e20 2024-09-21T03:45:35.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.585+0000 7fb20b7fe640 1 -- 172.21.15.84:0/3999165281 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb20c005020 con 0x7fb214109e20 2024-09-21T03:45:35.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.585+0000 7fb20b7fe640 1 -- 172.21.15.84:0/3999165281 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c0116d0 con 0x7fb214109e20 2024-09-21T03:45:35.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.586+0000 7fb2188a3640 1 -- 172.21.15.84:0/3999165281 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2141a6e50 con 0x7fb214109e20 2024-09-21T03:45:35.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.588+0000 7fb20b7fe640 1 -- 172.21.15.84:0/3999165281 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fb20c0051d0 con 0x7fb214109e20 2024-09-21T03:45:35.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.588+0000 7fb21ee17740 1 Processor -- start 2024-09-21T03:45:35.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.589+0000 7fb21ee17740 1 -- start start 2024-09-21T03:45:35.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.589+0000 7fb21ee17740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757e0e070 0x55c7581b5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:35.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.589+0000 7fb21ee17740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757de51b0 0x55c7581b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:35.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.589+0000 7fb21ee17740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757ded390 0x55c7581b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:35.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.589+0000 7fb21ee17740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c75812be50 con 0x55c757e0e070 2024-09-21T03:45:35.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.589+0000 7fb21ee17740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c75811b280 con 0x55c757ded390 2024-09-21T03:45:35.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.589+0000 7fb21ee17740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c75811f090 con 0x55c757de51b0 2024-09-21T03:45:35.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.589+0000 7fb211d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757e0e070 0x55c7581b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:35.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.589+0000 7fb211d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757e0e070 0x55c7581b5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57776/0 (socket says 172.21.15.84:57776) 2024-09-21T03:45:35.609 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.589+0000 7fb211d9b640 1 -- 172.21.15.84:0/1667087279 learned_addr learned my addr 172.21.15.84:0/1667087279 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:35.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.589+0000 7fb20b7fe640 1 --2- 172.21.15.84:0/3999165281 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2000b6680 0x7fb2000b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:35.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.589+0000 7fb211d9b640 1 --2- 172.21.15.84:0/1667087279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757ded390 0x55c7581b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:35.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.589+0000 7fb212d9d640 1 --2- 172.21.15.84:0/3999165281 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2000b6680 0x7fb2000b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:35.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.589+0000 7fb21259c640 1 --2- 172.21.15.84:0/1667087279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757de51b0 0x55c7581b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:35.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.589+0000 7fb211d9b640 1 -- 172.21.15.84:0/1667087279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757de51b0 msgr2=0x55c7581b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:35.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.590+0000 7fb211d9b640 1 --2- 172.21.15.84:0/1667087279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757de51b0 0x55c7581b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.590+0000 7fb211d9b640 1 -- 172.21.15.84:0/1667087279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757ded390 msgr2=0x55c7581b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:35.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.590+0000 7fb211d9b640 1 --2- 172.21.15.84:0/1667087279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757ded390 0x55c7581b60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.590+0000 7fb211d9b640 1 -- 172.21.15.84:0/1667087279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c757e79650 con 0x55c757e0e070 2024-09-21T03:45:35.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.590+0000 7fb20b7fe640 1 -- 172.21.15.84:0/3999165281 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fb20c0e79a0 con 0x7fb214109e20 2024-09-21T03:45:35.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.590+0000 7fb211d9b640 1 --2- 172.21.15.84:0/1667087279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757e0e070 0x55c7581b5650 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc005940 tx=0x7fb1fc0058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560cd34d6fd71bc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:35.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.590+0000 7fb212d9d640 1 --2- 172.21.15.84:0/3999165281 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2000b6680 0x7fb2000b8b90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0ad7a0 tx=0x7fb20c005890 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:35.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.590+0000 7fb208ff9640 1 -- 172.21.15.84:0/1667087279 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc035070 con 0x55c757e0e070 2024-09-21T03:45:35.610 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.590+0000 7fb208ff9640 1 -- 172.21.15.84:0/1667087279 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1fc005dd0 con 0x55c757e0e070 2024-09-21T03:45:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.590+0000 7fb208ff9640 1 -- 172.21.15.84:0/1667087279 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc003e00 con 0x55c757e0e070 2024-09-21T03:45:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.591+0000 7fb21ee17740 1 -- 172.21.15.84:0/1667087279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757e0e070 msgr2=0x55c7581b5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.591+0000 7fb21ee17740 1 --2- 172.21.15.84:0/1667087279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757e0e070 0x55c7581b5650 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc005940 tx=0x7fb1fc0058b0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.591+0000 7fb21ee17740 1 -- 172.21.15.84:0/1667087279 shutdown_connections 2024-09-21T03:45:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.591+0000 7fb21ee17740 1 --2- 172.21.15.84:0/1667087279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757ded390 0x55c7581b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.591+0000 7fb21ee17740 1 --2- 172.21.15.84:0/1667087279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757de51b0 0x55c7581b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.591+0000 7fb21ee17740 1 --2- 172.21.15.84:0/1667087279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757e0e070 0x55c7581b5650 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.591+0000 7fb21ee17740 1 -- 172.21.15.84:0/1667087279 >> 172.21.15.84:0/1667087279 conn(0x55c757e02460 msgr2=0x55c7581b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.591+0000 7fb21ee17740 1 -- 172.21.15.84:0/1667087279 shutdown_connections 2024-09-21T03:45:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.591+0000 7fb21ee17740 1 -- 172.21.15.84:0/1667087279 wait complete. 2024-09-21T03:45:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.591+0000 7fb21ee17740 1 -- start start 2024-09-21T03:45:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.592+0000 7fb21ee17740 1 Processor -- start 2024-09-21T03:45:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.592+0000 7fb21ee17740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757de51b0 0x55c7581c50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.592+0000 7fb21ee17740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757ded390 0x55c7581c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.592+0000 7fb21ee17740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757e0e070 0x55c7581c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:35.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.592+0000 7fb21ee17740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c757f7c700 con 0x55c757e0e070 2024-09-21T03:45:35.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.592+0000 7fb21ee17740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c7580b6110 con 0x55c757ded390 2024-09-21T03:45:35.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.592+0000 7fb21ee17740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c7581c8130 con 0x55c757de51b0 2024-09-21T03:45:35.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.592+0000 7fb21ee17740 10 client.0 _ll_register_callbacks cb 0x55c7580cf990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:45:35.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.592+0000 7fb211d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757e0e070 0x55c7581c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:35.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.592+0000 7fb211d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757e0e070 0x55c7581c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57782/0 (socket says 172.21.15.84:57782) 2024-09-21T03:45:35.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.592+0000 7fb211d9b640 1 -- 172.21.15.84:0/3764897597 learned_addr learned my addr 172.21.15.84:0/3764897597 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:35.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.592+0000 7fb21259c640 1 --2- 172.21.15.84:0/3764897597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757ded390 0x55c7581c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:35.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.592+0000 7fb211d9b640 1 --2- 172.21.15.84:0/3764897597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757de51b0 0x55c7581c50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:35.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.592+0000 7fb211d9b640 1 -- 172.21.15.84:0/3764897597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757de51b0 msgr2=0x55c7581c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:35.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.592+0000 7fb211d9b640 1 --2- 172.21.15.84:0/3764897597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757de51b0 0x55c7581c50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.592+0000 7fb211d9b640 1 -- 172.21.15.84:0/3764897597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757ded390 msgr2=0x55c7581c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:35.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.592+0000 7fb211d9b640 1 --2- 172.21.15.84:0/3764897597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757ded390 0x55c7581c55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.612 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.592+0000 7fb211d9b640 1 -- 172.21.15.84:0/3764897597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7580e3c40 con 0x55c757e0e070 2024-09-21T03:45:35.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.593+0000 7fb211d9b640 1 --2- 172.21.15.84:0/3764897597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757e0e070 0x55c7581c5b50 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x55c7581ae3a0 tx=0x7fb1fc0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eab32fef897a902 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:35.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.593+0000 7fb1f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:45:35.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.593+0000 7fb1f9ffb640 1 -- 172.21.15.84:0/3764897597 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc035040 con 0x55c757e0e070 2024-09-21T03:45:35.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.593+0000 7fb21ee17740 1 -- 172.21.15.84:0/3764897597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1fc005dd0 con 0x55c757e0e070 2024-09-21T03:45:35.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.593+0000 7fb1f9ffb640 1 -- 172.21.15.84:0/3764897597 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fb1fc004230 con 0x55c757e0e070 2024-09-21T03:45:35.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.593+0000 7fb1f9ffb640 1 -- 172.21.15.84:0/3764897597 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb1fc003e50 con 0x55c757e0e070 2024-09-21T03:45:35.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.593+0000 7fb21ee17740 10 client.16065 fetch_fsmap learned FSMap version 25 2024-09-21T03:45:35.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.593+0000 7fb21ee17740 1 -- 172.21.15.84:0/3764897597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c7581d3e50 con 0x55c757e0e070 2024-09-21T03:45:35.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.593+0000 7fb1f9ffb640 1 -- 172.21.15.84:0/3764897597 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1fc005dd0 con 0x55c757e0e070 2024-09-21T03:45:35.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.593+0000 7fb1f9ffb640 1 -- 172.21.15.84:0/3764897597 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb1fc049040 con 0x55c757e0e070 2024-09-21T03:45:35.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.593+0000 7fb21ee17740 10 client.16065 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:45:35.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.593+0000 7fb21ee17740 10 client.16065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:45:35.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.593+0000 7fb21ee17740 20 client.16065 populate_metadata read hostname 'smithi084' 2024-09-21T03:45:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.593+0000 7fb21ee17740 1 --2- 172.21.15.84:0/3764897597 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c757dcc9f0 0x55c7581d71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.593+0000 7fb21ee17740 4 client.16065 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:45:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.593+0000 7fb21ee17740 1 -- 172.21.15.84:0/3764897597 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c75812dda0 con 0x55c757dcc9f0 2024-09-21T03:45:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.594+0000 7fb21259c640 1 --2- 172.21.15.84:0/3764897597 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c757dcc9f0 0x55c7581d71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.594+0000 7fb1f9ffb640 10 client.16065 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.594+0000 7fb21259c640 1 --2- 172.21.15.84:0/3764897597 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c757dcc9f0 0x55c7581d71b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ece9a84a0cc630 server_cookie=dc2dda1b9be0d26f in_seq=0 out_seq=0 2024-09-21T03:45:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.595+0000 7fb1f9ffb640 1 -- 172.21.15.84:0/3764897597 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c75812dda0 con 0x55c757dcc9f0 2024-09-21T03:45:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.595+0000 7fb1f9ffb640 10 client.16065 handle_command_reply: tid=0 2024-09-21T03:45:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.595+0000 7fb21ee17740 1 client.16065 shutdown 2024-09-21T03:45:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.595+0000 7fb21ee17740 1 -- 172.21.15.84:0/3764897597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757e0e070 msgr2=0x55c7581c5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.595+0000 7fb21ee17740 1 --2- 172.21.15.84:0/3764897597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757e0e070 0x55c7581c5b50 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x55c7581ae3a0 tx=0x7fb1fc0056d0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.595+0000 7fb21ee17740 1 -- 172.21.15.84:0/3764897597 shutdown_connections 2024-09-21T03:45:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.595+0000 7fb21ee17740 1 --2- 172.21.15.84:0/3764897597 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c757dcc9f0 0x55c7581d71b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.595+0000 7fb21ee17740 1 --2- 172.21.15.84:0/3764897597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757e0e070 0x55c7581c5b50 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.595+0000 7fb21ee17740 1 --2- 172.21.15.84:0/3764897597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757ded390 0x55c7581c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.595+0000 7fb21ee17740 1 --2- 172.21.15.84:0/3764897597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757de51b0 0x55c7581c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.595+0000 7fb1f9ffb640 0 client.16065 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:35.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.595+0000 7fb21ee17740 1 -- 172.21.15.84:0/3764897597 >> 172.21.15.84:0/3764897597 conn(0x55c757e02460 msgr2=0x55c7581b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:35.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.595+0000 7fb21ee17740 1 -- 172.21.15.84:0/3764897597 shutdown_connections 2024-09-21T03:45:35.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.595+0000 7fb21ee17740 1 -- 172.21.15.84:0/3764897597 wait complete. 2024-09-21T03:45:35.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.595+0000 7fb21ee17740 20 client.16065 trim_cache size 0 max 16384 2024-09-21T03:45:35.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.627+0000 7fb21ee17740 1 Processor -- start 2024-09-21T03:45:35.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.627+0000 7fb21ee17740 1 -- start start 2024-09-21T03:45:35.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.628+0000 7fb21ee17740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757de51b0 0x55c7581b7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:35.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.628+0000 7fb21ee17740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757ded390 0x55c7581c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:35.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.628+0000 7fb21ee17740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757e0e070 0x55c7581baf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:35.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.628+0000 7fb21ee17740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141afb60 con 0x55c757de51b0 2024-09-21T03:45:35.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.628+0000 7fb21ee17740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141ad430 con 0x55c757ded390 2024-09-21T03:45:35.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.628+0000 7fb21ee17740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141ab280 con 0x55c757e0e070 2024-09-21T03:45:35.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.628+0000 7fb211d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757de51b0 0x55c7581b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:35.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.628+0000 7fb211d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757de51b0 0x55c7581b7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57786/0 (socket says 172.21.15.84:57786) 2024-09-21T03:45:35.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.628+0000 7fb211d9b640 1 -- 172.21.15.84:0/3925320781 learned_addr learned my addr 172.21.15.84:0/3925320781 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:35.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.628+0000 7fb21259c640 1 --2- 172.21.15.84:0/3925320781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757ded390 0x55c7581c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:35.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.628+0000 7fb211d9b640 1 --2- 172.21.15.84:0/3925320781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757e0e070 0x55c7581baf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:35.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.628+0000 7fb211d9b640 1 -- 172.21.15.84:0/3925320781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757e0e070 msgr2=0x55c7581baf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:35.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.628+0000 7fb211d9b640 1 --2- 172.21.15.84:0/3925320781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757e0e070 0x55c7581baf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.628+0000 7fb211d9b640 1 -- 172.21.15.84:0/3925320781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757ded390 msgr2=0x55c7581c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:35.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.628+0000 7fb211d9b640 1 --2- 172.21.15.84:0/3925320781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757ded390 0x55c7581c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.628+0000 7fb211d9b640 1 -- 172.21.15.84:0/3925320781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c757dccc20 con 0x55c757de51b0 2024-09-21T03:45:35.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.628+0000 7fb21259c640 1 --2- 172.21.15.84:0/3925320781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757ded390 0x55c7581c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:45:35.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.629+0000 7fb211d9b640 1 --2- 172.21.15.84:0/3925320781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757de51b0 0x55c7581b7150 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0057c0 tx=0x7fb1fc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d69b23e6ec3b0265 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:35.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.629+0000 7fb1fbfff640 1 -- 172.21.15.84:0/3925320781 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc005dd0 con 0x55c757de51b0 2024-09-21T03:45:35.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.629+0000 7fb1fbfff640 1 -- 172.21.15.84:0/3925320781 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1fc05b030 con 0x55c757de51b0 2024-09-21T03:45:35.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.629+0000 7fb1fbfff640 1 -- 172.21.15.84:0/3925320781 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc04bb70 con 0x55c757de51b0 2024-09-21T03:45:35.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.630+0000 7fb21ee17740 1 -- 172.21.15.84:0/3925320781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757de51b0 msgr2=0x55c7581b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:35.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.630+0000 7fb21ee17740 1 --2- 172.21.15.84:0/3925320781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757de51b0 0x55c7581b7150 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0057c0 tx=0x7fb1fc02a410 comp rx=0 tx=0).stop 2024-09-21T03:45:35.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.630+0000 7fb21ee17740 1 -- 172.21.15.84:0/3925320781 shutdown_connections 2024-09-21T03:45:35.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.630+0000 7fb21ee17740 1 --2- 172.21.15.84:0/3925320781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757e0e070 0x55c7581baf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.630+0000 7fb21ee17740 1 --2- 172.21.15.84:0/3925320781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757ded390 0x55c7581c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.630+0000 7fb21ee17740 1 --2- 172.21.15.84:0/3925320781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757de51b0 0x55c7581b7150 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.630+0000 7fb21ee17740 1 -- 172.21.15.84:0/3925320781 >> 172.21.15.84:0/3925320781 conn(0x55c757e02460 msgr2=0x55c7581ba7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:35.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.630+0000 7fb21ee17740 1 -- 172.21.15.84:0/3925320781 shutdown_connections 2024-09-21T03:45:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.630+0000 7fb21ee17740 1 -- 172.21.15.84:0/3925320781 wait complete. 2024-09-21T03:45:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.630+0000 7fb21ee17740 1 -- start start 2024-09-21T03:45:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.630+0000 7fb21ee17740 1 Processor -- start 2024-09-21T03:45:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.631+0000 7fb21ee17740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757de51b0 0x55c7581da950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.631+0000 7fb21ee17740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757ded390 0x55c7581d7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.631+0000 7fb21ee17740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757e0e070 0x55c7581d83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.631+0000 7fb21ee17740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141ab8f0 con 0x55c757de51b0 2024-09-21T03:45:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.631+0000 7fb21ee17740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141acd60 con 0x55c757e0e070 2024-09-21T03:45:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.631+0000 7fb21ee17740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb2141abfc0 con 0x55c757ded390 2024-09-21T03:45:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.631+0000 7fb21ee17740 10 client.0 _ll_register_callbacks cb 0x7fb1fc032d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:45:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.631+0000 7fb211d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757de51b0 0x55c7581da950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.631+0000 7fb211d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757de51b0 0x55c7581da950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57800/0 (socket says 172.21.15.84:57800) 2024-09-21T03:45:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.631+0000 7fb211d9b640 1 -- 172.21.15.84:0/4276084869 learned_addr learned my addr 172.21.15.84:0/4276084869 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:35.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.631+0000 7fb211d9b640 1 --2- 172.21.15.84:0/4276084869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757e0e070 0x55c7581d83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:35.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.631+0000 7fb21259c640 1 --2- 172.21.15.84:0/4276084869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757ded390 0x55c7581d7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:35.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.631+0000 7fb211d9b640 1 -- 172.21.15.84:0/4276084869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757ded390 msgr2=0x55c7581d7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:35.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.631+0000 7fb211d9b640 1 --2- 172.21.15.84:0/4276084869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757ded390 0x55c7581d7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.631+0000 7fb211d9b640 1 -- 172.21.15.84:0/4276084869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757e0e070 msgr2=0x55c7581d83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:35.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.631+0000 7fb211d9b640 1 --2- 172.21.15.84:0/4276084869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757e0e070 0x55c7581d83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.631+0000 7fb211d9b640 1 -- 172.21.15.84:0/4276084869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7581d8ac0 con 0x55c757de51b0 2024-09-21T03:45:35.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.631+0000 7fb21259c640 1 --2- 172.21.15.84:0/4276084869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757ded390 0x55c7581d7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:45:35.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.631+0000 7fb211d9b640 1 --2- 172.21.15.84:0/4276084869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757de51b0 0x55c7581da950 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0039d0 tx=0x7fb1fc003a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c50764c5bcdc37f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:35.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.631+0000 7fb1f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:45:35.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.632+0000 7fb1f9ffb640 1 -- 172.21.15.84:0/4276084869 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc004050 con 0x55c757de51b0 2024-09-21T03:45:35.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.632+0000 7fb1f9ffb640 1 -- 172.21.15.84:0/4276084869 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fb1fc0041f0 con 0x55c757de51b0 2024-09-21T03:45:35.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.632+0000 7fb21ee17740 1 -- 172.21.15.84:0/4276084869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1fc05b030 con 0x55c757de51b0 2024-09-21T03:45:35.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.632+0000 7fb1f9ffb640 1 -- 172.21.15.84:0/4276084869 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb1fc009520 con 0x55c757de51b0 2024-09-21T03:45:35.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.632+0000 7fb21ee17740 10 client.16071 fetch_fsmap learned FSMap version 25 2024-09-21T03:45:35.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.632+0000 7fb21ee17740 1 -- 172.21.15.84:0/4276084869 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c758241800 con 0x55c757de51b0 2024-09-21T03:45:35.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.632+0000 7fb1f9ffb640 1 -- 172.21.15.84:0/4276084869 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1fc05b030 con 0x55c757de51b0 2024-09-21T03:45:35.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.632+0000 7fb1f9ffb640 1 -- 172.21.15.84:0/4276084869 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb1fc049070 con 0x55c757de51b0 2024-09-21T03:45:35.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.632+0000 7fb21ee17740 10 client.16071 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:45:35.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.632+0000 7fb21ee17740 10 client.16071 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:45:35.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.632+0000 7fb21ee17740 20 client.16071 populate_metadata read hostname 'smithi084' 2024-09-21T03:45:35.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.632+0000 7fb21ee17740 1 --2- 172.21.15.84:0/4276084869 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c757da1da0 0x55c758243db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:35.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.632+0000 7fb21ee17740 4 client.16071 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:45:35.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.632+0000 7fb21ee17740 1 -- 172.21.15.84:0/4276084869 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c758129850 con 0x55c757da1da0 2024-09-21T03:45:35.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.633+0000 7fb21259c640 1 --2- 172.21.15.84:0/4276084869 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c757da1da0 0x55c758243db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:35.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.633+0000 7fb1f9ffb640 10 client.16071 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:35.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.633+0000 7fb21259c640 1 --2- 172.21.15.84:0/4276084869 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c757da1da0 0x55c758243db0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47b7385ffcd0bbe9 server_cookie=e561686ca69b7249 in_seq=0 out_seq=0 2024-09-21T03:45:35.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.633+0000 7fb1f9ffb640 1 -- 172.21.15.84:0/4276084869 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x55c758129850 con 0x55c757da1da0 2024-09-21T03:45:35.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.633+0000 7fb1f9ffb640 10 client.16071 handle_command_reply: tid=0 2024-09-21T03:45:35.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.633+0000 7fb21ee17740 1 client.16071 shutdown 2024-09-21T03:45:35.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.633+0000 7fb21ee17740 1 -- 172.21.15.84:0/4276084869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757de51b0 msgr2=0x55c7581da950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:35.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.633+0000 7fb21ee17740 1 --2- 172.21.15.84:0/4276084869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757de51b0 0x55c7581da950 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0039d0 tx=0x7fb1fc003a30 comp rx=0 tx=0).stop 2024-09-21T03:45:35.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.633+0000 7fb21ee17740 1 -- 172.21.15.84:0/4276084869 shutdown_connections 2024-09-21T03:45:35.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.633+0000 7fb21ee17740 1 --2- 172.21.15.84:0/4276084869 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c757da1da0 0x55c758243db0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.634+0000 7fb21ee17740 1 --2- 172.21.15.84:0/4276084869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c757e0e070 0x55c7581d83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.634+0000 7fb21ee17740 1 --2- 172.21.15.84:0/4276084869 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c757ded390 0x55c7581d7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.634+0000 7fb21ee17740 1 --2- 172.21.15.84:0/4276084869 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c757de51b0 0x55c7581da950 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.634+0000 7fb1f9ffb640 0 client.16071 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:35.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.634+0000 7fb21ee17740 1 -- 172.21.15.84:0/4276084869 >> 172.21.15.84:0/4276084869 conn(0x55c757e02460 msgr2=0x55c7581d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:35.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.634+0000 7fb21ee17740 1 -- 172.21.15.84:0/4276084869 shutdown_connections 2024-09-21T03:45:35.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.634+0000 7fb21ee17740 1 -- 172.21.15.84:0/4276084869 wait complete. 2024-09-21T03:45:35.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.634+0000 7fb21ee17740 20 client.16071 trim_cache size 0 max 16384 2024-09-21T03:45:35.641 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:45:35.641 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T03:45:35.641 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T03:45:35.641 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:45:35.641 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:45:35.641 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:45:35.641 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:35.641 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:45:35.641 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:45:35.641 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:45:35.641 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:45:35.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:45:35.641 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:45:35.641 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:45:35.642 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:35.642 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:45:35.642 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:45:35.642 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:45:35.642 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:45:35.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:45:35.642 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:45:35.642 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:45:35.642 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:35.642 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:45:35.642 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:45:35.642 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:45:35.642 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:45:35.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:45:35.643 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:45:35.643 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:45:35.643 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:35.643 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:45:35.643 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:45:35.643 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:45:35.643 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:45:35.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:45:35.643 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:45:35.643 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:45:35.643 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:35.643 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:45:35.643 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:45:35.644 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:45:35.644 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:45:35.644 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:45:35.644 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:45:35.644 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:45:35.644 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:35.644 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:45:35.644 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:45:35.644 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:45:35.644 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:45:35.644 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:45:35.644 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:45:35.644 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:45:35.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.634+0000 7fb2188a3640 1 -- 172.21.15.84:0/3999165281 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2000b6680 msgr2=0x7fb2000b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:35.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.634+0000 7fb2188a3640 1 --2- 172.21.15.84:0/3999165281 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2000b6680 0x7fb2000b8b90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0ad7a0 tx=0x7fb20c005890 comp rx=0 tx=0).stop 2024-09-21T03:45:35.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.634+0000 7fb2188a3640 1 -- 172.21.15.84:0/3999165281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb214109e20 msgr2=0x7fb21419fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:35.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.634+0000 7fb2188a3640 1 --2- 172.21.15.84:0/3999165281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb214109e20 0x7fb21419fcd0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00eaa0 tx=0x7fb20c00ef60 comp rx=0 tx=0).stop 2024-09-21T03:45:35.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.634+0000 7fb2188a3640 1 -- 172.21.15.84:0/3999165281 shutdown_connections 2024-09-21T03:45:35.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.634+0000 7fb2188a3640 1 --2- 172.21.15.84:0/3999165281 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2000b6680 0x7fb2000b8b90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.635+0000 7fb2188a3640 1 --2- 172.21.15.84:0/3999165281 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb214109e20 0x7fb21419fcd0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.635+0000 7fb2188a3640 1 --2- 172.21.15.84:0/3999165281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb2141094d0 0x7fb21419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.635+0000 7fb2188a3640 1 --2- 172.21.15.84:0/3999165281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb214103b90 0x7fb21419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:35.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.635+0000 7fb2188a3640 1 -- 172.21.15.84:0/3999165281 >> 172.21.15.84:0/3999165281 conn(0x7fb2140ff600 msgr2=0x7fb214101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:35.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.635+0000 7fb2188a3640 1 -- 172.21.15.84:0/3999165281 shutdown_connections 2024-09-21T03:45:35.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:35.635+0000 7fb2188a3640 1 -- 172.21.15.84:0/3999165281 wait complete. 2024-09-21T03:45:35.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:35 smithi174 ceph-mon[34403]: pgmap v417: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-09-21T03:45:35.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:35 smithi172 ceph-mon[34821]: pgmap v417: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-09-21T03:45:36.549 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:45:36.549 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:45:36.799 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:45:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.320+0000 7fc10a0d6640 1 -- 172.21.15.84:0/2522789314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc104108d20 msgr2=0x7fc10410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.320+0000 7fc10a0d6640 1 --2- 172.21.15.84:0/2522789314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc104108d20 0x7fc10410f550 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009ca0 tx=0x7fc0fc02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:45:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.320+0000 7fc10a0d6640 1 -- 172.21.15.84:0/2522789314 shutdown_connections 2024-09-21T03:45:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.320+0000 7fc10a0d6640 1 --2- 172.21.15.84:0/2522789314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc104108d20 0x7fc10410f550 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.320+0000 7fc10a0d6640 1 --2- 172.21.15.84:0/2522789314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1041083d0 0x7fc1041087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.320+0000 7fc10a0d6640 1 --2- 172.21.15.84:0/2522789314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc104102a90 0x7fc104102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.320+0000 7fc10a0d6640 1 -- 172.21.15.84:0/2522789314 >> 172.21.15.84:0/2522789314 conn(0x7fc104079750 msgr2=0x7fc104079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.320+0000 7fc10a0d6640 1 -- 172.21.15.84:0/2522789314 shutdown_connections 2024-09-21T03:45:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.320+0000 7fc10a0d6640 1 -- 172.21.15.84:0/2522789314 wait complete. 2024-09-21T03:45:37.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.321+0000 7fc10a0d6640 1 Processor -- start 2024-09-21T03:45:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.321+0000 7fc10a0d6640 1 -- start start 2024-09-21T03:45:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.322+0000 7fc10a0d6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc104102a90 0x7fc10419b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.322+0000 7fc10a0d6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1041083d0 0x7fc10419b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.322+0000 7fc10a0d6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc104108d20 0x7fc10419bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.322+0000 7fc10a0d6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc104112990 con 0x7fc104108d20 2024-09-21T03:45:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.322+0000 7fc10a0d6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc104112810 con 0x7fc104102a90 2024-09-21T03:45:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.322+0000 7fc10a0d6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc104112b10 con 0x7fc1041083d0 2024-09-21T03:45:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.322+0000 7fc103fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc104108d20 0x7fc10419bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.322+0000 7fc103fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc104108d20 0x7fc10419bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57826/0 (socket says 172.21.15.84:57826) 2024-09-21T03:45:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.322+0000 7fc103fff640 1 -- 172.21.15.84:0/4035344314 learned_addr learned my addr 172.21.15.84:0/4035344314 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.322+0000 7fc102ffd640 1 --2- 172.21.15.84:0/4035344314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1041083d0 0x7fc10419b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.322+0000 7fc1037fe640 1 --2- 172.21.15.84:0/4035344314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc104102a90 0x7fc10419b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:37.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.322+0000 7fc103fff640 1 -- 172.21.15.84:0/4035344314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1041083d0 msgr2=0x7fc10419b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.322+0000 7fc103fff640 1 --2- 172.21.15.84:0/4035344314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1041083d0 0x7fc10419b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.322+0000 7fc103fff640 1 -- 172.21.15.84:0/4035344314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc104102a90 msgr2=0x7fc10419b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.322+0000 7fc103fff640 1 --2- 172.21.15.84:0/4035344314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc104102a90 0x7fc10419b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.322+0000 7fc103fff640 1 -- 172.21.15.84:0/4035344314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1041a6480 con 0x7fc104108d20 2024-09-21T03:45:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.322+0000 7fc103fff640 1 --2- 172.21.15.84:0/4035344314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc104108d20 0x7fc10419bc80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc005cc0 tx=0x7fc0fc02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.323+0000 7fc100ff9640 1 -- 172.21.15.84:0/4035344314 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc003cf0 con 0x7fc104108d20 2024-09-21T03:45:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.323+0000 7fc10a0d6640 1 -- 172.21.15.84:0/4035344314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1041a6710 con 0x7fc104108d20 2024-09-21T03:45:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.323+0000 7fc100ff9640 1 -- 172.21.15.84:0/4035344314 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0fc0044f0 con 0x7fc104108d20 2024-09-21T03:45:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.323+0000 7fc100ff9640 1 -- 172.21.15.84:0/4035344314 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc02fc30 con 0x7fc104108d20 2024-09-21T03:45:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.323+0000 7fc10a0d6640 1 -- 172.21.15.84:0/4035344314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1041a6ca0 con 0x7fc104108d20 2024-09-21T03:45:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.324+0000 7fc10a0d6640 1 -- 172.21.15.84:0/4035344314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc104103d10 con 0x7fc104108d20 2024-09-21T03:45:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.325+0000 7fc100ff9640 1 -- 172.21.15.84:0/4035344314 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fc0fc0046a0 con 0x7fc104108d20 2024-09-21T03:45:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.326+0000 7fc100ff9640 1 --2- 172.21.15.84:0/4035344314 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc0ec0b6680 0x7fc0ec0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:37.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.326+0000 7fc1037fe640 1 --2- 172.21.15.84:0/4035344314 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc0ec0b6680 0x7fc0ec0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:37.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.326+0000 7fc100ff9640 1 -- 172.21.15.84:0/4035344314 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fc0fc108c70 con 0x7fc104108d20 2024-09-21T03:45:37.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.326+0000 7fc1037fe640 1 --2- 172.21.15.84:0/4035344314 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc0ec0b6680 0x7fc0ec0b8b90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40058c0 tx=0x7fc0f400a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:37.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.329+0000 7fc100ff9640 1 -- 172.21.15.84:0/4035344314 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc0fc0cf240 con 0x7fc104108d20 2024-09-21T03:45:37.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.544+0000 7fc10a0d6640 1 -- 172.21.15.84:0/4035344314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc104102ea0 con 0x7fc104108d20 2024-09-21T03:45:37.547 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:37 smithi084 ceph-mon[30941]: pgmap v418: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 9 op/s 2024-09-21T03:45:37.547 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.545+0000 7fc100ff9640 1 -- 172.21.15.84:0/4035344314 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7fc104102ea0 con 0x7fc104108d20 2024-09-21T03:45:37.547 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:45:37.547 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:45:37.548 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:45:37.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.547+0000 7fc10a0d6640 1 -- 172.21.15.84:0/4035344314 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc0ec0b6680 msgr2=0x7fc0ec0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:37.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.547+0000 7fc10a0d6640 1 --2- 172.21.15.84:0/4035344314 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc0ec0b6680 0x7fc0ec0b8b90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40058c0 tx=0x7fc0f400a2d0 comp rx=0 tx=0).stop 2024-09-21T03:45:37.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.547+0000 7fc10a0d6640 1 -- 172.21.15.84:0/4035344314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc104108d20 msgr2=0x7fc10419bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:37.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.547+0000 7fc10a0d6640 1 --2- 172.21.15.84:0/4035344314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc104108d20 0x7fc10419bc80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc005cc0 tx=0x7fc0fc02f470 comp rx=0 tx=0).stop 2024-09-21T03:45:37.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.547+0000 7fc10a0d6640 1 -- 172.21.15.84:0/4035344314 shutdown_connections 2024-09-21T03:45:37.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.547+0000 7fc10a0d6640 1 --2- 172.21.15.84:0/4035344314 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc0ec0b6680 0x7fc0ec0b8b90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:37.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.547+0000 7fc10a0d6640 1 --2- 172.21.15.84:0/4035344314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc104108d20 0x7fc10419bc80 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:37.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.547+0000 7fc10a0d6640 1 --2- 172.21.15.84:0/4035344314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1041083d0 0x7fc10419b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:37.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.547+0000 7fc10a0d6640 1 --2- 172.21.15.84:0/4035344314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc104102a90 0x7fc10419b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:37.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.547+0000 7fc10a0d6640 1 -- 172.21.15.84:0/4035344314 >> 172.21.15.84:0/4035344314 conn(0x7fc104079750 msgr2=0x7fc1041043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:37.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.547+0000 7fc10a0d6640 1 -- 172.21.15.84:0/4035344314 shutdown_connections 2024-09-21T03:45:37.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:37.547+0000 7fc10a0d6640 1 -- 172.21.15.84:0/4035344314 wait complete. 2024-09-21T03:45:37.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:37 smithi174 ceph-mon[34403]: pgmap v418: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 9 op/s 2024-09-21T03:45:37.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:37 smithi172 ceph-mon[34821]: pgmap v418: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 9 op/s 2024-09-21T03:45:38.353 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:45:38.607 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:45:38.730 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:38 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/4035344314' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:45:38.730 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:38 smithi084 ceph-mon[30941]: pgmap v419: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-09-21T03:45:38.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:38 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/4035344314' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:45:38.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:38 smithi174 ceph-mon[34403]: pgmap v419: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-09-21T03:45:38.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:38 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/4035344314' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:45:38.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:38 smithi172 ceph-mon[34821]: pgmap v419: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 20 KiB/s wr, 11 op/s 2024-09-21T03:45:39.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.138+0000 7f5b93617640 1 -- 172.21.15.84:0/1155174813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b8c102a60 msgr2=0x7f5b8c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:39.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.138+0000 7f5b93617640 1 --2- 172.21.15.84:0/1155174813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b8c102a60 0x7f5b8c102e70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009900 tx=0x7f5b8802a410 comp rx=0 tx=0).stop 2024-09-21T03:45:39.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.138+0000 7f5b93617640 1 -- 172.21.15.84:0/1155174813 shutdown_connections 2024-09-21T03:45:39.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.138+0000 7f5b93617640 1 --2- 172.21.15.84:0/1155174813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b8c108cf0 0x7f5b8c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.138+0000 7f5b93617640 1 --2- 172.21.15.84:0/1155174813 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b8c1083a0 0x7f5b8c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.138+0000 7f5b93617640 1 --2- 172.21.15.84:0/1155174813 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b8c102a60 0x7f5b8c102e70 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.138+0000 7f5b93617640 1 -- 172.21.15.84:0/1155174813 >> 172.21.15.84:0/1155174813 conn(0x7f5b8c079730 msgr2=0x7f5b8c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.138+0000 7f5b93617640 1 -- 172.21.15.84:0/1155174813 shutdown_connections 2024-09-21T03:45:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.138+0000 7f5b93617640 1 -- 172.21.15.84:0/1155174813 wait complete. 2024-09-21T03:45:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.139+0000 7f5b93617640 1 Processor -- start 2024-09-21T03:45:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.139+0000 7f5b93617640 1 -- start start 2024-09-21T03:45:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.139+0000 7f5b93617640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b8c102a60 0x7f5b8c199000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.139+0000 7f5b93617640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b8c1083a0 0x7f5b8c199540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.139+0000 7f5b93617640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b8c108cf0 0x7f5b8c199a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.139+0000 7f5b93617640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c112960 con 0x7f5b8c1083a0 2024-09-21T03:45:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.139+0000 7f5b93617640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c1127e0 con 0x7f5b8c108cf0 2024-09-21T03:45:39.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.139+0000 7f5b93617640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c112ae0 con 0x7f5b8c102a60 2024-09-21T03:45:39.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.139+0000 7f5b90bb2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b8c1083a0 0x7f5b8c199540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:39.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.139+0000 7f5b90bb2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b8c1083a0 0x7f5b8c199540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51244/0 (socket says 172.21.15.84:51244) 2024-09-21T03:45:39.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.139+0000 7f5b90bb2640 1 -- 172.21.15.84:0/4178107837 learned_addr learned my addr 172.21.15.84:0/4178107837 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:39.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.140+0000 7f5b913b3640 1 --2- 172.21.15.84:0/4178107837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b8c102a60 0x7f5b8c199000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:39.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.140+0000 7f5b91bb4640 1 --2- 172.21.15.84:0/4178107837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b8c108cf0 0x7f5b8c199a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:39.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.140+0000 7f5b90bb2640 1 -- 172.21.15.84:0/4178107837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b8c102a60 msgr2=0x7f5b8c199000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:39.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.140+0000 7f5b90bb2640 1 --2- 172.21.15.84:0/4178107837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b8c102a60 0x7f5b8c199000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.140+0000 7f5b90bb2640 1 -- 172.21.15.84:0/4178107837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b8c108cf0 msgr2=0x7f5b8c199a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:39.159 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.140+0000 7f5b90bb2640 1 --2- 172.21.15.84:0/4178107837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b8c108cf0 0x7f5b8c199a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.140+0000 7f5b90bb2640 1 -- 172.21.15.84:0/4178107837 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8c19e2e0 con 0x7f5b8c1083a0 2024-09-21T03:45:39.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.140+0000 7f5b91bb4640 1 --2- 172.21.15.84:0/4178107837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b8c108cf0 0x7f5b8c199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:45:39.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.140+0000 7f5b90bb2640 1 --2- 172.21.15.84:0/4178107837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b8c1083a0 0x7f5b8c199540 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000c970 tx=0x7f5b8000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:39.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.140+0000 7f5b7e7fc640 1 -- 172.21.15.84:0/4178107837 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b80007bb0 con 0x7f5b8c1083a0 2024-09-21T03:45:39.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.140+0000 7f5b7e7fc640 1 -- 172.21.15.84:0/4178107837 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b80007d50 con 0x7f5b8c1083a0 2024-09-21T03:45:39.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.140+0000 7f5b93617640 1 -- 172.21.15.84:0/4178107837 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b8c19e5d0 con 0x7f5b8c1083a0 2024-09-21T03:45:39.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.140+0000 7f5b7e7fc640 1 -- 172.21.15.84:0/4178107837 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8000f450 con 0x7f5b8c1083a0 2024-09-21T03:45:39.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.140+0000 7f5b93617640 1 -- 172.21.15.84:0/4178107837 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b8c19eb10 con 0x7f5b8c1083a0 2024-09-21T03:45:39.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.143+0000 7f5b7e7fc640 1 -- 172.21.15.84:0/4178107837 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f5b80004f20 con 0x7f5b8c1083a0 2024-09-21T03:45:39.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.143+0000 7f5b99b8b740 1 Processor -- start 2024-09-21T03:45:39.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.143+0000 7f5b99b8b740 1 -- start start 2024-09-21T03:45:39.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.143+0000 7f5b99b8b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fa8a28070 0x560fa8dcf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:39.160 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.143+0000 7f5b99b8b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa89ff1b0 0x560fa8dcf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:39.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.143+0000 7f5b99b8b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a07390 0x560fa8dcfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:39.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.143+0000 7f5b99b8b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560fa8d45ea0 con 0x560fa8a07390 2024-09-21T03:45:39.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.143+0000 7f5b99b8b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560fa8d352d0 con 0x560fa8a28070 2024-09-21T03:45:39.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.143+0000 7f5b99b8b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560fa8d390e0 con 0x560fa89ff1b0 2024-09-21T03:45:39.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.143+0000 7f5b90bb2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a07390 0x560fa8dcfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:39.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.143+0000 7f5b90bb2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a07390 0x560fa8dcfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51258/0 (socket says 172.21.15.84:51258) 2024-09-21T03:45:39.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.143+0000 7f5b90bb2640 1 -- 172.21.15.84:0/411500294 learned_addr learned my addr 172.21.15.84:0/411500294 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:39.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.144+0000 7f5b7e7fc640 1 --2- 172.21.15.84:0/4178107837 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5b780b6680 0x7f5b780b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:39.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.144+0000 7f5b913b3640 1 --2- 172.21.15.84:0/411500294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa89ff1b0 0x560fa8dcf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:39.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.144+0000 7f5b91bb4640 1 --2- 172.21.15.84:0/411500294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fa8a28070 0x560fa8dcf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:39.161 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.144+0000 7f5b91bb4640 1 --2- 172.21.15.84:0/4178107837 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5b780b6680 0x7f5b780b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:39.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.144+0000 7f5b7e7fc640 1 -- 172.21.15.84:0/4178107837 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f5b800e77c0 con 0x7f5b8c1083a0 2024-09-21T03:45:39.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.144+0000 7f5b90bb2640 1 -- 172.21.15.84:0/411500294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa89ff1b0 msgr2=0x560fa8dcf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:39.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.144+0000 7f5b90bb2640 1 --2- 172.21.15.84:0/411500294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa89ff1b0 0x560fa8dcf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.144+0000 7f5b90bb2640 1 -- 172.21.15.84:0/411500294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fa8a28070 msgr2=0x560fa8dcf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:39.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.144+0000 7f5b90bb2640 1 --2- 172.21.15.84:0/411500294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fa8a28070 0x560fa8dcf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.144+0000 7f5b90bb2640 1 -- 172.21.15.84:0/411500294 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fa8a93650 con 0x560fa8a07390 2024-09-21T03:45:39.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.144+0000 7f5b90bb2640 1 --2- 172.21.15.84:0/411500294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a07390 0x560fa8dcfd40 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5b800aa900 tx=0x7f5b800a9660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2a50833f71b2e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:39.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.144+0000 7f5b91bb4640 1 --2- 172.21.15.84:0/4178107837 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5b780b6680 0x7f5b780b8b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5b84005c40 tx=0x7f5b840094a0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:39.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.144+0000 7f5b777fe640 1 -- 172.21.15.84:0/411500294 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8001d030 con 0x560fa8a07390 2024-09-21T03:45:39.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.144+0000 7f5b777fe640 1 -- 172.21.15.84:0/411500294 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b800add90 con 0x560fa8a07390 2024-09-21T03:45:39.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.144+0000 7f5b777fe640 1 -- 172.21.15.84:0/411500294 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b80005210 con 0x560fa8a07390 2024-09-21T03:45:39.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.145+0000 7f5b99b8b740 1 -- 172.21.15.84:0/411500294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a07390 msgr2=0x560fa8dcfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:39.162 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.145+0000 7f5b99b8b740 1 --2- 172.21.15.84:0/411500294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a07390 0x560fa8dcfd40 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5b800aa900 tx=0x7f5b800a9660 comp rx=0 tx=0).stop 2024-09-21T03:45:39.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.145+0000 7f5b99b8b740 1 -- 172.21.15.84:0/411500294 shutdown_connections 2024-09-21T03:45:39.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.145+0000 7f5b99b8b740 1 --2- 172.21.15.84:0/411500294 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a07390 0x560fa8dcfd40 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.145+0000 7f5b99b8b740 1 --2- 172.21.15.84:0/411500294 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa89ff1b0 0x560fa8dcf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.145+0000 7f5b99b8b740 1 --2- 172.21.15.84:0/411500294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fa8a28070 0x560fa8dcf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.145+0000 7f5b99b8b740 1 -- 172.21.15.84:0/411500294 >> 172.21.15.84:0/411500294 conn(0x560fa8a1c460 msgr2=0x560fa8dcd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:39.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.145+0000 7f5b99b8b740 1 -- 172.21.15.84:0/411500294 shutdown_connections 2024-09-21T03:45:39.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.145+0000 7f5b99b8b740 1 -- 172.21.15.84:0/411500294 wait complete. 2024-09-21T03:45:39.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.146+0000 7f5b99b8b740 1 -- start start 2024-09-21T03:45:39.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.146+0000 7f5b99b8b740 1 Processor -- start 2024-09-21T03:45:39.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.146+0000 7f5b99b8b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fa89ff1b0 0x560fa8dda9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:39.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.146+0000 7f5b99b8b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa8a07390 0x560fa8ddaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:39.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.146+0000 7f5b99b8b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a28070 0x560fa8de6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:39.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.146+0000 7f5b99b8b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560fa8b96700 con 0x560fa8a28070 2024-09-21T03:45:39.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.146+0000 7f5b99b8b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560fa8cd0160 con 0x560fa89ff1b0 2024-09-21T03:45:39.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.146+0000 7f5b99b8b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560fa8ddda40 con 0x560fa8a07390 2024-09-21T03:45:39.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.146+0000 7f5b99b8b740 10 client.0 _ll_register_callbacks cb 0x560fa8ce99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:45:39.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.146+0000 7f5b91bb4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a28070 0x560fa8de6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:39.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.146+0000 7f5b91bb4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a28070 0x560fa8de6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51272/0 (socket says 172.21.15.84:51272) 2024-09-21T03:45:39.164 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.146+0000 7f5b91bb4640 1 -- 172.21.15.84:0/876928629 learned_addr learned my addr 172.21.15.84:0/876928629 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:39.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.147+0000 7f5b90bb2640 1 --2- 172.21.15.84:0/876928629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa8a07390 0x560fa8ddaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:39.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.147+0000 7f5b913b3640 1 --2- 172.21.15.84:0/876928629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fa89ff1b0 0x560fa8dda9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:39.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.147+0000 7f5b91bb4640 1 -- 172.21.15.84:0/876928629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa8a07390 msgr2=0x560fa8ddaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:39.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.147+0000 7f5b91bb4640 1 --2- 172.21.15.84:0/876928629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa8a07390 0x560fa8ddaf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.147+0000 7f5b91bb4640 1 -- 172.21.15.84:0/876928629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fa89ff1b0 msgr2=0x560fa8dda9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:39.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.147+0000 7f5b91bb4640 1 --2- 172.21.15.84:0/876928629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fa89ff1b0 0x560fa8dda9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.147+0000 7f5b91bb4640 1 -- 172.21.15.84:0/876928629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fa8cfdc90 con 0x560fa8a28070 2024-09-21T03:45:39.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.147+0000 7f5b90bb2640 1 --2- 172.21.15.84:0/876928629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa8a07390 0x560fa8ddaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:45:39.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.147+0000 7f5b91bb4640 1 --2- 172.21.15.84:0/876928629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a28070 0x560fa8de6d30 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f5b840123a0 tx=0x7f5b84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d960ad444e9f92c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:39.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.147+0000 7f5b74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:45:39.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.147+0000 7f5b74ff9640 1 -- 172.21.15.84:0/876928629 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b84024030 con 0x560fa8a28070 2024-09-21T03:45:39.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.147+0000 7f5b74ff9640 1 -- 172.21.15.84:0/876928629 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f5b84011960 con 0x560fa8a28070 2024-09-21T03:45:39.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.147+0000 7f5b99b8b740 1 -- 172.21.15.84:0/876928629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b800add90 con 0x560fa8a28070 2024-09-21T03:45:39.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.147+0000 7f5b74ff9640 1 -- 172.21.15.84:0/876928629 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5b84011b60 con 0x560fa8a28070 2024-09-21T03:45:39.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.147+0000 7f5b99b8b740 10 client.16089 fetch_fsmap learned FSMap version 25 2024-09-21T03:45:39.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.147+0000 7f5b99b8b740 1 -- 172.21.15.84:0/876928629 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560fa8de9810 con 0x560fa8a28070 2024-09-21T03:45:39.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.147+0000 7f5b74ff9640 1 -- 172.21.15.84:0/876928629 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b800add90 con 0x560fa8a28070 2024-09-21T03:45:39.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.148+0000 7f5b74ff9640 1 -- 172.21.15.84:0/876928629 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5b8401e040 con 0x560fa8a28070 2024-09-21T03:45:39.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.148+0000 7f5b99b8b740 10 client.16089 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:45:39.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.148+0000 7f5b99b8b740 10 client.16089 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:45:39.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.148+0000 7f5b99b8b740 20 client.16089 populate_metadata read hostname 'smithi084' 2024-09-21T03:45:39.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.148+0000 7f5b99b8b740 1 --2- 172.21.15.84:0/876928629 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x560fa89e69f0 0x560fa8decd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:39.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.148+0000 7f5b99b8b740 4 client.16089 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:45:39.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.148+0000 7f5b99b8b740 1 -- 172.21.15.84:0/876928629 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fa8d47df0 con 0x560fa89e69f0 2024-09-21T03:45:39.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.148+0000 7f5b913b3640 1 --2- 172.21.15.84:0/876928629 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x560fa89e69f0 0x560fa8decd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:39.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.148+0000 7f5b74ff9640 10 client.16089 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:45:39.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.148+0000 7f5b913b3640 1 --2- 172.21.15.84:0/876928629 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x560fa89e69f0 0x560fa8decd30 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8f277b61158eab6c server_cookie=7ca7e8d0f4ae0786 in_seq=0 out_seq=0 2024-09-21T03:45:39.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.149+0000 7f5b74ff9640 1 -- 172.21.15.84:0/876928629 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560fa8d47df0 con 0x560fa89e69f0 2024-09-21T03:45:39.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.149+0000 7f5b74ff9640 10 client.16089 handle_command_reply: tid=0 2024-09-21T03:45:39.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.149+0000 7f5b99b8b740 1 client.16089 shutdown 2024-09-21T03:45:39.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.149+0000 7f5b99b8b740 1 -- 172.21.15.84:0/876928629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a28070 msgr2=0x560fa8de6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:39.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.149+0000 7f5b99b8b740 1 --2- 172.21.15.84:0/876928629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a28070 0x560fa8de6d30 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f5b840123a0 tx=0x7f5b84004a40 comp rx=0 tx=0).stop 2024-09-21T03:45:39.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.149+0000 7f5b99b8b740 1 -- 172.21.15.84:0/876928629 shutdown_connections 2024-09-21T03:45:39.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.149+0000 7f5b99b8b740 1 --2- 172.21.15.84:0/876928629 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x560fa89e69f0 0x560fa8decd30 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.149+0000 7f5b99b8b740 1 --2- 172.21.15.84:0/876928629 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a28070 0x560fa8de6d30 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.149+0000 7f5b99b8b740 1 --2- 172.21.15.84:0/876928629 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa8a07390 0x560fa8ddaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.149+0000 7f5b99b8b740 1 --2- 172.21.15.84:0/876928629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fa89ff1b0 0x560fa8dda9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.149+0000 7f5b74ff9640 0 client.16089 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:45:39.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.149+0000 7f5b99b8b740 1 -- 172.21.15.84:0/876928629 >> 172.21.15.84:0/876928629 conn(0x560fa8a1c460 msgr2=0x560fa8dd24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:39.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.150+0000 7f5b99b8b740 1 -- 172.21.15.84:0/876928629 shutdown_connections 2024-09-21T03:45:39.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.150+0000 7f5b99b8b740 1 -- 172.21.15.84:0/876928629 wait complete. 2024-09-21T03:45:39.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.150+0000 7f5b99b8b740 20 client.16089 trim_cache size 0 max 16384 2024-09-21T03:45:39.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.163+0000 7f5b99b8b740 1 Processor -- start 2024-09-21T03:45:39.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.163+0000 7f5b99b8b740 1 -- start start 2024-09-21T03:45:39.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.163+0000 7f5b99b8b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa89ff1b0 0x560fa8ddc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:39.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.163+0000 7f5b99b8b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa8a07390 0x560fa8de6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:39.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.163+0000 7f5b99b8b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fa8a28070 0x560fa8dd7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:39.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.163+0000 7f5b99b8b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c1b8530 con 0x560fa89ff1b0 2024-09-21T03:45:39.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.163+0000 7f5b99b8b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c1b5e00 con 0x560fa8a28070 2024-09-21T03:45:39.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.163+0000 7f5b99b8b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c1b3c50 con 0x560fa8a07390 2024-09-21T03:45:39.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.164+0000 7f5b913b3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa89ff1b0 0x560fa8ddc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:39.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.164+0000 7f5b913b3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa89ff1b0 0x560fa8ddc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51284/0 (socket says 172.21.15.84:51284) 2024-09-21T03:45:39.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.164+0000 7f5b913b3640 1 -- 172.21.15.84:0/1506546832 learned_addr learned my addr 172.21.15.84:0/1506546832 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:39.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.164+0000 7f5b90bb2640 1 --2- 172.21.15.84:0/1506546832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa8a07390 0x560fa8de6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:39.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.164+0000 7f5b91bb4640 1 --2- 172.21.15.84:0/1506546832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fa8a28070 0x560fa8dd7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:39.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.164+0000 7f5b913b3640 1 -- 172.21.15.84:0/1506546832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa8a07390 msgr2=0x560fa8de6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:39.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.164+0000 7f5b913b3640 1 --2- 172.21.15.84:0/1506546832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa8a07390 0x560fa8de6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.164+0000 7f5b913b3640 1 -- 172.21.15.84:0/1506546832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fa8a28070 msgr2=0x560fa8dd7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:39.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.164+0000 7f5b913b3640 1 --2- 172.21.15.84:0/1506546832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fa8a28070 0x560fa8dd7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.164+0000 7f5b913b3640 1 -- 172.21.15.84:0/1506546832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fa8ddbc90 con 0x560fa89ff1b0 2024-09-21T03:45:39.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.164+0000 7f5b90bb2640 1 --2- 172.21.15.84:0/1506546832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa8a07390 0x560fa8de6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:45:39.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.164+0000 7f5b913b3640 1 --2- 172.21.15.84:0/1506546832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa89ff1b0 0x560fa8ddc600 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5b88005f70 tx=0x7f5b88009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58447e021048d3b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:39.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.164+0000 7f5b76ffd640 1 -- 172.21.15.84:0/1506546832 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b88035040 con 0x560fa89ff1b0 2024-09-21T03:45:39.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.164+0000 7f5b76ffd640 1 -- 172.21.15.84:0/1506546832 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b88048070 con 0x560fa89ff1b0 2024-09-21T03:45:39.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.164+0000 7f5b76ffd640 1 -- 172.21.15.84:0/1506546832 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b88004bf0 con 0x560fa89ff1b0 2024-09-21T03:45:39.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.165+0000 7f5b99b8b740 1 -- 172.21.15.84:0/1506546832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa89ff1b0 msgr2=0x560fa8ddc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:39.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.165+0000 7f5b99b8b740 1 --2- 172.21.15.84:0/1506546832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa89ff1b0 0x560fa8ddc600 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5b88005f70 tx=0x7f5b88009640 comp rx=0 tx=0).stop 2024-09-21T03:45:39.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.165+0000 7f5b99b8b740 1 -- 172.21.15.84:0/1506546832 shutdown_connections 2024-09-21T03:45:39.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.165+0000 7f5b99b8b740 1 --2- 172.21.15.84:0/1506546832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fa8a28070 0x560fa8dd7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.165+0000 7f5b99b8b740 1 --2- 172.21.15.84:0/1506546832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa8a07390 0x560fa8de6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.165+0000 7f5b99b8b740 1 --2- 172.21.15.84:0/1506546832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa89ff1b0 0x560fa8ddc600 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.165+0000 7f5b99b8b740 1 -- 172.21.15.84:0/1506546832 >> 172.21.15.84:0/1506546832 conn(0x560fa8a1c460 msgr2=0x560fa8ddbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:39.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.165+0000 7f5b99b8b740 1 -- 172.21.15.84:0/1506546832 shutdown_connections 2024-09-21T03:45:39.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.165+0000 7f5b99b8b740 1 -- 172.21.15.84:0/1506546832 wait complete. 2024-09-21T03:45:39.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.166+0000 7f5b99b8b740 1 -- start start 2024-09-21T03:45:39.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.166+0000 7f5b99b8b740 1 Processor -- start 2024-09-21T03:45:39.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.166+0000 7f5b99b8b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fa89ff1b0 0x560fa8ddf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:39.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.166+0000 7f5b99b8b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a07390 0x560fa8ddf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:39.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.166+0000 7f5b99b8b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa8a28070 0x560fa8e566f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:39.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.166+0000 7f5b99b8b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c1b42c0 con 0x560fa8a07390 2024-09-21T03:45:39.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.166+0000 7f5b99b8b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c1b5730 con 0x560fa89ff1b0 2024-09-21T03:45:39.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.166+0000 7f5b99b8b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8c1b4990 con 0x560fa8a28070 2024-09-21T03:45:39.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.166+0000 7f5b99b8b740 10 client.0 _ll_register_callbacks cb 0x7f5b84009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:45:39.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.166+0000 7f5b90bb2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a07390 0x560fa8ddf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:39.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.166+0000 7f5b90bb2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a07390 0x560fa8ddf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51290/0 (socket says 172.21.15.84:51290) 2024-09-21T03:45:39.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.166+0000 7f5b90bb2640 1 -- 172.21.15.84:0/4045979358 learned_addr learned my addr 172.21.15.84:0/4045979358 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:39.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.166+0000 7f5b91bb4640 1 --2- 172.21.15.84:0/4045979358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa8a28070 0x560fa8e566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:39.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.166+0000 7f5b913b3640 1 --2- 172.21.15.84:0/4045979358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fa89ff1b0 0x560fa8ddf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:39.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.167+0000 7f5b90bb2640 1 -- 172.21.15.84:0/4045979358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa8a28070 msgr2=0x560fa8e566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:39.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.167+0000 7f5b90bb2640 1 --2- 172.21.15.84:0/4045979358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa8a28070 0x560fa8e566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.167+0000 7f5b90bb2640 1 -- 172.21.15.84:0/4045979358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fa89ff1b0 msgr2=0x560fa8ddf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:39.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.167+0000 7f5b90bb2640 1 --2- 172.21.15.84:0/4045979358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fa89ff1b0 0x560fa8ddf3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.167+0000 7f5b90bb2640 1 -- 172.21.15.84:0/4045979358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fa8e56c30 con 0x560fa8a07390 2024-09-21T03:45:39.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.167+0000 7f5b90bb2640 1 --2- 172.21.15.84:0/4045979358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a07390 0x560fa8ddf930 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5b800e5590 tx=0x7f5b800048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506e04cf8c48411 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:39.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.167+0000 7f5b74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:45:39.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.167+0000 7f5b74ff9640 1 -- 172.21.15.84:0/4045979358 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b80098020 con 0x560fa8a07390 2024-09-21T03:45:39.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.167+0000 7f5b74ff9640 1 -- 172.21.15.84:0/4045979358 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f5b800b8370 con 0x560fa8a07390 2024-09-21T03:45:39.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.167+0000 7f5b99b8b740 1 -- 172.21.15.84:0/4045979358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b88048070 con 0x560fa8a07390 2024-09-21T03:45:39.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.167+0000 7f5b74ff9640 1 -- 172.21.15.84:0/4045979358 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5b8001d070 con 0x560fa8a07390 2024-09-21T03:45:39.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.167+0000 7f5b99b8b740 10 client.16095 fetch_fsmap learned FSMap version 25 2024-09-21T03:45:39.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.167+0000 7f5b99b8b740 1 -- 172.21.15.84:0/4045979358 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560fa8e57e60 con 0x560fa8a07390 2024-09-21T03:45:39.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.167+0000 7f5b74ff9640 1 -- 172.21.15.84:0/4045979358 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b88048070 con 0x560fa8a07390 2024-09-21T03:45:39.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.168+0000 7f5b74ff9640 1 -- 172.21.15.84:0/4045979358 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5b800c8ce0 con 0x560fa8a07390 2024-09-21T03:45:39.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.168+0000 7f5b99b8b740 10 client.16095 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:45:39.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.168+0000 7f5b99b8b740 10 client.16095 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:45:39.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.168+0000 7f5b99b8b740 20 client.16095 populate_metadata read hostname 'smithi084' 2024-09-21T03:45:39.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.168+0000 7f5b99b8b740 1 --2- 172.21.15.84:0/4045979358 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x560fa89bbda0 0x560fa8e5a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:39.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.168+0000 7f5b99b8b740 4 client.16095 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:45:39.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.168+0000 7f5b99b8b740 1 -- 172.21.15.84:0/4045979358 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560fa8d438a0 con 0x560fa89bbda0 2024-09-21T03:45:39.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.168+0000 7f5b913b3640 1 --2- 172.21.15.84:0/4045979358 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x560fa89bbda0 0x560fa8e5a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:39.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.168+0000 7f5b913b3640 1 --2- 172.21.15.84:0/4045979358 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x560fa89bbda0 0x560fa8e5a200 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9e322101616546b server_cookie=5823c447c7c8f5d2 in_seq=0 out_seq=0 2024-09-21T03:45:39.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.168+0000 7f5b74ff9640 10 client.16095 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:45:39.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.169+0000 7f5b74ff9640 1 -- 172.21.15.84:0/4045979358 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560fa8d438a0 con 0x560fa89bbda0 2024-09-21T03:45:39.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.169+0000 7f5b74ff9640 10 client.16095 handle_command_reply: tid=0 2024-09-21T03:45:39.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.169+0000 7f5b99b8b740 1 client.16095 shutdown 2024-09-21T03:45:39.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.169+0000 7f5b99b8b740 1 -- 172.21.15.84:0/4045979358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a07390 msgr2=0x560fa8ddf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:39.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.169+0000 7f5b99b8b740 1 --2- 172.21.15.84:0/4045979358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a07390 0x560fa8ddf930 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f5b800e5590 tx=0x7f5b800048d0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.169+0000 7f5b99b8b740 1 -- 172.21.15.84:0/4045979358 shutdown_connections 2024-09-21T03:45:39.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.169+0000 7f5b99b8b740 1 --2- 172.21.15.84:0/4045979358 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x560fa89bbda0 0x560fa8e5a200 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.169+0000 7f5b99b8b740 1 --2- 172.21.15.84:0/4045979358 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560fa8a28070 0x560fa8e566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.169+0000 7f5b74ff9640 0 client.16095 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:45:39.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.169+0000 7f5b99b8b740 1 --2- 172.21.15.84:0/4045979358 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560fa8a07390 0x560fa8ddf930 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.169+0000 7f5b99b8b740 1 --2- 172.21.15.84:0/4045979358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560fa89ff1b0 0x560fa8ddf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.169+0000 7f5b99b8b740 1 -- 172.21.15.84:0/4045979358 >> 172.21.15.84:0/4045979358 conn(0x560fa8a1c460 msgr2=0x560fa8ddbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:39.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.169+0000 7f5b99b8b740 1 -- 172.21.15.84:0/4045979358 shutdown_connections 2024-09-21T03:45:39.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.169+0000 7f5b99b8b740 1 -- 172.21.15.84:0/4045979358 wait complete. 2024-09-21T03:45:39.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.169+0000 7f5b99b8b740 20 client.16095 trim_cache size 0 max 16384 2024-09-21T03:45:39.181 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:45:39.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.170+0000 7f5b93617640 1 -- 172.21.15.84:0/4178107837 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5b780b6680 msgr2=0x7f5b780b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:39.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.170+0000 7f5b93617640 1 --2- 172.21.15.84:0/4178107837 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5b780b6680 0x7f5b780b8b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5b84005c40 tx=0x7f5b840094a0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.170+0000 7f5b93617640 1 -- 172.21.15.84:0/4178107837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b8c1083a0 msgr2=0x7f5b8c199540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:39.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.170+0000 7f5b93617640 1 --2- 172.21.15.84:0/4178107837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b8c1083a0 0x7f5b8c199540 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000c970 tx=0x7f5b8000ce30 comp rx=0 tx=0).stop 2024-09-21T03:45:39.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.170+0000 7f5b93617640 1 -- 172.21.15.84:0/4178107837 shutdown_connections 2024-09-21T03:45:39.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.170+0000 7f5b93617640 1 --2- 172.21.15.84:0/4178107837 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5b780b6680 0x7f5b780b8b90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.170+0000 7f5b93617640 1 --2- 172.21.15.84:0/4178107837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b8c108cf0 0x7f5b8c199a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.170+0000 7f5b93617640 1 --2- 172.21.15.84:0/4178107837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b8c1083a0 0x7f5b8c199540 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.170+0000 7f5b93617640 1 --2- 172.21.15.84:0/4178107837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b8c102a60 0x7f5b8c199000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:39.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.170+0000 7f5b93617640 1 -- 172.21.15.84:0/4178107837 >> 172.21.15.84:0/4178107837 conn(0x7f5b8c079730 msgr2=0x7f5b8c1013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:39.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.170+0000 7f5b93617640 1 -- 172.21.15.84:0/4178107837 shutdown_connections 2024-09-21T03:45:39.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:39.170+0000 7f5b93617640 1 -- 172.21.15.84:0/4178107837 wait complete. 2024-09-21T03:45:40.107 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:45:40.350 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:45:40.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.811+0000 7fb30ee03640 1 -- 172.21.15.84:0/3917209519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb308102080 msgr2=0x7fb308102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:40.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.811+0000 7fb30ee03640 1 --2- 172.21.15.84:0/3917209519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb308102080 0x7fb308102490 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009900 tx=0x7fb2fc02a3f0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.811+0000 7fb30ee03640 1 -- 172.21.15.84:0/3917209519 shutdown_connections 2024-09-21T03:45:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.811+0000 7fb30ee03640 1 --2- 172.21.15.84:0/3917209519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb308109eb0 0x7fb3081106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.811+0000 7fb30ee03640 1 --2- 172.21.15.84:0/3917209519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb308109560 0x7fb308109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.811+0000 7fb30ee03640 1 --2- 172.21.15.84:0/3917209519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb308102080 0x7fb308102490 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.811+0000 7fb30ee03640 1 -- 172.21.15.84:0/3917209519 >> 172.21.15.84:0/3917209519 conn(0x7fb308079ec0 msgr2=0x7fb30807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.811+0000 7fb30ee03640 1 -- 172.21.15.84:0/3917209519 shutdown_connections 2024-09-21T03:45:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.811+0000 7fb30ee03640 1 -- 172.21.15.84:0/3917209519 wait complete. 2024-09-21T03:45:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.812+0000 7fb30ee03640 1 Processor -- start 2024-09-21T03:45:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.812+0000 7fb30ee03640 1 -- start start 2024-09-21T03:45:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.812+0000 7fb30ee03640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb308102080 0x7fb30819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.812+0000 7fb30ee03640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb308109560 0x7fb30819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.812+0000 7fb30ee03640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb308109eb0 0x7fb30819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:40.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.812+0000 7fb30ee03640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb308113b70 con 0x7fb308109560 2024-09-21T03:45:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.812+0000 7fb30ee03640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081139f0 con 0x7fb308102080 2024-09-21T03:45:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.812+0000 7fb30ee03640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb308113cf0 con 0x7fb308109eb0 2024-09-21T03:45:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.812+0000 7fb307fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb308109560 0x7fb30819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.812+0000 7fb307fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb308109560 0x7fb30819aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51312/0 (socket says 172.21.15.84:51312) 2024-09-21T03:45:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.812+0000 7fb307fff640 1 -- 172.21.15.84:0/806092995 learned_addr learned my addr 172.21.15.84:0/806092995 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.813+0000 7fb30d3a0640 1 --2- 172.21.15.84:0/806092995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb308109eb0 0x7fb30819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.813+0000 7fb30cb9f640 1 --2- 172.21.15.84:0/806092995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb308102080 0x7fb30819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.813+0000 7fb307fff640 1 -- 172.21.15.84:0/806092995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb308109eb0 msgr2=0x7fb30819fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.813+0000 7fb307fff640 1 --2- 172.21.15.84:0/806092995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb308109eb0 0x7fb30819fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.813+0000 7fb307fff640 1 -- 172.21.15.84:0/806092995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb308102080 msgr2=0x7fb30819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.813+0000 7fb307fff640 1 --2- 172.21.15.84:0/806092995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb308102080 0x7fb30819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.813+0000 7fb307fff640 1 -- 172.21.15.84:0/806092995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3081a0390 con 0x7fb308109560 2024-09-21T03:45:40.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.813+0000 7fb30d3a0640 1 --2- 172.21.15.84:0/806092995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb308109eb0 0x7fb30819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:45:40.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.813+0000 7fb307fff640 1 --2- 172.21.15.84:0/806092995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb308109560 0x7fb30819aa80 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400c8c0 tx=0x7fb2f400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:40.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.813+0000 7fb305ffb640 1 -- 172.21.15.84:0/806092995 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4007bb0 con 0x7fb308109560 2024-09-21T03:45:40.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.813+0000 7fb305ffb640 1 -- 172.21.15.84:0/806092995 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2f4007d50 con 0x7fb308109560 2024-09-21T03:45:40.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.813+0000 7fb30ee03640 1 -- 172.21.15.84:0/806092995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3081a0680 con 0x7fb308109560 2024-09-21T03:45:40.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.813+0000 7fb305ffb640 1 -- 172.21.15.84:0/806092995 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f40187c0 con 0x7fb308109560 2024-09-21T03:45:40.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.813+0000 7fb30ee03640 1 -- 172.21.15.84:0/806092995 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3081a6ea0 con 0x7fb308109560 2024-09-21T03:45:40.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.816+0000 7fb305ffb640 1 -- 172.21.15.84:0/806092995 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fb2f400fa20 con 0x7fb308109560 2024-09-21T03:45:40.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.816+0000 7fb315377740 1 Processor -- start 2024-09-21T03:45:40.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.816+0000 7fb315377740 1 -- start start 2024-09-21T03:45:40.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.816+0000 7fb315377740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802dddc070 0x55802e1836a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:40.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.816+0000 7fb315377740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802ddb31b0 0x55802e183be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:40.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.816+0000 7fb315377740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55802ddbb390 0x55802e184120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:40.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.816+0000 7fb315377740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55802e0f9ea0 con 0x55802ddb31b0 2024-09-21T03:45:40.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.816+0000 7fb315377740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55802e0e92d0 con 0x55802dddc070 2024-09-21T03:45:40.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.816+0000 7fb315377740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55802e0ed0e0 con 0x55802ddbb390 2024-09-21T03:45:40.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.817+0000 7fb30cb9f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802ddb31b0 0x55802e183be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:40.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.817+0000 7fb30cb9f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802ddb31b0 0x55802e183be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51318/0 (socket says 172.21.15.84:51318) 2024-09-21T03:45:40.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.817+0000 7fb30cb9f640 1 -- 172.21.15.84:0/950722224 learned_addr learned my addr 172.21.15.84:0/950722224 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:40.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.817+0000 7fb307fff640 1 --2- 172.21.15.84:0/950722224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55802ddbb390 0x55802e184120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:40.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.817+0000 7fb30d3a0640 1 --2- 172.21.15.84:0/950722224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802dddc070 0x55802e1836a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:40.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.817+0000 7fb305ffb640 1 --2- 172.21.15.84:0/806092995 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2f80b66b0 0x7fb2f80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:40.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.817+0000 7fb30cb9f640 1 -- 172.21.15.84:0/950722224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55802ddbb390 msgr2=0x55802e184120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:40.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.817+0000 7fb30d3a0640 1 --2- 172.21.15.84:0/806092995 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2f80b66b0 0x7fb2f80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:40.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.817+0000 7fb30cb9f640 1 --2- 172.21.15.84:0/950722224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55802ddbb390 0x55802e184120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.817+0000 7fb30cb9f640 1 -- 172.21.15.84:0/950722224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802dddc070 msgr2=0x55802e1836a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:40.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.817+0000 7fb30cb9f640 1 --2- 172.21.15.84:0/950722224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802dddc070 0x55802e1836a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.817+0000 7fb30cb9f640 1 -- 172.21.15.84:0/950722224 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55802de47650 con 0x55802ddb31b0 2024-09-21T03:45:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.817+0000 7fb305ffb640 1 -- 172.21.15.84:0/806092995 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fb2f40e77f0 con 0x7fb308109560 2024-09-21T03:45:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.817+0000 7fb30cb9f640 1 --2- 172.21.15.84:0/950722224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802ddb31b0 0x55802e183be0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc02a910 tx=0x7fb2fc031cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ae1fe920ac2869 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.817+0000 7fb30d3a0640 1 --2- 172.21.15.84:0/806092995 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2f80b66b0 0x7fb2f80b8bc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb3000124d0 tx=0x7fb300004ab0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.817+0000 7fb2f2ffd640 1 -- 172.21.15.84:0/950722224 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc035070 con 0x55802ddb31b0 2024-09-21T03:45:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.818+0000 7fb2f2ffd640 1 -- 172.21.15.84:0/950722224 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2fc0316a0 con 0x55802ddb31b0 2024-09-21T03:45:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.818+0000 7fb2f2ffd640 1 -- 172.21.15.84:0/950722224 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc03e7d0 con 0x55802ddb31b0 2024-09-21T03:45:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.818+0000 7fb315377740 1 -- 172.21.15.84:0/950722224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802ddb31b0 msgr2=0x55802e183be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.818+0000 7fb315377740 1 --2- 172.21.15.84:0/950722224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802ddb31b0 0x55802e183be0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc02a910 tx=0x7fb2fc031cd0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.818+0000 7fb315377740 1 -- 172.21.15.84:0/950722224 shutdown_connections 2024-09-21T03:45:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.818+0000 7fb315377740 1 --2- 172.21.15.84:0/950722224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55802ddbb390 0x55802e184120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.818+0000 7fb315377740 1 --2- 172.21.15.84:0/950722224 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802ddb31b0 0x55802e183be0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.818+0000 7fb315377740 1 --2- 172.21.15.84:0/950722224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802dddc070 0x55802e1836a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.818+0000 7fb315377740 1 -- 172.21.15.84:0/950722224 >> 172.21.15.84:0/950722224 conn(0x55802ddd0460 msgr2=0x55802e181590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.819+0000 7fb315377740 1 -- 172.21.15.84:0/950722224 shutdown_connections 2024-09-21T03:45:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.819+0000 7fb315377740 1 -- 172.21.15.84:0/950722224 wait complete. 2024-09-21T03:45:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.819+0000 7fb315377740 1 -- start start 2024-09-21T03:45:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.819+0000 7fb315377740 1 Processor -- start 2024-09-21T03:45:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.819+0000 7fb315377740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802ddb31b0 0x55802e18ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.819+0000 7fb315377740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55802ddbb390 0x55802e18f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.819+0000 7fb315377740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 0x55802e18f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.819+0000 7fb315377740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55802df4a700 con 0x55802dddc070 2024-09-21T03:45:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.819+0000 7fb315377740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55802e084160 con 0x55802ddb31b0 2024-09-21T03:45:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.819+0000 7fb315377740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55802e191e20 con 0x55802ddbb390 2024-09-21T03:45:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.819+0000 7fb315377740 10 client.0 _ll_register_callbacks cb 0x55802e09d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:45:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.820+0000 7fb30d3a0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 0x55802e18f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:40.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.820+0000 7fb30d3a0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 0x55802e18f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51326/0 (socket says 172.21.15.84:51326) 2024-09-21T03:45:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.820+0000 7fb30d3a0640 1 -- 172.21.15.84:0/3876259617 learned_addr learned my addr 172.21.15.84:0/3876259617 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.820+0000 7fb30cb9f640 1 --2- 172.21.15.84:0/3876259617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802ddb31b0 0x55802e18ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.820+0000 7fb307fff640 1 --2- 172.21.15.84:0/3876259617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55802ddbb390 0x55802e18f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.820+0000 7fb30d3a0640 1 -- 172.21.15.84:0/3876259617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55802ddbb390 msgr2=0x55802e18f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.820+0000 7fb30d3a0640 1 --2- 172.21.15.84:0/3876259617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55802ddbb390 0x55802e18f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.820+0000 7fb30d3a0640 1 -- 172.21.15.84:0/3876259617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802ddb31b0 msgr2=0x55802e18ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.820+0000 7fb30d3a0640 1 --2- 172.21.15.84:0/3876259617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802ddb31b0 0x55802e18ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.820+0000 7fb30d3a0640 1 -- 172.21.15.84:0/3876259617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55802e0b1c90 con 0x55802dddc070 2024-09-21T03:45:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.820+0000 7fb30d3a0640 1 --2- 172.21.15.84:0/3876259617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 0x55802e18f800 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb300010ec0 tx=0x7fb300007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811cf374a2f54d28 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.820+0000 7fb2e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:45:40.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.820+0000 7fb2e7fff640 1 -- 172.21.15.84:0/3876259617 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300026470 con 0x55802dddc070 2024-09-21T03:45:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.820+0000 7fb315377740 1 -- 172.21.15.84:0/3876259617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2fc0316a0 con 0x55802dddc070 2024-09-21T03:45:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.820+0000 7fb2e7fff640 1 -- 172.21.15.84:0/3876259617 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fb30001c420 con 0x55802dddc070 2024-09-21T03:45:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.820+0000 7fb2e7fff640 1 -- 172.21.15.84:0/3876259617 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb30001c620 con 0x55802dddc070 2024-09-21T03:45:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.820+0000 7fb315377740 10 client.16107 fetch_fsmap learned FSMap version 25 2024-09-21T03:45:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.820+0000 7fb315377740 1 -- 172.21.15.84:0/3876259617 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55802e19dba0 con 0x55802dddc070 2024-09-21T03:45:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.821+0000 7fb2e7fff640 1 -- 172.21.15.84:0/3876259617 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2fc0316a0 con 0x55802dddc070 2024-09-21T03:45:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.821+0000 7fb2e7fff640 1 -- 172.21.15.84:0/3876259617 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb3000269f0 con 0x55802dddc070 2024-09-21T03:45:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.821+0000 7fb315377740 10 client.16107 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:45:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.821+0000 7fb315377740 10 client.16107 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:45:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.821+0000 7fb315377740 20 client.16107 populate_metadata read hostname 'smithi084' 2024-09-21T03:45:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.821+0000 7fb315377740 1 --2- 172.21.15.84:0/3876259617 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55802dd9a9f0 0x55802e1a1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.821+0000 7fb315377740 4 client.16107 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:45:40.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.821+0000 7fb315377740 1 -- 172.21.15.84:0/3876259617 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55802e0fbdf0 con 0x55802dd9a9f0 2024-09-21T03:45:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.821+0000 7fb30cb9f640 1 --2- 172.21.15.84:0/3876259617 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55802dd9a9f0 0x55802e1a1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.822+0000 7fb2e7fff640 10 client.16107 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:45:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.822+0000 7fb30cb9f640 1 --2- 172.21.15.84:0/3876259617 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55802dd9a9f0 0x55802e1a1040 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=635417cf3e7f7cf7 server_cookie=e6f5acc87a724a80 in_seq=0 out_seq=0 2024-09-21T03:45:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.822+0000 7fb2e7fff640 1 -- 172.21.15.84:0/3876259617 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55802e0fbdf0 con 0x55802dd9a9f0 2024-09-21T03:45:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.822+0000 7fb2e7fff640 10 client.16107 handle_command_reply: tid=0 2024-09-21T03:45:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.823+0000 7fb315377740 1 client.16107 shutdown 2024-09-21T03:45:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.823+0000 7fb315377740 1 -- 172.21.15.84:0/3876259617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 msgr2=0x55802e18f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.823+0000 7fb315377740 1 --2- 172.21.15.84:0/3876259617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 0x55802e18f800 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb300010ec0 tx=0x7fb300007590 comp rx=0 tx=0).stop 2024-09-21T03:45:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.823+0000 7fb315377740 1 -- 172.21.15.84:0/3876259617 shutdown_connections 2024-09-21T03:45:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.823+0000 7fb315377740 1 --2- 172.21.15.84:0/3876259617 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55802dd9a9f0 0x55802e1a1040 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.823+0000 7fb315377740 1 --2- 172.21.15.84:0/3876259617 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 0x55802e18f800 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.823+0000 7fb2e7fff640 0 client.16107 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:45:40.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.823+0000 7fb315377740 1 --2- 172.21.15.84:0/3876259617 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55802ddbb390 0x55802e18f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.823+0000 7fb315377740 1 --2- 172.21.15.84:0/3876259617 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802ddb31b0 0x55802e18ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.823+0000 7fb315377740 1 -- 172.21.15.84:0/3876259617 >> 172.21.15.84:0/3876259617 conn(0x55802ddd0460 msgr2=0x55802e186830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:40.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.823+0000 7fb315377740 1 -- 172.21.15.84:0/3876259617 shutdown_connections 2024-09-21T03:45:40.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.823+0000 7fb315377740 1 -- 172.21.15.84:0/3876259617 wait complete. 2024-09-21T03:45:40.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.823+0000 7fb315377740 20 client.16107 trim_cache size 0 max 16384 2024-09-21T03:45:40.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.836+0000 7fb315377740 1 Processor -- start 2024-09-21T03:45:40.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.836+0000 7fb315377740 1 -- start start 2024-09-21T03:45:40.845 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.836+0000 7fb315377740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802ddb31b0 0x55802e184de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:40.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.836+0000 7fb315377740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55802ddbb390 0x55802e18bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:40.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.836+0000 7fb315377740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 0x55802e18c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:40.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.836+0000 7fb315377740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081afb30 con 0x55802dddc070 2024-09-21T03:45:40.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.836+0000 7fb315377740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081ad400 con 0x55802ddb31b0 2024-09-21T03:45:40.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.836+0000 7fb315377740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081ab250 con 0x55802ddbb390 2024-09-21T03:45:40.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.836+0000 7fb30d3a0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 0x55802e18c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:40.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.836+0000 7fb30d3a0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 0x55802e18c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51342/0 (socket says 172.21.15.84:51342) 2024-09-21T03:45:40.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.836+0000 7fb30d3a0640 1 -- 172.21.15.84:0/1128811567 learned_addr learned my addr 172.21.15.84:0/1128811567 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:40.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.837+0000 7fb30cb9f640 1 --2- 172.21.15.84:0/1128811567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802ddb31b0 0x55802e184de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:40.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.837+0000 7fb30d3a0640 1 -- 172.21.15.84:0/1128811567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55802ddbb390 msgr2=0x55802e18bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:40.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.837+0000 7fb30d3a0640 1 --2- 172.21.15.84:0/1128811567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55802ddbb390 0x55802e18bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.837+0000 7fb30d3a0640 1 -- 172.21.15.84:0/1128811567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802ddb31b0 msgr2=0x55802e184de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:40.846 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.837+0000 7fb30d3a0640 1 --2- 172.21.15.84:0/1128811567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802ddb31b0 0x55802e184de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.837+0000 7fb30d3a0640 1 -- 172.21.15.84:0/1128811567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55802e185990 con 0x55802dddc070 2024-09-21T03:45:40.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.837+0000 7fb30cb9f640 1 --2- 172.21.15.84:0/1128811567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802ddb31b0 0x55802e184de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:45:40.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.837+0000 7fb30d3a0640 1 --2- 172.21.15.84:0/1128811567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 0x55802e18c470 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb300010910 tx=0x7fb300007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3707a50b51ab5392 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:40.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.837+0000 7fb2f27fc640 1 -- 172.21.15.84:0/1128811567 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30001d420 con 0x55802dddc070 2024-09-21T03:45:40.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.837+0000 7fb2f27fc640 1 -- 172.21.15.84:0/1128811567 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb300021070 con 0x55802dddc070 2024-09-21T03:45:40.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.837+0000 7fb2f27fc640 1 -- 172.21.15.84:0/1128811567 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3000266d0 con 0x55802dddc070 2024-09-21T03:45:40.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.838+0000 7fb315377740 1 -- 172.21.15.84:0/1128811567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 msgr2=0x55802e18c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:40.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.838+0000 7fb315377740 1 --2- 172.21.15.84:0/1128811567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 0x55802e18c470 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb300010910 tx=0x7fb300007860 comp rx=0 tx=0).stop 2024-09-21T03:45:40.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.838+0000 7fb315377740 1 -- 172.21.15.84:0/1128811567 shutdown_connections 2024-09-21T03:45:40.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.838+0000 7fb315377740 1 --2- 172.21.15.84:0/1128811567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 0x55802e18c470 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.838+0000 7fb315377740 1 --2- 172.21.15.84:0/1128811567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55802ddbb390 0x55802e18bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.838+0000 7fb315377740 1 --2- 172.21.15.84:0/1128811567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802ddb31b0 0x55802e184de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.847 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.838+0000 7fb315377740 1 -- 172.21.15.84:0/1128811567 >> 172.21.15.84:0/1128811567 conn(0x55802ddd0460 msgr2=0x55802e1846d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:40.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.838+0000 7fb315377740 1 -- 172.21.15.84:0/1128811567 shutdown_connections 2024-09-21T03:45:40.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.838+0000 7fb315377740 1 -- 172.21.15.84:0/1128811567 wait complete. 2024-09-21T03:45:40.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.838+0000 7fb315377740 1 -- start start 2024-09-21T03:45:40.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.838+0000 7fb315377740 1 Processor -- start 2024-09-21T03:45:40.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.839+0000 7fb315377740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55802ddb31b0 0x55802e193720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:40.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.839+0000 7fb315377740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802ddbb390 0x55802e193c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:40.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.839+0000 7fb315377740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 0x55802e20aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:40.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.839+0000 7fb315377740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081ab8c0 con 0x55802dddc070 2024-09-21T03:45:40.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.839+0000 7fb315377740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081acd30 con 0x55802ddbb390 2024-09-21T03:45:40.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.839+0000 7fb315377740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb3081abf90 con 0x55802ddb31b0 2024-09-21T03:45:40.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.839+0000 7fb315377740 10 client.0 _ll_register_callbacks cb 0x7fb300007e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:45:40.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.839+0000 7fb30d3a0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 0x55802e20aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:40.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.839+0000 7fb30d3a0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 0x55802e20aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51348/0 (socket says 172.21.15.84:51348) 2024-09-21T03:45:40.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.839+0000 7fb30d3a0640 1 -- 172.21.15.84:0/2581363023 learned_addr learned my addr 172.21.15.84:0/2581363023 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.839+0000 7fb30cb9f640 1 --2- 172.21.15.84:0/2581363023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55802ddb31b0 0x55802e193720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.839+0000 7fb307fff640 1 --2- 172.21.15.84:0/2581363023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802ddbb390 0x55802e193c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.839+0000 7fb30d3a0640 1 -- 172.21.15.84:0/2581363023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55802ddb31b0 msgr2=0x55802e193720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.839+0000 7fb30d3a0640 1 --2- 172.21.15.84:0/2581363023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55802ddb31b0 0x55802e193720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.839+0000 7fb30d3a0640 1 -- 172.21.15.84:0/2581363023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802ddbb390 msgr2=0x55802e193c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.839+0000 7fb30d3a0640 1 --2- 172.21.15.84:0/2581363023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802ddbb390 0x55802e193c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.839+0000 7fb30d3a0640 1 -- 172.21.15.84:0/2581363023 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55802e20af40 con 0x55802dddc070 2024-09-21T03:45:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.839+0000 7fb30cb9f640 1 --2- 172.21.15.84:0/2581363023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55802ddb31b0 0x55802e193720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:45:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.839+0000 7fb30d3a0640 1 --2- 172.21.15.84:0/2581363023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 0x55802e20aa00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb300012e80 tx=0x7fb30001cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8dd354342360ce4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.839+0000 7fb2e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:45:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.840+0000 7fb2e7fff640 1 -- 172.21.15.84:0/2581363023 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300047060 con 0x55802dddc070 2024-09-21T03:45:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.840+0000 7fb2e7fff640 1 -- 172.21.15.84:0/2581363023 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fb30001c7c0 con 0x55802dddc070 2024-09-21T03:45:40.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.840+0000 7fb315377740 1 -- 172.21.15.84:0/2581363023 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb300021070 con 0x55802dddc070 2024-09-21T03:45:40.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.840+0000 7fb2e7fff640 1 -- 172.21.15.84:0/2581363023 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb30001c9c0 con 0x55802dddc070 2024-09-21T03:45:40.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.840+0000 7fb315377740 10 client.16113 fetch_fsmap learned FSMap version 25 2024-09-21T03:45:40.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.840+0000 7fb315377740 1 -- 172.21.15.84:0/2581363023 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55802e20c090 con 0x55802dddc070 2024-09-21T03:45:40.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.840+0000 7fb2e7fff640 1 -- 172.21.15.84:0/2581363023 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb300021070 con 0x55802dddc070 2024-09-21T03:45:40.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.840+0000 7fb2e7fff640 1 -- 172.21.15.84:0/2581363023 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb30001d6f0 con 0x55802dddc070 2024-09-21T03:45:40.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.840+0000 7fb315377740 10 client.16113 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:45:40.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.840+0000 7fb315377740 10 client.16113 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:45:40.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.840+0000 7fb315377740 20 client.16113 populate_metadata read hostname 'smithi084' 2024-09-21T03:45:40.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.840+0000 7fb315377740 1 --2- 172.21.15.84:0/2581363023 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55802dd6fda0 0x55802e20e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:40.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.840+0000 7fb315377740 4 client.16113 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:45:40.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.840+0000 7fb315377740 1 -- 172.21.15.84:0/2581363023 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55802e0f78a0 con 0x55802dd6fda0 2024-09-21T03:45:40.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.840+0000 7fb30cb9f640 1 --2- 172.21.15.84:0/2581363023 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55802dd6fda0 0x55802e20e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:40.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.841+0000 7fb30cb9f640 1 --2- 172.21.15.84:0/2581363023 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55802dd6fda0 0x55802e20e710 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=94190cca20cb73d8 server_cookie=c1f8f582779c586 in_seq=0 out_seq=0 2024-09-21T03:45:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.841+0000 7fb2e7fff640 10 client.16113 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:45:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.841+0000 7fb2e7fff640 1 -- 172.21.15.84:0/2581363023 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55802e0f78a0 con 0x55802dd6fda0 2024-09-21T03:45:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.841+0000 7fb2e7fff640 10 client.16113 handle_command_reply: tid=0 2024-09-21T03:45:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.841+0000 7fb315377740 1 client.16113 shutdown 2024-09-21T03:45:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.841+0000 7fb315377740 1 -- 172.21.15.84:0/2581363023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 msgr2=0x55802e20aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.841+0000 7fb315377740 1 --2- 172.21.15.84:0/2581363023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 0x55802e20aa00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb300012e80 tx=0x7fb30001cef0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.841+0000 7fb315377740 1 -- 172.21.15.84:0/2581363023 shutdown_connections 2024-09-21T03:45:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.841+0000 7fb315377740 1 --2- 172.21.15.84:0/2581363023 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55802dd6fda0 0x55802e20e710 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.841+0000 7fb315377740 1 --2- 172.21.15.84:0/2581363023 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55802dddc070 0x55802e20aa00 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.841+0000 7fb315377740 1 --2- 172.21.15.84:0/2581363023 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55802ddbb390 0x55802e193c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.841+0000 7fb315377740 1 --2- 172.21.15.84:0/2581363023 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55802ddb31b0 0x55802e193720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.841+0000 7fb2e7fff640 0 client.16113 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:45:40.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.841+0000 7fb315377740 1 -- 172.21.15.84:0/2581363023 >> 172.21.15.84:0/2581363023 conn(0x55802ddd0460 msgr2=0x55802e190bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:40.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.841+0000 7fb315377740 1 -- 172.21.15.84:0/2581363023 shutdown_connections 2024-09-21T03:45:40.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.841+0000 7fb315377740 1 -- 172.21.15.84:0/2581363023 wait complete. 2024-09-21T03:45:40.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.842+0000 7fb315377740 20 client.16113 trim_cache size 0 max 16384 2024-09-21T03:45:40.852 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:45:40.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.842+0000 7fb30ee03640 1 -- 172.21.15.84:0/806092995 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2f80b66b0 msgr2=0x7fb2f80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:40.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.842+0000 7fb30ee03640 1 --2- 172.21.15.84:0/806092995 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2f80b66b0 0x7fb2f80b8bc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb3000124d0 tx=0x7fb300004ab0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.842+0000 7fb30ee03640 1 -- 172.21.15.84:0/806092995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb308109560 msgr2=0x7fb30819aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:40.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.842+0000 7fb30ee03640 1 --2- 172.21.15.84:0/806092995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb308109560 0x7fb30819aa80 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400c8c0 tx=0x7fb2f400cd80 comp rx=0 tx=0).stop 2024-09-21T03:45:40.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.842+0000 7fb30ee03640 1 -- 172.21.15.84:0/806092995 shutdown_connections 2024-09-21T03:45:40.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.842+0000 7fb30ee03640 1 --2- 172.21.15.84:0/806092995 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2f80b66b0 0x7fb2f80b8bc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.842+0000 7fb30ee03640 1 --2- 172.21.15.84:0/806092995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb308109eb0 0x7fb30819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.842+0000 7fb30ee03640 1 --2- 172.21.15.84:0/806092995 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb308109560 0x7fb30819aa80 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.842+0000 7fb30ee03640 1 --2- 172.21.15.84:0/806092995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb308102080 0x7fb30819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:40.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.842+0000 7fb30ee03640 1 -- 172.21.15.84:0/806092995 >> 172.21.15.84:0/806092995 conn(0x7fb308079ec0 msgr2=0x7fb308107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:40.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.842+0000 7fb30ee03640 1 -- 172.21.15.84:0/806092995 shutdown_connections 2024-09-21T03:45:40.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:40.842+0000 7fb30ee03640 1 -- 172.21.15.84:0/806092995 wait complete. 2024-09-21T03:45:41.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:41 smithi084 ceph-mon[30941]: pgmap v420: 97 pgs: 97 active+clean; 3.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-21T03:45:41.657 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:45:41.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:41 smithi174 ceph-mon[34403]: pgmap v420: 97 pgs: 97 active+clean; 3.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-21T03:45:41.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:41 smithi172 ceph-mon[34821]: pgmap v420: 97 pgs: 97 active+clean; 3.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-21T03:45:41.917 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:45:42.474 INFO:tasks.workunit.client.0.smithi084.stdout:64/600: open fd = 3 2024-09-21T03:45:42.474 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.474 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.475 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.475 INFO:tasks.workunit.client.0.smithi084.stdout:65/600: open fd = 3 2024-09-21T03:45:42.475 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.475 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.475 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.475 INFO:tasks.workunit.client.0.smithi084.stdout:66/600: open fd = 3 2024-09-21T03:45:42.475 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.475 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.475 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.475 INFO:tasks.workunit.client.0.smithi084.stdout:67/600: open fd = 3 2024-09-21T03:45:42.475 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.475 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.475 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.475 INFO:tasks.workunit.client.0.smithi084.stdout:68/600: open fd = 3 2024-09-21T03:45:42.476 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.476 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.476 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.476 INFO:tasks.workunit.client.0.smithi084.stdout:69/600: open fd = 3 2024-09-21T03:45:42.476 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.476 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.476 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.476 INFO:tasks.workunit.client.0.smithi084.stdout:70/600: open fd = 3 2024-09-21T03:45:42.476 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.476 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.476 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.476 INFO:tasks.workunit.client.0.smithi084.stdout:71/600: open fd = 3 2024-09-21T03:45:42.476 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.476 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.476 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.477 INFO:tasks.workunit.client.0.smithi084.stdout:72/600: open fd = 3 2024-09-21T03:45:42.477 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.477 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.477 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.477 INFO:tasks.workunit.client.0.smithi084.stdout:73/600: open fd = 3 2024-09-21T03:45:42.477 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.477 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.477 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.477 INFO:tasks.workunit.client.0.smithi084.stdout:74/600: open fd = 3 2024-09-21T03:45:42.477 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.477 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.477 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.477 INFO:tasks.workunit.client.0.smithi084.stdout:75/600: open fd = 3 2024-09-21T03:45:42.477 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.478 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.478 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.478 INFO:tasks.workunit.client.0.smithi084.stdout:76/600: open fd = 3 2024-09-21T03:45:42.478 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.478 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.478 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.478 INFO:tasks.workunit.client.0.smithi084.stdout:77/600: open fd = 3 2024-09-21T03:45:42.478 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.478 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.478 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.478 INFO:tasks.workunit.client.0.smithi084.stdout:78/600: open fd = 3 2024-09-21T03:45:42.478 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.478 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.478 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.479 INFO:tasks.workunit.client.0.smithi084.stdout:79/600: open fd = 3 2024-09-21T03:45:42.479 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.479 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.479 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.479 INFO:tasks.workunit.client.0.smithi084.stdout:80/600: open fd = 3 2024-09-21T03:45:42.479 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.479 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.479 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.479 INFO:tasks.workunit.client.0.smithi084.stdout:81/600: open fd = 3 2024-09-21T03:45:42.479 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.479 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.479 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.479 INFO:tasks.workunit.client.0.smithi084.stdout:82/600: open fd = 3 2024-09-21T03:45:42.479 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.479 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.480 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.480 INFO:tasks.workunit.client.0.smithi084.stdout:83/600: open fd = 3 2024-09-21T03:45:42.480 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.480 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.480 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.480 INFO:tasks.workunit.client.0.smithi084.stdout:84/600: open fd = 3 2024-09-21T03:45:42.480 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.480 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.480 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.480 INFO:tasks.workunit.client.0.smithi084.stdout:85/600: open fd = 3 2024-09-21T03:45:42.480 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.480 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.480 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.480 INFO:tasks.workunit.client.0.smithi084.stdout:86/600: open fd = 3 2024-09-21T03:45:42.480 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.481 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.481 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.481 INFO:tasks.workunit.client.0.smithi084.stdout:87/600: open fd = 3 2024-09-21T03:45:42.481 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.481 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.481 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.481 INFO:tasks.workunit.client.0.smithi084.stdout:88/600: open fd = 3 2024-09-21T03:45:42.481 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.481 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.481 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.481 INFO:tasks.workunit.client.0.smithi084.stdout:89/600: open fd = 3 2024-09-21T03:45:42.481 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.481 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.481 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.481 INFO:tasks.workunit.client.0.smithi084.stdout:90/600: open fd = 3 2024-09-21T03:45:42.482 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.482 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.482 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.482 INFO:tasks.workunit.client.0.smithi084.stdout:91/600: open fd = 3 2024-09-21T03:45:42.482 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.482 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.482 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.482 INFO:tasks.workunit.client.0.smithi084.stdout:92/600: open fd = 3 2024-09-21T03:45:42.482 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.482 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.482 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.482 INFO:tasks.workunit.client.0.smithi084.stdout:93/600: open fd = 3 2024-09-21T03:45:42.483 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.483 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.483 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.483 INFO:tasks.workunit.client.0.smithi084.stdout:94/600: open fd = 3 2024-09-21T03:45:42.483 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.483 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.483 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.483 INFO:tasks.workunit.client.0.smithi084.stdout:95/600: open fd = 3 2024-09-21T03:45:42.483 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.483 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.483 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.483 INFO:tasks.workunit.client.0.smithi084.stdout:96/600: open fd = 3 2024-09-21T03:45:42.483 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.483 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.483 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.484 INFO:tasks.workunit.client.0.smithi084.stdout:97/600: open fd = 3 2024-09-21T03:45:42.484 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.484 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.484 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.484 INFO:tasks.workunit.client.0.smithi084.stdout:98/600: open fd = 3 2024-09-21T03:45:42.484 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.484 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.484 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.484 INFO:tasks.workunit.client.0.smithi084.stdout:99/600: open fd = 3 2024-09-21T03:45:42.484 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.484 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.484 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.484 INFO:tasks.workunit.client.0.smithi084.stdout:100/600: open fd = 3 2024-09-21T03:45:42.484 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.484 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.484 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.484 INFO:tasks.workunit.client.0.smithi084.stdout:101/600: open fd = 3 2024-09-21T03:45:42.485 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.485 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.485 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.485 INFO:tasks.workunit.client.0.smithi084.stdout:102/600: open fd = 3 2024-09-21T03:45:42.485 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.485 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.485 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.485 INFO:tasks.workunit.client.0.smithi084.stdout:103/600: open fd = 3 2024-09-21T03:45:42.485 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.485 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.485 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.485 INFO:tasks.workunit.client.0.smithi084.stdout:104/600: open fd = 3 2024-09-21T03:45:42.485 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.485 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.485 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.486 INFO:tasks.workunit.client.0.smithi084.stdout:105/600: open fd = 3 2024-09-21T03:45:42.486 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.486 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.486 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.486 INFO:tasks.workunit.client.0.smithi084.stdout:106/600: open fd = 3 2024-09-21T03:45:42.486 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.486 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.486 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.486 INFO:tasks.workunit.client.0.smithi084.stdout:107/600: open fd = 3 2024-09-21T03:45:42.486 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.486 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.486 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.486 INFO:tasks.workunit.client.0.smithi084.stdout:108/600: open fd = 3 2024-09-21T03:45:42.486 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.486 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.486 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.487 INFO:tasks.workunit.client.0.smithi084.stdout:109/600: open fd = 3 2024-09-21T03:45:42.487 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.487 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.487 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.487 INFO:tasks.workunit.client.0.smithi084.stdout:110/600: open fd = 3 2024-09-21T03:45:42.487 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.487 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.487 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.487 INFO:tasks.workunit.client.0.smithi084.stdout:111/600: open fd = 3 2024-09-21T03:45:42.487 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.487 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.487 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.487 INFO:tasks.workunit.client.0.smithi084.stdout:112/600: open fd = 3 2024-09-21T03:45:42.487 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.487 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.487 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.488 INFO:tasks.workunit.client.0.smithi084.stdout:113/600: open fd = 3 2024-09-21T03:45:42.488 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.488 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.488 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.488 INFO:tasks.workunit.client.0.smithi084.stdout:114/600: open fd = 3 2024-09-21T03:45:42.488 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.488 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.488 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.488 INFO:tasks.workunit.client.0.smithi084.stdout:115/600: open fd = 3 2024-09-21T03:45:42.488 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.488 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.488 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.488 INFO:tasks.workunit.client.0.smithi084.stdout:116/600: open fd = 3 2024-09-21T03:45:42.488 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.489 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.489 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.489 INFO:tasks.workunit.client.0.smithi084.stdout:117/600: open fd = 3 2024-09-21T03:45:42.489 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.489 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.489 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.489 INFO:tasks.workunit.client.0.smithi084.stdout:118/600: open fd = 3 2024-09-21T03:45:42.489 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.489 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.489 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.489 INFO:tasks.workunit.client.0.smithi084.stdout:119/600: open fd = 3 2024-09-21T03:45:42.489 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.489 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.489 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.490 INFO:tasks.workunit.client.0.smithi084.stdout:120/600: open fd = 3 2024-09-21T03:45:42.490 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.490 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.490 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.490 INFO:tasks.workunit.client.0.smithi084.stdout:121/600: open fd = 3 2024-09-21T03:45:42.490 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.490 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.490 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.490 INFO:tasks.workunit.client.0.smithi084.stdout:122/600: open fd = 3 2024-09-21T03:45:42.490 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.490 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.490 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.490 INFO:tasks.workunit.client.0.smithi084.stdout:123/600: open fd = 3 2024-09-21T03:45:42.490 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.490 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.491 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.491 INFO:tasks.workunit.client.0.smithi084.stdout:124/600: open fd = 3 2024-09-21T03:45:42.491 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.491 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.491 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.491 INFO:tasks.workunit.client.0.smithi084.stdout:125/600: open fd = 3 2024-09-21T03:45:42.491 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.491 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.491 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:45:42.491 INFO:tasks.workunit.client.0.smithi084.stdout:126/600: open fd = 3 2024-09-21T03:45:42.491 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:45:42.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.472+0000 7f1f0fb7f640 1 -- 172.21.15.84:0/1417320201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f08108d20 msgr2=0x7f1f0810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:42.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.472+0000 7f1f0fb7f640 1 --2- 172.21.15.84:0/1417320201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f08108d20 0x7f1f0810f550 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009900 tx=0x7f1f0002a410 comp rx=0 tx=0).stop 2024-09-21T03:45:42.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.472+0000 7f1f0fb7f640 1 -- 172.21.15.84:0/1417320201 shutdown_connections 2024-09-21T03:45:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.472+0000 7f1f0fb7f640 1 --2- 172.21.15.84:0/1417320201 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f08108d20 0x7f1f0810f550 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.472+0000 7f1f0fb7f640 1 --2- 172.21.15.84:0/1417320201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f081083d0 0x7f1f081087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.472+0000 7f1f0fb7f640 1 --2- 172.21.15.84:0/1417320201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f08102ae0 0x7f1f08102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.472+0000 7f1f0fb7f640 1 -- 172.21.15.84:0/1417320201 >> 172.21.15.84:0/1417320201 conn(0x7f1f08079790 msgr2=0x7f1f08079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.472+0000 7f1f0fb7f640 1 -- 172.21.15.84:0/1417320201 shutdown_connections 2024-09-21T03:45:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.472+0000 7f1f0fb7f640 1 -- 172.21.15.84:0/1417320201 wait complete. 2024-09-21T03:45:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.472+0000 7f1f0fb7f640 1 Processor -- start 2024-09-21T03:45:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.473+0000 7f1f0fb7f640 1 -- start start 2024-09-21T03:45:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.473+0000 7f1f0fb7f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f08102ae0 0x7f1f0819b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.473+0000 7f1f0fb7f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f081083d0 0x7f1f0819b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.473+0000 7f1f0fb7f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f08108d20 0x7f1f0819bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.473+0000 7f1f0fb7f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f081129e0 con 0x7f1f08108d20 2024-09-21T03:45:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.473+0000 7f1f0fb7f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1f08112860 con 0x7f1f081083d0 2024-09-21T03:45:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.473+0000 7f1f0fb7f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1f08112b60 con 0x7f1f08102ae0 2024-09-21T03:45:42.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.473+0000 7f1f0e11c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f08108d20 0x7f1f0819bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.473+0000 7f1f0e11c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f08108d20 0x7f1f0819bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51368/0 (socket says 172.21.15.84:51368) 2024-09-21T03:45:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.473+0000 7f1f0e11c640 1 -- 172.21.15.84:0/1853961912 learned_addr learned my addr 172.21.15.84:0/1853961912 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.473+0000 7f1f0d11a640 1 --2- 172.21.15.84:0/1853961912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f081083d0 0x7f1f0819b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.473+0000 7f1f0d91b640 1 --2- 172.21.15.84:0/1853961912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f08102ae0 0x7f1f0819b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.473+0000 7f1f0e11c640 1 -- 172.21.15.84:0/1853961912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f08102ae0 msgr2=0x7f1f0819b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.473+0000 7f1f0e11c640 1 --2- 172.21.15.84:0/1853961912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f08102ae0 0x7f1f0819b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.473+0000 7f1f0e11c640 1 -- 172.21.15.84:0/1853961912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f081083d0 msgr2=0x7f1f0819b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.473+0000 7f1f0e11c640 1 --2- 172.21.15.84:0/1853961912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f081083d0 0x7f1f0819b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.473+0000 7f1f0e11c640 1 -- 172.21.15.84:0/1853961912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f081a64f0 con 0x7f1f08108d20 2024-09-21T03:45:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.473+0000 7f1f0d91b640 1 --2- 172.21.15.84:0/1853961912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f08102ae0 0x7f1f0819b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:45:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.473+0000 7f1f0e11c640 1 --2- 172.21.15.84:0/1853961912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f08108d20 0x7f1f0819bcf0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1f00004770 tx=0x7f1f00004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.474+0000 7f1f06ffd640 1 -- 172.21.15.84:0/1853961912 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0003f030 con 0x7f1f08108d20 2024-09-21T03:45:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.474+0000 7f1f06ffd640 1 -- 172.21.15.84:0/1853961912 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f00003aa0 con 0x7f1f08108d20 2024-09-21T03:45:42.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.474+0000 7f1f06ffd640 1 -- 172.21.15.84:0/1853961912 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f00035070 con 0x7f1f08108d20 2024-09-21T03:45:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.474+0000 7f1f0fb7f640 1 -- 172.21.15.84:0/1853961912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f081a6780 con 0x7f1f08108d20 2024-09-21T03:45:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.474+0000 7f1f0fb7f640 1 -- 172.21.15.84:0/1853961912 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f081a6cb0 con 0x7f1f08108d20 2024-09-21T03:45:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.476+0000 7f1f160f3740 1 Processor -- start 2024-09-21T03:45:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.476+0000 7f1f06ffd640 1 -- 172.21.15.84:0/1853961912 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f1f00042030 con 0x7f1f08108d20 2024-09-21T03:45:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.476+0000 7f1f160f3740 1 -- start start 2024-09-21T03:45:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.477+0000 7f1f160f3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018ba3070 0x55c018f4a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.477+0000 7f1f160f3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018b7a1b0 0x55c018f4abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.477+0000 7f1f160f3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 0x55c018f4b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.477+0000 7f1f160f3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c018ec0ea0 con 0x55c018b82390 2024-09-21T03:45:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.477+0000 7f1f160f3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c018eb02d0 con 0x55c018ba3070 2024-09-21T03:45:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.477+0000 7f1f160f3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c018eb40e0 con 0x55c018b7a1b0 2024-09-21T03:45:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.477+0000 7f1f0d11a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018ba3070 0x55c018f4a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.477+0000 7f1f0d11a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 0x55c018f4b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.477+0000 7f1f0d11a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 0x55c018f4b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51370/0 (socket says 172.21.15.84:51370) 2024-09-21T03:45:42.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.477+0000 7f1f0d11a640 1 -- 172.21.15.84:0/1036613072 learned_addr learned my addr 172.21.15.84:0/1036613072 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.477+0000 7f1f06ffd640 1 --2- 172.21.15.84:0/1853961912 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1ef00b6700 0x7f1ef00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.477+0000 7f1f0d91b640 1 --2- 172.21.15.84:0/1036613072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018b7a1b0 0x55c018f4abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.477+0000 7f1f0d11a640 1 -- 172.21.15.84:0/1036613072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018b7a1b0 msgr2=0x55c018f4abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.477+0000 7f1f0d11a640 1 --2- 172.21.15.84:0/1036613072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018b7a1b0 0x55c018f4abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.477+0000 7f1f0e11c640 1 --2- 172.21.15.84:0/1853961912 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1ef00b6700 0x7f1ef00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.477+0000 7f1f0d11a640 1 -- 172.21.15.84:0/1036613072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018ba3070 msgr2=0x55c018f4a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.477+0000 7f1f0d11a640 1 --2- 172.21.15.84:0/1036613072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018ba3070 0x55c018f4a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.477+0000 7f1f0d11a640 1 -- 172.21.15.84:0/1036613072 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c018c0e650 con 0x55c018b82390 2024-09-21T03:45:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.477+0000 7f1f0d91b640 1 --2- 172.21.15.84:0/1036613072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018b7a1b0 0x55c018f4abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:45:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.477+0000 7f1f06ffd640 1 -- 172.21.15.84:0/1853961912 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f1f00107cb0 con 0x7f1f08108d20 2024-09-21T03:45:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.478+0000 7f1f0d11a640 1 --2- 172.21.15.84:0/1036613072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 0x55c018f4b120 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1efc010920 tx=0x7f1efc005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7a985e2d6bd870 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.478+0000 7f1eeffff640 1 -- 172.21.15.84:0/1036613072 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc016030 con 0x55c018b82390 2024-09-21T03:45:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.478+0000 7f1eeffff640 1 -- 172.21.15.84:0/1036613072 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1efc00fc70 con 0x55c018b82390 2024-09-21T03:45:42.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.478+0000 7f1f0e11c640 1 --2- 172.21.15.84:0/1853961912 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1ef00b6700 0x7f1ef00b8c10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1f000cd880 tx=0x7f1f000b5040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.478+0000 7f1eeffff640 1 -- 172.21.15.84:0/1036613072 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc019040 con 0x55c018b82390 2024-09-21T03:45:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.479+0000 7f1f160f3740 1 -- 172.21.15.84:0/1036613072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 msgr2=0x55c018f4b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.479+0000 7f1f160f3740 1 --2- 172.21.15.84:0/1036613072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 0x55c018f4b120 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f1efc010920 tx=0x7f1efc005f90 comp rx=0 tx=0).stop 2024-09-21T03:45:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.479+0000 7f1f160f3740 1 -- 172.21.15.84:0/1036613072 shutdown_connections 2024-09-21T03:45:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.479+0000 7f1f160f3740 1 --2- 172.21.15.84:0/1036613072 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 0x55c018f4b120 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.479+0000 7f1f160f3740 1 --2- 172.21.15.84:0/1036613072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018b7a1b0 0x55c018f4abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.479+0000 7f1f160f3740 1 --2- 172.21.15.84:0/1036613072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018ba3070 0x55c018f4a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.479+0000 7f1f160f3740 1 -- 172.21.15.84:0/1036613072 >> 172.21.15.84:0/1036613072 conn(0x55c018b97460 msgr2=0x55c018f48590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.479+0000 7f1f160f3740 1 -- 172.21.15.84:0/1036613072 shutdown_connections 2024-09-21T03:45:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.479+0000 7f1f160f3740 1 -- 172.21.15.84:0/1036613072 wait complete. 2024-09-21T03:45:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.480+0000 7f1f160f3740 1 -- start start 2024-09-21T03:45:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.480+0000 7f1f160f3740 1 Processor -- start 2024-09-21T03:45:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.480+0000 7f1f160f3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018b7a1b0 0x55c018f5a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.480+0000 7f1f160f3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 0x55c018f5a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:42.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.480+0000 7f1f160f3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018ba3070 0x55c018f664b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.480+0000 7f1f160f3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c018d11700 con 0x55c018b82390 2024-09-21T03:45:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.480+0000 7f1f160f3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c018e4b160 con 0x55c018ba3070 2024-09-21T03:45:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.480+0000 7f1f160f3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c018f5d180 con 0x55c018b7a1b0 2024-09-21T03:45:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.480+0000 7f1f160f3740 10 client.0 _ll_register_callbacks cb 0x55c018e649e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:45:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.480+0000 7f1f0d91b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 0x55c018f5a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.480+0000 7f1f0d91b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 0x55c018f5a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51376/0 (socket says 172.21.15.84:51376) 2024-09-21T03:45:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.480+0000 7f1f0d11a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018b7a1b0 0x55c018f5a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.480+0000 7f1f0d91b640 1 -- 172.21.15.84:0/987188092 learned_addr learned my addr 172.21.15.84:0/987188092 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.480+0000 7f1f0d11a640 1 --2- 172.21.15.84:0/987188092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018ba3070 0x55c018f664b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.481+0000 7f1f0d91b640 1 -- 172.21.15.84:0/987188092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018b7a1b0 msgr2=0x55c018f5a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.481+0000 7f1f0d91b640 1 --2- 172.21.15.84:0/987188092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018b7a1b0 0x55c018f5a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.481+0000 7f1f0d91b640 1 -- 172.21.15.84:0/987188092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018ba3070 msgr2=0x55c018f664b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:42.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.481+0000 7f1f0d91b640 1 --2- 172.21.15.84:0/987188092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018ba3070 0x55c018f664b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.481+0000 7f1f0d91b640 1 -- 172.21.15.84:0/987188092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c018e78c90 con 0x55c018b82390 2024-09-21T03:45:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.481+0000 7f1f0d91b640 1 --2- 172.21.15.84:0/987188092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 0x55c018f5a6a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8010ab0 tx=0x7f1ef8010f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aaa232065297e8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.481+0000 7f1eed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:45:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.481+0000 7f1eed7fa640 1 -- 172.21.15.84:0/987188092 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef800eea0 con 0x55c018b82390 2024-09-21T03:45:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.481+0000 7f1eed7fa640 1 -- 172.21.15.84:0/987188092 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f1ef8004b20 con 0x55c018b82390 2024-09-21T03:45:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.481+0000 7f1f160f3740 1 -- 172.21.15.84:0/987188092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1efc00fc70 con 0x55c018b82390 2024-09-21T03:45:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.481+0000 7f1eed7fa640 1 -- 172.21.15.84:0/987188092 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1ef8004d20 con 0x55c018b82390 2024-09-21T03:45:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.481+0000 7f1f160f3740 10 client.16125 fetch_fsmap learned FSMap version 25 2024-09-21T03:45:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.481+0000 7f1f160f3740 1 -- 172.21.15.84:0/987188092 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c018f68ef0 con 0x55c018b82390 2024-09-21T03:45:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.481+0000 7f1eed7fa640 1 -- 172.21.15.84:0/987188092 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1efc00fc70 con 0x55c018b82390 2024-09-21T03:45:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.482+0000 7f1eed7fa640 1 -- 172.21.15.84:0/987188092 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1ef8025680 con 0x55c018b82390 2024-09-21T03:45:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.482+0000 7f1f160f3740 10 client.16125 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:45:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.482+0000 7f1f160f3740 10 client.16125 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:45:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.482+0000 7f1f160f3740 20 client.16125 populate_metadata read hostname 'smithi084' 2024-09-21T03:45:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.482+0000 7f1f160f3740 1 --2- 172.21.15.84:0/987188092 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c018b619f0 0x55c018f6c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:42.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.482+0000 7f1f160f3740 4 client.16125 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:45:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.482+0000 7f1f160f3740 1 -- 172.21.15.84:0/987188092 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c018ec2df0 con 0x55c018b619f0 2024-09-21T03:45:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.482+0000 7f1f0d11a640 1 --2- 172.21.15.84:0/987188092 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c018b619f0 0x55c018f6c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.482+0000 7f1eed7fa640 10 client.16125 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.482+0000 7f1f0d11a640 1 --2- 172.21.15.84:0/987188092 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c018b619f0 0x55c018f6c3b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b9a00b0c8e13151 server_cookie=788e55f82f24c73d in_seq=0 out_seq=0 2024-09-21T03:45:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.483+0000 7f1eed7fa640 1 -- 172.21.15.84:0/987188092 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c018ec2df0 con 0x55c018b619f0 2024-09-21T03:45:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.483+0000 7f1eed7fa640 10 client.16125 handle_command_reply: tid=0 2024-09-21T03:45:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.483+0000 7f1f160f3740 1 client.16125 shutdown 2024-09-21T03:45:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.483+0000 7f1f160f3740 1 -- 172.21.15.84:0/987188092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 msgr2=0x55c018f5a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.483+0000 7f1f160f3740 1 --2- 172.21.15.84:0/987188092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 0x55c018f5a6a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8010ab0 tx=0x7f1ef8010f70 comp rx=0 tx=0).stop 2024-09-21T03:45:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.483+0000 7f1f160f3740 1 -- 172.21.15.84:0/987188092 shutdown_connections 2024-09-21T03:45:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.483+0000 7f1f160f3740 1 --2- 172.21.15.84:0/987188092 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c018b619f0 0x55c018f6c3b0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.483+0000 7f1f160f3740 1 --2- 172.21.15.84:0/987188092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018ba3070 0x55c018f664b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.483+0000 7f1eed7fa640 0 client.16125 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:42.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.483+0000 7f1f160f3740 1 --2- 172.21.15.84:0/987188092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 0x55c018f5a6a0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.483+0000 7f1f160f3740 1 --2- 172.21.15.84:0/987188092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018b7a1b0 0x55c018f5a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.483+0000 7f1f160f3740 1 -- 172.21.15.84:0/987188092 >> 172.21.15.84:0/987188092 conn(0x55c018b97460 msgr2=0x55c018f4c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:42.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.483+0000 7f1f160f3740 1 -- 172.21.15.84:0/987188092 shutdown_connections 2024-09-21T03:45:42.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.483+0000 7f1f160f3740 1 -- 172.21.15.84:0/987188092 wait complete. 2024-09-21T03:45:42.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.483+0000 7f1f160f3740 20 client.16125 trim_cache size 0 max 16384 2024-09-21T03:45:42.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.496+0000 7f1f160f3740 1 Processor -- start 2024-09-21T03:45:42.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.496+0000 7f1f160f3740 1 -- start start 2024-09-21T03:45:42.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.496+0000 7f1f160f3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018b7a1b0 0x55c018f55910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:42.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.496+0000 7f1f160f3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018b82390 0x55c018f485c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:42.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.496+0000 7f1f160f3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018ba3070 0x55c018f663b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:42.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.496+0000 7f1f160f3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f081afbc0 con 0x55c018ba3070 2024-09-21T03:45:42.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.496+0000 7f1f160f3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1f081ad490 con 0x55c018b82390 2024-09-21T03:45:42.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.496+0000 7f1f160f3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1f081ab2e0 con 0x55c018b7a1b0 2024-09-21T03:45:42.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.497+0000 7f1f0d11a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018ba3070 0x55c018f663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:42.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.497+0000 7f1f0d11a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018ba3070 0x55c018f663b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51392/0 (socket says 172.21.15.84:51392) 2024-09-21T03:45:42.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.497+0000 7f1f0d11a640 1 -- 172.21.15.84:0/1742789194 learned_addr learned my addr 172.21.15.84:0/1742789194 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:42.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.497+0000 7f1f0d11a640 1 --2- 172.21.15.84:0/1742789194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018b7a1b0 0x55c018f55910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:42.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.497+0000 7f1f0d91b640 1 --2- 172.21.15.84:0/1742789194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018b82390 0x55c018f485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:42.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.497+0000 7f1f0d11a640 1 -- 172.21.15.84:0/1742789194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018b7a1b0 msgr2=0x55c018f55910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:42.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.497+0000 7f1f0d11a640 1 --2- 172.21.15.84:0/1742789194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018b7a1b0 0x55c018f55910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.497+0000 7f1f0d11a640 1 -- 172.21.15.84:0/1742789194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018b82390 msgr2=0x55c018f485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:42.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.497+0000 7f1f0d11a640 1 --2- 172.21.15.84:0/1742789194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018b82390 0x55c018f485c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.497+0000 7f1f0d11a640 1 -- 172.21.15.84:0/1742789194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c018f5afb0 con 0x55c018ba3070 2024-09-21T03:45:42.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.497+0000 7f1f0d11a640 1 --2- 172.21.15.84:0/1742789194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018ba3070 0x55c018f663b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1efc0108f0 tx=0x7f1efc021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19374758937d4499 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:42.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.497+0000 7f1eef7fe640 1 -- 172.21.15.84:0/1742789194 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc016040 con 0x55c018ba3070 2024-09-21T03:45:42.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.497+0000 7f1eef7fe640 1 -- 172.21.15.84:0/1742789194 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1efc00f790 con 0x55c018ba3070 2024-09-21T03:45:42.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.497+0000 7f1eef7fe640 1 -- 172.21.15.84:0/1742789194 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc028040 con 0x55c018ba3070 2024-09-21T03:45:42.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.498+0000 7f1f160f3740 1 -- 172.21.15.84:0/1742789194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018ba3070 msgr2=0x55c018f663b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:42.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.498+0000 7f1f160f3740 1 --2- 172.21.15.84:0/1742789194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018ba3070 0x55c018f663b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1efc0108f0 tx=0x7f1efc021040 comp rx=0 tx=0).stop 2024-09-21T03:45:42.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.498+0000 7f1f160f3740 1 -- 172.21.15.84:0/1742789194 shutdown_connections 2024-09-21T03:45:42.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.498+0000 7f1f160f3740 1 --2- 172.21.15.84:0/1742789194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018ba3070 0x55c018f663b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.498+0000 7f1f160f3740 1 --2- 172.21.15.84:0/1742789194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018b82390 0x55c018f485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.498+0000 7f1f160f3740 1 --2- 172.21.15.84:0/1742789194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018b7a1b0 0x55c018f55910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.498+0000 7f1f160f3740 1 -- 172.21.15.84:0/1742789194 >> 172.21.15.84:0/1742789194 conn(0x55c018b97460 msgr2=0x55c018f47eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:42.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.498+0000 7f1f160f3740 1 -- 172.21.15.84:0/1742789194 shutdown_connections 2024-09-21T03:45:42.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.498+0000 7f1f160f3740 1 -- 172.21.15.84:0/1742789194 wait complete. 2024-09-21T03:45:42.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.499+0000 7f1f160f3740 1 -- start start 2024-09-21T03:45:42.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.499+0000 7f1f160f3740 1 Processor -- start 2024-09-21T03:45:42.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.499+0000 7f1f160f3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018b7a1b0 0x55c018f5e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:42.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.499+0000 7f1f160f3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 0x55c018f5ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:42.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.499+0000 7f1f160f3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018ba3070 0x55c018fd5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:42.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.499+0000 7f1f160f3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1f081ab950 con 0x55c018b82390 2024-09-21T03:45:42.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.499+0000 7f1f160f3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1f081acdc0 con 0x55c018b7a1b0 2024-09-21T03:45:42.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.499+0000 7f1f160f3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1f081ac020 con 0x55c018ba3070 2024-09-21T03:45:42.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.499+0000 7f1f160f3740 10 client.0 _ll_register_callbacks cb 0x7f1ef80076c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:45:42.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.499+0000 7f1f0d91b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 0x55c018f5ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:42.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.499+0000 7f1f0d91b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 0x55c018f5ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51402/0 (socket says 172.21.15.84:51402) 2024-09-21T03:45:42.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.499+0000 7f1f0d91b640 1 -- 172.21.15.84:0/4164360833 learned_addr learned my addr 172.21.15.84:0/4164360833 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:42.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.499+0000 7f1f0d11a640 1 --2- 172.21.15.84:0/4164360833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018ba3070 0x55c018fd5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:42.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.499+0000 7f1f0d11a640 1 --2- 172.21.15.84:0/4164360833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018b7a1b0 0x55c018f5e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:42.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.500+0000 7f1f0d91b640 1 -- 172.21.15.84:0/4164360833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018ba3070 msgr2=0x55c018fd5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:42.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.500+0000 7f1f0d91b640 1 --2- 172.21.15.84:0/4164360833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018ba3070 0x55c018fd5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.500+0000 7f1f0d91b640 1 -- 172.21.15.84:0/4164360833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018b7a1b0 msgr2=0x55c018f5e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:42.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.500+0000 7f1f0d91b640 1 --2- 172.21.15.84:0/4164360833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018b7a1b0 0x55c018f5e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.500+0000 7f1f0d91b640 1 -- 172.21.15.84:0/4164360833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c018f5f480 con 0x55c018b82390 2024-09-21T03:45:42.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.500+0000 7f1f0d11a640 1 --2- 172.21.15.84:0/4164360833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018b7a1b0 0x55c018f5e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:45:42.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.500+0000 7f1f0d91b640 1 --2- 172.21.15.84:0/4164360833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 0x55c018f5ebe0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8010410 tx=0x7f1ef80078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35042f50776c9873 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:42.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.500+0000 7f1eed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:45:42.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.500+0000 7f1eed7fa640 1 -- 172.21.15.84:0/4164360833 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef802b040 con 0x55c018b82390 2024-09-21T03:45:42.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.500+0000 7f1eed7fa640 1 -- 172.21.15.84:0/4164360833 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f1ef8025450 con 0x55c018b82390 2024-09-21T03:45:42.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.500+0000 7f1f160f3740 1 -- 172.21.15.84:0/4164360833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1efc00f790 con 0x55c018b82390 2024-09-21T03:45:42.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.500+0000 7f1eed7fa640 1 -- 172.21.15.84:0/4164360833 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1ef800eea0 con 0x55c018b82390 2024-09-21T03:45:42.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.500+0000 7f1f160f3740 10 client.16131 fetch_fsmap learned FSMap version 25 2024-09-21T03:45:42.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.500+0000 7f1f160f3740 1 -- 172.21.15.84:0/4164360833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c018fd72a0 con 0x55c018b82390 2024-09-21T03:45:42.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.500+0000 7f1eed7fa640 1 -- 172.21.15.84:0/4164360833 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1efc00f790 con 0x55c018b82390 2024-09-21T03:45:42.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.500+0000 7f1eed7fa640 1 -- 172.21.15.84:0/4164360833 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1ef802e070 con 0x55c018b82390 2024-09-21T03:45:42.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.501+0000 7f1f160f3740 10 client.16131 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:45:42.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.501+0000 7f1f160f3740 10 client.16131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:45:42.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.501+0000 7f1f160f3740 20 client.16131 populate_metadata read hostname 'smithi084' 2024-09-21T03:45:42.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.501+0000 7f1f160f3740 1 --2- 172.21.15.84:0/4164360833 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c018b36da0 0x55c018fd9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:42.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.501+0000 7f1f160f3740 4 client.16131 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:45:42.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.501+0000 7f1f160f3740 1 -- 172.21.15.84:0/4164360833 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c018ebe8a0 con 0x55c018b36da0 2024-09-21T03:45:42.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.501+0000 7f1f0d11a640 1 --2- 172.21.15.84:0/4164360833 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c018b36da0 0x55c018fd9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:42.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.501+0000 7f1f0d11a640 1 --2- 172.21.15.84:0/4164360833 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c018b36da0 0x55c018fd9a80 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0162e1560016697 server_cookie=83f044861686b39d in_seq=0 out_seq=0 2024-09-21T03:45:42.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.501+0000 7f1eed7fa640 10 client.16131 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:42.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.501+0000 7f1eed7fa640 1 -- 172.21.15.84:0/4164360833 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c018ebe8a0 con 0x55c018b36da0 2024-09-21T03:45:42.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.501+0000 7f1eed7fa640 10 client.16131 handle_command_reply: tid=0 2024-09-21T03:45:42.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.502+0000 7f1f160f3740 1 client.16131 shutdown 2024-09-21T03:45:42.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.502+0000 7f1f160f3740 1 -- 172.21.15.84:0/4164360833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 msgr2=0x55c018f5ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:42.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.502+0000 7f1f160f3740 1 --2- 172.21.15.84:0/4164360833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 0x55c018f5ebe0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8010410 tx=0x7f1ef80078d0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.502+0000 7f1f160f3740 1 -- 172.21.15.84:0/4164360833 shutdown_connections 2024-09-21T03:45:42.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.502+0000 7f1f160f3740 1 --2- 172.21.15.84:0/4164360833 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c018b36da0 0x55c018fd9a80 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.502+0000 7f1f160f3740 1 --2- 172.21.15.84:0/4164360833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c018ba3070 0x55c018fd5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.502+0000 7f1f160f3740 1 --2- 172.21.15.84:0/4164360833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c018b82390 0x55c018f5ebe0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.502+0000 7f1f160f3740 1 --2- 172.21.15.84:0/4164360833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c018b7a1b0 0x55c018f5e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.502+0000 7f1eed7fa640 0 client.16131 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:42.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.502+0000 7f1f160f3740 1 -- 172.21.15.84:0/4164360833 >> 172.21.15.84:0/4164360833 conn(0x55c018b97460 msgr2=0x55c018f4b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:42.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.502+0000 7f1f160f3740 1 -- 172.21.15.84:0/4164360833 shutdown_connections 2024-09-21T03:45:42.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.502+0000 7f1f160f3740 1 -- 172.21.15.84:0/4164360833 wait complete. 2024-09-21T03:45:42.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.502+0000 7f1f160f3740 20 client.16131 trim_cache size 0 max 16384 2024-09-21T03:45:42.514 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:45:42.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.502+0000 7f1f0fb7f640 1 -- 172.21.15.84:0/1853961912 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1ef00b6700 msgr2=0x7f1ef00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:42.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.502+0000 7f1f0fb7f640 1 --2- 172.21.15.84:0/1853961912 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1ef00b6700 0x7f1ef00b8c10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1f000cd880 tx=0x7f1f000b5040 comp rx=0 tx=0).stop 2024-09-21T03:45:42.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.502+0000 7f1f0fb7f640 1 -- 172.21.15.84:0/1853961912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f08108d20 msgr2=0x7f1f0819bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:42.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.502+0000 7f1f0fb7f640 1 --2- 172.21.15.84:0/1853961912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f08108d20 0x7f1f0819bcf0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1f00004770 tx=0x7f1f00004270 comp rx=0 tx=0).stop 2024-09-21T03:45:42.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.503+0000 7f1f0fb7f640 1 -- 172.21.15.84:0/1853961912 shutdown_connections 2024-09-21T03:45:42.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.503+0000 7f1f0fb7f640 1 --2- 172.21.15.84:0/1853961912 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f1ef00b6700 0x7f1ef00b8c10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.503+0000 7f1f0fb7f640 1 --2- 172.21.15.84:0/1853961912 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1f08108d20 0x7f1f0819bcf0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.503+0000 7f1f0fb7f640 1 --2- 172.21.15.84:0/1853961912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f081083d0 0x7f1f0819b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.503+0000 7f1f0fb7f640 1 --2- 172.21.15.84:0/1853961912 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f08102ae0 0x7f1f0819b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:42.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.503+0000 7f1f0fb7f640 1 -- 172.21.15.84:0/1853961912 >> 172.21.15.84:0/1853961912 conn(0x7f1f08079790 msgr2=0x7f1f08106460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:42.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.503+0000 7f1f0fb7f640 1 -- 172.21.15.84:0/1853961912 shutdown_connections 2024-09-21T03:45:42.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:42.503+0000 7f1f0fb7f640 1 -- 172.21.15.84:0/1853961912 wait complete. 2024-09-21T03:45:42.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:45:42.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:45:42.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:45:42.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:45:42.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:45:42.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:45:42.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:45:42.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:45:42.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:45:42.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:45:42.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:45:42.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:45:43.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:43 smithi084 ceph-mon[30941]: pgmap v421: 97 pgs: 97 active+clean; 3.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-21T03:45:43.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:43 smithi174 ceph-mon[34403]: pgmap v421: 97 pgs: 97 active+clean; 3.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-21T03:45:43.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:43 smithi172 ceph-mon[34821]: pgmap v421: 97 pgs: 97 active+clean; 3.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-09-21T03:45:44.373 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:45:44.374 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:45:44.633 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:45:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.198+0000 7f046fef3640 1 -- 172.21.15.84:0/1958290700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0468109ec0 msgr2=0x7f04681106f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.198+0000 7f046fef3640 1 --2- 172.21.15.84:0/1958290700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0468109ec0 0x7f04681106f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0460009900 tx=0x7f046002a410 comp rx=0 tx=0).stop 2024-09-21T03:45:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.198+0000 7f046fef3640 1 -- 172.21.15.84:0/1958290700 shutdown_connections 2024-09-21T03:45:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.198+0000 7f046fef3640 1 --2- 172.21.15.84:0/1958290700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0468109ec0 0x7f04681106f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.198+0000 7f046fef3640 1 --2- 172.21.15.84:0/1958290700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0468109570 0x7f0468109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.207 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.198+0000 7f046fef3640 1 --2- 172.21.15.84:0/1958290700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0468103c30 0x7f0468104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.198+0000 7f046fef3640 1 -- 172.21.15.84:0/1958290700 >> 172.21.15.84:0/1958290700 conn(0x7f046807b8d0 msgr2=0x7f046807bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.198+0000 7f046fef3640 1 -- 172.21.15.84:0/1958290700 shutdown_connections 2024-09-21T03:45:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.198+0000 7f046fef3640 1 -- 172.21.15.84:0/1958290700 wait complete. 2024-09-21T03:45:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.199+0000 7f046fef3640 1 Processor -- start 2024-09-21T03:45:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.199+0000 7f046fef3640 1 -- start start 2024-09-21T03:45:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.199+0000 7f046fef3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0468103c30 0x7f046819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.199+0000 7f046fef3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0468109570 0x7f046819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.199+0000 7f046fef3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0468109ec0 0x7f046819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.199+0000 7f046fef3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0468113b40 con 0x7f0468103c30 2024-09-21T03:45:45.208 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.199+0000 7f046fef3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f04681139c0 con 0x7f0468109ec0 2024-09-21T03:45:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.199+0000 7f046fef3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0468113cc0 con 0x7f0468109570 2024-09-21T03:45:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.199+0000 7f046dc8f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0468103c30 0x7f046819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.199+0000 7f046dc8f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0468103c30 0x7f046819a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51422/0 (socket says 172.21.15.84:51422) 2024-09-21T03:45:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.199+0000 7f046dc8f640 1 -- 172.21.15.84:0/28730350 learned_addr learned my addr 172.21.15.84:0/28730350 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.200+0000 7f046d48e640 1 --2- 172.21.15.84:0/28730350 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0468109570 0x7f046819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.200+0000 7f046dc8f640 1 -- 172.21.15.84:0/28730350 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0468109570 msgr2=0x7f046819aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.200+0000 7f046dc8f640 1 --2- 172.21.15.84:0/28730350 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0468109570 0x7f046819aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.200+0000 7f046dc8f640 1 -- 172.21.15.84:0/28730350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0468109ec0 msgr2=0x7f046819fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.200+0000 7f046dc8f640 1 --2- 172.21.15.84:0/28730350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0468109ec0 0x7f046819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.200+0000 7f046dc8f640 1 -- 172.21.15.84:0/28730350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04681a0460 con 0x7f0468103c30 2024-09-21T03:45:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.200+0000 7f046dc8f640 1 --2- 172.21.15.84:0/28730350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0468103c30 0x7f046819a4f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f045800ea80 tx=0x7f045800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.200+0000 7f0466ffd640 1 -- 172.21.15.84:0/28730350 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045800ce40 con 0x7f0468103c30 2024-09-21T03:45:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.200+0000 7f0466ffd640 1 -- 172.21.15.84:0/28730350 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0458005020 con 0x7f0468103c30 2024-09-21T03:45:45.209 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.200+0000 7f046fef3640 1 -- 172.21.15.84:0/28730350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04681a0750 con 0x7f0468103c30 2024-09-21T03:45:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.200+0000 7f0466ffd640 1 -- 172.21.15.84:0/28730350 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04580116d0 con 0x7f0468103c30 2024-09-21T03:45:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.200+0000 7f046fef3640 1 -- 172.21.15.84:0/28730350 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04681a6eb0 con 0x7f0468103c30 2024-09-21T03:45:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.203+0000 7f0476467740 1 Processor -- start 2024-09-21T03:45:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.203+0000 7f0466ffd640 1 -- 172.21.15.84:0/28730350 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f04580054d0 con 0x7f0468103c30 2024-09-21T03:45:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.203+0000 7f0476467740 1 -- start start 2024-09-21T03:45:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.203+0000 7f0476467740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55da2220b350 0x55da225b2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.203+0000 7f0476467740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da221e2490 0x55da225b2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.203+0000 7f0476467740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 0x55da225b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.203+0000 7f0476467740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55da22528e60 con 0x55da221ea670 2024-09-21T03:45:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.203+0000 7f0476467740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55da22518290 con 0x55da221e2490 2024-09-21T03:45:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.203+0000 7f0476467740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55da2251c0a0 con 0x55da2220b350 2024-09-21T03:45:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.203+0000 7f046d48e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 0x55da225b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.204+0000 7f046d48e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 0x55da225b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51426/0 (socket says 172.21.15.84:51426) 2024-09-21T03:45:45.210 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.204+0000 7f046d48e640 1 -- 172.21.15.84:0/3835348112 learned_addr learned my addr 172.21.15.84:0/3835348112 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:45.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.204+0000 7f046e490640 1 --2- 172.21.15.84:0/3835348112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55da2220b350 0x55da225b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:45.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.204+0000 7f046dc8f640 1 --2- 172.21.15.84:0/3835348112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da221e2490 0x55da225b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:45.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.204+0000 7f0466ffd640 1 --2- 172.21.15.84:0/28730350 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f04500b6680 0x7f04500b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:45.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.204+0000 7f046d48e640 1 -- 172.21.15.84:0/3835348112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55da2220b350 msgr2=0x55da225b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:45.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.204+0000 7f046d48e640 1 --2- 172.21.15.84:0/3835348112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55da2220b350 0x55da225b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.204+0000 7f046d48e640 1 -- 172.21.15.84:0/3835348112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da221e2490 msgr2=0x55da225b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:45.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.204+0000 7f046d48e640 1 --2- 172.21.15.84:0/3835348112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da221e2490 0x55da225b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.204+0000 7f046d48e640 1 -- 172.21.15.84:0/3835348112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da22276930 con 0x55da221ea670 2024-09-21T03:45:45.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.204+0000 7f046e490640 1 --2- 172.21.15.84:0/28730350 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f04500b6680 0x7f04500b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:45.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.204+0000 7f0466ffd640 1 -- 172.21.15.84:0/28730350 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f04580e7a30 con 0x7f0468103c30 2024-09-21T03:45:45.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.204+0000 7f046d48e640 1 --2- 172.21.15.84:0/3835348112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 0x55da225b2eb0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f045c00b790 tx=0x7f045c00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f486bd91a1f80d84 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:45.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.205+0000 7f044ffff640 1 -- 172.21.15.84:0/3835348112 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c00d950 con 0x55da221ea670 2024-09-21T03:45:45.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.205+0000 7f046e490640 1 --2- 172.21.15.84:0/28730350 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f04500b6680 0x7f04500b8b90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0460009230 tx=0x7f0460009260 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:45.211 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.205+0000 7f044ffff640 1 -- 172.21.15.84:0/3835348112 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f045c018070 con 0x55da221ea670 2024-09-21T03:45:45.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.205+0000 7f044ffff640 1 -- 172.21.15.84:0/3835348112 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c0123e0 con 0x55da221ea670 2024-09-21T03:45:45.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.205+0000 7f0476467740 1 -- 172.21.15.84:0/3835348112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 msgr2=0x55da225b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:45.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.205+0000 7f0476467740 1 --2- 172.21.15.84:0/3835348112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 0x55da225b2eb0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f045c00b790 tx=0x7f045c00bc50 comp rx=0 tx=0).stop 2024-09-21T03:45:45.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.206+0000 7f0476467740 1 -- 172.21.15.84:0/3835348112 shutdown_connections 2024-09-21T03:45:45.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.206+0000 7f0476467740 1 --2- 172.21.15.84:0/3835348112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 0x55da225b2eb0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.206+0000 7f0476467740 1 --2- 172.21.15.84:0/3835348112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da221e2490 0x55da225b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.206+0000 7f0476467740 1 --2- 172.21.15.84:0/3835348112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55da2220b350 0x55da225b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.206+0000 7f0476467740 1 -- 172.21.15.84:0/3835348112 >> 172.21.15.84:0/3835348112 conn(0x55da221ff740 msgr2=0x55da225b0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:45.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.206+0000 7f0476467740 1 -- 172.21.15.84:0/3835348112 shutdown_connections 2024-09-21T03:45:45.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.206+0000 7f0476467740 1 -- 172.21.15.84:0/3835348112 wait complete. 2024-09-21T03:45:45.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.206+0000 7f0476467740 1 -- start start 2024-09-21T03:45:45.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.206+0000 7f0476467740 1 Processor -- start 2024-09-21T03:45:45.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.207+0000 7f0476467740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55da221e2490 0x55da225bdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:45.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.207+0000 7f0476467740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 0x55da225be4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:45.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.207+0000 7f0476467740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da2220b350 0x55da225c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:45.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.207+0000 7f0476467740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55da22379890 con 0x55da221ea670 2024-09-21T03:45:45.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.207+0000 7f0476467740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55da224b2d40 con 0x55da2220b350 2024-09-21T03:45:45.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.207+0000 7f0476467740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55da225c0c10 con 0x55da221e2490 2024-09-21T03:45:45.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.207+0000 7f0476467740 10 client.0 _ll_register_callbacks cb 0x55da22516c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:45:45.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.207+0000 7f046d48e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 0x55da225be4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:45.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.207+0000 7f046d48e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 0x55da225be4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51432/0 (socket says 172.21.15.84:51432) 2024-09-21T03:45:45.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.207+0000 7f046d48e640 1 -- 172.21.15.84:0/1735568867 learned_addr learned my addr 172.21.15.84:0/1735568867 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:45.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.207+0000 7f046dc8f640 1 --2- 172.21.15.84:0/1735568867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55da221e2490 0x55da225bdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:45.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.207+0000 7f046e490640 1 --2- 172.21.15.84:0/1735568867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da2220b350 0x55da225c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:45.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.207+0000 7f046d48e640 1 -- 172.21.15.84:0/1735568867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55da221e2490 msgr2=0x55da225bdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:45.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.207+0000 7f046d48e640 1 --2- 172.21.15.84:0/1735568867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55da221e2490 0x55da225bdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.207+0000 7f046d48e640 1 -- 172.21.15.84:0/1735568867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da2220b350 msgr2=0x55da225c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:45.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.207+0000 7f046d48e640 1 --2- 172.21.15.84:0/1735568867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da2220b350 0x55da225c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.207+0000 7f046d48e640 1 -- 172.21.15.84:0/1735568867 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da225ca490 con 0x55da221ea670 2024-09-21T03:45:45.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.207+0000 7f046e490640 1 --2- 172.21.15.84:0/1735568867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da2220b350 0x55da225c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:45:45.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.207+0000 7f046d48e640 1 --2- 172.21.15.84:0/1735568867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 0x55da225be4e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f045c013b80 tx=0x7f045c014ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1cb45b0696e3a15 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:45.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.207+0000 7f044d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:45:45.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.208+0000 7f044d7fa640 1 -- 172.21.15.84:0/1735568867 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c00d950 con 0x55da221ea670 2024-09-21T03:45:45.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.208+0000 7f044d7fa640 1 -- 172.21.15.84:0/1735568867 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f045c00daf0 con 0x55da221ea670 2024-09-21T03:45:45.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.208+0000 7f0476467740 1 -- 172.21.15.84:0/1735568867 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f045c018070 con 0x55da221ea670 2024-09-21T03:45:45.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.208+0000 7f044d7fa640 1 -- 172.21.15.84:0/1735568867 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f045c00dcf0 con 0x55da221ea670 2024-09-21T03:45:45.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.208+0000 7f0476467740 10 client.16143 fetch_fsmap learned FSMap version 25 2024-09-21T03:45:45.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.208+0000 7f0476467740 1 -- 172.21.15.84:0/1735568867 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55da225ccda0 con 0x55da221ea670 2024-09-21T03:45:45.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.208+0000 7f044d7fa640 1 -- 172.21.15.84:0/1735568867 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f045c018070 con 0x55da221ea670 2024-09-21T03:45:45.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.208+0000 7f044d7fa640 1 -- 172.21.15.84:0/1735568867 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f045c024420 con 0x55da221ea670 2024-09-21T03:45:45.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.208+0000 7f0476467740 10 client.16143 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:45:45.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.208+0000 7f0476467740 10 client.16143 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:45:45.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.208+0000 7f0476467740 20 client.16143 populate_metadata read hostname 'smithi084' 2024-09-21T03:45:45.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.208+0000 7f0476467740 1 --2- 172.21.15.84:0/1735568867 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55da221c9cd0 0x55da225d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:45.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.208+0000 7f0476467740 4 client.16143 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:45:45.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.208+0000 7f0476467740 1 -- 172.21.15.84:0/1735568867 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da2252adb0 con 0x55da221c9cd0 2024-09-21T03:45:45.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.208+0000 7f046dc8f640 1 --2- 172.21.15.84:0/1735568867 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55da221c9cd0 0x55da225d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:45.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.209+0000 7f044d7fa640 10 client.16143 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:45.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.209+0000 7f046dc8f640 1 --2- 172.21.15.84:0/1735568867 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55da221c9cd0 0x55da225d0160 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbcbb16424aa513 server_cookie=76b2819e27ef5551 in_seq=0 out_seq=0 2024-09-21T03:45:45.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.210+0000 7f044d7fa640 1 -- 172.21.15.84:0/1735568867 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55da2252adb0 con 0x55da221c9cd0 2024-09-21T03:45:45.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.210+0000 7f044d7fa640 10 client.16143 handle_command_reply: tid=0 2024-09-21T03:45:45.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.210+0000 7f0476467740 1 client.16143 shutdown 2024-09-21T03:45:45.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.210+0000 7f0476467740 1 -- 172.21.15.84:0/1735568867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 msgr2=0x55da225be4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:45.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.210+0000 7f0476467740 1 --2- 172.21.15.84:0/1735568867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 0x55da225be4e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f045c013b80 tx=0x7f045c014ee0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.210+0000 7f0476467740 1 -- 172.21.15.84:0/1735568867 shutdown_connections 2024-09-21T03:45:45.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.210+0000 7f0476467740 1 --2- 172.21.15.84:0/1735568867 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55da221c9cd0 0x55da225d0160 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.210+0000 7f0476467740 1 --2- 172.21.15.84:0/1735568867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da2220b350 0x55da225c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.210+0000 7f0476467740 1 --2- 172.21.15.84:0/1735568867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 0x55da225be4e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.210+0000 7f044d7fa640 0 client.16143 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.210+0000 7f0476467740 1 --2- 172.21.15.84:0/1735568867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55da221e2490 0x55da225bdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.210+0000 7f0476467740 1 -- 172.21.15.84:0/1735568867 >> 172.21.15.84:0/1735568867 conn(0x55da221ff740 msgr2=0x55da225b55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.210+0000 7f0476467740 1 -- 172.21.15.84:0/1735568867 shutdown_connections 2024-09-21T03:45:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.210+0000 7f0476467740 1 -- 172.21.15.84:0/1735568867 wait complete. 2024-09-21T03:45:45.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.210+0000 7f0476467740 20 client.16143 trim_cache size 0 max 16384 2024-09-21T03:45:45.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.227+0000 7f0476467740 1 Processor -- start 2024-09-21T03:45:45.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.227+0000 7f0476467740 1 -- start start 2024-09-21T03:45:45.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.227+0000 7f0476467740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55da221c9cd0 0x55da225c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:45.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.227+0000 7f0476467740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221e2490 0x55da225bd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:45.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.227+0000 7f0476467740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da221ea670 0x55da225bf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:45.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.227+0000 7f0476467740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f04681b1f50 con 0x55da221e2490 2024-09-21T03:45:45.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.227+0000 7f0476467740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f04681af820 con 0x55da221ea670 2024-09-21T03:45:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.227+0000 7f0476467740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f04681ad670 con 0x55da221c9cd0 2024-09-21T03:45:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.228+0000 7f046d48e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221e2490 0x55da225bd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.228+0000 7f046d48e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221e2490 0x55da225bd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51440/0 (socket says 172.21.15.84:51440) 2024-09-21T03:45:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.228+0000 7f046d48e640 1 -- 172.21.15.84:0/827104519 learned_addr learned my addr 172.21.15.84:0/827104519 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.228+0000 7f046e490640 1 --2- 172.21.15.84:0/827104519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da221ea670 0x55da225bf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.228+0000 7f046dc8f640 1 --2- 172.21.15.84:0/827104519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55da221c9cd0 0x55da225c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.228+0000 7f046d48e640 1 -- 172.21.15.84:0/827104519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55da221c9cd0 msgr2=0x55da225c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.228+0000 7f046d48e640 1 --2- 172.21.15.84:0/827104519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55da221c9cd0 0x55da225c9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.228+0000 7f046d48e640 1 -- 172.21.15.84:0/827104519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da221ea670 msgr2=0x55da225bf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.228+0000 7f046d48e640 1 --2- 172.21.15.84:0/827104519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da221ea670 0x55da225bf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.228+0000 7f046d48e640 1 -- 172.21.15.84:0/827104519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da225b0c10 con 0x55da221e2490 2024-09-21T03:45:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.228+0000 7f046e490640 1 --2- 172.21.15.84:0/827104519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da221ea670 0x55da225bf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:45:45.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.228+0000 7f046d48e640 1 --2- 172.21.15.84:0/827104519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221e2490 0x55da225bd630 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f045c00bc90 tx=0x7f045c006d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75326aeaad4c31b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:45.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.228+0000 7f044f7fe640 1 -- 172.21.15.84:0/827104519 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c00bea0 con 0x55da221e2490 2024-09-21T03:45:45.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.228+0000 7f044f7fe640 1 -- 172.21.15.84:0/827104519 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f045c018040 con 0x55da221e2490 2024-09-21T03:45:45.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.228+0000 7f044f7fe640 1 -- 172.21.15.84:0/827104519 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c024420 con 0x55da221e2490 2024-09-21T03:45:45.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.229+0000 7f0476467740 1 -- 172.21.15.84:0/827104519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221e2490 msgr2=0x55da225bd630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:45.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.229+0000 7f0476467740 1 --2- 172.21.15.84:0/827104519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221e2490 0x55da225bd630 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f045c00bc90 tx=0x7f045c006d10 comp rx=0 tx=0).stop 2024-09-21T03:45:45.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.229+0000 7f0476467740 1 -- 172.21.15.84:0/827104519 shutdown_connections 2024-09-21T03:45:45.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.229+0000 7f0476467740 1 --2- 172.21.15.84:0/827104519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da221ea670 0x55da225bf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.229+0000 7f0476467740 1 --2- 172.21.15.84:0/827104519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221e2490 0x55da225bd630 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.229+0000 7f0476467740 1 --2- 172.21.15.84:0/827104519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55da221c9cd0 0x55da225c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.229+0000 7f0476467740 1 -- 172.21.15.84:0/827104519 >> 172.21.15.84:0/827104519 conn(0x55da221ff740 msgr2=0x55da225bf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:45.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.229+0000 7f0476467740 1 -- 172.21.15.84:0/827104519 shutdown_connections 2024-09-21T03:45:45.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.229+0000 7f0476467740 1 -- 172.21.15.84:0/827104519 wait complete. 2024-09-21T03:45:45.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.229+0000 7f0476467740 1 -- start start 2024-09-21T03:45:45.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.230+0000 7f0476467740 1 Processor -- start 2024-09-21T03:45:45.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.230+0000 7f0476467740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da221c9cd0 0x55da225d15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:45.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.230+0000 7f0476467740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55da221e2490 0x55da225d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:45.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.230+0000 7f0476467740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 0x55da226398e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:45.235 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.230+0000 7f0476467740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f04681adce0 con 0x55da221ea670 2024-09-21T03:45:45.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.230+0000 7f0476467740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f04681af150 con 0x55da221c9cd0 2024-09-21T03:45:45.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.230+0000 7f0476467740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f04681ae3b0 con 0x55da221e2490 2024-09-21T03:45:45.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.230+0000 7f0476467740 10 client.0 _ll_register_callbacks cb 0x7f04580eb450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:45:45.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.230+0000 7f046e490640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 0x55da226398e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:45.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.230+0000 7f046e490640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 0x55da226398e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51448/0 (socket says 172.21.15.84:51448) 2024-09-21T03:45:45.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.230+0000 7f046dc8f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da221c9cd0 0x55da225d15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:45.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.230+0000 7f046e490640 1 -- 172.21.15.84:0/1600076746 learned_addr learned my addr 172.21.15.84:0/1600076746 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:45.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.230+0000 7f046d48e640 1 --2- 172.21.15.84:0/1600076746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55da221e2490 0x55da225d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:45.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.230+0000 7f046e490640 1 -- 172.21.15.84:0/1600076746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55da221e2490 msgr2=0x55da225d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:45.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.230+0000 7f046e490640 1 --2- 172.21.15.84:0/1600076746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55da221e2490 0x55da225d1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.230+0000 7f046e490640 1 -- 172.21.15.84:0/1600076746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da221c9cd0 msgr2=0x55da225d15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:45.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.231+0000 7f046e490640 1 --2- 172.21.15.84:0/1600076746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da221c9cd0 0x55da225d15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.231+0000 7f046e490640 1 -- 172.21.15.84:0/1600076746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da22639e20 con 0x55da221ea670 2024-09-21T03:45:45.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.231+0000 7f046dc8f640 1 --2- 172.21.15.84:0/1600076746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da221c9cd0 0x55da225d15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:45:45.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.231+0000 7f046e490640 1 --2- 172.21.15.84:0/1600076746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 0x55da226398e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0460033000 tx=0x7f0460031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e0d07131a81885 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:45.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.231+0000 7f044d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:45:45.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.231+0000 7f044d7fa640 1 -- 172.21.15.84:0/1600076746 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0460035040 con 0x55da221ea670 2024-09-21T03:45:45.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.231+0000 7f044d7fa640 1 -- 172.21.15.84:0/1600076746 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f046003db10 con 0x55da221ea670 2024-09-21T03:45:45.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.231+0000 7f0476467740 1 -- 172.21.15.84:0/1600076746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f045c018040 con 0x55da221ea670 2024-09-21T03:45:45.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.231+0000 7f044d7fa640 1 -- 172.21.15.84:0/1600076746 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f046003dd10 con 0x55da221ea670 2024-09-21T03:45:45.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.231+0000 7f0476467740 10 client.16149 fetch_fsmap learned FSMap version 25 2024-09-21T03:45:45.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.231+0000 7f0476467740 1 -- 172.21.15.84:0/1600076746 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55da2263afe0 con 0x55da221ea670 2024-09-21T03:45:45.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.231+0000 7f044d7fa640 1 -- 172.21.15.84:0/1600076746 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f045c018040 con 0x55da221ea670 2024-09-21T03:45:45.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.231+0000 7f044d7fa640 1 -- 172.21.15.84:0/1600076746 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0460052490 con 0x55da221ea670 2024-09-21T03:45:45.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.232+0000 7f0476467740 10 client.16149 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:45:45.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.232+0000 7f0476467740 10 client.16149 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:45:45.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.232+0000 7f0476467740 20 client.16149 populate_metadata read hostname 'smithi084' 2024-09-21T03:45:45.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.232+0000 7f0476467740 1 --2- 172.21.15.84:0/1600076746 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55da2220b350 0x55da2263d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:45.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.232+0000 7f0476467740 4 client.16149 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:45:45.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.232+0000 7f0476467740 1 -- 172.21.15.84:0/1600076746 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55da22526860 con 0x55da2220b350 2024-09-21T03:45:45.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.232+0000 7f046dc8f640 1 --2- 172.21.15.84:0/1600076746 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55da2220b350 0x55da2263d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:45.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.232+0000 7f044d7fa640 10 client.16149 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:45.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.232+0000 7f046dc8f640 1 --2- 172.21.15.84:0/1600076746 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55da2220b350 0x55da2263d750 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6144a18a3cb5040 server_cookie=f02f42299c882500 in_seq=0 out_seq=0 2024-09-21T03:45:45.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.234+0000 7f044d7fa640 1 -- 172.21.15.84:0/1600076746 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55da22526860 con 0x55da2220b350 2024-09-21T03:45:45.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.234+0000 7f044d7fa640 10 client.16149 handle_command_reply: tid=0 2024-09-21T03:45:45.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.234+0000 7f0476467740 1 client.16149 shutdown 2024-09-21T03:45:45.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.234+0000 7f0476467740 1 -- 172.21.15.84:0/1600076746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 msgr2=0x55da226398e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:45.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.234+0000 7f0476467740 1 --2- 172.21.15.84:0/1600076746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 0x55da226398e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0460033000 tx=0x7f0460031400 comp rx=0 tx=0).stop 2024-09-21T03:45:45.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.234+0000 7f0476467740 1 -- 172.21.15.84:0/1600076746 shutdown_connections 2024-09-21T03:45:45.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.234+0000 7f0476467740 1 --2- 172.21.15.84:0/1600076746 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55da2220b350 0x55da2263d750 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.234+0000 7f0476467740 1 --2- 172.21.15.84:0/1600076746 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55da221ea670 0x55da226398e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.234+0000 7f0476467740 1 --2- 172.21.15.84:0/1600076746 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55da221e2490 0x55da225d1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.234+0000 7f0476467740 1 --2- 172.21.15.84:0/1600076746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da221c9cd0 0x55da225d15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.234+0000 7f044d7fa640 0 client.16149 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:45.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.234+0000 7f0476467740 1 -- 172.21.15.84:0/1600076746 >> 172.21.15.84:0/1600076746 conn(0x55da221ff740 msgr2=0x55da225bfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:45.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.234+0000 7f0476467740 1 -- 172.21.15.84:0/1600076746 shutdown_connections 2024-09-21T03:45:45.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.235+0000 7f0476467740 1 -- 172.21.15.84:0/1600076746 wait complete. 2024-09-21T03:45:45.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.235+0000 7f0476467740 20 client.16149 trim_cache size 0 max 16384 2024-09-21T03:45:45.240 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:45:45.241 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T03:45:45.241 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "954d2649-ab71-4fff-8083-23a07798c7f1", 2024-09-21T03:45:45.241 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T03:45:45.241 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:45:45.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.235+0000 7f046fef3640 1 -- 172.21.15.84:0/28730350 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f04500b6680 msgr2=0x7f04500b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:45.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.235+0000 7f046fef3640 1 --2- 172.21.15.84:0/28730350 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f04500b6680 0x7f04500b8b90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0460009230 tx=0x7f0460009260 comp rx=0 tx=0).stop 2024-09-21T03:45:45.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.235+0000 7f046fef3640 1 -- 172.21.15.84:0/28730350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0468103c30 msgr2=0x7f046819a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:45.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.235+0000 7f046fef3640 1 --2- 172.21.15.84:0/28730350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0468103c30 0x7f046819a4f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f045800ea80 tx=0x7f045800ef40 comp rx=0 tx=0).stop 2024-09-21T03:45:45.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.235+0000 7f046fef3640 1 -- 172.21.15.84:0/28730350 shutdown_connections 2024-09-21T03:45:45.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.235+0000 7f046fef3640 1 --2- 172.21.15.84:0/28730350 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f04500b6680 0x7f04500b8b90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.235+0000 7f046fef3640 1 --2- 172.21.15.84:0/28730350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0468109ec0 0x7f046819fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.235+0000 7f046fef3640 1 --2- 172.21.15.84:0/28730350 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0468109570 0x7f046819aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.235+0000 7f046fef3640 1 --2- 172.21.15.84:0/28730350 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0468103c30 0x7f046819a4f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:45.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.235+0000 7f046fef3640 1 -- 172.21.15.84:0/28730350 >> 172.21.15.84:0/28730350 conn(0x7f046807b8d0 msgr2=0x7f04681054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:45.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.235+0000 7f046fef3640 1 -- 172.21.15.84:0/28730350 shutdown_connections 2024-09-21T03:45:45.243 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:45.235+0000 7f046fef3640 1 -- 172.21.15.84:0/28730350 wait complete. 2024-09-21T03:45:45.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:45 smithi084 ceph-mon[30941]: pgmap v422: 97 pgs: 97 active+clean; 3.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-21T03:45:45.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:45 smithi174 ceph-mon[34403]: pgmap v422: 97 pgs: 97 active+clean; 3.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-21T03:45:45.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:45 smithi172 ceph-mon[34821]: pgmap v422: 97 pgs: 97 active+clean; 3.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 12 op/s 2024-09-21T03:45:46.056 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:45:46.303 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:45:46.748 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:46 smithi084 ceph-mon[30941]: scrub queued for path: / 2024-09-21T03:45:46.748 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:46 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:45:46.748 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:46 smithi084 ceph-mon[30941]: scrub summary: active paths [/] 2024-09-21T03:45:46.748 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:46 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:45:46.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.837+0000 7f5d3ce9c640 1 -- 172.21.15.84:0/3355211329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d38102000 msgr2=0x7f5d38102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:46.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.837+0000 7f5d3ce9c640 1 --2- 172.21.15.84:0/3355211329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d38102000 0x7f5d38102410 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009900 tx=0x7f5d2802a410 comp rx=0 tx=0).stop 2024-09-21T03:45:46.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.837+0000 7f5d3ce9c640 1 -- 172.21.15.84:0/3355211329 shutdown_connections 2024-09-21T03:45:46.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.837+0000 7f5d3ce9c640 1 --2- 172.21.15.84:0/3355211329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d38106c30 0x7f5d38110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.837+0000 7f5d3ce9c640 1 --2- 172.21.15.84:0/3355211329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d381062e0 0x7f5d381066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.837+0000 7f5d3ce9c640 1 --2- 172.21.15.84:0/3355211329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d38102000 0x7f5d38102410 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.837+0000 7f5d3ce9c640 1 -- 172.21.15.84:0/3355211329 >> 172.21.15.84:0/3355211329 conn(0x7f5d38079e40 msgr2=0x7f5d3807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:46.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.837+0000 7f5d3ce9c640 1 -- 172.21.15.84:0/3355211329 shutdown_connections 2024-09-21T03:45:46.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.837+0000 7f5d3ce9c640 1 -- 172.21.15.84:0/3355211329 wait complete. 2024-09-21T03:45:46.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.838+0000 7f5d3ce9c640 1 Processor -- start 2024-09-21T03:45:46.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.838+0000 7f5d3ce9c640 1 -- start start 2024-09-21T03:45:46.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.839+0000 7f5d3ce9c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d38102000 0x7f5d3819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:46.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.839+0000 7f5d3ce9c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d381062e0 0x7f5d3819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:46.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.839+0000 7f5d3ce9c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d38106c30 0x7f5d3819fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:46.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.839+0000 7f5d3ce9c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5d38113c00 con 0x7f5d381062e0 2024-09-21T03:45:46.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.839+0000 7f5d3ce9c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5d38113a80 con 0x7f5d38102000 2024-09-21T03:45:46.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.839+0000 7f5d3ce9c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5d38113d80 con 0x7f5d38106c30 2024-09-21T03:45:46.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.839+0000 7f5d2dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d381062e0 0x7f5d3819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:46.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.839+0000 7f5d2dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d381062e0 0x7f5d3819abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51470/0 (socket says 172.21.15.84:51470) 2024-09-21T03:45:46.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.839+0000 7f5d2dd9b640 1 -- 172.21.15.84:0/3657156335 learned_addr learned my addr 172.21.15.84:0/3657156335 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:46.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.839+0000 7f5d36d9d640 1 --2- 172.21.15.84:0/3657156335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d38106c30 0x7f5d3819fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:46.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.839+0000 7f5d3659c640 1 --2- 172.21.15.84:0/3657156335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d38102000 0x7f5d3819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:46.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.839+0000 7f5d2dd9b640 1 -- 172.21.15.84:0/3657156335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d38106c30 msgr2=0x7f5d3819fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:46.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.839+0000 7f5d2dd9b640 1 --2- 172.21.15.84:0/3657156335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d38106c30 0x7f5d3819fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.839+0000 7f5d2dd9b640 1 -- 172.21.15.84:0/3657156335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d38102000 msgr2=0x7f5d3819a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:46.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.839+0000 7f5d2dd9b640 1 --2- 172.21.15.84:0/3657156335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d38102000 0x7f5d3819a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.839+0000 7f5d2dd9b640 1 -- 172.21.15.84:0/3657156335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d381a0580 con 0x7f5d381062e0 2024-09-21T03:45:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.839+0000 7f5d3659c640 1 --2- 172.21.15.84:0/3657156335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d38102000 0x7f5d3819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:45:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.839+0000 7f5d2dd9b640 1 --2- 172.21.15.84:0/3657156335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d381062e0 0x7f5d3819abb0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5d2000b450 tx=0x7f5d2000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.839+0000 7f5d2ffff640 1 -- 172.21.15.84:0/3657156335 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d20015020 con 0x7f5d381062e0 2024-09-21T03:45:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.840+0000 7f5d3ce9c640 1 -- 172.21.15.84:0/3657156335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d381a0870 con 0x7f5d381062e0 2024-09-21T03:45:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.840+0000 7f5d2ffff640 1 -- 172.21.15.84:0/3657156335 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d20011d40 con 0x7f5d381062e0 2024-09-21T03:45:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.840+0000 7f5d2ffff640 1 -- 172.21.15.84:0/3657156335 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2000f340 con 0x7f5d381062e0 2024-09-21T03:45:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.840+0000 7f5d3ce9c640 1 -- 172.21.15.84:0/3657156335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d381a6fd0 con 0x7f5d381062e0 2024-09-21T03:45:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.842+0000 7f5d2ffff640 1 -- 172.21.15.84:0/3657156335 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f5d20018020 con 0x7f5d381062e0 2024-09-21T03:45:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.842+0000 7f5d43410740 1 Processor -- start 2024-09-21T03:45:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d43410740 1 -- start start 2024-09-21T03:45:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d43410740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fed070 0x560455394650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d43410740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fc41b0 0x560455394b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:46.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d43410740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fcc390 0x5604553950d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d43410740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56045530ae50 con 0x560454fc41b0 2024-09-21T03:45:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d43410740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5604552fa280 con 0x560454fcc390 2024-09-21T03:45:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d43410740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5604552fe090 con 0x560454fed070 2024-09-21T03:45:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d3659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fc41b0 0x560455394b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d3659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fc41b0 0x560455394b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51480/0 (socket says 172.21.15.84:51480) 2024-09-21T03:45:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d3659c640 1 -- 172.21.15.84:0/2642702047 learned_addr learned my addr 172.21.15.84:0/2642702047 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d2ffff640 1 --2- 172.21.15.84:0/3657156335 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5d240b6680 0x7f5d240b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d2dd9b640 1 --2- 172.21.15.84:0/2642702047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fcc390 0x5604553950d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d36d9d640 1 --2- 172.21.15.84:0/2642702047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fed070 0x560455394650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d36d9d640 1 --2- 172.21.15.84:0/3657156335 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5d240b6680 0x7f5d240b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d3659c640 1 -- 172.21.15.84:0/2642702047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fed070 msgr2=0x560455394650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d3659c640 1 --2- 172.21.15.84:0/2642702047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fed070 0x560455394650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d3659c640 1 -- 172.21.15.84:0/2642702047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fcc390 msgr2=0x5604553950d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:46.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d3659c640 1 --2- 172.21.15.84:0/2642702047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fcc390 0x5604553950d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d3659c640 1 -- 172.21.15.84:0/2642702047 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560455058650 con 0x560454fc41b0 2024-09-21T03:45:46.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d2ffff640 1 -- 172.21.15.84:0/3657156335 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f5d200e7030 con 0x7f5d381062e0 2024-09-21T03:45:46.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d36d9d640 1 --2- 172.21.15.84:0/2642702047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fed070 0x560455394650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:45:46.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.843+0000 7f5d2dd9b640 1 --2- 172.21.15.84:0/2642702047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fcc390 0x5604553950d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:45:46.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.844+0000 7f5d3659c640 1 --2- 172.21.15.84:0/2642702047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fc41b0 0x560455394b90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009900 tx=0x7f5d28004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332aaa911f9e38b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:46.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.844+0000 7f5d36d9d640 1 --2- 172.21.15.84:0/3657156335 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5d240b6680 0x7f5d240b8b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009900 tx=0x7f5d30009650 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:46.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.844+0000 7f5d2cd99640 1 -- 172.21.15.84:0/2642702047 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2803f070 con 0x560454fc41b0 2024-09-21T03:45:46.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.844+0000 7f5d2cd99640 1 -- 172.21.15.84:0/2642702047 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d28005de0 con 0x560454fc41b0 2024-09-21T03:45:46.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.844+0000 7f5d2cd99640 1 -- 172.21.15.84:0/2642702047 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28035070 con 0x560454fc41b0 2024-09-21T03:45:46.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.845+0000 7f5d43410740 1 -- 172.21.15.84:0/2642702047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fc41b0 msgr2=0x560455394b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:46.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.845+0000 7f5d43410740 1 --2- 172.21.15.84:0/2642702047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fc41b0 0x560455394b90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009900 tx=0x7f5d28004390 comp rx=0 tx=0).stop 2024-09-21T03:45:46.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.845+0000 7f5d43410740 1 -- 172.21.15.84:0/2642702047 shutdown_connections 2024-09-21T03:45:46.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.845+0000 7f5d43410740 1 --2- 172.21.15.84:0/2642702047 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fcc390 0x5604553950d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.845+0000 7f5d43410740 1 --2- 172.21.15.84:0/2642702047 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fc41b0 0x560455394b90 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.845+0000 7f5d43410740 1 --2- 172.21.15.84:0/2642702047 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fed070 0x560455394650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.845+0000 7f5d43410740 1 -- 172.21.15.84:0/2642702047 >> 172.21.15.84:0/2642702047 conn(0x560454fe1460 msgr2=0x560455392540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:46.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.845+0000 7f5d43410740 1 -- 172.21.15.84:0/2642702047 shutdown_connections 2024-09-21T03:45:46.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.845+0000 7f5d43410740 1 -- 172.21.15.84:0/2642702047 wait complete. 2024-09-21T03:45:46.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.845+0000 7f5d43410740 1 -- start start 2024-09-21T03:45:46.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.845+0000 7f5d43410740 1 Processor -- start 2024-09-21T03:45:46.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d43410740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fc41b0 0x56045539fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:46.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d43410740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fcc390 0x5604553a0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:46.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d43410740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fed070 0x5604553ac0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:46.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d43410740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56045515b700 con 0x560454fed070 2024-09-21T03:45:46.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d43410740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560455295110 con 0x560454fcc390 2024-09-21T03:45:46.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d43410740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5604553a2dd0 con 0x560454fc41b0 2024-09-21T03:45:46.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d43410740 10 client.0 _ll_register_callbacks cb 0x5604552ae990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:45:46.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d36d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fed070 0x5604553ac0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:46.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d36d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fed070 0x5604553ac0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51484/0 (socket says 172.21.15.84:51484) 2024-09-21T03:45:46.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d36d9d640 1 -- 172.21.15.84:0/1286823071 learned_addr learned my addr 172.21.15.84:0/1286823071 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:46.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d36d9d640 1 -- 172.21.15.84:0/1286823071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fc41b0 msgr2=0x56045539fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:46.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d2dd9b640 1 --2- 172.21.15.84:0/1286823071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fcc390 0x5604553a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:46.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d36d9d640 1 --2- 172.21.15.84:0/1286823071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fc41b0 0x56045539fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d36d9d640 1 -- 172.21.15.84:0/1286823071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fcc390 msgr2=0x5604553a0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:46.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d36d9d640 1 --2- 172.21.15.84:0/1286823071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fcc390 0x5604553a0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d36d9d640 1 -- 172.21.15.84:0/1286823071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604552c2c40 con 0x560454fed070 2024-09-21T03:45:46.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d36d9d640 1 --2- 172.21.15.84:0/1286823071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fed070 0x5604553ac0f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f5d30008ba0 tx=0x7f5d30004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2689b41d9b30f65 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:46.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:45:46.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d1dffb640 1 -- 172.21.15.84:0/1286823071 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d30028060 con 0x560454fed070 2024-09-21T03:45:46.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d1dffb640 1 -- 172.21.15.84:0/1286823071 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f5d3001aa90 con 0x560454fed070 2024-09-21T03:45:46.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.846+0000 7f5d43410740 1 -- 172.21.15.84:0/1286823071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56045530cda0 con 0x560454fed070 2024-09-21T03:45:46.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.847+0000 7f5d1dffb640 1 -- 172.21.15.84:0/1286823071 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5d30014040 con 0x560454fed070 2024-09-21T03:45:46.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.847+0000 7f5d43410740 10 client.16161 fetch_fsmap learned FSMap version 25 2024-09-21T03:45:46.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.847+0000 7f5d43410740 1 -- 172.21.15.84:0/1286823071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5604553aea50 con 0x560454fed070 2024-09-21T03:45:46.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.847+0000 7f5d1dffb640 1 -- 172.21.15.84:0/1286823071 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56045530cda0 con 0x560454fed070 2024-09-21T03:45:46.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.847+0000 7f5d1dffb640 1 -- 172.21.15.84:0/1286823071 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5d30023410 con 0x560454fed070 2024-09-21T03:45:46.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.847+0000 7f5d43410740 10 client.16161 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:45:46.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.847+0000 7f5d43410740 10 client.16161 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:45:46.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.847+0000 7f5d43410740 20 client.16161 populate_metadata read hostname 'smithi084' 2024-09-21T03:45:46.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.847+0000 7f5d43410740 1 --2- 172.21.15.84:0/1286823071 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560454fab9f0 0x5604553b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:46.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.847+0000 7f5d43410740 4 client.16161 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:45:46.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.847+0000 7f5d43410740 1 -- 172.21.15.84:0/1286823071 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560455308850 con 0x560454fab9f0 2024-09-21T03:45:46.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.848+0000 7f5d3659c640 1 --2- 172.21.15.84:0/1286823071 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560454fab9f0 0x5604553b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:46.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.849+0000 7f5d3659c640 1 --2- 172.21.15.84:0/1286823071 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560454fab9f0 0x5604553b20e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ecc19c4d830a9c8 server_cookie=ecd8ea3f769783e in_seq=0 out_seq=0 2024-09-21T03:45:46.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.849+0000 7f5d1dffb640 10 client.16161 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.849+0000 7f5d1dffb640 1 -- 172.21.15.84:0/1286823071 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560455308850 con 0x560454fab9f0 2024-09-21T03:45:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.849+0000 7f5d1dffb640 10 client.16161 handle_command_reply: tid=0 2024-09-21T03:45:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.849+0000 7f5d43410740 1 client.16161 shutdown 2024-09-21T03:45:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.850+0000 7f5d43410740 1 -- 172.21.15.84:0/1286823071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fed070 msgr2=0x5604553ac0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.850+0000 7f5d43410740 1 --2- 172.21.15.84:0/1286823071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fed070 0x5604553ac0f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f5d30008ba0 tx=0x7f5d30004b50 comp rx=0 tx=0).stop 2024-09-21T03:45:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.850+0000 7f5d43410740 1 -- 172.21.15.84:0/1286823071 shutdown_connections 2024-09-21T03:45:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.850+0000 7f5d43410740 1 --2- 172.21.15.84:0/1286823071 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560454fab9f0 0x5604553b20e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.850+0000 7f5d43410740 1 --2- 172.21.15.84:0/1286823071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fed070 0x5604553ac0f0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.850+0000 7f5d43410740 1 --2- 172.21.15.84:0/1286823071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fcc390 0x5604553a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.850+0000 7f5d1dffb640 0 client.16161 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.850+0000 7f5d43410740 1 --2- 172.21.15.84:0/1286823071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fc41b0 0x56045539fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.850+0000 7f5d43410740 1 -- 172.21.15.84:0/1286823071 >> 172.21.15.84:0/1286823071 conn(0x560454fe1460 msgr2=0x5604553977e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.850+0000 7f5d43410740 1 -- 172.21.15.84:0/1286823071 shutdown_connections 2024-09-21T03:45:46.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.850+0000 7f5d43410740 1 -- 172.21.15.84:0/1286823071 wait complete. 2024-09-21T03:45:46.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.850+0000 7f5d43410740 20 client.16161 trim_cache size 0 max 16384 2024-09-21T03:45:46.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.867+0000 7f5d43410740 1 Processor -- start 2024-09-21T03:45:46.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.867+0000 7f5d43410740 1 -- start start 2024-09-21T03:45:46.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.868+0000 7f5d43410740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fc41b0 0x5604553a0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:46.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.868+0000 7f5d43410740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fcc390 0x560455397750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:46.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.868+0000 7f5d43410740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fed070 0x560455397c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:46.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.868+0000 7f5d43410740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5d381b1fa0 con 0x560454fed070 2024-09-21T03:45:46.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.868+0000 7f5d43410740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5d381af870 con 0x560454fc41b0 2024-09-21T03:45:46.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.868+0000 7f5d43410740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5d381ad6c0 con 0x560454fcc390 2024-09-21T03:45:46.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.868+0000 7f5d36d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fed070 0x560455397c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:46.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.868+0000 7f5d2dd9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fcc390 0x560455397750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:46.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.868+0000 7f5d36d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fed070 0x560455397c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51500/0 (socket says 172.21.15.84:51500) 2024-09-21T03:45:46.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.868+0000 7f5d36d9d640 1 -- 172.21.15.84:0/891961205 learned_addr learned my addr 172.21.15.84:0/891961205 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:46.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.868+0000 7f5d2dd9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fcc390 0x560455397750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.84:39876/0 (socket says 172.21.15.84:39876) 2024-09-21T03:45:46.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.868+0000 7f5d3659c640 1 --2- 172.21.15.84:0/891961205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fc41b0 0x5604553a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:46.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.868+0000 7f5d36d9d640 1 -- 172.21.15.84:0/891961205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fcc390 msgr2=0x560455397750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:46.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.868+0000 7f5d36d9d640 1 --2- 172.21.15.84:0/891961205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fcc390 0x560455397750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.868+0000 7f5d36d9d640 1 -- 172.21.15.84:0/891961205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fc41b0 msgr2=0x5604553a0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:46.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.868+0000 7f5d36d9d640 1 --2- 172.21.15.84:0/891961205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fc41b0 0x5604553a0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.868+0000 7f5d36d9d640 1 -- 172.21.15.84:0/891961205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56045539b5d0 con 0x560454fed070 2024-09-21T03:45:46.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.868+0000 7f5d2dd9b640 1 --2- 172.21.15.84:0/891961205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fcc390 0x560455397750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:45:46.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.868+0000 7f5d3659c640 1 --2- 172.21.15.84:0/891961205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fc41b0 0x5604553a0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:45:46.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.868+0000 7f5d36d9d640 1 --2- 172.21.15.84:0/891961205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fed070 0x560455397c90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5d3001a390 tx=0x7f5d30009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bafebf5669b304b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:46.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.869+0000 7f5d1ffff640 1 -- 172.21.15.84:0/891961205 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d30028040 con 0x560454fed070 2024-09-21T03:45:46.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.869+0000 7f5d1ffff640 1 -- 172.21.15.84:0/891961205 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d3000be00 con 0x560454fed070 2024-09-21T03:45:46.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.869+0000 7f5d1ffff640 1 -- 172.21.15.84:0/891961205 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d300366c0 con 0x560454fed070 2024-09-21T03:45:46.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.869+0000 7f5d43410740 1 -- 172.21.15.84:0/891961205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fed070 msgr2=0x560455397c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:46.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.869+0000 7f5d43410740 1 --2- 172.21.15.84:0/891961205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fed070 0x560455397c90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f5d3001a390 tx=0x7f5d30009be0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.869+0000 7f5d43410740 1 -- 172.21.15.84:0/891961205 shutdown_connections 2024-09-21T03:45:46.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.869+0000 7f5d43410740 1 --2- 172.21.15.84:0/891961205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fed070 0x560455397c90 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.869+0000 7f5d43410740 1 --2- 172.21.15.84:0/891961205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fcc390 0x560455397750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.869+0000 7f5d43410740 1 --2- 172.21.15.84:0/891961205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fc41b0 0x5604553a0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.869+0000 7f5d43410740 1 -- 172.21.15.84:0/891961205 >> 172.21.15.84:0/891961205 conn(0x560454fe1460 msgr2=0x56045539faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:46.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.870+0000 7f5d43410740 1 -- 172.21.15.84:0/891961205 shutdown_connections 2024-09-21T03:45:46.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.870+0000 7f5d43410740 1 -- 172.21.15.84:0/891961205 wait complete. 2024-09-21T03:45:46.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.870+0000 7f5d43410740 1 -- start start 2024-09-21T03:45:46.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.870+0000 7f5d43410740 1 Processor -- start 2024-09-21T03:45:46.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.870+0000 7f5d43410740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fc41b0 0x5604553a4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:46.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.870+0000 7f5d43410740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fcc390 0x5604553a4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:46.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.870+0000 7f5d43410740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fed070 0x5604553a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:46.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.870+0000 7f5d43410740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5d381add30 con 0x560454fc41b0 2024-09-21T03:45:46.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.870+0000 7f5d43410740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5d381af1a0 con 0x560454fcc390 2024-09-21T03:45:46.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.870+0000 7f5d43410740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5d381ae400 con 0x560454fed070 2024-09-21T03:45:46.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.870+0000 7f5d43410740 10 client.0 _ll_register_callbacks cb 0x7f5d30009cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:45:46.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.870+0000 7f5d3659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fc41b0 0x5604553a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:46.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.870+0000 7f5d3659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fc41b0 0x5604553a4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:51506/0 (socket says 172.21.15.84:51506) 2024-09-21T03:45:46.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.870+0000 7f5d3659c640 1 -- 172.21.15.84:0/763248442 learned_addr learned my addr 172.21.15.84:0/763248442 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:45:46.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.871+0000 7f5d36d9d640 1 --2- 172.21.15.84:0/763248442 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fed070 0x5604553a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:46.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.871+0000 7f5d3659c640 1 -- 172.21.15.84:0/763248442 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fed070 msgr2=0x5604553a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:46.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.871+0000 7f5d3659c640 1 --2- 172.21.15.84:0/763248442 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fed070 0x5604553a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.871+0000 7f5d2dd9b640 1 --2- 172.21.15.84:0/763248442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fcc390 0x5604553a4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:46.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.871+0000 7f5d3659c640 1 -- 172.21.15.84:0/763248442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fcc390 msgr2=0x5604553a4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:45:46.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.871+0000 7f5d3659c640 1 --2- 172.21.15.84:0/763248442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fcc390 0x5604553a4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.871+0000 7f5d3659c640 1 -- 172.21.15.84:0/763248442 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56045541bad0 con 0x560454fc41b0 2024-09-21T03:45:46.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.871+0000 7f5d36d9d640 1 --2- 172.21.15.84:0/763248442 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fed070 0x5604553a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:45:46.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.871+0000 7f5d3659c640 1 --2- 172.21.15.84:0/763248442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fc41b0 0x5604553a4050 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f5d28006010 tx=0x7f5d2802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d352b4006856f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:45:46.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.871+0000 7f5d1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:45:46.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.871+0000 7f5d1dffb640 1 -- 172.21.15.84:0/763248442 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2803f070 con 0x560454fc41b0 2024-09-21T03:45:46.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.871+0000 7f5d1dffb640 1 -- 172.21.15.84:0/763248442 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f5d280052a0 con 0x560454fc41b0 2024-09-21T03:45:46.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.871+0000 7f5d43410740 1 -- 172.21.15.84:0/763248442 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d3000be00 con 0x560454fc41b0 2024-09-21T03:45:46.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.871+0000 7f5d1dffb640 1 -- 172.21.15.84:0/763248442 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5d2805b050 con 0x560454fc41b0 2024-09-21T03:45:46.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.871+0000 7f5d43410740 10 client.16167 fetch_fsmap learned FSMap version 25 2024-09-21T03:45:46.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.871+0000 7f5d43410740 1 -- 172.21.15.84:0/763248442 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56045541cd60 con 0x560454fc41b0 2024-09-21T03:45:46.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.871+0000 7f5d1dffb640 1 -- 172.21.15.84:0/763248442 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d3000be00 con 0x560454fc41b0 2024-09-21T03:45:46.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.872+0000 7f5d1dffb640 1 -- 172.21.15.84:0/763248442 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5d28031b50 con 0x560454fc41b0 2024-09-21T03:45:46.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.872+0000 7f5d43410740 10 client.16167 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:45:46.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.872+0000 7f5d43410740 10 client.16167 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:45:46.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.872+0000 7f5d43410740 20 client.16167 populate_metadata read hostname 'smithi084' 2024-09-21T03:45:46.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.872+0000 7f5d43410740 1 --2- 172.21.15.84:0/763248442 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560454f80da0 0x56045541f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:45:46.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.872+0000 7f5d43410740 4 client.16167 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:45:46.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.872+0000 7f5d43410740 1 -- 172.21.15.84:0/763248442 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560455305c80 con 0x560454f80da0 2024-09-21T03:45:46.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.872+0000 7f5d2dd9b640 1 --2- 172.21.15.84:0/763248442 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560454f80da0 0x56045541f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:45:46.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.872+0000 7f5d2dd9b640 1 --2- 172.21.15.84:0/763248442 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560454f80da0 0x56045541f120 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2300ee2f98630c4 server_cookie=1adb584a8196023c in_seq=0 out_seq=0 2024-09-21T03:45:46.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.872+0000 7f5d1dffb640 10 client.16167 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:46.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.873+0000 7f5d1dffb640 1 -- 172.21.15.84:0/763248442 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2274 (crc 0 0 0) 0x560455305c80 con 0x560454f80da0 2024-09-21T03:45:46.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.873+0000 7f5d1dffb640 10 client.16167 handle_command_reply: tid=0 2024-09-21T03:45:46.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.873+0000 7f5d43410740 1 client.16167 shutdown 2024-09-21T03:45:46.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.873+0000 7f5d43410740 1 -- 172.21.15.84:0/763248442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fc41b0 msgr2=0x5604553a4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:46.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.873+0000 7f5d43410740 1 --2- 172.21.15.84:0/763248442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fc41b0 0x5604553a4050 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f5d28006010 tx=0x7f5d2802a410 comp rx=0 tx=0).stop 2024-09-21T03:45:46.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.873+0000 7f5d43410740 1 -- 172.21.15.84:0/763248442 shutdown_connections 2024-09-21T03:45:46.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.873+0000 7f5d43410740 1 --2- 172.21.15.84:0/763248442 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560454f80da0 0x56045541f120 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.873+0000 7f5d43410740 1 --2- 172.21.15.84:0/763248442 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560454fed070 0x5604553a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.873+0000 7f5d43410740 1 --2- 172.21.15.84:0/763248442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560454fcc390 0x5604553a4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.873+0000 7f5d43410740 1 --2- 172.21.15.84:0/763248442 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560454fc41b0 0x5604553a4050 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.873+0000 7f5d43410740 1 -- 172.21.15.84:0/763248442 >> 172.21.15.84:0/763248442 conn(0x560454fe1460 msgr2=0x56045539e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:46.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.873+0000 7f5d1dffb640 0 client.16167 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:45:46.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.873+0000 7f5d43410740 1 -- 172.21.15.84:0/763248442 shutdown_connections 2024-09-21T03:45:46.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.873+0000 7f5d43410740 1 -- 172.21.15.84:0/763248442 wait complete. 2024-09-21T03:45:46.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.873+0000 7f5d43410740 20 client.16167 trim_cache size 0 max 16384 2024-09-21T03:45:46.881 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:45:46.881 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:45:46.881 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T03:45:46.881 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:45:46.881 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:46.881 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "954d2649-ab71-4fff-8083-23a07798c7f1", 2024-09-21T03:45:46.882 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T03:45:46.882 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:45:46.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:45:46.882 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:45:46.882 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:45:46.882 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:45:46.882 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:46.882 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:45:46.882 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:45:46.882 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:45:46.882 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:45:46.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:45:46.882 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:45:46.883 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:45:46.883 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:46.883 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:45:46.883 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:45:46.883 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:45:46.883 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:45:46.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:45:46.883 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:45:46.883 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:45:46.883 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:46.883 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:45:46.883 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:45:46.883 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:45:46.883 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:45:46.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:45:46.884 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:45:46.884 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:45:46.884 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:46.884 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:45:46.884 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:45:46.884 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:45:46.884 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:45:46.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:45:46.884 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:45:46.884 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:45:46.884 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:46.884 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:45:46.884 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:45:46.885 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:45:46.885 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:45:46.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:45:46.885 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:45:46.885 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:45:46.885 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:46.885 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:45:46.885 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:45:46.885 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:45:46.885 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:45:46.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:45:46.885 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:45:46.885 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:45:46.885 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:45:46.886 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:45:46.886 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:45:46.886 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:45:46.886 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:45:46.886 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:45:46.886 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:45:46.886 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:45:46.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.874+0000 7f5d3ce9c640 1 -- 172.21.15.84:0/3657156335 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5d240b6680 msgr2=0x7f5d240b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:46.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.874+0000 7f5d3ce9c640 1 --2- 172.21.15.84:0/3657156335 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5d240b6680 0x7f5d240b8b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009900 tx=0x7f5d30009650 comp rx=0 tx=0).stop 2024-09-21T03:45:46.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.874+0000 7f5d3ce9c640 1 -- 172.21.15.84:0/3657156335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d381062e0 msgr2=0x7f5d3819abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:45:46.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.874+0000 7f5d3ce9c640 1 --2- 172.21.15.84:0/3657156335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d381062e0 0x7f5d3819abb0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f5d2000b450 tx=0x7f5d2000b910 comp rx=0 tx=0).stop 2024-09-21T03:45:46.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.874+0000 7f5d3ce9c640 1 -- 172.21.15.84:0/3657156335 shutdown_connections 2024-09-21T03:45:46.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.874+0000 7f5d3ce9c640 1 --2- 172.21.15.84:0/3657156335 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5d240b6680 0x7f5d240b8b90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.874+0000 7f5d3ce9c640 1 --2- 172.21.15.84:0/3657156335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d38106c30 0x7f5d3819fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.874+0000 7f5d3ce9c640 1 --2- 172.21.15.84:0/3657156335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d381062e0 0x7f5d3819abb0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.874+0000 7f5d3ce9c640 1 --2- 172.21.15.84:0/3657156335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d38102000 0x7f5d3819a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:45:46.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.874+0000 7f5d3ce9c640 1 -- 172.21.15.84:0/3657156335 >> 172.21.15.84:0/3657156335 conn(0x7f5d38079e40 msgr2=0x7f5d38107fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:45:46.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.874+0000 7f5d3ce9c640 1 -- 172.21.15.84:0/3657156335 shutdown_connections 2024-09-21T03:45:46.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:45:46.874+0000 7f5d3ce9c640 1 -- 172.21.15.84:0/3657156335 wait complete. 2024-09-21T03:45:46.888 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:46 smithi174 ceph-mon[34403]: scrub queued for path: / 2024-09-21T03:45:46.888 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:46 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:45:46.888 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:46 smithi174 ceph-mon[34403]: scrub summary: active paths [/] 2024-09-21T03:45:46.888 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:46 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:45:46.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:46 smithi172 ceph-mon[34821]: scrub queued for path: / 2024-09-21T03:45:46.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:46 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:45:46.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:46 smithi172 ceph-mon[34821]: scrub summary: active paths [/] 2024-09-21T03:45:46.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:46 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:45:47.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:47 smithi084 ceph-mon[30941]: pgmap v423: 97 pgs: 97 active+clean; 3.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-09-21T03:45:47.697 INFO:tasks.cephfs.filesystem:scrub status for tag:954d2649-ab71-4fff-8083-23a07798c7f1 - {'path': '/', 'tag': '954d2649-ab71-4fff-8083-23a07798c7f1', 'options': 'recursive,force'} 2024-09-21T03:45:47.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:47 smithi174 ceph-mon[34403]: pgmap v423: 97 pgs: 97 active+clean; 3.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-09-21T03:45:47.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:47 smithi172 ceph-mon[34821]: pgmap v423: 97 pgs: 97 active+clean; 3.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-09-21T03:45:49.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:49 smithi084 ceph-mon[30941]: pgmap v424: 97 pgs: 97 active+clean; 3.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T03:45:49.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:49 smithi174 ceph-mon[34403]: pgmap v424: 97 pgs: 97 active+clean; 3.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T03:45:49.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:49 smithi172 ceph-mon[34821]: pgmap v424: 97 pgs: 97 active+clean; 3.9 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T03:45:50.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:50 smithi084 ceph-mon[30941]: scrub summary: idle 2024-09-21T03:45:50.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:50 smithi174 ceph-mon[34403]: scrub summary: idle 2024-09-21T03:45:50.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:50 smithi172 ceph-mon[34821]: scrub summary: idle 2024-09-21T03:45:51.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:51 smithi084 ceph-mon[30941]: pgmap v425: 97 pgs: 97 active+clean; 4.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-21T03:45:51.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:51 smithi174 ceph-mon[34403]: pgmap v425: 97 pgs: 97 active+clean; 4.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-21T03:45:51.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:51 smithi172 ceph-mon[34821]: pgmap v425: 97 pgs: 97 active+clean; 4.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-21T03:45:52.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:52 smithi084 ceph-mon[30941]: pgmap v426: 97 pgs: 97 active+clean; 4.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T03:45:52.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:52 smithi174 ceph-mon[34403]: pgmap v426: 97 pgs: 97 active+clean; 4.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T03:45:52.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:52 smithi172 ceph-mon[34821]: pgmap v426: 97 pgs: 97 active+clean; 4.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T03:45:55.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:55 smithi084 ceph-mon[30941]: pgmap v427: 97 pgs: 97 active+clean; 4.2 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-21T03:45:55.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:55 smithi174 ceph-mon[34403]: pgmap v427: 97 pgs: 97 active+clean; 4.2 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-21T03:45:55.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:55 smithi172 ceph-mon[34821]: pgmap v427: 97 pgs: 97 active+clean; 4.2 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-21T03:45:57.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:57 smithi084 ceph-mon[30941]: pgmap v428: 97 pgs: 97 active+clean; 4.2 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-09-21T03:45:57.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:57 smithi174 ceph-mon[34403]: pgmap v428: 97 pgs: 97 active+clean; 4.2 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-09-21T03:45:57.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:57 smithi172 ceph-mon[34821]: pgmap v428: 97 pgs: 97 active+clean; 4.2 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-09-21T03:45:59.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:45:59 smithi084 ceph-mon[30941]: pgmap v429: 97 pgs: 97 active+clean; 4.2 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T03:45:59.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:45:59 smithi174 ceph-mon[34403]: pgmap v429: 97 pgs: 97 active+clean; 4.2 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T03:45:59.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:45:59 smithi172 ceph-mon[34821]: pgmap v429: 97 pgs: 97 active+clean; 4.2 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T03:46:01.703 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:01 smithi172 ceph-mon[34821]: pgmap v430: 97 pgs: 97 active+clean; 4.3 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-21T03:46:01.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:01 smithi084 ceph-mon[30941]: pgmap v430: 97 pgs: 97 active+clean; 4.3 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-21T03:46:01.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:01 smithi174 ceph-mon[34403]: pgmap v430: 97 pgs: 97 active+clean; 4.3 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-21T03:46:03.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:03 smithi084 ceph-mon[30941]: pgmap v431: 97 pgs: 97 active+clean; 4.3 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-21T03:46:03.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:03 smithi174 ceph-mon[34403]: pgmap v431: 97 pgs: 97 active+clean; 4.3 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-21T03:46:03.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:03 smithi172 ceph-mon[34821]: pgmap v431: 97 pgs: 97 active+clean; 4.3 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-21T03:46:05.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:05 smithi084 ceph-mon[30941]: pgmap v432: 97 pgs: 97 active+clean; 4.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 56 KiB/s wr, 27 op/s 2024-09-21T03:46:05.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:05 smithi174 ceph-mon[34403]: pgmap v432: 97 pgs: 97 active+clean; 4.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 56 KiB/s wr, 27 op/s 2024-09-21T03:46:05.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:05 smithi172 ceph-mon[34821]: pgmap v432: 97 pgs: 97 active+clean; 4.4 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 56 KiB/s wr, 27 op/s 2024-09-21T03:46:07.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:07 smithi084 ceph-mon[30941]: pgmap v433: 97 pgs: 97 active+clean; 4.4 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-21T03:46:07.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:07 smithi174 ceph-mon[34403]: pgmap v433: 97 pgs: 97 active+clean; 4.4 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-21T03:46:07.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:07 smithi172 ceph-mon[34821]: pgmap v433: 97 pgs: 97 active+clean; 4.4 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-21T03:46:08.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:08 smithi084 ceph-mon[30941]: pgmap v434: 97 pgs: 97 active+clean; 4.4 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-21T03:46:08.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:08 smithi174 ceph-mon[34403]: pgmap v434: 97 pgs: 97 active+clean; 4.4 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-21T03:46:08.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:08 smithi172 ceph-mon[34821]: pgmap v434: 97 pgs: 97 active+clean; 4.4 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 45 KiB/s wr, 26 op/s 2024-09-21T03:46:11.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:11 smithi084 ceph-mon[30941]: pgmap v435: 97 pgs: 97 active+clean; 4.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 60 KiB/s wr, 28 op/s 2024-09-21T03:46:11.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:11 smithi174 ceph-mon[34403]: pgmap v435: 97 pgs: 97 active+clean; 4.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 60 KiB/s wr, 28 op/s 2024-09-21T03:46:11.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:11 smithi172 ceph-mon[34821]: pgmap v435: 97 pgs: 97 active+clean; 4.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 60 KiB/s wr, 28 op/s 2024-09-21T03:46:13.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:13 smithi084 ceph-mon[30941]: pgmap v436: 97 pgs: 97 active+clean; 4.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 49 KiB/s wr, 26 op/s 2024-09-21T03:46:13.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:13 smithi174 ceph-mon[34403]: pgmap v436: 97 pgs: 97 active+clean; 4.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 49 KiB/s wr, 26 op/s 2024-09-21T03:46:13.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:13 smithi172 ceph-mon[34821]: pgmap v436: 97 pgs: 97 active+clean; 4.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 49 KiB/s wr, 26 op/s 2024-09-21T03:46:15.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:15 smithi084 ceph-mon[30941]: pgmap v437: 97 pgs: 97 active+clean; 4.7 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 26 op/s 2024-09-21T03:46:15.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:15 smithi174 ceph-mon[34403]: pgmap v437: 97 pgs: 97 active+clean; 4.7 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 26 op/s 2024-09-21T03:46:15.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:15 smithi172 ceph-mon[34821]: pgmap v437: 97 pgs: 97 active+clean; 4.7 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 26 op/s 2024-09-21T03:46:17.698 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:46:17.727 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:17 smithi084 ceph-mon[30941]: pgmap v438: 97 pgs: 97 active+clean; 4.7 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 KiB/s wr, 10 op/s 2024-09-21T03:46:17.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:17 smithi174 ceph-mon[34403]: pgmap v438: 97 pgs: 97 active+clean; 4.7 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 KiB/s wr, 10 op/s 2024-09-21T03:46:17.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:17 smithi172 ceph-mon[34821]: pgmap v438: 97 pgs: 97 active+clean; 4.7 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 KiB/s wr, 10 op/s 2024-09-21T03:46:17.960 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:18.442 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.436+0000 7ff7462fd640 1 -- 172.21.15.84:0/3807402093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff740103b60 msgr2=0x7ff740103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:18.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.436+0000 7ff7462fd640 1 --2- 172.21.15.84:0/3807402093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff740103b60 0x7ff740103f70 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff730009900 tx=0x7ff73002a410 comp rx=0 tx=0).stop 2024-09-21T03:46:18.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.436+0000 7ff7462fd640 1 -- 172.21.15.84:0/3807402093 shutdown_connections 2024-09-21T03:46:18.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.436+0000 7ff7462fd640 1 --2- 172.21.15.84:0/3807402093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff740109df0 0x7ff740110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.436+0000 7ff7462fd640 1 --2- 172.21.15.84:0/3807402093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff7401094a0 0x7ff7401098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.436+0000 7ff7462fd640 1 --2- 172.21.15.84:0/3807402093 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff740103b60 0x7ff740103f70 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.436+0000 7ff7462fd640 1 -- 172.21.15.84:0/3807402093 >> 172.21.15.84:0/3807402093 conn(0x7ff74007b850 msgr2=0x7ff74007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:18.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.436+0000 7ff7462fd640 1 -- 172.21.15.84:0/3807402093 shutdown_connections 2024-09-21T03:46:18.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.436+0000 7ff7462fd640 1 -- 172.21.15.84:0/3807402093 wait complete. 2024-09-21T03:46:18.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.437+0000 7ff7462fd640 1 Processor -- start 2024-09-21T03:46:18.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.437+0000 7ff7462fd640 1 -- start start 2024-09-21T03:46:18.443 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.438+0000 7ff7462fd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff740103b60 0x7ff74019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:18.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.438+0000 7ff7462fd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff7401094a0 0x7ff74019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:18.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.438+0000 7ff7462fd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff740109df0 0x7ff74019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:18.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.438+0000 7ff7462fd640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff740113af0 con 0x7ff740109df0 2024-09-21T03:46:18.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.438+0000 7ff7462fd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff740113970 con 0x7ff740103b60 2024-09-21T03:46:18.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.438+0000 7ff7462fd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff740113c70 con 0x7ff7401094a0 2024-09-21T03:46:18.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.438+0000 7ff74489a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff740109df0 0x7ff74019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:18.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.438+0000 7ff74489a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff740109df0 0x7ff74019fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35762/0 (socket says 172.21.15.84:35762) 2024-09-21T03:46:18.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.438+0000 7ff74489a640 1 -- 172.21.15.84:0/3735304112 learned_addr learned my addr 172.21.15.84:0/3735304112 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:18.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.438+0000 7ff73f7fe640 1 --2- 172.21.15.84:0/3735304112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff7401094a0 0x7ff74019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:18.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.438+0000 7ff73ffff640 1 --2- 172.21.15.84:0/3735304112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff740103b60 0x7ff74019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:18.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.438+0000 7ff74489a640 1 -- 172.21.15.84:0/3735304112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff7401094a0 msgr2=0x7ff74019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:18.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.438+0000 7ff74489a640 1 --2- 172.21.15.84:0/3735304112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff7401094a0 0x7ff74019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.444 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.438+0000 7ff74489a640 1 -- 172.21.15.84:0/3735304112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff740103b60 msgr2=0x7ff74019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:18.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.438+0000 7ff74489a640 1 --2- 172.21.15.84:0/3735304112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff740103b60 0x7ff74019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.438+0000 7ff74489a640 1 -- 172.21.15.84:0/3735304112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7401a0450 con 0x7ff740109df0 2024-09-21T03:46:18.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.438+0000 7ff74489a640 1 --2- 172.21.15.84:0/3735304112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff740109df0 0x7ff74019fd20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff73800eaa0 tx=0x7ff73800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:18.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.438+0000 7ff73d7fa640 1 -- 172.21.15.84:0/3735304112 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738004d20 con 0x7ff740109df0 2024-09-21T03:46:18.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.439+0000 7ff73d7fa640 1 -- 172.21.15.84:0/3735304112 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff738005020 con 0x7ff740109df0 2024-09-21T03:46:18.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.439+0000 7ff7462fd640 1 -- 172.21.15.84:0/3735304112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7401a0740 con 0x7ff740109df0 2024-09-21T03:46:18.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.439+0000 7ff73d7fa640 1 -- 172.21.15.84:0/3735304112 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7380116b0 con 0x7ff740109df0 2024-09-21T03:46:18.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.439+0000 7ff7462fd640 1 -- 172.21.15.84:0/3735304112 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7401a6ea0 con 0x7ff740109df0 2024-09-21T03:46:18.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.441+0000 7ff74c871740 1 Processor -- start 2024-09-21T03:46:18.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.441+0000 7ff73d7fa640 1 -- 172.21.15.84:0/3735304112 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7ff738011850 con 0x7ff740109df0 2024-09-21T03:46:18.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.442+0000 7ff74c871740 1 -- start start 2024-09-21T03:46:18.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.442+0000 7ff74c871740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bec8418070 0x55bec87bf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:18.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.442+0000 7ff74c871740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec83ef1b0 0x55bec87bf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:18.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.442+0000 7ff74c871740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec83f7390 0x55bec87bfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:18.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.442+0000 7ff74c871740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55bec8735e50 con 0x55bec83f7390 2024-09-21T03:46:18.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.442+0000 7ff74c871740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bec8725280 con 0x55bec8418070 2024-09-21T03:46:18.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.442+0000 7ff74c871740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55bec8729090 con 0x55bec83ef1b0 2024-09-21T03:46:18.447 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.442+0000 7ff73f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec83f7390 0x55bec87bfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:18.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.442+0000 7ff73ffff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec83ef1b0 0x55bec87bf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:18.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.442+0000 7ff73ffff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec83ef1b0 0x55bec87bf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.84:39776/0 (socket says 172.21.15.84:39776) 2024-09-21T03:46:18.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.442+0000 7ff73ffff640 1 -- 172.21.15.84:0/268627927 learned_addr learned my addr 172.21.15.84:0/268627927 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:18.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.442+0000 7ff73f7fe640 1 --2- 172.21.15.84:0/268627927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bec8418070 0x55bec87bf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:18.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.442+0000 7ff73d7fa640 1 --2- 172.21.15.84:0/3735304112 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff7280b6700 0x7ff7280b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:18.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.443+0000 7ff73ffff640 1 -- 172.21.15.84:0/268627927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bec8418070 msgr2=0x55bec87bf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:18.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.443+0000 7ff73ffff640 1 --2- 172.21.15.84:0/268627927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bec8418070 0x55bec87bf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.443+0000 7ff73ffff640 1 -- 172.21.15.84:0/268627927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec83f7390 msgr2=0x55bec87bfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:18.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.443+0000 7ff73ffff640 1 --2- 172.21.15.84:0/268627927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec83f7390 0x55bec87bfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.443+0000 7ff73ffff640 1 -- 172.21.15.84:0/268627927 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bec8483650 con 0x55bec83ef1b0 2024-09-21T03:46:18.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.443+0000 7ff74489a640 1 --2- 172.21.15.84:0/3735304112 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff7280b6700 0x7ff7280b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:18.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.443+0000 7ff73d7fa640 1 -- 172.21.15.84:0/3735304112 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff7380e7870 con 0x7ff740109df0 2024-09-21T03:46:18.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.443+0000 7ff73ffff640 1 --2- 172.21.15.84:0/268627927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec83ef1b0 0x55bec87bf7b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff73002a930 tx=0x7ff730032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93a57245574efb95 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:18.448 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.443+0000 7ff74489a640 1 --2- 172.21.15.84:0/3735304112 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff7280b6700 0x7ff7280b8c10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff7380e50f0 tx=0x7ff7380792f0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:18.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.445+0000 7ff7267fc640 1 -- 172.21.15.84:0/268627927 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73003f070 con 0x55bec83ef1b0 2024-09-21T03:46:18.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.445+0000 7ff7267fc640 1 -- 172.21.15.84:0/268627927 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7300316a0 con 0x55bec83ef1b0 2024-09-21T03:46:18.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.445+0000 7ff7267fc640 1 -- 172.21.15.84:0/268627927 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff730035070 con 0x55bec83ef1b0 2024-09-21T03:46:18.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.446+0000 7ff74c871740 1 -- 172.21.15.84:0/268627927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec83ef1b0 msgr2=0x55bec87bf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:18.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.446+0000 7ff74c871740 1 --2- 172.21.15.84:0/268627927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec83ef1b0 0x55bec87bf7b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff73002a930 tx=0x7ff730032ce0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.446+0000 7ff74c871740 1 -- 172.21.15.84:0/268627927 shutdown_connections 2024-09-21T03:46:18.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.446+0000 7ff74c871740 1 --2- 172.21.15.84:0/268627927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec83f7390 0x55bec87bfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.446+0000 7ff74c871740 1 --2- 172.21.15.84:0/268627927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec83ef1b0 0x55bec87bf7b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.446+0000 7ff74c871740 1 --2- 172.21.15.84:0/268627927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bec8418070 0x55bec87bf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.446+0000 7ff74c871740 1 -- 172.21.15.84:0/268627927 >> 172.21.15.84:0/268627927 conn(0x55bec840c460 msgr2=0x55bec87bd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:18.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.446+0000 7ff74c871740 1 -- 172.21.15.84:0/268627927 shutdown_connections 2024-09-21T03:46:18.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.446+0000 7ff74c871740 1 -- 172.21.15.84:0/268627927 wait complete. 2024-09-21T03:46:18.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.446+0000 7ff74c871740 1 -- start start 2024-09-21T03:46:18.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.447+0000 7ff74c871740 1 Processor -- start 2024-09-21T03:46:18.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.447+0000 7ff74c871740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bec83ef1b0 0x55bec87ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:18.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.447+0000 7ff74c871740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec83f7390 0x55bec87cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:18.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.447+0000 7ff74c871740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec8418070 0x55bec87d6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:18.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.447+0000 7ff74c871740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55bec8586700 con 0x55bec83f7390 2024-09-21T03:46:18.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.447+0000 7ff74c871740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bec86c0110 con 0x55bec83ef1b0 2024-09-21T03:46:18.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.447+0000 7ff74c871740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55bec87cd9f0 con 0x55bec8418070 2024-09-21T03:46:18.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.447+0000 7ff74c871740 10 client.0 _ll_register_callbacks cb 0x55bec86d9990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:46:18.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.447+0000 7ff73ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec83f7390 0x55bec87cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:18.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.447+0000 7ff73ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec83f7390 0x55bec87cae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35778/0 (socket says 172.21.15.84:35778) 2024-09-21T03:46:18.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.447+0000 7ff73ffff640 1 -- 172.21.15.84:0/3789541407 learned_addr learned my addr 172.21.15.84:0/3789541407 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:18.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.447+0000 7ff73f7fe640 1 --2- 172.21.15.84:0/3789541407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bec83ef1b0 0x55bec87ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:18.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.447+0000 7ff73f7fe640 1 --2- 172.21.15.84:0/3789541407 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec8418070 0x55bec87d6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:18.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.447+0000 7ff73ffff640 1 -- 172.21.15.84:0/3789541407 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec8418070 msgr2=0x55bec87d6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:18.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.447+0000 7ff73ffff640 1 --2- 172.21.15.84:0/3789541407 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec8418070 0x55bec87d6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.447+0000 7ff73ffff640 1 -- 172.21.15.84:0/3789541407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bec83ef1b0 msgr2=0x55bec87ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:18.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.447+0000 7ff73ffff640 1 --2- 172.21.15.84:0/3789541407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bec83ef1b0 0x55bec87ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.447+0000 7ff73ffff640 1 -- 172.21.15.84:0/3789541407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bec86edc40 con 0x55bec83f7390 2024-09-21T03:46:18.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.448+0000 7ff73ffff640 1 --2- 172.21.15.84:0/3789541407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec83f7390 0x55bec87cae30 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff730000c00 tx=0x7ff73002aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469d8c238841fbcb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:18.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.448+0000 7ff71f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:46:18.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.448+0000 7ff71f7fe640 1 -- 172.21.15.84:0/3789541407 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73003f070 con 0x55bec83f7390 2024-09-21T03:46:18.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.448+0000 7ff71f7fe640 1 -- 172.21.15.84:0/3789541407 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff730004240 con 0x55bec83f7390 2024-09-21T03:46:18.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.448+0000 7ff74c871740 1 -- 172.21.15.84:0/3789541407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7300316a0 con 0x55bec83f7390 2024-09-21T03:46:18.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.448+0000 7ff71f7fe640 1 -- 172.21.15.84:0/3789541407 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff730035040 con 0x55bec83f7390 2024-09-21T03:46:18.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.448+0000 7ff74c871740 10 client.16179 fetch_fsmap learned FSMap version 25 2024-09-21T03:46:18.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.448+0000 7ff74c871740 1 -- 172.21.15.84:0/3789541407 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bec87d96f0 con 0x55bec83f7390 2024-09-21T03:46:18.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.448+0000 7ff71f7fe640 1 -- 172.21.15.84:0/3789541407 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7300316a0 con 0x55bec83f7390 2024-09-21T03:46:18.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.448+0000 7ff71f7fe640 1 -- 172.21.15.84:0/3789541407 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff7300047e0 con 0x55bec83f7390 2024-09-21T03:46:18.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.448+0000 7ff74c871740 10 client.16179 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:46:18.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.448+0000 7ff74c871740 10 client.16179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:46:18.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.448+0000 7ff74c871740 20 client.16179 populate_metadata read hostname 'smithi084' 2024-09-21T03:46:18.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.448+0000 7ff74c871740 1 --2- 172.21.15.84:0/3789541407 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bec83d69f0 0x55bec87dca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:18.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.449+0000 7ff74c871740 4 client.16179 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:46:18.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.449+0000 7ff74c871740 1 -- 172.21.15.84:0/3789541407 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bec8737da0 con 0x55bec83d69f0 2024-09-21T03:46:18.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.449+0000 7ff73f7fe640 1 --2- 172.21.15.84:0/3789541407 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bec83d69f0 0x55bec87dca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:18.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.449+0000 7ff73f7fe640 1 --2- 172.21.15.84:0/3789541407 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bec83d69f0 0x55bec87dca50 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64620c1d308c0698 server_cookie=d02a686fdfb6e664 in_seq=0 out_seq=0 2024-09-21T03:46:18.455 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.449+0000 7ff71f7fe640 10 client.16179 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:46:18.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.450+0000 7ff71f7fe640 1 -- 172.21.15.84:0/3789541407 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bec8737da0 con 0x55bec83d69f0 2024-09-21T03:46:18.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.450+0000 7ff71f7fe640 10 client.16179 handle_command_reply: tid=0 2024-09-21T03:46:18.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.450+0000 7ff74c871740 1 client.16179 shutdown 2024-09-21T03:46:18.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.450+0000 7ff74c871740 1 -- 172.21.15.84:0/3789541407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec83f7390 msgr2=0x55bec87cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:18.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.450+0000 7ff74c871740 1 --2- 172.21.15.84:0/3789541407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec83f7390 0x55bec87cae30 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff730000c00 tx=0x7ff73002aaf0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.450+0000 7ff74c871740 1 -- 172.21.15.84:0/3789541407 shutdown_connections 2024-09-21T03:46:18.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.450+0000 7ff74c871740 1 --2- 172.21.15.84:0/3789541407 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bec83d69f0 0x55bec87dca50 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.456 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.450+0000 7ff74c871740 1 --2- 172.21.15.84:0/3789541407 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec8418070 0x55bec87d6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.450+0000 7ff74c871740 1 --2- 172.21.15.84:0/3789541407 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec83f7390 0x55bec87cae30 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.450+0000 7ff74c871740 1 --2- 172.21.15.84:0/3789541407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bec83ef1b0 0x55bec87ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.450+0000 7ff71f7fe640 0 client.16179 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:46:18.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.450+0000 7ff74c871740 1 -- 172.21.15.84:0/3789541407 >> 172.21.15.84:0/3789541407 conn(0x55bec840c460 msgr2=0x55bec87c2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:18.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.451+0000 7ff74c871740 1 -- 172.21.15.84:0/3789541407 shutdown_connections 2024-09-21T03:46:18.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.451+0000 7ff74c871740 1 -- 172.21.15.84:0/3789541407 wait complete. 2024-09-21T03:46:18.457 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.451+0000 7ff74c871740 20 client.16179 trim_cache size 0 max 16384 2024-09-21T03:46:18.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.468+0000 7ff74c871740 1 Processor -- start 2024-09-21T03:46:18.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.468+0000 7ff74c871740 1 -- start start 2024-09-21T03:46:18.470 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.468+0000 7ff74c871740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec83ef1b0 0x55bec87c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:18.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.468+0000 7ff74c871740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bec83f7390 0x55bec87cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:18.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.468+0000 7ff74c871740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec8418070 0x55bec87bc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:18.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.468+0000 7ff74c871740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff7401afca0 con 0x55bec8418070 2024-09-21T03:46:18.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.468+0000 7ff74c871740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff7401ad570 con 0x55bec83f7390 2024-09-21T03:46:18.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.468+0000 7ff74c871740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff7401ab3c0 con 0x55bec83ef1b0 2024-09-21T03:46:18.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.468+0000 7ff73f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec8418070 0x55bec87bc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:18.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.468+0000 7ff73f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec8418070 0x55bec87bc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35786/0 (socket says 172.21.15.84:35786) 2024-09-21T03:46:18.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.468+0000 7ff73f7fe640 1 -- 172.21.15.84:0/1065143309 learned_addr learned my addr 172.21.15.84:0/1065143309 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:18.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.468+0000 7ff73f7fe640 1 -- 172.21.15.84:0/1065143309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec83ef1b0 msgr2=0x55bec87c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:18.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.468+0000 7ff73f7fe640 1 --2- 172.21.15.84:0/1065143309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec83ef1b0 0x55bec87c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.468+0000 7ff73f7fe640 1 -- 172.21.15.84:0/1065143309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bec83f7390 msgr2=0x55bec87cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:18.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.468+0000 7ff73f7fe640 1 --2- 172.21.15.84:0/1065143309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bec83f7390 0x55bec87cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.468+0000 7ff73f7fe640 1 -- 172.21.15.84:0/1065143309 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bec87c8df0 con 0x55bec8418070 2024-09-21T03:46:18.471 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.469+0000 7ff73f7fe640 1 --2- 172.21.15.84:0/1065143309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec8418070 0x55bec87bc710 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff7401091a0 tx=0x7ff7340047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d082222cdd38f9d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:18.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.469+0000 7ff725ffb640 1 -- 172.21.15.84:0/1065143309 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff734030070 con 0x55bec8418070 2024-09-21T03:46:18.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.469+0000 7ff725ffb640 1 -- 172.21.15.84:0/1065143309 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff734011e50 con 0x55bec8418070 2024-09-21T03:46:18.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.469+0000 7ff725ffb640 1 -- 172.21.15.84:0/1065143309 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7340249f0 con 0x55bec8418070 2024-09-21T03:46:18.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.470+0000 7ff74c871740 1 -- 172.21.15.84:0/1065143309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec8418070 msgr2=0x55bec87bc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:18.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.470+0000 7ff74c871740 1 --2- 172.21.15.84:0/1065143309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec8418070 0x55bec87bc710 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff7401091a0 tx=0x7ff7340047d0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.470+0000 7ff74c871740 1 -- 172.21.15.84:0/1065143309 shutdown_connections 2024-09-21T03:46:18.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.470+0000 7ff74c871740 1 --2- 172.21.15.84:0/1065143309 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec8418070 0x55bec87bc710 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.470+0000 7ff74c871740 1 --2- 172.21.15.84:0/1065143309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bec83f7390 0x55bec87cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.470+0000 7ff74c871740 1 --2- 172.21.15.84:0/1065143309 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec83ef1b0 0x55bec87c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.470+0000 7ff74c871740 1 -- 172.21.15.84:0/1065143309 >> 172.21.15.84:0/1065143309 conn(0x55bec840c460 msgr2=0x55bec87cbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:18.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.470+0000 7ff74c871740 1 -- 172.21.15.84:0/1065143309 shutdown_connections 2024-09-21T03:46:18.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.470+0000 7ff74c871740 1 -- 172.21.15.84:0/1065143309 wait complete. 2024-09-21T03:46:18.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.470+0000 7ff74c871740 1 -- start start 2024-09-21T03:46:18.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.470+0000 7ff74c871740 1 Processor -- start 2024-09-21T03:46:18.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.471+0000 7ff74c871740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec83ef1b0 0x55bec87ddc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:18.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.471+0000 7ff74c871740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bec83f7390 0x55bec87de180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:18.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.471+0000 7ff74c871740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec8418070 0x55bec87de6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:18.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.471+0000 7ff74c871740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff7401aba30 con 0x55bec8418070 2024-09-21T03:46:18.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.471+0000 7ff74c871740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff7401acea0 con 0x55bec83f7390 2024-09-21T03:46:18.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.471+0000 7ff74c871740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff7401ac100 con 0x55bec83ef1b0 2024-09-21T03:46:18.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.471+0000 7ff74c871740 10 client.0 _ll_register_callbacks cb 0x7ff7340129b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:46:18.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.471+0000 7ff73f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec8418070 0x55bec87de6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:18.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.471+0000 7ff73f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec8418070 0x55bec87de6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35788/0 (socket says 172.21.15.84:35788) 2024-09-21T03:46:18.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.471+0000 7ff73f7fe640 1 -- 172.21.15.84:0/3489179070 learned_addr learned my addr 172.21.15.84:0/3489179070 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:18.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.471+0000 7ff73f7fe640 1 --2- 172.21.15.84:0/3489179070 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec83ef1b0 0x55bec87ddc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:18.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.471+0000 7ff73ffff640 1 --2- 172.21.15.84:0/3489179070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bec83f7390 0x55bec87de180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:18.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.471+0000 7ff73f7fe640 1 -- 172.21.15.84:0/3489179070 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec83ef1b0 msgr2=0x55bec87ddc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:18.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.471+0000 7ff73f7fe640 1 --2- 172.21.15.84:0/3489179070 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec83ef1b0 0x55bec87ddc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.471+0000 7ff73f7fe640 1 -- 172.21.15.84:0/3489179070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bec83f7390 msgr2=0x55bec87de180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:18.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.471+0000 7ff73f7fe640 1 --2- 172.21.15.84:0/3489179070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bec83f7390 0x55bec87de180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.471+0000 7ff73f7fe640 1 -- 172.21.15.84:0/3489179070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bec88463d0 con 0x55bec8418070 2024-09-21T03:46:18.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.471+0000 7ff73f7fe640 1 --2- 172.21.15.84:0/3489179070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec8418070 0x55bec87de6c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff734009170 tx=0x7ff734006a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eed54db4307efdc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:18.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.471+0000 7ff71f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:46:18.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.472+0000 7ff71f7fe640 1 -- 172.21.15.84:0/3489179070 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff734030070 con 0x55bec8418070 2024-09-21T03:46:18.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.472+0000 7ff71f7fe640 1 -- 172.21.15.84:0/3489179070 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff734011bb0 con 0x55bec8418070 2024-09-21T03:46:18.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.472+0000 7ff74c871740 1 -- 172.21.15.84:0/3489179070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff734011e50 con 0x55bec8418070 2024-09-21T03:46:18.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.472+0000 7ff71f7fe640 1 -- 172.21.15.84:0/3489179070 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff734024670 con 0x55bec8418070 2024-09-21T03:46:18.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.472+0000 7ff74c871740 10 client.16185 fetch_fsmap learned FSMap version 25 2024-09-21T03:46:18.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.472+0000 7ff74c871740 1 -- 172.21.15.84:0/3489179070 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bec8847620 con 0x55bec8418070 2024-09-21T03:46:18.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.472+0000 7ff71f7fe640 1 -- 172.21.15.84:0/3489179070 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff734011e50 con 0x55bec8418070 2024-09-21T03:46:18.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.472+0000 7ff71f7fe640 1 -- 172.21.15.84:0/3489179070 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff734021040 con 0x55bec8418070 2024-09-21T03:46:18.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.472+0000 7ff74c871740 10 client.16185 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:46:18.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.472+0000 7ff74c871740 10 client.16185 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:46:18.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.472+0000 7ff74c871740 20 client.16185 populate_metadata read hostname 'smithi084' 2024-09-21T03:46:18.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.472+0000 7ff74c871740 1 --2- 172.21.15.84:0/3489179070 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bec83abda0 0x55bec8849be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:18.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.472+0000 7ff74c871740 4 client.16185 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:46:18.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.472+0000 7ff74c871740 1 -- 172.21.15.84:0/3489179070 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bec8733850 con 0x55bec83abda0 2024-09-21T03:46:18.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.472+0000 7ff73ffff640 1 --2- 172.21.15.84:0/3489179070 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bec83abda0 0x55bec8849be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:18.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.473+0000 7ff71f7fe640 10 client.16185 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:46:18.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.473+0000 7ff73ffff640 1 --2- 172.21.15.84:0/3489179070 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bec83abda0 0x55bec8849be0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80ba143a6e25d659 server_cookie=5b0eab3e53dfdf91 in_seq=0 out_seq=0 2024-09-21T03:46:18.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.473+0000 7ff71f7fe640 1 -- 172.21.15.84:0/3489179070 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x55bec8733850 con 0x55bec83abda0 2024-09-21T03:46:18.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.473+0000 7ff71f7fe640 10 client.16185 handle_command_reply: tid=0 2024-09-21T03:46:18.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.473+0000 7ff74c871740 1 client.16185 shutdown 2024-09-21T03:46:18.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.473+0000 7ff74c871740 1 -- 172.21.15.84:0/3489179070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec8418070 msgr2=0x55bec87de6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:18.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.473+0000 7ff74c871740 1 --2- 172.21.15.84:0/3489179070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec8418070 0x55bec87de6c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff734009170 tx=0x7ff734006a30 comp rx=0 tx=0).stop 2024-09-21T03:46:18.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.473+0000 7ff74c871740 1 -- 172.21.15.84:0/3489179070 shutdown_connections 2024-09-21T03:46:18.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.473+0000 7ff74c871740 1 --2- 172.21.15.84:0/3489179070 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55bec83abda0 0x55bec8849be0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.473+0000 7ff74c871740 1 --2- 172.21.15.84:0/3489179070 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55bec8418070 0x55bec87de6c0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.473+0000 7ff74c871740 1 --2- 172.21.15.84:0/3489179070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bec83f7390 0x55bec87de180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.473+0000 7ff74c871740 1 --2- 172.21.15.84:0/3489179070 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bec83ef1b0 0x55bec87ddc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.473+0000 7ff71f7fe640 0 client.16185 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:46:18.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.473+0000 7ff74c871740 1 -- 172.21.15.84:0/3489179070 >> 172.21.15.84:0/3489179070 conn(0x55bec840c460 msgr2=0x55bec87cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:18.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.474+0000 7ff74c871740 1 -- 172.21.15.84:0/3489179070 shutdown_connections 2024-09-21T03:46:18.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.474+0000 7ff74c871740 1 -- 172.21.15.84:0/3489179070 wait complete. 2024-09-21T03:46:18.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.474+0000 7ff74c871740 20 client.16185 trim_cache size 0 max 16384 2024-09-21T03:46:18.480 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:46:18.481 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T03:46:18.481 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T03:46:18.481 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:46:18.481 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:46:18.481 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:46:18.481 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:46:18.481 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:46:18.481 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:46:18.481 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:46:18.481 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:46:18.481 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:46:18.481 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:46:18.481 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:46:18.481 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:46:18.482 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:46:18.482 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:46:18.482 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:46:18.482 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:46:18.482 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:46:18.482 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:46:18.482 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:46:18.482 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:46:18.482 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:46:18.482 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:46:18.482 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:46:18.482 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:46:18.482 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:46:18.483 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:46:18.483 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:46:18.483 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:46:18.483 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:46:18.483 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:46:18.483 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:46:18.483 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:46:18.483 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:46:18.483 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:46:18.483 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:46:18.483 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:46:18.483 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:46:18.483 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:46:18.483 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:46:18.484 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:46:18.484 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:46:18.484 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:46:18.484 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:46:18.484 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:46:18.484 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:46:18.484 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:46:18.484 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:46:18.484 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:46:18.484 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:46:18.484 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:46:18.484 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:46:18.484 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:46:18.484 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:46:18.485 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:46:18.485 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:46:18.485 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:46:18.485 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:46:18.485 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:46:18.485 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:46:18.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.474+0000 7ff7462fd640 1 -- 172.21.15.84:0/3735304112 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff7280b6700 msgr2=0x7ff7280b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:18.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.474+0000 7ff7462fd640 1 --2- 172.21.15.84:0/3735304112 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff7280b6700 0x7ff7280b8c10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff7380e50f0 tx=0x7ff7380792f0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.474+0000 7ff7462fd640 1 -- 172.21.15.84:0/3735304112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff740109df0 msgr2=0x7ff74019fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:18.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.474+0000 7ff7462fd640 1 --2- 172.21.15.84:0/3735304112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff740109df0 0x7ff74019fd20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff73800eaa0 tx=0x7ff73800eea0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.474+0000 7ff7462fd640 1 -- 172.21.15.84:0/3735304112 shutdown_connections 2024-09-21T03:46:18.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.474+0000 7ff7462fd640 1 --2- 172.21.15.84:0/3735304112 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff7280b6700 0x7ff7280b8c10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.474+0000 7ff7462fd640 1 --2- 172.21.15.84:0/3735304112 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff740109df0 0x7ff74019fd20 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.474+0000 7ff7462fd640 1 --2- 172.21.15.84:0/3735304112 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff7401094a0 0x7ff74019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.474+0000 7ff7462fd640 1 --2- 172.21.15.84:0/3735304112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff740103b60 0x7ff74019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:18.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.474+0000 7ff7462fd640 1 -- 172.21.15.84:0/3735304112 >> 172.21.15.84:0/3735304112 conn(0x7ff74007b850 msgr2=0x7ff740107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:18.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.474+0000 7ff7462fd640 1 -- 172.21.15.84:0/3735304112 shutdown_connections 2024-09-21T03:46:18.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:18.474+0000 7ff7462fd640 1 -- 172.21.15.84:0/3735304112 wait complete. 2024-09-21T03:46:19.381 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:46:19.381 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:46:19.673 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:19.793 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:19 smithi084 ceph-mon[30941]: pgmap v439: 97 pgs: 97 active+clean; 4.7 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 KiB/s wr, 11 op/s 2024-09-21T03:46:19.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:19 smithi174 ceph-mon[34403]: pgmap v439: 97 pgs: 97 active+clean; 4.7 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 KiB/s wr, 11 op/s 2024-09-21T03:46:19.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:19 smithi172 ceph-mon[34821]: pgmap v439: 97 pgs: 97 active+clean; 4.7 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 KiB/s wr, 11 op/s 2024-09-21T03:46:20.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.156+0000 7f95cca75640 1 -- 172.21.15.84:0/373722875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c81094a0 msgr2=0x7f95c81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:20.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.156+0000 7f95cca75640 1 --2- 172.21.15.84:0/373722875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c81094a0 0x7f95c81098b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009900 tx=0x7f95bc02a410 comp rx=0 tx=0).stop 2024-09-21T03:46:20.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.156+0000 7f95cca75640 1 -- 172.21.15.84:0/373722875 shutdown_connections 2024-09-21T03:46:20.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.156+0000 7f95cca75640 1 --2- 172.21.15.84:0/373722875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95c8109df0 0x7f95c8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:20.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.156+0000 7f95cca75640 1 --2- 172.21.15.84:0/373722875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c81094a0 0x7f95c81098b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:20.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.156+0000 7f95cca75640 1 --2- 172.21.15.84:0/373722875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95c8103b60 0x7f95c8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.156+0000 7f95cca75640 1 -- 172.21.15.84:0/373722875 >> 172.21.15.84:0/373722875 conn(0x7f95c807b850 msgr2=0x7f95c807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.156+0000 7f95cca75640 1 -- 172.21.15.84:0/373722875 shutdown_connections 2024-09-21T03:46:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.156+0000 7f95cca75640 1 -- 172.21.15.84:0/373722875 wait complete. 2024-09-21T03:46:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.157+0000 7f95cca75640 1 Processor -- start 2024-09-21T03:46:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.157+0000 7f95cca75640 1 -- start start 2024-09-21T03:46:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.157+0000 7f95cca75640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95c8103b60 0x7f95c8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.157+0000 7f95cca75640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95c81094a0 0x7f95c8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.157+0000 7f95cca75640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c8109df0 0x7f95c8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.157+0000 7f95cca75640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f95c8113ab0 con 0x7f95c8109df0 2024-09-21T03:46:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.157+0000 7f95cca75640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f95c8113930 con 0x7f95c81094a0 2024-09-21T03:46:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.157+0000 7f95cca75640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f95c8113c30 con 0x7f95c8103b60 2024-09-21T03:46:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.157+0000 7f95c6d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c8109df0 0x7f95c8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:20.178 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.157+0000 7f95c6d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c8109df0 0x7f95c8076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35804/0 (socket says 172.21.15.84:35804) 2024-09-21T03:46:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.157+0000 7f95c6d9d640 1 -- 172.21.15.84:0/90085432 learned_addr learned my addr 172.21.15.84:0/90085432 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.157+0000 7f95c5d9b640 1 --2- 172.21.15.84:0/90085432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95c81094a0 0x7f95c8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.157+0000 7f95c659c640 1 --2- 172.21.15.84:0/90085432 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95c8103b60 0x7f95c8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.158+0000 7f95c6d9d640 1 -- 172.21.15.84:0/90085432 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95c8103b60 msgr2=0x7f95c8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.158+0000 7f95c6d9d640 1 --2- 172.21.15.84:0/90085432 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95c8103b60 0x7f95c8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.158+0000 7f95c6d9d640 1 -- 172.21.15.84:0/90085432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95c81094a0 msgr2=0x7f95c8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.158+0000 7f95c6d9d640 1 --2- 172.21.15.84:0/90085432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95c81094a0 0x7f95c8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.158+0000 7f95c6d9d640 1 -- 172.21.15.84:0/90085432 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c81a8740 con 0x7f95c8109df0 2024-09-21T03:46:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.158+0000 7f95c659c640 1 --2- 172.21.15.84:0/90085432 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95c8103b60 0x7f95c8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:46:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.158+0000 7f95c5d9b640 1 --2- 172.21.15.84:0/90085432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95c81094a0 0x7f95c8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:46:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.158+0000 7f95c6d9d640 1 --2- 172.21.15.84:0/90085432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c8109df0 0x7f95c8076190 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f95c000eaa0 tx=0x7f95c000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.158+0000 7f95b77fe640 1 -- 172.21.15.84:0/90085432 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c000cdb0 con 0x7f95c8109df0 2024-09-21T03:46:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.158+0000 7f95b77fe640 1 -- 172.21.15.84:0/90085432 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95c0005020 con 0x7f95c8109df0 2024-09-21T03:46:20.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.158+0000 7f95b77fe640 1 -- 172.21.15.84:0/90085432 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c00116d0 con 0x7f95c8109df0 2024-09-21T03:46:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.158+0000 7f95cca75640 1 -- 172.21.15.84:0/90085432 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c81a8a30 con 0x7f95c8109df0 2024-09-21T03:46:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.158+0000 7f95cca75640 1 -- 172.21.15.84:0/90085432 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c81a8f40 con 0x7f95c8109df0 2024-09-21T03:46:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.159+0000 7f95cca75640 1 -- 172.21.15.84:0/90085432 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95c8103f70 con 0x7f95c8109df0 2024-09-21T03:46:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.161+0000 7f95b77fe640 1 -- 172.21.15.84:0/90085432 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f95c00051d0 con 0x7f95c8109df0 2024-09-21T03:46:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.161+0000 7f95b77fe640 1 --2- 172.21.15.84:0/90085432 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f95b00b6680 0x7f95b00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.161+0000 7f95c659c640 1 --2- 172.21.15.84:0/90085432 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f95b00b6680 0x7f95b00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.162+0000 7f95b77fe640 1 -- 172.21.15.84:0/90085432 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f95c00e7c90 con 0x7f95c8109df0 2024-09-21T03:46:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.162+0000 7f95c659c640 1 --2- 172.21.15.84:0/90085432 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f95b00b6680 0x7f95b00b8b90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f95b8005fd0 tx=0x7f95b8005ec0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:20.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.165+0000 7f95b77fe640 1 -- 172.21.15.84:0/90085432 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f95c0016030 con 0x7f95c8109df0 2024-09-21T03:46:20.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.378+0000 7f95cca75640 1 -- 172.21.15.84:0/90085432 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95c8076a10 con 0x7f95c8109df0 2024-09-21T03:46:20.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.379+0000 7f95b77fe640 1 -- 172.21.15.84:0/90085432 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7f95c8076a10 con 0x7f95c8109df0 2024-09-21T03:46:20.381 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:46:20.381 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:46:20.381 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:46:20.383 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.381+0000 7f95cca75640 1 -- 172.21.15.84:0/90085432 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f95b00b6680 msgr2=0x7f95b00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:20.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.381+0000 7f95cca75640 1 --2- 172.21.15.84:0/90085432 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f95b00b6680 0x7f95b00b8b90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f95b8005fd0 tx=0x7f95b8005ec0 comp rx=0 tx=0).stop 2024-09-21T03:46:20.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.381+0000 7f95cca75640 1 -- 172.21.15.84:0/90085432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c8109df0 msgr2=0x7f95c8076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:20.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.381+0000 7f95cca75640 1 --2- 172.21.15.84:0/90085432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c8109df0 0x7f95c8076190 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f95c000eaa0 tx=0x7f95c000ef60 comp rx=0 tx=0).stop 2024-09-21T03:46:20.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.381+0000 7f95cca75640 1 -- 172.21.15.84:0/90085432 shutdown_connections 2024-09-21T03:46:20.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.381+0000 7f95cca75640 1 --2- 172.21.15.84:0/90085432 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f95b00b6680 0x7f95b00b8b90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:20.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.381+0000 7f95cca75640 1 --2- 172.21.15.84:0/90085432 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f95c8109df0 0x7f95c8076190 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:20.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.381+0000 7f95cca75640 1 --2- 172.21.15.84:0/90085432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95c81094a0 0x7f95c8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:20.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.381+0000 7f95cca75640 1 --2- 172.21.15.84:0/90085432 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95c8103b60 0x7f95c8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:20.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.381+0000 7f95cca75640 1 -- 172.21.15.84:0/90085432 >> 172.21.15.84:0/90085432 conn(0x7f95c807b850 msgr2=0x7f95c8107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:20.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.382+0000 7f95cca75640 1 -- 172.21.15.84:0/90085432 shutdown_connections 2024-09-21T03:46:20.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:20.382+0000 7f95cca75640 1 -- 172.21.15.84:0/90085432 wait complete. 2024-09-21T03:46:20.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:20 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/90085432' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:46:20.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:20 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/90085432' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:46:20.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:20 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/90085432' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:46:21.114 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:46:21.364 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:21.750 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:21 smithi084 ceph-mon[30941]: pgmap v440: 97 pgs: 97 active+clean; 4.9 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-09-21T03:46:21.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.839+0000 7f4d988cd640 1 -- 172.21.15.84:0/410928050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d94109e00 msgr2=0x7f4d94110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:21.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.839+0000 7f4d988cd640 1 --2- 172.21.15.84:0/410928050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d94109e00 0x7f4d94110630 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009900 tx=0x7f4d8c02a410 comp rx=0 tx=0).stop 2024-09-21T03:46:21.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.839+0000 7f4d988cd640 1 -- 172.21.15.84:0/410928050 shutdown_connections 2024-09-21T03:46:21.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.839+0000 7f4d988cd640 1 --2- 172.21.15.84:0/410928050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d94109e00 0x7f4d94110630 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.839+0000 7f4d988cd640 1 --2- 172.21.15.84:0/410928050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d941094b0 0x7f4d941098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.839+0000 7f4d988cd640 1 --2- 172.21.15.84:0/410928050 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d94101f70 0x7f4d94102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.839+0000 7f4d988cd640 1 -- 172.21.15.84:0/410928050 >> 172.21.15.84:0/410928050 conn(0x7f4d94077c60 msgr2=0x7f4d940780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:21.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.839+0000 7f4d988cd640 1 -- 172.21.15.84:0/410928050 shutdown_connections 2024-09-21T03:46:21.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.839+0000 7f4d988cd640 1 -- 172.21.15.84:0/410928050 wait complete. 2024-09-21T03:46:21.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.840+0000 7f4d988cd640 1 Processor -- start 2024-09-21T03:46:21.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.840+0000 7f4d988cd640 1 -- start start 2024-09-21T03:46:21.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.840+0000 7f4d988cd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d94101f70 0x7f4d9419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:21.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.840+0000 7f4d988cd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d941094b0 0x7f4d9419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:21.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.840+0000 7f4d988cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d94109e00 0x7f4d9419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:21.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.840+0000 7f4d988cd640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4d94113b20 con 0x7f4d94109e00 2024-09-21T03:46:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.840+0000 7f4d988cd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4d941139a0 con 0x7f4d941094b0 2024-09-21T03:46:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.840+0000 7f4d988cd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d94113ca0 con 0x7f4d94101f70 2024-09-21T03:46:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.840+0000 7f4d92d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d94109e00 0x7f4d9419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.840+0000 7f4d92d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d94109e00 0x7f4d9419fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35820/0 (socket says 172.21.15.84:35820) 2024-09-21T03:46:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.840+0000 7f4d92d9d640 1 -- 172.21.15.84:0/135664076 learned_addr learned my addr 172.21.15.84:0/135664076 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.841+0000 7f4d9259c640 1 --2- 172.21.15.84:0/135664076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d94101f70 0x7f4d9419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.841+0000 7f4d91d9b640 1 --2- 172.21.15.84:0/135664076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d941094b0 0x7f4d9419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.841+0000 7f4d92d9d640 1 -- 172.21.15.84:0/135664076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d94101f70 msgr2=0x7f4d9419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.841+0000 7f4d92d9d640 1 --2- 172.21.15.84:0/135664076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d94101f70 0x7f4d9419a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.841+0000 7f4d92d9d640 1 -- 172.21.15.84:0/135664076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d941094b0 msgr2=0x7f4d9419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.841+0000 7f4d92d9d640 1 --2- 172.21.15.84:0/135664076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d941094b0 0x7f4d9419aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.841+0000 7f4d92d9d640 1 -- 172.21.15.84:0/135664076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d941a0460 con 0x7f4d94109e00 2024-09-21T03:46:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.841+0000 7f4d91d9b640 1 --2- 172.21.15.84:0/135664076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d941094b0 0x7f4d9419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:46:21.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.841+0000 7f4d9259c640 1 --2- 172.21.15.84:0/135664076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d94101f70 0x7f4d9419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:46:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.841+0000 7f4d92d9d640 1 --2- 172.21.15.84:0/135664076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d94109e00 0x7f4d9419fd30 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009a20 tx=0x7f4d8c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.841+0000 7f4d8b7fe640 1 -- 172.21.15.84:0/135664076 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c03f030 con 0x7f4d94109e00 2024-09-21T03:46:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.841+0000 7f4d8b7fe640 1 -- 172.21.15.84:0/135664076 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d8c003aa0 con 0x7f4d94109e00 2024-09-21T03:46:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.841+0000 7f4d988cd640 1 -- 172.21.15.84:0/135664076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d941a06f0 con 0x7f4d94109e00 2024-09-21T03:46:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.841+0000 7f4d8b7fe640 1 -- 172.21.15.84:0/135664076 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c035070 con 0x7f4d94109e00 2024-09-21T03:46:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.841+0000 7f4d988cd640 1 -- 172.21.15.84:0/135664076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d941a6eb0 con 0x7f4d94109e00 2024-09-21T03:46:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.844+0000 7f4d9ee41740 1 Processor -- start 2024-09-21T03:46:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.844+0000 7f4d8b7fe640 1 -- 172.21.15.84:0/135664076 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f4d8c042030 con 0x7f4d94109e00 2024-09-21T03:46:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.844+0000 7f4d9ee41740 1 -- start start 2024-09-21T03:46:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.844+0000 7f4d9ee41740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d34e070 0x56071d6f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.844+0000 7f4d9ee41740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56071d3251b0 0x56071d6f5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.844+0000 7f4d9ee41740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d32d390 0x56071d6f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:21.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.844+0000 7f4d9ee41740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56071d66bea0 con 0x56071d34e070 2024-09-21T03:46:21.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.844+0000 7f4d9ee41740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56071d65b2d0 con 0x56071d32d390 2024-09-21T03:46:21.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.844+0000 7f4d9ee41740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56071d65f0e0 con 0x56071d3251b0 2024-09-21T03:46:21.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.844+0000 7f4d91d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d34e070 0x56071d6f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:21.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.844+0000 7f4d91d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d34e070 0x56071d6f52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35830/0 (socket says 172.21.15.84:35830) 2024-09-21T03:46:21.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.844+0000 7f4d91d9b640 1 -- 172.21.15.84:0/3983377083 learned_addr learned my addr 172.21.15.84:0/3983377083 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:21.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.845+0000 7f4d91d9b640 1 --2- 172.21.15.84:0/3983377083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d32d390 0x56071d6f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:21.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.845+0000 7f4d9259c640 1 --2- 172.21.15.84:0/3983377083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56071d3251b0 0x56071d6f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:21.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.845+0000 7f4d8b7fe640 1 --2- 172.21.15.84:0/135664076 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4d800b6680 0x7f4d800b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:21.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.845+0000 7f4d91d9b640 1 -- 172.21.15.84:0/3983377083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56071d3251b0 msgr2=0x56071d6f5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:21.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.845+0000 7f4d91d9b640 1 --2- 172.21.15.84:0/3983377083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56071d3251b0 0x56071d6f5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.845+0000 7f4d91d9b640 1 -- 172.21.15.84:0/3983377083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d32d390 msgr2=0x56071d6f5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:21.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.845+0000 7f4d91d9b640 1 --2- 172.21.15.84:0/3983377083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d32d390 0x56071d6f5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.845+0000 7f4d91d9b640 1 -- 172.21.15.84:0/3983377083 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56071d3b9650 con 0x56071d34e070 2024-09-21T03:46:21.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.845+0000 7f4d92d9d640 1 --2- 172.21.15.84:0/135664076 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4d800b6680 0x7f4d800b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:21.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.845+0000 7f4d91d9b640 1 --2- 172.21.15.84:0/3983377083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d34e070 0x56071d6f52c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0144f0 tx=0x7f4d7c00b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c2d625f1e8a931 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:21.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.845+0000 7f4d8b7fe640 1 -- 172.21.15.84:0/135664076 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4d8c107d60 con 0x7f4d94109e00 2024-09-21T03:46:21.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.845+0000 7f4d88ff9640 1 -- 172.21.15.84:0/3983377083 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c012710 con 0x56071d34e070 2024-09-21T03:46:21.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.845+0000 7f4d88ff9640 1 -- 172.21.15.84:0/3983377083 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d7c01a070 con 0x56071d34e070 2024-09-21T03:46:21.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.845+0000 7f4d88ff9640 1 -- 172.21.15.84:0/3983377083 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c012710 con 0x56071d34e070 2024-09-21T03:46:21.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.846+0000 7f4d9ee41740 1 -- 172.21.15.84:0/3983377083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d34e070 msgr2=0x56071d6f52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:21.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.846+0000 7f4d92d9d640 1 --2- 172.21.15.84:0/135664076 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4d800b6680 0x7f4d800b8b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c1055e0 tx=0x7f4d8c09af10 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:21.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.846+0000 7f4d9ee41740 1 --2- 172.21.15.84:0/3983377083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d34e070 0x56071d6f52c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0144f0 tx=0x7f4d7c00b4e0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.846+0000 7f4d9ee41740 1 -- 172.21.15.84:0/3983377083 shutdown_connections 2024-09-21T03:46:21.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.846+0000 7f4d9ee41740 1 --2- 172.21.15.84:0/3983377083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d32d390 0x56071d6f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.846+0000 7f4d9ee41740 1 --2- 172.21.15.84:0/3983377083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56071d3251b0 0x56071d6f5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.846+0000 7f4d9ee41740 1 --2- 172.21.15.84:0/3983377083 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d34e070 0x56071d6f52c0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.846+0000 7f4d9ee41740 1 -- 172.21.15.84:0/3983377083 >> 172.21.15.84:0/3983377083 conn(0x56071d342460 msgr2=0x56071d6f31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:21.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.846+0000 7f4d9ee41740 1 -- 172.21.15.84:0/3983377083 shutdown_connections 2024-09-21T03:46:21.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.846+0000 7f4d9ee41740 1 -- 172.21.15.84:0/3983377083 wait complete. 2024-09-21T03:46:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.847+0000 7f4d9ee41740 1 -- start start 2024-09-21T03:46:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.847+0000 7f4d9ee41740 1 Processor -- start 2024-09-21T03:46:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.847+0000 7f4d9ee41740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56071d3251b0 0x56071d704dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.847+0000 7f4d9ee41740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d32d390 0x56071d705300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.847+0000 7f4d9ee41740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d34e070 0x56071d711100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.847+0000 7f4d9ee41740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56071d4bc700 con 0x56071d34e070 2024-09-21T03:46:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.847+0000 7f4d9ee41740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56071d5f6160 con 0x56071d32d390 2024-09-21T03:46:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.847+0000 7f4d9ee41740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56071d707da0 con 0x56071d3251b0 2024-09-21T03:46:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.847+0000 7f4d9ee41740 10 client.0 _ll_register_callbacks cb 0x56071d60f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:46:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.847+0000 7f4d91d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d34e070 0x56071d711100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.847+0000 7f4d91d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d34e070 0x56071d711100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35842/0 (socket says 172.21.15.84:35842) 2024-09-21T03:46:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.847+0000 7f4d91d9b640 1 -- 172.21.15.84:0/385868530 learned_addr learned my addr 172.21.15.84:0/385868530 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.848+0000 7f4d91d9b640 1 --2- 172.21.15.84:0/385868530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56071d3251b0 0x56071d704dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:21.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.848+0000 7f4d91d9b640 1 -- 172.21.15.84:0/385868530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56071d3251b0 msgr2=0x56071d704dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.848+0000 7f4d9259c640 1 --2- 172.21.15.84:0/385868530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d32d390 0x56071d705300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.848+0000 7f4d91d9b640 1 --2- 172.21.15.84:0/385868530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56071d3251b0 0x56071d704dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.848+0000 7f4d91d9b640 1 -- 172.21.15.84:0/385868530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d32d390 msgr2=0x56071d705300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.848+0000 7f4d91d9b640 1 --2- 172.21.15.84:0/385868530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d32d390 0x56071d705300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.848+0000 7f4d91d9b640 1 -- 172.21.15.84:0/385868530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56071d623c90 con 0x56071d34e070 2024-09-21T03:46:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.848+0000 7f4d9259c640 1 --2- 172.21.15.84:0/385868530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d32d390 0x56071d705300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:46:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.848+0000 7f4d91d9b640 1 --2- 172.21.15.84:0/385868530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d34e070 0x56071d711100 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x56071d707610 tx=0x7f4d7c00e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5cc28bd85e08d8a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.848+0000 7f4d79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:46:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.848+0000 7f4d79ffb640 1 -- 172.21.15.84:0/385868530 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c012920 con 0x56071d34e070 2024-09-21T03:46:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.848+0000 7f4d79ffb640 1 -- 172.21.15.84:0/385868530 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4d7c012ac0 con 0x56071d34e070 2024-09-21T03:46:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.848+0000 7f4d9ee41740 1 -- 172.21.15.84:0/385868530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d7c01a070 con 0x56071d34e070 2024-09-21T03:46:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.848+0000 7f4d79ffb640 1 -- 172.21.15.84:0/385868530 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4d7c012cc0 con 0x56071d34e070 2024-09-21T03:46:21.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.848+0000 7f4d9ee41740 10 client.16203 fetch_fsmap learned FSMap version 25 2024-09-21T03:46:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.848+0000 7f4d9ee41740 1 -- 172.21.15.84:0/385868530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56071d713b20 con 0x56071d34e070 2024-09-21T03:46:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.849+0000 7f4d79ffb640 1 -- 172.21.15.84:0/385868530 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d7c01a070 con 0x56071d34e070 2024-09-21T03:46:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.849+0000 7f4d79ffb640 1 -- 172.21.15.84:0/385868530 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4d7c02a020 con 0x56071d34e070 2024-09-21T03:46:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.849+0000 7f4d9ee41740 10 client.16203 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:46:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.849+0000 7f4d9ee41740 10 client.16203 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:46:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.849+0000 7f4d9ee41740 20 client.16203 populate_metadata read hostname 'smithi084' 2024-09-21T03:46:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.849+0000 7f4d9ee41740 1 --2- 172.21.15.84:0/385868530 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x56071d30c9f0 0x56071d716ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.849+0000 7f4d9ee41740 4 client.16203 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:46:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.849+0000 7f4d9ee41740 1 -- 172.21.15.84:0/385868530 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56071d66ddf0 con 0x56071d30c9f0 2024-09-21T03:46:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.849+0000 7f4d9259c640 1 --2- 172.21.15.84:0/385868530 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x56071d30c9f0 0x56071d716ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.850+0000 7f4d9259c640 1 --2- 172.21.15.84:0/385868530 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x56071d30c9f0 0x56071d716ed0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8fc64fd40a2f300 server_cookie=51b2681768d777b1 in_seq=0 out_seq=0 2024-09-21T03:46:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.850+0000 7f4d79ffb640 10 client.16203 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:46:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.850+0000 7f4d79ffb640 1 -- 172.21.15.84:0/385868530 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56071d66ddf0 con 0x56071d30c9f0 2024-09-21T03:46:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.850+0000 7f4d79ffb640 10 client.16203 handle_command_reply: tid=0 2024-09-21T03:46:21.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.851+0000 7f4d9ee41740 1 client.16203 shutdown 2024-09-21T03:46:21.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.851+0000 7f4d9ee41740 1 -- 172.21.15.84:0/385868530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d34e070 msgr2=0x56071d711100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:21.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.851+0000 7f4d9ee41740 1 --2- 172.21.15.84:0/385868530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d34e070 0x56071d711100 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x56071d707610 tx=0x7f4d7c00e650 comp rx=0 tx=0).stop 2024-09-21T03:46:21.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.851+0000 7f4d9ee41740 1 -- 172.21.15.84:0/385868530 shutdown_connections 2024-09-21T03:46:21.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.851+0000 7f4d9ee41740 1 --2- 172.21.15.84:0/385868530 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x56071d30c9f0 0x56071d716ed0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.851+0000 7f4d9ee41740 1 --2- 172.21.15.84:0/385868530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d34e070 0x56071d711100 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.851+0000 7f4d9ee41740 1 --2- 172.21.15.84:0/385868530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d32d390 0x56071d705300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.851+0000 7f4d79ffb640 0 client.16203 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:46:21.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.851+0000 7f4d9ee41740 1 --2- 172.21.15.84:0/385868530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56071d3251b0 0x56071d704dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.851+0000 7f4d9ee41740 1 -- 172.21.15.84:0/385868530 >> 172.21.15.84:0/385868530 conn(0x56071d342460 msgr2=0x56071d6f6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:21.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.851+0000 7f4d9ee41740 1 -- 172.21.15.84:0/385868530 shutdown_connections 2024-09-21T03:46:21.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.851+0000 7f4d9ee41740 1 -- 172.21.15.84:0/385868530 wait complete. 2024-09-21T03:46:21.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.851+0000 7f4d9ee41740 20 client.16203 trim_cache size 0 max 16384 2024-09-21T03:46:21.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.864+0000 7f4d9ee41740 1 Processor -- start 2024-09-21T03:46:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.864+0000 7f4d9ee41740 1 -- start start 2024-09-21T03:46:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.865+0000 7f4d9ee41740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d30c9f0 0x56071d700570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.865+0000 7f4d9ee41740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56071d3251b0 0x56071d706ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.865+0000 7f4d9ee41740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d32d390 0x56071d6f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.865+0000 7f4d9ee41740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4d941afc80 con 0x56071d32d390 2024-09-21T03:46:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.865+0000 7f4d9ee41740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4d941ad550 con 0x56071d30c9f0 2024-09-21T03:46:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.865+0000 7f4d9ee41740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d941ab3a0 con 0x56071d3251b0 2024-09-21T03:46:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.865+0000 7f4d91d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d32d390 0x56071d6f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.865+0000 7f4d91d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d30c9f0 0x56071d700570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.865+0000 7f4d91d9b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d30c9f0 0x56071d700570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:49170/0 (socket says 172.21.15.84:49170) 2024-09-21T03:46:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.865+0000 7f4d91d9b640 1 -- 172.21.15.84:0/386479469 learned_addr learned my addr 172.21.15.84:0/386479469 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:21.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.865+0000 7f4d9259c640 1 --2- 172.21.15.84:0/386479469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56071d3251b0 0x56071d706ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:21.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.865+0000 7f4d91d9b640 1 -- 172.21.15.84:0/386479469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56071d3251b0 msgr2=0x56071d706ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:21.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.865+0000 7f4d91d9b640 1 --2- 172.21.15.84:0/386479469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56071d3251b0 0x56071d706ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.865+0000 7f4d91d9b640 1 -- 172.21.15.84:0/386479469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d30c9f0 msgr2=0x56071d700570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:21.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.865+0000 7f4d91d9b640 1 --2- 172.21.15.84:0/386479469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d30c9f0 0x56071d700570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.865+0000 7f4d91d9b640 1 -- 172.21.15.84:0/386479469 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56071d6f8080 con 0x56071d32d390 2024-09-21T03:46:21.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.866+0000 7f4d91d9b640 1 --2- 172.21.15.84:0/386479469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d32d390 0x56071d6f6a00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c01f4a0 tx=0x7f4d7c00bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9fb9fbce57da5c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:21.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.866+0000 7f4d7bfff640 1 -- 172.21.15.84:0/386479469 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c00b3b0 con 0x56071d32d390 2024-09-21T03:46:21.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.866+0000 7f4d7bfff640 1 -- 172.21.15.84:0/386479469 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d7c01a070 con 0x56071d32d390 2024-09-21T03:46:21.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.866+0000 7f4d7bfff640 1 -- 172.21.15.84:0/386479469 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c01fce0 con 0x56071d32d390 2024-09-21T03:46:21.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.867+0000 7f4d9ee41740 1 -- 172.21.15.84:0/386479469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d32d390 msgr2=0x56071d6f6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:21.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.867+0000 7f4d9ee41740 1 --2- 172.21.15.84:0/386479469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d32d390 0x56071d6f6a00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c01f4a0 tx=0x7f4d7c00bcf0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.867+0000 7f4d9ee41740 1 -- 172.21.15.84:0/386479469 shutdown_connections 2024-09-21T03:46:21.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.867+0000 7f4d9ee41740 1 --2- 172.21.15.84:0/386479469 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d32d390 0x56071d6f6a00 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.867+0000 7f4d9ee41740 1 --2- 172.21.15.84:0/386479469 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56071d3251b0 0x56071d706ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.867+0000 7f4d9ee41740 1 --2- 172.21.15.84:0/386479469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d30c9f0 0x56071d700570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.867+0000 7f4d9ee41740 1 -- 172.21.15.84:0/386479469 >> 172.21.15.84:0/386479469 conn(0x56071d342460 msgr2=0x56071d6f62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:21.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.867+0000 7f4d9ee41740 1 -- 172.21.15.84:0/386479469 shutdown_connections 2024-09-21T03:46:21.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.867+0000 7f4d9ee41740 1 -- 172.21.15.84:0/386479469 wait complete. 2024-09-21T03:46:21.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.867+0000 7f4d9ee41740 1 -- start start 2024-09-21T03:46:21.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.867+0000 7f4d9ee41740 1 Processor -- start 2024-09-21T03:46:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.867+0000 7f4d9ee41740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d30c9f0 0x56071d70b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.867+0000 7f4d9ee41740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d3251b0 0x56071d70b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.867+0000 7f4d9ee41740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56071d32d390 0x56071d70bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.867+0000 7f4d9ee41740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4d941aba10 con 0x56071d30c9f0 2024-09-21T03:46:21.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.867+0000 7f4d9ee41740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4d941ace80 con 0x56071d3251b0 2024-09-21T03:46:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.867+0000 7f4d9ee41740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d941ac0e0 con 0x56071d32d390 2024-09-21T03:46:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.868+0000 7f4d9ee41740 10 client.0 _ll_register_callbacks cb 0x7f4d7c00bee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:46:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.868+0000 7f4d91d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d30c9f0 0x56071d70b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.868+0000 7f4d91d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d30c9f0 0x56071d70b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35870/0 (socket says 172.21.15.84:35870) 2024-09-21T03:46:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.868+0000 7f4d91d9b640 1 -- 172.21.15.84:0/299481921 learned_addr learned my addr 172.21.15.84:0/299481921 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.868+0000 7f4d9259c640 1 --2- 172.21.15.84:0/299481921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d3251b0 0x56071d70b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.868+0000 7f4d91d9b640 1 --2- 172.21.15.84:0/299481921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56071d32d390 0x56071d70bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.868+0000 7f4d91d9b640 1 -- 172.21.15.84:0/299481921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56071d32d390 msgr2=0x56071d70bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.868+0000 7f4d91d9b640 1 --2- 172.21.15.84:0/299481921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56071d32d390 0x56071d70bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.868+0000 7f4d91d9b640 1 -- 172.21.15.84:0/299481921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d3251b0 msgr2=0x56071d70b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:21.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.868+0000 7f4d91d9b640 1 --2- 172.21.15.84:0/299481921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d3251b0 0x56071d70b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.868+0000 7f4d91d9b640 1 -- 172.21.15.84:0/299481921 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56071d780830 con 0x56071d30c9f0 2024-09-21T03:46:21.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.868+0000 7f4d91d9b640 1 --2- 172.21.15.84:0/299481921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d30c9f0 0x56071d70b200 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c000c00 tx=0x7f4d7c014380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6b039a45ca38a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:21.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.868+0000 7f4d79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:46:21.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.868+0000 7f4d79ffb640 1 -- 172.21.15.84:0/299481921 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c012930 con 0x56071d30c9f0 2024-09-21T03:46:21.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.868+0000 7f4d79ffb640 1 -- 172.21.15.84:0/299481921 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4d7c01f980 con 0x56071d30c9f0 2024-09-21T03:46:21.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.868+0000 7f4d9ee41740 1 -- 172.21.15.84:0/299481921 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d7c01a070 con 0x56071d30c9f0 2024-09-21T03:46:21.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.868+0000 7f4d79ffb640 1 -- 172.21.15.84:0/299481921 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4d7c012ad0 con 0x56071d30c9f0 2024-09-21T03:46:21.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.869+0000 7f4d9ee41740 10 client.16209 fetch_fsmap learned FSMap version 25 2024-09-21T03:46:21.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.869+0000 7f4d9ee41740 1 -- 172.21.15.84:0/299481921 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56071d781ab0 con 0x56071d30c9f0 2024-09-21T03:46:21.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.869+0000 7f4d79ffb640 1 -- 172.21.15.84:0/299481921 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d7c01a070 con 0x56071d30c9f0 2024-09-21T03:46:21.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.869+0000 7f4d79ffb640 1 -- 172.21.15.84:0/299481921 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4d7c02a040 con 0x56071d30c9f0 2024-09-21T03:46:21.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.869+0000 7f4d9ee41740 10 client.16209 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:46:21.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.869+0000 7f4d9ee41740 10 client.16209 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:46:21.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.869+0000 7f4d9ee41740 20 client.16209 populate_metadata read hostname 'smithi084' 2024-09-21T03:46:21.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.869+0000 7f4d9ee41740 1 --2- 172.21.15.84:0/299481921 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x56071d34e070 0x56071d784230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:21.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.869+0000 7f4d9ee41740 4 client.16209 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:46:21.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.869+0000 7f4d9ee41740 1 -- 172.21.15.84:0/299481921 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56071d6698a0 con 0x56071d34e070 2024-09-21T03:46:21.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.869+0000 7f4d9259c640 1 --2- 172.21.15.84:0/299481921 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x56071d34e070 0x56071d784230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:21.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.870+0000 7f4d79ffb640 10 client.16209 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:46:21.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.870+0000 7f4d9259c640 1 --2- 172.21.15.84:0/299481921 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x56071d34e070 0x56071d784230 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7c541f287c4482fb server_cookie=236b1a2b8b5a7ab4 in_seq=0 out_seq=0 2024-09-21T03:46:21.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.870+0000 7f4d79ffb640 1 -- 172.21.15.84:0/299481921 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56071d6698a0 con 0x56071d34e070 2024-09-21T03:46:21.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.870+0000 7f4d79ffb640 10 client.16209 handle_command_reply: tid=0 2024-09-21T03:46:21.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.870+0000 7f4d9ee41740 1 client.16209 shutdown 2024-09-21T03:46:21.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.870+0000 7f4d9ee41740 1 -- 172.21.15.84:0/299481921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d30c9f0 msgr2=0x56071d70b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:21.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.870+0000 7f4d9ee41740 1 --2- 172.21.15.84:0/299481921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d30c9f0 0x56071d70b200 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c000c00 tx=0x7f4d7c014380 comp rx=0 tx=0).stop 2024-09-21T03:46:21.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.870+0000 7f4d9ee41740 1 -- 172.21.15.84:0/299481921 shutdown_connections 2024-09-21T03:46:21.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.870+0000 7f4d9ee41740 1 --2- 172.21.15.84:0/299481921 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x56071d34e070 0x56071d784230 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.870+0000 7f4d9ee41740 1 --2- 172.21.15.84:0/299481921 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56071d32d390 0x56071d70bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.870+0000 7f4d9ee41740 1 --2- 172.21.15.84:0/299481921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56071d3251b0 0x56071d70b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.870+0000 7f4d79ffb640 0 client.16209 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:46:21.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.870+0000 7f4d9ee41740 1 --2- 172.21.15.84:0/299481921 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56071d30c9f0 0x56071d70b200 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.870+0000 7f4d9ee41740 1 -- 172.21.15.84:0/299481921 >> 172.21.15.84:0/299481921 conn(0x56071d342460 msgr2=0x56071d706c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:21.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.870+0000 7f4d9ee41740 1 -- 172.21.15.84:0/299481921 shutdown_connections 2024-09-21T03:46:21.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.870+0000 7f4d9ee41740 1 -- 172.21.15.84:0/299481921 wait complete. 2024-09-21T03:46:21.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.870+0000 7f4d9ee41740 20 client.16209 trim_cache size 0 max 16384 2024-09-21T03:46:21.881 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:46:21.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.871+0000 7f4d988cd640 1 -- 172.21.15.84:0/135664076 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4d800b6680 msgr2=0x7f4d800b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:21.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.871+0000 7f4d988cd640 1 --2- 172.21.15.84:0/135664076 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4d800b6680 0x7f4d800b8b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c1055e0 tx=0x7f4d8c09af10 comp rx=0 tx=0).stop 2024-09-21T03:46:21.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.871+0000 7f4d988cd640 1 -- 172.21.15.84:0/135664076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d94109e00 msgr2=0x7f4d9419fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:21.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.871+0000 7f4d988cd640 1 --2- 172.21.15.84:0/135664076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d94109e00 0x7f4d9419fd30 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009a20 tx=0x7f4d8c004270 comp rx=0 tx=0).stop 2024-09-21T03:46:21.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.871+0000 7f4d988cd640 1 -- 172.21.15.84:0/135664076 shutdown_connections 2024-09-21T03:46:21.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.871+0000 7f4d988cd640 1 --2- 172.21.15.84:0/135664076 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4d800b6680 0x7f4d800b8b90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.871+0000 7f4d988cd640 1 --2- 172.21.15.84:0/135664076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d94109e00 0x7f4d9419fd30 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.871+0000 7f4d988cd640 1 --2- 172.21.15.84:0/135664076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d941094b0 0x7f4d9419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.871+0000 7f4d988cd640 1 --2- 172.21.15.84:0/135664076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d94101f70 0x7f4d9419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:21.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.871+0000 7f4d988cd640 1 -- 172.21.15.84:0/135664076 >> 172.21.15.84:0/135664076 conn(0x7f4d94077c60 msgr2=0x7f4d94107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:21.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.871+0000 7f4d988cd640 1 -- 172.21.15.84:0/135664076 shutdown_connections 2024-09-21T03:46:21.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:21.871+0000 7f4d988cd640 1 -- 172.21.15.84:0/135664076 wait complete. 2024-09-21T03:46:21.883 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:21 smithi174 ceph-mon[34403]: pgmap v440: 97 pgs: 97 active+clean; 4.9 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-09-21T03:46:21.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:21 smithi172 ceph-mon[34821]: pgmap v440: 97 pgs: 97 active+clean; 4.9 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-09-21T03:46:22.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:22 smithi084 ceph-mon[30941]: pgmap v441: 97 pgs: 97 active+clean; 4.9 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-09-21T03:46:22.687 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:46:22.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:22 smithi174 ceph-mon[34403]: pgmap v441: 97 pgs: 97 active+clean; 4.9 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-09-21T03:46:22.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:22 smithi172 ceph-mon[34821]: pgmap v441: 97 pgs: 97 active+clean; 4.9 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-09-21T03:46:22.933 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:23.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.447+0000 7facbcd9f640 1 -- 172.21.15.84:0/3691739120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facb81081b0 msgr2=0x7facb81085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:23.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.447+0000 7facbcd9f640 1 --2- 172.21.15.84:0/3691739120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facb81081b0 0x7facb81085c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7faca8009900 tx=0x7faca802a410 comp rx=0 tx=0).stop 2024-09-21T03:46:23.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.447+0000 7facbcd9f640 1 -- 172.21.15.84:0/3691739120 shutdown_connections 2024-09-21T03:46:23.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.447+0000 7facbcd9f640 1 --2- 172.21.15.84:0/3691739120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7facb8108b00 0x7facb810f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.447+0000 7facbcd9f640 1 --2- 172.21.15.84:0/3691739120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facb81081b0 0x7facb81085c0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.447+0000 7facbcd9f640 1 --2- 172.21.15.84:0/3691739120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facb8102870 0x7facb8102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.447+0000 7facbcd9f640 1 -- 172.21.15.84:0/3691739120 >> 172.21.15.84:0/3691739120 conn(0x7facb80fe2c0 msgr2=0x7facb8100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:23.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.447+0000 7facbcd9f640 1 -- 172.21.15.84:0/3691739120 shutdown_connections 2024-09-21T03:46:23.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.447+0000 7facbcd9f640 1 -- 172.21.15.84:0/3691739120 wait complete. 2024-09-21T03:46:23.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.448+0000 7facbcd9f640 1 Processor -- start 2024-09-21T03:46:23.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.448+0000 7facbcd9f640 1 -- start start 2024-09-21T03:46:23.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.448+0000 7facbcd9f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7facb8102870 0x7facb819b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:23.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.448+0000 7facbcd9f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facb81081b0 0x7facb819b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:23.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.448+0000 7facbcd9f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facb8108b00 0x7facb819bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:23.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.448+0000 7facbcd9f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7facb81127e0 con 0x7facb8108b00 2024-09-21T03:46:23.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.448+0000 7facbcd9f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7facb8112660 con 0x7facb81081b0 2024-09-21T03:46:23.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.448+0000 7facbcd9f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7facb8112960 con 0x7facb8102870 2024-09-21T03:46:23.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.448+0000 7facb7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facb8108b00 0x7facb819bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:23.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.449+0000 7facb7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facb8108b00 0x7facb819bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35888/0 (socket says 172.21.15.84:35888) 2024-09-21T03:46:23.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.449+0000 7facb7fff640 1 -- 172.21.15.84:0/3177120488 learned_addr learned my addr 172.21.15.84:0/3177120488 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:23.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.449+0000 7facb77fe640 1 --2- 172.21.15.84:0/3177120488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7facb8102870 0x7facb819b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:23.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.449+0000 7facb6ffd640 1 --2- 172.21.15.84:0/3177120488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facb81081b0 0x7facb819b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:23.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.449+0000 7facb7fff640 1 -- 172.21.15.84:0/3177120488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7facb8102870 msgr2=0x7facb819b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:23.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.449+0000 7facb7fff640 1 --2- 172.21.15.84:0/3177120488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7facb8102870 0x7facb819b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.449+0000 7facb7fff640 1 -- 172.21.15.84:0/3177120488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facb81081b0 msgr2=0x7facb819b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:23.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.449+0000 7facb7fff640 1 --2- 172.21.15.84:0/3177120488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facb81081b0 0x7facb819b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.449+0000 7facb7fff640 1 -- 172.21.15.84:0/3177120488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb81a63b0 con 0x7facb8108b00 2024-09-21T03:46:23.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.449+0000 7facb6ffd640 1 --2- 172.21.15.84:0/3177120488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facb81081b0 0x7facb819b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:46:23.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.449+0000 7facb7fff640 1 --2- 172.21.15.84:0/3177120488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facb8108b00 0x7facb819bc30 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7facb000b970 tx=0x7facb000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:23.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.449+0000 7facb4ff9640 1 -- 172.21.15.84:0/3177120488 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb0019070 con 0x7facb8108b00 2024-09-21T03:46:23.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.449+0000 7facb4ff9640 1 -- 172.21.15.84:0/3177120488 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7facb0014440 con 0x7facb8108b00 2024-09-21T03:46:23.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.449+0000 7facb4ff9640 1 -- 172.21.15.84:0/3177120488 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb00075d0 con 0x7facb8108b00 2024-09-21T03:46:23.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.449+0000 7facbcd9f640 1 -- 172.21.15.84:0/3177120488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facb81a66a0 con 0x7facb8108b00 2024-09-21T03:46:23.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.449+0000 7facbcd9f640 1 -- 172.21.15.84:0/3177120488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facb81a6b60 con 0x7facb8108b00 2024-09-21T03:46:23.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.452+0000 7facc4575740 1 Processor -- start 2024-09-21T03:46:23.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.452+0000 7facb4ff9640 1 -- 172.21.15.84:0/3177120488 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7facb001c070 con 0x7facb8108b00 2024-09-21T03:46:23.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.452+0000 7facc4575740 1 -- start start 2024-09-21T03:46:23.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.452+0000 7facc4575740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3992a1070 0x55f399648460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:23.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.452+0000 7facc4575740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 0x55f3996489a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:23.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.452+0000 7facc4575740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f399280390 0x55f399648ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:23.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.452+0000 7facc4575740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f3995beea0 con 0x55f3992781b0 2024-09-21T03:46:23.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.452+0000 7facc4575740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f3995ae2d0 con 0x55f399280390 2024-09-21T03:46:23.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.452+0000 7facc4575740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f3995b20e0 con 0x55f3992a1070 2024-09-21T03:46:23.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.452+0000 7facb77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 0x55f3996489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:23.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.453+0000 7facb77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 0x55f3996489a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35898/0 (socket says 172.21.15.84:35898) 2024-09-21T03:46:23.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.453+0000 7facb77fe640 1 -- 172.21.15.84:0/2734420153 learned_addr learned my addr 172.21.15.84:0/2734420153 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:23.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.453+0000 7facb6ffd640 1 --2- 172.21.15.84:0/2734420153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3992a1070 0x55f399648460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:23.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.453+0000 7facb6ffd640 1 --2- 172.21.15.84:0/2734420153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f399280390 0x55f399648ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:23.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.453+0000 7facb4ff9640 1 --2- 172.21.15.84:0/3177120488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7faca40b66b0 0x7faca40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:23.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.453+0000 7facb77fe640 1 -- 172.21.15.84:0/2734420153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3992a1070 msgr2=0x55f399648460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:23.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.453+0000 7facb77fe640 1 --2- 172.21.15.84:0/2734420153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3992a1070 0x55f399648460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.453+0000 7facb77fe640 1 -- 172.21.15.84:0/2734420153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f399280390 msgr2=0x55f399648ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:23.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.453+0000 7facb77fe640 1 --2- 172.21.15.84:0/2734420153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f399280390 0x55f399648ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.453+0000 7facb77fe640 1 -- 172.21.15.84:0/2734420153 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f39930c650 con 0x55f3992781b0 2024-09-21T03:46:23.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.453+0000 7facb6ffd640 1 --2- 172.21.15.84:0/2734420153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3992a1070 0x55f399648460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:46:23.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.453+0000 7facb7fff640 1 --2- 172.21.15.84:0/3177120488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7faca40b66b0 0x7faca40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:23.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.453+0000 7facb77fe640 1 --2- 172.21.15.84:0/2734420153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 0x55f3996489a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7faca000ac80 tx=0x7faca000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0309328495b0520 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:23.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.453+0000 7facadffb640 1 -- 172.21.15.84:0/2734420153 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca001d070 con 0x55f3992781b0 2024-09-21T03:46:23.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.453+0000 7facb4ff9640 1 -- 172.21.15.84:0/3177120488 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7facb00e6b20 con 0x7facb8108b00 2024-09-21T03:46:23.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.453+0000 7facadffb640 1 -- 172.21.15.84:0/2734420153 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faca0018af0 con 0x55f3992781b0 2024-09-21T03:46:23.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.454+0000 7facadffb640 1 -- 172.21.15.84:0/2734420153 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca00109f0 con 0x55f3992781b0 2024-09-21T03:46:23.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.454+0000 7facc4575740 1 -- 172.21.15.84:0/2734420153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 msgr2=0x55f3996489a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:23.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.454+0000 7facb7fff640 1 --2- 172.21.15.84:0/3177120488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7faca40b66b0 0x7faca40b8bc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7facb00ac980 tx=0x7facb0079cd0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.454+0000 7facc4575740 1 --2- 172.21.15.84:0/2734420153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 0x55f3996489a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7faca000ac80 tx=0x7faca000f790 comp rx=0 tx=0).stop 2024-09-21T03:46:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.454+0000 7facc4575740 1 -- 172.21.15.84:0/2734420153 shutdown_connections 2024-09-21T03:46:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.454+0000 7facc4575740 1 --2- 172.21.15.84:0/2734420153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f399280390 0x55f399648ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.454+0000 7facc4575740 1 --2- 172.21.15.84:0/2734420153 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 0x55f3996489a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.454+0000 7facc4575740 1 --2- 172.21.15.84:0/2734420153 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3992a1070 0x55f399648460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.454+0000 7facc4575740 1 -- 172.21.15.84:0/2734420153 >> 172.21.15.84:0/2734420153 conn(0x55f399295460 msgr2=0x55f399646350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.454+0000 7facc4575740 1 -- 172.21.15.84:0/2734420153 shutdown_connections 2024-09-21T03:46:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.454+0000 7facc4575740 1 -- 172.21.15.84:0/2734420153 wait complete. 2024-09-21T03:46:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.455+0000 7facc4575740 1 -- start start 2024-09-21T03:46:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.455+0000 7facc4575740 1 Processor -- start 2024-09-21T03:46:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.455+0000 7facc4575740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 0x55f399653af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.455+0000 7facc4575740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f399280390 0x55f399654030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:23.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.455+0000 7facc4575740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3992a1070 0x55f39965ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:23.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.455+0000 7facc4575740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f39940f700 con 0x55f3992781b0 2024-09-21T03:46:23.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.455+0000 7facc4575740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f399549160 con 0x55f3992a1070 2024-09-21T03:46:23.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.455+0000 7facc4575740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f399656c90 con 0x55f399280390 2024-09-21T03:46:23.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.455+0000 7facc4575740 10 client.0 _ll_register_callbacks cb 0x55f3995629e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:46:23.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.455+0000 7facb6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 0x55f399653af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:23.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.456+0000 7facb6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 0x55f399653af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35902/0 (socket says 172.21.15.84:35902) 2024-09-21T03:46:23.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.456+0000 7facb6ffd640 1 -- 172.21.15.84:0/457298940 learned_addr learned my addr 172.21.15.84:0/457298940 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:23.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.456+0000 7facb77fe640 1 --2- 172.21.15.84:0/457298940 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f399280390 0x55f399654030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:23.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.456+0000 7facb6ffd640 1 --2- 172.21.15.84:0/457298940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3992a1070 0x55f39965ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:23.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.456+0000 7facb6ffd640 1 -- 172.21.15.84:0/457298940 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f399280390 msgr2=0x55f399654030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:23.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.456+0000 7facb6ffd640 1 --2- 172.21.15.84:0/457298940 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f399280390 0x55f399654030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.456+0000 7facb6ffd640 1 -- 172.21.15.84:0/457298940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3992a1070 msgr2=0x55f39965ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:23.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.456+0000 7facb6ffd640 1 --2- 172.21.15.84:0/457298940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3992a1070 0x55f39965ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.456+0000 7facb6ffd640 1 -- 172.21.15.84:0/457298940 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f399576c90 con 0x55f3992781b0 2024-09-21T03:46:23.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.456+0000 7facb6ffd640 1 --2- 172.21.15.84:0/457298940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 0x55f399653af0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7facb806aa90 tx=0x7faca8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e412e0d597a2a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:23.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.456+0000 7fac96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:46:23.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.456+0000 7fac96ffd640 1 -- 172.21.15.84:0/457298940 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8035040 con 0x55f3992781b0 2024-09-21T03:46:23.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.456+0000 7fac96ffd640 1 -- 172.21.15.84:0/457298940 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7faca8005220 con 0x55f3992781b0 2024-09-21T03:46:23.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.456+0000 7facc4575740 1 -- 172.21.15.84:0/457298940 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faca0018af0 con 0x55f3992781b0 2024-09-21T03:46:23.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.456+0000 7fac96ffd640 1 -- 172.21.15.84:0/457298940 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faca8005420 con 0x55f3992781b0 2024-09-21T03:46:23.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.457+0000 7facc4575740 10 client.16221 fetch_fsmap learned FSMap version 25 2024-09-21T03:46:23.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.457+0000 7facc4575740 1 -- 172.21.15.84:0/457298940 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f399662970 con 0x55f3992781b0 2024-09-21T03:46:23.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.457+0000 7fac96ffd640 1 -- 172.21.15.84:0/457298940 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faca0018af0 con 0x55f3992781b0 2024-09-21T03:46:23.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.457+0000 7fac96ffd640 1 -- 172.21.15.84:0/457298940 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7faca803a040 con 0x55f3992781b0 2024-09-21T03:46:23.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.457+0000 7facc4575740 10 client.16221 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:46:23.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.457+0000 7facc4575740 10 client.16221 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:46:23.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.457+0000 7facc4575740 20 client.16221 populate_metadata read hostname 'smithi084' 2024-09-21T03:46:23.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.457+0000 7facc4575740 1 --2- 172.21.15.84:0/457298940 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55f39925f9f0 0x55f399665d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:23.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.457+0000 7facc4575740 4 client.16221 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:46:23.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.457+0000 7facc4575740 1 -- 172.21.15.84:0/457298940 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3995c0df0 con 0x55f39925f9f0 2024-09-21T03:46:23.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.457+0000 7facb77fe640 1 --2- 172.21.15.84:0/457298940 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55f39925f9f0 0x55f399665d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:23.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.458+0000 7fac96ffd640 10 client.16221 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:46:23.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.458+0000 7facb77fe640 1 --2- 172.21.15.84:0/457298940 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55f39925f9f0 0x55f399665d90 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7ae5ef5f2ff6d66a server_cookie=ec7c88fd961d167d in_seq=0 out_seq=0 2024-09-21T03:46:23.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.459+0000 7fac96ffd640 1 -- 172.21.15.84:0/457298940 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f3995c0df0 con 0x55f39925f9f0 2024-09-21T03:46:23.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.459+0000 7fac96ffd640 10 client.16221 handle_command_reply: tid=0 2024-09-21T03:46:23.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.459+0000 7facc4575740 1 client.16221 shutdown 2024-09-21T03:46:23.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.459+0000 7facc4575740 1 -- 172.21.15.84:0/457298940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 msgr2=0x55f399653af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:23.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.459+0000 7facc4575740 1 --2- 172.21.15.84:0/457298940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 0x55f399653af0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7facb806aa90 tx=0x7faca8009260 comp rx=0 tx=0).stop 2024-09-21T03:46:23.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.459+0000 7facc4575740 1 -- 172.21.15.84:0/457298940 shutdown_connections 2024-09-21T03:46:23.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.459+0000 7facc4575740 1 --2- 172.21.15.84:0/457298940 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55f39925f9f0 0x55f399665d90 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.459+0000 7facc4575740 1 --2- 172.21.15.84:0/457298940 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3992a1070 0x55f39965ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.459+0000 7facc4575740 1 --2- 172.21.15.84:0/457298940 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f399280390 0x55f399654030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.459+0000 7facc4575740 1 --2- 172.21.15.84:0/457298940 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 0x55f399653af0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.459+0000 7facc4575740 1 -- 172.21.15.84:0/457298940 >> 172.21.15.84:0/457298940 conn(0x55f399295460 msgr2=0x55f399649e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:23.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.459+0000 7fac96ffd640 0 client.16221 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:46:23.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.459+0000 7facc4575740 1 -- 172.21.15.84:0/457298940 shutdown_connections 2024-09-21T03:46:23.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.459+0000 7facc4575740 1 -- 172.21.15.84:0/457298940 wait complete. 2024-09-21T03:46:23.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.459+0000 7facc4575740 20 client.16221 trim_cache size 0 max 16384 2024-09-21T03:46:23.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.472+0000 7facc4575740 1 Processor -- start 2024-09-21T03:46:23.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.472+0000 7facc4575740 1 -- start start 2024-09-21T03:46:23.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.473+0000 7facc4575740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3992781b0 0x55f3996538a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:23.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.473+0000 7facc4575740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f399280390 0x55f399653de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:23.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.473+0000 7facc4575740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3992a1070 0x55f399650ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:23.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.473+0000 7facc4575740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7facb81b1c50 con 0x55f399280390 2024-09-21T03:46:23.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.473+0000 7facc4575740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7facb81af520 con 0x55f3992781b0 2024-09-21T03:46:23.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.473+0000 7facc4575740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7facb81ad370 con 0x55f3992a1070 2024-09-21T03:46:23.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.473+0000 7facb77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f399280390 0x55f399653de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:23.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.473+0000 7facb77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f399280390 0x55f399653de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35904/0 (socket says 172.21.15.84:35904) 2024-09-21T03:46:23.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.473+0000 7facb77fe640 1 -- 172.21.15.84:0/734641158 learned_addr learned my addr 172.21.15.84:0/734641158 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:23.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.473+0000 7facb6ffd640 1 --2- 172.21.15.84:0/734641158 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3992a1070 0x55f399650ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:23.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.473+0000 7facb77fe640 1 -- 172.21.15.84:0/734641158 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3992a1070 msgr2=0x55f399650ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:23.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.473+0000 7facb77fe640 1 --2- 172.21.15.84:0/734641158 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3992a1070 0x55f399650ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.473+0000 7facb77fe640 1 -- 172.21.15.84:0/734641158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3992781b0 msgr2=0x55f3996538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:23.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.473+0000 7facb77fe640 1 --2- 172.21.15.84:0/734641158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3992781b0 0x55f3996538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.473+0000 7facb77fe640 1 -- 172.21.15.84:0/734641158 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3996662f0 con 0x55f399280390 2024-09-21T03:46:23.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.473+0000 7facb6ffd640 1 --2- 172.21.15.84:0/734641158 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3992a1070 0x55f399650ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:46:23.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.473+0000 7facb77fe640 1 --2- 172.21.15.84:0/734641158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f399280390 0x55f399653de0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7faca000ac80 tx=0x7faca000a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b159c07433810c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:23.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.473+0000 7facad7fa640 1 -- 172.21.15.84:0/734641158 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca002f020 con 0x55f399280390 2024-09-21T03:46:23.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.474+0000 7facad7fa640 1 -- 172.21.15.84:0/734641158 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faca000a8b0 con 0x55f399280390 2024-09-21T03:46:23.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.474+0000 7facad7fa640 1 -- 172.21.15.84:0/734641158 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca001d040 con 0x55f399280390 2024-09-21T03:46:23.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.474+0000 7facc4575740 1 -- 172.21.15.84:0/734641158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f399280390 msgr2=0x55f399653de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:23.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.474+0000 7facc4575740 1 --2- 172.21.15.84:0/734641158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f399280390 0x55f399653de0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7faca000ac80 tx=0x7faca000a840 comp rx=0 tx=0).stop 2024-09-21T03:46:23.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.474+0000 7facc4575740 1 -- 172.21.15.84:0/734641158 shutdown_connections 2024-09-21T03:46:23.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.474+0000 7facc4575740 1 --2- 172.21.15.84:0/734641158 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3992a1070 0x55f399650ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.474+0000 7facc4575740 1 --2- 172.21.15.84:0/734641158 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f399280390 0x55f399653de0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.474+0000 7facc4575740 1 --2- 172.21.15.84:0/734641158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f3992781b0 0x55f3996538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.474+0000 7facc4575740 1 -- 172.21.15.84:0/734641158 >> 172.21.15.84:0/734641158 conn(0x55f399295460 msgr2=0x55f399652370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:23.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.474+0000 7facc4575740 1 -- 172.21.15.84:0/734641158 shutdown_connections 2024-09-21T03:46:23.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.474+0000 7facc4575740 1 -- 172.21.15.84:0/734641158 wait complete. 2024-09-21T03:46:23.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.475+0000 7facc4575740 1 -- start start 2024-09-21T03:46:23.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.475+0000 7facc4575740 1 Processor -- start 2024-09-21T03:46:23.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.475+0000 7facc4575740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 0x55f399657e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:23.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.475+0000 7facc4575740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f399280390 0x55f399658340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:23.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.475+0000 7facc4575740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3992a1070 0x55f399658880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:23.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.475+0000 7facc4575740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7facb81ad9e0 con 0x55f3992781b0 2024-09-21T03:46:23.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.475+0000 7facc4575740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7facb81aee50 con 0x55f399280390 2024-09-21T03:46:23.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.475+0000 7facc4575740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7facb81ae0b0 con 0x55f3992a1070 2024-09-21T03:46:23.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.475+0000 7facc4575740 10 client.0 _ll_register_callbacks cb 0x7faca8009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:46:23.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.476+0000 7facb6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 0x55f399657e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:23.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.476+0000 7facb6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 0x55f399657e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35920/0 (socket says 172.21.15.84:35920) 2024-09-21T03:46:23.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.476+0000 7facb6ffd640 1 -- 172.21.15.84:0/3482158366 learned_addr learned my addr 172.21.15.84:0/3482158366 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:23.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.476+0000 7facb77fe640 1 --2- 172.21.15.84:0/3482158366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f399280390 0x55f399658340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:23.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.476+0000 7facb6ffd640 1 -- 172.21.15.84:0/3482158366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3992a1070 msgr2=0x55f399658880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:23.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.476+0000 7facb6ffd640 1 --2- 172.21.15.84:0/3482158366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3992a1070 0x55f399658880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.476+0000 7facb6ffd640 1 -- 172.21.15.84:0/3482158366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f399280390 msgr2=0x55f399658340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:23.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.476+0000 7facb6ffd640 1 --2- 172.21.15.84:0/3482158366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f399280390 0x55f399658340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.476+0000 7facb6ffd640 1 -- 172.21.15.84:0/3482158366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3996cf730 con 0x55f3992781b0 2024-09-21T03:46:23.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.476+0000 7facb6ffd640 1 --2- 172.21.15.84:0/3482158366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 0x55f399657e00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7faca8006010 tx=0x7faca8005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87028cad54ec81f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:23.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.476+0000 7fac96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:46:23.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.476+0000 7fac96ffd640 1 -- 172.21.15.84:0/3482158366 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca8035030 con 0x55f3992781b0 2024-09-21T03:46:23.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.476+0000 7fac96ffd640 1 -- 172.21.15.84:0/3482158366 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7faca8004040 con 0x55f3992781b0 2024-09-21T03:46:23.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.476+0000 7facc4575740 1 -- 172.21.15.84:0/3482158366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f3995bc8a0 con 0x55f3992781b0 2024-09-21T03:46:23.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.476+0000 7fac96ffd640 1 -- 172.21.15.84:0/3482158366 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faca8031b10 con 0x55f3992781b0 2024-09-21T03:46:23.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.476+0000 7facc4575740 10 client.16227 fetch_fsmap learned FSMap version 25 2024-09-21T03:46:23.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.476+0000 7facc4575740 1 -- 172.21.15.84:0/3482158366 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f3996d0860 con 0x55f3992781b0 2024-09-21T03:46:23.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.477+0000 7fac96ffd640 1 -- 172.21.15.84:0/3482158366 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f3995bc8a0 con 0x55f3992781b0 2024-09-21T03:46:23.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.477+0000 7fac96ffd640 1 -- 172.21.15.84:0/3482158366 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7faca8004b00 con 0x55f3992781b0 2024-09-21T03:46:23.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.477+0000 7facc4575740 10 client.16227 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:46:23.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.477+0000 7facc4575740 10 client.16227 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:46:23.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.477+0000 7facc4575740 20 client.16227 populate_metadata read hostname 'smithi084' 2024-09-21T03:46:23.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.477+0000 7facc4575740 1 --2- 172.21.15.84:0/3482158366 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55f399234da0 0x55f3996d3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.477+0000 7facc4575740 4 client.16227 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:46:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.477+0000 7facc4575740 1 -- 172.21.15.84:0/3482158366 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f3995b9cd0 con 0x55f399234da0 2024-09-21T03:46:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.477+0000 7facb77fe640 1 --2- 172.21.15.84:0/3482158366 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55f399234da0 0x55f3996d3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.477+0000 7fac96ffd640 10 client.16227 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:46:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.477+0000 7facb77fe640 1 --2- 172.21.15.84:0/3482158366 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55f399234da0 0x55f3996d3050 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=29c14ba4fb95fad3 server_cookie=e573e7aba3117792 in_seq=0 out_seq=0 2024-09-21T03:46:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.478+0000 7fac96ffd640 1 -- 172.21.15.84:0/3482158366 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f3995b9cd0 con 0x55f399234da0 2024-09-21T03:46:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.478+0000 7fac96ffd640 10 client.16227 handle_command_reply: tid=0 2024-09-21T03:46:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.478+0000 7facc4575740 1 client.16227 shutdown 2024-09-21T03:46:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.478+0000 7facc4575740 1 -- 172.21.15.84:0/3482158366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 msgr2=0x55f399657e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.478+0000 7facc4575740 1 --2- 172.21.15.84:0/3482158366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 0x55f399657e00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7faca8006010 tx=0x7faca8005e30 comp rx=0 tx=0).stop 2024-09-21T03:46:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.478+0000 7facc4575740 1 -- 172.21.15.84:0/3482158366 shutdown_connections 2024-09-21T03:46:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.478+0000 7facc4575740 1 --2- 172.21.15.84:0/3482158366 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55f399234da0 0x55f3996d3050 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.478+0000 7facc4575740 1 --2- 172.21.15.84:0/3482158366 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f3992a1070 0x55f399658880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.478+0000 7facc4575740 1 --2- 172.21.15.84:0/3482158366 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f399280390 0x55f399658340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.478+0000 7facc4575740 1 --2- 172.21.15.84:0/3482158366 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f3992781b0 0x55f399657e00 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.478+0000 7facc4575740 1 -- 172.21.15.84:0/3482158366 >> 172.21.15.84:0/3482158366 conn(0x55f399295460 msgr2=0x55f399651f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:23.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.478+0000 7fac96ffd640 0 client.16227 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:46:23.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.478+0000 7facc4575740 1 -- 172.21.15.84:0/3482158366 shutdown_connections 2024-09-21T03:46:23.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.478+0000 7facc4575740 1 -- 172.21.15.84:0/3482158366 wait complete. 2024-09-21T03:46:23.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.478+0000 7facc4575740 20 client.16227 trim_cache size 0 max 16384 2024-09-21T03:46:23.485 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:46:23.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.479+0000 7facbcd9f640 1 -- 172.21.15.84:0/3177120488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7faca40b66b0 msgr2=0x7faca40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:23.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.479+0000 7facbcd9f640 1 --2- 172.21.15.84:0/3177120488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7faca40b66b0 0x7faca40b8bc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7facb00ac980 tx=0x7facb0079cd0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.479+0000 7facbcd9f640 1 -- 172.21.15.84:0/3177120488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facb8108b00 msgr2=0x7facb819bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:23.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.479+0000 7facbcd9f640 1 --2- 172.21.15.84:0/3177120488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facb8108b00 0x7facb819bc30 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7facb000b970 tx=0x7facb000bd70 comp rx=0 tx=0).stop 2024-09-21T03:46:23.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.479+0000 7facbcd9f640 1 -- 172.21.15.84:0/3177120488 shutdown_connections 2024-09-21T03:46:23.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.479+0000 7facbcd9f640 1 --2- 172.21.15.84:0/3177120488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7faca40b66b0 0x7faca40b8bc0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.479+0000 7facbcd9f640 1 --2- 172.21.15.84:0/3177120488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7facb8108b00 0x7facb819bc30 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.479+0000 7facbcd9f640 1 --2- 172.21.15.84:0/3177120488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7facb81081b0 0x7facb819b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.479+0000 7facbcd9f640 1 --2- 172.21.15.84:0/3177120488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7facb8102870 0x7facb819b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:23.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.479+0000 7facbcd9f640 1 -- 172.21.15.84:0/3177120488 >> 172.21.15.84:0/3177120488 conn(0x7facb80fe2c0 msgr2=0x7facb81006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:23.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.479+0000 7facbcd9f640 1 -- 172.21.15.84:0/3177120488 shutdown_connections 2024-09-21T03:46:23.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:23.479+0000 7facbcd9f640 1 -- 172.21.15.84:0/3177120488 wait complete. 2024-09-21T03:46:24.330 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:46:24.581 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:25.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.089+0000 7f98316b1640 1 -- 172.21.15.84:0/2140699742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f982c108d10 msgr2=0x7f982c10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:25.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.089+0000 7f98316b1640 1 --2- 172.21.15.84:0/2140699742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f982c108d10 0x7f982c10f540 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9824009ca0 tx=0x7f982402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.089+0000 7f98316b1640 1 -- 172.21.15.84:0/2140699742 shutdown_connections 2024-09-21T03:46:25.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.089+0000 7f98316b1640 1 --2- 172.21.15.84:0/2140699742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f982c108d10 0x7f982c10f540 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.089+0000 7f98316b1640 1 --2- 172.21.15.84:0/2140699742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f982c1083c0 0x7f982c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.089+0000 7f98316b1640 1 --2- 172.21.15.84:0/2140699742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f982c102a80 0x7f982c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.089+0000 7f98316b1640 1 -- 172.21.15.84:0/2140699742 >> 172.21.15.84:0/2140699742 conn(0x7f982c079740 msgr2=0x7f982c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:25.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.089+0000 7f98316b1640 1 -- 172.21.15.84:0/2140699742 shutdown_connections 2024-09-21T03:46:25.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.089+0000 7f98316b1640 1 -- 172.21.15.84:0/2140699742 wait complete. 2024-09-21T03:46:25.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.089+0000 7f98316b1640 1 Processor -- start 2024-09-21T03:46:25.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.089+0000 7f98316b1640 1 -- start start 2024-09-21T03:46:25.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.090+0000 7f98316b1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f982c102a80 0x7f982c19b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:25.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.090+0000 7f98316b1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f982c1083c0 0x7f982c19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:25.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.090+0000 7f98316b1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f982c108d10 0x7f982c19bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:25.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.090+0000 7f98316b1640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f982c112a60 con 0x7f982c108d10 2024-09-21T03:46:25.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.090+0000 7f98316b1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f982c1128e0 con 0x7f982c1083c0 2024-09-21T03:46:25.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.090+0000 7f98316b1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f982c112be0 con 0x7f982c102a80 2024-09-21T03:46:25.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.090+0000 7f982b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f982c108d10 0x7f982c19bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:25.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.090+0000 7f982b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f982c108d10 0x7f982c19bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35934/0 (socket says 172.21.15.84:35934) 2024-09-21T03:46:25.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.090+0000 7f982b7fe640 1 -- 172.21.15.84:0/2168783548 learned_addr learned my addr 172.21.15.84:0/2168783548 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:25.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.090+0000 7f982affd640 1 --2- 172.21.15.84:0/2168783548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f982c102a80 0x7f982c19b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:25.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.090+0000 7f9823fff640 1 --2- 172.21.15.84:0/2168783548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f982c1083c0 0x7f982c19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:25.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.090+0000 7f982b7fe640 1 -- 172.21.15.84:0/2168783548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f982c102a80 msgr2=0x7f982c19b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:25.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.090+0000 7f982b7fe640 1 --2- 172.21.15.84:0/2168783548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f982c102a80 0x7f982c19b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.090+0000 7f982b7fe640 1 -- 172.21.15.84:0/2168783548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f982c1083c0 msgr2=0x7f982c19b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:25.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.090+0000 7f982b7fe640 1 --2- 172.21.15.84:0/2168783548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f982c1083c0 0x7f982c19b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.090+0000 7f982b7fe640 1 -- 172.21.15.84:0/2168783548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c1a6680 con 0x7f982c108d10 2024-09-21T03:46:25.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.090+0000 7f982affd640 1 --2- 172.21.15.84:0/2168783548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f982c102a80 0x7f982c19b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:46:25.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.090+0000 7f9823fff640 1 --2- 172.21.15.84:0/2168783548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f982c1083c0 0x7f982c19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:46:25.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.090+0000 7f982b7fe640 1 --2- 172.21.15.84:0/2168783548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f982c108d10 0x7f982c19bdf0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9824005cc0 tx=0x7f982402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:25.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.091+0000 7f9828ff9640 1 -- 172.21.15.84:0/2168783548 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9824003cf0 con 0x7f982c108d10 2024-09-21T03:46:25.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.091+0000 7f98316b1640 1 -- 172.21.15.84:0/2168783548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f982c1a6910 con 0x7f982c108d10 2024-09-21T03:46:25.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.091+0000 7f9828ff9640 1 -- 172.21.15.84:0/2168783548 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98240044f0 con 0x7f982c108d10 2024-09-21T03:46:25.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.091+0000 7f9828ff9640 1 -- 172.21.15.84:0/2168783548 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982402fd10 con 0x7f982c108d10 2024-09-21T03:46:25.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.091+0000 7f98316b1640 1 -- 172.21.15.84:0/2168783548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f982c1a6ed0 con 0x7f982c108d10 2024-09-21T03:46:25.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.093+0000 7f9837c25740 1 Processor -- start 2024-09-21T03:46:25.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.093+0000 7f9828ff9640 1 -- 172.21.15.84:0/2168783548 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f98240305c0 con 0x7f982c108d10 2024-09-21T03:46:25.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.094+0000 7f9837c25740 1 -- start start 2024-09-21T03:46:25.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.094+0000 7f9837c25740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261d2070 0x562d265796a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:25.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.094+0000 7f9837c25740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261a91b0 0x562d26579be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:25.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.094+0000 7f9837c25740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261b1390 0x562d2657a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:25.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.094+0000 7f9837c25740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562d264efea0 con 0x562d261a91b0 2024-09-21T03:46:25.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.094+0000 7f9837c25740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562d264df2d0 con 0x562d261d2070 2024-09-21T03:46:25.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.094+0000 7f9837c25740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562d264e30e0 con 0x562d261b1390 2024-09-21T03:46:25.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.094+0000 7f982affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261a91b0 0x562d26579be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:25.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.094+0000 7f982affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261a91b0 0x562d26579be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35942/0 (socket says 172.21.15.84:35942) 2024-09-21T03:46:25.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.094+0000 7f982affd640 1 -- 172.21.15.84:0/3078333079 learned_addr learned my addr 172.21.15.84:0/3078333079 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:25.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.094+0000 7f9823fff640 1 --2- 172.21.15.84:0/3078333079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261b1390 0x562d2657a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:25.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.094+0000 7f9823fff640 1 --2- 172.21.15.84:0/3078333079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261d2070 0x562d265796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:25.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.094+0000 7f9828ff9640 1 --2- 172.21.15.84:0/2168783548 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f98180b6680 0x7f98180b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.094+0000 7f982affd640 1 -- 172.21.15.84:0/3078333079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261b1390 msgr2=0x562d2657a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.095+0000 7f982affd640 1 --2- 172.21.15.84:0/3078333079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261b1390 0x562d2657a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.095+0000 7f982affd640 1 -- 172.21.15.84:0/3078333079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261d2070 msgr2=0x562d265796a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.095+0000 7f982affd640 1 --2- 172.21.15.84:0/3078333079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261d2070 0x562d265796a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.095+0000 7f982affd640 1 -- 172.21.15.84:0/3078333079 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d2623d650 con 0x562d261a91b0 2024-09-21T03:46:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.095+0000 7f9828ff9640 1 -- 172.21.15.84:0/2168783548 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f9824108da0 con 0x7f982c108d10 2024-09-21T03:46:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.095+0000 7f982b7fe640 1 --2- 172.21.15.84:0/2168783548 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f98180b6680 0x7f98180b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.095+0000 7f982affd640 1 --2- 172.21.15.84:0/3078333079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261a91b0 0x562d26579be0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f981c007820 tx=0x7f981c007ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e02be4a944900 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.095+0000 7f98217fa640 1 -- 172.21.15.84:0/3078333079 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c00d8f0 con 0x562d261a91b0 2024-09-21T03:46:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.095+0000 7f98217fa640 1 -- 172.21.15.84:0/3078333079 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f981c018070 con 0x562d261a91b0 2024-09-21T03:46:25.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.095+0000 7f98217fa640 1 -- 172.21.15.84:0/3078333079 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c013d80 con 0x562d261a91b0 2024-09-21T03:46:25.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.096+0000 7f9837c25740 1 -- 172.21.15.84:0/3078333079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261a91b0 msgr2=0x562d26579be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:25.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.096+0000 7f9837c25740 1 --2- 172.21.15.84:0/3078333079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261a91b0 0x562d26579be0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f981c007820 tx=0x7f981c007ce0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.096+0000 7f982b7fe640 1 --2- 172.21.15.84:0/2168783548 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f98180b6680 0x7f98180b8b90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9824106620 tx=0x7f982402a8c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:25.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.096+0000 7f9837c25740 1 -- 172.21.15.84:0/3078333079 shutdown_connections 2024-09-21T03:46:25.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.096+0000 7f9837c25740 1 --2- 172.21.15.84:0/3078333079 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261b1390 0x562d2657a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.096+0000 7f9837c25740 1 --2- 172.21.15.84:0/3078333079 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261a91b0 0x562d26579be0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.096+0000 7f9837c25740 1 --2- 172.21.15.84:0/3078333079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261d2070 0x562d265796a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.096+0000 7f9837c25740 1 -- 172.21.15.84:0/3078333079 >> 172.21.15.84:0/3078333079 conn(0x562d261c6460 msgr2=0x562d26577590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:25.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.096+0000 7f9837c25740 1 -- 172.21.15.84:0/3078333079 shutdown_connections 2024-09-21T03:46:25.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.096+0000 7f9837c25740 1 -- 172.21.15.84:0/3078333079 wait complete. 2024-09-21T03:46:25.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.097+0000 7f9837c25740 1 -- start start 2024-09-21T03:46:25.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.097+0000 7f9837c25740 1 Processor -- start 2024-09-21T03:46:25.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.097+0000 7f9837c25740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261a91b0 0x562d265890d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:25.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.097+0000 7f9837c25740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261b1390 0x562d26589610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:25.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.097+0000 7f9837c25740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261d2070 0x562d26589b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:25.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.097+0000 7f9837c25740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562d26340700 con 0x562d261b1390 2024-09-21T03:46:25.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.097+0000 7f9837c25740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562d2647a160 con 0x562d261a91b0 2024-09-21T03:46:25.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.097+0000 7f9837c25740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562d2658c1e0 con 0x562d261d2070 2024-09-21T03:46:25.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.097+0000 7f9837c25740 10 client.0 _ll_register_callbacks cb 0x562d264939e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:46:25.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.097+0000 7f982affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261b1390 0x562d26589610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:25.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.097+0000 7f982affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261b1390 0x562d26589610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35958/0 (socket says 172.21.15.84:35958) 2024-09-21T03:46:25.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.097+0000 7f982affd640 1 -- 172.21.15.84:0/3444469737 learned_addr learned my addr 172.21.15.84:0/3444469737 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:25.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.097+0000 7f9823fff640 1 --2- 172.21.15.84:0/3444469737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261a91b0 0x562d265890d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:25.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.097+0000 7f9823fff640 1 --2- 172.21.15.84:0/3444469737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261d2070 0x562d26589b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.098+0000 7f982affd640 1 -- 172.21.15.84:0/3444469737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261d2070 msgr2=0x562d26589b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.098+0000 7f982affd640 1 --2- 172.21.15.84:0/3444469737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261d2070 0x562d26589b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.098+0000 7f982affd640 1 -- 172.21.15.84:0/3444469737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261a91b0 msgr2=0x562d265890d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.098+0000 7f982affd640 1 --2- 172.21.15.84:0/3444469737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261a91b0 0x562d265890d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.098+0000 7f982affd640 1 -- 172.21.15.84:0/3444469737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d264a7c90 con 0x562d261b1390 2024-09-21T03:46:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.098+0000 7f9823fff640 1 --2- 172.21.15.84:0/3444469737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261d2070 0x562d26589b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:46:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.098+0000 7f982affd640 1 --2- 172.21.15.84:0/3444469737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261b1390 0x562d26589610 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f981c004810 tx=0x7f981c013730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6351b487886e3a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.098+0000 7f98127fc640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:46:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.098+0000 7f98127fc640 1 -- 172.21.15.84:0/3444469737 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c00daf0 con 0x562d261b1390 2024-09-21T03:46:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.098+0000 7f98127fc640 1 -- 172.21.15.84:0/3444469737 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f981c00dc90 con 0x562d261b1390 2024-09-21T03:46:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.098+0000 7f9837c25740 1 -- 172.21.15.84:0/3444469737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f981c018070 con 0x562d261b1390 2024-09-21T03:46:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.098+0000 7f98127fc640 1 -- 172.21.15.84:0/3444469737 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f981c025480 con 0x562d261b1390 2024-09-21T03:46:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.098+0000 7f9837c25740 10 client.16239 fetch_fsmap learned FSMap version 25 2024-09-21T03:46:25.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.098+0000 7f9837c25740 1 -- 172.21.15.84:0/3444469737 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562d26597e70 con 0x562d261b1390 2024-09-21T03:46:25.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.098+0000 7f98127fc640 1 -- 172.21.15.84:0/3444469737 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f981c018070 con 0x562d261b1390 2024-09-21T03:46:25.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.099+0000 7f98127fc640 1 -- 172.21.15.84:0/3444469737 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f981c02f5f0 con 0x562d261b1390 2024-09-21T03:46:25.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.099+0000 7f9837c25740 10 client.16239 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:46:25.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.099+0000 7f9837c25740 10 client.16239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:46:25.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.099+0000 7f9837c25740 20 client.16239 populate_metadata read hostname 'smithi084' 2024-09-21T03:46:25.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.099+0000 7f9837c25740 1 --2- 172.21.15.84:0/3444469737 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x562d261909f0 0x562d2659b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:25.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.099+0000 7f9837c25740 4 client.16239 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:46:25.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.099+0000 7f9837c25740 1 -- 172.21.15.84:0/3444469737 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d264f1df0 con 0x562d261909f0 2024-09-21T03:46:25.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.099+0000 7f9823fff640 1 --2- 172.21.15.84:0/3444469737 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x562d261909f0 0x562d2659b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:25.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.099+0000 7f9823fff640 1 --2- 172.21.15.84:0/3444469737 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x562d261909f0 0x562d2659b1d0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58c30480f3aeb1ef server_cookie=2a67aa0b4dfb76f9 in_seq=0 out_seq=0 2024-09-21T03:46:25.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.099+0000 7f98127fc640 10 client.16239 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:46:25.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.100+0000 7f98127fc640 1 -- 172.21.15.84:0/3444469737 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562d264f1df0 con 0x562d261909f0 2024-09-21T03:46:25.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.100+0000 7f98127fc640 10 client.16239 handle_command_reply: tid=0 2024-09-21T03:46:25.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.100+0000 7f9837c25740 1 client.16239 shutdown 2024-09-21T03:46:25.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.101+0000 7f9837c25740 1 -- 172.21.15.84:0/3444469737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261b1390 msgr2=0x562d26589610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:25.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.101+0000 7f9837c25740 1 --2- 172.21.15.84:0/3444469737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261b1390 0x562d26589610 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f981c004810 tx=0x7f981c013730 comp rx=0 tx=0).stop 2024-09-21T03:46:25.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.101+0000 7f9837c25740 1 -- 172.21.15.84:0/3444469737 shutdown_connections 2024-09-21T03:46:25.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.101+0000 7f9837c25740 1 --2- 172.21.15.84:0/3444469737 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x562d261909f0 0x562d2659b1d0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.101+0000 7f98127fc640 0 client.16239 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:46:25.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.101+0000 7f9837c25740 1 --2- 172.21.15.84:0/3444469737 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261d2070 0x562d26589b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.101+0000 7f9837c25740 1 --2- 172.21.15.84:0/3444469737 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261b1390 0x562d26589610 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.101+0000 7f9837c25740 1 --2- 172.21.15.84:0/3444469737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261a91b0 0x562d265890d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.101+0000 7f9837c25740 1 -- 172.21.15.84:0/3444469737 >> 172.21.15.84:0/3444469737 conn(0x562d261c6460 msgr2=0x562d2657b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:25.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.101+0000 7f9837c25740 1 -- 172.21.15.84:0/3444469737 shutdown_connections 2024-09-21T03:46:25.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.101+0000 7f9837c25740 1 -- 172.21.15.84:0/3444469737 wait complete. 2024-09-21T03:46:25.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.101+0000 7f9837c25740 20 client.16239 trim_cache size 0 max 16384 2024-09-21T03:46:25.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.114+0000 7f9837c25740 1 Processor -- start 2024-09-21T03:46:25.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.114+0000 7f9837c25740 1 -- start start 2024-09-21T03:46:25.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.114+0000 7f9837c25740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261909f0 0x562d2658afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:25.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.114+0000 7f9837c25740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261a91b0 0x562d2657ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:25.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.114+0000 7f9837c25740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261b1390 0x562d265862c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:25.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.114+0000 7f9837c25740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f982c1afd90 con 0x562d261b1390 2024-09-21T03:46:25.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.114+0000 7f9837c25740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f982c1ad660 con 0x562d261a91b0 2024-09-21T03:46:25.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.114+0000 7f9837c25740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f982c1ab4b0 con 0x562d261909f0 2024-09-21T03:46:25.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.114+0000 7f9823fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261b1390 0x562d265862c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:25.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.114+0000 7f9823fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261b1390 0x562d265862c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35970/0 (socket says 172.21.15.84:35970) 2024-09-21T03:46:25.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.114+0000 7f9823fff640 1 -- 172.21.15.84:0/2898378155 learned_addr learned my addr 172.21.15.84:0/2898378155 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:25.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.115+0000 7f9823fff640 1 --2- 172.21.15.84:0/2898378155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261909f0 0x562d2658afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:25.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.115+0000 7f982affd640 1 --2- 172.21.15.84:0/2898378155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261a91b0 0x562d2657ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:25.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.115+0000 7f9823fff640 1 -- 172.21.15.84:0/2898378155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261909f0 msgr2=0x562d2658afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:25.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.115+0000 7f9823fff640 1 --2- 172.21.15.84:0/2898378155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261909f0 0x562d2658afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.115+0000 7f9823fff640 1 -- 172.21.15.84:0/2898378155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261a91b0 msgr2=0x562d2657ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:25.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.115+0000 7f9823fff640 1 --2- 172.21.15.84:0/2898378155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261a91b0 0x562d2657ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.115+0000 7f9823fff640 1 -- 172.21.15.84:0/2898378155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d2657c460 con 0x562d261b1390 2024-09-21T03:46:25.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.115+0000 7f982affd640 1 --2- 172.21.15.84:0/2898378155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261a91b0 0x562d2657ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:46:25.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.115+0000 7f9823fff640 1 --2- 172.21.15.84:0/2898378155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261b1390 0x562d265862c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f981400a9e0 tx=0x7f9814006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9d726fc313c7ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:25.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.115+0000 7f9820ff9640 1 -- 172.21.15.84:0/2898378155 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9814026070 con 0x562d261b1390 2024-09-21T03:46:25.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.115+0000 7f9820ff9640 1 -- 172.21.15.84:0/2898378155 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9814024070 con 0x562d261b1390 2024-09-21T03:46:25.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.115+0000 7f9820ff9640 1 -- 172.21.15.84:0/2898378155 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9814016cd0 con 0x562d261b1390 2024-09-21T03:46:25.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.116+0000 7f9837c25740 1 -- 172.21.15.84:0/2898378155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261b1390 msgr2=0x562d265862c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:25.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.116+0000 7f9837c25740 1 --2- 172.21.15.84:0/2898378155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261b1390 0x562d265862c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f981400a9e0 tx=0x7f9814006f90 comp rx=0 tx=0).stop 2024-09-21T03:46:25.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.116+0000 7f9837c25740 1 -- 172.21.15.84:0/2898378155 shutdown_connections 2024-09-21T03:46:25.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.116+0000 7f9837c25740 1 --2- 172.21.15.84:0/2898378155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261b1390 0x562d265862c0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.116+0000 7f9837c25740 1 --2- 172.21.15.84:0/2898378155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261a91b0 0x562d2657ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.116+0000 7f9837c25740 1 --2- 172.21.15.84:0/2898378155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261909f0 0x562d2658afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.116+0000 7f9837c25740 1 -- 172.21.15.84:0/2898378155 >> 172.21.15.84:0/2898378155 conn(0x562d261c6460 msgr2=0x562d2657a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:25.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.116+0000 7f9837c25740 1 -- 172.21.15.84:0/2898378155 shutdown_connections 2024-09-21T03:46:25.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.116+0000 7f9837c25740 1 -- 172.21.15.84:0/2898378155 wait complete. 2024-09-21T03:46:25.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.116+0000 7f9837c25740 1 -- start start 2024-09-21T03:46:25.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.117+0000 7f9837c25740 1 Processor -- start 2024-09-21T03:46:25.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.117+0000 7f9837c25740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261909f0 0x562d265f98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:25.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.117+0000 7f9837c25740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261a91b0 0x562d265f9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:25.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.117+0000 7f9837c25740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261b1390 0x562d265fa360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:25.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.117+0000 7f9837c25740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f982c1abb20 con 0x562d261a91b0 2024-09-21T03:46:25.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.117+0000 7f9837c25740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f982c1acf90 con 0x562d261b1390 2024-09-21T03:46:25.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.117+0000 7f9837c25740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f982c1ac1f0 con 0x562d261909f0 2024-09-21T03:46:25.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.117+0000 7f9837c25740 10 client.0 _ll_register_callbacks cb 0x7f981c007670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:46:25.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.117+0000 7f982affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261a91b0 0x562d265f9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:25.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.117+0000 7f982affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261a91b0 0x562d265f9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35986/0 (socket says 172.21.15.84:35986) 2024-09-21T03:46:25.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.117+0000 7f982affd640 1 -- 172.21.15.84:0/682343870 learned_addr learned my addr 172.21.15.84:0/682343870 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:25.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.117+0000 7f9823fff640 1 --2- 172.21.15.84:0/682343870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261b1390 0x562d265fa360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:25.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.117+0000 7f9823fff640 1 --2- 172.21.15.84:0/682343870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261909f0 0x562d265f98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:25.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.117+0000 7f982affd640 1 -- 172.21.15.84:0/682343870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261909f0 msgr2=0x562d265f98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:25.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.117+0000 7f982affd640 1 --2- 172.21.15.84:0/682343870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261909f0 0x562d265f98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.117+0000 7f982affd640 1 -- 172.21.15.84:0/682343870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261b1390 msgr2=0x562d265fa360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:25.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.117+0000 7f982affd640 1 --2- 172.21.15.84:0/682343870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261b1390 0x562d265fa360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.117+0000 7f982affd640 1 -- 172.21.15.84:0/682343870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d26604a90 con 0x562d261a91b0 2024-09-21T03:46:25.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.117+0000 7f9823fff640 1 --2- 172.21.15.84:0/682343870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261909f0 0x562d265f98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:46:25.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.118+0000 7f982affd640 1 --2- 172.21.15.84:0/682343870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261a91b0 0x562d265f9e20 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f981c007d20 tx=0x7f981c006a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ca5724f715c9c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:25.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.118+0000 7f98127fc640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:46:25.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.118+0000 7f98127fc640 1 -- 172.21.15.84:0/682343870 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981c034030 con 0x562d261a91b0 2024-09-21T03:46:25.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.118+0000 7f98127fc640 1 -- 172.21.15.84:0/682343870 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f981c02f450 con 0x562d261a91b0 2024-09-21T03:46:25.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.118+0000 7f9837c25740 1 -- 172.21.15.84:0/682343870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9814024070 con 0x562d261a91b0 2024-09-21T03:46:25.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.118+0000 7f98127fc640 1 -- 172.21.15.84:0/682343870 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f981c03e050 con 0x562d261a91b0 2024-09-21T03:46:25.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.118+0000 7f9837c25740 10 client.16245 fetch_fsmap learned FSMap version 25 2024-09-21T03:46:25.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.118+0000 7f9837c25740 1 -- 172.21.15.84:0/682343870 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562d26605c80 con 0x562d261a91b0 2024-09-21T03:46:25.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.118+0000 7f98127fc640 1 -- 172.21.15.84:0/682343870 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9814024070 con 0x562d261a91b0 2024-09-21T03:46:25.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.118+0000 7f98127fc640 1 -- 172.21.15.84:0/682343870 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f981c0256b0 con 0x562d261a91b0 2024-09-21T03:46:25.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.118+0000 7f9837c25740 10 client.16245 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:46:25.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.118+0000 7f9837c25740 10 client.16245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:46:25.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.118+0000 7f9837c25740 20 client.16245 populate_metadata read hostname 'smithi084' 2024-09-21T03:46:25.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.118+0000 7f9837c25740 1 --2- 172.21.15.84:0/682343870 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x562d261d2070 0x562d26608460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:25.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.118+0000 7f9837c25740 4 client.16245 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:46:25.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.118+0000 7f9837c25740 1 -- 172.21.15.84:0/682343870 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562d264ed8a0 con 0x562d261d2070 2024-09-21T03:46:25.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.119+0000 7f9823fff640 1 --2- 172.21.15.84:0/682343870 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x562d261d2070 0x562d26608460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:25.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.119+0000 7f9823fff640 1 --2- 172.21.15.84:0/682343870 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x562d261d2070 0x562d26608460 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8f9c85589bb1844 server_cookie=46bdcd2b12db9e97 in_seq=0 out_seq=0 2024-09-21T03:46:25.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.119+0000 7f98127fc640 10 client.16245 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:46:25.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.119+0000 7f98127fc640 1 -- 172.21.15.84:0/682343870 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562d264ed8a0 con 0x562d261d2070 2024-09-21T03:46:25.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.119+0000 7f98127fc640 10 client.16245 handle_command_reply: tid=0 2024-09-21T03:46:25.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.119+0000 7f9837c25740 1 client.16245 shutdown 2024-09-21T03:46:25.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f9837c25740 1 -- 172.21.15.84:0/682343870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261a91b0 msgr2=0x562d265f9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:25.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f9837c25740 1 --2- 172.21.15.84:0/682343870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261a91b0 0x562d265f9e20 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f981c007d20 tx=0x7f981c006a30 comp rx=0 tx=0).stop 2024-09-21T03:46:25.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f9837c25740 1 -- 172.21.15.84:0/682343870 shutdown_connections 2024-09-21T03:46:25.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f9837c25740 1 --2- 172.21.15.84:0/682343870 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x562d261d2070 0x562d26608460 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f9837c25740 1 --2- 172.21.15.84:0/682343870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d261b1390 0x562d265fa360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f98127fc640 0 client.16245 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:46:25.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f9837c25740 1 --2- 172.21.15.84:0/682343870 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562d261a91b0 0x562d265f9e20 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f9837c25740 1 --2- 172.21.15.84:0/682343870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562d261909f0 0x562d265f98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f9837c25740 1 -- 172.21.15.84:0/682343870 >> 172.21.15.84:0/682343870 conn(0x562d261c6460 msgr2=0x562d2658ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:25.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f9837c25740 1 -- 172.21.15.84:0/682343870 shutdown_connections 2024-09-21T03:46:25.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f9837c25740 1 -- 172.21.15.84:0/682343870 wait complete. 2024-09-21T03:46:25.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f9837c25740 20 client.16245 trim_cache size 0 max 16384 2024-09-21T03:46:25.126 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:46:25.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f98316b1640 1 -- 172.21.15.84:0/2168783548 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f98180b6680 msgr2=0x7f98180b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:25.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f98316b1640 1 --2- 172.21.15.84:0/2168783548 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f98180b6680 0x7f98180b8b90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9824106620 tx=0x7f982402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f98316b1640 1 -- 172.21.15.84:0/2168783548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f982c108d10 msgr2=0x7f982c19bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:25.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f98316b1640 1 --2- 172.21.15.84:0/2168783548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f982c108d10 0x7f982c19bdf0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9824005cc0 tx=0x7f982402f470 comp rx=0 tx=0).stop 2024-09-21T03:46:25.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f98316b1640 1 -- 172.21.15.84:0/2168783548 shutdown_connections 2024-09-21T03:46:25.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f98316b1640 1 --2- 172.21.15.84:0/2168783548 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f98180b6680 0x7f98180b8b90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f98316b1640 1 --2- 172.21.15.84:0/2168783548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f982c108d10 0x7f982c19bdf0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f98316b1640 1 --2- 172.21.15.84:0/2168783548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f982c1083c0 0x7f982c19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f98316b1640 1 --2- 172.21.15.84:0/2168783548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f982c102a80 0x7f982c19b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:25.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.120+0000 7f98316b1640 1 -- 172.21.15.84:0/2168783548 >> 172.21.15.84:0/2168783548 conn(0x7f982c079740 msgr2=0x7f982c1052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:25.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.121+0000 7f98316b1640 1 -- 172.21.15.84:0/2168783548 shutdown_connections 2024-09-21T03:46:25.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:25.121+0000 7f98316b1640 1 -- 172.21.15.84:0/2168783548 wait complete. 2024-09-21T03:46:25.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:25 smithi084 ceph-mon[30941]: pgmap v442: 97 pgs: 97 active+clean; 5.0 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-09-21T03:46:25.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:25 smithi174 ceph-mon[34403]: pgmap v442: 97 pgs: 97 active+clean; 5.0 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-09-21T03:46:25.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:25 smithi172 ceph-mon[34821]: pgmap v442: 97 pgs: 97 active+clean; 5.0 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-09-21T03:46:26.925 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:46:26.926 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:46:27.183 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:27.553 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:27 smithi084 ceph-mon[30941]: pgmap v443: 97 pgs: 97 active+clean; 5.0 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-21T03:46:27.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.640+0000 7fd76f3a8640 1 -- 172.21.15.84:0/1805079788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd768102290 msgr2=0x7fd7681026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:27.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.640+0000 7fd76f3a8640 1 --2- 172.21.15.84:0/1805079788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd768102290 0x7fd7681026a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fd758009900 tx=0x7fd75802a410 comp rx=0 tx=0).stop 2024-09-21T03:46:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.640+0000 7fd76f3a8640 1 -- 172.21.15.84:0/1805079788 shutdown_connections 2024-09-21T03:46:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.640+0000 7fd76f3a8640 1 --2- 172.21.15.84:0/1805079788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd768108520 0x7fd76810ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.640+0000 7fd76f3a8640 1 --2- 172.21.15.84:0/1805079788 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd768107bd0 0x7fd768107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.640+0000 7fd76f3a8640 1 --2- 172.21.15.84:0/1805079788 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd768102290 0x7fd7681026a0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.640+0000 7fd76f3a8640 1 -- 172.21.15.84:0/1805079788 >> 172.21.15.84:0/1805079788 conn(0x7fd768079ea0 msgr2=0x7fd76807a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.640+0000 7fd76f3a8640 1 -- 172.21.15.84:0/1805079788 shutdown_connections 2024-09-21T03:46:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.640+0000 7fd76f3a8640 1 -- 172.21.15.84:0/1805079788 wait complete. 2024-09-21T03:46:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.641+0000 7fd76f3a8640 1 Processor -- start 2024-09-21T03:46:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.641+0000 7fd76f3a8640 1 -- start start 2024-09-21T03:46:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.641+0000 7fd76f3a8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd768102290 0x7fd76819b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.641+0000 7fd76f3a8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd768107bd0 0x7fd76819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.641+0000 7fd76f3a8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd768108520 0x7fd76819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.641+0000 7fd76f3a8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd768112aa0 con 0x7fd768107bd0 2024-09-21T03:46:27.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.641+0000 7fd76f3a8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd768112920 con 0x7fd768108520 2024-09-21T03:46:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.641+0000 7fd76f3a8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd768112c20 con 0x7fd768102290 2024-09-21T03:46:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.641+0000 7fd76c943640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd768107bd0 0x7fd76819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.641+0000 7fd76c943640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd768107bd0 0x7fd76819b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36010/0 (socket says 172.21.15.84:36010) 2024-09-21T03:46:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.641+0000 7fd76c943640 1 -- 172.21.15.84:0/999444138 learned_addr learned my addr 172.21.15.84:0/999444138 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.641+0000 7fd76d144640 1 --2- 172.21.15.84:0/999444138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd768102290 0x7fd76819b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.641+0000 7fd76d945640 1 --2- 172.21.15.84:0/999444138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd768108520 0x7fd76819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.641+0000 7fd76c943640 1 -- 172.21.15.84:0/999444138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd768102290 msgr2=0x7fd76819b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.641+0000 7fd76c943640 1 --2- 172.21.15.84:0/999444138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd768102290 0x7fd76819b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.641+0000 7fd76c943640 1 -- 172.21.15.84:0/999444138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd768108520 msgr2=0x7fd76819be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.641+0000 7fd76c943640 1 --2- 172.21.15.84:0/999444138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd768108520 0x7fd76819be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.641+0000 7fd76c943640 1 -- 172.21.15.84:0/999444138 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7681a6590 con 0x7fd768107bd0 2024-09-21T03:46:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.641+0000 7fd76d945640 1 --2- 172.21.15.84:0/999444138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd768108520 0x7fd76819be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:46:27.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.642+0000 7fd76c943640 1 --2- 172.21.15.84:0/999444138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd768107bd0 0x7fd76819b8d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd75c00c8c0 tx=0x7fd75c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.642+0000 7fd7667fc640 1 -- 172.21.15.84:0/999444138 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c007bb0 con 0x7fd768107bd0 2024-09-21T03:46:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.642+0000 7fd76f3a8640 1 -- 172.21.15.84:0/999444138 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7681a6880 con 0x7fd768107bd0 2024-09-21T03:46:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.642+0000 7fd7667fc640 1 -- 172.21.15.84:0/999444138 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd75c007d50 con 0x7fd768107bd0 2024-09-21T03:46:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.642+0000 7fd7667fc640 1 -- 172.21.15.84:0/999444138 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c0187c0 con 0x7fd768107bd0 2024-09-21T03:46:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.642+0000 7fd76f3a8640 1 -- 172.21.15.84:0/999444138 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7681a6e10 con 0x7fd768107bd0 2024-09-21T03:46:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.645+0000 7fd77591c740 1 Processor -- start 2024-09-21T03:46:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.645+0000 7fd77591c740 1 -- start start 2024-09-21T03:46:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.645+0000 7fd77591c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 0x564b23166430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.645+0000 7fd77591c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d96490 0x564b23166970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.645+0000 7fd77591c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b22d9e670 0x564b23166eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.645+0000 7fd77591c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564b230dce60 con 0x564b22dbf350 2024-09-21T03:46:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.645+0000 7fd77591c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564b230cc290 con 0x564b22d9e670 2024-09-21T03:46:27.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.645+0000 7fd77591c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564b230d00a0 con 0x564b22d96490 2024-09-21T03:46:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.645+0000 7fd76d945640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 0x564b23166430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.645+0000 7fd76d945640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 0x564b23166430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36026/0 (socket says 172.21.15.84:36026) 2024-09-21T03:46:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.645+0000 7fd76d945640 1 -- 172.21.15.84:0/3951354234 learned_addr learned my addr 172.21.15.84:0/3951354234 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.645+0000 7fd76d144640 1 --2- 172.21.15.84:0/3951354234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d96490 0x564b23166970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.645+0000 7fd7667fc640 1 -- 172.21.15.84:0/999444138 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fd75c00fa20 con 0x7fd768107bd0 2024-09-21T03:46:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.645+0000 7fd76d945640 1 -- 172.21.15.84:0/3951354234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d96490 msgr2=0x564b23166970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.645+0000 7fd76d945640 1 --2- 172.21.15.84:0/3951354234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d96490 0x564b23166970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.645+0000 7fd76d945640 1 -- 172.21.15.84:0/3951354234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b22d9e670 msgr2=0x564b23166eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T03:46:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.645+0000 7fd76d945640 1 --2- 172.21.15.84:0/3951354234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b22d9e670 0x564b23166eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.645+0000 7fd76d945640 1 -- 172.21.15.84:0/3951354234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b22e2a930 con 0x564b22dbf350 2024-09-21T03:46:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.646+0000 7fd76d945640 1 --2- 172.21.15.84:0/3951354234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 0x564b23166430 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd760008dd0 tx=0x7fd76000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b05fb325f45d178 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.646+0000 7fd74f7fe640 1 -- 172.21.15.84:0/3951354234 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76000f830 con 0x564b22dbf350 2024-09-21T03:46:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.646+0000 7fd74f7fe640 1 -- 172.21.15.84:0/3951354234 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd76000de20 con 0x564b22dbf350 2024-09-21T03:46:27.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.646+0000 7fd74f7fe640 1 -- 172.21.15.84:0/3951354234 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd760018de0 con 0x564b22dbf350 2024-09-21T03:46:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.646+0000 7fd7667fc640 1 --2- 172.21.15.84:0/999444138 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd7500b66b0 0x7fd7500b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.646+0000 7fd76d144640 1 --2- 172.21.15.84:0/999444138 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd7500b66b0 0x7fd7500b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.646+0000 7fd7667fc640 1 -- 172.21.15.84:0/999444138 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fd75c0e77f0 con 0x7fd768107bd0 2024-09-21T03:46:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.647+0000 7fd77591c740 1 -- 172.21.15.84:0/3951354234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 msgr2=0x564b23166430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.647+0000 7fd77591c740 1 --2- 172.21.15.84:0/3951354234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 0x564b23166430 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd760008dd0 tx=0x7fd76000d710 comp rx=0 tx=0).stop 2024-09-21T03:46:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.647+0000 7fd76d144640 1 --2- 172.21.15.84:0/999444138 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd7500b66b0 0x7fd7500b8bc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd758006010 tx=0x7fd758009640 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.647+0000 7fd77591c740 1 -- 172.21.15.84:0/3951354234 shutdown_connections 2024-09-21T03:46:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.647+0000 7fd77591c740 1 --2- 172.21.15.84:0/3951354234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b22d9e670 0x564b23166eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.647+0000 7fd77591c740 1 --2- 172.21.15.84:0/3951354234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d96490 0x564b23166970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.647+0000 7fd77591c740 1 --2- 172.21.15.84:0/3951354234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 0x564b23166430 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.647+0000 7fd77591c740 1 -- 172.21.15.84:0/3951354234 >> 172.21.15.84:0/3951354234 conn(0x564b22db3740 msgr2=0x564b23164320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.647+0000 7fd77591c740 1 -- 172.21.15.84:0/3951354234 shutdown_connections 2024-09-21T03:46:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.647+0000 7fd77591c740 1 -- 172.21.15.84:0/3951354234 wait complete. 2024-09-21T03:46:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.647+0000 7fd77591c740 1 -- start start 2024-09-21T03:46:27.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.647+0000 7fd77591c740 1 Processor -- start 2024-09-21T03:46:27.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.648+0000 7fd77591c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b22d96490 0x564b231720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:27.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.648+0000 7fd77591c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d9e670 0x564b23172680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:27.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.648+0000 7fd77591c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 0x564b2317df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:27.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.648+0000 7fd77591c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564b22f2d890 con 0x564b22dbf350 2024-09-21T03:46:27.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.648+0000 7fd77591c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564b23066d40 con 0x564b22d96490 2024-09-21T03:46:27.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.648+0000 7fd77591c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564b23174c10 con 0x564b22d9e670 2024-09-21T03:46:27.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.648+0000 7fd77591c740 10 client.0 _ll_register_callbacks cb 0x564b230cac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:46:27.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.648+0000 7fd76d945640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 0x564b2317df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:27.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.648+0000 7fd76d945640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 0x564b2317df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36034/0 (socket says 172.21.15.84:36034) 2024-09-21T03:46:27.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.648+0000 7fd76d945640 1 -- 172.21.15.84:0/1633767457 learned_addr learned my addr 172.21.15.84:0/1633767457 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:27.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.648+0000 7fd76d144640 1 --2- 172.21.15.84:0/1633767457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b22d96490 0x564b231720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:27.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.648+0000 7fd76c943640 1 --2- 172.21.15.84:0/1633767457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d9e670 0x564b23172680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:27.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.649+0000 7fd76d945640 1 -- 172.21.15.84:0/1633767457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d9e670 msgr2=0x564b23172680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:27.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.649+0000 7fd76d945640 1 --2- 172.21.15.84:0/1633767457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d9e670 0x564b23172680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.649+0000 7fd76d945640 1 -- 172.21.15.84:0/1633767457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b22d96490 msgr2=0x564b231720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.649+0000 7fd76d945640 1 --2- 172.21.15.84:0/1633767457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b22d96490 0x564b231720a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.649+0000 7fd76d945640 1 -- 172.21.15.84:0/1633767457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b2317e570 con 0x564b22dbf350 2024-09-21T03:46:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.649+0000 7fd76d945640 1 --2- 172.21.15.84:0/1633767457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 0x564b2317df00 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd760018a60 tx=0x7fd760008b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a78a6faa46d19b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.649+0000 7fd74cff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:46:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.649+0000 7fd74cff9640 1 -- 172.21.15.84:0/1633767457 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd760029060 con 0x564b22dbf350 2024-09-21T03:46:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.649+0000 7fd74cff9640 1 -- 172.21.15.84:0/1633767457 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fd760019cd0 con 0x564b22dbf350 2024-09-21T03:46:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.649+0000 7fd77591c740 1 -- 172.21.15.84:0/1633767457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd76000de20 con 0x564b22dbf350 2024-09-21T03:46:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.649+0000 7fd74cff9640 1 -- 172.21.15.84:0/1633767457 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd76000f630 con 0x564b22dbf350 2024-09-21T03:46:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.649+0000 7fd77591c740 10 client.16257 fetch_fsmap learned FSMap version 25 2024-09-21T03:46:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.649+0000 7fd77591c740 1 -- 172.21.15.84:0/1633767457 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564b23180ea0 con 0x564b22dbf350 2024-09-21T03:46:27.658 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.649+0000 7fd74cff9640 1 -- 172.21.15.84:0/1633767457 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd76000fc80 con 0x564b22dbf350 2024-09-21T03:46:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.650+0000 7fd74cff9640 1 -- 172.21.15.84:0/1633767457 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd76002eb50 con 0x564b22dbf350 2024-09-21T03:46:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.650+0000 7fd77591c740 10 client.16257 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:46:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.650+0000 7fd77591c740 10 client.16257 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:46:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.650+0000 7fd77591c740 20 client.16257 populate_metadata read hostname 'smithi084' 2024-09-21T03:46:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.650+0000 7fd77591c740 1 --2- 172.21.15.84:0/1633767457 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564b22d7dcd0 0x564b231842b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.650+0000 7fd77591c740 4 client.16257 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:46:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.650+0000 7fd77591c740 1 -- 172.21.15.84:0/1633767457 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd76000de20 con 0x564b22d7dcd0 2024-09-21T03:46:27.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.650+0000 7fd76d144640 1 --2- 172.21.15.84:0/1633767457 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564b22d7dcd0 0x564b231842b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.651+0000 7fd76d144640 1 --2- 172.21.15.84:0/1633767457 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564b22d7dcd0 0x564b231842b0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0b005f585f21213 server_cookie=b95aaae879ad2c06 in_seq=0 out_seq=0 2024-09-21T03:46:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.651+0000 7fd74cff9640 10 client.16257 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:46:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.651+0000 7fd74cff9640 1 -- 172.21.15.84:0/1633767457 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fd76000de20 con 0x564b22d7dcd0 2024-09-21T03:46:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.651+0000 7fd74cff9640 10 client.16257 handle_command_reply: tid=0 2024-09-21T03:46:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.651+0000 7fd77591c740 1 client.16257 shutdown 2024-09-21T03:46:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.651+0000 7fd77591c740 1 -- 172.21.15.84:0/1633767457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 msgr2=0x564b2317df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.652+0000 7fd77591c740 1 --2- 172.21.15.84:0/1633767457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 0x564b2317df00 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd760018a60 tx=0x7fd760008b10 comp rx=0 tx=0).stop 2024-09-21T03:46:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.652+0000 7fd77591c740 1 -- 172.21.15.84:0/1633767457 shutdown_connections 2024-09-21T03:46:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.652+0000 7fd77591c740 1 --2- 172.21.15.84:0/1633767457 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564b22d7dcd0 0x564b231842b0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.652+0000 7fd77591c740 1 --2- 172.21.15.84:0/1633767457 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 0x564b2317df00 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.652+0000 7fd77591c740 1 --2- 172.21.15.84:0/1633767457 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d9e670 0x564b23172680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.652+0000 7fd77591c740 1 --2- 172.21.15.84:0/1633767457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b22d96490 0x564b231720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.652+0000 7fd77591c740 1 -- 172.21.15.84:0/1633767457 >> 172.21.15.84:0/1633767457 conn(0x564b22db3740 msgr2=0x564b23169610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:27.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.652+0000 7fd74cff9640 0 client.16257 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:46:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.652+0000 7fd77591c740 1 -- 172.21.15.84:0/1633767457 shutdown_connections 2024-09-21T03:46:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.652+0000 7fd77591c740 1 -- 172.21.15.84:0/1633767457 wait complete. 2024-09-21T03:46:27.662 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.652+0000 7fd77591c740 20 client.16257 trim_cache size 0 max 16384 2024-09-21T03:46:27.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.672+0000 7fd77591c740 1 Processor -- start 2024-09-21T03:46:27.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.672+0000 7fd77591c740 1 -- start start 2024-09-21T03:46:27.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.672+0000 7fd77591c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d96490 0x564b2317de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:27.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.672+0000 7fd77591c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22d9e670 0x564b23163d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:27.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.672+0000 7fd77591c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b22dbf350 0x564b23164250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:27.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.672+0000 7fd77591c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd7681b1e70 con 0x564b22d9e670 2024-09-21T03:46:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.672+0000 7fd77591c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd7681af740 con 0x564b22dbf350 2024-09-21T03:46:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.672+0000 7fd77591c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd7681ad590 con 0x564b22d96490 2024-09-21T03:46:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.672+0000 7fd76c943640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22d9e670 0x564b23163d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.672+0000 7fd76c943640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22d9e670 0x564b23163d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36040/0 (socket says 172.21.15.84:36040) 2024-09-21T03:46:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.672+0000 7fd76c943640 1 -- 172.21.15.84:0/3111720648 learned_addr learned my addr 172.21.15.84:0/3111720648 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.672+0000 7fd76d144640 1 --2- 172.21.15.84:0/3111720648 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d96490 0x564b2317de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.672+0000 7fd76d945640 1 --2- 172.21.15.84:0/3111720648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b22dbf350 0x564b23164250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.672+0000 7fd76c943640 1 -- 172.21.15.84:0/3111720648 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d96490 msgr2=0x564b2317de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.672+0000 7fd76c943640 1 --2- 172.21.15.84:0/3111720648 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d96490 0x564b2317de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.672+0000 7fd76c943640 1 -- 172.21.15.84:0/3111720648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b22dbf350 msgr2=0x564b23164250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.672+0000 7fd76c943640 1 --2- 172.21.15.84:0/3111720648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b22dbf350 0x564b23164250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.673+0000 7fd76c943640 1 -- 172.21.15.84:0/3111720648 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b2316d730 con 0x564b22d9e670 2024-09-21T03:46:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.673+0000 7fd76d144640 1 --2- 172.21.15.84:0/3111720648 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d96490 0x564b2317de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:46:27.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.673+0000 7fd76d945640 1 --2- 172.21.15.84:0/3111720648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b22dbf350 0x564b23164250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:46:27.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.673+0000 7fd76c943640 1 --2- 172.21.15.84:0/3111720648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22d9e670 0x564b23163d10 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0a9c90 tx=0x7fd75c0a9690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e47b6bf3349d70 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:27.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.673+0000 7fd74effd640 1 -- 172.21.15.84:0/3111720648 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c098030 con 0x564b22d9e670 2024-09-21T03:46:27.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.673+0000 7fd74effd640 1 -- 172.21.15.84:0/3111720648 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd75c0b21a0 con 0x564b22d9e670 2024-09-21T03:46:27.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.673+0000 7fd74effd640 1 -- 172.21.15.84:0/3111720648 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c0a9010 con 0x564b22d9e670 2024-09-21T03:46:27.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.674+0000 7fd77591c740 1 -- 172.21.15.84:0/3111720648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22d9e670 msgr2=0x564b23163d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:27.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.674+0000 7fd77591c740 1 --2- 172.21.15.84:0/3111720648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22d9e670 0x564b23163d10 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0a9c90 tx=0x7fd75c0a9690 comp rx=0 tx=0).stop 2024-09-21T03:46:27.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.674+0000 7fd77591c740 1 -- 172.21.15.84:0/3111720648 shutdown_connections 2024-09-21T03:46:27.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.674+0000 7fd77591c740 1 --2- 172.21.15.84:0/3111720648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b22dbf350 0x564b23164250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.674+0000 7fd77591c740 1 --2- 172.21.15.84:0/3111720648 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22d9e670 0x564b23163d10 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.674+0000 7fd77591c740 1 --2- 172.21.15.84:0/3111720648 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d96490 0x564b2317de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.674+0000 7fd77591c740 1 -- 172.21.15.84:0/3111720648 >> 172.21.15.84:0/3111720648 conn(0x564b22db3740 msgr2=0x564b23170720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:27.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.674+0000 7fd77591c740 1 -- 172.21.15.84:0/3111720648 shutdown_connections 2024-09-21T03:46:27.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.674+0000 7fd77591c740 1 -- 172.21.15.84:0/3111720648 wait complete. 2024-09-21T03:46:27.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.674+0000 7fd77591c740 1 -- start start 2024-09-21T03:46:27.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.674+0000 7fd77591c740 1 Processor -- start 2024-09-21T03:46:27.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.675+0000 7fd77591c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b22d96490 0x564b231835d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:27.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.675+0000 7fd77591c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d9e670 0x564b23183b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:27.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.675+0000 7fd77591c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 0x564b231eda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:27.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.675+0000 7fd77591c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd7681adc00 con 0x564b22dbf350 2024-09-21T03:46:27.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.675+0000 7fd77591c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd7681af070 con 0x564b22d96490 2024-09-21T03:46:27.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.675+0000 7fd77591c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd7681ae2d0 con 0x564b22d9e670 2024-09-21T03:46:27.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.675+0000 7fd77591c740 10 client.0 _ll_register_callbacks cb 0x7fd758009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:46:27.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.675+0000 7fd76d945640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 0x564b231eda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:27.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.675+0000 7fd76d945640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 0x564b231eda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36050/0 (socket says 172.21.15.84:36050) 2024-09-21T03:46:27.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.675+0000 7fd76d945640 1 -- 172.21.15.84:0/3224058077 learned_addr learned my addr 172.21.15.84:0/3224058077 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:27.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.675+0000 7fd76d144640 1 --2- 172.21.15.84:0/3224058077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b22d96490 0x564b231835d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:27.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.675+0000 7fd76c943640 1 --2- 172.21.15.84:0/3224058077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d9e670 0x564b23183b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:27.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.675+0000 7fd76d945640 1 -- 172.21.15.84:0/3224058077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d9e670 msgr2=0x564b23183b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:27.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.675+0000 7fd76d945640 1 --2- 172.21.15.84:0/3224058077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d9e670 0x564b23183b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.675+0000 7fd76d945640 1 -- 172.21.15.84:0/3224058077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b22d96490 msgr2=0x564b231835d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:27.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.675+0000 7fd76d945640 1 --2- 172.21.15.84:0/3224058077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b22d96490 0x564b231835d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.675+0000 7fd76d945640 1 -- 172.21.15.84:0/3224058077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b231843b0 con 0x564b22dbf350 2024-09-21T03:46:27.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.675+0000 7fd76c943640 1 --2- 172.21.15.84:0/3224058077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d9e670 0x564b23183b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:46:27.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.675+0000 7fd76d945640 1 --2- 172.21.15.84:0/3224058077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 0x564b231eda20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd76002efd0 tx=0x7fd760008660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c814e0f885850f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:27.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.675+0000 7fd74cff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:46:27.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.676+0000 7fd74cff9640 1 -- 172.21.15.84:0/3224058077 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd760029040 con 0x564b22dbf350 2024-09-21T03:46:27.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.676+0000 7fd74cff9640 1 -- 172.21.15.84:0/3224058077 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fd76000dd40 con 0x564b22dbf350 2024-09-21T03:46:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.676+0000 7fd77591c740 1 -- 172.21.15.84:0/3224058077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd75c0b21a0 con 0x564b22dbf350 2024-09-21T03:46:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.676+0000 7fd74cff9640 1 -- 172.21.15.84:0/3224058077 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd760018a90 con 0x564b22dbf350 2024-09-21T03:46:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.676+0000 7fd77591c740 10 client.16263 fetch_fsmap learned FSMap version 25 2024-09-21T03:46:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.676+0000 7fd77591c740 1 -- 172.21.15.84:0/3224058077 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564b231eeed0 con 0x564b22dbf350 2024-09-21T03:46:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.676+0000 7fd74cff9640 1 -- 172.21.15.84:0/3224058077 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd75c0b21a0 con 0x564b22dbf350 2024-09-21T03:46:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.676+0000 7fd74cff9640 1 -- 172.21.15.84:0/3224058077 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd76000f8f0 con 0x564b22dbf350 2024-09-21T03:46:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.676+0000 7fd77591c740 10 client.16263 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:46:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.676+0000 7fd77591c740 10 client.16263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:46:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.676+0000 7fd77591c740 20 client.16263 populate_metadata read hostname 'smithi084' 2024-09-21T03:46:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.676+0000 7fd77591c740 1 --2- 172.21.15.84:0/3224058077 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564b22d53080 0x564b231f16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.676+0000 7fd77591c740 4 client.16263 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:46:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.676+0000 7fd77591c740 1 -- 172.21.15.84:0/3224058077 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564b230dedb0 con 0x564b22d53080 2024-09-21T03:46:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.677+0000 7fd76d144640 1 --2- 172.21.15.84:0/3224058077 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564b22d53080 0x564b231f16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:27.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.677+0000 7fd76d144640 1 --2- 172.21.15.84:0/3224058077 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564b22d53080 0x564b231f16b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22eb1283e26d4ba0 server_cookie=33cf429608fcb9cd in_seq=0 out_seq=0 2024-09-21T03:46:27.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.677+0000 7fd74cff9640 10 client.16263 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:46:27.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.679+0000 7fd74cff9640 1 -- 172.21.15.84:0/3224058077 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564b230dedb0 con 0x564b22d53080 2024-09-21T03:46:27.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.679+0000 7fd74cff9640 10 client.16263 handle_command_reply: tid=0 2024-09-21T03:46:27.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.679+0000 7fd77591c740 1 client.16263 shutdown 2024-09-21T03:46:27.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.679+0000 7fd77591c740 1 -- 172.21.15.84:0/3224058077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 msgr2=0x564b231eda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:27.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.679+0000 7fd77591c740 1 --2- 172.21.15.84:0/3224058077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 0x564b231eda20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd76002efd0 tx=0x7fd760008660 comp rx=0 tx=0).stop 2024-09-21T03:46:27.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.679+0000 7fd77591c740 1 -- 172.21.15.84:0/3224058077 shutdown_connections 2024-09-21T03:46:27.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.679+0000 7fd77591c740 1 --2- 172.21.15.84:0/3224058077 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564b22d53080 0x564b231f16b0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.679+0000 7fd77591c740 1 --2- 172.21.15.84:0/3224058077 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564b22dbf350 0x564b231eda20 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.679+0000 7fd77591c740 1 --2- 172.21.15.84:0/3224058077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564b22d9e670 0x564b23183b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.679+0000 7fd77591c740 1 --2- 172.21.15.84:0/3224058077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564b22d96490 0x564b231835d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.679+0000 7fd77591c740 1 -- 172.21.15.84:0/3224058077 >> 172.21.15.84:0/3224058077 conn(0x564b22db3740 msgr2=0x564b23163ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:27.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.679+0000 7fd74cff9640 0 client.16263 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:46:27.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.679+0000 7fd77591c740 1 -- 172.21.15.84:0/3224058077 shutdown_connections 2024-09-21T03:46:27.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.679+0000 7fd77591c740 1 -- 172.21.15.84:0/3224058077 wait complete. 2024-09-21T03:46:27.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.679+0000 7fd77591c740 20 client.16263 trim_cache size 0 max 16384 2024-09-21T03:46:27.686 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:46:27.686 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T03:46:27.686 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "76fe28fc-001d-4a83-89c6-36f23b2fbf13", 2024-09-21T03:46:27.686 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T03:46:27.686 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:46:27.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.680+0000 7fd76f3a8640 1 -- 172.21.15.84:0/999444138 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd7500b66b0 msgr2=0x7fd7500b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:27.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.680+0000 7fd76f3a8640 1 --2- 172.21.15.84:0/999444138 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd7500b66b0 0x7fd7500b8bc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd758006010 tx=0x7fd758009640 comp rx=0 tx=0).stop 2024-09-21T03:46:27.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.680+0000 7fd76f3a8640 1 -- 172.21.15.84:0/999444138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd768107bd0 msgr2=0x7fd76819b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:27.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.680+0000 7fd76f3a8640 1 --2- 172.21.15.84:0/999444138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd768107bd0 0x7fd76819b8d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fd75c00c8c0 tx=0x7fd75c00cd80 comp rx=0 tx=0).stop 2024-09-21T03:46:27.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.680+0000 7fd76f3a8640 1 -- 172.21.15.84:0/999444138 shutdown_connections 2024-09-21T03:46:27.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.680+0000 7fd76f3a8640 1 --2- 172.21.15.84:0/999444138 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd7500b66b0 0x7fd7500b8bc0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.680+0000 7fd76f3a8640 1 --2- 172.21.15.84:0/999444138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd768108520 0x7fd76819be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.680+0000 7fd76f3a8640 1 --2- 172.21.15.84:0/999444138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd768107bd0 0x7fd76819b8d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.680+0000 7fd76f3a8640 1 --2- 172.21.15.84:0/999444138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd768102290 0x7fd76819b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:27.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.680+0000 7fd76f3a8640 1 -- 172.21.15.84:0/999444138 >> 172.21.15.84:0/999444138 conn(0x7fd768079ea0 msgr2=0x7fd768105cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:27.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.680+0000 7fd76f3a8640 1 -- 172.21.15.84:0/999444138 shutdown_connections 2024-09-21T03:46:27.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:27.680+0000 7fd76f3a8640 1 -- 172.21.15.84:0/999444138 wait complete. 2024-09-21T03:46:27.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:27 smithi174 ceph-mon[34403]: pgmap v443: 97 pgs: 97 active+clean; 5.0 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-21T03:46:27.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:27 smithi172 ceph-mon[34821]: pgmap v443: 97 pgs: 97 active+clean; 5.0 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-09-21T03:46:28.499 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:46:28.743 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:46:28.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:28 smithi084 ceph-mon[30941]: scrub queued for path: / 2024-09-21T03:46:28.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:28 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:46:28.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:28 smithi084 ceph-mon[30941]: scrub summary: active paths [/] 2024-09-21T03:46:28.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:28 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:46:28.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:28 smithi174 ceph-mon[34403]: scrub queued for path: / 2024-09-21T03:46:28.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:28 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:46:28.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:28 smithi174 ceph-mon[34403]: scrub summary: active paths [/] 2024-09-21T03:46:28.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:28 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:46:28.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:28 smithi172 ceph-mon[34821]: scrub queued for path: / 2024-09-21T03:46:28.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:28 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:46:28.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:28 smithi172 ceph-mon[34821]: scrub summary: active paths [/] 2024-09-21T03:46:28.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:28 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:46:29.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.247+0000 7f9cfcc8a640 1 -- 172.21.15.84:0/10748356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf8108d70 msgr2=0x7f9cf810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:29.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.247+0000 7f9cfcc8a640 1 --2- 172.21.15.84:0/10748356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf8108d70 0x7f9cf810f5a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009ca0 tx=0x7f9cf002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.247+0000 7f9cfcc8a640 1 -- 172.21.15.84:0/10748356 shutdown_connections 2024-09-21T03:46:29.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.247+0000 7f9cfcc8a640 1 --2- 172.21.15.84:0/10748356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf8108d70 0x7f9cf810f5a0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.247+0000 7f9cfcc8a640 1 --2- 172.21.15.84:0/10748356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cf8108420 0x7f9cf8108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.247+0000 7f9cfcc8a640 1 --2- 172.21.15.84:0/10748356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cf8102ae0 0x7f9cf8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.247+0000 7f9cfcc8a640 1 -- 172.21.15.84:0/10748356 >> 172.21.15.84:0/10748356 conn(0x7f9cf8079770 msgr2=0x7f9cf8079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:29.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.247+0000 7f9cfcc8a640 1 -- 172.21.15.84:0/10748356 shutdown_connections 2024-09-21T03:46:29.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.247+0000 7f9cfcc8a640 1 -- 172.21.15.84:0/10748356 wait complete. 2024-09-21T03:46:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.248+0000 7f9cfcc8a640 1 Processor -- start 2024-09-21T03:46:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.248+0000 7f9cfcc8a640 1 -- start start 2024-09-21T03:46:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.248+0000 7f9cfcc8a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cf8102ae0 0x7f9cf8110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.248+0000 7f9cfcc8a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cf8108420 0x7f9cf81105c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.248+0000 7f9cfcc8a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf8108d70 0x7f9cf8110b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.248+0000 7f9cfcc8a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf8113b90 con 0x7f9cf8108d70 2024-09-21T03:46:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.248+0000 7f9cfcc8a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf8113a10 con 0x7f9cf8108420 2024-09-21T03:46:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.248+0000 7f9cfcc8a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf8113d10 con 0x7f9cf8102ae0 2024-09-21T03:46:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.248+0000 7f9cf6d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf8108d70 0x7f9cf8110b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.248+0000 7f9cf6d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf8108d70 0x7f9cf8110b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48428/0 (socket says 172.21.15.84:48428) 2024-09-21T03:46:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.248+0000 7f9cf6d9d640 1 -- 172.21.15.84:0/2524533953 learned_addr learned my addr 172.21.15.84:0/2524533953 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.249+0000 7f9cf5d9b640 1 --2- 172.21.15.84:0/2524533953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cf8108420 0x7f9cf81105c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.249+0000 7f9cf659c640 1 --2- 172.21.15.84:0/2524533953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cf8102ae0 0x7f9cf8110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.249+0000 7f9cf6d9d640 1 -- 172.21.15.84:0/2524533953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cf8102ae0 msgr2=0x7f9cf8110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.249+0000 7f9cf6d9d640 1 --2- 172.21.15.84:0/2524533953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cf8102ae0 0x7f9cf8110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.249+0000 7f9cf6d9d640 1 -- 172.21.15.84:0/2524533953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cf8108420 msgr2=0x7f9cf81105c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.249+0000 7f9cf6d9d640 1 --2- 172.21.15.84:0/2524533953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cf8108420 0x7f9cf81105c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.249+0000 7f9cf6d9d640 1 -- 172.21.15.84:0/2524533953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cf81a87c0 con 0x7f9cf8108d70 2024-09-21T03:46:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.249+0000 7f9cf6d9d640 1 --2- 172.21.15.84:0/2524533953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf8108d70 0x7f9cf8110b00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0005cc0 tx=0x7f9cf002f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.249+0000 7f9ce77fe640 1 -- 172.21.15.84:0/2524533953 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0003cf0 con 0x7f9cf8108d70 2024-09-21T03:46:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.249+0000 7f9cfcc8a640 1 -- 172.21.15.84:0/2524533953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cf81a8a50 con 0x7f9cf8108d70 2024-09-21T03:46:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.249+0000 7f9ce77fe640 1 -- 172.21.15.84:0/2524533953 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cf00044f0 con 0x7f9cf8108d70 2024-09-21T03:46:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.249+0000 7f9ce77fe640 1 -- 172.21.15.84:0/2524533953 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf002fc30 con 0x7f9cf8108d70 2024-09-21T03:46:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.249+0000 7f9cfcc8a640 1 -- 172.21.15.84:0/2524533953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cf81a8f90 con 0x7f9cf8108d70 2024-09-21T03:46:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.252+0000 7f9ce77fe640 1 -- 172.21.15.84:0/2524533953 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f9cf00046a0 con 0x7f9cf8108d70 2024-09-21T03:46:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.252+0000 7f9d031fe740 1 Processor -- start 2024-09-21T03:46:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.252+0000 7f9d031fe740 1 -- start start 2024-09-21T03:46:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.252+0000 7f9d031fe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e6184070 0x5632e652b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.252+0000 7f9d031fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e615b1b0 0x5632e652bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.252+0000 7f9d031fe740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e6163390 0x5632e652c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.252+0000 7f9d031fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5632e64a1e50 con 0x5632e615b1b0 2024-09-21T03:46:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.252+0000 7f9d031fe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5632e6491280 con 0x5632e6184070 2024-09-21T03:46:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.252+0000 7f9d031fe740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5632e6495090 con 0x5632e6163390 2024-09-21T03:46:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.252+0000 7f9cf659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e615b1b0 0x5632e652bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.252+0000 7f9cf659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e615b1b0 0x5632e652bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48434/0 (socket says 172.21.15.84:48434) 2024-09-21T03:46:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.252+0000 7f9cf659c640 1 -- 172.21.15.84:0/978967048 learned_addr learned my addr 172.21.15.84:0/978967048 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.253+0000 7f9cf5d9b640 1 --2- 172.21.15.84:0/978967048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e6184070 0x5632e652b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.253+0000 7f9cf5d9b640 1 --2- 172.21.15.84:0/978967048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e6163390 0x5632e652c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.253+0000 7f9ce77fe640 1 --2- 172.21.15.84:0/2524533953 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9ce00b6680 0x7f9ce00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.253+0000 7f9cf659c640 1 -- 172.21.15.84:0/978967048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e6163390 msgr2=0x5632e652c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.253+0000 7f9cf659c640 1 --2- 172.21.15.84:0/978967048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e6163390 0x5632e652c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.253+0000 7f9cf659c640 1 -- 172.21.15.84:0/978967048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e6184070 msgr2=0x5632e652b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.253+0000 7f9cf659c640 1 --2- 172.21.15.84:0/978967048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e6184070 0x5632e652b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.253+0000 7f9cf659c640 1 -- 172.21.15.84:0/978967048 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632e61ef650 con 0x5632e615b1b0 2024-09-21T03:46:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.253+0000 7f9cf5d9b640 1 --2- 172.21.15.84:0/978967048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e6163390 0x5632e652c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:46:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.253+0000 7f9cf6d9d640 1 --2- 172.21.15.84:0/2524533953 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9ce00b6680 0x7f9ce00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.253+0000 7f9cf659c640 1 --2- 172.21.15.84:0/978967048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e615b1b0 0x5632e652bb90 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8009a40 tx=0x7f9ce8009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf67aad2e0642b84 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.253+0000 7f9ce77fe640 1 -- 172.21.15.84:0/2524533953 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f9cf0108aa0 con 0x7f9cf8108d70 2024-09-21T03:46:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.253+0000 7f9ce4ff9640 1 -- 172.21.15.84:0/978967048 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8017070 con 0x5632e615b1b0 2024-09-21T03:46:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.253+0000 7f9ce4ff9640 1 -- 172.21.15.84:0/978967048 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ce8013470 con 0x5632e615b1b0 2024-09-21T03:46:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.253+0000 7f9ce4ff9640 1 -- 172.21.15.84:0/978967048 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8012630 con 0x5632e615b1b0 2024-09-21T03:46:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.254+0000 7f9d031fe740 1 -- 172.21.15.84:0/978967048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e615b1b0 msgr2=0x5632e652bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.254+0000 7f9cf6d9d640 1 --2- 172.21.15.84:0/2524533953 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9ce00b6680 0x7f9ce00b8b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00cbbe0 tx=0x7f9cf009b730 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.254+0000 7f9d031fe740 1 --2- 172.21.15.84:0/978967048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e615b1b0 0x5632e652bb90 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8009a40 tx=0x7f9ce8009f00 comp rx=0 tx=0).stop 2024-09-21T03:46:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.254+0000 7f9d031fe740 1 -- 172.21.15.84:0/978967048 shutdown_connections 2024-09-21T03:46:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.254+0000 7f9d031fe740 1 --2- 172.21.15.84:0/978967048 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e6163390 0x5632e652c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.254+0000 7f9d031fe740 1 --2- 172.21.15.84:0/978967048 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e615b1b0 0x5632e652bb90 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.254+0000 7f9d031fe740 1 --2- 172.21.15.84:0/978967048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e6184070 0x5632e652b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.254+0000 7f9d031fe740 1 -- 172.21.15.84:0/978967048 >> 172.21.15.84:0/978967048 conn(0x5632e6178460 msgr2=0x5632e6529540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.254+0000 7f9d031fe740 1 -- 172.21.15.84:0/978967048 shutdown_connections 2024-09-21T03:46:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.254+0000 7f9d031fe740 1 -- 172.21.15.84:0/978967048 wait complete. 2024-09-21T03:46:29.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.255+0000 7f9d031fe740 1 -- start start 2024-09-21T03:46:29.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.255+0000 7f9d031fe740 1 Processor -- start 2024-09-21T03:46:29.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.255+0000 7f9d031fe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e615b1b0 0x5632e6536ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:29.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.255+0000 7f9d031fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e6163390 0x5632e65371e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:29.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.255+0000 7f9d031fe740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e6184070 0x5632e6537720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:29.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.255+0000 7f9d031fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5632e62f2700 con 0x5632e6163390 2024-09-21T03:46:29.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.255+0000 7f9d031fe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5632e642c110 con 0x5632e615b1b0 2024-09-21T03:46:29.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.255+0000 7f9d031fe740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5632e6539e30 con 0x5632e6184070 2024-09-21T03:46:29.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.255+0000 7f9d031fe740 10 client.0 _ll_register_callbacks cb 0x5632e6445990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:46:29.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.255+0000 7f9cf659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e6163390 0x5632e65371e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:29.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.255+0000 7f9cf659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e6163390 0x5632e65371e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48436/0 (socket says 172.21.15.84:48436) 2024-09-21T03:46:29.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.255+0000 7f9cf659c640 1 -- 172.21.15.84:0/357142288 learned_addr learned my addr 172.21.15.84:0/357142288 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:29.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.255+0000 7f9cf5d9b640 1 --2- 172.21.15.84:0/357142288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e615b1b0 0x5632e6536ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:29.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.256+0000 7f9cf5d9b640 1 --2- 172.21.15.84:0/357142288 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e6184070 0x5632e6537720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:29.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.256+0000 7f9cf659c640 1 -- 172.21.15.84:0/357142288 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e6184070 msgr2=0x5632e6537720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:29.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.256+0000 7f9cf659c640 1 --2- 172.21.15.84:0/357142288 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e6184070 0x5632e6537720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.256+0000 7f9cf659c640 1 -- 172.21.15.84:0/357142288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e615b1b0 msgr2=0x5632e6536ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:29.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.256+0000 7f9cf659c640 1 --2- 172.21.15.84:0/357142288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e615b1b0 0x5632e6536ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.256+0000 7f9cf659c640 1 -- 172.21.15.84:0/357142288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632e6459c40 con 0x5632e6163390 2024-09-21T03:46:29.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.256+0000 7f9cf5d9b640 1 --2- 172.21.15.84:0/357142288 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e6184070 0x5632e6537720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:46:29.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.256+0000 7f9cf659c640 1 --2- 172.21.15.84:0/357142288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e6163390 0x5632e65371e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8013d80 tx=0x7f9ce8013850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6b7b59553138b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:29.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.256+0000 7f9cddffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:46:29.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.256+0000 7f9cddffb640 1 -- 172.21.15.84:0/357142288 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8017050 con 0x5632e6163390 2024-09-21T03:46:29.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.256+0000 7f9cddffb640 1 -- 172.21.15.84:0/357142288 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f9ce801c650 con 0x5632e6163390 2024-09-21T03:46:29.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.256+0000 7f9d031fe740 1 -- 172.21.15.84:0/357142288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ce8013470 con 0x5632e6163390 2024-09-21T03:46:29.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.256+0000 7f9cddffb640 1 -- 172.21.15.84:0/357142288 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9ce8009650 con 0x5632e6163390 2024-09-21T03:46:29.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.256+0000 7f9d031fe740 10 client.16275 fetch_fsmap learned FSMap version 25 2024-09-21T03:46:29.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.256+0000 7f9d031fe740 1 -- 172.21.15.84:0/357142288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5632e65459f0 con 0x5632e6163390 2024-09-21T03:46:29.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.256+0000 7f9cddffb640 1 -- 172.21.15.84:0/357142288 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ce8013470 con 0x5632e6163390 2024-09-21T03:46:29.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.257+0000 7f9cddffb640 1 -- 172.21.15.84:0/357142288 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9ce80309f0 con 0x5632e6163390 2024-09-21T03:46:29.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.257+0000 7f9d031fe740 10 client.16275 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:46:29.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.257+0000 7f9d031fe740 10 client.16275 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:46:29.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.257+0000 7f9d031fe740 20 client.16275 populate_metadata read hostname 'smithi084' 2024-09-21T03:46:29.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.257+0000 7f9d031fe740 1 --2- 172.21.15.84:0/357142288 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5632e61429f0 0x5632e6548d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:29.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.257+0000 7f9d031fe740 4 client.16275 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:46:29.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.257+0000 7f9d031fe740 1 -- 172.21.15.84:0/357142288 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632e64a3da0 con 0x5632e61429f0 2024-09-21T03:46:29.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.257+0000 7f9cf5d9b640 1 --2- 172.21.15.84:0/357142288 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5632e61429f0 0x5632e6548d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:29.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.257+0000 7f9cddffb640 10 client.16275 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:46:29.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.257+0000 7f9cf5d9b640 1 --2- 172.21.15.84:0/357142288 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5632e61429f0 0x5632e6548d50 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0fd91de4af47d17 server_cookie=8c83b033813da510 in_seq=0 out_seq=0 2024-09-21T03:46:29.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.258+0000 7f9cddffb640 1 -- 172.21.15.84:0/357142288 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5632e64a3da0 con 0x5632e61429f0 2024-09-21T03:46:29.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.258+0000 7f9cddffb640 10 client.16275 handle_command_reply: tid=0 2024-09-21T03:46:29.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.258+0000 7f9d031fe740 1 client.16275 shutdown 2024-09-21T03:46:29.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.258+0000 7f9d031fe740 1 -- 172.21.15.84:0/357142288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e6163390 msgr2=0x5632e65371e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:29.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.258+0000 7f9d031fe740 1 --2- 172.21.15.84:0/357142288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e6163390 0x5632e65371e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8013d80 tx=0x7f9ce8013850 comp rx=0 tx=0).stop 2024-09-21T03:46:29.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.258+0000 7f9d031fe740 1 -- 172.21.15.84:0/357142288 shutdown_connections 2024-09-21T03:46:29.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.258+0000 7f9d031fe740 1 --2- 172.21.15.84:0/357142288 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5632e61429f0 0x5632e6548d50 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.258+0000 7f9d031fe740 1 --2- 172.21.15.84:0/357142288 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e6184070 0x5632e6537720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.258+0000 7f9d031fe740 1 --2- 172.21.15.84:0/357142288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e6163390 0x5632e65371e0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.258+0000 7f9cddffb640 0 client.16275 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:46:29.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.258+0000 7f9d031fe740 1 --2- 172.21.15.84:0/357142288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e615b1b0 0x5632e6536ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.258+0000 7f9d031fe740 1 -- 172.21.15.84:0/357142288 >> 172.21.15.84:0/357142288 conn(0x5632e6178460 msgr2=0x5632e652e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:29.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.259+0000 7f9d031fe740 1 -- 172.21.15.84:0/357142288 shutdown_connections 2024-09-21T03:46:29.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.259+0000 7f9d031fe740 1 -- 172.21.15.84:0/357142288 wait complete. 2024-09-21T03:46:29.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.259+0000 7f9d031fe740 20 client.16275 trim_cache size 0 max 16384 2024-09-21T03:46:29.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.276+0000 7f9d031fe740 1 Processor -- start 2024-09-21T03:46:29.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.276+0000 7f9d031fe740 1 -- start start 2024-09-21T03:46:29.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.276+0000 7f9d031fe740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e61429f0 0x5632e652cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:29.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.276+0000 7f9d031fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e615b1b0 0x5632e6533e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:29.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.276+0000 7f9d031fe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e6163390 0x5632e65343d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:29.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.276+0000 7f9d031fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf81b40a0 con 0x5632e615b1b0 2024-09-21T03:46:29.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.276+0000 7f9d031fe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf81b1970 con 0x5632e6163390 2024-09-21T03:46:29.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.276+0000 7f9d031fe740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf81af7c0 con 0x5632e61429f0 2024-09-21T03:46:29.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.276+0000 7f9cf659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e615b1b0 0x5632e6533e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:29.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.276+0000 7f9cf659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e615b1b0 0x5632e6533e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48446/0 (socket says 172.21.15.84:48446) 2024-09-21T03:46:29.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.276+0000 7f9cf659c640 1 -- 172.21.15.84:0/177168916 learned_addr learned my addr 172.21.15.84:0/177168916 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:29.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.276+0000 7f9cf5d9b640 1 --2- 172.21.15.84:0/177168916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e61429f0 0x5632e652cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:29.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.276+0000 7f9cf5d9b640 1 --2- 172.21.15.84:0/177168916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e6163390 0x5632e65343d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:29.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.276+0000 7f9cf659c640 1 -- 172.21.15.84:0/177168916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e61429f0 msgr2=0x5632e652cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:29.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.276+0000 7f9cf659c640 1 --2- 172.21.15.84:0/177168916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e61429f0 0x5632e652cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.276+0000 7f9cf659c640 1 -- 172.21.15.84:0/177168916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e6163390 msgr2=0x5632e65343d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:29.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.276+0000 7f9cf659c640 1 --2- 172.21.15.84:0/177168916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e6163390 0x5632e65343d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.276+0000 7f9cf659c640 1 -- 172.21.15.84:0/177168916 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632e6537f60 con 0x5632e615b1b0 2024-09-21T03:46:29.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.277+0000 7f9cf659c640 1 --2- 172.21.15.84:0/177168916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e615b1b0 0x5632e6533e90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800eef0 tx=0x7f9ce8009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b05581caba3c3c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:29.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.277+0000 7f9cdffff640 1 -- 172.21.15.84:0/177168916 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce8009460 con 0x5632e615b1b0 2024-09-21T03:46:29.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.277+0000 7f9cdffff640 1 -- 172.21.15.84:0/177168916 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ce8009600 con 0x5632e615b1b0 2024-09-21T03:46:29.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.277+0000 7f9cdffff640 1 -- 172.21.15.84:0/177168916 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce80306b0 con 0x5632e615b1b0 2024-09-21T03:46:29.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.277+0000 7f9d031fe740 1 -- 172.21.15.84:0/177168916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e615b1b0 msgr2=0x5632e6533e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:29.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.277+0000 7f9d031fe740 1 --2- 172.21.15.84:0/177168916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e615b1b0 0x5632e6533e90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9ce800eef0 tx=0x7f9ce8009f00 comp rx=0 tx=0).stop 2024-09-21T03:46:29.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.277+0000 7f9d031fe740 1 -- 172.21.15.84:0/177168916 shutdown_connections 2024-09-21T03:46:29.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.277+0000 7f9d031fe740 1 --2- 172.21.15.84:0/177168916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e6163390 0x5632e65343d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.277+0000 7f9d031fe740 1 --2- 172.21.15.84:0/177168916 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e615b1b0 0x5632e6533e90 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.277+0000 7f9d031fe740 1 --2- 172.21.15.84:0/177168916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e61429f0 0x5632e652cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.277+0000 7f9d031fe740 1 -- 172.21.15.84:0/177168916 >> 172.21.15.84:0/177168916 conn(0x5632e6178460 msgr2=0x5632e652c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:29.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.278+0000 7f9d031fe740 1 -- 172.21.15.84:0/177168916 shutdown_connections 2024-09-21T03:46:29.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.278+0000 7f9d031fe740 1 -- 172.21.15.84:0/177168916 wait complete. 2024-09-21T03:46:29.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.278+0000 7f9d031fe740 1 -- start start 2024-09-21T03:46:29.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.278+0000 7f9d031fe740 1 Processor -- start 2024-09-21T03:46:29.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.278+0000 7f9d031fe740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e61429f0 0x5632e654c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:29.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.278+0000 7f9d031fe740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e615b1b0 0x5632e6549b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:29.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.278+0000 7f9d031fe740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e6163390 0x5632e654a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:29.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.278+0000 7f9d031fe740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf81afe30 con 0x5632e6163390 2024-09-21T03:46:29.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.278+0000 7f9d031fe740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf81b12a0 con 0x5632e615b1b0 2024-09-21T03:46:29.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.278+0000 7f9d031fe740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf81b0500 con 0x5632e61429f0 2024-09-21T03:46:29.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.278+0000 7f9d031fe740 10 client.0 _ll_register_callbacks cb 0x7f9ce8009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:46:29.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.278+0000 7f9cf5d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e6163390 0x5632e654a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:29.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.278+0000 7f9cf5d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e6163390 0x5632e654a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48448/0 (socket says 172.21.15.84:48448) 2024-09-21T03:46:29.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.278+0000 7f9cf5d9b640 1 -- 172.21.15.84:0/2890328605 learned_addr learned my addr 172.21.15.84:0/2890328605 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:46:29.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.279+0000 7f9cf5d9b640 1 --2- 172.21.15.84:0/2890328605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e61429f0 0x5632e654c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:29.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.279+0000 7f9cf659c640 1 --2- 172.21.15.84:0/2890328605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e615b1b0 0x5632e6549b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:29.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.279+0000 7f9cf5d9b640 1 -- 172.21.15.84:0/2890328605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e61429f0 msgr2=0x5632e654c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:29.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.279+0000 7f9cf5d9b640 1 --2- 172.21.15.84:0/2890328605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e61429f0 0x5632e654c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.279+0000 7f9cf5d9b640 1 -- 172.21.15.84:0/2890328605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e615b1b0 msgr2=0x5632e6549b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:46:29.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.279+0000 7f9cf5d9b640 1 --2- 172.21.15.84:0/2890328605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e615b1b0 0x5632e6549b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.279+0000 7f9cf5d9b640 1 -- 172.21.15.84:0/2890328605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632e654a8e0 con 0x5632e6163390 2024-09-21T03:46:29.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.279+0000 7f9cf659c640 1 --2- 172.21.15.84:0/2890328605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e615b1b0 0x5632e6549b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:46:29.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.279+0000 7f9cf5d9b640 1 --2- 172.21.15.84:0/2890328605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e6163390 0x5632e654a170 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00adf0 tx=0x7f9cec00a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ee457f1273dcfb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:46:29.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.279+0000 7f9cddffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:46:29.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.279+0000 7f9cddffb640 1 -- 172.21.15.84:0/2890328605 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cec00fd80 con 0x5632e6163390 2024-09-21T03:46:29.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.279+0000 7f9cddffb640 1 -- 172.21.15.84:0/2890328605 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f9cec004020 con 0x5632e6163390 2024-09-21T03:46:29.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.279+0000 7f9d031fe740 1 -- 172.21.15.84:0/2890328605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ce8009600 con 0x5632e6163390 2024-09-21T03:46:29.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.279+0000 7f9cddffb640 1 -- 172.21.15.84:0/2890328605 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9cec004220 con 0x5632e6163390 2024-09-21T03:46:29.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.279+0000 7f9d031fe740 10 client.16281 fetch_fsmap learned FSMap version 25 2024-09-21T03:46:29.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.279+0000 7f9d031fe740 1 -- 172.21.15.84:0/2890328605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5632e65b3580 con 0x5632e6163390 2024-09-21T03:46:29.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.279+0000 7f9cddffb640 1 -- 172.21.15.84:0/2890328605 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ce8009600 con 0x5632e6163390 2024-09-21T03:46:29.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.280+0000 7f9cddffb640 1 -- 172.21.15.84:0/2890328605 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9cec030070 con 0x5632e6163390 2024-09-21T03:46:29.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.280+0000 7f9d031fe740 10 client.16281 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:46:29.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.280+0000 7f9d031fe740 10 client.16281 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:46:29.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.280+0000 7f9d031fe740 20 client.16281 populate_metadata read hostname 'smithi084' 2024-09-21T03:46:29.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.280+0000 7f9d031fe740 1 --2- 172.21.15.84:0/2890328605 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5632e6184070 0x5632e65b5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:46:29.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.280+0000 7f9d031fe740 4 client.16281 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:46:29.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.280+0000 7f9d031fe740 1 -- 172.21.15.84:0/2890328605 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5632e649f850 con 0x5632e6184070 2024-09-21T03:46:29.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.280+0000 7f9cf659c640 1 --2- 172.21.15.84:0/2890328605 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5632e6184070 0x5632e65b5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:46:29.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.280+0000 7f9cf659c640 1 --2- 172.21.15.84:0/2890328605 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5632e6184070 0x5632e65b5d70 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdc31a81b0f8ff6b server_cookie=d782b8c7305aedb8 in_seq=0 out_seq=0 2024-09-21T03:46:29.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.280+0000 7f9cddffb640 10 client.16281 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:46:29.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.281+0000 7f9cddffb640 1 -- 172.21.15.84:0/2890328605 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x5632e649f850 con 0x5632e6184070 2024-09-21T03:46:29.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.281+0000 7f9cddffb640 10 client.16281 handle_command_reply: tid=0 2024-09-21T03:46:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.281+0000 7f9d031fe740 1 client.16281 shutdown 2024-09-21T03:46:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.281+0000 7f9d031fe740 1 -- 172.21.15.84:0/2890328605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e6163390 msgr2=0x5632e654a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.281+0000 7f9d031fe740 1 --2- 172.21.15.84:0/2890328605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e6163390 0x5632e654a170 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9cec00adf0 tx=0x7f9cec00a640 comp rx=0 tx=0).stop 2024-09-21T03:46:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.281+0000 7f9d031fe740 1 -- 172.21.15.84:0/2890328605 shutdown_connections 2024-09-21T03:46:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.281+0000 7f9d031fe740 1 --2- 172.21.15.84:0/2890328605 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5632e6184070 0x5632e65b5d70 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.281+0000 7f9d031fe740 1 --2- 172.21.15.84:0/2890328605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5632e6163390 0x5632e654a170 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.281+0000 7f9d031fe740 1 --2- 172.21.15.84:0/2890328605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5632e615b1b0 0x5632e6549b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.281+0000 7f9cddffb640 0 client.16281 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:46:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.281+0000 7f9d031fe740 1 --2- 172.21.15.84:0/2890328605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5632e61429f0 0x5632e654c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.281+0000 7f9d031fe740 1 -- 172.21.15.84:0/2890328605 >> 172.21.15.84:0/2890328605 conn(0x5632e6178460 msgr2=0x5632e6538130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.281+0000 7f9d031fe740 1 -- 172.21.15.84:0/2890328605 shutdown_connections 2024-09-21T03:46:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.281+0000 7f9d031fe740 1 -- 172.21.15.84:0/2890328605 wait complete. 2024-09-21T03:46:29.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.281+0000 7f9d031fe740 20 client.16281 trim_cache size 0 max 16384 2024-09-21T03:46:29.290 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:46:29.290 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:46:29.290 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T03:46:29.290 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:46:29.290 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:46:29.290 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "76fe28fc-001d-4a83-89c6-36f23b2fbf13", 2024-09-21T03:46:29.290 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T03:46:29.290 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:46:29.290 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:46:29.290 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:46:29.290 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:46:29.290 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:46:29.291 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:46:29.291 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:46:29.291 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:46:29.291 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:46:29.291 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:46:29.291 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:46:29.291 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:46:29.291 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:46:29.291 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:46:29.291 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:46:29.291 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:46:29.291 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:46:29.291 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:46:29.291 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:46:29.292 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:46:29.292 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:46:29.292 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:46:29.292 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:46:29.292 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:46:29.292 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:46:29.292 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:46:29.292 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:46:29.292 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:46:29.292 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:46:29.292 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:46:29.292 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:46:29.292 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:46:29.292 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:46:29.293 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:46:29.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:46:29.293 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:46:29.293 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:46:29.293 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:46:29.293 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:46:29.293 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:46:29.293 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:46:29.293 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:46:29.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:46:29.293 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:46:29.293 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:46:29.293 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:46:29.293 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:46:29.294 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:46:29.294 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:46:29.294 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:46:29.294 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:46:29.294 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:46:29.294 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:46:29.294 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:46:29.294 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:46:29.294 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:46:29.294 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:46:29.294 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:46:29.294 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:46:29.294 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:46:29.294 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:46:29.295 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:46:29.295 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:46:29.295 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:46:29.295 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:46:29.295 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:46:29.295 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:46:29.295 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:46:29.295 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:46:29.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.282+0000 7f9cfcc8a640 1 -- 172.21.15.84:0/2524533953 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9ce00b6680 msgr2=0x7f9ce00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:29.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.282+0000 7f9cfcc8a640 1 --2- 172.21.15.84:0/2524533953 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9ce00b6680 0x7f9ce00b8b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00cbbe0 tx=0x7f9cf009b730 comp rx=0 tx=0).stop 2024-09-21T03:46:29.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.282+0000 7f9cfcc8a640 1 -- 172.21.15.84:0/2524533953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf8108d70 msgr2=0x7f9cf8110b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:46:29.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.282+0000 7f9cfcc8a640 1 --2- 172.21.15.84:0/2524533953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf8108d70 0x7f9cf8110b00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0005cc0 tx=0x7f9cf002f470 comp rx=0 tx=0).stop 2024-09-21T03:46:29.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.282+0000 7f9cfcc8a640 1 -- 172.21.15.84:0/2524533953 shutdown_connections 2024-09-21T03:46:29.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.282+0000 7f9cfcc8a640 1 --2- 172.21.15.84:0/2524533953 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9ce00b6680 0x7f9ce00b8b90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.282+0000 7f9cfcc8a640 1 --2- 172.21.15.84:0/2524533953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9cf8108d70 0x7f9cf8110b00 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.282+0000 7f9cfcc8a640 1 --2- 172.21.15.84:0/2524533953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9cf8108420 0x7f9cf81105c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.282+0000 7f9cfcc8a640 1 --2- 172.21.15.84:0/2524533953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9cf8102ae0 0x7f9cf8110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:46:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.282+0000 7f9cfcc8a640 1 -- 172.21.15.84:0/2524533953 >> 172.21.15.84:0/2524533953 conn(0x7f9cf8079770 msgr2=0x7f9cf8106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:46:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.282+0000 7f9cfcc8a640 1 -- 172.21.15.84:0/2524533953 shutdown_connections 2024-09-21T03:46:29.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:46:29.282+0000 7f9cfcc8a640 1 -- 172.21.15.84:0/2524533953 wait complete. 2024-09-21T03:46:29.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:29 smithi084 ceph-mon[30941]: pgmap v444: 97 pgs: 97 active+clean; 5.0 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-09-21T03:46:29.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:29 smithi174 ceph-mon[34403]: pgmap v444: 97 pgs: 97 active+clean; 5.0 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-09-21T03:46:29.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:29 smithi172 ceph-mon[34821]: pgmap v444: 97 pgs: 97 active+clean; 5.0 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-09-21T03:46:30.091 INFO:tasks.cephfs.filesystem:scrub status for tag:76fe28fc-001d-4a83-89c6-36f23b2fbf13 - {'path': '/', 'tag': '76fe28fc-001d-4a83-89c6-36f23b2fbf13', 'options': 'recursive,force'} 2024-09-21T03:46:30.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:30 smithi084 ceph-mon[30941]: scrub summary: idle 2024-09-21T03:46:30.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:30 smithi174 ceph-mon[34403]: scrub summary: idle 2024-09-21T03:46:30.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:30 smithi172 ceph-mon[34821]: scrub summary: idle 2024-09-21T03:46:31.779 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:31 smithi174 ceph-mon[34403]: pgmap v445: 97 pgs: 97 active+clean; 5.2 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-09-21T03:46:31.801 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:31 smithi172 ceph-mon[34821]: pgmap v445: 97 pgs: 97 active+clean; 5.2 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-09-21T03:46:31.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:31 smithi084 ceph-mon[30941]: pgmap v445: 97 pgs: 97 active+clean; 5.2 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-09-21T03:46:32.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:32 smithi084 ceph-mon[30941]: pgmap v446: 97 pgs: 97 active+clean; 5.2 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 11 op/s 2024-09-21T03:46:32.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:32 smithi174 ceph-mon[34403]: pgmap v446: 97 pgs: 97 active+clean; 5.2 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 11 op/s 2024-09-21T03:46:32.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:32 smithi172 ceph-mon[34821]: pgmap v446: 97 pgs: 97 active+clean; 5.2 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 11 op/s 2024-09-21T03:46:35.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:35 smithi084 ceph-mon[30941]: pgmap v447: 97 pgs: 97 active+clean; 5.3 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-09-21T03:46:35.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:35 smithi174 ceph-mon[34403]: pgmap v447: 97 pgs: 97 active+clean; 5.3 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-09-21T03:46:35.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:35 smithi172 ceph-mon[34821]: pgmap v447: 97 pgs: 97 active+clean; 5.3 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-09-21T03:46:37.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:37 smithi084 ceph-mon[30941]: pgmap v448: 97 pgs: 97 active+clean; 5.3 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 9 op/s 2024-09-21T03:46:37.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:37 smithi174 ceph-mon[34403]: pgmap v448: 97 pgs: 97 active+clean; 5.3 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 9 op/s 2024-09-21T03:46:37.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:37 smithi172 ceph-mon[34821]: pgmap v448: 97 pgs: 97 active+clean; 5.3 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 9 op/s 2024-09-21T03:46:39.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:39 smithi084 ceph-mon[30941]: pgmap v449: 97 pgs: 97 active+clean; 5.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-21T03:46:39.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:39 smithi174 ceph-mon[34403]: pgmap v449: 97 pgs: 97 active+clean; 5.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-21T03:46:39.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:39 smithi172 ceph-mon[34821]: pgmap v449: 97 pgs: 97 active+clean; 5.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-21T03:46:41.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:41 smithi084 ceph-mon[30941]: pgmap v450: 97 pgs: 97 active+clean; 5.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-09-21T03:46:41.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:41 smithi174 ceph-mon[34403]: pgmap v450: 97 pgs: 97 active+clean; 5.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-09-21T03:46:41.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:41 smithi172 ceph-mon[34821]: pgmap v450: 97 pgs: 97 active+clean; 5.4 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-09-21T03:46:42.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:46:42.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:42.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:46:42.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:42 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:46:42.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:46:42.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:42.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:46:42.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:42 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:46:42.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:46:42.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:46:42.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:46:42.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:42 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:46:43.720 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:43 smithi084 ceph-mon[30941]: pgmap v451: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-21T03:46:43.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:43 smithi174 ceph-mon[34403]: pgmap v451: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-21T03:46:43.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:43 smithi172 ceph-mon[34821]: pgmap v451: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-09-21T03:46:44.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:44 smithi084 ceph-mon[30941]: pgmap v452: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-09-21T03:46:44.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:44 smithi174 ceph-mon[34403]: pgmap v452: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-09-21T03:46:44.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:44 smithi172 ceph-mon[34821]: pgmap v452: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-09-21T03:46:44.993 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.994 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.994 INFO:tasks.workunit.client.0.smithi084.stdout:127/600: open fd = 3 2024-09-21T03:46:44.994 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.994 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.994 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.994 INFO:tasks.workunit.client.0.smithi084.stdout:128/600: open fd = 3 2024-09-21T03:46:44.994 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.994 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.994 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.994 INFO:tasks.workunit.client.0.smithi084.stdout:129/600: open fd = 3 2024-09-21T03:46:44.994 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.994 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.994 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.995 INFO:tasks.workunit.client.0.smithi084.stdout:130/600: open fd = 3 2024-09-21T03:46:44.995 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.995 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.995 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.995 INFO:tasks.workunit.client.0.smithi084.stdout:131/600: open fd = 3 2024-09-21T03:46:44.995 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.995 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.995 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.995 INFO:tasks.workunit.client.0.smithi084.stdout:132/600: open fd = 3 2024-09-21T03:46:44.995 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.995 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.995 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.995 INFO:tasks.workunit.client.0.smithi084.stdout:133/600: open fd = 3 2024-09-21T03:46:44.995 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.995 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.996 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.996 INFO:tasks.workunit.client.0.smithi084.stdout:134/600: open fd = 3 2024-09-21T03:46:44.996 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.996 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.996 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.996 INFO:tasks.workunit.client.0.smithi084.stdout:135/600: open fd = 3 2024-09-21T03:46:44.996 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.996 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.996 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.996 INFO:tasks.workunit.client.0.smithi084.stdout:136/600: open fd = 3 2024-09-21T03:46:44.996 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.996 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.996 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.996 INFO:tasks.workunit.client.0.smithi084.stdout:137/600: open fd = 3 2024-09-21T03:46:44.996 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.997 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.997 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.997 INFO:tasks.workunit.client.0.smithi084.stdout:138/600: open fd = 3 2024-09-21T03:46:44.997 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.997 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.997 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.997 INFO:tasks.workunit.client.0.smithi084.stdout:139/600: open fd = 3 2024-09-21T03:46:44.997 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.997 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.997 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.997 INFO:tasks.workunit.client.0.smithi084.stdout:140/600: open fd = 3 2024-09-21T03:46:44.997 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.997 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.997 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.997 INFO:tasks.workunit.client.0.smithi084.stdout:141/600: open fd = 3 2024-09-21T03:46:44.998 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.998 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.998 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.998 INFO:tasks.workunit.client.0.smithi084.stdout:142/600: open fd = 3 2024-09-21T03:46:44.998 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.998 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.998 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.998 INFO:tasks.workunit.client.0.smithi084.stdout:143/600: open fd = 3 2024-09-21T03:46:44.998 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.998 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.998 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.998 INFO:tasks.workunit.client.0.smithi084.stdout:144/600: open fd = 3 2024-09-21T03:46:44.998 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.998 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.999 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.999 INFO:tasks.workunit.client.0.smithi084.stdout:145/600: open fd = 3 2024-09-21T03:46:44.999 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.999 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.999 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.999 INFO:tasks.workunit.client.0.smithi084.stdout:146/600: open fd = 3 2024-09-21T03:46:44.999 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.999 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.999 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.999 INFO:tasks.workunit.client.0.smithi084.stdout:147/600: open fd = 3 2024-09-21T03:46:44.999 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.999 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:44.999 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:44.999 INFO:tasks.workunit.client.0.smithi084.stdout:148/600: open fd = 3 2024-09-21T03:46:44.999 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.000 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.000 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.000 INFO:tasks.workunit.client.0.smithi084.stdout:149/600: open fd = 3 2024-09-21T03:46:45.000 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.000 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.000 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.000 INFO:tasks.workunit.client.0.smithi084.stdout:150/600: open fd = 3 2024-09-21T03:46:45.000 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.000 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.000 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.000 INFO:tasks.workunit.client.0.smithi084.stdout:151/600: open fd = 3 2024-09-21T03:46:45.000 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.000 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.000 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.000 INFO:tasks.workunit.client.0.smithi084.stdout:152/600: open fd = 3 2024-09-21T03:46:45.001 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.001 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.001 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.001 INFO:tasks.workunit.client.0.smithi084.stdout:153/600: open fd = 3 2024-09-21T03:46:45.001 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.001 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.001 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.001 INFO:tasks.workunit.client.0.smithi084.stdout:154/600: open fd = 3 2024-09-21T03:46:45.001 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.001 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.001 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.001 INFO:tasks.workunit.client.0.smithi084.stdout:155/600: open fd = 3 2024-09-21T03:46:45.001 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.001 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.002 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.002 INFO:tasks.workunit.client.0.smithi084.stdout:156/600: open fd = 3 2024-09-21T03:46:45.002 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.002 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.002 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.002 INFO:tasks.workunit.client.0.smithi084.stdout:157/600: open fd = 3 2024-09-21T03:46:45.002 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.002 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.002 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.002 INFO:tasks.workunit.client.0.smithi084.stdout:158/600: open fd = 3 2024-09-21T03:46:45.002 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.002 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.002 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.002 INFO:tasks.workunit.client.0.smithi084.stdout:159/600: open fd = 3 2024-09-21T03:46:45.002 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.003 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.003 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.003 INFO:tasks.workunit.client.0.smithi084.stdout:160/600: open fd = 3 2024-09-21T03:46:45.003 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.003 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.003 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.003 INFO:tasks.workunit.client.0.smithi084.stdout:161/600: open fd = 3 2024-09-21T03:46:45.003 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.003 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.003 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.003 INFO:tasks.workunit.client.0.smithi084.stdout:162/600: open fd = 3 2024-09-21T03:46:45.003 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.003 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.003 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.003 INFO:tasks.workunit.client.0.smithi084.stdout:163/600: open fd = 3 2024-09-21T03:46:45.004 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.004 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.004 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.004 INFO:tasks.workunit.client.0.smithi084.stdout:164/600: open fd = 3 2024-09-21T03:46:45.004 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.004 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.004 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.004 INFO:tasks.workunit.client.0.smithi084.stdout:165/600: open fd = 3 2024-09-21T03:46:45.004 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.004 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.004 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.004 INFO:tasks.workunit.client.0.smithi084.stdout:166/600: open fd = 3 2024-09-21T03:46:45.004 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.004 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.005 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.005 INFO:tasks.workunit.client.0.smithi084.stdout:167/600: open fd = 3 2024-09-21T03:46:45.005 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.005 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.005 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.005 INFO:tasks.workunit.client.0.smithi084.stdout:168/600: open fd = 3 2024-09-21T03:46:45.005 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.005 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.005 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.005 INFO:tasks.workunit.client.0.smithi084.stdout:169/600: open fd = 3 2024-09-21T03:46:45.005 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.005 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.005 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.005 INFO:tasks.workunit.client.0.smithi084.stdout:170/600: open fd = 3 2024-09-21T03:46:45.005 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.006 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.006 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.006 INFO:tasks.workunit.client.0.smithi084.stdout:171/600: open fd = 3 2024-09-21T03:46:45.006 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.006 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.006 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.006 INFO:tasks.workunit.client.0.smithi084.stdout:172/600: open fd = 3 2024-09-21T03:46:45.006 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.006 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.006 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.006 INFO:tasks.workunit.client.0.smithi084.stdout:173/600: open fd = 3 2024-09-21T03:46:45.006 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.006 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.006 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.007 INFO:tasks.workunit.client.0.smithi084.stdout:174/600: open fd = 3 2024-09-21T03:46:45.007 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.007 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.007 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.007 INFO:tasks.workunit.client.0.smithi084.stdout:175/600: open fd = 3 2024-09-21T03:46:45.007 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.007 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.007 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.007 INFO:tasks.workunit.client.0.smithi084.stdout:176/600: open fd = 3 2024-09-21T03:46:45.007 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.007 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.007 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.007 INFO:tasks.workunit.client.0.smithi084.stdout:177/600: open fd = 3 2024-09-21T03:46:45.007 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.007 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.008 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.008 INFO:tasks.workunit.client.0.smithi084.stdout:178/600: open fd = 3 2024-09-21T03:46:45.008 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.008 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.008 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.008 INFO:tasks.workunit.client.0.smithi084.stdout:179/600: open fd = 3 2024-09-21T03:46:45.008 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.008 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.008 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.008 INFO:tasks.workunit.client.0.smithi084.stdout:180/600: open fd = 3 2024-09-21T03:46:45.008 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.008 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.008 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.008 INFO:tasks.workunit.client.0.smithi084.stdout:181/600: open fd = 3 2024-09-21T03:46:45.008 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.009 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.009 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.009 INFO:tasks.workunit.client.0.smithi084.stdout:182/600: open fd = 3 2024-09-21T03:46:45.009 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.009 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.009 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.009 INFO:tasks.workunit.client.0.smithi084.stdout:183/600: open fd = 3 2024-09-21T03:46:45.009 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.009 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.009 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.009 INFO:tasks.workunit.client.0.smithi084.stdout:184/600: open fd = 3 2024-09-21T03:46:45.009 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.009 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.009 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.010 INFO:tasks.workunit.client.0.smithi084.stdout:185/600: open fd = 3 2024-09-21T03:46:45.010 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.010 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.010 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.010 INFO:tasks.workunit.client.0.smithi084.stdout:186/600: open fd = 3 2024-09-21T03:46:45.010 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.010 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.010 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.010 INFO:tasks.workunit.client.0.smithi084.stdout:187/600: open fd = 3 2024-09-21T03:46:45.010 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.010 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.010 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:46:45.010 INFO:tasks.workunit.client.0.smithi084.stdout:188/600: open fd = 3 2024-09-21T03:46:45.010 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:45.011 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:46:47.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:47 smithi084 ceph-mon[30941]: pgmap v453: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-09-21T03:46:47.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:47 smithi174 ceph-mon[34403]: pgmap v453: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-09-21T03:46:47.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:47 smithi172 ceph-mon[34821]: pgmap v453: 97 pgs: 97 active+clean; 5.6 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 10 op/s 2024-09-21T03:46:49.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:49 smithi084 ceph-mon[30941]: pgmap v454: 97 pgs: 97 active+clean; 5.7 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-21T03:46:49.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:49 smithi174 ceph-mon[34403]: pgmap v454: 97 pgs: 97 active+clean; 5.7 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-21T03:46:49.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:49 smithi172 ceph-mon[34821]: pgmap v454: 97 pgs: 97 active+clean; 5.7 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 13 op/s 2024-09-21T03:46:51.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:51 smithi084 ceph-mon[30941]: pgmap v455: 97 pgs: 97 active+clean; 5.7 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 10 op/s 2024-09-21T03:46:51.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:51 smithi174 ceph-mon[34403]: pgmap v455: 97 pgs: 97 active+clean; 5.7 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 10 op/s 2024-09-21T03:46:51.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:51 smithi172 ceph-mon[34821]: pgmap v455: 97 pgs: 97 active+clean; 5.7 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 10 op/s 2024-09-21T03:46:53.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:53 smithi084 ceph-mon[30941]: pgmap v456: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-09-21T03:46:53.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:53 smithi174 ceph-mon[34403]: pgmap v456: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-09-21T03:46:53.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:53 smithi172 ceph-mon[34821]: pgmap v456: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-09-21T03:46:54.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:54 smithi084 ceph-mon[30941]: pgmap v457: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 10 op/s 2024-09-21T03:46:54.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:54 smithi174 ceph-mon[34403]: pgmap v457: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 10 op/s 2024-09-21T03:46:54.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:54 smithi172 ceph-mon[34821]: pgmap v457: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 10 op/s 2024-09-21T03:46:57.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:57 smithi084 ceph-mon[30941]: pgmap v458: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 10 op/s 2024-09-21T03:46:57.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:57 smithi174 ceph-mon[34403]: pgmap v458: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 10 op/s 2024-09-21T03:46:57.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:57 smithi172 ceph-mon[34821]: pgmap v458: 97 pgs: 97 active+clean; 5.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 10 op/s 2024-09-21T03:46:59.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:46:59 smithi084 ceph-mon[30941]: pgmap v459: 97 pgs: 97 active+clean; 6.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-21T03:46:59.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:46:59 smithi174 ceph-mon[34403]: pgmap v459: 97 pgs: 97 active+clean; 6.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-21T03:46:59.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:46:59 smithi172 ceph-mon[34821]: pgmap v459: 97 pgs: 97 active+clean; 6.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-09-21T03:47:00.105 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:47:00.366 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:47:00.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.888+0000 7ff4f750a640 1 -- 172.21.15.84:0/4085247588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4f0109e20 msgr2=0x7ff4f0110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:00.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.888+0000 7ff4f750a640 1 --2- 172.21.15.84:0/4085247588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4f0109e20 0x7ff4f0110650 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009ca0 tx=0x7ff4e002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.888+0000 7ff4f750a640 1 -- 172.21.15.84:0/4085247588 shutdown_connections 2024-09-21T03:47:00.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.888+0000 7ff4f750a640 1 --2- 172.21.15.84:0/4085247588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4f0109e20 0x7ff4f0110650 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.888+0000 7ff4f750a640 1 --2- 172.21.15.84:0/4085247588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4f01094d0 0x7ff4f01098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.888+0000 7ff4f750a640 1 --2- 172.21.15.84:0/4085247588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f0103b90 0x7ff4f0103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.888+0000 7ff4f750a640 1 -- 172.21.15.84:0/4085247588 >> 172.21.15.84:0/4085247588 conn(0x7ff4f00ff5e0 msgr2=0x7ff4f0101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:00.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.888+0000 7ff4f750a640 1 -- 172.21.15.84:0/4085247588 shutdown_connections 2024-09-21T03:47:00.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.888+0000 7ff4f750a640 1 -- 172.21.15.84:0/4085247588 wait complete. 2024-09-21T03:47:00.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.889+0000 7ff4f750a640 1 Processor -- start 2024-09-21T03:47:00.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.889+0000 7ff4f750a640 1 -- start start 2024-09-21T03:47:00.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.889+0000 7ff4f750a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4f0103b90 0x7ff4f019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.889+0000 7ff4f750a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f01094d0 0x7ff4f019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.889+0000 7ff4f750a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4f0109e20 0x7ff4f019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.890+0000 7ff4f750a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f0113ae0 con 0x7ff4f0109e20 2024-09-21T03:47:00.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.890+0000 7ff4f750a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f0113960 con 0x7ff4f01094d0 2024-09-21T03:47:00.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.890+0000 7ff4f750a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f0113c60 con 0x7ff4f0103b90 2024-09-21T03:47:00.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.890+0000 7ff4f5aa7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4f0109e20 0x7ff4f019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.890+0000 7ff4f5aa7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4f0109e20 0x7ff4f019fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53658/0 (socket says 172.21.15.84:53658) 2024-09-21T03:47:00.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.890+0000 7ff4f5aa7640 1 -- 172.21.15.84:0/3624920404 learned_addr learned my addr 172.21.15.84:0/3624920404 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:00.898 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.890+0000 7ff4f52a6640 1 --2- 172.21.15.84:0/3624920404 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4f0103b90 0x7ff4f019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.890+0000 7ff4f4aa5640 1 --2- 172.21.15.84:0/3624920404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f01094d0 0x7ff4f019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.890+0000 7ff4f5aa7640 1 -- 172.21.15.84:0/3624920404 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4f0103b90 msgr2=0x7ff4f019a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:00.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.890+0000 7ff4f5aa7640 1 --2- 172.21.15.84:0/3624920404 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4f0103b90 0x7ff4f019a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.890+0000 7ff4f5aa7640 1 -- 172.21.15.84:0/3624920404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f01094d0 msgr2=0x7ff4f019a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:00.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.890+0000 7ff4f5aa7640 1 --2- 172.21.15.84:0/3624920404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f01094d0 0x7ff4f019a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.890+0000 7ff4f5aa7640 1 -- 172.21.15.84:0/3624920404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f01a0300 con 0x7ff4f0109e20 2024-09-21T03:47:00.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.890+0000 7ff4f4aa5640 1 --2- 172.21.15.84:0/3624920404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f01094d0 0x7ff4f019a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:47:00.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.890+0000 7ff4f5aa7640 1 --2- 172.21.15.84:0/3624920404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4f0109e20 0x7ff4f019fc90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0005cc0 tx=0x7ff4e002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:00.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.890+0000 7ff4ee7fc640 1 -- 172.21.15.84:0/3624920404 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0003bf0 con 0x7ff4f0109e20 2024-09-21T03:47:00.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.890+0000 7ff4ee7fc640 1 -- 172.21.15.84:0/3624920404 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4e0003d90 con 0x7ff4f0109e20 2024-09-21T03:47:00.899 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.890+0000 7ff4ee7fc640 1 -- 172.21.15.84:0/3624920404 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e002fb20 con 0x7ff4f0109e20 2024-09-21T03:47:00.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.890+0000 7ff4f750a640 1 -- 172.21.15.84:0/3624920404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f01a0590 con 0x7ff4f0109e20 2024-09-21T03:47:00.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.890+0000 7ff4f750a640 1 -- 172.21.15.84:0/3624920404 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4f01a6e10 con 0x7ff4f0109e20 2024-09-21T03:47:00.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.893+0000 7ff4ee7fc640 1 -- 172.21.15.84:0/3624920404 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7ff4e002fcc0 con 0x7ff4f0109e20 2024-09-21T03:47:00.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.893+0000 7ff4fda7e740 1 Processor -- start 2024-09-21T03:47:00.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.894+0000 7ff4fda7e740 1 -- start start 2024-09-21T03:47:00.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.894+0000 7ff4fda7e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d288140070 0x55d2884e7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.894+0000 7ff4fda7e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2881171b0 0x55d2884e77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.894+0000 7ff4fda7e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d28811f390 0x55d2884e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.894+0000 7ff4fda7e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d28845de50 con 0x55d28811f390 2024-09-21T03:47:00.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.894+0000 7ff4fda7e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d28844d280 con 0x55d288140070 2024-09-21T03:47:00.900 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.894+0000 7ff4fda7e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d288451090 con 0x55d2881171b0 2024-09-21T03:47:00.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.894+0000 7ff4f4aa5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d28811f390 0x55d2884e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.894+0000 7ff4f4aa5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d28811f390 0x55d2884e7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53666/0 (socket says 172.21.15.84:53666) 2024-09-21T03:47:00.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.894+0000 7ff4f4aa5640 1 -- 172.21.15.84:0/1555164359 learned_addr learned my addr 172.21.15.84:0/1555164359 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:00.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.894+0000 7ff4ee7fc640 1 --2- 172.21.15.84:0/3624920404 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff4d80b6730 0x7ff4d80b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.894+0000 7ff4f4aa5640 1 --2- 172.21.15.84:0/1555164359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d288140070 0x55d2884e7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.894+0000 7ff4f4aa5640 1 -- 172.21.15.84:0/1555164359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2881171b0 msgr2=0x55d2884e77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:00.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.894+0000 7ff4f4aa5640 1 --2- 172.21.15.84:0/1555164359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2881171b0 0x55d2884e77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.894+0000 7ff4f4aa5640 1 -- 172.21.15.84:0/1555164359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d288140070 msgr2=0x55d2884e7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:00.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.894+0000 7ff4f4aa5640 1 --2- 172.21.15.84:0/1555164359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d288140070 0x55d2884e7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.894+0000 7ff4f4aa5640 1 -- 172.21.15.84:0/1555164359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2881ab650 con 0x55d28811f390 2024-09-21T03:47:00.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.894+0000 7ff4ee7fc640 1 -- 172.21.15.84:0/3624920404 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff4e0108a70 con 0x7ff4f0109e20 2024-09-21T03:47:00.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.894+0000 7ff4f5aa7640 1 --2- 172.21.15.84:0/3624920404 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff4d80b6730 0x7ff4d80b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.895+0000 7ff4f4aa5640 1 --2- 172.21.15.84:0/1555164359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d28811f390 0x55d2884e7cf0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40127f0 tx=0x7ff4e400b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838e098e35f4bf88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:00.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.895+0000 7ff4d77fe640 1 -- 172.21.15.84:0/1555164359 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4010970 con 0x55d28811f390 2024-09-21T03:47:00.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.895+0000 7ff4d77fe640 1 -- 172.21.15.84:0/1555164359 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4e4012e30 con 0x55d28811f390 2024-09-21T03:47:00.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.895+0000 7ff4d77fe640 1 -- 172.21.15.84:0/1555164359 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4011c80 con 0x55d28811f390 2024-09-21T03:47:00.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.896+0000 7ff4fda7e740 1 -- 172.21.15.84:0/1555164359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d28811f390 msgr2=0x55d2884e7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:00.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.896+0000 7ff4f5aa7640 1 --2- 172.21.15.84:0/3624920404 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff4d80b6730 0x7ff4d80b8c40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00ce8d0 tx=0x7ff4e00095c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:00.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.896+0000 7ff4fda7e740 1 --2- 172.21.15.84:0/1555164359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d28811f390 0x55d2884e7cf0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40127f0 tx=0x7ff4e400b5a0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.896+0000 7ff4fda7e740 1 -- 172.21.15.84:0/1555164359 shutdown_connections 2024-09-21T03:47:00.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.896+0000 7ff4fda7e740 1 --2- 172.21.15.84:0/1555164359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d28811f390 0x55d2884e7cf0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.896+0000 7ff4fda7e740 1 --2- 172.21.15.84:0/1555164359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2881171b0 0x55d2884e77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.896+0000 7ff4fda7e740 1 --2- 172.21.15.84:0/1555164359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d288140070 0x55d2884e7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.896+0000 7ff4fda7e740 1 -- 172.21.15.84:0/1555164359 >> 172.21.15.84:0/1555164359 conn(0x55d288134460 msgr2=0x55d2884e5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:00.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.896+0000 7ff4fda7e740 1 -- 172.21.15.84:0/1555164359 shutdown_connections 2024-09-21T03:47:00.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.896+0000 7ff4fda7e740 1 -- 172.21.15.84:0/1555164359 wait complete. 2024-09-21T03:47:00.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.896+0000 7ff4fda7e740 1 -- start start 2024-09-21T03:47:00.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.896+0000 7ff4fda7e740 1 Processor -- start 2024-09-21T03:47:00.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.897+0000 7ff4fda7e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2881171b0 0x55d2884f2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.897+0000 7ff4fda7e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d28811f390 0x55d2884f2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.897+0000 7ff4fda7e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d288140070 0x55d2884fed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.897+0000 7ff4fda7e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d2882ae700 con 0x55d28811f390 2024-09-21T03:47:00.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.897+0000 7ff4fda7e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d2883e8110 con 0x55d2881171b0 2024-09-21T03:47:00.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.897+0000 7ff4fda7e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d2884f5a50 con 0x55d288140070 2024-09-21T03:47:00.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.897+0000 7ff4fda7e740 10 client.0 _ll_register_callbacks cb 0x55d288401990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:00.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.897+0000 7ff4f52a6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d28811f390 0x55d2884f2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.897+0000 7ff4f52a6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d28811f390 0x55d2884f2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53680/0 (socket says 172.21.15.84:53680) 2024-09-21T03:47:00.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.897+0000 7ff4f52a6640 1 -- 172.21.15.84:0/2227405867 learned_addr learned my addr 172.21.15.84:0/2227405867 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.897+0000 7ff4f4aa5640 1 --2- 172.21.15.84:0/2227405867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2881171b0 0x55d2884f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.897+0000 7ff4f4aa5640 1 --2- 172.21.15.84:0/2227405867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d288140070 0x55d2884fed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.898+0000 7ff4f52a6640 1 -- 172.21.15.84:0/2227405867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d288140070 msgr2=0x55d2884fed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.898+0000 7ff4f52a6640 1 --2- 172.21.15.84:0/2227405867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d288140070 0x55d2884fed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.898+0000 7ff4f52a6640 1 -- 172.21.15.84:0/2227405867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2881171b0 msgr2=0x55d2884f2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.898+0000 7ff4f52a6640 1 --2- 172.21.15.84:0/2227405867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2881171b0 0x55d2884f2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.898+0000 7ff4f52a6640 1 -- 172.21.15.84:0/2227405867 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d288415c40 con 0x55d28811f390 2024-09-21T03:47:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.898+0000 7ff4f4aa5640 1 --2- 172.21.15.84:0/2227405867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2881171b0 0x55d2884f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:47:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.898+0000 7ff4f52a6640 1 --2- 172.21.15.84:0/2227405867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d28811f390 0x55d2884f2eb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800f7b0 tx=0x7ff4e800fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6b788b53c34e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.898+0000 7ff4d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.898+0000 7ff4d4ff9640 1 -- 172.21.15.84:0/2227405867 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e801d060 con 0x55d28811f390 2024-09-21T03:47:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.898+0000 7ff4d4ff9640 1 -- 172.21.15.84:0/2227405867 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff4e800dc30 con 0x55d28811f390 2024-09-21T03:47:00.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.898+0000 7ff4fda7e740 1 -- 172.21.15.84:0/2227405867 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4e4012e30 con 0x55d28811f390 2024-09-21T03:47:00.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.898+0000 7ff4d4ff9640 1 -- 172.21.15.84:0/2227405867 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff4e800de30 con 0x55d28811f390 2024-09-21T03:47:00.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.898+0000 7ff4fda7e740 10 client.16293 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:00.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.898+0000 7ff4fda7e740 1 -- 172.21.15.84:0/2227405867 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d288501850 con 0x55d28811f390 2024-09-21T03:47:00.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.898+0000 7ff4d4ff9640 1 -- 172.21.15.84:0/2227405867 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4e4012e30 con 0x55d28811f390 2024-09-21T03:47:00.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.899+0000 7ff4d4ff9640 1 -- 172.21.15.84:0/2227405867 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff4e8010450 con 0x55d28811f390 2024-09-21T03:47:00.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.899+0000 7ff4fda7e740 10 client.16293 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:00.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.899+0000 7ff4fda7e740 10 client.16293 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:47:00.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.899+0000 7ff4fda7e740 20 client.16293 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:00.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.899+0000 7ff4fda7e740 1 --2- 172.21.15.84:0/2227405867 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d2880fe9f0 0x55d288504d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.899+0000 7ff4fda7e740 4 client.16293 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:47:00.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.899+0000 7ff4fda7e740 1 -- 172.21.15.84:0/2227405867 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d28845fda0 con 0x55d2880fe9f0 2024-09-21T03:47:00.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.899+0000 7ff4f4aa5640 1 --2- 172.21.15.84:0/2227405867 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d2880fe9f0 0x55d288504d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.899+0000 7ff4d4ff9640 10 client.16293 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:00.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.900+0000 7ff4f4aa5640 1 --2- 172.21.15.84:0/2227405867 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d2880fe9f0 0x55d288504d40 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b547e44630b540d server_cookie=aefed5d6fd1995d7 in_seq=0 out_seq=0 2024-09-21T03:47:00.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.900+0000 7ff4d4ff9640 1 -- 172.21.15.84:0/2227405867 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d28845fda0 con 0x55d2880fe9f0 2024-09-21T03:47:00.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.900+0000 7ff4d4ff9640 10 client.16293 handle_command_reply: tid=0 2024-09-21T03:47:00.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.900+0000 7ff4fda7e740 1 client.16293 shutdown 2024-09-21T03:47:00.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.901+0000 7ff4fda7e740 1 -- 172.21.15.84:0/2227405867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d28811f390 msgr2=0x55d2884f2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:00.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.901+0000 7ff4fda7e740 1 --2- 172.21.15.84:0/2227405867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d28811f390 0x55d2884f2eb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800f7b0 tx=0x7ff4e800fc70 comp rx=0 tx=0).stop 2024-09-21T03:47:00.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.901+0000 7ff4fda7e740 1 -- 172.21.15.84:0/2227405867 shutdown_connections 2024-09-21T03:47:00.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.901+0000 7ff4fda7e740 1 --2- 172.21.15.84:0/2227405867 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d2880fe9f0 0x55d288504d40 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.901+0000 7ff4fda7e740 1 --2- 172.21.15.84:0/2227405867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d288140070 0x55d2884fed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.901+0000 7ff4fda7e740 1 --2- 172.21.15.84:0/2227405867 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d28811f390 0x55d2884f2eb0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.901+0000 7ff4fda7e740 1 --2- 172.21.15.84:0/2227405867 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2881171b0 0x55d2884f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.901+0000 7ff4d4ff9640 0 client.16293 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:00.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.901+0000 7ff4fda7e740 1 -- 172.21.15.84:0/2227405867 >> 172.21.15.84:0/2227405867 conn(0x55d288134460 msgr2=0x55d2884ea400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:00.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.901+0000 7ff4fda7e740 1 -- 172.21.15.84:0/2227405867 shutdown_connections 2024-09-21T03:47:00.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.901+0000 7ff4fda7e740 1 -- 172.21.15.84:0/2227405867 wait complete. 2024-09-21T03:47:00.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.901+0000 7ff4fda7e740 20 client.16293 trim_cache size 0 max 16384 2024-09-21T03:47:00.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.918+0000 7ff4fda7e740 1 Processor -- start 2024-09-21T03:47:00.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.918+0000 7ff4fda7e740 1 -- start start 2024-09-21T03:47:00.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.919+0000 7ff4fda7e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2881171b0 0x55d2884e51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.919+0000 7ff4fda7e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d28811f390 0x55d2884fec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.919+0000 7ff4fda7e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d288140070 0x55d2884ea370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.919+0000 7ff4fda7e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f01b1d80 con 0x55d288140070 2024-09-21T03:47:00.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.919+0000 7ff4fda7e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f01af650 con 0x55d2881171b0 2024-09-21T03:47:00.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.919+0000 7ff4fda7e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f01ad4a0 con 0x55d28811f390 2024-09-21T03:47:00.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.919+0000 7ff4f4aa5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d288140070 0x55d2884ea370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.919+0000 7ff4f4aa5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d288140070 0x55d2884ea370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53682/0 (socket says 172.21.15.84:53682) 2024-09-21T03:47:00.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.919+0000 7ff4f4aa5640 1 -- 172.21.15.84:0/2609553032 learned_addr learned my addr 172.21.15.84:0/2609553032 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:00.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.919+0000 7ff4f4aa5640 1 --2- 172.21.15.84:0/2609553032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2881171b0 0x55d2884e51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.919+0000 7ff4f52a6640 1 --2- 172.21.15.84:0/2609553032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d28811f390 0x55d2884fec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.919+0000 7ff4f4aa5640 1 -- 172.21.15.84:0/2609553032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d28811f390 msgr2=0x55d2884fec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:00.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.919+0000 7ff4f4aa5640 1 --2- 172.21.15.84:0/2609553032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d28811f390 0x55d2884fec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.919+0000 7ff4f4aa5640 1 -- 172.21.15.84:0/2609553032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2881171b0 msgr2=0x55d2884e51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:00.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.919+0000 7ff4f4aa5640 1 --2- 172.21.15.84:0/2609553032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2881171b0 0x55d2884e51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.919+0000 7ff4f4aa5640 1 -- 172.21.15.84:0/2609553032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2884e9560 con 0x55d288140070 2024-09-21T03:47:00.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.919+0000 7ff4f52a6640 1 --2- 172.21.15.84:0/2609553032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d28811f390 0x55d2884fec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:47:00.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.919+0000 7ff4f4aa5640 1 --2- 172.21.15.84:0/2609553032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d288140070 0x55d2884ea370 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40127c0 tx=0x7ff4e400be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b400bdc06ad29 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:00.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.920+0000 7ff4d6ffd640 1 -- 172.21.15.84:0/2609553032 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4028040 con 0x55d288140070 2024-09-21T03:47:00.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.920+0000 7ff4d6ffd640 1 -- 172.21.15.84:0/2609553032 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4e4011e80 con 0x55d288140070 2024-09-21T03:47:00.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.920+0000 7ff4d6ffd640 1 -- 172.21.15.84:0/2609553032 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4010980 con 0x55d288140070 2024-09-21T03:47:00.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.920+0000 7ff4fda7e740 1 -- 172.21.15.84:0/2609553032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d288140070 msgr2=0x55d2884ea370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.920+0000 7ff4fda7e740 1 --2- 172.21.15.84:0/2609553032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d288140070 0x55d2884ea370 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40127c0 tx=0x7ff4e400be40 comp rx=0 tx=0).stop 2024-09-21T03:47:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.921+0000 7ff4fda7e740 1 -- 172.21.15.84:0/2609553032 shutdown_connections 2024-09-21T03:47:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.921+0000 7ff4fda7e740 1 --2- 172.21.15.84:0/2609553032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d288140070 0x55d2884ea370 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.921+0000 7ff4fda7e740 1 --2- 172.21.15.84:0/2609553032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d28811f390 0x55d2884fec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.921+0000 7ff4fda7e740 1 --2- 172.21.15.84:0/2609553032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2881171b0 0x55d2884e51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.921+0000 7ff4fda7e740 1 -- 172.21.15.84:0/2609553032 >> 172.21.15.84:0/2609553032 conn(0x55d288134460 msgr2=0x55d2884e4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.921+0000 7ff4fda7e740 1 -- 172.21.15.84:0/2609553032 shutdown_connections 2024-09-21T03:47:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.921+0000 7ff4fda7e740 1 -- 172.21.15.84:0/2609553032 wait complete. 2024-09-21T03:47:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.921+0000 7ff4fda7e740 1 -- start start 2024-09-21T03:47:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.921+0000 7ff4fda7e740 1 Processor -- start 2024-09-21T03:47:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.922+0000 7ff4fda7e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2881171b0 0x55d2884f7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.922+0000 7ff4fda7e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d28811f390 0x55d2884f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.922+0000 7ff4fda7e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d288140070 0x55d28856cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.922+0000 7ff4fda7e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f01adb10 con 0x55d2881171b0 2024-09-21T03:47:00.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.922+0000 7ff4fda7e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f01aef80 con 0x55d288140070 2024-09-21T03:47:00.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.922+0000 7ff4fda7e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f01ae1e0 con 0x55d28811f390 2024-09-21T03:47:00.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.922+0000 7ff4f4aa5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2881171b0 0x55d2884f7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.922+0000 7ff4f4aa5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2881171b0 0x55d2884f7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53694/0 (socket says 172.21.15.84:53694) 2024-09-21T03:47:00.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.922+0000 7ff4f4aa5640 1 -- 172.21.15.84:0/1605633719 learned_addr learned my addr 172.21.15.84:0/1605633719 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:00.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.922+0000 7ff4fda7e740 10 client.0 _ll_register_callbacks cb 0x7ff4e800a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:00.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.922+0000 7ff4f4aa5640 1 --2- 172.21.15.84:0/1605633719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d288140070 0x55d28856cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.922+0000 7ff4f52a6640 1 --2- 172.21.15.84:0/1605633719 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d28811f390 0x55d2884f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.922+0000 7ff4f4aa5640 1 -- 172.21.15.84:0/1605633719 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d28811f390 msgr2=0x55d2884f7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:00.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.922+0000 7ff4f4aa5640 1 --2- 172.21.15.84:0/1605633719 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d28811f390 0x55d2884f7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.922+0000 7ff4f4aa5640 1 -- 172.21.15.84:0/1605633719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d288140070 msgr2=0x55d28856cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:00.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.922+0000 7ff4f4aa5640 1 --2- 172.21.15.84:0/1605633719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d288140070 0x55d28856cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.922+0000 7ff4f4aa5640 1 -- 172.21.15.84:0/1605633719 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d28856d230 con 0x55d2881171b0 2024-09-21T03:47:00.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.922+0000 7ff4f52a6640 1 --2- 172.21.15.84:0/1605633719 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d28811f390 0x55d2884f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:47:00.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.923+0000 7ff4f4aa5640 1 --2- 172.21.15.84:0/1605633719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2881171b0 0x55d2884f7670 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4005630 tx=0x7ff4e4012f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad3035ffbbadffb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:00.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.923+0000 7ff4d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:00.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.923+0000 7ff4d4ff9640 1 -- 172.21.15.84:0/1605633719 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4023030 con 0x55d2881171b0 2024-09-21T03:47:00.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.923+0000 7ff4fda7e740 1 -- 172.21.15.84:0/1605633719 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d28845b850 con 0x55d2881171b0 2024-09-21T03:47:00.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.923+0000 7ff4d4ff9640 1 -- 172.21.15.84:0/1605633719 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff4e4011bd0 con 0x55d2881171b0 2024-09-21T03:47:00.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.923+0000 7ff4d4ff9640 1 -- 172.21.15.84:0/1605633719 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff4e4004020 con 0x55d2881171b0 2024-09-21T03:47:00.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.923+0000 7ff4fda7e740 10 client.16299 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:00.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.923+0000 7ff4fda7e740 1 -- 172.21.15.84:0/1605633719 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d288574570 con 0x55d2881171b0 2024-09-21T03:47:00.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.923+0000 7ff4d4ff9640 1 -- 172.21.15.84:0/1605633719 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d28845b850 con 0x55d2881171b0 2024-09-21T03:47:00.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.923+0000 7ff4d4ff9640 1 -- 172.21.15.84:0/1605633719 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff4e402e040 con 0x55d2881171b0 2024-09-21T03:47:00.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.924+0000 7ff4fda7e740 10 client.16299 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:00.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.924+0000 7ff4fda7e740 10 client.16299 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:47:00.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.924+0000 7ff4fda7e740 20 client.16299 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:00.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.924+0000 7ff4fda7e740 1 --2- 172.21.15.84:0/1605633719 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d2880d3da0 0x55d288576b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:00.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.924+0000 7ff4fda7e740 4 client.16299 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:47:00.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.924+0000 7ff4fda7e740 1 -- 172.21.15.84:0/1605633719 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d288458c80 con 0x55d2880d3da0 2024-09-21T03:47:00.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.924+0000 7ff4f52a6640 1 --2- 172.21.15.84:0/1605633719 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d2880d3da0 0x55d288576b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:00.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.924+0000 7ff4d4ff9640 10 client.16299 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:00.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.924+0000 7ff4f52a6640 1 --2- 172.21.15.84:0/1605633719 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d2880d3da0 0x55d288576b20 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c36ad3a3a73130b3 server_cookie=1179a7ac4df810f1 in_seq=0 out_seq=0 2024-09-21T03:47:00.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.925+0000 7ff4d4ff9640 1 -- 172.21.15.84:0/1605633719 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x55d288458c80 con 0x55d2880d3da0 2024-09-21T03:47:00.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.925+0000 7ff4d4ff9640 10 client.16299 handle_command_reply: tid=0 2024-09-21T03:47:00.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.925+0000 7ff4fda7e740 1 client.16299 shutdown 2024-09-21T03:47:00.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.925+0000 7ff4fda7e740 1 -- 172.21.15.84:0/1605633719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2881171b0 msgr2=0x55d2884f7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:00.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.925+0000 7ff4fda7e740 1 --2- 172.21.15.84:0/1605633719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2881171b0 0x55d2884f7670 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff4e4005630 tx=0x7ff4e4012f60 comp rx=0 tx=0).stop 2024-09-21T03:47:00.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.925+0000 7ff4fda7e740 1 -- 172.21.15.84:0/1605633719 shutdown_connections 2024-09-21T03:47:00.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.925+0000 7ff4fda7e740 1 --2- 172.21.15.84:0/1605633719 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d2880d3da0 0x55d288576b20 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.925+0000 7ff4fda7e740 1 --2- 172.21.15.84:0/1605633719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d288140070 0x55d28856cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.925+0000 7ff4fda7e740 1 --2- 172.21.15.84:0/1605633719 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d28811f390 0x55d2884f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.925+0000 7ff4fda7e740 1 --2- 172.21.15.84:0/1605633719 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2881171b0 0x55d2884f7670 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.925+0000 7ff4fda7e740 1 -- 172.21.15.84:0/1605633719 >> 172.21.15.84:0/1605633719 conn(0x55d288134460 msgr2=0x55d2884ea340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:00.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.925+0000 7ff4d4ff9640 0 client.16299 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:00.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.925+0000 7ff4fda7e740 1 -- 172.21.15.84:0/1605633719 shutdown_connections 2024-09-21T03:47:00.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.925+0000 7ff4fda7e740 1 -- 172.21.15.84:0/1605633719 wait complete. 2024-09-21T03:47:00.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.925+0000 7ff4fda7e740 20 client.16299 trim_cache size 0 max 16384 2024-09-21T03:47:00.933 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:47:00.933 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T03:47:00.933 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T03:47:00.933 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:47:00.933 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:47:00.933 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:47:00.933 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:00.933 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:00.933 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:00.933 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:00.933 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:00.933 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:00.933 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:47:00.933 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:47:00.934 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:00.934 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:00.934 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:00.934 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:00.934 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:00.934 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:00.934 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:47:00.934 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:47:00.934 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:00.934 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:00.934 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:00.934 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:00.934 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:00.934 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:00.935 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:47:00.935 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:47:00.935 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:00.935 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:00.935 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:00.935 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:00.935 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:00.935 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:00.935 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:47:00.935 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:47:00.935 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:00.935 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:00.935 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:00.935 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:00.936 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:00.936 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:00.936 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:47:00.936 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:47:00.936 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:00.936 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:00.936 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:00.936 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:00.936 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:00.936 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:00.936 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:47:00.936 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:47:00.936 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:00.936 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:00.937 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:00.937 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:00.937 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:00.937 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:00.937 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:47:00.937 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:47:00.937 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:00.937 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:00.937 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:00.937 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:00.937 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:00.937 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:47:00.937 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:47:00.937 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:47:00.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.926+0000 7ff4f750a640 1 -- 172.21.15.84:0/3624920404 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff4d80b6730 msgr2=0x7ff4d80b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:00.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.926+0000 7ff4f750a640 1 --2- 172.21.15.84:0/3624920404 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff4d80b6730 0x7ff4d80b8c40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00ce8d0 tx=0x7ff4e00095c0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.926+0000 7ff4f750a640 1 -- 172.21.15.84:0/3624920404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4f0109e20 msgr2=0x7ff4f019fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:00.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.926+0000 7ff4f750a640 1 --2- 172.21.15.84:0/3624920404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4f0109e20 0x7ff4f019fc90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0005cc0 tx=0x7ff4e002f380 comp rx=0 tx=0).stop 2024-09-21T03:47:00.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.926+0000 7ff4f750a640 1 -- 172.21.15.84:0/3624920404 shutdown_connections 2024-09-21T03:47:00.938 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.926+0000 7ff4f750a640 1 --2- 172.21.15.84:0/3624920404 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff4d80b6730 0x7ff4d80b8c40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.926+0000 7ff4f750a640 1 --2- 172.21.15.84:0/3624920404 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4f0109e20 0x7ff4f019fc90 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.926+0000 7ff4f750a640 1 --2- 172.21.15.84:0/3624920404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4f01094d0 0x7ff4f019a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.926+0000 7ff4f750a640 1 --2- 172.21.15.84:0/3624920404 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4f0103b90 0x7ff4f019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:00.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.926+0000 7ff4f750a640 1 -- 172.21.15.84:0/3624920404 >> 172.21.15.84:0/3624920404 conn(0x7ff4f00ff5e0 msgr2=0x7ff4f0101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:00.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.926+0000 7ff4f750a640 1 -- 172.21.15.84:0/3624920404 shutdown_connections 2024-09-21T03:47:00.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:00.926+0000 7ff4f750a640 1 -- 172.21.15.84:0/3624920404 wait complete. 2024-09-21T03:47:01.703 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:01 smithi172 ceph-mon[34821]: pgmap v460: 97 pgs: 97 active+clean; 6.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 10 op/s 2024-09-21T03:47:01.800 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:01 smithi084 ceph-mon[30941]: pgmap v460: 97 pgs: 97 active+clean; 6.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 10 op/s 2024-09-21T03:47:01.829 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:47:01.829 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:47:01.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:01 smithi174 ceph-mon[34403]: pgmap v460: 97 pgs: 97 active+clean; 6.0 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 10 op/s 2024-09-21T03:47:02.090 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:47:02.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.600+0000 7fc303aaf640 1 -- 172.21.15.84:0/3417723147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2fc10ddf0 msgr2=0x7fc2fc110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:02.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.600+0000 7fc303aaf640 1 --2- 172.21.15.84:0/3417723147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2fc10ddf0 0x7fc2fc110300 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4009ca0 tx=0x7fc2f402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:47:02.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.600+0000 7fc303aaf640 1 -- 172.21.15.84:0/3417723147 shutdown_connections 2024-09-21T03:47:02.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.600+0000 7fc303aaf640 1 --2- 172.21.15.84:0/3417723147 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2fc10ddf0 0x7fc2fc110300 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:02.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.600+0000 7fc303aaf640 1 --2- 172.21.15.84:0/3417723147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2fc105270 0x7fc2fc10d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:02.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.600+0000 7fc303aaf640 1 --2- 172.21.15.84:0/3417723147 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2fc104840 0x7fc2fc104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:02.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.600+0000 7fc303aaf640 1 -- 172.21.15.84:0/3417723147 >> 172.21.15.84:0/3417723147 conn(0x7fc2fc079730 msgr2=0x7fc2fc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:02.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.600+0000 7fc303aaf640 1 -- 172.21.15.84:0/3417723147 shutdown_connections 2024-09-21T03:47:02.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.600+0000 7fc303aaf640 1 -- 172.21.15.84:0/3417723147 wait complete. 2024-09-21T03:47:02.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.601+0000 7fc303aaf640 1 Processor -- start 2024-09-21T03:47:02.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.601+0000 7fc303aaf640 1 -- start start 2024-09-21T03:47:02.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.601+0000 7fc303aaf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2fc104840 0x7fc2fc19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:02.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.601+0000 7fc303aaf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2fc105270 0x7fc2fc19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:02.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.601+0000 7fc303aaf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2fc10ddf0 0x7fc2fc19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:02.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.601+0000 7fc303aaf640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc113a90 con 0x7fc2fc105270 2024-09-21T03:47:02.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.601+0000 7fc303aaf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc113910 con 0x7fc2fc10ddf0 2024-09-21T03:47:02.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.601+0000 7fc303aaf640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc2fc113c10 con 0x7fc2fc104840 2024-09-21T03:47:02.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.601+0000 7fc30104a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2fc105270 0x7fc2fc19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:02.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.601+0000 7fc30104a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2fc105270 0x7fc2fc19aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53700/0 (socket says 172.21.15.84:53700) 2024-09-21T03:47:02.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.601+0000 7fc30104a640 1 -- 172.21.15.84:0/3473587726 learned_addr learned my addr 172.21.15.84:0/3473587726 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:02.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.602+0000 7fc30204c640 1 --2- 172.21.15.84:0/3473587726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2fc10ddf0 0x7fc2fc19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:02.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.602+0000 7fc30184b640 1 --2- 172.21.15.84:0/3473587726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2fc104840 0x7fc2fc19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:02.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.602+0000 7fc30104a640 1 -- 172.21.15.84:0/3473587726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2fc104840 msgr2=0x7fc2fc19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:02.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.602+0000 7fc30104a640 1 --2- 172.21.15.84:0/3473587726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2fc104840 0x7fc2fc19a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:02.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.602+0000 7fc30104a640 1 -- 172.21.15.84:0/3473587726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2fc10ddf0 msgr2=0x7fc2fc19fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:02.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.602+0000 7fc30104a640 1 --2- 172.21.15.84:0/3473587726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2fc10ddf0 0x7fc2fc19fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:02.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.602+0000 7fc30104a640 1 -- 172.21.15.84:0/3473587726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2fc1a03d0 con 0x7fc2fc105270 2024-09-21T03:47:02.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.602+0000 7fc30104a640 1 --2- 172.21.15.84:0/3473587726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2fc105270 0x7fc2fc19aa00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00d740 tx=0x7fc2ec00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:02.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.602+0000 7fc2f2ffd640 1 -- 172.21.15.84:0/3473587726 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec017070 con 0x7fc2fc105270 2024-09-21T03:47:02.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.602+0000 7fc2f2ffd640 1 -- 172.21.15.84:0/3473587726 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2ec00de50 con 0x7fc2fc105270 2024-09-21T03:47:02.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.602+0000 7fc303aaf640 1 -- 172.21.15.84:0/3473587726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2fc1a06c0 con 0x7fc2fc105270 2024-09-21T03:47:02.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.602+0000 7fc2f2ffd640 1 -- 172.21.15.84:0/3473587726 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec00f620 con 0x7fc2fc105270 2024-09-21T03:47:02.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.602+0000 7fc303aaf640 1 -- 172.21.15.84:0/3473587726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2fc1a6e20 con 0x7fc2fc105270 2024-09-21T03:47:02.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.603+0000 7fc303aaf640 1 -- 172.21.15.84:0/3473587726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2fc104c50 con 0x7fc2fc105270 2024-09-21T03:47:02.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.605+0000 7fc2f2ffd640 1 -- 172.21.15.84:0/3473587726 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fc2ec01a070 con 0x7fc2fc105270 2024-09-21T03:47:02.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.605+0000 7fc2f2ffd640 1 --2- 172.21.15.84:0/3473587726 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc2e80b6700 0x7fc2e80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:02.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.606+0000 7fc30184b640 1 --2- 172.21.15.84:0/3473587726 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc2e80b6700 0x7fc2e80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:02.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.606+0000 7fc2f2ffd640 1 -- 172.21.15.84:0/3473587726 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fc2ec0e6f80 con 0x7fc2fc105270 2024-09-21T03:47:02.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.606+0000 7fc30184b640 1 --2- 172.21.15.84:0/3473587726 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc2e80b6700 0x7fc2e80b8c10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8005fd0 tx=0x7fc2f800b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:02.611 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.609+0000 7fc2f2ffd640 1 -- 172.21.15.84:0/3473587726 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc2ec0b19b0 con 0x7fc2fc105270 2024-09-21T03:47:02.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.821+0000 7fc303aaf640 1 -- 172.21.15.84:0/3473587726 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2fc19b590 con 0x7fc2fc105270 2024-09-21T03:47:02.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.821+0000 7fc2f2ffd640 1 -- 172.21.15.84:0/3473587726 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7fc2fc19b590 con 0x7fc2fc105270 2024-09-21T03:47:02.824 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:47:02.824 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:47:02.824 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:47:02.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.823+0000 7fc303aaf640 1 -- 172.21.15.84:0/3473587726 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc2e80b6700 msgr2=0x7fc2e80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:02.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.823+0000 7fc303aaf640 1 --2- 172.21.15.84:0/3473587726 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc2e80b6700 0x7fc2e80b8c10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8005fd0 tx=0x7fc2f800b390 comp rx=0 tx=0).stop 2024-09-21T03:47:02.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.823+0000 7fc303aaf640 1 -- 172.21.15.84:0/3473587726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2fc105270 msgr2=0x7fc2fc19aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:02.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.823+0000 7fc303aaf640 1 --2- 172.21.15.84:0/3473587726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2fc105270 0x7fc2fc19aa00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00d740 tx=0x7fc2ec00dc00 comp rx=0 tx=0).stop 2024-09-21T03:47:02.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.823+0000 7fc303aaf640 1 -- 172.21.15.84:0/3473587726 shutdown_connections 2024-09-21T03:47:02.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.823+0000 7fc303aaf640 1 --2- 172.21.15.84:0/3473587726 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc2e80b6700 0x7fc2e80b8c10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:02.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.823+0000 7fc303aaf640 1 --2- 172.21.15.84:0/3473587726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2fc10ddf0 0x7fc2fc19fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:02.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.823+0000 7fc303aaf640 1 --2- 172.21.15.84:0/3473587726 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2fc105270 0x7fc2fc19aa00 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:02.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.823+0000 7fc303aaf640 1 --2- 172.21.15.84:0/3473587726 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2fc104840 0x7fc2fc19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:02.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.823+0000 7fc303aaf640 1 -- 172.21.15.84:0/3473587726 >> 172.21.15.84:0/3473587726 conn(0x7fc2fc079730 msgr2=0x7fc2fc107970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:02.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.824+0000 7fc303aaf640 1 -- 172.21.15.84:0/3473587726 shutdown_connections 2024-09-21T03:47:02.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:02.824+0000 7fc303aaf640 1 -- 172.21.15.84:0/3473587726 wait complete. 2024-09-21T03:47:03.636 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:47:03.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:03 smithi084 ceph-mon[30941]: pgmap v461: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-21T03:47:03.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:03 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3473587726' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:47:03.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:03 smithi174 ceph-mon[34403]: pgmap v461: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-21T03:47:03.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:03 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3473587726' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:47:03.880 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:47:03.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:03 smithi172 ceph-mon[34821]: pgmap v461: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-21T03:47:03.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:03 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3473587726' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:47:04.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.377+0000 7fd46c8e1640 1 -- 172.21.15.84:0/1842418666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd468110180 msgr2=0x7fd4681125a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:04.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.377+0000 7fd46c8e1640 1 --2- 172.21.15.84:0/1842418666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd468110180 0x7fd4681125a0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fd460009900 tx=0x7fd46002a480 comp rx=0 tx=0).stop 2024-09-21T03:47:04.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.377+0000 7fd46c8e1640 1 -- 172.21.15.84:0/1842418666 shutdown_connections 2024-09-21T03:47:04.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.377+0000 7fd46c8e1640 1 --2- 172.21.15.84:0/1842418666 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd468110180 0x7fd4681125a0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.377+0000 7fd46c8e1640 1 --2- 172.21.15.84:0/1842418666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd468102f20 0x7fd46810fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.377+0000 7fd46c8e1640 1 --2- 172.21.15.84:0/1842418666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4681025d0 0x7fd4681029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.377+0000 7fd46c8e1640 1 -- 172.21.15.84:0/1842418666 >> 172.21.15.84:0/1842418666 conn(0x7fd468079730 msgr2=0x7fd468079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:04.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.377+0000 7fd46c8e1640 1 -- 172.21.15.84:0/1842418666 shutdown_connections 2024-09-21T03:47:04.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.377+0000 7fd46c8e1640 1 -- 172.21.15.84:0/1842418666 wait complete. 2024-09-21T03:47:04.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.378+0000 7fd46c8e1640 1 Processor -- start 2024-09-21T03:47:04.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.378+0000 7fd46c8e1640 1 -- start start 2024-09-21T03:47:04.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.378+0000 7fd46c8e1640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4681025d0 0x7fd46819c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:04.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.378+0000 7fd46c8e1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd468102f20 0x7fd46819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:04.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.378+0000 7fd46c8e1640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd468110180 0x7fd4681a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:04.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.378+0000 7fd46c8e1640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd468115cb0 con 0x7fd468102f20 2024-09-21T03:47:04.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.378+0000 7fd46c8e1640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd468115b30 con 0x7fd468110180 2024-09-21T03:47:04.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.378+0000 7fd46c8e1640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd468115e30 con 0x7fd4681025d0 2024-09-21T03:47:04.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.378+0000 7fd465d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd468102f20 0x7fd46819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:04.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.378+0000 7fd465d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd468102f20 0x7fd46819cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53726/0 (socket says 172.21.15.84:53726) 2024-09-21T03:47:04.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.378+0000 7fd465d9b640 1 -- 172.21.15.84:0/349178265 learned_addr learned my addr 172.21.15.84:0/349178265 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:04.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.379+0000 7fd466d9d640 1 --2- 172.21.15.84:0/349178265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd468110180 0x7fd4681a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:04.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.379+0000 7fd46659c640 1 --2- 172.21.15.84:0/349178265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4681025d0 0x7fd46819c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:04.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.379+0000 7fd465d9b640 1 -- 172.21.15.84:0/349178265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4681025d0 msgr2=0x7fd46819c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:04.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.379+0000 7fd465d9b640 1 --2- 172.21.15.84:0/349178265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4681025d0 0x7fd46819c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.379+0000 7fd465d9b640 1 -- 172.21.15.84:0/349178265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd468110180 msgr2=0x7fd4681a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:04.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.379+0000 7fd465d9b640 1 --2- 172.21.15.84:0/349178265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd468110180 0x7fd4681a1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.379+0000 7fd465d9b640 1 -- 172.21.15.84:0/349178265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4681a2650 con 0x7fd468102f20 2024-09-21T03:47:04.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.379+0000 7fd465d9b640 1 --2- 172.21.15.84:0/349178265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd468102f20 0x7fd46819cc80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd45000d770 tx=0x7fd45000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:04.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.379+0000 7fd45f7fe640 1 -- 172.21.15.84:0/349178265 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd450017070 con 0x7fd468102f20 2024-09-21T03:47:04.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.379+0000 7fd45f7fe640 1 -- 172.21.15.84:0/349178265 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4500054d0 con 0x7fd468102f20 2024-09-21T03:47:04.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.379+0000 7fd46c8e1640 1 -- 172.21.15.84:0/349178265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4681a2940 con 0x7fd468102f20 2024-09-21T03:47:04.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.379+0000 7fd45f7fe640 1 -- 172.21.15.84:0/349178265 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd450004c30 con 0x7fd468102f20 2024-09-21T03:47:04.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.379+0000 7fd46c8e1640 1 -- 172.21.15.84:0/349178265 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4681a90a0 con 0x7fd468102f20 2024-09-21T03:47:04.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.382+0000 7fd472e55740 1 Processor -- start 2024-09-21T03:47:04.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.382+0000 7fd45f7fe640 1 -- 172.21.15.84:0/349178265 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fd450004e10 con 0x7fd468102f20 2024-09-21T03:47:04.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.382+0000 7fd472e55740 1 -- start start 2024-09-21T03:47:04.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.382+0000 7fd472e55740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce37f070 0x5563ce7262c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:04.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.382+0000 7fd472e55740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce3561b0 0x5563ce726800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:04.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.382+0000 7fd472e55740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce35e390 0x5563ce726d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:04.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.382+0000 7fd472e55740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5563ce69cea0 con 0x5563ce35e390 2024-09-21T03:47:04.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.382+0000 7fd472e55740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5563ce68c2d0 con 0x5563ce37f070 2024-09-21T03:47:04.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.382+0000 7fd472e55740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5563ce6900e0 con 0x5563ce3561b0 2024-09-21T03:47:04.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.382+0000 7fd465d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce35e390 0x5563ce726d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:04.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.382+0000 7fd465d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce35e390 0x5563ce726d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53742/0 (socket says 172.21.15.84:53742) 2024-09-21T03:47:04.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.382+0000 7fd465d9b640 1 -- 172.21.15.84:0/1686777141 learned_addr learned my addr 172.21.15.84:0/1686777141 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:04.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.383+0000 7fd466d9d640 1 --2- 172.21.15.84:0/1686777141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce37f070 0x5563ce7262c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:04.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.383+0000 7fd46659c640 1 --2- 172.21.15.84:0/1686777141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce3561b0 0x5563ce726800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:04.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.383+0000 7fd45f7fe640 1 --2- 172.21.15.84:0/349178265 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4540b6700 0x7fd4540b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:04.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.383+0000 7fd465d9b640 1 -- 172.21.15.84:0/1686777141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce3561b0 msgr2=0x5563ce726800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:04.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.383+0000 7fd465d9b640 1 --2- 172.21.15.84:0/1686777141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce3561b0 0x5563ce726800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.383+0000 7fd465d9b640 1 -- 172.21.15.84:0/1686777141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce37f070 msgr2=0x5563ce7262c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:04.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.383+0000 7fd465d9b640 1 --2- 172.21.15.84:0/1686777141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce37f070 0x5563ce7262c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.383+0000 7fd465d9b640 1 -- 172.21.15.84:0/1686777141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563ce3ea650 con 0x5563ce35e390 2024-09-21T03:47:04.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.383+0000 7fd466d9d640 1 --2- 172.21.15.84:0/1686777141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce37f070 0x5563ce7262c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:47:04.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.383+0000 7fd46659c640 1 --2- 172.21.15.84:0/1686777141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce3561b0 0x5563ce726800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:47:04.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.383+0000 7fd466d9d640 1 --2- 172.21.15.84:0/349178265 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4540b6700 0x7fd4540b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:04.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.383+0000 7fd45f7fe640 1 -- 172.21.15.84:0/349178265 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fd4500e7080 con 0x7fd468102f20 2024-09-21T03:47:04.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.383+0000 7fd465d9b640 1 --2- 172.21.15.84:0/1686777141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce35e390 0x5563ce726d40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd4500e4860 tx=0x7fd4500ad1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aeb1ba4171b8851 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:04.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.383+0000 7fd45cff9640 1 -- 172.21.15.84:0/1686777141 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd450020070 con 0x5563ce35e390 2024-09-21T03:47:04.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.383+0000 7fd45cff9640 1 -- 172.21.15.84:0/1686777141 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4500b4e50 con 0x5563ce35e390 2024-09-21T03:47:04.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.383+0000 7fd45cff9640 1 -- 172.21.15.84:0/1686777141 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4500ac940 con 0x5563ce35e390 2024-09-21T03:47:04.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.384+0000 7fd472e55740 1 -- 172.21.15.84:0/1686777141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce35e390 msgr2=0x5563ce726d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:04.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.384+0000 7fd466d9d640 1 --2- 172.21.15.84:0/349178265 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4540b6700 0x7fd4540b8c10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd460006010 tx=0x7fd460009260 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:04.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.384+0000 7fd472e55740 1 --2- 172.21.15.84:0/1686777141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce35e390 0x5563ce726d40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd4500e4860 tx=0x7fd4500ad1e0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.384+0000 7fd472e55740 1 -- 172.21.15.84:0/1686777141 shutdown_connections 2024-09-21T03:47:04.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.384+0000 7fd472e55740 1 --2- 172.21.15.84:0/1686777141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce35e390 0x5563ce726d40 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.384+0000 7fd472e55740 1 --2- 172.21.15.84:0/1686777141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce3561b0 0x5563ce726800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.384+0000 7fd472e55740 1 --2- 172.21.15.84:0/1686777141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce37f070 0x5563ce7262c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.384+0000 7fd472e55740 1 -- 172.21.15.84:0/1686777141 >> 172.21.15.84:0/1686777141 conn(0x5563ce373460 msgr2=0x5563ce7241b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:04.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.384+0000 7fd472e55740 1 -- 172.21.15.84:0/1686777141 shutdown_connections 2024-09-21T03:47:04.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.384+0000 7fd472e55740 1 -- 172.21.15.84:0/1686777141 wait complete. 2024-09-21T03:47:04.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.385+0000 7fd472e55740 1 -- start start 2024-09-21T03:47:04.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.385+0000 7fd472e55740 1 Processor -- start 2024-09-21T03:47:04.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.385+0000 7fd472e55740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce3561b0 0x5563ce7318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:04.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.385+0000 7fd472e55740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce35e390 0x5563ce731df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:04.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.385+0000 7fd472e55740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce37f070 0x5563ce732330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:04.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.385+0000 7fd472e55740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5563ce4ed700 con 0x5563ce3561b0 2024-09-21T03:47:04.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.385+0000 7fd472e55740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5563ce627160 con 0x5563ce37f070 2024-09-21T03:47:04.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.385+0000 7fd472e55740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5563ce734aa0 con 0x5563ce35e390 2024-09-21T03:47:04.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.385+0000 7fd472e55740 10 client.0 _ll_register_callbacks cb 0x5563ce6409e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:04.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.385+0000 7fd46659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce3561b0 0x5563ce7318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:04.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.385+0000 7fd46659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce3561b0 0x5563ce7318b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53750/0 (socket says 172.21.15.84:53750) 2024-09-21T03:47:04.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.385+0000 7fd46659c640 1 -- 172.21.15.84:0/2783297920 learned_addr learned my addr 172.21.15.84:0/2783297920 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:04.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.385+0000 7fd465d9b640 1 --2- 172.21.15.84:0/2783297920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce35e390 0x5563ce731df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:04.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.386+0000 7fd466d9d640 1 --2- 172.21.15.84:0/2783297920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce37f070 0x5563ce732330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:04.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.386+0000 7fd46659c640 1 -- 172.21.15.84:0/2783297920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce35e390 msgr2=0x5563ce731df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:04.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.386+0000 7fd46659c640 1 --2- 172.21.15.84:0/2783297920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce35e390 0x5563ce731df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.386+0000 7fd46659c640 1 -- 172.21.15.84:0/2783297920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce37f070 msgr2=0x5563ce732330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:04.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.386+0000 7fd46659c640 1 --2- 172.21.15.84:0/2783297920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce37f070 0x5563ce732330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.386+0000 7fd46659c640 1 -- 172.21.15.84:0/2783297920 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563ce654c90 con 0x5563ce3561b0 2024-09-21T03:47:04.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.386+0000 7fd466d9d640 1 --2- 172.21.15.84:0/2783297920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce37f070 0x5563ce732330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:47:04.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.386+0000 7fd46659c640 1 --2- 172.21.15.84:0/2783297920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce3561b0 0x5563ce7318b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd45800abc0 tx=0x7fd458007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d2b8a0b164d965 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:04.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.386+0000 7fd44dffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:04.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.386+0000 7fd44dffb640 1 -- 172.21.15.84:0/2783297920 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45801b060 con 0x5563ce3561b0 2024-09-21T03:47:04.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.386+0000 7fd472e55740 1 -- 172.21.15.84:0/2783297920 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4500b4e50 con 0x5563ce3561b0 2024-09-21T03:47:04.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.386+0000 7fd44dffb640 1 -- 172.21.15.84:0/2783297920 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fd458016640 con 0x5563ce3561b0 2024-09-21T03:47:04.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.386+0000 7fd44dffb640 1 -- 172.21.15.84:0/2783297920 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd458016840 con 0x5563ce3561b0 2024-09-21T03:47:04.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.386+0000 7fd472e55740 10 client.16317 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:04.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.386+0000 7fd472e55740 1 -- 172.21.15.84:0/2783297920 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5563ce7407d0 con 0x5563ce3561b0 2024-09-21T03:47:04.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.386+0000 7fd44dffb640 1 -- 172.21.15.84:0/2783297920 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4500b4e50 con 0x5563ce3561b0 2024-09-21T03:47:04.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.387+0000 7fd44dffb640 1 -- 172.21.15.84:0/2783297920 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd458014340 con 0x5563ce3561b0 2024-09-21T03:47:04.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.387+0000 7fd472e55740 10 client.16317 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:04.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.387+0000 7fd472e55740 10 client.16317 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:47:04.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.387+0000 7fd472e55740 20 client.16317 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:04.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.387+0000 7fd472e55740 1 --2- 172.21.15.84:0/2783297920 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5563ce33d9f0 0x5563ce743c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:04.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.387+0000 7fd472e55740 4 client.16317 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:47:04.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.387+0000 7fd472e55740 1 -- 172.21.15.84:0/2783297920 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563ce69edf0 con 0x5563ce33d9f0 2024-09-21T03:47:04.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.387+0000 7fd465d9b640 1 --2- 172.21.15.84:0/2783297920 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5563ce33d9f0 0x5563ce743c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:04.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.387+0000 7fd44dffb640 10 client.16317 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:47:04.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.387+0000 7fd465d9b640 1 --2- 172.21.15.84:0/2783297920 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5563ce33d9f0 0x5563ce743c10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f4faf9f43e782b9a server_cookie=3bf1bc4c073c12c1 in_seq=0 out_seq=0 2024-09-21T03:47:04.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.388+0000 7fd44dffb640 1 -- 172.21.15.84:0/2783297920 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5563ce69edf0 con 0x5563ce33d9f0 2024-09-21T03:47:04.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.388+0000 7fd44dffb640 10 client.16317 handle_command_reply: tid=0 2024-09-21T03:47:04.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.388+0000 7fd472e55740 1 client.16317 shutdown 2024-09-21T03:47:04.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.389+0000 7fd472e55740 1 -- 172.21.15.84:0/2783297920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce3561b0 msgr2=0x5563ce7318b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:04.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.389+0000 7fd472e55740 1 --2- 172.21.15.84:0/2783297920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce3561b0 0x5563ce7318b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd45800abc0 tx=0x7fd458007680 comp rx=0 tx=0).stop 2024-09-21T03:47:04.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.389+0000 7fd472e55740 1 -- 172.21.15.84:0/2783297920 shutdown_connections 2024-09-21T03:47:04.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.389+0000 7fd472e55740 1 --2- 172.21.15.84:0/2783297920 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5563ce33d9f0 0x5563ce743c10 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.389+0000 7fd472e55740 1 --2- 172.21.15.84:0/2783297920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce37f070 0x5563ce732330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.389+0000 7fd472e55740 1 --2- 172.21.15.84:0/2783297920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce35e390 0x5563ce731df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.389+0000 7fd44dffb640 0 client.16317 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:47:04.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.389+0000 7fd472e55740 1 --2- 172.21.15.84:0/2783297920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce3561b0 0x5563ce7318b0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.389+0000 7fd472e55740 1 -- 172.21.15.84:0/2783297920 >> 172.21.15.84:0/2783297920 conn(0x5563ce373460 msgr2=0x5563ce729450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:04.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.389+0000 7fd472e55740 1 -- 172.21.15.84:0/2783297920 shutdown_connections 2024-09-21T03:47:04.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.389+0000 7fd472e55740 1 -- 172.21.15.84:0/2783297920 wait complete. 2024-09-21T03:47:04.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.389+0000 7fd472e55740 20 client.16317 trim_cache size 0 max 16384 2024-09-21T03:47:04.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.402+0000 7fd472e55740 1 Processor -- start 2024-09-21T03:47:04.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.402+0000 7fd472e55740 1 -- start start 2024-09-21T03:47:04.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.402+0000 7fd472e55740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce3561b0 0x5563ce7334e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:04.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.402+0000 7fd472e55740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce35e390 0x5563ce7493d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:04.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.402+0000 7fd472e55740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce37f070 0x5563ce749910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:04.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.402+0000 7fd472e55740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd4681b4010 con 0x5563ce35e390 2024-09-21T03:47:04.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.402+0000 7fd472e55740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd4681b18e0 con 0x5563ce3561b0 2024-09-21T03:47:04.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.402+0000 7fd472e55740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd4681af730 con 0x5563ce37f070 2024-09-21T03:47:04.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.402+0000 7fd465d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce35e390 0x5563ce7493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:04.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.402+0000 7fd465d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce35e390 0x5563ce7493d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53758/0 (socket says 172.21.15.84:53758) 2024-09-21T03:47:04.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.402+0000 7fd465d9b640 1 -- 172.21.15.84:0/2876661402 learned_addr learned my addr 172.21.15.84:0/2876661402 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:04.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.403+0000 7fd46659c640 1 --2- 172.21.15.84:0/2876661402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce3561b0 0x5563ce7334e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:04.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.403+0000 7fd466d9d640 1 --2- 172.21.15.84:0/2876661402 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce37f070 0x5563ce749910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:04.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.403+0000 7fd465d9b640 1 -- 172.21.15.84:0/2876661402 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce37f070 msgr2=0x5563ce749910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:04.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.403+0000 7fd465d9b640 1 --2- 172.21.15.84:0/2876661402 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce37f070 0x5563ce749910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.403+0000 7fd465d9b640 1 -- 172.21.15.84:0/2876661402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce3561b0 msgr2=0x5563ce7334e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:04.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.403+0000 7fd465d9b640 1 --2- 172.21.15.84:0/2876661402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce3561b0 0x5563ce7334e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.403+0000 7fd465d9b640 1 -- 172.21.15.84:0/2876661402 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563ce72fdb0 con 0x5563ce35e390 2024-09-21T03:47:04.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.403+0000 7fd46659c640 1 --2- 172.21.15.84:0/2876661402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce3561b0 0x5563ce7334e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:47:04.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.403+0000 7fd465d9b640 1 --2- 172.21.15.84:0/2876661402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce35e390 0x5563ce7493d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd4500a95c0 tx=0x7fd450005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a885660ef9f0518 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:04.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.403+0000 7fd44ffff640 1 -- 172.21.15.84:0/2876661402 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd450020040 con 0x5563ce35e390 2024-09-21T03:47:04.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.403+0000 7fd44ffff640 1 -- 172.21.15.84:0/2876661402 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4500b4e50 con 0x5563ce35e390 2024-09-21T03:47:04.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.403+0000 7fd44ffff640 1 -- 172.21.15.84:0/2876661402 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4500ab3c0 con 0x5563ce35e390 2024-09-21T03:47:04.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.404+0000 7fd472e55740 1 -- 172.21.15.84:0/2876661402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce35e390 msgr2=0x5563ce7493d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:04.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.404+0000 7fd472e55740 1 --2- 172.21.15.84:0/2876661402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce35e390 0x5563ce7493d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd4500a95c0 tx=0x7fd450005bb0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.404+0000 7fd472e55740 1 -- 172.21.15.84:0/2876661402 shutdown_connections 2024-09-21T03:47:04.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.404+0000 7fd472e55740 1 --2- 172.21.15.84:0/2876661402 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce37f070 0x5563ce749910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.404+0000 7fd472e55740 1 --2- 172.21.15.84:0/2876661402 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce35e390 0x5563ce7493d0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.404+0000 7fd472e55740 1 --2- 172.21.15.84:0/2876661402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce3561b0 0x5563ce7334e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.404+0000 7fd472e55740 1 -- 172.21.15.84:0/2876661402 >> 172.21.15.84:0/2876661402 conn(0x5563ce373460 msgr2=0x5563ce732dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:04.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.404+0000 7fd472e55740 1 -- 172.21.15.84:0/2876661402 shutdown_connections 2024-09-21T03:47:04.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.404+0000 7fd472e55740 1 -- 172.21.15.84:0/2876661402 wait complete. 2024-09-21T03:47:04.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.404+0000 7fd472e55740 1 -- start start 2024-09-21T03:47:04.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.404+0000 7fd472e55740 1 Processor -- start 2024-09-21T03:47:04.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd472e55740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce3561b0 0x5563ce73a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:04.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd472e55740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce35e390 0x5563ce735b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:04.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd472e55740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce37f070 0x5563ce736280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:04.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd472e55740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd4681afda0 con 0x5563ce3561b0 2024-09-21T03:47:04.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd472e55740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd4681b1210 con 0x5563ce37f070 2024-09-21T03:47:04.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd472e55740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd4681b0470 con 0x5563ce35e390 2024-09-21T03:47:04.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd472e55740 10 client.0 _ll_register_callbacks cb 0x7fd458009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:04.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd46659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce3561b0 0x5563ce73a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:04.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd46659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce3561b0 0x5563ce73a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53774/0 (socket says 172.21.15.84:53774) 2024-09-21T03:47:04.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd46659c640 1 -- 172.21.15.84:0/825464588 learned_addr learned my addr 172.21.15.84:0/825464588 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:04.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd465d9b640 1 --2- 172.21.15.84:0/825464588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce35e390 0x5563ce735b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:04.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd46659c640 1 -- 172.21.15.84:0/825464588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce35e390 msgr2=0x5563ce735b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:04.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd466d9d640 1 --2- 172.21.15.84:0/825464588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce37f070 0x5563ce736280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:04.415 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd46659c640 1 --2- 172.21.15.84:0/825464588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce35e390 0x5563ce735b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd46659c640 1 -- 172.21.15.84:0/825464588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce37f070 msgr2=0x5563ce736280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd46659c640 1 --2- 172.21.15.84:0/825464588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce37f070 0x5563ce736280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd46659c640 1 -- 172.21.15.84:0/825464588 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563ce7ad5d0 con 0x5563ce3561b0 2024-09-21T03:47:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd466d9d640 1 --2- 172.21.15.84:0/825464588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce37f070 0x5563ce736280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:47:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd46659c640 1 --2- 172.21.15.84:0/825464588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce3561b0 0x5563ce73a690 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd458004b90 tx=0x7fd458015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415c0c5afeef6cf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd44dffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd44dffb640 1 -- 172.21.15.84:0/825464588 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45802c020 con 0x5563ce3561b0 2024-09-21T03:47:04.416 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd44dffb640 1 -- 172.21.15.84:0/825464588 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fd458014980 con 0x5563ce3561b0 2024-09-21T03:47:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.405+0000 7fd472e55740 1 -- 172.21.15.84:0/825464588 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4500b4e50 con 0x5563ce3561b0 2024-09-21T03:47:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.406+0000 7fd44dffb640 1 -- 172.21.15.84:0/825464588 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd45801b020 con 0x5563ce3561b0 2024-09-21T03:47:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.406+0000 7fd472e55740 10 client.16323 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.406+0000 7fd472e55740 1 -- 172.21.15.84:0/825464588 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5563ce7ae700 con 0x5563ce3561b0 2024-09-21T03:47:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.406+0000 7fd44dffb640 1 -- 172.21.15.84:0/825464588 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4500b4e50 con 0x5563ce3561b0 2024-09-21T03:47:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.406+0000 7fd44dffb640 1 -- 172.21.15.84:0/825464588 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd458020430 con 0x5563ce3561b0 2024-09-21T03:47:04.417 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.406+0000 7fd472e55740 10 client.16323 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:04.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.406+0000 7fd472e55740 10 client.16323 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:47:04.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.406+0000 7fd472e55740 20 client.16323 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:04.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.406+0000 7fd472e55740 1 --2- 172.21.15.84:0/825464588 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5563ce312da0 0x5563ce7b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:04.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.406+0000 7fd472e55740 4 client.16323 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:47:04.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.406+0000 7fd472e55740 1 -- 172.21.15.84:0/825464588 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5563ce69a8a0 con 0x5563ce312da0 2024-09-21T03:47:04.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.406+0000 7fd465d9b640 1 --2- 172.21.15.84:0/825464588 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5563ce312da0 0x5563ce7b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:04.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.407+0000 7fd465d9b640 1 --2- 172.21.15.84:0/825464588 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5563ce312da0 0x5563ce7b0f40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=521dde3b855c0a87 server_cookie=9d095e98b0200fda in_seq=0 out_seq=0 2024-09-21T03:47:04.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.407+0000 7fd44dffb640 10 client.16323 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:47:04.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.407+0000 7fd44dffb640 1 -- 172.21.15.84:0/825464588 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5563ce69a8a0 con 0x5563ce312da0 2024-09-21T03:47:04.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.407+0000 7fd44dffb640 10 client.16323 handle_command_reply: tid=0 2024-09-21T03:47:04.418 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.407+0000 7fd472e55740 1 client.16323 shutdown 2024-09-21T03:47:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.407+0000 7fd472e55740 1 -- 172.21.15.84:0/825464588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce3561b0 msgr2=0x5563ce73a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.407+0000 7fd472e55740 1 --2- 172.21.15.84:0/825464588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce3561b0 0x5563ce73a690 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd458004b90 tx=0x7fd458015000 comp rx=0 tx=0).stop 2024-09-21T03:47:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.407+0000 7fd472e55740 1 -- 172.21.15.84:0/825464588 shutdown_connections 2024-09-21T03:47:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.407+0000 7fd472e55740 1 --2- 172.21.15.84:0/825464588 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5563ce312da0 0x5563ce7b0f40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.407+0000 7fd472e55740 1 --2- 172.21.15.84:0/825464588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5563ce37f070 0x5563ce736280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.407+0000 7fd44dffb640 0 client.16323 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:47:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.407+0000 7fd472e55740 1 --2- 172.21.15.84:0/825464588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5563ce35e390 0x5563ce735b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.407+0000 7fd472e55740 1 --2- 172.21.15.84:0/825464588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5563ce3561b0 0x5563ce73a690 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.407+0000 7fd472e55740 1 -- 172.21.15.84:0/825464588 >> 172.21.15.84:0/825464588 conn(0x5563ce373460 msgr2=0x5563ce7272f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.407+0000 7fd472e55740 1 -- 172.21.15.84:0/825464588 shutdown_connections 2024-09-21T03:47:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.407+0000 7fd472e55740 1 -- 172.21.15.84:0/825464588 wait complete. 2024-09-21T03:47:04.419 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.407+0000 7fd472e55740 20 client.16323 trim_cache size 0 max 16384 2024-09-21T03:47:04.420 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:47:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.408+0000 7fd46c8e1640 1 -- 172.21.15.84:0/349178265 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4540b6700 msgr2=0x7fd4540b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.408+0000 7fd46c8e1640 1 --2- 172.21.15.84:0/349178265 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4540b6700 0x7fd4540b8c10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd460006010 tx=0x7fd460009260 comp rx=0 tx=0).stop 2024-09-21T03:47:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.408+0000 7fd46c8e1640 1 -- 172.21.15.84:0/349178265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd468102f20 msgr2=0x7fd46819cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.408+0000 7fd46c8e1640 1 --2- 172.21.15.84:0/349178265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd468102f20 0x7fd46819cc80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd45000d770 tx=0x7fd45000dc30 comp rx=0 tx=0).stop 2024-09-21T03:47:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.408+0000 7fd46c8e1640 1 -- 172.21.15.84:0/349178265 shutdown_connections 2024-09-21T03:47:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.408+0000 7fd46c8e1640 1 --2- 172.21.15.84:0/349178265 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4540b6700 0x7fd4540b8c10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.408+0000 7fd46c8e1640 1 --2- 172.21.15.84:0/349178265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd468110180 0x7fd4681a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.408+0000 7fd46c8e1640 1 --2- 172.21.15.84:0/349178265 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd468102f20 0x7fd46819cc80 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.408+0000 7fd46c8e1640 1 --2- 172.21.15.84:0/349178265 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4681025d0 0x7fd46819c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.408+0000 7fd46c8e1640 1 -- 172.21.15.84:0/349178265 >> 172.21.15.84:0/349178265 conn(0x7fd468079730 msgr2=0x7fd468108c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:04.421 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.408+0000 7fd46c8e1640 1 -- 172.21.15.84:0/349178265 shutdown_connections 2024-09-21T03:47:04.422 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:04.408+0000 7fd46c8e1640 1 -- 172.21.15.84:0/349178265 wait complete. 2024-09-21T03:47:04.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:04 smithi084 ceph-mon[30941]: pgmap v462: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 50 KiB/s wr, 25 op/s 2024-09-21T03:47:04.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:04 smithi174 ceph-mon[34403]: pgmap v462: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 50 KiB/s wr, 25 op/s 2024-09-21T03:47:04.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:04 smithi172 ceph-mon[34821]: pgmap v462: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 50 KiB/s wr, 25 op/s 2024-09-21T03:47:05.202 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:47:05.447 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:47:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.966+0000 7f2280ffd640 1 -- 172.21.15.84:0/2542885092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f227c102a80 msgr2=0x7f227c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.966+0000 7f2280ffd640 1 --2- 172.21.15.84:0/2542885092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f227c102a80 0x7f227c102e90 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f226c009900 tx=0x7f226c02a410 comp rx=0 tx=0).stop 2024-09-21T03:47:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.967+0000 7f2280ffd640 1 -- 172.21.15.84:0/2542885092 shutdown_connections 2024-09-21T03:47:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.967+0000 7f2280ffd640 1 --2- 172.21.15.84:0/2542885092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f227c108d10 0x7f227c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.967+0000 7f2280ffd640 1 --2- 172.21.15.84:0/2542885092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f227c1083c0 0x7f227c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.967+0000 7f2280ffd640 1 --2- 172.21.15.84:0/2542885092 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f227c102a80 0x7f227c102e90 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.967+0000 7f2280ffd640 1 -- 172.21.15.84:0/2542885092 >> 172.21.15.84:0/2542885092 conn(0x7f227c079740 msgr2=0x7f227c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.967+0000 7f2280ffd640 1 -- 172.21.15.84:0/2542885092 shutdown_connections 2024-09-21T03:47:05.979 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.967+0000 7f2280ffd640 1 -- 172.21.15.84:0/2542885092 wait complete. 2024-09-21T03:47:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.967+0000 7f2280ffd640 1 Processor -- start 2024-09-21T03:47:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.968+0000 7f2280ffd640 1 -- start start 2024-09-21T03:47:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.968+0000 7f2280ffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f227c102a80 0x7f227c19b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.968+0000 7f2280ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f227c1083c0 0x7f227c19b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.968+0000 7f2280ffd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f227c108d10 0x7f227c19bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.968+0000 7f2280ffd640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f227c112a30 con 0x7f227c1083c0 2024-09-21T03:47:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.968+0000 7f2280ffd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f227c1128b0 con 0x7f227c108d10 2024-09-21T03:47:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.968+0000 7f2280ffd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f227c112bb0 con 0x7f227c102a80 2024-09-21T03:47:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.968+0000 7f2279d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f227c1083c0 0x7f227c19b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.968+0000 7f2279d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f227c1083c0 0x7f227c19b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53794/0 (socket says 172.21.15.84:53794) 2024-09-21T03:47:05.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.968+0000 7f2279d9b640 1 -- 172.21.15.84:0/4201271415 learned_addr learned my addr 172.21.15.84:0/4201271415 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.968+0000 7f227a59c640 1 --2- 172.21.15.84:0/4201271415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f227c102a80 0x7f227c19b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.968+0000 7f227ad9d640 1 --2- 172.21.15.84:0/4201271415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f227c108d10 0x7f227c19bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.968+0000 7f2279d9b640 1 -- 172.21.15.84:0/4201271415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f227c102a80 msgr2=0x7f227c19b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.968+0000 7f2279d9b640 1 --2- 172.21.15.84:0/4201271415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f227c102a80 0x7f227c19b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.968+0000 7f2279d9b640 1 -- 172.21.15.84:0/4201271415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f227c108d10 msgr2=0x7f227c19bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.968+0000 7f2279d9b640 1 --2- 172.21.15.84:0/4201271415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f227c108d10 0x7f227c19bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.968+0000 7f2279d9b640 1 -- 172.21.15.84:0/4201271415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227c1a6530 con 0x7f227c1083c0 2024-09-21T03:47:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.968+0000 7f2279d9b640 1 --2- 172.21.15.84:0/4201271415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f227c1083c0 0x7f227c19b840 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f227000c970 tx=0x7f227000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.968+0000 7f226b7fe640 1 -- 172.21.15.84:0/4201271415 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2270014070 con 0x7f227c1083c0 2024-09-21T03:47:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.969+0000 7f2280ffd640 1 -- 172.21.15.84:0/4201271415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f227c1a6820 con 0x7f227c1083c0 2024-09-21T03:47:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.969+0000 7f226b7fe640 1 -- 172.21.15.84:0/4201271415 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2270004440 con 0x7f227c1083c0 2024-09-21T03:47:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.969+0000 7f226b7fe640 1 -- 172.21.15.84:0/4201271415 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2270003e50 con 0x7f227c1083c0 2024-09-21T03:47:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.969+0000 7f2280ffd640 1 -- 172.21.15.84:0/4201271415 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f227c1a6e30 con 0x7f227c1083c0 2024-09-21T03:47:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.971+0000 7f2287571740 1 Processor -- start 2024-09-21T03:47:05.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.971+0000 7f2287571740 1 -- start start 2024-09-21T03:47:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.971+0000 7f2287571740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1ec070 0x558d9a5932c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.971+0000 7f2287571740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d9a1c31b0 0x558d9a593800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.971+0000 7f2287571740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1cb390 0x558d9a593d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.972+0000 7f2287571740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558d9a509ea0 con 0x558d9a1ec070 2024-09-21T03:47:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.972+0000 7f2287571740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558d9a4f92d0 con 0x558d9a1cb390 2024-09-21T03:47:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.972+0000 7f2287571740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558d9a4fd0e0 con 0x558d9a1c31b0 2024-09-21T03:47:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.972+0000 7f226b7fe640 1 -- 172.21.15.84:0/4201271415 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f2270017070 con 0x7f227c1083c0 2024-09-21T03:47:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.972+0000 7f227ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1ec070 0x558d9a5932c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.972+0000 7f227ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1ec070 0x558d9a5932c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53796/0 (socket says 172.21.15.84:53796) 2024-09-21T03:47:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.972+0000 7f227ad9d640 1 -- 172.21.15.84:0/3596874889 learned_addr learned my addr 172.21.15.84:0/3596874889 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.972+0000 7f227a59c640 1 --2- 172.21.15.84:0/3596874889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d9a1c31b0 0x558d9a593800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.972+0000 7f2279d9b640 1 --2- 172.21.15.84:0/3596874889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1cb390 0x558d9a593d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.972+0000 7f227ad9d640 1 -- 172.21.15.84:0/3596874889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d9a1c31b0 msgr2=0x558d9a593800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:05.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.972+0000 7f227ad9d640 1 --2- 172.21.15.84:0/3596874889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d9a1c31b0 0x558d9a593800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.972+0000 7f227ad9d640 1 -- 172.21.15.84:0/3596874889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1cb390 msgr2=0x558d9a593d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:05.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.972+0000 7f227ad9d640 1 --2- 172.21.15.84:0/3596874889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1cb390 0x558d9a593d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.972+0000 7f227ad9d640 1 -- 172.21.15.84:0/3596874889 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d9a257650 con 0x558d9a1ec070 2024-09-21T03:47:05.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.972+0000 7f2279d9b640 1 --2- 172.21.15.84:0/3596874889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1cb390 0x558d9a593d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:47:05.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.972+0000 7f227ad9d640 1 --2- 172.21.15.84:0/3596874889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1ec070 0x558d9a5932c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f2274009f20 tx=0x7f227400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4dab0e7afc0a1c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:05.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.972+0000 7f2268ff9640 1 -- 172.21.15.84:0/3596874889 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227401a070 con 0x558d9a1ec070 2024-09-21T03:47:05.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.972+0000 7f2268ff9640 1 -- 172.21.15.84:0/3596874889 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22740158c0 con 0x558d9a1ec070 2024-09-21T03:47:05.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.973+0000 7f2268ff9640 1 -- 172.21.15.84:0/3596874889 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227400a820 con 0x558d9a1ec070 2024-09-21T03:47:05.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.973+0000 7f226b7fe640 1 --2- 172.21.15.84:0/4201271415 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f22640b6820 0x7f22640b8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.973+0000 7f227a59c640 1 --2- 172.21.15.84:0/4201271415 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f22640b6820 0x7f22640b8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:05.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.973+0000 7f226b7fe640 1 -- 172.21.15.84:0/4201271415 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f22700e7290 con 0x7f227c1083c0 2024-09-21T03:47:05.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.973+0000 7f2287571740 1 -- 172.21.15.84:0/3596874889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1ec070 msgr2=0x558d9a5932c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:05.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.973+0000 7f2287571740 1 --2- 172.21.15.84:0/3596874889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1ec070 0x558d9a5932c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f2274009f20 tx=0x7f227400c8b0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.973+0000 7f227a59c640 1 --2- 172.21.15.84:0/4201271415 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f22640b6820 0x7f22640b8d30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f226c006010 tx=0x7f226c009640 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:05.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.973+0000 7f2287571740 1 -- 172.21.15.84:0/3596874889 shutdown_connections 2024-09-21T03:47:05.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.973+0000 7f2287571740 1 --2- 172.21.15.84:0/3596874889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1cb390 0x558d9a593d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.973+0000 7f2287571740 1 --2- 172.21.15.84:0/3596874889 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d9a1c31b0 0x558d9a593800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.973+0000 7f2287571740 1 --2- 172.21.15.84:0/3596874889 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1ec070 0x558d9a5932c0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.973+0000 7f2287571740 1 -- 172.21.15.84:0/3596874889 >> 172.21.15.84:0/3596874889 conn(0x558d9a1e0460 msgr2=0x558d9a5911b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:05.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.974+0000 7f2287571740 1 -- 172.21.15.84:0/3596874889 shutdown_connections 2024-09-21T03:47:05.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.974+0000 7f2287571740 1 -- 172.21.15.84:0/3596874889 wait complete. 2024-09-21T03:47:05.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.974+0000 7f2287571740 1 -- start start 2024-09-21T03:47:05.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.974+0000 7f2287571740 1 Processor -- start 2024-09-21T03:47:05.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.974+0000 7f2287571740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1c31b0 0x558d9a5a2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.974+0000 7f2287571740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d9a1cb390 0x558d9a5a3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.974+0000 7f2287571740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1ec070 0x558d9a5a3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.974+0000 7f2287571740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558d9a35a700 con 0x558d9a1ec070 2024-09-21T03:47:05.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.974+0000 7f2287571740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558d9a494160 con 0x558d9a1c31b0 2024-09-21T03:47:05.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.974+0000 7f2287571740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558d9a5a5e00 con 0x558d9a1cb390 2024-09-21T03:47:05.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.974+0000 7f2287571740 10 client.0 _ll_register_callbacks cb 0x558d9a4ad9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:05.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.974+0000 7f227ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1ec070 0x558d9a5a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:05.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.975+0000 7f227ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1ec070 0x558d9a5a3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53802/0 (socket says 172.21.15.84:53802) 2024-09-21T03:47:05.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.975+0000 7f227ad9d640 1 -- 172.21.15.84:0/2859226518 learned_addr learned my addr 172.21.15.84:0/2859226518 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:05.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.975+0000 7f2279d9b640 1 --2- 172.21.15.84:0/2859226518 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d9a1cb390 0x558d9a5a3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:05.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.975+0000 7f227a59c640 1 --2- 172.21.15.84:0/2859226518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1c31b0 0x558d9a5a2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:05.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.975+0000 7f227ad9d640 1 -- 172.21.15.84:0/2859226518 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d9a1cb390 msgr2=0x558d9a5a3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:05.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.975+0000 7f227ad9d640 1 --2- 172.21.15.84:0/2859226518 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d9a1cb390 0x558d9a5a3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.975+0000 7f227ad9d640 1 -- 172.21.15.84:0/2859226518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1c31b0 msgr2=0x558d9a5a2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:05.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.975+0000 7f227ad9d640 1 --2- 172.21.15.84:0/2859226518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1c31b0 0x558d9a5a2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.975+0000 7f227ad9d640 1 -- 172.21.15.84:0/2859226518 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d9a4c1c90 con 0x558d9a1ec070 2024-09-21T03:47:05.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.975+0000 7f227ad9d640 1 --2- 172.21.15.84:0/2859226518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1ec070 0x558d9a5a3800 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f227400a440 tx=0x7f2274015ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a4b6704cf9b9cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:05.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.975+0000 7f2261ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:05.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.975+0000 7f2261ffb640 1 -- 172.21.15.84:0/2859226518 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227401a040 con 0x558d9a1ec070 2024-09-21T03:47:05.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.975+0000 7f2261ffb640 1 -- 172.21.15.84:0/2859226518 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f227400a5a0 con 0x558d9a1ec070 2024-09-21T03:47:05.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.975+0000 7f2287571740 1 -- 172.21.15.84:0/2859226518 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22740158c0 con 0x558d9a1ec070 2024-09-21T03:47:05.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.975+0000 7f2261ffb640 1 -- 172.21.15.84:0/2859226518 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2274015e10 con 0x558d9a1ec070 2024-09-21T03:47:05.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.975+0000 7f2287571740 10 client.16335 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:05.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.975+0000 7f2287571740 1 -- 172.21.15.84:0/2859226518 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558d9a5b1a50 con 0x558d9a1ec070 2024-09-21T03:47:05.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.976+0000 7f2261ffb640 1 -- 172.21.15.84:0/2859226518 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22740158c0 con 0x558d9a1ec070 2024-09-21T03:47:05.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.976+0000 7f2261ffb640 1 -- 172.21.15.84:0/2859226518 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f227401d030 con 0x558d9a1ec070 2024-09-21T03:47:05.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.976+0000 7f2287571740 10 client.16335 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:05.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.976+0000 7f2287571740 10 client.16335 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:47:05.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.976+0000 7f2287571740 20 client.16335 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:05.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.976+0000 7f2287571740 1 --2- 172.21.15.84:0/2859226518 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x558d9a1aa9f0 0x558d9a5b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.976+0000 7f2287571740 4 client.16335 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:47:05.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.976+0000 7f2287571740 1 -- 172.21.15.84:0/2859226518 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d9a50bdf0 con 0x558d9a1aa9f0 2024-09-21T03:47:05.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.976+0000 7f227a59c640 1 --2- 172.21.15.84:0/2859226518 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x558d9a1aa9f0 0x558d9a5b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:05.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.977+0000 7f2261ffb640 10 client.16335 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:47:05.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.977+0000 7f227a59c640 1 --2- 172.21.15.84:0/2859226518 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x558d9a1aa9f0 0x558d9a5b4e60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=559ac0e86f741b1d server_cookie=8bd180589f3ebe0b in_seq=0 out_seq=0 2024-09-21T03:47:05.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.977+0000 7f2261ffb640 1 -- 172.21.15.84:0/2859226518 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558d9a50bdf0 con 0x558d9a1aa9f0 2024-09-21T03:47:05.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.977+0000 7f2261ffb640 10 client.16335 handle_command_reply: tid=0 2024-09-21T03:47:05.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.978+0000 7f2287571740 1 client.16335 shutdown 2024-09-21T03:47:05.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.978+0000 7f2287571740 1 -- 172.21.15.84:0/2859226518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1ec070 msgr2=0x558d9a5a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:05.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.978+0000 7f2287571740 1 --2- 172.21.15.84:0/2859226518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1ec070 0x558d9a5a3800 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f227400a440 tx=0x7f2274015ca0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.978+0000 7f2287571740 1 -- 172.21.15.84:0/2859226518 shutdown_connections 2024-09-21T03:47:05.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.978+0000 7f2287571740 1 --2- 172.21.15.84:0/2859226518 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x558d9a1aa9f0 0x558d9a5b4e60 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.978+0000 7f2287571740 1 --2- 172.21.15.84:0/2859226518 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1ec070 0x558d9a5a3800 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.978+0000 7f2287571740 1 --2- 172.21.15.84:0/2859226518 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d9a1cb390 0x558d9a5a3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.978+0000 7f2287571740 1 --2- 172.21.15.84:0/2859226518 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1c31b0 0x558d9a5a2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.978+0000 7f2287571740 1 -- 172.21.15.84:0/2859226518 >> 172.21.15.84:0/2859226518 conn(0x558d9a1e0460 msgr2=0x558d9a594cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:05.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.978+0000 7f2261ffb640 0 client.16335 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:47:05.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.978+0000 7f2287571740 1 -- 172.21.15.84:0/2859226518 shutdown_connections 2024-09-21T03:47:05.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.978+0000 7f2287571740 1 -- 172.21.15.84:0/2859226518 wait complete. 2024-09-21T03:47:05.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.978+0000 7f2287571740 20 client.16335 trim_cache size 0 max 16384 2024-09-21T03:47:05.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.991+0000 7f2287571740 1 Processor -- start 2024-09-21T03:47:05.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.991+0000 7f2287571740 1 -- start start 2024-09-21T03:47:05.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.991+0000 7f2287571740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d9a1e0460 0x558d9a5a4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.991+0000 7f2287571740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1c31b0 0x558d9a59ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.991+0000 7f2287571740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1cb390 0x558d9a5a0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.991+0000 7f2287571740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f227c1afd30 con 0x558d9a1cb390 2024-09-21T03:47:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.991+0000 7f2287571740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f227c1ad600 con 0x558d9a1c31b0 2024-09-21T03:47:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.991+0000 7f2287571740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f227c1ab470 con 0x558d9a1e0460 2024-09-21T03:47:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.991+0000 7f227ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1cb390 0x558d9a5a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.991+0000 7f227ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1cb390 0x558d9a5a0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53816/0 (socket says 172.21.15.84:53816) 2024-09-21T03:47:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.991+0000 7f227ad9d640 1 -- 172.21.15.84:0/2351831769 learned_addr learned my addr 172.21.15.84:0/2351831769 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.992+0000 7f2279d9b640 1 --2- 172.21.15.84:0/2351831769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1c31b0 0x558d9a59ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.992+0000 7f227a59c640 1 --2- 172.21.15.84:0/2351831769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d9a1e0460 0x558d9a5a4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.992+0000 7f227ad9d640 1 -- 172.21.15.84:0/2351831769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d9a1e0460 msgr2=0x558d9a5a4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.992+0000 7f227ad9d640 1 --2- 172.21.15.84:0/2351831769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d9a1e0460 0x558d9a5a4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.992+0000 7f227ad9d640 1 -- 172.21.15.84:0/2351831769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1c31b0 msgr2=0x558d9a59ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:05.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.992+0000 7f227ad9d640 1 --2- 172.21.15.84:0/2351831769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1c31b0 0x558d9a59ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.992+0000 7f227ad9d640 1 -- 172.21.15.84:0/2351831769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d9a5957e0 con 0x558d9a1cb390 2024-09-21T03:47:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.992+0000 7f227ad9d640 1 --2- 172.21.15.84:0/2351831769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1cb390 0x558d9a5a0470 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f2274015830 tx=0x7f2274009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6545aaadeca7ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.992+0000 7f2263fff640 1 -- 172.21.15.84:0/2351831769 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2274020440 con 0x558d9a1cb390 2024-09-21T03:47:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.992+0000 7f2263fff640 1 -- 172.21.15.84:0/2351831769 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2274025070 con 0x558d9a1cb390 2024-09-21T03:47:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.992+0000 7f2263fff640 1 -- 172.21.15.84:0/2351831769 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227400ab80 con 0x558d9a1cb390 2024-09-21T03:47:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.993+0000 7f2287571740 1 -- 172.21.15.84:0/2351831769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1cb390 msgr2=0x558d9a5a0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.993+0000 7f2287571740 1 --2- 172.21.15.84:0/2351831769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1cb390 0x558d9a5a0470 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f2274015830 tx=0x7f2274009710 comp rx=0 tx=0).stop 2024-09-21T03:47:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.993+0000 7f2287571740 1 -- 172.21.15.84:0/2351831769 shutdown_connections 2024-09-21T03:47:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.993+0000 7f2287571740 1 --2- 172.21.15.84:0/2351831769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1cb390 0x558d9a5a0470 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.993+0000 7f2287571740 1 --2- 172.21.15.84:0/2351831769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1c31b0 0x558d9a59ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.993+0000 7f2287571740 1 --2- 172.21.15.84:0/2351831769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d9a1e0460 0x558d9a5a4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.993+0000 7f2287571740 1 -- 172.21.15.84:0/2351831769 >> 172.21.15.84:0/2351831769 conn(0x558d9a58c390 msgr2=0x558d9a5a4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:05.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.993+0000 7f2287571740 1 -- 172.21.15.84:0/2351831769 shutdown_connections 2024-09-21T03:47:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.993+0000 7f2287571740 1 -- 172.21.15.84:0/2351831769 wait complete. 2024-09-21T03:47:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.993+0000 7f2287571740 1 -- start start 2024-09-21T03:47:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.993+0000 7f2287571740 1 Processor -- start 2024-09-21T03:47:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f2287571740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1c31b0 0x558d9a5b7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f2287571740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1cb390 0x558d9a5b8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f2287571740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d9a1e0460 0x558d9a617d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f2287571740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f227c1abac0 con 0x558d9a1c31b0 2024-09-21T03:47:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f2287571740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f227c1acf30 con 0x558d9a1cb390 2024-09-21T03:47:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f2287571740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f227c1ac190 con 0x558d9a1e0460 2024-09-21T03:47:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f2287571740 10 client.0 _ll_register_callbacks cb 0x7f2274018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f227a59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1c31b0 0x558d9a5b7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f227a59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1c31b0 0x558d9a5b7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53820/0 (socket says 172.21.15.84:53820) 2024-09-21T03:47:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f227a59c640 1 -- 172.21.15.84:0/541383673 learned_addr learned my addr 172.21.15.84:0/541383673 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:05.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f2279d9b640 1 --2- 172.21.15.84:0/541383673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1cb390 0x558d9a5b8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f227ad9d640 1 --2- 172.21.15.84:0/541383673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d9a1e0460 0x558d9a617d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f227a59c640 1 -- 172.21.15.84:0/541383673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d9a1e0460 msgr2=0x558d9a617d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f227a59c640 1 --2- 172.21.15.84:0/541383673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d9a1e0460 0x558d9a617d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f227a59c640 1 -- 172.21.15.84:0/541383673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1cb390 msgr2=0x558d9a5b8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f227a59c640 1 --2- 172.21.15.84:0/541383673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1cb390 0x558d9a5b8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f227a59c640 1 -- 172.21.15.84:0/541383673 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d9a618370 con 0x558d9a1c31b0 2024-09-21T03:47:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f2279d9b640 1 --2- 172.21.15.84:0/541383673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1cb390 0x558d9a5b8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:47:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f227a59c640 1 --2- 172.21.15.84:0/541383673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1c31b0 0x558d9a5b7fa0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f226c009230 tx=0x7f226c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73354e51947e167a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f2261ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f2261ffb640 1 -- 172.21.15.84:0/541383673 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c055020 con 0x558d9a1c31b0 2024-09-21T03:47:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f2261ffb640 1 -- 172.21.15.84:0/541383673 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f226c0314a0 con 0x558d9a1c31b0 2024-09-21T03:47:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.994+0000 7f2287571740 1 -- 172.21.15.84:0/541383673 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2274025070 con 0x558d9a1c31b0 2024-09-21T03:47:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.995+0000 7f2261ffb640 1 -- 172.21.15.84:0/541383673 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f226c060050 con 0x558d9a1c31b0 2024-09-21T03:47:06.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.995+0000 7f2287571740 10 client.16341 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:06.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.995+0000 7f2287571740 1 -- 172.21.15.84:0/541383673 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558d9a61f790 con 0x558d9a1c31b0 2024-09-21T03:47:06.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.995+0000 7f2261ffb640 1 -- 172.21.15.84:0/541383673 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2274025070 con 0x558d9a1c31b0 2024-09-21T03:47:06.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.995+0000 7f2261ffb640 1 -- 172.21.15.84:0/541383673 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f226c03c6b0 con 0x558d9a1c31b0 2024-09-21T03:47:06.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.995+0000 7f2287571740 10 client.16341 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:06.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.995+0000 7f2287571740 10 client.16341 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:47:06.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.995+0000 7f2287571740 20 client.16341 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:06.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.995+0000 7f2287571740 1 --2- 172.21.15.84:0/541383673 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x558d9a1ec070 0x558d9a621f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:06.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.995+0000 7f2287571740 4 client.16341 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:47:06.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.995+0000 7f2287571740 1 -- 172.21.15.84:0/541383673 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558d9a5078a0 con 0x558d9a1ec070 2024-09-21T03:47:06.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.995+0000 7f2279d9b640 1 --2- 172.21.15.84:0/541383673 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x558d9a1ec070 0x558d9a621f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:06.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.996+0000 7f2279d9b640 1 --2- 172.21.15.84:0/541383673 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x558d9a1ec070 0x558d9a621f80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4fb2c7c905eaf373 server_cookie=8f3e8d8b6a85ab4d in_seq=0 out_seq=0 2024-09-21T03:47:06.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.996+0000 7f2261ffb640 10 client.16341 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:47:06.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.996+0000 7f2261ffb640 1 -- 172.21.15.84:0/541383673 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558d9a5078a0 con 0x558d9a1ec070 2024-09-21T03:47:06.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.996+0000 7f2261ffb640 10 client.16341 handle_command_reply: tid=0 2024-09-21T03:47:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.996+0000 7f2287571740 1 client.16341 shutdown 2024-09-21T03:47:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.996+0000 7f2287571740 1 -- 172.21.15.84:0/541383673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1c31b0 msgr2=0x558d9a5b7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:06.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.996+0000 7f2287571740 1 --2- 172.21.15.84:0/541383673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1c31b0 0x558d9a5b7fa0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f226c009230 tx=0x7f226c009260 comp rx=0 tx=0).stop 2024-09-21T03:47:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.996+0000 7f2287571740 1 -- 172.21.15.84:0/541383673 shutdown_connections 2024-09-21T03:47:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.996+0000 7f2287571740 1 --2- 172.21.15.84:0/541383673 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x558d9a1ec070 0x558d9a621f80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.996+0000 7f2287571740 1 --2- 172.21.15.84:0/541383673 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558d9a1e0460 0x558d9a617d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.996+0000 7f2261ffb640 0 client.16341 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:47:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.996+0000 7f2287571740 1 --2- 172.21.15.84:0/541383673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d9a1cb390 0x558d9a5b8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.996+0000 7f2287571740 1 --2- 172.21.15.84:0/541383673 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558d9a1c31b0 0x558d9a5b7fa0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.996+0000 7f2287571740 1 -- 172.21.15.84:0/541383673 >> 172.21.15.84:0/541383673 conn(0x558d9a58c390 msgr2=0x558d9a5a40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.996+0000 7f2287571740 1 -- 172.21.15.84:0/541383673 shutdown_connections 2024-09-21T03:47:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.996+0000 7f2287571740 1 -- 172.21.15.84:0/541383673 wait complete. 2024-09-21T03:47:06.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.996+0000 7f2287571740 20 client.16341 trim_cache size 0 max 16384 2024-09-21T03:47:06.003 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:47:06.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.997+0000 7f2280ffd640 1 -- 172.21.15.84:0/4201271415 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f22640b6820 msgr2=0x7f22640b8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:06.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.997+0000 7f2280ffd640 1 --2- 172.21.15.84:0/4201271415 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f22640b6820 0x7f22640b8d30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f226c006010 tx=0x7f226c009640 comp rx=0 tx=0).stop 2024-09-21T03:47:06.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.997+0000 7f2280ffd640 1 -- 172.21.15.84:0/4201271415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f227c1083c0 msgr2=0x7f227c19b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:06.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.997+0000 7f2280ffd640 1 --2- 172.21.15.84:0/4201271415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f227c1083c0 0x7f227c19b840 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f227000c970 tx=0x7f227000ce30 comp rx=0 tx=0).stop 2024-09-21T03:47:06.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.997+0000 7f2280ffd640 1 -- 172.21.15.84:0/4201271415 shutdown_connections 2024-09-21T03:47:06.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.997+0000 7f2280ffd640 1 --2- 172.21.15.84:0/4201271415 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f22640b6820 0x7f22640b8d30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:06.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.997+0000 7f2280ffd640 1 --2- 172.21.15.84:0/4201271415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f227c108d10 0x7f227c19bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:06.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.997+0000 7f2280ffd640 1 --2- 172.21.15.84:0/4201271415 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f227c1083c0 0x7f227c19b840 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:06.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.997+0000 7f2280ffd640 1 --2- 172.21.15.84:0/4201271415 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f227c102a80 0x7f227c19b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:06.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.997+0000 7f2280ffd640 1 -- 172.21.15.84:0/4201271415 >> 172.21.15.84:0/4201271415 conn(0x7f227c079740 msgr2=0x7f227c101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:06.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.997+0000 7f2280ffd640 1 -- 172.21.15.84:0/4201271415 shutdown_connections 2024-09-21T03:47:06.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:05.997+0000 7f2280ffd640 1 -- 172.21.15.84:0/4201271415 wait complete. 2024-09-21T03:47:06.855 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:47:07.101 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:47:07.528 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:07 smithi084 ceph-mon[30941]: pgmap v463: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 50 KiB/s wr, 24 op/s 2024-09-21T03:47:07.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.617+0000 7fdddc3a3640 1 -- 172.21.15.84:0/529961292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd4102a60 msgr2=0x7fddd4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:07.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.617+0000 7fdddc3a3640 1 --2- 172.21.15.84:0/529961292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd4102a60 0x7fddd4102e70 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009900 tx=0x7fddcc02a410 comp rx=0 tx=0).stop 2024-09-21T03:47:07.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.618+0000 7fdddc3a3640 1 -- 172.21.15.84:0/529961292 shutdown_connections 2024-09-21T03:47:07.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.618+0000 7fdddc3a3640 1 --2- 172.21.15.84:0/529961292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddd4108cf0 0x7fddd410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.618+0000 7fdddc3a3640 1 --2- 172.21.15.84:0/529961292 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddd41083a0 0x7fddd41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.618+0000 7fdddc3a3640 1 --2- 172.21.15.84:0/529961292 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd4102a60 0x7fddd4102e70 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.618+0000 7fdddc3a3640 1 -- 172.21.15.84:0/529961292 >> 172.21.15.84:0/529961292 conn(0x7fddd4079730 msgr2=0x7fddd4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:07.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.618+0000 7fdddc3a3640 1 -- 172.21.15.84:0/529961292 shutdown_connections 2024-09-21T03:47:07.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.618+0000 7fdddc3a3640 1 -- 172.21.15.84:0/529961292 wait complete. 2024-09-21T03:47:07.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.618+0000 7fdddc3a3640 1 Processor -- start 2024-09-21T03:47:07.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.618+0000 7fdddc3a3640 1 -- start start 2024-09-21T03:47:07.630 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fdddc3a3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddd4102a60 0x7fddd419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fdddc3a3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddd41083a0 0x7fddd419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fdddc3a3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd4108cf0 0x7fddd419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fdddc3a3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fddd4112960 con 0x7fddd4108cf0 2024-09-21T03:47:07.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fdddc3a3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41127e0 con 0x7fddd4102a60 2024-09-21T03:47:07.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fdddc3a3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fddd4112ae0 con 0x7fddd41083a0 2024-09-21T03:47:07.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fddda940640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd4108cf0 0x7fddd419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fddda940640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd4108cf0 0x7fddd419fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53836/0 (socket says 172.21.15.84:53836) 2024-09-21T03:47:07.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fddda940640 1 -- 172.21.15.84:0/3276501968 learned_addr learned my addr 172.21.15.84:0/3276501968 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:07.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fddda13f640 1 --2- 172.21.15.84:0/3276501968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddd4102a60 0x7fddd419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fddd993e640 1 --2- 172.21.15.84:0/3276501968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddd41083a0 0x7fddd419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fddda940640 1 -- 172.21.15.84:0/3276501968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddd41083a0 msgr2=0x7fddd419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:07.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fddda940640 1 --2- 172.21.15.84:0/3276501968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddd41083a0 0x7fddd419aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fddda940640 1 -- 172.21.15.84:0/3276501968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddd4102a60 msgr2=0x7fddd419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:07.631 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fddda940640 1 --2- 172.21.15.84:0/3276501968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddd4102a60 0x7fddd419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fddda940640 1 -- 172.21.15.84:0/3276501968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd41a03d0 con 0x7fddd4108cf0 2024-09-21T03:47:07.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fddda13f640 1 --2- 172.21.15.84:0/3276501968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddd4102a60 0x7fddd419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:47:07.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fddda940640 1 --2- 172.21.15.84:0/3276501968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd4108cf0 0x7fddd419fca0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fddc400c970 tx=0x7fddc400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:07.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fddd37fe640 1 -- 172.21.15.84:0/3276501968 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4007bb0 con 0x7fddd4108cf0 2024-09-21T03:47:07.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fddd37fe640 1 -- 172.21.15.84:0/3276501968 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddc4007d50 con 0x7fddd4108cf0 2024-09-21T03:47:07.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fdddc3a3640 1 -- 172.21.15.84:0/3276501968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd41a06c0 con 0x7fddd4108cf0 2024-09-21T03:47:07.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fddd37fe640 1 -- 172.21.15.84:0/3276501968 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4004e60 con 0x7fddd4108cf0 2024-09-21T03:47:07.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.619+0000 7fdddc3a3640 1 -- 172.21.15.84:0/3276501968 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd41a6e20 con 0x7fddd4108cf0 2024-09-21T03:47:07.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.622+0000 7fdde2917740 1 Processor -- start 2024-09-21T03:47:07.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.622+0000 7fddd37fe640 1 -- 172.21.15.84:0/3276501968 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fddc4005020 con 0x7fddd4108cf0 2024-09-21T03:47:07.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.622+0000 7fdde2917740 1 -- start start 2024-09-21T03:47:07.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.623+0000 7fdde2917740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560bb30d4070 0x560bb347b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.623+0000 7fdde2917740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bb30ab1b0 0x560bb347bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.632 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.623+0000 7fdde2917740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30b3390 0x560bb347c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.623+0000 7fdde2917740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560bb33f1ea0 con 0x560bb30b3390 2024-09-21T03:47:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.623+0000 7fdde2917740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560bb33e12d0 con 0x560bb30d4070 2024-09-21T03:47:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.623+0000 7fdde2917740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560bb33e50e0 con 0x560bb30ab1b0 2024-09-21T03:47:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.623+0000 7fddd993e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30b3390 0x560bb347c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.623+0000 7fddd993e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30b3390 0x560bb347c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53846/0 (socket says 172.21.15.84:53846) 2024-09-21T03:47:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.623+0000 7fddd993e640 1 -- 172.21.15.84:0/834379580 learned_addr learned my addr 172.21.15.84:0/834379580 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.623+0000 7fddd993e640 1 --2- 172.21.15.84:0/834379580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560bb30d4070 0x560bb347b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.623+0000 7fddda13f640 1 --2- 172.21.15.84:0/834379580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bb30ab1b0 0x560bb347bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.623+0000 7fddd993e640 1 -- 172.21.15.84:0/834379580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bb30ab1b0 msgr2=0x560bb347bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.623+0000 7fddd993e640 1 --2- 172.21.15.84:0/834379580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bb30ab1b0 0x560bb347bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.623+0000 7fddd993e640 1 -- 172.21.15.84:0/834379580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560bb30d4070 msgr2=0x560bb347b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.623+0000 7fddd993e640 1 --2- 172.21.15.84:0/834379580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560bb30d4070 0x560bb347b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.623+0000 7fddd37fe640 1 --2- 172.21.15.84:0/3276501968 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fddbc0b6680 0x7fddbc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.633 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.623+0000 7fddd993e640 1 -- 172.21.15.84:0/834379580 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bb313f650 con 0x560bb30b3390 2024-09-21T03:47:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.623+0000 7fddda940640 1 --2- 172.21.15.84:0/3276501968 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fddbc0b6680 0x7fddbc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.624+0000 7fddd993e640 1 --2- 172.21.15.84:0/834379580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30b3390 0x560bb347c120 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009f50 tx=0x7fddc8009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edcd1350ae45248 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.624+0000 7fddd37fe640 1 -- 172.21.15.84:0/3276501968 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fddc40e73e0 con 0x7fddd4108cf0 2024-09-21T03:47:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.624+0000 7fddd0d9a640 1 -- 172.21.15.84:0/834379580 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8019030 con 0x560bb30b3390 2024-09-21T03:47:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.624+0000 7fddd0d9a640 1 -- 172.21.15.84:0/834379580 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddc8013dd0 con 0x560bb30b3390 2024-09-21T03:47:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.624+0000 7fddd0d9a640 1 -- 172.21.15.84:0/834379580 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8005280 con 0x560bb30b3390 2024-09-21T03:47:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.625+0000 7fdde2917740 1 -- 172.21.15.84:0/834379580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30b3390 msgr2=0x560bb347c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.625+0000 7fddda940640 1 --2- 172.21.15.84:0/3276501968 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fddbc0b6680 0x7fddbc0b8b90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fddc40e4c60 tx=0x7fddc404af90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.625+0000 7fdde2917740 1 --2- 172.21.15.84:0/834379580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30b3390 0x560bb347c120 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009f50 tx=0x7fddc8009810 comp rx=0 tx=0).stop 2024-09-21T03:47:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.625+0000 7fdde2917740 1 -- 172.21.15.84:0/834379580 shutdown_connections 2024-09-21T03:47:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.625+0000 7fdde2917740 1 --2- 172.21.15.84:0/834379580 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30b3390 0x560bb347c120 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.634 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.625+0000 7fdde2917740 1 --2- 172.21.15.84:0/834379580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bb30ab1b0 0x560bb347bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.625+0000 7fdde2917740 1 --2- 172.21.15.84:0/834379580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560bb30d4070 0x560bb347b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.625+0000 7fdde2917740 1 -- 172.21.15.84:0/834379580 >> 172.21.15.84:0/834379580 conn(0x560bb30c8460 msgr2=0x560bb3479590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.625+0000 7fdde2917740 1 -- 172.21.15.84:0/834379580 shutdown_connections 2024-09-21T03:47:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.625+0000 7fdde2917740 1 -- 172.21.15.84:0/834379580 wait complete. 2024-09-21T03:47:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.625+0000 7fdde2917740 1 -- start start 2024-09-21T03:47:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.625+0000 7fdde2917740 1 Processor -- start 2024-09-21T03:47:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.626+0000 7fdde2917740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bb30ab1b0 0x560bb3486da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.626+0000 7fdde2917740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560bb30b3390 0x560bb34872e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.626+0000 7fdde2917740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 0x560bb3493170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.626+0000 7fdde2917740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560bb3242700 con 0x560bb30d4070 2024-09-21T03:47:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.626+0000 7fdde2917740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560bb337c160 con 0x560bb30b3390 2024-09-21T03:47:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.626+0000 7fdde2917740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560bb3489e80 con 0x560bb30ab1b0 2024-09-21T03:47:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.626+0000 7fdde2917740 10 client.0 _ll_register_callbacks cb 0x560bb33959e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.626+0000 7fddd993e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 0x560bb3493170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.635 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.626+0000 7fddd993e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 0x560bb3493170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53850/0 (socket says 172.21.15.84:53850) 2024-09-21T03:47:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.626+0000 7fddd993e640 1 -- 172.21.15.84:0/1338421727 learned_addr learned my addr 172.21.15.84:0/1338421727 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.626+0000 7fddd993e640 1 --2- 172.21.15.84:0/1338421727 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bb30ab1b0 0x560bb3486da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.626+0000 7fddda13f640 1 --2- 172.21.15.84:0/1338421727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560bb30b3390 0x560bb34872e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.626+0000 7fddd993e640 1 -- 172.21.15.84:0/1338421727 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bb30ab1b0 msgr2=0x560bb3486da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.626+0000 7fddd993e640 1 --2- 172.21.15.84:0/1338421727 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bb30ab1b0 0x560bb3486da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.626+0000 7fddd993e640 1 -- 172.21.15.84:0/1338421727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560bb30b3390 msgr2=0x560bb34872e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.626+0000 7fddd993e640 1 --2- 172.21.15.84:0/1338421727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560bb30b3390 0x560bb34872e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.626+0000 7fddd993e640 1 -- 172.21.15.84:0/1338421727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bb33a9c90 con 0x560bb30d4070 2024-09-21T03:47:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.626+0000 7fddd993e640 1 --2- 172.21.15.84:0/1338421727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 0x560bb3493170 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fddc8012010 tx=0x7fddc8013590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56316eb9b5f48ec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.626+0000 7fddb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.627+0000 7fddb9ffb640 1 -- 172.21.15.84:0/1338421727 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8019040 con 0x560bb30d4070 2024-09-21T03:47:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.627+0000 7fddb9ffb640 1 -- 172.21.15.84:0/1338421727 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fddc8004af0 con 0x560bb30d4070 2024-09-21T03:47:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.627+0000 7fdde2917740 1 -- 172.21.15.84:0/1338421727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddc8013dd0 con 0x560bb30d4070 2024-09-21T03:47:07.636 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.627+0000 7fddb9ffb640 1 -- 172.21.15.84:0/1338421727 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fddc8004cf0 con 0x560bb30d4070 2024-09-21T03:47:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.627+0000 7fdde2917740 10 client.16353 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.627+0000 7fdde2917740 1 -- 172.21.15.84:0/1338421727 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560bb3495bf0 con 0x560bb30d4070 2024-09-21T03:47:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.627+0000 7fddb9ffb640 1 -- 172.21.15.84:0/1338421727 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddc8013dd0 con 0x560bb30d4070 2024-09-21T03:47:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.627+0000 7fddb9ffb640 1 -- 172.21.15.84:0/1338421727 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fddc802b020 con 0x560bb30d4070 2024-09-21T03:47:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.627+0000 7fdde2917740 10 client.16353 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.627+0000 7fdde2917740 10 client.16353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:47:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.627+0000 7fdde2917740 20 client.16353 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.627+0000 7fdde2917740 1 --2- 172.21.15.84:0/1338421727 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560bb30929f0 0x560bb3498f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.627+0000 7fdde2917740 4 client.16353 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:47:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.627+0000 7fdde2917740 1 -- 172.21.15.84:0/1338421727 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560bb33f3df0 con 0x560bb30929f0 2024-09-21T03:47:07.637 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.628+0000 7fddda13f640 1 --2- 172.21.15.84:0/1338421727 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560bb30929f0 0x560bb3498f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.638 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.628+0000 7fddb9ffb640 10 client.16353 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.628+0000 7fddda13f640 1 --2- 172.21.15.84:0/1338421727 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560bb30929f0 0x560bb3498f50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3126229f38be14ac server_cookie=16a6aeecd7b23065 in_seq=0 out_seq=0 2024-09-21T03:47:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.629+0000 7fddb9ffb640 1 -- 172.21.15.84:0/1338421727 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560bb33f3df0 con 0x560bb30929f0 2024-09-21T03:47:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.629+0000 7fddb9ffb640 10 client.16353 handle_command_reply: tid=0 2024-09-21T03:47:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.629+0000 7fdde2917740 1 client.16353 shutdown 2024-09-21T03:47:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.629+0000 7fdde2917740 1 -- 172.21.15.84:0/1338421727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 msgr2=0x560bb3493170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.629+0000 7fdde2917740 1 --2- 172.21.15.84:0/1338421727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 0x560bb3493170 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fddc8012010 tx=0x7fddc8013590 comp rx=0 tx=0).stop 2024-09-21T03:47:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.629+0000 7fdde2917740 1 -- 172.21.15.84:0/1338421727 shutdown_connections 2024-09-21T03:47:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.629+0000 7fdde2917740 1 --2- 172.21.15.84:0/1338421727 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560bb30929f0 0x560bb3498f50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.629+0000 7fdde2917740 1 --2- 172.21.15.84:0/1338421727 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 0x560bb3493170 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.629+0000 7fddb9ffb640 0 client.16353 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.629+0000 7fdde2917740 1 --2- 172.21.15.84:0/1338421727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560bb30b3390 0x560bb34872e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.629+0000 7fdde2917740 1 --2- 172.21.15.84:0/1338421727 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bb30ab1b0 0x560bb3486da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.629+0000 7fdde2917740 1 -- 172.21.15.84:0/1338421727 >> 172.21.15.84:0/1338421727 conn(0x560bb30c8460 msgr2=0x560bb347e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:07.639 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.629+0000 7fdde2917740 1 -- 172.21.15.84:0/1338421727 shutdown_connections 2024-09-21T03:47:07.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.629+0000 7fdde2917740 1 -- 172.21.15.84:0/1338421727 wait complete. 2024-09-21T03:47:07.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.629+0000 7fdde2917740 20 client.16353 trim_cache size 0 max 16384 2024-09-21T03:47:07.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.642+0000 7fdde2917740 1 Processor -- start 2024-09-21T03:47:07.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.642+0000 7fdde2917740 1 -- start start 2024-09-21T03:47:07.645 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.643+0000 7fdde2917740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560bb30ab1b0 0x560bb347cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.643+0000 7fdde2917740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bb30b3390 0x560bb349c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.643+0000 7fdde2917740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 0x560bb349c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.643+0000 7fdde2917740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41b1e10 con 0x560bb30d4070 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.643+0000 7fdde2917740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41af6e0 con 0x560bb30ab1b0 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.643+0000 7fdde2917740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41ad530 con 0x560bb30b3390 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.643+0000 7fddd993e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 0x560bb349c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.643+0000 7fddd993e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 0x560bb349c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53866/0 (socket says 172.21.15.84:53866) 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.643+0000 7fddd993e640 1 -- 172.21.15.84:0/3664926907 learned_addr learned my addr 172.21.15.84:0/3664926907 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.643+0000 7fddd993e640 1 --2- 172.21.15.84:0/3664926907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560bb30ab1b0 0x560bb347cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.643+0000 7fddd993e640 1 -- 172.21.15.84:0/3664926907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bb30b3390 msgr2=0x560bb349c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.643+0000 7fddda13f640 1 --2- 172.21.15.84:0/3664926907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bb30b3390 0x560bb349c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.646 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.643+0000 7fddd993e640 1 --2- 172.21.15.84:0/3664926907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bb30b3390 0x560bb349c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.643+0000 7fddd993e640 1 -- 172.21.15.84:0/3664926907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560bb30ab1b0 msgr2=0x560bb347cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:07.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.643+0000 7fddd993e640 1 --2- 172.21.15.84:0/3664926907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560bb30ab1b0 0x560bb347cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.643+0000 7fddd993e640 1 -- 172.21.15.84:0/3664926907 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bb347d990 con 0x560bb30d4070 2024-09-21T03:47:07.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.643+0000 7fddd993e640 1 --2- 172.21.15.84:0/3664926907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 0x560bb349c8a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fddc8004a30 tx=0x7fddc80049a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9799a5b5f2386fa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:07.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.643+0000 7fddbbfff640 1 -- 172.21.15.84:0/3664926907 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8019040 con 0x560bb30d4070 2024-09-21T03:47:07.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.643+0000 7fddbbfff640 1 -- 172.21.15.84:0/3664926907 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddc803c020 con 0x560bb30d4070 2024-09-21T03:47:07.647 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.643+0000 7fddbbfff640 1 -- 172.21.15.84:0/3664926907 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8004ed0 con 0x560bb30d4070 2024-09-21T03:47:07.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.644+0000 7fdde2917740 1 -- 172.21.15.84:0/3664926907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 msgr2=0x560bb349c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:07.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.644+0000 7fdde2917740 1 --2- 172.21.15.84:0/3664926907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 0x560bb349c8a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fddc8004a30 tx=0x7fddc80049a0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.644+0000 7fdde2917740 1 -- 172.21.15.84:0/3664926907 shutdown_connections 2024-09-21T03:47:07.650 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.644+0000 7fdde2917740 1 --2- 172.21.15.84:0/3664926907 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 0x560bb349c8a0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.644+0000 7fdde2917740 1 --2- 172.21.15.84:0/3664926907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bb30b3390 0x560bb349c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.644+0000 7fdde2917740 1 --2- 172.21.15.84:0/3664926907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560bb30ab1b0 0x560bb347cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.644+0000 7fdde2917740 1 -- 172.21.15.84:0/3664926907 >> 172.21.15.84:0/3664926907 conn(0x560bb30c8460 msgr2=0x560bb347c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.644+0000 7fdde2917740 1 -- 172.21.15.84:0/3664926907 shutdown_connections 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.644+0000 7fdde2917740 1 -- 172.21.15.84:0/3664926907 wait complete. 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.645+0000 7fdde2917740 1 -- start start 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.645+0000 7fdde2917740 1 Processor -- start 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.645+0000 7fdde2917740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bb30ab1b0 0x560bb34fac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.645+0000 7fdde2917740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560bb30b3390 0x560bb34fb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.645+0000 7fdde2917740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 0x560bb3500210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.645+0000 7fdde2917740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41adba0 con 0x560bb30d4070 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.645+0000 7fdde2917740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41af010 con 0x560bb30b3390 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.645+0000 7fdde2917740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fddd41ae270 con 0x560bb30ab1b0 2024-09-21T03:47:07.651 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.645+0000 7fdde2917740 10 client.0 _ll_register_callbacks cb 0x7fddc8013620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.645+0000 7fddd993e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 0x560bb3500210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.645+0000 7fddd993e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 0x560bb3500210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53870/0 (socket says 172.21.15.84:53870) 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.645+0000 7fddd993e640 1 -- 172.21.15.84:0/253758716 learned_addr learned my addr 172.21.15.84:0/253758716 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.645+0000 7fddda13f640 1 --2- 172.21.15.84:0/253758716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560bb30b3390 0x560bb34fb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.646+0000 7fddd993e640 1 --2- 172.21.15.84:0/253758716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bb30ab1b0 0x560bb34fac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.646+0000 7fddd993e640 1 -- 172.21.15.84:0/253758716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bb30ab1b0 msgr2=0x560bb34fac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.646+0000 7fddd993e640 1 --2- 172.21.15.84:0/253758716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bb30ab1b0 0x560bb34fac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.646+0000 7fddd993e640 1 -- 172.21.15.84:0/253758716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560bb30b3390 msgr2=0x560bb34fb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.646+0000 7fddd993e640 1 --2- 172.21.15.84:0/253758716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560bb30b3390 0x560bb34fb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.646+0000 7fddd993e640 1 -- 172.21.15.84:0/253758716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bb3500880 con 0x560bb30d4070 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.646+0000 7fddd993e640 1 --2- 172.21.15.84:0/253758716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 0x560bb3500210 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fddc80135f0 tx=0x7fddc8004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ff39e32e68fa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.646+0000 7fddb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.646+0000 7fddb9ffb640 1 -- 172.21.15.84:0/253758716 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8019040 con 0x560bb30d4070 2024-09-21T03:47:07.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.646+0000 7fddb9ffb640 1 -- 172.21.15.84:0/253758716 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fddc8028040 con 0x560bb30d4070 2024-09-21T03:47:07.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.646+0000 7fdde2917740 1 -- 172.21.15.84:0/253758716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddc803c020 con 0x560bb30d4070 2024-09-21T03:47:07.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.646+0000 7fddb9ffb640 1 -- 172.21.15.84:0/253758716 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fddc8013dd0 con 0x560bb30d4070 2024-09-21T03:47:07.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.646+0000 7fdde2917740 10 client.16359 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:07.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.646+0000 7fdde2917740 1 -- 172.21.15.84:0/253758716 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560bb3507c70 con 0x560bb30d4070 2024-09-21T03:47:07.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.646+0000 7fddb9ffb640 1 -- 172.21.15.84:0/253758716 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddc803c020 con 0x560bb30d4070 2024-09-21T03:47:07.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.647+0000 7fddb9ffb640 1 -- 172.21.15.84:0/253758716 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fddc802b070 con 0x560bb30d4070 2024-09-21T03:47:07.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.647+0000 7fdde2917740 10 client.16359 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:07.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.647+0000 7fdde2917740 10 client.16359 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:47:07.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.647+0000 7fdde2917740 20 client.16359 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:07.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.647+0000 7fdde2917740 1 --2- 172.21.15.84:0/253758716 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560bb3067da0 0x560bb350a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:07.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.647+0000 7fdde2917740 4 client.16359 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:47:07.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.647+0000 7fdde2917740 1 -- 172.21.15.84:0/253758716 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560bb33ef8a0 con 0x560bb3067da0 2024-09-21T03:47:07.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.647+0000 7fddda13f640 1 --2- 172.21.15.84:0/253758716 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560bb3067da0 0x560bb350a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:07.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.648+0000 7fddb9ffb640 10 client.16359 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.648+0000 7fddda13f640 1 --2- 172.21.15.84:0/253758716 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560bb3067da0 0x560bb350a340 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9ca4656b67aac82 server_cookie=ddb5dd6126de5698 in_seq=0 out_seq=0 2024-09-21T03:47:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.648+0000 7fddb9ffb640 1 -- 172.21.15.84:0/253758716 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560bb33ef8a0 con 0x560bb3067da0 2024-09-21T03:47:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.648+0000 7fddb9ffb640 10 client.16359 handle_command_reply: tid=0 2024-09-21T03:47:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.648+0000 7fdde2917740 1 client.16359 shutdown 2024-09-21T03:47:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.648+0000 7fdde2917740 1 -- 172.21.15.84:0/253758716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 msgr2=0x560bb3500210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.648+0000 7fdde2917740 1 --2- 172.21.15.84:0/253758716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 0x560bb3500210 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fddc80135f0 tx=0x7fddc8004c80 comp rx=0 tx=0).stop 2024-09-21T03:47:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.648+0000 7fdde2917740 1 -- 172.21.15.84:0/253758716 shutdown_connections 2024-09-21T03:47:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.648+0000 7fdde2917740 1 --2- 172.21.15.84:0/253758716 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560bb3067da0 0x560bb350a340 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.648+0000 7fdde2917740 1 --2- 172.21.15.84:0/253758716 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560bb30d4070 0x560bb3500210 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.648+0000 7fdde2917740 1 --2- 172.21.15.84:0/253758716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560bb30b3390 0x560bb34fb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.648+0000 7fdde2917740 1 --2- 172.21.15.84:0/253758716 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560bb30ab1b0 0x560bb34fac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.648+0000 7fdde2917740 1 -- 172.21.15.84:0/253758716 >> 172.21.15.84:0/253758716 conn(0x560bb30c8460 msgr2=0x560bb3488250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.648+0000 7fddb9ffb640 0 client.16359 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.648+0000 7fdde2917740 1 -- 172.21.15.84:0/253758716 shutdown_connections 2024-09-21T03:47:07.654 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.648+0000 7fdde2917740 1 -- 172.21.15.84:0/253758716 wait complete. 2024-09-21T03:47:07.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.648+0000 7fdde2917740 20 client.16359 trim_cache size 0 max 16384 2024-09-21T03:47:07.655 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:47:07.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.649+0000 7fdddc3a3640 1 -- 172.21.15.84:0/3276501968 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fddbc0b6680 msgr2=0x7fddbc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:07.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.649+0000 7fdddc3a3640 1 --2- 172.21.15.84:0/3276501968 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fddbc0b6680 0x7fddbc0b8b90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fddc40e4c60 tx=0x7fddc404af90 comp rx=0 tx=0).stop 2024-09-21T03:47:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.649+0000 7fdddc3a3640 1 -- 172.21.15.84:0/3276501968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd4108cf0 msgr2=0x7fddd419fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.649+0000 7fdddc3a3640 1 --2- 172.21.15.84:0/3276501968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd4108cf0 0x7fddd419fca0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fddc400c970 tx=0x7fddc400ce30 comp rx=0 tx=0).stop 2024-09-21T03:47:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.649+0000 7fdddc3a3640 1 -- 172.21.15.84:0/3276501968 shutdown_connections 2024-09-21T03:47:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.649+0000 7fdddc3a3640 1 --2- 172.21.15.84:0/3276501968 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fddbc0b6680 0x7fddbc0b8b90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.649+0000 7fdddc3a3640 1 --2- 172.21.15.84:0/3276501968 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fddd4108cf0 0x7fddd419fca0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.649+0000 7fdddc3a3640 1 --2- 172.21.15.84:0/3276501968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fddd41083a0 0x7fddd419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.649+0000 7fdddc3a3640 1 --2- 172.21.15.84:0/3276501968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddd4102a60 0x7fddd419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.649+0000 7fdddc3a3640 1 -- 172.21.15.84:0/3276501968 >> 172.21.15.84:0/3276501968 conn(0x7fddd4079730 msgr2=0x7fddd4101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.649+0000 7fdddc3a3640 1 -- 172.21.15.84:0/3276501968 shutdown_connections 2024-09-21T03:47:07.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:07.649+0000 7fdddc3a3640 1 -- 172.21.15.84:0/3276501968 wait complete. 2024-09-21T03:47:07.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:07 smithi174 ceph-mon[34403]: pgmap v463: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 50 KiB/s wr, 24 op/s 2024-09-21T03:47:07.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:07 smithi172 ceph-mon[34821]: pgmap v463: 97 pgs: 97 active+clean; 6.1 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 50 KiB/s wr, 24 op/s 2024-09-21T03:47:09.454 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:47:09.454 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:47:09.709 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:47:09.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:09 smithi084 ceph-mon[30941]: pgmap v464: 97 pgs: 97 active+clean; 6.3 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 65 KiB/s wr, 28 op/s 2024-09-21T03:47:09.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:09 smithi174 ceph-mon[34403]: pgmap v464: 97 pgs: 97 active+clean; 6.3 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 65 KiB/s wr, 28 op/s 2024-09-21T03:47:09.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:09 smithi172 ceph-mon[34821]: pgmap v464: 97 pgs: 97 active+clean; 6.3 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 65 KiB/s wr, 28 op/s 2024-09-21T03:47:10.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.244+0000 7f73fbf67640 1 -- 172.21.15.84:0/4180015157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73f4109df0 msgr2=0x7f73f4110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:10.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.244+0000 7f73fbf67640 1 --2- 172.21.15.84:0/4180015157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73f4109df0 0x7f73f4110620 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f73ec009ca0 tx=0x7f73ec02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.244+0000 7f73fbf67640 1 -- 172.21.15.84:0/4180015157 shutdown_connections 2024-09-21T03:47:10.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.244+0000 7f73fbf67640 1 --2- 172.21.15.84:0/4180015157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73f4109df0 0x7f73f4110620 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.244+0000 7f73fbf67640 1 --2- 172.21.15.84:0/4180015157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f41094a0 0x7f73f41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.244+0000 7f73fbf67640 1 --2- 172.21.15.84:0/4180015157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73f4103b60 0x7f73f4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.244+0000 7f73fbf67640 1 -- 172.21.15.84:0/4180015157 >> 172.21.15.84:0/4180015157 conn(0x7f73f407b850 msgr2=0x7f73f407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:10.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.245+0000 7f73fbf67640 1 -- 172.21.15.84:0/4180015157 shutdown_connections 2024-09-21T03:47:10.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.245+0000 7f73fbf67640 1 -- 172.21.15.84:0/4180015157 wait complete. 2024-09-21T03:47:10.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.245+0000 7f73fbf67640 1 Processor -- start 2024-09-21T03:47:10.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.245+0000 7f73fbf67640 1 -- start start 2024-09-21T03:47:10.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.246+0000 7f73fbf67640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73f4103b60 0x7f73f419c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:10.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.246+0000 7f73fbf67640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73f41094a0 0x7f73f419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:10.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.246+0000 7f73fbf67640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f4109df0 0x7f73f41a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:10.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.246+0000 7f73fbf67640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f73f4113ab0 con 0x7f73f41094a0 2024-09-21T03:47:10.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.246+0000 7f73fbf67640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f73f4113930 con 0x7f73f4103b60 2024-09-21T03:47:10.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.246+0000 7f73fbf67640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f73f4113c30 con 0x7f73f4109df0 2024-09-21T03:47:10.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.246+0000 7f73f9502640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73f41094a0 0x7f73f419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:10.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.246+0000 7f73f9502640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73f41094a0 0x7f73f419cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34306/0 (socket says 172.21.15.84:34306) 2024-09-21T03:47:10.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.246+0000 7f73f9502640 1 -- 172.21.15.84:0/2519962242 learned_addr learned my addr 172.21.15.84:0/2519962242 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:10.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.246+0000 7f73f9d03640 1 --2- 172.21.15.84:0/2519962242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73f4103b60 0x7f73f419c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:10.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.246+0000 7f73fa504640 1 --2- 172.21.15.84:0/2519962242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f4109df0 0x7f73f41a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:10.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.246+0000 7f73f9502640 1 -- 172.21.15.84:0/2519962242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f4109df0 msgr2=0x7f73f41a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:10.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.246+0000 7f73f9502640 1 --2- 172.21.15.84:0/2519962242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f4109df0 0x7f73f41a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.246+0000 7f73f9502640 1 -- 172.21.15.84:0/2519962242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73f4103b60 msgr2=0x7f73f419c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:10.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.246+0000 7f73f9502640 1 --2- 172.21.15.84:0/2519962242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73f4103b60 0x7f73f419c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.246+0000 7f73f9502640 1 -- 172.21.15.84:0/2519962242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f41a2450 con 0x7f73f41094a0 2024-09-21T03:47:10.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.246+0000 7f73fa504640 1 --2- 172.21.15.84:0/2519962242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f4109df0 0x7f73f41a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:47:10.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.246+0000 7f73f9502640 1 --2- 172.21.15.84:0/2519962242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73f41094a0 0x7f73f419cb40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f73e400c8c0 tx=0x7f73e400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:10.264 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.246+0000 7f73eaffd640 1 -- 172.21.15.84:0/2519962242 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e4007bb0 con 0x7f73f41094a0 2024-09-21T03:47:10.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.247+0000 7f73eaffd640 1 -- 172.21.15.84:0/2519962242 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73e4007d50 con 0x7f73f41094a0 2024-09-21T03:47:10.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.247+0000 7f73eaffd640 1 -- 172.21.15.84:0/2519962242 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e40187c0 con 0x7f73f41094a0 2024-09-21T03:47:10.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.247+0000 7f73fbf67640 1 -- 172.21.15.84:0/2519962242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73f41a2740 con 0x7f73f41094a0 2024-09-21T03:47:10.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.247+0000 7f73fbf67640 1 -- 172.21.15.84:0/2519962242 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73f41a8f60 con 0x7f73f41094a0 2024-09-21T03:47:10.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.249+0000 7f73eaffd640 1 -- 172.21.15.84:0/2519962242 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f73e400fa20 con 0x7f73f41094a0 2024-09-21T03:47:10.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.249+0000 7f74024db740 1 Processor -- start 2024-09-21T03:47:10.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.249+0000 7f74024db740 1 -- start start 2024-09-21T03:47:10.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.250+0000 7f74024db740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276f5350 0x55c327a9c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:10.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.250+0000 7f74024db740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276cc490 0x55c327a9c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:10.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.250+0000 7f74024db740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3276d4670 0x55c327a9ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:10.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.250+0000 7f74024db740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c327a12e60 con 0x55c3276f5350 2024-09-21T03:47:10.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.250+0000 7f74024db740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c327a02290 con 0x55c3276cc490 2024-09-21T03:47:10.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.250+0000 7f74024db740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c327a060a0 con 0x55c3276d4670 2024-09-21T03:47:10.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.250+0000 7f73fa504640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276f5350 0x55c327a9c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:10.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.250+0000 7f73fa504640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276f5350 0x55c327a9c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34318/0 (socket says 172.21.15.84:34318) 2024-09-21T03:47:10.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.250+0000 7f73fa504640 1 -- 172.21.15.84:0/3979795382 learned_addr learned my addr 172.21.15.84:0/3979795382 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:10.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.250+0000 7f73f9d03640 1 --2- 172.21.15.84:0/3979795382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276cc490 0x55c327a9c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:10.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.250+0000 7f73f9502640 1 --2- 172.21.15.84:0/3979795382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3276d4670 0x55c327a9ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:10.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.250+0000 7f73eaffd640 1 --2- 172.21.15.84:0/2519962242 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f73e00b6730 0x7f73e00b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:10.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.250+0000 7f73fa504640 1 -- 172.21.15.84:0/3979795382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3276d4670 msgr2=0x55c327a9ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:10.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.250+0000 7f73fa504640 1 --2- 172.21.15.84:0/3979795382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3276d4670 0x55c327a9ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.250+0000 7f73fa504640 1 -- 172.21.15.84:0/3979795382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276cc490 msgr2=0x55c327a9c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:10.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.250+0000 7f73fa504640 1 --2- 172.21.15.84:0/3979795382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276cc490 0x55c327a9c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.250+0000 7f73fa504640 1 -- 172.21.15.84:0/3979795382 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c327760930 con 0x55c3276f5350 2024-09-21T03:47:10.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.250+0000 7f73eaffd640 1 -- 172.21.15.84:0/2519962242 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f73e40e7790 con 0x7f73f41094a0 2024-09-21T03:47:10.267 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.250+0000 7f73fa504640 1 --2- 172.21.15.84:0/2519962242 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f73e00b6730 0x7f73e00b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:10.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.251+0000 7f73fa504640 1 --2- 172.21.15.84:0/3979795382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276f5350 0x55c327a9c430 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f73ec02f500 tx=0x7f73ec009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920ad53cc2423bfb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:10.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.251+0000 7f73dffff640 1 -- 172.21.15.84:0/3979795382 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec04c070 con 0x55c3276f5350 2024-09-21T03:47:10.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.251+0000 7f73dffff640 1 -- 172.21.15.84:0/3979795382 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73ec036070 con 0x55c3276f5350 2024-09-21T03:47:10.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.251+0000 7f73dffff640 1 -- 172.21.15.84:0/3979795382 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec02f8a0 con 0x55c3276f5350 2024-09-21T03:47:10.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.252+0000 7f74024db740 1 -- 172.21.15.84:0/3979795382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276f5350 msgr2=0x55c327a9c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:10.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.252+0000 7f73fa504640 1 --2- 172.21.15.84:0/2519962242 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f73e00b6730 0x7f73e00b8c40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f73ec049000 tx=0x7f73ec04a000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:10.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.252+0000 7f74024db740 1 --2- 172.21.15.84:0/3979795382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276f5350 0x55c327a9c430 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f73ec02f500 tx=0x7f73ec009a20 comp rx=0 tx=0).stop 2024-09-21T03:47:10.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.252+0000 7f74024db740 1 -- 172.21.15.84:0/3979795382 shutdown_connections 2024-09-21T03:47:10.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.252+0000 7f74024db740 1 --2- 172.21.15.84:0/3979795382 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3276d4670 0x55c327a9ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.252+0000 7f74024db740 1 --2- 172.21.15.84:0/3979795382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276cc490 0x55c327a9c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.252+0000 7f74024db740 1 --2- 172.21.15.84:0/3979795382 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276f5350 0x55c327a9c430 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.252+0000 7f74024db740 1 -- 172.21.15.84:0/3979795382 >> 172.21.15.84:0/3979795382 conn(0x55c3276e9740 msgr2=0x55c327a9a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:10.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.252+0000 7f74024db740 1 -- 172.21.15.84:0/3979795382 shutdown_connections 2024-09-21T03:47:10.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.252+0000 7f74024db740 1 -- 172.21.15.84:0/3979795382 wait complete. 2024-09-21T03:47:10.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.252+0000 7f74024db740 1 -- start start 2024-09-21T03:47:10.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.252+0000 7f74024db740 1 Processor -- start 2024-09-21T03:47:10.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.253+0000 7f74024db740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3276cc490 0x55c327aa80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:10.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.253+0000 7f74024db740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276d4670 0x55c327aa8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:10.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.253+0000 7f74024db740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276f5350 0x55c327ab3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:10.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.253+0000 7f74024db740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c327863890 con 0x55c3276d4670 2024-09-21T03:47:10.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.253+0000 7f74024db740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c32799cd40 con 0x55c3276f5350 2024-09-21T03:47:10.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.253+0000 7f74024db740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c327aaac10 con 0x55c3276cc490 2024-09-21T03:47:10.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.253+0000 7f73f9502640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276d4670 0x55c327aa8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:10.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.253+0000 7f74024db740 10 client.0 _ll_register_callbacks cb 0x55c327a00c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:10.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.253+0000 7f73f9502640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276d4670 0x55c327aa8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34330/0 (socket says 172.21.15.84:34330) 2024-09-21T03:47:10.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.253+0000 7f73f9502640 1 -- 172.21.15.84:0/1309047839 learned_addr learned my addr 172.21.15.84:0/1309047839 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:10.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.253+0000 7f73fa504640 1 --2- 172.21.15.84:0/1309047839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276f5350 0x55c327ab3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:10.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.253+0000 7f73f9d03640 1 --2- 172.21.15.84:0/1309047839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3276cc490 0x55c327aa80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:10.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.253+0000 7f73f9502640 1 -- 172.21.15.84:0/1309047839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3276cc490 msgr2=0x55c327aa80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:10.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.253+0000 7f73f9502640 1 --2- 172.21.15.84:0/1309047839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3276cc490 0x55c327aa80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.253+0000 7f73f9502640 1 -- 172.21.15.84:0/1309047839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276f5350 msgr2=0x55c327ab3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:10.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.253+0000 7f73f9502640 1 --2- 172.21.15.84:0/1309047839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276f5350 0x55c327ab3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.253+0000 7f73f9502640 1 -- 172.21.15.84:0/1309047839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c327ab4550 con 0x55c3276d4670 2024-09-21T03:47:10.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.253+0000 7f73f9d03640 1 --2- 172.21.15.84:0/1309047839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3276cc490 0x55c327aa80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:47:10.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.254+0000 7f73f9502640 1 --2- 172.21.15.84:0/1309047839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276d4670 0x55c327aa8610 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f73e40e4fc0 tx=0x7f73e40acfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c740580d87f427 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:10.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.254+0000 7f73dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:10.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.254+0000 7f73dd7fa640 1 -- 172.21.15.84:0/1309047839 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e40add60 con 0x55c3276d4670 2024-09-21T03:47:10.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.254+0000 7f73dd7fa640 1 -- 172.21.15.84:0/1309047839 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f73e40ac8c0 con 0x55c3276d4670 2024-09-21T03:47:10.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.254+0000 7f74024db740 1 -- 172.21.15.84:0/1309047839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73ec036070 con 0x55c3276d4670 2024-09-21T03:47:10.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.254+0000 7f73dd7fa640 1 -- 172.21.15.84:0/1309047839 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f73e40b2140 con 0x55c3276d4670 2024-09-21T03:47:10.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.254+0000 7f74024db740 10 client.16371 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:10.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.254+0000 7f74024db740 1 -- 172.21.15.84:0/1309047839 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c327ab6e60 con 0x55c3276d4670 2024-09-21T03:47:10.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.254+0000 7f73dd7fa640 1 -- 172.21.15.84:0/1309047839 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73ec036070 con 0x55c3276d4670 2024-09-21T03:47:10.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.254+0000 7f73dd7fa640 1 -- 172.21.15.84:0/1309047839 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f73e40ac330 con 0x55c3276d4670 2024-09-21T03:47:10.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.254+0000 7f74024db740 10 client.16371 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:10.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.254+0000 7f74024db740 10 client.16371 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:47:10.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.254+0000 7f74024db740 20 client.16371 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:10.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.254+0000 7f74024db740 1 --2- 172.21.15.84:0/1309047839 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c3276b3cd0 0x55c327aba350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:10.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.254+0000 7f74024db740 4 client.16371 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:47:10.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.254+0000 7f74024db740 1 -- 172.21.15.84:0/1309047839 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c327a14db0 con 0x55c3276b3cd0 2024-09-21T03:47:10.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.255+0000 7f73f9d03640 1 --2- 172.21.15.84:0/1309047839 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c3276b3cd0 0x55c327aba350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:10.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.255+0000 7f73dd7fa640 10 client.16371 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:10.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.255+0000 7f73f9d03640 1 --2- 172.21.15.84:0/1309047839 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c3276b3cd0 0x55c327aba350 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=480f0cf487fcf1b server_cookie=3bb59555ade8ed68 in_seq=0 out_seq=0 2024-09-21T03:47:10.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.256+0000 7f73dd7fa640 1 -- 172.21.15.84:0/1309047839 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c327a14db0 con 0x55c3276b3cd0 2024-09-21T03:47:10.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.256+0000 7f73dd7fa640 10 client.16371 handle_command_reply: tid=0 2024-09-21T03:47:10.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.256+0000 7f74024db740 1 client.16371 shutdown 2024-09-21T03:47:10.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.256+0000 7f74024db740 1 -- 172.21.15.84:0/1309047839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276d4670 msgr2=0x55c327aa8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:10.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.256+0000 7f74024db740 1 --2- 172.21.15.84:0/1309047839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276d4670 0x55c327aa8610 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f73e40e4fc0 tx=0x7f73e40acfb0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.256+0000 7f74024db740 1 -- 172.21.15.84:0/1309047839 shutdown_connections 2024-09-21T03:47:10.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.256+0000 7f74024db740 1 --2- 172.21.15.84:0/1309047839 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c3276b3cd0 0x55c327aba350 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.256+0000 7f74024db740 1 --2- 172.21.15.84:0/1309047839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276f5350 0x55c327ab3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.256+0000 7f73dd7fa640 0 client.16371 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:10.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.256+0000 7f74024db740 1 --2- 172.21.15.84:0/1309047839 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276d4670 0x55c327aa8610 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.256+0000 7f74024db740 1 --2- 172.21.15.84:0/1309047839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3276cc490 0x55c327aa80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.256+0000 7f74024db740 1 -- 172.21.15.84:0/1309047839 >> 172.21.15.84:0/1309047839 conn(0x55c3276e9740 msgr2=0x55c327a9f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:10.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.256+0000 7f74024db740 1 -- 172.21.15.84:0/1309047839 shutdown_connections 2024-09-21T03:47:10.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.256+0000 7f74024db740 1 -- 172.21.15.84:0/1309047839 wait complete. 2024-09-21T03:47:10.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.256+0000 7f74024db740 20 client.16371 trim_cache size 0 max 16384 2024-09-21T03:47:10.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.273+0000 7f74024db740 1 Processor -- start 2024-09-21T03:47:10.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.273+0000 7f74024db740 1 -- start start 2024-09-21T03:47:10.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.274+0000 7f74024db740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276b3cd0 0x55c327a9fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:10.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.274+0000 7f74024db740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3276cc490 0x55c327aa1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:10.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.274+0000 7f74024db740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276d4670 0x55c327aa1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:10.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.274+0000 7f74024db740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f73f41b3e50 con 0x55c3276b3cd0 2024-09-21T03:47:10.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.274+0000 7f74024db740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f73f41b1720 con 0x55c3276d4670 2024-09-21T03:47:10.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.274+0000 7f74024db740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f73f41af570 con 0x55c3276cc490 2024-09-21T03:47:10.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.274+0000 7f73f9d03640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276b3cd0 0x55c327a9fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:10.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.274+0000 7f73f9d03640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276b3cd0 0x55c327a9fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34338/0 (socket says 172.21.15.84:34338) 2024-09-21T03:47:10.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.274+0000 7f73f9d03640 1 -- 172.21.15.84:0/716052223 learned_addr learned my addr 172.21.15.84:0/716052223 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:10.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.274+0000 7f73fa504640 1 --2- 172.21.15.84:0/716052223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276d4670 0x55c327aa1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:10.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.274+0000 7f73f9d03640 1 -- 172.21.15.84:0/716052223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3276cc490 msgr2=0x55c327aa1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:10.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.274+0000 7f73f9d03640 1 --2- 172.21.15.84:0/716052223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3276cc490 0x55c327aa1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.274+0000 7f73f9d03640 1 -- 172.21.15.84:0/716052223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276d4670 msgr2=0x55c327aa1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:10.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.274+0000 7f73f9d03640 1 --2- 172.21.15.84:0/716052223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276d4670 0x55c327aa1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.274+0000 7f73f9d03640 1 -- 172.21.15.84:0/716052223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c327aa9190 con 0x55c3276b3cd0 2024-09-21T03:47:10.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.274+0000 7f73fa504640 1 --2- 172.21.15.84:0/716052223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276d4670 0x55c327aa1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:47:10.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.274+0000 7f73f9d03640 1 --2- 172.21.15.84:0/716052223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276b3cd0 0x55c327a9fc40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f73f0005e10 tx=0x7f73f000cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2126a3045abf54f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:10.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.274+0000 7f73df7fe640 1 -- 172.21.15.84:0/716052223 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f0003b20 con 0x55c3276b3cd0 2024-09-21T03:47:10.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.274+0000 7f73df7fe640 1 -- 172.21.15.84:0/716052223 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73f0003cc0 con 0x55c3276b3cd0 2024-09-21T03:47:10.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.274+0000 7f73df7fe640 1 -- 172.21.15.84:0/716052223 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f00106b0 con 0x55c3276b3cd0 2024-09-21T03:47:10.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.275+0000 7f74024db740 1 -- 172.21.15.84:0/716052223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276b3cd0 msgr2=0x55c327a9fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:10.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.275+0000 7f74024db740 1 --2- 172.21.15.84:0/716052223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276b3cd0 0x55c327a9fc40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f73f0005e10 tx=0x7f73f000cd00 comp rx=0 tx=0).stop 2024-09-21T03:47:10.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.275+0000 7f74024db740 1 -- 172.21.15.84:0/716052223 shutdown_connections 2024-09-21T03:47:10.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.275+0000 7f74024db740 1 --2- 172.21.15.84:0/716052223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276d4670 0x55c327aa1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.275+0000 7f74024db740 1 --2- 172.21.15.84:0/716052223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3276cc490 0x55c327aa1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.275+0000 7f74024db740 1 --2- 172.21.15.84:0/716052223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276b3cd0 0x55c327a9fc40 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.275+0000 7f74024db740 1 -- 172.21.15.84:0/716052223 >> 172.21.15.84:0/716052223 conn(0x55c3276e9740 msgr2=0x55c327a9f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:10.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.275+0000 7f74024db740 1 -- 172.21.15.84:0/716052223 shutdown_connections 2024-09-21T03:47:10.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.275+0000 7f74024db740 1 -- 172.21.15.84:0/716052223 wait complete. 2024-09-21T03:47:10.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.276+0000 7f74024db740 1 -- start start 2024-09-21T03:47:10.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.276+0000 7f74024db740 1 Processor -- start 2024-09-21T03:47:10.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.276+0000 7f74024db740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276b3cd0 0x55c327ab0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:10.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.276+0000 7f74024db740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276cc490 0x55c327aac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:10.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.276+0000 7f74024db740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3276d4670 0x55c327aacf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:10.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.276+0000 7f74024db740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f73f41afbe0 con 0x55c3276cc490 2024-09-21T03:47:10.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.276+0000 7f74024db740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f73f41b1050 con 0x55c3276b3cd0 2024-09-21T03:47:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.276+0000 7f74024db740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f73f41b02b0 con 0x55c3276d4670 2024-09-21T03:47:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.276+0000 7f74024db740 10 client.0 _ll_register_callbacks cb 0x7f73e400a560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.276+0000 7f73f9502640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276cc490 0x55c327aac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.276+0000 7f73f9502640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276cc490 0x55c327aac9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34348/0 (socket says 172.21.15.84:34348) 2024-09-21T03:47:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.276+0000 7f73f9502640 1 -- 172.21.15.84:0/3963214559 learned_addr learned my addr 172.21.15.84:0/3963214559 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.276+0000 7f73f9d03640 1 --2- 172.21.15.84:0/3963214559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276b3cd0 0x55c327ab0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.277+0000 7f73fa504640 1 --2- 172.21.15.84:0/3963214559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3276d4670 0x55c327aacf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.277+0000 7f73f9502640 1 -- 172.21.15.84:0/3963214559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3276d4670 msgr2=0x55c327aacf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.277+0000 7f73f9502640 1 --2- 172.21.15.84:0/3963214559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3276d4670 0x55c327aacf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.277+0000 7f73f9502640 1 -- 172.21.15.84:0/3963214559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276b3cd0 msgr2=0x55c327ab0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.277+0000 7f73f9502640 1 --2- 172.21.15.84:0/3963214559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276b3cd0 0x55c327ab0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.277+0000 7f73f9502640 1 -- 172.21.15.84:0/3963214559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c327aad560 con 0x55c3276cc490 2024-09-21T03:47:10.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.277+0000 7f73f9502640 1 --2- 172.21.15.84:0/3963214559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276cc490 0x55c327aac9e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f73e4000c00 tx=0x7f73e40e7a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9443e44d999c81d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:10.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.277+0000 7f73dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:10.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.277+0000 7f73dd7fa640 1 -- 172.21.15.84:0/3963214559 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e40a9500 con 0x55c3276cc490 2024-09-21T03:47:10.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.277+0000 7f73dd7fa640 1 -- 172.21.15.84:0/3963214559 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f73e40ac8c0 con 0x55c3276cc490 2024-09-21T03:47:10.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.277+0000 7f74024db740 1 -- 172.21.15.84:0/3963214559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73f0003cc0 con 0x55c3276cc490 2024-09-21T03:47:10.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.277+0000 7f73dd7fa640 1 -- 172.21.15.84:0/3963214559 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f73e40add60 con 0x55c3276cc490 2024-09-21T03:47:10.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.277+0000 7f74024db740 10 client.16377 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:10.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.277+0000 7f74024db740 1 -- 172.21.15.84:0/3963214559 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c327b25a80 con 0x55c3276cc490 2024-09-21T03:47:10.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.277+0000 7f73dd7fa640 1 -- 172.21.15.84:0/3963214559 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73f0003cc0 con 0x55c3276cc490 2024-09-21T03:47:10.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.278+0000 7f73dd7fa640 1 -- 172.21.15.84:0/3963214559 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f73e400f450 con 0x55c3276cc490 2024-09-21T03:47:10.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.278+0000 7f74024db740 10 client.16377 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:10.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.278+0000 7f74024db740 10 client.16377 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:47:10.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.278+0000 7f74024db740 20 client.16377 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:10.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.278+0000 7f74024db740 1 --2- 172.21.15.84:0/3963214559 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c3276f5350 0x55c327b28160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:10.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.278+0000 7f74024db740 4 client.16377 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:47:10.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.278+0000 7f74024db740 1 -- 172.21.15.84:0/3963214559 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c327a10860 con 0x55c3276f5350 2024-09-21T03:47:10.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.278+0000 7f73f9d03640 1 --2- 172.21.15.84:0/3963214559 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c3276f5350 0x55c327b28160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:10.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.278+0000 7f73dd7fa640 10 client.16377 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:10.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.278+0000 7f73f9d03640 1 --2- 172.21.15.84:0/3963214559 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c3276f5350 0x55c327b28160 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd87f5b61c0cddfb server_cookie=eb90e8f63f1cfce0 in_seq=0 out_seq=0 2024-09-21T03:47:10.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.280+0000 7f73dd7fa640 1 -- 172.21.15.84:0/3963214559 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c327a10860 con 0x55c3276f5350 2024-09-21T03:47:10.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.280+0000 7f73dd7fa640 10 client.16377 handle_command_reply: tid=0 2024-09-21T03:47:10.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.280+0000 7f74024db740 1 client.16377 shutdown 2024-09-21T03:47:10.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.280+0000 7f74024db740 1 -- 172.21.15.84:0/3963214559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276cc490 msgr2=0x55c327aac9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:10.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.280+0000 7f74024db740 1 --2- 172.21.15.84:0/3963214559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276cc490 0x55c327aac9e0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f73e4000c00 tx=0x7f73e40e7a90 comp rx=0 tx=0).stop 2024-09-21T03:47:10.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.280+0000 7f74024db740 1 -- 172.21.15.84:0/3963214559 shutdown_connections 2024-09-21T03:47:10.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.280+0000 7f74024db740 1 --2- 172.21.15.84:0/3963214559 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c3276f5350 0x55c327b28160 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.280+0000 7f74024db740 1 --2- 172.21.15.84:0/3963214559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3276d4670 0x55c327aacf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.280+0000 7f74024db740 1 --2- 172.21.15.84:0/3963214559 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3276cc490 0x55c327aac9e0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.280+0000 7f73dd7fa640 0 client.16377 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:10.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.280+0000 7f74024db740 1 --2- 172.21.15.84:0/3963214559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3276b3cd0 0x55c327ab0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.280+0000 7f74024db740 1 -- 172.21.15.84:0/3963214559 >> 172.21.15.84:0/3963214559 conn(0x55c3276e9740 msgr2=0x55c327aa9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:10.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.280+0000 7f74024db740 1 -- 172.21.15.84:0/3963214559 shutdown_connections 2024-09-21T03:47:10.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.280+0000 7f74024db740 1 -- 172.21.15.84:0/3963214559 wait complete. 2024-09-21T03:47:10.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.280+0000 7f74024db740 20 client.16377 trim_cache size 0 max 16384 2024-09-21T03:47:10.291 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:47:10.291 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T03:47:10.292 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "3227fa23-3635-4300-9e54-df2b6386d541", 2024-09-21T03:47:10.292 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T03:47:10.292 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:47:10.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.281+0000 7f73fbf67640 1 -- 172.21.15.84:0/2519962242 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f73e00b6730 msgr2=0x7f73e00b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:10.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.281+0000 7f73fbf67640 1 --2- 172.21.15.84:0/2519962242 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f73e00b6730 0x7f73e00b8c40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f73ec049000 tx=0x7f73ec04a000 comp rx=0 tx=0).stop 2024-09-21T03:47:10.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.281+0000 7f73fbf67640 1 -- 172.21.15.84:0/2519962242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73f41094a0 msgr2=0x7f73f419cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:10.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.281+0000 7f73fbf67640 1 --2- 172.21.15.84:0/2519962242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73f41094a0 0x7f73f419cb40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f73e400c8c0 tx=0x7f73e400cd80 comp rx=0 tx=0).stop 2024-09-21T03:47:10.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.281+0000 7f73fbf67640 1 -- 172.21.15.84:0/2519962242 shutdown_connections 2024-09-21T03:47:10.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.281+0000 7f73fbf67640 1 --2- 172.21.15.84:0/2519962242 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f73e00b6730 0x7f73e00b8c40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.281+0000 7f73fbf67640 1 --2- 172.21.15.84:0/2519962242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f73f4109df0 0x7f73f41a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.281+0000 7f73fbf67640 1 --2- 172.21.15.84:0/2519962242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f73f41094a0 0x7f73f419cb40 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.281+0000 7f73fbf67640 1 --2- 172.21.15.84:0/2519962242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73f4103b60 0x7f73f419c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:10.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.281+0000 7f73fbf67640 1 -- 172.21.15.84:0/2519962242 >> 172.21.15.84:0/2519962242 conn(0x7f73f407b850 msgr2=0x7f73f4105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:10.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.281+0000 7f73fbf67640 1 -- 172.21.15.84:0/2519962242 shutdown_connections 2024-09-21T03:47:10.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:10.281+0000 7f73fbf67640 1 -- 172.21.15.84:0/2519962242 wait complete. 2024-09-21T03:47:11.232 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:47:11.478 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:47:11.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:11 smithi084 ceph-mon[30941]: scrub queued for path: / 2024-09-21T03:47:11.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:11 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:47:11.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:11 smithi084 ceph-mon[30941]: scrub summary: active paths [/] 2024-09-21T03:47:11.754 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:11 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:47:11.755 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:11 smithi084 ceph-mon[30941]: pgmap v465: 97 pgs: 97 active+clean; 6.3 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 51 KiB/s wr, 25 op/s 2024-09-21T03:47:11.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:11 smithi174 ceph-mon[34403]: scrub queued for path: / 2024-09-21T03:47:11.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:11 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:47:11.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:11 smithi174 ceph-mon[34403]: scrub summary: active paths [/] 2024-09-21T03:47:11.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:11 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:47:11.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:11 smithi174 ceph-mon[34403]: pgmap v465: 97 pgs: 97 active+clean; 6.3 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 51 KiB/s wr, 25 op/s 2024-09-21T03:47:11.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:11 smithi172 ceph-mon[34821]: scrub queued for path: / 2024-09-21T03:47:11.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:11 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:47:11.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:11 smithi172 ceph-mon[34821]: scrub summary: active paths [/] 2024-09-21T03:47:11.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:11 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:47:11.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:11 smithi172 ceph-mon[34821]: pgmap v465: 97 pgs: 97 active+clean; 6.3 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 51 KiB/s wr, 25 op/s 2024-09-21T03:47:11.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.968+0000 7fa144efb640 1 -- 172.21.15.84:0/3127807630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa140108d70 msgr2=0x7fa14010f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:11.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.968+0000 7fa144efb640 1 --2- 172.21.15.84:0/3127807630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa140108d70 0x7fa14010f5a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa138009ca0 tx=0x7fa13802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:47:11.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.968+0000 7fa144efb640 1 -- 172.21.15.84:0/3127807630 shutdown_connections 2024-09-21T03:47:11.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.968+0000 7fa144efb640 1 --2- 172.21.15.84:0/3127807630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa140108d70 0x7fa14010f5a0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:11.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.968+0000 7fa144efb640 1 --2- 172.21.15.84:0/3127807630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa140108420 0x7fa140108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:11.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.968+0000 7fa144efb640 1 --2- 172.21.15.84:0/3127807630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa140102ae0 0x7fa140102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:11.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.968+0000 7fa144efb640 1 -- 172.21.15.84:0/3127807630 >> 172.21.15.84:0/3127807630 conn(0x7fa140079770 msgr2=0x7fa140079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:11.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.969+0000 7fa144efb640 1 -- 172.21.15.84:0/3127807630 shutdown_connections 2024-09-21T03:47:11.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.969+0000 7fa144efb640 1 -- 172.21.15.84:0/3127807630 wait complete. 2024-09-21T03:47:11.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.969+0000 7fa144efb640 1 Processor -- start 2024-09-21T03:47:11.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.970+0000 7fa144efb640 1 -- start start 2024-09-21T03:47:11.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.970+0000 7fa144efb640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa140102ae0 0x7fa14019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:11.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.970+0000 7fa144efb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa140108420 0x7fa14019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:11.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.970+0000 7fa144efb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa140108d70 0x7fa14019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:11.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.970+0000 7fa144efb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa140112a30 con 0x7fa140108d70 2024-09-21T03:47:11.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.970+0000 7fa144efb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa1401128b0 con 0x7fa140108420 2024-09-21T03:47:11.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.970+0000 7fa144efb640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa140112bb0 con 0x7fa140102ae0 2024-09-21T03:47:11.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.970+0000 7fa13ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa140108d70 0x7fa14019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:11.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.970+0000 7fa13ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa140108d70 0x7fa14019fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34366/0 (socket says 172.21.15.84:34366) 2024-09-21T03:47:11.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.970+0000 7fa13ed9d640 1 -- 172.21.15.84:0/1591276840 learned_addr learned my addr 172.21.15.84:0/1591276840 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:11.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.970+0000 7fa13e59c640 1 --2- 172.21.15.84:0/1591276840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa140102ae0 0x7fa14019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:11.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.970+0000 7fa13dd9b640 1 --2- 172.21.15.84:0/1591276840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa140108420 0x7fa14019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:11.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.971+0000 7fa13ed9d640 1 -- 172.21.15.84:0/1591276840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa140102ae0 msgr2=0x7fa14019a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:11.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.971+0000 7fa13ed9d640 1 --2- 172.21.15.84:0/1591276840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa140102ae0 0x7fa14019a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:11.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.971+0000 7fa13ed9d640 1 -- 172.21.15.84:0/1591276840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa140108420 msgr2=0x7fa14019aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:11.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.971+0000 7fa13ed9d640 1 --2- 172.21.15.84:0/1591276840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa140108420 0x7fa14019aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:11.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.971+0000 7fa13ed9d640 1 -- 172.21.15.84:0/1591276840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1401a0440 con 0x7fa140108d70 2024-09-21T03:47:11.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.971+0000 7fa13ed9d640 1 --2- 172.21.15.84:0/1591276840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa140108d70 0x7fa14019fd10 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa138005cc0 tx=0x7fa13802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:11.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.971+0000 7fa12f7fe640 1 -- 172.21.15.84:0/1591276840 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa138003bf0 con 0x7fa140108d70 2024-09-21T03:47:11.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.971+0000 7fa144efb640 1 -- 172.21.15.84:0/1591276840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1401a06d0 con 0x7fa140108d70 2024-09-21T03:47:11.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.971+0000 7fa12f7fe640 1 -- 172.21.15.84:0/1591276840 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa138003d90 con 0x7fa140108d70 2024-09-21T03:47:11.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.971+0000 7fa12f7fe640 1 -- 172.21.15.84:0/1591276840 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13802fbc0 con 0x7fa140108d70 2024-09-21T03:47:11.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.971+0000 7fa144efb640 1 -- 172.21.15.84:0/1591276840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1401a6e90 con 0x7fa140108d70 2024-09-21T03:47:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.974+0000 7fa14b46f740 1 Processor -- start 2024-09-21T03:47:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.974+0000 7fa12f7fe640 1 -- 172.21.15.84:0/1591276840 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fa13802fd60 con 0x7fa140108d70 2024-09-21T03:47:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.974+0000 7fa14b46f740 1 -- start start 2024-09-21T03:47:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.974+0000 7fa14b46f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f62d5a070 0x562f63101650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:11.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.974+0000 7fa14b46f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d311b0 0x562f63101b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:11.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.974+0000 7fa14b46f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d39390 0x562f631020d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:11.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.975+0000 7fa14b46f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562f63077e50 con 0x562f62d39390 2024-09-21T03:47:11.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.975+0000 7fa14b46f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562f63067280 con 0x562f62d311b0 2024-09-21T03:47:11.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.975+0000 7fa14b46f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562f6306b090 con 0x562f62d5a070 2024-09-21T03:47:11.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.975+0000 7fa13dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d39390 0x562f631020d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:11.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.975+0000 7fa13dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d39390 0x562f631020d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34378/0 (socket says 172.21.15.84:34378) 2024-09-21T03:47:11.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.975+0000 7fa13dd9b640 1 -- 172.21.15.84:0/2818459004 learned_addr learned my addr 172.21.15.84:0/2818459004 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:11.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.975+0000 7fa13e59c640 1 --2- 172.21.15.84:0/2818459004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d311b0 0x562f63101b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:11.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.975+0000 7fa13dd9b640 1 --2- 172.21.15.84:0/2818459004 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f62d5a070 0x562f63101650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:11.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.975+0000 7fa12f7fe640 1 --2- 172.21.15.84:0/1591276840 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa1280b6680 0x7fa1280b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:11.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.975+0000 7fa13ed9d640 1 --2- 172.21.15.84:0/1591276840 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa1280b6680 0x7fa1280b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:11.990 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.975+0000 7fa13e59c640 1 -- 172.21.15.84:0/2818459004 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f62d5a070 msgr2=0x562f63101650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:11.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.975+0000 7fa13e59c640 1 --2- 172.21.15.84:0/2818459004 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f62d5a070 0x562f63101650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:11.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.975+0000 7fa13e59c640 1 -- 172.21.15.84:0/2818459004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d39390 msgr2=0x562f631020d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:11.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.975+0000 7fa13e59c640 1 --2- 172.21.15.84:0/2818459004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d39390 0x562f631020d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:11.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.975+0000 7fa13e59c640 1 -- 172.21.15.84:0/2818459004 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f62dc5650 con 0x562f62d311b0 2024-09-21T03:47:11.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.975+0000 7fa12f7fe640 1 -- 172.21.15.84:0/1591276840 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa138108af0 con 0x7fa140108d70 2024-09-21T03:47:11.991 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.975+0000 7fa13e59c640 1 --2- 172.21.15.84:0/2818459004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d311b0 0x562f63101b90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa13000ab40 tx=0x7fa13000f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5444e0f89b098e5e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:11.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.976+0000 7fa13ed9d640 1 --2- 172.21.15.84:0/1591276840 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa1280b6680 0x7fa1280b8b90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa138106370 tx=0x7fa13809b780 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:11.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.976+0000 7fa12cff9640 1 -- 172.21.15.84:0/2818459004 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa130004020 con 0x562f62d311b0 2024-09-21T03:47:11.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.976+0000 7fa12cff9640 1 -- 172.21.15.84:0/2818459004 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1300041c0 con 0x562f62d311b0 2024-09-21T03:47:11.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.976+0000 7fa12cff9640 1 -- 172.21.15.84:0/2818459004 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1300186a0 con 0x562f62d311b0 2024-09-21T03:47:11.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.977+0000 7fa14b46f740 1 -- 172.21.15.84:0/2818459004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d311b0 msgr2=0x562f63101b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:11.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.977+0000 7fa14b46f740 1 --2- 172.21.15.84:0/2818459004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d311b0 0x562f63101b90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa13000ab40 tx=0x7fa13000f3c0 comp rx=0 tx=0).stop 2024-09-21T03:47:11.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.977+0000 7fa14b46f740 1 -- 172.21.15.84:0/2818459004 shutdown_connections 2024-09-21T03:47:11.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.977+0000 7fa14b46f740 1 --2- 172.21.15.84:0/2818459004 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d39390 0x562f631020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:11.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.977+0000 7fa14b46f740 1 --2- 172.21.15.84:0/2818459004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d311b0 0x562f63101b90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:11.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.977+0000 7fa14b46f740 1 --2- 172.21.15.84:0/2818459004 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f62d5a070 0x562f63101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:11.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.977+0000 7fa14b46f740 1 -- 172.21.15.84:0/2818459004 >> 172.21.15.84:0/2818459004 conn(0x562f62d4e460 msgr2=0x562f630ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:11.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.977+0000 7fa14b46f740 1 -- 172.21.15.84:0/2818459004 shutdown_connections 2024-09-21T03:47:11.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.977+0000 7fa14b46f740 1 -- 172.21.15.84:0/2818459004 wait complete. 2024-09-21T03:47:11.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.977+0000 7fa14b46f740 1 -- start start 2024-09-21T03:47:11.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.977+0000 7fa14b46f740 1 Processor -- start 2024-09-21T03:47:11.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.977+0000 7fa14b46f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d311b0 0x562f6310cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:11.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.977+0000 7fa14b46f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d39390 0x562f6310d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:11.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa14b46f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f62d5a070 0x562f6310d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:11.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa14b46f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562f62ec8700 con 0x562f62d39390 2024-09-21T03:47:11.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa14b46f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562f63002110 con 0x562f62d311b0 2024-09-21T03:47:11.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa14b46f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562f6310fe30 con 0x562f62d5a070 2024-09-21T03:47:11.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa14b46f740 10 client.0 _ll_register_callbacks cb 0x562f6301b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:11.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa13e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d39390 0x562f6310d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:11.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa13e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d39390 0x562f6310d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34382/0 (socket says 172.21.15.84:34382) 2024-09-21T03:47:11.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa13e59c640 1 -- 172.21.15.84:0/3792606167 learned_addr learned my addr 172.21.15.84:0/3792606167 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:11.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa13dd9b640 1 --2- 172.21.15.84:0/3792606167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f62d5a070 0x562f6310d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:11.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa13dd9b640 1 --2- 172.21.15.84:0/3792606167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d311b0 0x562f6310cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:11.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa13e59c640 1 -- 172.21.15.84:0/3792606167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f62d5a070 msgr2=0x562f6310d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:11.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa13e59c640 1 --2- 172.21.15.84:0/3792606167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f62d5a070 0x562f6310d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:11.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa13e59c640 1 -- 172.21.15.84:0/3792606167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d311b0 msgr2=0x562f6310cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:11.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa13e59c640 1 --2- 172.21.15.84:0/3792606167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d311b0 0x562f6310cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:11.996 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa13e59c640 1 -- 172.21.15.84:0/3792606167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f6302fc40 con 0x562f62d39390 2024-09-21T03:47:11.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa13dd9b640 1 --2- 172.21.15.84:0/3792606167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d311b0 0x562f6310cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:47:11.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa13e59c640 1 --2- 172.21.15.84:0/3792606167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d39390 0x562f6310d190 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa130003a40 tx=0x7fa130003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688997ff208f202f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:11.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa125ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:11.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa125ffb640 1 -- 172.21.15.84:0/3792606167 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13002f060 con 0x562f62d39390 2024-09-21T03:47:11.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa14b46f740 1 -- 172.21.15.84:0/3792606167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1300041c0 con 0x562f62d39390 2024-09-21T03:47:11.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa125ffb640 1 -- 172.21.15.84:0/3792606167 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa130004370 con 0x562f62d39390 2024-09-21T03:47:11.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.978+0000 7fa125ffb640 1 -- 172.21.15.84:0/3792606167 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa130005040 con 0x562f62d39390 2024-09-21T03:47:11.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.979+0000 7fa14b46f740 10 client.16389 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:11.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.979+0000 7fa14b46f740 1 -- 172.21.15.84:0/3792606167 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562f6311bab0 con 0x562f62d39390 2024-09-21T03:47:11.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.979+0000 7fa125ffb640 1 -- 172.21.15.84:0/3792606167 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1300041c0 con 0x562f62d39390 2024-09-21T03:47:11.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.979+0000 7fa125ffb640 1 -- 172.21.15.84:0/3792606167 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa130004a80 con 0x562f62d39390 2024-09-21T03:47:11.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.979+0000 7fa14b46f740 10 client.16389 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:11.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.979+0000 7fa14b46f740 10 client.16389 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:47:11.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.979+0000 7fa14b46f740 20 client.16389 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:11.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.979+0000 7fa14b46f740 1 --2- 172.21.15.84:0/3792606167 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x562f62d189f0 0x562f6311ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:11.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.979+0000 7fa14b46f740 4 client.16389 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:47:11.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.979+0000 7fa14b46f740 1 -- 172.21.15.84:0/3792606167 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f63079da0 con 0x562f62d189f0 2024-09-21T03:47:11.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.979+0000 7fa13dd9b640 1 --2- 172.21.15.84:0/3792606167 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x562f62d189f0 0x562f6311ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:11.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.980+0000 7fa125ffb640 10 client.16389 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:11.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.980+0000 7fa13dd9b640 1 --2- 172.21.15.84:0/3792606167 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x562f62d189f0 0x562f6311ee70 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d60f61103f20ec55 server_cookie=d825ad2dc2860780 in_seq=0 out_seq=0 2024-09-21T03:47:11.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.980+0000 7fa125ffb640 1 -- 172.21.15.84:0/3792606167 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562f63079da0 con 0x562f62d189f0 2024-09-21T03:47:11.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.980+0000 7fa125ffb640 10 client.16389 handle_command_reply: tid=0 2024-09-21T03:47:11.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.980+0000 7fa14b46f740 1 client.16389 shutdown 2024-09-21T03:47:11.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.981+0000 7fa14b46f740 1 -- 172.21.15.84:0/3792606167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d39390 msgr2=0x562f6310d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:11.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.981+0000 7fa14b46f740 1 --2- 172.21.15.84:0/3792606167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d39390 0x562f6310d190 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa130003a40 tx=0x7fa130003a70 comp rx=0 tx=0).stop 2024-09-21T03:47:11.999 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.981+0000 7fa14b46f740 1 -- 172.21.15.84:0/3792606167 shutdown_connections 2024-09-21T03:47:12.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.981+0000 7fa14b46f740 1 --2- 172.21.15.84:0/3792606167 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x562f62d189f0 0x562f6311ee70 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:12.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.981+0000 7fa14b46f740 1 --2- 172.21.15.84:0/3792606167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f62d5a070 0x562f6310d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:12.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.981+0000 7fa14b46f740 1 --2- 172.21.15.84:0/3792606167 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d39390 0x562f6310d190 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:12.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.981+0000 7fa14b46f740 1 --2- 172.21.15.84:0/3792606167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d311b0 0x562f6310cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:12.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.981+0000 7fa125ffb640 0 client.16389 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:12.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.981+0000 7fa14b46f740 1 -- 172.21.15.84:0/3792606167 >> 172.21.15.84:0/3792606167 conn(0x562f62d4e460 msgr2=0x562f631047e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:12.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.981+0000 7fa14b46f740 1 -- 172.21.15.84:0/3792606167 shutdown_connections 2024-09-21T03:47:12.000 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.981+0000 7fa14b46f740 1 -- 172.21.15.84:0/3792606167 wait complete. 2024-09-21T03:47:12.001 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.981+0000 7fa14b46f740 20 client.16389 trim_cache size 0 max 16384 2024-09-21T03:47:12.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.998+0000 7fa14b46f740 1 Processor -- start 2024-09-21T03:47:12.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.998+0000 7fa14b46f740 1 -- start start 2024-09-21T03:47:12.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.998+0000 7fa14b46f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f62d311b0 0x562f63103150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:12.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.998+0000 7fa14b46f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d39390 0x562f6310eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:12.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.998+0000 7fa14b46f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d5a070 0x562f631190c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:12.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.998+0000 7fa14b46f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa1401afbd0 con 0x562f62d5a070 2024-09-21T03:47:12.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.998+0000 7fa14b46f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa1401ad4a0 con 0x562f62d39390 2024-09-21T03:47:12.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.998+0000 7fa14b46f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa1401ab2f0 con 0x562f62d311b0 2024-09-21T03:47:12.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.998+0000 7fa13dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d5a070 0x562f631190c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:12.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.999+0000 7fa13dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d5a070 0x562f631190c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34390/0 (socket says 172.21.15.84:34390) 2024-09-21T03:47:12.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.999+0000 7fa13dd9b640 1 -- 172.21.15.84:0/3142297833 learned_addr learned my addr 172.21.15.84:0/3142297833 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:12.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.999+0000 7fa13dd9b640 1 -- 172.21.15.84:0/3142297833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f62d311b0 msgr2=0x562f63103150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:12.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.999+0000 7fa13dd9b640 1 --2- 172.21.15.84:0/3142297833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f62d311b0 0x562f63103150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:12.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.999+0000 7fa13e59c640 1 --2- 172.21.15.84:0/3142297833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d39390 0x562f6310eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:12.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.999+0000 7fa13dd9b640 1 -- 172.21.15.84:0/3142297833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d39390 msgr2=0x562f6310eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:12.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.999+0000 7fa13dd9b640 1 --2- 172.21.15.84:0/3142297833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d39390 0x562f6310eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:12.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.999+0000 7fa13dd9b640 1 -- 172.21.15.84:0/3142297833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f63125160 con 0x562f62d5a070 2024-09-21T03:47:12.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.999+0000 7fa13dd9b640 1 --2- 172.21.15.84:0/3142297833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d5a070 0x562f631190c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa134005d00 tx=0x7fa134014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40ffb9b1a62c7e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.999+0000 7fa127fff640 1 -- 172.21.15.84:0/3142297833 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1340054d0 con 0x562f62d5a070 2024-09-21T03:47:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.999+0000 7fa127fff640 1 -- 172.21.15.84:0/3142297833 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa13402b070 con 0x562f62d5a070 2024-09-21T03:47:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:11.999+0000 7fa127fff640 1 -- 172.21.15.84:0/3142297833 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa134023440 con 0x562f62d5a070 2024-09-21T03:47:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.000+0000 7fa14b46f740 1 -- 172.21.15.84:0/3142297833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d5a070 msgr2=0x562f631190c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.000+0000 7fa14b46f740 1 --2- 172.21.15.84:0/3142297833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d5a070 0x562f631190c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fa134005d00 tx=0x7fa134014040 comp rx=0 tx=0).stop 2024-09-21T03:47:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.000+0000 7fa14b46f740 1 -- 172.21.15.84:0/3142297833 shutdown_connections 2024-09-21T03:47:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.000+0000 7fa14b46f740 1 --2- 172.21.15.84:0/3142297833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d5a070 0x562f631190c0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.000+0000 7fa14b46f740 1 --2- 172.21.15.84:0/3142297833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d39390 0x562f6310eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.000+0000 7fa14b46f740 1 --2- 172.21.15.84:0/3142297833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f62d311b0 0x562f63103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.000+0000 7fa14b46f740 1 -- 172.21.15.84:0/3142297833 >> 172.21.15.84:0/3142297833 conn(0x562f62d4e460 msgr2=0x562f63106760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.000+0000 7fa14b46f740 1 -- 172.21.15.84:0/3142297833 shutdown_connections 2024-09-21T03:47:12.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.000+0000 7fa14b46f740 1 -- 172.21.15.84:0/3142297833 wait complete. 2024-09-21T03:47:12.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.000+0000 7fa14b46f740 1 -- start start 2024-09-21T03:47:12.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.001+0000 7fa14b46f740 1 Processor -- start 2024-09-21T03:47:12.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.001+0000 7fa14b46f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d311b0 0x562f63122410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:12.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.001+0000 7fa14b46f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f62d39390 0x562f6311f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:12.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.001+0000 7fa14b46f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d5a070 0x562f6311fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:12.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.001+0000 7fa14b46f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa1401ab960 con 0x562f62d311b0 2024-09-21T03:47:12.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.001+0000 7fa14b46f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa1401acdd0 con 0x562f62d5a070 2024-09-21T03:47:12.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.001+0000 7fa14b46f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa1401ac030 con 0x562f62d39390 2024-09-21T03:47:12.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.001+0000 7fa14b46f740 10 client.0 _ll_register_callbacks cb 0x7fa13400ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:12.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.001+0000 7fa13dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d311b0 0x562f63122410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:12.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.001+0000 7fa13dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d311b0 0x562f63122410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34394/0 (socket says 172.21.15.84:34394) 2024-09-21T03:47:12.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.001+0000 7fa13dd9b640 1 -- 172.21.15.84:0/2105965268 learned_addr learned my addr 172.21.15.84:0/2105965268 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:12.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.001+0000 7fa13dd9b640 1 --2- 172.21.15.84:0/2105965268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d5a070 0x562f6311fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:12.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.001+0000 7fa13e59c640 1 --2- 172.21.15.84:0/2105965268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f62d39390 0x562f6311f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:12.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.001+0000 7fa13dd9b640 1 -- 172.21.15.84:0/2105965268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f62d39390 msgr2=0x562f6311f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:12.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.001+0000 7fa13dd9b640 1 --2- 172.21.15.84:0/2105965268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f62d39390 0x562f6311f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:12.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.001+0000 7fa13dd9b640 1 -- 172.21.15.84:0/2105965268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d5a070 msgr2=0x562f6311fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:12.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.001+0000 7fa13dd9b640 1 --2- 172.21.15.84:0/2105965268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d5a070 0x562f6311fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:12.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.001+0000 7fa13dd9b640 1 -- 172.21.15.84:0/2105965268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f63120360 con 0x562f62d311b0 2024-09-21T03:47:12.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.001+0000 7fa13e59c640 1 --2- 172.21.15.84:0/2105965268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f62d39390 0x562f6311f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:47:12.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.002+0000 7fa13dd9b640 1 --2- 172.21.15.84:0/2105965268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d311b0 0x562f63122410 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa134005cd0 tx=0x7fa134012ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44075c996ebf56c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:12.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.002+0000 7fa125ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:12.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.002+0000 7fa125ffb640 1 -- 172.21.15.84:0/2105965268 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa134023440 con 0x562f62d311b0 2024-09-21T03:47:12.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.002+0000 7fa125ffb640 1 -- 172.21.15.84:0/2105965268 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa1340235e0 con 0x562f62d311b0 2024-09-21T03:47:12.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.002+0000 7fa14b46f740 1 -- 172.21.15.84:0/2105965268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa13402b070 con 0x562f62d311b0 2024-09-21T03:47:12.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.002+0000 7fa125ffb640 1 -- 172.21.15.84:0/2105965268 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa1340237e0 con 0x562f62d311b0 2024-09-21T03:47:12.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.002+0000 7fa14b46f740 10 client.16395 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:12.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.002+0000 7fa14b46f740 1 -- 172.21.15.84:0/2105965268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562f631892c0 con 0x562f62d311b0 2024-09-21T03:47:12.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.002+0000 7fa125ffb640 1 -- 172.21.15.84:0/2105965268 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa13402b070 con 0x562f62d311b0 2024-09-21T03:47:12.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.003+0000 7fa125ffb640 1 -- 172.21.15.84:0/2105965268 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa13402f800 con 0x562f62d311b0 2024-09-21T03:47:12.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.003+0000 7fa14b46f740 10 client.16395 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:12.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.003+0000 7fa14b46f740 10 client.16395 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:47:12.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.003+0000 7fa14b46f740 20 client.16395 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:12.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.003+0000 7fa14b46f740 1 --2- 172.21.15.84:0/2105965268 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x562f62cedda0 0x562f6318b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:12.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.003+0000 7fa14b46f740 4 client.16395 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:47:12.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.003+0000 7fa14b46f740 1 -- 172.21.15.84:0/2105965268 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562f63075850 con 0x562f62cedda0 2024-09-21T03:47:12.010 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.003+0000 7fa13e59c640 1 --2- 172.21.15.84:0/2105965268 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x562f62cedda0 0x562f6318b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:12.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.003+0000 7fa125ffb640 10 client.16395 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:12.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.003+0000 7fa13e59c640 1 --2- 172.21.15.84:0/2105965268 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x562f62cedda0 0x562f6318b9a0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56d28f25d81f32a4 server_cookie=9b157fdc54a735dc in_seq=0 out_seq=0 2024-09-21T03:47:12.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.004+0000 7fa125ffb640 1 -- 172.21.15.84:0/2105965268 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x562f63075850 con 0x562f62cedda0 2024-09-21T03:47:12.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.004+0000 7fa125ffb640 10 client.16395 handle_command_reply: tid=0 2024-09-21T03:47:12.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.004+0000 7fa14b46f740 1 client.16395 shutdown 2024-09-21T03:47:12.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.004+0000 7fa14b46f740 1 -- 172.21.15.84:0/2105965268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d311b0 msgr2=0x562f63122410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:12.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.004+0000 7fa14b46f740 1 --2- 172.21.15.84:0/2105965268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d311b0 0x562f63122410 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fa134005cd0 tx=0x7fa134012ae0 comp rx=0 tx=0).stop 2024-09-21T03:47:12.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.004+0000 7fa14b46f740 1 -- 172.21.15.84:0/2105965268 shutdown_connections 2024-09-21T03:47:12.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.004+0000 7fa14b46f740 1 --2- 172.21.15.84:0/2105965268 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x562f62cedda0 0x562f6318b9a0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:12.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.004+0000 7fa14b46f740 1 --2- 172.21.15.84:0/2105965268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562f62d5a070 0x562f6311fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:12.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.004+0000 7fa14b46f740 1 --2- 172.21.15.84:0/2105965268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562f62d39390 0x562f6311f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:12.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.004+0000 7fa125ffb640 0 client.16395 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:12.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.004+0000 7fa14b46f740 1 --2- 172.21.15.84:0/2105965268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562f62d311b0 0x562f63122410 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:12.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.004+0000 7fa14b46f740 1 -- 172.21.15.84:0/2105965268 >> 172.21.15.84:0/2105965268 conn(0x562f62d4e460 msgr2=0x562f6310e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:12.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.004+0000 7fa14b46f740 1 -- 172.21.15.84:0/2105965268 shutdown_connections 2024-09-21T03:47:12.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.004+0000 7fa14b46f740 1 -- 172.21.15.84:0/2105965268 wait complete. 2024-09-21T03:47:12.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.004+0000 7fa14b46f740 20 client.16395 trim_cache size 0 max 16384 2024-09-21T03:47:12.013 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:47:12.013 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:47:12.013 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T03:47:12.014 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:47:12.014 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:12.014 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "3227fa23-3635-4300-9e54-df2b6386d541", 2024-09-21T03:47:12.014 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T03:47:12.014 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:47:12.014 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:12.014 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:47:12.014 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:47:12.014 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:47:12.014 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:12.014 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:12.014 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:12.014 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:12.015 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:12.015 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:12.015 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:47:12.015 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:47:12.015 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:12.015 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:12.015 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:12.015 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:12.015 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:12.015 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:12.015 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:47:12.015 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:47:12.015 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:12.015 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:12.016 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:12.016 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:12.016 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:12.016 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:12.016 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:47:12.016 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:47:12.016 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:12.016 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:12.016 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:12.016 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:12.016 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:12.016 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:12.016 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:47:12.017 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:47:12.017 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:12.017 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:12.017 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:12.017 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:12.017 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:12.017 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:12.017 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:47:12.017 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:47:12.017 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:12.017 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:12.017 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:12.017 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:12.018 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:12.018 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:12.018 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:47:12.018 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:47:12.018 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:12.018 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:12.018 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:12.018 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:12.018 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:12.018 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:12.018 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:47:12.018 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:47:12.018 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:12.018 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:12.019 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:12.019 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:12.019 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:12.019 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:12.019 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:47:12.019 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:47:12.019 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:12.019 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:12.019 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:12.019 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:12.019 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:12.019 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:47:12.020 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:47:12.020 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:47:12.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.005+0000 7fa144efb640 1 -- 172.21.15.84:0/1591276840 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa1280b6680 msgr2=0x7fa1280b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:12.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.005+0000 7fa144efb640 1 --2- 172.21.15.84:0/1591276840 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa1280b6680 0x7fa1280b8b90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa138106370 tx=0x7fa13809b780 comp rx=0 tx=0).stop 2024-09-21T03:47:12.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.005+0000 7fa144efb640 1 -- 172.21.15.84:0/1591276840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa140108d70 msgr2=0x7fa14019fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:12.020 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.005+0000 7fa144efb640 1 --2- 172.21.15.84:0/1591276840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa140108d70 0x7fa14019fd10 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa138005cc0 tx=0x7fa13802f380 comp rx=0 tx=0).stop 2024-09-21T03:47:12.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.005+0000 7fa144efb640 1 -- 172.21.15.84:0/1591276840 shutdown_connections 2024-09-21T03:47:12.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.005+0000 7fa144efb640 1 --2- 172.21.15.84:0/1591276840 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa1280b6680 0x7fa1280b8b90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:12.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.005+0000 7fa144efb640 1 --2- 172.21.15.84:0/1591276840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa140108d70 0x7fa14019fd10 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:12.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.005+0000 7fa144efb640 1 --2- 172.21.15.84:0/1591276840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa140108420 0x7fa14019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:12.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.005+0000 7fa144efb640 1 --2- 172.21.15.84:0/1591276840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa140102ae0 0x7fa14019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:12.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.005+0000 7fa144efb640 1 -- 172.21.15.84:0/1591276840 >> 172.21.15.84:0/1591276840 conn(0x7fa140079770 msgr2=0x7fa140101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:12.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.005+0000 7fa144efb640 1 -- 172.21.15.84:0/1591276840 shutdown_connections 2024-09-21T03:47:12.021 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:12.005+0000 7fa144efb640 1 -- 172.21.15.84:0/1591276840 wait complete. 2024-09-21T03:47:12.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:12 smithi084 ceph-mon[30941]: pgmap v466: 97 pgs: 97 active+clean; 6.5 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 67 KiB/s wr, 28 op/s 2024-09-21T03:47:12.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:12 smithi174 ceph-mon[34403]: pgmap v466: 97 pgs: 97 active+clean; 6.5 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 67 KiB/s wr, 28 op/s 2024-09-21T03:47:12.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:12 smithi172 ceph-mon[34821]: pgmap v466: 97 pgs: 97 active+clean; 6.5 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 67 KiB/s wr, 28 op/s 2024-09-21T03:47:12.921 INFO:tasks.cephfs.filesystem:scrub status for tag:3227fa23-3635-4300-9e54-df2b6386d541 - {'path': '/', 'tag': '3227fa23-3635-4300-9e54-df2b6386d541', 'options': 'recursive,force'} 2024-09-21T03:47:15.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:15 smithi084 ceph-mon[30941]: pgmap v467: 97 pgs: 97 active+clean; 6.5 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 24 op/s 2024-09-21T03:47:15.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:15 smithi084 ceph-mon[30941]: scrub summary: idle 2024-09-21T03:47:15.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:15 smithi174 ceph-mon[34403]: pgmap v467: 97 pgs: 97 active+clean; 6.5 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 24 op/s 2024-09-21T03:47:15.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:15 smithi174 ceph-mon[34403]: scrub summary: idle 2024-09-21T03:47:15.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:15 smithi172 ceph-mon[34821]: pgmap v467: 97 pgs: 97 active+clean; 6.5 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 24 op/s 2024-09-21T03:47:15.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:15 smithi172 ceph-mon[34821]: scrub summary: idle 2024-09-21T03:47:17.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:17 smithi084 ceph-mon[30941]: pgmap v468: 97 pgs: 97 active+clean; 6.5 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-21T03:47:17.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:17 smithi174 ceph-mon[34403]: pgmap v468: 97 pgs: 97 active+clean; 6.5 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-21T03:47:17.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:17 smithi172 ceph-mon[34821]: pgmap v468: 97 pgs: 97 active+clean; 6.5 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-21T03:47:19.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:19 smithi084 ceph-mon[30941]: pgmap v469: 97 pgs: 97 active+clean; 6.7 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 14 op/s 2024-09-21T03:47:19.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:19 smithi174 ceph-mon[34403]: pgmap v469: 97 pgs: 97 active+clean; 6.7 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 14 op/s 2024-09-21T03:47:19.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:19 smithi172 ceph-mon[34821]: pgmap v469: 97 pgs: 97 active+clean; 6.7 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 14 op/s 2024-09-21T03:47:20.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:20 smithi084 ceph-mon[30941]: pgmap v470: 97 pgs: 97 active+clean; 6.7 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 11 op/s 2024-09-21T03:47:20.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:20 smithi174 ceph-mon[34403]: pgmap v470: 97 pgs: 97 active+clean; 6.7 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 11 op/s 2024-09-21T03:47:20.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:20 smithi172 ceph-mon[34821]: pgmap v470: 97 pgs: 97 active+clean; 6.7 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 11 op/s 2024-09-21T03:47:23.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:23 smithi084 ceph-mon[30941]: pgmap v471: 97 pgs: 97 active+clean; 6.8 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 14 op/s 2024-09-21T03:47:23.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:23 smithi174 ceph-mon[34403]: pgmap v471: 97 pgs: 97 active+clean; 6.8 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 14 op/s 2024-09-21T03:47:23.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:23 smithi172 ceph-mon[34821]: pgmap v471: 97 pgs: 97 active+clean; 6.8 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 14 op/s 2024-09-21T03:47:25.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:25 smithi084 ceph-mon[30941]: pgmap v472: 97 pgs: 97 active+clean; 6.8 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-21T03:47:25.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:25 smithi174 ceph-mon[34403]: pgmap v472: 97 pgs: 97 active+clean; 6.8 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-21T03:47:25.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:25 smithi172 ceph-mon[34821]: pgmap v472: 97 pgs: 97 active+clean; 6.8 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-21T03:47:26.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:26 smithi084 ceph-mon[30941]: pgmap v473: 97 pgs: 97 active+clean; 6.8 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-21T03:47:26.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:26 smithi174 ceph-mon[34403]: pgmap v473: 97 pgs: 97 active+clean; 6.8 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-21T03:47:26.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:26 smithi172 ceph-mon[34821]: pgmap v473: 97 pgs: 97 active+clean; 6.8 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-21T03:47:29.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:29 smithi084 ceph-mon[30941]: pgmap v474: 97 pgs: 97 active+clean; 7.0 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 13 op/s 2024-09-21T03:47:29.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:29 smithi174 ceph-mon[34403]: pgmap v474: 97 pgs: 97 active+clean; 7.0 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 13 op/s 2024-09-21T03:47:29.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:29 smithi172 ceph-mon[34821]: pgmap v474: 97 pgs: 97 active+clean; 7.0 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 13 op/s 2024-09-21T03:47:30.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:30 smithi084 ceph-mon[30941]: pgmap v475: 97 pgs: 97 active+clean; 7.0 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-09-21T03:47:30.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:30 smithi174 ceph-mon[34403]: pgmap v475: 97 pgs: 97 active+clean; 7.0 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-09-21T03:47:30.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:30 smithi172 ceph-mon[34821]: pgmap v475: 97 pgs: 97 active+clean; 7.0 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-09-21T03:47:33.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:33 smithi084 ceph-mon[30941]: pgmap v476: 97 pgs: 97 active+clean; 7.1 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 13 op/s 2024-09-21T03:47:33.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:33 smithi174 ceph-mon[34403]: pgmap v476: 97 pgs: 97 active+clean; 7.1 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 13 op/s 2024-09-21T03:47:33.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:33 smithi172 ceph-mon[34821]: pgmap v476: 97 pgs: 97 active+clean; 7.1 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 13 op/s 2024-09-21T03:47:34.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:34 smithi084 ceph-mon[30941]: pgmap v477: 97 pgs: 97 active+clean; 7.1 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-09-21T03:47:34.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:34 smithi174 ceph-mon[34403]: pgmap v477: 97 pgs: 97 active+clean; 7.1 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-09-21T03:47:34.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:34 smithi172 ceph-mon[34821]: pgmap v477: 97 pgs: 97 active+clean; 7.1 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-09-21T03:47:37.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:37 smithi084 ceph-mon[30941]: pgmap v478: 97 pgs: 97 active+clean; 7.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-09-21T03:47:37.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:37 smithi174 ceph-mon[34403]: pgmap v478: 97 pgs: 97 active+clean; 7.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-09-21T03:47:37.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:37 smithi172 ceph-mon[34821]: pgmap v478: 97 pgs: 97 active+clean; 7.1 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-09-21T03:47:38.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:38 smithi084 ceph-mon[30941]: pgmap v479: 97 pgs: 97 active+clean; 7.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 14 op/s 2024-09-21T03:47:38.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:38 smithi174 ceph-mon[34403]: pgmap v479: 97 pgs: 97 active+clean; 7.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 14 op/s 2024-09-21T03:47:38.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:38 smithi172 ceph-mon[34821]: pgmap v479: 97 pgs: 97 active+clean; 7.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 14 op/s 2024-09-21T03:47:41.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:41 smithi084 ceph-mon[30941]: pgmap v480: 97 pgs: 97 active+clean; 7.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-21T03:47:41.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:41 smithi174 ceph-mon[34403]: pgmap v480: 97 pgs: 97 active+clean; 7.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-21T03:47:41.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:41 smithi172 ceph-mon[34821]: pgmap v480: 97 pgs: 97 active+clean; 7.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-21T03:47:42.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:42 smithi084 ceph-mon[30941]: pgmap v481: 97 pgs: 97 active+clean; 7.5 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 46 KiB/s wr, 13 op/s 2024-09-21T03:47:42.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:42 smithi174 ceph-mon[34403]: pgmap v481: 97 pgs: 97 active+clean; 7.5 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 46 KiB/s wr, 13 op/s 2024-09-21T03:47:42.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:42 smithi172 ceph-mon[34821]: pgmap v481: 97 pgs: 97 active+clean; 7.5 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 46 KiB/s wr, 13 op/s 2024-09-21T03:47:42.922 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:47:43.167 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:47:43.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:43 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:47:43.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:43 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:43.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:43 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:47:43.559 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:43 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:47:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.648+0000 7ff577153640 1 -- 172.21.15.84:0/2931711567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff570102a60 msgr2=0x7ff570102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.648+0000 7ff577153640 1 --2- 172.21.15.84:0/2931711567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff570102a60 0x7ff570102e70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff564009900 tx=0x7ff56402a410 comp rx=0 tx=0).stop 2024-09-21T03:47:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.649+0000 7ff577153640 1 -- 172.21.15.84:0/2931711567 shutdown_connections 2024-09-21T03:47:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.649+0000 7ff577153640 1 --2- 172.21.15.84:0/2931711567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff570108cf0 0x7ff57010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.649+0000 7ff577153640 1 --2- 172.21.15.84:0/2931711567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff5701083a0 0x7ff5701087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.649+0000 7ff577153640 1 --2- 172.21.15.84:0/2931711567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff570102a60 0x7ff570102e70 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.649+0000 7ff577153640 1 -- 172.21.15.84:0/2931711567 >> 172.21.15.84:0/2931711567 conn(0x7ff570079730 msgr2=0x7ff570079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.649+0000 7ff577153640 1 -- 172.21.15.84:0/2931711567 shutdown_connections 2024-09-21T03:47:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.649+0000 7ff577153640 1 -- 172.21.15.84:0/2931711567 wait complete. 2024-09-21T03:47:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.649+0000 7ff577153640 1 Processor -- start 2024-09-21T03:47:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.649+0000 7ff577153640 1 -- start start 2024-09-21T03:47:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.650+0000 7ff577153640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff570102a60 0x7ff57019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.650+0000 7ff577153640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5701083a0 0x7ff57019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.650+0000 7ff577153640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff570108cf0 0x7ff57019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.650+0000 7ff577153640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff570113a80 con 0x7ff570102a60 2024-09-21T03:47:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.650+0000 7ff577153640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff570113900 con 0x7ff5701083a0 2024-09-21T03:47:43.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.650+0000 7ff577153640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff570113c00 con 0x7ff570108cf0 2024-09-21T03:47:43.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.650+0000 7ff574eef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff570102a60 0x7ff57019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:43.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.650+0000 7ff574eef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff570102a60 0x7ff57019a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53740/0 (socket says 172.21.15.84:53740) 2024-09-21T03:47:43.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.650+0000 7ff574eef640 1 -- 172.21.15.84:0/3982040713 learned_addr learned my addr 172.21.15.84:0/3982040713 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:43.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.650+0000 7ff5756f0640 1 --2- 172.21.15.84:0/3982040713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff570108cf0 0x7ff57019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:43.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.650+0000 7ff56ffff640 1 --2- 172.21.15.84:0/3982040713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5701083a0 0x7ff57019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:43.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.650+0000 7ff574eef640 1 -- 172.21.15.84:0/3982040713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff570108cf0 msgr2=0x7ff57019fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:43.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.650+0000 7ff574eef640 1 --2- 172.21.15.84:0/3982040713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff570108cf0 0x7ff57019fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.650+0000 7ff574eef640 1 -- 172.21.15.84:0/3982040713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5701083a0 msgr2=0x7ff57019a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:43.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.650+0000 7ff574eef640 1 --2- 172.21.15.84:0/3982040713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5701083a0 0x7ff57019a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.650+0000 7ff574eef640 1 -- 172.21.15.84:0/3982040713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5701a02c0 con 0x7ff570102a60 2024-09-21T03:47:43.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.650+0000 7ff56ffff640 1 --2- 172.21.15.84:0/3982040713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5701083a0 0x7ff57019a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:47:43.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.650+0000 7ff574eef640 1 --2- 172.21.15.84:0/3982040713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff570102a60 0x7ff57019a410 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff564006010 tx=0x7ff5640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.650+0000 7ff56dffb640 1 -- 172.21.15.84:0/3982040713 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56403f030 con 0x7ff570102a60 2024-09-21T03:47:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.651+0000 7ff56dffb640 1 -- 172.21.15.84:0/3982040713 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff564003800 con 0x7ff570102a60 2024-09-21T03:47:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.651+0000 7ff577153640 1 -- 172.21.15.84:0/3982040713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5701a0550 con 0x7ff570102a60 2024-09-21T03:47:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.651+0000 7ff56dffb640 1 -- 172.21.15.84:0/3982040713 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff564035070 con 0x7ff570102a60 2024-09-21T03:47:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.651+0000 7ff577153640 1 -- 172.21.15.84:0/3982040713 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5701a0a80 con 0x7ff570102a60 2024-09-21T03:47:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.653+0000 7ff56dffb640 1 -- 172.21.15.84:0/3982040713 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7ff564003cb0 con 0x7ff570102a60 2024-09-21T03:47:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.653+0000 7ff57d6c7740 1 Processor -- start 2024-09-21T03:47:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.654+0000 7ff57d6c7740 1 -- start start 2024-09-21T03:47:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.654+0000 7ff57d6c7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baafabf070 0x55baafe6aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.654+0000 7ff57d6c7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafa961b0 0x55baafe6afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.654+0000 7ff57d6c7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe6b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.654+0000 7ff57d6c7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55baafddce50 con 0x55baafa9e390 2024-09-21T03:47:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.654+0000 7ff57d6c7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55baafdcc280 con 0x55baafabf070 2024-09-21T03:47:43.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.654+0000 7ff57d6c7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55baafdd0090 con 0x55baafa961b0 2024-09-21T03:47:43.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.654+0000 7ff56ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe6b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:43.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.654+0000 7ff56ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe6b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53754/0 (socket says 172.21.15.84:53754) 2024-09-21T03:47:43.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.654+0000 7ff56ffff640 1 -- 172.21.15.84:0/2392519485 learned_addr learned my addr 172.21.15.84:0/2392519485 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:43.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.654+0000 7ff5756f0640 1 --2- 172.21.15.84:0/2392519485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baafabf070 0x55baafe6aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:43.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.654+0000 7ff56dffb640 1 --2- 172.21.15.84:0/3982040713 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff5600b6730 0x7ff5600b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:43.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.654+0000 7ff574eef640 1 --2- 172.21.15.84:0/2392519485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafa961b0 0x55baafe6afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:43.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.654+0000 7ff5756f0640 1 --2- 172.21.15.84:0/3982040713 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff5600b6730 0x7ff5600b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:43.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.654+0000 7ff56ffff640 1 -- 172.21.15.84:0/2392519485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafa961b0 msgr2=0x55baafe6afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:43.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.654+0000 7ff56ffff640 1 --2- 172.21.15.84:0/2392519485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafa961b0 0x55baafe6afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.654+0000 7ff56ffff640 1 -- 172.21.15.84:0/2392519485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baafabf070 msgr2=0x55baafe6aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:43.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.654+0000 7ff56ffff640 1 --2- 172.21.15.84:0/2392519485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baafabf070 0x55baafe6aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.654+0000 7ff56ffff640 1 -- 172.21.15.84:0/2392519485 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baafb2a650 con 0x55baafa9e390 2024-09-21T03:47:43.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.654+0000 7ff56dffb640 1 -- 172.21.15.84:0/3982040713 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff5641080f0 con 0x7ff570102a60 2024-09-21T03:47:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.655+0000 7ff56ffff640 1 --2- 172.21.15.84:0/2392519485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe6b4e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00bbb0 tx=0x7ff55c00d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb65b28915d6a8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.655+0000 7ff5756f0640 1 --2- 172.21.15.84:0/3982040713 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff5600b6730 0x7ff5600b8c40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff568012730 tx=0x7ff568004ab0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.655+0000 7ff55affd640 1 -- 172.21.15.84:0/2392519485 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c017620 con 0x55baafa9e390 2024-09-21T03:47:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.655+0000 7ff55affd640 1 -- 172.21.15.84:0/2392519485 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff55c017c70 con 0x55baafa9e390 2024-09-21T03:47:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.655+0000 7ff55affd640 1 -- 172.21.15.84:0/2392519485 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00fc00 con 0x55baafa9e390 2024-09-21T03:47:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.656+0000 7ff57d6c7740 1 -- 172.21.15.84:0/2392519485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 msgr2=0x55baafe6b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.656+0000 7ff57d6c7740 1 --2- 172.21.15.84:0/2392519485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe6b4e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00bbb0 tx=0x7ff55c00d710 comp rx=0 tx=0).stop 2024-09-21T03:47:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.656+0000 7ff57d6c7740 1 -- 172.21.15.84:0/2392519485 shutdown_connections 2024-09-21T03:47:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.656+0000 7ff57d6c7740 1 --2- 172.21.15.84:0/2392519485 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe6b4e0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.656+0000 7ff57d6c7740 1 --2- 172.21.15.84:0/2392519485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafa961b0 0x55baafe6afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.656+0000 7ff57d6c7740 1 --2- 172.21.15.84:0/2392519485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baafabf070 0x55baafe6aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.656+0000 7ff57d6c7740 1 -- 172.21.15.84:0/2392519485 >> 172.21.15.84:0/2392519485 conn(0x55baafab3460 msgr2=0x55baafe68950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.656+0000 7ff57d6c7740 1 -- 172.21.15.84:0/2392519485 shutdown_connections 2024-09-21T03:47:43.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.656+0000 7ff57d6c7740 1 -- 172.21.15.84:0/2392519485 wait complete. 2024-09-21T03:47:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.656+0000 7ff57d6c7740 1 -- start start 2024-09-21T03:47:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.656+0000 7ff57d6c7740 1 Processor -- start 2024-09-21T03:47:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff57d6c7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baafa961b0 0x55baafe76020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff57d6c7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe76560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff57d6c7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafabf070 0x55baafe76aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff57d6c7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55baafc2d700 con 0x55baafa9e390 2024-09-21T03:47:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff57d6c7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55baafd67110 con 0x55baafa961b0 2024-09-21T03:47:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff57d6c7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55baafe79240 con 0x55baafabf070 2024-09-21T03:47:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff57d6c7740 10 client.0 _ll_register_callbacks cb 0x55baafd80990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff56ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe76560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff56ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe76560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53762/0 (socket says 172.21.15.84:53762) 2024-09-21T03:47:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff56ffff640 1 -- 172.21.15.84:0/2264530102 learned_addr learned my addr 172.21.15.84:0/2264530102 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:43.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff574eef640 1 --2- 172.21.15.84:0/2264530102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baafa961b0 0x55baafe76020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff5756f0640 1 --2- 172.21.15.84:0/2264530102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafabf070 0x55baafe76aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff56ffff640 1 -- 172.21.15.84:0/2264530102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafabf070 msgr2=0x55baafe76aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff56ffff640 1 --2- 172.21.15.84:0/2264530102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafabf070 0x55baafe76aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff56ffff640 1 -- 172.21.15.84:0/2264530102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baafa961b0 msgr2=0x55baafe76020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff56ffff640 1 --2- 172.21.15.84:0/2264530102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baafa961b0 0x55baafe76020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff56ffff640 1 -- 172.21.15.84:0/2264530102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baafd94c40 con 0x55baafa9e390 2024-09-21T03:47:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff56ffff640 1 --2- 172.21.15.84:0/2264530102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe76560 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00f8c0 tx=0x7ff55c00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b96d04b8631330d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff54ffff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff54ffff640 1 -- 172.21.15.84:0/2264530102 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c026020 con 0x55baafa9e390 2024-09-21T03:47:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.657+0000 7ff57d6c7740 1 -- 172.21.15.84:0/2264530102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff55c017c70 con 0x55baafa9e390 2024-09-21T03:47:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.658+0000 7ff54ffff640 1 -- 172.21.15.84:0/2264530102 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff55c017630 con 0x55baafa9e390 2024-09-21T03:47:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.658+0000 7ff54ffff640 1 -- 172.21.15.84:0/2264530102 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff55c031050 con 0x55baafa9e390 2024-09-21T03:47:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.658+0000 7ff57d6c7740 10 client.16407 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:43.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.658+0000 7ff57d6c7740 1 -- 172.21.15.84:0/2264530102 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55baafe84e50 con 0x55baafa9e390 2024-09-21T03:47:43.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.658+0000 7ff54ffff640 1 -- 172.21.15.84:0/2264530102 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff55c017c70 con 0x55baafa9e390 2024-09-21T03:47:43.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.658+0000 7ff54ffff640 1 -- 172.21.15.84:0/2264530102 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff55c021900 con 0x55baafa9e390 2024-09-21T03:47:43.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.658+0000 7ff57d6c7740 10 client.16407 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:43.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.658+0000 7ff57d6c7740 10 client.16407 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:47:43.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.658+0000 7ff57d6c7740 20 client.16407 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:43.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.658+0000 7ff57d6c7740 1 --2- 172.21.15.84:0/2264530102 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55baafa7d9f0 0x55baafe88270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:43.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.658+0000 7ff57d6c7740 4 client.16407 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:47:43.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.658+0000 7ff57d6c7740 1 -- 172.21.15.84:0/2264530102 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55baafddeda0 con 0x55baafa7d9f0 2024-09-21T03:47:43.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.658+0000 7ff574eef640 1 --2- 172.21.15.84:0/2264530102 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55baafa7d9f0 0x55baafe88270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:43.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.659+0000 7ff54ffff640 10 client.16407 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:43.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.659+0000 7ff574eef640 1 --2- 172.21.15.84:0/2264530102 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55baafa7d9f0 0x55baafe88270 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c9c3ead393e4c3f server_cookie=45728eef3242ebeb in_seq=0 out_seq=0 2024-09-21T03:47:43.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.659+0000 7ff54ffff640 1 -- 172.21.15.84:0/2264530102 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55baafddeda0 con 0x55baafa7d9f0 2024-09-21T03:47:43.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.659+0000 7ff54ffff640 10 client.16407 handle_command_reply: tid=0 2024-09-21T03:47:43.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.659+0000 7ff57d6c7740 1 client.16407 shutdown 2024-09-21T03:47:43.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.660+0000 7ff57d6c7740 1 -- 172.21.15.84:0/2264530102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 msgr2=0x55baafe76560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:43.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.660+0000 7ff57d6c7740 1 --2- 172.21.15.84:0/2264530102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe76560 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00f8c0 tx=0x7ff55c00bf30 comp rx=0 tx=0).stop 2024-09-21T03:47:43.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.660+0000 7ff57d6c7740 1 -- 172.21.15.84:0/2264530102 shutdown_connections 2024-09-21T03:47:43.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.660+0000 7ff57d6c7740 1 --2- 172.21.15.84:0/2264530102 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55baafa7d9f0 0x55baafe88270 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.660+0000 7ff57d6c7740 1 --2- 172.21.15.84:0/2264530102 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafabf070 0x55baafe76aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.660+0000 7ff57d6c7740 1 --2- 172.21.15.84:0/2264530102 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe76560 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.660+0000 7ff57d6c7740 1 --2- 172.21.15.84:0/2264530102 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baafa961b0 0x55baafe76020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.660+0000 7ff57d6c7740 1 -- 172.21.15.84:0/2264530102 >> 172.21.15.84:0/2264530102 conn(0x55baafab3460 msgr2=0x55baafe6dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:43.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.660+0000 7ff54ffff640 0 client.16407 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:43.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.660+0000 7ff57d6c7740 1 -- 172.21.15.84:0/2264530102 shutdown_connections 2024-09-21T03:47:43.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.660+0000 7ff57d6c7740 1 -- 172.21.15.84:0/2264530102 wait complete. 2024-09-21T03:47:43.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.660+0000 7ff57d6c7740 20 client.16407 trim_cache size 0 max 16384 2024-09-21T03:47:43.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.677+0000 7ff57d6c7740 1 Processor -- start 2024-09-21T03:47:43.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.677+0000 7ff57d6c7740 1 -- start start 2024-09-21T03:47:43.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.677+0000 7ff57d6c7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baafa961b0 0x55baafe6c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:43.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.677+0000 7ff57d6c7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe77c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:43.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.677+0000 7ff57d6c7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafabf070 0x55baafe73210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:43.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.677+0000 7ff57d6c7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff5701afb30 con 0x55baafa9e390 2024-09-21T03:47:43.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.677+0000 7ff57d6c7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff5701ad400 con 0x55baafa961b0 2024-09-21T03:47:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.677+0000 7ff57d6c7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff5701ab250 con 0x55baafabf070 2024-09-21T03:47:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.677+0000 7ff56ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe77c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.677+0000 7ff56ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe77c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53776/0 (socket says 172.21.15.84:53776) 2024-09-21T03:47:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.677+0000 7ff56ffff640 1 -- 172.21.15.84:0/113439116 learned_addr learned my addr 172.21.15.84:0/113439116 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.678+0000 7ff574eef640 1 --2- 172.21.15.84:0/113439116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baafa961b0 0x55baafe6c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.678+0000 7ff5756f0640 1 --2- 172.21.15.84:0/113439116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafabf070 0x55baafe73210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.678+0000 7ff56ffff640 1 -- 172.21.15.84:0/113439116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafabf070 msgr2=0x55baafe73210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.678+0000 7ff56ffff640 1 --2- 172.21.15.84:0/113439116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafabf070 0x55baafe73210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.678+0000 7ff56ffff640 1 -- 172.21.15.84:0/113439116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baafa961b0 msgr2=0x55baafe6c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.678+0000 7ff56ffff640 1 --2- 172.21.15.84:0/113439116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baafa961b0 0x55baafe6c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.678+0000 7ff56ffff640 1 -- 172.21.15.84:0/113439116 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baafe772e0 con 0x55baafa9e390 2024-09-21T03:47:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.678+0000 7ff5756f0640 1 --2- 172.21.15.84:0/113439116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafabf070 0x55baafe73210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:47:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.678+0000 7ff56ffff640 1 --2- 172.21.15.84:0/113439116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe77c50 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff55c000c00 tx=0x7ff55c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c639009877edacb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.678+0000 7ff55a7fc640 1 -- 172.21.15.84:0/113439116 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c026070 con 0x55baafa9e390 2024-09-21T03:47:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.678+0000 7ff55a7fc640 1 -- 172.21.15.84:0/113439116 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff55c00b7b0 con 0x55baafa9e390 2024-09-21T03:47:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.678+0000 7ff55a7fc640 1 -- 172.21.15.84:0/113439116 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c021450 con 0x55baafa9e390 2024-09-21T03:47:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.679+0000 7ff57d6c7740 1 -- 172.21.15.84:0/113439116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 msgr2=0x55baafe77c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.679+0000 7ff57d6c7740 1 --2- 172.21.15.84:0/113439116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe77c50 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff55c000c00 tx=0x7ff55c001e70 comp rx=0 tx=0).stop 2024-09-21T03:47:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.679+0000 7ff57d6c7740 1 -- 172.21.15.84:0/113439116 shutdown_connections 2024-09-21T03:47:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.679+0000 7ff57d6c7740 1 --2- 172.21.15.84:0/113439116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafabf070 0x55baafe73210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.679+0000 7ff57d6c7740 1 --2- 172.21.15.84:0/113439116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe77c50 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.679+0000 7ff57d6c7740 1 --2- 172.21.15.84:0/113439116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baafa961b0 0x55baafe6c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.679+0000 7ff57d6c7740 1 -- 172.21.15.84:0/113439116 >> 172.21.15.84:0/113439116 conn(0x55baafab3460 msgr2=0x55baafe77540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.679+0000 7ff57d6c7740 1 -- 172.21.15.84:0/113439116 shutdown_connections 2024-09-21T03:47:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.679+0000 7ff57d6c7740 1 -- 172.21.15.84:0/113439116 wait complete. 2024-09-21T03:47:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.679+0000 7ff57d6c7740 1 -- start start 2024-09-21T03:47:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.680+0000 7ff57d6c7740 1 Processor -- start 2024-09-21T03:47:43.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.680+0000 7ff57d6c7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafa961b0 0x55baafe7ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:43.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.680+0000 7ff57d6c7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe7a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:43.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.680+0000 7ff57d6c7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baafabf070 0x55baafe7a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:43.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.680+0000 7ff57d6c7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff5701ab8c0 con 0x55baafa9e390 2024-09-21T03:47:43.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.680+0000 7ff57d6c7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff5701acd30 con 0x55baafabf070 2024-09-21T03:47:43.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.680+0000 7ff57d6c7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff5701abf90 con 0x55baafa961b0 2024-09-21T03:47:43.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.680+0000 7ff56ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe7a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:43.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.680+0000 7ff57d6c7740 10 client.0 _ll_register_callbacks cb 0x7ff568008550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:43.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.680+0000 7ff56ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe7a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53790/0 (socket says 172.21.15.84:53790) 2024-09-21T03:47:43.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.680+0000 7ff56ffff640 1 -- 172.21.15.84:0/35805296 learned_addr learned my addr 172.21.15.84:0/35805296 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:43.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.680+0000 7ff574eef640 1 --2- 172.21.15.84:0/35805296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafa961b0 0x55baafe7ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:43.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.680+0000 7ff5756f0640 1 --2- 172.21.15.84:0/35805296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baafabf070 0x55baafe7a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:43.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.681+0000 7ff56ffff640 1 -- 172.21.15.84:0/35805296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafa961b0 msgr2=0x55baafe7ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:43.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.681+0000 7ff56ffff640 1 --2- 172.21.15.84:0/35805296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafa961b0 0x55baafe7ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.681+0000 7ff56ffff640 1 -- 172.21.15.84:0/35805296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baafabf070 msgr2=0x55baafe7a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.681+0000 7ff56ffff640 1 --2- 172.21.15.84:0/35805296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baafabf070 0x55baafe7a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.681+0000 7ff56ffff640 1 -- 172.21.15.84:0/35805296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baafe7adb0 con 0x55baafa9e390 2024-09-21T03:47:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.681+0000 7ff56ffff640 1 --2- 172.21.15.84:0/35805296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe7a100 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff55c022040 tx=0x7ff55c00b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217ee8499f8d6767 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.681+0000 7ff54ffff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.681+0000 7ff54ffff640 1 -- 172.21.15.84:0/35805296 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c026040 con 0x55baafa9e390 2024-09-21T03:47:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.681+0000 7ff54ffff640 1 -- 172.21.15.84:0/35805296 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff55c021450 con 0x55baafa9e390 2024-09-21T03:47:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.681+0000 7ff57d6c7740 1 -- 172.21.15.84:0/35805296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55baafdda850 con 0x55baafa9e390 2024-09-21T03:47:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.681+0000 7ff54ffff640 1 -- 172.21.15.84:0/35805296 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff55c021690 con 0x55baafa9e390 2024-09-21T03:47:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.681+0000 7ff57d6c7740 10 client.16413 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.681+0000 7ff57d6c7740 1 -- 172.21.15.84:0/35805296 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55baafef2940 con 0x55baafa9e390 2024-09-21T03:47:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.681+0000 7ff54ffff640 1 -- 172.21.15.84:0/35805296 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55baafdda850 con 0x55baafa9e390 2024-09-21T03:47:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.682+0000 7ff54ffff640 1 -- 172.21.15.84:0/35805296 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff55c00fce0 con 0x55baafa9e390 2024-09-21T03:47:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.682+0000 7ff57d6c7740 10 client.16413 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:43.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.682+0000 7ff57d6c7740 10 client.16413 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:47:43.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.682+0000 7ff57d6c7740 20 client.16413 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:43.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.682+0000 7ff57d6c7740 1 --2- 172.21.15.84:0/35805296 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55baafa52da0 0x55baafef5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:43.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.682+0000 7ff57d6c7740 4 client.16413 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:47:43.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.682+0000 7ff57d6c7740 1 -- 172.21.15.84:0/35805296 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55baafdd7c80 con 0x55baafa52da0 2024-09-21T03:47:43.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.682+0000 7ff574eef640 1 --2- 172.21.15.84:0/35805296 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55baafa52da0 0x55baafef5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:43.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.682+0000 7ff54ffff640 10 client.16413 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:43.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.682+0000 7ff574eef640 1 --2- 172.21.15.84:0/35805296 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55baafa52da0 0x55baafef5000 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0e60d56bb56d754 server_cookie=d8e5a90737e521a4 in_seq=0 out_seq=0 2024-09-21T03:47:43.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.682+0000 7ff54ffff640 1 -- 172.21.15.84:0/35805296 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x55baafdd7c80 con 0x55baafa52da0 2024-09-21T03:47:43.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.682+0000 7ff54ffff640 10 client.16413 handle_command_reply: tid=0 2024-09-21T03:47:43.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.683+0000 7ff57d6c7740 1 client.16413 shutdown 2024-09-21T03:47:43.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.683+0000 7ff57d6c7740 1 -- 172.21.15.84:0/35805296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 msgr2=0x55baafe7a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:43.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.683+0000 7ff57d6c7740 1 --2- 172.21.15.84:0/35805296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe7a100 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff55c022040 tx=0x7ff55c00b6e0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.683+0000 7ff57d6c7740 1 -- 172.21.15.84:0/35805296 shutdown_connections 2024-09-21T03:47:43.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.683+0000 7ff57d6c7740 1 --2- 172.21.15.84:0/35805296 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55baafa52da0 0x55baafef5000 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.683+0000 7ff57d6c7740 1 --2- 172.21.15.84:0/35805296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55baafabf070 0x55baafe7a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.683+0000 7ff57d6c7740 1 --2- 172.21.15.84:0/35805296 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55baafa9e390 0x55baafe7a100 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.683+0000 7ff54ffff640 0 client.16413 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:43.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.683+0000 7ff57d6c7740 1 --2- 172.21.15.84:0/35805296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55baafa961b0 0x55baafe7ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.683+0000 7ff57d6c7740 1 -- 172.21.15.84:0/35805296 >> 172.21.15.84:0/35805296 conn(0x55baafab3460 msgr2=0x55baafe6c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:43.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.683+0000 7ff57d6c7740 1 -- 172.21.15.84:0/35805296 shutdown_connections 2024-09-21T03:47:43.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.683+0000 7ff57d6c7740 1 -- 172.21.15.84:0/35805296 wait complete. 2024-09-21T03:47:43.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.683+0000 7ff57d6c7740 20 client.16413 trim_cache size 0 max 16384 2024-09-21T03:47:43.696 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:47:43.697 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T03:47:43.697 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T03:47:43.697 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:47:43.697 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:47:43.697 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:47:43.697 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:43.697 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:43.697 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:43.697 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:43.697 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:43.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:43.697 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:47:43.697 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:47:43.697 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:43.698 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:43.698 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:43.698 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:43.698 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:43.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:43.698 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:47:43.698 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:47:43.698 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:43.698 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:43.698 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:43.698 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:43.698 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:43.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:43.698 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:47:43.699 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:47:43.699 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:43.699 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:43.699 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:43.699 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:43.699 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:43.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:43.699 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:47:43.699 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:47:43.699 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:43.699 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:43.699 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:43.699 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:43.699 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:43.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:43.700 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:47:43.700 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:47:43.700 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:43.700 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:43.700 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:43.700 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:43.700 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:43.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:43.700 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:47:43.700 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:47:43.700 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:43.700 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:43.700 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:43.700 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:43.701 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:43.701 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:43.701 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:47:43.701 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:47:43.701 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:43.701 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:43.701 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:43.701 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:43.701 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:43.701 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:43.701 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:47:43.701 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:47:43.701 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:43.701 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:43.701 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:43.702 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:43.702 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:43.702 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:47:43.702 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:47:43.702 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:47:43.702 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.683+0000 7ff577153640 1 -- 172.21.15.84:0/3982040713 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff5600b6730 msgr2=0x7ff5600b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.683+0000 7ff577153640 1 --2- 172.21.15.84:0/3982040713 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff5600b6730 0x7ff5600b8c40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff568012730 tx=0x7ff568004ab0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.683+0000 7ff577153640 1 -- 172.21.15.84:0/3982040713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff570102a60 msgr2=0x7ff57019a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.683+0000 7ff577153640 1 --2- 172.21.15.84:0/3982040713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff570102a60 0x7ff57019a410 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff564006010 tx=0x7ff5640042f0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.684+0000 7ff577153640 1 -- 172.21.15.84:0/3982040713 shutdown_connections 2024-09-21T03:47:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.684+0000 7ff577153640 1 --2- 172.21.15.84:0/3982040713 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff5600b6730 0x7ff5600b8c40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.684+0000 7ff577153640 1 --2- 172.21.15.84:0/3982040713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff570108cf0 0x7ff57019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.684+0000 7ff577153640 1 --2- 172.21.15.84:0/3982040713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff5701083a0 0x7ff57019a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.684+0000 7ff577153640 1 --2- 172.21.15.84:0/3982040713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff570102a60 0x7ff57019a410 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.684+0000 7ff577153640 1 -- 172.21.15.84:0/3982040713 >> 172.21.15.84:0/3982040713 conn(0x7ff570079730 msgr2=0x7ff570101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.684+0000 7ff577153640 1 -- 172.21.15.84:0/3982040713 shutdown_connections 2024-09-21T03:47:43.703 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:43.684+0000 7ff577153640 1 -- 172.21.15.84:0/3982040713 wait complete. 2024-09-21T03:47:43.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:43 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:47:43.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:43 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:43.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:43 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:47:43.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:43 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:47:43.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:43 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:47:43.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:43 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:47:43.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:43 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:47:43.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:43 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:47:44.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:44 smithi084 ceph-mon[30941]: pgmap v482: 97 pgs: 97 active+clean; 7.5 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-09-21T03:47:44.609 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:47:44.609 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:47:44.855 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:47:44.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:44 smithi174 ceph-mon[34403]: pgmap v482: 97 pgs: 97 active+clean; 7.5 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-09-21T03:47:44.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:44 smithi172 ceph-mon[34821]: pgmap v482: 97 pgs: 97 active+clean; 7.5 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-09-21T03:47:45.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.313+0000 7fe632a12640 1 -- 172.21.15.84:0/2588587137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe62c1094a0 msgr2=0x7fe62c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.313+0000 7fe632a12640 1 --2- 172.21.15.84:0/2588587137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe62c1094a0 0x7fe62c1098b0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe620009900 tx=0x7fe62002a410 comp rx=0 tx=0).stop 2024-09-21T03:47:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.313+0000 7fe632a12640 1 -- 172.21.15.84:0/2588587137 shutdown_connections 2024-09-21T03:47:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.313+0000 7fe632a12640 1 --2- 172.21.15.84:0/2588587137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe62c109df0 0x7fe62c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.313+0000 7fe632a12640 1 --2- 172.21.15.84:0/2588587137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe62c1094a0 0x7fe62c1098b0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.313+0000 7fe632a12640 1 --2- 172.21.15.84:0/2588587137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe62c103b60 0x7fe62c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.313+0000 7fe632a12640 1 -- 172.21.15.84:0/2588587137 >> 172.21.15.84:0/2588587137 conn(0x7fe62c07b850 msgr2=0x7fe62c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.313+0000 7fe632a12640 1 -- 172.21.15.84:0/2588587137 shutdown_connections 2024-09-21T03:47:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.313+0000 7fe632a12640 1 -- 172.21.15.84:0/2588587137 wait complete. 2024-09-21T03:47:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.313+0000 7fe632a12640 1 Processor -- start 2024-09-21T03:47:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.314+0000 7fe632a12640 1 -- start start 2024-09-21T03:47:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.314+0000 7fe632a12640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe62c103b60 0x7fe62c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.314+0000 7fe632a12640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe62c1094a0 0x7fe62c19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:45.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.314+0000 7fe632a12640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe62c109df0 0x7fe62c19fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.314+0000 7fe632a12640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c113b50 con 0x7fe62c103b60 2024-09-21T03:47:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.314+0000 7fe632a12640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c1139d0 con 0x7fe62c1094a0 2024-09-21T03:47:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.314+0000 7fe632a12640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c113cd0 con 0x7fe62c109df0 2024-09-21T03:47:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.314+0000 7fe62bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe62c103b60 0x7fe62c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.314+0000 7fe62bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe62c103b60 0x7fe62c19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53804/0 (socket says 172.21.15.84:53804) 2024-09-21T03:47:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.314+0000 7fe62bfff640 1 -- 172.21.15.84:0/2419678063 learned_addr learned my addr 172.21.15.84:0/2419678063 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.314+0000 7fe62b7fe640 1 --2- 172.21.15.84:0/2419678063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe62c1094a0 0x7fe62c19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.314+0000 7fe62bfff640 1 -- 172.21.15.84:0/2419678063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe62c109df0 msgr2=0x7fe62c19fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.314+0000 7fe62bfff640 1 --2- 172.21.15.84:0/2419678063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe62c109df0 0x7fe62c19fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.314+0000 7fe62bfff640 1 -- 172.21.15.84:0/2419678063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe62c1094a0 msgr2=0x7fe62c19abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.314+0000 7fe62bfff640 1 --2- 172.21.15.84:0/2419678063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe62c1094a0 0x7fe62c19abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.314+0000 7fe62bfff640 1 -- 172.21.15.84:0/2419678063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62c1a05b0 con 0x7fe62c103b60 2024-09-21T03:47:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.315+0000 7fe62bfff640 1 --2- 172.21.15.84:0/2419678063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe62c103b60 0x7fe62c19a640 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe61c00b4a0 tx=0x7fe61c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:45.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.315+0000 7fe6297fa640 1 -- 172.21.15.84:0/2419678063 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61c014070 con 0x7fe62c103b60 2024-09-21T03:47:45.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.315+0000 7fe6297fa640 1 -- 172.21.15.84:0/2419678063 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe61c010ac0 con 0x7fe62c103b60 2024-09-21T03:47:45.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.315+0000 7fe632a12640 1 -- 172.21.15.84:0/2419678063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe62c1a08a0 con 0x7fe62c103b60 2024-09-21T03:47:45.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.315+0000 7fe6297fa640 1 -- 172.21.15.84:0/2419678063 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61c017c30 con 0x7fe62c103b60 2024-09-21T03:47:45.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.315+0000 7fe632a12640 1 -- 172.21.15.84:0/2419678063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe62c1a7000 con 0x7fe62c103b60 2024-09-21T03:47:45.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.316+0000 7fe632a12640 1 -- 172.21.15.84:0/2419678063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe62c103ff0 con 0x7fe62c103b60 2024-09-21T03:47:45.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.318+0000 7fe6297fa640 1 -- 172.21.15.84:0/2419678063 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fe61c017070 con 0x7fe62c103b60 2024-09-21T03:47:45.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.318+0000 7fe6297fa640 1 --2- 172.21.15.84:0/2419678063 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe6140b6680 0x7fe6140b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:45.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.318+0000 7fe62b7fe640 1 --2- 172.21.15.84:0/2419678063 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe6140b6680 0x7fe6140b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:45.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.318+0000 7fe6297fa640 1 -- 172.21.15.84:0/2419678063 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe61c0e6d00 con 0x7fe62c103b60 2024-09-21T03:47:45.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.319+0000 7fe62b7fe640 1 --2- 172.21.15.84:0/2419678063 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe6140b6680 0x7fe6140b8b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe620009230 tx=0x7fe620031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:45.353 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.321+0000 7fe6297fa640 1 -- 172.21.15.84:0/2419678063 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe61c0ad2d0 con 0x7fe62c103b60 2024-09-21T03:47:45.539 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.537+0000 7fe632a12640 1 -- 172.21.15.84:0/2419678063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe62c19b770 con 0x7fe62c103b60 2024-09-21T03:47:45.540 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.538+0000 7fe6297fa640 1 -- 172.21.15.84:0/2419678063 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7fe61c0b16b0 con 0x7fe62c103b60 2024-09-21T03:47:45.540 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:47:45.541 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:47:45.541 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:47:45.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.540+0000 7fe632a12640 1 -- 172.21.15.84:0/2419678063 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe6140b6680 msgr2=0x7fe6140b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:45.542 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.540+0000 7fe632a12640 1 --2- 172.21.15.84:0/2419678063 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe6140b6680 0x7fe6140b8b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe620009230 tx=0x7fe620031400 comp rx=0 tx=0).stop 2024-09-21T03:47:45.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.540+0000 7fe632a12640 1 -- 172.21.15.84:0/2419678063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe62c103b60 msgr2=0x7fe62c19a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:45.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.540+0000 7fe632a12640 1 --2- 172.21.15.84:0/2419678063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe62c103b60 0x7fe62c19a640 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe61c00b4a0 tx=0x7fe61c00b960 comp rx=0 tx=0).stop 2024-09-21T03:47:45.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.540+0000 7fe632a12640 1 -- 172.21.15.84:0/2419678063 shutdown_connections 2024-09-21T03:47:45.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.540+0000 7fe632a12640 1 --2- 172.21.15.84:0/2419678063 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe6140b6680 0x7fe6140b8b90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:45.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.540+0000 7fe632a12640 1 --2- 172.21.15.84:0/2419678063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe62c109df0 0x7fe62c19fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:45.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.540+0000 7fe632a12640 1 --2- 172.21.15.84:0/2419678063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe62c1094a0 0x7fe62c19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:45.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.540+0000 7fe632a12640 1 --2- 172.21.15.84:0/2419678063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe62c103b60 0x7fe62c19a640 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:45.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.540+0000 7fe632a12640 1 -- 172.21.15.84:0/2419678063 >> 172.21.15.84:0/2419678063 conn(0x7fe62c07b850 msgr2=0x7fe62c1075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:45.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.540+0000 7fe632a12640 1 -- 172.21.15.84:0/2419678063 shutdown_connections 2024-09-21T03:47:45.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:45.541+0000 7fe632a12640 1 -- 172.21.15.84:0/2419678063 wait complete. 2024-09-21T03:47:45.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:45 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2419678063' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:47:45.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:45 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2419678063' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:47:45.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:45 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2419678063' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:47:46.268 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:47:46.513 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:47:46.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:46 smithi174 ceph-mon[34403]: pgmap v483: 97 pgs: 97 active+clean; 7.5 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-09-21T03:47:46.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:46 smithi172 ceph-mon[34821]: pgmap v483: 97 pgs: 97 active+clean; 7.5 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-09-21T03:47:46.933 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:46 smithi084 ceph-mon[30941]: pgmap v483: 97 pgs: 97 active+clean; 7.5 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-09-21T03:47:47.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.023+0000 7f5f874fa640 1 -- 172.21.15.84:0/1773444492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f80103b60 msgr2=0x7f5f80103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:47.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.023+0000 7f5f874fa640 1 --2- 172.21.15.84:0/1773444492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f80103b60 0x7f5f80103f70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009ca0 tx=0x7f5f7002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.023+0000 7f5f874fa640 1 -- 172.21.15.84:0/1773444492 shutdown_connections 2024-09-21T03:47:47.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.023+0000 7f5f874fa640 1 --2- 172.21.15.84:0/1773444492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f80109df0 0x7f5f80110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.023+0000 7f5f874fa640 1 --2- 172.21.15.84:0/1773444492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f801094a0 0x7f5f801098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.023+0000 7f5f874fa640 1 --2- 172.21.15.84:0/1773444492 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f80103b60 0x7f5f80103f70 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.023+0000 7f5f874fa640 1 -- 172.21.15.84:0/1773444492 >> 172.21.15.84:0/1773444492 conn(0x7f5f8007b850 msgr2=0x7f5f8007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:47.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.023+0000 7f5f874fa640 1 -- 172.21.15.84:0/1773444492 shutdown_connections 2024-09-21T03:47:47.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.023+0000 7f5f874fa640 1 -- 172.21.15.84:0/1773444492 wait complete. 2024-09-21T03:47:47.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.024+0000 7f5f874fa640 1 Processor -- start 2024-09-21T03:47:47.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.024+0000 7f5f874fa640 1 -- start start 2024-09-21T03:47:47.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.024+0000 7f5f874fa640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f80103b60 0x7f5f80075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:47.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.024+0000 7f5f874fa640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f801094a0 0x7f5f80075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:47.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.024+0000 7f5f874fa640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f80109df0 0x7f5f80076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:47.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.024+0000 7f5f874fa640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5f80113ab0 con 0x7f5f80103b60 2024-09-21T03:47:47.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.024+0000 7f5f874fa640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5f80113930 con 0x7f5f801094a0 2024-09-21T03:47:47.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.024+0000 7f5f874fa640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5f80113c30 con 0x7f5f80109df0 2024-09-21T03:47:47.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.024+0000 7f5f85296640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f80103b60 0x7f5f80075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:47.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.024+0000 7f5f85296640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f80103b60 0x7f5f80075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53818/0 (socket says 172.21.15.84:53818) 2024-09-21T03:47:47.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.024+0000 7f5f85296640 1 -- 172.21.15.84:0/1038157530 learned_addr learned my addr 172.21.15.84:0/1038157530 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:47.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.024+0000 7f5f84a95640 1 --2- 172.21.15.84:0/1038157530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f801094a0 0x7f5f80075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:47.045 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.025+0000 7f5f85a97640 1 --2- 172.21.15.84:0/1038157530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f80109df0 0x7f5f80076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:47.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.025+0000 7f5f85296640 1 -- 172.21.15.84:0/1038157530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f80109df0 msgr2=0x7f5f80076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:47.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.025+0000 7f5f85296640 1 --2- 172.21.15.84:0/1038157530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f80109df0 0x7f5f80076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.025+0000 7f5f85296640 1 -- 172.21.15.84:0/1038157530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f801094a0 msgr2=0x7f5f80075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:47.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.025+0000 7f5f85296640 1 --2- 172.21.15.84:0/1038157530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f801094a0 0x7f5f80075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.025+0000 7f5f85296640 1 -- 172.21.15.84:0/1038157530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f801a86b0 con 0x7f5f80103b60 2024-09-21T03:47:47.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.025+0000 7f5f85a97640 1 --2- 172.21.15.84:0/1038157530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f80109df0 0x7f5f80076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:47:47.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.025+0000 7f5f85296640 1 --2- 172.21.15.84:0/1038157530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f80103b60 0x7f5f80075710 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5f70006010 tx=0x7f5f700319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:47.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.025+0000 7f5f7e7fc640 1 -- 172.21.15.84:0/1038157530 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f70003bf0 con 0x7f5f80103b60 2024-09-21T03:47:47.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.025+0000 7f5f874fa640 1 -- 172.21.15.84:0/1038157530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f801a8940 con 0x7f5f80103b60 2024-09-21T03:47:47.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.025+0000 7f5f7e7fc640 1 -- 172.21.15.84:0/1038157530 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f70003d90 con 0x7f5f80103b60 2024-09-21T03:47:47.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.025+0000 7f5f7e7fc640 1 -- 172.21.15.84:0/1038157530 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7002fc20 con 0x7f5f80103b60 2024-09-21T03:47:47.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.025+0000 7f5f874fa640 1 -- 172.21.15.84:0/1038157530 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f801a8ed0 con 0x7f5f80103b60 2024-09-21T03:47:47.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.028+0000 7f5f7e7fc640 1 -- 172.21.15.84:0/1038157530 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f5f700046a0 con 0x7f5f80103b60 2024-09-21T03:47:47.046 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.028+0000 7f5f8da6e740 1 Processor -- start 2024-09-21T03:47:47.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.028+0000 7f5f8da6e740 1 -- start start 2024-09-21T03:47:47.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.028+0000 7f5f8da6e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f7a070 0x5572c13216a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:47.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.028+0000 7f5f8da6e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f511b0 0x5572c1321be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:47.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.028+0000 7f5f8da6e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f59390 0x5572c1322120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:47.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.028+0000 7f5f8da6e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5572c1297ea0 con 0x5572c0f511b0 2024-09-21T03:47:47.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.028+0000 7f5f8da6e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5572c12872d0 con 0x5572c0f7a070 2024-09-21T03:47:47.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.028+0000 7f5f8da6e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5572c128b0e0 con 0x5572c0f59390 2024-09-21T03:47:47.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.028+0000 7f5f85296640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f511b0 0x5572c1321be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:47.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.029+0000 7f5f7e7fc640 1 --2- 172.21.15.84:0/1038157530 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f680b6680 0x7f5f680b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:47.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.029+0000 7f5f85296640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f511b0 0x5572c1321be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53832/0 (socket says 172.21.15.84:53832) 2024-09-21T03:47:47.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.029+0000 7f5f85296640 1 -- 172.21.15.84:0/360149733 learned_addr learned my addr 172.21.15.84:0/360149733 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:47.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.029+0000 7f5f85a97640 1 --2- 172.21.15.84:0/360149733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f7a070 0x5572c13216a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:47.047 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.029+0000 7f5f84a95640 1 --2- 172.21.15.84:0/360149733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f59390 0x5572c1322120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:47.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.029+0000 7f5f85a97640 1 --2- 172.21.15.84:0/1038157530 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f680b6680 0x7f5f680b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:47.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.029+0000 7f5f7e7fc640 1 -- 172.21.15.84:0/1038157530 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f5f70108a90 con 0x7f5f80103b60 2024-09-21T03:47:47.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.029+0000 7f5f85296640 1 -- 172.21.15.84:0/360149733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f59390 msgr2=0x5572c1322120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:47.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.029+0000 7f5f85296640 1 --2- 172.21.15.84:0/360149733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f59390 0x5572c1322120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.029+0000 7f5f85296640 1 -- 172.21.15.84:0/360149733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f7a070 msgr2=0x5572c13216a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:47.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.029+0000 7f5f85296640 1 --2- 172.21.15.84:0/360149733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f7a070 0x5572c13216a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.029+0000 7f5f85296640 1 -- 172.21.15.84:0/360149733 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572c0fe5650 con 0x5572c0f511b0 2024-09-21T03:47:47.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.029+0000 7f5f85296640 1 --2- 172.21.15.84:0/360149733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f511b0 0x5572c1321be0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5f70106200 tx=0x7f5f700ce860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1082387a688b557f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:47.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.029+0000 7f5f85a97640 1 --2- 172.21.15.84:0/1038157530 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f680b6680 0x7f5f680b8b90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5f78005d00 tx=0x7f5f78005c90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:47.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.029+0000 7f5f677fe640 1 -- 172.21.15.84:0/360149733 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f700d3440 con 0x5572c0f511b0 2024-09-21T03:47:47.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.029+0000 7f5f677fe640 1 -- 172.21.15.84:0/360149733 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f70036070 con 0x5572c0f511b0 2024-09-21T03:47:47.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.029+0000 7f5f677fe640 1 -- 172.21.15.84:0/360149733 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f700d7ef0 con 0x5572c0f511b0 2024-09-21T03:47:47.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.030+0000 7f5f8da6e740 1 -- 172.21.15.84:0/360149733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f511b0 msgr2=0x5572c1321be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:47.048 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.030+0000 7f5f8da6e740 1 --2- 172.21.15.84:0/360149733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f511b0 0x5572c1321be0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5f70106200 tx=0x7f5f700ce860 comp rx=0 tx=0).stop 2024-09-21T03:47:47.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.030+0000 7f5f8da6e740 1 -- 172.21.15.84:0/360149733 shutdown_connections 2024-09-21T03:47:47.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.030+0000 7f5f8da6e740 1 --2- 172.21.15.84:0/360149733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f59390 0x5572c1322120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.030+0000 7f5f8da6e740 1 --2- 172.21.15.84:0/360149733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f511b0 0x5572c1321be0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.030+0000 7f5f8da6e740 1 --2- 172.21.15.84:0/360149733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f7a070 0x5572c13216a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.030+0000 7f5f8da6e740 1 -- 172.21.15.84:0/360149733 >> 172.21.15.84:0/360149733 conn(0x5572c0f6e460 msgr2=0x5572c131f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:47.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.030+0000 7f5f8da6e740 1 -- 172.21.15.84:0/360149733 shutdown_connections 2024-09-21T03:47:47.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.030+0000 7f5f8da6e740 1 -- 172.21.15.84:0/360149733 wait complete. 2024-09-21T03:47:47.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.031+0000 7f5f8da6e740 1 -- start start 2024-09-21T03:47:47.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.031+0000 7f5f8da6e740 1 Processor -- start 2024-09-21T03:47:47.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.031+0000 7f5f8da6e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f511b0 0x5572c132cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:47.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.031+0000 7f5f8da6e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 0x5572c132d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:47.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.031+0000 7f5f8da6e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f7a070 0x5572c1338d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:47.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.031+0000 7f5f8da6e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5572c10e8700 con 0x5572c0f59390 2024-09-21T03:47:47.049 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.031+0000 7f5f8da6e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5572c1222160 con 0x5572c0f511b0 2024-09-21T03:47:47.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.031+0000 7f5f8da6e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5572c1297ea0 con 0x5572c0f7a070 2024-09-21T03:47:47.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.031+0000 7f5f8da6e740 10 client.0 _ll_register_callbacks cb 0x5572c123b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:47.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.031+0000 7f5f84a95640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 0x5572c132d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:47.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.031+0000 7f5f84a95640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 0x5572c132d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53842/0 (socket says 172.21.15.84:53842) 2024-09-21T03:47:47.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.031+0000 7f5f84a95640 1 -- 172.21.15.84:0/518557802 learned_addr learned my addr 172.21.15.84:0/518557802 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:47.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.032+0000 7f5f85a97640 1 --2- 172.21.15.84:0/518557802 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f7a070 0x5572c1338d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:47.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.032+0000 7f5f84a95640 1 -- 172.21.15.84:0/518557802 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f7a070 msgr2=0x5572c1338d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:47.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.032+0000 7f5f84a95640 1 --2- 172.21.15.84:0/518557802 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f7a070 0x5572c1338d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.032+0000 7f5f85296640 1 --2- 172.21.15.84:0/518557802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f511b0 0x5572c132cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:47.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.032+0000 7f5f84a95640 1 -- 172.21.15.84:0/518557802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f511b0 msgr2=0x5572c132cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:47.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.032+0000 7f5f84a95640 1 --2- 172.21.15.84:0/518557802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f511b0 0x5572c132cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.032+0000 7f5f84a95640 1 -- 172.21.15.84:0/518557802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572c124fc90 con 0x5572c0f59390 2024-09-21T03:47:47.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.032+0000 7f5f85a97640 1 --2- 172.21.15.84:0/518557802 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f7a070 0x5572c1338d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:47:47.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.032+0000 7f5f85296640 1 --2- 172.21.15.84:0/518557802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f511b0 0x5572c132cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:47:47.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.032+0000 7f5f84a95640 1 --2- 172.21.15.84:0/518557802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 0x5572c132d2a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5f7400ce30 tx=0x7f5f740039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a54eb837112b7f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:47.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.032+0000 7f5f64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:47.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.032+0000 7f5f64ff9640 1 -- 172.21.15.84:0/518557802 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f74011970 con 0x5572c0f59390 2024-09-21T03:47:47.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.032+0000 7f5f64ff9640 1 -- 172.21.15.84:0/518557802 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f5f74011b10 con 0x5572c0f59390 2024-09-21T03:47:47.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.032+0000 7f5f8da6e740 1 -- 172.21.15.84:0/518557802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f70036070 con 0x5572c0f59390 2024-09-21T03:47:47.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.032+0000 7f5f64ff9640 1 -- 172.21.15.84:0/518557802 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5f74011d10 con 0x5572c0f59390 2024-09-21T03:47:47.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.032+0000 7f5f8da6e740 10 client.16431 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:47.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.032+0000 7f5f8da6e740 1 -- 172.21.15.84:0/518557802 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5572c133b770 con 0x5572c0f59390 2024-09-21T03:47:47.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.032+0000 7f5f64ff9640 1 -- 172.21.15.84:0/518557802 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f70036070 con 0x5572c0f59390 2024-09-21T03:47:47.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.033+0000 7f5f64ff9640 1 -- 172.21.15.84:0/518557802 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5f74018070 con 0x5572c0f59390 2024-09-21T03:47:47.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.033+0000 7f5f8da6e740 10 client.16431 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:47.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.033+0000 7f5f8da6e740 10 client.16431 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:47:47.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.033+0000 7f5f8da6e740 20 client.16431 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:47.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.033+0000 7f5f8da6e740 1 --2- 172.21.15.84:0/518557802 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5572c0f389f0 0x5572c133ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:47.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.033+0000 7f5f8da6e740 4 client.16431 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:47:47.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.033+0000 7f5f8da6e740 1 -- 172.21.15.84:0/518557802 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572c1299df0 con 0x5572c0f389f0 2024-09-21T03:47:47.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.033+0000 7f5f85296640 1 --2- 172.21.15.84:0/518557802 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5572c0f389f0 0x5572c133ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:47.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.034+0000 7f5f64ff9640 10 client.16431 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:47:47.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.034+0000 7f5f85296640 1 --2- 172.21.15.84:0/518557802 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5572c0f389f0 0x5572c133ecc0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bcd732f6354bada6 server_cookie=f10a370b67229535 in_seq=0 out_seq=0 2024-09-21T03:47:47.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.034+0000 7f5f64ff9640 1 -- 172.21.15.84:0/518557802 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5572c1299df0 con 0x5572c0f389f0 2024-09-21T03:47:47.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.034+0000 7f5f64ff9640 10 client.16431 handle_command_reply: tid=0 2024-09-21T03:47:47.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.034+0000 7f5f8da6e740 1 client.16431 shutdown 2024-09-21T03:47:47.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.035+0000 7f5f8da6e740 1 -- 172.21.15.84:0/518557802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 msgr2=0x5572c132d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:47.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.035+0000 7f5f8da6e740 1 --2- 172.21.15.84:0/518557802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 0x5572c132d2a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5f7400ce30 tx=0x7f5f740039c0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.035+0000 7f5f8da6e740 1 -- 172.21.15.84:0/518557802 shutdown_connections 2024-09-21T03:47:47.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.035+0000 7f5f8da6e740 1 --2- 172.21.15.84:0/518557802 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5572c0f389f0 0x5572c133ecc0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.035+0000 7f5f8da6e740 1 --2- 172.21.15.84:0/518557802 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f7a070 0x5572c1338d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.035+0000 7f5f8da6e740 1 --2- 172.21.15.84:0/518557802 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 0x5572c132d2a0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.035+0000 7f5f8da6e740 1 --2- 172.21.15.84:0/518557802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f511b0 0x5572c132cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.035+0000 7f5f64ff9640 0 client.16431 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:47:47.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.035+0000 7f5f8da6e740 1 -- 172.21.15.84:0/518557802 >> 172.21.15.84:0/518557802 conn(0x5572c0f6e460 msgr2=0x5572c1324830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:47.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.035+0000 7f5f8da6e740 1 -- 172.21.15.84:0/518557802 shutdown_connections 2024-09-21T03:47:47.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.035+0000 7f5f8da6e740 1 -- 172.21.15.84:0/518557802 wait complete. 2024-09-21T03:47:47.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.035+0000 7f5f8da6e740 20 client.16431 trim_cache size 0 max 16384 2024-09-21T03:47:47.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.048+0000 7f5f8da6e740 1 Processor -- start 2024-09-21T03:47:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.048+0000 7f5f8da6e740 1 -- start start 2024-09-21T03:47:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.049+0000 7f5f8da6e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f511b0 0x5572c132bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.049+0000 7f5f8da6e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 0x5572c1322de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.049+0000 7f5f8da6e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f7a070 0x5572c131ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.049+0000 7f5f8da6e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5f801b4040 con 0x5572c0f59390 2024-09-21T03:47:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.049+0000 7f5f8da6e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5f801b1910 con 0x5572c0f7a070 2024-09-21T03:47:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.049+0000 7f5f8da6e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5f801af760 con 0x5572c0f511b0 2024-09-21T03:47:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.049+0000 7f5f84a95640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 0x5572c1322de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.049+0000 7f5f84a95640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 0x5572c1322de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53854/0 (socket says 172.21.15.84:53854) 2024-09-21T03:47:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.049+0000 7f5f84a95640 1 -- 172.21.15.84:0/3271318351 learned_addr learned my addr 172.21.15.84:0/3271318351 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.049+0000 7f5f85296640 1 --2- 172.21.15.84:0/3271318351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f511b0 0x5572c132bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.049+0000 7f5f85a97640 1 --2- 172.21.15.84:0/3271318351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f7a070 0x5572c131ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:47.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.049+0000 7f5f84a95640 1 -- 172.21.15.84:0/3271318351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f511b0 msgr2=0x5572c132bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:47.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.049+0000 7f5f84a95640 1 --2- 172.21.15.84:0/3271318351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f511b0 0x5572c132bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.049+0000 7f5f84a95640 1 -- 172.21.15.84:0/3271318351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f7a070 msgr2=0x5572c131ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:47.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.049+0000 7f5f84a95640 1 --2- 172.21.15.84:0/3271318351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f7a070 0x5572c131ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.049+0000 7f5f84a95640 1 -- 172.21.15.84:0/3271318351 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572c13393d0 con 0x5572c0f59390 2024-09-21T03:47:47.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.049+0000 7f5f85a97640 1 --2- 172.21.15.84:0/3271318351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f7a070 0x5572c131ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:47:47.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.049+0000 7f5f85296640 1 --2- 172.21.15.84:0/3271318351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f511b0 0x5572c132bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:47:47.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.049+0000 7f5f84a95640 1 --2- 172.21.15.84:0/3271318351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 0x5572c1322de0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f5f740195c0 tx=0x7f5f74012ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5cf3630f6d63ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:47.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.050+0000 7f5f66ffd640 1 -- 172.21.15.84:0/3271318351 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f74027070 con 0x5572c0f59390 2024-09-21T03:47:47.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.050+0000 7f5f66ffd640 1 -- 172.21.15.84:0/3271318351 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f74029070 con 0x5572c0f59390 2024-09-21T03:47:47.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.050+0000 7f5f66ffd640 1 -- 172.21.15.84:0/3271318351 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7402e7a0 con 0x5572c0f59390 2024-09-21T03:47:47.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.050+0000 7f5f8da6e740 1 -- 172.21.15.84:0/3271318351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 msgr2=0x5572c1322de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:47.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.051+0000 7f5f8da6e740 1 --2- 172.21.15.84:0/3271318351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 0x5572c1322de0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f5f740195c0 tx=0x7f5f74012ec0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.051+0000 7f5f8da6e740 1 -- 172.21.15.84:0/3271318351 shutdown_connections 2024-09-21T03:47:47.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.051+0000 7f5f8da6e740 1 --2- 172.21.15.84:0/3271318351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f7a070 0x5572c131ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.051+0000 7f5f8da6e740 1 --2- 172.21.15.84:0/3271318351 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 0x5572c1322de0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.051+0000 7f5f8da6e740 1 --2- 172.21.15.84:0/3271318351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f511b0 0x5572c132bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.051+0000 7f5f8da6e740 1 -- 172.21.15.84:0/3271318351 >> 172.21.15.84:0/3271318351 conn(0x5572c0f6e460 msgr2=0x5572c13226d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:47.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.051+0000 7f5f8da6e740 1 -- 172.21.15.84:0/3271318351 shutdown_connections 2024-09-21T03:47:47.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.051+0000 7f5f8da6e740 1 -- 172.21.15.84:0/3271318351 wait complete. 2024-09-21T03:47:47.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.051+0000 7f5f8da6e740 1 -- start start 2024-09-21T03:47:47.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.051+0000 7f5f8da6e740 1 Processor -- start 2024-09-21T03:47:47.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.052+0000 7f5f8da6e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f511b0 0x5572c1330ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:47.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.052+0000 7f5f8da6e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 0x5572c1331430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:47.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.052+0000 7f5f8da6e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f7a070 0x5572c13319b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:47.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.052+0000 7f5f8da6e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5f801afdd0 con 0x5572c0f59390 2024-09-21T03:47:47.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.052+0000 7f5f8da6e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5f801b1240 con 0x5572c0f7a070 2024-09-21T03:47:47.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.052+0000 7f5f8da6e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5f801b04a0 con 0x5572c0f511b0 2024-09-21T03:47:47.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.052+0000 7f5f84a95640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 0x5572c1331430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:47.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.052+0000 7f5f8da6e740 10 client.0 _ll_register_callbacks cb 0x7f5f7400ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:47.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.052+0000 7f5f84a95640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 0x5572c1331430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53868/0 (socket says 172.21.15.84:53868) 2024-09-21T03:47:47.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.052+0000 7f5f84a95640 1 -- 172.21.15.84:0/163741046 learned_addr learned my addr 172.21.15.84:0/163741046 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:47.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.052+0000 7f5f85a97640 1 --2- 172.21.15.84:0/163741046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f7a070 0x5572c13319b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:47.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.052+0000 7f5f85296640 1 --2- 172.21.15.84:0/163741046 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f511b0 0x5572c1330ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:47.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.052+0000 7f5f84a95640 1 -- 172.21.15.84:0/163741046 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f511b0 msgr2=0x5572c1330ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:47.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.052+0000 7f5f84a95640 1 --2- 172.21.15.84:0/163741046 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f511b0 0x5572c1330ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.052+0000 7f5f84a95640 1 -- 172.21.15.84:0/163741046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f7a070 msgr2=0x5572c13319b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:47.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.052+0000 7f5f84a95640 1 --2- 172.21.15.84:0/163741046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f7a070 0x5572c13319b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.052+0000 7f5f84a95640 1 -- 172.21.15.84:0/163741046 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572c13a8910 con 0x5572c0f59390 2024-09-21T03:47:47.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.052+0000 7f5f85a97640 1 --2- 172.21.15.84:0/163741046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f7a070 0x5572c13319b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:47:47.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.052+0000 7f5f84a95640 1 --2- 172.21.15.84:0/163741046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 0x5572c1331430 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f5f74019640 tx=0x7f5f740194d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a3e4ba8d6cd650 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:47.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.052+0000 7f5f64ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:47.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.053+0000 7f5f64ff9640 1 -- 172.21.15.84:0/163741046 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f74027050 con 0x5572c0f59390 2024-09-21T03:47:47.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.053+0000 7f5f64ff9640 1 -- 172.21.15.84:0/163741046 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f5f7402e470 con 0x5572c0f59390 2024-09-21T03:47:47.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.053+0000 7f5f8da6e740 1 -- 172.21.15.84:0/163741046 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f74029070 con 0x5572c0f59390 2024-09-21T03:47:47.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.053+0000 7f5f64ff9640 1 -- 172.21.15.84:0/163741046 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5f7402e670 con 0x5572c0f59390 2024-09-21T03:47:47.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.053+0000 7f5f8da6e740 10 client.16437 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:47.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.053+0000 7f5f8da6e740 1 -- 172.21.15.84:0/163741046 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5572c13a9b00 con 0x5572c0f59390 2024-09-21T03:47:47.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.053+0000 7f5f64ff9640 1 -- 172.21.15.84:0/163741046 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f74029070 con 0x5572c0f59390 2024-09-21T03:47:47.137 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.053+0000 7f5f64ff9640 1 -- 172.21.15.84:0/163741046 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5f74018040 con 0x5572c0f59390 2024-09-21T03:47:47.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.053+0000 7f5f8da6e740 10 client.16437 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:47.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.053+0000 7f5f8da6e740 10 client.16437 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:47:47.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.053+0000 7f5f8da6e740 20 client.16437 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:47.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.053+0000 7f5f8da6e740 1 --2- 172.21.15.84:0/163741046 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5572c0f0dda0 0x5572c13ac240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:47.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.053+0000 7f5f8da6e740 4 client.16437 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:47:47.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.053+0000 7f5f8da6e740 1 -- 172.21.15.84:0/163741046 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5572c12958a0 con 0x5572c0f0dda0 2024-09-21T03:47:47.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.054+0000 7f5f85296640 1 --2- 172.21.15.84:0/163741046 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5572c0f0dda0 0x5572c13ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:47.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.054+0000 7f5f64ff9640 10 client.16437 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:47:47.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.054+0000 7f5f85296640 1 --2- 172.21.15.84:0/163741046 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5572c0f0dda0 0x5572c13ac240 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=986c653b0724dbf2 server_cookie=e1f0a4c973e636fe in_seq=0 out_seq=0 2024-09-21T03:47:47.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.054+0000 7f5f64ff9640 1 -- 172.21.15.84:0/163741046 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5572c12958a0 con 0x5572c0f0dda0 2024-09-21T03:47:47.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.054+0000 7f5f64ff9640 10 client.16437 handle_command_reply: tid=0 2024-09-21T03:47:47.138 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.054+0000 7f5f8da6e740 1 client.16437 shutdown 2024-09-21T03:47:47.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.054+0000 7f5f8da6e740 1 -- 172.21.15.84:0/163741046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 msgr2=0x5572c1331430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:47.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.054+0000 7f5f8da6e740 1 --2- 172.21.15.84:0/163741046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 0x5572c1331430 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f5f74019640 tx=0x7f5f740194d0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.054+0000 7f5f8da6e740 1 -- 172.21.15.84:0/163741046 shutdown_connections 2024-09-21T03:47:47.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.054+0000 7f5f8da6e740 1 --2- 172.21.15.84:0/163741046 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5572c0f0dda0 0x5572c13ac240 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.054+0000 7f5f8da6e740 1 --2- 172.21.15.84:0/163741046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5572c0f7a070 0x5572c13319b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.054+0000 7f5f64ff9640 0 client.16437 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:47:47.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.054+0000 7f5f8da6e740 1 --2- 172.21.15.84:0/163741046 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5572c0f59390 0x5572c1331430 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.054+0000 7f5f8da6e740 1 --2- 172.21.15.84:0/163741046 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5572c0f511b0 0x5572c1330ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.054+0000 7f5f8da6e740 1 -- 172.21.15.84:0/163741046 >> 172.21.15.84:0/163741046 conn(0x5572c0f6e460 msgr2=0x5572c132e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:47.139 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.054+0000 7f5f8da6e740 1 -- 172.21.15.84:0/163741046 shutdown_connections 2024-09-21T03:47:47.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.054+0000 7f5f8da6e740 1 -- 172.21.15.84:0/163741046 wait complete. 2024-09-21T03:47:47.140 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.055+0000 7f5f8da6e740 20 client.16437 trim_cache size 0 max 16384 2024-09-21T03:47:47.140 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:47:47.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.055+0000 7f5f874fa640 1 -- 172.21.15.84:0/1038157530 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f680b6680 msgr2=0x7f5f680b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:47.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.055+0000 7f5f874fa640 1 --2- 172.21.15.84:0/1038157530 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f680b6680 0x7f5f680b8b90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5f78005d00 tx=0x7f5f78005c90 comp rx=0 tx=0).stop 2024-09-21T03:47:47.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.055+0000 7f5f874fa640 1 -- 172.21.15.84:0/1038157530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f80103b60 msgr2=0x7f5f80075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:47.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.055+0000 7f5f874fa640 1 --2- 172.21.15.84:0/1038157530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f80103b60 0x7f5f80075710 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5f70006010 tx=0x7f5f700319f0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.055+0000 7f5f874fa640 1 -- 172.21.15.84:0/1038157530 shutdown_connections 2024-09-21T03:47:47.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.055+0000 7f5f874fa640 1 --2- 172.21.15.84:0/1038157530 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f680b6680 0x7f5f680b8b90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.055+0000 7f5f874fa640 1 --2- 172.21.15.84:0/1038157530 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f80109df0 0x7f5f80076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.141 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.055+0000 7f5f874fa640 1 --2- 172.21.15.84:0/1038157530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f801094a0 0x7f5f80075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.055+0000 7f5f874fa640 1 --2- 172.21.15.84:0/1038157530 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f80103b60 0x7f5f80075710 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:47.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.055+0000 7f5f874fa640 1 -- 172.21.15.84:0/1038157530 >> 172.21.15.84:0/1038157530 conn(0x7f5f8007b850 msgr2=0x7f5f80107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:47.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.055+0000 7f5f874fa640 1 -- 172.21.15.84:0/1038157530 shutdown_connections 2024-09-21T03:47:47.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:47.055+0000 7f5f874fa640 1 -- 172.21.15.84:0/1038157530 wait complete. 2024-09-21T03:47:47.496 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.496 INFO:tasks.workunit.client.0.smithi084.stdout:189/600: open fd = 3 2024-09-21T03:47:47.496 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.496 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.496 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.496 INFO:tasks.workunit.client.0.smithi084.stdout:190/600: open fd = 3 2024-09-21T03:47:47.496 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.496 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.496 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.496 INFO:tasks.workunit.client.0.smithi084.stdout:191/600: open fd = 3 2024-09-21T03:47:47.497 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.497 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.497 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.497 INFO:tasks.workunit.client.0.smithi084.stdout:192/600: open fd = 3 2024-09-21T03:47:47.497 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.497 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.497 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.497 INFO:tasks.workunit.client.0.smithi084.stdout:193/600: open fd = 3 2024-09-21T03:47:47.497 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.497 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.497 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.497 INFO:tasks.workunit.client.0.smithi084.stdout:194/600: open fd = 3 2024-09-21T03:47:47.497 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.497 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.498 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.498 INFO:tasks.workunit.client.0.smithi084.stdout:195/600: open fd = 3 2024-09-21T03:47:47.498 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.498 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.498 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.498 INFO:tasks.workunit.client.0.smithi084.stdout:196/600: open fd = 3 2024-09-21T03:47:47.498 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.498 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.498 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.498 INFO:tasks.workunit.client.0.smithi084.stdout:197/600: open fd = 3 2024-09-21T03:47:47.498 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.499 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.499 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.499 INFO:tasks.workunit.client.0.smithi084.stdout:198/600: open fd = 3 2024-09-21T03:47:47.499 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.499 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.499 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.499 INFO:tasks.workunit.client.0.smithi084.stdout:199/600: open fd = 3 2024-09-21T03:47:47.499 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.499 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.499 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.499 INFO:tasks.workunit.client.0.smithi084.stdout:200/600: open fd = 3 2024-09-21T03:47:47.499 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.499 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.500 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.500 INFO:tasks.workunit.client.0.smithi084.stdout:201/600: open fd = 3 2024-09-21T03:47:47.500 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.500 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.500 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.500 INFO:tasks.workunit.client.0.smithi084.stdout:202/600: open fd = 3 2024-09-21T03:47:47.500 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.500 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.500 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.500 INFO:tasks.workunit.client.0.smithi084.stdout:203/600: open fd = 3 2024-09-21T03:47:47.500 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.500 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.500 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.500 INFO:tasks.workunit.client.0.smithi084.stdout:204/600: open fd = 3 2024-09-21T03:47:47.500 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.501 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.501 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.501 INFO:tasks.workunit.client.0.smithi084.stdout:205/600: open fd = 3 2024-09-21T03:47:47.501 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.501 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.501 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.501 INFO:tasks.workunit.client.0.smithi084.stdout:206/600: open fd = 3 2024-09-21T03:47:47.501 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.501 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.501 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.501 INFO:tasks.workunit.client.0.smithi084.stdout:207/600: open fd = 3 2024-09-21T03:47:47.501 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.501 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.502 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.502 INFO:tasks.workunit.client.0.smithi084.stdout:208/600: open fd = 3 2024-09-21T03:47:47.502 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.502 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.502 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.502 INFO:tasks.workunit.client.0.smithi084.stdout:209/600: open fd = 3 2024-09-21T03:47:47.502 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.502 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.502 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.502 INFO:tasks.workunit.client.0.smithi084.stdout:210/600: open fd = 3 2024-09-21T03:47:47.502 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.502 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.502 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.503 INFO:tasks.workunit.client.0.smithi084.stdout:211/600: open fd = 3 2024-09-21T03:47:47.503 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.503 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.503 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.503 INFO:tasks.workunit.client.0.smithi084.stdout:212/600: open fd = 3 2024-09-21T03:47:47.503 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.503 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.503 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.503 INFO:tasks.workunit.client.0.smithi084.stdout:213/600: open fd = 3 2024-09-21T03:47:47.503 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.503 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.503 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.503 INFO:tasks.workunit.client.0.smithi084.stdout:214/600: open fd = 3 2024-09-21T03:47:47.503 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.504 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.504 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.504 INFO:tasks.workunit.client.0.smithi084.stdout:215/600: open fd = 3 2024-09-21T03:47:47.504 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.504 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.504 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.504 INFO:tasks.workunit.client.0.smithi084.stdout:216/600: open fd = 3 2024-09-21T03:47:47.504 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.504 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.504 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.504 INFO:tasks.workunit.client.0.smithi084.stdout:217/600: open fd = 3 2024-09-21T03:47:47.504 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.504 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.505 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.505 INFO:tasks.workunit.client.0.smithi084.stdout:218/600: open fd = 3 2024-09-21T03:47:47.505 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.505 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.505 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.505 INFO:tasks.workunit.client.0.smithi084.stdout:219/600: open fd = 3 2024-09-21T03:47:47.505 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.505 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.505 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.505 INFO:tasks.workunit.client.0.smithi084.stdout:220/600: open fd = 3 2024-09-21T03:47:47.505 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.506 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.506 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.506 INFO:tasks.workunit.client.0.smithi084.stdout:221/600: open fd = 3 2024-09-21T03:47:47.506 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.506 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.506 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.506 INFO:tasks.workunit.client.0.smithi084.stdout:222/600: open fd = 3 2024-09-21T03:47:47.506 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.506 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.506 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.506 INFO:tasks.workunit.client.0.smithi084.stdout:223/600: open fd = 3 2024-09-21T03:47:47.506 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.507 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.507 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.507 INFO:tasks.workunit.client.0.smithi084.stdout:224/600: open fd = 3 2024-09-21T03:47:47.507 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.507 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.507 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.507 INFO:tasks.workunit.client.0.smithi084.stdout:225/600: open fd = 3 2024-09-21T03:47:47.507 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.507 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.507 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.507 INFO:tasks.workunit.client.0.smithi084.stdout:226/600: open fd = 3 2024-09-21T03:47:47.507 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.507 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.507 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.508 INFO:tasks.workunit.client.0.smithi084.stdout:227/600: open fd = 3 2024-09-21T03:47:47.508 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.508 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.508 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.508 INFO:tasks.workunit.client.0.smithi084.stdout:228/600: open fd = 3 2024-09-21T03:47:47.508 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.508 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.508 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.508 INFO:tasks.workunit.client.0.smithi084.stdout:229/600: open fd = 3 2024-09-21T03:47:47.508 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.508 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.508 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.508 INFO:tasks.workunit.client.0.smithi084.stdout:230/600: open fd = 3 2024-09-21T03:47:47.508 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.509 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.509 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.509 INFO:tasks.workunit.client.0.smithi084.stdout:231/600: open fd = 3 2024-09-21T03:47:47.509 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.509 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.509 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.509 INFO:tasks.workunit.client.0.smithi084.stdout:232/600: open fd = 3 2024-09-21T03:47:47.509 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.509 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.509 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.510 INFO:tasks.workunit.client.0.smithi084.stdout:233/600: open fd = 3 2024-09-21T03:47:47.510 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.510 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.510 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.510 INFO:tasks.workunit.client.0.smithi084.stdout:234/600: open fd = 3 2024-09-21T03:47:47.510 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.511 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.511 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.511 INFO:tasks.workunit.client.0.smithi084.stdout:235/600: open fd = 3 2024-09-21T03:47:47.511 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.511 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.511 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.511 INFO:tasks.workunit.client.0.smithi084.stdout:236/600: open fd = 3 2024-09-21T03:47:47.511 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.511 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.511 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.511 INFO:tasks.workunit.client.0.smithi084.stdout:237/600: open fd = 3 2024-09-21T03:47:47.511 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.511 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.511 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.512 INFO:tasks.workunit.client.0.smithi084.stdout:238/600: open fd = 3 2024-09-21T03:47:47.512 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.512 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.512 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.512 INFO:tasks.workunit.client.0.smithi084.stdout:239/600: open fd = 3 2024-09-21T03:47:47.512 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.512 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.512 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.512 INFO:tasks.workunit.client.0.smithi084.stdout:240/600: open fd = 3 2024-09-21T03:47:47.512 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.512 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.512 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.512 INFO:tasks.workunit.client.0.smithi084.stdout:241/600: open fd = 3 2024-09-21T03:47:47.512 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.512 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.513 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.513 INFO:tasks.workunit.client.0.smithi084.stdout:242/600: open fd = 3 2024-09-21T03:47:47.513 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.513 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.513 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.513 INFO:tasks.workunit.client.0.smithi084.stdout:243/600: open fd = 3 2024-09-21T03:47:47.513 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.513 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.513 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.513 INFO:tasks.workunit.client.0.smithi084.stdout:244/600: open fd = 3 2024-09-21T03:47:47.513 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.513 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.513 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.513 INFO:tasks.workunit.client.0.smithi084.stdout:245/600: open fd = 3 2024-09-21T03:47:47.514 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.514 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.514 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.514 INFO:tasks.workunit.client.0.smithi084.stdout:246/600: open fd = 3 2024-09-21T03:47:47.514 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.514 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.514 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.514 INFO:tasks.workunit.client.0.smithi084.stdout:247/600: open fd = 3 2024-09-21T03:47:47.514 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.514 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.514 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.514 INFO:tasks.workunit.client.0.smithi084.stdout:248/600: open fd = 3 2024-09-21T03:47:47.514 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.514 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.515 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.515 INFO:tasks.workunit.client.0.smithi084.stdout:249/600: open fd = 3 2024-09-21T03:47:47.515 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.515 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.515 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:47:47.515 INFO:tasks.workunit.client.0.smithi084.stdout:250/600: open fd = 3 2024-09-21T03:47:47.515 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.515 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:47:47.815 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:47:48.059 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:47:48.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.565+0000 7ff4b8c29640 1 -- 172.21.15.84:0/2887914599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4b410de50 msgr2=0x7ff4b4110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:48.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.565+0000 7ff4b8c29640 1 --2- 172.21.15.84:0/2887914599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4b410de50 0x7ff4b4110320 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac009900 tx=0x7ff4ac02a410 comp rx=0 tx=0).stop 2024-09-21T03:47:48.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.565+0000 7ff4b8c29640 1 -- 172.21.15.84:0/2887914599 shutdown_connections 2024-09-21T03:47:48.577 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.565+0000 7ff4b8c29640 1 --2- 172.21.15.84:0/2887914599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4b410de50 0x7ff4b4110320 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.565+0000 7ff4b8c29640 1 --2- 172.21.15.84:0/2887914599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4b41052d0 0x7ff4b410d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.565+0000 7ff4b8c29640 1 --2- 172.21.15.84:0/2887914599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4b41048a0 0x7ff4b4104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.565+0000 7ff4b8c29640 1 -- 172.21.15.84:0/2887914599 >> 172.21.15.84:0/2887914599 conn(0x7ff4b4079740 msgr2=0x7ff4b4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:48.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.565+0000 7ff4b8c29640 1 -- 172.21.15.84:0/2887914599 shutdown_connections 2024-09-21T03:47:48.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.565+0000 7ff4b8c29640 1 -- 172.21.15.84:0/2887914599 wait complete. 2024-09-21T03:47:48.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.566+0000 7ff4b8c29640 1 Processor -- start 2024-09-21T03:47:48.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.566+0000 7ff4b8c29640 1 -- start start 2024-09-21T03:47:48.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.566+0000 7ff4b8c29640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4b41048a0 0x7ff4b419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:48.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.566+0000 7ff4b8c29640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4b41052d0 0x7ff4b419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:48.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.566+0000 7ff4b8c29640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4b410de50 0x7ff4b419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:48.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.566+0000 7ff4b8c29640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b4113a90 con 0x7ff4b41052d0 2024-09-21T03:47:48.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.566+0000 7ff4b8c29640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b4113910 con 0x7ff4b410de50 2024-09-21T03:47:48.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.566+0000 7ff4b8c29640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b4113c10 con 0x7ff4b41048a0 2024-09-21T03:47:48.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.566+0000 7ff4b1d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4b41052d0 0x7ff4b419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:48.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.566+0000 7ff4b1d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4b41052d0 0x7ff4b419a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34460/0 (socket says 172.21.15.84:34460) 2024-09-21T03:47:48.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.566+0000 7ff4b1d9b640 1 -- 172.21.15.84:0/4256036249 learned_addr learned my addr 172.21.15.84:0/4256036249 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:48.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.566+0000 7ff4b2d9d640 1 --2- 172.21.15.84:0/4256036249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4b410de50 0x7ff4b419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:48.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.566+0000 7ff4b259c640 1 --2- 172.21.15.84:0/4256036249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4b41048a0 0x7ff4b419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:48.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.567+0000 7ff4b1d9b640 1 -- 172.21.15.84:0/4256036249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4b41048a0 msgr2=0x7ff4b419a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:48.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.567+0000 7ff4b1d9b640 1 --2- 172.21.15.84:0/4256036249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4b41048a0 0x7ff4b419a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.567+0000 7ff4b1d9b640 1 -- 172.21.15.84:0/4256036249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4b410de50 msgr2=0x7ff4b419fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:48.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.567+0000 7ff4b1d9b640 1 --2- 172.21.15.84:0/4256036249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4b410de50 0x7ff4b419fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.567+0000 7ff4b1d9b640 1 -- 172.21.15.84:0/4256036249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b41a03b0 con 0x7ff4b41052d0 2024-09-21T03:47:48.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.567+0000 7ff4b1d9b640 1 --2- 172.21.15.84:0/4256036249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4b41052d0 0x7ff4b419a9e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff4a800d770 tx=0x7ff4a800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:48.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.567+0000 7ff4a37fe640 1 -- 172.21.15.84:0/4256036249 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8017070 con 0x7ff4b41052d0 2024-09-21T03:47:48.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.567+0000 7ff4a37fe640 1 -- 172.21.15.84:0/4256036249 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4a8009c30 con 0x7ff4b41052d0 2024-09-21T03:47:48.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.567+0000 7ff4a37fe640 1 -- 172.21.15.84:0/4256036249 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a800f620 con 0x7ff4b41052d0 2024-09-21T03:47:48.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.567+0000 7ff4b8c29640 1 -- 172.21.15.84:0/4256036249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4b41a06a0 con 0x7ff4b41052d0 2024-09-21T03:47:48.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.567+0000 7ff4b8c29640 1 -- 172.21.15.84:0/4256036249 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4b41a6e00 con 0x7ff4b41052d0 2024-09-21T03:47:48.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.570+0000 7ff4bf19d740 1 Processor -- start 2024-09-21T03:47:48.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.570+0000 7ff4bf19d740 1 -- start start 2024-09-21T03:47:48.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.570+0000 7ff4a37fe640 1 -- 172.21.15.84:0/4256036249 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7ff4a801a070 con 0x7ff4b41052d0 2024-09-21T03:47:48.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.570+0000 7ff4bf19d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56548040a070 0x5654807b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:48.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.570+0000 7ff4bf19d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5654803e11b0 0x5654807b1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:48.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.570+0000 7ff4bf19d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654803e9390 0x5654807b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:48.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.570+0000 7ff4bf19d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x565480727ea0 con 0x56548040a070 2024-09-21T03:47:48.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.570+0000 7ff4bf19d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5654807172d0 con 0x5654803e9390 2024-09-21T03:47:48.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.570+0000 7ff4bf19d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56548071b0e0 con 0x5654803e11b0 2024-09-21T03:47:48.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.570+0000 7ff4b2d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56548040a070 0x5654807b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:48.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.570+0000 7ff4b2d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56548040a070 0x5654807b12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34466/0 (socket says 172.21.15.84:34466) 2024-09-21T03:47:48.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.570+0000 7ff4b2d9d640 1 -- 172.21.15.84:0/2729588211 learned_addr learned my addr 172.21.15.84:0/2729588211 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:48.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.571+0000 7ff4b259c640 1 --2- 172.21.15.84:0/2729588211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5654803e11b0 0x5654807b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:48.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.571+0000 7ff4b2d9d640 1 -- 172.21.15.84:0/2729588211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5654803e11b0 msgr2=0x5654807b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:48.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.571+0000 7ff4b2d9d640 1 --2- 172.21.15.84:0/2729588211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5654803e11b0 0x5654807b1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.571+0000 7ff4b2d9d640 1 -- 172.21.15.84:0/2729588211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654803e9390 msgr2=0x5654807b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:48.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.571+0000 7ff4b2d9d640 1 --2- 172.21.15.84:0/2729588211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654803e9390 0x5654807b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.571+0000 7ff4b2d9d640 1 -- 172.21.15.84:0/2729588211 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565480475650 con 0x56548040a070 2024-09-21T03:47:48.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.571+0000 7ff4b2d9d640 1 --2- 172.21.15.84:0/2729588211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56548040a070 0x5654807b12c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac009900 tx=0x7ff4ac032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eecd3435890c3f0d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:48.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.571+0000 7ff4a37fe640 1 --2- 172.21.15.84:0/4256036249 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff49c0b6680 0x7ff49c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:48.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.571+0000 7ff4a0ff9640 1 -- 172.21.15.84:0/2729588211 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac040070 con 0x56548040a070 2024-09-21T03:47:48.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.571+0000 7ff4b259c640 1 --2- 172.21.15.84:0/4256036249 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff49c0b6680 0x7ff49c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:48.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.571+0000 7ff4a0ff9640 1 -- 172.21.15.84:0/2729588211 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4ac004030 con 0x56548040a070 2024-09-21T03:47:48.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.571+0000 7ff4a0ff9640 1 -- 172.21.15.84:0/2729588211 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac035040 con 0x56548040a070 2024-09-21T03:47:48.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.571+0000 7ff4a37fe640 1 -- 172.21.15.84:0/4256036249 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff4a80e7140 con 0x7ff4b41052d0 2024-09-21T03:47:48.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.572+0000 7ff4bf19d740 1 -- 172.21.15.84:0/2729588211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56548040a070 msgr2=0x5654807b12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:48.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.572+0000 7ff4bf19d740 1 --2- 172.21.15.84:0/2729588211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56548040a070 0x5654807b12c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac009900 tx=0x7ff4ac032bd0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.572+0000 7ff4b259c640 1 --2- 172.21.15.84:0/4256036249 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff49c0b6680 0x7ff49c0b8b90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5654807aff40 tx=0x7ff4a4009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:48.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.572+0000 7ff4bf19d740 1 -- 172.21.15.84:0/2729588211 shutdown_connections 2024-09-21T03:47:48.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.572+0000 7ff4bf19d740 1 --2- 172.21.15.84:0/2729588211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654803e9390 0x5654807b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.572+0000 7ff4bf19d740 1 --2- 172.21.15.84:0/2729588211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5654803e11b0 0x5654807b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.572+0000 7ff4bf19d740 1 --2- 172.21.15.84:0/2729588211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56548040a070 0x5654807b12c0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.572+0000 7ff4bf19d740 1 -- 172.21.15.84:0/2729588211 >> 172.21.15.84:0/2729588211 conn(0x5654803fe460 msgr2=0x5654807af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:48.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.572+0000 7ff4bf19d740 1 -- 172.21.15.84:0/2729588211 shutdown_connections 2024-09-21T03:47:48.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.572+0000 7ff4bf19d740 1 -- 172.21.15.84:0/2729588211 wait complete. 2024-09-21T03:47:48.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.573+0000 7ff4bf19d740 1 -- start start 2024-09-21T03:47:48.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.573+0000 7ff4bf19d740 1 Processor -- start 2024-09-21T03:47:48.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.573+0000 7ff4bf19d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654803e11b0 0x5654807bca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:48.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.573+0000 7ff4bf19d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5654803e9390 0x5654807bcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:48.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.573+0000 7ff4bf19d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56548040a070 0x5654807c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:48.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.573+0000 7ff4bf19d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x565480578700 con 0x5654803e11b0 2024-09-21T03:47:48.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.573+0000 7ff4bf19d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5654806b2160 con 0x56548040a070 2024-09-21T03:47:48.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.573+0000 7ff4bf19d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5654807bfa40 con 0x5654803e9390 2024-09-21T03:47:48.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.573+0000 7ff4bf19d740 10 client.0 _ll_register_callbacks cb 0x5654806cb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:48.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.574+0000 7ff4b259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654803e11b0 0x5654807bca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:48.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.574+0000 7ff4b259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654803e11b0 0x5654807bca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34480/0 (socket says 172.21.15.84:34480) 2024-09-21T03:47:48.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.574+0000 7ff4b1d9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5654803e9390 0x5654807bcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:48.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.574+0000 7ff4b259c640 1 -- 172.21.15.84:0/688828572 learned_addr learned my addr 172.21.15.84:0/688828572 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:48.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.574+0000 7ff4b2d9d640 1 --2- 172.21.15.84:0/688828572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56548040a070 0x5654807c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:48.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.574+0000 7ff4b259c640 1 -- 172.21.15.84:0/688828572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5654803e9390 msgr2=0x5654807bcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:48.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.574+0000 7ff4b259c640 1 --2- 172.21.15.84:0/688828572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5654803e9390 0x5654807bcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.574+0000 7ff4b259c640 1 -- 172.21.15.84:0/688828572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56548040a070 msgr2=0x5654807c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:48.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.574+0000 7ff4b259c640 1 --2- 172.21.15.84:0/688828572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56548040a070 0x5654807c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.574+0000 7ff4b259c640 1 -- 172.21.15.84:0/688828572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654806dfc90 con 0x5654803e11b0 2024-09-21T03:47:48.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.574+0000 7ff4b259c640 1 --2- 172.21.15.84:0/688828572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654803e11b0 0x5654807bca70 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009dc0 tx=0x7ff4a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfc753c46f93df1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:48.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.574+0000 7ff499ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:48.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.574+0000 7ff499ffb640 1 -- 172.21.15.84:0/688828572 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a40109e0 con 0x5654803e11b0 2024-09-21T03:47:48.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.574+0000 7ff499ffb640 1 -- 172.21.15.84:0/688828572 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff4a4010b80 con 0x5654803e11b0 2024-09-21T03:47:48.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.574+0000 7ff4bf19d740 1 -- 172.21.15.84:0/688828572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4ac004030 con 0x5654803e11b0 2024-09-21T03:47:48.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.574+0000 7ff499ffb640 1 -- 172.21.15.84:0/688828572 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff4a4010d80 con 0x5654803e11b0 2024-09-21T03:47:48.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.574+0000 7ff4bf19d740 10 client.16449 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:48.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.575+0000 7ff4bf19d740 1 -- 172.21.15.84:0/688828572 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5654807cb880 con 0x5654803e11b0 2024-09-21T03:47:48.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.575+0000 7ff499ffb640 1 -- 172.21.15.84:0/688828572 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4ac004030 con 0x5654803e11b0 2024-09-21T03:47:48.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.575+0000 7ff499ffb640 1 -- 172.21.15.84:0/688828572 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff4a4030490 con 0x5654803e11b0 2024-09-21T03:47:48.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.575+0000 7ff4bf19d740 10 client.16449 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:48.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.575+0000 7ff4bf19d740 10 client.16449 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:47:48.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.575+0000 7ff4bf19d740 20 client.16449 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:48.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.575+0000 7ff4bf19d740 1 --2- 172.21.15.84:0/688828572 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5654803c89f0 0x5654807cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:48.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.575+0000 7ff4bf19d740 4 client.16449 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:47:48.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.575+0000 7ff4bf19d740 1 -- 172.21.15.84:0/688828572 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565480729df0 con 0x5654803c89f0 2024-09-21T03:47:48.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.575+0000 7ff4b1d9b640 1 --2- 172.21.15.84:0/688828572 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5654803c89f0 0x5654807cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:48.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.576+0000 7ff499ffb640 10 client.16449 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:47:48.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.576+0000 7ff4b1d9b640 1 --2- 172.21.15.84:0/688828572 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5654803c89f0 0x5654807cecd0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dc4ead7bf1880c50 server_cookie=b097893b17099e62 in_seq=0 out_seq=0 2024-09-21T03:47:48.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.576+0000 7ff499ffb640 1 -- 172.21.15.84:0/688828572 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565480729df0 con 0x5654803c89f0 2024-09-21T03:47:48.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.576+0000 7ff499ffb640 10 client.16449 handle_command_reply: tid=0 2024-09-21T03:47:48.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.576+0000 7ff4bf19d740 1 client.16449 shutdown 2024-09-21T03:47:48.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.577+0000 7ff4bf19d740 1 -- 172.21.15.84:0/688828572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654803e11b0 msgr2=0x5654807bca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.577+0000 7ff4bf19d740 1 --2- 172.21.15.84:0/688828572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654803e11b0 0x5654807bca70 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009dc0 tx=0x7ff4a4004a40 comp rx=0 tx=0).stop 2024-09-21T03:47:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.577+0000 7ff4bf19d740 1 -- 172.21.15.84:0/688828572 shutdown_connections 2024-09-21T03:47:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.577+0000 7ff4bf19d740 1 --2- 172.21.15.84:0/688828572 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5654803c89f0 0x5654807cecd0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.577+0000 7ff4bf19d740 1 --2- 172.21.15.84:0/688828572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56548040a070 0x5654807c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.577+0000 7ff4bf19d740 1 --2- 172.21.15.84:0/688828572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5654803e9390 0x5654807bcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.577+0000 7ff4bf19d740 1 --2- 172.21.15.84:0/688828572 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654803e11b0 0x5654807bca70 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.577+0000 7ff4bf19d740 1 -- 172.21.15.84:0/688828572 >> 172.21.15.84:0/688828572 conn(0x5654803fe460 msgr2=0x5654807b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.577+0000 7ff499ffb640 0 client.16449 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:47:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.577+0000 7ff4bf19d740 1 -- 172.21.15.84:0/688828572 shutdown_connections 2024-09-21T03:47:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.577+0000 7ff4bf19d740 1 -- 172.21.15.84:0/688828572 wait complete. 2024-09-21T03:47:48.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.577+0000 7ff4bf19d740 20 client.16449 trim_cache size 0 max 16384 2024-09-21T03:47:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.590+0000 7ff4bf19d740 1 Processor -- start 2024-09-21T03:47:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.590+0000 7ff4bf19d740 1 -- start start 2024-09-21T03:47:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.590+0000 7ff4bf19d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5654803e11b0 0x5654807af200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.590+0000 7ff4bf19d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654803e9390 0x5654807c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.590+0000 7ff4bf19d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56548040a070 0x5654807b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.590+0000 7ff4bf19d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b41b1e80 con 0x56548040a070 2024-09-21T03:47:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.590+0000 7ff4bf19d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b41af750 con 0x5654803e9390 2024-09-21T03:47:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.590+0000 7ff4bf19d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b41ad5a0 con 0x5654803e11b0 2024-09-21T03:47:48.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.590+0000 7ff4b2d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56548040a070 0x5654807b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:48.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.590+0000 7ff4b2d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56548040a070 0x5654807b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34488/0 (socket says 172.21.15.84:34488) 2024-09-21T03:47:48.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.590+0000 7ff4b2d9d640 1 -- 172.21.15.84:0/2754699141 learned_addr learned my addr 172.21.15.84:0/2754699141 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:48.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.590+0000 7ff4b1d9b640 1 --2- 172.21.15.84:0/2754699141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654803e9390 0x5654807c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:48.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.590+0000 7ff4b259c640 1 --2- 172.21.15.84:0/2754699141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5654803e11b0 0x5654807af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:48.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.591+0000 7ff4b2d9d640 1 -- 172.21.15.84:0/2754699141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5654803e11b0 msgr2=0x5654807af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:48.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.591+0000 7ff4b2d9d640 1 --2- 172.21.15.84:0/2754699141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5654803e11b0 0x5654807af200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.591+0000 7ff4b2d9d640 1 -- 172.21.15.84:0/2754699141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654803e9390 msgr2=0x5654807c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:48.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.591+0000 7ff4b2d9d640 1 --2- 172.21.15.84:0/2754699141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654803e9390 0x5654807c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.591+0000 7ff4b2d9d640 1 -- 172.21.15.84:0/2754699141 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654807afaa0 con 0x56548040a070 2024-09-21T03:47:48.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.591+0000 7ff4b2d9d640 1 --2- 172.21.15.84:0/2754699141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56548040a070 0x5654807b43c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac031440 tx=0x7ff4ac005290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74841143c304896b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:48.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.591+0000 7ff49bfff640 1 -- 172.21.15.84:0/2754699141 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac035040 con 0x56548040a070 2024-09-21T03:47:48.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.591+0000 7ff49bfff640 1 -- 172.21.15.84:0/2754699141 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4ac004030 con 0x56548040a070 2024-09-21T03:47:48.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.591+0000 7ff49bfff640 1 -- 172.21.15.84:0/2754699141 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac040040 con 0x56548040a070 2024-09-21T03:47:48.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.592+0000 7ff4bf19d740 1 -- 172.21.15.84:0/2754699141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56548040a070 msgr2=0x5654807b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:48.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.592+0000 7ff4bf19d740 1 --2- 172.21.15.84:0/2754699141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56548040a070 0x5654807b43c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac031440 tx=0x7ff4ac005290 comp rx=0 tx=0).stop 2024-09-21T03:47:48.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.592+0000 7ff4bf19d740 1 -- 172.21.15.84:0/2754699141 shutdown_connections 2024-09-21T03:47:48.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.592+0000 7ff4bf19d740 1 --2- 172.21.15.84:0/2754699141 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56548040a070 0x5654807b43c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.592+0000 7ff4bf19d740 1 --2- 172.21.15.84:0/2754699141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654803e9390 0x5654807c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.592+0000 7ff4bf19d740 1 --2- 172.21.15.84:0/2754699141 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5654803e11b0 0x5654807af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.592+0000 7ff4bf19d740 1 -- 172.21.15.84:0/2754699141 >> 172.21.15.84:0/2754699141 conn(0x5654803fe460 msgr2=0x5654807aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:48.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.592+0000 7ff4bf19d740 1 -- 172.21.15.84:0/2754699141 shutdown_connections 2024-09-21T03:47:48.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.592+0000 7ff4bf19d740 1 -- 172.21.15.84:0/2754699141 wait complete. 2024-09-21T03:47:48.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.592+0000 7ff4bf19d740 1 -- start start 2024-09-21T03:47:48.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.592+0000 7ff4bf19d740 1 Processor -- start 2024-09-21T03:47:48.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff4bf19d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654803e11b0 0x565480835030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:48.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff4bf19d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654803e9390 0x5654807c4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:48.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff4bf19d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56548040a070 0x5654807c5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:48.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff4bf19d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b41adc10 con 0x5654803e11b0 2024-09-21T03:47:48.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff4bf19d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b41af080 con 0x5654803e9390 2024-09-21T03:47:48.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff4bf19d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff4b41ae2e0 con 0x56548040a070 2024-09-21T03:47:48.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff4bf19d740 10 client.0 _ll_register_callbacks cb 0x7ff4a4009cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:48.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff4b259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654803e11b0 0x565480835030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:48.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff4b259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654803e11b0 0x565480835030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34502/0 (socket says 172.21.15.84:34502) 2024-09-21T03:47:48.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff4b259c640 1 -- 172.21.15.84:0/3594947170 learned_addr learned my addr 172.21.15.84:0/3594947170 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:48.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff4b2d9d640 1 --2- 172.21.15.84:0/3594947170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56548040a070 0x5654807c5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:48.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff4b1d9b640 1 --2- 172.21.15.84:0/3594947170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654803e9390 0x5654807c4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:48.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff4b259c640 1 -- 172.21.15.84:0/3594947170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56548040a070 msgr2=0x5654807c5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:48.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff4b259c640 1 --2- 172.21.15.84:0/3594947170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56548040a070 0x5654807c5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff4b259c640 1 -- 172.21.15.84:0/3594947170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654803e9390 msgr2=0x5654807c4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:48.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff4b259c640 1 --2- 172.21.15.84:0/3594947170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654803e9390 0x5654807c4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff4b259c640 1 -- 172.21.15.84:0/3594947170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654808325a0 con 0x5654803e11b0 2024-09-21T03:47:48.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff4b2d9d640 1 --2- 172.21.15.84:0/3594947170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56548040a070 0x5654807c5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:47:48.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff4b259c640 1 --2- 172.21.15.84:0/3594947170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654803e11b0 0x565480835030 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4030a50 tx=0x7ff4a4004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2adf882cc77f567 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:48.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff499ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:48.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff499ffb640 1 -- 172.21.15.84:0/3594947170 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4030ad0 con 0x5654803e11b0 2024-09-21T03:47:48.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff499ffb640 1 -- 172.21.15.84:0/3594947170 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff4a4030c70 con 0x5654803e11b0 2024-09-21T03:47:48.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.593+0000 7ff4bf19d740 1 -- 172.21.15.84:0/3594947170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4ac004030 con 0x5654803e11b0 2024-09-21T03:47:48.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.594+0000 7ff499ffb640 1 -- 172.21.15.84:0/3594947170 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff4a40107e0 con 0x5654803e11b0 2024-09-21T03:47:48.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.594+0000 7ff4bf19d740 10 client.16455 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:48.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.594+0000 7ff4bf19d740 1 -- 172.21.15.84:0/3594947170 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56548083dc20 con 0x5654803e11b0 2024-09-21T03:47:48.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.594+0000 7ff499ffb640 1 -- 172.21.15.84:0/3594947170 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4ac004030 con 0x5654803e11b0 2024-09-21T03:47:48.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.594+0000 7ff499ffb640 1 -- 172.21.15.84:0/3594947170 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff4a4041030 con 0x5654803e11b0 2024-09-21T03:47:48.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.594+0000 7ff4bf19d740 10 client.16455 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:48.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.594+0000 7ff4bf19d740 10 client.16455 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:47:48.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.594+0000 7ff4bf19d740 20 client.16455 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:48.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.594+0000 7ff4bf19d740 1 --2- 172.21.15.84:0/3594947170 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x56548039dda0 0x565480840460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:48.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.594+0000 7ff4bf19d740 4 client.16455 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:47:48.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.594+0000 7ff4bf19d740 1 -- 172.21.15.84:0/3594947170 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5654807258a0 con 0x56548039dda0 2024-09-21T03:47:48.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.594+0000 7ff4b1d9b640 1 --2- 172.21.15.84:0/3594947170 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x56548039dda0 0x565480840460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:48.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.595+0000 7ff4b1d9b640 1 --2- 172.21.15.84:0/3594947170 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x56548039dda0 0x565480840460 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e8f1e26f1cce022a server_cookie=4221b8725f22f162 in_seq=0 out_seq=0 2024-09-21T03:47:48.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.595+0000 7ff499ffb640 10 client.16455 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:47:48.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.595+0000 7ff499ffb640 1 -- 172.21.15.84:0/3594947170 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5654807258a0 con 0x56548039dda0 2024-09-21T03:47:48.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.595+0000 7ff499ffb640 10 client.16455 handle_command_reply: tid=0 2024-09-21T03:47:48.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.595+0000 7ff4bf19d740 1 client.16455 shutdown 2024-09-21T03:47:48.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.595+0000 7ff4bf19d740 1 -- 172.21.15.84:0/3594947170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654803e11b0 msgr2=0x565480835030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:48.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.595+0000 7ff4bf19d740 1 --2- 172.21.15.84:0/3594947170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654803e11b0 0x565480835030 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4030a50 tx=0x7ff4a4004990 comp rx=0 tx=0).stop 2024-09-21T03:47:48.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.595+0000 7ff4bf19d740 1 -- 172.21.15.84:0/3594947170 shutdown_connections 2024-09-21T03:47:48.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.595+0000 7ff4bf19d740 1 --2- 172.21.15.84:0/3594947170 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x56548039dda0 0x565480840460 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.595+0000 7ff4bf19d740 1 --2- 172.21.15.84:0/3594947170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56548040a070 0x5654807c5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.595+0000 7ff4bf19d740 1 --2- 172.21.15.84:0/3594947170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654803e9390 0x5654807c4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.595+0000 7ff499ffb640 0 client.16455 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:47:48.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.595+0000 7ff4bf19d740 1 --2- 172.21.15.84:0/3594947170 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5654803e11b0 0x565480835030 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.595+0000 7ff4bf19d740 1 -- 172.21.15.84:0/3594947170 >> 172.21.15.84:0/3594947170 conn(0x5654803fe460 msgr2=0x5654807b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:48.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.595+0000 7ff4bf19d740 1 -- 172.21.15.84:0/3594947170 shutdown_connections 2024-09-21T03:47:48.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.595+0000 7ff4bf19d740 1 -- 172.21.15.84:0/3594947170 wait complete. 2024-09-21T03:47:48.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.595+0000 7ff4bf19d740 20 client.16455 trim_cache size 0 max 16384 2024-09-21T03:47:48.603 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:47:48.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.596+0000 7ff4b8c29640 1 -- 172.21.15.84:0/4256036249 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff49c0b6680 msgr2=0x7ff49c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:48.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.596+0000 7ff4b8c29640 1 --2- 172.21.15.84:0/4256036249 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff49c0b6680 0x7ff49c0b8b90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5654807aff40 tx=0x7ff4a4009500 comp rx=0 tx=0).stop 2024-09-21T03:47:48.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.596+0000 7ff4b8c29640 1 -- 172.21.15.84:0/4256036249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4b41052d0 msgr2=0x7ff4b419a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:48.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.596+0000 7ff4b8c29640 1 --2- 172.21.15.84:0/4256036249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4b41052d0 0x7ff4b419a9e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff4a800d770 tx=0x7ff4a800dc30 comp rx=0 tx=0).stop 2024-09-21T03:47:48.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.596+0000 7ff4b8c29640 1 -- 172.21.15.84:0/4256036249 shutdown_connections 2024-09-21T03:47:48.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.596+0000 7ff4b8c29640 1 --2- 172.21.15.84:0/4256036249 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff49c0b6680 0x7ff49c0b8b90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.596+0000 7ff4b8c29640 1 --2- 172.21.15.84:0/4256036249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4b410de50 0x7ff4b419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.596+0000 7ff4b8c29640 1 --2- 172.21.15.84:0/4256036249 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff4b41052d0 0x7ff4b419a9e0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.596+0000 7ff4b8c29640 1 --2- 172.21.15.84:0/4256036249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4b41048a0 0x7ff4b419a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:48.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.596+0000 7ff4b8c29640 1 -- 172.21.15.84:0/4256036249 >> 172.21.15.84:0/4256036249 conn(0x7ff4b4079740 msgr2=0x7ff4b41008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:48.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.596+0000 7ff4b8c29640 1 -- 172.21.15.84:0/4256036249 shutdown_connections 2024-09-21T03:47:48.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:48.596+0000 7ff4b8c29640 1 -- 172.21.15.84:0/4256036249 wait complete. 2024-09-21T03:47:48.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:48 smithi084 ceph-mon[30941]: pgmap v484: 97 pgs: 97 active+clean; 7.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 14 op/s 2024-09-21T03:47:48.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:48 smithi174 ceph-mon[34403]: pgmap v484: 97 pgs: 97 active+clean; 7.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 14 op/s 2024-09-21T03:47:48.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:48 smithi172 ceph-mon[34821]: pgmap v484: 97 pgs: 97 active+clean; 7.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 14 op/s 2024-09-21T03:47:49.351 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:47:49.596 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:47:50.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.086+0000 7f18bd225640 1 -- 172.21.15.84:0/3232043823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b8108d20 msgr2=0x7f18b810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:50.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.086+0000 7f18bd225640 1 --2- 172.21.15.84:0/3232043823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b8108d20 0x7f18b810f550 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009ca0 tx=0x7f18b002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.086+0000 7f18bd225640 1 -- 172.21.15.84:0/3232043823 shutdown_connections 2024-09-21T03:47:50.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.086+0000 7f18bd225640 1 --2- 172.21.15.84:0/3232043823 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b8108d20 0x7f18b810f550 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.086+0000 7f18bd225640 1 --2- 172.21.15.84:0/3232043823 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18b81083d0 0x7f18b81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.086+0000 7f18bd225640 1 --2- 172.21.15.84:0/3232043823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18b8102ae0 0x7f18b8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.086+0000 7f18bd225640 1 -- 172.21.15.84:0/3232043823 >> 172.21.15.84:0/3232043823 conn(0x7f18b8079760 msgr2=0x7f18b8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:50.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.086+0000 7f18bd225640 1 -- 172.21.15.84:0/3232043823 shutdown_connections 2024-09-21T03:47:50.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.086+0000 7f18bd225640 1 -- 172.21.15.84:0/3232043823 wait complete. 2024-09-21T03:47:50.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.087+0000 7f18bd225640 1 Processor -- start 2024-09-21T03:47:50.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.087+0000 7f18bd225640 1 -- start start 2024-09-21T03:47:50.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.088+0000 7f18bd225640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18b8102ae0 0x7f18b8199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:50.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.088+0000 7f18bd225640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18b81083d0 0x7f18b81999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:50.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.088+0000 7f18bd225640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b8108d20 0x7f18b819ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:50.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.088+0000 7f18bd225640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f18b8112990 con 0x7f18b8108d20 2024-09-21T03:47:50.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.088+0000 7f18bd225640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f18b8112810 con 0x7f18b8102ae0 2024-09-21T03:47:50.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.088+0000 7f18bd225640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f18b8112b10 con 0x7f18b81083d0 2024-09-21T03:47:50.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.088+0000 7f18b759e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b8108d20 0x7f18b819ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:50.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.088+0000 7f18b759e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b8108d20 0x7f18b819ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34516/0 (socket says 172.21.15.84:34516) 2024-09-21T03:47:50.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.088+0000 7f18b759e640 1 -- 172.21.15.84:0/1523084665 learned_addr learned my addr 172.21.15.84:0/1523084665 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:50.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.088+0000 7f18b6d9d640 1 --2- 172.21.15.84:0/1523084665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18b8102ae0 0x7f18b8199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:50.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.088+0000 7f18b659c640 1 --2- 172.21.15.84:0/1523084665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18b81083d0 0x7f18b81999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:50.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.088+0000 7f18b759e640 1 -- 172.21.15.84:0/1523084665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18b81083d0 msgr2=0x7f18b81999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:50.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.088+0000 7f18b759e640 1 --2- 172.21.15.84:0/1523084665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18b81083d0 0x7f18b81999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.088+0000 7f18b759e640 1 -- 172.21.15.84:0/1523084665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18b8102ae0 msgr2=0x7f18b8199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:50.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.088+0000 7f18b759e640 1 --2- 172.21.15.84:0/1523084665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18b8102ae0 0x7f18b8199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.088+0000 7f18b759e640 1 -- 172.21.15.84:0/1523084665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b819f370 con 0x7f18b8108d20 2024-09-21T03:47:50.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.088+0000 7f18b759e640 1 --2- 172.21.15.84:0/1523084665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b8108d20 0x7f18b819ec40 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f18b0005cc0 tx=0x7f18b002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:50.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.088+0000 7f189ffff640 1 -- 172.21.15.84:0/1523084665 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0003bf0 con 0x7f18b8108d20 2024-09-21T03:47:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.089+0000 7f18bd225640 1 -- 172.21.15.84:0/1523084665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b819f600 con 0x7f18b8108d20 2024-09-21T03:47:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.089+0000 7f189ffff640 1 -- 172.21.15.84:0/1523084665 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18b0003d90 con 0x7f18b8108d20 2024-09-21T03:47:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.089+0000 7f189ffff640 1 -- 172.21.15.84:0/1523084665 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b002fbc0 con 0x7f18b8108d20 2024-09-21T03:47:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.089+0000 7f18bd225640 1 -- 172.21.15.84:0/1523084665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b81a5dc0 con 0x7f18b8108d20 2024-09-21T03:47:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.091+0000 7f18c3799740 1 Processor -- start 2024-09-21T03:47:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.091+0000 7f189ffff640 1 -- 172.21.15.84:0/1523084665 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f18b002fd60 con 0x7f18b8108d20 2024-09-21T03:47:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.091+0000 7f18c3799740 1 -- start start 2024-09-21T03:47:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.092+0000 7f18c3799740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564520896070 0x564520c40100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.092+0000 7f18c3799740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56452086d1b0 0x564520c3d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.092+0000 7f18c3799740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520875390 0x564520c3dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.092+0000 7f18c3799740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564520bb3ea0 con 0x564520875390 2024-09-21T03:47:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.092+0000 7f18c3799740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564520ba32d0 con 0x56452086d1b0 2024-09-21T03:47:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.092+0000 7f18c3799740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564520ba70e0 con 0x564520896070 2024-09-21T03:47:50.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.092+0000 7f18b659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520875390 0x564520c3dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.092+0000 7f18b659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520875390 0x564520c3dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34532/0 (socket says 172.21.15.84:34532) 2024-09-21T03:47:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.092+0000 7f18b659c640 1 -- 172.21.15.84:0/3932715735 learned_addr learned my addr 172.21.15.84:0/3932715735 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.092+0000 7f18b659c640 1 --2- 172.21.15.84:0/3932715735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564520896070 0x564520c40100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.092+0000 7f18b6d9d640 1 --2- 172.21.15.84:0/3932715735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56452086d1b0 0x564520c3d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.092+0000 7f189ffff640 1 --2- 172.21.15.84:0/1523084665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f18a00b6680 0x7f18a00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.092+0000 7f18b659c640 1 -- 172.21.15.84:0/3932715735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564520896070 msgr2=0x564520c40100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.092+0000 7f18b659c640 1 --2- 172.21.15.84:0/3932715735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564520896070 0x564520c40100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.092+0000 7f18b659c640 1 -- 172.21.15.84:0/3932715735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56452086d1b0 msgr2=0x564520c3d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.092+0000 7f18b659c640 1 --2- 172.21.15.84:0/3932715735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56452086d1b0 0x564520c3d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.092+0000 7f18b659c640 1 -- 172.21.15.84:0/3932715735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564520901650 con 0x564520875390 2024-09-21T03:47:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.092+0000 7f18b6d9d640 1 --2- 172.21.15.84:0/3932715735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56452086d1b0 0x564520c3d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:47:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.092+0000 7f18b759e640 1 --2- 172.21.15.84:0/1523084665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f18a00b6680 0x7f18a00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:50.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.093+0000 7f189ffff640 1 -- 172.21.15.84:0/1523084665 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f18b0108b50 con 0x7f18b8108d20 2024-09-21T03:47:50.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.093+0000 7f18b659c640 1 --2- 172.21.15.84:0/3932715735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520875390 0x564520c3dd50 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f18ac012700 tx=0x7f18ac00b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3812d101d667bdf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:50.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.093+0000 7f189d7fa640 1 -- 172.21.15.84:0/3932715735 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac012c80 con 0x564520875390 2024-09-21T03:47:50.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.093+0000 7f189d7fa640 1 -- 172.21.15.84:0/3932715735 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18ac012e20 con 0x564520875390 2024-09-21T03:47:50.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.093+0000 7f189d7fa640 1 -- 172.21.15.84:0/3932715735 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac0035f0 con 0x564520875390 2024-09-21T03:47:50.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.094+0000 7f18c3799740 1 -- 172.21.15.84:0/3932715735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520875390 msgr2=0x564520c3dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:50.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.094+0000 7f18c3799740 1 --2- 172.21.15.84:0/3932715735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520875390 0x564520c3dd50 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f18ac012700 tx=0x7f18ac00b6e0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.094+0000 7f18b759e640 1 --2- 172.21.15.84:0/1523084665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f18a00b6680 0x7f18a00b8b90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f18b00cbc30 tx=0x7f18b009bdb0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:50.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.094+0000 7f18c3799740 1 -- 172.21.15.84:0/3932715735 shutdown_connections 2024-09-21T03:47:50.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.094+0000 7f18c3799740 1 --2- 172.21.15.84:0/3932715735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520875390 0x564520c3dd50 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.094+0000 7f18c3799740 1 --2- 172.21.15.84:0/3932715735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56452086d1b0 0x564520c3d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.094+0000 7f18c3799740 1 --2- 172.21.15.84:0/3932715735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564520896070 0x564520c40100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.094+0000 7f18c3799740 1 -- 172.21.15.84:0/3932715735 >> 172.21.15.84:0/3932715735 conn(0x56452088a460 msgr2=0x564520c3b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:50.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.094+0000 7f18c3799740 1 -- 172.21.15.84:0/3932715735 shutdown_connections 2024-09-21T03:47:50.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.094+0000 7f18c3799740 1 -- 172.21.15.84:0/3932715735 wait complete. 2024-09-21T03:47:50.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.094+0000 7f18c3799740 1 -- start start 2024-09-21T03:47:50.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.094+0000 7f18c3799740 1 Processor -- start 2024-09-21T03:47:50.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.094+0000 7f18c3799740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56452086d1b0 0x564520c4d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:50.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.094+0000 7f18c3799740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564520875390 0x564520c4d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:50.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.094+0000 7f18c3799740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520896070 0x564520c59560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:50.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.094+0000 7f18c3799740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564520a04700 con 0x564520896070 2024-09-21T03:47:50.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.094+0000 7f18c3799740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564520b3e160 con 0x56452086d1b0 2024-09-21T03:47:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.094+0000 7f18c3799740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564520c50200 con 0x564520875390 2024-09-21T03:47:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.095+0000 7f18c3799740 10 client.0 _ll_register_callbacks cb 0x564520b579e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.095+0000 7f18b659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520896070 0x564520c59560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.095+0000 7f18b659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520896070 0x564520c59560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34542/0 (socket says 172.21.15.84:34542) 2024-09-21T03:47:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.095+0000 7f18b659c640 1 -- 172.21.15.84:0/2198444774 learned_addr learned my addr 172.21.15.84:0/2198444774 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.095+0000 7f18b659c640 1 --2- 172.21.15.84:0/2198444774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56452086d1b0 0x564520c4d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.095+0000 7f18b6d9d640 1 --2- 172.21.15.84:0/2198444774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564520875390 0x564520c4d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.095+0000 7f18b659c640 1 -- 172.21.15.84:0/2198444774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564520875390 msgr2=0x564520c4d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.095+0000 7f18b659c640 1 --2- 172.21.15.84:0/2198444774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564520875390 0x564520c4d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.095+0000 7f18b659c640 1 -- 172.21.15.84:0/2198444774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56452086d1b0 msgr2=0x564520c4d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.095+0000 7f18b659c640 1 --2- 172.21.15.84:0/2198444774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56452086d1b0 0x564520c4d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.095+0000 7f18b659c640 1 -- 172.21.15.84:0/2198444774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564520b6bc90 con 0x564520896070 2024-09-21T03:47:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.095+0000 7f18b659c640 1 --2- 172.21.15.84:0/2198444774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520896070 0x564520c59560 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00b450 tx=0x7f18ac014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a72b3c65728f4d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:50.124 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.095+0000 7f189aff5640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:50.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.095+0000 7f189aff5640 1 -- 172.21.15.84:0/2198444774 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac010830 con 0x564520896070 2024-09-21T03:47:50.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.095+0000 7f189aff5640 1 -- 172.21.15.84:0/2198444774 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f18ac0109d0 con 0x564520896070 2024-09-21T03:47:50.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.095+0000 7f18c3799740 1 -- 172.21.15.84:0/2198444774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18ac012e20 con 0x564520896070 2024-09-21T03:47:50.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.095+0000 7f189aff5640 1 -- 172.21.15.84:0/2198444774 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f18ac005030 con 0x564520896070 2024-09-21T03:47:50.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.095+0000 7f18c3799740 10 client.16467 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:50.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.095+0000 7f18c3799740 1 -- 172.21.15.84:0/2198444774 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564520c5bf40 con 0x564520896070 2024-09-21T03:47:50.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.096+0000 7f189aff5640 1 -- 172.21.15.84:0/2198444774 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18ac012e20 con 0x564520896070 2024-09-21T03:47:50.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.096+0000 7f189aff5640 1 -- 172.21.15.84:0/2198444774 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f18ac004ce0 con 0x564520896070 2024-09-21T03:47:50.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.096+0000 7f18c3799740 10 client.16467 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:50.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.096+0000 7f18c3799740 10 client.16467 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:47:50.125 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.096+0000 7f18c3799740 20 client.16467 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.096+0000 7f18c3799740 1 --2- 172.21.15.84:0/2198444774 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5645208549f0 0x564520c5f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.096+0000 7f18c3799740 4 client.16467 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:47:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.096+0000 7f18c3799740 1 -- 172.21.15.84:0/2198444774 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564520bb5df0 con 0x5645208549f0 2024-09-21T03:47:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.096+0000 7f18b6d9d640 1 --2- 172.21.15.84:0/2198444774 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5645208549f0 0x564520c5f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.097+0000 7f18b6d9d640 1 --2- 172.21.15.84:0/2198444774 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5645208549f0 0x564520c5f300 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0eeb10d699c2b25 server_cookie=d413ad985f88a19c in_seq=0 out_seq=0 2024-09-21T03:47:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.097+0000 7f189aff5640 10 client.16467 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.097+0000 7f189aff5640 1 -- 172.21.15.84:0/2198444774 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564520bb5df0 con 0x5645208549f0 2024-09-21T03:47:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.097+0000 7f189aff5640 10 client.16467 handle_command_reply: tid=0 2024-09-21T03:47:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.098+0000 7f18c3799740 1 client.16467 shutdown 2024-09-21T03:47:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.098+0000 7f18c3799740 1 -- 172.21.15.84:0/2198444774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520896070 msgr2=0x564520c59560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.098+0000 7f18c3799740 1 --2- 172.21.15.84:0/2198444774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520896070 0x564520c59560 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00b450 tx=0x7f18ac014040 comp rx=0 tx=0).stop 2024-09-21T03:47:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.098+0000 7f18c3799740 1 -- 172.21.15.84:0/2198444774 shutdown_connections 2024-09-21T03:47:50.126 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.098+0000 7f18c3799740 1 --2- 172.21.15.84:0/2198444774 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5645208549f0 0x564520c5f300 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.098+0000 7f18c3799740 1 --2- 172.21.15.84:0/2198444774 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520896070 0x564520c59560 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.098+0000 7f18c3799740 1 --2- 172.21.15.84:0/2198444774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564520875390 0x564520c4d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.098+0000 7f18c3799740 1 --2- 172.21.15.84:0/2198444774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56452086d1b0 0x564520c4d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.098+0000 7f189aff5640 0 client.16467 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.098+0000 7f18c3799740 1 -- 172.21.15.84:0/2198444774 >> 172.21.15.84:0/2198444774 conn(0x56452088a460 msgr2=0x564520c3f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.098+0000 7f18c3799740 1 -- 172.21.15.84:0/2198444774 shutdown_connections 2024-09-21T03:47:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.098+0000 7f18c3799740 1 -- 172.21.15.84:0/2198444774 wait complete. 2024-09-21T03:47:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.098+0000 7f18c3799740 20 client.16467 trim_cache size 0 max 16384 2024-09-21T03:47:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.111+0000 7f18c3799740 1 Processor -- start 2024-09-21T03:47:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.111+0000 7f18c3799740 1 -- start start 2024-09-21T03:47:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.111+0000 7f18c3799740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56452086d1b0 0x564520c3d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.111+0000 7f18c3799740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520875390 0x564520c59460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.111+0000 7f18c3799740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520896070 0x564520c4bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:50.127 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.111+0000 7f18c3799740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81afcb0 con 0x564520896070 2024-09-21T03:47:50.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.111+0000 7f18c3799740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81ad580 con 0x564520875390 2024-09-21T03:47:50.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.111+0000 7f18c3799740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81ab3f0 con 0x56452086d1b0 2024-09-21T03:47:50.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.111+0000 7f18b659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520896070 0x564520c4bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:50.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.111+0000 7f18b659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520896070 0x564520c4bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34546/0 (socket says 172.21.15.84:34546) 2024-09-21T03:47:50.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.111+0000 7f18b659c640 1 -- 172.21.15.84:0/1115491150 learned_addr learned my addr 172.21.15.84:0/1115491150 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:50.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.112+0000 7f18b659c640 1 --2- 172.21.15.84:0/1115491150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56452086d1b0 0x564520c3d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:50.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.112+0000 7f18b6d9d640 1 --2- 172.21.15.84:0/1115491150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520875390 0x564520c59460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:50.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.112+0000 7f18b659c640 1 -- 172.21.15.84:0/1115491150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56452086d1b0 msgr2=0x564520c3d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:50.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.112+0000 7f18b659c640 1 --2- 172.21.15.84:0/1115491150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56452086d1b0 0x564520c3d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.112+0000 7f18b659c640 1 -- 172.21.15.84:0/1115491150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520875390 msgr2=0x564520c59460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:50.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.112+0000 7f18b659c640 1 --2- 172.21.15.84:0/1115491150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520875390 0x564520c59460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.112+0000 7f18b659c640 1 -- 172.21.15.84:0/1115491150 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564520c40500 con 0x564520896070 2024-09-21T03:47:50.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.112+0000 7f18b659c640 1 --2- 172.21.15.84:0/1115491150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520896070 0x564520c4bba0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00b530 tx=0x7f18ac010db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4743d67f50604d68 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:50.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.112+0000 7f189cff9640 1 -- 172.21.15.84:0/1115491150 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac00b9f0 con 0x564520896070 2024-09-21T03:47:50.128 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.112+0000 7f189cff9640 1 -- 172.21.15.84:0/1115491150 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18ac0120e0 con 0x564520896070 2024-09-21T03:47:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.112+0000 7f189cff9640 1 -- 172.21.15.84:0/1115491150 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac010a90 con 0x564520896070 2024-09-21T03:47:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.113+0000 7f18c3799740 1 -- 172.21.15.84:0/1115491150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520896070 msgr2=0x564520c4bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.113+0000 7f18c3799740 1 --2- 172.21.15.84:0/1115491150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520896070 0x564520c4bba0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00b530 tx=0x7f18ac010db0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.113+0000 7f18c3799740 1 -- 172.21.15.84:0/1115491150 shutdown_connections 2024-09-21T03:47:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.113+0000 7f18c3799740 1 --2- 172.21.15.84:0/1115491150 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564520896070 0x564520c4bba0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.113+0000 7f18c3799740 1 --2- 172.21.15.84:0/1115491150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520875390 0x564520c59460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.113+0000 7f18c3799740 1 --2- 172.21.15.84:0/1115491150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56452086d1b0 0x564520c3d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.113+0000 7f18c3799740 1 -- 172.21.15.84:0/1115491150 >> 172.21.15.84:0/1115491150 conn(0x56452088a460 msgr2=0x564520c43e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.113+0000 7f18c3799740 1 -- 172.21.15.84:0/1115491150 shutdown_connections 2024-09-21T03:47:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.113+0000 7f18c3799740 1 -- 172.21.15.84:0/1115491150 wait complete. 2024-09-21T03:47:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.113+0000 7f18c3799740 1 -- start start 2024-09-21T03:47:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.113+0000 7f18c3799740 1 Processor -- start 2024-09-21T03:47:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.114+0000 7f18c3799740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56452086d1b0 0x564520c64d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:50.129 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.114+0000 7f18c3799740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520875390 0x564520c652c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.114+0000 7f18c3799740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564520896070 0x564520c55690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.114+0000 7f18c3799740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81aba40 con 0x56452086d1b0 2024-09-21T03:47:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.114+0000 7f18c3799740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81aceb0 con 0x564520875390 2024-09-21T03:47:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.114+0000 7f18c3799740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81ac110 con 0x564520896070 2024-09-21T03:47:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.114+0000 7f18c3799740 10 client.0 _ll_register_callbacks cb 0x7f18ac00bdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.114+0000 7f18b659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56452086d1b0 0x564520c64d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.114+0000 7f18b659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56452086d1b0 0x564520c64d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34548/0 (socket says 172.21.15.84:34548) 2024-09-21T03:47:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.114+0000 7f18b659c640 1 -- 172.21.15.84:0/2674486703 learned_addr learned my addr 172.21.15.84:0/2674486703 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.114+0000 7f18b659c640 1 -- 172.21.15.84:0/2674486703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564520896070 msgr2=0x564520c55690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.114+0000 7f18b659c640 1 --2- 172.21.15.84:0/2674486703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564520896070 0x564520c55690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.114+0000 7f18b659c640 1 -- 172.21.15.84:0/2674486703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520875390 msgr2=0x564520c652c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.114+0000 7f18b659c640 1 --2- 172.21.15.84:0/2674486703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520875390 0x564520c652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.130 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.114+0000 7f18b659c640 1 -- 172.21.15.84:0/2674486703 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564520c55e20 con 0x56452086d1b0 2024-09-21T03:47:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.114+0000 7f18b659c640 1 --2- 172.21.15.84:0/2674486703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56452086d1b0 0x564520c64d60 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00b450 tx=0x7f18ac02e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44a16aa67074771 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.114+0000 7f189aff5640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.114+0000 7f189aff5640 1 -- 172.21.15.84:0/2674486703 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac00be80 con 0x56452086d1b0 2024-09-21T03:47:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.114+0000 7f189aff5640 1 -- 172.21.15.84:0/2674486703 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f18ac010a40 con 0x56452086d1b0 2024-09-21T03:47:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.114+0000 7f18c3799740 1 -- 172.21.15.84:0/2674486703 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18ac0120e0 con 0x56452086d1b0 2024-09-21T03:47:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.115+0000 7f189aff5640 1 -- 172.21.15.84:0/2674486703 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f18ac044050 con 0x56452086d1b0 2024-09-21T03:47:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.115+0000 7f18c3799740 10 client.16473 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.115+0000 7f18c3799740 1 -- 172.21.15.84:0/2674486703 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564520c596c0 con 0x56452086d1b0 2024-09-21T03:47:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.115+0000 7f189aff5640 1 -- 172.21.15.84:0/2674486703 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18ac0120e0 con 0x56452086d1b0 2024-09-21T03:47:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.115+0000 7f189aff5640 1 -- 172.21.15.84:0/2674486703 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f18ac0052f0 con 0x56452086d1b0 2024-09-21T03:47:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.115+0000 7f18c3799740 10 client.16473 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.115+0000 7f18c3799740 10 client.16473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:47:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.115+0000 7f18c3799740 20 client.16473 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.115+0000 7f18c3799740 1 --2- 172.21.15.84:0/2674486703 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564520829da0 0x564520ccbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:50.131 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.115+0000 7f18c3799740 4 client.16473 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:47:50.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.115+0000 7f18c3799740 1 -- 172.21.15.84:0/2674486703 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564520bb18a0 con 0x564520829da0 2024-09-21T03:47:50.132 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.115+0000 7f18b6d9d640 1 --2- 172.21.15.84:0/2674486703 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564520829da0 0x564520ccbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.116+0000 7f189aff5640 10 client.16473 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.116+0000 7f18b6d9d640 1 --2- 172.21.15.84:0/2674486703 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564520829da0 0x564520ccbe10 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a0af41d22160565 server_cookie=c92991366b563c16 in_seq=0 out_seq=0 2024-09-21T03:47:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.116+0000 7f189aff5640 1 -- 172.21.15.84:0/2674486703 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564520bb18a0 con 0x564520829da0 2024-09-21T03:47:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.116+0000 7f189aff5640 10 client.16473 handle_command_reply: tid=0 2024-09-21T03:47:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.116+0000 7f18c3799740 1 client.16473 shutdown 2024-09-21T03:47:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.116+0000 7f18c3799740 1 -- 172.21.15.84:0/2674486703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56452086d1b0 msgr2=0x564520c64d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:50.133 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.116+0000 7f18c3799740 1 --2- 172.21.15.84:0/2674486703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56452086d1b0 0x564520c64d60 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f18ac00b450 tx=0x7f18ac02e4d0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.116+0000 7f18c3799740 1 -- 172.21.15.84:0/2674486703 shutdown_connections 2024-09-21T03:47:50.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.116+0000 7f18c3799740 1 --2- 172.21.15.84:0/2674486703 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564520829da0 0x564520ccbe10 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.116+0000 7f18c3799740 1 --2- 172.21.15.84:0/2674486703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564520896070 0x564520c55690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.116+0000 7f18c3799740 1 --2- 172.21.15.84:0/2674486703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520875390 0x564520c652c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.116+0000 7f189aff5640 0 client.16473 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:50.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.116+0000 7f18c3799740 1 --2- 172.21.15.84:0/2674486703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56452086d1b0 0x564520c64d60 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.116+0000 7f18c3799740 1 -- 172.21.15.84:0/2674486703 >> 172.21.15.84:0/2674486703 conn(0x56452088a460 msgr2=0x564520c44f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:50.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.116+0000 7f18c3799740 1 -- 172.21.15.84:0/2674486703 shutdown_connections 2024-09-21T03:47:50.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.116+0000 7f18c3799740 1 -- 172.21.15.84:0/2674486703 wait complete. 2024-09-21T03:47:50.134 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.116+0000 7f18c3799740 20 client.16473 trim_cache size 0 max 16384 2024-09-21T03:47:50.135 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:47:50.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.117+0000 7f18bd225640 1 -- 172.21.15.84:0/1523084665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f18a00b6680 msgr2=0x7f18a00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:50.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.117+0000 7f18bd225640 1 --2- 172.21.15.84:0/1523084665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f18a00b6680 0x7f18a00b8b90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f18b00cbc30 tx=0x7f18b009bdb0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.117+0000 7f18bd225640 1 -- 172.21.15.84:0/1523084665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b8108d20 msgr2=0x7f18b819ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:50.135 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.117+0000 7f18bd225640 1 --2- 172.21.15.84:0/1523084665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b8108d20 0x7f18b819ec40 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f18b0005cc0 tx=0x7f18b002f380 comp rx=0 tx=0).stop 2024-09-21T03:47:50.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.117+0000 7f18bd225640 1 -- 172.21.15.84:0/1523084665 shutdown_connections 2024-09-21T03:47:50.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.117+0000 7f18bd225640 1 --2- 172.21.15.84:0/1523084665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f18a00b6680 0x7f18a00b8b90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.117+0000 7f18bd225640 1 --2- 172.21.15.84:0/1523084665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f18b8108d20 0x7f18b819ec40 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.117+0000 7f18bd225640 1 --2- 172.21.15.84:0/1523084665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f18b81083d0 0x7f18b81999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.117+0000 7f18bd225640 1 --2- 172.21.15.84:0/1523084665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18b8102ae0 0x7f18b8199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:50.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.117+0000 7f18bd225640 1 -- 172.21.15.84:0/1523084665 >> 172.21.15.84:0/1523084665 conn(0x7f18b8079760 msgr2=0x7f18b8104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:50.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.117+0000 7f18bd225640 1 -- 172.21.15.84:0/1523084665 shutdown_connections 2024-09-21T03:47:50.136 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:50.117+0000 7f18bd225640 1 -- 172.21.15.84:0/1523084665 wait complete. 2024-09-21T03:47:50.794 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:50 smithi084 ceph-mon[30941]: pgmap v485: 97 pgs: 97 active+clean; 7.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-09-21T03:47:50.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:50 smithi174 ceph-mon[34403]: pgmap v485: 97 pgs: 97 active+clean; 7.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-09-21T03:47:50.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:50 smithi172 ceph-mon[34821]: pgmap v485: 97 pgs: 97 active+clean; 7.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-09-21T03:47:51.822 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:47:51.823 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:47:52.081 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:47:52.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.565+0000 7f51b161a640 1 -- 172.21.15.84:0/1170695711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac102a60 msgr2=0x7f51ac102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:52.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.565+0000 7f51b161a640 1 --2- 172.21.15.84:0/1170695711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac102a60 0x7f51ac102e70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f519c009ca0 tx=0x7f519c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.565+0000 7f51b161a640 1 -- 172.21.15.84:0/1170695711 shutdown_connections 2024-09-21T03:47:52.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.565+0000 7f51b161a640 1 --2- 172.21.15.84:0/1170695711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51ac108cf0 0x7f51ac10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.565+0000 7f51b161a640 1 --2- 172.21.15.84:0/1170695711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51ac1083a0 0x7f51ac1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.565+0000 7f51b161a640 1 --2- 172.21.15.84:0/1170695711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac102a60 0x7f51ac102e70 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.565+0000 7f51b161a640 1 -- 172.21.15.84:0/1170695711 >> 172.21.15.84:0/1170695711 conn(0x7f51ac079730 msgr2=0x7f51ac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:52.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.565+0000 7f51b161a640 1 -- 172.21.15.84:0/1170695711 shutdown_connections 2024-09-21T03:47:52.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.565+0000 7f51b161a640 1 -- 172.21.15.84:0/1170695711 wait complete. 2024-09-21T03:47:52.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.565+0000 7f51b161a640 1 Processor -- start 2024-09-21T03:47:52.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.566+0000 7f51b161a640 1 -- start start 2024-09-21T03:47:52.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.566+0000 7f51b161a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51ac102a60 0x7f51ac19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:52.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.566+0000 7f51b161a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac1083a0 0x7f51ac19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:52.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.566+0000 7f51b161a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51ac108cf0 0x7f51ac19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:52.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.566+0000 7f51b161a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac1129c0 con 0x7f51ac1083a0 2024-09-21T03:47:52.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.566+0000 7f51b161a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac112840 con 0x7f51ac102a60 2024-09-21T03:47:52.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.566+0000 7f51b161a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac112b40 con 0x7f51ac108cf0 2024-09-21T03:47:52.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.566+0000 7f51aa7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac1083a0 0x7f51ac19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:52.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.566+0000 7f51aa7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac1083a0 0x7f51ac19aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34566/0 (socket says 172.21.15.84:34566) 2024-09-21T03:47:52.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.566+0000 7f51aa7fc640 1 -- 172.21.15.84:0/840284295 learned_addr learned my addr 172.21.15.84:0/840284295 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:52.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.566+0000 7f51ab7fe640 1 --2- 172.21.15.84:0/840284295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51ac108cf0 0x7f51ac19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:52.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.566+0000 7f51aaffd640 1 --2- 172.21.15.84:0/840284295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51ac102a60 0x7f51ac19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:52.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.566+0000 7f51aa7fc640 1 -- 172.21.15.84:0/840284295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51ac108cf0 msgr2=0x7f51ac19fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:52.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.566+0000 7f51aa7fc640 1 --2- 172.21.15.84:0/840284295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51ac108cf0 0x7f51ac19fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.566+0000 7f51aa7fc640 1 -- 172.21.15.84:0/840284295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51ac102a60 msgr2=0x7f51ac19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:52.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.566+0000 7f51aa7fc640 1 --2- 172.21.15.84:0/840284295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51ac102a60 0x7f51ac19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.566+0000 7f51aa7fc640 1 -- 172.21.15.84:0/840284295 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ac1a0410 con 0x7f51ac1083a0 2024-09-21T03:47:52.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.566+0000 7f51aa7fc640 1 --2- 172.21.15.84:0/840284295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac1083a0 0x7f51ac19aa40 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f51a000b450 tx=0x7f51a000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:52.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.567+0000 7f5193fff640 1 -- 172.21.15.84:0/840284295 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a0015020 con 0x7f51ac1083a0 2024-09-21T03:47:52.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.567+0000 7f51b161a640 1 -- 172.21.15.84:0/840284295 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51ac1a0700 con 0x7f51ac1083a0 2024-09-21T03:47:52.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.567+0000 7f5193fff640 1 -- 172.21.15.84:0/840284295 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51a0011d40 con 0x7f51ac1083a0 2024-09-21T03:47:52.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.567+0000 7f5193fff640 1 -- 172.21.15.84:0/840284295 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a000f340 con 0x7f51ac1083a0 2024-09-21T03:47:52.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.567+0000 7f51b161a640 1 -- 172.21.15.84:0/840284295 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51ac1a6ee0 con 0x7f51ac1083a0 2024-09-21T03:47:52.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.569+0000 7f51b7b8e740 1 Processor -- start 2024-09-21T03:47:52.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.569+0000 7f5193fff640 1 -- 172.21.15.84:0/840284295 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f51a0018020 con 0x7f51ac1083a0 2024-09-21T03:47:52.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.569+0000 7f51b7b8e740 1 -- start start 2024-09-21T03:47:52.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f51b7b8e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa80350 0x56132ae27430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:52.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f51b7b8e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa57490 0x56132ae27970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:52.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f51b7b8e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa5f670 0x56132ae27eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:52.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f51b7b8e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56132ad9de60 con 0x56132aa80350 2024-09-21T03:47:52.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f51b7b8e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56132ad8d290 con 0x56132aa5f670 2024-09-21T03:47:52.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f51b7b8e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56132ad910a0 con 0x56132aa57490 2024-09-21T03:47:52.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f51ab7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa80350 0x56132ae27430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:52.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f51ab7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa80350 0x56132ae27430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34574/0 (socket says 172.21.15.84:34574) 2024-09-21T03:47:52.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f51ab7fe640 1 -- 172.21.15.84:0/131541990 learned_addr learned my addr 172.21.15.84:0/131541990 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:52.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f51aaffd640 1 --2- 172.21.15.84:0/131541990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa57490 0x56132ae27970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:52.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f51ab7fe640 1 -- 172.21.15.84:0/131541990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa57490 msgr2=0x56132ae27970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:52.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f51ab7fe640 1 --2- 172.21.15.84:0/131541990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa57490 0x56132ae27970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f51ab7fe640 1 -- 172.21.15.84:0/131541990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa5f670 msgr2=0x56132ae27eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:52.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f51aa7fc640 1 --2- 172.21.15.84:0/131541990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa5f670 0x56132ae27eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:52.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f51ab7fe640 1 --2- 172.21.15.84:0/131541990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa5f670 0x56132ae27eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f51ab7fe640 1 -- 172.21.15.84:0/131541990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56132aaeb930 con 0x56132aa80350 2024-09-21T03:47:52.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f51aa7fc640 1 --2- 172.21.15.84:0/131541990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa5f670 0x56132ae27eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:47:52.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f5193fff640 1 --2- 172.21.15.84:0/840284295 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f51940b6680 0x7f51940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:52.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f51ab7fe640 1 --2- 172.21.15.84:0/131541990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa80350 0x56132ae27430 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f51a400bc70 tx=0x7f51a400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8fabecc6856c3d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:52.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f51aaffd640 1 --2- 172.21.15.84:0/840284295 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f51940b6680 0x7f51940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:52.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.570+0000 7f51917fa640 1 -- 172.21.15.84:0/131541990 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a4015070 con 0x56132aa80350 2024-09-21T03:47:52.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.571+0000 7f5193fff640 1 -- 172.21.15.84:0/840284295 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f51a00e7140 con 0x7f51ac1083a0 2024-09-21T03:47:52.574 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.571+0000 7f51917fa640 1 -- 172.21.15.84:0/131541990 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51a40118f0 con 0x56132aa80350 2024-09-21T03:47:52.575 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.571+0000 7f51917fa640 1 -- 172.21.15.84:0/131541990 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a40107d0 con 0x56132aa80350 2024-09-21T03:47:52.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.571+0000 7f51b7b8e740 1 -- 172.21.15.84:0/131541990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa80350 msgr2=0x56132ae27430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:52.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.571+0000 7f51aaffd640 1 --2- 172.21.15.84:0/840284295 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f51940b6680 0x7f51940b8b90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x56132ae260b0 tx=0x7f519c0093f0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:52.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.571+0000 7f51b7b8e740 1 --2- 172.21.15.84:0/131541990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa80350 0x56132ae27430 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f51a400bc70 tx=0x7f51a400f730 comp rx=0 tx=0).stop 2024-09-21T03:47:52.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.572+0000 7f51b7b8e740 1 -- 172.21.15.84:0/131541990 shutdown_connections 2024-09-21T03:47:52.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.572+0000 7f51b7b8e740 1 --2- 172.21.15.84:0/131541990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa5f670 0x56132ae27eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.572+0000 7f51b7b8e740 1 --2- 172.21.15.84:0/131541990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa57490 0x56132ae27970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.578 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.572+0000 7f51b7b8e740 1 --2- 172.21.15.84:0/131541990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa80350 0x56132ae27430 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.572+0000 7f51b7b8e740 1 -- 172.21.15.84:0/131541990 >> 172.21.15.84:0/131541990 conn(0x56132aa74740 msgr2=0x56132ae25320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.572+0000 7f51b7b8e740 1 -- 172.21.15.84:0/131541990 shutdown_connections 2024-09-21T03:47:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.572+0000 7f51b7b8e740 1 -- 172.21.15.84:0/131541990 wait complete. 2024-09-21T03:47:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.572+0000 7f51b7b8e740 1 -- start start 2024-09-21T03:47:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.572+0000 7f51b7b8e740 1 Processor -- start 2024-09-21T03:47:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.572+0000 7f51b7b8e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa57490 0x56132ae33010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.572+0000 7f51b7b8e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa5f670 0x56132ae33550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.572+0000 7f51b7b8e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa80350 0x56132ae3ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.572+0000 7f51b7b8e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56132abee890 con 0x56132aa80350 2024-09-21T03:47:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.572+0000 7f51b7b8e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56132ad27d40 con 0x56132aa57490 2024-09-21T03:47:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.572+0000 7f51b7b8e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56132ae35c10 con 0x56132aa5f670 2024-09-21T03:47:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.572+0000 7f51b7b8e740 10 client.0 _ll_register_callbacks cb 0x56132ad8bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.573+0000 7f51ab7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa80350 0x56132ae3ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:52.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.573+0000 7f51ab7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa80350 0x56132ae3ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34580/0 (socket says 172.21.15.84:34580) 2024-09-21T03:47:52.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.573+0000 7f51ab7fe640 1 -- 172.21.15.84:0/338553651 learned_addr learned my addr 172.21.15.84:0/338553651 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:52.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.573+0000 7f51aaffd640 1 --2- 172.21.15.84:0/338553651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa57490 0x56132ae33010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:52.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.573+0000 7f51aa7fc640 1 --2- 172.21.15.84:0/338553651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa5f670 0x56132ae33550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:52.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.573+0000 7f51ab7fe640 1 -- 172.21.15.84:0/338553651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa5f670 msgr2=0x56132ae33550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:52.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.573+0000 7f51ab7fe640 1 --2- 172.21.15.84:0/338553651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa5f670 0x56132ae33550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.573+0000 7f51ab7fe640 1 -- 172.21.15.84:0/338553651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa57490 msgr2=0x56132ae33010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:52.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.573+0000 7f51ab7fe640 1 --2- 172.21.15.84:0/338553651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa57490 0x56132ae33010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.573+0000 7f51ab7fe640 1 -- 172.21.15.84:0/338553651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56132ae3f4c0 con 0x56132aa80350 2024-09-21T03:47:52.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.573+0000 7f51aa7fc640 1 --2- 172.21.15.84:0/338553651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa5f670 0x56132ae33550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:47:52.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.573+0000 7f51ab7fe640 1 --2- 172.21.15.84:0/338553651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa80350 0x56132ae3ef30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f51a400bc40 tx=0x7f51a4011670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a1a661d6e0a66f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:52.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.573+0000 7f518eff5640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:52.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.573+0000 7f518eff5640 1 -- 172.21.15.84:0/338553651 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a4028060 con 0x56132aa80350 2024-09-21T03:47:52.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.573+0000 7f518eff5640 1 -- 172.21.15.84:0/338553651 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f51a4011cb0 con 0x56132aa80350 2024-09-21T03:47:52.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.573+0000 7f51b7b8e740 1 -- 172.21.15.84:0/338553651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51a40118f0 con 0x56132aa80350 2024-09-21T03:47:52.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.573+0000 7f518eff5640 1 -- 172.21.15.84:0/338553651 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f51a4015070 con 0x56132aa80350 2024-09-21T03:47:52.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.573+0000 7f51b7b8e740 10 client.16485 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:52.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.573+0000 7f51b7b8e740 1 -- 172.21.15.84:0/338553651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56132ae46170 con 0x56132aa80350 2024-09-21T03:47:52.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.574+0000 7f518eff5640 1 -- 172.21.15.84:0/338553651 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51a40118f0 con 0x56132aa80350 2024-09-21T03:47:52.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.574+0000 7f518eff5640 1 -- 172.21.15.84:0/338553651 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f51a4004be0 con 0x56132aa80350 2024-09-21T03:47:52.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.574+0000 7f51b7b8e740 10 client.16485 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:52.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.574+0000 7f51b7b8e740 10 client.16485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:47:52.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.574+0000 7f51b7b8e740 20 client.16485 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:52.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.574+0000 7f51b7b8e740 1 --2- 172.21.15.84:0/338553651 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56132aa3ecd0 0x56132ae49580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:52.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.574+0000 7f51b7b8e740 4 client.16485 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:47:52.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.574+0000 7f51b7b8e740 1 -- 172.21.15.84:0/338553651 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56132ad9fdb0 con 0x56132aa3ecd0 2024-09-21T03:47:52.581 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.574+0000 7f51aaffd640 1 --2- 172.21.15.84:0/338553651 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56132aa3ecd0 0x56132ae49580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:52.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.575+0000 7f518eff5640 10 client.16485 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:52.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.575+0000 7f51aaffd640 1 --2- 172.21.15.84:0/338553651 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56132aa3ecd0 0x56132ae49580 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43476460fb01f2a6 server_cookie=2b586b6ec6894933 in_seq=0 out_seq=0 2024-09-21T03:47:52.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.575+0000 7f518eff5640 1 -- 172.21.15.84:0/338553651 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56132ad9fdb0 con 0x56132aa3ecd0 2024-09-21T03:47:52.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.575+0000 7f518eff5640 10 client.16485 handle_command_reply: tid=0 2024-09-21T03:47:52.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.575+0000 7f51b7b8e740 1 client.16485 shutdown 2024-09-21T03:47:52.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.576+0000 7f51b7b8e740 1 -- 172.21.15.84:0/338553651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa80350 msgr2=0x56132ae3ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:52.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.576+0000 7f51b7b8e740 1 --2- 172.21.15.84:0/338553651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa80350 0x56132ae3ef30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f51a400bc40 tx=0x7f51a4011670 comp rx=0 tx=0).stop 2024-09-21T03:47:52.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.576+0000 7f51b7b8e740 1 -- 172.21.15.84:0/338553651 shutdown_connections 2024-09-21T03:47:52.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.576+0000 7f51b7b8e740 1 --2- 172.21.15.84:0/338553651 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56132aa3ecd0 0x56132ae49580 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.576+0000 7f51b7b8e740 1 --2- 172.21.15.84:0/338553651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa80350 0x56132ae3ef30 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.576+0000 7f51b7b8e740 1 --2- 172.21.15.84:0/338553651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa5f670 0x56132ae33550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.576+0000 7f518eff5640 0 client.16485 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:52.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.576+0000 7f51b7b8e740 1 --2- 172.21.15.84:0/338553651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa57490 0x56132ae33010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.576+0000 7f51b7b8e740 1 -- 172.21.15.84:0/338553651 >> 172.21.15.84:0/338553651 conn(0x56132aa74740 msgr2=0x56132ae2a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:52.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.576+0000 7f51b7b8e740 1 -- 172.21.15.84:0/338553651 shutdown_connections 2024-09-21T03:47:52.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.576+0000 7f51b7b8e740 1 -- 172.21.15.84:0/338553651 wait complete. 2024-09-21T03:47:52.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.576+0000 7f51b7b8e740 20 client.16485 trim_cache size 0 max 16384 2024-09-21T03:47:52.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.593+0000 7f51b7b8e740 1 Processor -- start 2024-09-21T03:47:52.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.593+0000 7f51b7b8e740 1 -- start start 2024-09-21T03:47:52.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.593+0000 7f51b7b8e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa3ecd0 0x56132ae3eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:52.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.593+0000 7f51b7b8e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa57490 0x56132ae2ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:52.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.593+0000 7f51b7b8e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa5f670 0x56132ae2c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:52.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.594+0000 7f51b7b8e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac1afd10 con 0x56132aa5f670 2024-09-21T03:47:52.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.594+0000 7f51b7b8e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac1ad5e0 con 0x56132aa3ecd0 2024-09-21T03:47:52.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.594+0000 7f51b7b8e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac1ab430 con 0x56132aa57490 2024-09-21T03:47:52.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.594+0000 7f51ab7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa5f670 0x56132ae2c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:52.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.594+0000 7f51ab7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa5f670 0x56132ae2c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34590/0 (socket says 172.21.15.84:34590) 2024-09-21T03:47:52.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.594+0000 7f51ab7fe640 1 -- 172.21.15.84:0/2777854299 learned_addr learned my addr 172.21.15.84:0/2777854299 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:52.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.594+0000 7f51aaffd640 1 --2- 172.21.15.84:0/2777854299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa3ecd0 0x56132ae3eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:52.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.594+0000 7f51aa7fc640 1 --2- 172.21.15.84:0/2777854299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa57490 0x56132ae2ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:52.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.594+0000 7f51ab7fe640 1 -- 172.21.15.84:0/2777854299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa57490 msgr2=0x56132ae2ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:52.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.594+0000 7f51ab7fe640 1 --2- 172.21.15.84:0/2777854299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa57490 0x56132ae2ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.594+0000 7f51ab7fe640 1 -- 172.21.15.84:0/2777854299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa3ecd0 msgr2=0x56132ae3eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:52.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.594+0000 7f51ab7fe640 1 --2- 172.21.15.84:0/2777854299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa3ecd0 0x56132ae3eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.594+0000 7f51ab7fe640 1 -- 172.21.15.84:0/2777854299 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56132ae29720 con 0x56132aa5f670 2024-09-21T03:47:52.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.594+0000 7f51ab7fe640 1 --2- 172.21.15.84:0/2777854299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa5f670 0x56132ae2c6b0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f51a400c010 tx=0x7f51a400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c8f7219690f19a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:52.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.594+0000 7f5190ff9640 1 -- 172.21.15.84:0/2777854299 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a4028070 con 0x56132aa5f670 2024-09-21T03:47:52.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.594+0000 7f5190ff9640 1 -- 172.21.15.84:0/2777854299 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51a40116e0 con 0x56132aa5f670 2024-09-21T03:47:52.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.594+0000 7f5190ff9640 1 -- 172.21.15.84:0/2777854299 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a40052a0 con 0x56132aa5f670 2024-09-21T03:47:52.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.595+0000 7f51b7b8e740 1 -- 172.21.15.84:0/2777854299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa5f670 msgr2=0x56132ae2c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:52.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.595+0000 7f51b7b8e740 1 --2- 172.21.15.84:0/2777854299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa5f670 0x56132ae2c6b0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f51a400c010 tx=0x7f51a400f730 comp rx=0 tx=0).stop 2024-09-21T03:47:52.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.595+0000 7f51b7b8e740 1 -- 172.21.15.84:0/2777854299 shutdown_connections 2024-09-21T03:47:52.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.595+0000 7f51b7b8e740 1 --2- 172.21.15.84:0/2777854299 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa5f670 0x56132ae2c6b0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.595+0000 7f51b7b8e740 1 --2- 172.21.15.84:0/2777854299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa57490 0x56132ae2ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.595+0000 7f51b7b8e740 1 --2- 172.21.15.84:0/2777854299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa3ecd0 0x56132ae3eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.595+0000 7f51b7b8e740 1 -- 172.21.15.84:0/2777854299 >> 172.21.15.84:0/2777854299 conn(0x56132aa74740 msgr2=0x56132ae2a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:52.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.595+0000 7f51b7b8e740 1 -- 172.21.15.84:0/2777854299 shutdown_connections 2024-09-21T03:47:52.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.595+0000 7f51b7b8e740 1 -- 172.21.15.84:0/2777854299 wait complete. 2024-09-21T03:47:52.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.595+0000 7f51b7b8e740 1 -- start start 2024-09-21T03:47:52.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.596+0000 7f51b7b8e740 1 Processor -- start 2024-09-21T03:47:52.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.596+0000 7f51b7b8e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa3ecd0 0x56132ae4cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:52.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.596+0000 7f51b7b8e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa57490 0x56132ae49160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:52.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.596+0000 7f51b7b8e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa5f670 0x56132ae496a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:52.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.596+0000 7f51b7b8e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac1abaa0 con 0x56132aa5f670 2024-09-21T03:47:52.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.596+0000 7f51b7b8e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac1acf10 con 0x56132aa57490 2024-09-21T03:47:52.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.596+0000 7f51b7b8e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac1ac170 con 0x56132aa3ecd0 2024-09-21T03:47:52.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.596+0000 7f51b7b8e740 10 client.0 _ll_register_callbacks cb 0x7f51a400bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:52.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.596+0000 7f51ab7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa5f670 0x56132ae496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:52.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.596+0000 7f51aa7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa57490 0x56132ae49160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:52.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.596+0000 7f51aaffd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa3ecd0 0x56132ae4cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:52.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.596+0000 7f51aa7fc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa57490 0x56132ae49160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:46726/0 (socket says 172.21.15.84:46726) 2024-09-21T03:47:52.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.596+0000 7f51aa7fc640 1 -- 172.21.15.84:0/157026658 learned_addr learned my addr 172.21.15.84:0/157026658 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:52.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.596+0000 7f51ab7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa5f670 0x56132ae496a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34596/0 (socket says 172.21.15.84:34596) 2024-09-21T03:47:52.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.596+0000 7f51ab7fe640 1 -- 172.21.15.84:0/157026658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa3ecd0 msgr2=0x56132ae4cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:52.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.596+0000 7f51ab7fe640 1 --2- 172.21.15.84:0/157026658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa3ecd0 0x56132ae4cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.596+0000 7f51ab7fe640 1 -- 172.21.15.84:0/157026658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa57490 msgr2=0x56132ae49160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:52.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.596+0000 7f51ab7fe640 1 --2- 172.21.15.84:0/157026658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa57490 0x56132ae49160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.596+0000 7f51ab7fe640 1 -- 172.21.15.84:0/157026658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56132ae49d40 con 0x56132aa5f670 2024-09-21T03:47:52.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.596+0000 7f51aa7fc640 1 --2- 172.21.15.84:0/157026658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa57490 0x56132ae49160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:47:52.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.597+0000 7f51ab7fe640 1 --2- 172.21.15.84:0/157026658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa5f670 0x56132ae496a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f51a400fc30 tx=0x7f51a4005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562695e225db584b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:52.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.597+0000 7f518eff5640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:52.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.597+0000 7f518eff5640 1 -- 172.21.15.84:0/157026658 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a4028070 con 0x56132aa5f670 2024-09-21T03:47:52.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.597+0000 7f518eff5640 1 -- 172.21.15.84:0/157026658 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f51a4011890 con 0x56132aa5f670 2024-09-21T03:47:52.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.597+0000 7f51b7b8e740 1 -- 172.21.15.84:0/157026658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51a40116e0 con 0x56132aa5f670 2024-09-21T03:47:52.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.597+0000 7f518eff5640 1 -- 172.21.15.84:0/157026658 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f51a4045050 con 0x56132aa5f670 2024-09-21T03:47:52.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.597+0000 7f51b7b8e740 10 client.16491 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:52.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.597+0000 7f51b7b8e740 1 -- 172.21.15.84:0/157026658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56132aeb4b90 con 0x56132aa5f670 2024-09-21T03:47:52.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.597+0000 7f518eff5640 1 -- 172.21.15.84:0/157026658 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51a40116e0 con 0x56132aa5f670 2024-09-21T03:47:52.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.597+0000 7f518eff5640 1 -- 172.21.15.84:0/157026658 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f51a4004640 con 0x56132aa5f670 2024-09-21T03:47:52.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.597+0000 7f51b7b8e740 10 client.16491 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:52.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.597+0000 7f51b7b8e740 10 client.16491 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:47:52.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.597+0000 7f51b7b8e740 20 client.16491 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:52.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.597+0000 7f51b7b8e740 1 --2- 172.21.15.84:0/157026658 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56132aa80350 0x56132aeb7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:52.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.597+0000 7f51b7b8e740 4 client.16491 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:47:52.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.597+0000 7f51b7b8e740 1 -- 172.21.15.84:0/157026658 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56132ad9b860 con 0x56132aa80350 2024-09-21T03:47:52.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.598+0000 7f51aaffd640 1 --2- 172.21.15.84:0/157026658 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56132aa80350 0x56132aeb7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:52.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.598+0000 7f518eff5640 10 client.16491 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:52.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.598+0000 7f51aaffd640 1 --2- 172.21.15.84:0/157026658 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56132aa80350 0x56132aeb7180 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c34d97a9a90cec51 server_cookie=a396ff040e277826 in_seq=0 out_seq=0 2024-09-21T03:47:52.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.600+0000 7f518eff5640 1 -- 172.21.15.84:0/157026658 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56132ad9b860 con 0x56132aa80350 2024-09-21T03:47:52.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.600+0000 7f518eff5640 10 client.16491 handle_command_reply: tid=0 2024-09-21T03:47:52.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.600+0000 7f51b7b8e740 1 client.16491 shutdown 2024-09-21T03:47:52.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.600+0000 7f51b7b8e740 1 -- 172.21.15.84:0/157026658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa5f670 msgr2=0x56132ae496a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:52.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.600+0000 7f51b7b8e740 1 --2- 172.21.15.84:0/157026658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa5f670 0x56132ae496a0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f51a400fc30 tx=0x7f51a4005bd0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.600+0000 7f51b7b8e740 1 -- 172.21.15.84:0/157026658 shutdown_connections 2024-09-21T03:47:52.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.600+0000 7f51b7b8e740 1 --2- 172.21.15.84:0/157026658 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56132aa80350 0x56132aeb7180 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.600+0000 7f51b7b8e740 1 --2- 172.21.15.84:0/157026658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56132aa5f670 0x56132ae496a0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.600+0000 7f51b7b8e740 1 --2- 172.21.15.84:0/157026658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56132aa57490 0x56132ae49160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.600+0000 7f51b7b8e740 1 --2- 172.21.15.84:0/157026658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56132aa3ecd0 0x56132ae4cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.600+0000 7f518eff5640 0 client.16491 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:52.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.600+0000 7f51b7b8e740 1 -- 172.21.15.84:0/157026658 >> 172.21.15.84:0/157026658 conn(0x56132aa74740 msgr2=0x56132ae2a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:52.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.600+0000 7f51b7b8e740 1 -- 172.21.15.84:0/157026658 shutdown_connections 2024-09-21T03:47:52.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.600+0000 7f51b7b8e740 1 -- 172.21.15.84:0/157026658 wait complete. 2024-09-21T03:47:52.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.600+0000 7f51b7b8e740 20 client.16491 trim_cache size 0 max 16384 2024-09-21T03:47:52.606 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:47:52.607 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T03:47:52.607 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "27dcb84c-89fa-46b2-b980-58857966c697", 2024-09-21T03:47:52.607 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T03:47:52.607 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:47:52.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.601+0000 7f51b161a640 1 -- 172.21.15.84:0/840284295 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f51940b6680 msgr2=0x7f51940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:52.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.601+0000 7f51b161a640 1 --2- 172.21.15.84:0/840284295 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f51940b6680 0x7f51940b8b90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x56132ae260b0 tx=0x7f519c0093f0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.601+0000 7f51b161a640 1 -- 172.21.15.84:0/840284295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac1083a0 msgr2=0x7f51ac19aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:52.607 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.601+0000 7f51b161a640 1 --2- 172.21.15.84:0/840284295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac1083a0 0x7f51ac19aa40 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f51a000b450 tx=0x7f51a000b910 comp rx=0 tx=0).stop 2024-09-21T03:47:52.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.601+0000 7f51b161a640 1 -- 172.21.15.84:0/840284295 shutdown_connections 2024-09-21T03:47:52.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.601+0000 7f51b161a640 1 --2- 172.21.15.84:0/840284295 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f51940b6680 0x7f51940b8b90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.601+0000 7f51b161a640 1 --2- 172.21.15.84:0/840284295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51ac108cf0 0x7f51ac19fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.601+0000 7f51b161a640 1 --2- 172.21.15.84:0/840284295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f51ac1083a0 0x7f51ac19aa40 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.601+0000 7f51b161a640 1 --2- 172.21.15.84:0/840284295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f51ac102a60 0x7f51ac19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:52.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.601+0000 7f51b161a640 1 -- 172.21.15.84:0/840284295 >> 172.21.15.84:0/840284295 conn(0x7f51ac079730 msgr2=0x7f51ac101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:52.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.601+0000 7f51b161a640 1 -- 172.21.15.84:0/840284295 shutdown_connections 2024-09-21T03:47:52.608 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:52.601+0000 7f51b161a640 1 -- 172.21.15.84:0/840284295 wait complete. 2024-09-21T03:47:52.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:52 smithi084 ceph-mon[30941]: pgmap v486: 97 pgs: 97 active+clean; 7.8 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 13 op/s 2024-09-21T03:47:52.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:52 smithi174 ceph-mon[34403]: pgmap v486: 97 pgs: 97 active+clean; 7.8 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 13 op/s 2024-09-21T03:47:52.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:52 smithi172 ceph-mon[34821]: pgmap v486: 97 pgs: 97 active+clean; 7.8 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 13 op/s 2024-09-21T03:47:53.324 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:47:53.571 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:47:53.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:53 smithi084 ceph-mon[30941]: scrub queued for path: / 2024-09-21T03:47:53.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:53 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:47:53.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:53 smithi084 ceph-mon[30941]: scrub summary: active paths [/] 2024-09-21T03:47:53.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:53 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:47:53.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:53 smithi174 ceph-mon[34403]: scrub queued for path: / 2024-09-21T03:47:53.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:53 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:47:53.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:53 smithi174 ceph-mon[34403]: scrub summary: active paths [/] 2024-09-21T03:47:53.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:53 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:47:53.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:53 smithi172 ceph-mon[34821]: scrub queued for path: / 2024-09-21T03:47:53.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:53 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:47:53.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:53 smithi172 ceph-mon[34821]: scrub summary: active paths [/] 2024-09-21T03:47:53.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:53 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:47:54.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.061+0000 7fa475180640 1 -- 172.21.15.84:0/561709242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa470108cf0 msgr2=0x7fa47010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:54.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.061+0000 7fa475180640 1 --2- 172.21.15.84:0/561709242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa470108cf0 0x7fa47010f520 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa460009900 tx=0x7fa46002a410 comp rx=0 tx=0).stop 2024-09-21T03:47:54.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.061+0000 7fa475180640 1 -- 172.21.15.84:0/561709242 shutdown_connections 2024-09-21T03:47:54.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.061+0000 7fa475180640 1 --2- 172.21.15.84:0/561709242 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa470108cf0 0x7fa47010f520 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.061+0000 7fa475180640 1 --2- 172.21.15.84:0/561709242 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4701083a0 0x7fa4701087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.061+0000 7fa475180640 1 --2- 172.21.15.84:0/561709242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa470102a60 0x7fa470102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.074 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.061+0000 7fa475180640 1 -- 172.21.15.84:0/561709242 >> 172.21.15.84:0/561709242 conn(0x7fa470079730 msgr2=0x7fa470079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.061+0000 7fa475180640 1 -- 172.21.15.84:0/561709242 shutdown_connections 2024-09-21T03:47:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.061+0000 7fa475180640 1 -- 172.21.15.84:0/561709242 wait complete. 2024-09-21T03:47:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.062+0000 7fa475180640 1 Processor -- start 2024-09-21T03:47:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.062+0000 7fa475180640 1 -- start start 2024-09-21T03:47:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.062+0000 7fa475180640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa470102a60 0x7fa47019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.062+0000 7fa475180640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4701083a0 0x7fa47019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.062+0000 7fa475180640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa470108cf0 0x7fa47019fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.062+0000 7fa475180640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa470112a40 con 0x7fa470102a60 2024-09-21T03:47:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.062+0000 7fa475180640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701128c0 con 0x7fa470108cf0 2024-09-21T03:47:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.062+0000 7fa475180640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa470112bc0 con 0x7fa4701083a0 2024-09-21T03:47:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.063+0000 7fa46ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa470102a60 0x7fa47019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.063+0000 7fa46ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa470102a60 0x7fa47019a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34616/0 (socket says 172.21.15.84:34616) 2024-09-21T03:47:54.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.063+0000 7fa46ed9d640 1 -- 172.21.15.84:0/2058295877 learned_addr learned my addr 172.21.15.84:0/2058295877 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:54.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.063+0000 7fa46f59e640 1 --2- 172.21.15.84:0/2058295877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa470108cf0 0x7fa47019fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:54.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.063+0000 7fa46e59c640 1 --2- 172.21.15.84:0/2058295877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4701083a0 0x7fa47019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:54.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.063+0000 7fa46ed9d640 1 -- 172.21.15.84:0/2058295877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4701083a0 msgr2=0x7fa47019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:54.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.063+0000 7fa46ed9d640 1 --2- 172.21.15.84:0/2058295877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4701083a0 0x7fa47019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.063+0000 7fa46ed9d640 1 -- 172.21.15.84:0/2058295877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa470108cf0 msgr2=0x7fa47019fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:54.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.063+0000 7fa46ed9d640 1 --2- 172.21.15.84:0/2058295877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa470108cf0 0x7fa47019fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.063+0000 7fa46ed9d640 1 -- 172.21.15.84:0/2058295877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4701a0510 con 0x7fa470102a60 2024-09-21T03:47:54.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.063+0000 7fa46e59c640 1 --2- 172.21.15.84:0/2058295877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4701083a0 0x7fa47019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:47:54.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.063+0000 7fa46ed9d640 1 --2- 172.21.15.84:0/2058295877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa470102a60 0x7fa47019a5a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa46800b4a0 tx=0x7fa46800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:54.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.063+0000 7fa457fff640 1 -- 172.21.15.84:0/2058295877 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa468014070 con 0x7fa470102a60 2024-09-21T03:47:54.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.063+0000 7fa475180640 1 -- 172.21.15.84:0/2058295877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4701a0800 con 0x7fa470102a60 2024-09-21T03:47:54.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.063+0000 7fa457fff640 1 -- 172.21.15.84:0/2058295877 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa468010ac0 con 0x7fa470102a60 2024-09-21T03:47:54.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.063+0000 7fa475180640 1 -- 172.21.15.84:0/2058295877 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4701a6fe0 con 0x7fa470102a60 2024-09-21T03:47:54.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.063+0000 7fa457fff640 1 -- 172.21.15.84:0/2058295877 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa468017c30 con 0x7fa470102a60 2024-09-21T03:47:54.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.066+0000 7fa47b6f4740 1 Processor -- start 2024-09-21T03:47:54.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.066+0000 7fa47b6f4740 1 -- start start 2024-09-21T03:47:54.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.066+0000 7fa457fff640 1 -- 172.21.15.84:0/2058295877 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fa468017070 con 0x7fa470102a60 2024-09-21T03:47:54.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.066+0000 7fa47b6f4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e7e070 0x564ed2225650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:54.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.066+0000 7fa47b6f4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e551b0 0x564ed2225b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:54.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.066+0000 7fa47b6f4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e5d390 0x564ed22260d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:54.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.066+0000 7fa47b6f4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564ed219be50 con 0x564ed1e551b0 2024-09-21T03:47:54.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.066+0000 7fa47b6f4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564ed218b280 con 0x564ed1e7e070 2024-09-21T03:47:54.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.066+0000 7fa47b6f4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564ed218f090 con 0x564ed1e5d390 2024-09-21T03:47:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.066+0000 7fa46ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e551b0 0x564ed2225b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.066+0000 7fa46ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e551b0 0x564ed2225b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34624/0 (socket says 172.21.15.84:34624) 2024-09-21T03:47:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.066+0000 7fa46ed9d640 1 -- 172.21.15.84:0/2400325832 learned_addr learned my addr 172.21.15.84:0/2400325832 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.067+0000 7fa46e59c640 1 --2- 172.21.15.84:0/2400325832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e5d390 0x564ed22260d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.067+0000 7fa46f59e640 1 --2- 172.21.15.84:0/2400325832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e7e070 0x564ed2225650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.067+0000 7fa46ed9d640 1 -- 172.21.15.84:0/2400325832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e5d390 msgr2=0x564ed22260d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.067+0000 7fa46ed9d640 1 --2- 172.21.15.84:0/2400325832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e5d390 0x564ed22260d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.067+0000 7fa46ed9d640 1 -- 172.21.15.84:0/2400325832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e7e070 msgr2=0x564ed2225650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.067+0000 7fa46ed9d640 1 --2- 172.21.15.84:0/2400325832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e7e070 0x564ed2225650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.067+0000 7fa46ed9d640 1 -- 172.21.15.84:0/2400325832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ed1ee9650 con 0x564ed1e551b0 2024-09-21T03:47:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.067+0000 7fa46ed9d640 1 --2- 172.21.15.84:0/2400325832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e551b0 0x564ed2225b90 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa4680e44a0 tx=0x7fa4680ed450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36e057e4aa0695f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:54.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.067+0000 7fa457fff640 1 --2- 172.21.15.84:0/2058295877 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4580b6680 0x7fa4580b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.067+0000 7fa4557fa640 1 -- 172.21.15.84:0/2400325832 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4680ac3a0 con 0x564ed1e551b0 2024-09-21T03:47:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.067+0000 7fa46f59e640 1 --2- 172.21.15.84:0/2058295877 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4580b6680 0x7fa4580b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.067+0000 7fa4557fa640 1 -- 172.21.15.84:0/2400325832 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4680ad330 con 0x564ed1e551b0 2024-09-21T03:47:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.067+0000 7fa4557fa640 1 -- 172.21.15.84:0/2400325832 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4680ac580 con 0x564ed1e551b0 2024-09-21T03:47:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.067+0000 7fa457fff640 1 -- 172.21.15.84:0/2058295877 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa4680e6d60 con 0x7fa470102a60 2024-09-21T03:47:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.068+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2400325832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e551b0 msgr2=0x564ed2225b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.068+0000 7fa47b6f4740 1 --2- 172.21.15.84:0/2400325832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e551b0 0x564ed2225b90 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa4680e44a0 tx=0x7fa4680ed450 comp rx=0 tx=0).stop 2024-09-21T03:47:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.068+0000 7fa46f59e640 1 --2- 172.21.15.84:0/2058295877 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4580b6680 0x7fa4580b8b90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa4600096c0 tx=0x7fa460005e60 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.068+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2400325832 shutdown_connections 2024-09-21T03:47:54.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.068+0000 7fa47b6f4740 1 --2- 172.21.15.84:0/2400325832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e5d390 0x564ed22260d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.068+0000 7fa47b6f4740 1 --2- 172.21.15.84:0/2400325832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e551b0 0x564ed2225b90 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.068+0000 7fa47b6f4740 1 --2- 172.21.15.84:0/2400325832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e7e070 0x564ed2225650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.068+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2400325832 >> 172.21.15.84:0/2400325832 conn(0x564ed1e72460 msgr2=0x564ed2223540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.068+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2400325832 shutdown_connections 2024-09-21T03:47:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.068+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2400325832 wait complete. 2024-09-21T03:47:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.069+0000 7fa47b6f4740 1 -- start start 2024-09-21T03:47:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.069+0000 7fa47b6f4740 1 Processor -- start 2024-09-21T03:47:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.069+0000 7fa47b6f4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e551b0 0x564ed2230c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:54.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.069+0000 7fa47b6f4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e5d390 0x564ed22311d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.069+0000 7fa47b6f4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e7e070 0x564ed2231710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.069+0000 7fa47b6f4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564ed1fec700 con 0x564ed1e7e070 2024-09-21T03:47:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.069+0000 7fa47b6f4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564ed2126110 con 0x564ed1e551b0 2024-09-21T03:47:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.069+0000 7fa47b6f4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564ed2233e30 con 0x564ed1e5d390 2024-09-21T03:47:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.069+0000 7fa47b6f4740 10 client.0 _ll_register_callbacks cb 0x564ed213f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.069+0000 7fa46f59e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e7e070 0x564ed2231710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.069+0000 7fa46f59e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e7e070 0x564ed2231710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34638/0 (socket says 172.21.15.84:34638) 2024-09-21T03:47:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.069+0000 7fa46f59e640 1 -- 172.21.15.84:0/2994891930 learned_addr learned my addr 172.21.15.84:0/2994891930 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.070+0000 7fa46e59c640 1 --2- 172.21.15.84:0/2994891930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e5d390 0x564ed22311d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.070+0000 7fa46ed9d640 1 --2- 172.21.15.84:0/2994891930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e551b0 0x564ed2230c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.070+0000 7fa46f59e640 1 -- 172.21.15.84:0/2994891930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e5d390 msgr2=0x564ed22311d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.070+0000 7fa46f59e640 1 --2- 172.21.15.84:0/2994891930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e5d390 0x564ed22311d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.070+0000 7fa46f59e640 1 -- 172.21.15.84:0/2994891930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e551b0 msgr2=0x564ed2230c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:54.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.070+0000 7fa46f59e640 1 --2- 172.21.15.84:0/2994891930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e551b0 0x564ed2230c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.070+0000 7fa46f59e640 1 -- 172.21.15.84:0/2994891930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ed2153c40 con 0x564ed1e7e070 2024-09-21T03:47:54.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.070+0000 7fa46f59e640 1 --2- 172.21.15.84:0/2994891930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e7e070 0x564ed2231710 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa460033000 tx=0x7fa460009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1e5485f00666d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:54.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.070+0000 7fa452ff5640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:54.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.070+0000 7fa452ff5640 1 -- 172.21.15.84:0/2994891930 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46004b070 con 0x564ed1e7e070 2024-09-21T03:47:54.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.070+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2994891930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4680ad330 con 0x564ed1e7e070 2024-09-21T03:47:54.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.070+0000 7fa452ff5640 1 -- 172.21.15.84:0/2994891930 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa460004460 con 0x564ed1e7e070 2024-09-21T03:47:54.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.070+0000 7fa452ff5640 1 -- 172.21.15.84:0/2994891930 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa460057050 con 0x564ed1e7e070 2024-09-21T03:47:54.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.070+0000 7fa47b6f4740 10 client.16503 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:54.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.070+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2994891930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564ed223fa90 con 0x564ed1e7e070 2024-09-21T03:47:54.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.071+0000 7fa452ff5640 1 -- 172.21.15.84:0/2994891930 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4680ad330 con 0x564ed1e7e070 2024-09-21T03:47:54.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.071+0000 7fa452ff5640 1 -- 172.21.15.84:0/2994891930 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa460003b90 con 0x564ed1e7e070 2024-09-21T03:47:54.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.071+0000 7fa47b6f4740 10 client.16503 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:54.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.071+0000 7fa47b6f4740 10 client.16503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:47:54.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.071+0000 7fa47b6f4740 20 client.16503 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:54.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.071+0000 7fa47b6f4740 1 --2- 172.21.15.84:0/2994891930 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564ed1e3c9f0 0x564ed2242f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:54.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.071+0000 7fa47b6f4740 4 client.16503 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:47:54.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.071+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2994891930 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ed219dda0 con 0x564ed1e3c9f0 2024-09-21T03:47:54.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.071+0000 7fa46ed9d640 1 --2- 172.21.15.84:0/2994891930 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564ed1e3c9f0 0x564ed2242f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:54.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.071+0000 7fa452ff5640 10 client.16503 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:54.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.071+0000 7fa46ed9d640 1 --2- 172.21.15.84:0/2994891930 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564ed1e3c9f0 0x564ed2242f90 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7846a35dea0616ca server_cookie=4aabfbe0179bc1f1 in_seq=0 out_seq=0 2024-09-21T03:47:54.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.072+0000 7fa452ff5640 1 -- 172.21.15.84:0/2994891930 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564ed219dda0 con 0x564ed1e3c9f0 2024-09-21T03:47:54.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.072+0000 7fa452ff5640 10 client.16503 handle_command_reply: tid=0 2024-09-21T03:47:54.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.072+0000 7fa47b6f4740 1 client.16503 shutdown 2024-09-21T03:47:54.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.072+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2994891930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e7e070 msgr2=0x564ed2231710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:54.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.072+0000 7fa47b6f4740 1 --2- 172.21.15.84:0/2994891930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e7e070 0x564ed2231710 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa460033000 tx=0x7fa460009260 comp rx=0 tx=0).stop 2024-09-21T03:47:54.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.073+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2994891930 shutdown_connections 2024-09-21T03:47:54.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.073+0000 7fa47b6f4740 1 --2- 172.21.15.84:0/2994891930 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564ed1e3c9f0 0x564ed2242f90 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.073+0000 7fa47b6f4740 1 --2- 172.21.15.84:0/2994891930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e7e070 0x564ed2231710 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.073+0000 7fa452ff5640 0 client.16503 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:54.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.073+0000 7fa47b6f4740 1 --2- 172.21.15.84:0/2994891930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e5d390 0x564ed22311d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.073+0000 7fa47b6f4740 1 --2- 172.21.15.84:0/2994891930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e551b0 0x564ed2230c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.073+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2994891930 >> 172.21.15.84:0/2994891930 conn(0x564ed1e72460 msgr2=0x564ed22287e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:54.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.073+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2994891930 shutdown_connections 2024-09-21T03:47:54.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.073+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2994891930 wait complete. 2024-09-21T03:47:54.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.073+0000 7fa47b6f4740 20 client.16503 trim_cache size 0 max 16384 2024-09-21T03:47:54.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.090+0000 7fa47b6f4740 1 Processor -- start 2024-09-21T03:47:54.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.090+0000 7fa47b6f4740 1 -- start start 2024-09-21T03:47:54.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.090+0000 7fa47b6f4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e3c9f0 0x564ed2232b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:54.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.090+0000 7fa47b6f4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e551b0 0x564ed2226680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:54.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.090+0000 7fa47b6f4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e5d390 0x564ed223d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:54.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.090+0000 7fa47b6f4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701b1fe0 con 0x564ed1e5d390 2024-09-21T03:47:54.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.090+0000 7fa47b6f4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701af8b0 con 0x564ed1e551b0 2024-09-21T03:47:54.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.090+0000 7fa47b6f4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701ad700 con 0x564ed1e3c9f0 2024-09-21T03:47:54.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.090+0000 7fa46f59e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e5d390 0x564ed223d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:54.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.090+0000 7fa46f59e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e5d390 0x564ed223d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34648/0 (socket says 172.21.15.84:34648) 2024-09-21T03:47:54.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.090+0000 7fa46f59e640 1 -- 172.21.15.84:0/3092674816 learned_addr learned my addr 172.21.15.84:0/3092674816 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:54.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.091+0000 7fa46ed9d640 1 --2- 172.21.15.84:0/3092674816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e3c9f0 0x564ed2232b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:54.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.091+0000 7fa46e59c640 1 --2- 172.21.15.84:0/3092674816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e551b0 0x564ed2226680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:54.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.091+0000 7fa46f59e640 1 -- 172.21.15.84:0/3092674816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e3c9f0 msgr2=0x564ed2232b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:54.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.091+0000 7fa46f59e640 1 --2- 172.21.15.84:0/3092674816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e3c9f0 0x564ed2232b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.091+0000 7fa46f59e640 1 -- 172.21.15.84:0/3092674816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e551b0 msgr2=0x564ed2226680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.091+0000 7fa46f59e640 1 --2- 172.21.15.84:0/3092674816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e551b0 0x564ed2226680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.091+0000 7fa46f59e640 1 -- 172.21.15.84:0/3092674816 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ed2231f50 con 0x564ed1e5d390 2024-09-21T03:47:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.091+0000 7fa46e59c640 1 --2- 172.21.15.84:0/3092674816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e551b0 0x564ed2226680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:47:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.091+0000 7fa46f59e640 1 --2- 172.21.15.84:0/3092674816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e5d390 0x564ed223d050 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa460031440 tx=0x7fa460031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19b117730c5b4c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.091+0000 7fa454ff9640 1 -- 172.21.15.84:0/3092674816 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46004b070 con 0x564ed1e5d390 2024-09-21T03:47:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.091+0000 7fa454ff9640 1 -- 172.21.15.84:0/3092674816 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa460004260 con 0x564ed1e5d390 2024-09-21T03:47:54.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.091+0000 7fa454ff9640 1 -- 172.21.15.84:0/3092674816 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa460035050 con 0x564ed1e5d390 2024-09-21T03:47:54.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.092+0000 7fa47b6f4740 1 -- 172.21.15.84:0/3092674816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e5d390 msgr2=0x564ed223d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:54.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.092+0000 7fa47b6f4740 1 --2- 172.21.15.84:0/3092674816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e5d390 0x564ed223d050 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa460031440 tx=0x7fa460031840 comp rx=0 tx=0).stop 2024-09-21T03:47:54.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.092+0000 7fa47b6f4740 1 -- 172.21.15.84:0/3092674816 shutdown_connections 2024-09-21T03:47:54.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.092+0000 7fa47b6f4740 1 --2- 172.21.15.84:0/3092674816 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e5d390 0x564ed223d050 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.092+0000 7fa47b6f4740 1 --2- 172.21.15.84:0/3092674816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e551b0 0x564ed2226680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.092+0000 7fa47b6f4740 1 --2- 172.21.15.84:0/3092674816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e3c9f0 0x564ed2232b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.092+0000 7fa47b6f4740 1 -- 172.21.15.84:0/3092674816 >> 172.21.15.84:0/3092674816 conn(0x564ed1e72460 msgr2=0x564ed2221b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:54.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.092+0000 7fa47b6f4740 1 -- 172.21.15.84:0/3092674816 shutdown_connections 2024-09-21T03:47:54.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.092+0000 7fa47b6f4740 1 -- 172.21.15.84:0/3092674816 wait complete. 2024-09-21T03:47:54.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.093+0000 7fa47b6f4740 1 -- start start 2024-09-21T03:47:54.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.093+0000 7fa47b6f4740 1 Processor -- start 2024-09-21T03:47:54.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.093+0000 7fa47b6f4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e3c9f0 0x564ed2235210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:54.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.093+0000 7fa47b6f4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e551b0 0x564ed2235750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:54.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.093+0000 7fa47b6f4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e5d390 0x564ed2235c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:54.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.093+0000 7fa47b6f4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701add70 con 0x564ed1e551b0 2024-09-21T03:47:54.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.093+0000 7fa47b6f4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701af1e0 con 0x564ed1e3c9f0 2024-09-21T03:47:54.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.093+0000 7fa47b6f4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa4701ae440 con 0x564ed1e5d390 2024-09-21T03:47:54.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.093+0000 7fa46e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e551b0 0x564ed2235750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:54.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.093+0000 7fa46e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e551b0 0x564ed2235750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34654/0 (socket says 172.21.15.84:34654) 2024-09-21T03:47:54.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.093+0000 7fa46e59c640 1 -- 172.21.15.84:0/2306545939 learned_addr learned my addr 172.21.15.84:0/2306545939 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:47:54.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.093+0000 7fa47b6f4740 10 client.0 _ll_register_callbacks cb 0x7fa460009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:47:54.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.093+0000 7fa46ed9d640 1 --2- 172.21.15.84:0/2306545939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e3c9f0 0x564ed2235210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:54.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.094+0000 7fa46f59e640 1 --2- 172.21.15.84:0/2306545939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e5d390 0x564ed2235c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:54.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.094+0000 7fa46e59c640 1 -- 172.21.15.84:0/2306545939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e5d390 msgr2=0x564ed2235c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:54.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.094+0000 7fa46e59c640 1 --2- 172.21.15.84:0/2306545939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e5d390 0x564ed2235c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.094+0000 7fa46e59c640 1 -- 172.21.15.84:0/2306545939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e3c9f0 msgr2=0x564ed2235210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:47:54.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.094+0000 7fa46e59c640 1 --2- 172.21.15.84:0/2306545939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e3c9f0 0x564ed2235210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.094+0000 7fa46e59c640 1 -- 172.21.15.84:0/2306545939 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ed22acad0 con 0x564ed1e551b0 2024-09-21T03:47:54.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.094+0000 7fa46f59e640 1 --2- 172.21.15.84:0/2306545939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e5d390 0x564ed2235c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:47:54.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.094+0000 7fa46e59c640 1 --2- 172.21.15.84:0/2306545939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e551b0 0x564ed2235750 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fa464011e80 tx=0x7fa46400f780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8430ad109ea3cb68 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:47:54.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.094+0000 7fa452ff5640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:47:54.102 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.094+0000 7fa452ff5640 1 -- 172.21.15.84:0/2306545939 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46401f060 con 0x564ed1e551b0 2024-09-21T03:47:54.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.094+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2306545939 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa460004260 con 0x564ed1e551b0 2024-09-21T03:47:54.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.094+0000 7fa452ff5640 1 -- 172.21.15.84:0/2306545939 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa46401a410 con 0x564ed1e551b0 2024-09-21T03:47:54.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.094+0000 7fa452ff5640 1 -- 172.21.15.84:0/2306545939 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa46401a610 con 0x564ed1e551b0 2024-09-21T03:47:54.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.094+0000 7fa47b6f4740 10 client.16509 fetch_fsmap learned FSMap version 25 2024-09-21T03:47:54.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.094+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2306545939 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564ed22addf0 con 0x564ed1e551b0 2024-09-21T03:47:54.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.095+0000 7fa452ff5640 1 -- 172.21.15.84:0/2306545939 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa460004260 con 0x564ed1e551b0 2024-09-21T03:47:54.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.095+0000 7fa452ff5640 1 -- 172.21.15.84:0/2306545939 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa464019400 con 0x564ed1e551b0 2024-09-21T03:47:54.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.095+0000 7fa47b6f4740 10 client.16509 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:47:54.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.095+0000 7fa47b6f4740 10 client.16509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:47:54.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.095+0000 7fa47b6f4740 20 client.16509 populate_metadata read hostname 'smithi084' 2024-09-21T03:47:54.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.095+0000 7fa47b6f4740 1 --2- 172.21.15.84:0/2306545939 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564ed1e7e070 0x564ed22b0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:47:54.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.095+0000 7fa47b6f4740 4 client.16509 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:47:54.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.095+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2306545939 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564ed2199850 con 0x564ed1e7e070 2024-09-21T03:47:54.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.095+0000 7fa46ed9d640 1 --2- 172.21.15.84:0/2306545939 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564ed1e7e070 0x564ed22b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:47:54.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.096+0000 7fa452ff5640 10 client.16509 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:54.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.096+0000 7fa46ed9d640 1 --2- 172.21.15.84:0/2306545939 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564ed1e7e070 0x564ed22b0590 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3cdabc2b85b34fe server_cookie=5480d571da78663b in_seq=0 out_seq=0 2024-09-21T03:47:54.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.096+0000 7fa452ff5640 1 -- 172.21.15.84:0/2306545939 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x564ed2199850 con 0x564ed1e7e070 2024-09-21T03:47:54.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.096+0000 7fa452ff5640 10 client.16509 handle_command_reply: tid=0 2024-09-21T03:47:54.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.096+0000 7fa47b6f4740 1 client.16509 shutdown 2024-09-21T03:47:54.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.096+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2306545939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e551b0 msgr2=0x564ed2235750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:54.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.096+0000 7fa47b6f4740 1 --2- 172.21.15.84:0/2306545939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e551b0 0x564ed2235750 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fa464011e80 tx=0x7fa46400f780 comp rx=0 tx=0).stop 2024-09-21T03:47:54.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.096+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2306545939 shutdown_connections 2024-09-21T03:47:54.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.096+0000 7fa47b6f4740 1 --2- 172.21.15.84:0/2306545939 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x564ed1e7e070 0x564ed22b0590 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.096+0000 7fa47b6f4740 1 --2- 172.21.15.84:0/2306545939 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed1e5d390 0x564ed2235c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.096+0000 7fa47b6f4740 1 --2- 172.21.15.84:0/2306545939 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed1e551b0 0x564ed2235750 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.096+0000 7fa47b6f4740 1 --2- 172.21.15.84:0/2306545939 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed1e3c9f0 0x564ed2235210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.096+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2306545939 >> 172.21.15.84:0/2306545939 conn(0x564ed1e72460 msgr2=0x564ed22328b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:54.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.096+0000 7fa452ff5640 0 client.16509 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:47:54.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.096+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2306545939 shutdown_connections 2024-09-21T03:47:54.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.096+0000 7fa47b6f4740 1 -- 172.21.15.84:0/2306545939 wait complete. 2024-09-21T03:47:54.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.097+0000 7fa47b6f4740 20 client.16509 trim_cache size 0 max 16384 2024-09-21T03:47:54.105 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:47:54.105 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:47:54.105 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T03:47:54.105 INFO:teuthology.orchestra.run.smithi084.stdout: "27dcb84c-89fa-46b2-b980-58857966c697": { 2024-09-21T03:47:54.106 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:54.106 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "27dcb84c-89fa-46b2-b980-58857966c697", 2024-09-21T03:47:54.106 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T03:47:54.106 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:47:54.106 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:54.106 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:47:54.106 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:47:54.106 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:47:54.107 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:54.107 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:54.107 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:54.107 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:54.107 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:54.108 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:54.108 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:47:54.108 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:47:54.108 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:54.108 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:54.108 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:54.108 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:54.108 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:54.108 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:54.108 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:47:54.108 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:47:54.109 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:54.109 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:54.109 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:54.109 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:54.109 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:54.109 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:54.109 INFO:teuthology.orchestra.run.smithi084.stdout: "27dcb84c-89fa-46b2-b980-58857966c697": { 2024-09-21T03:47:54.109 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:52.598527+0000", 2024-09-21T03:47:54.109 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:54.109 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:54.109 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:54.109 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:54.109 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:54.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:54.110 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:47:54.110 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:47:54.110 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:54.110 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:54.110 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:54.110 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:54.110 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:54.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:54.110 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:47:54.110 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:47:54.110 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:54.110 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:54.110 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:54.111 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:54.111 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:54.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:54.111 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:47:54.111 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:47:54.111 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:54.111 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:54.111 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:54.111 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:54.111 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:54.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:54.111 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:47:54.111 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:47:54.111 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:54.112 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:54.112 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:54.112 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:54.112 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:54.112 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:54.112 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:47:54.112 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:47:54.112 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:54.112 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:54.112 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:54.112 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:54.112 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:54.112 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:47:54.113 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:47:54.113 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:47:54.113 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:47:54.113 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:47:54.113 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:47:54.113 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:47:54.113 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:47:54.113 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:47:54.114 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:47:54.114 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:47:54.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.097+0000 7fa475180640 1 -- 172.21.15.84:0/2058295877 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4580b6680 msgr2=0x7fa4580b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:54.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.097+0000 7fa475180640 1 --2- 172.21.15.84:0/2058295877 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4580b6680 0x7fa4580b8b90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa4600096c0 tx=0x7fa460005e60 comp rx=0 tx=0).stop 2024-09-21T03:47:54.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.097+0000 7fa475180640 1 -- 172.21.15.84:0/2058295877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa470102a60 msgr2=0x7fa47019a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:47:54.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.097+0000 7fa475180640 1 --2- 172.21.15.84:0/2058295877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa470102a60 0x7fa47019a5a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa46800b4a0 tx=0x7fa46800b960 comp rx=0 tx=0).stop 2024-09-21T03:47:54.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.097+0000 7fa475180640 1 -- 172.21.15.84:0/2058295877 shutdown_connections 2024-09-21T03:47:54.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.097+0000 7fa475180640 1 --2- 172.21.15.84:0/2058295877 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa4580b6680 0x7fa4580b8b90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.097+0000 7fa475180640 1 --2- 172.21.15.84:0/2058295877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa470108cf0 0x7fa47019fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.097+0000 7fa475180640 1 --2- 172.21.15.84:0/2058295877 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa4701083a0 0x7fa47019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.097+0000 7fa475180640 1 --2- 172.21.15.84:0/2058295877 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa470102a60 0x7fa47019a5a0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:47:54.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.097+0000 7fa475180640 1 -- 172.21.15.84:0/2058295877 >> 172.21.15.84:0/2058295877 conn(0x7fa470079730 msgr2=0x7fa470100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:47:54.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.097+0000 7fa475180640 1 -- 172.21.15.84:0/2058295877 shutdown_connections 2024-09-21T03:47:54.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:47:54.097+0000 7fa475180640 1 -- 172.21.15.84:0/2058295877 wait complete. 2024-09-21T03:47:54.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:54 smithi084 ceph-mon[30941]: pgmap v487: 97 pgs: 97 active+clean; 7.8 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-09-21T03:47:54.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:54 smithi174 ceph-mon[34403]: pgmap v487: 97 pgs: 97 active+clean; 7.8 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-09-21T03:47:54.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:54 smithi172 ceph-mon[34821]: pgmap v487: 97 pgs: 97 active+clean; 7.8 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-09-21T03:47:54.907 INFO:tasks.cephfs.filesystem:scrub status for tag:27dcb84c-89fa-46b2-b980-58857966c697 - {'path': '/', 'tag': '27dcb84c-89fa-46b2-b980-58857966c697', 'options': 'recursive,force'} 2024-09-21T03:47:55.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:55 smithi084 ceph-mon[30941]: scrub summary: idle 2024-09-21T03:47:55.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:55 smithi174 ceph-mon[34403]: scrub summary: idle 2024-09-21T03:47:55.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:55 smithi172 ceph-mon[34821]: scrub summary: idle 2024-09-21T03:47:56.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:56 smithi084 ceph-mon[30941]: pgmap v488: 97 pgs: 97 active+clean; 7.8 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-09-21T03:47:56.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:56 smithi174 ceph-mon[34403]: pgmap v488: 97 pgs: 97 active+clean; 7.8 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-09-21T03:47:56.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:56 smithi172 ceph-mon[34821]: pgmap v488: 97 pgs: 97 active+clean; 7.8 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 10 op/s 2024-09-21T03:47:58.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:47:58 smithi084 ceph-mon[30941]: pgmap v489: 97 pgs: 97 active+clean; 8.0 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 14 op/s 2024-09-21T03:47:58.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:47:58 smithi174 ceph-mon[34403]: pgmap v489: 97 pgs: 97 active+clean; 8.0 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 14 op/s 2024-09-21T03:47:58.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:47:58 smithi172 ceph-mon[34821]: pgmap v489: 97 pgs: 97 active+clean; 8.0 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 14 op/s 2024-09-21T03:48:01.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:01 smithi084 ceph-mon[30941]: pgmap v490: 97 pgs: 97 active+clean; 8.0 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-21T03:48:01.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:01 smithi174 ceph-mon[34403]: pgmap v490: 97 pgs: 97 active+clean; 8.0 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-21T03:48:01.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:01 smithi172 ceph-mon[34821]: pgmap v490: 97 pgs: 97 active+clean; 8.0 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 10 op/s 2024-09-21T03:48:02.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:02 smithi084 ceph-mon[30941]: pgmap v491: 97 pgs: 97 active+clean; 8.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 58 KiB/s wr, 15 op/s 2024-09-21T03:48:02.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:02 smithi174 ceph-mon[34403]: pgmap v491: 97 pgs: 97 active+clean; 8.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 58 KiB/s wr, 15 op/s 2024-09-21T03:48:02.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:02 smithi172 ceph-mon[34821]: pgmap v491: 97 pgs: 97 active+clean; 8.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 58 KiB/s wr, 15 op/s 2024-09-21T03:48:04.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:04 smithi084 ceph-mon[30941]: pgmap v492: 97 pgs: 97 active+clean; 8.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 54 KiB/s wr, 25 op/s 2024-09-21T03:48:04.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:04 smithi174 ceph-mon[34403]: pgmap v492: 97 pgs: 97 active+clean; 8.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 54 KiB/s wr, 25 op/s 2024-09-21T03:48:04.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:04 smithi172 ceph-mon[34821]: pgmap v492: 97 pgs: 97 active+clean; 8.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 54 KiB/s wr, 25 op/s 2024-09-21T03:48:06.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:06 smithi084 ceph-mon[30941]: pgmap v493: 97 pgs: 97 active+clean; 8.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 54 KiB/s wr, 25 op/s 2024-09-21T03:48:06.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:06 smithi174 ceph-mon[34403]: pgmap v493: 97 pgs: 97 active+clean; 8.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 54 KiB/s wr, 25 op/s 2024-09-21T03:48:06.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:06 smithi172 ceph-mon[34821]: pgmap v493: 97 pgs: 97 active+clean; 8.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 54 KiB/s wr, 25 op/s 2024-09-21T03:48:08.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:08 smithi084 ceph-mon[30941]: pgmap v494: 97 pgs: 97 active+clean; 8.4 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 73 KiB/s wr, 29 op/s 2024-09-21T03:48:08.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:08 smithi174 ceph-mon[34403]: pgmap v494: 97 pgs: 97 active+clean; 8.4 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 73 KiB/s wr, 29 op/s 2024-09-21T03:48:08.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:08 smithi172 ceph-mon[34821]: pgmap v494: 97 pgs: 97 active+clean; 8.4 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 73 KiB/s wr, 29 op/s 2024-09-21T03:48:10.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:10 smithi084 ceph-mon[30941]: pgmap v495: 97 pgs: 97 active+clean; 8.4 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 57 KiB/s wr, 24 op/s 2024-09-21T03:48:10.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:10 smithi174 ceph-mon[34403]: pgmap v495: 97 pgs: 97 active+clean; 8.4 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 57 KiB/s wr, 24 op/s 2024-09-21T03:48:10.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:10 smithi172 ceph-mon[34821]: pgmap v495: 97 pgs: 97 active+clean; 8.4 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 57 KiB/s wr, 24 op/s 2024-09-21T03:48:12.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:12 smithi084 ceph-mon[30941]: pgmap v496: 97 pgs: 97 active+clean; 8.6 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 73 KiB/s wr, 28 op/s 2024-09-21T03:48:12.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:12 smithi174 ceph-mon[34403]: pgmap v496: 97 pgs: 97 active+clean; 8.6 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 73 KiB/s wr, 28 op/s 2024-09-21T03:48:12.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:12 smithi172 ceph-mon[34821]: pgmap v496: 97 pgs: 97 active+clean; 8.6 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 73 KiB/s wr, 28 op/s 2024-09-21T03:48:14.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:14 smithi084 ceph-mon[30941]: pgmap v497: 97 pgs: 97 active+clean; 8.6 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 46 KiB/s wr, 23 op/s 2024-09-21T03:48:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:14 smithi174 ceph-mon[34403]: pgmap v497: 97 pgs: 97 active+clean; 8.6 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 46 KiB/s wr, 23 op/s 2024-09-21T03:48:14.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:14 smithi172 ceph-mon[34821]: pgmap v497: 97 pgs: 97 active+clean; 8.6 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 46 KiB/s wr, 23 op/s 2024-09-21T03:48:16.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:16 smithi084 ceph-mon[30941]: pgmap v498: 97 pgs: 97 active+clean; 8.6 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 10 op/s 2024-09-21T03:48:16.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:16 smithi174 ceph-mon[34403]: pgmap v498: 97 pgs: 97 active+clean; 8.6 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 10 op/s 2024-09-21T03:48:16.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:16 smithi172 ceph-mon[34821]: pgmap v498: 97 pgs: 97 active+clean; 8.6 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 KiB/s wr, 10 op/s 2024-09-21T03:48:18.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:18 smithi084 ceph-mon[30941]: pgmap v499: 97 pgs: 97 active+clean; 8.8 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-09-21T03:48:18.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:18 smithi174 ceph-mon[34403]: pgmap v499: 97 pgs: 97 active+clean; 8.8 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-09-21T03:48:18.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:18 smithi172 ceph-mon[34821]: pgmap v499: 97 pgs: 97 active+clean; 8.8 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 53 KiB/s wr, 14 op/s 2024-09-21T03:48:20.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:20 smithi084 ceph-mon[30941]: pgmap v500: 97 pgs: 97 active+clean; 8.8 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-21T03:48:20.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:20 smithi174 ceph-mon[34403]: pgmap v500: 97 pgs: 97 active+clean; 8.8 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-21T03:48:20.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:20 smithi172 ceph-mon[34821]: pgmap v500: 97 pgs: 97 active+clean; 8.8 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-21T03:48:22.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:22 smithi084 ceph-mon[30941]: pgmap v501: 97 pgs: 97 active+clean; 8.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-09-21T03:48:22.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:22 smithi174 ceph-mon[34403]: pgmap v501: 97 pgs: 97 active+clean; 8.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-09-21T03:48:22.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:22 smithi172 ceph-mon[34821]: pgmap v501: 97 pgs: 97 active+clean; 8.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-09-21T03:48:24.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:24 smithi084 ceph-mon[30941]: pgmap v502: 97 pgs: 97 active+clean; 8.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 10 op/s 2024-09-21T03:48:24.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:24 smithi174 ceph-mon[34403]: pgmap v502: 97 pgs: 97 active+clean; 8.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 10 op/s 2024-09-21T03:48:24.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:24 smithi172 ceph-mon[34821]: pgmap v502: 97 pgs: 97 active+clean; 8.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 10 op/s 2024-09-21T03:48:24.907 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:48:25.167 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:48:25.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.679+0000 7fe1eda01640 1 -- 172.21.15.84:0/602513952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1e8103bb0 msgr2=0x7fe1e8103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:25.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.679+0000 7fe1eda01640 1 --2- 172.21.15.84:0/602513952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1e8103bb0 0x7fe1e8103fc0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009ca0 tx=0x7fe1d802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.679+0000 7fe1eda01640 1 -- 172.21.15.84:0/602513952 shutdown_connections 2024-09-21T03:48:25.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.679+0000 7fe1eda01640 1 --2- 172.21.15.84:0/602513952 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1e8109e40 0x7fe1e8110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.679+0000 7fe1eda01640 1 --2- 172.21.15.84:0/602513952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e81094f0 0x7fe1e8109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.679+0000 7fe1eda01640 1 --2- 172.21.15.84:0/602513952 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1e8103bb0 0x7fe1e8103fc0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.679+0000 7fe1eda01640 1 -- 172.21.15.84:0/602513952 >> 172.21.15.84:0/602513952 conn(0x7fe1e80ff600 msgr2=0x7fe1e8101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:25.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.679+0000 7fe1eda01640 1 -- 172.21.15.84:0/602513952 shutdown_connections 2024-09-21T03:48:25.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.679+0000 7fe1eda01640 1 -- 172.21.15.84:0/602513952 wait complete. 2024-09-21T03:48:25.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.680+0000 7fe1eda01640 1 Processor -- start 2024-09-21T03:48:25.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.680+0000 7fe1eda01640 1 -- start start 2024-09-21T03:48:25.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.680+0000 7fe1eda01640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1e8103bb0 0x7fe1e819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:25.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.680+0000 7fe1eda01640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1e81094f0 0x7fe1e819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:25.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.680+0000 7fe1eda01640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e8109e40 0x7fe1e819fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:25.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.680+0000 7fe1eda01640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e8113b00 con 0x7fe1e8103bb0 2024-09-21T03:48:25.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.680+0000 7fe1eda01640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e8113980 con 0x7fe1e8109e40 2024-09-21T03:48:25.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.680+0000 7fe1eda01640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e8113c80 con 0x7fe1e81094f0 2024-09-21T03:48:25.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.680+0000 7fe1e6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1e8103bb0 0x7fe1e819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:25.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.680+0000 7fe1e6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1e8103bb0 0x7fe1e819a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55594/0 (socket says 172.21.15.84:55594) 2024-09-21T03:48:25.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.680+0000 7fe1e6ffd640 1 -- 172.21.15.84:0/3310612516 learned_addr learned my addr 172.21.15.84:0/3310612516 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:25.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.681+0000 7fe1e77fe640 1 --2- 172.21.15.84:0/3310612516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e8109e40 0x7fe1e819fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:25.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.681+0000 7fe1e67fc640 1 --2- 172.21.15.84:0/3310612516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1e81094f0 0x7fe1e819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:25.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.681+0000 7fe1e6ffd640 1 -- 172.21.15.84:0/3310612516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1e81094f0 msgr2=0x7fe1e819ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.681+0000 7fe1e6ffd640 1 --2- 172.21.15.84:0/3310612516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1e81094f0 0x7fe1e819ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.681+0000 7fe1e6ffd640 1 -- 172.21.15.84:0/3310612516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e8109e40 msgr2=0x7fe1e819fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.681+0000 7fe1e6ffd640 1 --2- 172.21.15.84:0/3310612516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e8109e40 0x7fe1e819fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.681+0000 7fe1e6ffd640 1 -- 172.21.15.84:0/3310612516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e81a04e0 con 0x7fe1e8103bb0 2024-09-21T03:48:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.681+0000 7fe1e6ffd640 1 --2- 172.21.15.84:0/3310612516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1e8103bb0 0x7fe1e819a570 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8006010 tx=0x7fe1d80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.681+0000 7fe1ec9ff640 1 -- 172.21.15.84:0/3310612516 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8003bf0 con 0x7fe1e8103bb0 2024-09-21T03:48:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.681+0000 7fe1eda01640 1 -- 172.21.15.84:0/3310612516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e81a0770 con 0x7fe1e8103bb0 2024-09-21T03:48:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.681+0000 7fe1ec9ff640 1 -- 172.21.15.84:0/3310612516 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1d8003d90 con 0x7fe1e8103bb0 2024-09-21T03:48:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.681+0000 7fe1ec9ff640 1 -- 172.21.15.84:0/3310612516 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d802fc20 con 0x7fe1e8103bb0 2024-09-21T03:48:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.681+0000 7fe1eda01640 1 -- 172.21.15.84:0/3310612516 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e81a6f30 con 0x7fe1e8103bb0 2024-09-21T03:48:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.684+0000 7fe1f3f75740 1 Processor -- start 2024-09-21T03:48:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.684+0000 7fe1f3f75740 1 -- start start 2024-09-21T03:48:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.684+0000 7fe1f3f75740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e80070 0x56330a227650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.684+0000 7fe1f3f75740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 0x56330a227b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:25.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.684+0000 7fe1ec9ff640 1 -- 172.21.15.84:0/3310612516 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fe1d80305c0 con 0x7fe1e8103bb0 2024-09-21T03:48:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.684+0000 7fe1f3f75740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563309e5f390 0x56330a2280d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.684+0000 7fe1f3f75740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56330a19de50 con 0x563309e571b0 2024-09-21T03:48:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.684+0000 7fe1f3f75740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56330a18d280 con 0x563309e80070 2024-09-21T03:48:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.684+0000 7fe1f3f75740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56330a191090 con 0x563309e5f390 2024-09-21T03:48:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.684+0000 7fe1e6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 0x56330a227b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:25.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.684+0000 7fe1e6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 0x56330a227b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55606/0 (socket says 172.21.15.84:55606) 2024-09-21T03:48:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.684+0000 7fe1e6ffd640 1 -- 172.21.15.84:0/3212870692 learned_addr learned my addr 172.21.15.84:0/3212870692 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.684+0000 7fe1e77fe640 1 --2- 172.21.15.84:0/3212870692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e80070 0x56330a227650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.685+0000 7fe1e67fc640 1 --2- 172.21.15.84:0/3212870692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563309e5f390 0x56330a2280d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.685+0000 7fe1e77fe640 1 -- 172.21.15.84:0/3212870692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563309e5f390 msgr2=0x56330a2280d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.685+0000 7fe1e77fe640 1 --2- 172.21.15.84:0/3212870692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563309e5f390 0x56330a2280d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.685+0000 7fe1e77fe640 1 -- 172.21.15.84:0/3212870692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 msgr2=0x56330a227b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.685+0000 7fe1e77fe640 1 --2- 172.21.15.84:0/3212870692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 0x56330a227b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.685+0000 7fe1e77fe640 1 -- 172.21.15.84:0/3212870692 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563309eeb650 con 0x563309e80070 2024-09-21T03:48:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.685+0000 7fe1e6ffd640 1 --2- 172.21.15.84:0/3212870692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 0x56330a227b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:48:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.685+0000 7fe1ec9ff640 1 --2- 172.21.15.84:0/3310612516 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe1d00b6680 0x7fe1d00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.685+0000 7fe1e77fe640 1 --2- 172.21.15.84:0/3212870692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e80070 0x56330a227650 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00045c0 tx=0x7fe1e000ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9018b5384be2ab2f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.685+0000 7fe1e6ffd640 1 --2- 172.21.15.84:0/3310612516 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe1d00b6680 0x7fe1d00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:25.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.685+0000 7fe1ec9ff640 1 -- 172.21.15.84:0/3310612516 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe1d8108a70 con 0x7fe1e8103bb0 2024-09-21T03:48:25.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.685+0000 7fe1cdffb640 1 -- 172.21.15.84:0/3212870692 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0003a70 con 0x563309e80070 2024-09-21T03:48:25.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.685+0000 7fe1cdffb640 1 -- 172.21.15.84:0/3212870692 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1e0015070 con 0x563309e80070 2024-09-21T03:48:25.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.685+0000 7fe1cdffb640 1 -- 172.21.15.84:0/3212870692 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0011440 con 0x563309e80070 2024-09-21T03:48:25.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.686+0000 7fe1e6ffd640 1 --2- 172.21.15.84:0/3310612516 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe1d00b6680 0x7fe1d00b8b90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe1d802ade0 tx=0x7fe1d810c4a0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:25.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.686+0000 7fe1f3f75740 1 -- 172.21.15.84:0/3212870692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e80070 msgr2=0x56330a227650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:25.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.686+0000 7fe1f3f75740 1 --2- 172.21.15.84:0/3212870692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e80070 0x56330a227650 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00045c0 tx=0x7fe1e000ba90 comp rx=0 tx=0).stop 2024-09-21T03:48:25.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.686+0000 7fe1f3f75740 1 -- 172.21.15.84:0/3212870692 shutdown_connections 2024-09-21T03:48:25.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.686+0000 7fe1f3f75740 1 --2- 172.21.15.84:0/3212870692 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563309e5f390 0x56330a2280d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.686+0000 7fe1f3f75740 1 --2- 172.21.15.84:0/3212870692 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 0x56330a227b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.686+0000 7fe1f3f75740 1 --2- 172.21.15.84:0/3212870692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e80070 0x56330a227650 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.686+0000 7fe1f3f75740 1 -- 172.21.15.84:0/3212870692 >> 172.21.15.84:0/3212870692 conn(0x563309e74460 msgr2=0x56330a225540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:25.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.686+0000 7fe1f3f75740 1 -- 172.21.15.84:0/3212870692 shutdown_connections 2024-09-21T03:48:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.686+0000 7fe1f3f75740 1 -- 172.21.15.84:0/3212870692 wait complete. 2024-09-21T03:48:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.687+0000 7fe1f3f75740 1 -- start start 2024-09-21T03:48:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.687+0000 7fe1f3f75740 1 Processor -- start 2024-09-21T03:48:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.687+0000 7fe1f3f75740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563309e571b0 0x56330a232d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.687+0000 7fe1f3f75740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e5f390 0x56330a233290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.687+0000 7fe1f3f75740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e80070 0x56330a23f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.687+0000 7fe1f3f75740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563309fee700 con 0x563309e80070 2024-09-21T03:48:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.687+0000 7fe1f3f75740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56330a128110 con 0x563309e5f390 2024-09-21T03:48:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.687+0000 7fe1f3f75740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56330a235e30 con 0x563309e571b0 2024-09-21T03:48:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.688+0000 7fe1f3f75740 10 client.0 _ll_register_callbacks cb 0x56330a141990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:48:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.688+0000 7fe1e77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e80070 0x56330a23f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.688+0000 7fe1e77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e80070 0x56330a23f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55616/0 (socket says 172.21.15.84:55616) 2024-09-21T03:48:25.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.688+0000 7fe1e77fe640 1 -- 172.21.15.84:0/2432719730 learned_addr learned my addr 172.21.15.84:0/2432719730 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.688+0000 7fe1e77fe640 1 --2- 172.21.15.84:0/2432719730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563309e571b0 0x56330a232d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.688+0000 7fe1e67fc640 1 --2- 172.21.15.84:0/2432719730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e5f390 0x56330a233290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.688+0000 7fe1e77fe640 1 -- 172.21.15.84:0/2432719730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563309e571b0 msgr2=0x56330a232d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.688+0000 7fe1e77fe640 1 --2- 172.21.15.84:0/2432719730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563309e571b0 0x56330a232d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.688+0000 7fe1e77fe640 1 -- 172.21.15.84:0/2432719730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e5f390 msgr2=0x56330a233290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.688+0000 7fe1e77fe640 1 --2- 172.21.15.84:0/2432719730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e5f390 0x56330a233290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.688+0000 7fe1e77fe640 1 -- 172.21.15.84:0/2432719730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56330a155c40 con 0x563309e80070 2024-09-21T03:48:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.688+0000 7fe1e77fe640 1 --2- 172.21.15.84:0/2432719730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e80070 0x56330a23f150 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0005bc0 tx=0x7fe1e001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ca91b3c3210329 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:25.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.688+0000 7fe1c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:48:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.688+0000 7fe1c6ffd640 1 -- 172.21.15.84:0/2432719730 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0023040 con 0x563309e80070 2024-09-21T03:48:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.688+0000 7fe1f3f75740 1 -- 172.21.15.84:0/2432719730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1e0015070 con 0x563309e80070 2024-09-21T03:48:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.688+0000 7fe1c6ffd640 1 -- 172.21.15.84:0/2432719730 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe1e0003ca0 con 0x563309e80070 2024-09-21T03:48:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.689+0000 7fe1c6ffd640 1 -- 172.21.15.84:0/2432719730 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe1e0005020 con 0x563309e80070 2024-09-21T03:48:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.689+0000 7fe1f3f75740 10 client.16521 fetch_fsmap learned FSMap version 25 2024-09-21T03:48:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.689+0000 7fe1f3f75740 1 -- 172.21.15.84:0/2432719730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56330a241b30 con 0x563309e80070 2024-09-21T03:48:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.689+0000 7fe1c6ffd640 1 -- 172.21.15.84:0/2432719730 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1e0015070 con 0x563309e80070 2024-09-21T03:48:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.689+0000 7fe1c6ffd640 1 -- 172.21.15.84:0/2432719730 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe1e0004ac0 con 0x563309e80070 2024-09-21T03:48:25.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.689+0000 7fe1f3f75740 10 client.16521 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:48:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.689+0000 7fe1f3f75740 10 client.16521 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:48:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.689+0000 7fe1f3f75740 20 client.16521 populate_metadata read hostname 'smithi084' 2024-09-21T03:48:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.689+0000 7fe1f3f75740 1 --2- 172.21.15.84:0/2432719730 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x563309e3e9f0 0x56330a244e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.689+0000 7fe1f3f75740 4 client.16521 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:48:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.689+0000 7fe1f3f75740 1 -- 172.21.15.84:0/2432719730 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56330a19fda0 con 0x563309e3e9f0 2024-09-21T03:48:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.689+0000 7fe1e67fc640 1 --2- 172.21.15.84:0/2432719730 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x563309e3e9f0 0x56330a244e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.690+0000 7fe1c6ffd640 10 client.16521 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:48:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.690+0000 7fe1e67fc640 1 --2- 172.21.15.84:0/2432719730 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x563309e3e9f0 0x56330a244e90 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7aa1febe5866bed server_cookie=1a3b94c5125a2c81 in_seq=0 out_seq=0 2024-09-21T03:48:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.691+0000 7fe1c6ffd640 1 -- 172.21.15.84:0/2432719730 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56330a19fda0 con 0x563309e3e9f0 2024-09-21T03:48:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.691+0000 7fe1c6ffd640 10 client.16521 handle_command_reply: tid=0 2024-09-21T03:48:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.691+0000 7fe1f3f75740 1 client.16521 shutdown 2024-09-21T03:48:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.691+0000 7fe1f3f75740 1 -- 172.21.15.84:0/2432719730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e80070 msgr2=0x56330a23f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:25.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.691+0000 7fe1f3f75740 1 --2- 172.21.15.84:0/2432719730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e80070 0x56330a23f150 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0005bc0 tx=0x7fe1e001ac20 comp rx=0 tx=0).stop 2024-09-21T03:48:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.691+0000 7fe1f3f75740 1 -- 172.21.15.84:0/2432719730 shutdown_connections 2024-09-21T03:48:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.691+0000 7fe1f3f75740 1 --2- 172.21.15.84:0/2432719730 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x563309e3e9f0 0x56330a244e90 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.691+0000 7fe1f3f75740 1 --2- 172.21.15.84:0/2432719730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e80070 0x56330a23f150 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.691+0000 7fe1f3f75740 1 --2- 172.21.15.84:0/2432719730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e5f390 0x56330a233290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.691+0000 7fe1f3f75740 1 --2- 172.21.15.84:0/2432719730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563309e571b0 0x56330a232d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.691+0000 7fe1f3f75740 1 -- 172.21.15.84:0/2432719730 >> 172.21.15.84:0/2432719730 conn(0x563309e74460 msgr2=0x56330a22a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.691+0000 7fe1c6ffd640 0 client.16521 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:48:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.691+0000 7fe1f3f75740 1 -- 172.21.15.84:0/2432719730 shutdown_connections 2024-09-21T03:48:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.691+0000 7fe1f3f75740 1 -- 172.21.15.84:0/2432719730 wait complete. 2024-09-21T03:48:25.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.692+0000 7fe1f3f75740 20 client.16521 trim_cache size 0 max 16384 2024-09-21T03:48:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.709+0000 7fe1f3f75740 1 Processor -- start 2024-09-21T03:48:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.709+0000 7fe1f3f75740 1 -- start start 2024-09-21T03:48:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.709+0000 7fe1f3f75740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 0x56330a228d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.709+0000 7fe1f3f75740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563309e5f390 0x56330a224b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.709+0000 7fe1f3f75740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e80070 0x56330a2250b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.709+0000 7fe1f3f75740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e81b1f10 con 0x563309e571b0 2024-09-21T03:48:25.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.709+0000 7fe1f3f75740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e81af7e0 con 0x563309e80070 2024-09-21T03:48:25.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.709+0000 7fe1f3f75740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e81ad630 con 0x563309e5f390 2024-09-21T03:48:25.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.710+0000 7fe1e77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 0x56330a228d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:25.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.710+0000 7fe1e77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 0x56330a228d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55624/0 (socket says 172.21.15.84:55624) 2024-09-21T03:48:25.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.710+0000 7fe1e77fe640 1 -- 172.21.15.84:0/3953111561 learned_addr learned my addr 172.21.15.84:0/3953111561 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:25.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.710+0000 7fe1e77fe640 1 -- 172.21.15.84:0/3953111561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563309e5f390 msgr2=0x56330a224b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:25.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.710+0000 7fe1e67fc640 1 --2- 172.21.15.84:0/3953111561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563309e5f390 0x56330a224b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:25.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.710+0000 7fe1e77fe640 1 --2- 172.21.15.84:0/3953111561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563309e5f390 0x56330a224b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.710+0000 7fe1e77fe640 1 -- 172.21.15.84:0/3953111561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e80070 msgr2=0x56330a2250b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:25.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.710+0000 7fe1e77fe640 1 --2- 172.21.15.84:0/3953111561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e80070 0x56330a2250b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.710+0000 7fe1e77fe640 1 -- 172.21.15.84:0/3953111561 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56330a22a4b0 con 0x563309e571b0 2024-09-21T03:48:25.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.710+0000 7fe1e77fe640 1 --2- 172.21.15.84:0/3953111561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 0x56330a228d90 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fe1e001d040 tx=0x7fe1e0011540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178292ab1ccc4032 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:25.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.710+0000 7fe1cd7fa640 1 -- 172.21.15.84:0/3953111561 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00116e0 con 0x563309e571b0 2024-09-21T03:48:25.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.710+0000 7fe1cd7fa640 1 -- 172.21.15.84:0/3953111561 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1e0015070 con 0x563309e571b0 2024-09-21T03:48:25.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.710+0000 7fe1cd7fa640 1 -- 172.21.15.84:0/3953111561 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00051c0 con 0x563309e571b0 2024-09-21T03:48:25.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.711+0000 7fe1f3f75740 1 -- 172.21.15.84:0/3953111561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 msgr2=0x56330a228d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:25.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.711+0000 7fe1f3f75740 1 --2- 172.21.15.84:0/3953111561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 0x56330a228d90 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fe1e001d040 tx=0x7fe1e0011540 comp rx=0 tx=0).stop 2024-09-21T03:48:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.711+0000 7fe1f3f75740 1 -- 172.21.15.84:0/3953111561 shutdown_connections 2024-09-21T03:48:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.711+0000 7fe1f3f75740 1 --2- 172.21.15.84:0/3953111561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e80070 0x56330a2250b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.711+0000 7fe1f3f75740 1 --2- 172.21.15.84:0/3953111561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563309e5f390 0x56330a224b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.711+0000 7fe1f3f75740 1 --2- 172.21.15.84:0/3953111561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 0x56330a228d90 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.711+0000 7fe1f3f75740 1 -- 172.21.15.84:0/3953111561 >> 172.21.15.84:0/3953111561 conn(0x563309e74460 msgr2=0x56330a228680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.711+0000 7fe1f3f75740 1 -- 172.21.15.84:0/3953111561 shutdown_connections 2024-09-21T03:48:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.711+0000 7fe1f3f75740 1 -- 172.21.15.84:0/3953111561 wait complete. 2024-09-21T03:48:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.711+0000 7fe1f3f75740 1 -- start start 2024-09-21T03:48:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.712+0000 7fe1f3f75740 1 Processor -- start 2024-09-21T03:48:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.712+0000 7fe1f3f75740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 0x56330a23b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.712+0000 7fe1f3f75740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e5f390 0x56330a23bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.712+0000 7fe1f3f75740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563309e80070 0x56330a236b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.712+0000 7fe1f3f75740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e81adca0 con 0x563309e571b0 2024-09-21T03:48:25.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.712+0000 7fe1f3f75740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e81af110 con 0x563309e5f390 2024-09-21T03:48:25.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.712+0000 7fe1f3f75740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e81ae370 con 0x563309e80070 2024-09-21T03:48:25.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.712+0000 7fe1f3f75740 10 client.0 _ll_register_callbacks cb 0x7fe1d810c370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:48:25.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.712+0000 7fe1e77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 0x56330a23b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:25.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.712+0000 7fe1e77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 0x56330a23b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55640/0 (socket says 172.21.15.84:55640) 2024-09-21T03:48:25.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.712+0000 7fe1e77fe640 1 -- 172.21.15.84:0/3125661988 learned_addr learned my addr 172.21.15.84:0/3125661988 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:25.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.712+0000 7fe1e67fc640 1 --2- 172.21.15.84:0/3125661988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e5f390 0x56330a23bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:25.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.712+0000 7fe1e77fe640 1 -- 172.21.15.84:0/3125661988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563309e80070 msgr2=0x56330a236b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:25.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.712+0000 7fe1e77fe640 1 --2- 172.21.15.84:0/3125661988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563309e80070 0x56330a236b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.712+0000 7fe1e77fe640 1 -- 172.21.15.84:0/3125661988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e5f390 msgr2=0x56330a23bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:25.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.712+0000 7fe1e77fe640 1 --2- 172.21.15.84:0/3125661988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e5f390 0x56330a23bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.713+0000 7fe1e77fe640 1 -- 172.21.15.84:0/3125661988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56330a22d980 con 0x563309e571b0 2024-09-21T03:48:25.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.713+0000 7fe1e67fc640 1 --2- 172.21.15.84:0/3125661988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e5f390 0x56330a23bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:48:25.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.713+0000 7fe1e77fe640 1 --2- 172.21.15.84:0/3125661988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 0x56330a23b4f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0001eb0 tx=0x7fe1e0011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb14d99ddf662279 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:25.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.713+0000 7fe1c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:48:25.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.713+0000 7fe1c6ffd640 1 -- 172.21.15.84:0/3125661988 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0011d60 con 0x563309e571b0 2024-09-21T03:48:25.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.713+0000 7fe1c6ffd640 1 -- 172.21.15.84:0/3125661988 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fe1e0003a80 con 0x563309e571b0 2024-09-21T03:48:25.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.713+0000 7fe1f3f75740 1 -- 172.21.15.84:0/3125661988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1e0015070 con 0x563309e571b0 2024-09-21T03:48:25.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.713+0000 7fe1c6ffd640 1 -- 172.21.15.84:0/3125661988 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe1e001aaa0 con 0x563309e571b0 2024-09-21T03:48:25.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.713+0000 7fe1f3f75740 10 client.16527 fetch_fsmap learned FSMap version 25 2024-09-21T03:48:25.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.713+0000 7fe1f3f75740 1 -- 172.21.15.84:0/3125661988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56330a2af000 con 0x563309e571b0 2024-09-21T03:48:25.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.713+0000 7fe1c6ffd640 1 -- 172.21.15.84:0/3125661988 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1e0015070 con 0x563309e571b0 2024-09-21T03:48:25.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.714+0000 7fe1c6ffd640 1 -- 172.21.15.84:0/3125661988 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe1e0004590 con 0x563309e571b0 2024-09-21T03:48:25.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.714+0000 7fe1f3f75740 10 client.16527 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:48:25.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.714+0000 7fe1f3f75740 10 client.16527 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:48:25.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.714+0000 7fe1f3f75740 20 client.16527 populate_metadata read hostname 'smithi084' 2024-09-21T03:48:25.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.714+0000 7fe1f3f75740 1 --2- 172.21.15.84:0/3125661988 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x563309e13da0 0x56330a2b1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:25.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.714+0000 7fe1f3f75740 4 client.16527 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:48:25.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.714+0000 7fe1f3f75740 1 -- 172.21.15.84:0/3125661988 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56330a19b850 con 0x563309e13da0 2024-09-21T03:48:25.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.714+0000 7fe1e67fc640 1 --2- 172.21.15.84:0/3125661988 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x563309e13da0 0x56330a2b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:25.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.714+0000 7fe1c6ffd640 10 client.16527 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:48:25.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.714+0000 7fe1e67fc640 1 --2- 172.21.15.84:0/3125661988 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x563309e13da0 0x56330a2b1740 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90e85ec34babcf32 server_cookie=c176a192a0fc02c8 in_seq=0 out_seq=0 2024-09-21T03:48:25.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.715+0000 7fe1c6ffd640 1 -- 172.21.15.84:0/3125661988 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x56330a19b850 con 0x563309e13da0 2024-09-21T03:48:25.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.715+0000 7fe1c6ffd640 10 client.16527 handle_command_reply: tid=0 2024-09-21T03:48:25.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.715+0000 7fe1f3f75740 1 client.16527 shutdown 2024-09-21T03:48:25.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.715+0000 7fe1f3f75740 1 -- 172.21.15.84:0/3125661988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 msgr2=0x56330a23b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:25.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.715+0000 7fe1f3f75740 1 --2- 172.21.15.84:0/3125661988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 0x56330a23b4f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0001eb0 tx=0x7fe1e0011a50 comp rx=0 tx=0).stop 2024-09-21T03:48:25.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.715+0000 7fe1f3f75740 1 -- 172.21.15.84:0/3125661988 shutdown_connections 2024-09-21T03:48:25.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.715+0000 7fe1f3f75740 1 --2- 172.21.15.84:0/3125661988 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x563309e13da0 0x56330a2b1740 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.715+0000 7fe1f3f75740 1 --2- 172.21.15.84:0/3125661988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563309e80070 0x56330a236b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.715+0000 7fe1f3f75740 1 --2- 172.21.15.84:0/3125661988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563309e5f390 0x56330a23bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.715+0000 7fe1f3f75740 1 --2- 172.21.15.84:0/3125661988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563309e571b0 0x56330a23b4f0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.715+0000 7fe1c6ffd640 0 client.16527 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:48:25.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.715+0000 7fe1f3f75740 1 -- 172.21.15.84:0/3125661988 >> 172.21.15.84:0/3125661988 conn(0x563309e74460 msgr2=0x56330a2341c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:25.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.715+0000 7fe1f3f75740 1 -- 172.21.15.84:0/3125661988 shutdown_connections 2024-09-21T03:48:25.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.715+0000 7fe1f3f75740 1 -- 172.21.15.84:0/3125661988 wait complete. 2024-09-21T03:48:25.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.715+0000 7fe1f3f75740 20 client.16527 trim_cache size 0 max 16384 2024-09-21T03:48:25.732 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:48:25.732 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T03:48:25.732 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T03:48:25.732 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:48:25.732 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:48:25.732 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:48:25.732 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:25.732 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:25.732 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:25.732 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:25.732 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:25.732 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:48:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:48:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:48:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:48:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:48:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:48:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:25.733 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:25.734 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:25.734 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:48:25.734 INFO:teuthology.orchestra.run.smithi084.stdout: "27dcb84c-89fa-46b2-b980-58857966c697": { 2024-09-21T03:48:25.734 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:52.598527+0000", 2024-09-21T03:48:25.734 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:25.734 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:25.734 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:25.734 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:25.734 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:25.734 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:48:25.734 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:48:25.734 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:48:25.734 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:25.735 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:25.735 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:25.735 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:25.735 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:25.735 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:48:25.735 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:48:25.735 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:48:25.735 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:25.735 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:25.735 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:25.735 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:25.736 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:25.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:48:25.736 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:48:25.736 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:48:25.736 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:25.736 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:25.736 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:25.736 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:25.736 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:25.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:48:25.736 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:48:25.736 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:48:25.736 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:25.736 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:25.737 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:25.737 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:25.737 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:25.737 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:48:25.737 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:48:25.737 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:48:25.737 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:25.737 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:25.737 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:25.737 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:25.737 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:25.737 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:48:25.737 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:48:25.738 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:48:25.738 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:25.738 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:25.738 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:25.738 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:25.738 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:25.738 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:48:25.738 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:48:25.738 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:48:25.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.716+0000 7fe1eda01640 1 -- 172.21.15.84:0/3310612516 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe1d00b6680 msgr2=0x7fe1d00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:25.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.716+0000 7fe1eda01640 1 --2- 172.21.15.84:0/3310612516 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe1d00b6680 0x7fe1d00b8b90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe1d802ade0 tx=0x7fe1d810c4a0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.739 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.716+0000 7fe1eda01640 1 -- 172.21.15.84:0/3310612516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1e8103bb0 msgr2=0x7fe1e819a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:25.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.716+0000 7fe1eda01640 1 --2- 172.21.15.84:0/3310612516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1e8103bb0 0x7fe1e819a570 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8006010 tx=0x7fe1d80319f0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.716+0000 7fe1eda01640 1 -- 172.21.15.84:0/3310612516 shutdown_connections 2024-09-21T03:48:25.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.716+0000 7fe1eda01640 1 --2- 172.21.15.84:0/3310612516 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe1d00b6680 0x7fe1d00b8b90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.716+0000 7fe1eda01640 1 --2- 172.21.15.84:0/3310612516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1e8109e40 0x7fe1e819fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.716+0000 7fe1eda01640 1 --2- 172.21.15.84:0/3310612516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1e81094f0 0x7fe1e819ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.716+0000 7fe1eda01640 1 --2- 172.21.15.84:0/3310612516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1e8103bb0 0x7fe1e819a570 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:25.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.716+0000 7fe1eda01640 1 -- 172.21.15.84:0/3310612516 >> 172.21.15.84:0/3310612516 conn(0x7fe1e80ff600 msgr2=0x7fe1e8101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:25.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.716+0000 7fe1eda01640 1 -- 172.21.15.84:0/3310612516 shutdown_connections 2024-09-21T03:48:25.740 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:25.716+0000 7fe1eda01640 1 -- 172.21.15.84:0/3310612516 wait complete. 2024-09-21T03:48:26.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:26 smithi084 ceph-mon[30941]: pgmap v503: 97 pgs: 97 active+clean; 8.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 10 op/s 2024-09-21T03:48:26.601 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:48:26.601 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:48:26.846 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:48:26.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:26 smithi174 ceph-mon[34403]: pgmap v503: 97 pgs: 97 active+clean; 8.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 10 op/s 2024-09-21T03:48:26.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:26 smithi172 ceph-mon[34821]: pgmap v503: 97 pgs: 97 active+clean; 8.9 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 10 op/s 2024-09-21T03:48:27.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.371+0000 7f88f7cf8640 1 -- 172.21.15.84:0/2341017449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88f0105320 msgr2=0x7f88f010d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:27.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.371+0000 7f88f7cf8640 1 --2- 172.21.15.84:0/2341017449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88f0105320 0x7f88f010d870 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f88e0009900 tx=0x7f88e002a410 comp rx=0 tx=0).stop 2024-09-21T03:48:27.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.371+0000 7f88f7cf8640 1 -- 172.21.15.84:0/2341017449 shutdown_connections 2024-09-21T03:48:27.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.371+0000 7f88f7cf8640 1 --2- 172.21.15.84:0/2341017449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f010de30 0x7f88f0110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:27.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.371+0000 7f88f7cf8640 1 --2- 172.21.15.84:0/2341017449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88f0105320 0x7f88f010d870 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:27.384 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.371+0000 7f88f7cf8640 1 --2- 172.21.15.84:0/2341017449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88f01049d0 0x7f88f0104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:27.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.372+0000 7f88f7cf8640 1 -- 172.21.15.84:0/2341017449 >> 172.21.15.84:0/2341017449 conn(0x7f88f0079740 msgr2=0x7f88f0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:27.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.372+0000 7f88f7cf8640 1 -- 172.21.15.84:0/2341017449 shutdown_connections 2024-09-21T03:48:27.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.372+0000 7f88f7cf8640 1 -- 172.21.15.84:0/2341017449 wait complete. 2024-09-21T03:48:27.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.372+0000 7f88f7cf8640 1 Processor -- start 2024-09-21T03:48:27.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.372+0000 7f88f7cf8640 1 -- start start 2024-09-21T03:48:27.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.372+0000 7f88f7cf8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88f01049d0 0x7f88f019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:27.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.372+0000 7f88f7cf8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88f0105320 0x7f88f019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:27.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.373+0000 7f88f7cf8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f010de30 0x7f88f019fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:27.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.373+0000 7f88f7cf8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f88f0113b70 con 0x7f88f01049d0 2024-09-21T03:48:27.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.373+0000 7f88f7cf8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f88f01139f0 con 0x7f88f0105320 2024-09-21T03:48:27.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.373+0000 7f88f7cf8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f88f0113cf0 con 0x7f88f010de30 2024-09-21T03:48:27.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.373+0000 7f88f5a94640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88f01049d0 0x7f88f019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:27.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.373+0000 7f88f5a94640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88f01049d0 0x7f88f019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:55650/0 (socket says 172.21.15.84:55650) 2024-09-21T03:48:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.373+0000 7f88f5a94640 1 -- 172.21.15.84:0/2753520359 learned_addr learned my addr 172.21.15.84:0/2753520359 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.373+0000 7f88f6295640 1 --2- 172.21.15.84:0/2753520359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f010de30 0x7f88f019fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.373+0000 7f88f5a94640 1 -- 172.21.15.84:0/2753520359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f010de30 msgr2=0x7f88f019fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.373+0000 7f88f5a94640 1 --2- 172.21.15.84:0/2753520359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f010de30 0x7f88f019fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.373+0000 7f88f5a94640 1 -- 172.21.15.84:0/2753520359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88f0105320 msgr2=0x7f88f019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.373+0000 7f88f5a94640 1 --2- 172.21.15.84:0/2753520359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88f0105320 0x7f88f019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.373+0000 7f88f5a94640 1 -- 172.21.15.84:0/2753520359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f01a0590 con 0x7f88f01049d0 2024-09-21T03:48:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.373+0000 7f88f6295640 1 --2- 172.21.15.84:0/2753520359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f010de30 0x7f88f019fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:48:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.373+0000 7f88f5a94640 1 --2- 172.21.15.84:0/2753520359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88f01049d0 0x7f88f019a620 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00b450 tx=0x7f88ec00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.373+0000 7f88e6ffd640 1 -- 172.21.15.84:0/2753520359 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec015020 con 0x7f88f01049d0 2024-09-21T03:48:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.373+0000 7f88f7cf8640 1 -- 172.21.15.84:0/2753520359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f01a0880 con 0x7f88f01049d0 2024-09-21T03:48:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.373+0000 7f88e6ffd640 1 -- 172.21.15.84:0/2753520359 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88ec011d40 con 0x7f88f01049d0 2024-09-21T03:48:27.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.373+0000 7f88f7cf8640 1 -- 172.21.15.84:0/2753520359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f01a7060 con 0x7f88f01049d0 2024-09-21T03:48:27.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.373+0000 7f88e6ffd640 1 -- 172.21.15.84:0/2753520359 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ec010e60 con 0x7f88f01049d0 2024-09-21T03:48:27.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.374+0000 7f88f7cf8640 1 -- 172.21.15.84:0/2753520359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88f006c240 con 0x7f88f01049d0 2024-09-21T03:48:27.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.376+0000 7f88e6ffd640 1 -- 172.21.15.84:0/2753520359 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f88ec018020 con 0x7f88f01049d0 2024-09-21T03:48:27.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.377+0000 7f88e6ffd640 1 --2- 172.21.15.84:0/2753520359 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f88dc0b6680 0x7f88dc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:27.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.377+0000 7f88f5293640 1 --2- 172.21.15.84:0/2753520359 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f88dc0b6680 0x7f88dc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:27.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.377+0000 7f88e6ffd640 1 -- 172.21.15.84:0/2753520359 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f88ec0e7650 con 0x7f88f01049d0 2024-09-21T03:48:27.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.377+0000 7f88f5293640 1 --2- 172.21.15.84:0/2753520359 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f88dc0b6680 0x7f88dc0b8b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f88e002a930 tx=0x7f88e0031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:27.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.380+0000 7f88e6ffd640 1 -- 172.21.15.84:0/2753520359 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f88ec01f020 con 0x7f88f01049d0 2024-09-21T03:48:27.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.596+0000 7f88f7cf8640 1 -- 172.21.15.84:0/2753520359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88f019b750 con 0x7f88f01049d0 2024-09-21T03:48:27.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.597+0000 7f88e6ffd640 1 -- 172.21.15.84:0/2753520359 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7f88f019b750 con 0x7f88f01049d0 2024-09-21T03:48:27.599 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:48:27.599 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:48:27.599 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:48:27.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.599+0000 7f88f7cf8640 1 -- 172.21.15.84:0/2753520359 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f88dc0b6680 msgr2=0x7f88dc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:27.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.599+0000 7f88f7cf8640 1 --2- 172.21.15.84:0/2753520359 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f88dc0b6680 0x7f88dc0b8b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f88e002a930 tx=0x7f88e0031400 comp rx=0 tx=0).stop 2024-09-21T03:48:27.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.599+0000 7f88f7cf8640 1 -- 172.21.15.84:0/2753520359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88f01049d0 msgr2=0x7f88f019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:27.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.599+0000 7f88f7cf8640 1 --2- 172.21.15.84:0/2753520359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88f01049d0 0x7f88f019a620 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00b450 tx=0x7f88ec00b910 comp rx=0 tx=0).stop 2024-09-21T03:48:27.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.599+0000 7f88f7cf8640 1 -- 172.21.15.84:0/2753520359 shutdown_connections 2024-09-21T03:48:27.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.599+0000 7f88f7cf8640 1 --2- 172.21.15.84:0/2753520359 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f88dc0b6680 0x7f88dc0b8b90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:27.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.599+0000 7f88f7cf8640 1 --2- 172.21.15.84:0/2753520359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88f010de30 0x7f88f019fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:27.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.599+0000 7f88f7cf8640 1 --2- 172.21.15.84:0/2753520359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88f0105320 0x7f88f019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:27.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.599+0000 7f88f7cf8640 1 --2- 172.21.15.84:0/2753520359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88f01049d0 0x7f88f019a620 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:27.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.599+0000 7f88f7cf8640 1 -- 172.21.15.84:0/2753520359 >> 172.21.15.84:0/2753520359 conn(0x7f88f0079740 msgr2=0x7f88f01009b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:27.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.600+0000 7f88f7cf8640 1 -- 172.21.15.84:0/2753520359 shutdown_connections 2024-09-21T03:48:27.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:27.600+0000 7f88f7cf8640 1 -- 172.21.15.84:0/2753520359 wait complete. 2024-09-21T03:48:27.987 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:27 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2753520359' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:48:28.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:27 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2753520359' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:48:28.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:27 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2753520359' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:48:28.455 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:48:28.707 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:48:28.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:28 smithi084 ceph-mon[30941]: pgmap v504: 97 pgs: 97 active+clean; 9.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 52 KiB/s wr, 14 op/s 2024-09-21T03:48:29.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:28 smithi174 ceph-mon[34403]: pgmap v504: 97 pgs: 97 active+clean; 9.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 52 KiB/s wr, 14 op/s 2024-09-21T03:48:29.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:28 smithi172 ceph-mon[34821]: pgmap v504: 97 pgs: 97 active+clean; 9.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 52 KiB/s wr, 14 op/s 2024-09-21T03:48:29.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.239+0000 7f4d1a7ba640 1 -- 172.21.15.84:0/3928083500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d14102a90 msgr2=0x7f4d14102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.239+0000 7f4d1a7ba640 1 --2- 172.21.15.84:0/3928083500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d14102a90 0x7f4d14102ea0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009900 tx=0x7f4d0402a410 comp rx=0 tx=0).stop 2024-09-21T03:48:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.239+0000 7f4d1a7ba640 1 -- 172.21.15.84:0/3928083500 shutdown_connections 2024-09-21T03:48:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.239+0000 7f4d1a7ba640 1 --2- 172.21.15.84:0/3928083500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d14108d20 0x7f4d1410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.239+0000 7f4d1a7ba640 1 --2- 172.21.15.84:0/3928083500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d141083d0 0x7f4d141087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.239+0000 7f4d1a7ba640 1 --2- 172.21.15.84:0/3928083500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d14102a90 0x7f4d14102ea0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.239+0000 7f4d1a7ba640 1 -- 172.21.15.84:0/3928083500 >> 172.21.15.84:0/3928083500 conn(0x7f4d14079750 msgr2=0x7f4d14079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.239+0000 7f4d1a7ba640 1 -- 172.21.15.84:0/3928083500 shutdown_connections 2024-09-21T03:48:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.239+0000 7f4d1a7ba640 1 -- 172.21.15.84:0/3928083500 wait complete. 2024-09-21T03:48:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.240+0000 7f4d1a7ba640 1 Processor -- start 2024-09-21T03:48:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.240+0000 7f4d1a7ba640 1 -- start start 2024-09-21T03:48:29.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.240+0000 7f4d1a7ba640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d14102a90 0x7f4d1419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.240+0000 7f4d1a7ba640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d141083d0 0x7f4d1419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.240+0000 7f4d1a7ba640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d14108d20 0x7f4d1419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.240+0000 7f4d1a7ba640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4d14112a10 con 0x7f4d14102a90 2024-09-21T03:48:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.240+0000 7f4d1a7ba640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4d14112890 con 0x7f4d141083d0 2024-09-21T03:48:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.240+0000 7f4d1a7ba640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d14112b90 con 0x7f4d14108d20 2024-09-21T03:48:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.241+0000 7f4d13fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d14102a90 0x7f4d1419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.241+0000 7f4d13fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d14102a90 0x7f4d1419a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43550/0 (socket says 172.21.15.84:43550) 2024-09-21T03:48:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.241+0000 7f4d13fff640 1 -- 172.21.15.84:0/1152787804 learned_addr learned my addr 172.21.15.84:0/1152787804 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.241+0000 7f4d137fe640 1 --2- 172.21.15.84:0/1152787804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d141083d0 0x7f4d1419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.241+0000 7f4d18d57640 1 --2- 172.21.15.84:0/1152787804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d14108d20 0x7f4d1419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.241+0000 7f4d13fff640 1 -- 172.21.15.84:0/1152787804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d14108d20 msgr2=0x7f4d1419fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.241+0000 7f4d13fff640 1 --2- 172.21.15.84:0/1152787804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d14108d20 0x7f4d1419fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.241+0000 7f4d13fff640 1 -- 172.21.15.84:0/1152787804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d141083d0 msgr2=0x7f4d1419aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:29.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.241+0000 7f4d13fff640 1 --2- 172.21.15.84:0/1152787804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d141083d0 0x7f4d1419aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.241+0000 7f4d13fff640 1 -- 172.21.15.84:0/1152787804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d141a0440 con 0x7f4d14102a90 2024-09-21T03:48:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.241+0000 7f4d13fff640 1 --2- 172.21.15.84:0/1152787804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d14102a90 0x7f4d1419a4d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f4d04005940 tx=0x7f4d040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.241+0000 7f4d117fa640 1 -- 172.21.15.84:0/1152787804 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0403f030 con 0x7f4d14102a90 2024-09-21T03:48:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.241+0000 7f4d117fa640 1 -- 172.21.15.84:0/1152787804 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d04003cb0 con 0x7f4d14102a90 2024-09-21T03:48:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.241+0000 7f4d1a7ba640 1 -- 172.21.15.84:0/1152787804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d141a06d0 con 0x7f4d14102a90 2024-09-21T03:48:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.241+0000 7f4d117fa640 1 -- 172.21.15.84:0/1152787804 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d04035070 con 0x7f4d14102a90 2024-09-21T03:48:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.241+0000 7f4d1a7ba640 1 -- 172.21.15.84:0/1152787804 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d141a6e90 con 0x7f4d14102a90 2024-09-21T03:48:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.244+0000 7f4d20d2e740 1 Processor -- start 2024-09-21T03:48:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.244+0000 7f4d20d2e740 1 -- start start 2024-09-21T03:48:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.244+0000 7f4d117fa640 1 -- 172.21.15.84:0/1152787804 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f4d04042030 con 0x7f4d14102a90 2024-09-21T03:48:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.244+0000 7f4d20d2e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904ed070 0x55a2908946a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.244+0000 7f4d20d2e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904c41b0 0x55a290894be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.244+0000 7f4d20d2e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904cc390 0x55a290895120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.244+0000 7f4d20d2e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a29080aea0 con 0x55a2904c41b0 2024-09-21T03:48:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.244+0000 7f4d20d2e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a2907fa2d0 con 0x55a2904ed070 2024-09-21T03:48:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.244+0000 7f4d20d2e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a2907fe0e0 con 0x55a2904cc390 2024-09-21T03:48:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.244+0000 7f4d13fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904c41b0 0x55a290894be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.244+0000 7f4d13fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904c41b0 0x55a290894be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43564/0 (socket says 172.21.15.84:43564) 2024-09-21T03:48:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.244+0000 7f4d13fff640 1 -- 172.21.15.84:0/1128202002 learned_addr learned my addr 172.21.15.84:0/1128202002 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.244+0000 7f4d137fe640 1 --2- 172.21.15.84:0/1128202002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904cc390 0x55a290895120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.244+0000 7f4d18d57640 1 --2- 172.21.15.84:0/1128202002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904ed070 0x55a2908946a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.245+0000 7f4d13fff640 1 -- 172.21.15.84:0/1128202002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904cc390 msgr2=0x55a290895120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.245+0000 7f4d13fff640 1 --2- 172.21.15.84:0/1128202002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904cc390 0x55a290895120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.245+0000 7f4d13fff640 1 -- 172.21.15.84:0/1128202002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904ed070 msgr2=0x55a2908946a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.245+0000 7f4d13fff640 1 --2- 172.21.15.84:0/1128202002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904ed070 0x55a2908946a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.245+0000 7f4d13fff640 1 -- 172.21.15.84:0/1128202002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a290558650 con 0x55a2904c41b0 2024-09-21T03:48:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.245+0000 7f4d137fe640 1 --2- 172.21.15.84:0/1128202002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904cc390 0x55a290895120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:48:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.245+0000 7f4d117fa640 1 --2- 172.21.15.84:0/1152787804 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4cfc0b6680 0x7f4cfc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.245+0000 7f4d13fff640 1 --2- 172.21.15.84:0/1128202002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904c41b0 0x55a290894be0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f4d041055e0 tx=0x7f4d04110220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326aaadfa8467a1e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.245+0000 7f4d18d57640 1 --2- 172.21.15.84:0/1152787804 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4cfc0b6680 0x7f4cfc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.245+0000 7f4d117fa640 1 -- 172.21.15.84:0/1152787804 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4d04107ea0 con 0x7f4d14102a90 2024-09-21T03:48:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.245+0000 7f4cfa7fc640 1 -- 172.21.15.84:0/1128202002 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d040ca470 con 0x55a2904c41b0 2024-09-21T03:48:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.245+0000 7f4cfa7fc640 1 -- 172.21.15.84:0/1128202002 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d040cd930 con 0x55a2904c41b0 2024-09-21T03:48:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.245+0000 7f4cfa7fc640 1 -- 172.21.15.84:0/1128202002 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d040cd590 con 0x55a2904c41b0 2024-09-21T03:48:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.246+0000 7f4d20d2e740 1 -- 172.21.15.84:0/1128202002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904c41b0 msgr2=0x55a290894be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.246+0000 7f4d18d57640 1 --2- 172.21.15.84:0/1152787804 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4cfc0b6680 0x7f4cfc0b8b90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00a510 tx=0x7f4d0c00d040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.246+0000 7f4d20d2e740 1 --2- 172.21.15.84:0/1128202002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904c41b0 0x55a290894be0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f4d041055e0 tx=0x7f4d04110220 comp rx=0 tx=0).stop 2024-09-21T03:48:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.246+0000 7f4d20d2e740 1 -- 172.21.15.84:0/1128202002 shutdown_connections 2024-09-21T03:48:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.246+0000 7f4d20d2e740 1 --2- 172.21.15.84:0/1128202002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904cc390 0x55a290895120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.246+0000 7f4d20d2e740 1 --2- 172.21.15.84:0/1128202002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904c41b0 0x55a290894be0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.246+0000 7f4d20d2e740 1 --2- 172.21.15.84:0/1128202002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904ed070 0x55a2908946a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.246+0000 7f4d20d2e740 1 -- 172.21.15.84:0/1128202002 >> 172.21.15.84:0/1128202002 conn(0x55a2904e1460 msgr2=0x55a290892590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.246+0000 7f4d20d2e740 1 -- 172.21.15.84:0/1128202002 shutdown_connections 2024-09-21T03:48:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.246+0000 7f4d20d2e740 1 -- 172.21.15.84:0/1128202002 wait complete. 2024-09-21T03:48:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.247+0000 7f4d20d2e740 1 -- start start 2024-09-21T03:48:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.247+0000 7f4d20d2e740 1 Processor -- start 2024-09-21T03:48:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.247+0000 7f4d20d2e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904c41b0 0x55a29089fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.247+0000 7f4d20d2e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904cc390 0x55a2908a0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.247+0000 7f4d20d2e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904ed070 0x55a2908b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.247+0000 7f4d20d2e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a29065b700 con 0x55a2904ed070 2024-09-21T03:48:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.247+0000 7f4d20d2e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a290795160 con 0x55a2904cc390 2024-09-21T03:48:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.247+0000 7f4d20d2e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a29080aea0 con 0x55a2904c41b0 2024-09-21T03:48:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.247+0000 7f4d20d2e740 10 client.0 _ll_register_callbacks cb 0x55a2907ae9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:48:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.247+0000 7f4d18d57640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904ed070 0x55a2908b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.247+0000 7f4d18d57640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904ed070 0x55a2908b02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43578/0 (socket says 172.21.15.84:43578) 2024-09-21T03:48:29.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.247+0000 7f4d18d57640 1 -- 172.21.15.84:0/3530070157 learned_addr learned my addr 172.21.15.84:0/3530070157 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.247+0000 7f4d13fff640 1 --2- 172.21.15.84:0/3530070157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904c41b0 0x55a29089fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.248+0000 7f4d137fe640 1 --2- 172.21.15.84:0/3530070157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904cc390 0x55a2908a0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.248+0000 7f4d18d57640 1 -- 172.21.15.84:0/3530070157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904c41b0 msgr2=0x55a29089fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.248+0000 7f4d18d57640 1 --2- 172.21.15.84:0/3530070157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904c41b0 0x55a29089fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.248+0000 7f4d18d57640 1 -- 172.21.15.84:0/3530070157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904cc390 msgr2=0x55a2908a0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.248+0000 7f4d18d57640 1 --2- 172.21.15.84:0/3530070157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904cc390 0x55a2908a0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.248+0000 7f4d18d57640 1 -- 172.21.15.84:0/3530070157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2907c2c90 con 0x55a2904ed070 2024-09-21T03:48:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.248+0000 7f4d13fff640 1 --2- 172.21.15.84:0/3530070157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904c41b0 0x55a29089fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:48:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.248+0000 7f4d18d57640 1 --2- 172.21.15.84:0/3530070157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904ed070 0x55a2908b02a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c018a90 tx=0x7f4d0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b31e0cd628153e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.248+0000 7f4cf37fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:48:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.248+0000 7f4cf37fe640 1 -- 172.21.15.84:0/3530070157 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c028060 con 0x55a2904ed070 2024-09-21T03:48:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.248+0000 7f4cf37fe640 1 -- 172.21.15.84:0/3530070157 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4d0c023440 con 0x55a2904ed070 2024-09-21T03:48:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.248+0000 7f4d20d2e740 1 -- 172.21.15.84:0/3530070157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d040cd930 con 0x55a2904ed070 2024-09-21T03:48:29.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.248+0000 7f4cf37fe640 1 -- 172.21.15.84:0/3530070157 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4d0c007e80 con 0x55a2904ed070 2024-09-21T03:48:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.248+0000 7f4d20d2e740 10 client.16545 fetch_fsmap learned FSMap version 25 2024-09-21T03:48:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.248+0000 7f4d20d2e740 1 -- 172.21.15.84:0/3530070157 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a2908b2d80 con 0x55a2904ed070 2024-09-21T03:48:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.249+0000 7f4cf37fe640 1 -- 172.21.15.84:0/3530070157 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d040cd930 con 0x55a2904ed070 2024-09-21T03:48:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.249+0000 7f4cf37fe640 1 -- 172.21.15.84:0/3530070157 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4d0c016750 con 0x55a2904ed070 2024-09-21T03:48:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.249+0000 7f4d20d2e740 10 client.16545 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:48:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.249+0000 7f4d20d2e740 10 client.16545 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:48:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.249+0000 7f4d20d2e740 20 client.16545 populate_metadata read hostname 'smithi084' 2024-09-21T03:48:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.249+0000 7f4d20d2e740 1 --2- 172.21.15.84:0/3530070157 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55a2904ab9f0 0x55a2908b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.249+0000 7f4d20d2e740 4 client.16545 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:48:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.249+0000 7f4d20d2e740 1 -- 172.21.15.84:0/3530070157 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a29080cdf0 con 0x55a2904ab9f0 2024-09-21T03:48:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.249+0000 7f4d13fff640 1 --2- 172.21.15.84:0/3530070157 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55a2904ab9f0 0x55a2908b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.249+0000 7f4cf37fe640 10 client.16545 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:48:29.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.249+0000 7f4d13fff640 1 --2- 172.21.15.84:0/3530070157 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55a2904ab9f0 0x55a2908b6290 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=23cd870905834ba0 server_cookie=1e0ca3cba7791d72 in_seq=0 out_seq=0 2024-09-21T03:48:29.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.250+0000 7f4cf37fe640 1 -- 172.21.15.84:0/3530070157 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a29080cdf0 con 0x55a2904ab9f0 2024-09-21T03:48:29.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.250+0000 7f4cf37fe640 10 client.16545 handle_command_reply: tid=0 2024-09-21T03:48:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.250+0000 7f4d20d2e740 1 client.16545 shutdown 2024-09-21T03:48:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.250+0000 7f4d20d2e740 1 -- 172.21.15.84:0/3530070157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904ed070 msgr2=0x55a2908b02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.250+0000 7f4d20d2e740 1 --2- 172.21.15.84:0/3530070157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904ed070 0x55a2908b02a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c018a90 tx=0x7f4d0c004a40 comp rx=0 tx=0).stop 2024-09-21T03:48:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.251+0000 7f4d20d2e740 1 -- 172.21.15.84:0/3530070157 shutdown_connections 2024-09-21T03:48:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.251+0000 7f4d20d2e740 1 --2- 172.21.15.84:0/3530070157 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55a2904ab9f0 0x55a2908b6290 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.251+0000 7f4d20d2e740 1 --2- 172.21.15.84:0/3530070157 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904ed070 0x55a2908b02a0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.251+0000 7f4d20d2e740 1 --2- 172.21.15.84:0/3530070157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904cc390 0x55a2908a0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.251+0000 7f4cf37fe640 0 client.16545 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:48:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.251+0000 7f4d20d2e740 1 --2- 172.21.15.84:0/3530070157 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904c41b0 0x55a29089fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.251+0000 7f4d20d2e740 1 -- 172.21.15.84:0/3530070157 >> 172.21.15.84:0/3530070157 conn(0x55a2904e1460 msgr2=0x55a2908956d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.251+0000 7f4d20d2e740 1 -- 172.21.15.84:0/3530070157 shutdown_connections 2024-09-21T03:48:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.251+0000 7f4d20d2e740 1 -- 172.21.15.84:0/3530070157 wait complete. 2024-09-21T03:48:29.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.251+0000 7f4d20d2e740 20 client.16545 trim_cache size 0 max 16384 2024-09-21T03:48:29.265 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.264+0000 7f4d20d2e740 1 Processor -- start 2024-09-21T03:48:29.266 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.264+0000 7f4d20d2e740 1 -- start start 2024-09-21T03:48:29.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.264+0000 7f4d20d2e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904c41b0 0x55a290895de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.264+0000 7f4d20d2e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904cc390 0x55a29089d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.264+0000 7f4d20d2e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904ed070 0x55a29089d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.264+0000 7f4d20d2e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4d141afc90 con 0x55a2904ed070 2024-09-21T03:48:29.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.264+0000 7f4d20d2e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4d141ad560 con 0x55a2904cc390 2024-09-21T03:48:29.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.264+0000 7f4d20d2e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d141ab3b0 con 0x55a2904c41b0 2024-09-21T03:48:29.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.264+0000 7f4d18d57640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904ed070 0x55a29089d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.264+0000 7f4d18d57640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904ed070 0x55a29089d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43580/0 (socket says 172.21.15.84:43580) 2024-09-21T03:48:29.268 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.264+0000 7f4d18d57640 1 -- 172.21.15.84:0/657589458 learned_addr learned my addr 172.21.15.84:0/657589458 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:29.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.264+0000 7f4d137fe640 1 --2- 172.21.15.84:0/657589458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904cc390 0x55a29089d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.264+0000 7f4d18d57640 1 -- 172.21.15.84:0/657589458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904c41b0 msgr2=0x55a290895de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:29.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.264+0000 7f4d13fff640 1 --2- 172.21.15.84:0/657589458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904c41b0 0x55a290895de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.264+0000 7f4d18d57640 1 --2- 172.21.15.84:0/657589458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904c41b0 0x55a290895de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.264+0000 7f4d18d57640 1 -- 172.21.15.84:0/657589458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904cc390 msgr2=0x55a29089d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:29.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.264+0000 7f4d18d57640 1 --2- 172.21.15.84:0/657589458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904cc390 0x55a29089d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.264+0000 7f4d18d57640 1 -- 172.21.15.84:0/657589458 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a29088d9c0 con 0x55a2904ed070 2024-09-21T03:48:29.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.264+0000 7f4d137fe640 1 --2- 172.21.15.84:0/657589458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904cc390 0x55a29089d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:48:29.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.264+0000 7f4d13fff640 1 --2- 172.21.15.84:0/657589458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904c41b0 0x55a290895de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:48:29.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.265+0000 7f4d18d57640 1 --2- 172.21.15.84:0/657589458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904ed070 0x55a29089d540 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00ae40 tx=0x7f4d0c0097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47dac80db9d5b27 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:29.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.265+0000 7f4cf9ffb640 1 -- 172.21.15.84:0/657589458 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c016d90 con 0x55a2904ed070 2024-09-21T03:48:29.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.265+0000 7f4cf9ffb640 1 -- 172.21.15.84:0/657589458 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d0c016880 con 0x55a2904ed070 2024-09-21T03:48:29.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.265+0000 7f4cf9ffb640 1 -- 172.21.15.84:0/657589458 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c023d40 con 0x55a2904ed070 2024-09-21T03:48:29.269 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.265+0000 7f4d20d2e740 1 -- 172.21.15.84:0/657589458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904ed070 msgr2=0x55a29089d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:29.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.265+0000 7f4d20d2e740 1 --2- 172.21.15.84:0/657589458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904ed070 0x55a29089d540 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00ae40 tx=0x7f4d0c0097f0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.266+0000 7f4d20d2e740 1 -- 172.21.15.84:0/657589458 shutdown_connections 2024-09-21T03:48:29.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.266+0000 7f4d20d2e740 1 --2- 172.21.15.84:0/657589458 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904ed070 0x55a29089d540 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.266+0000 7f4d20d2e740 1 --2- 172.21.15.84:0/657589458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904cc390 0x55a29089d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.266+0000 7f4d20d2e740 1 --2- 172.21.15.84:0/657589458 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904c41b0 0x55a290895de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.266+0000 7f4d20d2e740 1 -- 172.21.15.84:0/657589458 >> 172.21.15.84:0/657589458 conn(0x55a2904e1460 msgr2=0x55a2908956d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:29.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.266+0000 7f4d20d2e740 1 -- 172.21.15.84:0/657589458 shutdown_connections 2024-09-21T03:48:29.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.266+0000 7f4d20d2e740 1 -- 172.21.15.84:0/657589458 wait complete. 2024-09-21T03:48:29.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.266+0000 7f4d20d2e740 1 -- start start 2024-09-21T03:48:29.270 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.266+0000 7f4d20d2e740 1 Processor -- start 2024-09-21T03:48:29.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.266+0000 7f4d20d2e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904c41b0 0x55a2908acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.266+0000 7f4d20d2e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904cc390 0x55a2908a80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.266+0000 7f4d20d2e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904ed070 0x55a2908a87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.266+0000 7f4d20d2e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4d141aba20 con 0x55a2904cc390 2024-09-21T03:48:29.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.266+0000 7f4d20d2e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4d141ace90 con 0x55a2904ed070 2024-09-21T03:48:29.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.266+0000 7f4d20d2e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4d141ac0f0 con 0x55a2904c41b0 2024-09-21T03:48:29.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.267+0000 7f4d20d2e740 10 client.0 _ll_register_callbacks cb 0x7f4d0c009cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:48:29.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.267+0000 7f4d137fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904cc390 0x55a2908a80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.267+0000 7f4d137fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904cc390 0x55a2908a80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43590/0 (socket says 172.21.15.84:43590) 2024-09-21T03:48:29.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.267+0000 7f4d137fe640 1 -- 172.21.15.84:0/1086885853 learned_addr learned my addr 172.21.15.84:0/1086885853 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:29.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.267+0000 7f4d13fff640 1 --2- 172.21.15.84:0/1086885853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904c41b0 0x55a2908acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.267+0000 7f4d18d57640 1 --2- 172.21.15.84:0/1086885853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904ed070 0x55a2908a87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.267+0000 7f4d137fe640 1 -- 172.21.15.84:0/1086885853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904c41b0 msgr2=0x55a2908acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:29.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.267+0000 7f4d137fe640 1 --2- 172.21.15.84:0/1086885853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904c41b0 0x55a2908acbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.267+0000 7f4d137fe640 1 -- 172.21.15.84:0/1086885853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904ed070 msgr2=0x55a2908a87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:29.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.267+0000 7f4d137fe640 1 --2- 172.21.15.84:0/1086885853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904ed070 0x55a2908a87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.267+0000 7f4d137fe640 1 -- 172.21.15.84:0/1086885853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a29091fc50 con 0x55a2904cc390 2024-09-21T03:48:29.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.267+0000 7f4d137fe640 1 --2- 172.21.15.84:0/1086885853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904cc390 0x55a2908a80e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800b980 tx=0x7f4d0800be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbe612b78c4bea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:29.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.267+0000 7f4cf37fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:48:29.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.267+0000 7f4cf37fe640 1 -- 172.21.15.84:0/1086885853 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d08021060 con 0x55a2904cc390 2024-09-21T03:48:29.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.267+0000 7f4cf37fe640 1 -- 172.21.15.84:0/1086885853 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4d08011640 con 0x55a2904cc390 2024-09-21T03:48:29.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.267+0000 7f4d20d2e740 1 -- 172.21.15.84:0/1086885853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d0c016880 con 0x55a2904cc390 2024-09-21T03:48:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.267+0000 7f4cf37fe640 1 -- 172.21.15.84:0/1086885853 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4d08011840 con 0x55a2904cc390 2024-09-21T03:48:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.267+0000 7f4d20d2e740 10 client.16551 fetch_fsmap learned FSMap version 25 2024-09-21T03:48:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.267+0000 7f4d20d2e740 1 -- 172.21.15.84:0/1086885853 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a290920d70 con 0x55a2904cc390 2024-09-21T03:48:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.268+0000 7f4cf37fe640 1 -- 172.21.15.84:0/1086885853 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d0c016880 con 0x55a2904cc390 2024-09-21T03:48:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.268+0000 7f4cf37fe640 1 -- 172.21.15.84:0/1086885853 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4d0801b070 con 0x55a2904cc390 2024-09-21T03:48:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.268+0000 7f4d20d2e740 10 client.16551 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:48:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.268+0000 7f4d20d2e740 10 client.16551 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:48:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.268+0000 7f4d20d2e740 20 client.16551 populate_metadata read hostname 'smithi084' 2024-09-21T03:48:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.268+0000 7f4d20d2e740 1 --2- 172.21.15.84:0/1086885853 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55a290480da0 0x55a290923590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.268+0000 7f4d20d2e740 4 client.16551 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:48:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.268+0000 7f4d20d2e740 1 -- 172.21.15.84:0/1086885853 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a2908088a0 con 0x55a290480da0 2024-09-21T03:48:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.268+0000 7f4d13fff640 1 --2- 172.21.15.84:0/1086885853 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55a290480da0 0x55a290923590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.269+0000 7f4d13fff640 1 --2- 172.21.15.84:0/1086885853 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55a290480da0 0x55a290923590 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c7a2e4280fd9c8d4 server_cookie=94a857d39d9d01aa in_seq=0 out_seq=0 2024-09-21T03:48:29.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.269+0000 7f4cf37fe640 10 client.16551 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:48:29.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.269+0000 7f4cf37fe640 1 -- 172.21.15.84:0/1086885853 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a2908088a0 con 0x55a290480da0 2024-09-21T03:48:29.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.269+0000 7f4cf37fe640 10 client.16551 handle_command_reply: tid=0 2024-09-21T03:48:29.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.269+0000 7f4d20d2e740 1 client.16551 shutdown 2024-09-21T03:48:29.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.269+0000 7f4d20d2e740 1 -- 172.21.15.84:0/1086885853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904cc390 msgr2=0x55a2908a80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:29.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.269+0000 7f4d20d2e740 1 --2- 172.21.15.84:0/1086885853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904cc390 0x55a2908a80e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800b980 tx=0x7f4d0800be40 comp rx=0 tx=0).stop 2024-09-21T03:48:29.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.269+0000 7f4d20d2e740 1 -- 172.21.15.84:0/1086885853 shutdown_connections 2024-09-21T03:48:29.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.269+0000 7f4d20d2e740 1 --2- 172.21.15.84:0/1086885853 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55a290480da0 0x55a290923590 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.269+0000 7f4d20d2e740 1 --2- 172.21.15.84:0/1086885853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2904ed070 0x55a2908a87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.269+0000 7f4d20d2e740 1 --2- 172.21.15.84:0/1086885853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2904cc390 0x55a2908a80e0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.269+0000 7f4d20d2e740 1 --2- 172.21.15.84:0/1086885853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2904c41b0 0x55a2908acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.269+0000 7f4d20d2e740 1 -- 172.21.15.84:0/1086885853 >> 172.21.15.84:0/1086885853 conn(0x55a2904e1460 msgr2=0x55a2908a10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:29.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.269+0000 7f4cf37fe640 0 client.16551 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:48:29.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.269+0000 7f4d20d2e740 1 -- 172.21.15.84:0/1086885853 shutdown_connections 2024-09-21T03:48:29.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.269+0000 7f4d20d2e740 1 -- 172.21.15.84:0/1086885853 wait complete. 2024-09-21T03:48:29.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.269+0000 7f4d20d2e740 20 client.16551 trim_cache size 0 max 16384 2024-09-21T03:48:29.277 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:48:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.270+0000 7f4d1a7ba640 1 -- 172.21.15.84:0/1152787804 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4cfc0b6680 msgr2=0x7f4cfc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.270+0000 7f4d1a7ba640 1 --2- 172.21.15.84:0/1152787804 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4cfc0b6680 0x7f4cfc0b8b90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00a510 tx=0x7f4d0c00d040 comp rx=0 tx=0).stop 2024-09-21T03:48:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.270+0000 7f4d1a7ba640 1 -- 172.21.15.84:0/1152787804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d14102a90 msgr2=0x7f4d1419a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.270+0000 7f4d1a7ba640 1 --2- 172.21.15.84:0/1152787804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d14102a90 0x7f4d1419a4d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f4d04005940 tx=0x7f4d040042f0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.270+0000 7f4d1a7ba640 1 -- 172.21.15.84:0/1152787804 shutdown_connections 2024-09-21T03:48:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.270+0000 7f4d1a7ba640 1 --2- 172.21.15.84:0/1152787804 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4cfc0b6680 0x7f4cfc0b8b90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.270+0000 7f4d1a7ba640 1 --2- 172.21.15.84:0/1152787804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4d14108d20 0x7f4d1419fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.270+0000 7f4d1a7ba640 1 --2- 172.21.15.84:0/1152787804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d141083d0 0x7f4d1419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.270+0000 7f4d1a7ba640 1 --2- 172.21.15.84:0/1152787804 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4d14102a90 0x7f4d1419a4d0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:29.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.270+0000 7f4d1a7ba640 1 -- 172.21.15.84:0/1152787804 >> 172.21.15.84:0/1152787804 conn(0x7f4d14079750 msgr2=0x7f4d14106720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:29.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.270+0000 7f4d1a7ba640 1 -- 172.21.15.84:0/1152787804 shutdown_connections 2024-09-21T03:48:29.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:29.270+0000 7f4d1a7ba640 1 -- 172.21.15.84:0/1152787804 wait complete. 2024-09-21T03:48:30.050 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:48:30.295 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:48:30.725 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:30 smithi084 ceph-mon[30941]: pgmap v505: 97 pgs: 97 active+clean; 9.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-21T03:48:30.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.814+0000 7ff634a72640 1 -- 172.21.15.84:0/4264014761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff630109df0 msgr2=0x7ff630110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:30.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.814+0000 7ff634a72640 1 --2- 172.21.15.84:0/4264014761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff630109df0 0x7ff630110620 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff628009ca0 tx=0x7ff62802a8e0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.814+0000 7ff634a72640 1 -- 172.21.15.84:0/4264014761 shutdown_connections 2024-09-21T03:48:30.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.814+0000 7ff634a72640 1 --2- 172.21.15.84:0/4264014761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff630109df0 0x7ff630110620 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.814+0000 7ff634a72640 1 --2- 172.21.15.84:0/4264014761 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6301094a0 0x7ff6301098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.814+0000 7ff634a72640 1 --2- 172.21.15.84:0/4264014761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff630103b60 0x7ff630103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.814+0000 7ff634a72640 1 -- 172.21.15.84:0/4264014761 >> 172.21.15.84:0/4264014761 conn(0x7ff63007b850 msgr2=0x7ff63007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:30.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.814+0000 7ff634a72640 1 -- 172.21.15.84:0/4264014761 shutdown_connections 2024-09-21T03:48:30.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.814+0000 7ff634a72640 1 -- 172.21.15.84:0/4264014761 wait complete. 2024-09-21T03:48:30.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.815+0000 7ff634a72640 1 Processor -- start 2024-09-21T03:48:30.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.815+0000 7ff634a72640 1 -- start start 2024-09-21T03:48:30.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.815+0000 7ff634a72640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff630103b60 0x7ff63019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:30.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.815+0000 7ff634a72640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6301094a0 0x7ff63019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:30.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.815+0000 7ff634a72640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff630109df0 0x7ff63019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:30.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.815+0000 7ff634a72640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff630113af0 con 0x7ff630109df0 2024-09-21T03:48:30.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.815+0000 7ff634a72640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff630113970 con 0x7ff6301094a0 2024-09-21T03:48:30.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.815+0000 7ff634a72640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff630113c70 con 0x7ff630103b60 2024-09-21T03:48:30.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.816+0000 7ff62ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff630109df0 0x7ff63019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:30.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.816+0000 7ff62ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff630109df0 0x7ff63019fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43612/0 (socket says 172.21.15.84:43612) 2024-09-21T03:48:30.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.816+0000 7ff62ed9d640 1 -- 172.21.15.84:0/2759387691 learned_addr learned my addr 172.21.15.84:0/2759387691 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:30.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.816+0000 7ff62e59c640 1 --2- 172.21.15.84:0/2759387691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff630103b60 0x7ff63019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:30.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.816+0000 7ff62dd9b640 1 --2- 172.21.15.84:0/2759387691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6301094a0 0x7ff63019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:30.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.816+0000 7ff62ed9d640 1 -- 172.21.15.84:0/2759387691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff630103b60 msgr2=0x7ff63019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.816+0000 7ff62ed9d640 1 --2- 172.21.15.84:0/2759387691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff630103b60 0x7ff63019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.816+0000 7ff62ed9d640 1 -- 172.21.15.84:0/2759387691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6301094a0 msgr2=0x7ff63019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.816+0000 7ff62ed9d640 1 --2- 172.21.15.84:0/2759387691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6301094a0 0x7ff63019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.816+0000 7ff62ed9d640 1 -- 172.21.15.84:0/2759387691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6301a0350 con 0x7ff630109df0 2024-09-21T03:48:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.816+0000 7ff62dd9b640 1 --2- 172.21.15.84:0/2759387691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6301094a0 0x7ff63019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:48:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.816+0000 7ff62ed9d640 1 --2- 172.21.15.84:0/2759387691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff630109df0 0x7ff63019fce0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff628005cc0 tx=0x7ff628003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.816+0000 7ff6277fe640 1 -- 172.21.15.84:0/2759387691 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff628004040 con 0x7ff630109df0 2024-09-21T03:48:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.816+0000 7ff6277fe640 1 -- 172.21.15.84:0/2759387691 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff628004690 con 0x7ff630109df0 2024-09-21T03:48:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.816+0000 7ff634a72640 1 -- 172.21.15.84:0/2759387691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6301a05e0 con 0x7ff630109df0 2024-09-21T03:48:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.816+0000 7ff6277fe640 1 -- 172.21.15.84:0/2759387691 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff628030d90 con 0x7ff630109df0 2024-09-21T03:48:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.816+0000 7ff634a72640 1 -- 172.21.15.84:0/2759387691 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6301a6e60 con 0x7ff630109df0 2024-09-21T03:48:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.819+0000 7ff63afe6740 1 Processor -- start 2024-09-21T03:48:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.819+0000 7ff6277fe640 1 -- 172.21.15.84:0/2759387691 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7ff6280041e0 con 0x7ff630109df0 2024-09-21T03:48:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.819+0000 7ff63afe6740 1 -- start start 2024-09-21T03:48:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.819+0000 7ff63afe6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdc3e070 0x55c3cdfe56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:30.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.819+0000 7ff63afe6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 0x55c3cdfe5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.819+0000 7ff63afe6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdc1d390 0x55c3cdfe6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.819+0000 7ff63afe6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c3cdf5bea0 con 0x55c3cdc151b0 2024-09-21T03:48:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.819+0000 7ff63afe6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c3cdf4b2d0 con 0x55c3cdc1d390 2024-09-21T03:48:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.819+0000 7ff63afe6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c3cdf4f0e0 con 0x55c3cdc3e070 2024-09-21T03:48:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.819+0000 7ff62e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 0x55c3cdfe5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.819+0000 7ff62e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 0x55c3cdfe5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43628/0 (socket says 172.21.15.84:43628) 2024-09-21T03:48:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.820+0000 7ff62e59c640 1 -- 172.21.15.84:0/2689858680 learned_addr learned my addr 172.21.15.84:0/2689858680 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.820+0000 7ff62dd9b640 1 --2- 172.21.15.84:0/2689858680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdc3e070 0x55c3cdfe56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.820+0000 7ff62dd9b640 1 --2- 172.21.15.84:0/2689858680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdc1d390 0x55c3cdfe6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.820+0000 7ff62e59c640 1 -- 172.21.15.84:0/2689858680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdc3e070 msgr2=0x55c3cdfe56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.820+0000 7ff62e59c640 1 --2- 172.21.15.84:0/2689858680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdc3e070 0x55c3cdfe56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.820+0000 7ff62e59c640 1 -- 172.21.15.84:0/2689858680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdc1d390 msgr2=0x55c3cdfe6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.820+0000 7ff62e59c640 1 --2- 172.21.15.84:0/2689858680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdc1d390 0x55c3cdfe6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.820+0000 7ff62e59c640 1 -- 172.21.15.84:0/2689858680 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3cdca9650 con 0x55c3cdc151b0 2024-09-21T03:48:30.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.820+0000 7ff62dd9b640 1 --2- 172.21.15.84:0/2689858680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdc3e070 0x55c3cdfe56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:48:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.820+0000 7ff6277fe640 1 --2- 172.21.15.84:0/2759387691 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff61c0b66b0 0x7ff61c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.820+0000 7ff62dd9b640 1 --2- 172.21.15.84:0/2759387691 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff61c0b66b0 0x7ff61c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.820+0000 7ff62e59c640 1 --2- 172.21.15.84:0/2689858680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 0x55c3cdfe5be0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff62000ad00 tx=0x7ff62000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4302d0e44fb6593d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.820+0000 7ff6277fe640 1 -- 172.21.15.84:0/2759387691 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff628108a40 con 0x7ff630109df0 2024-09-21T03:48:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.820+0000 7ff624ff9640 1 -- 172.21.15.84:0/2689858680 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62001d070 con 0x55c3cdc151b0 2024-09-21T03:48:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.820+0000 7ff624ff9640 1 -- 172.21.15.84:0/2689858680 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff620018af0 con 0x55c3cdc151b0 2024-09-21T03:48:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.820+0000 7ff624ff9640 1 -- 172.21.15.84:0/2689858680 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff620010b30 con 0x55c3cdc151b0 2024-09-21T03:48:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.821+0000 7ff63afe6740 1 -- 172.21.15.84:0/2689858680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 msgr2=0x55c3cdfe5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.821+0000 7ff62dd9b640 1 --2- 172.21.15.84:0/2759387691 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff61c0b66b0 0x7ff61c0b8bc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff630109040 tx=0x7ff618006f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.821+0000 7ff63afe6740 1 --2- 172.21.15.84:0/2689858680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 0x55c3cdfe5be0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff62000ad00 tx=0x7ff62000f790 comp rx=0 tx=0).stop 2024-09-21T03:48:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.821+0000 7ff63afe6740 1 -- 172.21.15.84:0/2689858680 shutdown_connections 2024-09-21T03:48:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.821+0000 7ff63afe6740 1 --2- 172.21.15.84:0/2689858680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdc1d390 0x55c3cdfe6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.821+0000 7ff63afe6740 1 --2- 172.21.15.84:0/2689858680 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 0x55c3cdfe5be0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.821+0000 7ff63afe6740 1 --2- 172.21.15.84:0/2689858680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdc3e070 0x55c3cdfe56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.821+0000 7ff63afe6740 1 -- 172.21.15.84:0/2689858680 >> 172.21.15.84:0/2689858680 conn(0x55c3cdc32460 msgr2=0x55c3cdfe3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:30.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.821+0000 7ff63afe6740 1 -- 172.21.15.84:0/2689858680 shutdown_connections 2024-09-21T03:48:30.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.821+0000 7ff63afe6740 1 -- 172.21.15.84:0/2689858680 wait complete. 2024-09-21T03:48:30.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.822+0000 7ff63afe6740 1 -- start start 2024-09-21T03:48:30.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.822+0000 7ff63afe6740 1 Processor -- start 2024-09-21T03:48:30.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.822+0000 7ff63afe6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 0x55c3cdff0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:30.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.822+0000 7ff63afe6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdc1d390 0x55c3cdff1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:30.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.822+0000 7ff63afe6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdc3e070 0x55c3cdff1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:30.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.822+0000 7ff63afe6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c3cddac700 con 0x55c3cdc151b0 2024-09-21T03:48:30.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.822+0000 7ff63afe6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c3cdee6160 con 0x55c3cdc1d390 2024-09-21T03:48:30.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.822+0000 7ff63afe6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c3cdff3e80 con 0x55c3cdc3e070 2024-09-21T03:48:30.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.822+0000 7ff63afe6740 10 client.0 _ll_register_callbacks cb 0x55c3cdeff9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:48:30.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.822+0000 7ff62e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 0x55c3cdff0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:30.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.822+0000 7ff62e59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 0x55c3cdff0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43636/0 (socket says 172.21.15.84:43636) 2024-09-21T03:48:30.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.822+0000 7ff62e59c640 1 -- 172.21.15.84:0/2253346297 learned_addr learned my addr 172.21.15.84:0/2253346297 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:30.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.822+0000 7ff62dd9b640 1 --2- 172.21.15.84:0/2253346297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdc1d390 0x55c3cdff1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:30.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.823+0000 7ff62ed9d640 1 --2- 172.21.15.84:0/2253346297 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdc3e070 0x55c3cdff1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:30.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.823+0000 7ff62e59c640 1 -- 172.21.15.84:0/2253346297 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdc3e070 msgr2=0x55c3cdff1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:30.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.823+0000 7ff62e59c640 1 --2- 172.21.15.84:0/2253346297 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdc3e070 0x55c3cdff1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.823+0000 7ff62e59c640 1 -- 172.21.15.84:0/2253346297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdc1d390 msgr2=0x55c3cdff1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:30.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.823+0000 7ff62e59c640 1 --2- 172.21.15.84:0/2253346297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdc1d390 0x55c3cdff1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.823+0000 7ff62e59c640 1 -- 172.21.15.84:0/2253346297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3cdf13c90 con 0x55c3cdc151b0 2024-09-21T03:48:30.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.823+0000 7ff62e59c640 1 --2- 172.21.15.84:0/2253346297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 0x55c3cdff0cd0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff620010470 tx=0x7ff6200186f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c27440cbb2cb14a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:30.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.823+0000 7ff615ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:48:30.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.823+0000 7ff615ffb640 1 -- 172.21.15.84:0/2253346297 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62001d040 con 0x55c3cdc151b0 2024-09-21T03:48:30.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.823+0000 7ff615ffb640 1 -- 172.21.15.84:0/2253346297 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff620010870 con 0x55c3cdc151b0 2024-09-21T03:48:30.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.823+0000 7ff63afe6740 1 -- 172.21.15.84:0/2253346297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff620018af0 con 0x55c3cdc151b0 2024-09-21T03:48:30.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.823+0000 7ff615ffb640 1 -- 172.21.15.84:0/2253346297 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff620010a70 con 0x55c3cdc151b0 2024-09-21T03:48:30.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.823+0000 7ff63afe6740 10 client.16563 fetch_fsmap learned FSMap version 25 2024-09-21T03:48:30.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.823+0000 7ff63afe6740 1 -- 172.21.15.84:0/2253346297 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c3cdfffae0 con 0x55c3cdc151b0 2024-09-21T03:48:30.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.823+0000 7ff615ffb640 1 -- 172.21.15.84:0/2253346297 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff620018af0 con 0x55c3cdc151b0 2024-09-21T03:48:30.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.824+0000 7ff615ffb640 1 -- 172.21.15.84:0/2253346297 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff620020030 con 0x55c3cdc151b0 2024-09-21T03:48:30.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.824+0000 7ff63afe6740 10 client.16563 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:48:30.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.824+0000 7ff63afe6740 10 client.16563 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:48:30.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.824+0000 7ff63afe6740 20 client.16563 populate_metadata read hostname 'smithi084' 2024-09-21T03:48:30.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.824+0000 7ff63afe6740 1 --2- 172.21.15.84:0/2253346297 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55c3cdbfc9f0 0x55c3ce002e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:30.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.824+0000 7ff63afe6740 4 client.16563 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:48:30.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.824+0000 7ff63afe6740 1 -- 172.21.15.84:0/2253346297 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3cdf5ddf0 con 0x55c3cdbfc9f0 2024-09-21T03:48:30.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.824+0000 7ff62dd9b640 1 --2- 172.21.15.84:0/2253346297 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55c3cdbfc9f0 0x55c3ce002e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:30.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.824+0000 7ff615ffb640 10 client.16563 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:48:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.824+0000 7ff62dd9b640 1 --2- 172.21.15.84:0/2253346297 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55c3cdbfc9f0 0x55c3ce002e40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7d949a5157ee191e server_cookie=83677a2a6f6f2078 in_seq=0 out_seq=0 2024-09-21T03:48:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.825+0000 7ff615ffb640 1 -- 172.21.15.84:0/2253346297 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c3cdf5ddf0 con 0x55c3cdbfc9f0 2024-09-21T03:48:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.825+0000 7ff615ffb640 10 client.16563 handle_command_reply: tid=0 2024-09-21T03:48:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.825+0000 7ff63afe6740 1 client.16563 shutdown 2024-09-21T03:48:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.825+0000 7ff63afe6740 1 -- 172.21.15.84:0/2253346297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 msgr2=0x55c3cdff0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.825+0000 7ff63afe6740 1 --2- 172.21.15.84:0/2253346297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 0x55c3cdff0cd0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ff620010470 tx=0x7ff6200186f0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.825+0000 7ff63afe6740 1 -- 172.21.15.84:0/2253346297 shutdown_connections 2024-09-21T03:48:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.825+0000 7ff63afe6740 1 --2- 172.21.15.84:0/2253346297 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55c3cdbfc9f0 0x55c3ce002e40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.825+0000 7ff63afe6740 1 --2- 172.21.15.84:0/2253346297 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdc3e070 0x55c3cdff1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.825+0000 7ff63afe6740 1 --2- 172.21.15.84:0/2253346297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdc1d390 0x55c3cdff1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.825+0000 7ff63afe6740 1 --2- 172.21.15.84:0/2253346297 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 0x55c3cdff0cd0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.825+0000 7ff615ffb640 0 client.16563 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:48:30.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.825+0000 7ff63afe6740 1 -- 172.21.15.84:0/2253346297 >> 172.21.15.84:0/2253346297 conn(0x55c3cdc32460 msgr2=0x55c3cdfe8830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:30.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.826+0000 7ff63afe6740 1 -- 172.21.15.84:0/2253346297 shutdown_connections 2024-09-21T03:48:30.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.826+0000 7ff63afe6740 1 -- 172.21.15.84:0/2253346297 wait complete. 2024-09-21T03:48:30.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.826+0000 7ff63afe6740 20 client.16563 trim_cache size 0 max 16384 2024-09-21T03:48:30.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.838+0000 7ff63afe6740 1 Processor -- start 2024-09-21T03:48:30.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.838+0000 7ff63afe6740 1 -- start start 2024-09-21T03:48:30.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.839+0000 7ff63afe6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdbfc9f0 0x55c3cdfe9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:30.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.839+0000 7ff63afe6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdc151b0 0x55c3cdfe6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:30.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.839+0000 7ff63afe6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc1d390 0x55c3cdfedec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:30.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.839+0000 7ff63afe6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff6301b1e80 con 0x55c3cdc1d390 2024-09-21T03:48:30.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.839+0000 7ff63afe6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff6301af750 con 0x55c3cdbfc9f0 2024-09-21T03:48:30.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.839+0000 7ff63afe6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff6301ad5a0 con 0x55c3cdc151b0 2024-09-21T03:48:30.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.839+0000 7ff62ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc1d390 0x55c3cdfedec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:30.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.839+0000 7ff62ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc1d390 0x55c3cdfedec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43640/0 (socket says 172.21.15.84:43640) 2024-09-21T03:48:30.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.839+0000 7ff62ed9d640 1 -- 172.21.15.84:0/1014541681 learned_addr learned my addr 172.21.15.84:0/1014541681 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:30.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.839+0000 7ff62dd9b640 1 --2- 172.21.15.84:0/1014541681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdc151b0 0x55c3cdfe6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:30.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.839+0000 7ff62e59c640 1 --2- 172.21.15.84:0/1014541681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdbfc9f0 0x55c3cdfe9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:30.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.839+0000 7ff62ed9d640 1 -- 172.21.15.84:0/1014541681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdc151b0 msgr2=0x55c3cdfe6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:30.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.839+0000 7ff62ed9d640 1 --2- 172.21.15.84:0/1014541681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdc151b0 0x55c3cdfe6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.839+0000 7ff62ed9d640 1 -- 172.21.15.84:0/1014541681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdbfc9f0 msgr2=0x55c3cdfe9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:30.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.839+0000 7ff62ed9d640 1 --2- 172.21.15.84:0/1014541681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdbfc9f0 0x55c3cdfe9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.839+0000 7ff62ed9d640 1 -- 172.21.15.84:0/1014541681 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3cdfe8500 con 0x55c3cdc1d390 2024-09-21T03:48:30.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.839+0000 7ff62e59c640 1 --2- 172.21.15.84:0/1014541681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdbfc9f0 0x55c3cdfe9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:48:30.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.839+0000 7ff62ed9d640 1 --2- 172.21.15.84:0/1014541681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc1d390 0x55c3cdfedec0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff628106270 tx=0x7ff62802a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a25ed72f77c2e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:30.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.840+0000 7ff617fff640 1 -- 172.21.15.84:0/1014541681 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6280044d0 con 0x55c3cdc1d390 2024-09-21T03:48:30.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.840+0000 7ff617fff640 1 -- 172.21.15.84:0/1014541681 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff628036040 con 0x55c3cdc1d390 2024-09-21T03:48:30.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.840+0000 7ff617fff640 1 -- 172.21.15.84:0/1014541681 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6280cf010 con 0x55c3cdc1d390 2024-09-21T03:48:30.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.840+0000 7ff63afe6740 1 -- 172.21.15.84:0/1014541681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc1d390 msgr2=0x55c3cdfedec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:30.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.840+0000 7ff63afe6740 1 --2- 172.21.15.84:0/1014541681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc1d390 0x55c3cdfedec0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff628106270 tx=0x7ff62802a8e0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.840+0000 7ff63afe6740 1 -- 172.21.15.84:0/1014541681 shutdown_connections 2024-09-21T03:48:30.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.840+0000 7ff63afe6740 1 --2- 172.21.15.84:0/1014541681 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc1d390 0x55c3cdfedec0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.840+0000 7ff63afe6740 1 --2- 172.21.15.84:0/1014541681 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdc151b0 0x55c3cdfe6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.840+0000 7ff63afe6740 1 --2- 172.21.15.84:0/1014541681 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdbfc9f0 0x55c3cdfe9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.840+0000 7ff63afe6740 1 -- 172.21.15.84:0/1014541681 >> 172.21.15.84:0/1014541681 conn(0x55c3cdc32460 msgr2=0x55c3cdfe66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:30.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.841+0000 7ff63afe6740 1 -- 172.21.15.84:0/1014541681 shutdown_connections 2024-09-21T03:48:30.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.841+0000 7ff63afe6740 1 -- 172.21.15.84:0/1014541681 wait complete. 2024-09-21T03:48:30.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.841+0000 7ff63afe6740 1 -- start start 2024-09-21T03:48:30.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.841+0000 7ff63afe6740 1 Processor -- start 2024-09-21T03:48:30.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.841+0000 7ff63afe6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdbfc9f0 0x55c3ce005ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:30.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.841+0000 7ff63afe6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 0x55c3ce0064d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:30.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.841+0000 7ff63afe6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdc1d390 0x55c3ce06a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:30.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.841+0000 7ff63afe6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff6301adc10 con 0x55c3cdc151b0 2024-09-21T03:48:30.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.841+0000 7ff63afe6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff6301af080 con 0x55c3cdc1d390 2024-09-21T03:48:30.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.841+0000 7ff63afe6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff6301ae2e0 con 0x55c3cdbfc9f0 2024-09-21T03:48:30.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.841+0000 7ff63afe6740 10 client.0 _ll_register_callbacks cb 0x7ff62001b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:48:30.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.841+0000 7ff62dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 0x55c3ce0064d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:30.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.842+0000 7ff62dd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 0x55c3ce0064d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43646/0 (socket says 172.21.15.84:43646) 2024-09-21T03:48:30.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.842+0000 7ff62dd9b640 1 -- 172.21.15.84:0/373277993 learned_addr learned my addr 172.21.15.84:0/373277993 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:30.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.842+0000 7ff62e59c640 1 --2- 172.21.15.84:0/373277993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdbfc9f0 0x55c3ce005ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:30.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.842+0000 7ff62ed9d640 1 --2- 172.21.15.84:0/373277993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdc1d390 0x55c3ce06a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:30.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.842+0000 7ff62dd9b640 1 -- 172.21.15.84:0/373277993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdbfc9f0 msgr2=0x55c3ce005ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:30.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.842+0000 7ff62dd9b640 1 --2- 172.21.15.84:0/373277993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdbfc9f0 0x55c3ce005ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.842+0000 7ff62dd9b640 1 -- 172.21.15.84:0/373277993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdc1d390 msgr2=0x55c3ce06a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:30.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.842+0000 7ff62dd9b640 1 --2- 172.21.15.84:0/373277993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdc1d390 0x55c3ce06a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.842+0000 7ff62dd9b640 1 -- 172.21.15.84:0/373277993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3ce06a6d0 con 0x55c3cdc151b0 2024-09-21T03:48:30.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.842+0000 7ff62e59c640 1 --2- 172.21.15.84:0/373277993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdbfc9f0 0x55c3ce005ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:48:30.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.842+0000 7ff62dd9b640 1 --2- 172.21.15.84:0/373277993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 0x55c3ce0064d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff63006c9f0 tx=0x7ff61800a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad42a0adad7df990 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:30.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.842+0000 7ff615ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:48:30.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.842+0000 7ff615ffb640 1 -- 172.21.15.84:0/373277993 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61802f020 con 0x55c3cdc151b0 2024-09-21T03:48:30.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.842+0000 7ff63afe6740 1 -- 172.21.15.84:0/373277993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff628036040 con 0x55c3cdc151b0 2024-09-21T03:48:30.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.842+0000 7ff615ffb640 1 -- 172.21.15.84:0/373277993 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7ff61802b690 con 0x55c3cdc151b0 2024-09-21T03:48:30.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.842+0000 7ff615ffb640 1 -- 172.21.15.84:0/373277993 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff61803a050 con 0x55c3cdc151b0 2024-09-21T03:48:30.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.842+0000 7ff63afe6740 10 client.16569 fetch_fsmap learned FSMap version 25 2024-09-21T03:48:30.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.842+0000 7ff63afe6740 1 -- 172.21.15.84:0/373277993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c3ce071ac0 con 0x55c3cdc151b0 2024-09-21T03:48:30.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.843+0000 7ff615ffb640 1 -- 172.21.15.84:0/373277993 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff628036040 con 0x55c3cdc151b0 2024-09-21T03:48:30.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.843+0000 7ff615ffb640 1 -- 172.21.15.84:0/373277993 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff618016050 con 0x55c3cdc151b0 2024-09-21T03:48:30.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.843+0000 7ff63afe6740 10 client.16569 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:48:30.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.843+0000 7ff63afe6740 10 client.16569 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:48:30.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.843+0000 7ff63afe6740 20 client.16569 populate_metadata read hostname 'smithi084' 2024-09-21T03:48:30.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.843+0000 7ff63afe6740 1 --2- 172.21.15.84:0/373277993 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55c3cdc3e070 0x55c3ce0742e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:30.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.843+0000 7ff63afe6740 4 client.16569 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:48:30.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.843+0000 7ff63afe6740 1 -- 172.21.15.84:0/373277993 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c3cdf598a0 con 0x55c3cdc3e070 2024-09-21T03:48:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.843+0000 7ff62e59c640 1 --2- 172.21.15.84:0/373277993 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55c3cdc3e070 0x55c3ce0742e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.843+0000 7ff615ffb640 10 client.16569 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:48:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.843+0000 7ff62e59c640 1 --2- 172.21.15.84:0/373277993 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55c3cdc3e070 0x55c3ce0742e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=89ee1a9f367567fc server_cookie=f29dcd8f61d1a4fb in_seq=0 out_seq=0 2024-09-21T03:48:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.844+0000 7ff615ffb640 1 -- 172.21.15.84:0/373277993 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c3cdf598a0 con 0x55c3cdc3e070 2024-09-21T03:48:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.844+0000 7ff615ffb640 10 client.16569 handle_command_reply: tid=0 2024-09-21T03:48:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.844+0000 7ff63afe6740 1 client.16569 shutdown 2024-09-21T03:48:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.844+0000 7ff63afe6740 1 -- 172.21.15.84:0/373277993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 msgr2=0x55c3ce0064d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.844+0000 7ff63afe6740 1 --2- 172.21.15.84:0/373277993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 0x55c3ce0064d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff63006c9f0 tx=0x7ff61800a2b0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.844+0000 7ff63afe6740 1 -- 172.21.15.84:0/373277993 shutdown_connections 2024-09-21T03:48:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.844+0000 7ff63afe6740 1 --2- 172.21.15.84:0/373277993 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55c3cdc3e070 0x55c3ce0742e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.844+0000 7ff63afe6740 1 --2- 172.21.15.84:0/373277993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c3cdc1d390 0x55c3ce06a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.844+0000 7ff63afe6740 1 --2- 172.21.15.84:0/373277993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c3cdc151b0 0x55c3ce0064d0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.844+0000 7ff615ffb640 0 client.16569 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:48:30.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.844+0000 7ff63afe6740 1 --2- 172.21.15.84:0/373277993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c3cdbfc9f0 0x55c3ce005ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.844+0000 7ff63afe6740 1 -- 172.21.15.84:0/373277993 >> 172.21.15.84:0/373277993 conn(0x55c3cdc32460 msgr2=0x55c3cdfe8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:30.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.844+0000 7ff63afe6740 1 -- 172.21.15.84:0/373277993 shutdown_connections 2024-09-21T03:48:30.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.844+0000 7ff63afe6740 1 -- 172.21.15.84:0/373277993 wait complete. 2024-09-21T03:48:30.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.844+0000 7ff63afe6740 20 client.16569 trim_cache size 0 max 16384 2024-09-21T03:48:30.854 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:48:30.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.844+0000 7ff634a72640 1 -- 172.21.15.84:0/2759387691 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff61c0b66b0 msgr2=0x7ff61c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:30.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.844+0000 7ff634a72640 1 --2- 172.21.15.84:0/2759387691 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff61c0b66b0 0x7ff61c0b8bc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff630109040 tx=0x7ff618006f90 comp rx=0 tx=0).stop 2024-09-21T03:48:30.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.844+0000 7ff634a72640 1 -- 172.21.15.84:0/2759387691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff630109df0 msgr2=0x7ff63019fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:30.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.845+0000 7ff634a72640 1 --2- 172.21.15.84:0/2759387691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff630109df0 0x7ff63019fce0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff628005cc0 tx=0x7ff628003ba0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.845+0000 7ff634a72640 1 -- 172.21.15.84:0/2759387691 shutdown_connections 2024-09-21T03:48:30.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.845+0000 7ff634a72640 1 --2- 172.21.15.84:0/2759387691 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff61c0b66b0 0x7ff61c0b8bc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.845+0000 7ff634a72640 1 --2- 172.21.15.84:0/2759387691 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff630109df0 0x7ff63019fce0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.845+0000 7ff634a72640 1 --2- 172.21.15.84:0/2759387691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6301094a0 0x7ff63019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.845+0000 7ff634a72640 1 --2- 172.21.15.84:0/2759387691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff630103b60 0x7ff63019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:30.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.845+0000 7ff634a72640 1 -- 172.21.15.84:0/2759387691 >> 172.21.15.84:0/2759387691 conn(0x7ff63007b850 msgr2=0x7ff6301074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:30.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.845+0000 7ff634a72640 1 -- 172.21.15.84:0/2759387691 shutdown_connections 2024-09-21T03:48:30.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:30.845+0000 7ff634a72640 1 -- 172.21.15.84:0/2759387691 wait complete. 2024-09-21T03:48:30.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:30 smithi174 ceph-mon[34403]: pgmap v505: 97 pgs: 97 active+clean; 9.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-21T03:48:30.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:30 smithi172 ceph-mon[34821]: pgmap v505: 97 pgs: 97 active+clean; 9.1 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-21T03:48:31.542 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:48:31.786 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:48:32.333 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.323+0000 7fa3fc27e640 1 -- 172.21.15.84:0/446823537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3f4102a70 msgr2=0x7fa3f4102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:32.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.323+0000 7fa3fc27e640 1 --2- 172.21.15.84:0/446823537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3f4102a70 0x7fa3f4102e80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0009900 tx=0x7fa3f002a410 comp rx=0 tx=0).stop 2024-09-21T03:48:32.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.323+0000 7fa3fc27e640 1 -- 172.21.15.84:0/446823537 shutdown_connections 2024-09-21T03:48:32.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.323+0000 7fa3fc27e640 1 --2- 172.21.15.84:0/446823537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f4108d00 0x7fa3f410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.323+0000 7fa3fc27e640 1 --2- 172.21.15.84:0/446823537 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3f41083b0 0x7fa3f41087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.323+0000 7fa3fc27e640 1 --2- 172.21.15.84:0/446823537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3f4102a70 0x7fa3f4102e80 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.323+0000 7fa3fc27e640 1 -- 172.21.15.84:0/446823537 >> 172.21.15.84:0/446823537 conn(0x7fa3f4079710 msgr2=0x7fa3f4079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:32.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.323+0000 7fa3fc27e640 1 -- 172.21.15.84:0/446823537 shutdown_connections 2024-09-21T03:48:32.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.323+0000 7fa3fc27e640 1 -- 172.21.15.84:0/446823537 wait complete. 2024-09-21T03:48:32.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.324+0000 7fa3fc27e640 1 Processor -- start 2024-09-21T03:48:32.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.324+0000 7fa3fc27e640 1 -- start start 2024-09-21T03:48:32.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.324+0000 7fa3fc27e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3f4102a70 0x7fa3f40ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:32.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.324+0000 7fa3fc27e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3f41083b0 0x7fa3f40ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:32.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.324+0000 7fa3fc27e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f4108d00 0x7fa3f4100070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:32.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.324+0000 7fa3fc27e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f4112a20 con 0x7fa3f4102a70 2024-09-21T03:48:32.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.324+0000 7fa3fc27e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f41128a0 con 0x7fa3f4108d00 2024-09-21T03:48:32.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.324+0000 7fa3fc27e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f4112ba0 con 0x7fa3f41083b0 2024-09-21T03:48:32.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.324+0000 7fa3fa01a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3f4102a70 0x7fa3f40ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:32.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.324+0000 7fa3fa01a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3f4102a70 0x7fa3f40ff5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43672/0 (socket says 172.21.15.84:43672) 2024-09-21T03:48:32.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.324+0000 7fa3fa01a640 1 -- 172.21.15.84:0/703410002 learned_addr learned my addr 172.21.15.84:0/703410002 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:32.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.324+0000 7fa3fa81b640 1 --2- 172.21.15.84:0/703410002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f4108d00 0x7fa3f4100070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:32.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.324+0000 7fa3f9819640 1 --2- 172.21.15.84:0/703410002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3f41083b0 0x7fa3f40ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:32.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.324+0000 7fa3fa01a640 1 -- 172.21.15.84:0/703410002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3f41083b0 msgr2=0x7fa3f40ffb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:32.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.324+0000 7fa3fa01a640 1 --2- 172.21.15.84:0/703410002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3f41083b0 0x7fa3f40ffb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.324+0000 7fa3fa01a640 1 -- 172.21.15.84:0/703410002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f4108d00 msgr2=0x7fa3f4100070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:32.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.324+0000 7fa3fa01a640 1 --2- 172.21.15.84:0/703410002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f4108d00 0x7fa3f4100070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.324+0000 7fa3fa01a640 1 -- 172.21.15.84:0/703410002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f41a87e0 con 0x7fa3f4102a70 2024-09-21T03:48:32.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.324+0000 7fa3fa81b640 1 --2- 172.21.15.84:0/703410002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f4108d00 0x7fa3f4100070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:48:32.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.324+0000 7fa3f9819640 1 --2- 172.21.15.84:0/703410002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3f41083b0 0x7fa3f40ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:48:32.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.325+0000 7fa3fa01a640 1 --2- 172.21.15.84:0/703410002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3f4102a70 0x7fa3f40ff5f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0005940 tx=0x7fa3f00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:32.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.325+0000 7fa3eb7fe640 1 -- 172.21.15.84:0/703410002 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f003f030 con 0x7fa3f4102a70 2024-09-21T03:48:32.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.325+0000 7fa3eb7fe640 1 -- 172.21.15.84:0/703410002 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3f0003cb0 con 0x7fa3f4102a70 2024-09-21T03:48:32.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.325+0000 7fa3fc27e640 1 -- 172.21.15.84:0/703410002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f41a8a70 con 0x7fa3f4102a70 2024-09-21T03:48:32.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.325+0000 7fa3eb7fe640 1 -- 172.21.15.84:0/703410002 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0035070 con 0x7fa3f4102a70 2024-09-21T03:48:32.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.325+0000 7fa3fc27e640 1 -- 172.21.15.84:0/703410002 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f41a8fd0 con 0x7fa3f4102a70 2024-09-21T03:48:32.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.327+0000 7fa4027f2740 1 Processor -- start 2024-09-21T03:48:32.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.328+0000 7fa4027f2740 1 -- start start 2024-09-21T03:48:32.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.328+0000 7fa3eb7fe640 1 -- 172.21.15.84:0/703410002 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fa3f0042030 con 0x7fa3f4102a70 2024-09-21T03:48:32.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.328+0000 7fa4027f2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559317716070 0x559317abd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:32.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.328+0000 7fa4027f2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5593176ed1b0 0x559317abdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:32.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.328+0000 7fa4027f2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593176f5390 0x559317abe120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:32.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.328+0000 7fa4027f2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559317a33ea0 con 0x5593176ed1b0 2024-09-21T03:48:32.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.328+0000 7fa4027f2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559317a232d0 con 0x559317716070 2024-09-21T03:48:32.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.328+0000 7fa4027f2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559317a270e0 con 0x5593176f5390 2024-09-21T03:48:32.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.328+0000 7fa3fa01a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5593176ed1b0 0x559317abdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:32.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.328+0000 7fa3fa01a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5593176ed1b0 0x559317abdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43678/0 (socket says 172.21.15.84:43678) 2024-09-21T03:48:32.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.328+0000 7fa3fa01a640 1 -- 172.21.15.84:0/3504828762 learned_addr learned my addr 172.21.15.84:0/3504828762 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:32.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.328+0000 7fa3fa81b640 1 --2- 172.21.15.84:0/3504828762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559317716070 0x559317abd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:32.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.328+0000 7fa3f9819640 1 --2- 172.21.15.84:0/3504828762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593176f5390 0x559317abe120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:32.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.328+0000 7fa3fa01a640 1 -- 172.21.15.84:0/3504828762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593176f5390 msgr2=0x559317abe120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:32.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.328+0000 7fa3fa01a640 1 --2- 172.21.15.84:0/3504828762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593176f5390 0x559317abe120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.328+0000 7fa3fa01a640 1 -- 172.21.15.84:0/3504828762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559317716070 msgr2=0x559317abd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:32.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.328+0000 7fa3fa01a640 1 --2- 172.21.15.84:0/3504828762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559317716070 0x559317abd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.328+0000 7fa3fa01a640 1 -- 172.21.15.84:0/3504828762 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559317781650 con 0x5593176ed1b0 2024-09-21T03:48:32.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.329+0000 7fa3fa01a640 1 --2- 172.21.15.84:0/3504828762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5593176ed1b0 0x559317abdbe0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0105710 tx=0x7fa3f0110320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46062952e4ee77c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:32.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.329+0000 7fa3e8d9a640 1 -- 172.21.15.84:0/3504828762 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0110980 con 0x5593176ed1b0 2024-09-21T03:48:32.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.329+0000 7fa3e8d9a640 1 -- 172.21.15.84:0/3504828762 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3f0115030 con 0x5593176ed1b0 2024-09-21T03:48:32.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.329+0000 7fa3e8d9a640 1 -- 172.21.15.84:0/3504828762 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0108cd0 con 0x5593176ed1b0 2024-09-21T03:48:32.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.329+0000 7fa3eb7fe640 1 --2- 172.21.15.84:0/703410002 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa3e00b6680 0x7fa3e00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:32.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.329+0000 7fa3fa81b640 1 --2- 172.21.15.84:0/703410002 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa3e00b6680 0x7fa3e00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:32.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.329+0000 7fa3eb7fe640 1 -- 172.21.15.84:0/703410002 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa3f0108060 con 0x7fa3f4102a70 2024-09-21T03:48:32.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.330+0000 7fa4027f2740 1 -- 172.21.15.84:0/3504828762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5593176ed1b0 msgr2=0x559317abdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:32.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.330+0000 7fa3fa81b640 1 --2- 172.21.15.84:0/703410002 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa3e00b6680 0x7fa3e00b8b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec00c610 tx=0x7fa3ec00e040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:32.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.330+0000 7fa4027f2740 1 --2- 172.21.15.84:0/3504828762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5593176ed1b0 0x559317abdbe0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0105710 tx=0x7fa3f0110320 comp rx=0 tx=0).stop 2024-09-21T03:48:32.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.330+0000 7fa4027f2740 1 -- 172.21.15.84:0/3504828762 shutdown_connections 2024-09-21T03:48:32.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.330+0000 7fa4027f2740 1 --2- 172.21.15.84:0/3504828762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593176f5390 0x559317abe120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.330+0000 7fa4027f2740 1 --2- 172.21.15.84:0/3504828762 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5593176ed1b0 0x559317abdbe0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.330+0000 7fa4027f2740 1 --2- 172.21.15.84:0/3504828762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559317716070 0x559317abd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.330+0000 7fa4027f2740 1 -- 172.21.15.84:0/3504828762 >> 172.21.15.84:0/3504828762 conn(0x55931770a460 msgr2=0x559317abb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:32.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.330+0000 7fa4027f2740 1 -- 172.21.15.84:0/3504828762 shutdown_connections 2024-09-21T03:48:32.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.330+0000 7fa4027f2740 1 -- 172.21.15.84:0/3504828762 wait complete. 2024-09-21T03:48:32.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.330+0000 7fa4027f2740 1 -- start start 2024-09-21T03:48:32.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.330+0000 7fa4027f2740 1 Processor -- start 2024-09-21T03:48:32.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.331+0000 7fa4027f2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593176ed1b0 0x559317ac8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:32.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.331+0000 7fa4027f2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593176f5390 0x559317ac92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:32.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.331+0000 7fa4027f2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559317716070 0x559317ad4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:32.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.331+0000 7fa4027f2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559317884700 con 0x559317716070 2024-09-21T03:48:32.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.331+0000 7fa4027f2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5593179be160 con 0x5593176ed1b0 2024-09-21T03:48:32.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.331+0000 7fa4027f2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559317acbc40 con 0x5593176f5390 2024-09-21T03:48:32.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.331+0000 7fa4027f2740 10 client.0 _ll_register_callbacks cb 0x5593179d79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:48:32.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.331+0000 7fa3fa81b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559317716070 0x559317ad4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:32.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.331+0000 7fa3fa81b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559317716070 0x559317ad4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43686/0 (socket says 172.21.15.84:43686) 2024-09-21T03:48:32.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.331+0000 7fa3fa81b640 1 -- 172.21.15.84:0/1894436124 learned_addr learned my addr 172.21.15.84:0/1894436124 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:32.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.331+0000 7fa3f9819640 1 --2- 172.21.15.84:0/1894436124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593176f5390 0x559317ac92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:32.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.331+0000 7fa3fa01a640 1 --2- 172.21.15.84:0/1894436124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593176ed1b0 0x559317ac8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:32.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.331+0000 7fa3fa81b640 1 -- 172.21.15.84:0/1894436124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593176f5390 msgr2=0x559317ac92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:32.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.331+0000 7fa3fa81b640 1 --2- 172.21.15.84:0/1894436124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593176f5390 0x559317ac92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.331+0000 7fa3fa81b640 1 -- 172.21.15.84:0/1894436124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593176ed1b0 msgr2=0x559317ac8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:32.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.331+0000 7fa3fa81b640 1 --2- 172.21.15.84:0/1894436124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593176ed1b0 0x559317ac8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.331+0000 7fa3fa81b640 1 -- 172.21.15.84:0/1894436124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593179ebc90 con 0x559317716070 2024-09-21T03:48:32.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.332+0000 7fa3fa81b640 1 --2- 172.21.15.84:0/1894436124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559317716070 0x559317ad4ea0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec007da0 tx=0x7fa3ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40675044fbf189f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:32.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.332+0000 7fa3ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:48:32.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.332+0000 7fa3ddffb640 1 -- 172.21.15.84:0/1894436124 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec01e040 con 0x559317716070 2024-09-21T03:48:32.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.332+0000 7fa3ddffb640 1 -- 172.21.15.84:0/1894436124 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa3ec022420 con 0x559317716070 2024-09-21T03:48:32.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.332+0000 7fa4027f2740 1 -- 172.21.15.84:0/1894436124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3f0115030 con 0x559317716070 2024-09-21T03:48:32.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.332+0000 7fa3ddffb640 1 -- 172.21.15.84:0/1894436124 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa3ec022620 con 0x559317716070 2024-09-21T03:48:32.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.332+0000 7fa4027f2740 10 client.16581 fetch_fsmap learned FSMap version 25 2024-09-21T03:48:32.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.332+0000 7fa4027f2740 1 -- 172.21.15.84:0/1894436124 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559317ad7920 con 0x559317716070 2024-09-21T03:48:32.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.332+0000 7fa3ddffb640 1 -- 172.21.15.84:0/1894436124 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3f0115030 con 0x559317716070 2024-09-21T03:48:32.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.332+0000 7fa3ddffb640 1 -- 172.21.15.84:0/1894436124 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa3ec02b810 con 0x559317716070 2024-09-21T03:48:32.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.332+0000 7fa4027f2740 10 client.16581 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:48:32.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.332+0000 7fa4027f2740 10 client.16581 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:48:32.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.332+0000 7fa4027f2740 20 client.16581 populate_metadata read hostname 'smithi084' 2024-09-21T03:48:32.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.332+0000 7fa4027f2740 1 --2- 172.21.15.84:0/1894436124 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5593176d49f0 0x559317adae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:32.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.332+0000 7fa4027f2740 4 client.16581 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:48:32.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.332+0000 7fa4027f2740 1 -- 172.21.15.84:0/1894436124 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559317a35df0 con 0x5593176d49f0 2024-09-21T03:48:32.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.333+0000 7fa3fa01a640 1 --2- 172.21.15.84:0/1894436124 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5593176d49f0 0x559317adae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:32.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.333+0000 7fa3ddffb640 10 client.16581 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:48:32.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.333+0000 7fa3fa01a640 1 --2- 172.21.15.84:0/1894436124 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5593176d49f0 0x559317adae60 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cb0ea9593305982 server_cookie=d79bd97213559e9a in_seq=0 out_seq=0 2024-09-21T03:48:32.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.334+0000 7fa3ddffb640 1 -- 172.21.15.84:0/1894436124 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559317a35df0 con 0x5593176d49f0 2024-09-21T03:48:32.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.334+0000 7fa3ddffb640 10 client.16581 handle_command_reply: tid=0 2024-09-21T03:48:32.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.334+0000 7fa4027f2740 1 client.16581 shutdown 2024-09-21T03:48:32.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.334+0000 7fa4027f2740 1 -- 172.21.15.84:0/1894436124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559317716070 msgr2=0x559317ad4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:32.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.334+0000 7fa4027f2740 1 --2- 172.21.15.84:0/1894436124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559317716070 0x559317ad4ea0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec007da0 tx=0x7fa3ec004a40 comp rx=0 tx=0).stop 2024-09-21T03:48:32.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.334+0000 7fa4027f2740 1 -- 172.21.15.84:0/1894436124 shutdown_connections 2024-09-21T03:48:32.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.334+0000 7fa4027f2740 1 --2- 172.21.15.84:0/1894436124 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5593176d49f0 0x559317adae60 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.334+0000 7fa4027f2740 1 --2- 172.21.15.84:0/1894436124 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559317716070 0x559317ad4ea0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.334+0000 7fa4027f2740 1 --2- 172.21.15.84:0/1894436124 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593176f5390 0x559317ac92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.334+0000 7fa4027f2740 1 --2- 172.21.15.84:0/1894436124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593176ed1b0 0x559317ac8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.334+0000 7fa4027f2740 1 -- 172.21.15.84:0/1894436124 >> 172.21.15.84:0/1894436124 conn(0x55931770a460 msgr2=0x559317ac0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:32.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.334+0000 7fa3ddffb640 0 client.16581 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:48:32.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.334+0000 7fa4027f2740 1 -- 172.21.15.84:0/1894436124 shutdown_connections 2024-09-21T03:48:32.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.334+0000 7fa4027f2740 1 -- 172.21.15.84:0/1894436124 wait complete. 2024-09-21T03:48:32.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.334+0000 7fa4027f2740 20 client.16581 trim_cache size 0 max 16384 2024-09-21T03:48:32.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.347+0000 7fa4027f2740 1 Processor -- start 2024-09-21T03:48:32.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.347+0000 7fa4027f2740 1 -- start start 2024-09-21T03:48:32.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.347+0000 7fa4027f2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593176ed1b0 0x559317abf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:32.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.347+0000 7fa4027f2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593176f5390 0x559317acac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:32.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.347+0000 7fa4027f2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559317716070 0x559317ad4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:32.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.347+0000 7fa4027f2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f41b4180 con 0x559317716070 2024-09-21T03:48:32.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.347+0000 7fa4027f2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f41b1a50 con 0x5593176ed1b0 2024-09-21T03:48:32.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.347+0000 7fa4027f2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f41af8a0 con 0x5593176f5390 2024-09-21T03:48:32.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.348+0000 7fa3fa81b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559317716070 0x559317ad4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:32.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.348+0000 7fa3fa81b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559317716070 0x559317ad4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43694/0 (socket says 172.21.15.84:43694) 2024-09-21T03:48:32.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.348+0000 7fa3fa81b640 1 -- 172.21.15.84:0/685687208 learned_addr learned my addr 172.21.15.84:0/685687208 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:32.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.348+0000 7fa3fa81b640 1 -- 172.21.15.84:0/685687208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593176f5390 msgr2=0x559317acac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:32.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.348+0000 7fa3fa81b640 1 --2- 172.21.15.84:0/685687208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593176f5390 0x559317acac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.348+0000 7fa3fa81b640 1 -- 172.21.15.84:0/685687208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593176ed1b0 msgr2=0x559317abf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:32.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.348+0000 7fa3fa01a640 1 --2- 172.21.15.84:0/685687208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593176ed1b0 0x559317abf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:32.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.348+0000 7fa3fa81b640 1 --2- 172.21.15.84:0/685687208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593176ed1b0 0x559317abf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.348+0000 7fa3fa81b640 1 -- 172.21.15.84:0/685687208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559317acb930 con 0x559317716070 2024-09-21T03:48:32.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.348+0000 7fa3fa01a640 1 --2- 172.21.15.84:0/685687208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593176ed1b0 0x559317abf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:48:32.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.348+0000 7fa3fa81b640 1 --2- 172.21.15.84:0/685687208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559317716070 0x559317ad4da0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec00cf40 tx=0x7fa3ec009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d3cc8e7ee6c213 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:32.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.348+0000 7fa3dffff640 1 -- 172.21.15.84:0/685687208 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec039020 con 0x559317716070 2024-09-21T03:48:32.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.348+0000 7fa3dffff640 1 -- 172.21.15.84:0/685687208 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3ec027070 con 0x559317716070 2024-09-21T03:48:32.352 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.348+0000 7fa3dffff640 1 -- 172.21.15.84:0/685687208 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec01e070 con 0x559317716070 2024-09-21T03:48:32.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.349+0000 7fa4027f2740 1 -- 172.21.15.84:0/685687208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559317716070 msgr2=0x559317ad4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:32.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.349+0000 7fa4027f2740 1 --2- 172.21.15.84:0/685687208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559317716070 0x559317ad4da0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec00cf40 tx=0x7fa3ec009d70 comp rx=0 tx=0).stop 2024-09-21T03:48:32.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.349+0000 7fa4027f2740 1 -- 172.21.15.84:0/685687208 shutdown_connections 2024-09-21T03:48:32.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.349+0000 7fa4027f2740 1 --2- 172.21.15.84:0/685687208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559317716070 0x559317ad4da0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.349+0000 7fa4027f2740 1 --2- 172.21.15.84:0/685687208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593176f5390 0x559317acac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.349+0000 7fa4027f2740 1 --2- 172.21.15.84:0/685687208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593176ed1b0 0x559317abf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.349+0000 7fa4027f2740 1 -- 172.21.15.84:0/685687208 >> 172.21.15.84:0/685687208 conn(0x55931770a460 msgr2=0x559317ac27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:32.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.349+0000 7fa4027f2740 1 -- 172.21.15.84:0/685687208 shutdown_connections 2024-09-21T03:48:32.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.349+0000 7fa4027f2740 1 -- 172.21.15.84:0/685687208 wait complete. 2024-09-21T03:48:32.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.349+0000 7fa4027f2740 1 -- start start 2024-09-21T03:48:32.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.349+0000 7fa4027f2740 1 Processor -- start 2024-09-21T03:48:32.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa4027f2740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5593176ed1b0 0x559317ad1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:32.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa4027f2740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593176f5390 0x559317accb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:32.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa4027f2740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559317716070 0x559317acd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:32.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa4027f2740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f41aff10 con 0x5593176ed1b0 2024-09-21T03:48:32.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa4027f2740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f41b1380 con 0x559317716070 2024-09-21T03:48:32.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa4027f2740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f41b05e0 con 0x5593176f5390 2024-09-21T03:48:32.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa4027f2740 10 client.0 _ll_register_callbacks cb 0x7fa3ec01b040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:48:32.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa3fa01a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5593176ed1b0 0x559317ad1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:32.356 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa3fa01a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5593176ed1b0 0x559317ad1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43710/0 (socket says 172.21.15.84:43710) 2024-09-21T03:48:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa3fa01a640 1 -- 172.21.15.84:0/2035441173 learned_addr learned my addr 172.21.15.84:0/2035441173 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa3f9819640 1 --2- 172.21.15.84:0/2035441173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593176f5390 0x559317accb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa3fa81b640 1 --2- 172.21.15.84:0/2035441173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559317716070 0x559317acd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa3fa01a640 1 -- 172.21.15.84:0/2035441173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593176f5390 msgr2=0x559317accb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa3fa01a640 1 --2- 172.21.15.84:0/2035441173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593176f5390 0x559317accb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa3fa01a640 1 -- 172.21.15.84:0/2035441173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559317716070 msgr2=0x559317acd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa3fa01a640 1 --2- 172.21.15.84:0/2035441173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559317716070 0x559317acd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa3fa01a640 1 -- 172.21.15.84:0/2035441173 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559317acd830 con 0x5593176ed1b0 2024-09-21T03:48:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa3fa81b640 1 --2- 172.21.15.84:0/2035441173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559317716070 0x559317acd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:48:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa3f9819640 1 --2- 172.21.15.84:0/2035441173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593176f5390 0x559317accb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:48:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa3fa01a640 1 --2- 172.21.15.84:0/2035441173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5593176ed1b0 0x559317ad1620 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00cb140 tx=0x7fa3f0032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d89bacd046e32c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.350+0000 7fa3ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:48:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.351+0000 7fa3ddffb640 1 -- 172.21.15.84:0/2035441173 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0049040 con 0x5593176ed1b0 2024-09-21T03:48:32.357 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.351+0000 7fa3ddffb640 1 -- 172.21.15.84:0/2035441173 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7fa3f010bd00 con 0x5593176ed1b0 2024-09-21T03:48:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.351+0000 7fa4027f2740 1 -- 172.21.15.84:0/2035441173 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3ec027070 con 0x5593176ed1b0 2024-09-21T03:48:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.351+0000 7fa3ddffb640 1 -- 172.21.15.84:0/2035441173 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa3f00c9d70 con 0x5593176ed1b0 2024-09-21T03:48:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.351+0000 7fa4027f2740 10 client.16587 fetch_fsmap learned FSMap version 25 2024-09-21T03:48:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.351+0000 7fa4027f2740 1 -- 172.21.15.84:0/2035441173 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559317b45710 con 0x5593176ed1b0 2024-09-21T03:48:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.351+0000 7fa3ddffb640 1 -- 172.21.15.84:0/2035441173 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3ec027070 con 0x5593176ed1b0 2024-09-21T03:48:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.351+0000 7fa3ddffb640 1 -- 172.21.15.84:0/2035441173 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa3f00ca140 con 0x5593176ed1b0 2024-09-21T03:48:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.351+0000 7fa4027f2740 10 client.16587 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:48:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.351+0000 7fa4027f2740 10 client.16587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:48:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.351+0000 7fa4027f2740 20 client.16587 populate_metadata read hostname 'smithi084' 2024-09-21T03:48:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.351+0000 7fa4027f2740 1 --2- 172.21.15.84:0/2035441173 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5593176a9da0 0x559317b47d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.351+0000 7fa4027f2740 4 client.16587 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:48:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.351+0000 7fa4027f2740 1 -- 172.21.15.84:0/2035441173 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559317a318a0 con 0x5593176a9da0 2024-09-21T03:48:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.352+0000 7fa3f9819640 1 --2- 172.21.15.84:0/2035441173 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5593176a9da0 0x559317b47d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:32.358 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.352+0000 7fa3ddffb640 10 client.16587 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:48:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.352+0000 7fa3f9819640 1 --2- 172.21.15.84:0/2035441173 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5593176a9da0 0x559317b47d90 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dfb56f768287c82 server_cookie=b03290ebcec96a25 in_seq=0 out_seq=0 2024-09-21T03:48:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.352+0000 7fa3ddffb640 1 -- 172.21.15.84:0/2035441173 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559317a318a0 con 0x5593176a9da0 2024-09-21T03:48:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.352+0000 7fa3ddffb640 10 client.16587 handle_command_reply: tid=0 2024-09-21T03:48:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.352+0000 7fa4027f2740 1 client.16587 shutdown 2024-09-21T03:48:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.352+0000 7fa4027f2740 1 -- 172.21.15.84:0/2035441173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5593176ed1b0 msgr2=0x559317ad1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.352+0000 7fa4027f2740 1 --2- 172.21.15.84:0/2035441173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5593176ed1b0 0x559317ad1620 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00cb140 tx=0x7fa3f0032f60 comp rx=0 tx=0).stop 2024-09-21T03:48:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.352+0000 7fa4027f2740 1 -- 172.21.15.84:0/2035441173 shutdown_connections 2024-09-21T03:48:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.352+0000 7fa4027f2740 1 --2- 172.21.15.84:0/2035441173 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5593176a9da0 0x559317b47d90 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.352+0000 7fa4027f2740 1 --2- 172.21.15.84:0/2035441173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559317716070 0x559317acd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.352+0000 7fa4027f2740 1 --2- 172.21.15.84:0/2035441173 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593176f5390 0x559317accb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.352+0000 7fa4027f2740 1 --2- 172.21.15.84:0/2035441173 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5593176ed1b0 0x559317ad1620 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.352+0000 7fa4027f2740 1 -- 172.21.15.84:0/2035441173 >> 172.21.15.84:0/2035441173 conn(0x55931770a460 msgr2=0x559317ac27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.352+0000 7fa3ddffb640 0 client.16587 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:48:32.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.353+0000 7fa4027f2740 1 -- 172.21.15.84:0/2035441173 shutdown_connections 2024-09-21T03:48:32.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.353+0000 7fa4027f2740 1 -- 172.21.15.84:0/2035441173 wait complete. 2024-09-21T03:48:32.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.353+0000 7fa4027f2740 20 client.16587 trim_cache size 0 max 16384 2024-09-21T03:48:32.360 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:48:32.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.353+0000 7fa3fc27e640 1 -- 172.21.15.84:0/703410002 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa3e00b6680 msgr2=0x7fa3e00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:32.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.353+0000 7fa3fc27e640 1 --2- 172.21.15.84:0/703410002 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa3e00b6680 0x7fa3e00b8b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec00c610 tx=0x7fa3ec00e040 comp rx=0 tx=0).stop 2024-09-21T03:48:32.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.353+0000 7fa3fc27e640 1 -- 172.21.15.84:0/703410002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3f4102a70 msgr2=0x7fa3f40ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:32.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.353+0000 7fa3fc27e640 1 --2- 172.21.15.84:0/703410002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3f4102a70 0x7fa3f40ff5f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0005940 tx=0x7fa3f00042f0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.353+0000 7fa3fc27e640 1 -- 172.21.15.84:0/703410002 shutdown_connections 2024-09-21T03:48:32.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.353+0000 7fa3fc27e640 1 --2- 172.21.15.84:0/703410002 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa3e00b6680 0x7fa3e00b8b90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.353+0000 7fa3fc27e640 1 --2- 172.21.15.84:0/703410002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3f4108d00 0x7fa3f4100070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.353+0000 7fa3fc27e640 1 --2- 172.21.15.84:0/703410002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3f41083b0 0x7fa3f40ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.353+0000 7fa3fc27e640 1 --2- 172.21.15.84:0/703410002 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa3f4102a70 0x7fa3f40ff5f0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:32.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.353+0000 7fa3fc27e640 1 -- 172.21.15.84:0/703410002 >> 172.21.15.84:0/703410002 conn(0x7fa3f4079710 msgr2=0x7fa3f4101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:32.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.353+0000 7fa3fc27e640 1 -- 172.21.15.84:0/703410002 shutdown_connections 2024-09-21T03:48:32.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:32.353+0000 7fa3fc27e640 1 -- 172.21.15.84:0/703410002 wait complete. 2024-09-21T03:48:32.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:32 smithi084 ceph-mon[30941]: pgmap v506: 97 pgs: 97 active+clean; 9.3 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-09-21T03:48:32.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:32 smithi174 ceph-mon[34403]: pgmap v506: 97 pgs: 97 active+clean; 9.3 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-09-21T03:48:32.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:32 smithi172 ceph-mon[34821]: pgmap v506: 97 pgs: 97 active+clean; 9.3 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 13 op/s 2024-09-21T03:48:34.065 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:48:34.065 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:48:34.322 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:48:34.739 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:34 smithi084 ceph-mon[30941]: pgmap v507: 97 pgs: 97 active+clean; 9.3 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 10 op/s 2024-09-21T03:48:34.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.828+0000 7f4e8eb30640 1 -- 172.21.15.84:0/165740059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e88102a60 msgr2=0x7f4e88102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:34.848 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.828+0000 7f4e8eb30640 1 --2- 172.21.15.84:0/165740059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e88102a60 0x7f4e88102e70 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c009900 tx=0x7f4e7c02a410 comp rx=0 tx=0).stop 2024-09-21T03:48:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.829+0000 7f4e8eb30640 1 -- 172.21.15.84:0/165740059 shutdown_connections 2024-09-21T03:48:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.829+0000 7f4e8eb30640 1 --2- 172.21.15.84:0/165740059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e88108cf0 0x7f4e8810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.829+0000 7f4e8eb30640 1 --2- 172.21.15.84:0/165740059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e881083a0 0x7f4e881087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.829+0000 7f4e8eb30640 1 --2- 172.21.15.84:0/165740059 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e88102a60 0x7f4e88102e70 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.829+0000 7f4e8eb30640 1 -- 172.21.15.84:0/165740059 >> 172.21.15.84:0/165740059 conn(0x7f4e88079720 msgr2=0x7f4e88079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.829+0000 7f4e8eb30640 1 -- 172.21.15.84:0/165740059 shutdown_connections 2024-09-21T03:48:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.829+0000 7f4e8eb30640 1 -- 172.21.15.84:0/165740059 wait complete. 2024-09-21T03:48:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.829+0000 7f4e8eb30640 1 Processor -- start 2024-09-21T03:48:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.829+0000 7f4e8eb30640 1 -- start start 2024-09-21T03:48:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.830+0000 7f4e8eb30640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e88102a60 0x7f4e8819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.830+0000 7f4e8eb30640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e881083a0 0x7f4e8819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.830+0000 7f4e8eb30640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e88108cf0 0x7f4e8819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.830+0000 7f4e8eb30640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4e88112960 con 0x7f4e88108cf0 2024-09-21T03:48:34.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.830+0000 7f4e8eb30640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4e881127e0 con 0x7f4e881083a0 2024-09-21T03:48:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.830+0000 7f4e8eb30640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4e88112ae0 con 0x7f4e88102a60 2024-09-21T03:48:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.830+0000 7f4e8d0cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e88108cf0 0x7f4e8819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.830+0000 7f4e8d0cd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e88108cf0 0x7f4e8819fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43728/0 (socket says 172.21.15.84:43728) 2024-09-21T03:48:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.830+0000 7f4e8d0cd640 1 -- 172.21.15.84:0/1891655892 learned_addr learned my addr 172.21.15.84:0/1891655892 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.830+0000 7f4e87fff640 1 --2- 172.21.15.84:0/1891655892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e881083a0 0x7f4e8819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.830+0000 7f4e8c8cc640 1 --2- 172.21.15.84:0/1891655892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e88102a60 0x7f4e8819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.830+0000 7f4e8d0cd640 1 -- 172.21.15.84:0/1891655892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e88102a60 msgr2=0x7f4e8819a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.830+0000 7f4e8d0cd640 1 --2- 172.21.15.84:0/1891655892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e88102a60 0x7f4e8819a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.830+0000 7f4e8d0cd640 1 -- 172.21.15.84:0/1891655892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e881083a0 msgr2=0x7f4e8819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.830+0000 7f4e8d0cd640 1 --2- 172.21.15.84:0/1891655892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e881083a0 0x7f4e8819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.830+0000 7f4e8d0cd640 1 -- 172.21.15.84:0/1891655892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e881a03d0 con 0x7f4e88108cf0 2024-09-21T03:48:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.830+0000 7f4e8d0cd640 1 --2- 172.21.15.84:0/1891655892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e88108cf0 0x7f4e8819fca0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000eaa0 tx=0x7f4e8000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:34.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.831+0000 7f4e85ffb640 1 -- 172.21.15.84:0/1891655892 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8000cdb0 con 0x7f4e88108cf0 2024-09-21T03:48:34.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.831+0000 7f4e85ffb640 1 -- 172.21.15.84:0/1891655892 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e80005020 con 0x7f4e88108cf0 2024-09-21T03:48:34.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.831+0000 7f4e8eb30640 1 -- 172.21.15.84:0/1891655892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e881a06c0 con 0x7f4e88108cf0 2024-09-21T03:48:34.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.831+0000 7f4e85ffb640 1 -- 172.21.15.84:0/1891655892 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e800116d0 con 0x7f4e88108cf0 2024-09-21T03:48:34.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.831+0000 7f4e8eb30640 1 -- 172.21.15.84:0/1891655892 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e881a6e20 con 0x7f4e88108cf0 2024-09-21T03:48:34.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.834+0000 7f4e950a4740 1 Processor -- start 2024-09-21T03:48:34.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.834+0000 7f4e85ffb640 1 -- 172.21.15.84:0/1891655892 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f4e800051d0 con 0x7f4e88108cf0 2024-09-21T03:48:34.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.834+0000 7f4e950a4740 1 -- start start 2024-09-21T03:48:34.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.834+0000 7f4e950a4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c9636a350 0x560c96711430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:34.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.834+0000 7f4e950a4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 0x560c96711970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:34.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.834+0000 7f4e950a4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c96349670 0x560c96711eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:34.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.834+0000 7f4e950a4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560c96687e60 con 0x560c96341490 2024-09-21T03:48:34.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.834+0000 7f4e950a4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560c96677290 con 0x560c9636a350 2024-09-21T03:48:34.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.834+0000 7f4e950a4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560c9667b0a0 con 0x560c96349670 2024-09-21T03:48:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.835+0000 7f4e8c8cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 0x560c96711970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.835+0000 7f4e8c8cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 0x560c96711970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43742/0 (socket says 172.21.15.84:43742) 2024-09-21T03:48:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.835+0000 7f4e8c8cc640 1 -- 172.21.15.84:0/3662624454 learned_addr learned my addr 172.21.15.84:0/3662624454 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.835+0000 7f4e87fff640 1 --2- 172.21.15.84:0/3662624454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c9636a350 0x560c96711430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.835+0000 7f4e87fff640 1 --2- 172.21.15.84:0/3662624454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c96349670 0x560c96711eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.835+0000 7f4e85ffb640 1 --2- 172.21.15.84:0/1891655892 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4e780b6680 0x7f4e780b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.835+0000 7f4e8c8cc640 1 -- 172.21.15.84:0/3662624454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c96349670 msgr2=0x560c96711eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.835+0000 7f4e8c8cc640 1 --2- 172.21.15.84:0/3662624454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c96349670 0x560c96711eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.835+0000 7f4e8c8cc640 1 -- 172.21.15.84:0/3662624454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c9636a350 msgr2=0x560c96711430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.835+0000 7f4e8c8cc640 1 --2- 172.21.15.84:0/3662624454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c9636a350 0x560c96711430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.835+0000 7f4e8c8cc640 1 -- 172.21.15.84:0/3662624454 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c963d5930 con 0x560c96341490 2024-09-21T03:48:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.835+0000 7f4e8d0cd640 1 --2- 172.21.15.84:0/1891655892 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4e780b6680 0x7f4e780b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:34.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.835+0000 7f4e8c8cc640 1 --2- 172.21.15.84:0/3662624454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 0x560c96711970 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c009900 tx=0x7f4e7c032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73ff21ab1639c8f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.835+0000 7f4e85ffb640 1 -- 172.21.15.84:0/1891655892 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4e800e77f0 con 0x7f4e88108cf0 2024-09-21T03:48:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.835+0000 7f4e72ffd640 1 -- 172.21.15.84:0/3662624454 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c040070 con 0x560c96341490 2024-09-21T03:48:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.835+0000 7f4e72ffd640 1 -- 172.21.15.84:0/3662624454 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e7c032e40 con 0x560c96341490 2024-09-21T03:48:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.836+0000 7f4e72ffd640 1 -- 172.21.15.84:0/3662624454 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c035040 con 0x560c96341490 2024-09-21T03:48:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.836+0000 7f4e950a4740 1 -- 172.21.15.84:0/3662624454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 msgr2=0x560c96711970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.836+0000 7f4e8d0cd640 1 --2- 172.21.15.84:0/1891655892 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4e780b6680 0x7f4e780b8b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4e800e5070 tx=0x7f4e80005890 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.836+0000 7f4e950a4740 1 --2- 172.21.15.84:0/3662624454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 0x560c96711970 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c009900 tx=0x7f4e7c032cd0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.836+0000 7f4e950a4740 1 -- 172.21.15.84:0/3662624454 shutdown_connections 2024-09-21T03:48:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.836+0000 7f4e950a4740 1 --2- 172.21.15.84:0/3662624454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c96349670 0x560c96711eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.836+0000 7f4e950a4740 1 --2- 172.21.15.84:0/3662624454 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 0x560c96711970 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.836+0000 7f4e950a4740 1 --2- 172.21.15.84:0/3662624454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c9636a350 0x560c96711430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.836+0000 7f4e950a4740 1 -- 172.21.15.84:0/3662624454 >> 172.21.15.84:0/3662624454 conn(0x560c9635e740 msgr2=0x560c9670f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.836+0000 7f4e950a4740 1 -- 172.21.15.84:0/3662624454 shutdown_connections 2024-09-21T03:48:34.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.836+0000 7f4e950a4740 1 -- 172.21.15.84:0/3662624454 wait complete. 2024-09-21T03:48:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.837+0000 7f4e950a4740 1 -- start start 2024-09-21T03:48:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.837+0000 7f4e950a4740 1 Processor -- start 2024-09-21T03:48:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.837+0000 7f4e950a4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c96341490 0x560c9671cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.837+0000 7f4e950a4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96349670 0x560c9671d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.837+0000 7f4e950a4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c9636a350 0x560c96728ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.837+0000 7f4e950a4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560c964d8890 con 0x560c96349670 2024-09-21T03:48:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.837+0000 7f4e950a4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560c96611d40 con 0x560c96341490 2024-09-21T03:48:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.837+0000 7f4e950a4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560c9671fbb0 con 0x560c9636a350 2024-09-21T03:48:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.837+0000 7f4e950a4740 10 client.0 _ll_register_callbacks cb 0x560c96675c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:48:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.837+0000 7f4e8c8cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96349670 0x560c9671d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.837+0000 7f4e8c8cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96349670 0x560c9671d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43748/0 (socket says 172.21.15.84:43748) 2024-09-21T03:48:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.837+0000 7f4e8c8cc640 1 -- 172.21.15.84:0/2813198909 learned_addr learned my addr 172.21.15.84:0/2813198909 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:34.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.838+0000 7f4e87fff640 1 --2- 172.21.15.84:0/2813198909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c9636a350 0x560c96728ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.838+0000 7f4e87fff640 1 --2- 172.21.15.84:0/2813198909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c96341490 0x560c9671cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.838+0000 7f4e8c8cc640 1 -- 172.21.15.84:0/2813198909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c9636a350 msgr2=0x560c96728ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.838+0000 7f4e8c8cc640 1 --2- 172.21.15.84:0/2813198909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c9636a350 0x560c96728ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.838+0000 7f4e8c8cc640 1 -- 172.21.15.84:0/2813198909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c96341490 msgr2=0x560c9671cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.838+0000 7f4e8c8cc640 1 --2- 172.21.15.84:0/2813198909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c96341490 0x560c9671cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.838+0000 7f4e8c8cc640 1 -- 172.21.15.84:0/2813198909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c96729440 con 0x560c96349670 2024-09-21T03:48:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.838+0000 7f4e87fff640 1 --2- 172.21.15.84:0/2813198909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c96341490 0x560c9671cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:48:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.838+0000 7f4e8c8cc640 1 --2- 172.21.15.84:0/2813198909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96349670 0x560c9671d530 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c02a930 tx=0x7f4e7c0051c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b10f582e0d88c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.838+0000 7f4e67fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:48:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.838+0000 7f4e67fff640 1 -- 172.21.15.84:0/2813198909 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7c035040 con 0x560c96349670 2024-09-21T03:48:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.838+0000 7f4e67fff640 1 -- 172.21.15.84:0/2813198909 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4e7c004030 con 0x560c96349670 2024-09-21T03:48:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.838+0000 7f4e950a4740 1 -- 172.21.15.84:0/2813198909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560c96689db0 con 0x560c96349670 2024-09-21T03:48:34.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.838+0000 7f4e67fff640 1 -- 172.21.15.84:0/2813198909 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4e7c040040 con 0x560c96349670 2024-09-21T03:48:34.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.838+0000 7f4e950a4740 10 client.16599 fetch_fsmap learned FSMap version 25 2024-09-21T03:48:34.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.838+0000 7f4e950a4740 1 -- 172.21.15.84:0/2813198909 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560c9672bd70 con 0x560c96349670 2024-09-21T03:48:34.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.838+0000 7f4e67fff640 1 -- 172.21.15.84:0/2813198909 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560c96689db0 con 0x560c96349670 2024-09-21T03:48:34.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.839+0000 7f4e67fff640 1 -- 172.21.15.84:0/2813198909 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4e7c003c30 con 0x560c96349670 2024-09-21T03:48:34.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.839+0000 7f4e950a4740 10 client.16599 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:48:34.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.839+0000 7f4e950a4740 10 client.16599 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:48:34.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.839+0000 7f4e950a4740 20 client.16599 populate_metadata read hostname 'smithi084' 2024-09-21T03:48:34.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.839+0000 7f4e950a4740 1 --2- 172.21.15.84:0/2813198909 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560c96328cd0 0x560c9672f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:34.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.839+0000 7f4e950a4740 4 client.16599 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:48:34.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.839+0000 7f4e950a4740 1 -- 172.21.15.84:0/2813198909 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c96685860 con 0x560c96328cd0 2024-09-21T03:48:34.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.839+0000 7f4e87fff640 1 --2- 172.21.15.84:0/2813198909 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560c96328cd0 0x560c9672f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:34.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.839+0000 7f4e67fff640 10 client.16599 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:48:34.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.839+0000 7f4e87fff640 1 --2- 172.21.15.84:0/2813198909 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560c96328cd0 0x560c9672f0d0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e615b4ba1dc529e9 server_cookie=74f0de5b8f6ad925 in_seq=0 out_seq=0 2024-09-21T03:48:34.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.840+0000 7f4e67fff640 1 -- 172.21.15.84:0/2813198909 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560c96685860 con 0x560c96328cd0 2024-09-21T03:48:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.840+0000 7f4e67fff640 10 client.16599 handle_command_reply: tid=0 2024-09-21T03:48:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.840+0000 7f4e950a4740 1 client.16599 shutdown 2024-09-21T03:48:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.840+0000 7f4e950a4740 1 -- 172.21.15.84:0/2813198909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96349670 msgr2=0x560c9671d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.840+0000 7f4e950a4740 1 --2- 172.21.15.84:0/2813198909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96349670 0x560c9671d530 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c02a930 tx=0x7f4e7c0051c0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.840+0000 7f4e950a4740 1 -- 172.21.15.84:0/2813198909 shutdown_connections 2024-09-21T03:48:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.840+0000 7f4e950a4740 1 --2- 172.21.15.84:0/2813198909 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560c96328cd0 0x560c9672f0d0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.840+0000 7f4e950a4740 1 --2- 172.21.15.84:0/2813198909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c9636a350 0x560c96728ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.840+0000 7f4e950a4740 1 --2- 172.21.15.84:0/2813198909 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96349670 0x560c9671d530 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.840+0000 7f4e67fff640 0 client.16599 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:48:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.840+0000 7f4e950a4740 1 --2- 172.21.15.84:0/2813198909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c96341490 0x560c9671cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.840+0000 7f4e950a4740 1 -- 172.21.15.84:0/2813198909 >> 172.21.15.84:0/2813198909 conn(0x560c9635e740 msgr2=0x560c967145c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.841+0000 7f4e950a4740 1 -- 172.21.15.84:0/2813198909 shutdown_connections 2024-09-21T03:48:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.841+0000 7f4e950a4740 1 -- 172.21.15.84:0/2813198909 wait complete. 2024-09-21T03:48:34.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.841+0000 7f4e950a4740 20 client.16599 trim_cache size 0 max 16384 2024-09-21T03:48:34.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.858+0000 7f4e950a4740 1 Processor -- start 2024-09-21T03:48:34.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.858+0000 7f4e950a4740 1 -- start start 2024-09-21T03:48:34.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.858+0000 7f4e950a4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 0x560c96728e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:34.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.858+0000 7f4e950a4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c96349670 0x560c96717550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:34.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.858+0000 7f4e950a4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c9636a350 0x560c96719fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:34.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.858+0000 7f4e950a4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4e881b1de0 con 0x560c96341490 2024-09-21T03:48:34.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.858+0000 7f4e950a4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4e881af6b0 con 0x560c9636a350 2024-09-21T03:48:34.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.858+0000 7f4e950a4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4e881ad500 con 0x560c96349670 2024-09-21T03:48:34.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.858+0000 7f4e87fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 0x560c96728e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:34.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.858+0000 7f4e87fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 0x560c96728e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43762/0 (socket says 172.21.15.84:43762) 2024-09-21T03:48:34.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.858+0000 7f4e87fff640 1 -- 172.21.15.84:0/4270954964 learned_addr learned my addr 172.21.15.84:0/4270954964 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.859+0000 7f4e87fff640 1 -- 172.21.15.84:0/4270954964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c96349670 msgr2=0x560c96717550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.859+0000 7f4e87fff640 1 --2- 172.21.15.84:0/4270954964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c96349670 0x560c96717550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.859+0000 7f4e87fff640 1 -- 172.21.15.84:0/4270954964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c9636a350 msgr2=0x560c96719fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.859+0000 7f4e87fff640 1 --2- 172.21.15.84:0/4270954964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c9636a350 0x560c96719fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.859+0000 7f4e87fff640 1 -- 172.21.15.84:0/4270954964 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c9671dbd0 con 0x560c96341490 2024-09-21T03:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.859+0000 7f4e87fff640 1 --2- 172.21.15.84:0/4270954964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 0x560c96728e40 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400f6c0 tx=0x7f4e740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed6684221548c02 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.859+0000 7f4e727fc640 1 -- 172.21.15.84:0/4270954964 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7401b040 con 0x560c96341490 2024-09-21T03:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.859+0000 7f4e727fc640 1 -- 172.21.15.84:0/4270954964 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e740044b0 con 0x560c96341490 2024-09-21T03:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.859+0000 7f4e727fc640 1 -- 172.21.15.84:0/4270954964 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e74003850 con 0x560c96341490 2024-09-21T03:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.860+0000 7f4e950a4740 1 -- 172.21.15.84:0/4270954964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 msgr2=0x560c96728e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.860+0000 7f4e950a4740 1 --2- 172.21.15.84:0/4270954964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 0x560c96728e40 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400f6c0 tx=0x7f4e740046c0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.860+0000 7f4e950a4740 1 -- 172.21.15.84:0/4270954964 shutdown_connections 2024-09-21T03:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.860+0000 7f4e950a4740 1 --2- 172.21.15.84:0/4270954964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c9636a350 0x560c96719fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.860+0000 7f4e950a4740 1 --2- 172.21.15.84:0/4270954964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c96349670 0x560c96717550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.860+0000 7f4e950a4740 1 --2- 172.21.15.84:0/4270954964 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 0x560c96728e40 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.860+0000 7f4e950a4740 1 -- 172.21.15.84:0/4270954964 >> 172.21.15.84:0/4270954964 conn(0x560c9635e740 msgr2=0x560c9671b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.860+0000 7f4e950a4740 1 -- 172.21.15.84:0/4270954964 shutdown_connections 2024-09-21T03:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.860+0000 7f4e950a4740 1 -- 172.21.15.84:0/4270954964 wait complete. 2024-09-21T03:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.860+0000 7f4e950a4740 1 -- start start 2024-09-21T03:48:34.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.860+0000 7f4e950a4740 1 Processor -- start 2024-09-21T03:48:34.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.861+0000 7f4e950a4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 0x560c96732310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:34.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.861+0000 7f4e950a4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c96349670 0x560c96732850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.861+0000 7f4e950a4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c9636a350 0x560c9672d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.861+0000 7f4e950a4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4e881adb70 con 0x560c96341490 2024-09-21T03:48:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.861+0000 7f4e950a4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4e881aefe0 con 0x560c96349670 2024-09-21T03:48:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.861+0000 7f4e950a4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4e881ae240 con 0x560c9636a350 2024-09-21T03:48:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.861+0000 7f4e950a4740 10 client.0 _ll_register_callbacks cb 0x7f4e7400ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:48:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.861+0000 7f4e87fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 0x560c96732310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.861+0000 7f4e87fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 0x560c96732310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43776/0 (socket says 172.21.15.84:43776) 2024-09-21T03:48:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.861+0000 7f4e87fff640 1 -- 172.21.15.84:0/2882004659 learned_addr learned my addr 172.21.15.84:0/2882004659 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.861+0000 7f4e8c8cc640 1 --2- 172.21.15.84:0/2882004659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c96349670 0x560c96732850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.861+0000 7f4e87fff640 1 -- 172.21.15.84:0/2882004659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c9636a350 msgr2=0x560c9672d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.861+0000 7f4e87fff640 1 --2- 172.21.15.84:0/2882004659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c9636a350 0x560c9672d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.861+0000 7f4e87fff640 1 -- 172.21.15.84:0/2882004659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c96349670 msgr2=0x560c96732850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.861+0000 7f4e87fff640 1 --2- 172.21.15.84:0/2882004659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c96349670 0x560c96732850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.861+0000 7f4e87fff640 1 -- 172.21.15.84:0/2882004659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c9672d700 con 0x560c96341490 2024-09-21T03:48:34.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.861+0000 7f4e87fff640 1 --2- 172.21.15.84:0/2882004659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 0x560c96732310 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4e74005c60 tx=0x7f4e740047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d440982868a4ff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.861+0000 7f4e67fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:48:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.861+0000 7f4e67fff640 1 -- 172.21.15.84:0/2882004659 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e74004930 con 0x560c96341490 2024-09-21T03:48:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.862+0000 7f4e67fff640 1 -- 172.21.15.84:0/2882004659 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f4e74004ad0 con 0x560c96341490 2024-09-21T03:48:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.862+0000 7f4e950a4740 1 -- 172.21.15.84:0/2882004659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e740044b0 con 0x560c96341490 2024-09-21T03:48:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.862+0000 7f4e67fff640 1 -- 172.21.15.84:0/2882004659 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4e74005000 con 0x560c96341490 2024-09-21T03:48:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.862+0000 7f4e950a4740 10 client.16605 fetch_fsmap learned FSMap version 25 2024-09-21T03:48:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.862+0000 7f4e950a4740 1 -- 172.21.15.84:0/2882004659 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560c9679e560 con 0x560c96341490 2024-09-21T03:48:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.862+0000 7f4e67fff640 1 -- 172.21.15.84:0/2882004659 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e740044b0 con 0x560c96341490 2024-09-21T03:48:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.862+0000 7f4e67fff640 1 -- 172.21.15.84:0/2882004659 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4e74021070 con 0x560c96341490 2024-09-21T03:48:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.862+0000 7f4e950a4740 10 client.16605 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:48:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.862+0000 7f4e950a4740 10 client.16605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:48:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.862+0000 7f4e950a4740 20 client.16605 populate_metadata read hostname 'smithi084' 2024-09-21T03:48:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.862+0000 7f4e950a4740 1 --2- 172.21.15.84:0/2882004659 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560c962fe080 0x560c967a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.862+0000 7f4e950a4740 4 client.16605 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:48:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.862+0000 7f4e950a4740 1 -- 172.21.15.84:0/2882004659 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560c96682c90 con 0x560c962fe080 2024-09-21T03:48:34.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.862+0000 7f4e8c8cc640 1 --2- 172.21.15.84:0/2882004659 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560c962fe080 0x560c967a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:34.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.863+0000 7f4e8c8cc640 1 --2- 172.21.15.84:0/2882004659 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560c962fe080 0x560c967a0cd0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffbc9e4ff18c8b95 server_cookie=57ea21a2b8e582e5 in_seq=0 out_seq=0 2024-09-21T03:48:34.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.863+0000 7f4e67fff640 10 client.16605 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:48:34.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.864+0000 7f4e67fff640 1 -- 172.21.15.84:0/2882004659 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560c96682c90 con 0x560c962fe080 2024-09-21T03:48:34.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.864+0000 7f4e67fff640 10 client.16605 handle_command_reply: tid=0 2024-09-21T03:48:34.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.864+0000 7f4e950a4740 1 client.16605 shutdown 2024-09-21T03:48:34.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.865+0000 7f4e950a4740 1 -- 172.21.15.84:0/2882004659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 msgr2=0x560c96732310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:34.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.865+0000 7f4e950a4740 1 --2- 172.21.15.84:0/2882004659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 0x560c96732310 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4e74005c60 tx=0x7f4e740047c0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.865+0000 7f4e950a4740 1 -- 172.21.15.84:0/2882004659 shutdown_connections 2024-09-21T03:48:34.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.865+0000 7f4e950a4740 1 --2- 172.21.15.84:0/2882004659 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560c962fe080 0x560c967a0cd0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.865+0000 7f4e950a4740 1 --2- 172.21.15.84:0/2882004659 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560c9636a350 0x560c9672d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.865+0000 7f4e950a4740 1 --2- 172.21.15.84:0/2882004659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c96349670 0x560c96732850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.865+0000 7f4e950a4740 1 --2- 172.21.15.84:0/2882004659 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560c96341490 0x560c96732310 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.865+0000 7f4e950a4740 1 -- 172.21.15.84:0/2882004659 >> 172.21.15.84:0/2882004659 conn(0x560c9635e740 msgr2=0x560c96712460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:34.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.865+0000 7f4e67fff640 0 client.16605 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:48:34.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.865+0000 7f4e950a4740 1 -- 172.21.15.84:0/2882004659 shutdown_connections 2024-09-21T03:48:34.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.865+0000 7f4e950a4740 1 -- 172.21.15.84:0/2882004659 wait complete. 2024-09-21T03:48:34.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.865+0000 7f4e950a4740 20 client.16605 trim_cache size 0 max 16384 2024-09-21T03:48:34.871 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:48:34.871 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T03:48:34.871 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "b2063a70-0b1f-4b6b-9c96-d886e156ea66", 2024-09-21T03:48:34.871 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T03:48:34.871 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:48:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.866+0000 7f4e8eb30640 1 -- 172.21.15.84:0/1891655892 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4e780b6680 msgr2=0x7f4e780b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.866+0000 7f4e8eb30640 1 --2- 172.21.15.84:0/1891655892 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4e780b6680 0x7f4e780b8b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4e800e5070 tx=0x7f4e80005890 comp rx=0 tx=0).stop 2024-09-21T03:48:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.866+0000 7f4e8eb30640 1 -- 172.21.15.84:0/1891655892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e88108cf0 msgr2=0x7f4e8819fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.866+0000 7f4e8eb30640 1 --2- 172.21.15.84:0/1891655892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e88108cf0 0x7f4e8819fca0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000eaa0 tx=0x7f4e8000ef60 comp rx=0 tx=0).stop 2024-09-21T03:48:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.866+0000 7f4e8eb30640 1 -- 172.21.15.84:0/1891655892 shutdown_connections 2024-09-21T03:48:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.866+0000 7f4e8eb30640 1 --2- 172.21.15.84:0/1891655892 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4e780b6680 0x7f4e780b8b90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.866+0000 7f4e8eb30640 1 --2- 172.21.15.84:0/1891655892 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4e88108cf0 0x7f4e8819fca0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.866+0000 7f4e8eb30640 1 --2- 172.21.15.84:0/1891655892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e881083a0 0x7f4e8819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.866+0000 7f4e8eb30640 1 --2- 172.21.15.84:0/1891655892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e88102a60 0x7f4e8819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.866+0000 7f4e8eb30640 1 -- 172.21.15.84:0/1891655892 >> 172.21.15.84:0/1891655892 conn(0x7f4e88079720 msgr2=0x7f4e88101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:34.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.866+0000 7f4e8eb30640 1 -- 172.21.15.84:0/1891655892 shutdown_connections 2024-09-21T03:48:34.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:34.866+0000 7f4e8eb30640 1 -- 172.21.15.84:0/1891655892 wait complete. 2024-09-21T03:48:34.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:34 smithi174 ceph-mon[34403]: pgmap v507: 97 pgs: 97 active+clean; 9.3 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 10 op/s 2024-09-21T03:48:34.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:34 smithi172 ceph-mon[34821]: pgmap v507: 97 pgs: 97 active+clean; 9.3 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 10 op/s 2024-09-21T03:48:35.614 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:48:35.860 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:48:36.061 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:35 smithi084 ceph-mon[30941]: scrub queued for path: / 2024-09-21T03:48:36.061 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:35 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:48:36.062 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:35 smithi084 ceph-mon[30941]: scrub summary: active paths [/] 2024-09-21T03:48:36.062 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:35 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:48:36.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:35 smithi174 ceph-mon[34403]: scrub queued for path: / 2024-09-21T03:48:36.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:35 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:48:36.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:35 smithi174 ceph-mon[34403]: scrub summary: active paths [/] 2024-09-21T03:48:36.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:35 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:48:36.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:35 smithi172 ceph-mon[34821]: scrub queued for path: / 2024-09-21T03:48:36.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:35 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:48:36.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:35 smithi172 ceph-mon[34821]: scrub summary: active paths [/] 2024-09-21T03:48:36.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:35 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:48:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.411+0000 7f986cdaf640 1 -- 172.21.15.84:0/828987302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9868103bb0 msgr2=0x7f9868103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.411+0000 7f986cdaf640 1 --2- 172.21.15.84:0/828987302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9868103bb0 0x7f9868103fc0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f9858009900 tx=0x7f985802a410 comp rx=0 tx=0).stop 2024-09-21T03:48:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.411+0000 7f986cdaf640 1 -- 172.21.15.84:0/828987302 shutdown_connections 2024-09-21T03:48:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.411+0000 7f986cdaf640 1 --2- 172.21.15.84:0/828987302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9868109e40 0x7f9868110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.411+0000 7f986cdaf640 1 --2- 172.21.15.84:0/828987302 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98681094f0 0x7f9868109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.411+0000 7f986cdaf640 1 --2- 172.21.15.84:0/828987302 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9868103bb0 0x7f9868103fc0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.411+0000 7f986cdaf640 1 -- 172.21.15.84:0/828987302 >> 172.21.15.84:0/828987302 conn(0x7f98680ff600 msgr2=0x7f9868101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.411+0000 7f986cdaf640 1 -- 172.21.15.84:0/828987302 shutdown_connections 2024-09-21T03:48:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.412+0000 7f986cdaf640 1 -- 172.21.15.84:0/828987302 wait complete. 2024-09-21T03:48:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.412+0000 7f986cdaf640 1 Processor -- start 2024-09-21T03:48:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.412+0000 7f986cdaf640 1 -- start start 2024-09-21T03:48:36.424 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.413+0000 7f986cdaf640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9868103bb0 0x7f986819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.413+0000 7f986cdaf640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98681094f0 0x7f986819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.413+0000 7f986cdaf640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9868109e40 0x7f986819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.413+0000 7f986cdaf640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9868113b00 con 0x7f9868103bb0 2024-09-21T03:48:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.413+0000 7f986cdaf640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9868113980 con 0x7f9868109e40 2024-09-21T03:48:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.413+0000 7f986cdaf640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9868113c80 con 0x7f98681094f0 2024-09-21T03:48:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.413+0000 7f986659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9868103bb0 0x7f986819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.413+0000 7f986659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9868103bb0 0x7f986819a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43806/0 (socket says 172.21.15.84:43806) 2024-09-21T03:48:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.413+0000 7f986659c640 1 -- 172.21.15.84:0/1385716872 learned_addr learned my addr 172.21.15.84:0/1385716872 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.413+0000 7f9866d9d640 1 --2- 172.21.15.84:0/1385716872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9868109e40 0x7f986819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.413+0000 7f985ffff640 1 --2- 172.21.15.84:0/1385716872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98681094f0 0x7f986819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.413+0000 7f986659c640 1 -- 172.21.15.84:0/1385716872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98681094f0 msgr2=0x7f986819aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.413+0000 7f986659c640 1 --2- 172.21.15.84:0/1385716872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98681094f0 0x7f986819aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.413+0000 7f986659c640 1 -- 172.21.15.84:0/1385716872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9868109e40 msgr2=0x7f986819fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:36.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.413+0000 7f986659c640 1 --2- 172.21.15.84:0/1385716872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9868109e40 0x7f986819fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.413+0000 7f986659c640 1 -- 172.21.15.84:0/1385716872 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98681a0440 con 0x7f9868103bb0 2024-09-21T03:48:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.413+0000 7f9866d9d640 1 --2- 172.21.15.84:0/1385716872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9868109e40 0x7f986819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:48:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.414+0000 7f986659c640 1 --2- 172.21.15.84:0/1385716872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9868103bb0 0x7f986819a4d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f9858005940 tx=0x7f9858004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.414+0000 7f985f7fe640 1 -- 172.21.15.84:0/1385716872 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f985803f030 con 0x7f9868103bb0 2024-09-21T03:48:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.414+0000 7f986cdaf640 1 -- 172.21.15.84:0/1385716872 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98681a06d0 con 0x7f9868103bb0 2024-09-21T03:48:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.414+0000 7f985f7fe640 1 -- 172.21.15.84:0/1385716872 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9858003aa0 con 0x7f9868103bb0 2024-09-21T03:48:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.414+0000 7f985f7fe640 1 -- 172.21.15.84:0/1385716872 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9858035070 con 0x7f9868103bb0 2024-09-21T03:48:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.414+0000 7f986cdaf640 1 -- 172.21.15.84:0/1385716872 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98681a6e90 con 0x7f9868103bb0 2024-09-21T03:48:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.417+0000 7f9873323740 1 Processor -- start 2024-09-21T03:48:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.417+0000 7f985f7fe640 1 -- 172.21.15.84:0/1385716872 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f9858042030 con 0x7f9868103bb0 2024-09-21T03:48:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.417+0000 7f9873323740 1 -- start start 2024-09-21T03:48:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.417+0000 7f9873323740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c432070 0x55cd6c7d9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.417+0000 7f9873323740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c4091b0 0x55cd6c7d9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:36.426 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.417+0000 7f9873323740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 0x55cd6c7da0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.417+0000 7f9873323740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cd6c74fe50 con 0x55cd6c411390 2024-09-21T03:48:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.417+0000 7f9873323740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cd6c73f280 con 0x55cd6c432070 2024-09-21T03:48:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.417+0000 7f9873323740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55cd6c743090 con 0x55cd6c4091b0 2024-09-21T03:48:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.417+0000 7f985ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 0x55cd6c7da0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.417+0000 7f985ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 0x55cd6c7da0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43810/0 (socket says 172.21.15.84:43810) 2024-09-21T03:48:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.417+0000 7f985ffff640 1 -- 172.21.15.84:0/1191144658 learned_addr learned my addr 172.21.15.84:0/1191144658 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.417+0000 7f986659c640 1 --2- 172.21.15.84:0/1191144658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c4091b0 0x55cd6c7d9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.417+0000 7f9866d9d640 1 --2- 172.21.15.84:0/1191144658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c432070 0x55cd6c7d9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.418+0000 7f985ffff640 1 -- 172.21.15.84:0/1191144658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c4091b0 msgr2=0x55cd6c7d9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.418+0000 7f985ffff640 1 --2- 172.21.15.84:0/1191144658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c4091b0 0x55cd6c7d9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.418+0000 7f985ffff640 1 -- 172.21.15.84:0/1191144658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c432070 msgr2=0x55cd6c7d9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.418+0000 7f985ffff640 1 --2- 172.21.15.84:0/1191144658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c432070 0x55cd6c7d9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.418+0000 7f985ffff640 1 -- 172.21.15.84:0/1191144658 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd6c49d650 con 0x55cd6c411390 2024-09-21T03:48:36.427 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.418+0000 7f986659c640 1 --2- 172.21.15.84:0/1191144658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c4091b0 0x55cd6c7d9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:48:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.418+0000 7f985f7fe640 1 --2- 172.21.15.84:0/1385716872 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f98540b6680 0x7f98540b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.418+0000 7f985ffff640 1 --2- 172.21.15.84:0/1191144658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 0x55cd6c7da0d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f985000bc20 tx=0x7f985000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fe7e3ca22b21cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.418+0000 7f985cff9640 1 -- 172.21.15.84:0/1191144658 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9850015070 con 0x55cd6c411390 2024-09-21T03:48:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.418+0000 7f9866d9d640 1 --2- 172.21.15.84:0/1385716872 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f98540b6680 0x7f98540b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.418+0000 7f985cff9640 1 -- 172.21.15.84:0/1191144658 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f985001a910 con 0x55cd6c411390 2024-09-21T03:48:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.418+0000 7f985cff9640 1 -- 172.21.15.84:0/1191144658 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9850011830 con 0x55cd6c411390 2024-09-21T03:48:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.418+0000 7f985f7fe640 1 -- 172.21.15.84:0/1385716872 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f9858107e60 con 0x7f9868103bb0 2024-09-21T03:48:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.419+0000 7f9873323740 1 -- 172.21.15.84:0/1191144658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 msgr2=0x55cd6c7da0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.419+0000 7f9873323740 1 --2- 172.21.15.84:0/1191144658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 0x55cd6c7da0d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f985000bc20 tx=0x7f985000f730 comp rx=0 tx=0).stop 2024-09-21T03:48:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.419+0000 7f9866d9d640 1 --2- 172.21.15.84:0/1385716872 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f98540b6680 0x7f98540b8b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9860005fd0 tx=0x7f9860009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.419+0000 7f9873323740 1 -- 172.21.15.84:0/1191144658 shutdown_connections 2024-09-21T03:48:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.419+0000 7f9873323740 1 --2- 172.21.15.84:0/1191144658 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 0x55cd6c7da0d0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.419+0000 7f9873323740 1 --2- 172.21.15.84:0/1191144658 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c4091b0 0x55cd6c7d9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.419+0000 7f9873323740 1 --2- 172.21.15.84:0/1191144658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c432070 0x55cd6c7d9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.419+0000 7f9873323740 1 -- 172.21.15.84:0/1191144658 >> 172.21.15.84:0/1191144658 conn(0x55cd6c426460 msgr2=0x55cd6c7d7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.419+0000 7f9873323740 1 -- 172.21.15.84:0/1191144658 shutdown_connections 2024-09-21T03:48:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.419+0000 7f9873323740 1 -- 172.21.15.84:0/1191144658 wait complete. 2024-09-21T03:48:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.420+0000 7f9873323740 1 -- start start 2024-09-21T03:48:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.420+0000 7f9873323740 1 Processor -- start 2024-09-21T03:48:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.420+0000 7f9873323740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c4091b0 0x55cd6c7e4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.420+0000 7f9873323740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c411390 0x55cd6c7e51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.420+0000 7f9873323740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c432070 0x55cd6c7f1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.420+0000 7f9873323740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55cd6c5a0700 con 0x55cd6c4091b0 2024-09-21T03:48:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.420+0000 7f9873323740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cd6c6da110 con 0x55cd6c411390 2024-09-21T03:48:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.420+0000 7f9873323740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55cd6c7e7e30 con 0x55cd6c432070 2024-09-21T03:48:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.420+0000 7f9873323740 10 client.0 _ll_register_callbacks cb 0x55cd6c6f3990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:48:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.420+0000 7f986659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c4091b0 0x55cd6c7e4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:36.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.420+0000 7f986659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c4091b0 0x55cd6c7e4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43816/0 (socket says 172.21.15.84:43816) 2024-09-21T03:48:36.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.420+0000 7f986659c640 1 -- 172.21.15.84:0/1096307911 learned_addr learned my addr 172.21.15.84:0/1096307911 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:36.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.420+0000 7f985ffff640 1 --2- 172.21.15.84:0/1096307911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c411390 0x55cd6c7e51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:36.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.420+0000 7f986659c640 1 -- 172.21.15.84:0/1096307911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c432070 msgr2=0x55cd6c7f1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:36.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.420+0000 7f9866d9d640 1 --2- 172.21.15.84:0/1096307911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c432070 0x55cd6c7f1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:36.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.420+0000 7f986659c640 1 --2- 172.21.15.84:0/1096307911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c432070 0x55cd6c7f1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.421+0000 7f986659c640 1 -- 172.21.15.84:0/1096307911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c411390 msgr2=0x55cd6c7e51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:36.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.421+0000 7f986659c640 1 --2- 172.21.15.84:0/1096307911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c411390 0x55cd6c7e51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.421+0000 7f986659c640 1 -- 172.21.15.84:0/1096307911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd6c707c40 con 0x55cd6c4091b0 2024-09-21T03:48:36.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.421+0000 7f985ffff640 1 --2- 172.21.15.84:0/1096307911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c411390 0x55cd6c7e51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:48:36.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.421+0000 7f986659c640 1 --2- 172.21.15.84:0/1096307911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c4091b0 0x55cd6c7e4cb0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f98580cafa0 tx=0x7f9858031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d86c2e19ed980a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:36.430 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.421+0000 7f984dffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:48:36.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.421+0000 7f984dffb640 1 -- 172.21.15.84:0/1096307911 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9858049030 con 0x55cd6c4091b0 2024-09-21T03:48:36.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.421+0000 7f984dffb640 1 -- 172.21.15.84:0/1096307911 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f985803bca0 con 0x55cd6c4091b0 2024-09-21T03:48:36.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.421+0000 7f9873323740 1 -- 172.21.15.84:0/1096307911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f985001a910 con 0x55cd6c4091b0 2024-09-21T03:48:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.421+0000 7f984dffb640 1 -- 172.21.15.84:0/1096307911 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f98580cdb00 con 0x55cd6c4091b0 2024-09-21T03:48:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.421+0000 7f9873323740 10 client.16617 fetch_fsmap learned FSMap version 25 2024-09-21T03:48:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.421+0000 7f9873323740 1 -- 172.21.15.84:0/1096307911 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cd6c7f3ae0 con 0x55cd6c4091b0 2024-09-21T03:48:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.421+0000 7f984dffb640 1 -- 172.21.15.84:0/1096307911 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f985001a910 con 0x55cd6c4091b0 2024-09-21T03:48:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.422+0000 7f984dffb640 1 -- 172.21.15.84:0/1096307911 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f98580d72c0 con 0x55cd6c4091b0 2024-09-21T03:48:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.422+0000 7f9873323740 10 client.16617 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:48:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.422+0000 7f9873323740 10 client.16617 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:48:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.422+0000 7f9873323740 20 client.16617 populate_metadata read hostname 'smithi084' 2024-09-21T03:48:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.422+0000 7f9873323740 1 --2- 172.21.15.84:0/1096307911 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55cd6c3f09f0 0x55cd6c7f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.422+0000 7f9873323740 4 client.16617 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:48:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.422+0000 7f9873323740 1 -- 172.21.15.84:0/1096307911 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd6c751da0 con 0x55cd6c3f09f0 2024-09-21T03:48:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.422+0000 7f985ffff640 1 --2- 172.21.15.84:0/1096307911 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55cd6c3f09f0 0x55cd6c7f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.422+0000 7f984dffb640 10 client.16617 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:48:36.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.422+0000 7f985ffff640 1 --2- 172.21.15.84:0/1096307911 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55cd6c3f09f0 0x55cd6c7f6f70 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a22b2f36f9c0a00 server_cookie=372218ce628dd4c in_seq=0 out_seq=0 2024-09-21T03:48:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.423+0000 7f984dffb640 1 -- 172.21.15.84:0/1096307911 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cd6c751da0 con 0x55cd6c3f09f0 2024-09-21T03:48:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.423+0000 7f984dffb640 10 client.16617 handle_command_reply: tid=0 2024-09-21T03:48:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.423+0000 7f9873323740 1 client.16617 shutdown 2024-09-21T03:48:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.423+0000 7f9873323740 1 -- 172.21.15.84:0/1096307911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c4091b0 msgr2=0x55cd6c7e4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.423+0000 7f9873323740 1 --2- 172.21.15.84:0/1096307911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c4091b0 0x55cd6c7e4cb0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f98580cafa0 tx=0x7f9858031a10 comp rx=0 tx=0).stop 2024-09-21T03:48:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.423+0000 7f9873323740 1 -- 172.21.15.84:0/1096307911 shutdown_connections 2024-09-21T03:48:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.423+0000 7f9873323740 1 --2- 172.21.15.84:0/1096307911 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55cd6c3f09f0 0x55cd6c7f6f70 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.423+0000 7f9873323740 1 --2- 172.21.15.84:0/1096307911 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c432070 0x55cd6c7f1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.423+0000 7f984dffb640 0 client.16617 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:48:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.423+0000 7f9873323740 1 --2- 172.21.15.84:0/1096307911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c411390 0x55cd6c7e51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.423+0000 7f9873323740 1 --2- 172.21.15.84:0/1096307911 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c4091b0 0x55cd6c7e4cb0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.423+0000 7f9873323740 1 -- 172.21.15.84:0/1096307911 >> 172.21.15.84:0/1096307911 conn(0x55cd6c426460 msgr2=0x55cd6c7dc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.424+0000 7f9873323740 1 -- 172.21.15.84:0/1096307911 shutdown_connections 2024-09-21T03:48:36.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.424+0000 7f9873323740 1 -- 172.21.15.84:0/1096307911 wait complete. 2024-09-21T03:48:36.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.424+0000 7f9873323740 20 client.16617 trim_cache size 0 max 16384 2024-09-21T03:48:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.441+0000 7f9873323740 1 Processor -- start 2024-09-21T03:48:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.441+0000 7f9873323740 1 -- start start 2024-09-21T03:48:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.441+0000 7f9873323740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c4091b0 0x55cd6c7e3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.441+0000 7f9873323740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 0x55cd6c7e68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.441+0000 7f9873323740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c432070 0x55cd6c7d6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.441+0000 7f9873323740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f98681b1d10 con 0x55cd6c411390 2024-09-21T03:48:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.441+0000 7f9873323740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f98681af5e0 con 0x55cd6c4091b0 2024-09-21T03:48:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.441+0000 7f9873323740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f98681ad430 con 0x55cd6c432070 2024-09-21T03:48:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.441+0000 7f985ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 0x55cd6c7e68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.441+0000 7f985ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 0x55cd6c7e68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43818/0 (socket says 172.21.15.84:43818) 2024-09-21T03:48:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.441+0000 7f985ffff640 1 -- 172.21.15.84:0/2253360704 learned_addr learned my addr 172.21.15.84:0/2253360704 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:36.445 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.441+0000 7f986659c640 1 --2- 172.21.15.84:0/2253360704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c4091b0 0x55cd6c7e3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.441+0000 7f985ffff640 1 -- 172.21.15.84:0/2253360704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c432070 msgr2=0x55cd6c7d6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.441+0000 7f985ffff640 1 --2- 172.21.15.84:0/2253360704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c432070 0x55cd6c7d6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.441+0000 7f985ffff640 1 -- 172.21.15.84:0/2253360704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c4091b0 msgr2=0x55cd6c7e3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.441+0000 7f985ffff640 1 --2- 172.21.15.84:0/2253360704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c4091b0 0x55cd6c7e3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.441+0000 7f985ffff640 1 -- 172.21.15.84:0/2253360704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd6c7dc4b0 con 0x55cd6c411390 2024-09-21T03:48:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.442+0000 7f985ffff640 1 --2- 172.21.15.84:0/2253360704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 0x55cd6c7e68e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f985000fc30 tx=0x7f985000b440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2882925e06a51606 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.442+0000 7f984ffff640 1 -- 172.21.15.84:0/2253360704 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9850015070 con 0x55cd6c411390 2024-09-21T03:48:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.442+0000 7f984ffff640 1 -- 172.21.15.84:0/2253360704 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9850004640 con 0x55cd6c411390 2024-09-21T03:48:36.446 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.442+0000 7f984ffff640 1 -- 172.21.15.84:0/2253360704 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9850021040 con 0x55cd6c411390 2024-09-21T03:48:36.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.442+0000 7f9873323740 1 -- 172.21.15.84:0/2253360704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 msgr2=0x55cd6c7e68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:36.449 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.442+0000 7f9873323740 1 --2- 172.21.15.84:0/2253360704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 0x55cd6c7e68e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f985000fc30 tx=0x7f985000b440 comp rx=0 tx=0).stop 2024-09-21T03:48:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.442+0000 7f9873323740 1 -- 172.21.15.84:0/2253360704 shutdown_connections 2024-09-21T03:48:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.443+0000 7f9873323740 1 --2- 172.21.15.84:0/2253360704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c432070 0x55cd6c7d6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.443+0000 7f9873323740 1 --2- 172.21.15.84:0/2253360704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 0x55cd6c7e68e0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.443+0000 7f9873323740 1 --2- 172.21.15.84:0/2253360704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c4091b0 0x55cd6c7e3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.443+0000 7f9873323740 1 -- 172.21.15.84:0/2253360704 >> 172.21.15.84:0/2253360704 conn(0x55cd6c426460 msgr2=0x55cd6c7e61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.443+0000 7f9873323740 1 -- 172.21.15.84:0/2253360704 shutdown_connections 2024-09-21T03:48:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.443+0000 7f9873323740 1 -- 172.21.15.84:0/2253360704 wait complete. 2024-09-21T03:48:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.443+0000 7f9873323740 1 -- start start 2024-09-21T03:48:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.443+0000 7f9873323740 1 Processor -- start 2024-09-21T03:48:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.443+0000 7f9873323740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c4091b0 0x55cd6c7e9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.443+0000 7f9873323740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 0x55cd6c7e9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.443+0000 7f9873323740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c432070 0x55cd6c7e9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.443+0000 7f9873323740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f98681adaa0 con 0x55cd6c411390 2024-09-21T03:48:36.450 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.443+0000 7f9873323740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f98681aef10 con 0x55cd6c432070 2024-09-21T03:48:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.443+0000 7f9873323740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f98681ae170 con 0x55cd6c4091b0 2024-09-21T03:48:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.443+0000 7f9873323740 10 client.0 _ll_register_callbacks cb 0x7f9858005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:48:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.443+0000 7f985ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 0x55cd6c7e9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.443+0000 7f985ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 0x55cd6c7e9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:43828/0 (socket says 172.21.15.84:43828) 2024-09-21T03:48:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.444+0000 7f985ffff640 1 -- 172.21.15.84:0/3222795137 learned_addr learned my addr 172.21.15.84:0/3222795137 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:48:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.444+0000 7f9866d9d640 1 --2- 172.21.15.84:0/3222795137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c432070 0x55cd6c7e9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.444+0000 7f986659c640 1 --2- 172.21.15.84:0/3222795137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c4091b0 0x55cd6c7e9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.444+0000 7f985ffff640 1 -- 172.21.15.84:0/3222795137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c4091b0 msgr2=0x55cd6c7e9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.444+0000 7f985ffff640 1 --2- 172.21.15.84:0/3222795137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c4091b0 0x55cd6c7e9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.451 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.444+0000 7f985ffff640 1 -- 172.21.15.84:0/3222795137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c432070 msgr2=0x55cd6c7e9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.444+0000 7f985ffff640 1 --2- 172.21.15.84:0/3222795137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c432070 0x55cd6c7e9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.444+0000 7f985ffff640 1 -- 172.21.15.84:0/3222795137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd6c860ae0 con 0x55cd6c411390 2024-09-21T03:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.444+0000 7f986659c640 1 --2- 172.21.15.84:0/3222795137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c4091b0 0x55cd6c7e9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.444+0000 7f9866d9d640 1 --2- 172.21.15.84:0/3222795137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c432070 0x55cd6c7e9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.444+0000 7f985ffff640 1 --2- 172.21.15.84:0/3222795137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 0x55cd6c7e9790 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f985000bb40 tx=0x7f9850004930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2dc8559cc3c0b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.444+0000 7f984dffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.444+0000 7f984dffb640 1 -- 172.21.15.84:0/3222795137 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9850033070 con 0x55cd6c411390 2024-09-21T03:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.444+0000 7f984dffb640 1 -- 172.21.15.84:0/3222795137 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8397+0+0 (secure 0 0 0) 0x7f9850004ca0 con 0x55cd6c411390 2024-09-21T03:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.444+0000 7f9873323740 1 -- 172.21.15.84:0/3222795137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9850004640 con 0x55cd6c411390 2024-09-21T03:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.444+0000 7f984dffb640 1 -- 172.21.15.84:0/3222795137 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9850015050 con 0x55cd6c411390 2024-09-21T03:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.444+0000 7f9873323740 10 client.16623 fetch_fsmap learned FSMap version 25 2024-09-21T03:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.444+0000 7f9873323740 1 -- 172.21.15.84:0/3222795137 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cd6c866180 con 0x55cd6c411390 2024-09-21T03:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.445+0000 7f984dffb640 1 -- 172.21.15.84:0/3222795137 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9850004640 con 0x55cd6c411390 2024-09-21T03:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.445+0000 7f984dffb640 1 -- 172.21.15.84:0/3222795137 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f985001a990 con 0x55cd6c411390 2024-09-21T03:48:36.452 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.445+0000 7f9873323740 10 client.16623 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:48:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.445+0000 7f9873323740 10 client.16623 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:48:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.445+0000 7f9873323740 20 client.16623 populate_metadata read hostname 'smithi084' 2024-09-21T03:48:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.445+0000 7f9873323740 1 --2- 172.21.15.84:0/3222795137 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55cd6c3c5da0 0x55cd6c8686b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:48:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.445+0000 7f9873323740 4 client.16623 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:48:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.445+0000 7f9873323740 1 -- 172.21.15.84:0/3222795137 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cd6c74d850 con 0x55cd6c3c5da0 2024-09-21T03:48:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.445+0000 7f986659c640 1 --2- 172.21.15.84:0/3222795137 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55cd6c3c5da0 0x55cd6c8686b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:48:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.445+0000 7f986659c640 1 --2- 172.21.15.84:0/3222795137 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55cd6c3c5da0 0x55cd6c8686b0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=480bffd9776591df server_cookie=77c3cd0ad087a946 in_seq=0 out_seq=0 2024-09-21T03:48:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.445+0000 7f984dffb640 10 client.16623 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:48:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.446+0000 7f984dffb640 1 -- 172.21.15.84:0/3222795137 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x55cd6c74d850 con 0x55cd6c3c5da0 2024-09-21T03:48:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.446+0000 7f984dffb640 10 client.16623 handle_command_reply: tid=0 2024-09-21T03:48:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.446+0000 7f9873323740 1 client.16623 shutdown 2024-09-21T03:48:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.446+0000 7f9873323740 1 -- 172.21.15.84:0/3222795137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 msgr2=0x55cd6c7e9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:36.453 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.446+0000 7f9873323740 1 --2- 172.21.15.84:0/3222795137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 0x55cd6c7e9790 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f985000bb40 tx=0x7f9850004930 comp rx=0 tx=0).stop 2024-09-21T03:48:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.446+0000 7f9873323740 1 -- 172.21.15.84:0/3222795137 shutdown_connections 2024-09-21T03:48:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.446+0000 7f9873323740 1 --2- 172.21.15.84:0/3222795137 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55cd6c3c5da0 0x55cd6c8686b0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.446+0000 7f9873323740 1 --2- 172.21.15.84:0/3222795137 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cd6c432070 0x55cd6c7e9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.446+0000 7f9873323740 1 --2- 172.21.15.84:0/3222795137 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55cd6c411390 0x55cd6c7e9790 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.446+0000 7f9873323740 1 --2- 172.21.15.84:0/3222795137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cd6c4091b0 0x55cd6c7e9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.446+0000 7f9873323740 1 -- 172.21.15.84:0/3222795137 >> 172.21.15.84:0/3222795137 conn(0x55cd6c426460 msgr2=0x55cd6c7da5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.446+0000 7f984dffb640 0 client.16623 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:48:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.446+0000 7f9873323740 1 -- 172.21.15.84:0/3222795137 shutdown_connections 2024-09-21T03:48:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.446+0000 7f9873323740 1 -- 172.21.15.84:0/3222795137 wait complete. 2024-09-21T03:48:36.454 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.446+0000 7f9873323740 20 client.16623 trim_cache size 0 max 16384 2024-09-21T03:48:36.454 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:48:36.455 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:48:36.455 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T03:48:36.455 INFO:teuthology.orchestra.run.smithi084.stdout: "b2063a70-0b1f-4b6b-9c96-d886e156ea66": { 2024-09-21T03:48:36.455 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:36.455 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "b2063a70-0b1f-4b6b-9c96-d886e156ea66", 2024-09-21T03:48:36.455 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T03:48:36.455 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:48:36.455 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:48:36.455 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:48:36.455 INFO:teuthology.orchestra.run.smithi084.stdout: "b2063a70-0b1f-4b6b-9c96-d886e156ea66": { 2024-09-21T03:48:36.455 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:48:34.864478+0000", 2024-09-21T03:48:36.455 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:36.455 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:36.455 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:36.456 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:36.456 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:36.456 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:48:36.456 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:48:36.456 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:48:36.456 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:36.456 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:36.456 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:36.456 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:36.456 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:36.456 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:48:36.456 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:48:36.456 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:48:36.456 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:36.456 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:36.457 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:36.457 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:36.457 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:36.457 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:48:36.457 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:48:36.457 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:48:36.457 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:36.457 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:36.457 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:36.457 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:36.457 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:36.457 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:48:36.457 INFO:teuthology.orchestra.run.smithi084.stdout: "27dcb84c-89fa-46b2-b980-58857966c697": { 2024-09-21T03:48:36.457 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:52.598527+0000", 2024-09-21T03:48:36.457 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:36.458 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:36.458 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:36.458 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:36.458 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:36.458 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:48:36.458 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:48:36.458 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:48:36.458 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:36.458 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:36.458 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:36.458 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:36.458 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:36.458 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:48:36.458 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:48:36.458 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:48:36.459 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:36.459 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:36.459 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:36.459 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:36.459 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:36.459 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:48:36.459 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:48:36.459 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:48:36.459 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:36.459 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:36.459 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:36.459 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:36.459 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:36.459 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:48:36.459 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:48:36.460 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:48:36.460 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:36.460 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:36.460 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:36.460 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:36.460 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:36.460 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:48:36.460 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:48:36.460 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:48:36.460 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:36.460 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:36.460 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:36.460 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:36.460 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:36.460 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:48:36.460 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:48:36.461 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:48:36.461 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:48:36.461 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:48:36.461 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:48:36.461 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:48:36.461 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:48:36.461 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:48:36.461 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:48:36.461 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:48:36.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.447+0000 7f986cdaf640 1 -- 172.21.15.84:0/1385716872 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f98540b6680 msgr2=0x7f98540b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:36.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.447+0000 7f986cdaf640 1 --2- 172.21.15.84:0/1385716872 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f98540b6680 0x7f98540b8b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9860005fd0 tx=0x7f9860009500 comp rx=0 tx=0).stop 2024-09-21T03:48:36.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.447+0000 7f986cdaf640 1 -- 172.21.15.84:0/1385716872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9868103bb0 msgr2=0x7f986819a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:48:36.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.447+0000 7f986cdaf640 1 --2- 172.21.15.84:0/1385716872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9868103bb0 0x7f986819a4d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f9858005940 tx=0x7f9858004270 comp rx=0 tx=0).stop 2024-09-21T03:48:36.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.447+0000 7f986cdaf640 1 -- 172.21.15.84:0/1385716872 shutdown_connections 2024-09-21T03:48:36.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.447+0000 7f986cdaf640 1 --2- 172.21.15.84:0/1385716872 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f98540b6680 0x7f98540b8b90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.447+0000 7f986cdaf640 1 --2- 172.21.15.84:0/1385716872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9868109e40 0x7f986819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.447+0000 7f986cdaf640 1 --2- 172.21.15.84:0/1385716872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f98681094f0 0x7f986819aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.447+0000 7f986cdaf640 1 --2- 172.21.15.84:0/1385716872 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9868103bb0 0x7f986819a4d0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:48:36.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.447+0000 7f986cdaf640 1 -- 172.21.15.84:0/1385716872 >> 172.21.15.84:0/1385716872 conn(0x7f98680ff600 msgr2=0x7f9868101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:48:36.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.447+0000 7f986cdaf640 1 -- 172.21.15.84:0/1385716872 shutdown_connections 2024-09-21T03:48:36.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:48:36.447+0000 7f986cdaf640 1 -- 172.21.15.84:0/1385716872 wait complete. 2024-09-21T03:48:37.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:36 smithi084 ceph-mon[30941]: pgmap v508: 97 pgs: 97 active+clean; 9.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 10 op/s 2024-09-21T03:48:37.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:36 smithi174 ceph-mon[34403]: pgmap v508: 97 pgs: 97 active+clean; 9.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 10 op/s 2024-09-21T03:48:37.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:36 smithi172 ceph-mon[34821]: pgmap v508: 97 pgs: 97 active+clean; 9.3 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 10 op/s 2024-09-21T03:48:37.212 INFO:tasks.cephfs.filesystem:scrub status for tag:b2063a70-0b1f-4b6b-9c96-d886e156ea66 - {'path': '/', 'tag': 'b2063a70-0b1f-4b6b-9c96-d886e156ea66', 'options': 'recursive,force'} 2024-09-21T03:48:38.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:38 smithi084 ceph-mon[30941]: pgmap v509: 97 pgs: 97 active+clean; 9.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-21T03:48:38.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:38 smithi174 ceph-mon[34403]: pgmap v509: 97 pgs: 97 active+clean; 9.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-21T03:48:38.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:38 smithi172 ceph-mon[34821]: pgmap v509: 97 pgs: 97 active+clean; 9.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 15 op/s 2024-09-21T03:48:40.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:39 smithi084 ceph-mon[30941]: scrub summary: idle 2024-09-21T03:48:40.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:39 smithi174 ceph-mon[34403]: scrub summary: idle 2024-09-21T03:48:40.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:39 smithi172 ceph-mon[34821]: scrub summary: idle 2024-09-21T03:48:41.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:40 smithi084 ceph-mon[30941]: pgmap v510: 97 pgs: 97 active+clean; 9.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 10 op/s 2024-09-21T03:48:41.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:40 smithi174 ceph-mon[34403]: pgmap v510: 97 pgs: 97 active+clean; 9.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 10 op/s 2024-09-21T03:48:41.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:40 smithi172 ceph-mon[34821]: pgmap v510: 97 pgs: 97 active+clean; 9.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 10 op/s 2024-09-21T03:48:42.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:42 smithi084 ceph-mon[30941]: pgmap v511: 97 pgs: 97 active+clean; 9.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-09-21T03:48:42.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:42 smithi174 ceph-mon[34403]: pgmap v511: 97 pgs: 97 active+clean; 9.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-09-21T03:48:42.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:42 smithi172 ceph-mon[34821]: pgmap v511: 97 pgs: 97 active+clean; 9.5 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-09-21T03:48:43.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:43 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:48:43.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:43 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:43.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:43 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:43.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:43 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:48:43.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:43 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:48:43.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:43 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:43.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:43 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:43.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:43 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:48:43.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:43 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:48:43.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:43 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:48:43.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:43 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:48:43.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:43 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:48:44.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:44 smithi084 ceph-mon[30941]: pgmap v512: 97 pgs: 97 active+clean; 9.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 11 op/s 2024-09-21T03:48:44.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:44 smithi174 ceph-mon[34403]: pgmap v512: 97 pgs: 97 active+clean; 9.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 11 op/s 2024-09-21T03:48:44.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:44 smithi172 ceph-mon[34821]: pgmap v512: 97 pgs: 97 active+clean; 9.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 11 op/s 2024-09-21T03:48:46.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:46 smithi084 ceph-mon[30941]: pgmap v513: 97 pgs: 97 active+clean; 9.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 11 op/s 2024-09-21T03:48:46.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:46 smithi174 ceph-mon[34403]: pgmap v513: 97 pgs: 97 active+clean; 9.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 11 op/s 2024-09-21T03:48:46.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:46 smithi172 ceph-mon[34821]: pgmap v513: 97 pgs: 97 active+clean; 9.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 11 op/s 2024-09-21T03:48:48.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:48 smithi084 ceph-mon[30941]: pgmap v514: 97 pgs: 97 active+clean; 9.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 15 op/s 2024-09-21T03:48:48.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:48 smithi174 ceph-mon[34403]: pgmap v514: 97 pgs: 97 active+clean; 9.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 15 op/s 2024-09-21T03:48:48.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:48 smithi172 ceph-mon[34821]: pgmap v514: 97 pgs: 97 active+clean; 9.9 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 15 op/s 2024-09-21T03:48:50.008 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.008 INFO:tasks.workunit.client.0.smithi084.stdout:251/600: open fd = 3 2024-09-21T03:48:50.009 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.009 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.009 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.009 INFO:tasks.workunit.client.0.smithi084.stdout:252/600: open fd = 3 2024-09-21T03:48:50.009 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.009 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.010 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.010 INFO:tasks.workunit.client.0.smithi084.stdout:253/600: open fd = 3 2024-09-21T03:48:50.010 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.010 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.010 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.010 INFO:tasks.workunit.client.0.smithi084.stdout:254/600: open fd = 3 2024-09-21T03:48:50.011 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.011 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.011 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.011 INFO:tasks.workunit.client.0.smithi084.stdout:255/600: open fd = 3 2024-09-21T03:48:50.011 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.011 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.011 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.012 INFO:tasks.workunit.client.0.smithi084.stdout:256/600: open fd = 3 2024-09-21T03:48:50.012 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.012 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.012 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.012 INFO:tasks.workunit.client.0.smithi084.stdout:257/600: open fd = 3 2024-09-21T03:48:50.012 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.012 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.012 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.012 INFO:tasks.workunit.client.0.smithi084.stdout:258/600: open fd = 3 2024-09-21T03:48:50.012 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.013 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.013 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.013 INFO:tasks.workunit.client.0.smithi084.stdout:259/600: open fd = 3 2024-09-21T03:48:50.013 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.013 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.013 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.013 INFO:tasks.workunit.client.0.smithi084.stdout:260/600: open fd = 3 2024-09-21T03:48:50.013 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.013 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.014 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.014 INFO:tasks.workunit.client.0.smithi084.stdout:261/600: open fd = 3 2024-09-21T03:48:50.014 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.014 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.014 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.014 INFO:tasks.workunit.client.0.smithi084.stdout:262/600: open fd = 3 2024-09-21T03:48:50.014 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.014 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.015 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.015 INFO:tasks.workunit.client.0.smithi084.stdout:263/600: open fd = 3 2024-09-21T03:48:50.015 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.015 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.015 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.015 INFO:tasks.workunit.client.0.smithi084.stdout:264/600: open fd = 3 2024-09-21T03:48:50.015 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.015 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.016 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.016 INFO:tasks.workunit.client.0.smithi084.stdout:265/600: open fd = 3 2024-09-21T03:48:50.016 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.016 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.016 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.016 INFO:tasks.workunit.client.0.smithi084.stdout:266/600: open fd = 3 2024-09-21T03:48:50.016 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.016 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.016 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.016 INFO:tasks.workunit.client.0.smithi084.stdout:267/600: open fd = 3 2024-09-21T03:48:50.017 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.017 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.017 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.017 INFO:tasks.workunit.client.0.smithi084.stdout:268/600: open fd = 3 2024-09-21T03:48:50.017 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.017 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.017 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.017 INFO:tasks.workunit.client.0.smithi084.stdout:269/600: open fd = 3 2024-09-21T03:48:50.017 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.017 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.017 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.017 INFO:tasks.workunit.client.0.smithi084.stdout:270/600: open fd = 3 2024-09-21T03:48:50.017 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.018 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.018 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.018 INFO:tasks.workunit.client.0.smithi084.stdout:271/600: open fd = 3 2024-09-21T03:48:50.018 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.018 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.018 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.018 INFO:tasks.workunit.client.0.smithi084.stdout:272/600: open fd = 3 2024-09-21T03:48:50.018 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.018 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.018 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.018 INFO:tasks.workunit.client.0.smithi084.stdout:273/600: open fd = 3 2024-09-21T03:48:50.018 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.018 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.018 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.019 INFO:tasks.workunit.client.0.smithi084.stdout:274/600: open fd = 3 2024-09-21T03:48:50.019 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.019 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.019 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.019 INFO:tasks.workunit.client.0.smithi084.stdout:275/600: open fd = 3 2024-09-21T03:48:50.019 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.019 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.019 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.019 INFO:tasks.workunit.client.0.smithi084.stdout:276/600: open fd = 3 2024-09-21T03:48:50.019 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.019 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.019 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.019 INFO:tasks.workunit.client.0.smithi084.stdout:277/600: open fd = 3 2024-09-21T03:48:50.019 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.020 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.020 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.020 INFO:tasks.workunit.client.0.smithi084.stdout:278/600: open fd = 3 2024-09-21T03:48:50.020 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.020 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.020 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.020 INFO:tasks.workunit.client.0.smithi084.stdout:279/600: open fd = 3 2024-09-21T03:48:50.020 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.020 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.020 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.020 INFO:tasks.workunit.client.0.smithi084.stdout:280/600: open fd = 3 2024-09-21T03:48:50.020 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.020 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.020 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.021 INFO:tasks.workunit.client.0.smithi084.stdout:281/600: open fd = 3 2024-09-21T03:48:50.021 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.021 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.021 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.021 INFO:tasks.workunit.client.0.smithi084.stdout:282/600: open fd = 3 2024-09-21T03:48:50.021 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.021 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.021 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.021 INFO:tasks.workunit.client.0.smithi084.stdout:283/600: open fd = 3 2024-09-21T03:48:50.021 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.021 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.021 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.021 INFO:tasks.workunit.client.0.smithi084.stdout:284/600: open fd = 3 2024-09-21T03:48:50.021 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.022 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.022 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.022 INFO:tasks.workunit.client.0.smithi084.stdout:285/600: open fd = 3 2024-09-21T03:48:50.022 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.022 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.022 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.022 INFO:tasks.workunit.client.0.smithi084.stdout:286/600: open fd = 3 2024-09-21T03:48:50.022 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.022 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.022 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.022 INFO:tasks.workunit.client.0.smithi084.stdout:287/600: open fd = 3 2024-09-21T03:48:50.022 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.023 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.023 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.023 INFO:tasks.workunit.client.0.smithi084.stdout:288/600: open fd = 3 2024-09-21T03:48:50.023 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.023 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.023 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.023 INFO:tasks.workunit.client.0.smithi084.stdout:289/600: open fd = 3 2024-09-21T03:48:50.023 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.023 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.023 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.023 INFO:tasks.workunit.client.0.smithi084.stdout:290/600: open fd = 3 2024-09-21T03:48:50.023 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.023 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.023 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.023 INFO:tasks.workunit.client.0.smithi084.stdout:291/600: open fd = 3 2024-09-21T03:48:50.024 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.024 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.024 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.024 INFO:tasks.workunit.client.0.smithi084.stdout:292/600: open fd = 3 2024-09-21T03:48:50.024 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.024 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.024 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.024 INFO:tasks.workunit.client.0.smithi084.stdout:293/600: open fd = 3 2024-09-21T03:48:50.024 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.024 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.024 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.024 INFO:tasks.workunit.client.0.smithi084.stdout:294/600: open fd = 3 2024-09-21T03:48:50.024 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.024 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.025 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.025 INFO:tasks.workunit.client.0.smithi084.stdout:295/600: open fd = 3 2024-09-21T03:48:50.025 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.025 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.025 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.025 INFO:tasks.workunit.client.0.smithi084.stdout:296/600: open fd = 3 2024-09-21T03:48:50.025 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.025 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.025 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.025 INFO:tasks.workunit.client.0.smithi084.stdout:297/600: open fd = 3 2024-09-21T03:48:50.025 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.025 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.025 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.025 INFO:tasks.workunit.client.0.smithi084.stdout:298/600: open fd = 3 2024-09-21T03:48:50.026 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.026 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.026 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.026 INFO:tasks.workunit.client.0.smithi084.stdout:299/600: open fd = 3 2024-09-21T03:48:50.026 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.026 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.026 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.026 INFO:tasks.workunit.client.0.smithi084.stdout:300/600: open fd = 3 2024-09-21T03:48:50.026 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.026 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.026 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.026 INFO:tasks.workunit.client.0.smithi084.stdout:301/600: open fd = 3 2024-09-21T03:48:50.026 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.026 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.026 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.027 INFO:tasks.workunit.client.0.smithi084.stdout:302/600: open fd = 3 2024-09-21T03:48:50.027 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.027 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.027 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.027 INFO:tasks.workunit.client.0.smithi084.stdout:303/600: open fd = 3 2024-09-21T03:48:50.027 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.027 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.027 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.027 INFO:tasks.workunit.client.0.smithi084.stdout:304/600: open fd = 3 2024-09-21T03:48:50.027 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.027 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.027 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.027 INFO:tasks.workunit.client.0.smithi084.stdout:305/600: open fd = 3 2024-09-21T03:48:50.027 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.028 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.028 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.028 INFO:tasks.workunit.client.0.smithi084.stdout:306/600: open fd = 3 2024-09-21T03:48:50.028 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.028 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.028 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.028 INFO:tasks.workunit.client.0.smithi084.stdout:307/600: open fd = 3 2024-09-21T03:48:50.028 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.028 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.028 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.028 INFO:tasks.workunit.client.0.smithi084.stdout:308/600: open fd = 3 2024-09-21T03:48:50.028 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.028 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.028 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.029 INFO:tasks.workunit.client.0.smithi084.stdout:309/600: open fd = 3 2024-09-21T03:48:50.029 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.029 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.029 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.029 INFO:tasks.workunit.client.0.smithi084.stdout:310/600: open fd = 3 2024-09-21T03:48:50.029 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.029 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.029 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.029 INFO:tasks.workunit.client.0.smithi084.stdout:311/600: open fd = 3 2024-09-21T03:48:50.029 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.029 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.029 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:48:50.029 INFO:tasks.workunit.client.0.smithi084.stdout:312/600: open fd = 3 2024-09-21T03:48:50.029 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.029 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:48:50.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:50 smithi084 ceph-mon[30941]: pgmap v515: 97 pgs: 97 active+clean; 9.9 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-21T03:48:50.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:50 smithi174 ceph-mon[34403]: pgmap v515: 97 pgs: 97 active+clean; 9.9 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-21T03:48:50.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:50 smithi172 ceph-mon[34821]: pgmap v515: 97 pgs: 97 active+clean; 9.9 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-21T03:48:52.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:52 smithi084 ceph-mon[30941]: pgmap v516: 97 pgs: 97 active+clean; 9.9 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-09-21T03:48:52.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:52 smithi174 ceph-mon[34403]: pgmap v516: 97 pgs: 97 active+clean; 9.9 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-09-21T03:48:52.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:52 smithi172 ceph-mon[34821]: pgmap v516: 97 pgs: 97 active+clean; 9.9 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 11 op/s 2024-09-21T03:48:54.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:54 smithi084 ceph-mon[30941]: pgmap v517: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 12 op/s 2024-09-21T03:48:54.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:54 smithi174 ceph-mon[34403]: pgmap v517: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 12 op/s 2024-09-21T03:48:54.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:54 smithi172 ceph-mon[34821]: pgmap v517: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 12 op/s 2024-09-21T03:48:56.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:56 smithi084 ceph-mon[30941]: pgmap v518: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-09-21T03:48:56.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:56 smithi174 ceph-mon[34403]: pgmap v518: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-09-21T03:48:56.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:56 smithi172 ceph-mon[34821]: pgmap v518: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-09-21T03:48:58.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:48:58 smithi084 ceph-mon[30941]: pgmap v519: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 14 op/s 2024-09-21T03:48:58.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:48:58 smithi174 ceph-mon[34403]: pgmap v519: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 14 op/s 2024-09-21T03:48:58.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:48:58 smithi172 ceph-mon[34821]: pgmap v519: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 14 op/s 2024-09-21T03:49:00.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:00 smithi084 ceph-mon[30941]: pgmap v520: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-21T03:49:00.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:00 smithi174 ceph-mon[34403]: pgmap v520: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-21T03:49:00.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:00 smithi172 ceph-mon[34821]: pgmap v520: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-09-21T03:49:02.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:02 smithi084 ceph-mon[30941]: pgmap v521: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 57 KiB/s wr, 13 op/s 2024-09-21T03:49:02.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:02 smithi174 ceph-mon[34403]: pgmap v521: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 57 KiB/s wr, 13 op/s 2024-09-21T03:49:02.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:02 smithi172 ceph-mon[34821]: pgmap v521: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 57 KiB/s wr, 13 op/s 2024-09-21T03:49:04.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:04 smithi084 ceph-mon[30941]: pgmap v522: 97 pgs: 97 active+clean; 10 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 97 KiB/s wr, 29 op/s 2024-09-21T03:49:04.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:04 smithi174 ceph-mon[34403]: pgmap v522: 97 pgs: 97 active+clean; 10 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 97 KiB/s wr, 29 op/s 2024-09-21T03:49:04.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:04 smithi172 ceph-mon[34821]: pgmap v522: 97 pgs: 97 active+clean; 10 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 97 KiB/s wr, 29 op/s 2024-09-21T03:49:06.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:06 smithi084 ceph-mon[30941]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T03:49:06.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:06 smithi084 ceph-mon[30941]: pgmap v524: 97 pgs: 97 active+clean; 10 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 97 KiB/s wr, 32 op/s 2024-09-21T03:49:06.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:06 smithi174 ceph-mon[34403]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T03:49:06.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:06 smithi174 ceph-mon[34403]: pgmap v524: 97 pgs: 97 active+clean; 10 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 97 KiB/s wr, 32 op/s 2024-09-21T03:49:06.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:06 smithi172 ceph-mon[34821]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T03:49:06.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:06 smithi172 ceph-mon[34821]: pgmap v524: 97 pgs: 97 active+clean; 10 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 97 KiB/s wr, 32 op/s 2024-09-21T03:49:07.213 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:49:07.477 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:49:08.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.991+0000 7f999e828640 1 -- 172.21.15.84:0/1363488209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9998102a80 msgr2=0x7f9998102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:08.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.991+0000 7f999e828640 1 --2- 172.21.15.84:0/1363488209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9998102a80 0x7f9998102e90 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9988009900 tx=0x7f998802a410 comp rx=0 tx=0).stop 2024-09-21T03:49:08.002 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.991+0000 7f999e828640 1 -- 172.21.15.84:0/1363488209 shutdown_connections 2024-09-21T03:49:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.991+0000 7f999e828640 1 --2- 172.21.15.84:0/1363488209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9998108d10 0x7f999810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.991+0000 7f999e828640 1 --2- 172.21.15.84:0/1363488209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99981083c0 0x7f99981087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.991+0000 7f999e828640 1 --2- 172.21.15.84:0/1363488209 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9998102a80 0x7f9998102e90 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.991+0000 7f999e828640 1 -- 172.21.15.84:0/1363488209 >> 172.21.15.84:0/1363488209 conn(0x7f9998079740 msgr2=0x7f9998079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.991+0000 7f999e828640 1 -- 172.21.15.84:0/1363488209 shutdown_connections 2024-09-21T03:49:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.991+0000 7f999e828640 1 -- 172.21.15.84:0/1363488209 wait complete. 2024-09-21T03:49:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.992+0000 7f999e828640 1 Processor -- start 2024-09-21T03:49:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.992+0000 7f999e828640 1 -- start start 2024-09-21T03:49:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.993+0000 7f999e828640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9998102a80 0x7f999819b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.993+0000 7f999e828640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99981083c0 0x7f999819b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.993+0000 7f999e828640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9998108d10 0x7f999819bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:08.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.993+0000 7f999e828640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9998112980 con 0x7f9998108d10 2024-09-21T03:49:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.993+0000 7f999e828640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9998112800 con 0x7f99981083c0 2024-09-21T03:49:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.993+0000 7f999e828640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9998112b00 con 0x7f9998102a80 2024-09-21T03:49:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.993+0000 7f999cdc5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9998108d10 0x7f999819bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.993+0000 7f999cdc5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9998108d10 0x7f999819bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48074/0 (socket says 172.21.15.84:48074) 2024-09-21T03:49:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.993+0000 7f999cdc5640 1 -- 172.21.15.84:0/4111401644 learned_addr learned my addr 172.21.15.84:0/4111401644 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.993+0000 7f99977fe640 1 --2- 172.21.15.84:0/4111401644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99981083c0 0x7f999819b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.993+0000 7f9997fff640 1 --2- 172.21.15.84:0/4111401644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9998102a80 0x7f999819b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.993+0000 7f999cdc5640 1 -- 172.21.15.84:0/4111401644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9998102a80 msgr2=0x7f999819b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.993+0000 7f999cdc5640 1 --2- 172.21.15.84:0/4111401644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9998102a80 0x7f999819b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.993+0000 7f999cdc5640 1 -- 172.21.15.84:0/4111401644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99981083c0 msgr2=0x7f999819b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.993+0000 7f999cdc5640 1 --2- 172.21.15.84:0/4111401644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99981083c0 0x7f999819b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.993+0000 7f999cdc5640 1 -- 172.21.15.84:0/4111401644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99981a64e0 con 0x7f9998108d10 2024-09-21T03:49:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.994+0000 7f999cdc5640 1 --2- 172.21.15.84:0/4111401644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9998108d10 0x7f999819bcd0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f999000eaa0 tx=0x7f999000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:08.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.994+0000 7f99957fa640 1 -- 172.21.15.84:0/4111401644 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999000cdb0 con 0x7f9998108d10 2024-09-21T03:49:08.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.994+0000 7f999e828640 1 -- 172.21.15.84:0/4111401644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99981a67d0 con 0x7f9998108d10 2024-09-21T03:49:08.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.994+0000 7f99957fa640 1 -- 172.21.15.84:0/4111401644 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9990005020 con 0x7f9998108d10 2024-09-21T03:49:08.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.994+0000 7f99957fa640 1 -- 172.21.15.84:0/4111401644 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99900116d0 con 0x7f9998108d10 2024-09-21T03:49:08.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.994+0000 7f999e828640 1 -- 172.21.15.84:0/4111401644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99981a6d10 con 0x7f9998108d10 2024-09-21T03:49:08.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.996+0000 7f99a4d9c740 1 Processor -- start 2024-09-21T03:49:08.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.997+0000 7f99957fa640 1 -- 172.21.15.84:0/4111401644 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f9990011870 con 0x7f9998108d10 2024-09-21T03:49:08.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.997+0000 7f99a4d9c740 1 -- start start 2024-09-21T03:49:08.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.997+0000 7f99a4d9c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55db173a4070 0x55db1774b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:08.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.997+0000 7f99a4d9c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db1737b1b0 0x55db1774b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:08.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.997+0000 7f99a4d9c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db17383390 0x55db1774bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:08.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.997+0000 7f99a4d9c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55db176c1e50 con 0x55db17383390 2024-09-21T03:49:08.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.997+0000 7f99a4d9c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55db176b1280 con 0x55db1737b1b0 2024-09-21T03:49:08.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.997+0000 7f99a4d9c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55db176b5090 con 0x55db173a4070 2024-09-21T03:49:08.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.997+0000 7f99977fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db17383390 0x55db1774bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.997+0000 7f9997fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db1737b1b0 0x55db1774b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.997+0000 7f99977fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db17383390 0x55db1774bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48082/0 (socket says 172.21.15.84:48082) 2024-09-21T03:49:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.997+0000 7f99977fe640 1 -- 172.21.15.84:0/1740066717 learned_addr learned my addr 172.21.15.84:0/1740066717 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.997+0000 7f99957fa640 1 --2- 172.21.15.84:0/4111401644 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f99800b66b0 0x7f99800b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.997+0000 7f9997fff640 1 -- 172.21.15.84:0/1740066717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55db173a4070 msgr2=0x55db1774b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.997+0000 7f9997fff640 1 --2- 172.21.15.84:0/1740066717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55db173a4070 0x55db1774b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.997+0000 7f9997fff640 1 -- 172.21.15.84:0/1740066717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db17383390 msgr2=0x55db1774bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.997+0000 7f9997fff640 1 --2- 172.21.15.84:0/1740066717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db17383390 0x55db1774bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.997+0000 7f9997fff640 1 -- 172.21.15.84:0/1740066717 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db1740f650 con 0x55db1737b1b0 2024-09-21T03:49:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.997+0000 7f999cdc5640 1 --2- 172.21.15.84:0/4111401644 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f99800b66b0 0x7f99800b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.998+0000 7f99957fa640 1 -- 172.21.15.84:0/4111401644 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7f99900e77f0 con 0x7f9998108d10 2024-09-21T03:49:08.006 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.998+0000 7f9997fff640 1 --2- 172.21.15.84:0/1740066717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db1737b1b0 0x55db1774b7b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f999806c6a0 tx=0x7f9988032c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77bd3c3372838474 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.998+0000 7f999cdc5640 1 --2- 172.21.15.84:0/4111401644 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f99800b66b0 0x7f99800b8bc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9990009270 tx=0x7f9990084040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.998+0000 7f997e7fc640 1 -- 172.21.15.84:0/1740066717 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998803f070 con 0x55db1737b1b0 2024-09-21T03:49:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.998+0000 7f997e7fc640 1 -- 172.21.15.84:0/1740066717 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9988032e40 con 0x55db1737b1b0 2024-09-21T03:49:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.998+0000 7f997e7fc640 1 -- 172.21.15.84:0/1740066717 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9988035070 con 0x55db1737b1b0 2024-09-21T03:49:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.999+0000 7f99a4d9c740 1 -- 172.21.15.84:0/1740066717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db1737b1b0 msgr2=0x55db1774b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.999+0000 7f99a4d9c740 1 --2- 172.21.15.84:0/1740066717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db1737b1b0 0x55db1774b7b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f999806c6a0 tx=0x7f9988032c50 comp rx=0 tx=0).stop 2024-09-21T03:49:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.999+0000 7f99a4d9c740 1 -- 172.21.15.84:0/1740066717 shutdown_connections 2024-09-21T03:49:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.999+0000 7f99a4d9c740 1 --2- 172.21.15.84:0/1740066717 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db17383390 0x55db1774bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.999+0000 7f99a4d9c740 1 --2- 172.21.15.84:0/1740066717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db1737b1b0 0x55db1774b7b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.999+0000 7f99a4d9c740 1 --2- 172.21.15.84:0/1740066717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55db173a4070 0x55db1774b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.999+0000 7f99a4d9c740 1 -- 172.21.15.84:0/1740066717 >> 172.21.15.84:0/1740066717 conn(0x55db17398460 msgr2=0x55db17749160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.999+0000 7f99a4d9c740 1 -- 172.21.15.84:0/1740066717 shutdown_connections 2024-09-21T03:49:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:07.999+0000 7f99a4d9c740 1 -- 172.21.15.84:0/1740066717 wait complete. 2024-09-21T03:49:08.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.000+0000 7f99a4d9c740 1 -- start start 2024-09-21T03:49:08.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.000+0000 7f99a4d9c740 1 Processor -- start 2024-09-21T03:49:08.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.001+0000 7f99a4d9c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db1737b1b0 0x55db17756970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:08.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.001+0000 7f99a4d9c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db17383390 0x55db17756eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:08.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.001+0000 7f99a4d9c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55db173a4070 0x55db17762ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:08.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.001+0000 7f99a4d9c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55db17512700 con 0x55db17383390 2024-09-21T03:49:08.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.001+0000 7f99a4d9c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55db1764c110 con 0x55db1737b1b0 2024-09-21T03:49:08.011 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.001+0000 7f99a4d9c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55db177599f0 con 0x55db173a4070 2024-09-21T03:49:08.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.001+0000 7f99a4d9c740 10 client.0 _ll_register_callbacks cb 0x55db17665990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:49:08.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.001+0000 7f9997fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db17383390 0x55db17756eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:08.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.001+0000 7f9997fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db17383390 0x55db17756eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48084/0 (socket says 172.21.15.84:48084) 2024-09-21T03:49:08.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.001+0000 7f9997fff640 1 -- 172.21.15.84:0/1682737017 learned_addr learned my addr 172.21.15.84:0/1682737017 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:08.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.001+0000 7f99977fe640 1 --2- 172.21.15.84:0/1682737017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db1737b1b0 0x55db17756970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:08.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.001+0000 7f99977fe640 1 --2- 172.21.15.84:0/1682737017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55db173a4070 0x55db17762ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:08.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.001+0000 7f9997fff640 1 -- 172.21.15.84:0/1682737017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55db173a4070 msgr2=0x55db17762ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:08.012 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.001+0000 7f9997fff640 1 --2- 172.21.15.84:0/1682737017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55db173a4070 0x55db17762ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.001+0000 7f9997fff640 1 -- 172.21.15.84:0/1682737017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db1737b1b0 msgr2=0x55db17756970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.001+0000 7f9997fff640 1 --2- 172.21.15.84:0/1682737017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db1737b1b0 0x55db17756970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.001+0000 7f9997fff640 1 -- 172.21.15.84:0/1682737017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db17679c40 con 0x55db17383390 2024-09-21T03:49:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.001+0000 7f9997fff640 1 --2- 172.21.15.84:0/1682737017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db17383390 0x55db17756eb0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f998802a450 tx=0x7f99880316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc98d4dd791e534b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.001+0000 7f99777fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:49:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.002+0000 7f99777fe640 1 -- 172.21.15.84:0/1682737017 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9988035070 con 0x55db17383390 2024-09-21T03:49:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.002+0000 7f99777fe640 1 -- 172.21.15.84:0/1682737017 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7f9988004440 con 0x55db17383390 2024-09-21T03:49:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.002+0000 7f99a4d9c740 1 -- 172.21.15.84:0/1682737017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55db176c3da0 con 0x55db17383390 2024-09-21T03:49:08.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.002+0000 7f99777fe640 1 -- 172.21.15.84:0/1682737017 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9988055050 con 0x55db17383390 2024-09-21T03:49:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.002+0000 7f99a4d9c740 10 client.16635 fetch_fsmap learned FSMap version 25 2024-09-21T03:49:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.002+0000 7f99a4d9c740 1 -- 172.21.15.84:0/1682737017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55db17765760 con 0x55db17383390 2024-09-21T03:49:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.002+0000 7f99777fe640 1 -- 172.21.15.84:0/1682737017 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55db176c3da0 con 0x55db17383390 2024-09-21T03:49:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.002+0000 7f99777fe640 1 -- 172.21.15.84:0/1682737017 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f998803b700 con 0x55db17383390 2024-09-21T03:49:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.002+0000 7f99a4d9c740 10 client.16635 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:49:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.002+0000 7f99a4d9c740 10 client.16635 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:49:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.002+0000 7f99a4d9c740 20 client.16635 populate_metadata read hostname 'smithi084' 2024-09-21T03:49:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.002+0000 7f99a4d9c740 1 --2- 172.21.15.84:0/1682737017 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55db173629f0 0x55db17768ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.002+0000 7f99a4d9c740 4 client.16635 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:49:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.002+0000 7f99a4d9c740 1 -- 172.21.15.84:0/1682737017 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db176bf850 con 0x55db173629f0 2024-09-21T03:49:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.003+0000 7f99977fe640 1 --2- 172.21.15.84:0/1682737017 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55db173629f0 0x55db17768ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:08.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.003+0000 7f99777fe640 10 client.16635 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.003+0000 7f99977fe640 1 --2- 172.21.15.84:0/1682737017 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55db173629f0 0x55db17768ac0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3559c17759f2cd11 server_cookie=d1e317dee0df6b3e in_seq=0 out_seq=0 2024-09-21T03:49:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.004+0000 7f99777fe640 1 -- 172.21.15.84:0/1682737017 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55db176bf850 con 0x55db173629f0 2024-09-21T03:49:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.004+0000 7f99777fe640 10 client.16635 handle_command_reply: tid=0 2024-09-21T03:49:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.004+0000 7f99a4d9c740 1 client.16635 shutdown 2024-09-21T03:49:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.004+0000 7f99a4d9c740 1 -- 172.21.15.84:0/1682737017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db17383390 msgr2=0x55db17756eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.004+0000 7f99a4d9c740 1 --2- 172.21.15.84:0/1682737017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db17383390 0x55db17756eb0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f998802a450 tx=0x7f99880316d0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.004+0000 7f99a4d9c740 1 -- 172.21.15.84:0/1682737017 shutdown_connections 2024-09-21T03:49:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.004+0000 7f99a4d9c740 1 --2- 172.21.15.84:0/1682737017 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55db173629f0 0x55db17768ac0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.004+0000 7f99a4d9c740 1 --2- 172.21.15.84:0/1682737017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55db173a4070 0x55db17762ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.004+0000 7f99777fe640 0 client.16635 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.004+0000 7f99a4d9c740 1 --2- 172.21.15.84:0/1682737017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db17383390 0x55db17756eb0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.004+0000 7f99a4d9c740 1 --2- 172.21.15.84:0/1682737017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db1737b1b0 0x55db17756970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.005+0000 7f99a4d9c740 1 -- 172.21.15.84:0/1682737017 >> 172.21.15.84:0/1682737017 conn(0x55db17398460 msgr2=0x55db1774e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.005+0000 7f99a4d9c740 1 -- 172.21.15.84:0/1682737017 shutdown_connections 2024-09-21T03:49:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.005+0000 7f99a4d9c740 1 -- 172.21.15.84:0/1682737017 wait complete. 2024-09-21T03:49:08.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.005+0000 7f99a4d9c740 20 client.16635 trim_cache size 0 max 16384 2024-09-21T03:49:08.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.022+0000 7f99a4d9c740 1 Processor -- start 2024-09-21T03:49:08.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.022+0000 7f99a4d9c740 1 -- start start 2024-09-21T03:49:08.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.022+0000 7f99a4d9c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db173629f0 0x55db1774c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:08.025 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.022+0000 7f99a4d9c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db1737b1b0 0x55db17753b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:08.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.022+0000 7f99a4d9c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55db17383390 0x55db177540a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:08.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.022+0000 7f99a4d9c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f99981b1e50 con 0x55db1737b1b0 2024-09-21T03:49:08.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.022+0000 7f99a4d9c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f99981af720 con 0x55db173629f0 2024-09-21T03:49:08.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.022+0000 7f99a4d9c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f99981ad590 con 0x55db17383390 2024-09-21T03:49:08.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.023+0000 7f9997fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db1737b1b0 0x55db17753b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:08.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.023+0000 7f9997fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db1737b1b0 0x55db17753b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48100/0 (socket says 172.21.15.84:48100) 2024-09-21T03:49:08.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.023+0000 7f9997fff640 1 -- 172.21.15.84:0/2962546284 learned_addr learned my addr 172.21.15.84:0/2962546284 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:08.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.023+0000 7f99977fe640 1 --2- 172.21.15.84:0/2962546284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db173629f0 0x55db1774c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:08.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.023+0000 7f99977fe640 1 --2- 172.21.15.84:0/2962546284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55db17383390 0x55db177540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:08.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.023+0000 7f9997fff640 1 -- 172.21.15.84:0/2962546284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55db17383390 msgr2=0x55db177540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:08.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.023+0000 7f9997fff640 1 --2- 172.21.15.84:0/2962546284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55db17383390 0x55db177540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.026 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.023+0000 7f9997fff640 1 -- 172.21.15.84:0/2962546284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db173629f0 msgr2=0x55db1774c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:08.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.023+0000 7f9997fff640 1 --2- 172.21.15.84:0/2962546284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db173629f0 0x55db1774c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.023+0000 7f9997fff640 1 -- 172.21.15.84:0/2962546284 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db1774d880 con 0x55db1737b1b0 2024-09-21T03:49:08.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.023+0000 7f99977fe640 1 --2- 172.21.15.84:0/2962546284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55db17383390 0x55db177540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:49:08.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.023+0000 7f9997fff640 1 --2- 172.21.15.84:0/2962546284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db1737b1b0 0x55db17753b60 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f998803bad0 tx=0x7f9988032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04b70b7907f3d91 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:08.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.023+0000 7f997dffb640 1 -- 172.21.15.84:0/2962546284 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998805e070 con 0x55db1737b1b0 2024-09-21T03:49:08.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.023+0000 7f997dffb640 1 -- 172.21.15.84:0/2962546284 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f998804c070 con 0x55db1737b1b0 2024-09-21T03:49:08.027 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.023+0000 7f997dffb640 1 -- 172.21.15.84:0/2962546284 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9988035070 con 0x55db1737b1b0 2024-09-21T03:49:08.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.024+0000 7f99a4d9c740 1 -- 172.21.15.84:0/2962546284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db1737b1b0 msgr2=0x55db17753b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:08.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.024+0000 7f99a4d9c740 1 --2- 172.21.15.84:0/2962546284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db1737b1b0 0x55db17753b60 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f998803bad0 tx=0x7f9988032c50 comp rx=0 tx=0).stop 2024-09-21T03:49:08.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.024+0000 7f99a4d9c740 1 -- 172.21.15.84:0/2962546284 shutdown_connections 2024-09-21T03:49:08.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.024+0000 7f99a4d9c740 1 --2- 172.21.15.84:0/2962546284 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55db17383390 0x55db177540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.024+0000 7f99a4d9c740 1 --2- 172.21.15.84:0/2962546284 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db1737b1b0 0x55db17753b60 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.024+0000 7f99a4d9c740 1 --2- 172.21.15.84:0/2962546284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db173629f0 0x55db1774c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.024+0000 7f99a4d9c740 1 -- 172.21.15.84:0/2962546284 >> 172.21.15.84:0/2962546284 conn(0x55db17398460 msgr2=0x55db1774c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:08.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.024+0000 7f99a4d9c740 1 -- 172.21.15.84:0/2962546284 shutdown_connections 2024-09-21T03:49:08.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.024+0000 7f99a4d9c740 1 -- 172.21.15.84:0/2962546284 wait complete. 2024-09-21T03:49:08.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.024+0000 7f99a4d9c740 1 -- start start 2024-09-21T03:49:08.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.025+0000 7f99a4d9c740 1 Processor -- start 2024-09-21T03:49:08.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.025+0000 7f99a4d9c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55db173629f0 0x55db1776bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:08.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.025+0000 7f99a4d9c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db1737b1b0 0x55db1776c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:08.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.025+0000 7f99a4d9c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db17383390 0x55db177c8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:08.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.025+0000 7f99a4d9c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f99981adbe0 con 0x55db17383390 2024-09-21T03:49:08.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.025+0000 7f99a4d9c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f99981af050 con 0x55db1737b1b0 2024-09-21T03:49:08.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.025+0000 7f99a4d9c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f99981ae2b0 con 0x55db173629f0 2024-09-21T03:49:08.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.025+0000 7f99a4d9c740 10 client.0 _ll_register_callbacks cb 0x7f998c00b860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:49:08.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.025+0000 7f99977fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db17383390 0x55db177c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:08.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.025+0000 7f99977fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db17383390 0x55db177c8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48106/0 (socket says 172.21.15.84:48106) 2024-09-21T03:49:08.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.025+0000 7f99977fe640 1 -- 172.21.15.84:0/2373911283 learned_addr learned my addr 172.21.15.84:0/2373911283 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:08.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.025+0000 7f9997fff640 1 --2- 172.21.15.84:0/2373911283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db1737b1b0 0x55db1776c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:08.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.025+0000 7f99977fe640 1 --2- 172.21.15.84:0/2373911283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55db173629f0 0x55db1776bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:08.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.025+0000 7f99977fe640 1 -- 172.21.15.84:0/2373911283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55db173629f0 msgr2=0x55db1776bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:08.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.025+0000 7f99977fe640 1 --2- 172.21.15.84:0/2373911283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55db173629f0 0x55db1776bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.026+0000 7f99977fe640 1 -- 172.21.15.84:0/2373911283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db1737b1b0 msgr2=0x55db1776c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:08.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.026+0000 7f99977fe640 1 --2- 172.21.15.84:0/2373911283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db1737b1b0 0x55db1776c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.026+0000 7f99977fe640 1 -- 172.21.15.84:0/2373911283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db177c8c90 con 0x55db17383390 2024-09-21T03:49:08.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.026+0000 7f99977fe640 1 --2- 172.21.15.84:0/2373911283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db17383390 0x55db177c8620 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f998c005d00 tx=0x7f998c00b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6140d4d64d3231 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:08.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.026+0000 7f99777fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:49:08.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.026+0000 7f99777fe640 1 -- 172.21.15.84:0/2373911283 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f998c012be0 con 0x55db17383390 2024-09-21T03:49:08.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.026+0000 7f99777fe640 1 -- 172.21.15.84:0/2373911283 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7f998c020f90 con 0x55db17383390 2024-09-21T03:49:08.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.026+0000 7f99a4d9c740 1 -- 172.21.15.84:0/2373911283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f998804c070 con 0x55db17383390 2024-09-21T03:49:08.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.026+0000 7f99777fe640 1 -- 172.21.15.84:0/2373911283 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f998c012d80 con 0x55db17383390 2024-09-21T03:49:08.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.026+0000 7f99a4d9c740 10 client.16641 fetch_fsmap learned FSMap version 25 2024-09-21T03:49:08.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.026+0000 7f99a4d9c740 1 -- 172.21.15.84:0/2373911283 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55db177d32d0 con 0x55db17383390 2024-09-21T03:49:08.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.026+0000 7f99777fe640 1 -- 172.21.15.84:0/2373911283 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f998804c070 con 0x55db17383390 2024-09-21T03:49:08.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.027+0000 7f99777fe640 1 -- 172.21.15.84:0/2373911283 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f998c031070 con 0x55db17383390 2024-09-21T03:49:08.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.027+0000 7f99a4d9c740 10 client.16641 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:49:08.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.027+0000 7f99a4d9c740 10 client.16641 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:49:08.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.027+0000 7f99a4d9c740 20 client.16641 populate_metadata read hostname 'smithi084' 2024-09-21T03:49:08.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.027+0000 7f99a4d9c740 1 --2- 172.21.15.84:0/2373911283 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55db173a4070 0x55db177d5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:08.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.027+0000 7f99a4d9c740 4 client.16641 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:49:08.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.027+0000 7f99a4d9c740 1 -- 172.21.15.84:0/2373911283 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55db176bcc80 con 0x55db173a4070 2024-09-21T03:49:08.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.027+0000 7f9997fff640 1 --2- 172.21.15.84:0/2373911283 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55db173a4070 0x55db177d5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.027+0000 7f99777fe640 10 client.16641 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.027+0000 7f9997fff640 1 --2- 172.21.15.84:0/2373911283 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55db173a4070 0x55db177d5ac0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44dc628e2e247447 server_cookie=b01ff043c1310182 in_seq=0 out_seq=0 2024-09-21T03:49:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.028+0000 7f99777fe640 1 -- 172.21.15.84:0/2373911283 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x55db176bcc80 con 0x55db173a4070 2024-09-21T03:49:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.028+0000 7f99777fe640 10 client.16641 handle_command_reply: tid=0 2024-09-21T03:49:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.028+0000 7f99a4d9c740 1 client.16641 shutdown 2024-09-21T03:49:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.028+0000 7f99a4d9c740 1 -- 172.21.15.84:0/2373911283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db17383390 msgr2=0x55db177c8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.028+0000 7f99a4d9c740 1 --2- 172.21.15.84:0/2373911283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db17383390 0x55db177c8620 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f998c005d00 tx=0x7f998c00b410 comp rx=0 tx=0).stop 2024-09-21T03:49:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.028+0000 7f99a4d9c740 1 -- 172.21.15.84:0/2373911283 shutdown_connections 2024-09-21T03:49:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.028+0000 7f99a4d9c740 1 --2- 172.21.15.84:0/2373911283 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55db173a4070 0x55db177d5ac0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.028+0000 7f99a4d9c740 1 --2- 172.21.15.84:0/2373911283 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55db17383390 0x55db177c8620 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.028+0000 7f99a4d9c740 1 --2- 172.21.15.84:0/2373911283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55db1737b1b0 0x55db1776c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.028+0000 7f99a4d9c740 1 --2- 172.21.15.84:0/2373911283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55db173629f0 0x55db1776bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.028+0000 7f99a4d9c740 1 -- 172.21.15.84:0/2373911283 >> 172.21.15.84:0/2373911283 conn(0x55db17398460 msgr2=0x55db1774ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:08.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.028+0000 7f99777fe640 0 client.16641 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:08.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.028+0000 7f99a4d9c740 1 -- 172.21.15.84:0/2373911283 shutdown_connections 2024-09-21T03:49:08.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.028+0000 7f99a4d9c740 1 -- 172.21.15.84:0/2373911283 wait complete. 2024-09-21T03:49:08.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.028+0000 7f99a4d9c740 20 client.16641 trim_cache size 0 max 16384 2024-09-21T03:49:08.036 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:49:08.036 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T03:49:08.036 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T03:49:08.036 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:49:08.036 INFO:teuthology.orchestra.run.smithi084.stdout: "b2063a70-0b1f-4b6b-9c96-d886e156ea66": { 2024-09-21T03:49:08.036 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:48:34.864478+0000", 2024-09-21T03:49:08.036 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:08.037 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:08.037 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:08.037 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:08.037 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:08.037 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:08.037 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:49:08.037 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:49:08.037 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:08.037 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:08.037 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:08.037 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:08.037 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:08.037 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:08.038 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:49:08.038 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:49:08.038 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:08.038 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:08.038 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:08.038 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:08.038 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:08.038 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:08.038 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:49:08.038 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:49:08.038 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:08.038 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:08.038 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:08.039 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:08.039 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:08.039 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:08.039 INFO:teuthology.orchestra.run.smithi084.stdout: "27dcb84c-89fa-46b2-b980-58857966c697": { 2024-09-21T03:49:08.039 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:52.598527+0000", 2024-09-21T03:49:08.039 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:08.039 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:08.039 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:08.039 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:08.039 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:08.039 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:08.039 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:49:08.039 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:49:08.039 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:08.040 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:08.040 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:08.040 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:08.040 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:08.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:08.040 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:49:08.040 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:49:08.040 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:08.040 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:08.040 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:08.040 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:08.040 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:08.040 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:08.041 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:49:08.041 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:49:08.041 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:08.041 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:08.041 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:08.041 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:08.041 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:08.041 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:08.041 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:49:08.041 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:49:08.041 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:08.041 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:08.041 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:08.041 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:08.041 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:08.042 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:08.042 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:49:08.042 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:49:08.042 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:08.042 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:08.042 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:08.042 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:08.042 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:08.042 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:08.042 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:49:08.042 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:49:08.042 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:08.042 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:08.043 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:08.043 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:08.043 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:08.043 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:49:08.043 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:49:08.043 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:49:08.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.029+0000 7f999e828640 1 -- 172.21.15.84:0/4111401644 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f99800b66b0 msgr2=0x7f99800b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:08.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.029+0000 7f999e828640 1 --2- 172.21.15.84:0/4111401644 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f99800b66b0 0x7f99800b8bc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9990009270 tx=0x7f9990084040 comp rx=0 tx=0).stop 2024-09-21T03:49:08.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.029+0000 7f999e828640 1 -- 172.21.15.84:0/4111401644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9998108d10 msgr2=0x7f999819bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:08.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.029+0000 7f999e828640 1 --2- 172.21.15.84:0/4111401644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9998108d10 0x7f999819bcd0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f999000eaa0 tx=0x7f999000ef60 comp rx=0 tx=0).stop 2024-09-21T03:49:08.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.029+0000 7f999e828640 1 -- 172.21.15.84:0/4111401644 shutdown_connections 2024-09-21T03:49:08.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.029+0000 7f999e828640 1 --2- 172.21.15.84:0/4111401644 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f99800b66b0 0x7f99800b8bc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.029+0000 7f999e828640 1 --2- 172.21.15.84:0/4111401644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9998108d10 0x7f999819bcd0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.029+0000 7f999e828640 1 --2- 172.21.15.84:0/4111401644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f99981083c0 0x7f999819b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.029+0000 7f999e828640 1 --2- 172.21.15.84:0/4111401644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9998102a80 0x7f999819b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:08.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.029+0000 7f999e828640 1 -- 172.21.15.84:0/4111401644 >> 172.21.15.84:0/4111401644 conn(0x7f9998079740 msgr2=0x7f9998101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:08.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.029+0000 7f999e828640 1 -- 172.21.15.84:0/4111401644 shutdown_connections 2024-09-21T03:49:08.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:08.029+0000 7f999e828640 1 -- 172.21.15.84:0/4111401644 wait complete. 2024-09-21T03:49:08.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:08 smithi084 ceph-mon[30941]: pgmap v525: 97 pgs: 97 active+clean; 11 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 31 op/s 2024-09-21T03:49:08.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:08 smithi174 ceph-mon[34403]: pgmap v525: 97 pgs: 97 active+clean; 11 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 31 op/s 2024-09-21T03:49:08.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:08 smithi172 ceph-mon[34821]: pgmap v525: 97 pgs: 97 active+clean; 11 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 31 op/s 2024-09-21T03:49:08.959 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:49:08.959 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:49:09.204 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:49:09.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.713+0000 7fa9687a7640 1 -- 172.21.15.84:0/3793660634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa960103b60 msgr2=0x7fa960103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:09.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.713+0000 7fa9687a7640 1 --2- 172.21.15.84:0/3793660634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa960103b60 0x7fa960103f70 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fa95c009900 tx=0x7fa95c02a410 comp rx=0 tx=0).stop 2024-09-21T03:49:09.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.714+0000 7fa9687a7640 1 -- 172.21.15.84:0/3793660634 shutdown_connections 2024-09-21T03:49:09.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.714+0000 7fa9687a7640 1 --2- 172.21.15.84:0/3793660634 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa960109df0 0x7fa960110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:09.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.714+0000 7fa9687a7640 1 --2- 172.21.15.84:0/3793660634 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9601094a0 0x7fa9601098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:09.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.714+0000 7fa9687a7640 1 --2- 172.21.15.84:0/3793660634 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa960103b60 0x7fa960103f70 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:09.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.714+0000 7fa9687a7640 1 -- 172.21.15.84:0/3793660634 >> 172.21.15.84:0/3793660634 conn(0x7fa96007b850 msgr2=0x7fa96007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:09.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.714+0000 7fa9687a7640 1 -- 172.21.15.84:0/3793660634 shutdown_connections 2024-09-21T03:49:09.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.714+0000 7fa9687a7640 1 -- 172.21.15.84:0/3793660634 wait complete. 2024-09-21T03:49:09.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.714+0000 7fa9687a7640 1 Processor -- start 2024-09-21T03:49:09.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.714+0000 7fa9687a7640 1 -- start start 2024-09-21T03:49:09.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.715+0000 7fa9687a7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa960103b60 0x7fa96019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:09.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.715+0000 7fa9687a7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9601094a0 0x7fa96019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:09.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.715+0000 7fa9687a7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa960109df0 0x7fa96019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:09.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.715+0000 7fa9687a7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa960113ab0 con 0x7fa960103b60 2024-09-21T03:49:09.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.715+0000 7fa9687a7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa960113930 con 0x7fa9601094a0 2024-09-21T03:49:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.715+0000 7fa9687a7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa960113c30 con 0x7fa960109df0 2024-09-21T03:49:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.715+0000 7fa966543640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa960103b60 0x7fa96019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.715+0000 7fa966543640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa960103b60 0x7fa96019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41646/0 (socket says 172.21.15.84:41646) 2024-09-21T03:49:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.715+0000 7fa966543640 1 -- 172.21.15.84:0/1256106488 learned_addr learned my addr 172.21.15.84:0/1256106488 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.715+0000 7fa965d42640 1 --2- 172.21.15.84:0/1256106488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9601094a0 0x7fa96019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.715+0000 7fa966543640 1 -- 172.21.15.84:0/1256106488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa960109df0 msgr2=0x7fa96019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.715+0000 7fa966d44640 1 --2- 172.21.15.84:0/1256106488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa960109df0 0x7fa96019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.715+0000 7fa966543640 1 --2- 172.21.15.84:0/1256106488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa960109df0 0x7fa96019fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.715+0000 7fa966543640 1 -- 172.21.15.84:0/1256106488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9601094a0 msgr2=0x7fa96019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.715+0000 7fa966543640 1 --2- 172.21.15.84:0/1256106488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9601094a0 0x7fa96019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.715+0000 7fa966543640 1 -- 172.21.15.84:0/1256106488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9601a0410 con 0x7fa960103b60 2024-09-21T03:49:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.715+0000 7fa966543640 1 --2- 172.21.15.84:0/1256106488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa960103b60 0x7fa96019a4a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fa95c005940 tx=0x7fa95c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:09.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.715+0000 7fa9577fe640 1 -- 172.21.15.84:0/1256106488 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c03f030 con 0x7fa960103b60 2024-09-21T03:49:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.715+0000 7fa9687a7640 1 -- 172.21.15.84:0/1256106488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9601a06a0 con 0x7fa960103b60 2024-09-21T03:49:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.715+0000 7fa9577fe640 1 -- 172.21.15.84:0/1256106488 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa95c0044c0 con 0x7fa960103b60 2024-09-21T03:49:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.716+0000 7fa9687a7640 1 -- 172.21.15.84:0/1256106488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9601a6e60 con 0x7fa960103b60 2024-09-21T03:49:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.716+0000 7fa9577fe640 1 -- 172.21.15.84:0/1256106488 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c049060 con 0x7fa960103b60 2024-09-21T03:49:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.716+0000 7fa9687a7640 1 -- 172.21.15.84:0/1256106488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa960104de0 con 0x7fa960103b60 2024-09-21T03:49:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.718+0000 7fa9577fe640 1 -- 172.21.15.84:0/1256106488 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fa95c042030 con 0x7fa960103b60 2024-09-21T03:49:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.719+0000 7fa9577fe640 1 --2- 172.21.15.84:0/1256106488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa94c0b6680 0x7fa94c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.719+0000 7fa965d42640 1 --2- 172.21.15.84:0/1256106488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa94c0b6680 0x7fa94c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.719+0000 7fa9577fe640 1 -- 172.21.15.84:0/1256106488 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7fa95c108110 con 0x7fa960103b60 2024-09-21T03:49:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.719+0000 7fa965d42640 1 --2- 172.21.15.84:0/1256106488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa94c0b6680 0x7fa94c0b8b90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa9601091a0 tx=0x7fa950005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:09.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.723+0000 7fa9577fe640 1 -- 172.21.15.84:0/1256106488 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa95c0ce680 con 0x7fa960103b60 2024-09-21T03:49:09.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.937+0000 7fa9687a7640 1 -- 172.21.15.84:0/1256106488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa960103f70 con 0x7fa960103b60 2024-09-21T03:49:09.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.938+0000 7fa9577fe640 1 -- 172.21.15.84:0/1256106488 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7fa960103f70 con 0x7fa960103b60 2024-09-21T03:49:09.940 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:49:09.940 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:49:09.940 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:49:09.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.940+0000 7fa9687a7640 1 -- 172.21.15.84:0/1256106488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa94c0b6680 msgr2=0x7fa94c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:09.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.940+0000 7fa9687a7640 1 --2- 172.21.15.84:0/1256106488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa94c0b6680 0x7fa94c0b8b90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa9601091a0 tx=0x7fa950005f90 comp rx=0 tx=0).stop 2024-09-21T03:49:09.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.940+0000 7fa9687a7640 1 -- 172.21.15.84:0/1256106488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa960103b60 msgr2=0x7fa96019a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:09.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.940+0000 7fa9687a7640 1 --2- 172.21.15.84:0/1256106488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa960103b60 0x7fa96019a4a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fa95c005940 tx=0x7fa95c0040c0 comp rx=0 tx=0).stop 2024-09-21T03:49:09.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.940+0000 7fa9687a7640 1 -- 172.21.15.84:0/1256106488 shutdown_connections 2024-09-21T03:49:09.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.940+0000 7fa9687a7640 1 --2- 172.21.15.84:0/1256106488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa94c0b6680 0x7fa94c0b8b90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:09.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.940+0000 7fa9687a7640 1 --2- 172.21.15.84:0/1256106488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa960109df0 0x7fa96019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:09.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.940+0000 7fa9687a7640 1 --2- 172.21.15.84:0/1256106488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9601094a0 0x7fa96019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:09.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.940+0000 7fa9687a7640 1 --2- 172.21.15.84:0/1256106488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa960103b60 0x7fa96019a4a0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:09.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.940+0000 7fa9687a7640 1 -- 172.21.15.84:0/1256106488 >> 172.21.15.84:0/1256106488 conn(0x7fa96007b850 msgr2=0x7fa960107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:09.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.941+0000 7fa9687a7640 1 -- 172.21.15.84:0/1256106488 shutdown_connections 2024-09-21T03:49:09.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:09.941+0000 7fa9687a7640 1 -- 172.21.15.84:0/1256106488 wait complete. 2024-09-21T03:49:10.265 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:09 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1256106488' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:49:10.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:09 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1256106488' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:49:10.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:09 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1256106488' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:49:10.737 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:49:10.984 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:49:11.252 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:10 smithi084 ceph-mon[30941]: pgmap v526: 97 pgs: 97 active+clean; 11 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 31 op/s 2024-09-21T03:49:11.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:10 smithi174 ceph-mon[34403]: pgmap v526: 97 pgs: 97 active+clean; 11 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 31 op/s 2024-09-21T03:49:11.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:10 smithi172 ceph-mon[34821]: pgmap v526: 97 pgs: 97 active+clean; 11 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 98 KiB/s wr, 31 op/s 2024-09-21T03:49:11.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.482+0000 7f5a4b4ba640 1 -- 172.21.15.84:0/67436232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a4410de30 msgr2=0x7f5a44110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:11.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.482+0000 7f5a4b4ba640 1 --2- 172.21.15.84:0/67436232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a4410de30 0x7f5a44110320 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009900 tx=0x7f5a3c02a3f0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.482+0000 7f5a4b4ba640 1 -- 172.21.15.84:0/67436232 shutdown_connections 2024-09-21T03:49:11.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.482+0000 7f5a4b4ba640 1 --2- 172.21.15.84:0/67436232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a4410de30 0x7f5a44110320 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.482+0000 7f5a4b4ba640 1 --2- 172.21.15.84:0/67436232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a44105320 0x7f5a4410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.482+0000 7f5a4b4ba640 1 --2- 172.21.15.84:0/67436232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a441049d0 0x7f5a44104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.482+0000 7f5a4b4ba640 1 -- 172.21.15.84:0/67436232 >> 172.21.15.84:0/67436232 conn(0x7f5a44079740 msgr2=0x7f5a44079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:11.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.482+0000 7f5a4b4ba640 1 -- 172.21.15.84:0/67436232 shutdown_connections 2024-09-21T03:49:11.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.482+0000 7f5a4b4ba640 1 -- 172.21.15.84:0/67436232 wait complete. 2024-09-21T03:49:11.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.483+0000 7f5a4b4ba640 1 Processor -- start 2024-09-21T03:49:11.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.483+0000 7f5a4b4ba640 1 -- start start 2024-09-21T03:49:11.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.483+0000 7f5a4b4ba640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a441049d0 0x7f5a4419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:11.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.483+0000 7f5a4b4ba640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a44105320 0x7f5a4419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:11.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.483+0000 7f5a4b4ba640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a4410de30 0x7f5a4419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:11.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.483+0000 7f5a4b4ba640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5a44113a90 con 0x7f5a441049d0 2024-09-21T03:49:11.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.483+0000 7f5a49256640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a441049d0 0x7f5a4419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:11.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.483+0000 7f5a4b4ba640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5a44113910 con 0x7f5a44105320 2024-09-21T03:49:11.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.483+0000 7f5a4b4ba640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5a44113c10 con 0x7f5a4410de30 2024-09-21T03:49:11.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.483+0000 7f5a49256640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a441049d0 0x7f5a4419a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41670/0 (socket says 172.21.15.84:41670) 2024-09-21T03:49:11.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.483+0000 7f5a49256640 1 -- 172.21.15.84:0/16172938 learned_addr learned my addr 172.21.15.84:0/16172938 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:11.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.483+0000 7f5a48a55640 1 --2- 172.21.15.84:0/16172938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a44105320 0x7f5a4419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:11.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.483+0000 7f5a49a57640 1 --2- 172.21.15.84:0/16172938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a4410de30 0x7f5a4419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:11.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.484+0000 7f5a49256640 1 -- 172.21.15.84:0/16172938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a4410de30 msgr2=0x7f5a4419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:11.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.484+0000 7f5a49256640 1 --2- 172.21.15.84:0/16172938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a4410de30 0x7f5a4419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.484+0000 7f5a49256640 1 -- 172.21.15.84:0/16172938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a44105320 msgr2=0x7f5a4419aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:11.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.484+0000 7f5a49256640 1 --2- 172.21.15.84:0/16172938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a44105320 0x7f5a4419aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.484+0000 7f5a49256640 1 -- 172.21.15.84:0/16172938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a441a0350 con 0x7f5a441049d0 2024-09-21T03:49:11.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.484+0000 7f5a48a55640 1 --2- 172.21.15.84:0/16172938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a44105320 0x7f5a4419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:49:11.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.484+0000 7f5a49256640 1 --2- 172.21.15.84:0/16172938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a441049d0 0x7f5a4419a4a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400ccb0 tx=0x7f5a3400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:11.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.484+0000 7f5a427fc640 1 -- 172.21.15.84:0/16172938 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a34003b70 con 0x7f5a441049d0 2024-09-21T03:49:11.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.485+0000 7f5a427fc640 1 -- 172.21.15.84:0/16172938 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a3400ae50 con 0x7f5a441049d0 2024-09-21T03:49:11.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.485+0000 7f5a4b4ba640 1 -- 172.21.15.84:0/16172938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a441a0640 con 0x7f5a441049d0 2024-09-21T03:49:11.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.485+0000 7f5a427fc640 1 -- 172.21.15.84:0/16172938 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3400f6f0 con 0x7f5a441049d0 2024-09-21T03:49:11.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.485+0000 7f5a4b4ba640 1 -- 172.21.15.84:0/16172938 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a441a6e60 con 0x7f5a441049d0 2024-09-21T03:49:11.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.487+0000 7f5a51a2e740 1 Processor -- start 2024-09-21T03:49:11.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.487+0000 7f5a427fc640 1 -- 172.21.15.84:0/16172938 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f5a34004000 con 0x7f5a441049d0 2024-09-21T03:49:11.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.487+0000 7f5a51a2e740 1 -- start start 2024-09-21T03:49:11.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.488+0000 7f5a51a2e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3acb9070 0x561e3b0602c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:11.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.488+0000 7f5a51a2e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 0x561e3b060800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:11.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.488+0000 7f5a51a2e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac98390 0x561e3b060d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:11.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.488+0000 7f5a51a2e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561e3afd6ea0 con 0x561e3ac901b0 2024-09-21T03:49:11.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.488+0000 7f5a51a2e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561e3afc62d0 con 0x561e3ac98390 2024-09-21T03:49:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.488+0000 7f5a51a2e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561e3afca0e0 con 0x561e3acb9070 2024-09-21T03:49:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.488+0000 7f5a49256640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 0x561e3b060800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.488+0000 7f5a49256640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 0x561e3b060800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41676/0 (socket says 172.21.15.84:41676) 2024-09-21T03:49:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.488+0000 7f5a49256640 1 -- 172.21.15.84:0/3534956050 learned_addr learned my addr 172.21.15.84:0/3534956050 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.488+0000 7f5a49a57640 1 --2- 172.21.15.84:0/3534956050 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3acb9070 0x561e3b0602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.488+0000 7f5a48a55640 1 --2- 172.21.15.84:0/3534956050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac98390 0x561e3b060d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.488+0000 7f5a49256640 1 -- 172.21.15.84:0/3534956050 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3acb9070 msgr2=0x561e3b0602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.488+0000 7f5a49256640 1 --2- 172.21.15.84:0/3534956050 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3acb9070 0x561e3b0602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.488+0000 7f5a49256640 1 -- 172.21.15.84:0/3534956050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac98390 msgr2=0x561e3b060d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.488+0000 7f5a49256640 1 --2- 172.21.15.84:0/3534956050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac98390 0x561e3b060d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.488+0000 7f5a49256640 1 -- 172.21.15.84:0/3534956050 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e3ad24650 con 0x561e3ac901b0 2024-09-21T03:49:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.488+0000 7f5a49a57640 1 --2- 172.21.15.84:0/3534956050 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3acb9070 0x561e3b0602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:49:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.488+0000 7f5a427fc640 1 --2- 172.21.15.84:0/16172938 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5a2c0b66b0 0x7f5a2c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:11.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.489+0000 7f5a49256640 1 --2- 172.21.15.84:0/3534956050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 0x561e3b060800 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5a340e4f00 tx=0x7f5a340edcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2d7c1067a26d39b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:11.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.489+0000 7f5a49a57640 1 --2- 172.21.15.84:0/16172938 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5a2c0b66b0 0x7f5a2c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:11.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.489+0000 7f5a427fc640 1 -- 172.21.15.84:0/16172938 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7f5a340e7820 con 0x7f5a441049d0 2024-09-21T03:49:11.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.489+0000 7f5a2b7fe640 1 -- 172.21.15.84:0/3534956050 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3401d070 con 0x561e3ac901b0 2024-09-21T03:49:11.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.489+0000 7f5a2b7fe640 1 -- 172.21.15.84:0/3534956050 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a340ad1a0 con 0x561e3ac901b0 2024-09-21T03:49:11.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.489+0000 7f5a2b7fe640 1 -- 172.21.15.84:0/3534956050 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a340a9ce0 con 0x561e3ac901b0 2024-09-21T03:49:11.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.490+0000 7f5a51a2e740 1 -- 172.21.15.84:0/3534956050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 msgr2=0x561e3b060800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:11.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.490+0000 7f5a49a57640 1 --2- 172.21.15.84:0/16172938 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5a2c0b66b0 0x7f5a2c0b8bc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c006010 tx=0x7f5a3c0058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:11.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.490+0000 7f5a51a2e740 1 --2- 172.21.15.84:0/3534956050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 0x561e3b060800 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5a340e4f00 tx=0x7f5a340edcd0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.490+0000 7f5a51a2e740 1 -- 172.21.15.84:0/3534956050 shutdown_connections 2024-09-21T03:49:11.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.490+0000 7f5a51a2e740 1 --2- 172.21.15.84:0/3534956050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac98390 0x561e3b060d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.490+0000 7f5a51a2e740 1 --2- 172.21.15.84:0/3534956050 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 0x561e3b060800 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.490+0000 7f5a51a2e740 1 --2- 172.21.15.84:0/3534956050 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3acb9070 0x561e3b0602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.490+0000 7f5a51a2e740 1 -- 172.21.15.84:0/3534956050 >> 172.21.15.84:0/3534956050 conn(0x561e3acad460 msgr2=0x561e3b05e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:11.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.490+0000 7f5a51a2e740 1 -- 172.21.15.84:0/3534956050 shutdown_connections 2024-09-21T03:49:11.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.490+0000 7f5a51a2e740 1 -- 172.21.15.84:0/3534956050 wait complete. 2024-09-21T03:49:11.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.490+0000 7f5a51a2e740 1 -- start start 2024-09-21T03:49:11.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.490+0000 7f5a51a2e740 1 Processor -- start 2024-09-21T03:49:11.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.491+0000 7f5a51a2e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 0x561e3b06b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:11.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.491+0000 7f5a51a2e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac98390 0x561e3b06bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:11.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.491+0000 7f5a51a2e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3acb9070 0x561e3b077dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:11.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.491+0000 7f5a51a2e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x561e3ae27700 con 0x561e3ac901b0 2024-09-21T03:49:11.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.491+0000 7f5a51a2e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561e3af61160 con 0x561e3ac98390 2024-09-21T03:49:11.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.491+0000 7f5a51a2e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x561e3b06eaa0 con 0x561e3acb9070 2024-09-21T03:49:11.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.491+0000 7f5a51a2e740 10 client.0 _ll_register_callbacks cb 0x561e3af7a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:49:11.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.491+0000 7f5a49256640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 0x561e3b06b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:11.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.491+0000 7f5a49256640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 0x561e3b06b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41692/0 (socket says 172.21.15.84:41692) 2024-09-21T03:49:11.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.491+0000 7f5a49256640 1 -- 172.21.15.84:0/1752979588 learned_addr learned my addr 172.21.15.84:0/1752979588 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:11.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.491+0000 7f5a48a55640 1 --2- 172.21.15.84:0/1752979588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac98390 0x561e3b06bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:11.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.491+0000 7f5a49a57640 1 --2- 172.21.15.84:0/1752979588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3acb9070 0x561e3b077dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:11.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.491+0000 7f5a49256640 1 -- 172.21.15.84:0/1752979588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3acb9070 msgr2=0x561e3b077dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:11.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.491+0000 7f5a49256640 1 --2- 172.21.15.84:0/1752979588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3acb9070 0x561e3b077dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.491+0000 7f5a49256640 1 -- 172.21.15.84:0/1752979588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac98390 msgr2=0x561e3b06bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:11.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.491+0000 7f5a49256640 1 --2- 172.21.15.84:0/1752979588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac98390 0x561e3b06bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.491+0000 7f5a49256640 1 -- 172.21.15.84:0/1752979588 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e3af8ec90 con 0x561e3ac901b0 2024-09-21T03:49:11.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.492+0000 7f5a49256640 1 --2- 172.21.15.84:0/1752979588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 0x561e3b06b9f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5a340e5590 tx=0x7f5a34004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8abe13296169c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:11.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.492+0000 7f5a28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:49:11.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.492+0000 7f5a28ff9640 1 -- 172.21.15.84:0/1752979588 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3401d040 con 0x561e3ac901b0 2024-09-21T03:49:11.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.492+0000 7f5a51a2e740 1 -- 172.21.15.84:0/1752979588 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a340ad1a0 con 0x561e3ac901b0 2024-09-21T03:49:11.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.492+0000 7f5a28ff9640 1 -- 172.21.15.84:0/1752979588 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7f5a340b6e20 con 0x561e3ac901b0 2024-09-21T03:49:11.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.492+0000 7f5a28ff9640 1 -- 172.21.15.84:0/1752979588 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5a340ace00 con 0x561e3ac901b0 2024-09-21T03:49:11.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.492+0000 7f5a51a2e740 10 client.16659 fetch_fsmap learned FSMap version 25 2024-09-21T03:49:11.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.492+0000 7f5a51a2e740 1 -- 172.21.15.84:0/1752979588 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561e3b07a7f0 con 0x561e3ac901b0 2024-09-21T03:49:11.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.492+0000 7f5a28ff9640 1 -- 172.21.15.84:0/1752979588 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a340ad1a0 con 0x561e3ac901b0 2024-09-21T03:49:11.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.492+0000 7f5a28ff9640 1 -- 172.21.15.84:0/1752979588 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5a34004b60 con 0x561e3ac901b0 2024-09-21T03:49:11.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.492+0000 7f5a51a2e740 10 client.16659 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:49:11.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.492+0000 7f5a51a2e740 10 client.16659 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:49:11.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.492+0000 7f5a51a2e740 20 client.16659 populate_metadata read hostname 'smithi084' 2024-09-21T03:49:11.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.492+0000 7f5a51a2e740 1 --2- 172.21.15.84:0/1752979588 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x561e3ac779f0 0x561e3b07db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:11.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.492+0000 7f5a51a2e740 4 client.16659 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:49:11.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.492+0000 7f5a51a2e740 1 -- 172.21.15.84:0/1752979588 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e3afd8df0 con 0x561e3ac779f0 2024-09-21T03:49:11.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.493+0000 7f5a48a55640 1 --2- 172.21.15.84:0/1752979588 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x561e3ac779f0 0x561e3b07db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:11.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.493+0000 7f5a28ff9640 10 client.16659 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:49:11.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.493+0000 7f5a48a55640 1 --2- 172.21.15.84:0/1752979588 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x561e3ac779f0 0x561e3b07db50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=33b78ed5e128079 server_cookie=38bb7c8b56ee2051 in_seq=0 out_seq=0 2024-09-21T03:49:11.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.494+0000 7f5a28ff9640 1 -- 172.21.15.84:0/1752979588 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561e3afd8df0 con 0x561e3ac779f0 2024-09-21T03:49:11.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.494+0000 7f5a28ff9640 10 client.16659 handle_command_reply: tid=0 2024-09-21T03:49:11.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.494+0000 7f5a51a2e740 1 client.16659 shutdown 2024-09-21T03:49:11.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.494+0000 7f5a51a2e740 1 -- 172.21.15.84:0/1752979588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 msgr2=0x561e3b06b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:11.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.494+0000 7f5a51a2e740 1 --2- 172.21.15.84:0/1752979588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 0x561e3b06b9f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5a340e5590 tx=0x7f5a34004a40 comp rx=0 tx=0).stop 2024-09-21T03:49:11.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.494+0000 7f5a51a2e740 1 -- 172.21.15.84:0/1752979588 shutdown_connections 2024-09-21T03:49:11.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.494+0000 7f5a51a2e740 1 --2- 172.21.15.84:0/1752979588 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x561e3ac779f0 0x561e3b07db50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.494+0000 7f5a51a2e740 1 --2- 172.21.15.84:0/1752979588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3acb9070 0x561e3b077dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.494+0000 7f5a28ff9640 0 client.16659 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:49:11.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.494+0000 7f5a51a2e740 1 --2- 172.21.15.84:0/1752979588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac98390 0x561e3b06bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.494+0000 7f5a51a2e740 1 --2- 172.21.15.84:0/1752979588 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 0x561e3b06b9f0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.494+0000 7f5a51a2e740 1 -- 172.21.15.84:0/1752979588 >> 172.21.15.84:0/1752979588 conn(0x561e3acad460 msgr2=0x561e3b0612f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:11.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.494+0000 7f5a51a2e740 1 -- 172.21.15.84:0/1752979588 shutdown_connections 2024-09-21T03:49:11.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.494+0000 7f5a51a2e740 1 -- 172.21.15.84:0/1752979588 wait complete. 2024-09-21T03:49:11.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.494+0000 7f5a51a2e740 20 client.16659 trim_cache size 0 max 16384 2024-09-21T03:49:11.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.508+0000 7f5a51a2e740 1 Processor -- start 2024-09-21T03:49:11.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.508+0000 7f5a51a2e740 1 -- start start 2024-09-21T03:49:11.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.508+0000 7f5a51a2e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac779f0 0x561e3b061a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:11.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.508+0000 7f5a51a2e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3ac901b0 0x561e3b05d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:11.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.508+0000 7f5a51a2e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac98390 0x561e3b05dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:11.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.508+0000 7f5a51a2e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5a441b1f80 con 0x561e3ac98390 2024-09-21T03:49:11.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.508+0000 7f5a51a2e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5a441af850 con 0x561e3ac779f0 2024-09-21T03:49:11.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.508+0000 7f5a51a2e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5a441ad6c0 con 0x561e3ac901b0 2024-09-21T03:49:11.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.508+0000 7f5a49a57640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac98390 0x561e3b05dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:11.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.508+0000 7f5a49a57640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac98390 0x561e3b05dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41694/0 (socket says 172.21.15.84:41694) 2024-09-21T03:49:11.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.508+0000 7f5a49a57640 1 -- 172.21.15.84:0/4039085953 learned_addr learned my addr 172.21.15.84:0/4039085953 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:11.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.508+0000 7f5a49256640 1 --2- 172.21.15.84:0/4039085953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac779f0 0x561e3b061a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:11.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.508+0000 7f5a48a55640 1 --2- 172.21.15.84:0/4039085953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3ac901b0 0x561e3b05d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:11.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.508+0000 7f5a49a57640 1 -- 172.21.15.84:0/4039085953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3ac901b0 msgr2=0x561e3b05d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:11.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.508+0000 7f5a49a57640 1 --2- 172.21.15.84:0/4039085953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3ac901b0 0x561e3b05d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.508+0000 7f5a49a57640 1 -- 172.21.15.84:0/4039085953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac779f0 msgr2=0x561e3b061a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:11.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.508+0000 7f5a49a57640 1 --2- 172.21.15.84:0/4039085953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac779f0 0x561e3b061a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.508+0000 7f5a49a57640 1 -- 172.21.15.84:0/4039085953 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e3b069ef0 con 0x561e3ac98390 2024-09-21T03:49:11.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.508+0000 7f5a49256640 1 --2- 172.21.15.84:0/4039085953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac779f0 0x561e3b061a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:49:11.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.509+0000 7f5a49a57640 1 --2- 172.21.15.84:0/4039085953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac98390 0x561e3b05dca0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009900 tx=0x7f5a3c03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84acef50d875b267 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:11.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.509+0000 7f5a2affd640 1 -- 172.21.15.84:0/4039085953 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c035040 con 0x561e3ac98390 2024-09-21T03:49:11.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.509+0000 7f5a2affd640 1 -- 172.21.15.84:0/4039085953 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a3c04d070 con 0x561e3ac98390 2024-09-21T03:49:11.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.509+0000 7f5a2affd640 1 -- 172.21.15.84:0/4039085953 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c003850 con 0x561e3ac98390 2024-09-21T03:49:11.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.510+0000 7f5a51a2e740 1 -- 172.21.15.84:0/4039085953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac98390 msgr2=0x561e3b05dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:11.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.510+0000 7f5a51a2e740 1 --2- 172.21.15.84:0/4039085953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac98390 0x561e3b05dca0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009900 tx=0x7f5a3c03e000 comp rx=0 tx=0).stop 2024-09-21T03:49:11.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.510+0000 7f5a51a2e740 1 -- 172.21.15.84:0/4039085953 shutdown_connections 2024-09-21T03:49:11.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.510+0000 7f5a51a2e740 1 --2- 172.21.15.84:0/4039085953 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac98390 0x561e3b05dca0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.510+0000 7f5a51a2e740 1 --2- 172.21.15.84:0/4039085953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3ac901b0 0x561e3b05d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.510+0000 7f5a51a2e740 1 --2- 172.21.15.84:0/4039085953 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac779f0 0x561e3b061a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.510+0000 7f5a51a2e740 1 -- 172.21.15.84:0/4039085953 >> 172.21.15.84:0/4039085953 conn(0x561e3acad460 msgr2=0x561e3b0612f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:11.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.510+0000 7f5a51a2e740 1 -- 172.21.15.84:0/4039085953 shutdown_connections 2024-09-21T03:49:11.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.510+0000 7f5a51a2e740 1 -- 172.21.15.84:0/4039085953 wait complete. 2024-09-21T03:49:11.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.510+0000 7f5a51a2e740 1 -- start start 2024-09-21T03:49:11.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.511+0000 7f5a51a2e740 1 Processor -- start 2024-09-21T03:49:11.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.511+0000 7f5a51a2e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3ac779f0 0x561e3b081240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:11.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.511+0000 7f5a51a2e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 0x561e3b07e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:11.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.511+0000 7f5a51a2e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac98390 0x561e3b07eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:11.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.511+0000 7f5a51a2e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5a441add10 con 0x561e3ac901b0 2024-09-21T03:49:11.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.511+0000 7f5a51a2e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5a441af180 con 0x561e3ac98390 2024-09-21T03:49:11.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.511+0000 7f5a51a2e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5a441ae3e0 con 0x561e3ac779f0 2024-09-21T03:49:11.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.511+0000 7f5a51a2e740 10 client.0 _ll_register_callbacks cb 0x7f5a340eda90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:49:11.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.511+0000 7f5a48a55640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 0x561e3b07e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:11.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.511+0000 7f5a48a55640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 0x561e3b07e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41706/0 (socket says 172.21.15.84:41706) 2024-09-21T03:49:11.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.511+0000 7f5a48a55640 1 -- 172.21.15.84:0/1718658394 learned_addr learned my addr 172.21.15.84:0/1718658394 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:11.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.511+0000 7f5a49256640 1 --2- 172.21.15.84:0/1718658394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3ac779f0 0x561e3b081240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:11.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.511+0000 7f5a49a57640 1 --2- 172.21.15.84:0/1718658394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac98390 0x561e3b07eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:11.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.512+0000 7f5a48a55640 1 -- 172.21.15.84:0/1718658394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3ac779f0 msgr2=0x561e3b081240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:11.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.512+0000 7f5a48a55640 1 --2- 172.21.15.84:0/1718658394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3ac779f0 0x561e3b081240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.512+0000 7f5a48a55640 1 -- 172.21.15.84:0/1718658394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac98390 msgr2=0x561e3b07eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:11.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.512+0000 7f5a48a55640 1 --2- 172.21.15.84:0/1718658394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac98390 0x561e3b07eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.512+0000 7f5a48a55640 1 -- 172.21.15.84:0/1718658394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e3b07f310 con 0x561e3ac901b0 2024-09-21T03:49:11.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.512+0000 7f5a49256640 1 --2- 172.21.15.84:0/1718658394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3ac779f0 0x561e3b081240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:49:11.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.512+0000 7f5a48a55640 1 --2- 172.21.15.84:0/1718658394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 0x561e3b07e760 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f5a4406b6c0 tx=0x7f5a38012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e79307212f67de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:11.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.512+0000 7f5a28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:49:11.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.512+0000 7f5a28ff9640 1 -- 172.21.15.84:0/1718658394 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a38024430 con 0x561e3ac901b0 2024-09-21T03:49:11.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.512+0000 7f5a28ff9640 1 -- 172.21.15.84:0/1718658394 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7f5a380245d0 con 0x561e3ac901b0 2024-09-21T03:49:11.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.512+0000 7f5a51a2e740 1 -- 172.21.15.84:0/1718658394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a3c04d070 con 0x561e3ac901b0 2024-09-21T03:49:11.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.512+0000 7f5a28ff9640 1 -- 172.21.15.84:0/1718658394 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5a380247d0 con 0x561e3ac901b0 2024-09-21T03:49:11.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.512+0000 7f5a51a2e740 10 client.16665 fetch_fsmap learned FSMap version 25 2024-09-21T03:49:11.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.512+0000 7f5a51a2e740 1 -- 172.21.15.84:0/1718658394 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561e3b0e8160 con 0x561e3ac901b0 2024-09-21T03:49:11.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.512+0000 7f5a28ff9640 1 -- 172.21.15.84:0/1718658394 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a3c04d070 con 0x561e3ac901b0 2024-09-21T03:49:11.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.513+0000 7f5a28ff9640 1 -- 172.21.15.84:0/1718658394 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5a3802b020 con 0x561e3ac901b0 2024-09-21T03:49:11.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.513+0000 7f5a51a2e740 10 client.16665 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:49:11.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.513+0000 7f5a51a2e740 10 client.16665 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:49:11.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.513+0000 7f5a51a2e740 20 client.16665 populate_metadata read hostname 'smithi084' 2024-09-21T03:49:11.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.513+0000 7f5a51a2e740 1 --2- 172.21.15.84:0/1718658394 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x561e3acb9070 0x561e3b0ea950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:11.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.513+0000 7f5a51a2e740 4 client.16665 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:49:11.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.513+0000 7f5a51a2e740 1 -- 172.21.15.84:0/1718658394 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561e3afd48a0 con 0x561e3acb9070 2024-09-21T03:49:11.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.513+0000 7f5a49256640 1 --2- 172.21.15.84:0/1718658394 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x561e3acb9070 0x561e3b0ea950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:11.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.513+0000 7f5a28ff9640 10 client.16665 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:49:11.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.513+0000 7f5a49256640 1 --2- 172.21.15.84:0/1718658394 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x561e3acb9070 0x561e3b0ea950 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ad8cdbc5bf3056cc server_cookie=71e87f26e647735c in_seq=0 out_seq=0 2024-09-21T03:49:11.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.514+0000 7f5a28ff9640 1 -- 172.21.15.84:0/1718658394 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561e3afd48a0 con 0x561e3acb9070 2024-09-21T03:49:11.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.514+0000 7f5a28ff9640 10 client.16665 handle_command_reply: tid=0 2024-09-21T03:49:11.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.514+0000 7f5a51a2e740 1 client.16665 shutdown 2024-09-21T03:49:11.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.514+0000 7f5a51a2e740 1 -- 172.21.15.84:0/1718658394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 msgr2=0x561e3b07e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:11.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.514+0000 7f5a51a2e740 1 --2- 172.21.15.84:0/1718658394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 0x561e3b07e760 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f5a4406b6c0 tx=0x7f5a38012820 comp rx=0 tx=0).stop 2024-09-21T03:49:11.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.514+0000 7f5a51a2e740 1 -- 172.21.15.84:0/1718658394 shutdown_connections 2024-09-21T03:49:11.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.514+0000 7f5a51a2e740 1 --2- 172.21.15.84:0/1718658394 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x561e3acb9070 0x561e3b0ea950 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.514+0000 7f5a51a2e740 1 --2- 172.21.15.84:0/1718658394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561e3ac98390 0x561e3b07eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.514+0000 7f5a51a2e740 1 --2- 172.21.15.84:0/1718658394 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x561e3ac901b0 0x561e3b07e760 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.514+0000 7f5a51a2e740 1 --2- 172.21.15.84:0/1718658394 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e3ac779f0 0x561e3b081240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.520 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.514+0000 7f5a51a2e740 1 -- 172.21.15.84:0/1718658394 >> 172.21.15.84:0/1718658394 conn(0x561e3acad460 msgr2=0x561e3b0610c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:11.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.514+0000 7f5a28ff9640 0 client.16665 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:49:11.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.514+0000 7f5a51a2e740 1 -- 172.21.15.84:0/1718658394 shutdown_connections 2024-09-21T03:49:11.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.514+0000 7f5a51a2e740 1 -- 172.21.15.84:0/1718658394 wait complete. 2024-09-21T03:49:11.521 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.514+0000 7f5a51a2e740 20 client.16665 trim_cache size 0 max 16384 2024-09-21T03:49:11.521 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:49:11.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.515+0000 7f5a4b4ba640 1 -- 172.21.15.84:0/16172938 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5a2c0b66b0 msgr2=0x7f5a2c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:11.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.515+0000 7f5a4b4ba640 1 --2- 172.21.15.84:0/16172938 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5a2c0b66b0 0x7f5a2c0b8bc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c006010 tx=0x7f5a3c0058d0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.515+0000 7f5a4b4ba640 1 -- 172.21.15.84:0/16172938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a441049d0 msgr2=0x7f5a4419a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:11.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.515+0000 7f5a4b4ba640 1 --2- 172.21.15.84:0/16172938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a441049d0 0x7f5a4419a4a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400ccb0 tx=0x7f5a3400a620 comp rx=0 tx=0).stop 2024-09-21T03:49:11.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.515+0000 7f5a4b4ba640 1 -- 172.21.15.84:0/16172938 shutdown_connections 2024-09-21T03:49:11.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.515+0000 7f5a4b4ba640 1 --2- 172.21.15.84:0/16172938 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5a2c0b66b0 0x7f5a2c0b8bc0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.515+0000 7f5a4b4ba640 1 --2- 172.21.15.84:0/16172938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a4410de30 0x7f5a4419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.515+0000 7f5a4b4ba640 1 --2- 172.21.15.84:0/16172938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a44105320 0x7f5a4419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.515+0000 7f5a4b4ba640 1 --2- 172.21.15.84:0/16172938 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5a441049d0 0x7f5a4419a4a0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:11.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.515+0000 7f5a4b4ba640 1 -- 172.21.15.84:0/16172938 >> 172.21.15.84:0/16172938 conn(0x7f5a44079740 msgr2=0x7f5a440ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:11.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.515+0000 7f5a4b4ba640 1 -- 172.21.15.84:0/16172938 shutdown_connections 2024-09-21T03:49:11.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:11.515+0000 7f5a4b4ba640 1 -- 172.21.15.84:0/16172938 wait complete. 2024-09-21T03:49:12.235 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:49:12.480 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:49:12.792 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:12 smithi084 ceph-mon[30941]: pgmap v527: 97 pgs: 97 active+clean; 11 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 71 KiB/s wr, 29 op/s 2024-09-21T03:49:12.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:12 smithi174 ceph-mon[34403]: pgmap v527: 97 pgs: 97 active+clean; 11 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 71 KiB/s wr, 29 op/s 2024-09-21T03:49:12.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:12 smithi172 ceph-mon[34821]: pgmap v527: 97 pgs: 97 active+clean; 11 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 71 KiB/s wr, 29 op/s 2024-09-21T03:49:13.028 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.026+0000 7ff6aff15640 1 -- 172.21.15.84:0/1940695183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6a8109df0 msgr2=0x7ff6a8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:13.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.026+0000 7ff6aff15640 1 --2- 172.21.15.84:0/1940695183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6a8109df0 0x7ff6a8110620 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0009900 tx=0x7ff6a002a410 comp rx=0 tx=0).stop 2024-09-21T03:49:13.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.026+0000 7ff6aff15640 1 -- 172.21.15.84:0/1940695183 shutdown_connections 2024-09-21T03:49:13.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.026+0000 7ff6aff15640 1 --2- 172.21.15.84:0/1940695183 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6a8109df0 0x7ff6a8110620 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.026+0000 7ff6aff15640 1 --2- 172.21.15.84:0/1940695183 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a81094a0 0x7ff6a81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.026+0000 7ff6aff15640 1 --2- 172.21.15.84:0/1940695183 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6a8103b60 0x7ff6a8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.026+0000 7ff6aff15640 1 -- 172.21.15.84:0/1940695183 >> 172.21.15.84:0/1940695183 conn(0x7ff6a807b850 msgr2=0x7ff6a807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:13.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.026+0000 7ff6aff15640 1 -- 172.21.15.84:0/1940695183 shutdown_connections 2024-09-21T03:49:13.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.026+0000 7ff6aff15640 1 -- 172.21.15.84:0/1940695183 wait complete. 2024-09-21T03:49:13.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.027+0000 7ff6aff15640 1 Processor -- start 2024-09-21T03:49:13.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.027+0000 7ff6aff15640 1 -- start start 2024-09-21T03:49:13.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.027+0000 7ff6aff15640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a8103b60 0x7ff6a819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:13.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.027+0000 7ff6aff15640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6a81094a0 0x7ff6a819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:13.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.027+0000 7ff6aff15640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6a8109df0 0x7ff6a819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:13.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.027+0000 7ff6aff15640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a8113b30 con 0x7ff6a81094a0 2024-09-21T03:49:13.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.027+0000 7ff6aff15640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a81139b0 con 0x7ff6a8109df0 2024-09-21T03:49:13.031 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.027+0000 7ff6aff15640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a8113cb0 con 0x7ff6a8103b60 2024-09-21T03:49:13.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.027+0000 7ff6ad4b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6a81094a0 0x7ff6a819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:13.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.027+0000 7ff6ad4b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6a81094a0 0x7ff6a819aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41716/0 (socket says 172.21.15.84:41716) 2024-09-21T03:49:13.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.027+0000 7ff6ad4b0640 1 -- 172.21.15.84:0/3123707085 learned_addr learned my addr 172.21.15.84:0/3123707085 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:13.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.027+0000 7ff6ae4b2640 1 --2- 172.21.15.84:0/3123707085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6a8109df0 0x7ff6a819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:13.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.027+0000 7ff6adcb1640 1 --2- 172.21.15.84:0/3123707085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a8103b60 0x7ff6a819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:13.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.027+0000 7ff6ad4b0640 1 -- 172.21.15.84:0/3123707085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a8103b60 msgr2=0x7ff6a819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:13.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.027+0000 7ff6ad4b0640 1 --2- 172.21.15.84:0/3123707085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a8103b60 0x7ff6a819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.027+0000 7ff6ad4b0640 1 -- 172.21.15.84:0/3123707085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6a8109df0 msgr2=0x7ff6a819fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:13.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.027+0000 7ff6ad4b0640 1 --2- 172.21.15.84:0/3123707085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6a8109df0 0x7ff6a819fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.027+0000 7ff6ad4b0640 1 -- 172.21.15.84:0/3123707085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a81a0450 con 0x7ff6a81094a0 2024-09-21T03:49:13.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.027+0000 7ff6ae4b2640 1 --2- 172.21.15.84:0/3123707085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6a8109df0 0x7ff6a819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:49:13.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.027+0000 7ff6adcb1640 1 --2- 172.21.15.84:0/3123707085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a8103b60 0x7ff6a819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:49:13.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.028+0000 7ff6ad4b0640 1 --2- 172.21.15.84:0/3123707085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6a81094a0 0x7ff6a819aa80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00d750 tx=0x7ff69c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:13.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.028+0000 7ff6a6ffd640 1 -- 172.21.15.84:0/3123707085 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c017070 con 0x7ff6a81094a0 2024-09-21T03:49:13.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.028+0000 7ff6a6ffd640 1 -- 172.21.15.84:0/3123707085 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff69c0054d0 con 0x7ff6a81094a0 2024-09-21T03:49:13.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.028+0000 7ff6aff15640 1 -- 172.21.15.84:0/3123707085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a81a0740 con 0x7ff6a81094a0 2024-09-21T03:49:13.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.028+0000 7ff6a6ffd640 1 -- 172.21.15.84:0/3123707085 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c004c30 con 0x7ff6a81094a0 2024-09-21T03:49:13.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.028+0000 7ff6aff15640 1 -- 172.21.15.84:0/3123707085 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6a81a6ea0 con 0x7ff6a81094a0 2024-09-21T03:49:13.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.030+0000 7ff6b6489740 1 Processor -- start 2024-09-21T03:49:13.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.031+0000 7ff6b6489740 1 -- start start 2024-09-21T03:49:13.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.031+0000 7ff6a6ffd640 1 -- 172.21.15.84:0/3123707085 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7ff69c004dd0 con 0x7ff6a81094a0 2024-09-21T03:49:13.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.031+0000 7ff6b6489740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043fdf070 0x55f0443866a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:13.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.031+0000 7ff6b6489740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fb61b0 0x55f044386be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:13.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.031+0000 7ff6b6489740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fbe390 0x55f044387120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:13.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.031+0000 7ff6b6489740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f0442fcea0 con 0x55f043fbe390 2024-09-21T03:49:13.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.031+0000 7ff6b6489740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f0442ec2d0 con 0x55f043fb61b0 2024-09-21T03:49:13.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.031+0000 7ff6b6489740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f0442f00e0 con 0x55f043fdf070 2024-09-21T03:49:13.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.031+0000 7ff6ae4b2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043fdf070 0x55f0443866a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:13.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.031+0000 7ff6ad4b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fbe390 0x55f044387120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:13.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.031+0000 7ff6ae4b2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043fdf070 0x55f0443866a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.84:35732/0 (socket says 172.21.15.84:35732) 2024-09-21T03:49:13.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.031+0000 7ff6ae4b2640 1 -- 172.21.15.84:0/1436577063 learned_addr learned my addr 172.21.15.84:0/1436577063 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:13.035 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.031+0000 7ff6adcb1640 1 --2- 172.21.15.84:0/1436577063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fb61b0 0x55f044386be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:13.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.032+0000 7ff6ad4b0640 1 -- 172.21.15.84:0/1436577063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043fdf070 msgr2=0x55f0443866a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:13.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.032+0000 7ff6ad4b0640 1 --2- 172.21.15.84:0/1436577063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043fdf070 0x55f0443866a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.032+0000 7ff6ad4b0640 1 -- 172.21.15.84:0/1436577063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fb61b0 msgr2=0x55f044386be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:13.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.032+0000 7ff6ad4b0640 1 --2- 172.21.15.84:0/1436577063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fb61b0 0x55f044386be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.032+0000 7ff6ad4b0640 1 -- 172.21.15.84:0/1436577063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f04404a650 con 0x55f043fbe390 2024-09-21T03:49:13.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.032+0000 7ff6ad4b0640 1 --2- 172.21.15.84:0/1436577063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fbe390 0x55f044387120 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0e4940 tx=0x7ff69c0ef9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495d5037f50a3de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:13.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.032+0000 7ff6a6ffd640 1 --2- 172.21.15.84:0/3123707085 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff6900b6680 0x7ff6900b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:13.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.032+0000 7ff68ffff640 1 -- 172.21.15.84:0/1436577063 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c0fb070 con 0x55f043fbe390 2024-09-21T03:49:13.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.032+0000 7ff6ae4b2640 1 --2- 172.21.15.84:0/3123707085 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff6900b6680 0x7ff6900b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:13.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.032+0000 7ff68ffff640 1 -- 172.21.15.84:0/1436577063 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff69c0acb50 con 0x55f043fbe390 2024-09-21T03:49:13.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.032+0000 7ff68ffff640 1 -- 172.21.15.84:0/1436577063 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c0b4ea0 con 0x55f043fbe390 2024-09-21T03:49:13.036 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.032+0000 7ff6a6ffd640 1 -- 172.21.15.84:0/3123707085 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7ff69c0e71d0 con 0x7ff6a81094a0 2024-09-21T03:49:13.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.033+0000 7ff6b6489740 1 -- 172.21.15.84:0/1436577063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fbe390 msgr2=0x55f044387120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:13.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.033+0000 7ff6ae4b2640 1 --2- 172.21.15.84:0/3123707085 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff6900b6680 0x7ff6900b8b90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff6a002a930 tx=0x7ff6a0005f30 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:13.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.033+0000 7ff6b6489740 1 --2- 172.21.15.84:0/1436577063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fbe390 0x55f044387120 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0e4940 tx=0x7ff69c0ef9b0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.033+0000 7ff6b6489740 1 -- 172.21.15.84:0/1436577063 shutdown_connections 2024-09-21T03:49:13.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.033+0000 7ff6b6489740 1 --2- 172.21.15.84:0/1436577063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fbe390 0x55f044387120 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.033+0000 7ff6b6489740 1 --2- 172.21.15.84:0/1436577063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fb61b0 0x55f044386be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.033+0000 7ff6b6489740 1 --2- 172.21.15.84:0/1436577063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043fdf070 0x55f0443866a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.033+0000 7ff6b6489740 1 -- 172.21.15.84:0/1436577063 >> 172.21.15.84:0/1436577063 conn(0x55f043fd3460 msgr2=0x55f044384590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:13.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.033+0000 7ff6b6489740 1 -- 172.21.15.84:0/1436577063 shutdown_connections 2024-09-21T03:49:13.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.033+0000 7ff6b6489740 1 -- 172.21.15.84:0/1436577063 wait complete. 2024-09-21T03:49:13.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.034+0000 7ff6b6489740 1 -- start start 2024-09-21T03:49:13.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.034+0000 7ff6b6489740 1 Processor -- start 2024-09-21T03:49:13.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.034+0000 7ff6b6489740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043fb61b0 0x55f044391d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:13.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.034+0000 7ff6b6489740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fbe390 0x55f0443922c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:13.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.034+0000 7ff6b6489740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fdf070 0x55f04439e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:13.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.034+0000 7ff6b6489740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f04414d700 con 0x55f043fbe390 2024-09-21T03:49:13.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.034+0000 7ff6b6489740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f044287160 con 0x55f043fdf070 2024-09-21T03:49:13.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.034+0000 7ff6b6489740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f044394e80 con 0x55f043fb61b0 2024-09-21T03:49:13.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.034+0000 7ff6b6489740 10 client.0 _ll_register_callbacks cb 0x55f0442a09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:49:13.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.034+0000 7ff6ad4b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fbe390 0x55f0443922c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:13.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.035+0000 7ff6ad4b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fbe390 0x55f0443922c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41746/0 (socket says 172.21.15.84:41746) 2024-09-21T03:49:13.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.035+0000 7ff6ad4b0640 1 -- 172.21.15.84:0/503479700 learned_addr learned my addr 172.21.15.84:0/503479700 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:13.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.035+0000 7ff6adcb1640 1 --2- 172.21.15.84:0/503479700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043fb61b0 0x55f044391d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:13.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.035+0000 7ff6ae4b2640 1 --2- 172.21.15.84:0/503479700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fdf070 0x55f04439e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:13.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.035+0000 7ff6ad4b0640 1 -- 172.21.15.84:0/503479700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043fb61b0 msgr2=0x55f044391d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:13.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.035+0000 7ff6ad4b0640 1 --2- 172.21.15.84:0/503479700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043fb61b0 0x55f044391d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.035+0000 7ff6ad4b0640 1 -- 172.21.15.84:0/503479700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fdf070 msgr2=0x55f04439e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:13.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.035+0000 7ff6ad4b0640 1 --2- 172.21.15.84:0/503479700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fdf070 0x55f04439e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.035+0000 7ff6ad4b0640 1 -- 172.21.15.84:0/503479700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0442b4c90 con 0x55f043fbe390 2024-09-21T03:49:13.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.035+0000 7ff6ad4b0640 1 --2- 172.21.15.84:0/503479700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fbe390 0x55f0443922c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0acd40 tx=0x7ff69c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8cd894898af656 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:13.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.035+0000 7ff68d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:49:13.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.035+0000 7ff68d7fa640 1 -- 172.21.15.84:0/503479700 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c0a1510 con 0x55f043fbe390 2024-09-21T03:49:13.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.035+0000 7ff68d7fa640 1 -- 172.21.15.84:0/503479700 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7ff69c005680 con 0x55f043fbe390 2024-09-21T03:49:13.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.035+0000 7ff6b6489740 1 -- 172.21.15.84:0/503479700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff69c0acb50 con 0x55f043fbe390 2024-09-21T03:49:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.035+0000 7ff68d7fa640 1 -- 172.21.15.84:0/503479700 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff69c0a1700 con 0x55f043fbe390 2024-09-21T03:49:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.035+0000 7ff6b6489740 10 client.16677 fetch_fsmap learned FSMap version 25 2024-09-21T03:49:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.035+0000 7ff6b6489740 1 -- 172.21.15.84:0/503479700 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f0443a0bc0 con 0x55f043fbe390 2024-09-21T03:49:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.036+0000 7ff68d7fa640 1 -- 172.21.15.84:0/503479700 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff69c0acb50 con 0x55f043fbe390 2024-09-21T03:49:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.036+0000 7ff68d7fa640 1 -- 172.21.15.84:0/503479700 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff69c0e4bc0 con 0x55f043fbe390 2024-09-21T03:49:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.036+0000 7ff6b6489740 10 client.16677 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:49:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.036+0000 7ff6b6489740 10 client.16677 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:49:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.036+0000 7ff6b6489740 20 client.16677 populate_metadata read hostname 'smithi084' 2024-09-21T03:49:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.036+0000 7ff6b6489740 1 --2- 172.21.15.84:0/503479700 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55f043f9d9f0 0x55f0443a40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.036+0000 7ff6b6489740 4 client.16677 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:49:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.036+0000 7ff6b6489740 1 -- 172.21.15.84:0/503479700 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0442fedf0 con 0x55f043f9d9f0 2024-09-21T03:49:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.036+0000 7ff6adcb1640 1 --2- 172.21.15.84:0/503479700 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55f043f9d9f0 0x55f0443a40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.037+0000 7ff68d7fa640 10 client.16677 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:49:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.037+0000 7ff6adcb1640 1 --2- 172.21.15.84:0/503479700 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55f043f9d9f0 0x55f0443a40c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a1ecba43f1c1154b server_cookie=fab8deb2136948c4 in_seq=0 out_seq=0 2024-09-21T03:49:13.043 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.037+0000 7ff68d7fa640 1 -- 172.21.15.84:0/503479700 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f0442fedf0 con 0x55f043f9d9f0 2024-09-21T03:49:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.037+0000 7ff68d7fa640 10 client.16677 handle_command_reply: tid=0 2024-09-21T03:49:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.037+0000 7ff6b6489740 1 client.16677 shutdown 2024-09-21T03:49:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.038+0000 7ff6b6489740 1 -- 172.21.15.84:0/503479700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fbe390 msgr2=0x55f0443922c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.038+0000 7ff6b6489740 1 --2- 172.21.15.84:0/503479700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fbe390 0x55f0443922c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0acd40 tx=0x7ff69c0046c0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.038+0000 7ff6b6489740 1 -- 172.21.15.84:0/503479700 shutdown_connections 2024-09-21T03:49:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.038+0000 7ff6b6489740 1 --2- 172.21.15.84:0/503479700 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55f043f9d9f0 0x55f0443a40c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.038+0000 7ff6b6489740 1 --2- 172.21.15.84:0/503479700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fdf070 0x55f04439e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.038+0000 7ff68d7fa640 0 client.16677 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:49:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.038+0000 7ff6b6489740 1 --2- 172.21.15.84:0/503479700 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fbe390 0x55f0443922c0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.038+0000 7ff6b6489740 1 --2- 172.21.15.84:0/503479700 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043fb61b0 0x55f044391d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.038+0000 7ff6b6489740 1 -- 172.21.15.84:0/503479700 >> 172.21.15.84:0/503479700 conn(0x55f043fd3460 msgr2=0x55f044389830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.038+0000 7ff6b6489740 1 -- 172.21.15.84:0/503479700 shutdown_connections 2024-09-21T03:49:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.038+0000 7ff6b6489740 1 -- 172.21.15.84:0/503479700 wait complete. 2024-09-21T03:49:13.044 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.038+0000 7ff6b6489740 20 client.16677 trim_cache size 0 max 16384 2024-09-21T03:49:13.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.051+0000 7ff6b6489740 1 Processor -- start 2024-09-21T03:49:13.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.051+0000 7ff6b6489740 1 -- start start 2024-09-21T03:49:13.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.051+0000 7ff6b6489740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fb61b0 0x55f044392240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:13.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.051+0000 7ff6b6489740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043fbe390 0x55f04439e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:13.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.051+0000 7ff6b6489740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fdf070 0x55f04438ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:13.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.051+0000 7ff6b6489740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a81b2010 con 0x55f043fb61b0 2024-09-21T03:49:13.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.051+0000 7ff6b6489740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a81af8e0 con 0x55f043fdf070 2024-09-21T03:49:13.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.051+0000 7ff6b6489740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a81ad750 con 0x55f043fbe390 2024-09-21T03:49:13.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.051+0000 7ff6adcb1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fb61b0 0x55f044392240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:13.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.052+0000 7ff6adcb1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fb61b0 0x55f044392240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41762/0 (socket says 172.21.15.84:41762) 2024-09-21T03:49:13.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.052+0000 7ff6adcb1640 1 -- 172.21.15.84:0/3014050733 learned_addr learned my addr 172.21.15.84:0/3014050733 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:13.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.052+0000 7ff6ad4b0640 1 --2- 172.21.15.84:0/3014050733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043fbe390 0x55f04439e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:13.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.052+0000 7ff6ae4b2640 1 --2- 172.21.15.84:0/3014050733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fdf070 0x55f04438ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:13.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.052+0000 7ff6adcb1640 1 -- 172.21.15.84:0/3014050733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043fbe390 msgr2=0x55f04439e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:13.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.052+0000 7ff6adcb1640 1 --2- 172.21.15.84:0/3014050733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043fbe390 0x55f04439e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.052+0000 7ff6adcb1640 1 -- 172.21.15.84:0/3014050733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fdf070 msgr2=0x55f04438ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:13.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.052+0000 7ff6adcb1640 1 --2- 172.21.15.84:0/3014050733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fdf070 0x55f04438ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.052+0000 7ff6adcb1640 1 -- 172.21.15.84:0/3014050733 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f044393040 con 0x55f043fb61b0 2024-09-21T03:49:13.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.052+0000 7ff6ae4b2640 1 --2- 172.21.15.84:0/3014050733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fdf070 0x55f04438ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:49:13.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.052+0000 7ff6adcb1640 1 --2- 172.21.15.84:0/3014050733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fb61b0 0x55f044392240 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7ff698010530 tx=0x7ff698012720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab3df7163596e31 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:13.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.052+0000 7ff68f7fe640 1 -- 172.21.15.84:0/3014050733 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6980120d0 con 0x55f043fb61b0 2024-09-21T03:49:13.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.052+0000 7ff68f7fe640 1 -- 172.21.15.84:0/3014050733 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff698012270 con 0x55f043fb61b0 2024-09-21T03:49:13.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.052+0000 7ff68f7fe640 1 -- 172.21.15.84:0/3014050733 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6980227b0 con 0x55f043fb61b0 2024-09-21T03:49:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.053+0000 7ff6b6489740 1 -- 172.21.15.84:0/3014050733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fb61b0 msgr2=0x55f044392240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.053+0000 7ff6b6489740 1 --2- 172.21.15.84:0/3014050733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fb61b0 0x55f044392240 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7ff698010530 tx=0x7ff698012720 comp rx=0 tx=0).stop 2024-09-21T03:49:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.053+0000 7ff6b6489740 1 -- 172.21.15.84:0/3014050733 shutdown_connections 2024-09-21T03:49:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.053+0000 7ff6b6489740 1 --2- 172.21.15.84:0/3014050733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fdf070 0x55f04438ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.053+0000 7ff6b6489740 1 --2- 172.21.15.84:0/3014050733 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043fbe390 0x55f04439e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.053+0000 7ff6b6489740 1 --2- 172.21.15.84:0/3014050733 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fb61b0 0x55f044392240 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.053+0000 7ff6b6489740 1 -- 172.21.15.84:0/3014050733 >> 172.21.15.84:0/3014050733 conn(0x55f043fd3460 msgr2=0x55f044391b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.053+0000 7ff6b6489740 1 -- 172.21.15.84:0/3014050733 shutdown_connections 2024-09-21T03:49:13.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.053+0000 7ff6b6489740 1 -- 172.21.15.84:0/3014050733 wait complete. 2024-09-21T03:49:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.054+0000 7ff6b6489740 1 -- start start 2024-09-21T03:49:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.054+0000 7ff6b6489740 1 Processor -- start 2024-09-21T03:49:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.054+0000 7ff6b6489740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fbe390 0x55f044396110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.054+0000 7ff6b6489740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fdf070 0x55f044396650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.054+0000 7ff6b6489740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043f72da0 0x55f044396b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.054+0000 7ff6b6489740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a81adda0 con 0x55f043fdf070 2024-09-21T03:49:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.054+0000 7ff6b6489740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a81af210 con 0x55f043fbe390 2024-09-21T03:49:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.054+0000 7ff6b6489740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a81ae470 con 0x55f043f72da0 2024-09-21T03:49:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.054+0000 7ff6b6489740 10 client.0 _ll_register_callbacks cb 0x7ff69c0f9070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:49:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.055+0000 7ff6ad4b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fdf070 0x55f044396650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.055+0000 7ff6ad4b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fdf070 0x55f044396650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41764/0 (socket says 172.21.15.84:41764) 2024-09-21T03:49:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.055+0000 7ff6ad4b0640 1 -- 172.21.15.84:0/2428709329 learned_addr learned my addr 172.21.15.84:0/2428709329 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.055+0000 7ff6ae4b2640 1 --2- 172.21.15.84:0/2428709329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043f72da0 0x55f044396b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:13.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.055+0000 7ff6adcb1640 1 --2- 172.21.15.84:0/2428709329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fbe390 0x55f044396110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.055+0000 7ff6ad4b0640 1 -- 172.21.15.84:0/2428709329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043f72da0 msgr2=0x55f044396b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.055+0000 7ff6ad4b0640 1 --2- 172.21.15.84:0/2428709329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043f72da0 0x55f044396b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.055+0000 7ff6ad4b0640 1 -- 172.21.15.84:0/2428709329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fbe390 msgr2=0x55f044396110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.055+0000 7ff6ad4b0640 1 --2- 172.21.15.84:0/2428709329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fbe390 0x55f044396110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.055+0000 7ff6ad4b0640 1 -- 172.21.15.84:0/2428709329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f044411f10 con 0x55f043fdf070 2024-09-21T03:49:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.055+0000 7ff6ad4b0640 1 --2- 172.21.15.84:0/2428709329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fdf070 0x55f044396650 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0a18e0 tx=0x7ff69c0eae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6897d86aefa50376 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.055+0000 7ff68d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:49:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.055+0000 7ff68d7fa640 1 -- 172.21.15.84:0/2428709329 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c020070 con 0x55f043fdf070 2024-09-21T03:49:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.055+0000 7ff68d7fa640 1 -- 172.21.15.84:0/2428709329 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7ff69c0a92b0 con 0x55f043fdf070 2024-09-21T03:49:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.055+0000 7ff6b6489740 1 -- 172.21.15.84:0/2428709329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff698012270 con 0x55f043fdf070 2024-09-21T03:49:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.056+0000 7ff68d7fa640 1 -- 172.21.15.84:0/2428709329 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff69c0a1910 con 0x55f043fdf070 2024-09-21T03:49:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.056+0000 7ff6b6489740 10 client.16683 fetch_fsmap learned FSMap version 25 2024-09-21T03:49:13.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.056+0000 7ff6b6489740 1 -- 172.21.15.84:0/2428709329 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f0444130e0 con 0x55f043fdf070 2024-09-21T03:49:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.056+0000 7ff68d7fa640 1 -- 172.21.15.84:0/2428709329 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff698012270 con 0x55f043fdf070 2024-09-21T03:49:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.056+0000 7ff68d7fa640 1 -- 172.21.15.84:0/2428709329 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff69c0050c0 con 0x55f043fdf070 2024-09-21T03:49:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.056+0000 7ff6b6489740 10 client.16683 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:49:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.056+0000 7ff6b6489740 10 client.16683 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:49:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.056+0000 7ff6b6489740 20 client.16683 populate_metadata read hostname 'smithi084' 2024-09-21T03:49:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.056+0000 7ff6b6489740 1 --2- 172.21.15.84:0/2428709329 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55f044413640 0x55f044415a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.056+0000 7ff6b6489740 4 client.16683 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:49:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.056+0000 7ff6b6489740 1 -- 172.21.15.84:0/2428709329 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f0442fa8a0 con 0x55f044413640 2024-09-21T03:49:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.056+0000 7ff6adcb1640 1 --2- 172.21.15.84:0/2428709329 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55f044413640 0x55f044415a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.057+0000 7ff68d7fa640 10 client.16683 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:49:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.057+0000 7ff6adcb1640 1 --2- 172.21.15.84:0/2428709329 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55f044413640 0x55f044415a60 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bcffd56c0c2d05ec server_cookie=fef7016e99260ec1 in_seq=0 out_seq=0 2024-09-21T03:49:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.057+0000 7ff68d7fa640 1 -- 172.21.15.84:0/2428709329 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f0442fa8a0 con 0x55f044413640 2024-09-21T03:49:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.057+0000 7ff68d7fa640 10 client.16683 handle_command_reply: tid=0 2024-09-21T03:49:13.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.057+0000 7ff6b6489740 1 client.16683 shutdown 2024-09-21T03:49:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.057+0000 7ff6b6489740 1 -- 172.21.15.84:0/2428709329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fdf070 msgr2=0x55f044396650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.057+0000 7ff6b6489740 1 --2- 172.21.15.84:0/2428709329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fdf070 0x55f044396650 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7ff69c0a18e0 tx=0x7ff69c0eae40 comp rx=0 tx=0).stop 2024-09-21T03:49:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.057+0000 7ff6b6489740 1 -- 172.21.15.84:0/2428709329 shutdown_connections 2024-09-21T03:49:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.057+0000 7ff6b6489740 1 --2- 172.21.15.84:0/2428709329 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55f044413640 0x55f044415a60 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.057+0000 7ff6b6489740 1 --2- 172.21.15.84:0/2428709329 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f043f72da0 0x55f044396b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.057+0000 7ff6b6489740 1 --2- 172.21.15.84:0/2428709329 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f043fdf070 0x55f044396650 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.057+0000 7ff68d7fa640 0 client.16683 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:49:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.057+0000 7ff6b6489740 1 --2- 172.21.15.84:0/2428709329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f043fbe390 0x55f044396110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.057+0000 7ff6b6489740 1 -- 172.21.15.84:0/2428709329 >> 172.21.15.84:0/2428709329 conn(0x55f043fd3460 msgr2=0x55f044389770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.057+0000 7ff6b6489740 1 -- 172.21.15.84:0/2428709329 shutdown_connections 2024-09-21T03:49:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.057+0000 7ff6b6489740 1 -- 172.21.15.84:0/2428709329 wait complete. 2024-09-21T03:49:13.064 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.058+0000 7ff6b6489740 20 client.16683 trim_cache size 0 max 16384 2024-09-21T03:49:13.065 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:49:13.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.058+0000 7ff6aff15640 1 -- 172.21.15.84:0/3123707085 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff6900b6680 msgr2=0x7ff6900b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:13.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.058+0000 7ff6aff15640 1 --2- 172.21.15.84:0/3123707085 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff6900b6680 0x7ff6900b8b90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff6a002a930 tx=0x7ff6a0005f30 comp rx=0 tx=0).stop 2024-09-21T03:49:13.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.058+0000 7ff6aff15640 1 -- 172.21.15.84:0/3123707085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6a81094a0 msgr2=0x7ff6a819aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:13.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.058+0000 7ff6aff15640 1 --2- 172.21.15.84:0/3123707085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6a81094a0 0x7ff6a819aa80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00d750 tx=0x7ff69c00dc10 comp rx=0 tx=0).stop 2024-09-21T03:49:13.065 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.058+0000 7ff6aff15640 1 -- 172.21.15.84:0/3123707085 shutdown_connections 2024-09-21T03:49:13.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.058+0000 7ff6aff15640 1 --2- 172.21.15.84:0/3123707085 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff6900b6680 0x7ff6900b8b90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.058+0000 7ff6aff15640 1 --2- 172.21.15.84:0/3123707085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff6a8109df0 0x7ff6a819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.058+0000 7ff6aff15640 1 --2- 172.21.15.84:0/3123707085 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff6a81094a0 0x7ff6a819aa80 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.058+0000 7ff6aff15640 1 --2- 172.21.15.84:0/3123707085 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff6a8103b60 0x7ff6a819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:13.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.058+0000 7ff6aff15640 1 -- 172.21.15.84:0/3123707085 >> 172.21.15.84:0/3123707085 conn(0x7ff6a807b850 msgr2=0x7ff6a81074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:13.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.058+0000 7ff6aff15640 1 -- 172.21.15.84:0/3123707085 shutdown_connections 2024-09-21T03:49:13.066 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:13.058+0000 7ff6aff15640 1 -- 172.21.15.84:0/3123707085 wait complete. 2024-09-21T03:49:13.879 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:49:14.127 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:49:14.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.649+0000 7fe5e5e0b640 1 -- 172.21.15.84:0/1871244853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5e0108cf0 msgr2=0x7fe5e010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:14.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.649+0000 7fe5e5e0b640 1 --2- 172.21.15.84:0/1871244853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5e0108cf0 0x7fe5e010f520 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8009ca0 tx=0x7fe5d802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.650+0000 7fe5e5e0b640 1 -- 172.21.15.84:0/1871244853 shutdown_connections 2024-09-21T03:49:14.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.650+0000 7fe5e5e0b640 1 --2- 172.21.15.84:0/1871244853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5e0108cf0 0x7fe5e010f520 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.650+0000 7fe5e5e0b640 1 --2- 172.21.15.84:0/1871244853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5e01083a0 0x7fe5e01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.650+0000 7fe5e5e0b640 1 --2- 172.21.15.84:0/1871244853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5e0102a60 0x7fe5e0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.650+0000 7fe5e5e0b640 1 -- 172.21.15.84:0/1871244853 >> 172.21.15.84:0/1871244853 conn(0x7fe5e0079730 msgr2=0x7fe5e0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:14.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.650+0000 7fe5e5e0b640 1 -- 172.21.15.84:0/1871244853 shutdown_connections 2024-09-21T03:49:14.653 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.650+0000 7fe5e5e0b640 1 -- 172.21.15.84:0/1871244853 wait complete. 2024-09-21T03:49:14.653 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:14 smithi084 ceph-mon[30941]: pgmap v528: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-21T03:49:14.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.651+0000 7fe5e5e0b640 1 Processor -- start 2024-09-21T03:49:14.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.651+0000 7fe5e5e0b640 1 -- start start 2024-09-21T03:49:14.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.651+0000 7fe5e5e0b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5e0102a60 0x7fe5e0199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:14.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.651+0000 7fe5e5e0b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5e01083a0 0x7fe5e0199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:14.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.651+0000 7fe5e5e0b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5e0108cf0 0x7fe5e019e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:14.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.651+0000 7fe5e5e0b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e0112960 con 0x7fe5e01083a0 2024-09-21T03:49:14.655 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.651+0000 7fe5e5e0b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01127e0 con 0x7fe5e0108cf0 2024-09-21T03:49:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.651+0000 7fe5e5e0b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e0112ae0 con 0x7fe5e0102a60 2024-09-21T03:49:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.651+0000 7fe5d7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5e01083a0 0x7fe5e0199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.651+0000 7fe5d7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5e01083a0 0x7fe5e0199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41780/0 (socket says 172.21.15.84:41780) 2024-09-21T03:49:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.651+0000 7fe5d7fff640 1 -- 172.21.15.84:0/1171778633 learned_addr learned my addr 172.21.15.84:0/1171778633 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.652+0000 7fe5dffff640 1 --2- 172.21.15.84:0/1171778633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5e0108cf0 0x7fe5e019e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.652+0000 7fe5df7fe640 1 --2- 172.21.15.84:0/1171778633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5e0102a60 0x7fe5e0199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.652+0000 7fe5d7fff640 1 -- 172.21.15.84:0/1171778633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5e0102a60 msgr2=0x7fe5e0199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.652+0000 7fe5d7fff640 1 --2- 172.21.15.84:0/1171778633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5e0102a60 0x7fe5e0199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.652+0000 7fe5d7fff640 1 -- 172.21.15.84:0/1171778633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5e0108cf0 msgr2=0x7fe5e019e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.652+0000 7fe5d7fff640 1 --2- 172.21.15.84:0/1171778633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5e0108cf0 0x7fe5e019e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.652+0000 7fe5d7fff640 1 -- 172.21.15.84:0/1171778633 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e019f040 con 0x7fe5e01083a0 2024-09-21T03:49:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.652+0000 7fe5d7fff640 1 --2- 172.21.15.84:0/1171778633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5e01083a0 0x7fe5e0199730 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8007b50 tx=0x7fe5c800e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.652+0000 7fe5dd7fa640 1 -- 172.21.15.84:0/1171778633 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c801a070 con 0x7fe5e01083a0 2024-09-21T03:49:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.652+0000 7fe5e5e0b640 1 -- 172.21.15.84:0/1171778633 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e019f330 con 0x7fe5e01083a0 2024-09-21T03:49:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.652+0000 7fe5dd7fa640 1 -- 172.21.15.84:0/1171778633 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5c8007c40 con 0x7fe5e01083a0 2024-09-21T03:49:14.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.652+0000 7fe5dd7fa640 1 -- 172.21.15.84:0/1171778633 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8003850 con 0x7fe5e01083a0 2024-09-21T03:49:14.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.652+0000 7fe5e5e0b640 1 -- 172.21.15.84:0/1171778633 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5e006ae60 con 0x7fe5e01083a0 2024-09-21T03:49:14.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.655+0000 7fe5ec37f740 1 Processor -- start 2024-09-21T03:49:14.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.655+0000 7fe5ec37f740 1 -- start start 2024-09-21T03:49:14.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.655+0000 7fe5dd7fa640 1 -- 172.21.15.84:0/1171778633 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fe5c80039f0 con 0x7fe5e01083a0 2024-09-21T03:49:14.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.655+0000 7fe5ec37f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5d4070 0x55c2ba97b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:14.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.655+0000 7fe5ec37f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5ab1b0 0x55c2ba97b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:14.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.655+0000 7fe5ec37f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5b3390 0x55c2ba97bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:14.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.655+0000 7fe5ec37f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c2ba8f1ea0 con 0x55c2ba5b3390 2024-09-21T03:49:14.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.655+0000 7fe5ec37f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c2ba8e12d0 con 0x55c2ba5d4070 2024-09-21T03:49:14.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.655+0000 7fe5ec37f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c2ba8e50e0 con 0x55c2ba5ab1b0 2024-09-21T03:49:14.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.656+0000 7fe5d7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5b3390 0x55c2ba97bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:14.659 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.656+0000 7fe5d7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5b3390 0x55c2ba97bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41788/0 (socket says 172.21.15.84:41788) 2024-09-21T03:49:14.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.656+0000 7fe5d7fff640 1 -- 172.21.15.84:0/3834556464 learned_addr learned my addr 172.21.15.84:0/3834556464 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:14.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.656+0000 7fe5df7fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5ab1b0 0x55c2ba97b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:14.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.656+0000 7fe5dffff640 1 --2- 172.21.15.84:0/3834556464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5d4070 0x55c2ba97b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:14.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.656+0000 7fe5df7fe640 1 -- 172.21.15.84:0/3834556464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5d4070 msgr2=0x55c2ba97b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:14.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.656+0000 7fe5df7fe640 1 --2- 172.21.15.84:0/3834556464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5d4070 0x55c2ba97b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.656+0000 7fe5df7fe640 1 -- 172.21.15.84:0/3834556464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5b3390 msgr2=0x55c2ba97bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:14.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.656+0000 7fe5df7fe640 1 --2- 172.21.15.84:0/3834556464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5b3390 0x55c2ba97bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.656+0000 7fe5df7fe640 1 -- 172.21.15.84:0/3834556464 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2ba63f650 con 0x55c2ba5ab1b0 2024-09-21T03:49:14.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.656+0000 7fe5d7fff640 1 --2- 172.21.15.84:0/3834556464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5b3390 0x55c2ba97bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:49:14.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.656+0000 7fe5dd7fa640 1 --2- 172.21.15.84:0/1171778633 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe5cc0baac0 0x7fe5cc0bcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:14.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.656+0000 7fe5df7fe640 1 --2- 172.21.15.84:0/3834556464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5ab1b0 0x55c2ba97b800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000ab40 tx=0x7fe5d000f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a77d43e683f74d1f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:14.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.656+0000 7fe5dffff640 1 --2- 172.21.15.84:0/1171778633 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe5cc0baac0 0x7fe5cc0bcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:14.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.656+0000 7fe5d5ffb640 1 -- 172.21.15.84:0/3834556464 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0004020 con 0x55c2ba5ab1b0 2024-09-21T03:49:14.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.656+0000 7fe5dd7fa640 1 -- 172.21.15.84:0/1171778633 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7fe5c80e65f0 con 0x7fe5e01083a0 2024-09-21T03:49:14.660 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.657+0000 7fe5d5ffb640 1 -- 172.21.15.84:0/3834556464 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5d00041c0 con 0x55c2ba5ab1b0 2024-09-21T03:49:14.661 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.657+0000 7fe5d5ffb640 1 -- 172.21.15.84:0/3834556464 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0018770 con 0x55c2ba5ab1b0 2024-09-21T03:49:14.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.657+0000 7fe5ec37f740 1 -- 172.21.15.84:0/3834556464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5ab1b0 msgr2=0x55c2ba97b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:14.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.657+0000 7fe5dffff640 1 --2- 172.21.15.84:0/1171778633 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe5cc0baac0 0x7fe5cc0bcfd0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8009a60 tx=0x7fe5d8005c50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:14.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.657+0000 7fe5ec37f740 1 --2- 172.21.15.84:0/3834556464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5ab1b0 0x55c2ba97b800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000ab40 tx=0x7fe5d000f3c0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.658+0000 7fe5ec37f740 1 -- 172.21.15.84:0/3834556464 shutdown_connections 2024-09-21T03:49:14.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.658+0000 7fe5ec37f740 1 --2- 172.21.15.84:0/3834556464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5b3390 0x55c2ba97bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.658+0000 7fe5ec37f740 1 --2- 172.21.15.84:0/3834556464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5ab1b0 0x55c2ba97b800 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.658+0000 7fe5ec37f740 1 --2- 172.21.15.84:0/3834556464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5d4070 0x55c2ba97b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.658+0000 7fe5ec37f740 1 -- 172.21.15.84:0/3834556464 >> 172.21.15.84:0/3834556464 conn(0x55c2ba5c8460 msgr2=0x55c2ba9791b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:14.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.658+0000 7fe5ec37f740 1 -- 172.21.15.84:0/3834556464 shutdown_connections 2024-09-21T03:49:14.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.658+0000 7fe5ec37f740 1 -- 172.21.15.84:0/3834556464 wait complete. 2024-09-21T03:49:14.664 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.658+0000 7fe5ec37f740 1 -- start start 2024-09-21T03:49:14.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.658+0000 7fe5ec37f740 1 Processor -- start 2024-09-21T03:49:14.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.659+0000 7fe5ec37f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5ab1b0 0x55c2ba986980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:14.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.659+0000 7fe5ec37f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5b3390 0x55c2ba986ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:14.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.659+0000 7fe5ec37f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 0x55c2ba992d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:14.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.659+0000 7fe5ec37f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c2ba742700 con 0x55c2ba5d4070 2024-09-21T03:49:14.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.659+0000 7fe5ec37f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c2ba87c160 con 0x55c2ba5ab1b0 2024-09-21T03:49:14.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.659+0000 7fe5ec37f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c2ba989aa0 con 0x55c2ba5b3390 2024-09-21T03:49:14.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.659+0000 7fe5ec37f740 10 client.0 _ll_register_callbacks cb 0x55c2ba8959e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:49:14.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.659+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 0x55c2ba992d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:14.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.659+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 0x55c2ba992d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41798/0 (socket says 172.21.15.84:41798) 2024-09-21T03:49:14.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.659+0000 7fe5dffff640 1 -- 172.21.15.84:0/2408805564 learned_addr learned my addr 172.21.15.84:0/2408805564 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:14.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.659+0000 7fe5d7fff640 1 --2- 172.21.15.84:0/2408805564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5b3390 0x55c2ba986ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:14.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.659+0000 7fe5df7fe640 1 --2- 172.21.15.84:0/2408805564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5ab1b0 0x55c2ba986980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:14.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.659+0000 7fe5d7fff640 1 -- 172.21.15.84:0/2408805564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5ab1b0 msgr2=0x55c2ba986980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:14.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.659+0000 7fe5d7fff640 1 --2- 172.21.15.84:0/2408805564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5ab1b0 0x55c2ba986980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.659+0000 7fe5d7fff640 1 -- 172.21.15.84:0/2408805564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 msgr2=0x55c2ba992d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:14.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.659+0000 7fe5d7fff640 1 --2- 172.21.15.84:0/2408805564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 0x55c2ba992d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.659+0000 7fe5d7fff640 1 -- 172.21.15.84:0/2408805564 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2ba8a9c90 con 0x55c2ba5b3390 2024-09-21T03:49:14.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.659+0000 7fe5dffff640 1 --2- 172.21.15.84:0/2408805564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 0x55c2ba992d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:49:14.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.659+0000 7fe5d7fff640 1 --2- 172.21.15.84:0/2408805564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5b3390 0x55c2ba986ec0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80ac4a0 tx=0x7fe5c8003f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fb68545b0f6d16c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:14.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.659+0000 7fe5beffd640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-21T03:49:14.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.660+0000 7fe5beffd640 1 -- 172.21.15.84:0/2408805564 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c80a83b0 con 0x55c2ba5b3390 2024-09-21T03:49:14.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.660+0000 7fe5beffd640 1 -- 172.21.15.84:0/2408805564 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7fe5c80e60d0 con 0x55c2ba5b3390 2024-09-21T03:49:14.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.660+0000 7fe5ec37f740 1 -- 172.21.15.84:0/2408805564 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5d00041c0 con 0x55c2ba5b3390 2024-09-21T03:49:14.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.660+0000 7fe5beffd640 1 -- 172.21.15.84:0/2408805564 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe5c80abc80 con 0x55c2ba5b3390 2024-09-21T03:49:14.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.660+0000 7fe5ec37f740 10 client.25864 fetch_fsmap learned FSMap version 25 2024-09-21T03:49:14.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.660+0000 7fe5ec37f740 1 -- 172.21.15.84:0/2408805564 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c2ba995780 con 0x55c2ba5b3390 2024-09-21T03:49:14.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.660+0000 7fe5beffd640 1 -- 172.21.15.84:0/2408805564 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5d00041c0 con 0x55c2ba5b3390 2024-09-21T03:49:14.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.660+0000 7fe5beffd640 1 -- 172.21.15.84:0/2408805564 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe5c8014030 con 0x55c2ba5b3390 2024-09-21T03:49:14.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.660+0000 7fe5ec37f740 10 client.25864 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:49:14.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.660+0000 7fe5ec37f740 10 client.25864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:49:14.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.660+0000 7fe5ec37f740 20 client.25864 populate_metadata read hostname 'smithi084' 2024-09-21T03:49:14.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.660+0000 7fe5ec37f740 1 --2- 172.21.15.84:0/2408805564 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c2ba5929f0 0x55c2ba998ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:14.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.660+0000 7fe5ec37f740 4 client.25864 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:49:14.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.660+0000 7fe5ec37f740 1 -- 172.21.15.84:0/2408805564 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2ba8f3df0 con 0x55c2ba5929f0 2024-09-21T03:49:14.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.661+0000 7fe5df7fe640 1 --2- 172.21.15.84:0/2408805564 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c2ba5929f0 0x55c2ba998ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:14.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.661+0000 7fe5beffd640 10 client.25864 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:14.667 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.661+0000 7fe5df7fe640 1 --2- 172.21.15.84:0/2408805564 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c2ba5929f0 0x55c2ba998ca0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf24fdf54ea96e6f server_cookie=c098dceb653f72f9 in_seq=0 out_seq=0 2024-09-21T03:49:14.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.663+0000 7fe5beffd640 1 -- 172.21.15.84:0/2408805564 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c2ba8f3df0 con 0x55c2ba5929f0 2024-09-21T03:49:14.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.663+0000 7fe5beffd640 10 client.25864 handle_command_reply: tid=0 2024-09-21T03:49:14.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.663+0000 7fe5ec37f740 1 client.25864 shutdown 2024-09-21T03:49:14.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.663+0000 7fe5ec37f740 1 -- 172.21.15.84:0/2408805564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5b3390 msgr2=0x55c2ba986ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:14.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.663+0000 7fe5ec37f740 1 --2- 172.21.15.84:0/2408805564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5b3390 0x55c2ba986ec0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe5c80ac4a0 tx=0x7fe5c8003f60 comp rx=0 tx=0).stop 2024-09-21T03:49:14.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.663+0000 7fe5ec37f740 1 -- 172.21.15.84:0/2408805564 shutdown_connections 2024-09-21T03:49:14.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.663+0000 7fe5ec37f740 1 --2- 172.21.15.84:0/2408805564 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c2ba5929f0 0x55c2ba998ca0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.663+0000 7fe5ec37f740 1 --2- 172.21.15.84:0/2408805564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 0x55c2ba992d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.663+0000 7fe5ec37f740 1 --2- 172.21.15.84:0/2408805564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5b3390 0x55c2ba986ec0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.663+0000 7fe5ec37f740 1 --2- 172.21.15.84:0/2408805564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5ab1b0 0x55c2ba986980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.663+0000 7fe5beffd640 0 client.25864 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:14.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.663+0000 7fe5ec37f740 1 -- 172.21.15.84:0/2408805564 >> 172.21.15.84:0/2408805564 conn(0x55c2ba5c8460 msgr2=0x55c2ba97e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:14.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.663+0000 7fe5ec37f740 1 -- 172.21.15.84:0/2408805564 shutdown_connections 2024-09-21T03:49:14.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.663+0000 7fe5ec37f740 1 -- 172.21.15.84:0/2408805564 wait complete. 2024-09-21T03:49:14.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.663+0000 7fe5ec37f740 20 client.25864 trim_cache size 0 max 16384 2024-09-21T03:49:14.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.676+0000 7fe5ec37f740 1 Processor -- start 2024-09-21T03:49:14.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.676+0000 7fe5ec37f740 1 -- start start 2024-09-21T03:49:14.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.676+0000 7fe5ec37f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5ab1b0 0x55c2ba982130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:14.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.676+0000 7fe5ec37f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5b3390 0x55c2ba988540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:14.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.676+0000 7fe5ec37f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 0x55c2ba992c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:14.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.676+0000 7fe5ec37f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01afd00 con 0x55c2ba5d4070 2024-09-21T03:49:14.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.676+0000 7fe5ec37f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01ad5d0 con 0x55c2ba5ab1b0 2024-09-21T03:49:14.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.676+0000 7fe5ec37f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01ab440 con 0x55c2ba5b3390 2024-09-21T03:49:14.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.676+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 0x55c2ba992c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:14.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.676+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 0x55c2ba992c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41800/0 (socket says 172.21.15.84:41800) 2024-09-21T03:49:14.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.676+0000 7fe5dffff640 1 -- 172.21.15.84:0/2289156418 learned_addr learned my addr 172.21.15.84:0/2289156418 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:14.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.677+0000 7fe5df7fe640 1 --2- 172.21.15.84:0/2289156418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5ab1b0 0x55c2ba982130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:14.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.677+0000 7fe5d7fff640 1 --2- 172.21.15.84:0/2289156418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5b3390 0x55c2ba988540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:14.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.677+0000 7fe5dffff640 1 -- 172.21.15.84:0/2289156418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5b3390 msgr2=0x55c2ba988540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:14.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.677+0000 7fe5dffff640 1 --2- 172.21.15.84:0/2289156418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5b3390 0x55c2ba988540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.677+0000 7fe5dffff640 1 -- 172.21.15.84:0/2289156418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5ab1b0 msgr2=0x55c2ba982130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.677+0000 7fe5dffff640 1 --2- 172.21.15.84:0/2289156418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5ab1b0 0x55c2ba982130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.677+0000 7fe5dffff640 1 -- 172.21.15.84:0/2289156418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2ba97d5b0 con 0x55c2ba5d4070 2024-09-21T03:49:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.677+0000 7fe5dffff640 1 --2- 172.21.15.84:0/2289156418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 0x55c2ba992c90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe5d80097b0 tx=0x7fe5d8044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425ea4dd1dba098f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.677+0000 7fe5d57fa640 1 -- 172.21.15.84:0/2289156418 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8031830 con 0x55c2ba5d4070 2024-09-21T03:49:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.677+0000 7fe5d57fa640 1 -- 172.21.15.84:0/2289156418 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5d8036050 con 0x55c2ba5d4070 2024-09-21T03:49:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.677+0000 7fe5d57fa640 1 -- 172.21.15.84:0/2289156418 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d802fb90 con 0x55c2ba5d4070 2024-09-21T03:49:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.678+0000 7fe5ec37f740 1 -- 172.21.15.84:0/2289156418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 msgr2=0x55c2ba992c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.678+0000 7fe5ec37f740 1 --2- 172.21.15.84:0/2289156418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 0x55c2ba992c90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe5d80097b0 tx=0x7fe5d8044000 comp rx=0 tx=0).stop 2024-09-21T03:49:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.678+0000 7fe5ec37f740 1 -- 172.21.15.84:0/2289156418 shutdown_connections 2024-09-21T03:49:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.678+0000 7fe5ec37f740 1 --2- 172.21.15.84:0/2289156418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 0x55c2ba992c90 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.678+0000 7fe5ec37f740 1 --2- 172.21.15.84:0/2289156418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5b3390 0x55c2ba988540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.678+0000 7fe5ec37f740 1 --2- 172.21.15.84:0/2289156418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5ab1b0 0x55c2ba982130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.678+0000 7fe5ec37f740 1 -- 172.21.15.84:0/2289156418 >> 172.21.15.84:0/2289156418 conn(0x55c2ba5c8460 msgr2=0x55c2ba987e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.678+0000 7fe5ec37f740 1 -- 172.21.15.84:0/2289156418 shutdown_connections 2024-09-21T03:49:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.678+0000 7fe5ec37f740 1 -- 172.21.15.84:0/2289156418 wait complete. 2024-09-21T03:49:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.678+0000 7fe5ec37f740 1 -- start start 2024-09-21T03:49:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.678+0000 7fe5ec37f740 1 Processor -- start 2024-09-21T03:49:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5ec37f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5ab1b0 0x55c2ba98f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5ec37f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5b3390 0x55c2ba98f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5ec37f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 0x55c2ba98a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5ec37f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01aba90 con 0x55c2ba5d4070 2024-09-21T03:49:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5ec37f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01acf00 con 0x55c2ba5b3390 2024-09-21T03:49:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5ec37f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01ac160 con 0x55c2ba5ab1b0 2024-09-21T03:49:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5ec37f740 10 client.0 _ll_register_callbacks cb 0x7fe5c80ec240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:49:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 0x55c2ba98a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5dffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 0x55c2ba98a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41804/0 (socket says 172.21.15.84:41804) 2024-09-21T03:49:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5dffff640 1 -- 172.21.15.84:0/1783889601 learned_addr learned my addr 172.21.15.84:0/1783889601 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5df7fe640 1 --2- 172.21.15.84:0/1783889601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5ab1b0 0x55c2ba98f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5d7fff640 1 --2- 172.21.15.84:0/1783889601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5b3390 0x55c2ba98f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5dffff640 1 -- 172.21.15.84:0/1783889601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5ab1b0 msgr2=0x55c2ba98f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5dffff640 1 --2- 172.21.15.84:0/1783889601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5ab1b0 0x55c2ba98f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5dffff640 1 -- 172.21.15.84:0/1783889601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5b3390 msgr2=0x55c2ba98f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5dffff640 1 --2- 172.21.15.84:0/1783889601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5b3390 0x55c2ba98f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5dffff640 1 -- 172.21.15.84:0/1783889601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2ba98ae50 con 0x55c2ba5d4070 2024-09-21T03:49:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5df7fe640 1 --2- 172.21.15.84:0/1783889601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5ab1b0 0x55c2ba98f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:49:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5d7fff640 1 --2- 172.21.15.84:0/1783889601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5b3390 0x55c2ba98f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:49:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5dffff640 1 --2- 172.21.15.84:0/1783889601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 0x55c2ba98a6e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe5d802f870 tx=0x7fe5d802f910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f01bd53fa80e76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.679+0000 7fe5beffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:49:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.680+0000 7fe5beffd640 1 -- 172.21.15.84:0/1783889601 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d802fdd0 con 0x55c2ba5d4070 2024-09-21T03:49:14.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.680+0000 7fe5beffd640 1 -- 172.21.15.84:0/1783889601 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8485+0+0 (secure 0 0 0) 0x7fe5d8004000 con 0x55c2ba5d4070 2024-09-21T03:49:14.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.680+0000 7fe5ec37f740 1 -- 172.21.15.84:0/1783889601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5d8036050 con 0x55c2ba5d4070 2024-09-21T03:49:14.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.680+0000 7fe5beffd640 1 -- 172.21.15.84:0/1783889601 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe5d8065050 con 0x55c2ba5d4070 2024-09-21T03:49:14.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.680+0000 7fe5ec37f740 10 client.16701 fetch_fsmap learned FSMap version 25 2024-09-21T03:49:14.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.680+0000 7fe5ec37f740 1 -- 172.21.15.84:0/1783889601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c2baa03180 con 0x55c2ba5d4070 2024-09-21T03:49:14.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.680+0000 7fe5beffd640 1 -- 172.21.15.84:0/1783889601 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5d8036050 con 0x55c2ba5d4070 2024-09-21T03:49:14.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.680+0000 7fe5beffd640 1 -- 172.21.15.84:0/1783889601 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe5d80309c0 con 0x55c2ba5d4070 2024-09-21T03:49:14.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.680+0000 7fe5ec37f740 10 client.16701 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:49:14.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.680+0000 7fe5ec37f740 10 client.16701 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:49:14.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.680+0000 7fe5ec37f740 20 client.16701 populate_metadata read hostname 'smithi084' 2024-09-21T03:49:14.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.680+0000 7fe5ec37f740 1 --2- 172.21.15.84:0/1783889601 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c2ba567da0 0x55c2baa05880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:14.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.680+0000 7fe5ec37f740 4 client.16701 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:49:14.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.680+0000 7fe5ec37f740 1 -- 172.21.15.84:0/1783889601 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c2ba8ef8a0 con 0x55c2ba567da0 2024-09-21T03:49:14.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.681+0000 7fe5df7fe640 1 --2- 172.21.15.84:0/1783889601 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c2ba567da0 0x55c2baa05880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:14.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.681+0000 7fe5df7fe640 1 --2- 172.21.15.84:0/1783889601 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c2ba567da0 0x55c2baa05880 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7a5a6bdda393d15 server_cookie=c41bc5dce64a60e2 in_seq=0 out_seq=0 2024-09-21T03:49:14.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.681+0000 7fe5beffd640 10 client.16701 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:14.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.681+0000 7fe5beffd640 1 -- 172.21.15.84:0/1783889601 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c2ba8ef8a0 con 0x55c2ba567da0 2024-09-21T03:49:14.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.681+0000 7fe5beffd640 10 client.16701 handle_command_reply: tid=0 2024-09-21T03:49:14.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.681+0000 7fe5ec37f740 1 client.16701 shutdown 2024-09-21T03:49:14.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.681+0000 7fe5ec37f740 1 -- 172.21.15.84:0/1783889601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 msgr2=0x55c2ba98a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:14.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.681+0000 7fe5ec37f740 1 --2- 172.21.15.84:0/1783889601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 0x55c2ba98a6e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe5d802f870 tx=0x7fe5d802f910 comp rx=0 tx=0).stop 2024-09-21T03:49:14.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.682+0000 7fe5ec37f740 1 -- 172.21.15.84:0/1783889601 shutdown_connections 2024-09-21T03:49:14.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.682+0000 7fe5ec37f740 1 --2- 172.21.15.84:0/1783889601 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c2ba567da0 0x55c2baa05880 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.682+0000 7fe5ec37f740 1 --2- 172.21.15.84:0/1783889601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2ba5d4070 0x55c2ba98a6e0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.682+0000 7fe5ec37f740 1 --2- 172.21.15.84:0/1783889601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2ba5b3390 0x55c2ba98f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.682+0000 7fe5ec37f740 1 --2- 172.21.15.84:0/1783889601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2ba5ab1b0 0x55c2ba98f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.682+0000 7fe5ec37f740 1 -- 172.21.15.84:0/1783889601 >> 172.21.15.84:0/1783889601 conn(0x55c2ba5c8460 msgr2=0x55c2ba97c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:14.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.682+0000 7fe5beffd640 0 client.16701 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:14.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.682+0000 7fe5ec37f740 1 -- 172.21.15.84:0/1783889601 shutdown_connections 2024-09-21T03:49:14.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.682+0000 7fe5ec37f740 1 -- 172.21.15.84:0/1783889601 wait complete. 2024-09-21T03:49:14.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.682+0000 7fe5ec37f740 20 client.16701 trim_cache size 0 max 16384 2024-09-21T03:49:14.691 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:49:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.682+0000 7fe5e5e0b640 1 -- 172.21.15.84:0/1171778633 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe5cc0baac0 msgr2=0x7fe5cc0bcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.682+0000 7fe5e5e0b640 1 --2- 172.21.15.84:0/1171778633 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe5cc0baac0 0x7fe5cc0bcfd0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8009a60 tx=0x7fe5d8005c50 comp rx=0 tx=0).stop 2024-09-21T03:49:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.682+0000 7fe5e5e0b640 1 -- 172.21.15.84:0/1171778633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5e01083a0 msgr2=0x7fe5e0199730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.682+0000 7fe5e5e0b640 1 --2- 172.21.15.84:0/1171778633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5e01083a0 0x7fe5e0199730 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8007b50 tx=0x7fe5c800e420 comp rx=0 tx=0).stop 2024-09-21T03:49:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.682+0000 7fe5e5e0b640 1 -- 172.21.15.84:0/1171778633 shutdown_connections 2024-09-21T03:49:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.682+0000 7fe5e5e0b640 1 --2- 172.21.15.84:0/1171778633 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe5cc0baac0 0x7fe5cc0bcfd0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.682+0000 7fe5e5e0b640 1 --2- 172.21.15.84:0/1171778633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe5e0108cf0 0x7fe5e019e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.682+0000 7fe5e5e0b640 1 --2- 172.21.15.84:0/1171778633 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe5e01083a0 0x7fe5e0199730 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.682+0000 7fe5e5e0b640 1 --2- 172.21.15.84:0/1171778633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe5e0102a60 0x7fe5e0199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.682+0000 7fe5e5e0b640 1 -- 172.21.15.84:0/1171778633 >> 172.21.15.84:0/1171778633 conn(0x7fe5e0079730 msgr2=0x7fe5e00ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.683+0000 7fe5e5e0b640 1 -- 172.21.15.84:0/1171778633 shutdown_connections 2024-09-21T03:49:14.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:14.683+0000 7fe5e5e0b640 1 -- 172.21.15.84:0/1171778633 wait complete. 2024-09-21T03:49:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:14 smithi174 ceph-mon[34403]: pgmap v528: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-21T03:49:14.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:14 smithi172 ceph-mon[34821]: pgmap v528: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-21T03:49:16.535 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:49:16.535 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:49:16.560 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:16 smithi084 ceph-mon[30941]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T03:49:16.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:16 smithi174 ceph-mon[34403]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T03:49:16.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:16 smithi172 ceph-mon[34821]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T03:49:16.787 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:49:17.331 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.329+0000 7f4b3890e640 1 -- 172.21.15.84:0/2453305052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b34113eb0 msgr2=0x7f4b341142c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:17.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.329+0000 7f4b3890e640 1 --2- 172.21.15.84:0/2453305052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b34113eb0 0x7f4b341142c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c009900 tx=0x7f4b1c02a410 comp rx=0 tx=0).stop 2024-09-21T03:49:17.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.329+0000 7f4b3890e640 1 -- 172.21.15.84:0/2453305052 shutdown_connections 2024-09-21T03:49:17.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.329+0000 7f4b3890e640 1 --2- 172.21.15.84:0/2453305052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b34114800 0x7f4b3411b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.329+0000 7f4b3890e640 1 --2- 172.21.15.84:0/2453305052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b34113eb0 0x7f4b341142c0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.329+0000 7f4b3890e640 1 --2- 172.21.15.84:0/2453305052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b3410e5c0 0x7f4b3410e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.329+0000 7f4b3890e640 1 -- 172.21.15.84:0/2453305052 >> 172.21.15.84:0/2453305052 conn(0x7f4b3410a3c0 msgr2=0x7f4b3410c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:17.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.329+0000 7f4b3890e640 1 -- 172.21.15.84:0/2453305052 shutdown_connections 2024-09-21T03:49:17.332 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.329+0000 7f4b3890e640 1 -- 172.21.15.84:0/2453305052 wait complete. 2024-09-21T03:49:17.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.330+0000 7f4b3890e640 1 Processor -- start 2024-09-21T03:49:17.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.330+0000 7f4b3890e640 1 -- start start 2024-09-21T03:49:17.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.330+0000 7f4b3890e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b3410e5c0 0x7f4b341a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:17.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.330+0000 7f4b3890e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b34113eb0 0x7f4b341a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:17.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.330+0000 7f4b3890e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b34114800 0x7f4b341aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:17.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.330+0000 7f4b3890e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3411e490 con 0x7f4b3410e5c0 2024-09-21T03:49:17.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.330+0000 7f4b3890e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3411e310 con 0x7f4b34114800 2024-09-21T03:49:17.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.330+0000 7f4b3890e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3411e610 con 0x7f4b34113eb0 2024-09-21T03:49:17.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.330+0000 7f4b3259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b3410e5c0 0x7f4b341a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:17.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.330+0000 7f4b3259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b3410e5c0 0x7f4b341a4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41822/0 (socket says 172.21.15.84:41822) 2024-09-21T03:49:17.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.330+0000 7f4b3259c640 1 -- 172.21.15.84:0/1986600430 learned_addr learned my addr 172.21.15.84:0/1986600430 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:17.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.331+0000 7f4b32d9d640 1 --2- 172.21.15.84:0/1986600430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b34114800 0x7f4b341aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:17.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.331+0000 7f4b2bfff640 1 --2- 172.21.15.84:0/1986600430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b34113eb0 0x7f4b341a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:17.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.331+0000 7f4b3259c640 1 -- 172.21.15.84:0/1986600430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b34113eb0 msgr2=0x7f4b341a5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:17.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.331+0000 7f4b3259c640 1 --2- 172.21.15.84:0/1986600430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b34113eb0 0x7f4b341a5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.331+0000 7f4b3259c640 1 -- 172.21.15.84:0/1986600430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b34114800 msgr2=0x7f4b341aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:17.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.331+0000 7f4b3259c640 1 --2- 172.21.15.84:0/1986600430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b34114800 0x7f4b341aa6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.331+0000 7f4b3259c640 1 -- 172.21.15.84:0/1986600430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b341aae10 con 0x7f4b3410e5c0 2024-09-21T03:49:17.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.331+0000 7f4b32d9d640 1 --2- 172.21.15.84:0/1986600430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b34114800 0x7f4b341aa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:49:17.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.331+0000 7f4b3259c640 1 --2- 172.21.15.84:0/1986600430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b3410e5c0 0x7f4b341a4ea0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400d950 tx=0x7f4b2400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:17.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.331+0000 7f4b2b7fe640 1 -- 172.21.15.84:0/1986600430 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b24017070 con 0x7f4b3410e5c0 2024-09-21T03:49:17.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.331+0000 7f4b2b7fe640 1 -- 172.21.15.84:0/1986600430 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b24009c30 con 0x7f4b3410e5c0 2024-09-21T03:49:17.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.331+0000 7f4b3890e640 1 -- 172.21.15.84:0/1986600430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b341ab100 con 0x7f4b3410e5c0 2024-09-21T03:49:17.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.331+0000 7f4b2b7fe640 1 -- 172.21.15.84:0/1986600430 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2400f620 con 0x7f4b3410e5c0 2024-09-21T03:49:17.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.331+0000 7f4b3890e640 1 -- 172.21.15.84:0/1986600430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b341b1860 con 0x7f4b3410e5c0 2024-09-21T03:49:17.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.334+0000 7f4b3ee82740 1 Processor -- start 2024-09-21T03:49:17.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.334+0000 7f4b3ee82740 1 -- start start 2024-09-21T03:49:17.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.334+0000 7f4b2b7fe640 1 -- 172.21.15.84:0/1986600430 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f4b2400f7c0 con 0x7f4b3410e5c0 2024-09-21T03:49:17.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.334+0000 7f4b3ee82740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8b621b350 0x55d8b65c2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:17.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.334+0000 7f4b3ee82740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65c2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:17.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.334+0000 7f4b3ee82740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 0x55d8b65c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:17.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.334+0000 7f4b3ee82740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d8b6538e60 con 0x55d8b61f2490 2024-09-21T03:49:17.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.334+0000 7f4b3ee82740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d8b6528290 con 0x55d8b61fa670 2024-09-21T03:49:17.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.334+0000 7f4b3ee82740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d8b652c0a0 con 0x55d8b621b350 2024-09-21T03:49:17.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.334+0000 7f4b3259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:17.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.334+0000 7f4b32d9d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8b621b350 0x55d8b65c2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:17.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.334+0000 7f4b3259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65c2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41826/0 (socket says 172.21.15.84:41826) 2024-09-21T03:49:17.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.335+0000 7f4b3259c640 1 -- 172.21.15.84:0/3255912036 learned_addr learned my addr 172.21.15.84:0/3255912036 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:17.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.335+0000 7f4b2bfff640 1 --2- 172.21.15.84:0/3255912036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 0x55d8b65c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:17.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.335+0000 7f4b3259c640 1 -- 172.21.15.84:0/3255912036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8b621b350 msgr2=0x55d8b65c2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:17.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.335+0000 7f4b3259c640 1 --2- 172.21.15.84:0/3255912036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8b621b350 0x55d8b65c2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.335+0000 7f4b3259c640 1 -- 172.21.15.84:0/3255912036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 msgr2=0x55d8b65c2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:17.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.335+0000 7f4b3259c640 1 --2- 172.21.15.84:0/3255912036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 0x55d8b65c2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.335+0000 7f4b3259c640 1 -- 172.21.15.84:0/3255912036 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b6286930 con 0x55d8b61f2490 2024-09-21T03:49:17.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.335+0000 7f4b2b7fe640 1 --2- 172.21.15.84:0/1986600430 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b200b6680 0x7f4b200b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:17.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.335+0000 7f4b32d9d640 1 --2- 172.21.15.84:0/1986600430 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b200b6680 0x7f4b200b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:17.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.335+0000 7f4b3259c640 1 --2- 172.21.15.84:0/3255912036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65c2970 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4b240e4b50 tx=0x7f4b240edab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb91789788e8830 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:17.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.335+0000 7f4b2b7fe640 1 -- 172.21.15.84:0/1986600430 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f4b240e7410 con 0x7f4b3410e5c0 2024-09-21T03:49:17.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.335+0000 7f4b28ff9640 1 -- 172.21.15.84:0/3255912036 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b24020020 con 0x55d8b61f2490 2024-09-21T03:49:17.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.335+0000 7f4b28ff9640 1 -- 172.21.15.84:0/3255912036 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b240acdc0 con 0x55d8b61f2490 2024-09-21T03:49:17.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.336+0000 7f4b28ff9640 1 -- 172.21.15.84:0/3255912036 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b240a9150 con 0x55d8b61f2490 2024-09-21T03:49:17.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.336+0000 7f4b3ee82740 1 -- 172.21.15.84:0/3255912036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 msgr2=0x55d8b65c2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:17.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.336+0000 7f4b32d9d640 1 --2- 172.21.15.84:0/1986600430 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b200b6680 0x7f4b200b8b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c005fd0 tx=0x7f4b2c009800 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:17.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.336+0000 7f4b3ee82740 1 --2- 172.21.15.84:0/3255912036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65c2970 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4b240e4b50 tx=0x7f4b240edab0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.336+0000 7f4b3ee82740 1 -- 172.21.15.84:0/3255912036 shutdown_connections 2024-09-21T03:49:17.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.336+0000 7f4b3ee82740 1 --2- 172.21.15.84:0/3255912036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 0x55d8b65c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.336+0000 7f4b3ee82740 1 --2- 172.21.15.84:0/3255912036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65c2970 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.336+0000 7f4b3ee82740 1 --2- 172.21.15.84:0/3255912036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8b621b350 0x55d8b65c2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.336+0000 7f4b3ee82740 1 -- 172.21.15.84:0/3255912036 >> 172.21.15.84:0/3255912036 conn(0x55d8b620f740 msgr2=0x55d8b65c0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:17.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.337+0000 7f4b3ee82740 1 -- 172.21.15.84:0/3255912036 shutdown_connections 2024-09-21T03:49:17.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.337+0000 7f4b3ee82740 1 -- 172.21.15.84:0/3255912036 wait complete. 2024-09-21T03:49:17.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.337+0000 7f4b3ee82740 1 -- start start 2024-09-21T03:49:17.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.337+0000 7f4b3ee82740 1 Processor -- start 2024-09-21T03:49:17.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.337+0000 7f4b3ee82740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65ce070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:17.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.337+0000 7f4b3ee82740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 0x55d8b65ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:17.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.337+0000 7f4b3ee82740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8b621b350 0x55d8b65d9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:17.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.337+0000 7f4b3ee82740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d8b6389890 con 0x55d8b61f2490 2024-09-21T03:49:17.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.337+0000 7f4b3ee82740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d8b64c2d40 con 0x55d8b61fa670 2024-09-21T03:49:17.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.337+0000 7f4b3ee82740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d8b65d0c10 con 0x55d8b621b350 2024-09-21T03:49:17.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.337+0000 7f4b3ee82740 10 client.0 _ll_register_callbacks cb 0x55d8b6526c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:49:17.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.337+0000 7f4b3259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:17.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.338+0000 7f4b3259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65ce070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41842/0 (socket says 172.21.15.84:41842) 2024-09-21T03:49:17.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.338+0000 7f4b3259c640 1 -- 172.21.15.84:0/1479204094 learned_addr learned my addr 172.21.15.84:0/1479204094 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:17.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.338+0000 7f4b2bfff640 1 --2- 172.21.15.84:0/1479204094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 0x55d8b65ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:17.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.338+0000 7f4b32d9d640 1 --2- 172.21.15.84:0/1479204094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8b621b350 0x55d8b65d9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:17.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.338+0000 7f4b3259c640 1 -- 172.21.15.84:0/1479204094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8b621b350 msgr2=0x55d8b65d9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:17.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.338+0000 7f4b3259c640 1 --2- 172.21.15.84:0/1479204094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8b621b350 0x55d8b65d9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.338+0000 7f4b3259c640 1 -- 172.21.15.84:0/1479204094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 msgr2=0x55d8b65ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:17.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.338+0000 7f4b3259c640 1 --2- 172.21.15.84:0/1479204094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 0x55d8b65ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.338+0000 7f4b3259c640 1 -- 172.21.15.84:0/1479204094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b65da550 con 0x55d8b61f2490 2024-09-21T03:49:17.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.338+0000 7f4b3259c640 1 --2- 172.21.15.84:0/1479204094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65ce070 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4b240e4c60 tx=0x7f4b240ed390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373699ece68d8171 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:17.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.338+0000 7f4b19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:49:17.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.338+0000 7f4b19ffb640 1 -- 172.21.15.84:0/1479204094 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b24020040 con 0x55d8b61f2490 2024-09-21T03:49:17.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.338+0000 7f4b19ffb640 1 -- 172.21.15.84:0/1479204094 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f4b240b6a40 con 0x55d8b61f2490 2024-09-21T03:49:17.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.338+0000 7f4b3ee82740 1 -- 172.21.15.84:0/1479204094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b240acdc0 con 0x55d8b61f2490 2024-09-21T03:49:17.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.338+0000 7f4b19ffb640 1 -- 172.21.15.84:0/1479204094 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4b240aca20 con 0x55d8b61f2490 2024-09-21T03:49:17.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.338+0000 7f4b3ee82740 10 client.16713 fetch_fsmap learned FSMap version 25 2024-09-21T03:49:17.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.338+0000 7f4b3ee82740 1 -- 172.21.15.84:0/1479204094 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d8b65dce80 con 0x55d8b61f2490 2024-09-21T03:49:17.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.339+0000 7f4b19ffb640 1 -- 172.21.15.84:0/1479204094 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b240acdc0 con 0x55d8b61f2490 2024-09-21T03:49:17.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.339+0000 7f4b19ffb640 1 -- 172.21.15.84:0/1479204094 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4b24058b00 con 0x55d8b61f2490 2024-09-21T03:49:17.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.339+0000 7f4b3ee82740 10 client.16713 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:49:17.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.339+0000 7f4b3ee82740 10 client.16713 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:49:17.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.339+0000 7f4b3ee82740 20 client.16713 populate_metadata read hostname 'smithi084' 2024-09-21T03:49:17.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.339+0000 7f4b3ee82740 1 --2- 172.21.15.84:0/1479204094 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d8b61d9cd0 0x55d8b65e01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:17.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.339+0000 7f4b3ee82740 4 client.16713 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:49:17.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.339+0000 7f4b3ee82740 1 -- 172.21.15.84:0/1479204094 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8b653adb0 con 0x55d8b61d9cd0 2024-09-21T03:49:17.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.339+0000 7f4b2bfff640 1 --2- 172.21.15.84:0/1479204094 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d8b61d9cd0 0x55d8b65e01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:17.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.340+0000 7f4b19ffb640 10 client.16713 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:17.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.340+0000 7f4b2bfff640 1 --2- 172.21.15.84:0/1479204094 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d8b61d9cd0 0x55d8b65e01e0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a7552054ee2f34b server_cookie=3cdefb14b2f114cf in_seq=0 out_seq=0 2024-09-21T03:49:17.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.340+0000 7f4b19ffb640 1 -- 172.21.15.84:0/1479204094 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d8b653adb0 con 0x55d8b61d9cd0 2024-09-21T03:49:17.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.340+0000 7f4b19ffb640 10 client.16713 handle_command_reply: tid=0 2024-09-21T03:49:17.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.340+0000 7f4b3ee82740 1 client.16713 shutdown 2024-09-21T03:49:17.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.341+0000 7f4b3ee82740 1 -- 172.21.15.84:0/1479204094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 msgr2=0x55d8b65ce070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:17.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.341+0000 7f4b3ee82740 1 --2- 172.21.15.84:0/1479204094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65ce070 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4b240e4c60 tx=0x7f4b240ed390 comp rx=0 tx=0).stop 2024-09-21T03:49:17.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.341+0000 7f4b3ee82740 1 -- 172.21.15.84:0/1479204094 shutdown_connections 2024-09-21T03:49:17.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.341+0000 7f4b3ee82740 1 --2- 172.21.15.84:0/1479204094 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d8b61d9cd0 0x55d8b65e01e0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.341+0000 7f4b3ee82740 1 --2- 172.21.15.84:0/1479204094 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8b621b350 0x55d8b65d9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.341+0000 7f4b3ee82740 1 --2- 172.21.15.84:0/1479204094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 0x55d8b65ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.341+0000 7f4b3ee82740 1 --2- 172.21.15.84:0/1479204094 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65ce070 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.341+0000 7f4b3ee82740 1 -- 172.21.15.84:0/1479204094 >> 172.21.15.84:0/1479204094 conn(0x55d8b620f740 msgr2=0x55d8b65c3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:17.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.341+0000 7f4b19ffb640 0 client.16713 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:17.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.341+0000 7f4b3ee82740 1 -- 172.21.15.84:0/1479204094 shutdown_connections 2024-09-21T03:49:17.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.341+0000 7f4b3ee82740 1 -- 172.21.15.84:0/1479204094 wait complete. 2024-09-21T03:49:17.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.341+0000 7f4b3ee82740 20 client.16713 trim_cache size 0 max 16384 2024-09-21T03:49:17.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.361+0000 7f4b3ee82740 1 Processor -- start 2024-09-21T03:49:17.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.361+0000 7f4b3ee82740 1 -- start start 2024-09-21T03:49:17.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.361+0000 7f4b3ee82740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65d9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:17.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.361+0000 7f4b3ee82740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 0x55d8b65c7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:17.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.361+0000 7f4b3ee82740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8b621b350 0x55d8b65c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:17.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.361+0000 7f4b3ee82740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4b341bc9b0 con 0x55d8b61f2490 2024-09-21T03:49:17.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.361+0000 7f4b3ee82740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b341ba280 con 0x55d8b61fa670 2024-09-21T03:49:17.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.361+0000 7f4b3ee82740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4b341b80f0 con 0x55d8b621b350 2024-09-21T03:49:17.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.361+0000 7f4b3259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65d9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:17.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.361+0000 7f4b3259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65d9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41850/0 (socket says 172.21.15.84:41850) 2024-09-21T03:49:17.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.361+0000 7f4b3259c640 1 -- 172.21.15.84:0/2147011238 learned_addr learned my addr 172.21.15.84:0/2147011238 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:17.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.361+0000 7f4b2bfff640 1 --2- 172.21.15.84:0/2147011238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 0x55d8b65c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:17.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.362+0000 7f4b3259c640 1 -- 172.21.15.84:0/2147011238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8b621b350 msgr2=0x55d8b65c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:17.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.362+0000 7f4b32d9d640 1 --2- 172.21.15.84:0/2147011238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8b621b350 0x55d8b65c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:17.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.362+0000 7f4b3259c640 1 --2- 172.21.15.84:0/2147011238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8b621b350 0x55d8b65c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.362+0000 7f4b3259c640 1 -- 172.21.15.84:0/2147011238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 msgr2=0x55d8b65c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:17.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.362+0000 7f4b3259c640 1 --2- 172.21.15.84:0/2147011238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 0x55d8b65c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.362+0000 7f4b3259c640 1 -- 172.21.15.84:0/2147011238 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b65ba520 con 0x55d8b61f2490 2024-09-21T03:49:17.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.362+0000 7f4b2bfff640 1 --2- 172.21.15.84:0/2147011238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 0x55d8b65c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:49:17.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.362+0000 7f4b3259c640 1 --2- 172.21.15.84:0/2147011238 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65d9ed0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f4b240aa520 tx=0x7f4b24005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9167d48629c6616d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:17.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.362+0000 7f4b1bfff640 1 -- 172.21.15.84:0/2147011238 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b24020070 con 0x55d8b61f2490 2024-09-21T03:49:17.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.362+0000 7f4b1bfff640 1 -- 172.21.15.84:0/2147011238 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b24058d00 con 0x55d8b61f2490 2024-09-21T03:49:17.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.362+0000 7f4b1bfff640 1 -- 172.21.15.84:0/2147011238 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b240acc00 con 0x55d8b61f2490 2024-09-21T03:49:17.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.363+0000 7f4b3ee82740 1 -- 172.21.15.84:0/2147011238 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 msgr2=0x55d8b65d9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:17.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.363+0000 7f4b3ee82740 1 --2- 172.21.15.84:0/2147011238 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65d9ed0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f4b240aa520 tx=0x7f4b24005bb0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.363+0000 7f4b3ee82740 1 -- 172.21.15.84:0/2147011238 shutdown_connections 2024-09-21T03:49:17.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.363+0000 7f4b3ee82740 1 --2- 172.21.15.84:0/2147011238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8b621b350 0x55d8b65c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.363+0000 7f4b3ee82740 1 --2- 172.21.15.84:0/2147011238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 0x55d8b65c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.363+0000 7f4b3ee82740 1 --2- 172.21.15.84:0/2147011238 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65d9ed0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.363+0000 7f4b3ee82740 1 -- 172.21.15.84:0/2147011238 >> 172.21.15.84:0/2147011238 conn(0x55d8b620f740 msgr2=0x55d8b65cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:17.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.363+0000 7f4b3ee82740 1 -- 172.21.15.84:0/2147011238 shutdown_connections 2024-09-21T03:49:17.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.363+0000 7f4b3ee82740 1 -- 172.21.15.84:0/2147011238 wait complete. 2024-09-21T03:49:17.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.363+0000 7f4b3ee82740 1 -- start start 2024-09-21T03:49:17.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.364+0000 7f4b3ee82740 1 Processor -- start 2024-09-21T03:49:17.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.364+0000 7f4b3ee82740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65e3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:17.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.364+0000 7f4b3ee82740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 0x55d8b65e1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:17.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.364+0000 7f4b3ee82740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8b621b350 0x55d8b65e2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:17.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.364+0000 7f4b3ee82740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4b341b8740 con 0x55d8b61f2490 2024-09-21T03:49:17.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.364+0000 7f4b3ee82740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b341b9bb0 con 0x55d8b61fa670 2024-09-21T03:49:17.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.364+0000 7f4b3ee82740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4b341b8e10 con 0x55d8b621b350 2024-09-21T03:49:17.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.364+0000 7f4b3259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65e3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:17.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.364+0000 7f4b3259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65e3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:41866/0 (socket says 172.21.15.84:41866) 2024-09-21T03:49:17.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.364+0000 7f4b3259c640 1 -- 172.21.15.84:0/3675880476 learned_addr learned my addr 172.21.15.84:0/3675880476 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:17.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.364+0000 7f4b3ee82740 10 client.0 _ll_register_callbacks cb 0x7f4b24094030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:49:17.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.364+0000 7f4b32d9d640 1 --2- 172.21.15.84:0/3675880476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8b621b350 0x55d8b65e2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:17.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.364+0000 7f4b2bfff640 1 --2- 172.21.15.84:0/3675880476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 0x55d8b65e1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:17.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.364+0000 7f4b3259c640 1 -- 172.21.15.84:0/3675880476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8b621b350 msgr2=0x55d8b65e2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:17.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.364+0000 7f4b3259c640 1 --2- 172.21.15.84:0/3675880476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8b621b350 0x55d8b65e2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.364+0000 7f4b3259c640 1 -- 172.21.15.84:0/3675880476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 msgr2=0x55d8b65e1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:17.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.364+0000 7f4b3259c640 1 --2- 172.21.15.84:0/3675880476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 0x55d8b65e1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.364+0000 7f4b3259c640 1 -- 172.21.15.84:0/3675880476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b65e2740 con 0x55d8b61f2490 2024-09-21T03:49:17.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.364+0000 7f4b2bfff640 1 --2- 172.21.15.84:0/3675880476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 0x55d8b65e1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:49:17.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.365+0000 7f4b3259c640 1 --2- 172.21.15.84:0/3675880476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65e3790 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f4b240b6170 tx=0x7f4b240ac740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3327cf682c24e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:17.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.365+0000 7f4b19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:49:17.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.365+0000 7f4b19ffb640 1 -- 172.21.15.84:0/3675880476 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b24020070 con 0x55d8b61f2490 2024-09-21T03:49:17.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.365+0000 7f4b19ffb640 1 -- 172.21.15.84:0/3675880476 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f4b24058b00 con 0x55d8b61f2490 2024-09-21T03:49:17.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.365+0000 7f4b3ee82740 1 -- 172.21.15.84:0/3675880476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b24058d00 con 0x55d8b61f2490 2024-09-21T03:49:17.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.365+0000 7f4b19ffb640 1 -- 172.21.15.84:0/3675880476 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4b240ad080 con 0x55d8b61f2490 2024-09-21T03:49:17.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.365+0000 7f4b3ee82740 10 client.16719 fetch_fsmap learned FSMap version 25 2024-09-21T03:49:17.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.365+0000 7f4b3ee82740 1 -- 172.21.15.84:0/3675880476 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d8b65e2740 con 0x55d8b61f2490 2024-09-21T03:49:17.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.365+0000 7f4b19ffb640 1 -- 172.21.15.84:0/3675880476 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b24058d00 con 0x55d8b61f2490 2024-09-21T03:49:17.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.365+0000 7f4b19ffb640 1 -- 172.21.15.84:0/3675880476 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4b240b2f20 con 0x55d8b61f2490 2024-09-21T03:49:17.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.365+0000 7f4b3ee82740 10 client.16719 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:49:17.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.365+0000 7f4b3ee82740 10 client.16719 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:49:17.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.365+0000 7f4b3ee82740 20 client.16719 populate_metadata read hostname 'smithi084' 2024-09-21T03:49:17.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.365+0000 7f4b3ee82740 1 --2- 172.21.15.84:0/3675880476 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d8b61af080 0x55d8b664da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:17.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.365+0000 7f4b3ee82740 4 client.16719 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:49:17.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.365+0000 7f4b3ee82740 1 -- 172.21.15.84:0/3675880476 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d8b6536860 con 0x55d8b61af080 2024-09-21T03:49:17.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.366+0000 7f4b2bfff640 1 --2- 172.21.15.84:0/3675880476 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d8b61af080 0x55d8b664da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:17.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.366+0000 7f4b19ffb640 10 client.16719 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:17.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.366+0000 7f4b2bfff640 1 --2- 172.21.15.84:0/3675880476 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d8b61af080 0x55d8b664da20 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12ed79aafde8017f server_cookie=946e32efcbeded2c in_seq=0 out_seq=0 2024-09-21T03:49:17.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.368+0000 7f4b19ffb640 1 -- 172.21.15.84:0/3675880476 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d8b6536860 con 0x55d8b61af080 2024-09-21T03:49:17.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.368+0000 7f4b19ffb640 10 client.16719 handle_command_reply: tid=0 2024-09-21T03:49:17.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.368+0000 7f4b3ee82740 1 client.16719 shutdown 2024-09-21T03:49:17.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.368+0000 7f4b3ee82740 1 -- 172.21.15.84:0/3675880476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 msgr2=0x55d8b65e3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:17.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.368+0000 7f4b3ee82740 1 --2- 172.21.15.84:0/3675880476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65e3790 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f4b240b6170 tx=0x7f4b240ac740 comp rx=0 tx=0).stop 2024-09-21T03:49:17.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.368+0000 7f4b3ee82740 1 -- 172.21.15.84:0/3675880476 shutdown_connections 2024-09-21T03:49:17.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.368+0000 7f4b3ee82740 1 --2- 172.21.15.84:0/3675880476 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d8b61af080 0x55d8b664da20 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.368+0000 7f4b3ee82740 1 --2- 172.21.15.84:0/3675880476 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d8b621b350 0x55d8b65e2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.368+0000 7f4b3ee82740 1 --2- 172.21.15.84:0/3675880476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d8b61fa670 0x55d8b65e1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.368+0000 7f4b19ffb640 0 client.16719 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:17.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.368+0000 7f4b3ee82740 1 --2- 172.21.15.84:0/3675880476 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d8b61f2490 0x55d8b65e3790 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.368+0000 7f4b3ee82740 1 -- 172.21.15.84:0/3675880476 >> 172.21.15.84:0/3675880476 conn(0x55d8b620f740 msgr2=0x55d8b65cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:17.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.368+0000 7f4b3ee82740 1 -- 172.21.15.84:0/3675880476 shutdown_connections 2024-09-21T03:49:17.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.368+0000 7f4b3ee82740 1 -- 172.21.15.84:0/3675880476 wait complete. 2024-09-21T03:49:17.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.368+0000 7f4b3ee82740 20 client.16719 trim_cache size 0 max 16384 2024-09-21T03:49:17.374 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:49:17.375 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T03:49:17.375 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "43a49cca-fc1c-4c36-a314-49033e7c3fb6", 2024-09-21T03:49:17.375 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T03:49:17.375 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:49:17.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.369+0000 7f4b3890e640 1 -- 172.21.15.84:0/1986600430 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b200b6680 msgr2=0x7f4b200b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:17.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.369+0000 7f4b3890e640 1 --2- 172.21.15.84:0/1986600430 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b200b6680 0x7f4b200b8b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c005fd0 tx=0x7f4b2c009800 comp rx=0 tx=0).stop 2024-09-21T03:49:17.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.369+0000 7f4b3890e640 1 -- 172.21.15.84:0/1986600430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b3410e5c0 msgr2=0x7f4b341a4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:17.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.369+0000 7f4b3890e640 1 --2- 172.21.15.84:0/1986600430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b3410e5c0 0x7f4b341a4ea0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f4b2400d950 tx=0x7f4b2400de10 comp rx=0 tx=0).stop 2024-09-21T03:49:17.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.369+0000 7f4b3890e640 1 -- 172.21.15.84:0/1986600430 shutdown_connections 2024-09-21T03:49:17.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.369+0000 7f4b3890e640 1 --2- 172.21.15.84:0/1986600430 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f4b200b6680 0x7f4b200b8b90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.369+0000 7f4b3890e640 1 --2- 172.21.15.84:0/1986600430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b34114800 0x7f4b341aa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.369+0000 7f4b3890e640 1 --2- 172.21.15.84:0/1986600430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4b34113eb0 0x7f4b341a5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.369+0000 7f4b3890e640 1 --2- 172.21.15.84:0/1986600430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4b3410e5c0 0x7f4b341a4ea0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:17.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.369+0000 7f4b3890e640 1 -- 172.21.15.84:0/1986600430 >> 172.21.15.84:0/1986600430 conn(0x7f4b3410a3c0 msgr2=0x7f4b341134c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:17.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.369+0000 7f4b3890e640 1 -- 172.21.15.84:0/1986600430 shutdown_connections 2024-09-21T03:49:17.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:17.369+0000 7f4b3890e640 1 -- 172.21.15.84:0/1986600430 wait complete. 2024-09-21T03:49:17.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:17 smithi084 ceph-mon[30941]: pgmap v530: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-21T03:49:17.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:17 smithi174 ceph-mon[34403]: pgmap v530: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-21T03:49:17.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:17 smithi172 ceph-mon[34821]: pgmap v530: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-21T03:49:18.445 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:49:18.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:18 smithi084 ceph-mon[30941]: scrub queued for path: / 2024-09-21T03:49:18.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:18 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:49:18.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:18 smithi084 ceph-mon[30941]: scrub summary: active paths [/] 2024-09-21T03:49:18.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:18 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:49:18.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:18 smithi174 ceph-mon[34403]: scrub queued for path: / 2024-09-21T03:49:18.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:18 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:49:18.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:18 smithi174 ceph-mon[34403]: scrub summary: active paths [/] 2024-09-21T03:49:18.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:18 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:49:18.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:18 smithi172 ceph-mon[34821]: scrub queued for path: / 2024-09-21T03:49:18.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:18 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:49:18.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:18 smithi172 ceph-mon[34821]: scrub summary: active paths [/] 2024-09-21T03:49:18.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:18 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:49:18.735 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:49:19.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.182+0000 7f334f392640 1 -- 172.21.15.84:0/747620669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3348104880 msgr2=0x7f3348104c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:19.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.182+0000 7f334f392640 1 --2- 172.21.15.84:0/747620669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3348104880 0x7f3348104c90 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3338009ca0 tx=0x7f333802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.182+0000 7f334f392640 1 -- 172.21.15.84:0/747620669 shutdown_connections 2024-09-21T03:49:19.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.182+0000 7f334f392640 1 --2- 172.21.15.84:0/747620669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f334810de30 0x7f3348110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.182+0000 7f334f392640 1 --2- 172.21.15.84:0/747620669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33481052b0 0x7f334810d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.182+0000 7f334f392640 1 --2- 172.21.15.84:0/747620669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3348104880 0x7f3348104c90 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.182+0000 7f334f392640 1 -- 172.21.15.84:0/747620669 >> 172.21.15.84:0/747620669 conn(0x7f3348079750 msgr2=0x7f3348079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:19.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.182+0000 7f334f392640 1 -- 172.21.15.84:0/747620669 shutdown_connections 2024-09-21T03:49:19.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.182+0000 7f334f392640 1 -- 172.21.15.84:0/747620669 wait complete. 2024-09-21T03:49:19.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.183+0000 7f334f392640 1 Processor -- start 2024-09-21T03:49:19.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.183+0000 7f334f392640 1 -- start start 2024-09-21T03:49:19.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.183+0000 7f334f392640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3348104880 0x7f3348102790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:19.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.183+0000 7f334f392640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33481052b0 0x7f3348102cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:19.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.183+0000 7f334f392640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f334810de30 0x7f3348103210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:19.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.183+0000 7f334f392640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3348113ad0 con 0x7f334810de30 2024-09-21T03:49:19.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.183+0000 7f334f392640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3348113950 con 0x7f33481052b0 2024-09-21T03:49:19.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.183+0000 7f334f392640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3348113c50 con 0x7f3348104880 2024-09-21T03:49:19.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.183+0000 7f334d92f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f334810de30 0x7f3348103210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:19.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.183+0000 7f334d92f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f334810de30 0x7f3348103210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52488/0 (socket says 172.21.15.84:52488) 2024-09-21T03:49:19.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.183+0000 7f334d92f640 1 -- 172.21.15.84:0/4178529365 learned_addr learned my addr 172.21.15.84:0/4178529365 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:19.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.183+0000 7f334d12e640 1 --2- 172.21.15.84:0/4178529365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3348104880 0x7f3348102790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:19.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.184+0000 7f334c92d640 1 --2- 172.21.15.84:0/4178529365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33481052b0 0x7f3348102cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:19.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.184+0000 7f334d92f640 1 -- 172.21.15.84:0/4178529365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3348104880 msgr2=0x7f3348102790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:19.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.184+0000 7f334d92f640 1 --2- 172.21.15.84:0/4178529365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3348104880 0x7f3348102790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.184+0000 7f334d92f640 1 -- 172.21.15.84:0/4178529365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33481052b0 msgr2=0x7f3348102cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:19.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.184+0000 7f334d92f640 1 --2- 172.21.15.84:0/4178529365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33481052b0 0x7f3348102cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.184+0000 7f334d92f640 1 -- 172.21.15.84:0/4178529365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33481a87e0 con 0x7f334810de30 2024-09-21T03:49:19.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.184+0000 7f334d92f640 1 --2- 172.21.15.84:0/4178529365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f334810de30 0x7f3348103210 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f334000c970 tx=0x7f334000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:19.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.184+0000 7f33467fc640 1 -- 172.21.15.84:0/4178529365 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3340007bb0 con 0x7f334810de30 2024-09-21T03:49:19.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.184+0000 7f33467fc640 1 -- 172.21.15.84:0/4178529365 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3340007d50 con 0x7f334810de30 2024-09-21T03:49:19.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.184+0000 7f334f392640 1 -- 172.21.15.84:0/4178529365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33481a8ad0 con 0x7f334810de30 2024-09-21T03:49:19.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.184+0000 7f33467fc640 1 -- 172.21.15.84:0/4178529365 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3340004e60 con 0x7f334810de30 2024-09-21T03:49:19.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.184+0000 7f334f392640 1 -- 172.21.15.84:0/4178529365 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33481a8fc0 con 0x7f334810de30 2024-09-21T03:49:19.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.187+0000 7f33467fc640 1 -- 172.21.15.84:0/4178529365 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f3340005020 con 0x7f334810de30 2024-09-21T03:49:19.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.187+0000 7f3355906740 1 Processor -- start 2024-09-21T03:49:19.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.187+0000 7f3355906740 1 -- start start 2024-09-21T03:49:19.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f3355906740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 0x55567cf89650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:19.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f3355906740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55567cbb91b0 0x55567cf89b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:19.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f3355906740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 0x55567cf8a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:19.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f3355906740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55567ceffe50 con 0x55567cbe2070 2024-09-21T03:49:19.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f3355906740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55567ceef280 con 0x55567cbb91b0 2024-09-21T03:49:19.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f3355906740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55567cef3090 con 0x55567cbc1390 2024-09-21T03:49:19.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f334c92d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 0x55567cf89650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:19.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f334c92d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 0x55567cf89650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52504/0 (socket says 172.21.15.84:52504) 2024-09-21T03:49:19.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f334c92d640 1 -- 172.21.15.84:0/1717231223 learned_addr learned my addr 172.21.15.84:0/1717231223 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:19.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f33467fc640 1 --2- 172.21.15.84:0/4178529365 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f33300b6680 0x7f33300b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:19.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f334c92d640 1 --2- 172.21.15.84:0/1717231223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 0x55567cf8a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:19.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f334d12e640 1 --2- 172.21.15.84:0/1717231223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55567cbb91b0 0x55567cf89b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:19.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f334c92d640 1 -- 172.21.15.84:0/1717231223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 msgr2=0x55567cf8a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:19.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f334c92d640 1 --2- 172.21.15.84:0/1717231223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 0x55567cf8a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f334c92d640 1 -- 172.21.15.84:0/1717231223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55567cbb91b0 msgr2=0x55567cf89b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:19.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f334c92d640 1 --2- 172.21.15.84:0/1717231223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55567cbb91b0 0x55567cf89b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f334c92d640 1 -- 172.21.15.84:0/1717231223 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55567cc4d650 con 0x55567cbe2070 2024-09-21T03:49:19.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f334d12e640 1 --2- 172.21.15.84:0/1717231223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55567cbb91b0 0x55567cf89b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:49:19.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f334d92f640 1 --2- 172.21.15.84:0/4178529365 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f33300b6680 0x7f33300b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:19.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f334c92d640 1 --2- 172.21.15.84:0/1717231223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 0x55567cf89650 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f333c00bb20 tx=0x7f333c0041d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f26a51007a3ec59 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:19.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.188+0000 7f33467fc640 1 -- 172.21.15.84:0/4178529365 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f33400e72e0 con 0x7f334810de30 2024-09-21T03:49:19.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.189+0000 7f332f7fe640 1 -- 172.21.15.84:0/1717231223 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c005020 con 0x55567cbe2070 2024-09-21T03:49:19.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.189+0000 7f332f7fe640 1 -- 172.21.15.84:0/1717231223 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f333c005670 con 0x55567cbe2070 2024-09-21T03:49:19.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.189+0000 7f332f7fe640 1 -- 172.21.15.84:0/1717231223 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c0106c0 con 0x55567cbe2070 2024-09-21T03:49:19.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.190+0000 7f3355906740 1 -- 172.21.15.84:0/1717231223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 msgr2=0x55567cf89650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:19.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.190+0000 7f334d92f640 1 --2- 172.21.15.84:0/4178529365 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f33300b6680 0x7f33300b8b90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f33400ad1c0 tx=0x7f33400ddc20 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:19.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.190+0000 7f3355906740 1 --2- 172.21.15.84:0/1717231223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 0x55567cf89650 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f333c00bb20 tx=0x7f333c0041d0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.190+0000 7f3355906740 1 -- 172.21.15.84:0/1717231223 shutdown_connections 2024-09-21T03:49:19.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.190+0000 7f3355906740 1 --2- 172.21.15.84:0/1717231223 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 0x55567cf8a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.190+0000 7f3355906740 1 --2- 172.21.15.84:0/1717231223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55567cbb91b0 0x55567cf89b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.190+0000 7f3355906740 1 --2- 172.21.15.84:0/1717231223 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 0x55567cf89650 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.190+0000 7f3355906740 1 -- 172.21.15.84:0/1717231223 >> 172.21.15.84:0/1717231223 conn(0x55567cbd6460 msgr2=0x55567cf87540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:19.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.190+0000 7f3355906740 1 -- 172.21.15.84:0/1717231223 shutdown_connections 2024-09-21T03:49:19.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.190+0000 7f3355906740 1 -- 172.21.15.84:0/1717231223 wait complete. 2024-09-21T03:49:19.196 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.190+0000 7f3355906740 1 -- start start 2024-09-21T03:49:19.197 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.190+0000 7f3355906740 1 Processor -- start 2024-09-21T03:49:19.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.191+0000 7f3355906740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbb91b0 0x55567cf94d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:19.199 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.191+0000 7f3355906740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 0x55567cf952d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:19.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.191+0000 7f3355906740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55567cbe2070 0x55567cfa10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:19.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.191+0000 7f3355906740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55567cd50700 con 0x55567cbb91b0 2024-09-21T03:49:19.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.191+0000 7f3355906740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55567ce8a110 con 0x55567cbe2070 2024-09-21T03:49:19.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.191+0000 7f3355906740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55567cf97dd0 con 0x55567cbc1390 2024-09-21T03:49:19.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.191+0000 7f3355906740 10 client.0 _ll_register_callbacks cb 0x55567cea3990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:49:19.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.191+0000 7f334c92d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbb91b0 0x55567cf94d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:19.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.191+0000 7f334c92d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbb91b0 0x55567cf94d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52508/0 (socket says 172.21.15.84:52508) 2024-09-21T03:49:19.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.191+0000 7f334c92d640 1 -- 172.21.15.84:0/9994446 learned_addr learned my addr 172.21.15.84:0/9994446 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:19.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.191+0000 7f334d12e640 1 --2- 172.21.15.84:0/9994446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 0x55567cf952d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:19.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.191+0000 7f334c92d640 1 -- 172.21.15.84:0/9994446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 msgr2=0x55567cf952d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:19.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.191+0000 7f334c92d640 1 --2- 172.21.15.84:0/9994446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 0x55567cf952d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.191+0000 7f334c92d640 1 -- 172.21.15.84:0/9994446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55567cbe2070 msgr2=0x55567cfa10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:19.200 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.191+0000 7f334c92d640 1 --2- 172.21.15.84:0/9994446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55567cbe2070 0x55567cfa10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.191+0000 7f334c92d640 1 -- 172.21.15.84:0/9994446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55567ceb7c40 con 0x55567cbb91b0 2024-09-21T03:49:19.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.191+0000 7f334c92d640 1 --2- 172.21.15.84:0/9994446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbb91b0 0x55567cf94d90 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f333c004fd0 tx=0x7f333c003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54feb28566fb48df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:19.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.191+0000 7f332cff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:49:19.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.191+0000 7f332cff9640 1 -- 172.21.15.84:0/9994446 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c005000 con 0x55567cbb91b0 2024-09-21T03:49:19.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.192+0000 7f332cff9640 1 -- 172.21.15.84:0/9994446 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f333c0051a0 con 0x55567cbb91b0 2024-09-21T03:49:19.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.192+0000 7f3355906740 1 -- 172.21.15.84:0/9994446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f333c005670 con 0x55567cbb91b0 2024-09-21T03:49:19.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.192+0000 7f332cff9640 1 -- 172.21.15.84:0/9994446 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f333c0053a0 con 0x55567cbb91b0 2024-09-21T03:49:19.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.192+0000 7f3355906740 10 client.16731 fetch_fsmap learned FSMap version 25 2024-09-21T03:49:19.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.192+0000 7f3355906740 1 -- 172.21.15.84:0/9994446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55567cfa3ab0 con 0x55567cbb91b0 2024-09-21T03:49:19.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.192+0000 7f332cff9640 1 -- 172.21.15.84:0/9994446 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f333c005670 con 0x55567cbb91b0 2024-09-21T03:49:19.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.192+0000 7f332cff9640 1 -- 172.21.15.84:0/9994446 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f333c027020 con 0x55567cbb91b0 2024-09-21T03:49:19.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.192+0000 7f3355906740 10 client.16731 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:49:19.201 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.192+0000 7f3355906740 10 client.16731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:49:19.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.192+0000 7f3355906740 20 client.16731 populate_metadata read hostname 'smithi084' 2024-09-21T03:49:19.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.192+0000 7f3355906740 1 --2- 172.21.15.84:0/9994446 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55567cba09f0 0x55567cfa6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:19.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.192+0000 7f3355906740 4 client.16731 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:49:19.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.192+0000 7f3355906740 1 -- 172.21.15.84:0/9994446 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55567cf01da0 con 0x55567cba09f0 2024-09-21T03:49:19.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.192+0000 7f334d12e640 1 --2- 172.21.15.84:0/9994446 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55567cba09f0 0x55567cfa6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:19.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.193+0000 7f334d12e640 1 --2- 172.21.15.84:0/9994446 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55567cba09f0 0x55567cfa6e10 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab2d72423c9d89da server_cookie=47dcee9953f69389 in_seq=0 out_seq=0 2024-09-21T03:49:19.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.193+0000 7f332cff9640 10 client.16731 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:19.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.194+0000 7f332cff9640 1 -- 172.21.15.84:0/9994446 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55567cf01da0 con 0x55567cba09f0 2024-09-21T03:49:19.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.194+0000 7f332cff9640 10 client.16731 handle_command_reply: tid=0 2024-09-21T03:49:19.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.194+0000 7f3355906740 1 client.16731 shutdown 2024-09-21T03:49:19.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.194+0000 7f3355906740 1 -- 172.21.15.84:0/9994446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbb91b0 msgr2=0x55567cf94d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:19.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.194+0000 7f3355906740 1 --2- 172.21.15.84:0/9994446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbb91b0 0x55567cf94d90 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f333c004fd0 tx=0x7f333c003f20 comp rx=0 tx=0).stop 2024-09-21T03:49:19.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.194+0000 7f3355906740 1 -- 172.21.15.84:0/9994446 shutdown_connections 2024-09-21T03:49:19.202 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.194+0000 7f3355906740 1 --2- 172.21.15.84:0/9994446 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55567cba09f0 0x55567cfa6e10 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.194+0000 7f3355906740 1 --2- 172.21.15.84:0/9994446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55567cbe2070 0x55567cfa10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.194+0000 7f3355906740 1 --2- 172.21.15.84:0/9994446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 0x55567cf952d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.194+0000 7f3355906740 1 --2- 172.21.15.84:0/9994446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbb91b0 0x55567cf94d90 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.194+0000 7f3355906740 1 -- 172.21.15.84:0/9994446 >> 172.21.15.84:0/9994446 conn(0x55567cbd6460 msgr2=0x55567cf8c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:19.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.194+0000 7f332cff9640 0 client.16731 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:19.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.194+0000 7f3355906740 1 -- 172.21.15.84:0/9994446 shutdown_connections 2024-09-21T03:49:19.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.195+0000 7f3355906740 1 -- 172.21.15.84:0/9994446 wait complete. 2024-09-21T03:49:19.203 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.195+0000 7f3355906740 20 client.16731 trim_cache size 0 max 16384 2024-09-21T03:49:19.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.212+0000 7f3355906740 1 Processor -- start 2024-09-21T03:49:19.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.212+0000 7f3355906740 1 -- start start 2024-09-21T03:49:19.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.212+0000 7f3355906740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55567cbb91b0 0x55567cf8c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:19.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.212+0000 7f3355906740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 0x55567cf8cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:19.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.212+0000 7f3355906740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 0x55567cf91f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:19.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.212+0000 7f3355906740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f33481b4160 con 0x55567cbe2070 2024-09-21T03:49:19.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.212+0000 7f3355906740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f33481b1a30 con 0x55567cbb91b0 2024-09-21T03:49:19.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.212+0000 7f3355906740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f33481af8a0 con 0x55567cbc1390 2024-09-21T03:49:19.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.212+0000 7f334c92d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 0x55567cf91f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:19.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.212+0000 7f334c92d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 0x55567cf91f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52510/0 (socket says 172.21.15.84:52510) 2024-09-21T03:49:19.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.212+0000 7f334c92d640 1 -- 172.21.15.84:0/2172214827 learned_addr learned my addr 172.21.15.84:0/2172214827 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:19.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.212+0000 7f334d12e640 1 --2- 172.21.15.84:0/2172214827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 0x55567cf8cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:19.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.212+0000 7f334c92d640 1 --2- 172.21.15.84:0/2172214827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55567cbb91b0 0x55567cf8c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:19.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.213+0000 7f334c92d640 1 -- 172.21.15.84:0/2172214827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 msgr2=0x55567cf8cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:19.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.213+0000 7f334c92d640 1 --2- 172.21.15.84:0/2172214827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 0x55567cf8cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.213+0000 7f334c92d640 1 -- 172.21.15.84:0/2172214827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55567cbb91b0 msgr2=0x55567cf8c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:19.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.213+0000 7f334c92d640 1 --2- 172.21.15.84:0/2172214827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55567cbb91b0 0x55567cf8c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.213+0000 7f334c92d640 1 -- 172.21.15.84:0/2172214827 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55567cf96050 con 0x55567cbe2070 2024-09-21T03:49:19.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.213+0000 7f334d12e640 1 --2- 172.21.15.84:0/2172214827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 0x55567cf8cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:49:19.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.213+0000 7f334c92d640 1 --2- 172.21.15.84:0/2172214827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 0x55567cf91f80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f333c01e850 tx=0x7f333c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f30dbd4c49f5548 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:19.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.213+0000 7f332effd640 1 -- 172.21.15.84:0/2172214827 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c003a80 con 0x55567cbe2070 2024-09-21T03:49:19.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.213+0000 7f332effd640 1 -- 172.21.15.84:0/2172214827 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f333c0049d0 con 0x55567cbe2070 2024-09-21T03:49:19.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.213+0000 7f332effd640 1 -- 172.21.15.84:0/2172214827 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c020480 con 0x55567cbe2070 2024-09-21T03:49:19.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.214+0000 7f3355906740 1 -- 172.21.15.84:0/2172214827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 msgr2=0x55567cf91f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:19.274 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.214+0000 7f3355906740 1 --2- 172.21.15.84:0/2172214827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 0x55567cf91f80 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f333c01e850 tx=0x7f333c001e70 comp rx=0 tx=0).stop 2024-09-21T03:49:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.214+0000 7f3355906740 1 -- 172.21.15.84:0/2172214827 shutdown_connections 2024-09-21T03:49:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.214+0000 7f3355906740 1 --2- 172.21.15.84:0/2172214827 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 0x55567cf91f80 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.214+0000 7f3355906740 1 --2- 172.21.15.84:0/2172214827 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 0x55567cf8cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.214+0000 7f3355906740 1 --2- 172.21.15.84:0/2172214827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55567cbb91b0 0x55567cf8c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.214+0000 7f3355906740 1 -- 172.21.15.84:0/2172214827 >> 172.21.15.84:0/2172214827 conn(0x55567cbd6460 msgr2=0x55567cf93610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.214+0000 7f3355906740 1 -- 172.21.15.84:0/2172214827 shutdown_connections 2024-09-21T03:49:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.214+0000 7f3355906740 1 -- 172.21.15.84:0/2172214827 wait complete. 2024-09-21T03:49:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.214+0000 7f3355906740 1 -- start start 2024-09-21T03:49:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.214+0000 7f3355906740 1 Processor -- start 2024-09-21T03:49:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.215+0000 7f3355906740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55567cbb91b0 0x55567cfaa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.215+0000 7f3355906740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 0x55567cfa7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:19.275 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.215+0000 7f3355906740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 0x55567cfa7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.215+0000 7f3355906740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f33481afef0 con 0x55567cbe2070 2024-09-21T03:49:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.215+0000 7f3355906740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f33481b1360 con 0x55567cbb91b0 2024-09-21T03:49:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.215+0000 7f3355906740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f33481b05c0 con 0x55567cbc1390 2024-09-21T03:49:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.215+0000 7f3355906740 10 client.0 _ll_register_callbacks cb 0x7f333c00ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:49:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.215+0000 7f334c92d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 0x55567cfa7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.215+0000 7f334c92d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 0x55567cfa7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:52512/0 (socket says 172.21.15.84:52512) 2024-09-21T03:49:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.215+0000 7f334c92d640 1 -- 172.21.15.84:0/3647568482 learned_addr learned my addr 172.21.15.84:0/3647568482 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.215+0000 7f334d12e640 1 --2- 172.21.15.84:0/3647568482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 0x55567cfa7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.215+0000 7f334c92d640 1 --2- 172.21.15.84:0/3647568482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55567cbb91b0 0x55567cfaa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.215+0000 7f334c92d640 1 -- 172.21.15.84:0/3647568482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 msgr2=0x55567cfa7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.215+0000 7f334c92d640 1 --2- 172.21.15.84:0/3647568482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 0x55567cfa7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.215+0000 7f334c92d640 1 -- 172.21.15.84:0/3647568482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55567cbb91b0 msgr2=0x55567cfaa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:19.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.215+0000 7f334c92d640 1 --2- 172.21.15.84:0/3647568482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55567cbb91b0 0x55567cfaa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.215+0000 7f334c92d640 1 -- 172.21.15.84:0/3647568482 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55567cfa84f0 con 0x55567cbe2070 2024-09-21T03:49:19.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.215+0000 7f334c92d640 1 --2- 172.21.15.84:0/3647568482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 0x55567cfa7eb0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f333c006010 tx=0x7f333c004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e47c31ed999a173 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:19.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.215+0000 7f332cff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:49:19.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.216+0000 7f332cff9640 1 -- 172.21.15.84:0/3647568482 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c038040 con 0x55567cbe2070 2024-09-21T03:49:19.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.216+0000 7f332cff9640 1 -- 172.21.15.84:0/3647568482 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f333c005540 con 0x55567cbe2070 2024-09-21T03:49:19.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.216+0000 7f3355906740 1 -- 172.21.15.84:0/3647568482 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f333c0049d0 con 0x55567cbe2070 2024-09-21T03:49:19.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.216+0000 7f332cff9640 1 -- 172.21.15.84:0/3647568482 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f333c003a80 con 0x55567cbe2070 2024-09-21T03:49:19.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.216+0000 7f3355906740 10 client.16737 fetch_fsmap learned FSMap version 25 2024-09-21T03:49:19.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.216+0000 7f3355906740 1 -- 172.21.15.84:0/3647568482 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55567d019b60 con 0x55567cbe2070 2024-09-21T03:49:19.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.216+0000 7f332cff9640 1 -- 172.21.15.84:0/3647568482 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f333c0049d0 con 0x55567cbe2070 2024-09-21T03:49:19.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.216+0000 7f332cff9640 1 -- 172.21.15.84:0/3647568482 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f333c03e020 con 0x55567cbe2070 2024-09-21T03:49:19.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.216+0000 7f3355906740 10 client.16737 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:49:19.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.216+0000 7f3355906740 10 client.16737 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:49:19.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.216+0000 7f3355906740 20 client.16737 populate_metadata read hostname 'smithi084' 2024-09-21T03:49:19.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.216+0000 7f3355906740 1 --2- 172.21.15.84:0/3647568482 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55567cb75da0 0x55567d01c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:19.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.216+0000 7f3355906740 4 client.16737 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:49:19.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.216+0000 7f3355906740 1 -- 172.21.15.84:0/3647568482 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55567cefd850 con 0x55567cb75da0 2024-09-21T03:49:19.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.217+0000 7f334d12e640 1 --2- 172.21.15.84:0/3647568482 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55567cb75da0 0x55567d01c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:19.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.217+0000 7f332cff9640 10 client.16737 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:19.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.217+0000 7f334d12e640 1 --2- 172.21.15.84:0/3647568482 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55567cb75da0 0x55567d01c1d0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=587f072d9565bd06 server_cookie=81b0373b293578a0 in_seq=0 out_seq=0 2024-09-21T03:49:19.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.217+0000 7f332cff9640 1 -- 172.21.15.84:0/3647568482 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3694 (crc 0 0 0) 0x55567cefd850 con 0x55567cb75da0 2024-09-21T03:49:19.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.217+0000 7f332cff9640 10 client.16737 handle_command_reply: tid=0 2024-09-21T03:49:19.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.217+0000 7f3355906740 1 client.16737 shutdown 2024-09-21T03:49:19.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.217+0000 7f3355906740 1 -- 172.21.15.84:0/3647568482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 msgr2=0x55567cfa7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:19.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.217+0000 7f3355906740 1 --2- 172.21.15.84:0/3647568482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 0x55567cfa7eb0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f333c006010 tx=0x7f333c004f40 comp rx=0 tx=0).stop 2024-09-21T03:49:19.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.218+0000 7f3355906740 1 -- 172.21.15.84:0/3647568482 shutdown_connections 2024-09-21T03:49:19.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.218+0000 7f3355906740 1 --2- 172.21.15.84:0/3647568482 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55567cb75da0 0x55567d01c1d0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.218+0000 7f3355906740 1 --2- 172.21.15.84:0/3647568482 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55567cbe2070 0x55567cfa7eb0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.218+0000 7f3355906740 1 --2- 172.21.15.84:0/3647568482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55567cbc1390 0x55567cfa7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.218+0000 7f3355906740 1 --2- 172.21.15.84:0/3647568482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55567cbb91b0 0x55567cfaa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.218+0000 7f3355906740 1 -- 172.21.15.84:0/3647568482 >> 172.21.15.84:0/3647568482 conn(0x55567cbd6460 msgr2=0x55567cf931d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:19.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.218+0000 7f332cff9640 0 client.16737 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:19.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.218+0000 7f3355906740 1 -- 172.21.15.84:0/3647568482 shutdown_connections 2024-09-21T03:49:19.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.218+0000 7f3355906740 1 -- 172.21.15.84:0/3647568482 wait complete. 2024-09-21T03:49:19.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.218+0000 7f3355906740 20 client.16737 trim_cache size 0 max 16384 2024-09-21T03:49:19.280 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:49:19.281 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:49:19.281 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T03:49:19.281 INFO:teuthology.orchestra.run.smithi084.stdout: "43a49cca-fc1c-4c36-a314-49033e7c3fb6": { 2024-09-21T03:49:19.281 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:19.281 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "43a49cca-fc1c-4c36-a314-49033e7c3fb6", 2024-09-21T03:49:19.281 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T03:49:19.281 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:49:19.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:19.281 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:49:19.281 INFO:teuthology.orchestra.run.smithi084.stdout: "b2063a70-0b1f-4b6b-9c96-d886e156ea66": { 2024-09-21T03:49:19.281 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:48:34.864478+0000", 2024-09-21T03:49:19.281 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:19.281 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:19.282 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:19.282 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:19.282 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:19.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:19.282 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:49:19.282 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:49:19.282 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:19.282 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:19.282 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:19.282 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:19.282 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:19.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:19.282 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:49:19.283 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:49:19.283 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:19.283 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:19.283 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:19.283 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:19.283 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:19.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:19.283 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:49:19.283 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:49:19.283 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:19.283 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:19.283 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:19.283 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:19.283 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:19.284 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:19.284 INFO:teuthology.orchestra.run.smithi084.stdout: "27dcb84c-89fa-46b2-b980-58857966c697": { 2024-09-21T03:49:19.284 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:52.598527+0000", 2024-09-21T03:49:19.284 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:19.284 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:19.284 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:19.284 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:19.284 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:19.284 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:19.284 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:49:19.284 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:49:19.284 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:19.284 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:19.284 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:19.285 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:19.285 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:19.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:19.285 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:49:19.285 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:49:19.285 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:19.285 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:19.285 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:19.285 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:19.285 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:19.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:19.285 INFO:teuthology.orchestra.run.smithi084.stdout: "43a49cca-fc1c-4c36-a314-49033e7c3fb6": { 2024-09-21T03:49:19.285 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:49:17.366428+0000", 2024-09-21T03:49:19.285 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:19.286 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:19.286 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:19.286 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:19.286 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:19.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:19.286 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:49:19.286 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:49:19.286 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:19.286 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:19.286 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:19.286 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:19.286 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:19.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:19.286 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:49:19.287 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:49:19.287 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:19.287 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:19.287 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:19.287 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:19.287 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:19.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:19.287 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:49:19.287 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:49:19.287 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:19.287 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:19.287 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:19.287 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:19.288 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:19.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:19.288 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:49:19.288 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:49:19.288 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:19.288 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:19.288 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:19.288 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:19.288 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:19.288 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:49:19.288 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:49:19.288 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:49:19.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.218+0000 7f334f392640 1 -- 172.21.15.84:0/4178529365 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f33300b6680 msgr2=0x7f33300b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:19.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.218+0000 7f334f392640 1 --2- 172.21.15.84:0/4178529365 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f33300b6680 0x7f33300b8b90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f33400ad1c0 tx=0x7f33400ddc20 comp rx=0 tx=0).stop 2024-09-21T03:49:19.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.218+0000 7f334f392640 1 -- 172.21.15.84:0/4178529365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f334810de30 msgr2=0x7f3348103210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:19.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.218+0000 7f334f392640 1 --2- 172.21.15.84:0/4178529365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f334810de30 0x7f3348103210 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f334000c970 tx=0x7f334000ce30 comp rx=0 tx=0).stop 2024-09-21T03:49:19.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.218+0000 7f334f392640 1 -- 172.21.15.84:0/4178529365 shutdown_connections 2024-09-21T03:49:19.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.218+0000 7f334f392640 1 --2- 172.21.15.84:0/4178529365 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f33300b6680 0x7f33300b8b90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.218+0000 7f334f392640 1 --2- 172.21.15.84:0/4178529365 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f334810de30 0x7f3348103210 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.218+0000 7f334f392640 1 --2- 172.21.15.84:0/4178529365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33481052b0 0x7f3348102cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.218+0000 7f334f392640 1 --2- 172.21.15.84:0/4178529365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3348104880 0x7f3348102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:19.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.218+0000 7f334f392640 1 -- 172.21.15.84:0/4178529365 >> 172.21.15.84:0/4178529365 conn(0x7f3348079750 msgr2=0x7f33481079d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:19.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.219+0000 7f334f392640 1 -- 172.21.15.84:0/4178529365 shutdown_connections 2024-09-21T03:49:19.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:19.219+0000 7f334f392640 1 -- 172.21.15.84:0/4178529365 wait complete. 2024-09-21T03:49:19.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:19 smithi084 ceph-mon[30941]: pgmap v531: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-09-21T03:49:19.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:19 smithi174 ceph-mon[34403]: pgmap v531: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-09-21T03:49:19.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:19 smithi172 ceph-mon[34821]: pgmap v531: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-09-21T03:49:20.195 INFO:tasks.cephfs.filesystem:scrub status for tag:43a49cca-fc1c-4c36-a314-49033e7c3fb6 - {'path': '/', 'tag': '43a49cca-fc1c-4c36-a314-49033e7c3fb6', 'options': 'recursive,force'} 2024-09-21T03:49:20.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:20 smithi084 ceph-mon[30941]: scrub summary: idle 2024-09-21T03:49:20.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:20 smithi174 ceph-mon[34403]: scrub summary: idle 2024-09-21T03:49:20.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:20 smithi172 ceph-mon[34821]: scrub summary: idle 2024-09-21T03:49:21.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:21 smithi084 ceph-mon[30941]: pgmap v532: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-09-21T03:49:21.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:21 smithi174 ceph-mon[34403]: pgmap v532: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-09-21T03:49:21.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:21 smithi172 ceph-mon[34821]: pgmap v532: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-09-21T03:49:22.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:22 smithi084 ceph-mon[30941]: pgmap v533: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-09-21T03:49:22.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:22 smithi174 ceph-mon[34403]: pgmap v533: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-09-21T03:49:22.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:22 smithi172 ceph-mon[34821]: pgmap v533: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-09-21T03:49:24.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:24 smithi084 ceph-mon[30941]: pgmap v534: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-21T03:49:24.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:24 smithi174 ceph-mon[34403]: pgmap v534: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-21T03:49:24.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:24 smithi172 ceph-mon[34821]: pgmap v534: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-21T03:49:26.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:26 smithi084 ceph-mon[30941]: pgmap v535: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 10 op/s 2024-09-21T03:49:26.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:26 smithi174 ceph-mon[34403]: pgmap v535: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 10 op/s 2024-09-21T03:49:26.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:26 smithi172 ceph-mon[34821]: pgmap v535: 97 pgs: 97 active+clean; 11 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 KiB/s wr, 10 op/s 2024-09-21T03:49:28.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:28 smithi084 ceph-mon[30941]: pgmap v536: 97 pgs: 97 active+clean; 12 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 14 op/s 2024-09-21T03:49:28.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:28 smithi174 ceph-mon[34403]: pgmap v536: 97 pgs: 97 active+clean; 12 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 14 op/s 2024-09-21T03:49:28.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:28 smithi172 ceph-mon[34821]: pgmap v536: 97 pgs: 97 active+clean; 12 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 14 op/s 2024-09-21T03:49:30.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:30 smithi084 ceph-mon[30941]: pgmap v537: 97 pgs: 97 active+clean; 12 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-09-21T03:49:30.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:30 smithi174 ceph-mon[34403]: pgmap v537: 97 pgs: 97 active+clean; 12 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-09-21T03:49:30.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:30 smithi172 ceph-mon[34821]: pgmap v537: 97 pgs: 97 active+clean; 12 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-09-21T03:49:32.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:32 smithi084 ceph-mon[30941]: pgmap v538: 97 pgs: 97 active+clean; 12 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-09-21T03:49:32.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:32 smithi174 ceph-mon[34403]: pgmap v538: 97 pgs: 97 active+clean; 12 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-09-21T03:49:32.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:32 smithi172 ceph-mon[34821]: pgmap v538: 97 pgs: 97 active+clean; 12 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-09-21T03:49:34.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:34 smithi084 ceph-mon[30941]: pgmap v539: 97 pgs: 97 active+clean; 12 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 12 op/s 2024-09-21T03:49:34.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:34 smithi174 ceph-mon[34403]: pgmap v539: 97 pgs: 97 active+clean; 12 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 12 op/s 2024-09-21T03:49:34.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:34 smithi172 ceph-mon[34821]: pgmap v539: 97 pgs: 97 active+clean; 12 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 12 op/s 2024-09-21T03:49:36.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:36 smithi084 ceph-mon[30941]: pgmap v540: 97 pgs: 97 active+clean; 12 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-09-21T03:49:36.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:36 smithi174 ceph-mon[34403]: pgmap v540: 97 pgs: 97 active+clean; 12 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-09-21T03:49:36.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:36 smithi172 ceph-mon[34821]: pgmap v540: 97 pgs: 97 active+clean; 12 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-09-21T03:49:38.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:38 smithi084 ceph-mon[30941]: pgmap v541: 97 pgs: 97 active+clean; 12 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 57 KiB/s wr, 14 op/s 2024-09-21T03:49:38.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:38 smithi174 ceph-mon[34403]: pgmap v541: 97 pgs: 97 active+clean; 12 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 57 KiB/s wr, 14 op/s 2024-09-21T03:49:38.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:38 smithi172 ceph-mon[34821]: pgmap v541: 97 pgs: 97 active+clean; 12 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 57 KiB/s wr, 14 op/s 2024-09-21T03:49:40.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:40 smithi084 ceph-mon[30941]: pgmap v542: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 9 op/s 2024-09-21T03:49:40.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:40 smithi174 ceph-mon[34403]: pgmap v542: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 9 op/s 2024-09-21T03:49:40.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:40 smithi172 ceph-mon[34821]: pgmap v542: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 9 op/s 2024-09-21T03:49:42.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:42 smithi084 ceph-mon[30941]: pgmap v543: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 11 op/s 2024-09-21T03:49:42.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:42 smithi174 ceph-mon[34403]: pgmap v543: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 11 op/s 2024-09-21T03:49:42.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:42 smithi172 ceph-mon[34821]: pgmap v543: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 11 op/s 2024-09-21T03:49:43.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:43 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:49:43.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:43 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:49:43.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:43 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:49:44.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: Adjusting osd_memory_target on smithi084 to 176.0M 2024-09-21T03:49:44.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: Adjusting osd_memory_target on smithi172 to 176.0M 2024-09-21T03:49:44.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: Adjusting osd_memory_target on smithi174 to 176.0M 2024-09-21T03:49:44.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: Unable to set osd_memory_target on smithi084 to 184576716: error parsing value: Value '184576716' is below minimum 939524096 2024-09-21T03:49:44.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: Unable to set osd_memory_target on smithi174 to 184573849: error parsing value: Value '184573849' is below minimum 939524096 2024-09-21T03:49:44.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: Unable to set osd_memory_target on smithi172 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-21T03:49:44.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:44.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:49:44.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:49:44.820 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:44 smithi084 ceph-mon[30941]: pgmap v544: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 57 KiB/s wr, 12 op/s 2024-09-21T03:49:44.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: Adjusting osd_memory_target on smithi084 to 176.0M 2024-09-21T03:49:44.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: Adjusting osd_memory_target on smithi172 to 176.0M 2024-09-21T03:49:44.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: Adjusting osd_memory_target on smithi174 to 176.0M 2024-09-21T03:49:44.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: Unable to set osd_memory_target on smithi084 to 184576716: error parsing value: Value '184576716' is below minimum 939524096 2024-09-21T03:49:44.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: Unable to set osd_memory_target on smithi174 to 184573849: error parsing value: Value '184573849' is below minimum 939524096 2024-09-21T03:49:44.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: Unable to set osd_memory_target on smithi172 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-21T03:49:44.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:44.880 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:49:44.880 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:49:44.880 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:44 smithi174 ceph-mon[34403]: pgmap v544: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 57 KiB/s wr, 12 op/s 2024-09-21T03:49:44.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T03:49:44.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: Adjusting osd_memory_target on smithi084 to 176.0M 2024-09-21T03:49:44.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: Adjusting osd_memory_target on smithi172 to 176.0M 2024-09-21T03:49:44.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: Adjusting osd_memory_target on smithi174 to 176.0M 2024-09-21T03:49:44.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: Unable to set osd_memory_target on smithi084 to 184576716: error parsing value: Value '184576716' is below minimum 939524096 2024-09-21T03:49:44.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: Unable to set osd_memory_target on smithi174 to 184573849: error parsing value: Value '184573849' is below minimum 939524096 2024-09-21T03:49:44.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: Unable to set osd_memory_target on smithi172 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-21T03:49:44.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:49:44.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:49:44.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:49:44.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:44 smithi172 ceph-mon[34821]: pgmap v544: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 57 KiB/s wr, 12 op/s 2024-09-21T03:49:46.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:46 smithi084 ceph-mon[30941]: pgmap v545: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-09-21T03:49:46.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:46 smithi174 ceph-mon[34403]: pgmap v545: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-09-21T03:49:46.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:46 smithi172 ceph-mon[34821]: pgmap v545: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-09-21T03:49:48.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:48 smithi084 ceph-mon[30941]: pgmap v546: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-09-21T03:49:48.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:48 smithi174 ceph-mon[34403]: pgmap v546: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-09-21T03:49:48.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:48 smithi172 ceph-mon[34821]: pgmap v546: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-09-21T03:49:50.197 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:49:50.460 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:49:50.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:50 smithi084 ceph-mon[30941]: pgmap v547: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-21T03:49:50.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:50 smithi174 ceph-mon[34403]: pgmap v547: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-21T03:49:50.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:50 smithi172 ceph-mon[34821]: pgmap v547: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 9 op/s 2024-09-21T03:49:51.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:50.998+0000 7f729f540640 1 -- 172.21.15.84:0/150680743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7298109e10 msgr2=0x7f7298110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:51.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:50.998+0000 7f729f540640 1 --2- 172.21.15.84:0/150680743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7298109e10 0x7f7298110640 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f7290009ca0 tx=0x7f729002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:50.998+0000 7f729f540640 1 -- 172.21.15.84:0/150680743 shutdown_connections 2024-09-21T03:49:51.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:50.998+0000 7f729f540640 1 --2- 172.21.15.84:0/150680743 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7298109e10 0x7f7298110640 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:50.998+0000 7f729f540640 1 --2- 172.21.15.84:0/150680743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72981094c0 0x7f72981098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:50.998+0000 7f729f540640 1 --2- 172.21.15.84:0/150680743 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7298103b80 0x7f7298103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:50.999+0000 7f729f540640 1 -- 172.21.15.84:0/150680743 >> 172.21.15.84:0/150680743 conn(0x7f72980ff5d0 msgr2=0x7f7298101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:51.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:50.999+0000 7f729f540640 1 -- 172.21.15.84:0/150680743 shutdown_connections 2024-09-21T03:49:51.003 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:50.999+0000 7f729f540640 1 -- 172.21.15.84:0/150680743 wait complete. 2024-09-21T03:49:51.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:50.999+0000 7f729f540640 1 Processor -- start 2024-09-21T03:49:51.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:50.999+0000 7f729f540640 1 -- start start 2024-09-21T03:49:51.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f729f540640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7298103b80 0x7f729819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:51.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f729f540640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72981094c0 0x7f729819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:51.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f729f540640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7298109e10 0x7f729819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:51.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f729f540640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7298113b30 con 0x7f72981094c0 2024-09-21T03:49:51.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f729f540640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f72981139b0 con 0x7f7298103b80 2024-09-21T03:49:51.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f729f540640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7298113cb0 con 0x7f7298109e10 2024-09-21T03:49:51.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f729cadb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72981094c0 0x7f729819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:51.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f729cadb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72981094c0 0x7f729819aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57412/0 (socket says 172.21.15.84:57412) 2024-09-21T03:49:51.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f729cadb640 1 -- 172.21.15.84:0/3355774135 learned_addr learned my addr 172.21.15.84:0/3355774135 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:51.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f729d2dc640 1 --2- 172.21.15.84:0/3355774135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7298103b80 0x7f729819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:51.004 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f729dadd640 1 --2- 172.21.15.84:0/3355774135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7298109e10 0x7f729819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:51.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f729cadb640 1 -- 172.21.15.84:0/3355774135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7298109e10 msgr2=0x7f729819fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:51.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f729cadb640 1 --2- 172.21.15.84:0/3355774135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7298109e10 0x7f729819fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f729cadb640 1 -- 172.21.15.84:0/3355774135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7298103b80 msgr2=0x7f729819a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:51.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f729cadb640 1 --2- 172.21.15.84:0/3355774135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7298103b80 0x7f729819a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f729cadb640 1 -- 172.21.15.84:0/3355774135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72981a0410 con 0x7f72981094c0 2024-09-21T03:49:51.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f729dadd640 1 --2- 172.21.15.84:0/3355774135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7298109e10 0x7f729819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:49:51.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f729d2dc640 1 --2- 172.21.15.84:0/3355774135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7298103b80 0x7f729819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:49:51.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f729cadb640 1 --2- 172.21.15.84:0/3355774135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72981094c0 0x7f729819aa40 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f729400d740 tx=0x7f729400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:51.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f728e7fc640 1 -- 172.21.15.84:0/3355774135 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7294017070 con 0x7f72981094c0 2024-09-21T03:49:51.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f728e7fc640 1 -- 172.21.15.84:0/3355774135 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f729400de50 con 0x7f72981094c0 2024-09-21T03:49:51.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f729f540640 1 -- 172.21.15.84:0/3355774135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72981a0700 con 0x7f72981094c0 2024-09-21T03:49:51.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.000+0000 7f728e7fc640 1 -- 172.21.15.84:0/3355774135 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729400f620 con 0x7f72981094c0 2024-09-21T03:49:51.005 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.001+0000 7f729f540640 1 -- 172.21.15.84:0/3355774135 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72981a6e60 con 0x7f72981094c0 2024-09-21T03:49:51.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.003+0000 7f728e7fc640 1 -- 172.21.15.84:0/3355774135 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f729401a070 con 0x7f72981094c0 2024-09-21T03:49:51.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.003+0000 7f72a5ab4740 1 Processor -- start 2024-09-21T03:49:51.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.003+0000 7f72a5ab4740 1 -- start start 2024-09-21T03:49:51.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.004+0000 7f72a5ab4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34da070 0x5639d3881650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:51.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.004+0000 7f72a5ab4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34b11b0 0x5639d3881b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:51.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.004+0000 7f72a5ab4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b9390 0x5639d38820d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:51.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.004+0000 7f72a5ab4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5639d37f7e50 con 0x5639d34da070 2024-09-21T03:49:51.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.004+0000 7f72a5ab4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5639d37e7280 con 0x5639d34b11b0 2024-09-21T03:49:51.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.004+0000 7f72a5ab4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5639d37eb090 con 0x5639d34b9390 2024-09-21T03:49:51.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.004+0000 7f729dadd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34da070 0x5639d3881650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:51.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.004+0000 7f729dadd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34da070 0x5639d3881650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57416/0 (socket says 172.21.15.84:57416) 2024-09-21T03:49:51.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.004+0000 7f729dadd640 1 -- 172.21.15.84:0/2067067227 learned_addr learned my addr 172.21.15.84:0/2067067227 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:51.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.004+0000 7f728e7fc640 1 --2- 172.21.15.84:0/3355774135 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f72840b6680 0x7f72840b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:51.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.004+0000 7f729d2dc640 1 --2- 172.21.15.84:0/2067067227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34b11b0 0x5639d3881b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:51.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.004+0000 7f729dadd640 1 --2- 172.21.15.84:0/3355774135 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f72840b6680 0x7f72840b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.004+0000 7f729cadb640 1 --2- 172.21.15.84:0/2067067227 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b9390 0x5639d38820d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.004+0000 7f728e7fc640 1 -- 172.21.15.84:0/3355774135 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f72940e71b0 con 0x7f72981094c0 2024-09-21T03:49:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.004+0000 7f729d2dc640 1 -- 172.21.15.84:0/2067067227 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b9390 msgr2=0x5639d38820d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.004+0000 7f729d2dc640 1 --2- 172.21.15.84:0/2067067227 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b9390 0x5639d38820d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.004+0000 7f729d2dc640 1 -- 172.21.15.84:0/2067067227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34da070 msgr2=0x5639d3881650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.004+0000 7f729d2dc640 1 --2- 172.21.15.84:0/2067067227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34da070 0x5639d3881650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.004+0000 7f729d2dc640 1 -- 172.21.15.84:0/2067067227 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639d3545650 con 0x5639d34b11b0 2024-09-21T03:49:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.004+0000 7f729cadb640 1 --2- 172.21.15.84:0/2067067227 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b9390 0x5639d38820d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:49:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.005+0000 7f729d2dc640 1 --2- 172.21.15.84:0/2067067227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34b11b0 0x5639d3881b90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7288007760 tx=0x7f7288007c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f292413cf5acdd96 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.005+0000 7f729dadd640 1 --2- 172.21.15.84:0/3355774135 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f72840b6680 0x7f72840b8b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7290009a60 tx=0x7f729002a8c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.005+0000 7f72837fe640 1 -- 172.21.15.84:0/2067067227 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728800d950 con 0x5639d34b11b0 2024-09-21T03:49:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.005+0000 7f72837fe640 1 -- 172.21.15.84:0/2067067227 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7288018070 con 0x5639d34b11b0 2024-09-21T03:49:51.009 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.005+0000 7f72837fe640 1 -- 172.21.15.84:0/2067067227 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7288013db0 con 0x5639d34b11b0 2024-09-21T03:49:51.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.006+0000 7f72a5ab4740 1 -- 172.21.15.84:0/2067067227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34b11b0 msgr2=0x5639d3881b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:51.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.006+0000 7f72a5ab4740 1 --2- 172.21.15.84:0/2067067227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34b11b0 0x5639d3881b90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7288007760 tx=0x7f7288007c20 comp rx=0 tx=0).stop 2024-09-21T03:49:51.013 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.006+0000 7f72a5ab4740 1 -- 172.21.15.84:0/2067067227 shutdown_connections 2024-09-21T03:49:51.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.006+0000 7f72a5ab4740 1 --2- 172.21.15.84:0/2067067227 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b9390 0x5639d38820d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.006+0000 7f72a5ab4740 1 --2- 172.21.15.84:0/2067067227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34b11b0 0x5639d3881b90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.006+0000 7f72a5ab4740 1 --2- 172.21.15.84:0/2067067227 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34da070 0x5639d3881650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.006+0000 7f72a5ab4740 1 -- 172.21.15.84:0/2067067227 >> 172.21.15.84:0/2067067227 conn(0x5639d34ce460 msgr2=0x5639d387f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:51.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.006+0000 7f72a5ab4740 1 -- 172.21.15.84:0/2067067227 shutdown_connections 2024-09-21T03:49:51.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.006+0000 7f72a5ab4740 1 -- 172.21.15.84:0/2067067227 wait complete. 2024-09-21T03:49:51.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.006+0000 7f72a5ab4740 1 -- start start 2024-09-21T03:49:51.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.006+0000 7f72a5ab4740 1 Processor -- start 2024-09-21T03:49:51.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.007+0000 7f72a5ab4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b11b0 0x5639d388cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:51.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.007+0000 7f72a5ab4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b9390 0x5639d388d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:51.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.007+0000 7f72a5ab4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34da070 0x5639d388d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:51.014 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.007+0000 7f72a5ab4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5639d3648700 con 0x5639d34b9390 2024-09-21T03:49:51.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.007+0000 7f72a5ab4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5639d3782110 con 0x5639d34da070 2024-09-21T03:49:51.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.007+0000 7f72a5ab4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5639d388fe30 con 0x5639d34b11b0 2024-09-21T03:49:51.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.007+0000 7f72a5ab4740 10 client.0 _ll_register_callbacks cb 0x5639d379b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:49:51.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.007+0000 7f729cadb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b9390 0x5639d388d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:51.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.007+0000 7f729cadb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b9390 0x5639d388d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57420/0 (socket says 172.21.15.84:57420) 2024-09-21T03:49:51.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.007+0000 7f729cadb640 1 -- 172.21.15.84:0/1695036602 learned_addr learned my addr 172.21.15.84:0/1695036602 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:51.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.007+0000 7f729dadd640 1 --2- 172.21.15.84:0/1695036602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34da070 0x5639d388d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:51.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.007+0000 7f729d2dc640 1 --2- 172.21.15.84:0/1695036602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b11b0 0x5639d388cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:51.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.007+0000 7f729cadb640 1 -- 172.21.15.84:0/1695036602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b11b0 msgr2=0x5639d388cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:51.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.007+0000 7f729cadb640 1 --2- 172.21.15.84:0/1695036602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b11b0 0x5639d388cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.007+0000 7f729cadb640 1 -- 172.21.15.84:0/1695036602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34da070 msgr2=0x5639d388d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:51.015 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.007+0000 7f729cadb640 1 --2- 172.21.15.84:0/1695036602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34da070 0x5639d388d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.007+0000 7f729cadb640 1 -- 172.21.15.84:0/1695036602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639d37afc40 con 0x5639d34b9390 2024-09-21T03:49:51.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.007+0000 7f729d2dc640 1 --2- 172.21.15.84:0/1695036602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b11b0 0x5639d388cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:49:51.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.008+0000 7f729cadb640 1 --2- 172.21.15.84:0/1695036602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b9390 0x5639d388d280 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f72940acfc0 tx=0x7f72940ac980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3fd240d90a320cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:51.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.008+0000 7f7280ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:49:51.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.008+0000 7f7280ff9640 1 -- 172.21.15.84:0/1695036602 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7294021040 con 0x5639d34b9390 2024-09-21T03:49:51.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.008+0000 7f7280ff9640 1 -- 172.21.15.84:0/1695036602 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f72940e90f0 con 0x5639d34b9390 2024-09-21T03:49:51.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.008+0000 7f72a5ab4740 1 -- 172.21.15.84:0/1695036602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7288018070 con 0x5639d34b9390 2024-09-21T03:49:51.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.008+0000 7f7280ff9640 1 -- 172.21.15.84:0/1695036602 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7294098020 con 0x5639d34b9390 2024-09-21T03:49:51.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.008+0000 7f72a5ab4740 10 client.16749 fetch_fsmap learned FSMap version 25 2024-09-21T03:49:51.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.008+0000 7f72a5ab4740 1 -- 172.21.15.84:0/1695036602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5639d389ba80 con 0x5639d34b9390 2024-09-21T03:49:51.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.008+0000 7f7280ff9640 1 -- 172.21.15.84:0/1695036602 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7288018070 con 0x5639d34b9390 2024-09-21T03:49:51.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.008+0000 7f7280ff9640 1 -- 172.21.15.84:0/1695036602 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f72940981c0 con 0x5639d34b9390 2024-09-21T03:49:51.016 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.008+0000 7f72a5ab4740 10 client.16749 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:49:51.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.008+0000 7f72a5ab4740 10 client.16749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:49:51.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.008+0000 7f72a5ab4740 20 client.16749 populate_metadata read hostname 'smithi084' 2024-09-21T03:49:51.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.008+0000 7f72a5ab4740 1 --2- 172.21.15.84:0/1695036602 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5639d34989f0 0x5639d389f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:51.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.008+0000 7f72a5ab4740 4 client.16749 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:49:51.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.009+0000 7f72a5ab4740 1 -- 172.21.15.84:0/1695036602 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639d37f9da0 con 0x5639d34989f0 2024-09-21T03:49:51.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.009+0000 7f729d2dc640 1 --2- 172.21.15.84:0/1695036602 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5639d34989f0 0x5639d389f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:51.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.009+0000 7f729d2dc640 1 --2- 172.21.15.84:0/1695036602 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5639d34989f0 0x5639d389f0c0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fa544f7581250cf server_cookie=e3289472edb53bbd in_seq=0 out_seq=0 2024-09-21T03:49:51.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.009+0000 7f7280ff9640 10 client.16749 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:51.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.010+0000 7f7280ff9640 1 -- 172.21.15.84:0/1695036602 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5639d37f9da0 con 0x5639d34989f0 2024-09-21T03:49:51.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.010+0000 7f7280ff9640 10 client.16749 handle_command_reply: tid=0 2024-09-21T03:49:51.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.010+0000 7f72a5ab4740 1 client.16749 shutdown 2024-09-21T03:49:51.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.010+0000 7f72a5ab4740 1 -- 172.21.15.84:0/1695036602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b9390 msgr2=0x5639d388d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:51.017 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.010+0000 7f72a5ab4740 1 --2- 172.21.15.84:0/1695036602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b9390 0x5639d388d280 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f72940acfc0 tx=0x7f72940ac980 comp rx=0 tx=0).stop 2024-09-21T03:49:51.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.010+0000 7f72a5ab4740 1 -- 172.21.15.84:0/1695036602 shutdown_connections 2024-09-21T03:49:51.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.010+0000 7f72a5ab4740 1 --2- 172.21.15.84:0/1695036602 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5639d34989f0 0x5639d389f0c0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.010+0000 7f72a5ab4740 1 --2- 172.21.15.84:0/1695036602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34da070 0x5639d388d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.010+0000 7f72a5ab4740 1 --2- 172.21.15.84:0/1695036602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b9390 0x5639d388d280 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.010+0000 7f72a5ab4740 1 --2- 172.21.15.84:0/1695036602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b11b0 0x5639d388cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.010+0000 7f72a5ab4740 1 -- 172.21.15.84:0/1695036602 >> 172.21.15.84:0/1695036602 conn(0x5639d34ce460 msgr2=0x5639d3884830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:51.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.010+0000 7f7280ff9640 0 client.16749 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:51.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.010+0000 7f72a5ab4740 1 -- 172.21.15.84:0/1695036602 shutdown_connections 2024-09-21T03:49:51.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.010+0000 7f72a5ab4740 1 -- 172.21.15.84:0/1695036602 wait complete. 2024-09-21T03:49:51.018 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.011+0000 7f72a5ab4740 20 client.16749 trim_cache size 0 max 16384 2024-09-21T03:49:51.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.028+0000 7f72a5ab4740 1 Processor -- start 2024-09-21T03:49:51.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.028+0000 7f72a5ab4740 1 -- start start 2024-09-21T03:49:51.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.028+0000 7f72a5ab4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b11b0 0x5639d388e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:51.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.028+0000 7f72a5ab4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b9390 0x5639d3889f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:51.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.028+0000 7f72a5ab4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34da070 0x5639d388a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:51.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.028+0000 7f72a5ab4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f72981b1f20 con 0x5639d34b11b0 2024-09-21T03:49:51.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.028+0000 7f72a5ab4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f72981af7f0 con 0x5639d34da070 2024-09-21T03:49:51.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.028+0000 7f72a5ab4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f72981ad660 con 0x5639d34b9390 2024-09-21T03:49:51.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.028+0000 7f729d2dc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b11b0 0x5639d388e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:51.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.028+0000 7f729d2dc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b11b0 0x5639d388e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57422/0 (socket says 172.21.15.84:57422) 2024-09-21T03:49:51.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.028+0000 7f729d2dc640 1 -- 172.21.15.84:0/3119229607 learned_addr learned my addr 172.21.15.84:0/3119229607 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:51.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.028+0000 7f729dadd640 1 --2- 172.21.15.84:0/3119229607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34da070 0x5639d388a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:51.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.028+0000 7f729cadb640 1 --2- 172.21.15.84:0/3119229607 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b9390 0x5639d3889f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:51.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.028+0000 7f729d2dc640 1 -- 172.21.15.84:0/3119229607 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b9390 msgr2=0x5639d3889f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:51.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.028+0000 7f729d2dc640 1 --2- 172.21.15.84:0/3119229607 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b9390 0x5639d3889f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.028+0000 7f729d2dc640 1 -- 172.21.15.84:0/3119229607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34da070 msgr2=0x5639d388a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:51.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.028+0000 7f729d2dc640 1 --2- 172.21.15.84:0/3119229607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34da070 0x5639d388a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.028+0000 7f729d2dc640 1 -- 172.21.15.84:0/3119229607 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639d388e000 con 0x5639d34b11b0 2024-09-21T03:49:51.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.029+0000 7f729d2dc640 1 --2- 172.21.15.84:0/3119229607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b11b0 0x5639d388e970 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f7288007730 tx=0x7f728800f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c428e8f3a30b4a96 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:51.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.029+0000 7f7282ffd640 1 -- 172.21.15.84:0/3119229607 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7288029070 con 0x5639d34b11b0 2024-09-21T03:49:51.033 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.029+0000 7f7282ffd640 1 -- 172.21.15.84:0/3119229607 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7288021030 con 0x5639d34b11b0 2024-09-21T03:49:51.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.029+0000 7f7282ffd640 1 -- 172.21.15.84:0/3119229607 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f728801d660 con 0x5639d34b11b0 2024-09-21T03:49:51.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.030+0000 7f72a5ab4740 1 -- 172.21.15.84:0/3119229607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b11b0 msgr2=0x5639d388e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:51.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.030+0000 7f72a5ab4740 1 --2- 172.21.15.84:0/3119229607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b11b0 0x5639d388e970 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f7288007730 tx=0x7f728800f040 comp rx=0 tx=0).stop 2024-09-21T03:49:51.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.030+0000 7f72a5ab4740 1 -- 172.21.15.84:0/3119229607 shutdown_connections 2024-09-21T03:49:51.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.030+0000 7f72a5ab4740 1 --2- 172.21.15.84:0/3119229607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34da070 0x5639d388a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.030+0000 7f72a5ab4740 1 --2- 172.21.15.84:0/3119229607 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b9390 0x5639d3889f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.030+0000 7f72a5ab4740 1 --2- 172.21.15.84:0/3119229607 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b11b0 0x5639d388e970 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.030+0000 7f72a5ab4740 1 -- 172.21.15.84:0/3119229607 >> 172.21.15.84:0/3119229607 conn(0x5639d34ce460 msgr2=0x5639d388e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:51.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.030+0000 7f72a5ab4740 1 -- 172.21.15.84:0/3119229607 shutdown_connections 2024-09-21T03:49:51.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.030+0000 7f72a5ab4740 1 -- 172.21.15.84:0/3119229607 wait complete. 2024-09-21T03:49:51.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.030+0000 7f72a5ab4740 1 -- start start 2024-09-21T03:49:51.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.030+0000 7f72a5ab4740 1 Processor -- start 2024-09-21T03:49:51.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f72a5ab4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b11b0 0x5639d38933a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:51.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f72a5ab4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b9390 0x5639d38938e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:51.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f72a5ab4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34da070 0x5639d3908a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:51.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f72a5ab4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f72981adcb0 con 0x5639d34b9390 2024-09-21T03:49:51.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f72a5ab4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f72981af120 con 0x5639d34da070 2024-09-21T03:49:51.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f72a5ab4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f72981ae380 con 0x5639d34b11b0 2024-09-21T03:49:51.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f72a5ab4740 10 client.0 _ll_register_callbacks cb 0x7f7294009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:49:51.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f729cadb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b9390 0x5639d38938e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:51.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f729cadb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b9390 0x5639d38938e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57436/0 (socket says 172.21.15.84:57436) 2024-09-21T03:49:51.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f729cadb640 1 -- 172.21.15.84:0/4049860669 learned_addr learned my addr 172.21.15.84:0/4049860669 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:51.038 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f729d2dc640 1 --2- 172.21.15.84:0/4049860669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b11b0 0x5639d38933a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:51.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f729dadd640 1 --2- 172.21.15.84:0/4049860669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34da070 0x5639d3908a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:51.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f729cadb640 1 -- 172.21.15.84:0/4049860669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b11b0 msgr2=0x5639d38933a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:51.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f729cadb640 1 --2- 172.21.15.84:0/4049860669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b11b0 0x5639d38933a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f729cadb640 1 -- 172.21.15.84:0/4049860669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34da070 msgr2=0x5639d3908a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:51.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f729cadb640 1 --2- 172.21.15.84:0/4049860669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34da070 0x5639d3908a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f729cadb640 1 -- 172.21.15.84:0/4049860669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639d3894130 con 0x5639d34b9390 2024-09-21T03:49:51.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f729dadd640 1 --2- 172.21.15.84:0/4049860669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34da070 0x5639d3908a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:49:51.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f729cadb640 1 --2- 172.21.15.84:0/4049860669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b9390 0x5639d38938e0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f72940a97f0 tx=0x7f72940ac0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505acda03179a945 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:51.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f7280ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:49:51.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f7280ff9640 1 -- 172.21.15.84:0/4049860669 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7294021050 con 0x5639d34b9390 2024-09-21T03:49:51.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f7280ff9640 1 -- 172.21.15.84:0/4049860669 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f72940a8b90 con 0x5639d34b9390 2024-09-21T03:49:51.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.031+0000 7f72a5ab4740 1 -- 172.21.15.84:0/4049860669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7288021030 con 0x5639d34b9390 2024-09-21T03:49:51.039 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.032+0000 7f7280ff9640 1 -- 172.21.15.84:0/4049860669 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7294070050 con 0x5639d34b9390 2024-09-21T03:49:51.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.032+0000 7f72a5ab4740 10 client.16755 fetch_fsmap learned FSMap version 25 2024-09-21T03:49:51.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.032+0000 7f72a5ab4740 1 -- 172.21.15.84:0/4049860669 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5639d390a020 con 0x5639d34b9390 2024-09-21T03:49:51.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.032+0000 7f7280ff9640 1 -- 172.21.15.84:0/4049860669 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7288021030 con 0x5639d34b9390 2024-09-21T03:49:51.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.032+0000 7f7280ff9640 1 -- 172.21.15.84:0/4049860669 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f729405c180 con 0x5639d34b9390 2024-09-21T03:49:51.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.032+0000 7f72a5ab4740 10 client.16755 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:49:51.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.032+0000 7f72a5ab4740 10 client.16755 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:49:51.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.032+0000 7f72a5ab4740 20 client.16755 populate_metadata read hostname 'smithi084' 2024-09-21T03:49:51.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.032+0000 7f72a5ab4740 1 --2- 172.21.15.84:0/4049860669 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5639d346dda0 0x5639d390c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:51.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.032+0000 7f72a5ab4740 4 client.16755 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:49:51.040 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.032+0000 7f72a5ab4740 1 -- 172.21.15.84:0/4049860669 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5639d38888f0 con 0x5639d346dda0 2024-09-21T03:49:51.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.032+0000 7f729d2dc640 1 --2- 172.21.15.84:0/4049860669 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5639d346dda0 0x5639d390c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:51.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.033+0000 7f729d2dc640 1 --2- 172.21.15.84:0/4049860669 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5639d346dda0 0x5639d390c7b0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5201348a5266306 server_cookie=1e92dfd67effd884 in_seq=0 out_seq=0 2024-09-21T03:49:51.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.033+0000 7f7280ff9640 10 client.16755 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:51.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.033+0000 7f7280ff9640 1 -- 172.21.15.84:0/4049860669 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x5639d38888f0 con 0x5639d346dda0 2024-09-21T03:49:51.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.033+0000 7f7280ff9640 10 client.16755 handle_command_reply: tid=0 2024-09-21T03:49:51.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.033+0000 7f72a5ab4740 1 client.16755 shutdown 2024-09-21T03:49:51.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.033+0000 7f72a5ab4740 1 -- 172.21.15.84:0/4049860669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b9390 msgr2=0x5639d38938e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:51.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.033+0000 7f72a5ab4740 1 --2- 172.21.15.84:0/4049860669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b9390 0x5639d38938e0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f72940a97f0 tx=0x7f72940ac0a0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.033+0000 7f72a5ab4740 1 -- 172.21.15.84:0/4049860669 shutdown_connections 2024-09-21T03:49:51.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.033+0000 7f72a5ab4740 1 --2- 172.21.15.84:0/4049860669 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5639d346dda0 0x5639d390c7b0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.033+0000 7f7280ff9640 0 client.16755 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:51.041 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.033+0000 7f72a5ab4740 1 --2- 172.21.15.84:0/4049860669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639d34da070 0x5639d3908a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.033+0000 7f72a5ab4740 1 --2- 172.21.15.84:0/4049860669 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5639d34b9390 0x5639d38938e0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.033+0000 7f72a5ab4740 1 --2- 172.21.15.84:0/4049860669 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5639d34b11b0 0x5639d38933a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.033+0000 7f72a5ab4740 1 -- 172.21.15.84:0/4049860669 >> 172.21.15.84:0/4049860669 conn(0x5639d34ce460 msgr2=0x5639d388e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:51.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.034+0000 7f72a5ab4740 1 -- 172.21.15.84:0/4049860669 shutdown_connections 2024-09-21T03:49:51.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.034+0000 7f72a5ab4740 1 -- 172.21.15.84:0/4049860669 wait complete. 2024-09-21T03:49:51.042 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.034+0000 7f72a5ab4740 20 client.16755 trim_cache size 0 max 16384 2024-09-21T03:49:51.042 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:49:51.042 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T03:49:51.042 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T03:49:51.043 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:49:51.043 INFO:teuthology.orchestra.run.smithi084.stdout: "b2063a70-0b1f-4b6b-9c96-d886e156ea66": { 2024-09-21T03:49:51.043 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:48:34.864478+0000", 2024-09-21T03:49:51.043 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:51.043 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:51.043 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:51.043 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:51.043 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:51.043 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:51.043 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:49:51.043 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:49:51.043 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:51.043 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:51.043 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:51.044 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:51.044 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:51.044 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:51.044 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:49:51.044 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:49:51.044 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:51.044 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:51.044 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:51.044 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:51.044 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:51.044 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:51.044 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:49:51.044 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:49:51.044 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:51.045 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:51.045 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:51.045 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:51.045 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:51.045 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:51.045 INFO:teuthology.orchestra.run.smithi084.stdout: "27dcb84c-89fa-46b2-b980-58857966c697": { 2024-09-21T03:49:51.045 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:52.598527+0000", 2024-09-21T03:49:51.045 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:51.045 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:51.045 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:51.045 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:51.045 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:51.045 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:51.045 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:49:51.046 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:49:51.046 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:51.046 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:51.046 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:51.046 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:51.046 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:51.046 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:51.046 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:49:51.046 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:49:51.046 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:51.046 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:51.046 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:51.046 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:51.046 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:51.047 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:51.047 INFO:teuthology.orchestra.run.smithi084.stdout: "43a49cca-fc1c-4c36-a314-49033e7c3fb6": { 2024-09-21T03:49:51.047 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:49:17.366428+0000", 2024-09-21T03:49:51.047 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:51.047 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:51.047 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:51.047 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:51.047 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:51.047 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:51.047 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:49:51.047 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:49:51.047 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:51.047 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:51.047 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:51.048 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:51.048 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:51.048 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:51.048 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:49:51.048 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:49:51.048 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:51.048 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:51.048 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:51.048 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:51.048 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:51.048 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:51.048 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:49:51.048 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:49:51.048 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:51.048 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:51.049 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:51.049 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:51.049 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:51.049 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:49:51.049 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:49:51.049 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:49:51.049 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:49:51.049 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:49:51.049 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:49:51.049 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:49:51.049 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:49:51.049 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:49:51.049 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:49:51.049 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:49:51.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.034+0000 7f729f540640 1 -- 172.21.15.84:0/3355774135 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f72840b6680 msgr2=0x7f72840b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:51.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.034+0000 7f729f540640 1 --2- 172.21.15.84:0/3355774135 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f72840b6680 0x7f72840b8b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7290009a60 tx=0x7f729002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.034+0000 7f729f540640 1 -- 172.21.15.84:0/3355774135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72981094c0 msgr2=0x7f729819aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:51.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.034+0000 7f729f540640 1 --2- 172.21.15.84:0/3355774135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72981094c0 0x7f729819aa40 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f729400d740 tx=0x7f729400dc00 comp rx=0 tx=0).stop 2024-09-21T03:49:51.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.034+0000 7f729f540640 1 -- 172.21.15.84:0/3355774135 shutdown_connections 2024-09-21T03:49:51.050 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.034+0000 7f729f540640 1 --2- 172.21.15.84:0/3355774135 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f72840b6680 0x7f72840b8b90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.034+0000 7f729f540640 1 --2- 172.21.15.84:0/3355774135 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7298109e10 0x7f729819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.034+0000 7f729f540640 1 --2- 172.21.15.84:0/3355774135 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f72981094c0 0x7f729819aa40 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.034+0000 7f729f540640 1 --2- 172.21.15.84:0/3355774135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7298103b80 0x7f729819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:51.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.034+0000 7f729f540640 1 -- 172.21.15.84:0/3355774135 >> 172.21.15.84:0/3355774135 conn(0x7f72980ff5d0 msgr2=0x7f72981019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:51.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.034+0000 7f729f540640 1 -- 172.21.15.84:0/3355774135 shutdown_connections 2024-09-21T03:49:51.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:51.035+0000 7f729f540640 1 -- 172.21.15.84:0/3355774135 wait complete. 2024-09-21T03:49:51.934 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:49:51.934 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:49:52.181 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:49:52.538 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.538 INFO:tasks.workunit.client.0.smithi084.stdout:313/600: open fd = 3 2024-09-21T03:49:52.538 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.538 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.538 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.538 INFO:tasks.workunit.client.0.smithi084.stdout:314/600: open fd = 3 2024-09-21T03:49:52.538 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.539 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.539 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.539 INFO:tasks.workunit.client.0.smithi084.stdout:315/600: open fd = 3 2024-09-21T03:49:52.539 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.539 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.539 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.539 INFO:tasks.workunit.client.0.smithi084.stdout:316/600: open fd = 3 2024-09-21T03:49:52.539 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.539 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.539 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.539 INFO:tasks.workunit.client.0.smithi084.stdout:317/600: open fd = 3 2024-09-21T03:49:52.539 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.539 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.539 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.539 INFO:tasks.workunit.client.0.smithi084.stdout:318/600: open fd = 3 2024-09-21T03:49:52.539 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.540 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.540 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.540 INFO:tasks.workunit.client.0.smithi084.stdout:319/600: open fd = 3 2024-09-21T03:49:52.540 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.540 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.540 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.540 INFO:tasks.workunit.client.0.smithi084.stdout:320/600: open fd = 3 2024-09-21T03:49:52.540 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.540 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.540 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.540 INFO:tasks.workunit.client.0.smithi084.stdout:321/600: open fd = 3 2024-09-21T03:49:52.540 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.540 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.541 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.541 INFO:tasks.workunit.client.0.smithi084.stdout:322/600: open fd = 3 2024-09-21T03:49:52.541 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.541 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.541 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.541 INFO:tasks.workunit.client.0.smithi084.stdout:323/600: open fd = 3 2024-09-21T03:49:52.541 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.541 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.541 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.541 INFO:tasks.workunit.client.0.smithi084.stdout:324/600: open fd = 3 2024-09-21T03:49:52.541 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.541 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.541 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.541 INFO:tasks.workunit.client.0.smithi084.stdout:325/600: open fd = 3 2024-09-21T03:49:52.541 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.542 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.542 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.542 INFO:tasks.workunit.client.0.smithi084.stdout:326/600: open fd = 3 2024-09-21T03:49:52.542 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.542 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.542 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.542 INFO:tasks.workunit.client.0.smithi084.stdout:327/600: open fd = 3 2024-09-21T03:49:52.542 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.542 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.542 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.542 INFO:tasks.workunit.client.0.smithi084.stdout:328/600: open fd = 3 2024-09-21T03:49:52.542 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.542 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.542 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.542 INFO:tasks.workunit.client.0.smithi084.stdout:329/600: open fd = 3 2024-09-21T03:49:52.543 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.543 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.543 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.543 INFO:tasks.workunit.client.0.smithi084.stdout:330/600: open fd = 3 2024-09-21T03:49:52.543 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.543 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.543 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.543 INFO:tasks.workunit.client.0.smithi084.stdout:331/600: open fd = 3 2024-09-21T03:49:52.543 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.543 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.543 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.544 INFO:tasks.workunit.client.0.smithi084.stdout:332/600: open fd = 3 2024-09-21T03:49:52.544 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.544 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.544 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.544 INFO:tasks.workunit.client.0.smithi084.stdout:333/600: open fd = 3 2024-09-21T03:49:52.544 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.544 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.544 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.544 INFO:tasks.workunit.client.0.smithi084.stdout:334/600: open fd = 3 2024-09-21T03:49:52.544 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.544 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.544 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.544 INFO:tasks.workunit.client.0.smithi084.stdout:335/600: open fd = 3 2024-09-21T03:49:52.544 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.544 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.545 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.545 INFO:tasks.workunit.client.0.smithi084.stdout:336/600: open fd = 3 2024-09-21T03:49:52.545 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.545 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.545 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.545 INFO:tasks.workunit.client.0.smithi084.stdout:337/600: open fd = 3 2024-09-21T03:49:52.545 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.545 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.545 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.545 INFO:tasks.workunit.client.0.smithi084.stdout:338/600: open fd = 3 2024-09-21T03:49:52.545 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.545 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.545 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.545 INFO:tasks.workunit.client.0.smithi084.stdout:339/600: open fd = 3 2024-09-21T03:49:52.546 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.546 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.546 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.546 INFO:tasks.workunit.client.0.smithi084.stdout:340/600: open fd = 3 2024-09-21T03:49:52.546 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.546 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.546 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.546 INFO:tasks.workunit.client.0.smithi084.stdout:341/600: open fd = 3 2024-09-21T03:49:52.546 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.546 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.546 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.547 INFO:tasks.workunit.client.0.smithi084.stdout:342/600: open fd = 3 2024-09-21T03:49:52.547 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.547 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.547 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.547 INFO:tasks.workunit.client.0.smithi084.stdout:343/600: open fd = 3 2024-09-21T03:49:52.547 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.547 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.547 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.547 INFO:tasks.workunit.client.0.smithi084.stdout:344/600: open fd = 3 2024-09-21T03:49:52.547 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.548 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.548 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.548 INFO:tasks.workunit.client.0.smithi084.stdout:345/600: open fd = 3 2024-09-21T03:49:52.548 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.548 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.548 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.548 INFO:tasks.workunit.client.0.smithi084.stdout:346/600: open fd = 3 2024-09-21T03:49:52.548 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.548 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.548 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.548 INFO:tasks.workunit.client.0.smithi084.stdout:347/600: open fd = 3 2024-09-21T03:49:52.548 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.548 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.549 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.549 INFO:tasks.workunit.client.0.smithi084.stdout:348/600: open fd = 3 2024-09-21T03:49:52.549 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.549 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.549 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.549 INFO:tasks.workunit.client.0.smithi084.stdout:349/600: open fd = 3 2024-09-21T03:49:52.549 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.549 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.549 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.549 INFO:tasks.workunit.client.0.smithi084.stdout:350/600: open fd = 3 2024-09-21T03:49:52.549 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.549 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.550 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.550 INFO:tasks.workunit.client.0.smithi084.stdout:351/600: open fd = 3 2024-09-21T03:49:52.550 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.550 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.550 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.550 INFO:tasks.workunit.client.0.smithi084.stdout:352/600: open fd = 3 2024-09-21T03:49:52.550 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.550 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.550 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.550 INFO:tasks.workunit.client.0.smithi084.stdout:353/600: open fd = 3 2024-09-21T03:49:52.550 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.550 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.550 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.550 INFO:tasks.workunit.client.0.smithi084.stdout:354/600: open fd = 3 2024-09-21T03:49:52.551 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.551 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.551 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.551 INFO:tasks.workunit.client.0.smithi084.stdout:355/600: open fd = 3 2024-09-21T03:49:52.551 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.551 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.551 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.551 INFO:tasks.workunit.client.0.smithi084.stdout:356/600: open fd = 3 2024-09-21T03:49:52.551 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.551 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.551 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.551 INFO:tasks.workunit.client.0.smithi084.stdout:357/600: open fd = 3 2024-09-21T03:49:52.551 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.551 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.551 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.551 INFO:tasks.workunit.client.0.smithi084.stdout:358/600: open fd = 3 2024-09-21T03:49:52.552 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.552 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.552 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.552 INFO:tasks.workunit.client.0.smithi084.stdout:359/600: open fd = 3 2024-09-21T03:49:52.552 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.552 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.552 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.552 INFO:tasks.workunit.client.0.smithi084.stdout:360/600: open fd = 3 2024-09-21T03:49:52.552 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.552 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.552 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.552 INFO:tasks.workunit.client.0.smithi084.stdout:361/600: open fd = 3 2024-09-21T03:49:52.552 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.552 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.552 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.552 INFO:tasks.workunit.client.0.smithi084.stdout:362/600: open fd = 3 2024-09-21T03:49:52.552 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.553 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.553 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.553 INFO:tasks.workunit.client.0.smithi084.stdout:363/600: open fd = 3 2024-09-21T03:49:52.553 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.553 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.553 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.553 INFO:tasks.workunit.client.0.smithi084.stdout:364/600: open fd = 3 2024-09-21T03:49:52.553 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.553 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.553 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.553 INFO:tasks.workunit.client.0.smithi084.stdout:365/600: open fd = 3 2024-09-21T03:49:52.553 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.553 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.554 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.554 INFO:tasks.workunit.client.0.smithi084.stdout:366/600: open fd = 3 2024-09-21T03:49:52.554 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.554 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.554 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.554 INFO:tasks.workunit.client.0.smithi084.stdout:367/600: open fd = 3 2024-09-21T03:49:52.554 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.554 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.554 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.554 INFO:tasks.workunit.client.0.smithi084.stdout:368/600: open fd = 3 2024-09-21T03:49:52.554 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.554 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.554 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.555 INFO:tasks.workunit.client.0.smithi084.stdout:369/600: open fd = 3 2024-09-21T03:49:52.555 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.555 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.555 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.555 INFO:tasks.workunit.client.0.smithi084.stdout:370/600: open fd = 3 2024-09-21T03:49:52.555 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.555 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.555 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.555 INFO:tasks.workunit.client.0.smithi084.stdout:371/600: open fd = 3 2024-09-21T03:49:52.555 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.555 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.555 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.555 INFO:tasks.workunit.client.0.smithi084.stdout:372/600: open fd = 3 2024-09-21T03:49:52.555 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.555 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.556 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.556 INFO:tasks.workunit.client.0.smithi084.stdout:373/600: open fd = 3 2024-09-21T03:49:52.556 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.556 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.556 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.556 INFO:tasks.workunit.client.0.smithi084.stdout:374/600: open fd = 3 2024-09-21T03:49:52.556 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.556 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:49:52.556 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:49:52.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:52 smithi084 ceph-mon[30941]: pgmap v548: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 11 op/s 2024-09-21T03:49:52.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.712+0000 7f5dbf1f2640 1 -- 172.21.15.84:0/4076116443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db8109e10 msgr2=0x7f5db8110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:52.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.712+0000 7f5dbf1f2640 1 --2- 172.21.15.84:0/4076116443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db8109e10 0x7f5db8110640 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f5db0009ca0 tx=0x7f5db002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:49:52.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.713+0000 7f5dbf1f2640 1 -- 172.21.15.84:0/4076116443 shutdown_connections 2024-09-21T03:49:52.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.713+0000 7f5dbf1f2640 1 --2- 172.21.15.84:0/4076116443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db8109e10 0x7f5db8110640 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:52.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.713+0000 7f5dbf1f2640 1 --2- 172.21.15.84:0/4076116443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5db81094c0 0x7f5db81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:52.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.713+0000 7f5dbf1f2640 1 --2- 172.21.15.84:0/4076116443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db8103b80 0x7f5db8103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:52.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.713+0000 7f5dbf1f2640 1 -- 172.21.15.84:0/4076116443 >> 172.21.15.84:0/4076116443 conn(0x7f5db80ff5d0 msgr2=0x7f5db8101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:52.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.713+0000 7f5dbf1f2640 1 -- 172.21.15.84:0/4076116443 shutdown_connections 2024-09-21T03:49:52.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.713+0000 7f5dbf1f2640 1 -- 172.21.15.84:0/4076116443 wait complete. 2024-09-21T03:49:52.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.713+0000 7f5dbf1f2640 1 Processor -- start 2024-09-21T03:49:52.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.713+0000 7f5dbf1f2640 1 -- start start 2024-09-21T03:49:52.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5dbf1f2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db8103b80 0x7f5db819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:52.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5dbf1f2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5db81094c0 0x7f5db819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:52.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5dbf1f2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db8109e10 0x7f5db819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:52.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5dbf1f2640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5db8113ad0 con 0x7f5db8103b80 2024-09-21T03:49:52.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5dbf1f2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5db8113950 con 0x7f5db8109e10 2024-09-21T03:49:52.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5dbf1f2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5db8113c50 con 0x7f5db81094c0 2024-09-21T03:49:52.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5dbcf8e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db8103b80 0x7f5db819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:52.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5dbcf8e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db8103b80 0x7f5db819a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57460/0 (socket says 172.21.15.84:57460) 2024-09-21T03:49:52.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5dbcf8e640 1 -- 172.21.15.84:0/1945253499 learned_addr learned my addr 172.21.15.84:0/1945253499 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:52.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5dbd78f640 1 --2- 172.21.15.84:0/1945253499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db8109e10 0x7f5db819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:52.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5db7fff640 1 --2- 172.21.15.84:0/1945253499 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5db81094c0 0x7f5db819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:52.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5dbcf8e640 1 -- 172.21.15.84:0/1945253499 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5db81094c0 msgr2=0x7f5db819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:52.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5dbcf8e640 1 --2- 172.21.15.84:0/1945253499 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5db81094c0 0x7f5db819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:52.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5dbcf8e640 1 -- 172.21.15.84:0/1945253499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db8109e10 msgr2=0x7f5db819fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:52.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5dbcf8e640 1 --2- 172.21.15.84:0/1945253499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db8109e10 0x7f5db819fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:52.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5dbcf8e640 1 -- 172.21.15.84:0/1945253499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db81a02f0 con 0x7f5db8103b80 2024-09-21T03:49:52.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5dbd78f640 1 --2- 172.21.15.84:0/1945253499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db8109e10 0x7f5db819fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:49:52.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5dbcf8e640 1 --2- 172.21.15.84:0/1945253499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db8103b80 0x7f5db819a440 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f5dac00d950 tx=0x7f5dac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:52.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5db5ffb640 1 -- 172.21.15.84:0/1945253499 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac017070 con 0x7f5db8103b80 2024-09-21T03:49:52.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5dbf1f2640 1 -- 172.21.15.84:0/1945253499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5db81a05e0 con 0x7f5db8103b80 2024-09-21T03:49:52.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5db5ffb640 1 -- 172.21.15.84:0/1945253499 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dac009c30 con 0x7f5db8103b80 2024-09-21T03:49:52.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.714+0000 7f5db5ffb640 1 -- 172.21.15.84:0/1945253499 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac00f620 con 0x7f5db8103b80 2024-09-21T03:49:52.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.715+0000 7f5dbf1f2640 1 -- 172.21.15.84:0/1945253499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5db81a6e00 con 0x7f5db8103b80 2024-09-21T03:49:52.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.716+0000 7f5dbf1f2640 1 -- 172.21.15.84:0/1945253499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5db8103f90 con 0x7f5db8103b80 2024-09-21T03:49:52.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.717+0000 7f5db5ffb640 1 -- 172.21.15.84:0/1945253499 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f5dac010460 con 0x7f5db8103b80 2024-09-21T03:49:52.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.718+0000 7f5db5ffb640 1 --2- 172.21.15.84:0/1945253499 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5da80b66b0 0x7f5da80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:52.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.718+0000 7f5db7fff640 1 --2- 172.21.15.84:0/1945253499 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5da80b66b0 0x7f5da80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:52.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.718+0000 7f5db5ffb640 1 -- 172.21.15.84:0/1945253499 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f5dac0e73c0 con 0x7f5db8103b80 2024-09-21T03:49:52.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.718+0000 7f5db7fff640 1 --2- 172.21.15.84:0/1945253499 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5da80b66b0 0x7f5da80b8bc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5da4005e10 tx=0x7f5da4005da0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:52.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.722+0000 7f5db5ffb640 1 -- 172.21.15.84:0/1945253499 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5dac0ad960 con 0x7f5db8103b80 2024-09-21T03:49:52.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:52 smithi174 ceph-mon[34403]: pgmap v548: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 11 op/s 2024-09-21T03:49:52.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:52 smithi172 ceph-mon[34821]: pgmap v548: 97 pgs: 97 active+clean; 12 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 11 op/s 2024-09-21T03:49:52.936 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.934+0000 7f5dbf1f2640 1 -- 172.21.15.84:0/1945253499 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5db802e640 con 0x7f5db8103b80 2024-09-21T03:49:52.937 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.935+0000 7f5db5ffb640 1 -- 172.21.15.84:0/1945253499 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7f5dac009de0 con 0x7f5db8103b80 2024-09-21T03:49:52.937 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:49:52.937 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:49:52.938 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:49:52.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.938+0000 7f5dbf1f2640 1 -- 172.21.15.84:0/1945253499 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5da80b66b0 msgr2=0x7f5da80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:52.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.938+0000 7f5dbf1f2640 1 --2- 172.21.15.84:0/1945253499 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5da80b66b0 0x7f5da80b8bc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5da4005e10 tx=0x7f5da4005da0 comp rx=0 tx=0).stop 2024-09-21T03:49:52.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.938+0000 7f5dbf1f2640 1 -- 172.21.15.84:0/1945253499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db8103b80 msgr2=0x7f5db819a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:52.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.938+0000 7f5dbf1f2640 1 --2- 172.21.15.84:0/1945253499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db8103b80 0x7f5db819a440 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f5dac00d950 tx=0x7f5dac00de10 comp rx=0 tx=0).stop 2024-09-21T03:49:52.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.938+0000 7f5dbf1f2640 1 -- 172.21.15.84:0/1945253499 shutdown_connections 2024-09-21T03:49:52.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.938+0000 7f5dbf1f2640 1 --2- 172.21.15.84:0/1945253499 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5da80b66b0 0x7f5da80b8bc0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:52.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.938+0000 7f5dbf1f2640 1 --2- 172.21.15.84:0/1945253499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5db8109e10 0x7f5db819fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:52.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.938+0000 7f5dbf1f2640 1 --2- 172.21.15.84:0/1945253499 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5db81094c0 0x7f5db819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:52.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.938+0000 7f5dbf1f2640 1 --2- 172.21.15.84:0/1945253499 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5db8103b80 0x7f5db819a440 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:52.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.938+0000 7f5dbf1f2640 1 -- 172.21.15.84:0/1945253499 >> 172.21.15.84:0/1945253499 conn(0x7f5db80ff5d0 msgr2=0x7f5db81019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:52.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.938+0000 7f5dbf1f2640 1 -- 172.21.15.84:0/1945253499 shutdown_connections 2024-09-21T03:49:52.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:52.938+0000 7f5dbf1f2640 1 -- 172.21.15.84:0/1945253499 wait complete. 2024-09-21T03:49:53.746 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:53 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1945253499' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:49:53.777 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:49:53.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:53 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1945253499' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:49:53.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:53 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1945253499' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:49:54.023 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:49:54.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.564+0000 7f146d2d4640 1 -- 172.21.15.84:0/303950087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468102030 msgr2=0x7f1468102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:54.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.564+0000 7f146d2d4640 1 --2- 172.21.15.84:0/303950087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468102030 0x7f1468102440 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f1458009ca0 tx=0x7f145802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.582 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.564+0000 7f146d2d4640 1 -- 172.21.15.84:0/303950087 shutdown_connections 2024-09-21T03:49:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.564+0000 7f146d2d4640 1 --2- 172.21.15.84:0/303950087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1468106bd0 0x7f1468110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.564+0000 7f146d2d4640 1 --2- 172.21.15.84:0/303950087 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1468106280 0x7f1468106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.564+0000 7f146d2d4640 1 --2- 172.21.15.84:0/303950087 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468102030 0x7f1468102440 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.564+0000 7f146d2d4640 1 -- 172.21.15.84:0/303950087 >> 172.21.15.84:0/303950087 conn(0x7f1468077c60 msgr2=0x7f14680780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.564+0000 7f146d2d4640 1 -- 172.21.15.84:0/303950087 shutdown_connections 2024-09-21T03:49:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.564+0000 7f146d2d4640 1 -- 172.21.15.84:0/303950087 wait complete. 2024-09-21T03:49:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.565+0000 7f146d2d4640 1 Processor -- start 2024-09-21T03:49:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.565+0000 7f146d2d4640 1 -- start start 2024-09-21T03:49:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.565+0000 7f146d2d4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468102030 0x7f1468102fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.565+0000 7f146d2d4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1468106280 0x7f1468103510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.565+0000 7f146d2d4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1468106bd0 0x7f1468103a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.565+0000 7f146d2d4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1468113aa0 con 0x7f1468102030 2024-09-21T03:49:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.565+0000 7f146d2d4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1468113920 con 0x7f1468106280 2024-09-21T03:49:54.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.565+0000 7f146d2d4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1468113c20 con 0x7f1468106bd0 2024-09-21T03:49:54.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.565+0000 7f1466ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468102030 0x7f1468102fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:54.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.565+0000 7f1466ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468102030 0x7f1468102fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57486/0 (socket says 172.21.15.84:57486) 2024-09-21T03:49:54.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.565+0000 7f1466ffd640 1 -- 172.21.15.84:0/4000311418 learned_addr learned my addr 172.21.15.84:0/4000311418 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:54.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.566+0000 7f14667fc640 1 --2- 172.21.15.84:0/4000311418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1468106280 0x7f1468103510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:54.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.566+0000 7f1466ffd640 1 -- 172.21.15.84:0/4000311418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1468106bd0 msgr2=0x7f1468103a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:54.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.566+0000 7f1466ffd640 1 --2- 172.21.15.84:0/4000311418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1468106bd0 0x7f1468103a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.566+0000 7f1466ffd640 1 -- 172.21.15.84:0/4000311418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1468106280 msgr2=0x7f1468103510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:54.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.566+0000 7f1466ffd640 1 --2- 172.21.15.84:0/4000311418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1468106280 0x7f1468103510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.566+0000 7f1466ffd640 1 -- 172.21.15.84:0/4000311418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14681a86c0 con 0x7f1468102030 2024-09-21T03:49:54.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.566+0000 7f14667fc640 1 --2- 172.21.15.84:0/4000311418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1468106280 0x7f1468103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:49:54.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.566+0000 7f1466ffd640 1 --2- 172.21.15.84:0/4000311418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468102030 0x7f1468102fd0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f1458006010 tx=0x7f14580319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:54.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.566+0000 7f145ffff640 1 -- 172.21.15.84:0/4000311418 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1458003bf0 con 0x7f1468102030 2024-09-21T03:49:54.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.566+0000 7f145ffff640 1 -- 172.21.15.84:0/4000311418 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1458003d90 con 0x7f1468102030 2024-09-21T03:49:54.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.566+0000 7f146d2d4640 1 -- 172.21.15.84:0/4000311418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14681a8950 con 0x7f1468102030 2024-09-21T03:49:54.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.566+0000 7f145ffff640 1 -- 172.21.15.84:0/4000311418 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145802fb60 con 0x7f1468102030 2024-09-21T03:49:54.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.566+0000 7f146d2d4640 1 -- 172.21.15.84:0/4000311418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14681a8e90 con 0x7f1468102030 2024-09-21T03:49:54.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.568+0000 7f1473848740 1 Processor -- start 2024-09-21T03:49:54.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.569+0000 7f1473848740 1 -- start start 2024-09-21T03:49:54.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.569+0000 7f145ffff640 1 -- 172.21.15.84:0/4000311418 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f145802fd00 con 0x7f1468102030 2024-09-21T03:49:54.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.569+0000 7f1473848740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3feb070 0x5556e43922c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:54.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.569+0000 7f1473848740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5556e3fc21b0 0x5556e4392800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:54.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.569+0000 7f1473848740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fca390 0x5556e4392d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:54.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.569+0000 7f1473848740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5556e4308ea0 con 0x5556e3feb070 2024-09-21T03:49:54.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.569+0000 7f1473848740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5556e42f82d0 con 0x5556e3fc21b0 2024-09-21T03:49:54.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.569+0000 7f1473848740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5556e42fc0e0 con 0x5556e3fca390 2024-09-21T03:49:54.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.569+0000 7f14677fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3feb070 0x5556e43922c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:54.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.569+0000 7f14677fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3feb070 0x5556e43922c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57500/0 (socket says 172.21.15.84:57500) 2024-09-21T03:49:54.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.569+0000 7f14677fe640 1 -- 172.21.15.84:0/4215948636 learned_addr learned my addr 172.21.15.84:0/4215948636 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:54.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.569+0000 7f1466ffd640 1 --2- 172.21.15.84:0/4215948636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5556e3fc21b0 0x5556e4392800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:54.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.570+0000 7f14667fc640 1 --2- 172.21.15.84:0/4215948636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fca390 0x5556e4392d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:54.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.570+0000 7f14677fe640 1 -- 172.21.15.84:0/4215948636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fca390 msgr2=0x5556e4392d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:54.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.570+0000 7f14677fe640 1 --2- 172.21.15.84:0/4215948636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fca390 0x5556e4392d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.570+0000 7f14677fe640 1 -- 172.21.15.84:0/4215948636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5556e3fc21b0 msgr2=0x5556e4392800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:54.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.570+0000 7f14677fe640 1 --2- 172.21.15.84:0/4215948636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5556e3fc21b0 0x5556e4392800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.570+0000 7f14677fe640 1 -- 172.21.15.84:0/4215948636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556e4056650 con 0x5556e3feb070 2024-09-21T03:49:54.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.570+0000 7f14667fc640 1 --2- 172.21.15.84:0/4215948636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fca390 0x5556e4392d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:49:54.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.570+0000 7f145ffff640 1 --2- 172.21.15.84:0/4000311418 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f14540b6680 0x7f14540b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:54.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.570+0000 7f14677fe640 1 --2- 172.21.15.84:0/4215948636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3feb070 0x5556e43922c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f146000a970 tx=0x7f146000ae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997699058c98750c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:54.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.570+0000 7f145d7fa640 1 -- 172.21.15.84:0/4215948636 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146000cd80 con 0x5556e3feb070 2024-09-21T03:49:54.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.570+0000 7f1466ffd640 1 --2- 172.21.15.84:0/4000311418 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f14540b6680 0x7f14540b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:54.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.570+0000 7f145d7fa640 1 -- 172.21.15.84:0/4215948636 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14600035f0 con 0x5556e3feb070 2024-09-21T03:49:54.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.570+0000 7f145d7fa640 1 -- 172.21.15.84:0/4215948636 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14600044e0 con 0x5556e3feb070 2024-09-21T03:49:54.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.570+0000 7f145ffff640 1 -- 172.21.15.84:0/4000311418 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f1458108a60 con 0x7f1468102030 2024-09-21T03:49:54.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.571+0000 7f1473848740 1 -- 172.21.15.84:0/4215948636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3feb070 msgr2=0x5556e43922c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:54.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.571+0000 7f1466ffd640 1 --2- 172.21.15.84:0/4000311418 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f14540b6680 0x7f14540b8b90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f14581062b0 tx=0x7f145810c690 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:54.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.571+0000 7f1473848740 1 --2- 172.21.15.84:0/4215948636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3feb070 0x5556e43922c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f146000a970 tx=0x7f146000ae30 comp rx=0 tx=0).stop 2024-09-21T03:49:54.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.571+0000 7f1473848740 1 -- 172.21.15.84:0/4215948636 shutdown_connections 2024-09-21T03:49:54.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.571+0000 7f1473848740 1 --2- 172.21.15.84:0/4215948636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fca390 0x5556e4392d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.571+0000 7f1473848740 1 --2- 172.21.15.84:0/4215948636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5556e3fc21b0 0x5556e4392800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.571+0000 7f1473848740 1 --2- 172.21.15.84:0/4215948636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3feb070 0x5556e43922c0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.571+0000 7f1473848740 1 -- 172.21.15.84:0/4215948636 >> 172.21.15.84:0/4215948636 conn(0x5556e3fdf460 msgr2=0x5556e43901b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:54.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.571+0000 7f1473848740 1 -- 172.21.15.84:0/4215948636 shutdown_connections 2024-09-21T03:49:54.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.571+0000 7f1473848740 1 -- 172.21.15.84:0/4215948636 wait complete. 2024-09-21T03:49:54.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.572+0000 7f1473848740 1 -- start start 2024-09-21T03:49:54.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.572+0000 7f1473848740 1 Processor -- start 2024-09-21T03:49:54.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.572+0000 7f1473848740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fc21b0 0x5556e439da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:54.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.572+0000 7f1473848740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fca390 0x5556e439df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:54.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.572+0000 7f1473848740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5556e3feb070 0x5556e43a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:54.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.572+0000 7f1473848740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5556e4159700 con 0x5556e3fc21b0 2024-09-21T03:49:54.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.572+0000 7f1473848740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5556e4293160 con 0x5556e3feb070 2024-09-21T03:49:54.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.572+0000 7f1473848740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5556e43a0aa0 con 0x5556e3fca390 2024-09-21T03:49:54.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.572+0000 7f1473848740 10 client.0 _ll_register_callbacks cb 0x5556e42ac9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:49:54.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.572+0000 7f14677fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fc21b0 0x5556e439da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:54.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.572+0000 7f14677fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fc21b0 0x5556e439da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57514/0 (socket says 172.21.15.84:57514) 2024-09-21T03:49:54.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.572+0000 7f14677fe640 1 -- 172.21.15.84:0/2423244234 learned_addr learned my addr 172.21.15.84:0/2423244234 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:54.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.572+0000 7f14667fc640 1 --2- 172.21.15.84:0/2423244234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fca390 0x5556e439df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:54.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.572+0000 7f14677fe640 1 --2- 172.21.15.84:0/2423244234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5556e3feb070 0x5556e43a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:54.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.572+0000 7f14677fe640 1 -- 172.21.15.84:0/2423244234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fca390 msgr2=0x5556e439df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:54.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.572+0000 7f14677fe640 1 --2- 172.21.15.84:0/2423244234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fca390 0x5556e439df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.572+0000 7f14677fe640 1 -- 172.21.15.84:0/2423244234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5556e3feb070 msgr2=0x5556e43a9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:54.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.572+0000 7f14677fe640 1 --2- 172.21.15.84:0/2423244234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5556e3feb070 0x5556e43a9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.572+0000 7f14677fe640 1 -- 172.21.15.84:0/2423244234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556e42c0c90 con 0x5556e3fc21b0 2024-09-21T03:49:54.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.573+0000 7f14677fe640 1 --2- 172.21.15.84:0/2423244234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fc21b0 0x5556e439da30 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f146000d010 tx=0x7f1460003d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4513141abd1a2e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:54.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.573+0000 7f144e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:49:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.573+0000 7f144e7fc640 1 -- 172.21.15.84:0/2423244234 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460004410 con 0x5556e3fc21b0 2024-09-21T03:49:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.573+0000 7f144e7fc640 1 -- 172.21.15.84:0/2423244234 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f1460005020 con 0x5556e3fc21b0 2024-09-21T03:49:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.573+0000 7f1473848740 1 -- 172.21.15.84:0/2423244234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14600035f0 con 0x5556e3fc21b0 2024-09-21T03:49:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.573+0000 7f144e7fc640 1 -- 172.21.15.84:0/2423244234 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1460005220 con 0x5556e3fc21b0 2024-09-21T03:49:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.573+0000 7f1473848740 10 client.16773 fetch_fsmap learned FSMap version 25 2024-09-21T03:49:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.573+0000 7f1473848740 1 -- 172.21.15.84:0/2423244234 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5556e43ac7a0 con 0x5556e3fc21b0 2024-09-21T03:49:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.573+0000 7f144e7fc640 1 -- 172.21.15.84:0/2423244234 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14600035f0 con 0x5556e3fc21b0 2024-09-21T03:49:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.573+0000 7f144e7fc640 1 -- 172.21.15.84:0/2423244234 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1460026030 con 0x5556e3fc21b0 2024-09-21T03:49:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.573+0000 7f1473848740 10 client.16773 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:49:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.573+0000 7f1473848740 10 client.16773 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:49:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.573+0000 7f1473848740 20 client.16773 populate_metadata read hostname 'smithi084' 2024-09-21T03:49:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.573+0000 7f1473848740 1 --2- 172.21.15.84:0/2423244234 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5556e3fa99f0 0x5556e43afb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.573+0000 7f1473848740 4 client.16773 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:49:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.573+0000 7f1473848740 1 -- 172.21.15.84:0/2423244234 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556e430adf0 con 0x5556e3fa99f0 2024-09-21T03:49:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.574+0000 7f14667fc640 1 --2- 172.21.15.84:0/2423244234 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5556e3fa99f0 0x5556e43afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:54.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.574+0000 7f144e7fc640 10 client.16773 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:49:54.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.574+0000 7f14667fc640 1 --2- 172.21.15.84:0/2423244234 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5556e3fa99f0 0x5556e43afb00 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4d0ca32e3d290aed server_cookie=903fffbff2618d02 in_seq=0 out_seq=0 2024-09-21T03:49:54.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.575+0000 7f144e7fc640 1 -- 172.21.15.84:0/2423244234 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5556e430adf0 con 0x5556e3fa99f0 2024-09-21T03:49:54.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.575+0000 7f144e7fc640 10 client.16773 handle_command_reply: tid=0 2024-09-21T03:49:54.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.575+0000 7f1473848740 1 client.16773 shutdown 2024-09-21T03:49:54.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.575+0000 7f1473848740 1 -- 172.21.15.84:0/2423244234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fc21b0 msgr2=0x5556e439da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:54.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.575+0000 7f1473848740 1 --2- 172.21.15.84:0/2423244234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fc21b0 0x5556e439da30 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f146000d010 tx=0x7f1460003d10 comp rx=0 tx=0).stop 2024-09-21T03:49:54.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.575+0000 7f1473848740 1 -- 172.21.15.84:0/2423244234 shutdown_connections 2024-09-21T03:49:54.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.575+0000 7f1473848740 1 --2- 172.21.15.84:0/2423244234 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5556e3fa99f0 0x5556e43afb00 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.575+0000 7f144e7fc640 0 client.16773 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:49:54.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.575+0000 7f1473848740 1 --2- 172.21.15.84:0/2423244234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5556e3feb070 0x5556e43a9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.575+0000 7f1473848740 1 --2- 172.21.15.84:0/2423244234 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fca390 0x5556e439df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.575+0000 7f1473848740 1 --2- 172.21.15.84:0/2423244234 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fc21b0 0x5556e439da30 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.575+0000 7f1473848740 1 -- 172.21.15.84:0/2423244234 >> 172.21.15.84:0/2423244234 conn(0x5556e3fdf460 msgr2=0x5556e43954a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:54.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.575+0000 7f1473848740 1 -- 172.21.15.84:0/2423244234 shutdown_connections 2024-09-21T03:49:54.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.575+0000 7f1473848740 1 -- 172.21.15.84:0/2423244234 wait complete. 2024-09-21T03:49:54.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.575+0000 7f1473848740 20 client.16773 trim_cache size 0 max 16384 2024-09-21T03:49:54.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.588+0000 7f1473848740 1 Processor -- start 2024-09-21T03:49:54.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.588+0000 7f1473848740 1 -- start start 2024-09-21T03:49:54.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.588+0000 7f1473848740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fa99f0 0x5556e4393a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:54.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.588+0000 7f1473848740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fc21b0 0x5556e43a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:54.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.588+0000 7f1473848740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5556e3fca390 0x5556e439ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:54.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.588+0000 7f1473848740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f14681b4070 con 0x5556e3fa99f0 2024-09-21T03:49:54.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.588+0000 7f1473848740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f14681b1940 con 0x5556e3fca390 2024-09-21T03:49:54.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.588+0000 7f1473848740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f14681af7b0 con 0x5556e3fc21b0 2024-09-21T03:49:54.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.589+0000 7f14677fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fa99f0 0x5556e4393a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:54.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.589+0000 7f14677fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fa99f0 0x5556e4393a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57530/0 (socket says 172.21.15.84:57530) 2024-09-21T03:49:54.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.589+0000 7f14677fe640 1 -- 172.21.15.84:0/1407019605 learned_addr learned my addr 172.21.15.84:0/1407019605 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:54.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.589+0000 7f14667fc640 1 --2- 172.21.15.84:0/1407019605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fc21b0 0x5556e43a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:54.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.589+0000 7f14677fe640 1 --2- 172.21.15.84:0/1407019605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5556e3fca390 0x5556e439ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:54.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.589+0000 7f14677fe640 1 -- 172.21.15.84:0/1407019605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fc21b0 msgr2=0x5556e43a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:54.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.589+0000 7f14677fe640 1 --2- 172.21.15.84:0/1407019605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fc21b0 0x5556e43a9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.589+0000 7f14677fe640 1 -- 172.21.15.84:0/1407019605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5556e3fca390 msgr2=0x5556e439ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:54.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.589+0000 7f14677fe640 1 --2- 172.21.15.84:0/1407019605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5556e3fca390 0x5556e439ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.589+0000 7f14677fe640 1 -- 172.21.15.84:0/1407019605 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556e43a0010 con 0x5556e3fa99f0 2024-09-21T03:49:54.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.589+0000 7f14677fe640 1 --2- 172.21.15.84:0/1407019605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fa99f0 0x5556e4393a00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f146000a970 tx=0x7f146000a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3447ed0feb1e06b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:54.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.589+0000 7f145cff9640 1 -- 172.21.15.84:0/1407019605 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146000f6a0 con 0x5556e3fa99f0 2024-09-21T03:49:54.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.589+0000 7f145cff9640 1 -- 172.21.15.84:0/1407019605 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f146001d030 con 0x5556e3fa99f0 2024-09-21T03:49:54.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.589+0000 7f145cff9640 1 -- 172.21.15.84:0/1407019605 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146000fc00 con 0x5556e3fa99f0 2024-09-21T03:49:54.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.590+0000 7f1473848740 1 -- 172.21.15.84:0/1407019605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fa99f0 msgr2=0x5556e4393a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:54.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.590+0000 7f1473848740 1 --2- 172.21.15.84:0/1407019605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fa99f0 0x5556e4393a00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f146000a970 tx=0x7f146000a2a0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.590+0000 7f1473848740 1 -- 172.21.15.84:0/1407019605 shutdown_connections 2024-09-21T03:49:54.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.590+0000 7f1473848740 1 --2- 172.21.15.84:0/1407019605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5556e3fca390 0x5556e439ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.590+0000 7f1473848740 1 --2- 172.21.15.84:0/1407019605 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fc21b0 0x5556e43a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.590+0000 7f1473848740 1 --2- 172.21.15.84:0/1407019605 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fa99f0 0x5556e4393a00 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.590+0000 7f1473848740 1 -- 172.21.15.84:0/1407019605 >> 172.21.15.84:0/1407019605 conn(0x5556e3fdf460 msgr2=0x5556e43932f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:54.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.590+0000 7f1473848740 1 -- 172.21.15.84:0/1407019605 shutdown_connections 2024-09-21T03:49:54.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.590+0000 7f1473848740 1 -- 172.21.15.84:0/1407019605 wait complete. 2024-09-21T03:49:54.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.591+0000 7f1473848740 1 -- start start 2024-09-21T03:49:54.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.591+0000 7f1473848740 1 Processor -- start 2024-09-21T03:49:54.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.591+0000 7f1473848740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5556e3fa99f0 0x5556e43b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:54.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.591+0000 7f1473848740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fc21b0 0x5556e43b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:54.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.591+0000 7f1473848740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fca390 0x5556e4419280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:54.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.591+0000 7f1473848740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f14681afe00 con 0x5556e3fca390 2024-09-21T03:49:54.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.591+0000 7f1473848740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f14681b1270 con 0x5556e3fa99f0 2024-09-21T03:49:54.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.591+0000 7f1473848740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f14681b04d0 con 0x5556e3fc21b0 2024-09-21T03:49:54.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.591+0000 7f1473848740 10 client.0 _ll_register_callbacks cb 0x7f145810c560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:49:54.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.591+0000 7f14677fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fca390 0x5556e4419280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:54.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.591+0000 7f14677fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fca390 0x5556e4419280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57534/0 (socket says 172.21.15.84:57534) 2024-09-21T03:49:54.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.591+0000 7f14677fe640 1 -- 172.21.15.84:0/1597745313 learned_addr learned my addr 172.21.15.84:0/1597745313 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:54.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.591+0000 7f14677fe640 1 --2- 172.21.15.84:0/1597745313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5556e3fa99f0 0x5556e43b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:54.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.591+0000 7f14667fc640 1 --2- 172.21.15.84:0/1597745313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fc21b0 0x5556e43b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:54.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.591+0000 7f14677fe640 1 -- 172.21.15.84:0/1597745313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fc21b0 msgr2=0x5556e43b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:54.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.591+0000 7f14677fe640 1 --2- 172.21.15.84:0/1597745313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fc21b0 0x5556e43b14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.591+0000 7f14677fe640 1 -- 172.21.15.84:0/1597745313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5556e3fa99f0 msgr2=0x5556e43b0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:54.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.591+0000 7f14677fe640 1 --2- 172.21.15.84:0/1597745313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5556e3fa99f0 0x5556e43b0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.591+0000 7f14677fe640 1 -- 172.21.15.84:0/1597745313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556e44197c0 con 0x5556e3fca390 2024-09-21T03:49:54.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.592+0000 7f14677fe640 1 --2- 172.21.15.84:0/1597745313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fca390 0x5556e4419280 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f146000cf50 tx=0x7f1460032040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0a8f58786a8621 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:54.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.592+0000 7f144e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:49:54.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.592+0000 7f144e7fc640 1 -- 172.21.15.84:0/1597745313 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460003d70 con 0x5556e3fca390 2024-09-21T03:49:54.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.592+0000 7f144e7fc640 1 -- 172.21.15.84:0/1597745313 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f146000f9a0 con 0x5556e3fca390 2024-09-21T03:49:54.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.592+0000 7f1473848740 1 -- 172.21.15.84:0/1597745313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f146001d030 con 0x5556e3fca390 2024-09-21T03:49:54.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.592+0000 7f144e7fc640 1 -- 172.21.15.84:0/1597745313 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f146000fba0 con 0x5556e3fca390 2024-09-21T03:49:54.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.592+0000 7f1473848740 10 client.16779 fetch_fsmap learned FSMap version 25 2024-09-21T03:49:54.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.592+0000 7f1473848740 1 -- 172.21.15.84:0/1597745313 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5556e441a910 con 0x5556e3fca390 2024-09-21T03:49:54.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.592+0000 7f144e7fc640 1 -- 172.21.15.84:0/1597745313 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f146001d030 con 0x5556e3fca390 2024-09-21T03:49:54.600 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.592+0000 7f144e7fc640 1 -- 172.21.15.84:0/1597745313 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1460026050 con 0x5556e3fca390 2024-09-21T03:49:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.592+0000 7f1473848740 10 client.16779 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:49:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.592+0000 7f1473848740 10 client.16779 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:49:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.592+0000 7f1473848740 20 client.16779 populate_metadata read hostname 'smithi084' 2024-09-21T03:49:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.592+0000 7f1473848740 1 --2- 172.21.15.84:0/1597745313 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5556e3feb070 0x5556e441ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.592+0000 7f1473848740 4 client.16779 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:49:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.592+0000 7f1473848740 1 -- 172.21.15.84:0/1597745313 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5556e43068a0 con 0x5556e3feb070 2024-09-21T03:49:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.593+0000 7f14667fc640 1 --2- 172.21.15.84:0/1597745313 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5556e3feb070 0x5556e441ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.593+0000 7f144e7fc640 10 client.16779 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:49:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.593+0000 7f14667fc640 1 --2- 172.21.15.84:0/1597745313 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5556e3feb070 0x5556e441ce80 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=58d541794e277b57 server_cookie=97d6a4d03a64bd10 in_seq=0 out_seq=0 2024-09-21T03:49:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.593+0000 7f144e7fc640 1 -- 172.21.15.84:0/1597745313 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5556e43068a0 con 0x5556e3feb070 2024-09-21T03:49:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.593+0000 7f144e7fc640 10 client.16779 handle_command_reply: tid=0 2024-09-21T03:49:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.593+0000 7f1473848740 1 client.16779 shutdown 2024-09-21T03:49:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.593+0000 7f1473848740 1 -- 172.21.15.84:0/1597745313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fca390 msgr2=0x5556e4419280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.593+0000 7f1473848740 1 --2- 172.21.15.84:0/1597745313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fca390 0x5556e4419280 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f146000cf50 tx=0x7f1460032040 comp rx=0 tx=0).stop 2024-09-21T03:49:54.601 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.593+0000 7f1473848740 1 -- 172.21.15.84:0/1597745313 shutdown_connections 2024-09-21T03:49:54.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.593+0000 7f1473848740 1 --2- 172.21.15.84:0/1597745313 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5556e3feb070 0x5556e441ce80 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.593+0000 7f1473848740 1 --2- 172.21.15.84:0/1597745313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5556e3fca390 0x5556e4419280 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.593+0000 7f1473848740 1 --2- 172.21.15.84:0/1597745313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5556e3fc21b0 0x5556e43b14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.593+0000 7f1473848740 1 --2- 172.21.15.84:0/1597745313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5556e3fa99f0 0x5556e43b0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.594+0000 7f1473848740 1 -- 172.21.15.84:0/1597745313 >> 172.21.15.84:0/1597745313 conn(0x5556e3fdf460 msgr2=0x5556e4395b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:54.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.594+0000 7f144e7fc640 0 client.16779 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:49:54.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.594+0000 7f1473848740 1 -- 172.21.15.84:0/1597745313 shutdown_connections 2024-09-21T03:49:54.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.594+0000 7f1473848740 1 -- 172.21.15.84:0/1597745313 wait complete. 2024-09-21T03:49:54.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.594+0000 7f1473848740 20 client.16779 trim_cache size 0 max 16384 2024-09-21T03:49:54.602 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:49:54.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.594+0000 7f146d2d4640 1 -- 172.21.15.84:0/4000311418 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f14540b6680 msgr2=0x7f14540b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:54.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.594+0000 7f146d2d4640 1 --2- 172.21.15.84:0/4000311418 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f14540b6680 0x7f14540b8b90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f14581062b0 tx=0x7f145810c690 comp rx=0 tx=0).stop 2024-09-21T03:49:54.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.594+0000 7f146d2d4640 1 -- 172.21.15.84:0/4000311418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468102030 msgr2=0x7f1468102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:54.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.594+0000 7f146d2d4640 1 --2- 172.21.15.84:0/4000311418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468102030 0x7f1468102fd0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f1458006010 tx=0x7f14580319f0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.594+0000 7f146d2d4640 1 -- 172.21.15.84:0/4000311418 shutdown_connections 2024-09-21T03:49:54.603 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.594+0000 7f146d2d4640 1 --2- 172.21.15.84:0/4000311418 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f14540b6680 0x7f14540b8b90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.594+0000 7f146d2d4640 1 --2- 172.21.15.84:0/4000311418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1468106bd0 0x7f1468103a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.594+0000 7f146d2d4640 1 --2- 172.21.15.84:0/4000311418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1468106280 0x7f1468103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.594+0000 7f146d2d4640 1 --2- 172.21.15.84:0/4000311418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1468102030 0x7f1468102fd0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:54.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.594+0000 7f146d2d4640 1 -- 172.21.15.84:0/4000311418 >> 172.21.15.84:0/4000311418 conn(0x7f1468077c60 msgr2=0x7f1468107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:54.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.594+0000 7f146d2d4640 1 -- 172.21.15.84:0/4000311418 shutdown_connections 2024-09-21T03:49:54.604 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:54.594+0000 7f146d2d4640 1 -- 172.21.15.84:0/4000311418 wait complete. 2024-09-21T03:49:54.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:54 smithi084 ceph-mon[30941]: pgmap v549: 97 pgs: 97 active+clean; 13 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 12 op/s 2024-09-21T03:49:54.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:54 smithi174 ceph-mon[34403]: pgmap v549: 97 pgs: 97 active+clean; 13 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 12 op/s 2024-09-21T03:49:54.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:54 smithi172 ceph-mon[34821]: pgmap v549: 97 pgs: 97 active+clean; 13 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 12 op/s 2024-09-21T03:49:55.384 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:49:55.649 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:49:56.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.153+0000 7f82a2445640 1 -- 172.21.15.84:0/2296112657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f829c1083b0 msgr2=0x7f829c1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:56.165 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.153+0000 7f82a2445640 1 --2- 172.21.15.84:0/2296112657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f829c1083b0 0x7f829c1087c0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f8290009900 tx=0x7f829002a410 comp rx=0 tx=0).stop 2024-09-21T03:49:56.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.154+0000 7f82a2445640 1 -- 172.21.15.84:0/2296112657 shutdown_connections 2024-09-21T03:49:56.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.154+0000 7f82a2445640 1 --2- 172.21.15.84:0/2296112657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f829c108d00 0x7f829c10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.154+0000 7f82a2445640 1 --2- 172.21.15.84:0/2296112657 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f829c1083b0 0x7f829c1087c0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.154+0000 7f82a2445640 1 --2- 172.21.15.84:0/2296112657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f829c102a70 0x7f829c102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.154+0000 7f82a2445640 1 -- 172.21.15.84:0/2296112657 >> 172.21.15.84:0/2296112657 conn(0x7f829c079710 msgr2=0x7f829c079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:56.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.154+0000 7f82a2445640 1 -- 172.21.15.84:0/2296112657 shutdown_connections 2024-09-21T03:49:56.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.154+0000 7f82a2445640 1 -- 172.21.15.84:0/2296112657 wait complete. 2024-09-21T03:49:56.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.154+0000 7f82a2445640 1 Processor -- start 2024-09-21T03:49:56.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.154+0000 7f82a2445640 1 -- start start 2024-09-21T03:49:56.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.155+0000 7f82a2445640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f829c102a70 0x7f829c1993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:56.166 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.155+0000 7f82a2445640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f829c1083b0 0x7f829c199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:56.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.155+0000 7f82a2445640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f829c108d00 0x7f829c19ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:56.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.155+0000 7f82a2445640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f829c1129c0 con 0x7f829c108d00 2024-09-21T03:49:56.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.155+0000 7f82a2445640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f829c112840 con 0x7f829c1083b0 2024-09-21T03:49:56.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.155+0000 7f82a2445640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f829c112b40 con 0x7f829c102a70 2024-09-21T03:49:56.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.155+0000 7f82a09e2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f829c108d00 0x7f829c19ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:56.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.155+0000 7f82a09e2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f829c108d00 0x7f829c19ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57546/0 (socket says 172.21.15.84:57546) 2024-09-21T03:49:56.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.155+0000 7f829bfff640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f829c102a70 0x7f829c1993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:56.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.155+0000 7f82a09e2640 1 -- 172.21.15.84:0/2851074488 learned_addr learned my addr 172.21.15.84:0/2851074488 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:56.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.155+0000 7f829b7fe640 1 --2- 172.21.15.84:0/2851074488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f829c1083b0 0x7f829c199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:56.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.155+0000 7f82a09e2640 1 -- 172.21.15.84:0/2851074488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f829c102a70 msgr2=0x7f829c1993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:56.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.155+0000 7f82a09e2640 1 --2- 172.21.15.84:0/2851074488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f829c102a70 0x7f829c1993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.155+0000 7f82a09e2640 1 -- 172.21.15.84:0/2851074488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f829c1083b0 msgr2=0x7f829c199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:56.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.155+0000 7f82a09e2640 1 --2- 172.21.15.84:0/2851074488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f829c1083b0 0x7f829c199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.155+0000 7f82a09e2640 1 -- 172.21.15.84:0/2851074488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829c19f360 con 0x7f829c108d00 2024-09-21T03:49:56.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.156+0000 7f82a09e2640 1 --2- 172.21.15.84:0/2851074488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f829c108d00 0x7f829c19ec30 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f829400cad0 tx=0x7f829400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:56.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.156+0000 7f82997fa640 1 -- 172.21.15.84:0/2851074488 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829400ae20 con 0x7f829c108d00 2024-09-21T03:49:56.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.156+0000 7f82997fa640 1 -- 172.21.15.84:0/2851074488 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8294005020 con 0x7f829c108d00 2024-09-21T03:49:56.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.156+0000 7f82a2445640 1 -- 172.21.15.84:0/2851074488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829c19f650 con 0x7f829c108d00 2024-09-21T03:49:56.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.156+0000 7f82997fa640 1 -- 172.21.15.84:0/2851074488 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829400f6b0 con 0x7f829c108d00 2024-09-21T03:49:56.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.156+0000 7f82a2445640 1 -- 172.21.15.84:0/2851074488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f829c1a5db0 con 0x7f829c108d00 2024-09-21T03:49:56.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.159+0000 7f82a89b9740 1 Processor -- start 2024-09-21T03:49:56.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.159+0000 7f82997fa640 1 -- 172.21.15.84:0/2851074488 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f8294004b20 con 0x7f829c108d00 2024-09-21T03:49:56.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.159+0000 7f82a89b9740 1 -- start start 2024-09-21T03:49:56.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f82a89b9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb8f070 0x55d66ef366a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:56.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f82a89b9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d66eb661b0 0x55d66ef36be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:56.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f82a89b9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 0x55d66ef37120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:56.168 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f82a89b9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d66eeacea0 con 0x55d66eb8f070 2024-09-21T03:49:56.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f82a89b9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d66ee9c2d0 con 0x55d66eb661b0 2024-09-21T03:49:56.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f82a89b9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d66eea00e0 con 0x55d66eb6e390 2024-09-21T03:49:56.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f829b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb8f070 0x55d66ef366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:56.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f829b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb8f070 0x55d66ef366a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57560/0 (socket says 172.21.15.84:57560) 2024-09-21T03:49:56.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f829b7fe640 1 -- 172.21.15.84:0/69622011 learned_addr learned my addr 172.21.15.84:0/69622011 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:56.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f829bfff640 1 --2- 172.21.15.84:0/69622011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d66eb661b0 0x55d66ef36be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:56.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f829b7fe640 1 --2- 172.21.15.84:0/69622011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 0x55d66ef37120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:56.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f82997fa640 1 --2- 172.21.15.84:0/2851074488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f82840b6680 0x7f82840b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:56.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f829b7fe640 1 -- 172.21.15.84:0/69622011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 msgr2=0x55d66ef37120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:56.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f829b7fe640 1 --2- 172.21.15.84:0/69622011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 0x55d66ef37120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f829b7fe640 1 -- 172.21.15.84:0/69622011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d66eb661b0 msgr2=0x55d66ef36be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:56.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f829b7fe640 1 --2- 172.21.15.84:0/69622011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d66eb661b0 0x55d66ef36be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f829b7fe640 1 -- 172.21.15.84:0/69622011 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d66ebfa650 con 0x55d66eb8f070 2024-09-21T03:49:56.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f829bfff640 1 --2- 172.21.15.84:0/69622011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d66eb661b0 0x55d66ef36be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:49:56.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f82a09e2640 1 --2- 172.21.15.84:0/2851074488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f82840b6680 0x7f82840b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:56.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f829b7fe640 1 --2- 172.21.15.84:0/69622011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb8f070 0x55d66ef366a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f8290005ab0 tx=0x7f8290005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880fb95a60673ac5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:56.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.160+0000 7f82997fa640 1 -- 172.21.15.84:0/2851074488 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f82940e7770 con 0x7f829c108d00 2024-09-21T03:49:56.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.161+0000 7f82827fc640 1 -- 172.21.15.84:0/69622011 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8290035050 con 0x55d66eb8f070 2024-09-21T03:49:56.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.161+0000 7f82827fc640 1 -- 172.21.15.84:0/69622011 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82900316f0 con 0x55d66eb8f070 2024-09-21T03:49:56.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.161+0000 7f82827fc640 1 -- 172.21.15.84:0/69622011 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82900046c0 con 0x55d66eb8f070 2024-09-21T03:49:56.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.161+0000 7f82a89b9740 1 -- 172.21.15.84:0/69622011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb8f070 msgr2=0x55d66ef366a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:56.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.161+0000 7f82a09e2640 1 --2- 172.21.15.84:0/2851074488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f82840b6680 0x7f82840b8b90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f82940aa820 tx=0x7f82940760d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:56.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.161+0000 7f82a89b9740 1 --2- 172.21.15.84:0/69622011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb8f070 0x55d66ef366a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f8290005ab0 tx=0x7f8290005a20 comp rx=0 tx=0).stop 2024-09-21T03:49:56.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.161+0000 7f82a89b9740 1 -- 172.21.15.84:0/69622011 shutdown_connections 2024-09-21T03:49:56.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.161+0000 7f82a89b9740 1 --2- 172.21.15.84:0/69622011 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 0x55d66ef37120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.161+0000 7f82a89b9740 1 --2- 172.21.15.84:0/69622011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d66eb661b0 0x55d66ef36be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.161+0000 7f82a89b9740 1 --2- 172.21.15.84:0/69622011 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb8f070 0x55d66ef366a0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.162+0000 7f82a89b9740 1 -- 172.21.15.84:0/69622011 >> 172.21.15.84:0/69622011 conn(0x55d66eb83460 msgr2=0x55d66ef34590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:56.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.162+0000 7f82a89b9740 1 -- 172.21.15.84:0/69622011 shutdown_connections 2024-09-21T03:49:56.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.162+0000 7f82a89b9740 1 -- 172.21.15.84:0/69622011 wait complete. 2024-09-21T03:49:56.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.162+0000 7f82a89b9740 1 -- start start 2024-09-21T03:49:56.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.162+0000 7f82a89b9740 1 Processor -- start 2024-09-21T03:49:56.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.162+0000 7f82a89b9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 0x55d66ef43f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:56.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.162+0000 7f82a89b9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 0x55d66ef444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:56.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.162+0000 7f82a89b9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d66eb8f070 0x55d66ef502e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:56.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.163+0000 7f82a89b9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d66ecfd700 con 0x55d66eb661b0 2024-09-21T03:49:56.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.163+0000 7f82a89b9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d66ee37160 con 0x55d66eb8f070 2024-09-21T03:49:56.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.163+0000 7f82a89b9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d66ef46f80 con 0x55d66eb6e390 2024-09-21T03:49:56.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.163+0000 7f82a89b9740 10 client.0 _ll_register_callbacks cb 0x55d66ee509e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:49:56.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.163+0000 7f829b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 0x55d66ef43f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:56.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.163+0000 7f829b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 0x55d66ef43f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57566/0 (socket says 172.21.15.84:57566) 2024-09-21T03:49:56.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.163+0000 7f829b7fe640 1 -- 172.21.15.84:0/1164602943 learned_addr learned my addr 172.21.15.84:0/1164602943 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:56.172 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.163+0000 7f829bfff640 1 --2- 172.21.15.84:0/1164602943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 0x55d66ef444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:56.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.164+0000 7f829bfff640 1 -- 172.21.15.84:0/1164602943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d66eb8f070 msgr2=0x55d66ef502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:56.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.164+0000 7f829bfff640 1 --2- 172.21.15.84:0/1164602943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d66eb8f070 0x55d66ef502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.164+0000 7f829bfff640 1 -- 172.21.15.84:0/1164602943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 msgr2=0x55d66ef43f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:56.174 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.164+0000 7f829bfff640 1 --2- 172.21.15.84:0/1164602943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 0x55d66ef43f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.164+0000 7f829bfff640 1 -- 172.21.15.84:0/1164602943 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d66ee64c90 con 0x55d66eb6e390 2024-09-21T03:49:56.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.164+0000 7f829b7fe640 1 --2- 172.21.15.84:0/1164602943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 0x55d66ef43f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:49:56.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.164+0000 7f829bfff640 1 --2- 172.21.15.84:0/1164602943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 0x55d66ef444c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f828c005fd0 tx=0x7f828c00be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64264457880a36c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:56.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.164+0000 7f827b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-21T03:49:56.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.164+0000 7f827b7fe640 1 -- 172.21.15.84:0/1164602943 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c003ea0 con 0x55d66eb6e390 2024-09-21T03:49:56.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.164+0000 7f82a89b9740 1 -- 172.21.15.84:0/1164602943 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82900316f0 con 0x55d66eb6e390 2024-09-21T03:49:56.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.164+0000 7f827b7fe640 1 -- 172.21.15.84:0/1164602943 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f828c011440 con 0x55d66eb6e390 2024-09-21T03:49:56.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.164+0000 7f827b7fe640 1 -- 172.21.15.84:0/1164602943 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f828c01b640 con 0x55d66eb6e390 2024-09-21T03:49:56.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.164+0000 7f82a89b9740 10 client.25933 fetch_fsmap learned FSMap version 25 2024-09-21T03:49:56.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.164+0000 7f82a89b9740 1 -- 172.21.15.84:0/1164602943 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d66ef52d90 con 0x55d66eb6e390 2024-09-21T03:49:56.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.165+0000 7f827b7fe640 1 -- 172.21.15.84:0/1164602943 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82900316f0 con 0x55d66eb6e390 2024-09-21T03:49:56.175 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.165+0000 7f827b7fe640 1 -- 172.21.15.84:0/1164602943 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f828c019020 con 0x55d66eb6e390 2024-09-21T03:49:56.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.165+0000 7f82a89b9740 10 client.25933 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:49:56.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.165+0000 7f82a89b9740 10 client.25933 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:49:56.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.165+0000 7f82a89b9740 20 client.25933 populate_metadata read hostname 'smithi084' 2024-09-21T03:49:56.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.165+0000 7f82a89b9740 1 --2- 172.21.15.84:0/1164602943 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55d66eb4d9f0 0x55d66ef56240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:56.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.165+0000 7f82a89b9740 4 client.25933 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:49:56.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.165+0000 7f82a89b9740 1 -- 172.21.15.84:0/1164602943 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d66eeaedf0 con 0x55d66eb4d9f0 2024-09-21T03:49:56.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.165+0000 7f829b7fe640 1 --2- 172.21.15.84:0/1164602943 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55d66eb4d9f0 0x55d66ef56240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:56.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.166+0000 7f827b7fe640 10 client.25933 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:49:56.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.166+0000 7f829b7fe640 1 --2- 172.21.15.84:0/1164602943 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55d66eb4d9f0 0x55d66ef56240 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6e219745862003cd server_cookie=8f492044d6a90177 in_seq=0 out_seq=0 2024-09-21T03:49:56.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.167+0000 7f827b7fe640 1 -- 172.21.15.84:0/1164602943 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d66eeaedf0 con 0x55d66eb4d9f0 2024-09-21T03:49:56.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.167+0000 7f827b7fe640 10 client.25933 handle_command_reply: tid=0 2024-09-21T03:49:56.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.167+0000 7f82a89b9740 1 client.25933 shutdown 2024-09-21T03:49:56.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.167+0000 7f82a89b9740 1 -- 172.21.15.84:0/1164602943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 msgr2=0x55d66ef444c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:56.176 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.167+0000 7f82a89b9740 1 --2- 172.21.15.84:0/1164602943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 0x55d66ef444c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f828c005fd0 tx=0x7f828c00be20 comp rx=0 tx=0).stop 2024-09-21T03:49:56.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.167+0000 7f82a89b9740 1 -- 172.21.15.84:0/1164602943 shutdown_connections 2024-09-21T03:49:56.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.167+0000 7f82a89b9740 1 --2- 172.21.15.84:0/1164602943 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55d66eb4d9f0 0x55d66ef56240 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.167+0000 7f82a89b9740 1 --2- 172.21.15.84:0/1164602943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d66eb8f070 0x55d66ef502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.167+0000 7f82a89b9740 1 --2- 172.21.15.84:0/1164602943 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 0x55d66ef444c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.167+0000 7f827b7fe640 0 client.25933 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:49:56.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.167+0000 7f82a89b9740 1 --2- 172.21.15.84:0/1164602943 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 0x55d66ef43f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.167+0000 7f82a89b9740 1 -- 172.21.15.84:0/1164602943 >> 172.21.15.84:0/1164602943 conn(0x55d66eb83460 msgr2=0x55d66ef38090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:56.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.167+0000 7f82a89b9740 1 -- 172.21.15.84:0/1164602943 shutdown_connections 2024-09-21T03:49:56.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.167+0000 7f82a89b9740 1 -- 172.21.15.84:0/1164602943 wait complete. 2024-09-21T03:49:56.177 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.167+0000 7f82a89b9740 20 client.25933 trim_cache size 0 max 16384 2024-09-21T03:49:56.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.180+0000 7f82a89b9740 1 Processor -- start 2024-09-21T03:49:56.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.180+0000 7f82a89b9740 1 -- start start 2024-09-21T03:49:56.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.180+0000 7f82a89b9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 0x55d66ef501e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:56.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.180+0000 7f82a89b9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 0x55d66ef33eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:56.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.180+0000 7f82a89b9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d66eb8f070 0x55d66ef343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:56.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.180+0000 7f82a89b9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f829c1afbd0 con 0x55d66eb661b0 2024-09-21T03:49:56.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.180+0000 7f82a89b9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f829c1ad4a0 con 0x55d66eb8f070 2024-09-21T03:49:56.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.180+0000 7f82a89b9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f829c1ab310 con 0x55d66eb6e390 2024-09-21T03:49:56.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.180+0000 7f829b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 0x55d66ef501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:56.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.180+0000 7f829b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 0x55d66ef501e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57570/0 (socket says 172.21.15.84:57570) 2024-09-21T03:49:56.183 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.180+0000 7f829b7fe640 1 -- 172.21.15.84:0/3065723078 learned_addr learned my addr 172.21.15.84:0/3065723078 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:56.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.181+0000 7f829bfff640 1 --2- 172.21.15.84:0/3065723078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 0x55d66ef33eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:56.184 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.181+0000 7f829b7fe640 1 -- 172.21.15.84:0/3065723078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 msgr2=0x55d66ef33eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.181+0000 7f829b7fe640 1 --2- 172.21.15.84:0/3065723078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 0x55d66ef33eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.181+0000 7f829b7fe640 1 -- 172.21.15.84:0/3065723078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d66eb8f070 msgr2=0x55d66ef343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.181+0000 7f829b7fe640 1 --2- 172.21.15.84:0/3065723078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d66eb8f070 0x55d66ef343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.181+0000 7f829b7fe640 1 -- 172.21.15.84:0/3065723078 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d66ef42480 con 0x55d66eb661b0 2024-09-21T03:49:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.181+0000 7f829b7fe640 1 --2- 172.21.15.84:0/3065723078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 0x55d66ef501e0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f8290005f70 tx=0x7f8290009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f87fa075241d751 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.181+0000 7f8281ffb640 1 -- 172.21.15.84:0/3065723078 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8290035040 con 0x55d66eb661b0 2024-09-21T03:49:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.181+0000 7f8281ffb640 1 -- 172.21.15.84:0/3065723078 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8290050070 con 0x55d66eb661b0 2024-09-21T03:49:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.181+0000 7f8281ffb640 1 -- 172.21.15.84:0/3065723078 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8290003d50 con 0x55d66eb661b0 2024-09-21T03:49:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.182+0000 7f82a89b9740 1 -- 172.21.15.84:0/3065723078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 msgr2=0x55d66ef501e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.182+0000 7f82a89b9740 1 --2- 172.21.15.84:0/3065723078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 0x55d66ef501e0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f8290005f70 tx=0x7f8290009640 comp rx=0 tx=0).stop 2024-09-21T03:49:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.182+0000 7f82a89b9740 1 -- 172.21.15.84:0/3065723078 shutdown_connections 2024-09-21T03:49:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.182+0000 7f82a89b9740 1 --2- 172.21.15.84:0/3065723078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d66eb8f070 0x55d66ef343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.182+0000 7f82a89b9740 1 --2- 172.21.15.84:0/3065723078 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 0x55d66ef33eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.185 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.182+0000 7f82a89b9740 1 --2- 172.21.15.84:0/3065723078 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 0x55d66ef501e0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.182+0000 7f82a89b9740 1 -- 172.21.15.84:0/3065723078 >> 172.21.15.84:0/3065723078 conn(0x55d66eb83460 msgr2=0x55d66ef42800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:56.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.182+0000 7f82a89b9740 1 -- 172.21.15.84:0/3065723078 shutdown_connections 2024-09-21T03:49:56.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.182+0000 7f82a89b9740 1 -- 172.21.15.84:0/3065723078 wait complete. 2024-09-21T03:49:56.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.182+0000 7f82a89b9740 1 -- start start 2024-09-21T03:49:56.186 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.183+0000 7f82a89b9740 1 Processor -- start 2024-09-21T03:49:56.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.183+0000 7f82a89b9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 0x55d66ef4c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:56.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.183+0000 7f82a89b9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 0x55d66ef47c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:56.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.183+0000 7f82a89b9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d66eb8f070 0x55d66ef481b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:56.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.183+0000 7f82a89b9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f829c1ab960 con 0x55d66eb661b0 2024-09-21T03:49:56.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.183+0000 7f82a89b9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f829c1acdd0 con 0x55d66eb8f070 2024-09-21T03:49:56.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.183+0000 7f82a89b9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f829c1ac030 con 0x55d66eb6e390 2024-09-21T03:49:56.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.183+0000 7f82a89b9740 10 client.0 _ll_register_callbacks cb 0x7f828c004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:49:56.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.183+0000 7f829b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 0x55d66ef4c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:56.189 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.183+0000 7f829b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 0x55d66ef4c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57582/0 (socket says 172.21.15.84:57582) 2024-09-21T03:49:56.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.183+0000 7f829b7fe640 1 -- 172.21.15.84:0/2341868927 learned_addr learned my addr 172.21.15.84:0/2341868927 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:56.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.183+0000 7f829bfff640 1 --2- 172.21.15.84:0/2341868927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 0x55d66ef47c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:56.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.183+0000 7f829b7fe640 1 -- 172.21.15.84:0/2341868927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 msgr2=0x55d66ef47c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:56.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.183+0000 7f829b7fe640 1 --2- 172.21.15.84:0/2341868927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 0x55d66ef47c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.183+0000 7f829b7fe640 1 -- 172.21.15.84:0/2341868927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d66eb8f070 msgr2=0x55d66ef481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:56.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.183+0000 7f829b7fe640 1 --2- 172.21.15.84:0/2341868927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d66eb8f070 0x55d66ef481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.183+0000 7f829b7fe640 1 -- 172.21.15.84:0/2341868927 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d66ef486f0 con 0x55d66eb661b0 2024-09-21T03:49:56.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.183+0000 7f829bfff640 1 --2- 172.21.15.84:0/2341868927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 0x55d66ef47c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:49:56.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.184+0000 7f829b7fe640 1 --2- 172.21.15.84:0/2341868927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 0x55d66ef4c7c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f8290033000 tx=0x7f8290031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79cf93806e7d29d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:56.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.184+0000 7f827b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:49:56.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.184+0000 7f827b7fe640 1 -- 172.21.15.84:0/2341868927 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8290035040 con 0x55d66eb661b0 2024-09-21T03:49:56.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.184+0000 7f827b7fe640 1 -- 172.21.15.84:0/2341868927 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f82900042c0 con 0x55d66eb661b0 2024-09-21T03:49:56.190 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.184+0000 7f82a89b9740 1 -- 172.21.15.84:0/2341868927 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8290050070 con 0x55d66eb661b0 2024-09-21T03:49:56.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.184+0000 7f827b7fe640 1 -- 172.21.15.84:0/2341868927 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f82900044c0 con 0x55d66eb661b0 2024-09-21T03:49:56.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.184+0000 7f82a89b9740 10 client.16797 fetch_fsmap learned FSMap version 25 2024-09-21T03:49:56.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.184+0000 7f82a89b9740 1 -- 172.21.15.84:0/2341868927 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d66efc0910 con 0x55d66eb661b0 2024-09-21T03:49:56.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.184+0000 7f827b7fe640 1 -- 172.21.15.84:0/2341868927 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8290050070 con 0x55d66eb661b0 2024-09-21T03:49:56.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.184+0000 7f827b7fe640 1 -- 172.21.15.84:0/2341868927 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f829003a9e0 con 0x55d66eb661b0 2024-09-21T03:49:56.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.184+0000 7f82a89b9740 10 client.16797 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:49:56.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.184+0000 7f82a89b9740 10 client.16797 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:49:56.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.184+0000 7f82a89b9740 20 client.16797 populate_metadata read hostname 'smithi084' 2024-09-21T03:49:56.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.184+0000 7f82a89b9740 1 --2- 172.21.15.84:0/2341868927 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55d66eb22da0 0x55d66efc2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:56.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.184+0000 7f82a89b9740 4 client.16797 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:49:56.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.184+0000 7f82a89b9740 1 -- 172.21.15.84:0/2341868927 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d66eeaa8a0 con 0x55d66eb22da0 2024-09-21T03:49:56.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.185+0000 7f829bfff640 1 --2- 172.21.15.84:0/2341868927 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55d66eb22da0 0x55d66efc2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:56.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.185+0000 7f827b7fe640 10 client.16797 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:49:56.191 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.185+0000 7f829bfff640 1 --2- 172.21.15.84:0/2341868927 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55d66eb22da0 0x55d66efc2be0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=25ed180b49d94ba server_cookie=6c507b4c7e5e045 in_seq=0 out_seq=0 2024-09-21T03:49:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.185+0000 7f827b7fe640 1 -- 172.21.15.84:0/2341868927 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d66eeaa8a0 con 0x55d66eb22da0 2024-09-21T03:49:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.185+0000 7f827b7fe640 10 client.16797 handle_command_reply: tid=0 2024-09-21T03:49:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.185+0000 7f82a89b9740 1 client.16797 shutdown 2024-09-21T03:49:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.186+0000 7f82a89b9740 1 -- 172.21.15.84:0/2341868927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 msgr2=0x55d66ef4c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.186+0000 7f82a89b9740 1 --2- 172.21.15.84:0/2341868927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 0x55d66ef4c7c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f8290033000 tx=0x7f8290031700 comp rx=0 tx=0).stop 2024-09-21T03:49:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.186+0000 7f82a89b9740 1 -- 172.21.15.84:0/2341868927 shutdown_connections 2024-09-21T03:49:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.186+0000 7f82a89b9740 1 --2- 172.21.15.84:0/2341868927 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55d66eb22da0 0x55d66efc2be0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.186+0000 7f82a89b9740 1 --2- 172.21.15.84:0/2341868927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d66eb8f070 0x55d66ef481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.186+0000 7f82a89b9740 1 --2- 172.21.15.84:0/2341868927 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d66eb6e390 0x55d66ef47c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.186+0000 7f82a89b9740 1 --2- 172.21.15.84:0/2341868927 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d66eb661b0 0x55d66ef4c7c0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.186+0000 7f82a89b9740 1 -- 172.21.15.84:0/2341868927 >> 172.21.15.84:0/2341868927 conn(0x55d66eb83460 msgr2=0x55d66ef33e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.186+0000 7f827b7fe640 0 client.16797 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:49:56.192 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.186+0000 7f82a89b9740 1 -- 172.21.15.84:0/2341868927 shutdown_connections 2024-09-21T03:49:56.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.186+0000 7f82a89b9740 1 -- 172.21.15.84:0/2341868927 wait complete. 2024-09-21T03:49:56.193 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.186+0000 7f82a89b9740 20 client.16797 trim_cache size 0 max 16384 2024-09-21T03:49:56.193 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:49:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.186+0000 7f82a2445640 1 -- 172.21.15.84:0/2851074488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f82840b6680 msgr2=0x7f82840b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.186+0000 7f82a2445640 1 --2- 172.21.15.84:0/2851074488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f82840b6680 0x7f82840b8b90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f82940aa820 tx=0x7f82940760d0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.186+0000 7f82a2445640 1 -- 172.21.15.84:0/2851074488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f829c108d00 msgr2=0x7f829c19ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.186+0000 7f82a2445640 1 --2- 172.21.15.84:0/2851074488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f829c108d00 0x7f829c19ec30 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f829400cad0 tx=0x7f829400cf90 comp rx=0 tx=0).stop 2024-09-21T03:49:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.187+0000 7f82a2445640 1 -- 172.21.15.84:0/2851074488 shutdown_connections 2024-09-21T03:49:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.187+0000 7f82a2445640 1 --2- 172.21.15.84:0/2851074488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f82840b6680 0x7f82840b8b90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.187+0000 7f82a2445640 1 --2- 172.21.15.84:0/2851074488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f829c108d00 0x7f829c19ec30 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.194 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.187+0000 7f82a2445640 1 --2- 172.21.15.84:0/2851074488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f829c1083b0 0x7f829c199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.187+0000 7f82a2445640 1 --2- 172.21.15.84:0/2851074488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f829c102a70 0x7f829c1993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:56.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.187+0000 7f82a2445640 1 -- 172.21.15.84:0/2851074488 >> 172.21.15.84:0/2851074488 conn(0x7f829c079710 msgr2=0x7f829c104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:56.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.187+0000 7f82a2445640 1 -- 172.21.15.84:0/2851074488 shutdown_connections 2024-09-21T03:49:56.195 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:56.187+0000 7f82a2445640 1 -- 172.21.15.84:0/2851074488 wait complete. 2024-09-21T03:49:56.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:56 smithi084 ceph-mon[30941]: pgmap v550: 97 pgs: 97 active+clean; 13 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-21T03:49:56.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:56 smithi174 ceph-mon[34403]: pgmap v550: 97 pgs: 97 active+clean; 13 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-21T03:49:56.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:56 smithi172 ceph-mon[34821]: pgmap v550: 97 pgs: 97 active+clean; 13 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-09-21T03:49:56.973 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:49:57.220 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:49:57.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.754+0000 7f3307397640 1 -- 172.21.15.84:0/596756948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3300102ae0 msgr2=0x7f3300102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:57.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.754+0000 7f3307397640 1 --2- 172.21.15.84:0/596756948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3300102ae0 0x7f3300102ef0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f32f4009900 tx=0x7f32f402a410 comp rx=0 tx=0).stop 2024-09-21T03:49:57.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.754+0000 7f3307397640 1 -- 172.21.15.84:0/596756948 shutdown_connections 2024-09-21T03:49:57.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.754+0000 7f3307397640 1 --2- 172.21.15.84:0/596756948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3300108d70 0x7f330010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.754+0000 7f3307397640 1 --2- 172.21.15.84:0/596756948 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3300108420 0x7f3300108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.774 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.754+0000 7f3307397640 1 --2- 172.21.15.84:0/596756948 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3300102ae0 0x7f3300102ef0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.754+0000 7f3307397640 1 -- 172.21.15.84:0/596756948 >> 172.21.15.84:0/596756948 conn(0x7f3300079770 msgr2=0x7f3300079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.754+0000 7f3307397640 1 -- 172.21.15.84:0/596756948 shutdown_connections 2024-09-21T03:49:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.754+0000 7f3307397640 1 -- 172.21.15.84:0/596756948 wait complete. 2024-09-21T03:49:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.755+0000 7f3307397640 1 Processor -- start 2024-09-21T03:49:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.755+0000 7f3307397640 1 -- start start 2024-09-21T03:49:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.755+0000 7f3307397640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3300102ae0 0x7f33001994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.755+0000 7f3307397640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3300108420 0x7f3300199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.755+0000 7f3307397640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3300108d70 0x7f330019ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.755+0000 7f3307397640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3300112a30 con 0x7f3300108d70 2024-09-21T03:49:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.755+0000 7f3307397640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f33001128b0 con 0x7f3300108420 2024-09-21T03:49:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.755+0000 7f3307397640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3300112bb0 con 0x7f3300102ae0 2024-09-21T03:49:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.755+0000 7f3305934640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3300108d70 0x7f330019ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.756+0000 7f3305934640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3300108d70 0x7f330019ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57590/0 (socket says 172.21.15.84:57590) 2024-09-21T03:49:57.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.756+0000 7f3305934640 1 -- 172.21.15.84:0/1175755630 learned_addr learned my addr 172.21.15.84:0/1175755630 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:57.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.756+0000 7f3305133640 1 --2- 172.21.15.84:0/1175755630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3300102ae0 0x7f33001994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:57.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.756+0000 7f3304932640 1 --2- 172.21.15.84:0/1175755630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3300108420 0x7f3300199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:57.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.756+0000 7f3305934640 1 -- 172.21.15.84:0/1175755630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3300102ae0 msgr2=0x7f33001994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:57.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.756+0000 7f3305934640 1 --2- 172.21.15.84:0/1175755630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3300102ae0 0x7f33001994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.756+0000 7f3305934640 1 -- 172.21.15.84:0/1175755630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3300108420 msgr2=0x7f3300199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:57.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.756+0000 7f3305934640 1 --2- 172.21.15.84:0/1175755630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3300108420 0x7f3300199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.756+0000 7f3305934640 1 -- 172.21.15.84:0/1175755630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330019f430 con 0x7f3300108d70 2024-09-21T03:49:57.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.756+0000 7f3305934640 1 --2- 172.21.15.84:0/1175755630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3300108d70 0x7f330019ed00 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f32f800eaa0 tx=0x7f32f800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:57.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.756+0000 7f32f27fc640 1 -- 172.21.15.84:0/1175755630 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f800cdb0 con 0x7f3300108d70 2024-09-21T03:49:57.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.756+0000 7f32f27fc640 1 -- 172.21.15.84:0/1175755630 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32f8005020 con 0x7f3300108d70 2024-09-21T03:49:57.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.756+0000 7f32f27fc640 1 -- 172.21.15.84:0/1175755630 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f80116d0 con 0x7f3300108d70 2024-09-21T03:49:57.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.756+0000 7f3307397640 1 -- 172.21.15.84:0/1175755630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f330019f720 con 0x7f3300108d70 2024-09-21T03:49:57.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.756+0000 7f3307397640 1 -- 172.21.15.84:0/1175755630 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33001a5e80 con 0x7f3300108d70 2024-09-21T03:49:57.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.759+0000 7f330d90b740 1 Processor -- start 2024-09-21T03:49:57.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.759+0000 7f32f27fc640 1 -- 172.21.15.84:0/1175755630 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f32f80051d0 con 0x7f3300108d70 2024-09-21T03:49:57.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.759+0000 7f330d90b740 1 -- start start 2024-09-21T03:49:57.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.760+0000 7f330d90b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d251205070 0x55d2515ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:57.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.760+0000 7f330d90b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2511dc1b0 0x55d2515ac800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:57.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.760+0000 7f330d90b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 0x55d2515acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:57.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.760+0000 7f330d90b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d251522ea0 con 0x55d2511e4390 2024-09-21T03:49:57.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.760+0000 7f330d90b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d2515122d0 con 0x55d251205070 2024-09-21T03:49:57.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.760+0000 7f330d90b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d2515160e0 con 0x55d2511dc1b0 2024-09-21T03:49:57.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.760+0000 7f3304932640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 0x55d2515acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:57.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.760+0000 7f3304932640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 0x55d2515acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57592/0 (socket says 172.21.15.84:57592) 2024-09-21T03:49:57.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.760+0000 7f3304932640 1 -- 172.21.15.84:0/1722216970 learned_addr learned my addr 172.21.15.84:0/1722216970 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:57.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.760+0000 7f3305133640 1 --2- 172.21.15.84:0/1722216970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2511dc1b0 0x55d2515ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:57.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.760+0000 7f3304932640 1 --2- 172.21.15.84:0/1722216970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d251205070 0x55d2515ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:57.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.760+0000 7f32f27fc640 1 --2- 172.21.15.84:0/1175755630 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f32ec0b6700 0x7f32ec0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:57.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.760+0000 7f3304932640 1 -- 172.21.15.84:0/1722216970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2511dc1b0 msgr2=0x55d2515ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:57.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.760+0000 7f3304932640 1 --2- 172.21.15.84:0/1722216970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2511dc1b0 0x55d2515ac800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.760+0000 7f3304932640 1 -- 172.21.15.84:0/1722216970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d251205070 msgr2=0x55d2515ac2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:57.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.760+0000 7f3304932640 1 --2- 172.21.15.84:0/1722216970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d251205070 0x55d2515ac2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.760+0000 7f3304932640 1 -- 172.21.15.84:0/1722216970 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d251270650 con 0x55d2511e4390 2024-09-21T03:49:57.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.760+0000 7f3305934640 1 --2- 172.21.15.84:0/1175755630 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f32ec0b6700 0x7f32ec0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:57.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.760+0000 7f3304932640 1 --2- 172.21.15.84:0/1722216970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 0x55d2515acd40 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0138b0 tx=0x7f32fc00b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35149956e2a916f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:57.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.760+0000 7f32f27fc640 1 -- 172.21.15.84:0/1175755630 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f32f80e77b0 con 0x7f3300108d70 2024-09-21T03:49:57.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.761+0000 7f32eb7fe640 1 -- 172.21.15.84:0/1722216970 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc005220 con 0x55d2511e4390 2024-09-21T03:49:57.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.761+0000 7f32eb7fe640 1 -- 172.21.15.84:0/1722216970 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32fc004c50 con 0x55d2511e4390 2024-09-21T03:49:57.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.761+0000 7f32eb7fe640 1 -- 172.21.15.84:0/1722216970 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc011780 con 0x55d2511e4390 2024-09-21T03:49:57.778 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.761+0000 7f330d90b740 1 -- 172.21.15.84:0/1722216970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 msgr2=0x55d2515acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:57.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.761+0000 7f3305934640 1 --2- 172.21.15.84:0/1175755630 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f32ec0b6700 0x7f32ec0b8c10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f32f80e5000 tx=0x7f32f8071be0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:57.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.761+0000 7f330d90b740 1 --2- 172.21.15.84:0/1722216970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 0x55d2515acd40 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0138b0 tx=0x7f32fc00b660 comp rx=0 tx=0).stop 2024-09-21T03:49:57.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.762+0000 7f330d90b740 1 -- 172.21.15.84:0/1722216970 shutdown_connections 2024-09-21T03:49:57.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.762+0000 7f330d90b740 1 --2- 172.21.15.84:0/1722216970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 0x55d2515acd40 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.762+0000 7f330d90b740 1 --2- 172.21.15.84:0/1722216970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2511dc1b0 0x55d2515ac800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.762+0000 7f330d90b740 1 --2- 172.21.15.84:0/1722216970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d251205070 0x55d2515ac2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.762+0000 7f330d90b740 1 -- 172.21.15.84:0/1722216970 >> 172.21.15.84:0/1722216970 conn(0x55d2511f9460 msgr2=0x55d2515aa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:57.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.762+0000 7f330d90b740 1 -- 172.21.15.84:0/1722216970 shutdown_connections 2024-09-21T03:49:57.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.762+0000 7f330d90b740 1 -- 172.21.15.84:0/1722216970 wait complete. 2024-09-21T03:49:57.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.762+0000 7f330d90b740 1 -- start start 2024-09-21T03:49:57.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.762+0000 7f330d90b740 1 Processor -- start 2024-09-21T03:49:57.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.762+0000 7f330d90b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2511dc1b0 0x55d2515b9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:57.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.762+0000 7f330d90b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 0x55d2515ba090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:57.779 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.763+0000 7f330d90b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d251205070 0x55d2515c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:57.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.763+0000 7f330d90b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d251373700 con 0x55d2511e4390 2024-09-21T03:49:57.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.763+0000 7f330d90b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d2514ad160 con 0x55d2511dc1b0 2024-09-21T03:49:57.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.763+0000 7f330d90b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d2515bcc00 con 0x55d251205070 2024-09-21T03:49:57.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.763+0000 7f330d90b740 10 client.0 _ll_register_callbacks cb 0x55d2514c69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:49:57.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.763+0000 7f3305133640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 0x55d2515ba090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:57.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.763+0000 7f3305133640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 0x55d2515ba090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57606/0 (socket says 172.21.15.84:57606) 2024-09-21T03:49:57.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.763+0000 7f3305133640 1 -- 172.21.15.84:0/4140626279 learned_addr learned my addr 172.21.15.84:0/4140626279 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:57.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.763+0000 7f3304932640 1 --2- 172.21.15.84:0/4140626279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2511dc1b0 0x55d2515b9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:57.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.763+0000 7f3304932640 1 --2- 172.21.15.84:0/4140626279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d251205070 0x55d2515c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:57.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.763+0000 7f3305133640 1 -- 172.21.15.84:0/4140626279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d251205070 msgr2=0x55d2515c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:57.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.763+0000 7f3305133640 1 --2- 172.21.15.84:0/4140626279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d251205070 0x55d2515c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.763+0000 7f3305133640 1 -- 172.21.15.84:0/4140626279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2511dc1b0 msgr2=0x55d2515b9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:57.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.763+0000 7f3305133640 1 --2- 172.21.15.84:0/4140626279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2511dc1b0 0x55d2515b9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.763+0000 7f3305133640 1 -- 172.21.15.84:0/4140626279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2514dac90 con 0x55d2511e4390 2024-09-21T03:49:57.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.763+0000 7f3305133640 1 --2- 172.21.15.84:0/4140626279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 0x55d2515ba090 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f32f402a930 tx=0x7f32f40316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e7f0e5f151aa8e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:57.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.763+0000 7f32e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:49:57.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.763+0000 7f32e8ff9640 1 -- 172.21.15.84:0/4140626279 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4035040 con 0x55d2511e4390 2024-09-21T03:49:57.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.763+0000 7f32e8ff9640 1 -- 172.21.15.84:0/4140626279 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f32f4004040 con 0x55d2511e4390 2024-09-21T03:49:57.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.763+0000 7f330d90b740 1 -- 172.21.15.84:0/4140626279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32fc004c50 con 0x55d2511e4390 2024-09-21T03:49:57.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.764+0000 7f32e8ff9640 1 -- 172.21.15.84:0/4140626279 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f32f4032e10 con 0x55d2511e4390 2024-09-21T03:49:57.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.764+0000 7f330d90b740 10 client.16809 fetch_fsmap learned FSMap version 25 2024-09-21T03:49:57.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.764+0000 7f330d90b740 1 -- 172.21.15.84:0/4140626279 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d2515c88f0 con 0x55d2511e4390 2024-09-21T03:49:57.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.764+0000 7f32e8ff9640 1 -- 172.21.15.84:0/4140626279 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32fc004c50 con 0x55d2511e4390 2024-09-21T03:49:57.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.764+0000 7f32e8ff9640 1 -- 172.21.15.84:0/4140626279 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f32f40048e0 con 0x55d2511e4390 2024-09-21T03:49:57.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.764+0000 7f330d90b740 10 client.16809 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:49:57.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.764+0000 7f330d90b740 10 client.16809 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:49:57.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.764+0000 7f330d90b740 20 client.16809 populate_metadata read hostname 'smithi084' 2024-09-21T03:49:57.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.764+0000 7f330d90b740 1 --2- 172.21.15.84:0/4140626279 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d2511c39f0 0x55d2515cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:57.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.764+0000 7f330d90b740 4 client.16809 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:49:57.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.764+0000 7f330d90b740 1 -- 172.21.15.84:0/4140626279 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d251524df0 con 0x55d2511c39f0 2024-09-21T03:49:57.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.764+0000 7f3304932640 1 --2- 172.21.15.84:0/4140626279 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d2511c39f0 0x55d2515cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:57.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.765+0000 7f3304932640 1 --2- 172.21.15.84:0/4140626279 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d2511c39f0 0x55d2515cbd80 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3184edcb565ae60 server_cookie=92af38611082510b in_seq=0 out_seq=0 2024-09-21T03:49:57.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.765+0000 7f32e8ff9640 10 client.16809 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:57.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.765+0000 7f32e8ff9640 1 -- 172.21.15.84:0/4140626279 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d251524df0 con 0x55d2511c39f0 2024-09-21T03:49:57.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.765+0000 7f32e8ff9640 10 client.16809 handle_command_reply: tid=0 2024-09-21T03:49:57.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.765+0000 7f330d90b740 1 client.16809 shutdown 2024-09-21T03:49:57.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.766+0000 7f330d90b740 1 -- 172.21.15.84:0/4140626279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 msgr2=0x55d2515ba090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:57.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.766+0000 7f330d90b740 1 --2- 172.21.15.84:0/4140626279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 0x55d2515ba090 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f32f402a930 tx=0x7f32f40316d0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.766+0000 7f330d90b740 1 -- 172.21.15.84:0/4140626279 shutdown_connections 2024-09-21T03:49:57.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.766+0000 7f330d90b740 1 --2- 172.21.15.84:0/4140626279 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d2511c39f0 0x55d2515cbd80 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.766+0000 7f330d90b740 1 --2- 172.21.15.84:0/4140626279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d251205070 0x55d2515c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.766+0000 7f330d90b740 1 --2- 172.21.15.84:0/4140626279 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 0x55d2515ba090 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.766+0000 7f32e8ff9640 0 client.16809 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:57.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.766+0000 7f330d90b740 1 --2- 172.21.15.84:0/4140626279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2511dc1b0 0x55d2515b9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.766+0000 7f330d90b740 1 -- 172.21.15.84:0/4140626279 >> 172.21.15.84:0/4140626279 conn(0x55d2511f9460 msgr2=0x55d2515a8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:57.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.766+0000 7f330d90b740 1 -- 172.21.15.84:0/4140626279 shutdown_connections 2024-09-21T03:49:57.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.766+0000 7f330d90b740 1 -- 172.21.15.84:0/4140626279 wait complete. 2024-09-21T03:49:57.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.766+0000 7f330d90b740 20 client.16809 trim_cache size 0 max 16384 2024-09-21T03:49:57.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.779+0000 7f330d90b740 1 Processor -- start 2024-09-21T03:49:57.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.779+0000 7f330d90b740 1 -- start start 2024-09-21T03:49:57.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.779+0000 7f330d90b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2511dc1b0 0x55d2515bba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:57.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.779+0000 7f330d90b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2511e4390 0x55d2515c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:57.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.779+0000 7f330d90b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d251205070 0x55d2515ada00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:57.788 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.779+0000 7f330d90b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f33001afc80 con 0x55d251205070 2024-09-21T03:49:57.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.779+0000 7f330d90b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f33001ad550 con 0x55d2511dc1b0 2024-09-21T03:49:57.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.779+0000 7f330d90b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f33001ab3c0 con 0x55d2511e4390 2024-09-21T03:49:57.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.780+0000 7f3304932640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d251205070 0x55d2515ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:57.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.780+0000 7f3304932640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d251205070 0x55d2515ada00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57612/0 (socket says 172.21.15.84:57612) 2024-09-21T03:49:57.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.780+0000 7f3304932640 1 -- 172.21.15.84:0/786409757 learned_addr learned my addr 172.21.15.84:0/786409757 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:57.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.780+0000 7f3305133640 1 --2- 172.21.15.84:0/786409757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2511e4390 0x55d2515c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:57.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.780+0000 7f3304932640 1 --2- 172.21.15.84:0/786409757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2511dc1b0 0x55d2515bba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:57.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.780+0000 7f3304932640 1 -- 172.21.15.84:0/786409757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2511e4390 msgr2=0x55d2515c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:57.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.780+0000 7f3304932640 1 --2- 172.21.15.84:0/786409757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2511e4390 0x55d2515c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.780+0000 7f3304932640 1 -- 172.21.15.84:0/786409757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2511dc1b0 msgr2=0x55d2515bba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:57.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.780+0000 7f3304932640 1 --2- 172.21.15.84:0/786409757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2511dc1b0 0x55d2515bba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.780+0000 7f3304932640 1 -- 172.21.15.84:0/786409757 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2515b8050 con 0x55d251205070 2024-09-21T03:49:57.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.780+0000 7f3305133640 1 --2- 172.21.15.84:0/786409757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2511e4390 0x55d2515c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:49:57.789 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.780+0000 7f3304932640 1 --2- 172.21.15.84:0/786409757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d251205070 0x55d2515ada00 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f32fc013fd0 tx=0x7f32fc015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b3d7d7af7168b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:57.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.780+0000 7f32eaffd640 1 -- 172.21.15.84:0/786409757 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc00b6e0 con 0x55d251205070 2024-09-21T03:49:57.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.780+0000 7f32eaffd640 1 -- 172.21.15.84:0/786409757 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32fc005330 con 0x55d251205070 2024-09-21T03:49:57.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.780+0000 7f32eaffd640 1 -- 172.21.15.84:0/786409757 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc011750 con 0x55d251205070 2024-09-21T03:49:57.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.781+0000 7f330d90b740 1 -- 172.21.15.84:0/786409757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d251205070 msgr2=0x55d2515ada00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:57.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.781+0000 7f330d90b740 1 --2- 172.21.15.84:0/786409757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d251205070 0x55d2515ada00 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f32fc013fd0 tx=0x7f32fc015040 comp rx=0 tx=0).stop 2024-09-21T03:49:57.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.781+0000 7f330d90b740 1 -- 172.21.15.84:0/786409757 shutdown_connections 2024-09-21T03:49:57.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.781+0000 7f330d90b740 1 --2- 172.21.15.84:0/786409757 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d251205070 0x55d2515ada00 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.781+0000 7f330d90b740 1 --2- 172.21.15.84:0/786409757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2511e4390 0x55d2515c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.781+0000 7f330d90b740 1 --2- 172.21.15.84:0/786409757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d2511dc1b0 0x55d2515bba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.781+0000 7f330d90b740 1 -- 172.21.15.84:0/786409757 >> 172.21.15.84:0/786409757 conn(0x55d2511f9460 msgr2=0x55d2515ad2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:57.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.781+0000 7f330d90b740 1 -- 172.21.15.84:0/786409757 shutdown_connections 2024-09-21T03:49:57.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.781+0000 7f330d90b740 1 -- 172.21.15.84:0/786409757 wait complete. 2024-09-21T03:49:57.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.781+0000 7f330d90b740 1 -- start start 2024-09-21T03:49:57.790 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.782+0000 7f330d90b740 1 Processor -- start 2024-09-21T03:49:57.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.782+0000 7f330d90b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2511dc1b0 0x55d2515c2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:57.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.782+0000 7f330d90b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 0x55d2515c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:57.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.782+0000 7f330d90b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d251205070 0x55d2515c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:57.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.782+0000 7f330d90b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f33001aba10 con 0x55d2511e4390 2024-09-21T03:49:57.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.782+0000 7f330d90b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f33001ace80 con 0x55d251205070 2024-09-21T03:49:57.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.782+0000 7f330d90b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f33001ac0e0 con 0x55d2511dc1b0 2024-09-21T03:49:57.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.782+0000 7f330d90b740 10 client.0 _ll_register_callbacks cb 0x7f32f4005db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:49:57.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.782+0000 7f3305133640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 0x55d2515c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:57.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.782+0000 7f3305133640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 0x55d2515c0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:57616/0 (socket says 172.21.15.84:57616) 2024-09-21T03:49:57.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.782+0000 7f3305133640 1 -- 172.21.15.84:0/1104368989 learned_addr learned my addr 172.21.15.84:0/1104368989 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:49:57.791 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.782+0000 7f3304932640 1 --2- 172.21.15.84:0/1104368989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d251205070 0x55d2515c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:57.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.782+0000 7f3304932640 1 --2- 172.21.15.84:0/1104368989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2511dc1b0 0x55d2515c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:57.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.783+0000 7f3305133640 1 -- 172.21.15.84:0/1104368989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2511dc1b0 msgr2=0x55d2515c2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:57.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.783+0000 7f3305133640 1 --2- 172.21.15.84:0/1104368989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2511dc1b0 0x55d2515c2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.783+0000 7f3305133640 1 -- 172.21.15.84:0/1104368989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d251205070 msgr2=0x55d2515c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:49:57.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.783+0000 7f3305133640 1 --2- 172.21.15.84:0/1104368989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d251205070 0x55d2515c1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.783+0000 7f3305133640 1 -- 172.21.15.84:0/1104368989 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2515c1730 con 0x55d2511e4390 2024-09-21T03:49:57.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.783+0000 7f3305133640 1 --2- 172.21.15.84:0/1104368989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 0x55d2515c0ae0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f32f4031440 tx=0x7f32f40036c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301b4aaa5f19896e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:49:57.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.783+0000 7f32e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:49:57.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.783+0000 7f32e8ff9640 1 -- 172.21.15.84:0/1104368989 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4035070 con 0x55d2511e4390 2024-09-21T03:49:57.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.783+0000 7f32e8ff9640 1 -- 172.21.15.84:0/1104368989 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f32f4004ea0 con 0x55d2511e4390 2024-09-21T03:49:57.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.783+0000 7f330d90b740 1 -- 172.21.15.84:0/1104368989 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32fc005330 con 0x55d2511e4390 2024-09-21T03:49:57.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.783+0000 7f32e8ff9640 1 -- 172.21.15.84:0/1104368989 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f32f405f050 con 0x55d2511e4390 2024-09-21T03:49:57.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.783+0000 7f330d90b740 10 client.16815 fetch_fsmap learned FSMap version 25 2024-09-21T03:49:57.792 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.783+0000 7f330d90b740 1 -- 172.21.15.84:0/1104368989 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d251637620 con 0x55d2511e4390 2024-09-21T03:49:57.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.783+0000 7f32e8ff9640 1 -- 172.21.15.84:0/1104368989 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32fc005330 con 0x55d2511e4390 2024-09-21T03:49:57.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.784+0000 7f32e8ff9640 1 -- 172.21.15.84:0/1104368989 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f32f4058060 con 0x55d2511e4390 2024-09-21T03:49:57.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.784+0000 7f330d90b740 10 client.16815 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:49:57.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.784+0000 7f330d90b740 10 client.16815 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:49:57.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.784+0000 7f330d90b740 20 client.16815 populate_metadata read hostname 'smithi084' 2024-09-21T03:49:57.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.784+0000 7f330d90b740 1 --2- 172.21.15.84:0/1104368989 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d251198da0 0x55d251639da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:49:57.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.784+0000 7f330d90b740 4 client.16815 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:49:57.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.784+0000 7f330d90b740 1 -- 172.21.15.84:0/1104368989 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d2515208a0 con 0x55d251198da0 2024-09-21T03:49:57.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.784+0000 7f3304932640 1 --2- 172.21.15.84:0/1104368989 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d251198da0 0x55d251639da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:49:57.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.784+0000 7f3304932640 1 --2- 172.21.15.84:0/1104368989 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d251198da0 0x55d251639da0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=289c2033a19e21f server_cookie=3f17ba11e113c338 in_seq=0 out_seq=0 2024-09-21T03:49:57.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.784+0000 7f32e8ff9640 10 client.16815 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:57.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.785+0000 7f32e8ff9640 1 -- 172.21.15.84:0/1104368989 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d2515208a0 con 0x55d251198da0 2024-09-21T03:49:57.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.785+0000 7f32e8ff9640 10 client.16815 handle_command_reply: tid=0 2024-09-21T03:49:57.793 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.785+0000 7f330d90b740 1 client.16815 shutdown 2024-09-21T03:49:57.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.785+0000 7f330d90b740 1 -- 172.21.15.84:0/1104368989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 msgr2=0x55d2515c0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:57.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.785+0000 7f330d90b740 1 --2- 172.21.15.84:0/1104368989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 0x55d2515c0ae0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f32f4031440 tx=0x7f32f40036c0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.785+0000 7f330d90b740 1 -- 172.21.15.84:0/1104368989 shutdown_connections 2024-09-21T03:49:57.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.785+0000 7f330d90b740 1 --2- 172.21.15.84:0/1104368989 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d251198da0 0x55d251639da0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.785+0000 7f330d90b740 1 --2- 172.21.15.84:0/1104368989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d251205070 0x55d2515c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.785+0000 7f32e8ff9640 0 client.16815 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:49:57.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.785+0000 7f330d90b740 1 --2- 172.21.15.84:0/1104368989 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d2511e4390 0x55d2515c0ae0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.785+0000 7f330d90b740 1 --2- 172.21.15.84:0/1104368989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2511dc1b0 0x55d2515c2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.785+0000 7f330d90b740 1 -- 172.21.15.84:0/1104368989 >> 172.21.15.84:0/1104368989 conn(0x55d2511f9460 msgr2=0x55d2515adcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:57.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.785+0000 7f330d90b740 1 -- 172.21.15.84:0/1104368989 shutdown_connections 2024-09-21T03:49:57.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.785+0000 7f330d90b740 1 -- 172.21.15.84:0/1104368989 wait complete. 2024-09-21T03:49:57.794 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.785+0000 7f330d90b740 20 client.16815 trim_cache size 0 max 16384 2024-09-21T03:49:57.795 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:49:57.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.786+0000 7f3307397640 1 -- 172.21.15.84:0/1175755630 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f32ec0b6700 msgr2=0x7f32ec0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:57.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.786+0000 7f3307397640 1 --2- 172.21.15.84:0/1175755630 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f32ec0b6700 0x7f32ec0b8c10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f32f80e5000 tx=0x7f32f8071be0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.786+0000 7f3307397640 1 -- 172.21.15.84:0/1175755630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3300108d70 msgr2=0x7f330019ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:49:57.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.786+0000 7f3307397640 1 --2- 172.21.15.84:0/1175755630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3300108d70 0x7f330019ed00 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f32f800eaa0 tx=0x7f32f800ef60 comp rx=0 tx=0).stop 2024-09-21T03:49:57.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.786+0000 7f3307397640 1 -- 172.21.15.84:0/1175755630 shutdown_connections 2024-09-21T03:49:57.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.786+0000 7f3307397640 1 --2- 172.21.15.84:0/1175755630 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f32ec0b6700 0x7f32ec0b8c10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.786+0000 7f3307397640 1 --2- 172.21.15.84:0/1175755630 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3300108d70 0x7f330019ed00 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.786+0000 7f3307397640 1 --2- 172.21.15.84:0/1175755630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3300108420 0x7f3300199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.786+0000 7f3307397640 1 --2- 172.21.15.84:0/1175755630 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3300102ae0 0x7f33001994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:49:57.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.786+0000 7f3307397640 1 -- 172.21.15.84:0/1175755630 >> 172.21.15.84:0/1175755630 conn(0x7f3300079770 msgr2=0x7f3300106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:49:57.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.786+0000 7f3307397640 1 -- 172.21.15.84:0/1175755630 shutdown_connections 2024-09-21T03:49:57.796 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:49:57.786+0000 7f3307397640 1 -- 172.21.15.84:0/1175755630 wait complete. 2024-09-21T03:49:58.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:49:58 smithi084 ceph-mon[30941]: pgmap v551: 97 pgs: 97 active+clean; 13 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 54 KiB/s wr, 13 op/s 2024-09-21T03:49:58.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:49:58 smithi174 ceph-mon[34403]: pgmap v551: 97 pgs: 97 active+clean; 13 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 54 KiB/s wr, 13 op/s 2024-09-21T03:49:58.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:49:58 smithi172 ceph-mon[34821]: pgmap v551: 97 pgs: 97 active+clean; 13 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 54 KiB/s wr, 13 op/s 2024-09-21T03:49:59.706 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:49:59.707 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:49:59.965 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:50:00.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:00 smithi084 ceph-mon[30941]: overall HEALTH_OK 2024-09-21T03:50:00.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:00 smithi174 ceph-mon[34403]: overall HEALTH_OK 2024-09-21T03:50:00.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:00 smithi172 ceph-mon[34821]: overall HEALTH_OK 2024-09-21T03:50:00.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.490+0000 7f25e329a640 1 -- 172.21.15.84:0/2868630891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25dc103b60 msgr2=0x7f25dc103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:00.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.490+0000 7f25e329a640 1 --2- 172.21.15.84:0/2868630891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25dc103b60 0x7f25dc103f70 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f25cc009ca0 tx=0x7f25cc02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.490+0000 7f25e329a640 1 -- 172.21.15.84:0/2868630891 shutdown_connections 2024-09-21T03:50:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.490+0000 7f25e329a640 1 --2- 172.21.15.84:0/2868630891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25dc109df0 0x7f25dc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.490+0000 7f25e329a640 1 --2- 172.21.15.84:0/2868630891 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25dc1094a0 0x7f25dc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.490+0000 7f25e329a640 1 --2- 172.21.15.84:0/2868630891 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25dc103b60 0x7f25dc103f70 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.490+0000 7f25e329a640 1 -- 172.21.15.84:0/2868630891 >> 172.21.15.84:0/2868630891 conn(0x7f25dc07b850 msgr2=0x7f25dc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.490+0000 7f25e329a640 1 -- 172.21.15.84:0/2868630891 shutdown_connections 2024-09-21T03:50:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.490+0000 7f25e329a640 1 -- 172.21.15.84:0/2868630891 wait complete. 2024-09-21T03:50:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.491+0000 7f25e329a640 1 Processor -- start 2024-09-21T03:50:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.491+0000 7f25e329a640 1 -- start start 2024-09-21T03:50:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.491+0000 7f25e329a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25dc103b60 0x7f25dc19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.491+0000 7f25e329a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25dc1094a0 0x7f25dc19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.491+0000 7f25e329a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25dc109df0 0x7f25dc19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:00.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.491+0000 7f25e329a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f25dc113b30 con 0x7f25dc103b60 2024-09-21T03:50:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.491+0000 7f25e329a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f25dc1139b0 con 0x7f25dc109df0 2024-09-21T03:50:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.491+0000 7f25e329a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f25dc113cb0 con 0x7f25dc1094a0 2024-09-21T03:50:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.491+0000 7f25e1036640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25dc103b60 0x7f25dc19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.491+0000 7f25e1036640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25dc103b60 0x7f25dc19a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44086/0 (socket says 172.21.15.84:44086) 2024-09-21T03:50:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.491+0000 7f25e1036640 1 -- 172.21.15.84:0/1257172107 learned_addr learned my addr 172.21.15.84:0/1257172107 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.492+0000 7f25e1837640 1 --2- 172.21.15.84:0/1257172107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25dc109df0 0x7f25dc19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.492+0000 7f25e0835640 1 --2- 172.21.15.84:0/1257172107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25dc1094a0 0x7f25dc19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.492+0000 7f25e1036640 1 -- 172.21.15.84:0/1257172107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25dc1094a0 msgr2=0x7f25dc19aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.492+0000 7f25e1036640 1 --2- 172.21.15.84:0/1257172107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25dc1094a0 0x7f25dc19aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.492+0000 7f25e1036640 1 -- 172.21.15.84:0/1257172107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25dc109df0 msgr2=0x7f25dc19fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.492+0000 7f25e1036640 1 --2- 172.21.15.84:0/1257172107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25dc109df0 0x7f25dc19fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.492+0000 7f25e1036640 1 -- 172.21.15.84:0/1257172107 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25dc1a0490 con 0x7f25dc103b60 2024-09-21T03:50:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.492+0000 7f25e1837640 1 --2- 172.21.15.84:0/1257172107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25dc109df0 0x7f25dc19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.492+0000 7f25e1036640 1 --2- 172.21.15.84:0/1257172107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25dc103b60 0x7f25dc19a520 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f25cc02ade0 tx=0x7f25cc003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:00.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.492+0000 7f25da7fc640 1 -- 172.21.15.84:0/1257172107 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc003d60 con 0x7f25dc103b60 2024-09-21T03:50:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.492+0000 7f25e329a640 1 -- 172.21.15.84:0/1257172107 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25dc1a0720 con 0x7f25dc103b60 2024-09-21T03:50:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.492+0000 7f25da7fc640 1 -- 172.21.15.84:0/1257172107 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25cc0044f0 con 0x7f25dc103b60 2024-09-21T03:50:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.492+0000 7f25da7fc640 1 -- 172.21.15.84:0/1257172107 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc02fd10 con 0x7f25dc103b60 2024-09-21T03:50:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.492+0000 7f25e329a640 1 -- 172.21.15.84:0/1257172107 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25dc1a6ee0 con 0x7f25dc103b60 2024-09-21T03:50:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.495+0000 7f25da7fc640 1 -- 172.21.15.84:0/1257172107 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f25cc0046a0 con 0x7f25dc103b60 2024-09-21T03:50:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.495+0000 7f25e980e740 1 Processor -- start 2024-09-21T03:50:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.495+0000 7f25e980e740 1 -- start start 2024-09-21T03:50:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.495+0000 7f25e980e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c96065d350 0x55c960a04430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.495+0000 7f25e980e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c960634490 0x55c960a04970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.495+0000 7f25e980e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c96063c670 0x55c960a04eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.495+0000 7f25e980e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c96097ae60 con 0x55c960634490 2024-09-21T03:50:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.495+0000 7f25e980e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c96096a290 con 0x55c96063c670 2024-09-21T03:50:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.495+0000 7f25e980e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c96096e0a0 con 0x55c96065d350 2024-09-21T03:50:00.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.495+0000 7f25e1036640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c960634490 0x55c960a04970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.496+0000 7f25e1036640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c960634490 0x55c960a04970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44098/0 (socket says 172.21.15.84:44098) 2024-09-21T03:50:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.496+0000 7f25e1036640 1 -- 172.21.15.84:0/2574185596 learned_addr learned my addr 172.21.15.84:0/2574185596 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.496+0000 7f25e1837640 1 --2- 172.21.15.84:0/2574185596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c96065d350 0x55c960a04430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.496+0000 7f25da7fc640 1 --2- 172.21.15.84:0/1257172107 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f25c40b6680 0x7f25c40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.496+0000 7f25e0835640 1 --2- 172.21.15.84:0/2574185596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c96063c670 0x55c960a04eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.496+0000 7f25e1837640 1 --2- 172.21.15.84:0/1257172107 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f25c40b6680 0x7f25c40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.496+0000 7f25da7fc640 1 -- 172.21.15.84:0/1257172107 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f25cc108d60 con 0x7f25dc103b60 2024-09-21T03:50:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.496+0000 7f25e1036640 1 -- 172.21.15.84:0/2574185596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c96065d350 msgr2=0x55c960a04430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.496+0000 7f25e1036640 1 --2- 172.21.15.84:0/2574185596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c96065d350 0x55c960a04430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.496+0000 7f25e1036640 1 -- 172.21.15.84:0/2574185596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c96063c670 msgr2=0x55c960a04eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.496+0000 7f25e1036640 1 --2- 172.21.15.84:0/2574185596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c96063c670 0x55c960a04eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.496+0000 7f25e1036640 1 -- 172.21.15.84:0/2574185596 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9606c8930 con 0x55c960634490 2024-09-21T03:50:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.496+0000 7f25e1036640 1 --2- 172.21.15.84:0/2574185596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c960634490 0x55c960a04970 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f25cc1063e0 tx=0x7f25cc02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae574b4710ee693 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.496+0000 7f25e1837640 1 --2- 172.21.15.84:0/1257172107 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f25c40b6680 0x7f25c40b8b90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f25d4015600 tx=0x7f25d40046c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:00.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.496+0000 7f25c37fe640 1 -- 172.21.15.84:0/2574185596 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc0ce310 con 0x55c960634490 2024-09-21T03:50:00.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.496+0000 7f25c37fe640 1 -- 172.21.15.84:0/2574185596 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25cc036070 con 0x55c960634490 2024-09-21T03:50:00.504 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.496+0000 7f25c37fe640 1 -- 172.21.15.84:0/2574185596 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25cc0ca310 con 0x55c960634490 2024-09-21T03:50:00.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.497+0000 7f25e980e740 1 -- 172.21.15.84:0/2574185596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c960634490 msgr2=0x55c960a04970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:00.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.497+0000 7f25e980e740 1 --2- 172.21.15.84:0/2574185596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c960634490 0x55c960a04970 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f25cc1063e0 tx=0x7f25cc02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.498+0000 7f25e980e740 1 -- 172.21.15.84:0/2574185596 shutdown_connections 2024-09-21T03:50:00.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.498+0000 7f25e980e740 1 --2- 172.21.15.84:0/2574185596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c96063c670 0x55c960a04eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.498+0000 7f25e980e740 1 --2- 172.21.15.84:0/2574185596 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c960634490 0x55c960a04970 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.498+0000 7f25e980e740 1 --2- 172.21.15.84:0/2574185596 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c96065d350 0x55c960a04430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.498+0000 7f25e980e740 1 -- 172.21.15.84:0/2574185596 >> 172.21.15.84:0/2574185596 conn(0x55c960651740 msgr2=0x55c960a02320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.498+0000 7f25e980e740 1 -- 172.21.15.84:0/2574185596 shutdown_connections 2024-09-21T03:50:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.498+0000 7f25e980e740 1 -- 172.21.15.84:0/2574185596 wait complete. 2024-09-21T03:50:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.498+0000 7f25e980e740 1 -- start start 2024-09-21T03:50:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.498+0000 7f25e980e740 1 Processor -- start 2024-09-21T03:50:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.499+0000 7f25e980e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c960634490 0x55c960a143e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.499+0000 7f25e980e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 0x55c960a14920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.499+0000 7f25e980e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c96065d350 0x55c960a1fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.499+0000 7f25e980e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c9607cb890 con 0x55c96063c670 2024-09-21T03:50:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.499+0000 7f25e980e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c960904d40 con 0x55c96065d350 2024-09-21T03:50:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.499+0000 7f25e980e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c96097ae60 con 0x55c960634490 2024-09-21T03:50:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.499+0000 7f25e980e740 10 client.0 _ll_register_callbacks cb 0x55c960968c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.499+0000 7f25e0835640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 0x55c960a14920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:00.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.499+0000 7f25e0835640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 0x55c960a14920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44106/0 (socket says 172.21.15.84:44106) 2024-09-21T03:50:00.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.499+0000 7f25e0835640 1 -- 172.21.15.84:0/795674690 learned_addr learned my addr 172.21.15.84:0/795674690 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:00.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.499+0000 7f25e1837640 1 --2- 172.21.15.84:0/795674690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c96065d350 0x55c960a1fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:00.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.499+0000 7f25e1036640 1 --2- 172.21.15.84:0/795674690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c960634490 0x55c960a143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:00.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.499+0000 7f25e0835640 1 -- 172.21.15.84:0/795674690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c960634490 msgr2=0x55c960a143e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:00.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.499+0000 7f25e0835640 1 --2- 172.21.15.84:0/795674690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c960634490 0x55c960a143e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.499+0000 7f25e0835640 1 -- 172.21.15.84:0/795674690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c96065d350 msgr2=0x55c960a1fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:00.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.499+0000 7f25e0835640 1 --2- 172.21.15.84:0/795674690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c96065d350 0x55c960a1fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.499+0000 7f25e0835640 1 -- 172.21.15.84:0/795674690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c960a203b0 con 0x55c96063c670 2024-09-21T03:50:00.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.499+0000 7f25e1837640 1 --2- 172.21.15.84:0/795674690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c96065d350 0x55c960a1fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:50:00.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.499+0000 7f25e1036640 1 --2- 172.21.15.84:0/795674690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c960634490 0x55c960a143e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:00.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.500+0000 7f25e0835640 1 --2- 172.21.15.84:0/795674690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 0x55c960a14920 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f25d00106c0 tx=0x7f25d0010ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668b9abc948ae16b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:00.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.500+0000 7f25c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:00.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.500+0000 7f25c0ff9640 1 -- 172.21.15.84:0/795674690 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d001d060 con 0x55c96063c670 2024-09-21T03:50:00.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.500+0000 7f25c0ff9640 1 -- 172.21.15.84:0/795674690 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f25d000e8f0 con 0x55c96063c670 2024-09-21T03:50:00.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.500+0000 7f25e980e740 1 -- 172.21.15.84:0/795674690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25cc036070 con 0x55c96063c670 2024-09-21T03:50:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.500+0000 7f25c0ff9640 1 -- 172.21.15.84:0/795674690 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f25d000eb30 con 0x55c96063c670 2024-09-21T03:50:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.500+0000 7f25e980e740 10 client.16827 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.500+0000 7f25e980e740 1 -- 172.21.15.84:0/795674690 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c960a22d20 con 0x55c96063c670 2024-09-21T03:50:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.500+0000 7f25c0ff9640 1 -- 172.21.15.84:0/795674690 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25cc036070 con 0x55c96063c670 2024-09-21T03:50:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.500+0000 7f25c0ff9640 1 -- 172.21.15.84:0/795674690 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f25d0020360 con 0x55c96063c670 2024-09-21T03:50:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.500+0000 7f25e980e740 10 client.16827 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.500+0000 7f25e980e740 10 client.16827 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:50:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.500+0000 7f25e980e740 20 client.16827 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.500+0000 7f25e980e740 1 --2- 172.21.15.84:0/795674690 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c96061bcd0 0x55c960a26250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.500+0000 7f25e980e740 4 client.16827 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:50:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.500+0000 7f25e980e740 1 -- 172.21.15.84:0/795674690 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c96097cdb0 con 0x55c96061bcd0 2024-09-21T03:50:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.501+0000 7f25e1036640 1 --2- 172.21.15.84:0/795674690 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c96061bcd0 0x55c960a26250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.501+0000 7f25e1036640 1 --2- 172.21.15.84:0/795674690 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c96061bcd0 0x55c960a26250 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8407ae5998728558 server_cookie=3f62d2c6e46d86d7 in_seq=0 out_seq=0 2024-09-21T03:50:00.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.501+0000 7f25c0ff9640 10 client.16827 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:00.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.502+0000 7f25c0ff9640 1 -- 172.21.15.84:0/795674690 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c96097cdb0 con 0x55c96061bcd0 2024-09-21T03:50:00.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.502+0000 7f25c0ff9640 10 client.16827 handle_command_reply: tid=0 2024-09-21T03:50:00.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.502+0000 7f25e980e740 1 client.16827 shutdown 2024-09-21T03:50:00.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.502+0000 7f25e980e740 1 -- 172.21.15.84:0/795674690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 msgr2=0x55c960a14920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:00.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.502+0000 7f25e980e740 1 --2- 172.21.15.84:0/795674690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 0x55c960a14920 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f25d00106c0 tx=0x7f25d0010ac0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.502+0000 7f25e980e740 1 -- 172.21.15.84:0/795674690 shutdown_connections 2024-09-21T03:50:00.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.502+0000 7f25e980e740 1 --2- 172.21.15.84:0/795674690 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c96061bcd0 0x55c960a26250 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.502+0000 7f25e980e740 1 --2- 172.21.15.84:0/795674690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c96065d350 0x55c960a1fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.502+0000 7f25e980e740 1 --2- 172.21.15.84:0/795674690 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 0x55c960a14920 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.502+0000 7f25e980e740 1 --2- 172.21.15.84:0/795674690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c960634490 0x55c960a143e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.502+0000 7f25e980e740 1 -- 172.21.15.84:0/795674690 >> 172.21.15.84:0/795674690 conn(0x55c960651740 msgr2=0x55c960a00850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:00.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.502+0000 7f25c0ff9640 0 client.16827 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:00.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.502+0000 7f25e980e740 1 -- 172.21.15.84:0/795674690 shutdown_connections 2024-09-21T03:50:00.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.502+0000 7f25e980e740 1 -- 172.21.15.84:0/795674690 wait complete. 2024-09-21T03:50:00.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.502+0000 7f25e980e740 20 client.16827 trim_cache size 0 max 16384 2024-09-21T03:50:00.522 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.520+0000 7f25e980e740 1 Processor -- start 2024-09-21T03:50:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.520+0000 7f25e980e740 1 -- start start 2024-09-21T03:50:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.520+0000 7f25e980e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c960634490 0x55c960a00f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.520+0000 7f25e980e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 0x55c960a113d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.520+0000 7f25e980e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c96065d350 0x55c960a11910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.520+0000 7f25e980e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f25dc1afd90 con 0x55c96063c670 2024-09-21T03:50:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.520+0000 7f25e980e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f25dc1ad660 con 0x55c960634490 2024-09-21T03:50:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.520+0000 7f25e980e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f25dc1ab4d0 con 0x55c96065d350 2024-09-21T03:50:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.520+0000 7f25e0835640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 0x55c960a113d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.520+0000 7f25e0835640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 0x55c960a113d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44118/0 (socket says 172.21.15.84:44118) 2024-09-21T03:50:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.520+0000 7f25e0835640 1 -- 172.21.15.84:0/3697658833 learned_addr learned my addr 172.21.15.84:0/3697658833 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.520+0000 7f25e1837640 1 --2- 172.21.15.84:0/3697658833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c96065d350 0x55c960a11910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.520+0000 7f25e1036640 1 --2- 172.21.15.84:0/3697658833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c960634490 0x55c960a00f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.520+0000 7f25e0835640 1 -- 172.21.15.84:0/3697658833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c96065d350 msgr2=0x55c960a11910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:00.523 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.520+0000 7f25e0835640 1 --2- 172.21.15.84:0/3697658833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c96065d350 0x55c960a11910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.520+0000 7f25e0835640 1 -- 172.21.15.84:0/3697658833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c960634490 msgr2=0x55c960a00f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:00.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.520+0000 7f25e0835640 1 --2- 172.21.15.84:0/3697658833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c960634490 0x55c960a00f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.520+0000 7f25e0835640 1 -- 172.21.15.84:0/3697658833 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c960a13140 con 0x55c96063c670 2024-09-21T03:50:00.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.520+0000 7f25e0835640 1 --2- 172.21.15.84:0/3697658833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 0x55c960a113d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f25d0020730 tx=0x7f25d0005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c592dc8d46b91b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:00.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.521+0000 7f25c2ffd640 1 -- 172.21.15.84:0/3697658833 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d000e970 con 0x55c96063c670 2024-09-21T03:50:00.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.521+0000 7f25c2ffd640 1 -- 172.21.15.84:0/3697658833 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25d0020e50 con 0x55c96063c670 2024-09-21T03:50:00.524 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.521+0000 7f25c2ffd640 1 -- 172.21.15.84:0/3697658833 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d0022940 con 0x55c96063c670 2024-09-21T03:50:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.521+0000 7f25e980e740 1 -- 172.21.15.84:0/3697658833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 msgr2=0x55c960a113d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.521+0000 7f25e980e740 1 --2- 172.21.15.84:0/3697658833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 0x55c960a113d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f25d0020730 tx=0x7f25d0005a10 comp rx=0 tx=0).stop 2024-09-21T03:50:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.521+0000 7f25e980e740 1 -- 172.21.15.84:0/3697658833 shutdown_connections 2024-09-21T03:50:00.526 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.521+0000 7f25e980e740 1 --2- 172.21.15.84:0/3697658833 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c96065d350 0x55c960a11910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.521+0000 7f25e980e740 1 --2- 172.21.15.84:0/3697658833 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 0x55c960a113d0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.521+0000 7f25e980e740 1 --2- 172.21.15.84:0/3697658833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c960634490 0x55c960a00f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.521+0000 7f25e980e740 1 -- 172.21.15.84:0/3697658833 >> 172.21.15.84:0/3697658833 conn(0x55c960651740 msgr2=0x55c960a00850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.521+0000 7f25e980e740 1 -- 172.21.15.84:0/3697658833 shutdown_connections 2024-09-21T03:50:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.521+0000 7f25e980e740 1 -- 172.21.15.84:0/3697658833 wait complete. 2024-09-21T03:50:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.522+0000 7f25e980e740 1 -- start start 2024-09-21T03:50:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.522+0000 7f25e980e740 1 Processor -- start 2024-09-21T03:50:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.522+0000 7f25e980e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c960634490 0x55c960a1c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.522+0000 7f25e980e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 0x55c960a1ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.522+0000 7f25e980e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c96065d350 0x55c960a1b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.522+0000 7f25e980e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f25dc1abb20 con 0x55c96063c670 2024-09-21T03:50:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.522+0000 7f25e980e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f25dc1acf90 con 0x55c96065d350 2024-09-21T03:50:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.522+0000 7f25e980e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f25dc1ac1f0 con 0x55c960634490 2024-09-21T03:50:00.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.522+0000 7f25e980e740 10 client.0 _ll_register_callbacks cb 0x7f25d000b5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:00.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.522+0000 7f25e0835640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 0x55c960a1ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:00.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.522+0000 7f25e0835640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 0x55c960a1ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44128/0 (socket says 172.21.15.84:44128) 2024-09-21T03:50:00.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.522+0000 7f25e0835640 1 -- 172.21.15.84:0/3456288175 learned_addr learned my addr 172.21.15.84:0/3456288175 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:00.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.523+0000 7f25e1036640 1 --2- 172.21.15.84:0/3456288175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c960634490 0x55c960a1c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:00.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.523+0000 7f25e1837640 1 --2- 172.21.15.84:0/3456288175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c96065d350 0x55c960a1b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:00.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.523+0000 7f25e0835640 1 -- 172.21.15.84:0/3456288175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c960634490 msgr2=0x55c960a1c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:00.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.523+0000 7f25e0835640 1 --2- 172.21.15.84:0/3456288175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c960634490 0x55c960a1c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.523+0000 7f25e0835640 1 -- 172.21.15.84:0/3456288175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c96065d350 msgr2=0x55c960a1b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:00.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.523+0000 7f25e0835640 1 --2- 172.21.15.84:0/3456288175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c96065d350 0x55c960a1b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.523+0000 7f25e0835640 1 -- 172.21.15.84:0/3456288175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c960a1b8a0 con 0x55c96063c670 2024-09-21T03:50:00.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.523+0000 7f25e0835640 1 --2- 172.21.15.84:0/3456288175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 0x55c960a1ae20 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f25d0000c00 tx=0x7f25d0020610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c66a8c7de0bd2a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:00.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.523+0000 7f25c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:00.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.523+0000 7f25c0ff9640 1 -- 172.21.15.84:0/3456288175 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d001d040 con 0x55c96063c670 2024-09-21T03:50:00.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.523+0000 7f25c0ff9640 1 -- 172.21.15.84:0/3456288175 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f25d0020b30 con 0x55c96063c670 2024-09-21T03:50:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.523+0000 7f25e980e740 1 -- 172.21.15.84:0/3456288175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25d0020e50 con 0x55c96063c670 2024-09-21T03:50:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.523+0000 7f25c0ff9640 1 -- 172.21.15.84:0/3456288175 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f25d0022640 con 0x55c96063c670 2024-09-21T03:50:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.523+0000 7f25e980e740 10 client.16833 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.523+0000 7f25e980e740 1 -- 172.21.15.84:0/3456288175 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c960a91950 con 0x55c96063c670 2024-09-21T03:50:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.524+0000 7f25c0ff9640 1 -- 172.21.15.84:0/3456288175 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25d0020e50 con 0x55c96063c670 2024-09-21T03:50:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.524+0000 7f25c0ff9640 1 -- 172.21.15.84:0/3456288175 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f25d003c910 con 0x55c96063c670 2024-09-21T03:50:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.524+0000 7f25e980e740 10 client.16833 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.524+0000 7f25e980e740 10 client.16833 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:50:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.524+0000 7f25e980e740 20 client.16833 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.524+0000 7f25e980e740 1 --2- 172.21.15.84:0/3456288175 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c9605f1080 0x55c960a940a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.524+0000 7f25e980e740 4 client.16833 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:50:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.524+0000 7f25e980e740 1 -- 172.21.15.84:0/3456288175 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c960978860 con 0x55c9605f1080 2024-09-21T03:50:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.524+0000 7f25e1036640 1 --2- 172.21.15.84:0/3456288175 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c9605f1080 0x55c960a940a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.525+0000 7f25e1036640 1 --2- 172.21.15.84:0/3456288175 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c9605f1080 0x55c960a940a0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f922acf4c2aed4b server_cookie=3d401e7e84244e31 in_seq=0 out_seq=0 2024-09-21T03:50:00.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.525+0000 7f25c0ff9640 10 client.16833 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:00.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.526+0000 7f25c0ff9640 1 -- 172.21.15.84:0/3456288175 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c960978860 con 0x55c9605f1080 2024-09-21T03:50:00.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.526+0000 7f25c0ff9640 10 client.16833 handle_command_reply: tid=0 2024-09-21T03:50:00.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.526+0000 7f25e980e740 1 client.16833 shutdown 2024-09-21T03:50:00.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.526+0000 7f25e980e740 1 -- 172.21.15.84:0/3456288175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 msgr2=0x55c960a1ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:00.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.526+0000 7f25e980e740 1 --2- 172.21.15.84:0/3456288175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 0x55c960a1ae20 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f25d0000c00 tx=0x7f25d0020610 comp rx=0 tx=0).stop 2024-09-21T03:50:00.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.526+0000 7f25e980e740 1 -- 172.21.15.84:0/3456288175 shutdown_connections 2024-09-21T03:50:00.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.526+0000 7f25e980e740 1 --2- 172.21.15.84:0/3456288175 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c9605f1080 0x55c960a940a0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.526+0000 7f25e980e740 1 --2- 172.21.15.84:0/3456288175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c96065d350 0x55c960a1b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.526+0000 7f25e980e740 1 --2- 172.21.15.84:0/3456288175 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c96063c670 0x55c960a1ae20 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.526+0000 7f25e980e740 1 --2- 172.21.15.84:0/3456288175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c960634490 0x55c960a1c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.526+0000 7f25e980e740 1 -- 172.21.15.84:0/3456288175 >> 172.21.15.84:0/3456288175 conn(0x55c960651740 msgr2=0x55c960a095d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:00.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.527+0000 7f25c0ff9640 0 client.16833 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:00.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.527+0000 7f25e980e740 1 -- 172.21.15.84:0/3456288175 shutdown_connections 2024-09-21T03:50:00.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.527+0000 7f25e980e740 1 -- 172.21.15.84:0/3456288175 wait complete. 2024-09-21T03:50:00.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.527+0000 7f25e980e740 20 client.16833 trim_cache size 0 max 16384 2024-09-21T03:50:00.532 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:50:00.532 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T03:50:00.532 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "33131451-f242-447a-b13f-9bdebc7884ec", 2024-09-21T03:50:00.532 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T03:50:00.532 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:50:00.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.527+0000 7f25e329a640 1 -- 172.21.15.84:0/1257172107 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f25c40b6680 msgr2=0x7f25c40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:00.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.527+0000 7f25e329a640 1 --2- 172.21.15.84:0/1257172107 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f25c40b6680 0x7f25c40b8b90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f25d4015600 tx=0x7f25d40046c0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.527+0000 7f25e329a640 1 -- 172.21.15.84:0/1257172107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25dc103b60 msgr2=0x7f25dc19a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:00.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.527+0000 7f25e329a640 1 --2- 172.21.15.84:0/1257172107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25dc103b60 0x7f25dc19a520 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f25cc02ade0 tx=0x7f25cc003970 comp rx=0 tx=0).stop 2024-09-21T03:50:00.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.527+0000 7f25e329a640 1 -- 172.21.15.84:0/1257172107 shutdown_connections 2024-09-21T03:50:00.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.527+0000 7f25e329a640 1 --2- 172.21.15.84:0/1257172107 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f25c40b6680 0x7f25c40b8b90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.527+0000 7f25e329a640 1 --2- 172.21.15.84:0/1257172107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25dc109df0 0x7f25dc19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.527+0000 7f25e329a640 1 --2- 172.21.15.84:0/1257172107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f25dc1094a0 0x7f25dc19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.527+0000 7f25e329a640 1 --2- 172.21.15.84:0/1257172107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f25dc103b60 0x7f25dc19a520 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:00.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.527+0000 7f25e329a640 1 -- 172.21.15.84:0/1257172107 >> 172.21.15.84:0/1257172107 conn(0x7f25dc07b850 msgr2=0x7f25dc107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:00.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.528+0000 7f25e329a640 1 -- 172.21.15.84:0/1257172107 shutdown_connections 2024-09-21T03:50:00.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:00.528+0000 7f25e329a640 1 -- 172.21.15.84:0/1257172107 wait complete. 2024-09-21T03:50:01.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:01 smithi084 ceph-mon[30941]: pgmap v552: 97 pgs: 97 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 9 op/s 2024-09-21T03:50:01.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:01 smithi084 ceph-mon[30941]: scrub queued for path: / 2024-09-21T03:50:01.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:01 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:50:01.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:01 smithi084 ceph-mon[30941]: scrub summary: active paths [/] 2024-09-21T03:50:01.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:01 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:50:01.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:01 smithi174 ceph-mon[34403]: pgmap v552: 97 pgs: 97 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 9 op/s 2024-09-21T03:50:01.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:01 smithi174 ceph-mon[34403]: scrub queued for path: / 2024-09-21T03:50:01.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:01 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:50:01.379 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:01 smithi174 ceph-mon[34403]: scrub summary: active paths [/] 2024-09-21T03:50:01.379 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:01 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:50:01.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:01 smithi172 ceph-mon[34821]: pgmap v552: 97 pgs: 97 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 KiB/s wr, 9 op/s 2024-09-21T03:50:01.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:01 smithi172 ceph-mon[34821]: scrub queued for path: / 2024-09-21T03:50:01.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:01 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:50:01.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:01 smithi172 ceph-mon[34821]: scrub summary: active paths [/] 2024-09-21T03:50:01.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:01 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:50:01.507 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:50:01.751 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:50:02.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.239+0000 7f1068061640 1 -- 172.21.15.84:0/2743279763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10601051e0 msgr2=0x7f10601055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:02.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.239+0000 7f1068061640 1 --2- 172.21.15.84:0/2743279763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10601051e0 0x7f10601055f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f1050009900 tx=0x7f105002a410 comp rx=0 tx=0).stop 2024-09-21T03:50:02.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.239+0000 7f1068061640 1 -- 172.21.15.84:0/2743279763 shutdown_connections 2024-09-21T03:50:02.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.239+0000 7f1068061640 1 --2- 172.21.15.84:0/2743279763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1060105b30 0x7f106010f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.239+0000 7f1068061640 1 --2- 172.21.15.84:0/2743279763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f10601051e0 0x7f10601055f0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.239+0000 7f1068061640 1 --2- 172.21.15.84:0/2743279763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1060103210 0x7f1060103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.239+0000 7f1068061640 1 -- 172.21.15.84:0/2743279763 >> 172.21.15.84:0/2743279763 conn(0x7f1060079f90 msgr2=0x7f106007a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:02.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.239+0000 7f1068061640 1 -- 172.21.15.84:0/2743279763 shutdown_connections 2024-09-21T03:50:02.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.239+0000 7f1068061640 1 -- 172.21.15.84:0/2743279763 wait complete. 2024-09-21T03:50:02.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.240+0000 7f1068061640 1 Processor -- start 2024-09-21T03:50:02.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.240+0000 7f1068061640 1 -- start start 2024-09-21T03:50:02.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.240+0000 7f1068061640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1060103210 0x7f106019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:02.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.240+0000 7f1068061640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10601051e0 0x7f106019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:02.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.240+0000 7f1068061640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1060105b30 0x7f106019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:02.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.240+0000 7f1068061640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1060112a10 con 0x7f1060103210 2024-09-21T03:50:02.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.240+0000 7f1068061640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1060112890 con 0x7f10601051e0 2024-09-21T03:50:02.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.240+0000 7f1068061640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1060112b90 con 0x7f1060105b30 2024-09-21T03:50:02.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.240+0000 7f1065dfd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1060103210 0x7f106019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:02.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.241+0000 7f1065dfd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1060103210 0x7f106019a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44138/0 (socket says 172.21.15.84:44138) 2024-09-21T03:50:02.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.241+0000 7f1065dfd640 1 -- 172.21.15.84:0/4087718246 learned_addr learned my addr 172.21.15.84:0/4087718246 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:02.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.241+0000 7f10665fe640 1 --2- 172.21.15.84:0/4087718246 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1060105b30 0x7f106019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:02.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.241+0000 7f1065dfd640 1 -- 172.21.15.84:0/4087718246 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1060105b30 msgr2=0x7f106019fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:02.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.241+0000 7f1065dfd640 1 --2- 172.21.15.84:0/4087718246 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1060105b30 0x7f106019fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.241+0000 7f10655fc640 1 --2- 172.21.15.84:0/4087718246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10601051e0 0x7f106019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:02.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.241+0000 7f1065dfd640 1 -- 172.21.15.84:0/4087718246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10601051e0 msgr2=0x7f106019aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:02.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.241+0000 7f1065dfd640 1 --2- 172.21.15.84:0/4087718246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10601051e0 0x7f106019aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.241+0000 7f1065dfd640 1 -- 172.21.15.84:0/4087718246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10601a04c0 con 0x7f1060103210 2024-09-21T03:50:02.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.241+0000 7f1065dfd640 1 --2- 172.21.15.84:0/4087718246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1060103210 0x7f106019a550 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f105c00b4a0 tx=0x7f105c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:02.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.241+0000 7f1056ffd640 1 -- 172.21.15.84:0/4087718246 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c014070 con 0x7f1060103210 2024-09-21T03:50:02.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.241+0000 7f1056ffd640 1 -- 172.21.15.84:0/4087718246 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f105c010ac0 con 0x7f1060103210 2024-09-21T03:50:02.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.241+0000 7f1068061640 1 -- 172.21.15.84:0/4087718246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10601a07b0 con 0x7f1060103210 2024-09-21T03:50:02.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.241+0000 7f1056ffd640 1 -- 172.21.15.84:0/4087718246 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c017c30 con 0x7f1060103210 2024-09-21T03:50:02.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.241+0000 7f1068061640 1 -- 172.21.15.84:0/4087718246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10601a6f10 con 0x7f1060103210 2024-09-21T03:50:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.244+0000 7f106e5d5740 1 Processor -- start 2024-09-21T03:50:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.244+0000 7f106e5d5740 1 -- start start 2024-09-21T03:50:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.244+0000 7f1056ffd640 1 -- 172.21.15.84:0/4087718246 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f105c017070 con 0x7f1060103210 2024-09-21T03:50:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.244+0000 7f106e5d5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607d8e32070 0x5607d91d9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.244+0000 7f106e5d5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e091b0 0x5607d91d9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.244+0000 7f106e5d5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e11390 0x5607d91da0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.244+0000 7f106e5d5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5607d914fe50 con 0x5607d8e091b0 2024-09-21T03:50:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.244+0000 7f106e5d5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5607d913f280 con 0x5607d8e11390 2024-09-21T03:50:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.244+0000 7f106e5d5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5607d9143090 con 0x5607d8e32070 2024-09-21T03:50:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.244+0000 7f1065dfd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e091b0 0x5607d91d9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.244+0000 7f1065dfd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e091b0 0x5607d91d9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44146/0 (socket says 172.21.15.84:44146) 2024-09-21T03:50:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.245+0000 7f1065dfd640 1 -- 172.21.15.84:0/4189706253 learned_addr learned my addr 172.21.15.84:0/4189706253 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:02.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.245+0000 7f10665fe640 1 --2- 172.21.15.84:0/4189706253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607d8e32070 0x5607d91d9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:02.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.245+0000 7f10655fc640 1 --2- 172.21.15.84:0/4189706253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e11390 0x5607d91da0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:02.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.245+0000 7f1065dfd640 1 -- 172.21.15.84:0/4189706253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607d8e32070 msgr2=0x5607d91d9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:02.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.245+0000 7f1065dfd640 1 --2- 172.21.15.84:0/4189706253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607d8e32070 0x5607d91d9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.245+0000 7f1065dfd640 1 -- 172.21.15.84:0/4189706253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e11390 msgr2=0x5607d91da0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:02.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.245+0000 7f1065dfd640 1 --2- 172.21.15.84:0/4189706253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e11390 0x5607d91da0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.245+0000 7f1065dfd640 1 -- 172.21.15.84:0/4189706253 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607d8e9d650 con 0x5607d8e091b0 2024-09-21T03:50:02.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.245+0000 7f10655fc640 1 --2- 172.21.15.84:0/4189706253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e11390 0x5607d91da0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:50:02.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.245+0000 7f1056ffd640 1 --2- 172.21.15.84:0/4087718246 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f104c0b6680 0x7f104c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:02.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.245+0000 7f1065dfd640 1 --2- 172.21.15.84:0/4189706253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e091b0 0x5607d91d9b90 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f105c0e4150 tx=0x7f105c0ef580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a0226e85eb48fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:02.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.245+0000 7f10665fe640 1 --2- 172.21.15.84:0/4087718246 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f104c0b6680 0x7f104c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:02.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.245+0000 7f1056ffd640 1 -- 172.21.15.84:0/4087718246 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f105c0e6a40 con 0x7f1060103210 2024-09-21T03:50:02.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.245+0000 7f104bfff640 1 -- 172.21.15.84:0/4189706253 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c0a8f30 con 0x5607d8e091b0 2024-09-21T03:50:02.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.245+0000 7f104bfff640 1 -- 172.21.15.84:0/4189706253 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f105c017360 con 0x5607d8e091b0 2024-09-21T03:50:02.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.245+0000 7f104bfff640 1 -- 172.21.15.84:0/4189706253 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c0ac050 con 0x5607d8e091b0 2024-09-21T03:50:02.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.246+0000 7f106e5d5740 1 -- 172.21.15.84:0/4189706253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e091b0 msgr2=0x5607d91d9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:02.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.246+0000 7f10665fe640 1 --2- 172.21.15.84:0/4087718246 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f104c0b6680 0x7f104c0b8b90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1058005fd0 tx=0x7f1058009860 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:02.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.246+0000 7f106e5d5740 1 --2- 172.21.15.84:0/4189706253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e091b0 0x5607d91d9b90 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f105c0e4150 tx=0x7f105c0ef580 comp rx=0 tx=0).stop 2024-09-21T03:50:02.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.246+0000 7f106e5d5740 1 -- 172.21.15.84:0/4189706253 shutdown_connections 2024-09-21T03:50:02.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.246+0000 7f106e5d5740 1 --2- 172.21.15.84:0/4189706253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e11390 0x5607d91da0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.246+0000 7f106e5d5740 1 --2- 172.21.15.84:0/4189706253 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e091b0 0x5607d91d9b90 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.246+0000 7f106e5d5740 1 --2- 172.21.15.84:0/4189706253 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607d8e32070 0x5607d91d9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.246+0000 7f106e5d5740 1 -- 172.21.15.84:0/4189706253 >> 172.21.15.84:0/4189706253 conn(0x5607d8e26460 msgr2=0x5607d91d7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:02.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.246+0000 7f106e5d5740 1 -- 172.21.15.84:0/4189706253 shutdown_connections 2024-09-21T03:50:02.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.246+0000 7f106e5d5740 1 -- 172.21.15.84:0/4189706253 wait complete. 2024-09-21T03:50:02.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.247+0000 7f106e5d5740 1 -- start start 2024-09-21T03:50:02.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.247+0000 7f106e5d5740 1 Processor -- start 2024-09-21T03:50:02.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.247+0000 7f106e5d5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e091b0 0x5607d91e4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:02.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.247+0000 7f106e5d5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e11390 0x5607d91e5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:02.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.247+0000 7f106e5d5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607d8e32070 0x5607d91e57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:02.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.247+0000 7f106e5d5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5607d8fa0700 con 0x5607d8e11390 2024-09-21T03:50:02.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.247+0000 7f106e5d5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5607d90da110 con 0x5607d8e091b0 2024-09-21T03:50:02.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.247+0000 7f106e5d5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5607d91e7dd0 con 0x5607d8e32070 2024-09-21T03:50:02.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.247+0000 7f106e5d5740 10 client.0 _ll_register_callbacks cb 0x5607d90f3990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:02.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.247+0000 7f10655fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e11390 0x5607d91e5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:02.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.248+0000 7f10655fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e11390 0x5607d91e5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44154/0 (socket says 172.21.15.84:44154) 2024-09-21T03:50:02.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.248+0000 7f10655fc640 1 -- 172.21.15.84:0/286359500 learned_addr learned my addr 172.21.15.84:0/286359500 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:02.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.248+0000 7f10665fe640 1 --2- 172.21.15.84:0/286359500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607d8e32070 0x5607d91e57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:02.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.248+0000 7f1065dfd640 1 --2- 172.21.15.84:0/286359500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e091b0 0x5607d91e4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:02.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.248+0000 7f10655fc640 1 -- 172.21.15.84:0/286359500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607d8e32070 msgr2=0x5607d91e57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:02.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.248+0000 7f10655fc640 1 --2- 172.21.15.84:0/286359500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607d8e32070 0x5607d91e57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.248+0000 7f10655fc640 1 -- 172.21.15.84:0/286359500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e091b0 msgr2=0x5607d91e4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:02.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.248+0000 7f10655fc640 1 --2- 172.21.15.84:0/286359500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e091b0 0x5607d91e4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.248+0000 7f10655fc640 1 -- 172.21.15.84:0/286359500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607d9107c40 con 0x5607d8e11390 2024-09-21T03:50:02.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.248+0000 7f1065dfd640 1 --2- 172.21.15.84:0/286359500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e091b0 0x5607d91e4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:02.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.248+0000 7f10655fc640 1 --2- 172.21.15.84:0/286359500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e11390 0x5607d91e5220 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1050009900 tx=0x7f10500316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc445b32a670e82c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:02.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.248+0000 7f10497fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:02.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.248+0000 7f10497fa640 1 -- 172.21.15.84:0/286359500 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105003f070 con 0x5607d8e11390 2024-09-21T03:50:02.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.248+0000 7f10497fa640 1 -- 172.21.15.84:0/286359500 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f1050004240 con 0x5607d8e11390 2024-09-21T03:50:02.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.248+0000 7f106e5d5740 1 -- 172.21.15.84:0/286359500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5607d9151da0 con 0x5607d8e11390 2024-09-21T03:50:02.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.248+0000 7f10497fa640 1 -- 172.21.15.84:0/286359500 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1050035070 con 0x5607d8e11390 2024-09-21T03:50:02.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.248+0000 7f106e5d5740 10 client.16845 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:02.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.248+0000 7f106e5d5740 1 -- 172.21.15.84:0/286359500 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5607d91f3aa0 con 0x5607d8e11390 2024-09-21T03:50:02.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.249+0000 7f10497fa640 1 -- 172.21.15.84:0/286359500 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5607d9151da0 con 0x5607d8e11390 2024-09-21T03:50:02.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.249+0000 7f10497fa640 1 -- 172.21.15.84:0/286359500 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1050004b00 con 0x5607d8e11390 2024-09-21T03:50:02.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.249+0000 7f106e5d5740 10 client.16845 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:02.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.249+0000 7f106e5d5740 10 client.16845 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:50:02.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.249+0000 7f106e5d5740 20 client.16845 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:02.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.249+0000 7f106e5d5740 1 --2- 172.21.15.84:0/286359500 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5607d8df09f0 0x5607d91f6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:02.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.249+0000 7f106e5d5740 4 client.16845 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:50:02.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.249+0000 7f106e5d5740 1 -- 172.21.15.84:0/286359500 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607d914d850 con 0x5607d8df09f0 2024-09-21T03:50:02.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.249+0000 7f1065dfd640 1 --2- 172.21.15.84:0/286359500 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5607d8df09f0 0x5607d91f6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:02.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.250+0000 7f10497fa640 10 client.16845 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:02.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.250+0000 7f1065dfd640 1 --2- 172.21.15.84:0/286359500 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5607d8df09f0 0x5607d91f6fa0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d87b39c62232b56d server_cookie=cb43ff4e8d50592e in_seq=0 out_seq=0 2024-09-21T03:50:02.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.250+0000 7f10497fa640 1 -- 172.21.15.84:0/286359500 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5607d914d850 con 0x5607d8df09f0 2024-09-21T03:50:02.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.250+0000 7f10497fa640 10 client.16845 handle_command_reply: tid=0 2024-09-21T03:50:02.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.251+0000 7f106e5d5740 1 client.16845 shutdown 2024-09-21T03:50:02.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.251+0000 7f106e5d5740 1 -- 172.21.15.84:0/286359500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e11390 msgr2=0x5607d91e5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:02.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.251+0000 7f106e5d5740 1 --2- 172.21.15.84:0/286359500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e11390 0x5607d91e5220 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1050009900 tx=0x7f10500316d0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.251+0000 7f106e5d5740 1 -- 172.21.15.84:0/286359500 shutdown_connections 2024-09-21T03:50:02.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.251+0000 7f106e5d5740 1 --2- 172.21.15.84:0/286359500 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5607d8df09f0 0x5607d91f6fa0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.251+0000 7f106e5d5740 1 --2- 172.21.15.84:0/286359500 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607d8e32070 0x5607d91e57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.251+0000 7f10497fa640 0 client.16845 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:02.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.251+0000 7f106e5d5740 1 --2- 172.21.15.84:0/286359500 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e11390 0x5607d91e5220 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.251+0000 7f106e5d5740 1 --2- 172.21.15.84:0/286359500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e091b0 0x5607d91e4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.251+0000 7f106e5d5740 1 -- 172.21.15.84:0/286359500 >> 172.21.15.84:0/286359500 conn(0x5607d8e26460 msgr2=0x5607d91dc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:02.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.251+0000 7f106e5d5740 1 -- 172.21.15.84:0/286359500 shutdown_connections 2024-09-21T03:50:02.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.251+0000 7f106e5d5740 1 -- 172.21.15.84:0/286359500 wait complete. 2024-09-21T03:50:02.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.251+0000 7f106e5d5740 20 client.16845 trim_cache size 0 max 16384 2024-09-21T03:50:02.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.268+0000 7f106e5d5740 1 Processor -- start 2024-09-21T03:50:02.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.268+0000 7f106e5d5740 1 -- start start 2024-09-21T03:50:02.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.268+0000 7f106e5d5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e091b0 0x5607d91e6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:02.271 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.268+0000 7f106e5d5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e11390 0x5607d91d6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.268+0000 7f106e5d5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607d8e32070 0x5607d91d70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.268+0000 7f106e5d5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f10601b1f60 con 0x5607d8e11390 2024-09-21T03:50:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.268+0000 7f106e5d5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f10601af830 con 0x5607d8e091b0 2024-09-21T03:50:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.268+0000 7f106e5d5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f10601ad6a0 con 0x5607d8e32070 2024-09-21T03:50:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.268+0000 7f10655fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e11390 0x5607d91d6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.269+0000 7f10655fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e11390 0x5607d91d6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44166/0 (socket says 172.21.15.84:44166) 2024-09-21T03:50:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.269+0000 7f10655fc640 1 -- 172.21.15.84:0/3184894359 learned_addr learned my addr 172.21.15.84:0/3184894359 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.269+0000 7f1065dfd640 1 --2- 172.21.15.84:0/3184894359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e091b0 0x5607d91e6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.269+0000 7f10655fc640 1 -- 172.21.15.84:0/3184894359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607d8e32070 msgr2=0x5607d91d70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.269+0000 7f10655fc640 1 --2- 172.21.15.84:0/3184894359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607d8e32070 0x5607d91d70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.269+0000 7f10655fc640 1 -- 172.21.15.84:0/3184894359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e091b0 msgr2=0x5607d91e6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.269+0000 7f10655fc640 1 --2- 172.21.15.84:0/3184894359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e091b0 0x5607d91e6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.269+0000 7f10655fc640 1 -- 172.21.15.84:0/3184894359 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607d91e70b0 con 0x5607d8e11390 2024-09-21T03:50:02.272 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.269+0000 7f1065dfd640 1 --2- 172.21.15.84:0/3184894359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e091b0 0x5607d91e6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:02.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.269+0000 7f10655fc640 1 --2- 172.21.15.84:0/3184894359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e11390 0x5607d91d6b70 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f1050006010 tx=0x7f1050031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a78a509638f6c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:02.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.269+0000 7f104b7fe640 1 -- 172.21.15.84:0/3184894359 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105003f070 con 0x5607d8e11390 2024-09-21T03:50:02.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.269+0000 7f104b7fe640 1 -- 172.21.15.84:0/3184894359 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1050005000 con 0x5607d8e11390 2024-09-21T03:50:02.273 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.269+0000 7f104b7fe640 1 -- 172.21.15.84:0/3184894359 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1050003d70 con 0x5607d8e11390 2024-09-21T03:50:02.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.270+0000 7f106e5d5740 1 -- 172.21.15.84:0/3184894359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e11390 msgr2=0x5607d91d6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:02.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.270+0000 7f106e5d5740 1 --2- 172.21.15.84:0/3184894359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e11390 0x5607d91d6b70 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f1050006010 tx=0x7f1050031a50 comp rx=0 tx=0).stop 2024-09-21T03:50:02.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.270+0000 7f106e5d5740 1 -- 172.21.15.84:0/3184894359 shutdown_connections 2024-09-21T03:50:02.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.270+0000 7f106e5d5740 1 --2- 172.21.15.84:0/3184894359 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607d8e32070 0x5607d91d70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.270+0000 7f106e5d5740 1 --2- 172.21.15.84:0/3184894359 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e11390 0x5607d91d6b70 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.276 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.270+0000 7f106e5d5740 1 --2- 172.21.15.84:0/3184894359 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e091b0 0x5607d91e6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.270+0000 7f106e5d5740 1 -- 172.21.15.84:0/3184894359 >> 172.21.15.84:0/3184894359 conn(0x5607d8e26460 msgr2=0x5607d91db040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:02.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.270+0000 7f106e5d5740 1 -- 172.21.15.84:0/3184894359 shutdown_connections 2024-09-21T03:50:02.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.270+0000 7f106e5d5740 1 -- 172.21.15.84:0/3184894359 wait complete. 2024-09-21T03:50:02.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.270+0000 7f106e5d5740 1 -- start start 2024-09-21T03:50:02.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.271+0000 7f106e5d5740 1 Processor -- start 2024-09-21T03:50:02.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.271+0000 7f106e5d5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e091b0 0x5607d91ed690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:02.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.271+0000 7f106e5d5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607d8e11390 0x5607d91e8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:02.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.271+0000 7f106e5d5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e32070 0x5607d91e9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:02.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.271+0000 7f106e5d5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f10601adcf0 con 0x5607d8e091b0 2024-09-21T03:50:02.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.271+0000 7f106e5d5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f10601af160 con 0x5607d8e32070 2024-09-21T03:50:02.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.271+0000 7f106e5d5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f10601ae3c0 con 0x5607d8e11390 2024-09-21T03:50:02.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.271+0000 7f106e5d5740 10 client.0 _ll_register_callbacks cb 0x7f1050009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:02.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.271+0000 7f1065dfd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e091b0 0x5607d91ed690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:02.277 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.271+0000 7f1065dfd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e091b0 0x5607d91ed690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:44168/0 (socket says 172.21.15.84:44168) 2024-09-21T03:50:02.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.271+0000 7f1065dfd640 1 -- 172.21.15.84:0/48367467 learned_addr learned my addr 172.21.15.84:0/48367467 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:02.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.271+0000 7f10665fe640 1 --2- 172.21.15.84:0/48367467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e32070 0x5607d91e9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:02.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.271+0000 7f10655fc640 1 --2- 172.21.15.84:0/48367467 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607d8e11390 0x5607d91e8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:02.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.271+0000 7f1065dfd640 1 -- 172.21.15.84:0/48367467 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607d8e11390 msgr2=0x5607d91e8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:02.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.271+0000 7f1065dfd640 1 --2- 172.21.15.84:0/48367467 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607d8e11390 0x5607d91e8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.271+0000 7f1065dfd640 1 -- 172.21.15.84:0/48367467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e32070 msgr2=0x5607d91e9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:02.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.271+0000 7f1065dfd640 1 --2- 172.21.15.84:0/48367467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e32070 0x5607d91e9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.271+0000 7f1065dfd640 1 -- 172.21.15.84:0/48367467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607d91e9670 con 0x5607d8e091b0 2024-09-21T03:50:02.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.272+0000 7f1065dfd640 1 --2- 172.21.15.84:0/48367467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e091b0 0x5607d91ed690 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f105c004700 tx=0x7f105c0092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba7fe68f5c0a9f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:02.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.272+0000 7f10497fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:02.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.272+0000 7f10497fa640 1 -- 172.21.15.84:0/48367467 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105c01e070 con 0x5607d8e091b0 2024-09-21T03:50:02.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.272+0000 7f10497fa640 1 -- 172.21.15.84:0/48367467 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8441+0+0 (secure 0 0 0) 0x7f105c010c70 con 0x5607d8e091b0 2024-09-21T03:50:02.278 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.272+0000 7f106e5d5740 1 -- 172.21.15.84:0/48367467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1050005000 con 0x5607d8e091b0 2024-09-21T03:50:02.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.272+0000 7f10497fa640 1 -- 172.21.15.84:0/48367467 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f105c0ac230 con 0x5607d8e091b0 2024-09-21T03:50:02.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.272+0000 7f106e5d5740 10 client.16851 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:02.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.272+0000 7f106e5d5740 1 -- 172.21.15.84:0/48367467 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5607d9265a90 con 0x5607d8e091b0 2024-09-21T03:50:02.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.272+0000 7f10497fa640 1 -- 172.21.15.84:0/48367467 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1050005000 con 0x5607d8e091b0 2024-09-21T03:50:02.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.272+0000 7f10497fa640 1 -- 172.21.15.84:0/48367467 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f105c0e4460 con 0x5607d8e091b0 2024-09-21T03:50:02.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.272+0000 7f106e5d5740 10 client.16851 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:02.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.272+0000 7f106e5d5740 10 client.16851 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:50:02.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.272+0000 7f106e5d5740 20 client.16851 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:02.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.272+0000 7f106e5d5740 1 --2- 172.21.15.84:0/48367467 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5607d8dc5da0 0x5607d9267e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:02.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.272+0000 7f106e5d5740 4 client.16851 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:50:02.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.272+0000 7f106e5d5740 1 -- 172.21.15.84:0/48367467 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5607d914ac80 con 0x5607d8dc5da0 2024-09-21T03:50:02.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.273+0000 7f10655fc640 1 --2- 172.21.15.84:0/48367467 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5607d8dc5da0 0x5607d9267e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:02.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.273+0000 7f10497fa640 10 client.16851 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:02.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.273+0000 7f10655fc640 1 --2- 172.21.15.84:0/48367467 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5607d8dc5da0 0x5607d9267e20 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=420876806b170b54 server_cookie=2a76b4f904ec69d5 in_seq=0 out_seq=0 2024-09-21T03:50:02.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.273+0000 7f10497fa640 1 -- 172.21.15.84:0/48367467 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3978 (crc 0 0 0) 0x5607d914ac80 con 0x5607d8dc5da0 2024-09-21T03:50:02.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.274+0000 7f10497fa640 10 client.16851 handle_command_reply: tid=0 2024-09-21T03:50:02.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.274+0000 7f106e5d5740 1 client.16851 shutdown 2024-09-21T03:50:02.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.274+0000 7f106e5d5740 1 -- 172.21.15.84:0/48367467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e091b0 msgr2=0x5607d91ed690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:02.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.274+0000 7f106e5d5740 1 --2- 172.21.15.84:0/48367467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e091b0 0x5607d91ed690 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f105c004700 tx=0x7f105c0092b0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.274+0000 7f106e5d5740 1 -- 172.21.15.84:0/48367467 shutdown_connections 2024-09-21T03:50:02.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.274+0000 7f106e5d5740 1 --2- 172.21.15.84:0/48367467 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5607d8dc5da0 0x5607d9267e20 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.274+0000 7f106e5d5740 1 --2- 172.21.15.84:0/48367467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5607d8e32070 0x5607d91e9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.274+0000 7f106e5d5740 1 --2- 172.21.15.84:0/48367467 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5607d8e11390 0x5607d91e8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.274+0000 7f106e5d5740 1 --2- 172.21.15.84:0/48367467 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5607d8e091b0 0x5607d91ed690 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.274+0000 7f10497fa640 0 client.16851 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:02.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.274+0000 7f106e5d5740 1 -- 172.21.15.84:0/48367467 >> 172.21.15.84:0/48367467 conn(0x5607d8e26460 msgr2=0x5607d91db040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:02.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.274+0000 7f106e5d5740 1 -- 172.21.15.84:0/48367467 shutdown_connections 2024-09-21T03:50:02.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.274+0000 7f106e5d5740 1 -- 172.21.15.84:0/48367467 wait complete. 2024-09-21T03:50:02.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.274+0000 7f106e5d5740 20 client.16851 trim_cache size 0 max 16384 2024-09-21T03:50:02.281 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:50:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:50:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T03:50:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "33131451-f242-447a-b13f-9bdebc7884ec": { 2024-09-21T03:50:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "33131451-f242-447a-b13f-9bdebc7884ec", 2024-09-21T03:50:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T03:50:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:50:02.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:50:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "33131451-f242-447a-b13f-9bdebc7884ec": { 2024-09-21T03:50:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:00.524357+0000", 2024-09-21T03:50:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "b2063a70-0b1f-4b6b-9c96-d886e156ea66": { 2024-09-21T03:50:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:48:34.864478+0000", 2024-09-21T03:50:02.282 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:50:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:50:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:02.283 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:50:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:50:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:50:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:50:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:02.284 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "27dcb84c-89fa-46b2-b980-58857966c697": { 2024-09-21T03:50:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:52.598527+0000", 2024-09-21T03:50:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:50:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:50:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:02.285 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:50:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:50:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "43a49cca-fc1c-4c36-a314-49033e7c3fb6": { 2024-09-21T03:50:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:49:17.366428+0000", 2024-09-21T03:50:02.286 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:50:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:50:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:02.287 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:50:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:50:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:50:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:50:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:02.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:50:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:50:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:50:02.289 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:50:02.289 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:50:02.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.274+0000 7f1068061640 1 -- 172.21.15.84:0/4087718246 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f104c0b6680 msgr2=0x7f104c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:02.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.274+0000 7f1068061640 1 --2- 172.21.15.84:0/4087718246 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f104c0b6680 0x7f104c0b8b90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1058005fd0 tx=0x7f1058009860 comp rx=0 tx=0).stop 2024-09-21T03:50:02.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.274+0000 7f1068061640 1 -- 172.21.15.84:0/4087718246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1060103210 msgr2=0x7f106019a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:02.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.274+0000 7f1068061640 1 --2- 172.21.15.84:0/4087718246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1060103210 0x7f106019a550 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f105c00b4a0 tx=0x7f105c00b960 comp rx=0 tx=0).stop 2024-09-21T03:50:02.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.275+0000 7f1068061640 1 -- 172.21.15.84:0/4087718246 shutdown_connections 2024-09-21T03:50:02.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.275+0000 7f1068061640 1 --2- 172.21.15.84:0/4087718246 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f104c0b6680 0x7f104c0b8b90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.275+0000 7f1068061640 1 --2- 172.21.15.84:0/4087718246 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1060105b30 0x7f106019fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.275+0000 7f1068061640 1 --2- 172.21.15.84:0/4087718246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10601051e0 0x7f106019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.275+0000 7f1068061640 1 --2- 172.21.15.84:0/4087718246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f1060103210 0x7f106019a550 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:02.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.275+0000 7f1068061640 1 -- 172.21.15.84:0/4087718246 >> 172.21.15.84:0/4087718246 conn(0x7f1060079f90 msgr2=0x7f10601065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:02.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.275+0000 7f1068061640 1 -- 172.21.15.84:0/4087718246 shutdown_connections 2024-09-21T03:50:02.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:02.275+0000 7f1068061640 1 -- 172.21.15.84:0/4087718246 wait complete. 2024-09-21T03:50:02.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:02 smithi084 ceph-mon[30941]: pgmap v553: 97 pgs: 97 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 61 KiB/s wr, 13 op/s 2024-09-21T03:50:02.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:02 smithi174 ceph-mon[34403]: pgmap v553: 97 pgs: 97 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 61 KiB/s wr, 13 op/s 2024-09-21T03:50:02.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:02 smithi172 ceph-mon[34821]: pgmap v553: 97 pgs: 97 active+clean; 13 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 61 KiB/s wr, 13 op/s 2024-09-21T03:50:03.143 INFO:tasks.cephfs.filesystem:scrub status for tag:33131451-f242-447a-b13f-9bdebc7884ec - {'path': '/', 'tag': '33131451-f242-447a-b13f-9bdebc7884ec', 'options': 'recursive,force'} 2024-09-21T03:50:04.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:04 smithi084 ceph-mon[30941]: pgmap v554: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 103 KiB/s wr, 29 op/s 2024-09-21T03:50:04.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:04 smithi174 ceph-mon[34403]: pgmap v554: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 103 KiB/s wr, 29 op/s 2024-09-21T03:50:04.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:04 smithi172 ceph-mon[34821]: pgmap v554: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 103 KiB/s wr, 29 op/s 2024-09-21T03:50:05.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:05 smithi084 ceph-mon[30941]: scrub summary: idle 2024-09-21T03:50:05.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:05 smithi174 ceph-mon[34403]: scrub summary: idle 2024-09-21T03:50:05.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:05 smithi172 ceph-mon[34821]: scrub summary: idle 2024-09-21T03:50:06.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:06 smithi084 ceph-mon[30941]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T03:50:06.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:06 smithi084 ceph-mon[30941]: pgmap v556: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 102 KiB/s wr, 32 op/s 2024-09-21T03:50:06.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:06 smithi174 ceph-mon[34403]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T03:50:06.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:06 smithi174 ceph-mon[34403]: pgmap v556: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 102 KiB/s wr, 32 op/s 2024-09-21T03:50:06.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:06 smithi172 ceph-mon[34821]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T03:50:06.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:06 smithi172 ceph-mon[34821]: pgmap v556: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 102 KiB/s wr, 32 op/s 2024-09-21T03:50:08.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:08 smithi084 ceph-mon[30941]: pgmap v557: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 101 KiB/s wr, 32 op/s 2024-09-21T03:50:08.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:08 smithi174 ceph-mon[34403]: pgmap v557: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 101 KiB/s wr, 32 op/s 2024-09-21T03:50:08.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:08 smithi172 ceph-mon[34821]: pgmap v557: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 101 KiB/s wr, 32 op/s 2024-09-21T03:50:10.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:10 smithi084 ceph-mon[30941]: pgmap v558: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 101 KiB/s wr, 32 op/s 2024-09-21T03:50:10.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:10 smithi174 ceph-mon[34403]: pgmap v558: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 101 KiB/s wr, 32 op/s 2024-09-21T03:50:10.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:10 smithi172 ceph-mon[34821]: pgmap v558: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 101 KiB/s wr, 32 op/s 2024-09-21T03:50:12.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:12 smithi084 ceph-mon[30941]: pgmap v559: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 74 KiB/s wr, 29 op/s 2024-09-21T03:50:12.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:12 smithi174 ceph-mon[34403]: pgmap v559: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 74 KiB/s wr, 29 op/s 2024-09-21T03:50:12.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:12 smithi172 ceph-mon[34821]: pgmap v559: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 74 KiB/s wr, 29 op/s 2024-09-21T03:50:14.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:14 smithi084 ceph-mon[30941]: pgmap v560: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 12 op/s 2024-09-21T03:50:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:14 smithi174 ceph-mon[34403]: pgmap v560: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 12 op/s 2024-09-21T03:50:14.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:14 smithi172 ceph-mon[34821]: pgmap v560: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 12 op/s 2024-09-21T03:50:16.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:16 smithi084 ceph-mon[30941]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T03:50:16.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:16 smithi174 ceph-mon[34403]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T03:50:16.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:16 smithi172 ceph-mon[34821]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T03:50:17.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:17 smithi084 ceph-mon[30941]: pgmap v562: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 12 op/s 2024-09-21T03:50:17.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:17 smithi174 ceph-mon[34403]: pgmap v562: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 12 op/s 2024-09-21T03:50:17.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:17 smithi172 ceph-mon[34821]: pgmap v562: 97 pgs: 97 active+clean; 13 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 12 op/s 2024-09-21T03:50:18.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:18 smithi084 ceph-mon[30941]: pgmap v563: 97 pgs: 97 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 55 KiB/s wr, 13 op/s 2024-09-21T03:50:18.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:18 smithi174 ceph-mon[34403]: pgmap v563: 97 pgs: 97 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 55 KiB/s wr, 13 op/s 2024-09-21T03:50:18.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:18 smithi172 ceph-mon[34821]: pgmap v563: 97 pgs: 97 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 55 KiB/s wr, 13 op/s 2024-09-21T03:50:20.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:20 smithi084 ceph-mon[30941]: pgmap v564: 97 pgs: 97 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 55 KiB/s wr, 13 op/s 2024-09-21T03:50:20.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:20 smithi174 ceph-mon[34403]: pgmap v564: 97 pgs: 97 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 55 KiB/s wr, 13 op/s 2024-09-21T03:50:20.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:20 smithi172 ceph-mon[34821]: pgmap v564: 97 pgs: 97 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 55 KiB/s wr, 13 op/s 2024-09-21T03:50:22.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:22 smithi084 ceph-mon[30941]: pgmap v565: 97 pgs: 97 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 55 KiB/s wr, 13 op/s 2024-09-21T03:50:22.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:22 smithi174 ceph-mon[34403]: pgmap v565: 97 pgs: 97 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 55 KiB/s wr, 13 op/s 2024-09-21T03:50:22.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:22 smithi172 ceph-mon[34821]: pgmap v565: 97 pgs: 97 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 55 KiB/s wr, 13 op/s 2024-09-21T03:50:24.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:24 smithi084 ceph-mon[30941]: pgmap v566: 97 pgs: 97 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 12 op/s 2024-09-21T03:50:24.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:24 smithi174 ceph-mon[34403]: pgmap v566: 97 pgs: 97 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 12 op/s 2024-09-21T03:50:24.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:24 smithi172 ceph-mon[34821]: pgmap v566: 97 pgs: 97 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 49 KiB/s wr, 12 op/s 2024-09-21T03:50:26.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:26 smithi084 ceph-mon[30941]: pgmap v567: 97 pgs: 97 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 11 op/s 2024-09-21T03:50:26.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:26 smithi174 ceph-mon[34403]: pgmap v567: 97 pgs: 97 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 11 op/s 2024-09-21T03:50:26.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:26 smithi172 ceph-mon[34821]: pgmap v567: 97 pgs: 97 active+clean; 14 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 11 op/s 2024-09-21T03:50:28.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:28 smithi084 ceph-mon[30941]: pgmap v568: 97 pgs: 97 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 15 op/s 2024-09-21T03:50:28.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:28 smithi174 ceph-mon[34403]: pgmap v568: 97 pgs: 97 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 15 op/s 2024-09-21T03:50:28.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:28 smithi172 ceph-mon[34821]: pgmap v568: 97 pgs: 97 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 15 op/s 2024-09-21T03:50:30.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:30 smithi084 ceph-mon[30941]: pgmap v569: 97 pgs: 97 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-09-21T03:50:30.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:30 smithi174 ceph-mon[34403]: pgmap v569: 97 pgs: 97 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-09-21T03:50:30.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:30 smithi172 ceph-mon[34821]: pgmap v569: 97 pgs: 97 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-09-21T03:50:32.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:32 smithi084 ceph-mon[30941]: pgmap v570: 97 pgs: 97 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 11 op/s 2024-09-21T03:50:32.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:32 smithi174 ceph-mon[34403]: pgmap v570: 97 pgs: 97 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 11 op/s 2024-09-21T03:50:32.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:32 smithi172 ceph-mon[34821]: pgmap v570: 97 pgs: 97 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 11 op/s 2024-09-21T03:50:33.145 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:50:33.409 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:50:33.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.948+0000 7fdb4b6cc640 1 -- 172.21.15.84:0/2963219438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb44108cf0 msgr2=0x7fdb4410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:33.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.948+0000 7fdb4b6cc640 1 --2- 172.21.15.84:0/2963219438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb44108cf0 0x7fdb4410f520 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c009ca0 tx=0x7fdb3c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.948+0000 7fdb4b6cc640 1 -- 172.21.15.84:0/2963219438 shutdown_connections 2024-09-21T03:50:33.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.948+0000 7fdb4b6cc640 1 --2- 172.21.15.84:0/2963219438 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb44108cf0 0x7fdb4410f520 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.948+0000 7fdb4b6cc640 1 --2- 172.21.15.84:0/2963219438 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb441083a0 0x7fdb441087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.948+0000 7fdb4b6cc640 1 --2- 172.21.15.84:0/2963219438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb44102a60 0x7fdb44102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.948+0000 7fdb4b6cc640 1 -- 172.21.15.84:0/2963219438 >> 172.21.15.84:0/2963219438 conn(0x7fdb44079730 msgr2=0x7fdb44079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:33.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.948+0000 7fdb4b6cc640 1 -- 172.21.15.84:0/2963219438 shutdown_connections 2024-09-21T03:50:33.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.948+0000 7fdb4b6cc640 1 -- 172.21.15.84:0/2963219438 wait complete. 2024-09-21T03:50:33.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.949+0000 7fdb4b6cc640 1 Processor -- start 2024-09-21T03:50:33.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.949+0000 7fdb4b6cc640 1 -- start start 2024-09-21T03:50:33.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.949+0000 7fdb4b6cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb44102a60 0x7fdb44199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:33.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.949+0000 7fdb4b6cc640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb441083a0 0x7fdb44199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:33.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.949+0000 7fdb4b6cc640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb44108cf0 0x7fdb4419ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:33.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.949+0000 7fdb4b6cc640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdb44112a40 con 0x7fdb44102a60 2024-09-21T03:50:33.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.949+0000 7fdb4b6cc640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdb441128c0 con 0x7fdb441083a0 2024-09-21T03:50:33.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.949+0000 7fdb4b6cc640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdb44112bc0 con 0x7fdb44108cf0 2024-09-21T03:50:33.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.949+0000 7fdb49468640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb44102a60 0x7fdb44199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:33.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.949+0000 7fdb49468640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb44102a60 0x7fdb44199510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53570/0 (socket says 172.21.15.84:53570) 2024-09-21T03:50:33.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.949+0000 7fdb49468640 1 -- 172.21.15.84:0/1922723790 learned_addr learned my addr 172.21.15.84:0/1922723790 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:33.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.949+0000 7fdb48c67640 1 --2- 172.21.15.84:0/1922723790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb441083a0 0x7fdb44199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:33.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.949+0000 7fdb49c69640 1 --2- 172.21.15.84:0/1922723790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb44108cf0 0x7fdb4419ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:33.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.949+0000 7fdb49468640 1 -- 172.21.15.84:0/1922723790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb44108cf0 msgr2=0x7fdb4419ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:33.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.949+0000 7fdb49468640 1 --2- 172.21.15.84:0/1922723790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb44108cf0 0x7fdb4419ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.950+0000 7fdb49468640 1 -- 172.21.15.84:0/1922723790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb441083a0 msgr2=0x7fdb44199ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:33.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.950+0000 7fdb49468640 1 --2- 172.21.15.84:0/1922723790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb441083a0 0x7fdb44199ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.950+0000 7fdb49468640 1 -- 172.21.15.84:0/1922723790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4419f480 con 0x7fdb44102a60 2024-09-21T03:50:33.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.950+0000 7fdb49c69640 1 --2- 172.21.15.84:0/1922723790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb44108cf0 0x7fdb4419ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:33.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.950+0000 7fdb48c67640 1 --2- 172.21.15.84:0/1922723790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb441083a0 0x7fdb44199ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:50:33.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.950+0000 7fdb49468640 1 --2- 172.21.15.84:0/1922723790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb44102a60 0x7fdb44199510 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400b4a0 tx=0x7fdb3400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:33.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.950+0000 7fdb427fc640 1 -- 172.21.15.84:0/1922723790 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb34014070 con 0x7fdb44102a60 2024-09-21T03:50:33.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.950+0000 7fdb427fc640 1 -- 172.21.15.84:0/1922723790 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb34010ac0 con 0x7fdb44102a60 2024-09-21T03:50:33.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.950+0000 7fdb4b6cc640 1 -- 172.21.15.84:0/1922723790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb4419f770 con 0x7fdb44102a60 2024-09-21T03:50:33.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.950+0000 7fdb427fc640 1 -- 172.21.15.84:0/1922723790 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb34017c30 con 0x7fdb44102a60 2024-09-21T03:50:33.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.950+0000 7fdb4b6cc640 1 -- 172.21.15.84:0/1922723790 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb441a5ed0 con 0x7fdb44102a60 2024-09-21T03:50:33.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.953+0000 7fdb427fc640 1 -- 172.21.15.84:0/1922723790 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fdb34017070 con 0x7fdb44102a60 2024-09-21T03:50:33.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.953+0000 7fdb51c40740 1 Processor -- start 2024-09-21T03:50:33.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.953+0000 7fdb51c40740 1 -- start start 2024-09-21T03:50:33.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.953+0000 7fdb51c40740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560189a79070 0x560189e20650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:33.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.953+0000 7fdb51c40740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 0x560189e20b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:33.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.953+0000 7fdb51c40740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a58390 0x560189e210d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:33.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.953+0000 7fdb51c40740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560189d96e50 con 0x560189a58390 2024-09-21T03:50:33.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.953+0000 7fdb51c40740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560189d86280 con 0x560189a79070 2024-09-21T03:50:33.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.953+0000 7fdb51c40740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560189d8a090 con 0x560189a501b0 2024-09-21T03:50:33.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.953+0000 7fdb48c67640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a58390 0x560189e210d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:33.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.953+0000 7fdb48c67640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a58390 0x560189e210d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53586/0 (socket says 172.21.15.84:53586) 2024-09-21T03:50:33.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.953+0000 7fdb48c67640 1 -- 172.21.15.84:0/1017052138 learned_addr learned my addr 172.21.15.84:0/1017052138 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:33.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.953+0000 7fdb49c69640 1 --2- 172.21.15.84:0/1017052138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560189a79070 0x560189e20650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:33.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.953+0000 7fdb49468640 1 --2- 172.21.15.84:0/1017052138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 0x560189e20b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:33.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.953+0000 7fdb48c67640 1 -- 172.21.15.84:0/1017052138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 msgr2=0x560189e20b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:33.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.953+0000 7fdb48c67640 1 --2- 172.21.15.84:0/1017052138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 0x560189e20b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.953+0000 7fdb48c67640 1 -- 172.21.15.84:0/1017052138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560189a79070 msgr2=0x560189e20650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:33.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.953+0000 7fdb48c67640 1 --2- 172.21.15.84:0/1017052138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560189a79070 0x560189e20650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.953+0000 7fdb48c67640 1 -- 172.21.15.84:0/1017052138 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560189ae4650 con 0x560189a58390 2024-09-21T03:50:33.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.954+0000 7fdb427fc640 1 --2- 172.21.15.84:0/1922723790 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdb2c0b6680 0x7fdb2c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:33.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.954+0000 7fdb49c69640 1 --2- 172.21.15.84:0/1922723790 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdb2c0b6680 0x7fdb2c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:33.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.954+0000 7fdb48c67640 1 --2- 172.21.15.84:0/1017052138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a58390 0x560189e210d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fdb380077b0 tx=0x7fdb38007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192027a837970ba2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:33.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.954+0000 7fdb427fc640 1 -- 172.21.15.84:0/1922723790 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fdb340e6d60 con 0x7fdb44102a60 2024-09-21T03:50:33.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.954+0000 7fdb2b7fe640 1 -- 172.21.15.84:0/1017052138 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3800d950 con 0x560189a58390 2024-09-21T03:50:33.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.954+0000 7fdb2b7fe640 1 -- 172.21.15.84:0/1017052138 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb38018070 con 0x560189a58390 2024-09-21T03:50:33.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.954+0000 7fdb2b7fe640 1 -- 172.21.15.84:0/1017052138 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb380123e0 con 0x560189a58390 2024-09-21T03:50:33.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.955+0000 7fdb51c40740 1 -- 172.21.15.84:0/1017052138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a58390 msgr2=0x560189e210d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:33.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.955+0000 7fdb49c69640 1 --2- 172.21.15.84:0/1922723790 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdb2c0b6680 0x7fdb2c0b8b90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0094e0 tx=0x7fdb3c009360 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:33.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.955+0000 7fdb51c40740 1 --2- 172.21.15.84:0/1017052138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a58390 0x560189e210d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fdb380077b0 tx=0x7fdb38007c70 comp rx=0 tx=0).stop 2024-09-21T03:50:33.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.955+0000 7fdb51c40740 1 -- 172.21.15.84:0/1017052138 shutdown_connections 2024-09-21T03:50:33.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.955+0000 7fdb51c40740 1 --2- 172.21.15.84:0/1017052138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a58390 0x560189e210d0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.955+0000 7fdb51c40740 1 --2- 172.21.15.84:0/1017052138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 0x560189e20b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.955+0000 7fdb51c40740 1 --2- 172.21.15.84:0/1017052138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560189a79070 0x560189e20650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.955+0000 7fdb51c40740 1 -- 172.21.15.84:0/1017052138 >> 172.21.15.84:0/1017052138 conn(0x560189a6d460 msgr2=0x560189e1e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:33.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.955+0000 7fdb51c40740 1 -- 172.21.15.84:0/1017052138 shutdown_connections 2024-09-21T03:50:33.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.955+0000 7fdb51c40740 1 -- 172.21.15.84:0/1017052138 wait complete. 2024-09-21T03:50:33.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.955+0000 7fdb51c40740 1 -- start start 2024-09-21T03:50:33.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.955+0000 7fdb51c40740 1 Processor -- start 2024-09-21T03:50:33.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.956+0000 7fdb51c40740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 0x560189e2de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:33.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.956+0000 7fdb51c40740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560189a58390 0x560189e2e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:33.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.956+0000 7fdb51c40740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a79070 0x560189e2e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:33.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.956+0000 7fdb51c40740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x560189be7700 con 0x560189a79070 2024-09-21T03:50:33.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.956+0000 7fdb51c40740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560189d21110 con 0x560189a58390 2024-09-21T03:50:33.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.956+0000 7fdb51c40740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x560189e30f90 con 0x560189a501b0 2024-09-21T03:50:33.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.956+0000 7fdb51c40740 10 client.0 _ll_register_callbacks cb 0x560189d3a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:33.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.956+0000 7fdb49c69640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a79070 0x560189e2e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:33.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.956+0000 7fdb49c69640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a79070 0x560189e2e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53592/0 (socket says 172.21.15.84:53592) 2024-09-21T03:50:33.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.956+0000 7fdb49c69640 1 -- 172.21.15.84:0/190175930 learned_addr learned my addr 172.21.15.84:0/190175930 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:33.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.956+0000 7fdb48c67640 1 --2- 172.21.15.84:0/190175930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560189a58390 0x560189e2e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:33.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.956+0000 7fdb49468640 1 --2- 172.21.15.84:0/190175930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 0x560189e2de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:33.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.956+0000 7fdb49c69640 1 -- 172.21.15.84:0/190175930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 msgr2=0x560189e2de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:33.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.956+0000 7fdb49c69640 1 --2- 172.21.15.84:0/190175930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 0x560189e2de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.956+0000 7fdb49c69640 1 -- 172.21.15.84:0/190175930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560189a58390 msgr2=0x560189e2e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:33.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.956+0000 7fdb49c69640 1 --2- 172.21.15.84:0/190175930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560189a58390 0x560189e2e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.956+0000 7fdb49c69640 1 -- 172.21.15.84:0/190175930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560189d4ec40 con 0x560189a79070 2024-09-21T03:50:33.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.957+0000 7fdb49c69640 1 --2- 172.21.15.84:0/190175930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a79070 0x560189e2e8e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c031690 tx=0x7fdb3c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7310c6ff58b002a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:33.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.957+0000 7fdb28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:33.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.957+0000 7fdb28ff9640 1 -- 172.21.15.84:0/190175930 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c004310 con 0x560189a79070 2024-09-21T03:50:33.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.957+0000 7fdb51c40740 1 -- 172.21.15.84:0/190175930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb38018070 con 0x560189a79070 2024-09-21T03:50:33.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.957+0000 7fdb28ff9640 1 -- 172.21.15.84:0/190175930 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fdb3c0044b0 con 0x560189a79070 2024-09-21T03:50:33.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.957+0000 7fdb28ff9640 1 -- 172.21.15.84:0/190175930 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdb3c0046b0 con 0x560189a79070 2024-09-21T03:50:33.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.957+0000 7fdb51c40740 10 client.16863 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:33.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.957+0000 7fdb51c40740 1 -- 172.21.15.84:0/190175930 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560189e3cc00 con 0x560189a79070 2024-09-21T03:50:33.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.957+0000 7fdb28ff9640 1 -- 172.21.15.84:0/190175930 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb38018070 con 0x560189a79070 2024-09-21T03:50:33.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.957+0000 7fdb28ff9640 1 -- 172.21.15.84:0/190175930 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdb3c050070 con 0x560189a79070 2024-09-21T03:50:33.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.957+0000 7fdb51c40740 10 client.16863 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:33.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.957+0000 7fdb51c40740 10 client.16863 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:50:33.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.957+0000 7fdb51c40740 20 client.16863 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.958+0000 7fdb51c40740 1 --2- 172.21.15.84:0/190175930 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560189a379f0 0x560189e40110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.958+0000 7fdb51c40740 4 client.16863 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:50:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.958+0000 7fdb51c40740 1 -- 172.21.15.84:0/190175930 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560189d98da0 con 0x560189a379f0 2024-09-21T03:50:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.958+0000 7fdb49468640 1 --2- 172.21.15.84:0/190175930 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560189a379f0 0x560189e40110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.958+0000 7fdb49468640 1 --2- 172.21.15.84:0/190175930 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560189a379f0 0x560189e40110 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d620bf12a7411efa server_cookie=7f0356b06c552b0c in_seq=0 out_seq=0 2024-09-21T03:50:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.958+0000 7fdb28ff9640 10 client.16863 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.959+0000 7fdb28ff9640 1 -- 172.21.15.84:0/190175930 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560189d98da0 con 0x560189a379f0 2024-09-21T03:50:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.959+0000 7fdb28ff9640 10 client.16863 handle_command_reply: tid=0 2024-09-21T03:50:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.959+0000 7fdb51c40740 1 client.16863 shutdown 2024-09-21T03:50:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.959+0000 7fdb51c40740 1 -- 172.21.15.84:0/190175930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a79070 msgr2=0x560189e2e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.959+0000 7fdb51c40740 1 --2- 172.21.15.84:0/190175930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a79070 0x560189e2e8e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c031690 tx=0x7fdb3c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.959+0000 7fdb51c40740 1 -- 172.21.15.84:0/190175930 shutdown_connections 2024-09-21T03:50:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.959+0000 7fdb51c40740 1 --2- 172.21.15.84:0/190175930 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560189a379f0 0x560189e40110 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.959+0000 7fdb51c40740 1 --2- 172.21.15.84:0/190175930 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a79070 0x560189e2e8e0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.959+0000 7fdb28ff9640 0 client.16863 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.959+0000 7fdb51c40740 1 --2- 172.21.15.84:0/190175930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560189a58390 0x560189e2e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.959+0000 7fdb51c40740 1 --2- 172.21.15.84:0/190175930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 0x560189e2de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.959+0000 7fdb51c40740 1 -- 172.21.15.84:0/190175930 >> 172.21.15.84:0/190175930 conn(0x560189a6d460 msgr2=0x560189e1cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.959+0000 7fdb51c40740 1 -- 172.21.15.84:0/190175930 shutdown_connections 2024-09-21T03:50:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.959+0000 7fdb51c40740 1 -- 172.21.15.84:0/190175930 wait complete. 2024-09-21T03:50:33.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.960+0000 7fdb51c40740 20 client.16863 trim_cache size 0 max 16384 2024-09-21T03:50:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.977+0000 7fdb51c40740 1 Processor -- start 2024-09-21T03:50:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.977+0000 7fdb51c40740 1 -- start start 2024-09-21T03:50:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.977+0000 7fdb51c40740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a379f0 0x560189e2fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.977+0000 7fdb51c40740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 0x560189e2b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.977+0000 7fdb51c40740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560189a58390 0x560189e2b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.977+0000 7fdb51c40740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdb441afe60 con 0x560189a379f0 2024-09-21T03:50:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.977+0000 7fdb51c40740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdb441ad730 con 0x560189a58390 2024-09-21T03:50:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.977+0000 7fdb51c40740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdb441ab5a0 con 0x560189a501b0 2024-09-21T03:50:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.977+0000 7fdb49468640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a379f0 0x560189e2fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.977+0000 7fdb49468640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a379f0 0x560189e2fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53598/0 (socket says 172.21.15.84:53598) 2024-09-21T03:50:33.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.977+0000 7fdb49468640 1 -- 172.21.15.84:0/3265716401 learned_addr learned my addr 172.21.15.84:0/3265716401 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.977+0000 7fdb49c69640 1 --2- 172.21.15.84:0/3265716401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560189a58390 0x560189e2b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.978+0000 7fdb48c67640 1 --2- 172.21.15.84:0/3265716401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 0x560189e2b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.978+0000 7fdb49468640 1 -- 172.21.15.84:0/3265716401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 msgr2=0x560189e2b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.978+0000 7fdb49468640 1 --2- 172.21.15.84:0/3265716401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 0x560189e2b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.978+0000 7fdb49468640 1 -- 172.21.15.84:0/3265716401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560189a58390 msgr2=0x560189e2b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.978+0000 7fdb49468640 1 --2- 172.21.15.84:0/3265716401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560189a58390 0x560189e2b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.978+0000 7fdb49468640 1 -- 172.21.15.84:0/3265716401 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560189e22f70 con 0x560189a379f0 2024-09-21T03:50:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.978+0000 7fdb48c67640 1 --2- 172.21.15.84:0/3265716401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 0x560189e2b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.978+0000 7fdb49468640 1 --2- 172.21.15.84:0/3265716401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a379f0 0x560189e2fa90 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fdb340ac900 tx=0x7fdb340d0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7beeea9b1557958 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.978+0000 7fdb2affd640 1 -- 172.21.15.84:0/3265716401 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3401e040 con 0x560189a379f0 2024-09-21T03:50:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.978+0000 7fdb2affd640 1 -- 172.21.15.84:0/3265716401 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb34017360 con 0x560189a379f0 2024-09-21T03:50:33.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.978+0000 7fdb2affd640 1 -- 172.21.15.84:0/3265716401 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb34010d90 con 0x560189a379f0 2024-09-21T03:50:33.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.979+0000 7fdb51c40740 1 -- 172.21.15.84:0/3265716401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a379f0 msgr2=0x560189e2fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:33.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.979+0000 7fdb51c40740 1 --2- 172.21.15.84:0/3265716401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a379f0 0x560189e2fa90 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fdb340ac900 tx=0x7fdb340d0040 comp rx=0 tx=0).stop 2024-09-21T03:50:33.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.979+0000 7fdb51c40740 1 -- 172.21.15.84:0/3265716401 shutdown_connections 2024-09-21T03:50:33.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.979+0000 7fdb51c40740 1 --2- 172.21.15.84:0/3265716401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560189a58390 0x560189e2b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.979+0000 7fdb51c40740 1 --2- 172.21.15.84:0/3265716401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 0x560189e2b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.979+0000 7fdb51c40740 1 --2- 172.21.15.84:0/3265716401 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a379f0 0x560189e2fa90 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.979+0000 7fdb51c40740 1 -- 172.21.15.84:0/3265716401 >> 172.21.15.84:0/3265716401 conn(0x560189a6d460 msgr2=0x560189e2f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:33.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.979+0000 7fdb51c40740 1 -- 172.21.15.84:0/3265716401 shutdown_connections 2024-09-21T03:50:33.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.979+0000 7fdb51c40740 1 -- 172.21.15.84:0/3265716401 wait complete. 2024-09-21T03:50:33.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.979+0000 7fdb51c40740 1 -- start start 2024-09-21T03:50:33.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.979+0000 7fdb51c40740 1 Processor -- start 2024-09-21T03:50:33.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.980+0000 7fdb51c40740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 0x560189e366e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:33.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.980+0000 7fdb51c40740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560189a58390 0x560189e32ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:33.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.980+0000 7fdb51c40740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a79070 0x560189e330e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:33.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.980+0000 7fdb51c40740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdb441abbf0 con 0x560189a79070 2024-09-21T03:50:33.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.980+0000 7fdb51c40740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdb441ad060 con 0x560189a58390 2024-09-21T03:50:33.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.980+0000 7fdb51c40740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdb441ac2c0 con 0x560189a501b0 2024-09-21T03:50:33.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.980+0000 7fdb51c40740 10 client.0 _ll_register_callbacks cb 0x7fdb3c0099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:33.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.980+0000 7fdb49c69640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a79070 0x560189e330e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:33.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.980+0000 7fdb49c69640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a79070 0x560189e330e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53602/0 (socket says 172.21.15.84:53602) 2024-09-21T03:50:33.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.980+0000 7fdb49c69640 1 -- 172.21.15.84:0/2332107276 learned_addr learned my addr 172.21.15.84:0/2332107276 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:33.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.980+0000 7fdb48c67640 1 --2- 172.21.15.84:0/2332107276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560189a58390 0x560189e32ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:33.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.980+0000 7fdb49468640 1 --2- 172.21.15.84:0/2332107276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 0x560189e366e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:33.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.980+0000 7fdb49c69640 1 -- 172.21.15.84:0/2332107276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 msgr2=0x560189e366e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:33.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.980+0000 7fdb49c69640 1 --2- 172.21.15.84:0/2332107276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 0x560189e366e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.980+0000 7fdb49c69640 1 -- 172.21.15.84:0/2332107276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560189a58390 msgr2=0x560189e32ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:33.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.980+0000 7fdb49c69640 1 --2- 172.21.15.84:0/2332107276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560189a58390 0x560189e32ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.980+0000 7fdb49c69640 1 -- 172.21.15.84:0/2332107276 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560189e188a0 con 0x560189a79070 2024-09-21T03:50:33.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.981+0000 7fdb49c69640 1 --2- 172.21.15.84:0/2332107276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a79070 0x560189e330e0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c042040 tx=0x7fdb3c031da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d1028d0ab991f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:33.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.981+0000 7fdb28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:33.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.981+0000 7fdb28ff9640 1 -- 172.21.15.84:0/2332107276 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c05f070 con 0x560189a79070 2024-09-21T03:50:33.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.981+0000 7fdb28ff9640 1 -- 172.21.15.84:0/2332107276 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fdb3c030dd0 con 0x560189a79070 2024-09-21T03:50:33.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.981+0000 7fdb51c40740 1 -- 172.21.15.84:0/2332107276 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560189d94850 con 0x560189a79070 2024-09-21T03:50:33.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.981+0000 7fdb28ff9640 1 -- 172.21.15.84:0/2332107276 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdb3c068050 con 0x560189a79070 2024-09-21T03:50:33.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.981+0000 7fdb51c40740 10 client.16869 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:33.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.981+0000 7fdb51c40740 1 -- 172.21.15.84:0/2332107276 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560189eab4e0 con 0x560189a79070 2024-09-21T03:50:33.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.981+0000 7fdb28ff9640 1 -- 172.21.15.84:0/2332107276 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560189d94850 con 0x560189a79070 2024-09-21T03:50:33.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.981+0000 7fdb28ff9640 1 -- 172.21.15.84:0/2332107276 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdb3c062020 con 0x560189a79070 2024-09-21T03:50:33.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.981+0000 7fdb51c40740 10 client.16869 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:33.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.981+0000 7fdb51c40740 10 client.16869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:50:33.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.982+0000 7fdb51c40740 20 client.16869 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:33.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.982+0000 7fdb51c40740 1 --2- 172.21.15.84:0/2332107276 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560189a0cda0 0x560189eadc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:33.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.982+0000 7fdb51c40740 4 client.16869 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:50:33.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.982+0000 7fdb51c40740 1 -- 172.21.15.84:0/2332107276 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560189d91c80 con 0x560189a0cda0 2024-09-21T03:50:33.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.982+0000 7fdb49468640 1 --2- 172.21.15.84:0/2332107276 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560189a0cda0 0x560189eadc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:33.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.982+0000 7fdb49468640 1 --2- 172.21.15.84:0/2332107276 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560189a0cda0 0x560189eadc30 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=276aa544f766c0ad server_cookie=620285089ecf7abc in_seq=0 out_seq=0 2024-09-21T03:50:33.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.982+0000 7fdb28ff9640 10 client.16869 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:33.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.983+0000 7fdb28ff9640 1 -- 172.21.15.84:0/2332107276 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x560189d91c80 con 0x560189a0cda0 2024-09-21T03:50:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.983+0000 7fdb28ff9640 10 client.16869 handle_command_reply: tid=0 2024-09-21T03:50:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.983+0000 7fdb51c40740 1 client.16869 shutdown 2024-09-21T03:50:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.983+0000 7fdb51c40740 1 -- 172.21.15.84:0/2332107276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a79070 msgr2=0x560189e330e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.983+0000 7fdb51c40740 1 --2- 172.21.15.84:0/2332107276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a79070 0x560189e330e0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c042040 tx=0x7fdb3c031da0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.983+0000 7fdb51c40740 1 -- 172.21.15.84:0/2332107276 shutdown_connections 2024-09-21T03:50:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.983+0000 7fdb51c40740 1 --2- 172.21.15.84:0/2332107276 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x560189a0cda0 0x560189eadc30 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.983+0000 7fdb51c40740 1 --2- 172.21.15.84:0/2332107276 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x560189a79070 0x560189e330e0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.983+0000 7fdb51c40740 1 --2- 172.21.15.84:0/2332107276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560189a58390 0x560189e32ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.983+0000 7fdb51c40740 1 --2- 172.21.15.84:0/2332107276 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560189a501b0 0x560189e366e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.983+0000 7fdb51c40740 1 -- 172.21.15.84:0/2332107276 >> 172.21.15.84:0/2332107276 conn(0x560189a6d460 msgr2=0x560189e2cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.983+0000 7fdb28ff9640 0 client.16869 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.983+0000 7fdb51c40740 1 -- 172.21.15.84:0/2332107276 shutdown_connections 2024-09-21T03:50:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.983+0000 7fdb51c40740 1 -- 172.21.15.84:0/2332107276 wait complete. 2024-09-21T03:50:33.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.983+0000 7fdb51c40740 20 client.16869 trim_cache size 0 max 16384 2024-09-21T03:50:33.990 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:50:33.990 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T03:50:33.990 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T03:50:33.990 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:50:33.990 INFO:teuthology.orchestra.run.smithi084.stdout: "33131451-f242-447a-b13f-9bdebc7884ec": { 2024-09-21T03:50:33.990 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:00.524357+0000", 2024-09-21T03:50:33.990 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:33.990 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:33.990 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:33.990 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:33.990 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:33.990 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:33.991 INFO:teuthology.orchestra.run.smithi084.stdout: "b2063a70-0b1f-4b6b-9c96-d886e156ea66": { 2024-09-21T03:50:33.991 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:48:34.864478+0000", 2024-09-21T03:50:33.991 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:33.991 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:33.991 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:33.991 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:33.991 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:33.991 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:33.991 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:50:33.991 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:50:33.991 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:33.991 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:33.991 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:33.991 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:33.992 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:33.992 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:33.992 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:50:33.992 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:50:33.992 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:33.992 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:33.992 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:33.992 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:33.992 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:33.992 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:33.992 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:50:33.992 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:50:33.992 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:33.992 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:33.993 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:33.993 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:33.993 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:33.993 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:33.993 INFO:teuthology.orchestra.run.smithi084.stdout: "27dcb84c-89fa-46b2-b980-58857966c697": { 2024-09-21T03:50:33.993 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:52.598527+0000", 2024-09-21T03:50:33.993 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:33.993 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:33.993 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:33.993 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:33.993 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:33.993 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:33.993 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:50:33.993 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:50:33.993 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:33.994 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:33.994 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:33.994 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:33.994 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:33.994 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:33.994 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:50:33.994 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:50:33.994 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:33.994 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:33.994 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:33.994 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:33.994 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:33.994 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:33.994 INFO:teuthology.orchestra.run.smithi084.stdout: "43a49cca-fc1c-4c36-a314-49033e7c3fb6": { 2024-09-21T03:50:33.994 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:49:17.366428+0000", 2024-09-21T03:50:33.995 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:33.995 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:33.995 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:33.995 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:33.995 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:33.995 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:33.995 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:50:33.995 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:50:33.995 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:33.995 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:33.995 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:33.995 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:33.995 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:33.995 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:33.995 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:50:33.995 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:50:33.996 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:33.996 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:33.996 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:33.996 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:33.996 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:33.996 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:33.996 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:50:33.996 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:50:33.996 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:33.996 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:33.996 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:33.996 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:33.996 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:33.996 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:33.996 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:50:33.996 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:50:33.997 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:33.997 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:33.997 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:33.997 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:33.997 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:33.997 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:50:33.997 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:50:33.997 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:50:33.997 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.984+0000 7fdb4b6cc640 1 -- 172.21.15.84:0/1922723790 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdb2c0b6680 msgr2=0x7fdb2c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:33.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.984+0000 7fdb4b6cc640 1 --2- 172.21.15.84:0/1922723790 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdb2c0b6680 0x7fdb2c0b8b90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0094e0 tx=0x7fdb3c009360 comp rx=0 tx=0).stop 2024-09-21T03:50:33.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.984+0000 7fdb4b6cc640 1 -- 172.21.15.84:0/1922723790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb44102a60 msgr2=0x7fdb44199510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:33.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.984+0000 7fdb4b6cc640 1 --2- 172.21.15.84:0/1922723790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb44102a60 0x7fdb44199510 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400b4a0 tx=0x7fdb3400b960 comp rx=0 tx=0).stop 2024-09-21T03:50:33.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.984+0000 7fdb4b6cc640 1 -- 172.21.15.84:0/1922723790 shutdown_connections 2024-09-21T03:50:33.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.984+0000 7fdb4b6cc640 1 --2- 172.21.15.84:0/1922723790 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdb2c0b6680 0x7fdb2c0b8b90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.984+0000 7fdb4b6cc640 1 --2- 172.21.15.84:0/1922723790 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdb44108cf0 0x7fdb4419ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.984+0000 7fdb4b6cc640 1 --2- 172.21.15.84:0/1922723790 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb441083a0 0x7fdb44199ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.984+0000 7fdb4b6cc640 1 --2- 172.21.15.84:0/1922723790 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdb44102a60 0x7fdb44199510 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:33.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.984+0000 7fdb4b6cc640 1 -- 172.21.15.84:0/1922723790 >> 172.21.15.84:0/1922723790 conn(0x7fdb44079730 msgr2=0x7fdb44105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:33.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.984+0000 7fdb4b6cc640 1 -- 172.21.15.84:0/1922723790 shutdown_connections 2024-09-21T03:50:33.998 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:33.984+0000 7fdb4b6cc640 1 -- 172.21.15.84:0/1922723790 wait complete. 2024-09-21T03:50:34.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:34 smithi084 ceph-mon[30941]: pgmap v571: 97 pgs: 97 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 13 op/s 2024-09-21T03:50:34.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:34 smithi174 ceph-mon[34403]: pgmap v571: 97 pgs: 97 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 13 op/s 2024-09-21T03:50:34.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:34 smithi172 ceph-mon[34821]: pgmap v571: 97 pgs: 97 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 13 op/s 2024-09-21T03:50:34.908 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:50:34.908 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:50:35.152 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:50:35.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.694+0000 7f3315fe0640 1 -- 172.21.15.84:0/2790227970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3310108cf0 msgr2=0x7f331010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:35.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.694+0000 7f3315fe0640 1 --2- 172.21.15.84:0/2790227970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3310108cf0 0x7f331010f520 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f3308009ca0 tx=0x7f330802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:50:35.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.694+0000 7f3315fe0640 1 -- 172.21.15.84:0/2790227970 shutdown_connections 2024-09-21T03:50:35.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.694+0000 7f3315fe0640 1 --2- 172.21.15.84:0/2790227970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3310108cf0 0x7f331010f520 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:35.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.694+0000 7f3315fe0640 1 --2- 172.21.15.84:0/2790227970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33101083a0 0x7f33101087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:35.707 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.694+0000 7f3315fe0640 1 --2- 172.21.15.84:0/2790227970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3310102a60 0x7f3310102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:35.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.694+0000 7f3315fe0640 1 -- 172.21.15.84:0/2790227970 >> 172.21.15.84:0/2790227970 conn(0x7f3310079730 msgr2=0x7f3310079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:35.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.694+0000 7f3315fe0640 1 -- 172.21.15.84:0/2790227970 shutdown_connections 2024-09-21T03:50:35.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.694+0000 7f3315fe0640 1 -- 172.21.15.84:0/2790227970 wait complete. 2024-09-21T03:50:35.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.695+0000 7f3315fe0640 1 Processor -- start 2024-09-21T03:50:35.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.695+0000 7f3315fe0640 1 -- start start 2024-09-21T03:50:35.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.695+0000 7f3315fe0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3310102a60 0x7f331019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:35.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.695+0000 7f3315fe0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33101083a0 0x7f331019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:35.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.695+0000 7f3315fe0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3310108cf0 0x7f331019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:35.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.695+0000 7f3315fe0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3310113ac0 con 0x7f3310108cf0 2024-09-21T03:50:35.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.695+0000 7f3315fe0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3310113940 con 0x7f3310102a60 2024-09-21T03:50:35.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.695+0000 7f3315fe0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3310113c40 con 0x7f33101083a0 2024-09-21T03:50:35.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.696+0000 7f330ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3310108cf0 0x7f331019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:35.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.696+0000 7f330ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3310108cf0 0x7f331019fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53622/0 (socket says 172.21.15.84:53622) 2024-09-21T03:50:35.708 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.696+0000 7f330ffff640 1 -- 172.21.15.84:0/3727626970 learned_addr learned my addr 172.21.15.84:0/3727626970 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.696+0000 7f330f7fe640 1 --2- 172.21.15.84:0/3727626970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3310102a60 0x7f331019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.696+0000 7f330effd640 1 --2- 172.21.15.84:0/3727626970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33101083a0 0x7f331019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.696+0000 7f330f7fe640 1 -- 172.21.15.84:0/3727626970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33101083a0 msgr2=0x7f331019aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.696+0000 7f330f7fe640 1 --2- 172.21.15.84:0/3727626970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33101083a0 0x7f331019aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.696+0000 7f330f7fe640 1 -- 172.21.15.84:0/3727626970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3310108cf0 msgr2=0x7f331019fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.696+0000 7f330f7fe640 1 --2- 172.21.15.84:0/3727626970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3310108cf0 0x7f331019fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.696+0000 7f330f7fe640 1 -- 172.21.15.84:0/3727626970 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33101a0480 con 0x7f3310102a60 2024-09-21T03:50:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.696+0000 7f330ffff640 1 --2- 172.21.15.84:0/3727626970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3310108cf0 0x7f331019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:50:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.696+0000 7f330f7fe640 1 --2- 172.21.15.84:0/3727626970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3310102a60 0x7f331019a510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f330000e9f0 tx=0x7f330000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.696+0000 7f330cff9640 1 -- 172.21.15.84:0/3727626970 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330000ccc0 con 0x7f3310102a60 2024-09-21T03:50:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.696+0000 7f3315fe0640 1 -- 172.21.15.84:0/3727626970 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33101a0770 con 0x7f3310102a60 2024-09-21T03:50:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.696+0000 7f330cff9640 1 -- 172.21.15.84:0/3727626970 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33000108e0 con 0x7f3310102a60 2024-09-21T03:50:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.696+0000 7f330cff9640 1 -- 172.21.15.84:0/3727626970 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300018880 con 0x7f3310102a60 2024-09-21T03:50:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.696+0000 7f3315fe0640 1 -- 172.21.15.84:0/3727626970 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33101a6ed0 con 0x7f3310102a60 2024-09-21T03:50:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.697+0000 7f3315fe0640 1 -- 172.21.15.84:0/3727626970 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3310102e70 con 0x7f3310102a60 2024-09-21T03:50:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.699+0000 7f330cff9640 1 -- 172.21.15.84:0/3727626970 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f3300010430 con 0x7f3310102a60 2024-09-21T03:50:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.700+0000 7f330cff9640 1 --2- 172.21.15.84:0/3727626970 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f32fc0b6680 0x7f32fc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.700+0000 7f330effd640 1 --2- 172.21.15.84:0/3727626970 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f32fc0b6680 0x7f32fc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.700+0000 7f330cff9640 1 -- 172.21.15.84:0/3727626970 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f33000e7f40 con 0x7f3310102a60 2024-09-21T03:50:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.700+0000 7f330effd640 1 --2- 172.21.15.84:0/3727626970 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f32fc0b6680 0x7f32fc0b8b90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3310079d30 tx=0x7f32f8008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.703+0000 7f330cff9640 1 -- 172.21.15.84:0/3727626970 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f33000ae4e0 con 0x7f3310102a60 2024-09-21T03:50:35.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.917+0000 7f3315fe0640 1 -- 172.21.15.84:0/3727626970 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f331019b640 con 0x7f3310102a60 2024-09-21T03:50:35.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.918+0000 7f330cff9640 1 -- 172.21.15.84:0/3727626970 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7f33000b28c0 con 0x7f3310102a60 2024-09-21T03:50:35.920 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:50:35.921 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:50:35.921 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:50:35.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.920+0000 7f3315fe0640 1 -- 172.21.15.84:0/3727626970 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f32fc0b6680 msgr2=0x7f32fc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:35.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.920+0000 7f3315fe0640 1 --2- 172.21.15.84:0/3727626970 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f32fc0b6680 0x7f32fc0b8b90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3310079d30 tx=0x7f32f8008040 comp rx=0 tx=0).stop 2024-09-21T03:50:35.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.920+0000 7f3315fe0640 1 -- 172.21.15.84:0/3727626970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3310102a60 msgr2=0x7f331019a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:35.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.920+0000 7f3315fe0640 1 --2- 172.21.15.84:0/3727626970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3310102a60 0x7f331019a510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f330000e9f0 tx=0x7f330000eeb0 comp rx=0 tx=0).stop 2024-09-21T03:50:35.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.920+0000 7f3315fe0640 1 -- 172.21.15.84:0/3727626970 shutdown_connections 2024-09-21T03:50:35.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.920+0000 7f3315fe0640 1 --2- 172.21.15.84:0/3727626970 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f32fc0b6680 0x7f32fc0b8b90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:35.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.920+0000 7f3315fe0640 1 --2- 172.21.15.84:0/3727626970 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3310108cf0 0x7f331019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:35.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.920+0000 7f3315fe0640 1 --2- 172.21.15.84:0/3727626970 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f33101083a0 0x7f331019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:35.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.920+0000 7f3315fe0640 1 --2- 172.21.15.84:0/3727626970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3310102a60 0x7f331019a510 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:35.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.920+0000 7f3315fe0640 1 -- 172.21.15.84:0/3727626970 >> 172.21.15.84:0/3727626970 conn(0x7f3310079730 msgr2=0x7f33101052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:35.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.921+0000 7f3315fe0640 1 -- 172.21.15.84:0/3727626970 shutdown_connections 2024-09-21T03:50:35.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:35.921+0000 7f3315fe0640 1 -- 172.21.15.84:0/3727626970 wait complete. 2024-09-21T03:50:36.277 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:35 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3727626970' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:50:36.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:35 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3727626970' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:50:36.400 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:35 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3727626970' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:50:36.689 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:50:36.931 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:50:37.233 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:36 smithi084 ceph-mon[30941]: pgmap v572: 97 pgs: 97 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-09-21T03:50:37.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:36 smithi174 ceph-mon[34403]: pgmap v572: 97 pgs: 97 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-09-21T03:50:37.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:36 smithi172 ceph-mon[34821]: pgmap v572: 97 pgs: 97 active+clean; 14 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-09-21T03:50:37.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.446+0000 7f3d1eb93640 1 -- 172.21.15.84:0/1885055683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d18108cf0 msgr2=0x7f3d1810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:37.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.446+0000 7f3d1eb93640 1 --2- 172.21.15.84:0/1885055683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d18108cf0 0x7f3d1810f520 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009ca0 tx=0x7f3d1002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.446+0000 7f3d1eb93640 1 -- 172.21.15.84:0/1885055683 shutdown_connections 2024-09-21T03:50:37.458 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.446+0000 7f3d1eb93640 1 --2- 172.21.15.84:0/1885055683 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d18108cf0 0x7f3d1810f520 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.446+0000 7f3d1eb93640 1 --2- 172.21.15.84:0/1885055683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d181083a0 0x7f3d181087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.446+0000 7f3d1eb93640 1 --2- 172.21.15.84:0/1885055683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d18102a60 0x7f3d18102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.446+0000 7f3d1eb93640 1 -- 172.21.15.84:0/1885055683 >> 172.21.15.84:0/1885055683 conn(0x7f3d18079720 msgr2=0x7f3d18079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:37.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.446+0000 7f3d1eb93640 1 -- 172.21.15.84:0/1885055683 shutdown_connections 2024-09-21T03:50:37.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.446+0000 7f3d1eb93640 1 -- 172.21.15.84:0/1885055683 wait complete. 2024-09-21T03:50:37.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.447+0000 7f3d1eb93640 1 Processor -- start 2024-09-21T03:50:37.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.447+0000 7f3d1eb93640 1 -- start start 2024-09-21T03:50:37.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.447+0000 7f3d1eb93640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d18102a60 0x7f3d1819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:37.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.447+0000 7f3d1eb93640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d181083a0 0x7f3d1819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:37.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.447+0000 7f3d1eb93640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d18108cf0 0x7f3d1819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:37.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.447+0000 7f3d1eb93640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3d18112960 con 0x7f3d18102a60 2024-09-21T03:50:37.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.447+0000 7f3d1eb93640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3d181127e0 con 0x7f3d181083a0 2024-09-21T03:50:37.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.447+0000 7f3d1eb93640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3d18112ae0 con 0x7f3d18108cf0 2024-09-21T03:50:37.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.447+0000 7f3d1c92f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d18102a60 0x7f3d1819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:37.459 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.447+0000 7f3d1c92f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d18102a60 0x7f3d1819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53634/0 (socket says 172.21.15.84:53634) 2024-09-21T03:50:37.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.447+0000 7f3d1c92f640 1 -- 172.21.15.84:0/3735720017 learned_addr learned my addr 172.21.15.84:0/3735720017 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:37.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.447+0000 7f3d17fff640 1 --2- 172.21.15.84:0/3735720017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d181083a0 0x7f3d1819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:37.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.447+0000 7f3d1d130640 1 --2- 172.21.15.84:0/3735720017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d18108cf0 0x7f3d1819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:37.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.447+0000 7f3d1c92f640 1 -- 172.21.15.84:0/3735720017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d18108cf0 msgr2=0x7f3d1819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:37.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.447+0000 7f3d1c92f640 1 --2- 172.21.15.84:0/3735720017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d18108cf0 0x7f3d1819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.447+0000 7f3d1c92f640 1 -- 172.21.15.84:0/3735720017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d181083a0 msgr2=0x7f3d1819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:37.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.447+0000 7f3d1c92f640 1 --2- 172.21.15.84:0/3735720017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d181083a0 0x7f3d1819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.447+0000 7f3d1c92f640 1 -- 172.21.15.84:0/3735720017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d181a0430 con 0x7f3d18102a60 2024-09-21T03:50:37.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.448+0000 7f3d1c92f640 1 --2- 172.21.15.84:0/3735720017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d18102a60 0x7f3d1819a4c0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800d950 tx=0x7f3d0800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:37.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.448+0000 7f3d15ffb640 1 -- 172.21.15.84:0/3735720017 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d08017070 con 0x7f3d18102a60 2024-09-21T03:50:37.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.448+0000 7f3d1eb93640 1 -- 172.21.15.84:0/3735720017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d181a0720 con 0x7f3d18102a60 2024-09-21T03:50:37.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.448+0000 7f3d15ffb640 1 -- 172.21.15.84:0/3735720017 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d08009c30 con 0x7f3d18102a60 2024-09-21T03:50:37.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.448+0000 7f3d15ffb640 1 -- 172.21.15.84:0/3735720017 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0800f620 con 0x7f3d18102a60 2024-09-21T03:50:37.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.448+0000 7f3d1eb93640 1 -- 172.21.15.84:0/3735720017 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d181a6e80 con 0x7f3d18102a60 2024-09-21T03:50:37.460 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.450+0000 7f3d15ffb640 1 -- 172.21.15.84:0/3735720017 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f3d08010460 con 0x7f3d18102a60 2024-09-21T03:50:37.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.450+0000 7f3d25107740 1 Processor -- start 2024-09-21T03:50:37.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.451+0000 7f3d25107740 1 -- start start 2024-09-21T03:50:37.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.451+0000 7f3d25107740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ba6cbf070 0x559ba70666a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:37.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.451+0000 7f3d25107740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6c961b0 0x559ba7066be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:37.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.451+0000 7f3d25107740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c9e390 0x559ba7067120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:37.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.451+0000 7f3d25107740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559ba6fdcea0 con 0x559ba6c9e390 2024-09-21T03:50:37.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.451+0000 7f3d25107740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559ba6fcc2d0 con 0x559ba6cbf070 2024-09-21T03:50:37.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.451+0000 7f3d25107740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559ba6fd00e0 con 0x559ba6c961b0 2024-09-21T03:50:37.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.451+0000 7f3d17fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c9e390 0x559ba7067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:37.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.451+0000 7f3d17fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c9e390 0x559ba7067120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53646/0 (socket says 172.21.15.84:53646) 2024-09-21T03:50:37.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.451+0000 7f3d17fff640 1 -- 172.21.15.84:0/1390539738 learned_addr learned my addr 172.21.15.84:0/1390539738 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:37.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.451+0000 7f3d1c92f640 1 --2- 172.21.15.84:0/1390539738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6c961b0 0x559ba7066be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:37.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.451+0000 7f3d1d130640 1 --2- 172.21.15.84:0/1390539738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ba6cbf070 0x559ba70666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:37.461 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.451+0000 7f3d15ffb640 1 --2- 172.21.15.84:0/3735720017 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f3d040b6680 0x7f3d040b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.451+0000 7f3d17fff640 1 -- 172.21.15.84:0/1390539738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6c961b0 msgr2=0x559ba7066be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.451+0000 7f3d17fff640 1 --2- 172.21.15.84:0/1390539738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6c961b0 0x559ba7066be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.451+0000 7f3d17fff640 1 -- 172.21.15.84:0/1390539738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ba6cbf070 msgr2=0x559ba70666a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.451+0000 7f3d17fff640 1 --2- 172.21.15.84:0/1390539738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ba6cbf070 0x559ba70666a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.451+0000 7f3d17fff640 1 -- 172.21.15.84:0/1390539738 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ba6d2a650 con 0x559ba6c9e390 2024-09-21T03:50:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.451+0000 7f3d1d130640 1 --2- 172.21.15.84:0/3735720017 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f3d040b6680 0x7f3d040b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.452+0000 7f3d17fff640 1 --2- 172.21.15.84:0/1390539738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c9e390 0x559ba7067120 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f3d00004620 tx=0x7f3d0000bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c66654c5b702ede server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.452+0000 7f3d15ffb640 1 -- 172.21.15.84:0/3735720017 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f3d080e7340 con 0x7f3d18102a60 2024-09-21T03:50:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.452+0000 7f3d0effd640 1 -- 172.21.15.84:0/1390539738 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d00003ba0 con 0x559ba6c9e390 2024-09-21T03:50:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.452+0000 7f3d0effd640 1 -- 172.21.15.84:0/1390539738 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d00015070 con 0x559ba6c9e390 2024-09-21T03:50:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.452+0000 7f3d0effd640 1 -- 172.21.15.84:0/1390539738 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d00004cd0 con 0x559ba6c9e390 2024-09-21T03:50:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.453+0000 7f3d25107740 1 -- 172.21.15.84:0/1390539738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c9e390 msgr2=0x559ba7067120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.453+0000 7f3d1d130640 1 --2- 172.21.15.84:0/3735720017 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f3d040b6680 0x7f3d040b8b90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3d10005e30 tx=0x7f3d100095c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.453+0000 7f3d25107740 1 --2- 172.21.15.84:0/1390539738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c9e390 0x559ba7067120 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f3d00004620 tx=0x7f3d0000bb20 comp rx=0 tx=0).stop 2024-09-21T03:50:37.462 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.453+0000 7f3d25107740 1 -- 172.21.15.84:0/1390539738 shutdown_connections 2024-09-21T03:50:37.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.453+0000 7f3d25107740 1 --2- 172.21.15.84:0/1390539738 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c9e390 0x559ba7067120 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.453+0000 7f3d25107740 1 --2- 172.21.15.84:0/1390539738 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6c961b0 0x559ba7066be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.453+0000 7f3d25107740 1 --2- 172.21.15.84:0/1390539738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ba6cbf070 0x559ba70666a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.453+0000 7f3d25107740 1 -- 172.21.15.84:0/1390539738 >> 172.21.15.84:0/1390539738 conn(0x559ba6cb3460 msgr2=0x559ba7064590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:37.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.453+0000 7f3d25107740 1 -- 172.21.15.84:0/1390539738 shutdown_connections 2024-09-21T03:50:37.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.453+0000 7f3d25107740 1 -- 172.21.15.84:0/1390539738 wait complete. 2024-09-21T03:50:37.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.453+0000 7f3d25107740 1 -- start start 2024-09-21T03:50:37.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.453+0000 7f3d25107740 1 Processor -- start 2024-09-21T03:50:37.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.454+0000 7f3d25107740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ba6c961b0 0x559ba7071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:37.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.454+0000 7f3d25107740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6c9e390 0x559ba7072300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:37.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.454+0000 7f3d25107740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6cbf070 0x559ba707e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:37.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.454+0000 7f3d25107740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559ba6e2d700 con 0x559ba6cbf070 2024-09-21T03:50:37.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.454+0000 7f3d25107740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559ba6f67160 con 0x559ba6c961b0 2024-09-21T03:50:37.463 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.454+0000 7f3d25107740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x559ba7074e80 con 0x559ba6c9e390 2024-09-21T03:50:37.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.454+0000 7f3d25107740 10 client.0 _ll_register_callbacks cb 0x559ba6f809e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:37.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.454+0000 7f3d1d130640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6cbf070 0x559ba707e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:37.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.454+0000 7f3d1d130640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6cbf070 0x559ba707e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53662/0 (socket says 172.21.15.84:53662) 2024-09-21T03:50:37.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.454+0000 7f3d1d130640 1 -- 172.21.15.84:0/4248711537 learned_addr learned my addr 172.21.15.84:0/4248711537 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:37.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.454+0000 7f3d1c92f640 1 --2- 172.21.15.84:0/4248711537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ba6c961b0 0x559ba7071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:37.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.454+0000 7f3d17fff640 1 --2- 172.21.15.84:0/4248711537 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6c9e390 0x559ba7072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:37.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.454+0000 7f3d1d130640 1 -- 172.21.15.84:0/4248711537 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6c9e390 msgr2=0x559ba7072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:37.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.454+0000 7f3d1d130640 1 --2- 172.21.15.84:0/4248711537 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6c9e390 0x559ba7072300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.454+0000 7f3d1d130640 1 -- 172.21.15.84:0/4248711537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ba6c961b0 msgr2=0x559ba7071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:37.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.454+0000 7f3d1d130640 1 --2- 172.21.15.84:0/4248711537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ba6c961b0 0x559ba7071dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.454+0000 7f3d1d130640 1 -- 172.21.15.84:0/4248711537 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ba6f94c90 con 0x559ba6cbf070 2024-09-21T03:50:37.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.454+0000 7f3d17fff640 1 --2- 172.21.15.84:0/4248711537 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6c9e390 0x559ba7072300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:37.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.455+0000 7f3d1d130640 1 --2- 172.21.15.84:0/4248711537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6cbf070 0x559ba707e170 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f3d10035000 tx=0x7f3d1002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e45ec64e85c3b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:37.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.455+0000 7f3cf7fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:37.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.455+0000 7f3cf7fff640 1 -- 172.21.15.84:0/4248711537 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10004240 con 0x559ba6cbf070 2024-09-21T03:50:37.464 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.455+0000 7f3cf7fff640 1 -- 172.21.15.84:0/4248711537 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f3d100043e0 con 0x559ba6cbf070 2024-09-21T03:50:37.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.455+0000 7f3d25107740 1 -- 172.21.15.84:0/4248711537 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d00015070 con 0x559ba6cbf070 2024-09-21T03:50:37.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.455+0000 7f3cf7fff640 1 -- 172.21.15.84:0/4248711537 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3d10057030 con 0x559ba6cbf070 2024-09-21T03:50:37.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.455+0000 7f3d25107740 10 client.16887 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:37.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.455+0000 7f3d25107740 1 -- 172.21.15.84:0/4248711537 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559ba7080bf0 con 0x559ba6cbf070 2024-09-21T03:50:37.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.455+0000 7f3cf7fff640 1 -- 172.21.15.84:0/4248711537 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d00015070 con 0x559ba6cbf070 2024-09-21T03:50:37.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.455+0000 7f3cf7fff640 1 -- 172.21.15.84:0/4248711537 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3d100305c0 con 0x559ba6cbf070 2024-09-21T03:50:37.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.455+0000 7f3d25107740 10 client.16887 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:37.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.455+0000 7f3d25107740 10 client.16887 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:50:37.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.455+0000 7f3d25107740 20 client.16887 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:37.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.456+0000 7f3d25107740 1 --2- 172.21.15.84:0/4248711537 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x559ba6c7d9f0 0x559ba70840e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:37.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.456+0000 7f3d25107740 4 client.16887 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:50:37.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.456+0000 7f3d25107740 1 -- 172.21.15.84:0/4248711537 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ba6fdedf0 con 0x559ba6c7d9f0 2024-09-21T03:50:37.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.456+0000 7f3d1c92f640 1 --2- 172.21.15.84:0/4248711537 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x559ba6c7d9f0 0x559ba70840e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:37.465 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.456+0000 7f3d1c92f640 1 --2- 172.21.15.84:0/4248711537 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x559ba6c7d9f0 0x559ba70840e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=711640b4138c8c46 server_cookie=f1f70535d915edf1 in_seq=0 out_seq=0 2024-09-21T03:50:37.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.456+0000 7f3cf7fff640 10 client.16887 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:50:37.466 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.457+0000 7f3cf7fff640 1 -- 172.21.15.84:0/4248711537 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559ba6fdedf0 con 0x559ba6c7d9f0 2024-09-21T03:50:37.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.457+0000 7f3cf7fff640 10 client.16887 handle_command_reply: tid=0 2024-09-21T03:50:37.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.457+0000 7f3d25107740 1 client.16887 shutdown 2024-09-21T03:50:37.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.457+0000 7f3d25107740 1 -- 172.21.15.84:0/4248711537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6cbf070 msgr2=0x559ba707e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:37.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.457+0000 7f3d25107740 1 --2- 172.21.15.84:0/4248711537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6cbf070 0x559ba707e170 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f3d10035000 tx=0x7f3d1002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.457+0000 7f3d25107740 1 -- 172.21.15.84:0/4248711537 shutdown_connections 2024-09-21T03:50:37.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.457+0000 7f3d25107740 1 --2- 172.21.15.84:0/4248711537 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x559ba6c7d9f0 0x559ba70840e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.457+0000 7f3cf7fff640 0 client.16887 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:50:37.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.457+0000 7f3d25107740 1 --2- 172.21.15.84:0/4248711537 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6cbf070 0x559ba707e170 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.457+0000 7f3d25107740 1 --2- 172.21.15.84:0/4248711537 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6c9e390 0x559ba7072300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.457+0000 7f3d25107740 1 --2- 172.21.15.84:0/4248711537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ba6c961b0 0x559ba7071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.457+0000 7f3d25107740 1 -- 172.21.15.84:0/4248711537 >> 172.21.15.84:0/4248711537 conn(0x559ba6cb3460 msgr2=0x559ba7069880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:37.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.457+0000 7f3d25107740 1 -- 172.21.15.84:0/4248711537 shutdown_connections 2024-09-21T03:50:37.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.457+0000 7f3d25107740 1 -- 172.21.15.84:0/4248711537 wait complete. 2024-09-21T03:50:37.467 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.457+0000 7f3d25107740 20 client.16887 trim_cache size 0 max 16384 2024-09-21T03:50:37.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.470+0000 7f3d25107740 1 Processor -- start 2024-09-21T03:50:37.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.470+0000 7f3d25107740 1 -- start start 2024-09-21T03:50:37.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.470+0000 7f3d25107740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6c961b0 0x559ba70739f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:37.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.470+0000 7f3d25107740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c9e390 0x559ba707e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:37.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.470+0000 7f3d25107740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ba6cbf070 0x559ba706efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:37.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.470+0000 7f3d25107740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3d181b1f60 con 0x559ba6c9e390 2024-09-21T03:50:37.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.471+0000 7f3d25107740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3d181af830 con 0x559ba6cbf070 2024-09-21T03:50:37.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.471+0000 7f3d25107740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3d181ad6a0 con 0x559ba6c961b0 2024-09-21T03:50:37.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.471+0000 7f3d17fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c9e390 0x559ba707e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:37.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.471+0000 7f3d17fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c9e390 0x559ba707e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53670/0 (socket says 172.21.15.84:53670) 2024-09-21T03:50:37.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.471+0000 7f3d17fff640 1 -- 172.21.15.84:0/3209543182 learned_addr learned my addr 172.21.15.84:0/3209543182 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:37.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.471+0000 7f3d1c92f640 1 --2- 172.21.15.84:0/3209543182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6c961b0 0x559ba70739f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:37.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.471+0000 7f3d1d130640 1 --2- 172.21.15.84:0/3209543182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ba6cbf070 0x559ba706efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:37.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.471+0000 7f3d17fff640 1 -- 172.21.15.84:0/3209543182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6c961b0 msgr2=0x559ba70739f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:37.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.471+0000 7f3d17fff640 1 --2- 172.21.15.84:0/3209543182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6c961b0 0x559ba70739f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.471+0000 7f3d17fff640 1 -- 172.21.15.84:0/3209543182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ba6cbf070 msgr2=0x559ba706efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:37.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.471+0000 7f3d17fff640 1 --2- 172.21.15.84:0/3209543182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ba6cbf070 0x559ba706efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.471+0000 7f3d17fff640 1 -- 172.21.15.84:0/3209543182 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ba7074500 con 0x559ba6c9e390 2024-09-21T03:50:37.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.471+0000 7f3d17fff640 1 --2- 172.21.15.84:0/3209543182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c9e390 0x559ba707e070 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f3d000041e0 tx=0x7f3d00004210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577c9c5b0e0923a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:37.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.471+0000 7f3d0e7fc640 1 -- 172.21.15.84:0/3209543182 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d00027070 con 0x559ba6c9e390 2024-09-21T03:50:37.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.471+0000 7f3d0e7fc640 1 -- 172.21.15.84:0/3209543182 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d00015040 con 0x559ba6c9e390 2024-09-21T03:50:37.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.471+0000 7f3d0e7fc640 1 -- 172.21.15.84:0/3209543182 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d00022420 con 0x559ba6c9e390 2024-09-21T03:50:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.472+0000 7f3d25107740 1 -- 172.21.15.84:0/3209543182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c9e390 msgr2=0x559ba707e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.472+0000 7f3d25107740 1 --2- 172.21.15.84:0/3209543182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c9e390 0x559ba707e070 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f3d000041e0 tx=0x7f3d00004210 comp rx=0 tx=0).stop 2024-09-21T03:50:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.472+0000 7f3d25107740 1 -- 172.21.15.84:0/3209543182 shutdown_connections 2024-09-21T03:50:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.472+0000 7f3d25107740 1 --2- 172.21.15.84:0/3209543182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ba6cbf070 0x559ba706efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.472+0000 7f3d25107740 1 --2- 172.21.15.84:0/3209543182 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c9e390 0x559ba707e070 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.472+0000 7f3d25107740 1 --2- 172.21.15.84:0/3209543182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6c961b0 0x559ba70739f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.472+0000 7f3d25107740 1 -- 172.21.15.84:0/3209543182 >> 172.21.15.84:0/3209543182 conn(0x559ba6cb3460 msgr2=0x559ba70732e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.472+0000 7f3d25107740 1 -- 172.21.15.84:0/3209543182 shutdown_connections 2024-09-21T03:50:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.472+0000 7f3d25107740 1 -- 172.21.15.84:0/3209543182 wait complete. 2024-09-21T03:50:37.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.472+0000 7f3d25107740 1 -- start start 2024-09-21T03:50:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.473+0000 7f3d25107740 1 Processor -- start 2024-09-21T03:50:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.473+0000 7f3d25107740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c961b0 0x559ba7076200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.473+0000 7f3d25107740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ba6c9e390 0x559ba7076740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.473+0000 7f3d25107740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6cbf070 0x559ba7076c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.473+0000 7f3d25107740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3d181adcf0 con 0x559ba6c961b0 2024-09-21T03:50:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.473+0000 7f3d25107740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3d181af160 con 0x559ba6c9e390 2024-09-21T03:50:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.473+0000 7f3d25107740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3d181ae3c0 con 0x559ba6cbf070 2024-09-21T03:50:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.473+0000 7f3d25107740 10 client.0 _ll_register_callbacks cb 0x7f3d10009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.473+0000 7f3d1c92f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c961b0 0x559ba7076200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.473+0000 7f3d1c92f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c961b0 0x559ba7076200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53672/0 (socket says 172.21.15.84:53672) 2024-09-21T03:50:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.473+0000 7f3d1c92f640 1 -- 172.21.15.84:0/3865260840 learned_addr learned my addr 172.21.15.84:0/3865260840 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.473+0000 7f3d1d130640 1 --2- 172.21.15.84:0/3865260840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6cbf070 0x559ba7076c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.473+0000 7f3d17fff640 1 --2- 172.21.15.84:0/3865260840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ba6c9e390 0x559ba7076740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.473+0000 7f3d1c92f640 1 -- 172.21.15.84:0/3865260840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6cbf070 msgr2=0x559ba7076c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:37.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.473+0000 7f3d1c92f640 1 --2- 172.21.15.84:0/3865260840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6cbf070 0x559ba7076c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.473+0000 7f3d1c92f640 1 -- 172.21.15.84:0/3865260840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ba6c9e390 msgr2=0x559ba7076740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:37.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.473+0000 7f3d1c92f640 1 --2- 172.21.15.84:0/3865260840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ba6c9e390 0x559ba7076740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.474+0000 7f3d1c92f640 1 -- 172.21.15.84:0/3865260840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ba70edc40 con 0x559ba6c961b0 2024-09-21T03:50:37.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.474+0000 7f3d1d130640 1 --2- 172.21.15.84:0/3865260840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6cbf070 0x559ba7076c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:50:37.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.474+0000 7f3d1c92f640 1 --2- 172.21.15.84:0/3865260840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c961b0 0x559ba7076200 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f3d080e4b90 tx=0x7f3d08005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df87e40aa6fd01f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:37.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.474+0000 7f3cf7fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:37.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.474+0000 7f3cf7fff640 1 -- 172.21.15.84:0/3865260840 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d08020040 con 0x559ba6c961b0 2024-09-21T03:50:37.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.474+0000 7f3cf7fff640 1 -- 172.21.15.84:0/3865260840 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f3d080a8d30 con 0x559ba6c961b0 2024-09-21T03:50:37.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.474+0000 7f3d25107740 1 -- 172.21.15.84:0/3865260840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d00015040 con 0x559ba6c961b0 2024-09-21T03:50:37.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.474+0000 7f3cf7fff640 1 -- 172.21.15.84:0/3865260840 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3d080acfb0 con 0x559ba6c961b0 2024-09-21T03:50:37.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.474+0000 7f3d25107740 10 client.16893 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:37.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.474+0000 7f3d25107740 1 -- 172.21.15.84:0/3865260840 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559ba70eef20 con 0x559ba6c961b0 2024-09-21T03:50:37.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.474+0000 7f3cf7fff640 1 -- 172.21.15.84:0/3865260840 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d00015040 con 0x559ba6c961b0 2024-09-21T03:50:37.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.474+0000 7f3cf7fff640 1 -- 172.21.15.84:0/3865260840 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3d080d0b60 con 0x559ba6c961b0 2024-09-21T03:50:37.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.474+0000 7f3d25107740 10 client.16893 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:37.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.474+0000 7f3d25107740 10 client.16893 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:50:37.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.474+0000 7f3d25107740 20 client.16893 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:37.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.475+0000 7f3d25107740 1 --2- 172.21.15.84:0/3865260840 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x559ba6c52da0 0x559ba70f1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:37.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.475+0000 7f3d25107740 4 client.16893 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:50:37.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.475+0000 7f3d25107740 1 -- 172.21.15.84:0/3865260840 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559ba6fda8a0 con 0x559ba6c52da0 2024-09-21T03:50:37.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.475+0000 7f3d17fff640 1 --2- 172.21.15.84:0/3865260840 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x559ba6c52da0 0x559ba70f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:37.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.475+0000 7f3cf7fff640 10 client.16893 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:50:37.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.475+0000 7f3d17fff640 1 --2- 172.21.15.84:0/3865260840 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x559ba6c52da0 0x559ba70f1690 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ca4506604a3a57b7 server_cookie=837ae6f065b5e3c8 in_seq=0 out_seq=0 2024-09-21T03:50:37.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.475+0000 7f3cf7fff640 1 -- 172.21.15.84:0/3865260840 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559ba6fda8a0 con 0x559ba6c52da0 2024-09-21T03:50:37.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.475+0000 7f3cf7fff640 10 client.16893 handle_command_reply: tid=0 2024-09-21T03:50:37.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.475+0000 7f3d25107740 1 client.16893 shutdown 2024-09-21T03:50:37.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.476+0000 7f3d25107740 1 -- 172.21.15.84:0/3865260840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c961b0 msgr2=0x559ba7076200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:37.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.476+0000 7f3d25107740 1 --2- 172.21.15.84:0/3865260840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c961b0 0x559ba7076200 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f3d080e4b90 tx=0x7f3d08005880 comp rx=0 tx=0).stop 2024-09-21T03:50:37.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.476+0000 7f3d25107740 1 -- 172.21.15.84:0/3865260840 shutdown_connections 2024-09-21T03:50:37.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.476+0000 7f3d25107740 1 --2- 172.21.15.84:0/3865260840 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x559ba6c52da0 0x559ba70f1690 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.476+0000 7f3d25107740 1 --2- 172.21.15.84:0/3865260840 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ba6cbf070 0x559ba7076c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.476+0000 7f3d25107740 1 --2- 172.21.15.84:0/3865260840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ba6c9e390 0x559ba7076740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.476+0000 7f3d25107740 1 --2- 172.21.15.84:0/3865260840 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559ba6c961b0 0x559ba7076200 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.476+0000 7f3d25107740 1 -- 172.21.15.84:0/3865260840 >> 172.21.15.84:0/3865260840 conn(0x559ba6cb3460 msgr2=0x559ba7067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:37.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.476+0000 7f3cf7fff640 0 client.16893 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:50:37.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.476+0000 7f3d25107740 1 -- 172.21.15.84:0/3865260840 shutdown_connections 2024-09-21T03:50:37.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.476+0000 7f3d25107740 1 -- 172.21.15.84:0/3865260840 wait complete. 2024-09-21T03:50:37.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.476+0000 7f3d25107740 20 client.16893 trim_cache size 0 max 16384 2024-09-21T03:50:37.482 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:50:37.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.476+0000 7f3d1eb93640 1 -- 172.21.15.84:0/3735720017 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f3d040b6680 msgr2=0x7f3d040b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:37.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.476+0000 7f3d1eb93640 1 --2- 172.21.15.84:0/3735720017 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f3d040b6680 0x7f3d040b8b90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3d10005e30 tx=0x7f3d100095c0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.476+0000 7f3d1eb93640 1 -- 172.21.15.84:0/3735720017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d18102a60 msgr2=0x7f3d1819a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:37.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.477+0000 7f3d1eb93640 1 --2- 172.21.15.84:0/3735720017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d18102a60 0x7f3d1819a4c0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800d950 tx=0x7f3d0800de10 comp rx=0 tx=0).stop 2024-09-21T03:50:37.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.477+0000 7f3d1eb93640 1 -- 172.21.15.84:0/3735720017 shutdown_connections 2024-09-21T03:50:37.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.477+0000 7f3d1eb93640 1 --2- 172.21.15.84:0/3735720017 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f3d040b6680 0x7f3d040b8b90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.477+0000 7f3d1eb93640 1 --2- 172.21.15.84:0/3735720017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3d18108cf0 0x7f3d1819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.477+0000 7f3d1eb93640 1 --2- 172.21.15.84:0/3735720017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3d181083a0 0x7f3d1819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.477+0000 7f3d1eb93640 1 --2- 172.21.15.84:0/3735720017 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3d18102a60 0x7f3d1819a4c0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:37.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.477+0000 7f3d1eb93640 1 -- 172.21.15.84:0/3735720017 >> 172.21.15.84:0/3735720017 conn(0x7f3d18079720 msgr2=0x7f3d1806bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:37.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.477+0000 7f3d1eb93640 1 -- 172.21.15.84:0/3735720017 shutdown_connections 2024-09-21T03:50:37.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:37.477+0000 7f3d1eb93640 1 -- 172.21.15.84:0/3735720017 wait complete. 2024-09-21T03:50:38.324 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:50:38.570 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:50:38.690 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:38 smithi084 ceph-mon[30941]: pgmap v573: 97 pgs: 97 active+clean; 15 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 14 op/s 2024-09-21T03:50:38.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:38 smithi174 ceph-mon[34403]: pgmap v573: 97 pgs: 97 active+clean; 15 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 14 op/s 2024-09-21T03:50:38.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:38 smithi172 ceph-mon[34821]: pgmap v573: 97 pgs: 97 active+clean; 15 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 61 KiB/s wr, 14 op/s 2024-09-21T03:50:39.225 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.223+0000 7fd33b952640 1 -- 172.21.15.84:0/3458139752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd334108d20 msgr2=0x7fd33410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:39.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.223+0000 7fd33b952640 1 --2- 172.21.15.84:0/3458139752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd334108d20 0x7fd33410f550 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd32c009ca0 tx=0x7fd32c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.223+0000 7fd33b952640 1 -- 172.21.15.84:0/3458139752 shutdown_connections 2024-09-21T03:50:39.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.223+0000 7fd33b952640 1 --2- 172.21.15.84:0/3458139752 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd334108d20 0x7fd33410f550 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.223+0000 7fd33b952640 1 --2- 172.21.15.84:0/3458139752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd3341083d0 0x7fd3341087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.223+0000 7fd33b952640 1 --2- 172.21.15.84:0/3458139752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd334102ae0 0x7fd334102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.223+0000 7fd33b952640 1 -- 172.21.15.84:0/3458139752 >> 172.21.15.84:0/3458139752 conn(0x7fd334079760 msgr2=0x7fd334079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:39.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.223+0000 7fd33b952640 1 -- 172.21.15.84:0/3458139752 shutdown_connections 2024-09-21T03:50:39.226 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.223+0000 7fd33b952640 1 -- 172.21.15.84:0/3458139752 wait complete. 2024-09-21T03:50:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.224+0000 7fd33b952640 1 Processor -- start 2024-09-21T03:50:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.224+0000 7fd33b952640 1 -- start start 2024-09-21T03:50:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.224+0000 7fd33b952640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd334102ae0 0x7fd334199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.224+0000 7fd33b952640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3341083d0 0x7fd3341998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.224+0000 7fd33b952640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd334108d20 0x7fd33419eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.224+0000 7fd33b952640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd334112990 con 0x7fd3341083d0 2024-09-21T03:50:39.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.224+0000 7fd33b952640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd334112810 con 0x7fd334102ae0 2024-09-21T03:50:39.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.224+0000 7fd33b952640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd334112b10 con 0x7fd334108d20 2024-09-21T03:50:39.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.224+0000 7fd338eed640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3341083d0 0x7fd3341998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.225+0000 7fd338eed640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3341083d0 0x7fd3341998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48644/0 (socket says 172.21.15.84:48644) 2024-09-21T03:50:39.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.225+0000 7fd338eed640 1 -- 172.21.15.84:0/2563566672 learned_addr learned my addr 172.21.15.84:0/2563566672 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:39.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.225+0000 7fd3396ee640 1 --2- 172.21.15.84:0/2563566672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd334102ae0 0x7fd334199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.225+0000 7fd339eef640 1 --2- 172.21.15.84:0/2563566672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd334108d20 0x7fd33419eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.225+0000 7fd338eed640 1 -- 172.21.15.84:0/2563566672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd334108d20 msgr2=0x7fd33419eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:39.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.225+0000 7fd338eed640 1 --2- 172.21.15.84:0/2563566672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd334108d20 0x7fd33419eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.225+0000 7fd338eed640 1 -- 172.21.15.84:0/2563566672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd334102ae0 msgr2=0x7fd334199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:39.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.225+0000 7fd338eed640 1 --2- 172.21.15.84:0/2563566672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd334102ae0 0x7fd334199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.225+0000 7fd338eed640 1 -- 172.21.15.84:0/2563566672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33419f1f0 con 0x7fd3341083d0 2024-09-21T03:50:39.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.225+0000 7fd338eed640 1 --2- 172.21.15.84:0/2563566672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3341083d0 0x7fd3341998e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fd32400e9f0 tx=0x7fd32400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:39.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.225+0000 7fd32a7fc640 1 -- 172.21.15.84:0/2563566672 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32400ccc0 con 0x7fd3341083d0 2024-09-21T03:50:39.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.225+0000 7fd33b952640 1 -- 172.21.15.84:0/2563566672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd33419f4e0 con 0x7fd3341083d0 2024-09-21T03:50:39.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.225+0000 7fd32a7fc640 1 -- 172.21.15.84:0/2563566672 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3240054d0 con 0x7fd3341083d0 2024-09-21T03:50:39.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.225+0000 7fd32a7fc640 1 -- 172.21.15.84:0/2563566672 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324010430 con 0x7fd3341083d0 2024-09-21T03:50:39.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.225+0000 7fd33b952640 1 -- 172.21.15.84:0/2563566672 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd33406bb40 con 0x7fd3341083d0 2024-09-21T03:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.228+0000 7fd32a7fc640 1 -- 172.21.15.84:0/2563566672 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fd3240046c0 con 0x7fd3341083d0 2024-09-21T03:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.228+0000 7fd341ec6740 1 Processor -- start 2024-09-21T03:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.228+0000 7fd341ec6740 1 -- start start 2024-09-21T03:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd341ec6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f33f070 0x56282f6e62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd341ec6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f3161b0 0x56282f6e6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd341ec6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f31e390 0x56282f6e6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd341ec6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56282f65cea0 con 0x56282f33f070 2024-09-21T03:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd341ec6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56282f64c2d0 con 0x56282f31e390 2024-09-21T03:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd341ec6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56282f6500e0 con 0x56282f3161b0 2024-09-21T03:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd339eef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f33f070 0x56282f6e62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd339eef640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f33f070 0x56282f6e62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48658/0 (socket says 172.21.15.84:48658) 2024-09-21T03:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd339eef640 1 -- 172.21.15.84:0/782269695 learned_addr learned my addr 172.21.15.84:0/782269695 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:39.232 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd3396ee640 1 --2- 172.21.15.84:0/782269695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f3161b0 0x56282f6e6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd338eed640 1 --2- 172.21.15.84:0/782269695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f31e390 0x56282f6e6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd339eef640 1 -- 172.21.15.84:0/782269695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f3161b0 msgr2=0x56282f6e6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:39.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd339eef640 1 --2- 172.21.15.84:0/782269695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f3161b0 0x56282f6e6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd339eef640 1 -- 172.21.15.84:0/782269695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f31e390 msgr2=0x56282f6e6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:39.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd339eef640 1 --2- 172.21.15.84:0/782269695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f31e390 0x56282f6e6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd339eef640 1 -- 172.21.15.84:0/782269695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56282f3aa650 con 0x56282f33f070 2024-09-21T03:50:39.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd338eed640 1 --2- 172.21.15.84:0/782269695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f31e390 0x56282f6e6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:39.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd32a7fc640 1 --2- 172.21.15.84:0/2563566672 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd3200b66b0 0x7fd3200b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd339eef640 1 --2- 172.21.15.84:0/782269695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f33f070 0x56282f6e62c0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd32c009880 tx=0x7fd32c0098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a142a999ba2e3fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:39.233 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd3396ee640 1 --2- 172.21.15.84:0/2563566672 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd3200b66b0 0x7fd3200b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.229+0000 7fd32a7fc640 1 -- 172.21.15.84:0/2563566672 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fd3240e7ab0 con 0x7fd3341083d0 2024-09-21T03:50:39.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.230+0000 7fd31f7fe640 1 -- 172.21.15.84:0/782269695 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c031d70 con 0x56282f33f070 2024-09-21T03:50:39.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.230+0000 7fd31f7fe640 1 -- 172.21.15.84:0/782269695 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd32c036040 con 0x56282f33f070 2024-09-21T03:50:39.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.230+0000 7fd31f7fe640 1 -- 172.21.15.84:0/782269695 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c0042a0 con 0x56282f33f070 2024-09-21T03:50:39.237 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.230+0000 7fd341ec6740 1 -- 172.21.15.84:0/782269695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f33f070 msgr2=0x56282f6e62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.230+0000 7fd3396ee640 1 --2- 172.21.15.84:0/2563566672 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd3200b66b0 0x7fd3200b8bc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x56282f6e4f40 tx=0x7fd33000a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.230+0000 7fd341ec6740 1 --2- 172.21.15.84:0/782269695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f33f070 0x56282f6e62c0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd32c009880 tx=0x7fd32c0098b0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.231+0000 7fd341ec6740 1 -- 172.21.15.84:0/782269695 shutdown_connections 2024-09-21T03:50:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.231+0000 7fd341ec6740 1 --2- 172.21.15.84:0/782269695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f31e390 0x56282f6e6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.231+0000 7fd341ec6740 1 --2- 172.21.15.84:0/782269695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f3161b0 0x56282f6e6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.231+0000 7fd341ec6740 1 --2- 172.21.15.84:0/782269695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f33f070 0x56282f6e62c0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.231+0000 7fd341ec6740 1 -- 172.21.15.84:0/782269695 >> 172.21.15.84:0/782269695 conn(0x56282f333460 msgr2=0x56282f6e41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.231+0000 7fd341ec6740 1 -- 172.21.15.84:0/782269695 shutdown_connections 2024-09-21T03:50:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.231+0000 7fd341ec6740 1 -- 172.21.15.84:0/782269695 wait complete. 2024-09-21T03:50:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.231+0000 7fd341ec6740 1 -- start start 2024-09-21T03:50:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.231+0000 7fd341ec6740 1 Processor -- start 2024-09-21T03:50:39.238 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd341ec6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f3161b0 0x56282f6f19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd341ec6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f31e390 0x56282f6f1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd341ec6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f33f070 0x56282f6fdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd341ec6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56282f4ad700 con 0x56282f3161b0 2024-09-21T03:50:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd341ec6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56282f5e7160 con 0x56282f31e390 2024-09-21T03:50:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd341ec6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56282f6f4a40 con 0x56282f33f070 2024-09-21T03:50:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd3396ee640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f3161b0 0x56282f6f19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd341ec6740 10 client.0 _ll_register_callbacks cb 0x56282f6009e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd3396ee640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f3161b0 0x56282f6f19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48666/0 (socket says 172.21.15.84:48666) 2024-09-21T03:50:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd3396ee640 1 -- 172.21.15.84:0/1288072599 learned_addr learned my addr 172.21.15.84:0/1288072599 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd339eef640 1 --2- 172.21.15.84:0/1288072599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f33f070 0x56282f6fdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd338eed640 1 --2- 172.21.15.84:0/1288072599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f31e390 0x56282f6f1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd3396ee640 1 -- 172.21.15.84:0/1288072599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f33f070 msgr2=0x56282f6fdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd3396ee640 1 --2- 172.21.15.84:0/1288072599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f33f070 0x56282f6fdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.239 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd3396ee640 1 -- 172.21.15.84:0/1288072599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f31e390 msgr2=0x56282f6f1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd3396ee640 1 --2- 172.21.15.84:0/1288072599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f31e390 0x56282f6f1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd3396ee640 1 -- 172.21.15.84:0/1288072599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56282f614c90 con 0x56282f3161b0 2024-09-21T03:50:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd338eed640 1 --2- 172.21.15.84:0/1288072599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f31e390 0x56282f6f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd3396ee640 1 --2- 172.21.15.84:0/1288072599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f3161b0 0x56282f6f19b0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd330010e20 tx=0x7fd3300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e59a6e4a68a7a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd31cff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd31cff9640 1 -- 172.21.15.84:0/1288072599 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33000f8c0 con 0x56282f3161b0 2024-09-21T03:50:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd31cff9640 1 -- 172.21.15.84:0/1288072599 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fd33000fa60 con 0x56282f3161b0 2024-09-21T03:50:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.232+0000 7fd341ec6740 1 -- 172.21.15.84:0/1288072599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd32c036040 con 0x56282f3161b0 2024-09-21T03:50:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.233+0000 7fd31cff9640 1 -- 172.21.15.84:0/1288072599 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd33000fc60 con 0x56282f3161b0 2024-09-21T03:50:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.233+0000 7fd341ec6740 10 client.16905 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.233+0000 7fd341ec6740 1 -- 172.21.15.84:0/1288072599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56282f700750 con 0x56282f3161b0 2024-09-21T03:50:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.233+0000 7fd31cff9640 1 -- 172.21.15.84:0/1288072599 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd32c036040 con 0x56282f3161b0 2024-09-21T03:50:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.233+0000 7fd31cff9640 1 -- 172.21.15.84:0/1288072599 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd33001d410 con 0x56282f3161b0 2024-09-21T03:50:39.240 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.233+0000 7fd341ec6740 10 client.16905 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:39.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.233+0000 7fd341ec6740 10 client.16905 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:50:39.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.233+0000 7fd341ec6740 20 client.16905 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:39.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.233+0000 7fd341ec6740 1 --2- 172.21.15.84:0/1288072599 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x56282f2fd9f0 0x56282f703cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.233+0000 7fd341ec6740 4 client.16905 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:50:39.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.233+0000 7fd341ec6740 1 -- 172.21.15.84:0/1288072599 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56282f65edf0 con 0x56282f2fd9f0 2024-09-21T03:50:39.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.233+0000 7fd338eed640 1 --2- 172.21.15.84:0/1288072599 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x56282f2fd9f0 0x56282f703cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.234+0000 7fd338eed640 1 --2- 172.21.15.84:0/1288072599 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x56282f2fd9f0 0x56282f703cb0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=689385f7b834138e server_cookie=5b1a1098ac0b0bd in_seq=0 out_seq=0 2024-09-21T03:50:39.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.234+0000 7fd31cff9640 10 client.16905 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:50:39.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.235+0000 7fd31cff9640 1 -- 172.21.15.84:0/1288072599 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56282f65edf0 con 0x56282f2fd9f0 2024-09-21T03:50:39.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.235+0000 7fd31cff9640 10 client.16905 handle_command_reply: tid=0 2024-09-21T03:50:39.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.235+0000 7fd341ec6740 1 client.16905 shutdown 2024-09-21T03:50:39.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.235+0000 7fd341ec6740 1 -- 172.21.15.84:0/1288072599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f3161b0 msgr2=0x56282f6f19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:39.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.235+0000 7fd341ec6740 1 --2- 172.21.15.84:0/1288072599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f3161b0 0x56282f6f19b0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd330010e20 tx=0x7fd3300046c0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.235+0000 7fd341ec6740 1 -- 172.21.15.84:0/1288072599 shutdown_connections 2024-09-21T03:50:39.241 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.235+0000 7fd341ec6740 1 --2- 172.21.15.84:0/1288072599 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x56282f2fd9f0 0x56282f703cb0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.235+0000 7fd341ec6740 1 --2- 172.21.15.84:0/1288072599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f33f070 0x56282f6fdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.235+0000 7fd341ec6740 1 --2- 172.21.15.84:0/1288072599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f31e390 0x56282f6f1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.235+0000 7fd341ec6740 1 --2- 172.21.15.84:0/1288072599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f3161b0 0x56282f6f19b0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.235+0000 7fd341ec6740 1 -- 172.21.15.84:0/1288072599 >> 172.21.15.84:0/1288072599 conn(0x56282f333460 msgr2=0x56282f6e94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:39.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.235+0000 7fd31cff9640 0 client.16905 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:50:39.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.235+0000 7fd341ec6740 1 -- 172.21.15.84:0/1288072599 shutdown_connections 2024-09-21T03:50:39.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.235+0000 7fd341ec6740 1 -- 172.21.15.84:0/1288072599 wait complete. 2024-09-21T03:50:39.242 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.235+0000 7fd341ec6740 20 client.16905 trim_cache size 0 max 16384 2024-09-21T03:50:39.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.248+0000 7fd341ec6740 1 Processor -- start 2024-09-21T03:50:39.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.248+0000 7fd341ec6740 1 -- start start 2024-09-21T03:50:39.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.248+0000 7fd341ec6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f3161b0 0x56282f6f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.248+0000 7fd341ec6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f31e390 0x56282f6e3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.248+0000 7fd341ec6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f33f070 0x56282f6e3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.248+0000 7fd341ec6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341b1e60 con 0x56282f3161b0 2024-09-21T03:50:39.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.248+0000 7fd341ec6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341af730 con 0x56282f31e390 2024-09-21T03:50:39.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.248+0000 7fd341ec6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341ad5a0 con 0x56282f33f070 2024-09-21T03:50:39.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.248+0000 7fd3396ee640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f3161b0 0x56282f6f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.248+0000 7fd3396ee640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f3161b0 0x56282f6f35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48678/0 (socket says 172.21.15.84:48678) 2024-09-21T03:50:39.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.248+0000 7fd3396ee640 1 -- 172.21.15.84:0/3483080211 learned_addr learned my addr 172.21.15.84:0/3483080211 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:39.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.249+0000 7fd338eed640 1 --2- 172.21.15.84:0/3483080211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f31e390 0x56282f6e3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.249+0000 7fd3396ee640 1 -- 172.21.15.84:0/3483080211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f33f070 msgr2=0x56282f6e3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:39.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.249+0000 7fd339eef640 1 --2- 172.21.15.84:0/3483080211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f33f070 0x56282f6e3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.249+0000 7fd3396ee640 1 --2- 172.21.15.84:0/3483080211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f33f070 0x56282f6e3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.249+0000 7fd3396ee640 1 -- 172.21.15.84:0/3483080211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f31e390 msgr2=0x56282f6e3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:39.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.249+0000 7fd3396ee640 1 --2- 172.21.15.84:0/3483080211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f31e390 0x56282f6e3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.249+0000 7fd3396ee640 1 -- 172.21.15.84:0/3483080211 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56282f6e85b0 con 0x56282f3161b0 2024-09-21T03:50:39.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.249+0000 7fd338eed640 1 --2- 172.21.15.84:0/3483080211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f31e390 0x56282f6e3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:50:39.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.249+0000 7fd3396ee640 1 --2- 172.21.15.84:0/3483080211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f3161b0 0x56282f6f35e0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd330011010 tx=0x7fd33001dfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731257e1a64789f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:39.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.249+0000 7fd31effd640 1 -- 172.21.15.84:0/3483080211 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd330034070 con 0x56282f3161b0 2024-09-21T03:50:39.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.249+0000 7fd31effd640 1 -- 172.21.15.84:0/3483080211 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd33001daf0 con 0x56282f3161b0 2024-09-21T03:50:39.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.249+0000 7fd31effd640 1 -- 172.21.15.84:0/3483080211 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd330005270 con 0x56282f3161b0 2024-09-21T03:50:39.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.250+0000 7fd341ec6740 1 -- 172.21.15.84:0/3483080211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f3161b0 msgr2=0x56282f6f35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:39.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.250+0000 7fd341ec6740 1 --2- 172.21.15.84:0/3483080211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f3161b0 0x56282f6f35e0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fd330011010 tx=0x7fd33001dfd0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.250+0000 7fd341ec6740 1 -- 172.21.15.84:0/3483080211 shutdown_connections 2024-09-21T03:50:39.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.250+0000 7fd341ec6740 1 --2- 172.21.15.84:0/3483080211 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f33f070 0x56282f6e3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.250+0000 7fd341ec6740 1 --2- 172.21.15.84:0/3483080211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f31e390 0x56282f6e3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.250+0000 7fd341ec6740 1 --2- 172.21.15.84:0/3483080211 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f3161b0 0x56282f6f35e0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.250+0000 7fd341ec6740 1 -- 172.21.15.84:0/3483080211 >> 172.21.15.84:0/3483080211 conn(0x56282f333460 msgr2=0x56282f6f2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:39.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.250+0000 7fd341ec6740 1 -- 172.21.15.84:0/3483080211 shutdown_connections 2024-09-21T03:50:39.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.250+0000 7fd341ec6740 1 -- 172.21.15.84:0/3483080211 wait complete. 2024-09-21T03:50:39.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.250+0000 7fd341ec6740 1 -- start start 2024-09-21T03:50:39.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.251+0000 7fd341ec6740 1 Processor -- start 2024-09-21T03:50:39.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.251+0000 7fd341ec6740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f3161b0 0x56282f6fa620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.251+0000 7fd341ec6740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f31e390 0x56282f6f5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.251+0000 7fd341ec6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f33f070 0x56282f6f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.251+0000 7fd341ec6740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341adbf0 con 0x56282f31e390 2024-09-21T03:50:39.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.251+0000 7fd341ec6740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341af060 con 0x56282f3161b0 2024-09-21T03:50:39.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.251+0000 7fd341ec6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341ae2c0 con 0x56282f33f070 2024-09-21T03:50:39.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.251+0000 7fd341ec6740 10 client.0 _ll_register_callbacks cb 0x7fd330010aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:39.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.251+0000 7fd338eed640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f31e390 0x56282f6f5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.251+0000 7fd338eed640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f31e390 0x56282f6f5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48686/0 (socket says 172.21.15.84:48686) 2024-09-21T03:50:39.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.251+0000 7fd338eed640 1 -- 172.21.15.84:0/2188192944 learned_addr learned my addr 172.21.15.84:0/2188192944 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:39.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.251+0000 7fd3396ee640 1 --2- 172.21.15.84:0/2188192944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f3161b0 0x56282f6fa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.251+0000 7fd339eef640 1 --2- 172.21.15.84:0/2188192944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f33f070 0x56282f6f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.251+0000 7fd338eed640 1 -- 172.21.15.84:0/2188192944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f33f070 msgr2=0x56282f6f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:39.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.251+0000 7fd338eed640 1 --2- 172.21.15.84:0/2188192944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f33f070 0x56282f6f61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.251+0000 7fd338eed640 1 -- 172.21.15.84:0/2188192944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f3161b0 msgr2=0x56282f6fa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:39.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.251+0000 7fd338eed640 1 --2- 172.21.15.84:0/2188192944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f3161b0 0x56282f6fa620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.251+0000 7fd338eed640 1 -- 172.21.15.84:0/2188192944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56282f76d670 con 0x56282f31e390 2024-09-21T03:50:39.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.251+0000 7fd339eef640 1 --2- 172.21.15.84:0/2188192944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f33f070 0x56282f6f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:39.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.252+0000 7fd338eed640 1 --2- 172.21.15.84:0/2188192944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f31e390 0x56282f6f5ad0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fd3240ad8e0 tx=0x7fd32400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66196e4486c89e46 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:39.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.252+0000 7fd31cff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.252+0000 7fd31cff9640 1 -- 172.21.15.84:0/2188192944 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3240a97f0 con 0x56282f31e390 2024-09-21T03:50:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.252+0000 7fd31cff9640 1 -- 172.21.15.84:0/2188192944 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fd324005000 con 0x56282f31e390 2024-09-21T03:50:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.252+0000 7fd341ec6740 1 -- 172.21.15.84:0/2188192944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd33001daf0 con 0x56282f31e390 2024-09-21T03:50:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.252+0000 7fd31cff9640 1 -- 172.21.15.84:0/2188192944 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd324005680 con 0x56282f31e390 2024-09-21T03:50:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.252+0000 7fd341ec6740 10 client.16911 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.252+0000 7fd341ec6740 1 -- 172.21.15.84:0/2188192944 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56282f76e7c0 con 0x56282f31e390 2024-09-21T03:50:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.252+0000 7fd31cff9640 1 -- 172.21.15.84:0/2188192944 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd33001daf0 con 0x56282f31e390 2024-09-21T03:50:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.252+0000 7fd31cff9640 1 -- 172.21.15.84:0/2188192944 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd3240a92a0 con 0x56282f31e390 2024-09-21T03:50:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.252+0000 7fd341ec6740 10 client.16911 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.252+0000 7fd341ec6740 10 client.16911 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:50:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.252+0000 7fd341ec6740 20 client.16911 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.252+0000 7fd341ec6740 1 --2- 172.21.15.84:0/2188192944 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x56282f2d2da0 0x56282f770f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.252+0000 7fd341ec6740 4 client.16911 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:50:39.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.252+0000 7fd341ec6740 1 -- 172.21.15.84:0/2188192944 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56282f65a8a0 con 0x56282f2d2da0 2024-09-21T03:50:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.253+0000 7fd3396ee640 1 --2- 172.21.15.84:0/2188192944 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x56282f2d2da0 0x56282f770f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.253+0000 7fd3396ee640 1 --2- 172.21.15.84:0/2188192944 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x56282f2d2da0 0x56282f770f00 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=88891ccda161504 server_cookie=8e379de191e0651b in_seq=0 out_seq=0 2024-09-21T03:50:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.253+0000 7fd31cff9640 10 client.16911 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:50:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.253+0000 7fd31cff9640 1 -- 172.21.15.84:0/2188192944 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56282f65a8a0 con 0x56282f2d2da0 2024-09-21T03:50:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.253+0000 7fd31cff9640 10 client.16911 handle_command_reply: tid=0 2024-09-21T03:50:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.253+0000 7fd341ec6740 1 client.16911 shutdown 2024-09-21T03:50:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.253+0000 7fd341ec6740 1 -- 172.21.15.84:0/2188192944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f31e390 msgr2=0x56282f6f5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.253+0000 7fd341ec6740 1 --2- 172.21.15.84:0/2188192944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f31e390 0x56282f6f5ad0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fd3240ad8e0 tx=0x7fd32400ce60 comp rx=0 tx=0).stop 2024-09-21T03:50:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.253+0000 7fd341ec6740 1 -- 172.21.15.84:0/2188192944 shutdown_connections 2024-09-21T03:50:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.253+0000 7fd341ec6740 1 --2- 172.21.15.84:0/2188192944 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x56282f2d2da0 0x56282f770f00 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.253+0000 7fd341ec6740 1 --2- 172.21.15.84:0/2188192944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56282f33f070 0x56282f6f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.254+0000 7fd341ec6740 1 --2- 172.21.15.84:0/2188192944 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56282f31e390 0x56282f6f5ad0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.254+0000 7fd341ec6740 1 --2- 172.21.15.84:0/2188192944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56282f3161b0 0x56282f6fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.260 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.254+0000 7fd31cff9640 0 client.16911 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:50:39.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.254+0000 7fd341ec6740 1 -- 172.21.15.84:0/2188192944 >> 172.21.15.84:0/2188192944 conn(0x56282f333460 msgr2=0x56282f6f1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:39.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.254+0000 7fd341ec6740 1 -- 172.21.15.84:0/2188192944 shutdown_connections 2024-09-21T03:50:39.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.254+0000 7fd341ec6740 1 -- 172.21.15.84:0/2188192944 wait complete. 2024-09-21T03:50:39.261 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.254+0000 7fd341ec6740 20 client.16911 trim_cache size 0 max 16384 2024-09-21T03:50:39.261 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:50:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.254+0000 7fd33b952640 1 -- 172.21.15.84:0/2563566672 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd3200b66b0 msgr2=0x7fd3200b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.254+0000 7fd33b952640 1 --2- 172.21.15.84:0/2563566672 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd3200b66b0 0x7fd3200b8bc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x56282f6e4f40 tx=0x7fd33000a2d0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.254+0000 7fd33b952640 1 -- 172.21.15.84:0/2563566672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3341083d0 msgr2=0x7fd3341998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.254+0000 7fd33b952640 1 --2- 172.21.15.84:0/2563566672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3341083d0 0x7fd3341998e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fd32400e9f0 tx=0x7fd32400edf0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.254+0000 7fd33b952640 1 -- 172.21.15.84:0/2563566672 shutdown_connections 2024-09-21T03:50:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.254+0000 7fd33b952640 1 --2- 172.21.15.84:0/2563566672 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd3200b66b0 0x7fd3200b8bc0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.254+0000 7fd33b952640 1 --2- 172.21.15.84:0/2563566672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd334108d20 0x7fd33419eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.254+0000 7fd33b952640 1 --2- 172.21.15.84:0/2563566672 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd3341083d0 0x7fd3341998e0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.254+0000 7fd33b952640 1 --2- 172.21.15.84:0/2563566672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd334102ae0 0x7fd334199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.254+0000 7fd33b952640 1 -- 172.21.15.84:0/2563566672 >> 172.21.15.84:0/2563566672 conn(0x7fd334079760 msgr2=0x7fd334104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:39.262 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.255+0000 7fd33b952640 1 -- 172.21.15.84:0/2563566672 shutdown_connections 2024-09-21T03:50:39.263 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:39.255+0000 7fd33b952640 1 -- 172.21.15.84:0/2563566672 wait complete. 2024-09-21T03:50:40.133 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:50:40.380 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:50:40.817 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:40 smithi084 ceph-mon[30941]: pgmap v574: 97 pgs: 97 active+clean; 15 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 9 op/s 2024-09-21T03:50:40.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:40 smithi174 ceph-mon[34403]: pgmap v574: 97 pgs: 97 active+clean; 15 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 9 op/s 2024-09-21T03:50:40.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:40 smithi172 ceph-mon[34821]: pgmap v574: 97 pgs: 97 active+clean; 15 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 9 op/s 2024-09-21T03:50:40.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.905+0000 7f06d2555640 1 -- 172.21.15.84:0/735842149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06cc108d70 msgr2=0x7f06cc10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:40.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.905+0000 7f06d2555640 1 --2- 172.21.15.84:0/735842149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06cc108d70 0x7f06cc10f5a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009ca0 tx=0x7f06c402a8e0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.905+0000 7f06d2555640 1 -- 172.21.15.84:0/735842149 shutdown_connections 2024-09-21T03:50:40.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.905+0000 7f06d2555640 1 --2- 172.21.15.84:0/735842149 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06cc108d70 0x7f06cc10f5a0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.905+0000 7f06d2555640 1 --2- 172.21.15.84:0/735842149 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06cc108420 0x7f06cc108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.905+0000 7f06d2555640 1 --2- 172.21.15.84:0/735842149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06cc102ae0 0x7f06cc102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.905+0000 7f06d2555640 1 -- 172.21.15.84:0/735842149 >> 172.21.15.84:0/735842149 conn(0x7f06cc079770 msgr2=0x7f06cc079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:40.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.905+0000 7f06d2555640 1 -- 172.21.15.84:0/735842149 shutdown_connections 2024-09-21T03:50:40.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.905+0000 7f06d2555640 1 -- 172.21.15.84:0/735842149 wait complete. 2024-09-21T03:50:40.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.906+0000 7f06d2555640 1 Processor -- start 2024-09-21T03:50:40.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.906+0000 7f06d2555640 1 -- start start 2024-09-21T03:50:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.906+0000 7f06d2555640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06cc102ae0 0x7f06cc19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.906+0000 7f06d2555640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06cc108420 0x7f06cc19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.906+0000 7f06d2555640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06cc108d70 0x7f06cc19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.906+0000 7f06d2555640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc113b70 con 0x7f06cc102ae0 2024-09-21T03:50:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.906+0000 7f06d2555640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc1139f0 con 0x7f06cc108420 2024-09-21T03:50:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.906+0000 7f06d2555640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc113cf0 con 0x7f06cc108d70 2024-09-21T03:50:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.907+0000 7f06cbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06cc102ae0 0x7f06cc19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.907+0000 7f06cbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06cc102ae0 0x7f06cc19a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48708/0 (socket says 172.21.15.84:48708) 2024-09-21T03:50:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.907+0000 7f06cbfff640 1 -- 172.21.15.84:0/551820531 learned_addr learned my addr 172.21.15.84:0/551820531 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.907+0000 7f06d0af2640 1 --2- 172.21.15.84:0/551820531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06cc108d70 0x7f06cc19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:40.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.907+0000 7f06cb7fe640 1 --2- 172.21.15.84:0/551820531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06cc108420 0x7f06cc19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.907+0000 7f06cbfff640 1 -- 172.21.15.84:0/551820531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06cc108d70 msgr2=0x7f06cc19fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.907+0000 7f06cbfff640 1 --2- 172.21.15.84:0/551820531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06cc108d70 0x7f06cc19fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.907+0000 7f06cbfff640 1 -- 172.21.15.84:0/551820531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06cc108420 msgr2=0x7f06cc19aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.907+0000 7f06cbfff640 1 --2- 172.21.15.84:0/551820531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06cc108420 0x7f06cc19aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.907+0000 7f06cbfff640 1 -- 172.21.15.84:0/551820531 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06cc1a0470 con 0x7f06cc102ae0 2024-09-21T03:50:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.907+0000 7f06cb7fe640 1 --2- 172.21.15.84:0/551820531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06cc108420 0x7f06cc19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:50:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.907+0000 7f06cbfff640 1 --2- 172.21.15.84:0/551820531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06cc102ae0 0x7f06cc19a500 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00d950 tx=0x7f06bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.907+0000 7f06c97fa640 1 -- 172.21.15.84:0/551820531 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc017070 con 0x7f06cc102ae0 2024-09-21T03:50:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.907+0000 7f06c97fa640 1 -- 172.21.15.84:0/551820531 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06bc009c30 con 0x7f06cc102ae0 2024-09-21T03:50:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.907+0000 7f06d2555640 1 -- 172.21.15.84:0/551820531 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06cc1a0760 con 0x7f06cc102ae0 2024-09-21T03:50:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.907+0000 7f06c97fa640 1 -- 172.21.15.84:0/551820531 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc00f620 con 0x7f06cc102ae0 2024-09-21T03:50:40.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.907+0000 7f06d2555640 1 -- 172.21.15.84:0/551820531 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06cc1a6ec0 con 0x7f06cc102ae0 2024-09-21T03:50:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.910+0000 7f06d8ac9740 1 Processor -- start 2024-09-21T03:50:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.910+0000 7f06c97fa640 1 -- 172.21.15.84:0/551820531 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f06bc010460 con 0x7f06cc102ae0 2024-09-21T03:50:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.910+0000 7f06d8ac9740 1 -- start start 2024-09-21T03:50:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.910+0000 7f06d8ac9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf7ae070 0x5646bfb556a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.910+0000 7f06d8ac9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf7851b0 0x5646bfb55be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.910+0000 7f06d8ac9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf78d390 0x5646bfb56120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.910+0000 7f06d8ac9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5646bfacbea0 con 0x5646bf78d390 2024-09-21T03:50:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.910+0000 7f06d8ac9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5646bfabb2d0 con 0x5646bf7ae070 2024-09-21T03:50:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.910+0000 7f06d8ac9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5646bfabf0e0 con 0x5646bf7851b0 2024-09-21T03:50:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.910+0000 7f06cb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf78d390 0x5646bfb56120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:40.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.910+0000 7f06cb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf78d390 0x5646bfb56120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48716/0 (socket says 172.21.15.84:48716) 2024-09-21T03:50:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.911+0000 7f06cb7fe640 1 -- 172.21.15.84:0/495128146 learned_addr learned my addr 172.21.15.84:0/495128146 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.911+0000 7f06cbfff640 1 --2- 172.21.15.84:0/495128146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf7851b0 0x5646bfb55be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.911+0000 7f06d0af2640 1 --2- 172.21.15.84:0/495128146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf7ae070 0x5646bfb556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.911+0000 7f06c97fa640 1 --2- 172.21.15.84:0/551820531 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f06b80b6680 0x7f06b80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.911+0000 7f06cb7fe640 1 -- 172.21.15.84:0/495128146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf7851b0 msgr2=0x5646bfb55be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.911+0000 7f06cb7fe640 1 --2- 172.21.15.84:0/495128146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf7851b0 0x5646bfb55be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.911+0000 7f06cb7fe640 1 -- 172.21.15.84:0/495128146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf7ae070 msgr2=0x5646bfb556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.911+0000 7f06cb7fe640 1 --2- 172.21.15.84:0/495128146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf7ae070 0x5646bfb556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.911+0000 7f06cb7fe640 1 -- 172.21.15.84:0/495128146 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646bf819650 con 0x5646bf78d390 2024-09-21T03:50:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.911+0000 7f06d0af2640 1 --2- 172.21.15.84:0/551820531 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f06b80b6680 0x7f06b80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.911+0000 7f06c97fa640 1 -- 172.21.15.84:0/551820531 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f06bc0e7340 con 0x7f06cc102ae0 2024-09-21T03:50:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.911+0000 7f06cb7fe640 1 --2- 172.21.15.84:0/495128146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf78d390 0x5646bfb56120 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f06b40077a0 tx=0x7f06b4007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3c3891ce5cd9ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.911+0000 7f06c27fc640 1 -- 172.21.15.84:0/495128146 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b400d950 con 0x5646bf78d390 2024-09-21T03:50:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.911+0000 7f06c27fc640 1 -- 172.21.15.84:0/495128146 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06b4018070 con 0x5646bf78d390 2024-09-21T03:50:40.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.911+0000 7f06c27fc640 1 -- 172.21.15.84:0/495128146 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b4013e40 con 0x5646bf78d390 2024-09-21T03:50:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.912+0000 7f06d8ac9740 1 -- 172.21.15.84:0/495128146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf78d390 msgr2=0x5646bfb56120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.912+0000 7f06d0af2640 1 --2- 172.21.15.84:0/551820531 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f06b80b6680 0x7f06b80b8b90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f06c4006010 tx=0x7f06c403e040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.912+0000 7f06d8ac9740 1 --2- 172.21.15.84:0/495128146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf78d390 0x5646bfb56120 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f06b40077a0 tx=0x7f06b4007c60 comp rx=0 tx=0).stop 2024-09-21T03:50:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.912+0000 7f06d8ac9740 1 -- 172.21.15.84:0/495128146 shutdown_connections 2024-09-21T03:50:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.912+0000 7f06d8ac9740 1 --2- 172.21.15.84:0/495128146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf78d390 0x5646bfb56120 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.912+0000 7f06d8ac9740 1 --2- 172.21.15.84:0/495128146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf7851b0 0x5646bfb55be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.912+0000 7f06d8ac9740 1 --2- 172.21.15.84:0/495128146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf7ae070 0x5646bfb556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.912+0000 7f06d8ac9740 1 -- 172.21.15.84:0/495128146 >> 172.21.15.84:0/495128146 conn(0x5646bf7a2460 msgr2=0x5646bfb53590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.912+0000 7f06d8ac9740 1 -- 172.21.15.84:0/495128146 shutdown_connections 2024-09-21T03:50:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.912+0000 7f06d8ac9740 1 -- 172.21.15.84:0/495128146 wait complete. 2024-09-21T03:50:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.913+0000 7f06d8ac9740 1 -- start start 2024-09-21T03:50:40.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.913+0000 7f06d8ac9740 1 Processor -- start 2024-09-21T03:50:40.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.913+0000 7f06d8ac9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf7851b0 0x5646bfb60c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:40.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.913+0000 7f06d8ac9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf78d390 0x5646bfb611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:40.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.913+0000 7f06d8ac9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf7ae070 0x5646bfb616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:40.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.913+0000 7f06d8ac9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5646bf91c700 con 0x5646bf78d390 2024-09-21T03:50:40.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.913+0000 7f06d8ac9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5646bfa56160 con 0x5646bf7ae070 2024-09-21T03:50:40.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.913+0000 7f06d8ac9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5646bfb68290 con 0x5646bf7851b0 2024-09-21T03:50:40.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.913+0000 7f06d8ac9740 10 client.0 _ll_register_callbacks cb 0x5646bfa6f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:40.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.914+0000 7f06cb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf78d390 0x5646bfb611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:40.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.914+0000 7f06cb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf78d390 0x5646bfb611a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48728/0 (socket says 172.21.15.84:48728) 2024-09-21T03:50:40.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.914+0000 7f06cb7fe640 1 -- 172.21.15.84:0/108851352 learned_addr learned my addr 172.21.15.84:0/108851352 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:40.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.914+0000 7f06cbfff640 1 --2- 172.21.15.84:0/108851352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf7851b0 0x5646bfb60c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:40.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.914+0000 7f06d0af2640 1 --2- 172.21.15.84:0/108851352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf7ae070 0x5646bfb616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:40.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.914+0000 7f06cb7fe640 1 -- 172.21.15.84:0/108851352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf7851b0 msgr2=0x5646bfb60c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:40.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.914+0000 7f06cb7fe640 1 --2- 172.21.15.84:0/108851352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf7851b0 0x5646bfb60c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.914+0000 7f06cb7fe640 1 -- 172.21.15.84:0/108851352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf7ae070 msgr2=0x5646bfb616e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:40.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.914+0000 7f06cb7fe640 1 --2- 172.21.15.84:0/108851352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf7ae070 0x5646bfb616e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.914+0000 7f06cb7fe640 1 -- 172.21.15.84:0/108851352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646bfa83c90 con 0x5646bf78d390 2024-09-21T03:50:40.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.914+0000 7f06cb7fe640 1 --2- 172.21.15.84:0/108851352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf78d390 0x5646bfb611a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f06b4013a60 tx=0x7f06b40136b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45997f43aab747c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:40.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.914+0000 7f06ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:40.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.914+0000 7f06ab7fe640 1 -- 172.21.15.84:0/108851352 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06b400d950 con 0x5646bf78d390 2024-09-21T03:50:40.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.914+0000 7f06ab7fe640 1 -- 172.21.15.84:0/108851352 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f06b400daf0 con 0x5646bf78d390 2024-09-21T03:50:40.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.914+0000 7f06d8ac9740 1 -- 172.21.15.84:0/108851352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06b4018070 con 0x5646bf78d390 2024-09-21T03:50:40.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.914+0000 7f06ab7fe640 1 -- 172.21.15.84:0/108851352 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f06b400dd10 con 0x5646bf78d390 2024-09-21T03:50:40.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.914+0000 7f06d8ac9740 10 client.16923 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:40.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.914+0000 7f06d8ac9740 1 -- 172.21.15.84:0/108851352 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5646bfb73ea0 con 0x5646bf78d390 2024-09-21T03:50:40.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.915+0000 7f06ab7fe640 1 -- 172.21.15.84:0/108851352 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06b4018070 con 0x5646bf78d390 2024-09-21T03:50:40.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.915+0000 7f06ab7fe640 1 -- 172.21.15.84:0/108851352 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f06b40233d0 con 0x5646bf78d390 2024-09-21T03:50:40.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.915+0000 7f06d8ac9740 10 client.16923 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:40.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.915+0000 7f06d8ac9740 10 client.16923 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:50:40.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.915+0000 7f06d8ac9740 20 client.16923 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:40.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.915+0000 7f06d8ac9740 1 --2- 172.21.15.84:0/108851352 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5646bf76c9f0 0x5646bfb77310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:40.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.915+0000 7f06d8ac9740 4 client.16923 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:50:40.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.915+0000 7f06d8ac9740 1 -- 172.21.15.84:0/108851352 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646bfacddf0 con 0x5646bf76c9f0 2024-09-21T03:50:40.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.915+0000 7f06cbfff640 1 --2- 172.21.15.84:0/108851352 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5646bf76c9f0 0x5646bfb77310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:40.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.916+0000 7f06cbfff640 1 --2- 172.21.15.84:0/108851352 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5646bf76c9f0 0x5646bfb77310 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bc3b61a8cc48e11 server_cookie=a71b20f32fb71b3 in_seq=0 out_seq=0 2024-09-21T03:50:40.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.916+0000 7f06ab7fe640 10 client.16923 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:40.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.916+0000 7f06ab7fe640 1 -- 172.21.15.84:0/108851352 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5646bfacddf0 con 0x5646bf76c9f0 2024-09-21T03:50:40.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.916+0000 7f06ab7fe640 10 client.16923 handle_command_reply: tid=0 2024-09-21T03:50:40.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.916+0000 7f06d8ac9740 1 client.16923 shutdown 2024-09-21T03:50:40.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.917+0000 7f06d8ac9740 1 -- 172.21.15.84:0/108851352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf78d390 msgr2=0x5646bfb611a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:40.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.917+0000 7f06d8ac9740 1 --2- 172.21.15.84:0/108851352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf78d390 0x5646bfb611a0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f06b4013a60 tx=0x7f06b40136b0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.917+0000 7f06d8ac9740 1 -- 172.21.15.84:0/108851352 shutdown_connections 2024-09-21T03:50:40.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.917+0000 7f06d8ac9740 1 --2- 172.21.15.84:0/108851352 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5646bf76c9f0 0x5646bfb77310 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.917+0000 7f06d8ac9740 1 --2- 172.21.15.84:0/108851352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf7ae070 0x5646bfb616e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.917+0000 7f06d8ac9740 1 --2- 172.21.15.84:0/108851352 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf78d390 0x5646bfb611a0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.917+0000 7f06d8ac9740 1 --2- 172.21.15.84:0/108851352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf7851b0 0x5646bfb60c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.917+0000 7f06ab7fe640 0 client.16923 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:40.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.917+0000 7f06d8ac9740 1 -- 172.21.15.84:0/108851352 >> 172.21.15.84:0/108851352 conn(0x5646bf7a2460 msgr2=0x5646bfb58830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:40.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.917+0000 7f06d8ac9740 1 -- 172.21.15.84:0/108851352 shutdown_connections 2024-09-21T03:50:40.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.917+0000 7f06d8ac9740 1 -- 172.21.15.84:0/108851352 wait complete. 2024-09-21T03:50:40.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.917+0000 7f06d8ac9740 20 client.16923 trim_cache size 0 max 16384 2024-09-21T03:50:40.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.930+0000 7f06d8ac9740 1 Processor -- start 2024-09-21T03:50:40.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.930+0000 7f06d8ac9740 1 -- start start 2024-09-21T03:50:40.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.930+0000 7f06d8ac9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf7851b0 0x5646bfb57090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:40.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.930+0000 7f06d8ac9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf78d390 0x5646bfb70c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:40.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.930+0000 7f06d8ac9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf7ae070 0x5646bfb5de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:40.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.930+0000 7f06d8ac9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc1afdc0 con 0x5646bf7851b0 2024-09-21T03:50:40.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.930+0000 7f06d8ac9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc1ad690 con 0x5646bf78d390 2024-09-21T03:50:40.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.930+0000 7f06d8ac9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc1ab500 con 0x5646bf7ae070 2024-09-21T03:50:40.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.930+0000 7f06cbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf7851b0 0x5646bfb57090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.930+0000 7f06cbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf7851b0 0x5646bfb57090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48730/0 (socket says 172.21.15.84:48730) 2024-09-21T03:50:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.930+0000 7f06cbfff640 1 -- 172.21.15.84:0/2456119260 learned_addr learned my addr 172.21.15.84:0/2456119260 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.930+0000 7f06d0af2640 1 --2- 172.21.15.84:0/2456119260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf7ae070 0x5646bfb5de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.930+0000 7f06cb7fe640 1 --2- 172.21.15.84:0/2456119260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf78d390 0x5646bfb70c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.930+0000 7f06cbfff640 1 -- 172.21.15.84:0/2456119260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf7ae070 msgr2=0x5646bfb5de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.930+0000 7f06cbfff640 1 --2- 172.21.15.84:0/2456119260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf7ae070 0x5646bfb5de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.930+0000 7f06cbfff640 1 -- 172.21.15.84:0/2456119260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf78d390 msgr2=0x5646bfb70c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.931+0000 7f06cbfff640 1 --2- 172.21.15.84:0/2456119260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf78d390 0x5646bfb70c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.931+0000 7f06cbfff640 1 -- 172.21.15.84:0/2456119260 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646bfb633a0 con 0x5646bf7851b0 2024-09-21T03:50:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.931+0000 7f06d0af2640 1 --2- 172.21.15.84:0/2456119260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf7ae070 0x5646bfb5de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.931+0000 7f06cb7fe640 1 --2- 172.21.15.84:0/2456119260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf78d390 0x5646bfb70c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:40.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.931+0000 7f06cbfff640 1 --2- 172.21.15.84:0/2456119260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf7851b0 0x5646bfb57090 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0e50e0 tx=0x7f06bc0eae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294d552c82f11207 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:40.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.931+0000 7f06c1ffb640 1 -- 172.21.15.84:0/2456119260 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc020040 con 0x5646bf7851b0 2024-09-21T03:50:40.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.931+0000 7f06c1ffb640 1 -- 172.21.15.84:0/2456119260 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06bc0accf0 con 0x5646bf7851b0 2024-09-21T03:50:40.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.931+0000 7f06c1ffb640 1 -- 172.21.15.84:0/2456119260 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc009de0 con 0x5646bf7851b0 2024-09-21T03:50:40.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.932+0000 7f06d8ac9740 1 -- 172.21.15.84:0/2456119260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf7851b0 msgr2=0x5646bfb57090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:40.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.932+0000 7f06d8ac9740 1 --2- 172.21.15.84:0/2456119260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf7851b0 0x5646bfb57090 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0e50e0 tx=0x7f06bc0eae90 comp rx=0 tx=0).stop 2024-09-21T03:50:40.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.932+0000 7f06d8ac9740 1 -- 172.21.15.84:0/2456119260 shutdown_connections 2024-09-21T03:50:40.939 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.932+0000 7f06d8ac9740 1 --2- 172.21.15.84:0/2456119260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf7ae070 0x5646bfb5de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.932+0000 7f06d8ac9740 1 --2- 172.21.15.84:0/2456119260 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf78d390 0x5646bfb70c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.932+0000 7f06d8ac9740 1 --2- 172.21.15.84:0/2456119260 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf7851b0 0x5646bfb57090 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.932+0000 7f06d8ac9740 1 -- 172.21.15.84:0/2456119260 >> 172.21.15.84:0/2456119260 conn(0x5646bf7a2460 msgr2=0x5646bfb70510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:40.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.932+0000 7f06d8ac9740 1 -- 172.21.15.84:0/2456119260 shutdown_connections 2024-09-21T03:50:40.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.932+0000 7f06d8ac9740 1 -- 172.21.15.84:0/2456119260 wait complete. 2024-09-21T03:50:40.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.932+0000 7f06d8ac9740 1 -- start start 2024-09-21T03:50:40.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.932+0000 7f06d8ac9740 1 Processor -- start 2024-09-21T03:50:40.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06d8ac9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf7851b0 0x5646bfb782c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:40.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06d8ac9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf78d390 0x5646bfb78800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:40.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06d8ac9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf7ae070 0x5646bfb78d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:40.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06d8ac9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc1abb50 con 0x5646bf7851b0 2024-09-21T03:50:40.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06d8ac9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc1acfc0 con 0x5646bf7ae070 2024-09-21T03:50:40.940 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06d8ac9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc1ac220 con 0x5646bf78d390 2024-09-21T03:50:40.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06d8ac9740 10 client.0 _ll_register_callbacks cb 0x7f06bc0ead60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:40.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06cbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf7851b0 0x5646bfb782c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:40.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06cbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf7851b0 0x5646bfb782c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48734/0 (socket says 172.21.15.84:48734) 2024-09-21T03:50:40.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06cbfff640 1 -- 172.21.15.84:0/3387331200 learned_addr learned my addr 172.21.15.84:0/3387331200 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:40.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06cb7fe640 1 --2- 172.21.15.84:0/3387331200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf78d390 0x5646bfb78800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:40.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06d0af2640 1 --2- 172.21.15.84:0/3387331200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf7ae070 0x5646bfb78d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:40.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06cbfff640 1 -- 172.21.15.84:0/3387331200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf78d390 msgr2=0x5646bfb78800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:40.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06cbfff640 1 --2- 172.21.15.84:0/3387331200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf78d390 0x5646bfb78800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06cbfff640 1 -- 172.21.15.84:0/3387331200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf7ae070 msgr2=0x5646bfb78d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:40.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06cbfff640 1 --2- 172.21.15.84:0/3387331200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf7ae070 0x5646bfb78d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06cbfff640 1 -- 172.21.15.84:0/3387331200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646bfbe0a90 con 0x5646bf7851b0 2024-09-21T03:50:40.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06d0af2640 1 --2- 172.21.15.84:0/3387331200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf7ae070 0x5646bfb78d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:40.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06cbfff640 1 --2- 172.21.15.84:0/3387331200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf7851b0 0x5646bfb782c0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0ad170 tx=0x7f06bc010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd82656901a5ef0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:40.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:40.941 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06ab7fe640 1 -- 172.21.15.84:0/3387331200 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc020070 con 0x5646bf7851b0 2024-09-21T03:50:40.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06ab7fe640 1 -- 172.21.15.84:0/3387331200 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f06bc0a8d30 con 0x5646bf7851b0 2024-09-21T03:50:40.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.933+0000 7f06d8ac9740 1 -- 172.21.15.84:0/3387331200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06bc0accf0 con 0x5646bf7851b0 2024-09-21T03:50:40.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.934+0000 7f06ab7fe640 1 -- 172.21.15.84:0/3387331200 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f06bc0acb30 con 0x5646bf7851b0 2024-09-21T03:50:40.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.934+0000 7f06d8ac9740 10 client.16929 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:40.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.934+0000 7f06d8ac9740 1 -- 172.21.15.84:0/3387331200 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5646bfbe1b20 con 0x5646bf7851b0 2024-09-21T03:50:40.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.934+0000 7f06ab7fe640 1 -- 172.21.15.84:0/3387331200 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06bc0accf0 con 0x5646bf7851b0 2024-09-21T03:50:40.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.934+0000 7f06ab7fe640 1 -- 172.21.15.84:0/3387331200 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f06bc0ac070 con 0x5646bf7851b0 2024-09-21T03:50:40.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.934+0000 7f06d8ac9740 10 client.16929 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:40.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.934+0000 7f06d8ac9740 10 client.16929 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:50:40.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.934+0000 7f06d8ac9740 20 client.16929 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:40.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.934+0000 7f06d8ac9740 1 --2- 172.21.15.84:0/3387331200 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5646bf741da0 0x5646bfbe4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:40.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.934+0000 7f06d8ac9740 4 client.16929 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:50:40.942 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.934+0000 7f06d8ac9740 1 -- 172.21.15.84:0/3387331200 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5646bfac98a0 con 0x5646bf741da0 2024-09-21T03:50:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.934+0000 7f06cb7fe640 1 --2- 172.21.15.84:0/3387331200 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5646bf741da0 0x5646bfbe4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.935+0000 7f06cb7fe640 1 --2- 172.21.15.84:0/3387331200 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5646bf741da0 0x5646bfbe4300 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e224013d4b0e4cbb server_cookie=defb1b4f739308b1 in_seq=0 out_seq=0 2024-09-21T03:50:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.935+0000 7f06ab7fe640 10 client.16929 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.935+0000 7f06ab7fe640 1 -- 172.21.15.84:0/3387331200 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5646bfac98a0 con 0x5646bf741da0 2024-09-21T03:50:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.935+0000 7f06ab7fe640 10 client.16929 handle_command_reply: tid=0 2024-09-21T03:50:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.935+0000 7f06d8ac9740 1 client.16929 shutdown 2024-09-21T03:50:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.935+0000 7f06d8ac9740 1 -- 172.21.15.84:0/3387331200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf7851b0 msgr2=0x5646bfb782c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.935+0000 7f06d8ac9740 1 --2- 172.21.15.84:0/3387331200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf7851b0 0x5646bfb782c0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0ad170 tx=0x7f06bc010cb0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.935+0000 7f06d8ac9740 1 -- 172.21.15.84:0/3387331200 shutdown_connections 2024-09-21T03:50:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.935+0000 7f06d8ac9740 1 --2- 172.21.15.84:0/3387331200 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5646bf741da0 0x5646bfbe4300 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.935+0000 7f06d8ac9740 1 --2- 172.21.15.84:0/3387331200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5646bf7ae070 0x5646bfb78d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.935+0000 7f06d8ac9740 1 --2- 172.21.15.84:0/3387331200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5646bf78d390 0x5646bfb78800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.935+0000 7f06d8ac9740 1 --2- 172.21.15.84:0/3387331200 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5646bf7851b0 0x5646bfb782c0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.935+0000 7f06d8ac9740 1 -- 172.21.15.84:0/3387331200 >> 172.21.15.84:0/3387331200 conn(0x5646bf7a2460 msgr2=0x5646bfb56e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:40.943 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.935+0000 7f06ab7fe640 0 client.16929 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:40.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.935+0000 7f06d8ac9740 1 -- 172.21.15.84:0/3387331200 shutdown_connections 2024-09-21T03:50:40.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.935+0000 7f06d8ac9740 1 -- 172.21.15.84:0/3387331200 wait complete. 2024-09-21T03:50:40.944 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.936+0000 7f06d8ac9740 20 client.16929 trim_cache size 0 max 16384 2024-09-21T03:50:40.944 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:50:40.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.936+0000 7f06d2555640 1 -- 172.21.15.84:0/551820531 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f06b80b6680 msgr2=0x7f06b80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:40.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.936+0000 7f06d2555640 1 --2- 172.21.15.84:0/551820531 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f06b80b6680 0x7f06b80b8b90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f06c4006010 tx=0x7f06c403e040 comp rx=0 tx=0).stop 2024-09-21T03:50:40.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.936+0000 7f06d2555640 1 -- 172.21.15.84:0/551820531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06cc102ae0 msgr2=0x7f06cc19a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:40.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.936+0000 7f06d2555640 1 --2- 172.21.15.84:0/551820531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06cc102ae0 0x7f06cc19a500 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00d950 tx=0x7f06bc00de10 comp rx=0 tx=0).stop 2024-09-21T03:50:40.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.936+0000 7f06d2555640 1 -- 172.21.15.84:0/551820531 shutdown_connections 2024-09-21T03:50:40.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.936+0000 7f06d2555640 1 --2- 172.21.15.84:0/551820531 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f06b80b6680 0x7f06b80b8b90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.936+0000 7f06d2555640 1 --2- 172.21.15.84:0/551820531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f06cc108d70 0x7f06cc19fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.936+0000 7f06d2555640 1 --2- 172.21.15.84:0/551820531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06cc108420 0x7f06cc19aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.936+0000 7f06d2555640 1 --2- 172.21.15.84:0/551820531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f06cc102ae0 0x7f06cc19a500 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:40.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.936+0000 7f06d2555640 1 -- 172.21.15.84:0/551820531 >> 172.21.15.84:0/551820531 conn(0x7f06cc079770 msgr2=0x7f06cc106430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:40.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.936+0000 7f06d2555640 1 -- 172.21.15.84:0/551820531 shutdown_connections 2024-09-21T03:50:40.945 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:40.936+0000 7f06d2555640 1 -- 172.21.15.84:0/551820531 wait complete. 2024-09-21T03:50:42.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:42 smithi084 ceph-mon[30941]: pgmap v575: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-21T03:50:42.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:42 smithi174 ceph-mon[34403]: pgmap v575: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-21T03:50:42.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:42 smithi172 ceph-mon[34821]: pgmap v575: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-21T03:50:42.913 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:50:42.913 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:50:43.170 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:50:43.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.650+0000 7f5761a07640 1 -- 172.21.15.84:0/1210985589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c109df0 msgr2=0x7f575c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:43.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.650+0000 7f5761a07640 1 --2- 172.21.15.84:0/1210985589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c109df0 0x7f575c110620 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f5754009900 tx=0x7f575402a410 comp rx=0 tx=0).stop 2024-09-21T03:50:43.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.650+0000 7f5761a07640 1 -- 172.21.15.84:0/1210985589 shutdown_connections 2024-09-21T03:50:43.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.650+0000 7f5761a07640 1 --2- 172.21.15.84:0/1210985589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c109df0 0x7f575c110620 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.650+0000 7f5761a07640 1 --2- 172.21.15.84:0/1210985589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f575c1094a0 0x7f575c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.650+0000 7f5761a07640 1 --2- 172.21.15.84:0/1210985589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f575c103b60 0x7f575c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.650+0000 7f5761a07640 1 -- 172.21.15.84:0/1210985589 >> 172.21.15.84:0/1210985589 conn(0x7f575c07b850 msgr2=0x7f575c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:43.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.650+0000 7f5761a07640 1 -- 172.21.15.84:0/1210985589 shutdown_connections 2024-09-21T03:50:43.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.650+0000 7f5761a07640 1 -- 172.21.15.84:0/1210985589 wait complete. 2024-09-21T03:50:43.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.651+0000 7f5761a07640 1 Processor -- start 2024-09-21T03:50:43.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.651+0000 7f5761a07640 1 -- start start 2024-09-21T03:50:43.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.651+0000 7f5761a07640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f575c103b60 0x7f575c19a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:43.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.651+0000 7f5761a07640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c1094a0 0x7f575c19a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:43.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.651+0000 7f5761a07640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f575c109df0 0x7f575c19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:43.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.651+0000 7f5761a07640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f575c113ab0 con 0x7f575c1094a0 2024-09-21T03:50:43.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.651+0000 7f5761a07640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f575c113930 con 0x7f575c109df0 2024-09-21T03:50:43.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.651+0000 7f5761a07640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f575c113c30 con 0x7f575c103b60 2024-09-21T03:50:43.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.651+0000 7f575a7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c1094a0 0x7f575c19a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:43.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.652+0000 7f575a7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c1094a0 0x7f575c19a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48746/0 (socket says 172.21.15.84:48746) 2024-09-21T03:50:43.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.652+0000 7f575a7fc640 1 -- 172.21.15.84:0/2849749248 learned_addr learned my addr 172.21.15.84:0/2849749248 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:43.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.652+0000 7f575b7fe640 1 --2- 172.21.15.84:0/2849749248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f575c109df0 0x7f575c19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:43.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.652+0000 7f575affd640 1 --2- 172.21.15.84:0/2849749248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f575c103b60 0x7f575c19a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:43.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.652+0000 7f575a7fc640 1 -- 172.21.15.84:0/2849749248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f575c103b60 msgr2=0x7f575c19a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:43.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.652+0000 7f575a7fc640 1 --2- 172.21.15.84:0/2849749248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f575c103b60 0x7f575c19a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.652+0000 7f575a7fc640 1 -- 172.21.15.84:0/2849749248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f575c109df0 msgr2=0x7f575c19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:43.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.652+0000 7f575a7fc640 1 --2- 172.21.15.84:0/2849749248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f575c109df0 0x7f575c19fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.652+0000 7f575a7fc640 1 -- 172.21.15.84:0/2849749248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575c1a0370 con 0x7f575c1094a0 2024-09-21T03:50:43.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.652+0000 7f575a7fc640 1 --2- 172.21.15.84:0/2849749248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c1094a0 0x7f575c19a9a0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f574400d740 tx=0x7f574400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:43.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.652+0000 7f5760a05640 1 -- 172.21.15.84:0/2849749248 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744017070 con 0x7f575c1094a0 2024-09-21T03:50:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.652+0000 7f5760a05640 1 -- 172.21.15.84:0/2849749248 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f574400de50 con 0x7f575c1094a0 2024-09-21T03:50:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.652+0000 7f5761a07640 1 -- 172.21.15.84:0/2849749248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575c1a0660 con 0x7f575c1094a0 2024-09-21T03:50:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.652+0000 7f5760a05640 1 -- 172.21.15.84:0/2849749248 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574400f620 con 0x7f575c1094a0 2024-09-21T03:50:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.652+0000 7f5761a07640 1 -- 172.21.15.84:0/2849749248 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f575c1a6dc0 con 0x7f575c1094a0 2024-09-21T03:50:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.655+0000 7f5767f7b740 1 Processor -- start 2024-09-21T03:50:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.655+0000 7f5760a05640 1 -- 172.21.15.84:0/2849749248 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f574401a070 con 0x7f575c1094a0 2024-09-21T03:50:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.655+0000 7f5767f7b740 1 -- start start 2024-09-21T03:50:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.655+0000 7f5767f7b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56094001e350 0x5609403c5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.655+0000 7f5767f7b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fff5490 0x5609403c5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.655+0000 7f5767f7b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56093fffd670 0x5609403c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.655+0000 7f5767f7b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56094033be60 con 0x56094001e350 2024-09-21T03:50:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.655+0000 7f5767f7b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56094032b290 con 0x56093fff5490 2024-09-21T03:50:43.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.655+0000 7f5767f7b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56094032f0a0 con 0x56093fffd670 2024-09-21T03:50:43.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.656+0000 7f575b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56094001e350 0x5609403c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:43.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.656+0000 7f575b7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56094001e350 0x5609403c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48748/0 (socket says 172.21.15.84:48748) 2024-09-21T03:50:43.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.656+0000 7f575b7fe640 1 -- 172.21.15.84:0/2959149866 learned_addr learned my addr 172.21.15.84:0/2959149866 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:43.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.656+0000 7f575a7fc640 1 --2- 172.21.15.84:0/2959149866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56093fffd670 0x5609403c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:43.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.656+0000 7f575affd640 1 --2- 172.21.15.84:0/2959149866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fff5490 0x5609403c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:43.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.656+0000 7f575b7fe640 1 -- 172.21.15.84:0/2959149866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56093fffd670 msgr2=0x5609403c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:43.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.656+0000 7f575b7fe640 1 --2- 172.21.15.84:0/2959149866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56093fffd670 0x5609403c5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.656+0000 7f575b7fe640 1 -- 172.21.15.84:0/2959149866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fff5490 msgr2=0x5609403c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:43.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.656+0000 7f575b7fe640 1 --2- 172.21.15.84:0/2959149866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fff5490 0x5609403c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.656+0000 7f575b7fe640 1 -- 172.21.15.84:0/2959149866 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560940089930 con 0x56094001e350 2024-09-21T03:50:43.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.656+0000 7f575a7fc640 1 --2- 172.21.15.84:0/2959149866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56093fffd670 0x5609403c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:50:43.672 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.656+0000 7f5760a05640 1 --2- 172.21.15.84:0/2849749248 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f57480b6680 0x7f57480b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.656+0000 7f575b7fe640 1 --2- 172.21.15.84:0/2959149866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56094001e350 0x5609403c5430 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f5754009900 tx=0x7f5754032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8932cd7327d39484 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.656+0000 7f575affd640 1 --2- 172.21.15.84:0/2849749248 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f57480b6680 0x7f57480b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.656+0000 7f5760a05640 1 -- 172.21.15.84:0/2849749248 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f57440e70f0 con 0x7f575c1094a0 2024-09-21T03:50:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.656+0000 7f5751ffb640 1 -- 172.21.15.84:0/2959149866 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754040070 con 0x56094001e350 2024-09-21T03:50:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.656+0000 7f5751ffb640 1 -- 172.21.15.84:0/2959149866 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5754032e50 con 0x56094001e350 2024-09-21T03:50:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.656+0000 7f5751ffb640 1 -- 172.21.15.84:0/2959149866 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754035040 con 0x56094001e350 2024-09-21T03:50:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.657+0000 7f5767f7b740 1 -- 172.21.15.84:0/2959149866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56094001e350 msgr2=0x5609403c5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.657+0000 7f575affd640 1 --2- 172.21.15.84:0/2849749248 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f57480b6680 0x7f57480b8b90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x5609403c40b0 tx=0x7f574c009580 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.657+0000 7f5767f7b740 1 --2- 172.21.15.84:0/2959149866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56094001e350 0x5609403c5430 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f5754009900 tx=0x7f5754032c60 comp rx=0 tx=0).stop 2024-09-21T03:50:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.657+0000 7f5767f7b740 1 -- 172.21.15.84:0/2959149866 shutdown_connections 2024-09-21T03:50:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.657+0000 7f5767f7b740 1 --2- 172.21.15.84:0/2959149866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56093fffd670 0x5609403c5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.657+0000 7f5767f7b740 1 --2- 172.21.15.84:0/2959149866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fff5490 0x5609403c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.657+0000 7f5767f7b740 1 --2- 172.21.15.84:0/2959149866 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56094001e350 0x5609403c5430 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.657+0000 7f5767f7b740 1 -- 172.21.15.84:0/2959149866 >> 172.21.15.84:0/2959149866 conn(0x560940012740 msgr2=0x5609403c3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:43.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.657+0000 7f5767f7b740 1 -- 172.21.15.84:0/2959149866 shutdown_connections 2024-09-21T03:50:43.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.657+0000 7f5767f7b740 1 -- 172.21.15.84:0/2959149866 wait complete. 2024-09-21T03:50:43.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.658+0000 7f5767f7b740 1 -- start start 2024-09-21T03:50:43.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.658+0000 7f5767f7b740 1 Processor -- start 2024-09-21T03:50:43.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.658+0000 7f5767f7b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fff5490 0x5609403d1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:43.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.658+0000 7f5767f7b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fffd670 0x5609403d1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:43.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.658+0000 7f5767f7b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56094001e350 0x5609403dced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:43.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.658+0000 7f5767f7b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56094018c890 con 0x56093fffd670 2024-09-21T03:50:43.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.658+0000 7f5767f7b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5609402c5d40 con 0x56093fff5490 2024-09-21T03:50:43.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.658+0000 7f5767f7b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5609403d3bb0 con 0x56094001e350 2024-09-21T03:50:43.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.658+0000 7f5767f7b740 10 client.0 _ll_register_callbacks cb 0x560940329c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:43.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.658+0000 7f575a7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fffd670 0x5609403d1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:43.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.658+0000 7f575a7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fffd670 0x5609403d1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48762/0 (socket says 172.21.15.84:48762) 2024-09-21T03:50:43.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.658+0000 7f575a7fc640 1 -- 172.21.15.84:0/738401282 learned_addr learned my addr 172.21.15.84:0/738401282 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:43.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.658+0000 7f575affd640 1 --2- 172.21.15.84:0/738401282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fff5490 0x5609403d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:43.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.659+0000 7f575a7fc640 1 -- 172.21.15.84:0/738401282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56094001e350 msgr2=0x5609403dced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:43.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.659+0000 7f575a7fc640 1 --2- 172.21.15.84:0/738401282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56094001e350 0x5609403dced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.659+0000 7f575a7fc640 1 -- 172.21.15.84:0/738401282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fff5490 msgr2=0x5609403d1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:43.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.659+0000 7f575a7fc640 1 --2- 172.21.15.84:0/738401282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fff5490 0x5609403d1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.659+0000 7f575a7fc640 1 -- 172.21.15.84:0/738401282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609403dd4c0 con 0x56093fffd670 2024-09-21T03:50:43.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.659+0000 7f575affd640 1 --2- 172.21.15.84:0/738401282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fff5490 0x5609403d1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:50:43.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.659+0000 7f575a7fc640 1 --2- 172.21.15.84:0/738401282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fffd670 0x5609403d1590 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f57440aa200 tx=0x7f57440eaa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07c8f73816cf83b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:43.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.659+0000 7f573affd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.659+0000 7f573affd640 1 -- 172.21.15.84:0/738401282 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744021070 con 0x56093fffd670 2024-09-21T03:50:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.659+0000 7f573affd640 1 -- 172.21.15.84:0/738401282 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f57440940d0 con 0x56093fffd670 2024-09-21T03:50:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.659+0000 7f5767f7b740 1 -- 172.21.15.84:0/738401282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5754032e50 con 0x56093fffd670 2024-09-21T03:50:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.659+0000 7f573affd640 1 -- 172.21.15.84:0/738401282 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f57440ac8e0 con 0x56093fffd670 2024-09-21T03:50:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.659+0000 7f5767f7b740 10 client.16941 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.659+0000 7f5767f7b740 1 -- 172.21.15.84:0/738401282 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5609403dfdd0 con 0x56093fffd670 2024-09-21T03:50:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.659+0000 7f573affd640 1 -- 172.21.15.84:0/738401282 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5754032e50 con 0x56093fffd670 2024-09-21T03:50:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.660+0000 7f573affd640 1 -- 172.21.15.84:0/738401282 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f57440a88e0 con 0x56093fffd670 2024-09-21T03:50:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.660+0000 7f5767f7b740 10 client.16941 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.660+0000 7f5767f7b740 10 client.16941 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:50:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.660+0000 7f5767f7b740 20 client.16941 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.660+0000 7f5767f7b740 1 --2- 172.21.15.84:0/738401282 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56093ffdccd0 0x5609403e3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:43.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.660+0000 7f5767f7b740 4 client.16941 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:50:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.660+0000 7f5767f7b740 1 -- 172.21.15.84:0/738401282 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56094033ddb0 con 0x56093ffdccd0 2024-09-21T03:50:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.660+0000 7f575affd640 1 --2- 172.21.15.84:0/738401282 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56093ffdccd0 0x5609403e3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.660+0000 7f575affd640 1 --2- 172.21.15.84:0/738401282 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56093ffdccd0 0x5609403e3280 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff6b048d18479189 server_cookie=1b1abd3d04914816 in_seq=0 out_seq=0 2024-09-21T03:50:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.660+0000 7f573affd640 10 client.16941 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.661+0000 7f573affd640 1 -- 172.21.15.84:0/738401282 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56094033ddb0 con 0x56093ffdccd0 2024-09-21T03:50:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.661+0000 7f573affd640 10 client.16941 handle_command_reply: tid=0 2024-09-21T03:50:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.661+0000 7f5767f7b740 1 client.16941 shutdown 2024-09-21T03:50:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.661+0000 7f5767f7b740 1 -- 172.21.15.84:0/738401282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fffd670 msgr2=0x5609403d1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.661+0000 7f5767f7b740 1 --2- 172.21.15.84:0/738401282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fffd670 0x5609403d1590 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f57440aa200 tx=0x7f57440eaa20 comp rx=0 tx=0).stop 2024-09-21T03:50:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.661+0000 7f5767f7b740 1 -- 172.21.15.84:0/738401282 shutdown_connections 2024-09-21T03:50:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.661+0000 7f5767f7b740 1 --2- 172.21.15.84:0/738401282 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56093ffdccd0 0x5609403e3280 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.661+0000 7f5767f7b740 1 --2- 172.21.15.84:0/738401282 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56094001e350 0x5609403dced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.661+0000 7f5767f7b740 1 --2- 172.21.15.84:0/738401282 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fffd670 0x5609403d1590 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.661+0000 7f5767f7b740 1 --2- 172.21.15.84:0/738401282 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fff5490 0x5609403d1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.661+0000 7f5767f7b740 1 -- 172.21.15.84:0/738401282 >> 172.21.15.84:0/738401282 conn(0x560940012740 msgr2=0x5609403c8610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:43.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.661+0000 7f573affd640 0 client.16941 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:43.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.661+0000 7f5767f7b740 1 -- 172.21.15.84:0/738401282 shutdown_connections 2024-09-21T03:50:43.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.661+0000 7f5767f7b740 1 -- 172.21.15.84:0/738401282 wait complete. 2024-09-21T03:50:43.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.662+0000 7f5767f7b740 20 client.16941 trim_cache size 0 max 16384 2024-09-21T03:50:43.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.679+0000 7f5767f7b740 1 Processor -- start 2024-09-21T03:50:43.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.679+0000 7f5767f7b740 1 -- start start 2024-09-21T03:50:43.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.679+0000 7f5767f7b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fff5490 0x5609403dcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:43.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.679+0000 7f5767f7b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fffd670 0x5609403d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:43.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.679+0000 7f5767f7b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56094001e350 0x5609403c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:43.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.679+0000 7f5767f7b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f575c1b1e80 con 0x56093fff5490 2024-09-21T03:50:43.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.679+0000 7f5767f7b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f575c1af750 con 0x56093fffd670 2024-09-21T03:50:43.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.679+0000 7f5767f7b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f575c1ad5c0 con 0x56094001e350 2024-09-21T03:50:43.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.679+0000 7f575affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fff5490 0x5609403dcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:43.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.679+0000 7f575affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fff5490 0x5609403dcdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48766/0 (socket says 172.21.15.84:48766) 2024-09-21T03:50:43.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.679+0000 7f575affd640 1 -- 172.21.15.84:0/3111506088 learned_addr learned my addr 172.21.15.84:0/3111506088 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:43.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.679+0000 7f575a7fc640 1 --2- 172.21.15.84:0/3111506088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fffd670 0x5609403d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:43.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.680+0000 7f575b7fe640 1 --2- 172.21.15.84:0/3111506088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56094001e350 0x5609403c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:43.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.680+0000 7f575affd640 1 -- 172.21.15.84:0/3111506088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56094001e350 msgr2=0x5609403c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:43.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.680+0000 7f575affd640 1 --2- 172.21.15.84:0/3111506088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56094001e350 0x5609403c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.680+0000 7f575affd640 1 -- 172.21.15.84:0/3111506088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fffd670 msgr2=0x5609403d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:43.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.680+0000 7f575affd640 1 --2- 172.21.15.84:0/3111506088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fffd670 0x5609403d06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.680+0000 7f575affd640 1 -- 172.21.15.84:0/3111506088 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609403c7720 con 0x56093fff5490 2024-09-21T03:50:43.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.680+0000 7f575b7fe640 1 --2- 172.21.15.84:0/3111506088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56094001e350 0x5609403c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:43.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.680+0000 7f575affd640 1 --2- 172.21.15.84:0/3111506088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fff5490 0x5609403dcdd0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f574c005fd0 tx=0x7f574c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4dfd76793f1a543 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:43.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.680+0000 7f57517fa640 1 -- 172.21.15.84:0/3111506088 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c020bb0 con 0x56093fff5490 2024-09-21T03:50:43.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.680+0000 7f57517fa640 1 -- 172.21.15.84:0/3111506088 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f574c02c030 con 0x56093fff5490 2024-09-21T03:50:43.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.680+0000 7f57517fa640 1 -- 172.21.15.84:0/3111506088 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c004520 con 0x56093fff5490 2024-09-21T03:50:43.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.681+0000 7f5767f7b740 1 -- 172.21.15.84:0/3111506088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fff5490 msgr2=0x5609403dcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:43.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.681+0000 7f5767f7b740 1 --2- 172.21.15.84:0/3111506088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fff5490 0x5609403dcdd0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f574c005fd0 tx=0x7f574c014000 comp rx=0 tx=0).stop 2024-09-21T03:50:43.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.681+0000 7f5767f7b740 1 -- 172.21.15.84:0/3111506088 shutdown_connections 2024-09-21T03:50:43.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.681+0000 7f5767f7b740 1 --2- 172.21.15.84:0/3111506088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56094001e350 0x5609403c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.681+0000 7f5767f7b740 1 --2- 172.21.15.84:0/3111506088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fffd670 0x5609403d06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.681+0000 7f5767f7b740 1 --2- 172.21.15.84:0/3111506088 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fff5490 0x5609403dcdd0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.681+0000 7f5767f7b740 1 -- 172.21.15.84:0/3111506088 >> 172.21.15.84:0/3111506088 conn(0x560940012740 msgr2=0x5609403c6460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:43.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.681+0000 7f5767f7b740 1 -- 172.21.15.84:0/3111506088 shutdown_connections 2024-09-21T03:50:43.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.681+0000 7f5767f7b740 1 -- 172.21.15.84:0/3111506088 wait complete. 2024-09-21T03:50:43.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.681+0000 7f5767f7b740 1 -- start start 2024-09-21T03:50:43.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.682+0000 7f5767f7b740 1 Processor -- start 2024-09-21T03:50:43.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.682+0000 7f5767f7b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fff5490 0x56094044b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:43.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.682+0000 7f5767f7b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fffd670 0x56094044b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:43.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.682+0000 7f5767f7b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56094001e350 0x560940447cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:43.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.682+0000 7f5767f7b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f575c1adc10 con 0x56093fff5490 2024-09-21T03:50:43.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.682+0000 7f5767f7b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f575c1af080 con 0x56093fffd670 2024-09-21T03:50:43.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.682+0000 7f5767f7b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f575c1ae2e0 con 0x56094001e350 2024-09-21T03:50:43.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.682+0000 7f5767f7b740 10 client.0 _ll_register_callbacks cb 0x7f5744009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:43.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.682+0000 7f575affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fff5490 0x56094044b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:43.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.682+0000 7f575affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fff5490 0x56094044b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48774/0 (socket says 172.21.15.84:48774) 2024-09-21T03:50:43.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.682+0000 7f575affd640 1 -- 172.21.15.84:0/1816363489 learned_addr learned my addr 172.21.15.84:0/1816363489 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:43.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.682+0000 7f575b7fe640 1 --2- 172.21.15.84:0/1816363489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56094001e350 0x560940447cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.682+0000 7f575a7fc640 1 --2- 172.21.15.84:0/1816363489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fffd670 0x56094044b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.682+0000 7f575affd640 1 -- 172.21.15.84:0/1816363489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56094001e350 msgr2=0x560940447cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.682+0000 7f575affd640 1 --2- 172.21.15.84:0/1816363489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56094001e350 0x560940447cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.682+0000 7f575affd640 1 -- 172.21.15.84:0/1816363489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fffd670 msgr2=0x56094044b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.682+0000 7f575affd640 1 --2- 172.21.15.84:0/1816363489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fffd670 0x56094044b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.682+0000 7f575affd640 1 -- 172.21.15.84:0/1816363489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609404484b0 con 0x56093fff5490 2024-09-21T03:50:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.683+0000 7f575affd640 1 --2- 172.21.15.84:0/1816363489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fff5490 0x56094044b010 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f574c0040a0 tx=0x7f574c012f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857a0f378b142100 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.683+0000 7f573affd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.683+0000 7f573affd640 1 -- 172.21.15.84:0/1816363489 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c041060 con 0x56093fff5490 2024-09-21T03:50:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.683+0000 7f5767f7b740 1 -- 172.21.15.84:0/1816363489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f574c02c030 con 0x56093fff5490 2024-09-21T03:50:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.683+0000 7f573affd640 1 -- 172.21.15.84:0/1816363489 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f574c021b40 con 0x56093fff5490 2024-09-21T03:50:43.691 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.683+0000 7f573affd640 1 -- 172.21.15.84:0/1816363489 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f574c021d40 con 0x56093fff5490 2024-09-21T03:50:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.683+0000 7f5767f7b740 10 client.16947 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.683+0000 7f5767f7b740 1 -- 172.21.15.84:0/1816363489 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5609403d8910 con 0x56093fff5490 2024-09-21T03:50:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.683+0000 7f573affd640 1 -- 172.21.15.84:0/1816363489 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f574c02c030 con 0x56093fff5490 2024-09-21T03:50:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.683+0000 7f573affd640 1 -- 172.21.15.84:0/1816363489 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f574c00f040 con 0x56093fff5490 2024-09-21T03:50:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.683+0000 7f5767f7b740 10 client.16947 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.683+0000 7f5767f7b740 10 client.16947 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:50:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.683+0000 7f5767f7b740 20 client.16947 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.683+0000 7f5767f7b740 1 --2- 172.21.15.84:0/1816363489 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56093ffb2080 0x5609403d9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.683+0000 7f5767f7b740 4 client.16947 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:50:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.683+0000 7f5767f7b740 1 -- 172.21.15.84:0/1816363489 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560940339860 con 0x56093ffb2080 2024-09-21T03:50:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.684+0000 7f575a7fc640 1 --2- 172.21.15.84:0/1816363489 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56093ffb2080 0x5609403d9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:43.692 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.684+0000 7f573affd640 10 client.16947 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:43.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.684+0000 7f575a7fc640 1 --2- 172.21.15.84:0/1816363489 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56093ffb2080 0x5609403d9040 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6f1f5dd92c422f6 server_cookie=9c412ddf85530ced in_seq=0 out_seq=0 2024-09-21T03:50:43.693 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.686+0000 7f573affd640 1 -- 172.21.15.84:0/1816363489 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560940339860 con 0x56093ffb2080 2024-09-21T03:50:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.686+0000 7f573affd640 10 client.16947 handle_command_reply: tid=0 2024-09-21T03:50:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.686+0000 7f5767f7b740 1 client.16947 shutdown 2024-09-21T03:50:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.686+0000 7f5767f7b740 1 -- 172.21.15.84:0/1816363489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fff5490 msgr2=0x56094044b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.686+0000 7f5767f7b740 1 --2- 172.21.15.84:0/1816363489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fff5490 0x56094044b010 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f574c0040a0 tx=0x7f574c012f70 comp rx=0 tx=0).stop 2024-09-21T03:50:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.686+0000 7f5767f7b740 1 -- 172.21.15.84:0/1816363489 shutdown_connections 2024-09-21T03:50:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.686+0000 7f5767f7b740 1 --2- 172.21.15.84:0/1816363489 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56093ffb2080 0x5609403d9040 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.686+0000 7f573affd640 0 client.16947 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.686+0000 7f5767f7b740 1 --2- 172.21.15.84:0/1816363489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56094001e350 0x560940447cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.686+0000 7f5767f7b740 1 --2- 172.21.15.84:0/1816363489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56093fffd670 0x56094044b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.686+0000 7f5767f7b740 1 --2- 172.21.15.84:0/1816363489 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56093fff5490 0x56094044b010 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.686+0000 7f5767f7b740 1 -- 172.21.15.84:0/1816363489 >> 172.21.15.84:0/1816363489 conn(0x560940012740 msgr2=0x5609403c8530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:43.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.687+0000 7f5767f7b740 1 -- 172.21.15.84:0/1816363489 shutdown_connections 2024-09-21T03:50:43.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.687+0000 7f5767f7b740 1 -- 172.21.15.84:0/1816363489 wait complete. 2024-09-21T03:50:43.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.687+0000 7f5767f7b740 20 client.16947 trim_cache size 0 max 16384 2024-09-21T03:50:43.695 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:50:43.695 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T03:50:43.695 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "d85cdf50-3fc8-467d-942f-2b77981ba106", 2024-09-21T03:50:43.695 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T03:50:43.695 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:50:43.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.687+0000 7f5761a07640 1 -- 172.21.15.84:0/2849749248 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f57480b6680 msgr2=0x7f57480b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:43.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.687+0000 7f5761a07640 1 --2- 172.21.15.84:0/2849749248 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f57480b6680 0x7f57480b8b90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x5609403c40b0 tx=0x7f574c009580 comp rx=0 tx=0).stop 2024-09-21T03:50:43.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.687+0000 7f5761a07640 1 -- 172.21.15.84:0/2849749248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c1094a0 msgr2=0x7f575c19a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:43.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.687+0000 7f5761a07640 1 --2- 172.21.15.84:0/2849749248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c1094a0 0x7f575c19a9a0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f574400d740 tx=0x7f574400dc00 comp rx=0 tx=0).stop 2024-09-21T03:50:43.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.687+0000 7f5761a07640 1 -- 172.21.15.84:0/2849749248 shutdown_connections 2024-09-21T03:50:43.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.687+0000 7f5761a07640 1 --2- 172.21.15.84:0/2849749248 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f57480b6680 0x7f57480b8b90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.687+0000 7f5761a07640 1 --2- 172.21.15.84:0/2849749248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f575c109df0 0x7f575c19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.687+0000 7f5761a07640 1 --2- 172.21.15.84:0/2849749248 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f575c1094a0 0x7f575c19a9a0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.687+0000 7f5761a07640 1 --2- 172.21.15.84:0/2849749248 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f575c103b60 0x7f575c19a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:43.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.687+0000 7f5761a07640 1 -- 172.21.15.84:0/2849749248 >> 172.21.15.84:0/2849749248 conn(0x7f575c07b850 msgr2=0x7f575c105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:43.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.687+0000 7f5761a07640 1 -- 172.21.15.84:0/2849749248 shutdown_connections 2024-09-21T03:50:43.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:43.687+0000 7f5761a07640 1 -- 172.21.15.84:0/2849749248 wait complete. 2024-09-21T03:50:43.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:43 smithi084 ceph-mon[30941]: scrub queued for path: / 2024-09-21T03:50:43.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:43 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:50:43.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:43 smithi084 ceph-mon[30941]: scrub summary: active paths [/] 2024-09-21T03:50:43.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:43 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:50:44.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:43 smithi174 ceph-mon[34403]: scrub queued for path: / 2024-09-21T03:50:44.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:43 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:50:44.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:43 smithi174 ceph-mon[34403]: scrub summary: active paths [/] 2024-09-21T03:50:44.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:43 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:50:44.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:43 smithi172 ceph-mon[34821]: scrub queued for path: / 2024-09-21T03:50:44.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:43 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:50:44.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:43 smithi172 ceph-mon[34821]: scrub summary: active paths [/] 2024-09-21T03:50:44.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:43 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:50:44.727 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:50:44.982 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:50:45.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:44 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:50:45.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:44 smithi084 ceph-mon[30941]: pgmap v576: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 12 op/s 2024-09-21T03:50:45.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:44 smithi084 ceph-mon[30941]: scrub summary: idle 2024-09-21T03:50:45.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:44 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:50:45.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:44 smithi174 ceph-mon[34403]: pgmap v576: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 12 op/s 2024-09-21T03:50:45.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:44 smithi174 ceph-mon[34403]: scrub summary: idle 2024-09-21T03:50:45.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:44 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:50:45.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:44 smithi172 ceph-mon[34821]: pgmap v576: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 12 op/s 2024-09-21T03:50:45.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:44 smithi172 ceph-mon[34821]: scrub summary: idle 2024-09-21T03:50:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.510+0000 7f8e0b41b640 1 -- 172.21.15.84:0/2498745107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e04108d00 msgr2=0x7f8e0410f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.510+0000 7f8e0b41b640 1 --2- 172.21.15.84:0/2498745107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e04108d00 0x7f8e0410f530 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc009ca0 tx=0x7f8dfc02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.510+0000 7f8e0b41b640 1 -- 172.21.15.84:0/2498745107 shutdown_connections 2024-09-21T03:50:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.510+0000 7f8e0b41b640 1 --2- 172.21.15.84:0/2498745107 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e04108d00 0x7f8e0410f530 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.510+0000 7f8e0b41b640 1 --2- 172.21.15.84:0/2498745107 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e041083b0 0x7f8e041087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.527 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.510+0000 7f8e0b41b640 1 --2- 172.21.15.84:0/2498745107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e04102a70 0x7f8e04102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.510+0000 7f8e0b41b640 1 -- 172.21.15.84:0/2498745107 >> 172.21.15.84:0/2498745107 conn(0x7f8e04079730 msgr2=0x7f8e04079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.511+0000 7f8e0b41b640 1 -- 172.21.15.84:0/2498745107 shutdown_connections 2024-09-21T03:50:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.511+0000 7f8e0b41b640 1 -- 172.21.15.84:0/2498745107 wait complete. 2024-09-21T03:50:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.511+0000 7f8e0b41b640 1 Processor -- start 2024-09-21T03:50:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.511+0000 7f8e0b41b640 1 -- start start 2024-09-21T03:50:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.511+0000 7f8e0b41b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e04102a70 0x7f8e0419b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.511+0000 7f8e0b41b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e041083b0 0x7f8e0419b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.512+0000 7f8e0b41b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e04108d00 0x7f8e0419bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.512+0000 7f8e0b41b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8e04112970 con 0x7f8e04108d00 2024-09-21T03:50:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.512+0000 7f8e0b41b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e041127f0 con 0x7f8e041083b0 2024-09-21T03:50:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.512+0000 7f8e0b41b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8e04112af0 con 0x7f8e04102a70 2024-09-21T03:50:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.512+0000 7f8e099b8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e04108d00 0x7f8e0419bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.512+0000 7f8e099b8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e04108d00 0x7f8e0419bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48794/0 (socket says 172.21.15.84:48794) 2024-09-21T03:50:45.528 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.512+0000 7f8e089b6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e041083b0 0x7f8e0419b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.512+0000 7f8e099b8640 1 -- 172.21.15.84:0/1364890120 learned_addr learned my addr 172.21.15.84:0/1364890120 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.512+0000 7f8e091b7640 1 --2- 172.21.15.84:0/1364890120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e04102a70 0x7f8e0419b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.512+0000 7f8e099b8640 1 -- 172.21.15.84:0/1364890120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e04102a70 msgr2=0x7f8e0419b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.512+0000 7f8e099b8640 1 --2- 172.21.15.84:0/1364890120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e04102a70 0x7f8e0419b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.512+0000 7f8e099b8640 1 -- 172.21.15.84:0/1364890120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e041083b0 msgr2=0x7f8e0419b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.512+0000 7f8e099b8640 1 --2- 172.21.15.84:0/1364890120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e041083b0 0x7f8e0419b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.512+0000 7f8e099b8640 1 -- 172.21.15.84:0/1364890120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e041a6610 con 0x7f8e04108d00 2024-09-21T03:50:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.512+0000 7f8e089b6640 1 --2- 172.21.15.84:0/1364890120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e041083b0 0x7f8e0419b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:50:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.512+0000 7f8e099b8640 1 --2- 172.21.15.84:0/1364890120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e04108d00 0x7f8e0419bd80 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc005cc0 tx=0x7f8dfc02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.512+0000 7f8dfa7fc640 1 -- 172.21.15.84:0/1364890120 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc003bf0 con 0x7f8e04108d00 2024-09-21T03:50:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.513+0000 7f8e0b41b640 1 -- 172.21.15.84:0/1364890120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e041a68a0 con 0x7f8e04108d00 2024-09-21T03:50:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.513+0000 7f8dfa7fc640 1 -- 172.21.15.84:0/1364890120 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dfc003d90 con 0x7f8e04108d00 2024-09-21T03:50:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.513+0000 7f8dfa7fc640 1 -- 172.21.15.84:0/1364890120 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc02fbc0 con 0x7f8e04108d00 2024-09-21T03:50:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.513+0000 7f8e0b41b640 1 -- 172.21.15.84:0/1364890120 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e041a6de0 con 0x7f8e04108d00 2024-09-21T03:50:45.529 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.515+0000 7f8e1198f740 1 Processor -- start 2024-09-21T03:50:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.516+0000 7f8dfa7fc640 1 -- 172.21.15.84:0/1364890120 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f8dfc02fd60 con 0x7f8e04108d00 2024-09-21T03:50:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.516+0000 7f8e1198f740 1 -- start start 2024-09-21T03:50:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.516+0000 7f8e1198f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c87853b070 0x55c8788e2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.516+0000 7f8e1198f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8785121b0 0x55c8788e2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.516+0000 7f8e1198f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c87851a390 0x55c8788e30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.516+0000 7f8e1198f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c878858e50 con 0x55c87851a390 2024-09-21T03:50:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.516+0000 7f8e1198f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c878848280 con 0x55c87853b070 2024-09-21T03:50:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.516+0000 7f8e1198f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c87884c090 con 0x55c8785121b0 2024-09-21T03:50:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.516+0000 7f8e089b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c87851a390 0x55c8788e30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.517+0000 7f8e089b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c87851a390 0x55c8788e30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48802/0 (socket says 172.21.15.84:48802) 2024-09-21T03:50:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.517+0000 7f8e089b6640 1 -- 172.21.15.84:0/1072295858 learned_addr learned my addr 172.21.15.84:0/1072295858 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.517+0000 7f8e091b7640 1 --2- 172.21.15.84:0/1072295858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8785121b0 0x55c8788e2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:45.530 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.517+0000 7f8e089b6640 1 --2- 172.21.15.84:0/1072295858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c87853b070 0x55c8788e2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.517+0000 7f8dfa7fc640 1 --2- 172.21.15.84:0/1364890120 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8df00b6680 0x7f8df00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.517+0000 7f8e099b8640 1 --2- 172.21.15.84:0/1364890120 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8df00b6680 0x7f8df00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.517+0000 7f8e089b6640 1 -- 172.21.15.84:0/1072295858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8785121b0 msgr2=0x55c8788e2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.517+0000 7f8e089b6640 1 --2- 172.21.15.84:0/1072295858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8785121b0 0x55c8788e2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.517+0000 7f8e089b6640 1 -- 172.21.15.84:0/1072295858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c87853b070 msgr2=0x55c8788e2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.517+0000 7f8e089b6640 1 --2- 172.21.15.84:0/1072295858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c87853b070 0x55c8788e2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.517+0000 7f8e089b6640 1 -- 172.21.15.84:0/1072295858 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8785a6650 con 0x55c87851a390 2024-09-21T03:50:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.517+0000 7f8e091b7640 1 --2- 172.21.15.84:0/1072295858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8785121b0 0x55c8788e2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:50:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.517+0000 7f8dfa7fc640 1 -- 172.21.15.84:0/1364890120 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f8dfc108b60 con 0x7f8e04108d00 2024-09-21T03:50:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.517+0000 7f8e089b6640 1 --2- 172.21.15.84:0/1072295858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c87851a390 0x55c8788e30d0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f8df40128c0 tx=0x7f8df400bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2027848b84f9bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.517+0000 7f8e099b8640 1 --2- 172.21.15.84:0/1364890120 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8df00b6680 0x7f8df00b8b90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc1063b0 tx=0x7f8dfc09b7c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.518+0000 7f8def7fe640 1 -- 172.21.15.84:0/1072295858 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4012250 con 0x55c87851a390 2024-09-21T03:50:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.518+0000 7f8def7fe640 1 -- 172.21.15.84:0/1072295858 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8df40054d0 con 0x55c87851a390 2024-09-21T03:50:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.518+0000 7f8def7fe640 1 -- 172.21.15.84:0/1072295858 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df40049a0 con 0x55c87851a390 2024-09-21T03:50:45.531 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.518+0000 7f8e1198f740 1 -- 172.21.15.84:0/1072295858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c87851a390 msgr2=0x55c8788e30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.518+0000 7f8e1198f740 1 --2- 172.21.15.84:0/1072295858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c87851a390 0x55c8788e30d0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f8df40128c0 tx=0x7f8df400bb60 comp rx=0 tx=0).stop 2024-09-21T03:50:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.518+0000 7f8e1198f740 1 -- 172.21.15.84:0/1072295858 shutdown_connections 2024-09-21T03:50:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.518+0000 7f8e1198f740 1 --2- 172.21.15.84:0/1072295858 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c87851a390 0x55c8788e30d0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.518+0000 7f8e1198f740 1 --2- 172.21.15.84:0/1072295858 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c8785121b0 0x55c8788e2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.518+0000 7f8e1198f740 1 --2- 172.21.15.84:0/1072295858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c87853b070 0x55c8788e2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.518+0000 7f8e1198f740 1 -- 172.21.15.84:0/1072295858 >> 172.21.15.84:0/1072295858 conn(0x55c87852f460 msgr2=0x55c8788e0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.519+0000 7f8e1198f740 1 -- 172.21.15.84:0/1072295858 shutdown_connections 2024-09-21T03:50:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.519+0000 7f8e1198f740 1 -- 172.21.15.84:0/1072295858 wait complete. 2024-09-21T03:50:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.519+0000 7f8e1198f740 1 -- start start 2024-09-21T03:50:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.519+0000 7f8e1198f740 1 Processor -- start 2024-09-21T03:50:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.520+0000 7f8e1198f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8785121b0 0x55c8788edcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.520+0000 7f8e1198f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c87851a390 0x55c8788ee230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.520+0000 7f8e1198f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87853b070 0x55c8788fa120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.520+0000 7f8e1198f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c8786a9700 con 0x55c8785121b0 2024-09-21T03:50:45.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.520+0000 7f8e1198f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c8787e3110 con 0x55c87851a390 2024-09-21T03:50:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.520+0000 7f8e1198f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c8788f0e30 con 0x55c87853b070 2024-09-21T03:50:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.520+0000 7f8e1198f740 10 client.0 _ll_register_callbacks cb 0x55c8787fc990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.520+0000 7f8e089b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8785121b0 0x55c8788edcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.520+0000 7f8e089b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8785121b0 0x55c8788edcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48808/0 (socket says 172.21.15.84:48808) 2024-09-21T03:50:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.520+0000 7f8e089b6640 1 -- 172.21.15.84:0/4162703275 learned_addr learned my addr 172.21.15.84:0/4162703275 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.520+0000 7f8e091b7640 1 --2- 172.21.15.84:0/4162703275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c87851a390 0x55c8788ee230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.520+0000 7f8e089b6640 1 --2- 172.21.15.84:0/4162703275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87853b070 0x55c8788fa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.520+0000 7f8e089b6640 1 -- 172.21.15.84:0/4162703275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87853b070 msgr2=0x55c8788fa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.520+0000 7f8e089b6640 1 --2- 172.21.15.84:0/4162703275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87853b070 0x55c8788fa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.520+0000 7f8e089b6640 1 -- 172.21.15.84:0/4162703275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c87851a390 msgr2=0x55c8788ee230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.520+0000 7f8e089b6640 1 --2- 172.21.15.84:0/4162703275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c87851a390 0x55c8788ee230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.520+0000 7f8e089b6640 1 -- 172.21.15.84:0/4162703275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c878810c40 con 0x55c8785121b0 2024-09-21T03:50:45.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.520+0000 7f8e089b6640 1 --2- 172.21.15.84:0/4162703275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8785121b0 0x55c8788edcf0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f8df4011010 tx=0x7f8df4010eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d9c27b297ae77c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:45.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.520+0000 7f8decff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:45.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.521+0000 7f8decff9640 1 -- 172.21.15.84:0/4162703275 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df40046c0 con 0x55c8785121b0 2024-09-21T03:50:45.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.521+0000 7f8decff9640 1 -- 172.21.15.84:0/4162703275 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f8df4004860 con 0x55c8785121b0 2024-09-21T03:50:45.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.521+0000 7f8e1198f740 1 -- 172.21.15.84:0/4162703275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8df40054d0 con 0x55c8785121b0 2024-09-21T03:50:45.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.521+0000 7f8decff9640 1 -- 172.21.15.84:0/4162703275 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8df4036050 con 0x55c8785121b0 2024-09-21T03:50:45.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.521+0000 7f8e1198f740 10 client.16959 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:45.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.521+0000 7f8e1198f740 1 -- 172.21.15.84:0/4162703275 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c8788fcb20 con 0x55c8785121b0 2024-09-21T03:50:45.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.521+0000 7f8decff9640 1 -- 172.21.15.84:0/4162703275 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8df40054d0 con 0x55c8785121b0 2024-09-21T03:50:45.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.521+0000 7f8decff9640 1 -- 172.21.15.84:0/4162703275 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8df401ea80 con 0x55c8785121b0 2024-09-21T03:50:45.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.521+0000 7f8e1198f740 10 client.16959 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:45.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.521+0000 7f8e1198f740 10 client.16959 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:50:45.534 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.521+0000 7f8e1198f740 20 client.16959 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:45.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.521+0000 7f8e1198f740 1 --2- 172.21.15.84:0/4162703275 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c8784f99f0 0x55c8788ffe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:45.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.521+0000 7f8e1198f740 4 client.16959 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:50:45.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.521+0000 7f8e1198f740 1 -- 172.21.15.84:0/4162703275 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c87885ada0 con 0x55c8784f99f0 2024-09-21T03:50:45.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.522+0000 7f8e091b7640 1 --2- 172.21.15.84:0/4162703275 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c8784f99f0 0x55c8788ffe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:45.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.522+0000 7f8e091b7640 1 --2- 172.21.15.84:0/4162703275 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c8784f99f0 0x55c8788ffe80 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60c841e7739ded4a server_cookie=5898e39bd8ac0092 in_seq=0 out_seq=0 2024-09-21T03:50:45.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.522+0000 7f8decff9640 10 client.16959 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:45.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.523+0000 7f8decff9640 1 -- 172.21.15.84:0/4162703275 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c87885ada0 con 0x55c8784f99f0 2024-09-21T03:50:45.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.523+0000 7f8decff9640 10 client.16959 handle_command_reply: tid=0 2024-09-21T03:50:45.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.523+0000 7f8e1198f740 1 client.16959 shutdown 2024-09-21T03:50:45.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.523+0000 7f8e1198f740 1 -- 172.21.15.84:0/4162703275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8785121b0 msgr2=0x55c8788edcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:45.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.523+0000 7f8e1198f740 1 --2- 172.21.15.84:0/4162703275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8785121b0 0x55c8788edcf0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f8df4011010 tx=0x7f8df4010eb0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.523+0000 7f8e1198f740 1 -- 172.21.15.84:0/4162703275 shutdown_connections 2024-09-21T03:50:45.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.523+0000 7f8e1198f740 1 --2- 172.21.15.84:0/4162703275 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c8784f99f0 0x55c8788ffe80 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.523+0000 7f8e1198f740 1 --2- 172.21.15.84:0/4162703275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87853b070 0x55c8788fa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.535 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.523+0000 7f8e1198f740 1 --2- 172.21.15.84:0/4162703275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c87851a390 0x55c8788ee230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.523+0000 7f8decff9640 0 client.16959 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:45.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.523+0000 7f8e1198f740 1 --2- 172.21.15.84:0/4162703275 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8785121b0 0x55c8788edcf0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.523+0000 7f8e1198f740 1 -- 172.21.15.84:0/4162703275 >> 172.21.15.84:0/4162703275 conn(0x55c87852f460 msgr2=0x55c8788e5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:45.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.523+0000 7f8e1198f740 1 -- 172.21.15.84:0/4162703275 shutdown_connections 2024-09-21T03:50:45.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.523+0000 7f8e1198f740 1 -- 172.21.15.84:0/4162703275 wait complete. 2024-09-21T03:50:45.536 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.523+0000 7f8e1198f740 20 client.16959 trim_cache size 0 max 16384 2024-09-21T03:50:45.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.541+0000 7f8e1198f740 1 Processor -- start 2024-09-21T03:50:45.543 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.541+0000 7f8e1198f740 1 -- start start 2024-09-21T03:50:45.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.541+0000 7f8e1198f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8785121b0 0x55c8788efbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:45.544 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.541+0000 7f8e1198f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c87851a390 0x55c8788e3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.542+0000 7f8e1198f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87853b070 0x55c8788fa020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.542+0000 7f8e1198f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8e041b1ed0 con 0x55c87851a390 2024-09-21T03:50:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.542+0000 7f8e1198f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e041af7a0 con 0x55c8785121b0 2024-09-21T03:50:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.542+0000 7f8e1198f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8e041ad610 con 0x55c87853b070 2024-09-21T03:50:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.542+0000 7f8e091b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c87851a390 0x55c8788e3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.542+0000 7f8e091b7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c87851a390 0x55c8788e3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48812/0 (socket says 172.21.15.84:48812) 2024-09-21T03:50:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.542+0000 7f8e091b7640 1 -- 172.21.15.84:0/2762251783 learned_addr learned my addr 172.21.15.84:0/2762251783 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.542+0000 7f8e089b6640 1 --2- 172.21.15.84:0/2762251783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8785121b0 0x55c8788efbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.542+0000 7f8e089b6640 1 --2- 172.21.15.84:0/2762251783 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87853b070 0x55c8788fa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.542+0000 7f8e091b7640 1 -- 172.21.15.84:0/2762251783 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87853b070 msgr2=0x55c8788fa020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.542+0000 7f8e091b7640 1 --2- 172.21.15.84:0/2762251783 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87853b070 0x55c8788fa020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.542+0000 7f8e091b7640 1 -- 172.21.15.84:0/2762251783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8785121b0 msgr2=0x55c8788efbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.542+0000 7f8e091b7640 1 --2- 172.21.15.84:0/2762251783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8785121b0 0x55c8788efbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.545 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.542+0000 7f8e091b7640 1 -- 172.21.15.84:0/2762251783 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8788e4940 con 0x55c87851a390 2024-09-21T03:50:45.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.542+0000 7f8e089b6640 1 --2- 172.21.15.84:0/2762251783 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87853b070 0x55c8788fa020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:50:45.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.542+0000 7f8e091b7640 1 --2- 172.21.15.84:0/2762251783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c87851a390 0x55c8788e3d40 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f8e000041c0 tx=0x7f8e0000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3995d548d174c078 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:45.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.542+0000 7f8deeffd640 1 -- 172.21.15.84:0/2762251783 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e00003e20 con 0x55c87851a390 2024-09-21T03:50:45.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.543+0000 7f8deeffd640 1 -- 172.21.15.84:0/2762251783 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e000054d0 con 0x55c87851a390 2024-09-21T03:50:45.546 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.543+0000 7f8deeffd640 1 -- 172.21.15.84:0/2762251783 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e000116a0 con 0x55c87851a390 2024-09-21T03:50:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.543+0000 7f8e1198f740 1 -- 172.21.15.84:0/2762251783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c87851a390 msgr2=0x55c8788e3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.543+0000 7f8e1198f740 1 --2- 172.21.15.84:0/2762251783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c87851a390 0x55c8788e3d40 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f8e000041c0 tx=0x7f8e0000b390 comp rx=0 tx=0).stop 2024-09-21T03:50:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.543+0000 7f8e1198f740 1 -- 172.21.15.84:0/2762251783 shutdown_connections 2024-09-21T03:50:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.543+0000 7f8e1198f740 1 --2- 172.21.15.84:0/2762251783 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87853b070 0x55c8788fa020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.543+0000 7f8e1198f740 1 --2- 172.21.15.84:0/2762251783 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c87851a390 0x55c8788e3d40 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.543+0000 7f8e1198f740 1 --2- 172.21.15.84:0/2762251783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8785121b0 0x55c8788efbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.543+0000 7f8e1198f740 1 -- 172.21.15.84:0/2762251783 >> 172.21.15.84:0/2762251783 conn(0x55c87852f460 msgr2=0x55c8788e3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.544+0000 7f8e1198f740 1 -- 172.21.15.84:0/2762251783 shutdown_connections 2024-09-21T03:50:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.544+0000 7f8e1198f740 1 -- 172.21.15.84:0/2762251783 wait complete. 2024-09-21T03:50:45.549 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.544+0000 7f8e1198f740 1 -- start start 2024-09-21T03:50:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.544+0000 7f8e1198f740 1 Processor -- start 2024-09-21T03:50:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.544+0000 7f8e1198f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8785121b0 0x55c8788f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.544+0000 7f8e1198f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87853b070 0x55c8788f2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.545+0000 7f8e1198f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8784ceda0 0x55c8789696b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.545+0000 7f8e1198f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8e041adc60 con 0x55c8785121b0 2024-09-21T03:50:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.545+0000 7f8e1198f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e041af0d0 con 0x55c8784ceda0 2024-09-21T03:50:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.545+0000 7f8e1198f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8e041ae330 con 0x55c87853b070 2024-09-21T03:50:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.545+0000 7f8e1198f740 10 client.0 _ll_register_callbacks cb 0x7f8e0000b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.545+0000 7f8e089b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8785121b0 0x55c8788f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.545+0000 7f8e089b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8785121b0 0x55c8788f22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48828/0 (socket says 172.21.15.84:48828) 2024-09-21T03:50:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.545+0000 7f8e089b6640 1 -- 172.21.15.84:0/1018423032 learned_addr learned my addr 172.21.15.84:0/1018423032 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.545+0000 7f8e091b7640 1 --2- 172.21.15.84:0/1018423032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87853b070 0x55c8788f2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:45.550 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.545+0000 7f8e089b6640 1 --2- 172.21.15.84:0/1018423032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8784ceda0 0x55c8789696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.545+0000 7f8e089b6640 1 -- 172.21.15.84:0/1018423032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87853b070 msgr2=0x55c8788f2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.545+0000 7f8e089b6640 1 --2- 172.21.15.84:0/1018423032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87853b070 0x55c8788f2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.545+0000 7f8e089b6640 1 -- 172.21.15.84:0/1018423032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8784ceda0 msgr2=0x55c8789696b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.545+0000 7f8e089b6640 1 --2- 172.21.15.84:0/1018423032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8784ceda0 0x55c8789696b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.545+0000 7f8e089b6640 1 -- 172.21.15.84:0/1018423032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8788f3020 con 0x55c8785121b0 2024-09-21T03:50:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.545+0000 7f8e091b7640 1 --2- 172.21.15.84:0/1018423032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87853b070 0x55c8788f2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:50:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.545+0000 7f8e089b6640 1 --2- 172.21.15.84:0/1018423032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8785121b0 0x55c8788f22d0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f8df4011010 tx=0x7f8df401d440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dae563eaa87fe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.545+0000 7f8decff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.545+0000 7f8decff9640 1 -- 172.21.15.84:0/1018423032 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df4041020 con 0x55c8785121b0 2024-09-21T03:50:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.546+0000 7f8decff9640 1 -- 172.21.15.84:0/1018423032 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f8df40120b0 con 0x55c8785121b0 2024-09-21T03:50:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.546+0000 7f8e1198f740 1 -- 172.21.15.84:0/1018423032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e000054d0 con 0x55c8785121b0 2024-09-21T03:50:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.546+0000 7f8decff9640 1 -- 172.21.15.84:0/1018423032 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8df4022050 con 0x55c8785121b0 2024-09-21T03:50:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.546+0000 7f8e1198f740 10 client.16965 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.546+0000 7f8e1198f740 1 -- 172.21.15.84:0/1018423032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c87896abc0 con 0x55c8785121b0 2024-09-21T03:50:45.551 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.546+0000 7f8decff9640 1 -- 172.21.15.84:0/1018423032 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e000054d0 con 0x55c8785121b0 2024-09-21T03:50:45.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.546+0000 7f8decff9640 1 -- 172.21.15.84:0/1018423032 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8df401e440 con 0x55c8785121b0 2024-09-21T03:50:45.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.546+0000 7f8e1198f740 10 client.16965 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:45.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.546+0000 7f8e1198f740 10 client.16965 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:50:45.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.546+0000 7f8e1198f740 20 client.16965 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:45.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.546+0000 7f8e1198f740 1 --2- 172.21.15.84:0/1018423032 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c87896b200 0x55c87896d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:45.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.546+0000 7f8e1198f740 4 client.16965 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:50:45.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.546+0000 7f8e1198f740 1 -- 172.21.15.84:0/1018423032 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c8788ee5e0 con 0x55c87896b200 2024-09-21T03:50:45.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.547+0000 7f8e091b7640 1 --2- 172.21.15.84:0/1018423032 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c87896b200 0x55c87896d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:45.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.547+0000 7f8decff9640 10 client.16965 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:45.552 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.547+0000 7f8e091b7640 1 --2- 172.21.15.84:0/1018423032 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c87896b200 0x55c87896d620 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9eb885a6cdbd85a0 server_cookie=40cb2ab1b19474de in_seq=0 out_seq=0 2024-09-21T03:50:45.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.547+0000 7f8decff9640 1 -- 172.21.15.84:0/1018423032 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x55c8788ee5e0 con 0x55c87896b200 2024-09-21T03:50:45.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.547+0000 7f8decff9640 10 client.16965 handle_command_reply: tid=0 2024-09-21T03:50:45.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.547+0000 7f8e1198f740 1 client.16965 shutdown 2024-09-21T03:50:45.553 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.547+0000 7f8e1198f740 1 -- 172.21.15.84:0/1018423032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8785121b0 msgr2=0x55c8788f22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:45.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.547+0000 7f8e1198f740 1 --2- 172.21.15.84:0/1018423032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8785121b0 0x55c8788f22d0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f8df4011010 tx=0x7f8df401d440 comp rx=0 tx=0).stop 2024-09-21T03:50:45.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.548+0000 7f8e1198f740 1 -- 172.21.15.84:0/1018423032 shutdown_connections 2024-09-21T03:50:45.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.548+0000 7f8e1198f740 1 --2- 172.21.15.84:0/1018423032 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c87896b200 0x55c87896d620 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.548+0000 7f8e1198f740 1 --2- 172.21.15.84:0/1018423032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c8784ceda0 0x55c8789696b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.548+0000 7f8decff9640 0 client.16965 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:45.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.548+0000 7f8e1198f740 1 --2- 172.21.15.84:0/1018423032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c87853b070 0x55c8788f2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.548+0000 7f8e1198f740 1 --2- 172.21.15.84:0/1018423032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c8785121b0 0x55c8788f22d0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.548+0000 7f8e1198f740 1 -- 172.21.15.84:0/1018423032 >> 172.21.15.84:0/1018423032 conn(0x55c87852f460 msgr2=0x55c8788ef930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:45.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.548+0000 7f8e1198f740 1 -- 172.21.15.84:0/1018423032 shutdown_connections 2024-09-21T03:50:45.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.548+0000 7f8e1198f740 1 -- 172.21.15.84:0/1018423032 wait complete. 2024-09-21T03:50:45.554 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.548+0000 7f8e1198f740 20 client.16965 trim_cache size 0 max 16384 2024-09-21T03:50:45.555 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:50:45.555 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T03:50:45.555 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T03:50:45.555 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:50:45.555 INFO:teuthology.orchestra.run.smithi084.stdout: "d85cdf50-3fc8-467d-942f-2b77981ba106": { 2024-09-21T03:50:45.555 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:43.684286+0000", 2024-09-21T03:50:45.555 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:45.555 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:45.555 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:45.555 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:45.555 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:45.555 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:45.555 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:50:45.556 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:50:45.556 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:45.556 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:45.556 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:45.556 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:45.556 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:45.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:45.556 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:50:45.556 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:50:45.556 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:45.556 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:45.556 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:45.556 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:45.556 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:45.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:45.557 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:50:45.557 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:50:45.557 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:45.557 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:45.557 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:45.557 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:45.557 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:45.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:45.557 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:50:45.557 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:50:45.557 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:45.557 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:45.557 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:45.557 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:45.557 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:45.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:45.558 INFO:teuthology.orchestra.run.smithi084.stdout: "43a49cca-fc1c-4c36-a314-49033e7c3fb6": { 2024-09-21T03:50:45.558 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:49:17.366428+0000", 2024-09-21T03:50:45.558 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:45.558 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:45.558 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:45.558 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:45.558 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:45.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:45.558 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:50:45.558 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:50:45.558 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:45.558 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:45.558 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:45.559 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:45.559 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:45.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:45.559 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:50:45.559 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:50:45.559 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:45.559 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:45.559 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:45.559 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:45.559 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:45.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:45.559 INFO:teuthology.orchestra.run.smithi084.stdout: "27dcb84c-89fa-46b2-b980-58857966c697": { 2024-09-21T03:50:45.559 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:52.598527+0000", 2024-09-21T03:50:45.559 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:45.559 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:45.560 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:45.560 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:45.560 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:45.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:45.560 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:50:45.560 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:50:45.560 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:45.560 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:45.560 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:45.560 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:45.560 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:45.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:45.560 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:50:45.560 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:50:45.560 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:45.561 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:45.561 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:45.561 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:45.561 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:45.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:45.561 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:50:45.561 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:50:45.561 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:45.561 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:45.561 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:45.561 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:45.561 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:45.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:45.561 INFO:teuthology.orchestra.run.smithi084.stdout: "b2063a70-0b1f-4b6b-9c96-d886e156ea66": { 2024-09-21T03:50:45.561 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:48:34.864478+0000", 2024-09-21T03:50:45.562 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:45.562 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:45.562 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:45.562 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:45.562 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:45.562 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:45.562 INFO:teuthology.orchestra.run.smithi084.stdout: "33131451-f242-447a-b13f-9bdebc7884ec": { 2024-09-21T03:50:45.562 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:00.524357+0000", 2024-09-21T03:50:45.562 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:45.562 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:45.562 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:45.562 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:45.562 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:45.562 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:50:45.563 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:50:45.563 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:50:45.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.548+0000 7f8e0b41b640 1 -- 172.21.15.84:0/1364890120 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8df00b6680 msgr2=0x7f8df00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:45.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.548+0000 7f8e0b41b640 1 --2- 172.21.15.84:0/1364890120 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8df00b6680 0x7f8df00b8b90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc1063b0 tx=0x7f8dfc09b7c0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.548+0000 7f8e0b41b640 1 -- 172.21.15.84:0/1364890120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e04108d00 msgr2=0x7f8e0419bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:45.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.548+0000 7f8e0b41b640 1 --2- 172.21.15.84:0/1364890120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e04108d00 0x7f8e0419bd80 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc005cc0 tx=0x7f8dfc02f380 comp rx=0 tx=0).stop 2024-09-21T03:50:45.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.549+0000 7f8e0b41b640 1 -- 172.21.15.84:0/1364890120 shutdown_connections 2024-09-21T03:50:45.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.549+0000 7f8e0b41b640 1 --2- 172.21.15.84:0/1364890120 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f8df00b6680 0x7f8df00b8b90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.549+0000 7f8e0b41b640 1 --2- 172.21.15.84:0/1364890120 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8e04108d00 0x7f8e0419bd80 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.549+0000 7f8e0b41b640 1 --2- 172.21.15.84:0/1364890120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e041083b0 0x7f8e0419b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.549+0000 7f8e0b41b640 1 --2- 172.21.15.84:0/1364890120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8e04102a70 0x7f8e0419b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:45.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.549+0000 7f8e0b41b640 1 -- 172.21.15.84:0/1364890120 >> 172.21.15.84:0/1364890120 conn(0x7f8e04079730 msgr2=0x7f8e041044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:45.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.549+0000 7f8e0b41b640 1 -- 172.21.15.84:0/1364890120 shutdown_connections 2024-09-21T03:50:45.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:45.549+0000 7f8e0b41b640 1 -- 172.21.15.84:0/1364890120 wait complete. 2024-09-21T03:50:46.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:45 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:46.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:45 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:50:46.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:45 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:50:46.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:45 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:46.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:45 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:50:46.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:45 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:50:46.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:45 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:50:46.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:45 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:50:46.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:45 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:50:46.375 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:50:46.376 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:50:46.627 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:50:47.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:46 smithi084 ceph-mon[30941]: pgmap v577: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 9 op/s 2024-09-21T03:50:47.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:46 smithi174 ceph-mon[34403]: pgmap v577: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 9 op/s 2024-09-21T03:50:47.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:46 smithi172 ceph-mon[34821]: pgmap v577: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 9 op/s 2024-09-21T03:50:47.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.165+0000 7f392da50640 1 -- 172.21.15.84:0/1769951900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3928102a60 msgr2=0x7f3928102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:47.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.165+0000 7f392da50640 1 --2- 172.21.15.84:0/1769951900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3928102a60 0x7f3928102e70 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f3918009900 tx=0x7f391802a410 comp rx=0 tx=0).stop 2024-09-21T03:50:47.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.165+0000 7f392da50640 1 -- 172.21.15.84:0/1769951900 shutdown_connections 2024-09-21T03:50:47.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.165+0000 7f392da50640 1 --2- 172.21.15.84:0/1769951900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3928108cf0 0x7f392810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:47.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.165+0000 7f392da50640 1 --2- 172.21.15.84:0/1769951900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f39281083a0 0x7f39281087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:47.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.165+0000 7f392da50640 1 --2- 172.21.15.84:0/1769951900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3928102a60 0x7f3928102e70 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:47.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.165+0000 7f392da50640 1 -- 172.21.15.84:0/1769951900 >> 172.21.15.84:0/1769951900 conn(0x7f3928079730 msgr2=0x7f3928079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:47.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.165+0000 7f392da50640 1 -- 172.21.15.84:0/1769951900 shutdown_connections 2024-09-21T03:50:47.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.165+0000 7f392da50640 1 -- 172.21.15.84:0/1769951900 wait complete. 2024-09-21T03:50:47.179 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.166+0000 7f392da50640 1 Processor -- start 2024-09-21T03:50:47.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.166+0000 7f392da50640 1 -- start start 2024-09-21T03:50:47.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.166+0000 7f392da50640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3928102a60 0x7f392819c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:47.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.166+0000 7f392da50640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39281083a0 0x7f392819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:47.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.166+0000 7f392da50640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3928108cf0 0x7f39281a2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:47.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.166+0000 7f392da50640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3928113b40 con 0x7f39281083a0 2024-09-21T03:50:47.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.166+0000 7f392da50640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f39281139c0 con 0x7f3928102a60 2024-09-21T03:50:47.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.166+0000 7f392da50640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3928113cc0 con 0x7f3928108cf0 2024-09-21T03:50:47.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.167+0000 7f391e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39281083a0 0x7f392819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:47.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.167+0000 7f391e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39281083a0 0x7f392819cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48844/0 (socket says 172.21.15.84:48844) 2024-09-21T03:50:47.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.167+0000 7f391e7fc640 1 -- 172.21.15.84:0/2438637982 learned_addr learned my addr 172.21.15.84:0/2438637982 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:47.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.167+0000 7f3926ffd640 1 --2- 172.21.15.84:0/2438637982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3928102a60 0x7f392819c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:47.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.167+0000 7f39277fe640 1 --2- 172.21.15.84:0/2438637982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3928108cf0 0x7f39281a2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:47.180 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.167+0000 7f391e7fc640 1 -- 172.21.15.84:0/2438637982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3928108cf0 msgr2=0x7f39281a2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:47.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.167+0000 7f391e7fc640 1 --2- 172.21.15.84:0/2438637982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3928108cf0 0x7f39281a2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:47.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.167+0000 7f391e7fc640 1 -- 172.21.15.84:0/2438637982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3928102a60 msgr2=0x7f392819c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:47.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.167+0000 7f391e7fc640 1 --2- 172.21.15.84:0/2438637982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3928102a60 0x7f392819c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:47.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.167+0000 7f391e7fc640 1 -- 172.21.15.84:0/2438637982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39281a27a0 con 0x7f39281083a0 2024-09-21T03:50:47.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.167+0000 7f391e7fc640 1 --2- 172.21.15.84:0/2438637982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39281083a0 0x7f392819cdd0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f391000b450 tx=0x7f391000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:47.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.167+0000 7f392ca4e640 1 -- 172.21.15.84:0/2438637982 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3910015020 con 0x7f39281083a0 2024-09-21T03:50:47.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.167+0000 7f392ca4e640 1 -- 172.21.15.84:0/2438637982 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3910011d40 con 0x7f39281083a0 2024-09-21T03:50:47.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.167+0000 7f392da50640 1 -- 172.21.15.84:0/2438637982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39281a2a90 con 0x7f39281083a0 2024-09-21T03:50:47.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.167+0000 7f392ca4e640 1 -- 172.21.15.84:0/2438637982 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f391000f340 con 0x7f39281083a0 2024-09-21T03:50:47.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.167+0000 7f392da50640 1 -- 172.21.15.84:0/2438637982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39281a91f0 con 0x7f39281083a0 2024-09-21T03:50:47.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.168+0000 7f392da50640 1 -- 172.21.15.84:0/2438637982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3928102ef0 con 0x7f39281083a0 2024-09-21T03:50:47.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.171+0000 7f392ca4e640 1 -- 172.21.15.84:0/2438637982 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f3910018020 con 0x7f39281083a0 2024-09-21T03:50:47.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.171+0000 7f392ca4e640 1 --2- 172.21.15.84:0/2438637982 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f39140b6680 0x7f39140b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:47.181 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.172+0000 7f3926ffd640 1 --2- 172.21.15.84:0/2438637982 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f39140b6680 0x7f39140b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:47.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.172+0000 7f392ca4e640 1 -- 172.21.15.84:0/2438637982 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f39100e7640 con 0x7f39281083a0 2024-09-21T03:50:47.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.172+0000 7f3926ffd640 1 --2- 172.21.15.84:0/2438637982 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f39140b6680 0x7f39140b8b90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3918031440 tx=0x7f3918005e80 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:47.182 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.175+0000 7f392ca4e640 1 -- 172.21.15.84:0/2438637982 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f391001f020 con 0x7f39281083a0 2024-09-21T03:50:47.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.389+0000 7f392da50640 1 -- 172.21.15.84:0/2438637982 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f392819d960 con 0x7f39281083a0 2024-09-21T03:50:47.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.390+0000 7f392ca4e640 1 -- 172.21.15.84:0/2438637982 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7f392819d960 con 0x7f39281083a0 2024-09-21T03:50:47.393 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:50:47.393 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:50:47.393 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:50:47.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.392+0000 7f392da50640 1 -- 172.21.15.84:0/2438637982 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f39140b6680 msgr2=0x7f39140b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:47.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.392+0000 7f392da50640 1 --2- 172.21.15.84:0/2438637982 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f39140b6680 0x7f39140b8b90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3918031440 tx=0x7f3918005e80 comp rx=0 tx=0).stop 2024-09-21T03:50:47.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.392+0000 7f392da50640 1 -- 172.21.15.84:0/2438637982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39281083a0 msgr2=0x7f392819cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:47.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.392+0000 7f392da50640 1 --2- 172.21.15.84:0/2438637982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39281083a0 0x7f392819cdd0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f391000b450 tx=0x7f391000b910 comp rx=0 tx=0).stop 2024-09-21T03:50:47.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.393+0000 7f392da50640 1 -- 172.21.15.84:0/2438637982 shutdown_connections 2024-09-21T03:50:47.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.393+0000 7f392da50640 1 --2- 172.21.15.84:0/2438637982 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f39140b6680 0x7f39140b8b90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:47.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.393+0000 7f392da50640 1 --2- 172.21.15.84:0/2438637982 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3928108cf0 0x7f39281a2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:47.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.393+0000 7f392da50640 1 --2- 172.21.15.84:0/2438637982 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f39281083a0 0x7f392819cdd0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:47.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.393+0000 7f392da50640 1 --2- 172.21.15.84:0/2438637982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3928102a60 0x7f392819c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:47.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.393+0000 7f392da50640 1 -- 172.21.15.84:0/2438637982 >> 172.21.15.84:0/2438637982 conn(0x7f3928079730 msgr2=0x7f392810e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:47.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.393+0000 7f392da50640 1 -- 172.21.15.84:0/2438637982 shutdown_connections 2024-09-21T03:50:47.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:47.393+0000 7f392da50640 1 -- 172.21.15.84:0/2438637982 wait complete. 2024-09-21T03:50:48.056 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:47 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2438637982' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:50:48.084 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:50:48.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:47 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2438637982' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:50:48.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:47 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2438637982' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:50:48.330 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:50:48.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.815+0000 7fb73c94c640 1 -- 172.21.15.84:0/1095849675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb738109df0 msgr2=0x7fb738110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:48.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.815+0000 7fb73c94c640 1 --2- 172.21.15.84:0/1095849675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb738109df0 0x7fb738110620 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fb728009900 tx=0x7fb72802a410 comp rx=0 tx=0).stop 2024-09-21T03:50:48.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.816+0000 7fb73c94c640 1 -- 172.21.15.84:0/1095849675 shutdown_connections 2024-09-21T03:50:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.816+0000 7fb73c94c640 1 --2- 172.21.15.84:0/1095849675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb738109df0 0x7fb738110620 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.816+0000 7fb73c94c640 1 --2- 172.21.15.84:0/1095849675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7381094a0 0x7fb7381098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.816+0000 7fb73c94c640 1 --2- 172.21.15.84:0/1095849675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb738103b60 0x7fb738103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.816+0000 7fb73c94c640 1 -- 172.21.15.84:0/1095849675 >> 172.21.15.84:0/1095849675 conn(0x7fb7380ff5d0 msgr2=0x7fb738101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.816+0000 7fb73c94c640 1 -- 172.21.15.84:0/1095849675 shutdown_connections 2024-09-21T03:50:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.816+0000 7fb73c94c640 1 -- 172.21.15.84:0/1095849675 wait complete. 2024-09-21T03:50:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.817+0000 7fb73c94c640 1 Processor -- start 2024-09-21T03:50:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.817+0000 7fb73c94c640 1 -- start start 2024-09-21T03:50:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.817+0000 7fb73c94c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb738103b60 0x7fb73819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.817+0000 7fb73c94c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7381094a0 0x7fb73819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.817+0000 7fb73c94c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb738109df0 0x7fb73819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.817+0000 7fb73c94c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb738113ab0 con 0x7fb738109df0 2024-09-21T03:50:48.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.817+0000 7fb73c94c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb738113930 con 0x7fb7381094a0 2024-09-21T03:50:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.817+0000 7fb73c94c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb738113c30 con 0x7fb738103b60 2024-09-21T03:50:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.817+0000 7fb736d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb738109df0 0x7fb73819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.817+0000 7fb736d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb738109df0 0x7fb73819fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54058/0 (socket says 172.21.15.84:54058) 2024-09-21T03:50:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.817+0000 7fb736d9d640 1 -- 172.21.15.84:0/2672515064 learned_addr learned my addr 172.21.15.84:0/2672515064 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.817+0000 7fb735d9b640 1 --2- 172.21.15.84:0/2672515064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7381094a0 0x7fb73819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.818+0000 7fb73659c640 1 --2- 172.21.15.84:0/2672515064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb738103b60 0x7fb73819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.818+0000 7fb736d9d640 1 -- 172.21.15.84:0/2672515064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb738103b60 msgr2=0x7fb73819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.818+0000 7fb736d9d640 1 --2- 172.21.15.84:0/2672515064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb738103b60 0x7fb73819a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.818+0000 7fb736d9d640 1 -- 172.21.15.84:0/2672515064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7381094a0 msgr2=0x7fb73819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.818+0000 7fb736d9d640 1 --2- 172.21.15.84:0/2672515064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7381094a0 0x7fb73819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.818+0000 7fb736d9d640 1 -- 172.21.15.84:0/2672515064 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7381a03b0 con 0x7fb738109df0 2024-09-21T03:50:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.818+0000 7fb736d9d640 1 --2- 172.21.15.84:0/2672515064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb738109df0 0x7fb73819fc80 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fb728004770 tx=0x7fb728004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:48.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.818+0000 7fb7277fe640 1 -- 172.21.15.84:0/2672515064 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72803f030 con 0x7fb738109df0 2024-09-21T03:50:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.818+0000 7fb73c94c640 1 -- 172.21.15.84:0/2672515064 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7381a0640 con 0x7fb738109df0 2024-09-21T03:50:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.818+0000 7fb7277fe640 1 -- 172.21.15.84:0/2672515064 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb728003aa0 con 0x7fb738109df0 2024-09-21T03:50:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.818+0000 7fb7277fe640 1 -- 172.21.15.84:0/2672515064 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728035070 con 0x7fb738109df0 2024-09-21T03:50:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.818+0000 7fb73c94c640 1 -- 172.21.15.84:0/2672515064 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7381a6e00 con 0x7fb738109df0 2024-09-21T03:50:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.821+0000 7fb7277fe640 1 -- 172.21.15.84:0/2672515064 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fb728042030 con 0x7fb738109df0 2024-09-21T03:50:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.821+0000 7fb742ec0740 1 Processor -- start 2024-09-21T03:50:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.821+0000 7fb742ec0740 1 -- start start 2024-09-21T03:50:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb742ec0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daf17070 0x5567db2be2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb742ec0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5567daeee1b0 0x5567db2be800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb742ec0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daef6390 0x5567db2bed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb742ec0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5567db234ea0 con 0x5567daef6390 2024-09-21T03:50:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb742ec0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5567db2242d0 con 0x5567daf17070 2024-09-21T03:50:48.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb742ec0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5567db2280e0 con 0x5567daeee1b0 2024-09-21T03:50:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb735d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daef6390 0x5567db2bed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb735d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daef6390 0x5567db2bed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54070/0 (socket says 172.21.15.84:54070) 2024-09-21T03:50:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb735d9b640 1 -- 172.21.15.84:0/3607278599 learned_addr learned my addr 172.21.15.84:0/3607278599 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb73659c640 1 --2- 172.21.15.84:0/3607278599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5567daeee1b0 0x5567db2be800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb735d9b640 1 --2- 172.21.15.84:0/3607278599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daf17070 0x5567db2be2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb7277fe640 1 --2- 172.21.15.84:0/2672515064 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb7200b6680 0x7fb7200b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb735d9b640 1 -- 172.21.15.84:0/3607278599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5567daeee1b0 msgr2=0x5567db2be800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb735d9b640 1 --2- 172.21.15.84:0/3607278599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5567daeee1b0 0x5567db2be800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb735d9b640 1 -- 172.21.15.84:0/3607278599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daf17070 msgr2=0x5567db2be2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb735d9b640 1 --2- 172.21.15.84:0/3607278599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daf17070 0x5567db2be2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb735d9b640 1 -- 172.21.15.84:0/3607278599 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567daf82650 con 0x5567daef6390 2024-09-21T03:50:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb736d9d640 1 --2- 172.21.15.84:0/2672515064 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb7200b6680 0x7fb7200b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb735d9b640 1 --2- 172.21.15.84:0/3607278599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daef6390 0x5567db2bed40 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fb72c012540 tx=0x7fb72c005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad27805d443dc07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:48.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb7277fe640 1 -- 172.21.15.84:0/2672515064 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fb728107af0 con 0x7fb738109df0 2024-09-21T03:50:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.822+0000 7fb724ff9640 1 -- 172.21.15.84:0/3607278599 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c004230 con 0x5567daef6390 2024-09-21T03:50:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.823+0000 7fb724ff9640 1 -- 172.21.15.84:0/3607278599 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb72c0043d0 con 0x5567daef6390 2024-09-21T03:50:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.823+0000 7fb724ff9640 1 -- 172.21.15.84:0/3607278599 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c004d80 con 0x5567daef6390 2024-09-21T03:50:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.823+0000 7fb742ec0740 1 -- 172.21.15.84:0/3607278599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daef6390 msgr2=0x5567db2bed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.823+0000 7fb742ec0740 1 --2- 172.21.15.84:0/3607278599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daef6390 0x5567db2bed40 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fb72c012540 tx=0x7fb72c005c90 comp rx=0 tx=0).stop 2024-09-21T03:50:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.823+0000 7fb736d9d640 1 --2- 172.21.15.84:0/2672515064 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb7200b6680 0x7fb7200b8b90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb7280cd740 tx=0x7fb728091fd0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.824+0000 7fb742ec0740 1 -- 172.21.15.84:0/3607278599 shutdown_connections 2024-09-21T03:50:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.824+0000 7fb742ec0740 1 --2- 172.21.15.84:0/3607278599 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daef6390 0x5567db2bed40 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.824+0000 7fb742ec0740 1 --2- 172.21.15.84:0/3607278599 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5567daeee1b0 0x5567db2be800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.824+0000 7fb742ec0740 1 --2- 172.21.15.84:0/3607278599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daf17070 0x5567db2be2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.824+0000 7fb742ec0740 1 -- 172.21.15.84:0/3607278599 >> 172.21.15.84:0/3607278599 conn(0x5567daf0b460 msgr2=0x5567db2bc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.824+0000 7fb742ec0740 1 -- 172.21.15.84:0/3607278599 shutdown_connections 2024-09-21T03:50:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.824+0000 7fb742ec0740 1 -- 172.21.15.84:0/3607278599 wait complete. 2024-09-21T03:50:48.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.824+0000 7fb742ec0740 1 -- start start 2024-09-21T03:50:48.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.824+0000 7fb742ec0740 1 Processor -- start 2024-09-21T03:50:48.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb742ec0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daeee1b0 0x5567db2cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:48.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb742ec0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5567daef6390 0x5567db2ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:48.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb742ec0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daf17070 0x5567db2ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:48.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb742ec0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5567db085700 con 0x5567daf17070 2024-09-21T03:50:48.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb742ec0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5567db1bf160 con 0x5567daeee1b0 2024-09-21T03:50:48.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb742ec0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5567db2d0e00 con 0x5567daef6390 2024-09-21T03:50:48.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb742ec0740 10 client.0 _ll_register_callbacks cb 0x5567db1d89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:48.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb735d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daf17070 0x5567db2ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:48.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb735d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daf17070 0x5567db2ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54086/0 (socket says 172.21.15.84:54086) 2024-09-21T03:50:48.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb735d9b640 1 -- 172.21.15.84:0/3721555929 learned_addr learned my addr 172.21.15.84:0/3721555929 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:48.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb73659c640 1 --2- 172.21.15.84:0/3721555929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5567daef6390 0x5567db2ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:48.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb735d9b640 1 --2- 172.21.15.84:0/3721555929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daeee1b0 0x5567db2cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:48.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb735d9b640 1 -- 172.21.15.84:0/3721555929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5567daef6390 msgr2=0x5567db2ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb735d9b640 1 --2- 172.21.15.84:0/3721555929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5567daef6390 0x5567db2ce260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb735d9b640 1 -- 172.21.15.84:0/3721555929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daeee1b0 msgr2=0x5567db2cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb735d9b640 1 --2- 172.21.15.84:0/3721555929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daeee1b0 0x5567db2cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb735d9b640 1 -- 172.21.15.84:0/3721555929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567db1ecc90 con 0x5567daf17070 2024-09-21T03:50:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb735d9b640 1 --2- 172.21.15.84:0/3721555929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daf17070 0x5567db2ce7c0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00b5f0 tx=0x7fb72c004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9940ea6a84baab07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb71dffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb71dffb640 1 -- 172.21.15.84:0/3721555929 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c005430 con 0x5567daf17070 2024-09-21T03:50:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb71dffb640 1 -- 172.21.15.84:0/3721555929 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fb72c01d430 con 0x5567daf17070 2024-09-21T03:50:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb742ec0740 1 -- 172.21.15.84:0/3721555929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb72c0043d0 con 0x5567daf17070 2024-09-21T03:50:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb71dffb640 1 -- 172.21.15.84:0/3721555929 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb72c0055d0 con 0x5567daf17070 2024-09-21T03:50:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb742ec0740 10 client.16983 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.825+0000 7fb742ec0740 1 -- 172.21.15.84:0/3721555929 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5567db2dcb20 con 0x5567daf17070 2024-09-21T03:50:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.826+0000 7fb71dffb640 1 -- 172.21.15.84:0/3721555929 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb72c0043d0 con 0x5567daf17070 2024-09-21T03:50:48.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.826+0000 7fb71dffb640 1 -- 172.21.15.84:0/3721555929 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb72c036500 con 0x5567daf17070 2024-09-21T03:50:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.826+0000 7fb742ec0740 10 client.16983 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.826+0000 7fb742ec0740 10 client.16983 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:50:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.826+0000 7fb742ec0740 20 client.16983 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.826+0000 7fb742ec0740 1 --2- 172.21.15.84:0/3721555929 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5567daed59f0 0x5567db2dfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.826+0000 7fb742ec0740 4 client.16983 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:50:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.826+0000 7fb742ec0740 1 -- 172.21.15.84:0/3721555929 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567db236df0 con 0x5567daed59f0 2024-09-21T03:50:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.826+0000 7fb73659c640 1 --2- 172.21.15.84:0/3721555929 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5567daed59f0 0x5567db2dfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.827+0000 7fb71dffb640 10 client.16983 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:50:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.827+0000 7fb73659c640 1 --2- 172.21.15.84:0/3721555929 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5567daed59f0 0x5567db2dfe80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=44097a02842dd89c server_cookie=8293463f1b89aee in_seq=0 out_seq=0 2024-09-21T03:50:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.827+0000 7fb71dffb640 1 -- 172.21.15.84:0/3721555929 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5567db236df0 con 0x5567daed59f0 2024-09-21T03:50:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.827+0000 7fb71dffb640 10 client.16983 handle_command_reply: tid=0 2024-09-21T03:50:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.827+0000 7fb742ec0740 1 client.16983 shutdown 2024-09-21T03:50:48.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.828+0000 7fb742ec0740 1 -- 172.21.15.84:0/3721555929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daf17070 msgr2=0x5567db2ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:48.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.828+0000 7fb742ec0740 1 --2- 172.21.15.84:0/3721555929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daf17070 0x5567db2ce7c0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00b5f0 tx=0x7fb72c004920 comp rx=0 tx=0).stop 2024-09-21T03:50:48.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.828+0000 7fb742ec0740 1 -- 172.21.15.84:0/3721555929 shutdown_connections 2024-09-21T03:50:48.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.828+0000 7fb742ec0740 1 --2- 172.21.15.84:0/3721555929 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5567daed59f0 0x5567db2dfe80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.828+0000 7fb742ec0740 1 --2- 172.21.15.84:0/3721555929 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daf17070 0x5567db2ce7c0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.828+0000 7fb71dffb640 0 client.16983 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:50:48.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.828+0000 7fb742ec0740 1 --2- 172.21.15.84:0/3721555929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5567daef6390 0x5567db2ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.828+0000 7fb742ec0740 1 --2- 172.21.15.84:0/3721555929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daeee1b0 0x5567db2cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.828+0000 7fb742ec0740 1 -- 172.21.15.84:0/3721555929 >> 172.21.15.84:0/3721555929 conn(0x5567daf0b460 msgr2=0x5567db2ba750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:48.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.828+0000 7fb742ec0740 1 -- 172.21.15.84:0/3721555929 shutdown_connections 2024-09-21T03:50:48.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.828+0000 7fb742ec0740 1 -- 172.21.15.84:0/3721555929 wait complete. 2024-09-21T03:50:48.844 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.828+0000 7fb742ec0740 20 client.16983 trim_cache size 0 max 16384 2024-09-21T03:50:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.841+0000 7fb742ec0740 1 Processor -- start 2024-09-21T03:50:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.841+0000 7fb742ec0740 1 -- start start 2024-09-21T03:50:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.841+0000 7fb742ec0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5567daed59f0 0x5567db2bfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.841+0000 7fb742ec0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daeee1b0 0x5567db2cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.841+0000 7fb742ec0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daef6390 0x5567db2caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.841+0000 7fb742ec0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb7381afc70 con 0x5567daef6390 2024-09-21T03:50:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.841+0000 7fb742ec0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb7381ad540 con 0x5567daeee1b0 2024-09-21T03:50:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.841+0000 7fb742ec0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb7381ab3b0 con 0x5567daed59f0 2024-09-21T03:50:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.842+0000 7fb735d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daef6390 0x5567db2caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.842+0000 7fb735d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daef6390 0x5567db2caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54090/0 (socket says 172.21.15.84:54090) 2024-09-21T03:50:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.842+0000 7fb735d9b640 1 -- 172.21.15.84:0/660929686 learned_addr learned my addr 172.21.15.84:0/660929686 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.842+0000 7fb73659c640 1 --2- 172.21.15.84:0/660929686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daeee1b0 0x5567db2cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:48.849 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.842+0000 7fb735d9b640 1 --2- 172.21.15.84:0/660929686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5567daed59f0 0x5567db2bfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:48.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.842+0000 7fb735d9b640 1 -- 172.21.15.84:0/660929686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5567daed59f0 msgr2=0x5567db2bfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:48.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.842+0000 7fb735d9b640 1 --2- 172.21.15.84:0/660929686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5567daed59f0 0x5567db2bfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.842+0000 7fb735d9b640 1 -- 172.21.15.84:0/660929686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daeee1b0 msgr2=0x5567db2cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:48.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.842+0000 7fb735d9b640 1 --2- 172.21.15.84:0/660929686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daeee1b0 0x5567db2cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.842+0000 7fb735d9b640 1 -- 172.21.15.84:0/660929686 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567db2da090 con 0x5567daef6390 2024-09-21T03:50:48.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.842+0000 7fb73659c640 1 --2- 172.21.15.84:0/660929686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daeee1b0 0x5567db2cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:50:48.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.842+0000 7fb735d9b640 1 --2- 172.21.15.84:0/660929686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daef6390 0x5567db2caf10 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fb72c005940 tx=0x7fb72c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7b3a2fd6681df0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:48.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.842+0000 7fb71ffff640 1 -- 172.21.15.84:0/660929686 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c005b90 con 0x5567daef6390 2024-09-21T03:50:48.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.842+0000 7fb71ffff640 1 -- 172.21.15.84:0/660929686 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb72c004d30 con 0x5567daef6390 2024-09-21T03:50:48.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.842+0000 7fb71ffff640 1 -- 172.21.15.84:0/660929686 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72c0120d0 con 0x5567daef6390 2024-09-21T03:50:48.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.843+0000 7fb742ec0740 1 -- 172.21.15.84:0/660929686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daef6390 msgr2=0x5567db2caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:48.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.843+0000 7fb742ec0740 1 --2- 172.21.15.84:0/660929686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daef6390 0x5567db2caf10 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fb72c005940 tx=0x7fb72c00b390 comp rx=0 tx=0).stop 2024-09-21T03:50:48.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.843+0000 7fb742ec0740 1 -- 172.21.15.84:0/660929686 shutdown_connections 2024-09-21T03:50:48.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.843+0000 7fb742ec0740 1 --2- 172.21.15.84:0/660929686 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daef6390 0x5567db2caf10 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.843+0000 7fb742ec0740 1 --2- 172.21.15.84:0/660929686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daeee1b0 0x5567db2cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.843+0000 7fb742ec0740 1 --2- 172.21.15.84:0/660929686 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5567daed59f0 0x5567db2bfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.843+0000 7fb742ec0740 1 -- 172.21.15.84:0/660929686 >> 172.21.15.84:0/660929686 conn(0x5567daf0b460 msgr2=0x5567db2cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:48.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.843+0000 7fb742ec0740 1 -- 172.21.15.84:0/660929686 shutdown_connections 2024-09-21T03:50:48.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.843+0000 7fb742ec0740 1 -- 172.21.15.84:0/660929686 wait complete. 2024-09-21T03:50:48.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.843+0000 7fb742ec0740 1 -- start start 2024-09-21T03:50:48.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.843+0000 7fb742ec0740 1 Processor -- start 2024-09-21T03:50:48.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.844+0000 7fb742ec0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5567daed59f0 0x5567db2d6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:48.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.844+0000 7fb742ec0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daeee1b0 0x5567db2d3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:48.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.844+0000 7fb742ec0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daef6390 0x5567db2d43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:48.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.844+0000 7fb742ec0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb7381aba00 con 0x5567daeee1b0 2024-09-21T03:50:48.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.844+0000 7fb742ec0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb7381ace70 con 0x5567daef6390 2024-09-21T03:50:48.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.844+0000 7fb742ec0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb7381ac0d0 con 0x5567daed59f0 2024-09-21T03:50:48.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.844+0000 7fb742ec0740 10 client.0 _ll_register_callbacks cb 0x7fb730009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.844+0000 7fb73659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daeee1b0 0x5567db2d3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.844+0000 7fb73659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daeee1b0 0x5567db2d3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54094/0 (socket says 172.21.15.84:54094) 2024-09-21T03:50:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.844+0000 7fb73659c640 1 -- 172.21.15.84:0/3398794075 learned_addr learned my addr 172.21.15.84:0/3398794075 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.844+0000 7fb735d9b640 1 --2- 172.21.15.84:0/3398794075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daef6390 0x5567db2d43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.844+0000 7fb73659c640 1 -- 172.21.15.84:0/3398794075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5567daed59f0 msgr2=0x5567db2d6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.844+0000 7fb735d9b640 1 --2- 172.21.15.84:0/3398794075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5567daed59f0 0x5567db2d6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.844+0000 7fb73659c640 1 --2- 172.21.15.84:0/3398794075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5567daed59f0 0x5567db2d6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.844+0000 7fb73659c640 1 -- 172.21.15.84:0/3398794075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daef6390 msgr2=0x5567db2d43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.844+0000 7fb73659c640 1 --2- 172.21.15.84:0/3398794075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daef6390 0x5567db2d43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.844+0000 7fb73659c640 1 -- 172.21.15.84:0/3398794075 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567db2d4b80 con 0x5567daeee1b0 2024-09-21T03:50:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.844+0000 7fb735d9b640 1 --2- 172.21.15.84:0/3398794075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daef6390 0x5567db2d43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:50:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.844+0000 7fb73659c640 1 --2- 172.21.15.84:0/3398794075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daeee1b0 0x5567db2d3e30 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x5567db2bcf40 tx=0x7fb730010b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224fdff04aaf31de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.844+0000 7fb71dffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:48.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.845+0000 7fb71dffb640 1 -- 172.21.15.84:0/3398794075 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb730028060 con 0x5567daeee1b0 2024-09-21T03:50:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.845+0000 7fb71dffb640 1 -- 172.21.15.84:0/3398794075 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fb7300044f0 con 0x5567daeee1b0 2024-09-21T03:50:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.845+0000 7fb742ec0740 1 -- 172.21.15.84:0/3398794075 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb72c004d30 con 0x5567daeee1b0 2024-09-21T03:50:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.845+0000 7fb71dffb640 1 -- 172.21.15.84:0/3398794075 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb7300046f0 con 0x5567daeee1b0 2024-09-21T03:50:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.845+0000 7fb742ec0740 10 client.16989 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.845+0000 7fb742ec0740 1 -- 172.21.15.84:0/3398794075 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5567db34a6e0 con 0x5567daeee1b0 2024-09-21T03:50:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.845+0000 7fb71dffb640 1 -- 172.21.15.84:0/3398794075 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb72c004d30 con 0x5567daeee1b0 2024-09-21T03:50:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.845+0000 7fb71dffb640 1 -- 172.21.15.84:0/3398794075 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb73001d390 con 0x5567daeee1b0 2024-09-21T03:50:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.845+0000 7fb742ec0740 10 client.16989 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.845+0000 7fb742ec0740 10 client.16989 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:50:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.845+0000 7fb742ec0740 20 client.16989 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.845+0000 7fb742ec0740 1 --2- 172.21.15.84:0/3398794075 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5567daf17070 0x5567db34ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.845+0000 7fb742ec0740 4 client.16989 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:50:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.845+0000 7fb742ec0740 1 -- 172.21.15.84:0/3398794075 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5567db2328a0 con 0x5567daf17070 2024-09-21T03:50:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.846+0000 7fb735d9b640 1 --2- 172.21.15.84:0/3398794075 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5567daf17070 0x5567db34ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.846+0000 7fb735d9b640 1 --2- 172.21.15.84:0/3398794075 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5567daf17070 0x5567db34ced0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e98c5418d19c9a47 server_cookie=84230c65a17bd8ec in_seq=0 out_seq=0 2024-09-21T03:50:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.846+0000 7fb71dffb640 10 client.16989 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:50:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.846+0000 7fb71dffb640 1 -- 172.21.15.84:0/3398794075 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5567db2328a0 con 0x5567daf17070 2024-09-21T03:50:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.846+0000 7fb71dffb640 10 client.16989 handle_command_reply: tid=0 2024-09-21T03:50:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.846+0000 7fb742ec0740 1 client.16989 shutdown 2024-09-21T03:50:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.846+0000 7fb742ec0740 1 -- 172.21.15.84:0/3398794075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daeee1b0 msgr2=0x5567db2d3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.846+0000 7fb742ec0740 1 --2- 172.21.15.84:0/3398794075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daeee1b0 0x5567db2d3e30 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x5567db2bcf40 tx=0x7fb730010b80 comp rx=0 tx=0).stop 2024-09-21T03:50:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.846+0000 7fb742ec0740 1 -- 172.21.15.84:0/3398794075 shutdown_connections 2024-09-21T03:50:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.846+0000 7fb742ec0740 1 --2- 172.21.15.84:0/3398794075 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5567daf17070 0x5567db34ced0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.846+0000 7fb742ec0740 1 --2- 172.21.15.84:0/3398794075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567daef6390 0x5567db2d43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.846+0000 7fb742ec0740 1 --2- 172.21.15.84:0/3398794075 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5567daeee1b0 0x5567db2d3e30 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.846+0000 7fb71dffb640 0 client.16989 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:50:48.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.846+0000 7fb742ec0740 1 --2- 172.21.15.84:0/3398794075 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5567daed59f0 0x5567db2d6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.846+0000 7fb742ec0740 1 -- 172.21.15.84:0/3398794075 >> 172.21.15.84:0/3398794075 conn(0x5567daf0b460 msgr2=0x5567db2bfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:48.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.847+0000 7fb742ec0740 1 -- 172.21.15.84:0/3398794075 shutdown_connections 2024-09-21T03:50:48.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.847+0000 7fb742ec0740 1 -- 172.21.15.84:0/3398794075 wait complete. 2024-09-21T03:50:48.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.847+0000 7fb742ec0740 20 client.16989 trim_cache size 0 max 16384 2024-09-21T03:50:48.855 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:50:48.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.847+0000 7fb73c94c640 1 -- 172.21.15.84:0/2672515064 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb7200b6680 msgr2=0x7fb7200b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:48.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.847+0000 7fb73c94c640 1 --2- 172.21.15.84:0/2672515064 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb7200b6680 0x7fb7200b8b90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb7280cd740 tx=0x7fb728091fd0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.847+0000 7fb73c94c640 1 -- 172.21.15.84:0/2672515064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb738109df0 msgr2=0x7fb73819fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:48.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.847+0000 7fb73c94c640 1 --2- 172.21.15.84:0/2672515064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb738109df0 0x7fb73819fc80 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fb728004770 tx=0x7fb728004270 comp rx=0 tx=0).stop 2024-09-21T03:50:48.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.847+0000 7fb73c94c640 1 -- 172.21.15.84:0/2672515064 shutdown_connections 2024-09-21T03:50:48.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.847+0000 7fb73c94c640 1 --2- 172.21.15.84:0/2672515064 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb7200b6680 0x7fb7200b8b90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.847+0000 7fb73c94c640 1 --2- 172.21.15.84:0/2672515064 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb738109df0 0x7fb73819fc80 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.847+0000 7fb73c94c640 1 --2- 172.21.15.84:0/2672515064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7381094a0 0x7fb73819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.847+0000 7fb73c94c640 1 --2- 172.21.15.84:0/2672515064 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb738103b60 0x7fb73819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:48.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.847+0000 7fb73c94c640 1 -- 172.21.15.84:0/2672515064 >> 172.21.15.84:0/2672515064 conn(0x7fb7380ff5d0 msgr2=0x7fb738106a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:48.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.847+0000 7fb73c94c640 1 -- 172.21.15.84:0/2672515064 shutdown_connections 2024-09-21T03:50:48.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:48.847+0000 7fb73c94c640 1 -- 172.21.15.84:0/2672515064 wait complete. 2024-09-21T03:50:49.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:48 smithi084 ceph-mon[30941]: pgmap v578: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 14 op/s 2024-09-21T03:50:49.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:48 smithi174 ceph-mon[34403]: pgmap v578: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 14 op/s 2024-09-21T03:50:49.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:48 smithi172 ceph-mon[34821]: pgmap v578: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 14 op/s 2024-09-21T03:50:49.559 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:50:49.804 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:50:50.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.237+0000 7fc2d0335640 1 -- 172.21.15.84:0/3995912301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2c8108d10 msgr2=0x7fc2c810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:50.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.237+0000 7fc2d0335640 1 --2- 172.21.15.84:0/3995912301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2c8108d10 0x7fc2c810f540 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0009900 tx=0x7fc2c002a410 comp rx=0 tx=0).stop 2024-09-21T03:50:50.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.237+0000 7fc2d0335640 1 -- 172.21.15.84:0/3995912301 shutdown_connections 2024-09-21T03:50:50.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.237+0000 7fc2d0335640 1 --2- 172.21.15.84:0/3995912301 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2c8108d10 0x7fc2c810f540 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.237+0000 7fc2d0335640 1 --2- 172.21.15.84:0/3995912301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2c81083c0 0x7fc2c81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.237+0000 7fc2d0335640 1 --2- 172.21.15.84:0/3995912301 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2c8102a80 0x7fc2c8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.237+0000 7fc2d0335640 1 -- 172.21.15.84:0/3995912301 >> 172.21.15.84:0/3995912301 conn(0x7fc2c8079740 msgr2=0x7fc2c8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:50.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.237+0000 7fc2d0335640 1 -- 172.21.15.84:0/3995912301 shutdown_connections 2024-09-21T03:50:50.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.237+0000 7fc2d0335640 1 -- 172.21.15.84:0/3995912301 wait complete. 2024-09-21T03:50:50.279 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.238+0000 7fc2d0335640 1 Processor -- start 2024-09-21T03:50:50.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.238+0000 7fc2d0335640 1 -- start start 2024-09-21T03:50:50.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.238+0000 7fc2d0335640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2c8102a80 0x7fc2c819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:50.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.238+0000 7fc2d0335640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2c81083c0 0x7fc2c819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:50.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.238+0000 7fc2d0335640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2c8108d10 0x7fc2c819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:50.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.238+0000 7fc2d0335640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c8112980 con 0x7fc2c81083c0 2024-09-21T03:50:50.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.238+0000 7fc2d0335640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c8112800 con 0x7fc2c8102a80 2024-09-21T03:50:50.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.238+0000 7fc2d0335640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c8112b00 con 0x7fc2c8108d10 2024-09-21T03:50:50.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.238+0000 7fc2cd8d0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2c81083c0 0x7fc2c819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:50.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.239+0000 7fc2cd8d0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2c81083c0 0x7fc2c819aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54104/0 (socket says 172.21.15.84:54104) 2024-09-21T03:50:50.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.239+0000 7fc2cd8d0640 1 -- 172.21.15.84:0/1321473430 learned_addr learned my addr 172.21.15.84:0/1321473430 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:50.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.239+0000 7fc2ce0d1640 1 --2- 172.21.15.84:0/1321473430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2c8102a80 0x7fc2c819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:50.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.239+0000 7fc2ce8d2640 1 --2- 172.21.15.84:0/1321473430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2c8108d10 0x7fc2c819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:50.280 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.239+0000 7fc2cd8d0640 1 -- 172.21.15.84:0/1321473430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2c8108d10 msgr2=0x7fc2c819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.239+0000 7fc2cd8d0640 1 --2- 172.21.15.84:0/1321473430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2c8108d10 0x7fc2c819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.239+0000 7fc2cd8d0640 1 -- 172.21.15.84:0/1321473430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2c8102a80 msgr2=0x7fc2c819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.239+0000 7fc2cd8d0640 1 --2- 172.21.15.84:0/1321473430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2c8102a80 0x7fc2c819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.239+0000 7fc2cd8d0640 1 -- 172.21.15.84:0/1321473430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c81a0330 con 0x7fc2c81083c0 2024-09-21T03:50:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.239+0000 7fc2ce0d1640 1 --2- 172.21.15.84:0/1321473430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2c8102a80 0x7fc2c819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:50:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.239+0000 7fc2cd8d0640 1 --2- 172.21.15.84:0/1321473430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2c81083c0 0x7fc2c819aa20 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00c970 tx=0x7fc2bc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.239+0000 7fc2c77fe640 1 -- 172.21.15.84:0/1321473430 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc014070 con 0x7fc2c81083c0 2024-09-21T03:50:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.239+0000 7fc2c77fe640 1 -- 172.21.15.84:0/1321473430 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2bc004440 con 0x7fc2c81083c0 2024-09-21T03:50:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.239+0000 7fc2d0335640 1 -- 172.21.15.84:0/1321473430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c81a0620 con 0x7fc2c81083c0 2024-09-21T03:50:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.239+0000 7fc2c77fe640 1 -- 172.21.15.84:0/1321473430 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc003e50 con 0x7fc2c81083c0 2024-09-21T03:50:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.239+0000 7fc2d0335640 1 -- 172.21.15.84:0/1321473430 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c81a6e40 con 0x7fc2c81083c0 2024-09-21T03:50:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.242+0000 7fc2d68a9740 1 Processor -- start 2024-09-21T03:50:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.242+0000 7fc2c77fe640 1 -- 172.21.15.84:0/1321473430 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fc2bc017070 con 0x7fc2c81083c0 2024-09-21T03:50:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.242+0000 7fc2d68a9740 1 -- start start 2024-09-21T03:50:50.281 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.242+0000 7fc2d68a9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e60a6c070 0x558e60e136a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:50.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.242+0000 7fc2d68a9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a431b0 0x558e60e13be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:50.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.242+0000 7fc2d68a9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e60a4b390 0x558e60e14120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:50.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.242+0000 7fc2d68a9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558e60d89ea0 con 0x558e60a431b0 2024-09-21T03:50:50.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.242+0000 7fc2d68a9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558e60d792d0 con 0x558e60a6c070 2024-09-21T03:50:50.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.242+0000 7fc2d68a9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558e60d7d0e0 con 0x558e60a4b390 2024-09-21T03:50:50.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.242+0000 7fc2ce0d1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a431b0 0x558e60e13be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:50.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.242+0000 7fc2ce0d1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a431b0 0x558e60e13be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54112/0 (socket says 172.21.15.84:54112) 2024-09-21T03:50:50.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.242+0000 7fc2ce0d1640 1 -- 172.21.15.84:0/1069331781 learned_addr learned my addr 172.21.15.84:0/1069331781 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:50.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.243+0000 7fc2ce8d2640 1 --2- 172.21.15.84:0/1069331781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e60a6c070 0x558e60e136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:50.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.243+0000 7fc2cd8d0640 1 --2- 172.21.15.84:0/1069331781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e60a4b390 0x558e60e14120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:50.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.243+0000 7fc2c77fe640 1 --2- 172.21.15.84:0/1321473430 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc2b00b6850 0x7fc2b00b8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:50.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.243+0000 7fc2ce0d1640 1 -- 172.21.15.84:0/1069331781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e60a4b390 msgr2=0x558e60e14120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:50.282 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.243+0000 7fc2ce0d1640 1 --2- 172.21.15.84:0/1069331781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e60a4b390 0x558e60e14120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.243+0000 7fc2ce0d1640 1 -- 172.21.15.84:0/1069331781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e60a6c070 msgr2=0x558e60e136a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:50.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.243+0000 7fc2ce0d1640 1 --2- 172.21.15.84:0/1069331781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e60a6c070 0x558e60e136a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.243+0000 7fc2ce0d1640 1 -- 172.21.15.84:0/1069331781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e60ad7650 con 0x558e60a431b0 2024-09-21T03:50:50.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.243+0000 7fc2ce8d2640 1 --2- 172.21.15.84:0/1321473430 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc2b00b6850 0x7fc2b00b8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:50.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.243+0000 7fc2c77fe640 1 -- 172.21.15.84:0/1321473430 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fc2bc0e7220 con 0x7fc2c81083c0 2024-09-21T03:50:50.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.243+0000 7fc2ce0d1640 1 --2- 172.21.15.84:0/1069331781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a431b0 0x558e60e13be0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80103a0 tx=0x7fc2b8010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b519e5489a5425 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:50.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.243+0000 7fc2c4d9a640 1 -- 172.21.15.84:0/1069331781 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b8016070 con 0x558e60a431b0 2024-09-21T03:50:50.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.243+0000 7fc2c4d9a640 1 -- 172.21.15.84:0/1069331781 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2b8012bc0 con 0x558e60a431b0 2024-09-21T03:50:50.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.243+0000 7fc2c4d9a640 1 -- 172.21.15.84:0/1069331781 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b801bcb0 con 0x558e60a431b0 2024-09-21T03:50:50.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.244+0000 7fc2d68a9740 1 -- 172.21.15.84:0/1069331781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a431b0 msgr2=0x558e60e13be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:50.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.244+0000 7fc2ce8d2640 1 --2- 172.21.15.84:0/1321473430 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc2b00b6850 0x7fc2b00b8d60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0031440 tx=0x7fc2c0009260 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:50.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.244+0000 7fc2d68a9740 1 --2- 172.21.15.84:0/1069331781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a431b0 0x558e60e13be0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80103a0 tx=0x7fc2b8010860 comp rx=0 tx=0).stop 2024-09-21T03:50:50.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.244+0000 7fc2d68a9740 1 -- 172.21.15.84:0/1069331781 shutdown_connections 2024-09-21T03:50:50.283 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.244+0000 7fc2d68a9740 1 --2- 172.21.15.84:0/1069331781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e60a4b390 0x558e60e14120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.244+0000 7fc2d68a9740 1 --2- 172.21.15.84:0/1069331781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a431b0 0x558e60e13be0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.244+0000 7fc2d68a9740 1 --2- 172.21.15.84:0/1069331781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e60a6c070 0x558e60e136a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.244+0000 7fc2d68a9740 1 -- 172.21.15.84:0/1069331781 >> 172.21.15.84:0/1069331781 conn(0x558e60a60460 msgr2=0x558e60e11590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.244+0000 7fc2d68a9740 1 -- 172.21.15.84:0/1069331781 shutdown_connections 2024-09-21T03:50:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.244+0000 7fc2d68a9740 1 -- 172.21.15.84:0/1069331781 wait complete. 2024-09-21T03:50:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.245+0000 7fc2d68a9740 1 -- start start 2024-09-21T03:50:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.245+0000 7fc2d68a9740 1 Processor -- start 2024-09-21T03:50:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.245+0000 7fc2d68a9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e60a431b0 0x558e60e1ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.245+0000 7fc2d68a9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a4b390 0x558e60e1f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.245+0000 7fc2d68a9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e60a6c070 0x558e60e2b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.245+0000 7fc2d68a9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558e60bda700 con 0x558e60a4b390 2024-09-21T03:50:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.245+0000 7fc2d68a9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558e60d14160 con 0x558e60a6c070 2024-09-21T03:50:50.284 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.245+0000 7fc2d68a9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558e60e21e80 con 0x558e60a431b0 2024-09-21T03:50:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.245+0000 7fc2d68a9740 10 client.0 _ll_register_callbacks cb 0x558e60d2d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.245+0000 7fc2cd8d0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a4b390 0x558e60e1f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.245+0000 7fc2cd8d0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a4b390 0x558e60e1f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54128/0 (socket says 172.21.15.84:54128) 2024-09-21T03:50:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.245+0000 7fc2cd8d0640 1 -- 172.21.15.84:0/2104459103 learned_addr learned my addr 172.21.15.84:0/2104459103 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.245+0000 7fc2ce0d1640 1 --2- 172.21.15.84:0/2104459103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e60a431b0 0x558e60e1ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.245+0000 7fc2ce8d2640 1 --2- 172.21.15.84:0/2104459103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e60a6c070 0x558e60e2b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.245+0000 7fc2cd8d0640 1 -- 172.21.15.84:0/2104459103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e60a431b0 msgr2=0x558e60e1ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.245+0000 7fc2cd8d0640 1 --2- 172.21.15.84:0/2104459103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e60a431b0 0x558e60e1ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.245+0000 7fc2cd8d0640 1 -- 172.21.15.84:0/2104459103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e60a6c070 msgr2=0x558e60e2b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.245+0000 7fc2cd8d0640 1 --2- 172.21.15.84:0/2104459103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e60a6c070 0x558e60e2b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.246+0000 7fc2cd8d0640 1 -- 172.21.15.84:0/2104459103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e60d41c90 con 0x558e60a4b390 2024-09-21T03:50:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.246+0000 7fc2cd8d0640 1 --2- 172.21.15.84:0/2104459103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a4b390 0x558e60e1f2b0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0e4fc0 tx=0x7fc2bc003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2140dd65d0e6b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:50.285 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.246+0000 7fc2adffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:50.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.246+0000 7fc2adffb640 1 -- 172.21.15.84:0/2104459103 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0aca10 con 0x558e60a4b390 2024-09-21T03:50:50.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.246+0000 7fc2adffb640 1 -- 172.21.15.84:0/2104459103 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fc2bc0abd90 con 0x558e60a4b390 2024-09-21T03:50:50.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.246+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2104459103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2b8012bc0 con 0x558e60a4b390 2024-09-21T03:50:50.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.246+0000 7fc2adffb640 1 -- 172.21.15.84:0/2104459103 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc2bc0a9710 con 0x558e60a4b390 2024-09-21T03:50:50.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.246+0000 7fc2d68a9740 10 client.17001 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:50.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.246+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2104459103 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558e60e2dbe0 con 0x558e60a4b390 2024-09-21T03:50:50.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.246+0000 7fc2adffb640 1 -- 172.21.15.84:0/2104459103 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2b8012bc0 con 0x558e60a4b390 2024-09-21T03:50:50.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.246+0000 7fc2adffb640 1 -- 172.21.15.84:0/2104459103 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc2bc0abf90 con 0x558e60a4b390 2024-09-21T03:50:50.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.246+0000 7fc2d68a9740 10 client.17001 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:50.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.246+0000 7fc2d68a9740 10 client.17001 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:50:50.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.246+0000 7fc2d68a9740 20 client.17001 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:50.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.246+0000 7fc2d68a9740 1 --2- 172.21.15.84:0/2104459103 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x558e60a2a9f0 0x558e60e31100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:50.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.246+0000 7fc2d68a9740 4 client.17001 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:50:50.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.246+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2104459103 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e60d8bdf0 con 0x558e60a2a9f0 2024-09-21T03:50:50.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.247+0000 7fc2ce0d1640 1 --2- 172.21.15.84:0/2104459103 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x558e60a2a9f0 0x558e60e31100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:50.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.247+0000 7fc2adffb640 10 client.17001 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:50:50.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.247+0000 7fc2ce0d1640 1 --2- 172.21.15.84:0/2104459103 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x558e60a2a9f0 0x558e60e31100 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aa0ffbda568216a5 server_cookie=95637d1497c60a34 in_seq=0 out_seq=0 2024-09-21T03:50:50.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.248+0000 7fc2adffb640 1 -- 172.21.15.84:0/2104459103 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558e60d8bdf0 con 0x558e60a2a9f0 2024-09-21T03:50:50.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.248+0000 7fc2adffb640 10 client.17001 handle_command_reply: tid=0 2024-09-21T03:50:50.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.248+0000 7fc2d68a9740 1 client.17001 shutdown 2024-09-21T03:50:50.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.248+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2104459103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a4b390 msgr2=0x558e60e1f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:50.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.248+0000 7fc2d68a9740 1 --2- 172.21.15.84:0/2104459103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a4b390 0x558e60e1f2b0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0e4fc0 tx=0x7fc2bc003820 comp rx=0 tx=0).stop 2024-09-21T03:50:50.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.248+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2104459103 shutdown_connections 2024-09-21T03:50:50.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.248+0000 7fc2d68a9740 1 --2- 172.21.15.84:0/2104459103 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x558e60a2a9f0 0x558e60e31100 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.248+0000 7fc2d68a9740 1 --2- 172.21.15.84:0/2104459103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e60a6c070 0x558e60e2b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.248+0000 7fc2d68a9740 1 --2- 172.21.15.84:0/2104459103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a4b390 0x558e60e1f2b0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.248+0000 7fc2adffb640 0 client.17001 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:50:50.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.248+0000 7fc2d68a9740 1 --2- 172.21.15.84:0/2104459103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e60a431b0 0x558e60e1ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.248+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2104459103 >> 172.21.15.84:0/2104459103 conn(0x558e60a60460 msgr2=0x558e60e16830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.248+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2104459103 shutdown_connections 2024-09-21T03:50:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.248+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2104459103 wait complete. 2024-09-21T03:50:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.248+0000 7fc2d68a9740 20 client.17001 trim_cache size 0 max 16384 2024-09-21T03:50:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.261+0000 7fc2d68a9740 1 Processor -- start 2024-09-21T03:50:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.261+0000 7fc2d68a9740 1 -- start start 2024-09-21T03:50:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.262+0000 7fc2d68a9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e60a431b0 0x558e60e1f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.262+0000 7fc2d68a9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e60a4b390 0x558e60e2b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.262+0000 7fc2d68a9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a6c070 0x558e60e1bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.262+0000 7fc2d68a9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c81b1e70 con 0x558e60a6c070 2024-09-21T03:50:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.262+0000 7fc2d68a9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c81af740 con 0x558e60a431b0 2024-09-21T03:50:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.262+0000 7fc2d68a9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c81ad5b0 con 0x558e60a4b390 2024-09-21T03:50:50.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.262+0000 7fc2ce8d2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a6c070 0x558e60e1bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.262+0000 7fc2ce8d2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a6c070 0x558e60e1bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54132/0 (socket says 172.21.15.84:54132) 2024-09-21T03:50:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.262+0000 7fc2ce8d2640 1 -- 172.21.15.84:0/2747379695 learned_addr learned my addr 172.21.15.84:0/2747379695 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.262+0000 7fc2ce0d1640 1 --2- 172.21.15.84:0/2747379695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e60a431b0 0x558e60e1f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.262+0000 7fc2cd8d0640 1 --2- 172.21.15.84:0/2747379695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e60a4b390 0x558e60e2b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.262+0000 7fc2ce8d2640 1 -- 172.21.15.84:0/2747379695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e60a4b390 msgr2=0x558e60e2b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.262+0000 7fc2ce8d2640 1 --2- 172.21.15.84:0/2747379695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e60a4b390 0x558e60e2b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.262+0000 7fc2ce8d2640 1 -- 172.21.15.84:0/2747379695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e60a431b0 msgr2=0x558e60e1f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.262+0000 7fc2ce8d2640 1 --2- 172.21.15.84:0/2747379695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e60a431b0 0x558e60e1f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.262+0000 7fc2ce8d2640 1 -- 172.21.15.84:0/2747379695 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e60e16500 con 0x558e60a6c070 2024-09-21T03:50:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.262+0000 7fc2cd8d0640 1 --2- 172.21.15.84:0/2747379695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e60a4b390 0x558e60e2b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.262+0000 7fc2ce8d2640 1 --2- 172.21.15.84:0/2747379695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a6c070 0x558e60e1bf60 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fc2c00317c0 tx=0x7fc2c003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43fe49d4c787ab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.262+0000 7fc2affff640 1 -- 172.21.15.84:0/2747379695 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0035040 con 0x558e60a6c070 2024-09-21T03:50:50.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.263+0000 7fc2affff640 1 -- 172.21.15.84:0/2747379695 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2c004c030 con 0x558e60a6c070 2024-09-21T03:50:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.263+0000 7fc2affff640 1 -- 172.21.15.84:0/2747379695 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c00049f0 con 0x558e60a6c070 2024-09-21T03:50:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.263+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2747379695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a6c070 msgr2=0x558e60e1bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.263+0000 7fc2d68a9740 1 --2- 172.21.15.84:0/2747379695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a6c070 0x558e60e1bf60 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fc2c00317c0 tx=0x7fc2c003e000 comp rx=0 tx=0).stop 2024-09-21T03:50:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.263+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2747379695 shutdown_connections 2024-09-21T03:50:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.263+0000 7fc2d68a9740 1 --2- 172.21.15.84:0/2747379695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a6c070 0x558e60e1bf60 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.263+0000 7fc2d68a9740 1 --2- 172.21.15.84:0/2747379695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e60a4b390 0x558e60e2b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.263+0000 7fc2d68a9740 1 --2- 172.21.15.84:0/2747379695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e60a431b0 0x558e60e1f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.263+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2747379695 >> 172.21.15.84:0/2747379695 conn(0x558e60a60460 msgr2=0x558e60e1eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.263+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2747379695 shutdown_connections 2024-09-21T03:50:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.263+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2747379695 wait complete. 2024-09-21T03:50:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.264+0000 7fc2d68a9740 1 -- start start 2024-09-21T03:50:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.264+0000 7fc2d68a9740 1 Processor -- start 2024-09-21T03:50:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.264+0000 7fc2d68a9740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e60a431b0 0x558e60e231e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:50.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.264+0000 7fc2d68a9740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a4b390 0x558e60e23720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:50.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.264+0000 7fc2d68a9740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e60a6c070 0x558e60e23c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:50.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.264+0000 7fc2d68a9740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c81adc00 con 0x558e60a4b390 2024-09-21T03:50:50.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.264+0000 7fc2d68a9740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c81af070 con 0x558e60a6c070 2024-09-21T03:50:50.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.264+0000 7fc2d68a9740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c81ae2d0 con 0x558e60a431b0 2024-09-21T03:50:50.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.264+0000 7fc2d68a9740 10 client.0 _ll_register_callbacks cb 0x7fc2bc00c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:50.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.264+0000 7fc2cd8d0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a4b390 0x558e60e23720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:50.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.264+0000 7fc2cd8d0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a4b390 0x558e60e23720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54138/0 (socket says 172.21.15.84:54138) 2024-09-21T03:50:50.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.264+0000 7fc2cd8d0640 1 -- 172.21.15.84:0/2836629576 learned_addr learned my addr 172.21.15.84:0/2836629576 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:50.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.265+0000 7fc2ce8d2640 1 --2- 172.21.15.84:0/2836629576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e60a6c070 0x558e60e23c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:50.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.265+0000 7fc2cd8d0640 1 -- 172.21.15.84:0/2836629576 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e60a431b0 msgr2=0x558e60e231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:50.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.265+0000 7fc2cd8d0640 1 --2- 172.21.15.84:0/2836629576 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e60a431b0 0x558e60e231e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.265+0000 7fc2cd8d0640 1 -- 172.21.15.84:0/2836629576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e60a6c070 msgr2=0x558e60e23c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:50.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.265+0000 7fc2cd8d0640 1 --2- 172.21.15.84:0/2836629576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e60a6c070 0x558e60e23c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.265+0000 7fc2cd8d0640 1 -- 172.21.15.84:0/2836629576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e60e9abe0 con 0x558e60a4b390 2024-09-21T03:50:50.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.265+0000 7fc2cd8d0640 1 --2- 172.21.15.84:0/2836629576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a4b390 0x558e60e23720 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0a9690 tx=0x7fc2bc007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b51079f9c5d931 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:50.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.265+0000 7fc2adffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:50.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.265+0000 7fc2adffb640 1 -- 172.21.15.84:0/2836629576 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0ac830 con 0x558e60a4b390 2024-09-21T03:50:50.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.265+0000 7fc2adffb640 1 -- 172.21.15.84:0/2836629576 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fc2bc0abd90 con 0x558e60a4b390 2024-09-21T03:50:50.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.265+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2836629576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2c004c030 con 0x558e60a4b390 2024-09-21T03:50:50.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.265+0000 7fc2adffb640 1 -- 172.21.15.84:0/2836629576 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc2bc05c020 con 0x558e60a4b390 2024-09-21T03:50:50.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.265+0000 7fc2d68a9740 10 client.17007 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:50.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.265+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2836629576 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558e60e9bdd0 con 0x558e60a4b390 2024-09-21T03:50:50.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.265+0000 7fc2adffb640 1 -- 172.21.15.84:0/2836629576 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2c004c030 con 0x558e60a4b390 2024-09-21T03:50:50.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.265+0000 7fc2adffb640 1 -- 172.21.15.84:0/2836629576 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc2bc05c1c0 con 0x558e60a4b390 2024-09-21T03:50:50.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.265+0000 7fc2d68a9740 10 client.17007 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:50.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.265+0000 7fc2d68a9740 10 client.17007 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:50:50.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.266+0000 7fc2d68a9740 20 client.17007 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:50.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.266+0000 7fc2d68a9740 1 --2- 172.21.15.84:0/2836629576 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x558e609ffda0 0x558e60e9e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:50.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.266+0000 7fc2d68a9740 4 client.17007 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:50:50.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.266+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2836629576 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558e60d878a0 con 0x558e609ffda0 2024-09-21T03:50:50.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.266+0000 7fc2ce0d1640 1 --2- 172.21.15.84:0/2836629576 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x558e609ffda0 0x558e60e9e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:50.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.266+0000 7fc2adffb640 10 client.17007 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:50:50.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.266+0000 7fc2ce0d1640 1 --2- 172.21.15.84:0/2836629576 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x558e609ffda0 0x558e60e9e4d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=20bfbf5c165a097c server_cookie=566a251fcbaf7a7d in_seq=0 out_seq=0 2024-09-21T03:50:50.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.266+0000 7fc2adffb640 1 -- 172.21.15.84:0/2836629576 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558e60d878a0 con 0x558e609ffda0 2024-09-21T03:50:50.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.266+0000 7fc2adffb640 10 client.17007 handle_command_reply: tid=0 2024-09-21T03:50:50.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.266+0000 7fc2d68a9740 1 client.17007 shutdown 2024-09-21T03:50:50.293 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:50:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.267+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2836629576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a4b390 msgr2=0x558e60e23720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.267+0000 7fc2d68a9740 1 --2- 172.21.15.84:0/2836629576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a4b390 0x558e60e23720 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0a9690 tx=0x7fc2bc007f90 comp rx=0 tx=0).stop 2024-09-21T03:50:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.267+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2836629576 shutdown_connections 2024-09-21T03:50:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.267+0000 7fc2d68a9740 1 --2- 172.21.15.84:0/2836629576 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x558e609ffda0 0x558e60e9e4d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.267+0000 7fc2d68a9740 1 --2- 172.21.15.84:0/2836629576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e60a6c070 0x558e60e23c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.267+0000 7fc2adffb640 0 client.17007 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:50:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.267+0000 7fc2d68a9740 1 --2- 172.21.15.84:0/2836629576 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e60a4b390 0x558e60e23720 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.267+0000 7fc2d68a9740 1 --2- 172.21.15.84:0/2836629576 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e60a431b0 0x558e60e231e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.267+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2836629576 >> 172.21.15.84:0/2836629576 conn(0x558e60a60460 msgr2=0x558e60e1d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.267+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2836629576 shutdown_connections 2024-09-21T03:50:50.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.267+0000 7fc2d68a9740 1 -- 172.21.15.84:0/2836629576 wait complete. 2024-09-21T03:50:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.267+0000 7fc2d68a9740 20 client.17007 trim_cache size 0 max 16384 2024-09-21T03:50:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.267+0000 7fc2d0335640 1 -- 172.21.15.84:0/1321473430 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc2b00b6850 msgr2=0x7fc2b00b8d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.267+0000 7fc2d0335640 1 --2- 172.21.15.84:0/1321473430 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc2b00b6850 0x7fc2b00b8d60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0031440 tx=0x7fc2c0009260 comp rx=0 tx=0).stop 2024-09-21T03:50:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.267+0000 7fc2d0335640 1 -- 172.21.15.84:0/1321473430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2c81083c0 msgr2=0x7fc2c819aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.267+0000 7fc2d0335640 1 --2- 172.21.15.84:0/1321473430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2c81083c0 0x7fc2c819aa20 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00c970 tx=0x7fc2bc00ce30 comp rx=0 tx=0).stop 2024-09-21T03:50:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.268+0000 7fc2d0335640 1 -- 172.21.15.84:0/1321473430 shutdown_connections 2024-09-21T03:50:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.268+0000 7fc2d0335640 1 --2- 172.21.15.84:0/1321473430 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc2b00b6850 0x7fc2b00b8d60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.268+0000 7fc2d0335640 1 --2- 172.21.15.84:0/1321473430 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2c8108d10 0x7fc2c819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.268+0000 7fc2d0335640 1 --2- 172.21.15.84:0/1321473430 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc2c81083c0 0x7fc2c819aa20 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.268+0000 7fc2d0335640 1 --2- 172.21.15.84:0/1321473430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2c8102a80 0x7fc2c819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.268+0000 7fc2d0335640 1 -- 172.21.15.84:0/1321473430 >> 172.21.15.84:0/1321473430 conn(0x7fc2c8079740 msgr2=0x7fc2c806be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.268+0000 7fc2d0335640 1 -- 172.21.15.84:0/1321473430 shutdown_connections 2024-09-21T03:50:50.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:50.268+0000 7fc2d0335640 1 -- 172.21.15.84:0/1321473430 wait complete. 2024-09-21T03:50:50.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:50 smithi084 ceph-mon[30941]: pgmap v579: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 9 op/s 2024-09-21T03:50:50.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:50 smithi174 ceph-mon[34403]: pgmap v579: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 9 op/s 2024-09-21T03:50:50.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:50 smithi172 ceph-mon[34821]: pgmap v579: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 9 op/s 2024-09-21T03:50:51.126 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:50:51.371 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:50:51.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.881+0000 7f9aee04a640 1 -- 172.21.15.84:0/3602501703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ae8102220 msgr2=0x7f9ae8102630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:51.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.881+0000 7f9aee04a640 1 --2- 172.21.15.84:0/3602501703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ae8102220 0x7f9ae8102630 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8009900 tx=0x7f9ad802a410 comp rx=0 tx=0).stop 2024-09-21T03:50:51.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.881+0000 7f9aee04a640 1 -- 172.21.15.84:0/3602501703 shutdown_connections 2024-09-21T03:50:51.901 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.881+0000 7f9aee04a640 1 --2- 172.21.15.84:0/3602501703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ae81084b0 0x7f9ae810ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.881+0000 7f9aee04a640 1 --2- 172.21.15.84:0/3602501703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ae8107b60 0x7f9ae8107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.881+0000 7f9aee04a640 1 --2- 172.21.15.84:0/3602501703 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ae8102220 0x7f9ae8102630 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.881+0000 7f9aee04a640 1 -- 172.21.15.84:0/3602501703 >> 172.21.15.84:0/3602501703 conn(0x7f9ae8079e30 msgr2=0x7f9ae807a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:51.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.881+0000 7f9aee04a640 1 -- 172.21.15.84:0/3602501703 shutdown_connections 2024-09-21T03:50:51.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.881+0000 7f9aee04a640 1 -- 172.21.15.84:0/3602501703 wait complete. 2024-09-21T03:50:51.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.881+0000 7f9aee04a640 1 Processor -- start 2024-09-21T03:50:51.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.882+0000 7f9aee04a640 1 -- start start 2024-09-21T03:50:51.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.882+0000 7f9aee04a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ae8102220 0x7f9ae80fee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:51.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.882+0000 7f9aee04a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ae8107b60 0x7f9ae80ff3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:51.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.882+0000 7f9aee04a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ae81084b0 0x7f9ae80ff8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:51.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.882+0000 7f9aee04a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae8112160 con 0x7f9ae8107b60 2024-09-21T03:50:51.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.882+0000 7f9aee04a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae8111fe0 con 0x7f9ae8102220 2024-09-21T03:50:51.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.882+0000 7f9aee04a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae81122e0 con 0x7f9ae81084b0 2024-09-21T03:50:51.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.882+0000 7f9ae6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ae8107b60 0x7f9ae80ff3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:51.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.882+0000 7f9ae6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ae8107b60 0x7f9ae80ff3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54168/0 (socket says 172.21.15.84:54168) 2024-09-21T03:50:51.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.882+0000 7f9ae6ffd640 1 -- 172.21.15.84:0/1581954428 learned_addr learned my addr 172.21.15.84:0/1581954428 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:51.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.882+0000 7f9ae7fff640 1 --2- 172.21.15.84:0/1581954428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ae81084b0 0x7f9ae80ff8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:51.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.882+0000 7f9ae77fe640 1 --2- 172.21.15.84:0/1581954428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ae8102220 0x7f9ae80fee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:51.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.882+0000 7f9ae6ffd640 1 -- 172.21.15.84:0/1581954428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ae81084b0 msgr2=0x7f9ae80ff8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:51.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.882+0000 7f9ae6ffd640 1 --2- 172.21.15.84:0/1581954428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ae81084b0 0x7f9ae80ff8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.882+0000 7f9ae6ffd640 1 -- 172.21.15.84:0/1581954428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ae8102220 msgr2=0x7f9ae80fee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:51.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.882+0000 7f9ae6ffd640 1 --2- 172.21.15.84:0/1581954428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ae8102220 0x7f9ae80fee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.882+0000 7f9ae6ffd640 1 -- 172.21.15.84:0/1581954428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae81a86a0 con 0x7f9ae8107b60 2024-09-21T03:50:51.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.882+0000 7f9ae6ffd640 1 --2- 172.21.15.84:0/1581954428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ae8107b60 0x7f9ae80ff3a0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00c8c0 tx=0x7f9adc00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:51.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.883+0000 7f9ae4ff9640 1 -- 172.21.15.84:0/1581954428 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc007bb0 con 0x7f9ae8107b60 2024-09-21T03:50:51.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.883+0000 7f9aee04a640 1 -- 172.21.15.84:0/1581954428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae81a8990 con 0x7f9ae8107b60 2024-09-21T03:50:51.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.883+0000 7f9ae4ff9640 1 -- 172.21.15.84:0/1581954428 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9adc007d50 con 0x7f9ae8107b60 2024-09-21T03:50:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.883+0000 7f9ae4ff9640 1 -- 172.21.15.84:0/1581954428 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0187c0 con 0x7f9ae8107b60 2024-09-21T03:50:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.883+0000 7f9aee04a640 1 -- 172.21.15.84:0/1581954428 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae81a8ed0 con 0x7f9ae8107b60 2024-09-21T03:50:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.885+0000 7f9af45be740 1 Processor -- start 2024-09-21T03:50:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.885+0000 7f9af45be740 1 -- start start 2024-09-21T03:50:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.885+0000 7f9ae4ff9640 1 -- 172.21.15.84:0/1581954428 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f9adc00fa20 con 0x7f9ae8107b60 2024-09-21T03:50:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.885+0000 7f9af45be740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f063070 0x56353f40a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.885+0000 7f9af45be740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f03a1b0 0x56353f40a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.885+0000 7f9af45be740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f042390 0x56353f40ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.885+0000 7f9af45be740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56353f380ea0 con 0x56353f03a1b0 2024-09-21T03:50:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.885+0000 7f9af45be740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56353f3702d0 con 0x56353f042390 2024-09-21T03:50:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.885+0000 7f9af45be740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56353f3740e0 con 0x56353f063070 2024-09-21T03:50:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.885+0000 7f9ae77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f03a1b0 0x56353f40a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.886+0000 7f9ae77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f03a1b0 0x56353f40a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54180/0 (socket says 172.21.15.84:54180) 2024-09-21T03:50:51.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.886+0000 7f9ae77fe640 1 -- 172.21.15.84:0/454673314 learned_addr learned my addr 172.21.15.84:0/454673314 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:51.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.886+0000 7f9ae6ffd640 1 --2- 172.21.15.84:0/454673314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f042390 0x56353f40ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:51.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.886+0000 7f9ae7fff640 1 --2- 172.21.15.84:0/454673314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f063070 0x56353f40a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:51.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.886+0000 7f9ae77fe640 1 -- 172.21.15.84:0/454673314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f063070 msgr2=0x56353f40a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:51.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.886+0000 7f9ae77fe640 1 --2- 172.21.15.84:0/454673314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f063070 0x56353f40a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.886+0000 7f9ae77fe640 1 -- 172.21.15.84:0/454673314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f042390 msgr2=0x56353f40ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:51.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.886+0000 7f9ae77fe640 1 --2- 172.21.15.84:0/454673314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f042390 0x56353f40ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.886+0000 7f9ae77fe640 1 -- 172.21.15.84:0/454673314 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56353f0ce650 con 0x56353f03a1b0 2024-09-21T03:50:51.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.886+0000 7f9ae7fff640 1 --2- 172.21.15.84:0/454673314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f063070 0x56353f40a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:50:51.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.886+0000 7f9ae6ffd640 1 --2- 172.21.15.84:0/454673314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f042390 0x56353f40ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:50:51.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.886+0000 7f9ae4ff9640 1 --2- 172.21.15.84:0/1581954428 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9ad00b6680 0x7f9ad00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:51.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.886+0000 7f9ae77fe640 1 --2- 172.21.15.84:0/454673314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f03a1b0 0x56353f40a800 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f9ad802a930 tx=0x7f9ad8031cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56600add9d53dbb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:51.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.886+0000 7f9ae7fff640 1 --2- 172.21.15.84:0/1581954428 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9ad00b6680 0x7f9ad00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:51.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.886+0000 7f9ae4ff9640 1 -- 172.21.15.84:0/1581954428 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f9adc0e78a0 con 0x7f9ae8107b60 2024-09-21T03:50:51.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.886+0000 7f9acdffb640 1 -- 172.21.15.84:0/454673314 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad803f070 con 0x56353f03a1b0 2024-09-21T03:50:51.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.886+0000 7f9acdffb640 1 -- 172.21.15.84:0/454673314 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ad80316a0 con 0x56353f03a1b0 2024-09-21T03:50:51.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.886+0000 7f9acdffb640 1 -- 172.21.15.84:0/454673314 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8035070 con 0x56353f03a1b0 2024-09-21T03:50:51.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.887+0000 7f9af45be740 1 -- 172.21.15.84:0/454673314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f03a1b0 msgr2=0x56353f40a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:51.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.887+0000 7f9ae7fff640 1 --2- 172.21.15.84:0/1581954428 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9ad00b6680 0x7f9ad00b8b90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0007470 tx=0x7f9ae0007400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:51.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.887+0000 7f9af45be740 1 --2- 172.21.15.84:0/454673314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f03a1b0 0x56353f40a800 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f9ad802a930 tx=0x7f9ad8031cd0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.887+0000 7f9af45be740 1 -- 172.21.15.84:0/454673314 shutdown_connections 2024-09-21T03:50:51.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.887+0000 7f9af45be740 1 --2- 172.21.15.84:0/454673314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f042390 0x56353f40ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.887+0000 7f9af45be740 1 --2- 172.21.15.84:0/454673314 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f03a1b0 0x56353f40a800 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.887+0000 7f9af45be740 1 --2- 172.21.15.84:0/454673314 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f063070 0x56353f40a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.887+0000 7f9af45be740 1 -- 172.21.15.84:0/454673314 >> 172.21.15.84:0/454673314 conn(0x56353f057460 msgr2=0x56353f4081b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:51.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.887+0000 7f9af45be740 1 -- 172.21.15.84:0/454673314 shutdown_connections 2024-09-21T03:50:51.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.887+0000 7f9af45be740 1 -- 172.21.15.84:0/454673314 wait complete. 2024-09-21T03:50:51.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.888+0000 7f9af45be740 1 -- start start 2024-09-21T03:50:51.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.888+0000 7f9af45be740 1 Processor -- start 2024-09-21T03:50:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.888+0000 7f9af45be740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f03a1b0 0x56353f415980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.888+0000 7f9af45be740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f042390 0x56353f415ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.888+0000 7f9af45be740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f063070 0x56353f421d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.888+0000 7f9af45be740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56353f1d1700 con 0x56353f063070 2024-09-21T03:50:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.888+0000 7f9af45be740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56353f30b160 con 0x56353f042390 2024-09-21T03:50:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.888+0000 7f9af45be740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56353f418a40 con 0x56353f03a1b0 2024-09-21T03:50:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.888+0000 7f9af45be740 10 client.0 _ll_register_callbacks cb 0x56353f3249e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.889+0000 7f9ae7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f063070 0x56353f421d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.889+0000 7f9ae7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f063070 0x56353f421d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54192/0 (socket says 172.21.15.84:54192) 2024-09-21T03:50:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.889+0000 7f9ae7fff640 1 -- 172.21.15.84:0/2074629071 learned_addr learned my addr 172.21.15.84:0/2074629071 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.889+0000 7f9ae77fe640 1 --2- 172.21.15.84:0/2074629071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f03a1b0 0x56353f415980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.889+0000 7f9ae6ffd640 1 --2- 172.21.15.84:0/2074629071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f042390 0x56353f415ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.889+0000 7f9ae7fff640 1 -- 172.21.15.84:0/2074629071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f03a1b0 msgr2=0x56353f415980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:51.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.889+0000 7f9ae7fff640 1 --2- 172.21.15.84:0/2074629071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f03a1b0 0x56353f415980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.889+0000 7f9ae7fff640 1 -- 172.21.15.84:0/2074629071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f042390 msgr2=0x56353f415ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.889+0000 7f9ae7fff640 1 --2- 172.21.15.84:0/2074629071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f042390 0x56353f415ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.889+0000 7f9ae7fff640 1 -- 172.21.15.84:0/2074629071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56353f338c90 con 0x56353f063070 2024-09-21T03:50:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.889+0000 7f9ae6ffd640 1 --2- 172.21.15.84:0/2074629071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f042390 0x56353f415ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.889+0000 7f9ae77fe640 1 --2- 172.21.15.84:0/2074629071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f03a1b0 0x56353f415980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.889+0000 7f9ae7fff640 1 --2- 172.21.15.84:0/2074629071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f063070 0x56353f421d90 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0011e30 tx=0x7f9ae0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d727c1aa899ba7f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.889+0000 7f9ac6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.889+0000 7f9ac6ffd640 1 -- 172.21.15.84:0/2074629071 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae001e620 con 0x56353f063070 2024-09-21T03:50:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.889+0000 7f9ac6ffd640 1 -- 172.21.15.84:0/2074629071 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f9ae001e7c0 con 0x56353f063070 2024-09-21T03:50:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.889+0000 7f9af45be740 1 -- 172.21.15.84:0/2074629071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ad80316a0 con 0x56353f063070 2024-09-21T03:50:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.889+0000 7f9ac6ffd640 1 -- 172.21.15.84:0/2074629071 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9ae001e9c0 con 0x56353f063070 2024-09-21T03:50:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.889+0000 7f9af45be740 10 client.17019 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.889+0000 7f9af45be740 1 -- 172.21.15.84:0/2074629071 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56353f4247b0 con 0x56353f063070 2024-09-21T03:50:51.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.890+0000 7f9ac6ffd640 1 -- 172.21.15.84:0/2074629071 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ae001eb60 con 0x56353f063070 2024-09-21T03:50:51.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.890+0000 7f9ac6ffd640 1 -- 172.21.15.84:0/2074629071 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9ae0026400 con 0x56353f063070 2024-09-21T03:50:51.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.890+0000 7f9af45be740 10 client.17019 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:51.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.890+0000 7f9af45be740 10 client.17019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:50:51.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.890+0000 7f9af45be740 20 client.17019 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:51.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.890+0000 7f9af45be740 1 --2- 172.21.15.84:0/2074629071 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56353f0219f0 0x56353f427cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:51.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.890+0000 7f9af45be740 4 client.17019 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:50:51.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.890+0000 7f9af45be740 1 -- 172.21.15.84:0/2074629071 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9ad80316a0 con 0x56353f0219f0 2024-09-21T03:50:51.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.890+0000 7f9ae77fe640 1 --2- 172.21.15.84:0/2074629071 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56353f0219f0 0x56353f427cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:51.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.891+0000 7f9ae77fe640 1 --2- 172.21.15.84:0/2074629071 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56353f0219f0 0x56353f427cd0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5bfdb87f6cf790e server_cookie=9f9298fc24abddb7 in_seq=0 out_seq=0 2024-09-21T03:50:51.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.891+0000 7f9ac6ffd640 10 client.17019 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:51.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.891+0000 7f9ac6ffd640 1 -- 172.21.15.84:0/2074629071 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f9ad80316a0 con 0x56353f0219f0 2024-09-21T03:50:51.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.891+0000 7f9ac6ffd640 10 client.17019 handle_command_reply: tid=0 2024-09-21T03:50:51.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.891+0000 7f9af45be740 1 client.17019 shutdown 2024-09-21T03:50:51.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.892+0000 7f9af45be740 1 -- 172.21.15.84:0/2074629071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f063070 msgr2=0x56353f421d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:51.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.892+0000 7f9af45be740 1 --2- 172.21.15.84:0/2074629071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f063070 0x56353f421d90 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0011e30 tx=0x7f9ae0004a40 comp rx=0 tx=0).stop 2024-09-21T03:50:51.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.892+0000 7f9af45be740 1 -- 172.21.15.84:0/2074629071 shutdown_connections 2024-09-21T03:50:51.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.892+0000 7f9af45be740 1 --2- 172.21.15.84:0/2074629071 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56353f0219f0 0x56353f427cd0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.892+0000 7f9af45be740 1 --2- 172.21.15.84:0/2074629071 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f063070 0x56353f421d90 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.892+0000 7f9af45be740 1 --2- 172.21.15.84:0/2074629071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f042390 0x56353f415ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.892+0000 7f9af45be740 1 --2- 172.21.15.84:0/2074629071 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f03a1b0 0x56353f415980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.892+0000 7f9af45be740 1 -- 172.21.15.84:0/2074629071 >> 172.21.15.84:0/2074629071 conn(0x56353f057460 msgr2=0x56353f40d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:51.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.892+0000 7f9ac6ffd640 0 client.17019 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:51.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.892+0000 7f9af45be740 1 -- 172.21.15.84:0/2074629071 shutdown_connections 2024-09-21T03:50:51.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.892+0000 7f9af45be740 1 -- 172.21.15.84:0/2074629071 wait complete. 2024-09-21T03:50:51.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.892+0000 7f9af45be740 20 client.17019 trim_cache size 0 max 16384 2024-09-21T03:50:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.905+0000 7f9af45be740 1 Processor -- start 2024-09-21T03:50:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.905+0000 7f9af45be740 1 -- start start 2024-09-21T03:50:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.905+0000 7f9af45be740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f03a1b0 0x56353f40d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.905+0000 7f9af45be740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f042390 0x56353f40d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.905+0000 7f9af45be740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f063070 0x56353f412b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.905+0000 7f9af45be740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae81b3fe0 con 0x56353f042390 2024-09-21T03:50:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.905+0000 7f9af45be740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae81b18b0 con 0x56353f03a1b0 2024-09-21T03:50:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.905+0000 7f9af45be740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae81af720 con 0x56353f063070 2024-09-21T03:50:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.905+0000 7f9ae6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f042390 0x56353f40d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.905+0000 7f9ae6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f042390 0x56353f40d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54204/0 (socket says 172.21.15.84:54204) 2024-09-21T03:50:51.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.905+0000 7f9ae6ffd640 1 -- 172.21.15.84:0/154799734 learned_addr learned my addr 172.21.15.84:0/154799734 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.905+0000 7f9ae77fe640 1 --2- 172.21.15.84:0/154799734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f03a1b0 0x56353f40d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.905+0000 7f9ae6ffd640 1 -- 172.21.15.84:0/154799734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f063070 msgr2=0x56353f412b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.905+0000 7f9ae6ffd640 1 --2- 172.21.15.84:0/154799734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f063070 0x56353f412b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.906+0000 7f9ae6ffd640 1 -- 172.21.15.84:0/154799734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f03a1b0 msgr2=0x56353f40d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.906+0000 7f9ae6ffd640 1 --2- 172.21.15.84:0/154799734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f03a1b0 0x56353f40d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.906+0000 7f9ae6ffd640 1 -- 172.21.15.84:0/154799734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56353f40d120 con 0x56353f042390 2024-09-21T03:50:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.906+0000 7f9ae6ffd640 1 --2- 172.21.15.84:0/154799734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f042390 0x56353f40d900 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0ad440 tx=0x7f9adc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0fd0ec127edf29 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.906+0000 7f9acd7fa640 1 -- 172.21.15.84:0/154799734 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0ad250 con 0x56353f042390 2024-09-21T03:50:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.906+0000 7f9acd7fa640 1 -- 172.21.15.84:0/154799734 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9adc0ade40 con 0x56353f042390 2024-09-21T03:50:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.906+0000 7f9acd7fa640 1 -- 172.21.15.84:0/154799734 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0a92f0 con 0x56353f042390 2024-09-21T03:50:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.907+0000 7f9af45be740 1 -- 172.21.15.84:0/154799734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f042390 msgr2=0x56353f40d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.907+0000 7f9af45be740 1 --2- 172.21.15.84:0/154799734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f042390 0x56353f40d900 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0ad440 tx=0x7f9adc000bc0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.907+0000 7f9af45be740 1 -- 172.21.15.84:0/154799734 shutdown_connections 2024-09-21T03:50:51.916 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.907+0000 7f9af45be740 1 --2- 172.21.15.84:0/154799734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f063070 0x56353f412b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.907+0000 7f9af45be740 1 --2- 172.21.15.84:0/154799734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f042390 0x56353f40d900 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.907+0000 7f9af45be740 1 --2- 172.21.15.84:0/154799734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f03a1b0 0x56353f40d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.907+0000 7f9af45be740 1 -- 172.21.15.84:0/154799734 >> 172.21.15.84:0/154799734 conn(0x56353f057460 msgr2=0x56353f414200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.907+0000 7f9af45be740 1 -- 172.21.15.84:0/154799734 shutdown_connections 2024-09-21T03:50:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.907+0000 7f9af45be740 1 -- 172.21.15.84:0/154799734 wait complete. 2024-09-21T03:50:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.907+0000 7f9af45be740 1 -- start start 2024-09-21T03:50:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9af45be740 1 Processor -- start 2024-09-21T03:50:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9af45be740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f03a1b0 0x56353f41a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9af45be740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f042390 0x56353f41a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9af45be740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f063070 0x56353f4916d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9af45be740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae81afd70 con 0x56353f03a1b0 2024-09-21T03:50:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9af45be740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae81b11e0 con 0x56353f063070 2024-09-21T03:50:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9af45be740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae81b0440 con 0x56353f042390 2024-09-21T03:50:51.917 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9af45be740 10 client.0 _ll_register_callbacks cb 0x7f9ae0007720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9ae77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f03a1b0 0x56353f41a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9ae77fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f03a1b0 0x56353f41a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54216/0 (socket says 172.21.15.84:54216) 2024-09-21T03:50:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9ae77fe640 1 -- 172.21.15.84:0/277390729 learned_addr learned my addr 172.21.15.84:0/277390729 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9ae7fff640 1 --2- 172.21.15.84:0/277390729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f063070 0x56353f4916d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9ae6ffd640 1 --2- 172.21.15.84:0/277390729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f042390 0x56353f41a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9ae77fe640 1 -- 172.21.15.84:0/277390729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f042390 msgr2=0x56353f41a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9ae77fe640 1 --2- 172.21.15.84:0/277390729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f042390 0x56353f41a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9ae77fe640 1 -- 172.21.15.84:0/277390729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f063070 msgr2=0x56353f4916d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9ae77fe640 1 --2- 172.21.15.84:0/277390729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f063070 0x56353f4916d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9ae77fe640 1 -- 172.21.15.84:0/277390729 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56353f491c10 con 0x56353f03a1b0 2024-09-21T03:50:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9ae6ffd640 1 --2- 172.21.15.84:0/277390729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f042390 0x56353f41a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:50:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9ae77fe640 1 --2- 172.21.15.84:0/277390729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f03a1b0 0x56353f41a3f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80038c0 tx=0x7f9ad8003850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08f598b84459ad5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:51.918 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.908+0000 7f9ac6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.909+0000 7f9ac6ffd640 1 -- 172.21.15.84:0/277390729 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8035040 con 0x56353f03a1b0 2024-09-21T03:50:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.909+0000 7f9ac6ffd640 1 -- 172.21.15.84:0/277390729 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f9ad80318b0 con 0x56353f03a1b0 2024-09-21T03:50:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.909+0000 7f9af45be740 1 -- 172.21.15.84:0/277390729 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9adc0ade40 con 0x56353f03a1b0 2024-09-21T03:50:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.909+0000 7f9ac6ffd640 1 -- 172.21.15.84:0/277390729 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9ad805b050 con 0x56353f03a1b0 2024-09-21T03:50:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.909+0000 7f9af45be740 10 client.17025 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.909+0000 7f9af45be740 1 -- 172.21.15.84:0/277390729 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56353f492ed0 con 0x56353f03a1b0 2024-09-21T03:50:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.909+0000 7f9ac6ffd640 1 -- 172.21.15.84:0/277390729 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9adc0ade40 con 0x56353f03a1b0 2024-09-21T03:50:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.909+0000 7f9ac6ffd640 1 -- 172.21.15.84:0/277390729 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9ad8004be0 con 0x56353f03a1b0 2024-09-21T03:50:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.909+0000 7f9af45be740 10 client.17025 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.909+0000 7f9af45be740 10 client.17025 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:50:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.909+0000 7f9af45be740 20 client.17025 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.909+0000 7f9af45be740 1 --2- 172.21.15.84:0/277390729 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56353eff6da0 0x56353f495220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.909+0000 7f9af45be740 4 client.17025 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:50:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.909+0000 7f9af45be740 1 -- 172.21.15.84:0/277390729 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56353f382df0 con 0x56353eff6da0 2024-09-21T03:50:51.919 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.910+0000 7f9ae6ffd640 1 --2- 172.21.15.84:0/277390729 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56353eff6da0 0x56353f495220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:51.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.910+0000 7f9ac6ffd640 10 client.17025 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:51.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.910+0000 7f9ae6ffd640 1 --2- 172.21.15.84:0/277390729 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56353eff6da0 0x56353f495220 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9f8d139b50046c8 server_cookie=d9a29ecc2047fc58 in_seq=0 out_seq=0 2024-09-21T03:50:51.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.910+0000 7f9ac6ffd640 1 -- 172.21.15.84:0/277390729 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56353f382df0 con 0x56353eff6da0 2024-09-21T03:50:51.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.910+0000 7f9ac6ffd640 10 client.17025 handle_command_reply: tid=0 2024-09-21T03:50:51.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.910+0000 7f9af45be740 1 client.17025 shutdown 2024-09-21T03:50:51.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.910+0000 7f9af45be740 1 -- 172.21.15.84:0/277390729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f03a1b0 msgr2=0x56353f41a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:51.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.910+0000 7f9af45be740 1 --2- 172.21.15.84:0/277390729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f03a1b0 0x56353f41a3f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80038c0 tx=0x7f9ad8003850 comp rx=0 tx=0).stop 2024-09-21T03:50:51.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.910+0000 7f9af45be740 1 -- 172.21.15.84:0/277390729 shutdown_connections 2024-09-21T03:50:51.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.910+0000 7f9af45be740 1 --2- 172.21.15.84:0/277390729 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56353eff6da0 0x56353f495220 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.910+0000 7f9af45be740 1 --2- 172.21.15.84:0/277390729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56353f063070 0x56353f4916d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.910+0000 7f9af45be740 1 --2- 172.21.15.84:0/277390729 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56353f042390 0x56353f41a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.910+0000 7f9ac6ffd640 0 client.17025 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:51.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.910+0000 7f9af45be740 1 --2- 172.21.15.84:0/277390729 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56353f03a1b0 0x56353f41a3f0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.910+0000 7f9af45be740 1 -- 172.21.15.84:0/277390729 >> 172.21.15.84:0/277390729 conn(0x56353f057460 msgr2=0x56353f40d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:51.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.911+0000 7f9af45be740 1 -- 172.21.15.84:0/277390729 shutdown_connections 2024-09-21T03:50:51.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.911+0000 7f9af45be740 1 -- 172.21.15.84:0/277390729 wait complete. 2024-09-21T03:50:51.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.911+0000 7f9af45be740 20 client.17025 trim_cache size 0 max 16384 2024-09-21T03:50:51.921 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:50:51.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.911+0000 7f9aee04a640 1 -- 172.21.15.84:0/1581954428 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9ad00b6680 msgr2=0x7f9ad00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:51.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.911+0000 7f9aee04a640 1 --2- 172.21.15.84:0/1581954428 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9ad00b6680 0x7f9ad00b8b90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0007470 tx=0x7f9ae0007400 comp rx=0 tx=0).stop 2024-09-21T03:50:51.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.911+0000 7f9aee04a640 1 -- 172.21.15.84:0/1581954428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ae8107b60 msgr2=0x7f9ae80ff3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:51.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.911+0000 7f9aee04a640 1 --2- 172.21.15.84:0/1581954428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ae8107b60 0x7f9ae80ff3a0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00c8c0 tx=0x7f9adc00cd80 comp rx=0 tx=0).stop 2024-09-21T03:50:51.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.911+0000 7f9aee04a640 1 -- 172.21.15.84:0/1581954428 shutdown_connections 2024-09-21T03:50:51.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.911+0000 7f9aee04a640 1 --2- 172.21.15.84:0/1581954428 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9ad00b6680 0x7f9ad00b8b90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.911+0000 7f9aee04a640 1 --2- 172.21.15.84:0/1581954428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ae81084b0 0x7f9ae80ff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.911+0000 7f9aee04a640 1 --2- 172.21.15.84:0/1581954428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ae8107b60 0x7f9ae80ff3a0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.911+0000 7f9aee04a640 1 --2- 172.21.15.84:0/1581954428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ae8102220 0x7f9ae80fee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:51.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.911+0000 7f9aee04a640 1 -- 172.21.15.84:0/1581954428 >> 172.21.15.84:0/1581954428 conn(0x7f9ae8079e30 msgr2=0x7f9ae8108b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:51.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.911+0000 7f9aee04a640 1 -- 172.21.15.84:0/1581954428 shutdown_connections 2024-09-21T03:50:51.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:51.911+0000 7f9aee04a640 1 -- 172.21.15.84:0/1581954428 wait complete. 2024-09-21T03:50:52.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:52 smithi084 ceph-mon[30941]: pgmap v580: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 11 op/s 2024-09-21T03:50:52.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:52 smithi174 ceph-mon[34403]: pgmap v580: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 11 op/s 2024-09-21T03:50:52.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:52 smithi172 ceph-mon[34821]: pgmap v580: 97 pgs: 97 active+clean; 15 MiB data, 434 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 11 op/s 2024-09-21T03:50:53.729 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:50:53.729 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:50:53.987 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:50:54.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.475+0000 7fdcdfc2f640 1 -- 172.21.15.84:0/1795152847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd8108cf0 msgr2=0x7fdcd810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:54.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.475+0000 7fdcdfc2f640 1 --2- 172.21.15.84:0/1795152847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd8108cf0 0x7fdcd810f520 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009ca0 tx=0x7fdcd002a8e0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.475+0000 7fdcdfc2f640 1 -- 172.21.15.84:0/1795152847 shutdown_connections 2024-09-21T03:50:54.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.475+0000 7fdcdfc2f640 1 --2- 172.21.15.84:0/1795152847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd8108cf0 0x7fdcd810f520 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.475+0000 7fdcdfc2f640 1 --2- 172.21.15.84:0/1795152847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcd81083a0 0x7fdcd81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.475+0000 7fdcdfc2f640 1 --2- 172.21.15.84:0/1795152847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcd8102a60 0x7fdcd8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.475+0000 7fdcdfc2f640 1 -- 172.21.15.84:0/1795152847 >> 172.21.15.84:0/1795152847 conn(0x7fdcd8079760 msgr2=0x7fdcd8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:54.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.475+0000 7fdcdfc2f640 1 -- 172.21.15.84:0/1795152847 shutdown_connections 2024-09-21T03:50:54.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.475+0000 7fdcdfc2f640 1 -- 172.21.15.84:0/1795152847 wait complete. 2024-09-21T03:50:54.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.476+0000 7fdcdfc2f640 1 Processor -- start 2024-09-21T03:50:54.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.476+0000 7fdcdfc2f640 1 -- start start 2024-09-21T03:50:54.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.477+0000 7fdcdfc2f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcd8102a60 0x7fdcd819b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:54.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.477+0000 7fdcdfc2f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd81083a0 0x7fdcd819b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:54.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.477+0000 7fdcdfc2f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcd8108cf0 0x7fdcd819be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:54.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.477+0000 7fdcdfc2f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd8112a70 con 0x7fdcd81083a0 2024-09-21T03:50:54.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.477+0000 7fdcdfc2f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd81128f0 con 0x7fdcd8108cf0 2024-09-21T03:50:54.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.477+0000 7fdcdfc2f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd8112bf0 con 0x7fdcd8102a60 2024-09-21T03:50:54.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.477+0000 7fdcdd1ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd81083a0 0x7fdcd819b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:54.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.477+0000 7fdcdd1ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd81083a0 0x7fdcd819b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54234/0 (socket says 172.21.15.84:54234) 2024-09-21T03:50:54.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.477+0000 7fdcdd1ca640 1 -- 172.21.15.84:0/2319175449 learned_addr learned my addr 172.21.15.84:0/2319175449 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:54.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.477+0000 7fdcdd9cb640 1 --2- 172.21.15.84:0/2319175449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcd8102a60 0x7fdcd819b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:54.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.477+0000 7fdcde1cc640 1 --2- 172.21.15.84:0/2319175449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcd8108cf0 0x7fdcd819be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:54.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.477+0000 7fdcdd1ca640 1 -- 172.21.15.84:0/2319175449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcd8102a60 msgr2=0x7fdcd819b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:54.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.477+0000 7fdcdd1ca640 1 --2- 172.21.15.84:0/2319175449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcd8102a60 0x7fdcd819b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.477+0000 7fdcdd1ca640 1 -- 172.21.15.84:0/2319175449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcd8108cf0 msgr2=0x7fdcd819be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:54.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.477+0000 7fdcdd1ca640 1 --2- 172.21.15.84:0/2319175449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcd8108cf0 0x7fdcd819be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.477+0000 7fdcdd1ca640 1 -- 172.21.15.84:0/2319175449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd81a66a0 con 0x7fdcd81083a0 2024-09-21T03:50:54.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.477+0000 7fdcdd1ca640 1 --2- 172.21.15.84:0/2319175449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd81083a0 0x7fdcd819b920 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8006fd0 tx=0x7fdcc800b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:54.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.478+0000 7fdcceffd640 1 -- 172.21.15.84:0/2319175449 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8015020 con 0x7fdcd81083a0 2024-09-21T03:50:54.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.478+0000 7fdcceffd640 1 -- 172.21.15.84:0/2319175449 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcc8011ce0 con 0x7fdcd81083a0 2024-09-21T03:50:54.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.478+0000 7fdcdfc2f640 1 -- 172.21.15.84:0/2319175449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcd81a6990 con 0x7fdcd81083a0 2024-09-21T03:50:54.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.478+0000 7fdcceffd640 1 -- 172.21.15.84:0/2319175449 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8010d90 con 0x7fdcd81083a0 2024-09-21T03:50:54.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.478+0000 7fdcdfc2f640 1 -- 172.21.15.84:0/2319175449 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcd81a6f50 con 0x7fdcd81083a0 2024-09-21T03:50:54.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.480+0000 7fdcceffd640 1 -- 172.21.15.84:0/2319175449 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fdcc8018020 con 0x7fdcd81083a0 2024-09-21T03:50:54.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.480+0000 7fdce61a3740 1 Processor -- start 2024-09-21T03:50:54.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.481+0000 7fdce61a3740 1 -- start start 2024-09-21T03:50:54.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.481+0000 7fdce61a3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577072ac350 0x557707653430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:54.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.481+0000 7fdce61a3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557707283490 0x557707653970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:54.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.481+0000 7fdce61a3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55770728b670 0x557707653eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:54.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.481+0000 7fdce61a3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5577075c9e60 con 0x5577072ac350 2024-09-21T03:50:54.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.481+0000 7fdce61a3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5577075b9290 con 0x557707283490 2024-09-21T03:50:54.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.481+0000 7fdce61a3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5577075bd0a0 con 0x55770728b670 2024-09-21T03:50:54.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.481+0000 7fdcde1cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577072ac350 0x557707653430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:54.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.481+0000 7fdcceffd640 1 --2- 172.21.15.84:0/2319175449 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdcc40b6680 0x7fdcc40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:54.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.481+0000 7fdcde1cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577072ac350 0x557707653430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54250/0 (socket says 172.21.15.84:54250) 2024-09-21T03:50:54.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.481+0000 7fdcde1cc640 1 -- 172.21.15.84:0/2668817116 learned_addr learned my addr 172.21.15.84:0/2668817116 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:54.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.481+0000 7fdcdd9cb640 1 --2- 172.21.15.84:0/2668817116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557707283490 0x557707653970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:54.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.481+0000 7fdcceffd640 1 -- 172.21.15.84:0/2319175449 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fdcc80e6dc0 con 0x7fdcd81083a0 2024-09-21T03:50:54.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.481+0000 7fdcde1cc640 1 --2- 172.21.15.84:0/2319175449 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdcc40b6680 0x7fdcc40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:54.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.481+0000 7fdcdd1ca640 1 --2- 172.21.15.84:0/2668817116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55770728b670 0x557707653eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:54.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.481+0000 7fdcde1cc640 1 -- 172.21.15.84:0/2668817116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55770728b670 msgr2=0x557707653eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:54.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.481+0000 7fdcde1cc640 1 --2- 172.21.15.84:0/2668817116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55770728b670 0x557707653eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.481+0000 7fdcde1cc640 1 -- 172.21.15.84:0/2668817116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557707283490 msgr2=0x557707653970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:54.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.481+0000 7fdcde1cc640 1 --2- 172.21.15.84:0/2668817116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557707283490 0x557707653970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.482+0000 7fdcde1cc640 1 -- 172.21.15.84:0/2668817116 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557707317930 con 0x5577072ac350 2024-09-21T03:50:54.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.482+0000 7fdcde1cc640 1 --2- 172.21.15.84:0/2668817116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577072ac350 0x557707653430 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0035000 tx=0x7fdcd0031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4089753afef2444 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:54.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.482+0000 7fdcc3fff640 1 -- 172.21.15.84:0/2668817116 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0004b40 con 0x5577072ac350 2024-09-21T03:50:54.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.482+0000 7fdcde1cc640 1 --2- 172.21.15.84:0/2319175449 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdcc40b6680 0x7fdcc40b8b90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdcd004d000 tx=0x7fdcd004b000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:54.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.482+0000 7fdcc3fff640 1 -- 172.21.15.84:0/2668817116 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcd0036070 con 0x5577072ac350 2024-09-21T03:50:54.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.482+0000 7fdcc3fff640 1 -- 172.21.15.84:0/2668817116 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0030ed0 con 0x5577072ac350 2024-09-21T03:50:54.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.483+0000 7fdce61a3740 1 -- 172.21.15.84:0/2668817116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577072ac350 msgr2=0x557707653430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:54.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.483+0000 7fdce61a3740 1 --2- 172.21.15.84:0/2668817116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577072ac350 0x557707653430 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0035000 tx=0x7fdcd0031ca0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.483+0000 7fdce61a3740 1 -- 172.21.15.84:0/2668817116 shutdown_connections 2024-09-21T03:50:54.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.483+0000 7fdce61a3740 1 --2- 172.21.15.84:0/2668817116 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55770728b670 0x557707653eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.483+0000 7fdce61a3740 1 --2- 172.21.15.84:0/2668817116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557707283490 0x557707653970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.483+0000 7fdce61a3740 1 --2- 172.21.15.84:0/2668817116 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577072ac350 0x557707653430 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.483+0000 7fdce61a3740 1 -- 172.21.15.84:0/2668817116 >> 172.21.15.84:0/2668817116 conn(0x5577072a0740 msgr2=0x557707651320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:54.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.483+0000 7fdce61a3740 1 -- 172.21.15.84:0/2668817116 shutdown_connections 2024-09-21T03:50:54.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.483+0000 7fdce61a3740 1 -- 172.21.15.84:0/2668817116 wait complete. 2024-09-21T03:50:54.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.483+0000 7fdce61a3740 1 -- start start 2024-09-21T03:50:54.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.484+0000 7fdce61a3740 1 Processor -- start 2024-09-21T03:50:54.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.484+0000 7fdce61a3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557707283490 0x5577076633d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:54.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.484+0000 7fdce61a3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55770728b670 0x557707663910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:54.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.484+0000 7fdce61a3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577072ac350 0x55770766f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:54.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.484+0000 7fdce61a3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55770741a890 con 0x5577072ac350 2024-09-21T03:50:54.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.484+0000 7fdce61a3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557707553d40 con 0x55770728b670 2024-09-21T03:50:54.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.484+0000 7fdce61a3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557707665f70 con 0x557707283490 2024-09-21T03:50:54.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.484+0000 7fdce61a3740 10 client.0 _ll_register_callbacks cb 0x5577075b7c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:54.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.484+0000 7fdcde1cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577072ac350 0x55770766f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:54.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.484+0000 7fdcde1cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577072ac350 0x55770766f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54266/0 (socket says 172.21.15.84:54266) 2024-09-21T03:50:54.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.484+0000 7fdcde1cc640 1 -- 172.21.15.84:0/2799435466 learned_addr learned my addr 172.21.15.84:0/2799435466 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:54.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.484+0000 7fdcdd9cb640 1 --2- 172.21.15.84:0/2799435466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557707283490 0x5577076633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:54.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.484+0000 7fdcdd1ca640 1 --2- 172.21.15.84:0/2799435466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55770728b670 0x557707663910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:54.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.484+0000 7fdcde1cc640 1 -- 172.21.15.84:0/2799435466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557707283490 msgr2=0x5577076633d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:54.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.484+0000 7fdcde1cc640 1 --2- 172.21.15.84:0/2799435466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557707283490 0x5577076633d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.484+0000 7fdcde1cc640 1 -- 172.21.15.84:0/2799435466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55770728b670 msgr2=0x557707663910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:54.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.484+0000 7fdcde1cc640 1 --2- 172.21.15.84:0/2799435466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55770728b670 0x557707663910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.485+0000 7fdcde1cc640 1 -- 172.21.15.84:0/2799435466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55770766f8c0 con 0x5577072ac350 2024-09-21T03:50:54.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.485+0000 7fdcdd1ca640 1 --2- 172.21.15.84:0/2799435466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55770728b670 0x557707663910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:50:54.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.485+0000 7fdcde1cc640 1 --2- 172.21.15.84:0/2799435466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577072ac350 0x55770766f350 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fdcd002ae00 tx=0x7fdcd0005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3269896a94077ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:54.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.485+0000 7fdcc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:54.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.485+0000 7fdcc17fa640 1 -- 172.21.15.84:0/2799435466 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0060060 con 0x5577072ac350 2024-09-21T03:50:54.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.485+0000 7fdcc17fa640 1 -- 172.21.15.84:0/2799435466 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fdcd0004410 con 0x5577072ac350 2024-09-21T03:50:54.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.485+0000 7fdce61a3740 1 -- 172.21.15.84:0/2799435466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcd0036070 con 0x5577072ac350 2024-09-21T03:50:54.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.485+0000 7fdcc17fa640 1 -- 172.21.15.84:0/2799435466 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdcd0004610 con 0x5577072ac350 2024-09-21T03:50:54.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.485+0000 7fdce61a3740 10 client.17037 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:54.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.485+0000 7fdce61a3740 1 -- 172.21.15.84:0/2799435466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5577076721f0 con 0x5577072ac350 2024-09-21T03:50:54.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.485+0000 7fdcc17fa640 1 -- 172.21.15.84:0/2799435466 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcd0036070 con 0x5577072ac350 2024-09-21T03:50:54.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.485+0000 7fdcc17fa640 1 -- 172.21.15.84:0/2799435466 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdcd0049cb0 con 0x5577072ac350 2024-09-21T03:50:54.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.485+0000 7fdce61a3740 10 client.17037 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:54.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.485+0000 7fdce61a3740 10 client.17037 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:50:54.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.485+0000 7fdce61a3740 20 client.17037 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:54.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.485+0000 7fdce61a3740 1 --2- 172.21.15.84:0/2799435466 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55770726acd0 0x557707675550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:54.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.485+0000 7fdce61a3740 4 client.17037 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:50:54.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.486+0000 7fdce61a3740 1 -- 172.21.15.84:0/2799435466 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577075cbdb0 con 0x55770726acd0 2024-09-21T03:50:54.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.486+0000 7fdcdd9cb640 1 --2- 172.21.15.84:0/2799435466 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55770726acd0 0x557707675550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:54.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.486+0000 7fdcc17fa640 10 client.17037 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:54.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.486+0000 7fdcdd9cb640 1 --2- 172.21.15.84:0/2799435466 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55770726acd0 0x557707675550 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13f21b28a7e1e951 server_cookie=f9c2250f0b1935a9 in_seq=0 out_seq=0 2024-09-21T03:50:54.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.487+0000 7fdcc17fa640 1 -- 172.21.15.84:0/2799435466 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5577075cbdb0 con 0x55770726acd0 2024-09-21T03:50:54.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.487+0000 7fdcc17fa640 10 client.17037 handle_command_reply: tid=0 2024-09-21T03:50:54.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.487+0000 7fdce61a3740 1 client.17037 shutdown 2024-09-21T03:50:54.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.487+0000 7fdce61a3740 1 -- 172.21.15.84:0/2799435466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577072ac350 msgr2=0x55770766f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:54.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.487+0000 7fdce61a3740 1 --2- 172.21.15.84:0/2799435466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577072ac350 0x55770766f350 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fdcd002ae00 tx=0x7fdcd0005b50 comp rx=0 tx=0).stop 2024-09-21T03:50:54.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.487+0000 7fdce61a3740 1 -- 172.21.15.84:0/2799435466 shutdown_connections 2024-09-21T03:50:54.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.487+0000 7fdce61a3740 1 --2- 172.21.15.84:0/2799435466 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55770726acd0 0x557707675550 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.487+0000 7fdce61a3740 1 --2- 172.21.15.84:0/2799435466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577072ac350 0x55770766f350 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.487+0000 7fdce61a3740 1 --2- 172.21.15.84:0/2799435466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55770728b670 0x557707663910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.487+0000 7fdcc17fa640 0 client.17037 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:54.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.487+0000 7fdce61a3740 1 --2- 172.21.15.84:0/2799435466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557707283490 0x5577076633d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.487+0000 7fdce61a3740 1 -- 172.21.15.84:0/2799435466 >> 172.21.15.84:0/2799435466 conn(0x5577072a0740 msgr2=0x55770764f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:54.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.487+0000 7fdce61a3740 1 -- 172.21.15.84:0/2799435466 shutdown_connections 2024-09-21T03:50:54.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.487+0000 7fdce61a3740 1 -- 172.21.15.84:0/2799435466 wait complete. 2024-09-21T03:50:54.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.487+0000 7fdce61a3740 20 client.17037 trim_cache size 0 max 16384 2024-09-21T03:50:54.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.505+0000 7fdce61a3740 1 Processor -- start 2024-09-21T03:50:54.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.505+0000 7fdce61a3740 1 -- start start 2024-09-21T03:50:54.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.505+0000 7fdce61a3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557707283490 0x55770764f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:54.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.505+0000 7fdce61a3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55770728b670 0x55770764fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:54.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.505+0000 7fdce61a3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577072ac350 0x5577076603c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:54.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.505+0000 7fdce61a3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd81afdc0 con 0x55770728b670 2024-09-21T03:50:54.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.505+0000 7fdce61a3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd81ad690 con 0x5577072ac350 2024-09-21T03:50:54.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.505+0000 7fdce61a3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd81ab500 con 0x557707283490 2024-09-21T03:50:54.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.505+0000 7fdcdd1ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55770728b670 0x55770764fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:54.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.505+0000 7fdcdd1ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55770728b670 0x55770764fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54276/0 (socket says 172.21.15.84:54276) 2024-09-21T03:50:54.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.505+0000 7fdcdd1ca640 1 -- 172.21.15.84:0/3736454781 learned_addr learned my addr 172.21.15.84:0/3736454781 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:54.508 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.505+0000 7fdcde1cc640 1 --2- 172.21.15.84:0/3736454781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577072ac350 0x5577076603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:54.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.505+0000 7fdcdd9cb640 1 --2- 172.21.15.84:0/3736454781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557707283490 0x55770764f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:54.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.505+0000 7fdcdd1ca640 1 -- 172.21.15.84:0/3736454781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557707283490 msgr2=0x55770764f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:54.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.505+0000 7fdcdd1ca640 1 --2- 172.21.15.84:0/3736454781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557707283490 0x55770764f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.505+0000 7fdcdd1ca640 1 -- 172.21.15.84:0/3736454781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577072ac350 msgr2=0x5577076603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:54.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.505+0000 7fdcdd1ca640 1 --2- 172.21.15.84:0/3736454781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577072ac350 0x5577076603c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.505+0000 7fdcdd1ca640 1 -- 172.21.15.84:0/3736454781 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55770765ed10 con 0x55770728b670 2024-09-21T03:50:54.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.505+0000 7fdcde1cc640 1 --2- 172.21.15.84:0/3736454781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577072ac350 0x5577076603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:50:54.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.506+0000 7fdcdd1ca640 1 --2- 172.21.15.84:0/3736454781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55770728b670 0x55770764fd90 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fdcc80e4610 tx=0x7fdcc80047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1db2b97d0acc9b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:54.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.506+0000 7fdcc37fe640 1 -- 172.21.15.84:0/3736454781 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc80a83d0 con 0x55770728b670 2024-09-21T03:50:54.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.506+0000 7fdcc37fe640 1 -- 172.21.15.84:0/3736454781 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcc80ac770 con 0x55770728b670 2024-09-21T03:50:54.509 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.506+0000 7fdcc37fe640 1 -- 172.21.15.84:0/3736454781 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc80ac100 con 0x55770728b670 2024-09-21T03:50:54.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.507+0000 7fdce61a3740 1 -- 172.21.15.84:0/3736454781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55770728b670 msgr2=0x55770764fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:54.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.507+0000 7fdce61a3740 1 --2- 172.21.15.84:0/3736454781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55770728b670 0x55770764fd90 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fdcc80e4610 tx=0x7fdcc80047d0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.507+0000 7fdce61a3740 1 -- 172.21.15.84:0/3736454781 shutdown_connections 2024-09-21T03:50:54.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.507+0000 7fdce61a3740 1 --2- 172.21.15.84:0/3736454781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577072ac350 0x5577076603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.507+0000 7fdce61a3740 1 --2- 172.21.15.84:0/3736454781 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55770728b670 0x55770764fd90 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.507+0000 7fdce61a3740 1 --2- 172.21.15.84:0/3736454781 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557707283490 0x55770764f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.507+0000 7fdce61a3740 1 -- 172.21.15.84:0/3736454781 >> 172.21.15.84:0/3736454781 conn(0x5577072a0740 msgr2=0x557707661a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:54.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.507+0000 7fdce61a3740 1 -- 172.21.15.84:0/3736454781 shutdown_connections 2024-09-21T03:50:54.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.507+0000 7fdce61a3740 1 -- 172.21.15.84:0/3736454781 wait complete. 2024-09-21T03:50:54.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.507+0000 7fdce61a3740 1 -- start start 2024-09-21T03:50:54.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.507+0000 7fdce61a3740 1 Processor -- start 2024-09-21T03:50:54.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdce61a3740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557707283490 0x557707674e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:54.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdce61a3740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55770728b670 0x5577076753d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:54.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdce61a3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577072ac350 0x5577076d8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:54.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdce61a3740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd81abb50 con 0x55770728b670 2024-09-21T03:50:54.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdce61a3740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd81acfc0 con 0x557707283490 2024-09-21T03:50:54.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdce61a3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd81ac220 con 0x5577072ac350 2024-09-21T03:50:54.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdce61a3740 10 client.0 _ll_register_callbacks cb 0x7fdcd40093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:54.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdcdd1ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55770728b670 0x5577076753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:54.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdcdd1ca640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55770728b670 0x5577076753d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54280/0 (socket says 172.21.15.84:54280) 2024-09-21T03:50:54.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdcdd1ca640 1 -- 172.21.15.84:0/1416246332 learned_addr learned my addr 172.21.15.84:0/1416246332 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:54.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdcdd9cb640 1 --2- 172.21.15.84:0/1416246332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557707283490 0x557707674e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:54.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdcde1cc640 1 --2- 172.21.15.84:0/1416246332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577072ac350 0x5577076d8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:54.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdcdd1ca640 1 -- 172.21.15.84:0/1416246332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577072ac350 msgr2=0x5577076d8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:54.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdcdd1ca640 1 --2- 172.21.15.84:0/1416246332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577072ac350 0x5577076d8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdcdd1ca640 1 -- 172.21.15.84:0/1416246332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557707283490 msgr2=0x557707674e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:54.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdcdd1ca640 1 --2- 172.21.15.84:0/1416246332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557707283490 0x557707674e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdcdd1ca640 1 -- 172.21.15.84:0/1416246332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577076d9300 con 0x55770728b670 2024-09-21T03:50:54.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdcde1cc640 1 --2- 172.21.15.84:0/1416246332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577072ac350 0x5577076d8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:54.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdcdd1ca640 1 --2- 172.21.15.84:0/1416246332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55770728b670 0x5577076753d0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8011040 tx=0x7fdcc80e4550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb553c9dc4ab2d05 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:54.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdcc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:54.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdcc17fa640 1 -- 172.21.15.84:0/1416246332 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc80d4040 con 0x55770728b670 2024-09-21T03:50:54.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdcc17fa640 1 -- 172.21.15.84:0/1416246332 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fdcc80abec0 con 0x55770728b670 2024-09-21T03:50:54.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.508+0000 7fdce61a3740 1 -- 172.21.15.84:0/1416246332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcc80ac770 con 0x55770728b670 2024-09-21T03:50:54.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.509+0000 7fdcc17fa640 1 -- 172.21.15.84:0/1416246332 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdcc80a83d0 con 0x55770728b670 2024-09-21T03:50:54.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.509+0000 7fdce61a3740 10 client.17043 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:54.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.509+0000 7fdce61a3740 1 -- 172.21.15.84:0/1416246332 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5577076e0640 con 0x55770728b670 2024-09-21T03:50:54.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.509+0000 7fdcc17fa640 1 -- 172.21.15.84:0/1416246332 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcc80ac770 con 0x55770728b670 2024-09-21T03:50:54.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.509+0000 7fdcc17fa640 1 -- 172.21.15.84:0/1416246332 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdcc80ab930 con 0x55770728b670 2024-09-21T03:50:54.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.509+0000 7fdce61a3740 10 client.17043 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:54.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.509+0000 7fdce61a3740 10 client.17043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:50:54.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.509+0000 7fdce61a3740 20 client.17043 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:54.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.509+0000 7fdce61a3740 1 --2- 172.21.15.84:0/1416246332 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x557707240080 0x5577076e2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:54.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.509+0000 7fdce61a3740 4 client.17043 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:50:54.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.509+0000 7fdce61a3740 1 -- 172.21.15.84:0/1416246332 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5577075c7860 con 0x557707240080 2024-09-21T03:50:54.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.509+0000 7fdcdd9cb640 1 --2- 172.21.15.84:0/1416246332 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x557707240080 0x5577076e2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:54.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.510+0000 7fdcdd9cb640 1 --2- 172.21.15.84:0/1416246332 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x557707240080 0x5577076e2d80 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=639a2966adc1198a server_cookie=14dab505f1dabcc7 in_seq=0 out_seq=0 2024-09-21T03:50:54.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.510+0000 7fdcc17fa640 10 client.17043 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:54.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.511+0000 7fdcc17fa640 1 -- 172.21.15.84:0/1416246332 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5577075c7860 con 0x557707240080 2024-09-21T03:50:54.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.511+0000 7fdcc17fa640 10 client.17043 handle_command_reply: tid=0 2024-09-21T03:50:54.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.511+0000 7fdce61a3740 1 client.17043 shutdown 2024-09-21T03:50:54.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.511+0000 7fdce61a3740 1 -- 172.21.15.84:0/1416246332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55770728b670 msgr2=0x5577076753d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:54.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.511+0000 7fdce61a3740 1 --2- 172.21.15.84:0/1416246332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55770728b670 0x5577076753d0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8011040 tx=0x7fdcc80e4550 comp rx=0 tx=0).stop 2024-09-21T03:50:54.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.512+0000 7fdce61a3740 1 -- 172.21.15.84:0/1416246332 shutdown_connections 2024-09-21T03:50:54.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.512+0000 7fdce61a3740 1 --2- 172.21.15.84:0/1416246332 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x557707240080 0x5577076e2d80 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.512+0000 7fdce61a3740 1 --2- 172.21.15.84:0/1416246332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5577072ac350 0x5577076d8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.512+0000 7fdce61a3740 1 --2- 172.21.15.84:0/1416246332 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55770728b670 0x5577076753d0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.512+0000 7fdce61a3740 1 --2- 172.21.15.84:0/1416246332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557707283490 0x557707674e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.512+0000 7fdce61a3740 1 -- 172.21.15.84:0/1416246332 >> 172.21.15.84:0/1416246332 conn(0x5577072a0740 msgr2=0x55770764f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:54.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.512+0000 7fdcc17fa640 0 client.17043 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:54.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.512+0000 7fdce61a3740 1 -- 172.21.15.84:0/1416246332 shutdown_connections 2024-09-21T03:50:54.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.512+0000 7fdce61a3740 1 -- 172.21.15.84:0/1416246332 wait complete. 2024-09-21T03:50:54.517 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.512+0000 7fdce61a3740 20 client.17043 trim_cache size 0 max 16384 2024-09-21T03:50:54.517 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:50:54.517 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T03:50:54.517 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "0bb4e83d-6059-4d41-88f0-1562fa422c47", 2024-09-21T03:50:54.517 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T03:50:54.517 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:50:54.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.512+0000 7fdcdfc2f640 1 -- 172.21.15.84:0/2319175449 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdcc40b6680 msgr2=0x7fdcc40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:54.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.512+0000 7fdcdfc2f640 1 --2- 172.21.15.84:0/2319175449 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdcc40b6680 0x7fdcc40b8b90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdcd004d000 tx=0x7fdcd004b000 comp rx=0 tx=0).stop 2024-09-21T03:50:54.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.512+0000 7fdcdfc2f640 1 -- 172.21.15.84:0/2319175449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd81083a0 msgr2=0x7fdcd819b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:54.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.512+0000 7fdcdfc2f640 1 --2- 172.21.15.84:0/2319175449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd81083a0 0x7fdcd819b920 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8006fd0 tx=0x7fdcc800b820 comp rx=0 tx=0).stop 2024-09-21T03:50:54.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.513+0000 7fdcdfc2f640 1 -- 172.21.15.84:0/2319175449 shutdown_connections 2024-09-21T03:50:54.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.513+0000 7fdcdfc2f640 1 --2- 172.21.15.84:0/2319175449 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fdcc40b6680 0x7fdcc40b8b90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.513+0000 7fdcdfc2f640 1 --2- 172.21.15.84:0/2319175449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcd8108cf0 0x7fdcd819be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.513+0000 7fdcdfc2f640 1 --2- 172.21.15.84:0/2319175449 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fdcd81083a0 0x7fdcd819b920 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.513+0000 7fdcdfc2f640 1 --2- 172.21.15.84:0/2319175449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcd8102a60 0x7fdcd819b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:54.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.513+0000 7fdcdfc2f640 1 -- 172.21.15.84:0/2319175449 >> 172.21.15.84:0/2319175449 conn(0x7fdcd8079760 msgr2=0x7fdcd8106490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:54.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.513+0000 7fdcdfc2f640 1 -- 172.21.15.84:0/2319175449 shutdown_connections 2024-09-21T03:50:54.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:54.513+0000 7fdcdfc2f640 1 -- 172.21.15.84:0/2319175449 wait complete. 2024-09-21T03:50:54.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:54 smithi084 ceph-mon[30941]: pgmap v581: 97 pgs: 97 active+clean; 15 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 12 op/s 2024-09-21T03:50:54.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:54 smithi174 ceph-mon[34403]: pgmap v581: 97 pgs: 97 active+clean; 15 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 12 op/s 2024-09-21T03:50:54.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:54 smithi172 ceph-mon[34821]: pgmap v581: 97 pgs: 97 active+clean; 15 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 12 op/s 2024-09-21T03:50:55.076 INFO:tasks.workunit.client.0.smithi084.stdout:375/600: open fd = 3 2024-09-21T03:50:55.076 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.077 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.077 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.077 INFO:tasks.workunit.client.0.smithi084.stdout:376/600: open fd = 3 2024-09-21T03:50:55.077 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.077 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.077 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.077 INFO:tasks.workunit.client.0.smithi084.stdout:377/600: open fd = 3 2024-09-21T03:50:55.077 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.077 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.077 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.077 INFO:tasks.workunit.client.0.smithi084.stdout:378/600: open fd = 3 2024-09-21T03:50:55.077 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.077 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.077 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.078 INFO:tasks.workunit.client.0.smithi084.stdout:379/600: open fd = 3 2024-09-21T03:50:55.078 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.078 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.078 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.078 INFO:tasks.workunit.client.0.smithi084.stdout:380/600: open fd = 3 2024-09-21T03:50:55.078 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.078 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.078 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.078 INFO:tasks.workunit.client.0.smithi084.stdout:381/600: open fd = 3 2024-09-21T03:50:55.078 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.078 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.078 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.078 INFO:tasks.workunit.client.0.smithi084.stdout:382/600: open fd = 3 2024-09-21T03:50:55.078 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.078 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.079 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.079 INFO:tasks.workunit.client.0.smithi084.stdout:383/600: open fd = 3 2024-09-21T03:50:55.079 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.079 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.079 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.079 INFO:tasks.workunit.client.0.smithi084.stdout:384/600: open fd = 3 2024-09-21T03:50:55.079 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.079 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.079 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.079 INFO:tasks.workunit.client.0.smithi084.stdout:385/600: open fd = 3 2024-09-21T03:50:55.079 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.079 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.079 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.079 INFO:tasks.workunit.client.0.smithi084.stdout:386/600: open fd = 3 2024-09-21T03:50:55.079 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.080 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.080 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.080 INFO:tasks.workunit.client.0.smithi084.stdout:387/600: open fd = 3 2024-09-21T03:50:55.080 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.080 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.080 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.080 INFO:tasks.workunit.client.0.smithi084.stdout:388/600: open fd = 3 2024-09-21T03:50:55.080 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.080 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.080 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.080 INFO:tasks.workunit.client.0.smithi084.stdout:389/600: open fd = 3 2024-09-21T03:50:55.080 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.080 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.080 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.080 INFO:tasks.workunit.client.0.smithi084.stdout:390/600: open fd = 3 2024-09-21T03:50:55.081 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.081 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.081 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.081 INFO:tasks.workunit.client.0.smithi084.stdout:391/600: open fd = 3 2024-09-21T03:50:55.081 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.081 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.081 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.081 INFO:tasks.workunit.client.0.smithi084.stdout:392/600: open fd = 3 2024-09-21T03:50:55.081 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.081 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.081 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.081 INFO:tasks.workunit.client.0.smithi084.stdout:393/600: open fd = 3 2024-09-21T03:50:55.081 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.081 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.081 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.082 INFO:tasks.workunit.client.0.smithi084.stdout:394/600: open fd = 3 2024-09-21T03:50:55.082 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.082 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.082 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.082 INFO:tasks.workunit.client.0.smithi084.stdout:395/600: open fd = 3 2024-09-21T03:50:55.082 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.082 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.082 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.082 INFO:tasks.workunit.client.0.smithi084.stdout:396/600: open fd = 3 2024-09-21T03:50:55.082 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.082 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.082 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.082 INFO:tasks.workunit.client.0.smithi084.stdout:397/600: open fd = 3 2024-09-21T03:50:55.082 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.083 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.083 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.083 INFO:tasks.workunit.client.0.smithi084.stdout:398/600: open fd = 3 2024-09-21T03:50:55.083 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.083 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.083 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.083 INFO:tasks.workunit.client.0.smithi084.stdout:399/600: open fd = 3 2024-09-21T03:50:55.083 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.083 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.083 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.083 INFO:tasks.workunit.client.0.smithi084.stdout:400/600: open fd = 3 2024-09-21T03:50:55.083 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.083 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.083 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.083 INFO:tasks.workunit.client.0.smithi084.stdout:401/600: open fd = 3 2024-09-21T03:50:55.084 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.084 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.084 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.084 INFO:tasks.workunit.client.0.smithi084.stdout:402/600: open fd = 3 2024-09-21T03:50:55.084 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.084 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.084 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.084 INFO:tasks.workunit.client.0.smithi084.stdout:403/600: open fd = 3 2024-09-21T03:50:55.084 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.084 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.084 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.084 INFO:tasks.workunit.client.0.smithi084.stdout:404/600: open fd = 3 2024-09-21T03:50:55.084 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.084 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.085 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.085 INFO:tasks.workunit.client.0.smithi084.stdout:405/600: open fd = 3 2024-09-21T03:50:55.085 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.085 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.085 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.085 INFO:tasks.workunit.client.0.smithi084.stdout:406/600: open fd = 3 2024-09-21T03:50:55.085 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.085 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.085 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.085 INFO:tasks.workunit.client.0.smithi084.stdout:407/600: open fd = 3 2024-09-21T03:50:55.085 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.085 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.085 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.085 INFO:tasks.workunit.client.0.smithi084.stdout:408/600: open fd = 3 2024-09-21T03:50:55.085 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.085 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.086 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.086 INFO:tasks.workunit.client.0.smithi084.stdout:409/600: open fd = 3 2024-09-21T03:50:55.086 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.086 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.086 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.086 INFO:tasks.workunit.client.0.smithi084.stdout:410/600: open fd = 3 2024-09-21T03:50:55.086 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.086 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.086 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.086 INFO:tasks.workunit.client.0.smithi084.stdout:411/600: open fd = 3 2024-09-21T03:50:55.086 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.086 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.086 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.086 INFO:tasks.workunit.client.0.smithi084.stdout:412/600: open fd = 3 2024-09-21T03:50:55.086 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.087 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.087 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.087 INFO:tasks.workunit.client.0.smithi084.stdout:413/600: open fd = 3 2024-09-21T03:50:55.087 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.087 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.087 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.087 INFO:tasks.workunit.client.0.smithi084.stdout:414/600: open fd = 3 2024-09-21T03:50:55.087 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.087 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.087 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.087 INFO:tasks.workunit.client.0.smithi084.stdout:415/600: open fd = 3 2024-09-21T03:50:55.087 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.087 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.087 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.088 INFO:tasks.workunit.client.0.smithi084.stdout:416/600: open fd = 3 2024-09-21T03:50:55.088 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.088 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.088 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.088 INFO:tasks.workunit.client.0.smithi084.stdout:417/600: open fd = 3 2024-09-21T03:50:55.088 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.088 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.088 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.088 INFO:tasks.workunit.client.0.smithi084.stdout:418/600: open fd = 3 2024-09-21T03:50:55.088 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.088 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.088 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.088 INFO:tasks.workunit.client.0.smithi084.stdout:419/600: open fd = 3 2024-09-21T03:50:55.088 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.088 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.089 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.089 INFO:tasks.workunit.client.0.smithi084.stdout:420/600: open fd = 3 2024-09-21T03:50:55.089 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.089 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.089 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.089 INFO:tasks.workunit.client.0.smithi084.stdout:421/600: open fd = 3 2024-09-21T03:50:55.089 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.089 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.089 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.089 INFO:tasks.workunit.client.0.smithi084.stdout:422/600: open fd = 3 2024-09-21T03:50:55.089 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.089 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.089 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.089 INFO:tasks.workunit.client.0.smithi084.stdout:423/600: open fd = 3 2024-09-21T03:50:55.089 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.090 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.090 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.090 INFO:tasks.workunit.client.0.smithi084.stdout:424/600: open fd = 3 2024-09-21T03:50:55.090 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.090 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.090 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.090 INFO:tasks.workunit.client.0.smithi084.stdout:425/600: open fd = 3 2024-09-21T03:50:55.090 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.090 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.090 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.090 INFO:tasks.workunit.client.0.smithi084.stdout:426/600: open fd = 3 2024-09-21T03:50:55.090 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.090 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.090 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.091 INFO:tasks.workunit.client.0.smithi084.stdout:427/600: open fd = 3 2024-09-21T03:50:55.091 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.091 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.091 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.091 INFO:tasks.workunit.client.0.smithi084.stdout:428/600: open fd = 3 2024-09-21T03:50:55.091 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.091 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.091 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.091 INFO:tasks.workunit.client.0.smithi084.stdout:429/600: open fd = 3 2024-09-21T03:50:55.091 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.091 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.091 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.091 INFO:tasks.workunit.client.0.smithi084.stdout:430/600: open fd = 3 2024-09-21T03:50:55.091 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.091 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.092 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.092 INFO:tasks.workunit.client.0.smithi084.stdout:431/600: open fd = 3 2024-09-21T03:50:55.092 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.092 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.092 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.092 INFO:tasks.workunit.client.0.smithi084.stdout:432/600: open fd = 3 2024-09-21T03:50:55.092 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.092 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.092 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.092 INFO:tasks.workunit.client.0.smithi084.stdout:433/600: open fd = 3 2024-09-21T03:50:55.092 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.092 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.092 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.092 INFO:tasks.workunit.client.0.smithi084.stdout:434/600: open fd = 3 2024-09-21T03:50:55.092 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.093 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.093 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.093 INFO:tasks.workunit.client.0.smithi084.stdout:435/600: open fd = 3 2024-09-21T03:50:55.093 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.093 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.093 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.093 INFO:tasks.workunit.client.0.smithi084.stdout:436/600: open fd = 3 2024-09-21T03:50:55.093 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.093 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:50:55.093 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:50:55.293 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:50:55.535 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:50:55.801 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:55 smithi084 ceph-mon[30941]: scrub queued for path: / 2024-09-21T03:50:55.801 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:55 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:50:55.801 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:55 smithi084 ceph-mon[30941]: scrub summary: active paths [/] 2024-09-21T03:50:55.801 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:55 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:50:55.801 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:55 smithi084 ceph-mon[30941]: scrub summary: idle 2024-09-21T03:50:55.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:55 smithi174 ceph-mon[34403]: scrub queued for path: / 2024-09-21T03:50:55.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:55 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:50:55.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:55 smithi174 ceph-mon[34403]: scrub summary: active paths [/] 2024-09-21T03:50:55.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:55 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:50:55.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:55 smithi174 ceph-mon[34403]: scrub summary: idle 2024-09-21T03:50:55.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:55 smithi172 ceph-mon[34821]: scrub queued for path: / 2024-09-21T03:50:55.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:55 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:50:55.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:55 smithi172 ceph-mon[34821]: scrub summary: active paths [/] 2024-09-21T03:50:55.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:55 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:50:55.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:55 smithi172 ceph-mon[34821]: scrub summary: idle 2024-09-21T03:50:56.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.041+0000 7fc92af9e640 1 -- 172.21.15.84:0/1360156109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc92410de30 msgr2=0x7fc924110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:56.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.041+0000 7fc92af9e640 1 --2- 172.21.15.84:0/1360156109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc92410de30 0x7fc924110300 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fc91c009ca0 tx=0x7fc91c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.041+0000 7fc92af9e640 1 -- 172.21.15.84:0/1360156109 shutdown_connections 2024-09-21T03:50:56.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.041+0000 7fc92af9e640 1 --2- 172.21.15.84:0/1360156109 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc92410de30 0x7fc924110300 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.041+0000 7fc92af9e640 1 --2- 172.21.15.84:0/1360156109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9241052b0 0x7fc92410d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.051 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.041+0000 7fc92af9e640 1 --2- 172.21.15.84:0/1360156109 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc924104880 0x7fc924104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.041+0000 7fc92af9e640 1 -- 172.21.15.84:0/1360156109 >> 172.21.15.84:0/1360156109 conn(0x7fc924079730 msgr2=0x7fc924079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:56.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.041+0000 7fc92af9e640 1 -- 172.21.15.84:0/1360156109 shutdown_connections 2024-09-21T03:50:56.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.041+0000 7fc92af9e640 1 -- 172.21.15.84:0/1360156109 wait complete. 2024-09-21T03:50:56.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.042+0000 7fc92af9e640 1 Processor -- start 2024-09-21T03:50:56.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.042+0000 7fc92af9e640 1 -- start start 2024-09-21T03:50:56.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.042+0000 7fc92af9e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc924104880 0x7fc92419a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:56.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.042+0000 7fc92af9e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9241052b0 0x7fc92419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:56.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.042+0000 7fc92af9e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc92410de30 0x7fc92419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:56.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.042+0000 7fc92af9e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc924113a70 con 0x7fc92410de30 2024-09-21T03:50:56.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.042+0000 7fc92af9e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc9241138f0 con 0x7fc9241052b0 2024-09-21T03:50:56.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.042+0000 7fc92af9e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc924113bf0 con 0x7fc924104880 2024-09-21T03:50:56.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.043+0000 7fc92953b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc92410de30 0x7fc92419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:56.052 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.043+0000 7fc92953b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc92410de30 0x7fc92419fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54286/0 (socket says 172.21.15.84:54286) 2024-09-21T03:50:56.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.043+0000 7fc92953b640 1 -- 172.21.15.84:0/3575193466 learned_addr learned my addr 172.21.15.84:0/3575193466 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:56.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.043+0000 7fc928d3a640 1 --2- 172.21.15.84:0/3575193466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc924104880 0x7fc92419a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:56.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.043+0000 7fc923fff640 1 --2- 172.21.15.84:0/3575193466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9241052b0 0x7fc92419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:56.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.043+0000 7fc92953b640 1 -- 172.21.15.84:0/3575193466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc924104880 msgr2=0x7fc92419a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:56.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.043+0000 7fc92953b640 1 --2- 172.21.15.84:0/3575193466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc924104880 0x7fc92419a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.043+0000 7fc92953b640 1 -- 172.21.15.84:0/3575193466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9241052b0 msgr2=0x7fc92419a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:56.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.043+0000 7fc92953b640 1 --2- 172.21.15.84:0/3575193466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9241052b0 0x7fc92419a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.043+0000 7fc92953b640 1 -- 172.21.15.84:0/3575193466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9241a0370 con 0x7fc92410de30 2024-09-21T03:50:56.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.043+0000 7fc923fff640 1 --2- 172.21.15.84:0/3575193466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9241052b0 0x7fc92419a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:50:56.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.043+0000 7fc92953b640 1 --2- 172.21.15.84:0/3575193466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc92410de30 0x7fc92419fc40 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fc91c005cc0 tx=0x7fc91c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:56.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.043+0000 7fc921ffb640 1 -- 172.21.15.84:0/3575193466 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c003bf0 con 0x7fc92410de30 2024-09-21T03:50:56.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.043+0000 7fc921ffb640 1 -- 172.21.15.84:0/3575193466 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc91c003d90 con 0x7fc92410de30 2024-09-21T03:50:56.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.043+0000 7fc92af9e640 1 -- 172.21.15.84:0/3575193466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9241a0600 con 0x7fc92410de30 2024-09-21T03:50:56.053 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.043+0000 7fc921ffb640 1 -- 172.21.15.84:0/3575193466 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c02fbc0 con 0x7fc92410de30 2024-09-21T03:50:56.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.044+0000 7fc92af9e640 1 -- 172.21.15.84:0/3575193466 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9241a6dc0 con 0x7fc92410de30 2024-09-21T03:50:56.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.047+0000 7fc931512740 1 Processor -- start 2024-09-21T03:50:56.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.047+0000 7fc921ffb640 1 -- 172.21.15.84:0/3575193466 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fc91c02fd60 con 0x7fc92410de30 2024-09-21T03:50:56.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.047+0000 7fc931512740 1 -- start start 2024-09-21T03:50:56.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.047+0000 7fc931512740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740db2070 0x55d741159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:56.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.047+0000 7fc931512740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d740d891b0 0x55d7411597b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:56.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.047+0000 7fc931512740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 0x55d741159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:56.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.047+0000 7fc931512740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d7410cfe50 con 0x55d740d91390 2024-09-21T03:50:56.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.047+0000 7fc931512740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d7410bf280 con 0x55d740d891b0 2024-09-21T03:50:56.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.047+0000 7fc931512740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d7410c3090 con 0x55d740db2070 2024-09-21T03:50:56.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.047+0000 7fc923fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 0x55d741159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:56.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.048+0000 7fc923fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 0x55d741159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54294/0 (socket says 172.21.15.84:54294) 2024-09-21T03:50:56.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.048+0000 7fc923fff640 1 -- 172.21.15.84:0/2704053720 learned_addr learned my addr 172.21.15.84:0/2704053720 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:56.054 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.048+0000 7fc923fff640 1 --2- 172.21.15.84:0/2704053720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740db2070 0x55d741159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:56.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.048+0000 7fc928d3a640 1 --2- 172.21.15.84:0/2704053720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d740d891b0 0x55d7411597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:56.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.048+0000 7fc921ffb640 1 --2- 172.21.15.84:0/3575193466 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc9140b6680 0x7fc9140b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:56.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.048+0000 7fc923fff640 1 -- 172.21.15.84:0/2704053720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740db2070 msgr2=0x55d741159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:56.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.048+0000 7fc923fff640 1 --2- 172.21.15.84:0/2704053720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740db2070 0x55d741159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.048+0000 7fc923fff640 1 -- 172.21.15.84:0/2704053720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d740d891b0 msgr2=0x55d7411597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:56.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.048+0000 7fc92953b640 1 --2- 172.21.15.84:0/3575193466 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc9140b6680 0x7fc9140b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:56.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.048+0000 7fc923fff640 1 --2- 172.21.15.84:0/2704053720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d740d891b0 0x55d7411597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.048+0000 7fc923fff640 1 -- 172.21.15.84:0/2704053720 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d740e1d650 con 0x55d740d91390 2024-09-21T03:50:56.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.048+0000 7fc921ffb640 1 -- 172.21.15.84:0/3575193466 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fc91c108c50 con 0x7fc92410de30 2024-09-21T03:50:56.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.048+0000 7fc923fff640 1 --2- 172.21.15.84:0/2704053720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 0x55d741159cf0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fc910014a20 tx=0x7fc91000c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d552f7e51ee3847 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:56.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.048+0000 7fc90effd640 1 -- 172.21.15.84:0/2704053720 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9100142d0 con 0x55d740d91390 2024-09-21T03:50:56.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.048+0000 7fc90effd640 1 -- 172.21.15.84:0/2704053720 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc91000f760 con 0x55d740d91390 2024-09-21T03:50:56.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.049+0000 7fc90effd640 1 -- 172.21.15.84:0/2704053720 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9100037f0 con 0x55d740d91390 2024-09-21T03:50:56.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.050+0000 7fc931512740 1 -- 172.21.15.84:0/2704053720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 msgr2=0x55d741159cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:56.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.050+0000 7fc931512740 1 --2- 172.21.15.84:0/2704053720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 0x55d741159cf0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fc910014a20 tx=0x7fc91000c540 comp rx=0 tx=0).stop 2024-09-21T03:50:56.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.050+0000 7fc92953b640 1 --2- 172.21.15.84:0/3575193466 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc9140b6680 0x7fc9140b8b90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc91c1064a0 tx=0x7fc91c02a8c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:56.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.050+0000 7fc931512740 1 -- 172.21.15.84:0/2704053720 shutdown_connections 2024-09-21T03:50:56.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.050+0000 7fc931512740 1 --2- 172.21.15.84:0/2704053720 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 0x55d741159cf0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.050+0000 7fc931512740 1 --2- 172.21.15.84:0/2704053720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d740d891b0 0x55d7411597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.050+0000 7fc931512740 1 --2- 172.21.15.84:0/2704053720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740db2070 0x55d741159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.050+0000 7fc931512740 1 -- 172.21.15.84:0/2704053720 >> 172.21.15.84:0/2704053720 conn(0x55d740da6460 msgr2=0x55d741157160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:56.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.050+0000 7fc931512740 1 -- 172.21.15.84:0/2704053720 shutdown_connections 2024-09-21T03:50:56.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.050+0000 7fc931512740 1 -- 172.21.15.84:0/2704053720 wait complete. 2024-09-21T03:50:56.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.050+0000 7fc931512740 1 -- start start 2024-09-21T03:50:56.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.051+0000 7fc931512740 1 Processor -- start 2024-09-21T03:50:56.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.051+0000 7fc931512740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d740d891b0 0x55d7411648b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:56.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.051+0000 7fc931512740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 0x55d741164df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:56.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.051+0000 7fc931512740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740db2070 0x55d741165370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:56.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.051+0000 7fc931512740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d740f20700 con 0x55d740d91390 2024-09-21T03:50:56.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.051+0000 7fc931512740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d74105a110 con 0x55d740d891b0 2024-09-21T03:50:56.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.051+0000 7fc931512740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d7411679f0 con 0x55d740db2070 2024-09-21T03:50:56.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.051+0000 7fc931512740 10 client.0 _ll_register_callbacks cb 0x55d741073990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:56.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.051+0000 7fc928d3a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 0x55d741164df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:56.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.051+0000 7fc928d3a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 0x55d741164df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54304/0 (socket says 172.21.15.84:54304) 2024-09-21T03:50:56.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.051+0000 7fc928d3a640 1 -- 172.21.15.84:0/1669077854 learned_addr learned my addr 172.21.15.84:0/1669077854 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:56.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.051+0000 7fc923fff640 1 --2- 172.21.15.84:0/1669077854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d740d891b0 0x55d7411648b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:56.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.052+0000 7fc923fff640 1 --2- 172.21.15.84:0/1669077854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740db2070 0x55d741165370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:56.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.052+0000 7fc928d3a640 1 -- 172.21.15.84:0/1669077854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740db2070 msgr2=0x55d741165370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:56.060 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.052+0000 7fc928d3a640 1 --2- 172.21.15.84:0/1669077854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740db2070 0x55d741165370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.052+0000 7fc928d3a640 1 -- 172.21.15.84:0/1669077854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d740d891b0 msgr2=0x55d7411648b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:56.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.052+0000 7fc928d3a640 1 --2- 172.21.15.84:0/1669077854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d740d891b0 0x55d7411648b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.052+0000 7fc928d3a640 1 -- 172.21.15.84:0/1669077854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d741087c40 con 0x55d740d91390 2024-09-21T03:50:56.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.052+0000 7fc923fff640 1 --2- 172.21.15.84:0/1669077854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740db2070 0x55d741165370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:56.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.052+0000 7fc928d3a640 1 --2- 172.21.15.84:0/1669077854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 0x55d741164df0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc918010800 tx=0x7fc918010cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1f2eca53f88afb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:56.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.052+0000 7fc903fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:56.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.052+0000 7fc903fff640 1 -- 172.21.15.84:0/1669077854 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91800fb90 con 0x55d740d91390 2024-09-21T03:50:56.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.052+0000 7fc903fff640 1 -- 172.21.15.84:0/1669077854 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fc91800fd30 con 0x55d740d91390 2024-09-21T03:50:56.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.052+0000 7fc931512740 1 -- 172.21.15.84:0/1669077854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc91000f760 con 0x55d740d91390 2024-09-21T03:50:56.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.052+0000 7fc903fff640 1 -- 172.21.15.84:0/1669077854 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc918004030 con 0x55d740d91390 2024-09-21T03:50:56.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.052+0000 7fc931512740 10 client.17055 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:56.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.052+0000 7fc931512740 1 -- 172.21.15.84:0/1669077854 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d741173750 con 0x55d740d91390 2024-09-21T03:50:56.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.053+0000 7fc903fff640 1 -- 172.21.15.84:0/1669077854 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc91000f760 con 0x55d740d91390 2024-09-21T03:50:56.061 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.053+0000 7fc903fff640 1 -- 172.21.15.84:0/1669077854 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc918022410 con 0x55d740d91390 2024-09-21T03:50:56.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.053+0000 7fc931512740 10 client.17055 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:56.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.053+0000 7fc931512740 10 client.17055 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:50:56.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.053+0000 7fc931512740 20 client.17055 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:56.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.053+0000 7fc931512740 1 --2- 172.21.15.84:0/1669077854 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d740d709f0 0x55d741176dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:56.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.053+0000 7fc931512740 4 client.17055 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:50:56.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.053+0000 7fc931512740 1 -- 172.21.15.84:0/1669077854 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7410d1da0 con 0x55d740d709f0 2024-09-21T03:50:56.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.053+0000 7fc923fff640 1 --2- 172.21.15.84:0/1669077854 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d740d709f0 0x55d741176dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:56.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.054+0000 7fc903fff640 10 client.17055 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:56.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.054+0000 7fc923fff640 1 --2- 172.21.15.84:0/1669077854 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d740d709f0 0x55d741176dc0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a04ad70021a9d79c server_cookie=c66b45193f61203e in_seq=0 out_seq=0 2024-09-21T03:50:56.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.054+0000 7fc903fff640 1 -- 172.21.15.84:0/1669077854 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d7410d1da0 con 0x55d740d709f0 2024-09-21T03:50:56.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.054+0000 7fc903fff640 10 client.17055 handle_command_reply: tid=0 2024-09-21T03:50:56.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.055+0000 7fc931512740 1 client.17055 shutdown 2024-09-21T03:50:56.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.055+0000 7fc931512740 1 -- 172.21.15.84:0/1669077854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 msgr2=0x55d741164df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:56.062 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.055+0000 7fc931512740 1 --2- 172.21.15.84:0/1669077854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 0x55d741164df0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc918010800 tx=0x7fc918010cc0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.055+0000 7fc931512740 1 -- 172.21.15.84:0/1669077854 shutdown_connections 2024-09-21T03:50:56.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.055+0000 7fc931512740 1 --2- 172.21.15.84:0/1669077854 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d740d709f0 0x55d741176dc0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.055+0000 7fc931512740 1 --2- 172.21.15.84:0/1669077854 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740db2070 0x55d741165370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.055+0000 7fc931512740 1 --2- 172.21.15.84:0/1669077854 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 0x55d741164df0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.055+0000 7fc931512740 1 --2- 172.21.15.84:0/1669077854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d740d891b0 0x55d7411648b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.055+0000 7fc931512740 1 -- 172.21.15.84:0/1669077854 >> 172.21.15.84:0/1669077854 conn(0x55d740da6460 msgr2=0x55d74115c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:56.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.055+0000 7fc903fff640 0 client.17055 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:56.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.055+0000 7fc931512740 1 -- 172.21.15.84:0/1669077854 shutdown_connections 2024-09-21T03:50:56.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.055+0000 7fc931512740 1 -- 172.21.15.84:0/1669077854 wait complete. 2024-09-21T03:50:56.063 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.055+0000 7fc931512740 20 client.17055 trim_cache size 0 max 16384 2024-09-21T03:50:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.072+0000 7fc931512740 1 Processor -- start 2024-09-21T03:50:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.072+0000 7fc931512740 1 -- start start 2024-09-21T03:50:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.072+0000 7fc931512740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d891b0 0x55d741166790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:56.075 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.072+0000 7fc931512740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740d91390 0x55d74115a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.072+0000 7fc931512740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d740db2070 0x55d741170340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.072+0000 7fc931512740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc9241b1e90 con 0x55d740d891b0 2024-09-21T03:50:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.072+0000 7fc931512740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc9241af760 con 0x55d740db2070 2024-09-21T03:50:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.072+0000 7fc931512740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc9241ad5d0 con 0x55d740d91390 2024-09-21T03:50:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.073+0000 7fc923fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d891b0 0x55d741166790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.073+0000 7fc923fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d891b0 0x55d741166790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54318/0 (socket says 172.21.15.84:54318) 2024-09-21T03:50:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.073+0000 7fc923fff640 1 -- 172.21.15.84:0/277141321 learned_addr learned my addr 172.21.15.84:0/277141321 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.073+0000 7fc928d3a640 1 --2- 172.21.15.84:0/277141321 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740d91390 0x55d74115a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.073+0000 7fc923fff640 1 -- 172.21.15.84:0/277141321 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740d91390 msgr2=0x55d74115a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.073+0000 7fc923fff640 1 --2- 172.21.15.84:0/277141321 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740d91390 0x55d74115a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.073+0000 7fc923fff640 1 -- 172.21.15.84:0/277141321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d740db2070 msgr2=0x55d741170340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.073+0000 7fc923fff640 1 --2- 172.21.15.84:0/277141321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d740db2070 0x55d741170340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.073+0000 7fc923fff640 1 -- 172.21.15.84:0/277141321 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d741165950 con 0x55d740d891b0 2024-09-21T03:50:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.073+0000 7fc928d3a640 1 --2- 172.21.15.84:0/277141321 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740d91390 0x55d74115a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:50:56.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.073+0000 7fc923fff640 1 --2- 172.21.15.84:0/277141321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d891b0 0x55d741166790 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fc91001b000 tx=0x7fc91000c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c2579e5f06d7fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:56.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.073+0000 7fc90e7fc640 1 -- 172.21.15.84:0/277141321 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc910027030 con 0x55d740d891b0 2024-09-21T03:50:56.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.073+0000 7fc90e7fc640 1 -- 172.21.15.84:0/277141321 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc91002e020 con 0x55d740d891b0 2024-09-21T03:50:56.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.073+0000 7fc90e7fc640 1 -- 172.21.15.84:0/277141321 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91000fbf0 con 0x55d740d891b0 2024-09-21T03:50:56.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.074+0000 7fc931512740 1 -- 172.21.15.84:0/277141321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d891b0 msgr2=0x55d741166790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.074+0000 7fc931512740 1 --2- 172.21.15.84:0/277141321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d891b0 0x55d741166790 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fc91001b000 tx=0x7fc91000c4a0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.074+0000 7fc931512740 1 -- 172.21.15.84:0/277141321 shutdown_connections 2024-09-21T03:50:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.074+0000 7fc931512740 1 --2- 172.21.15.84:0/277141321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d740db2070 0x55d741170340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.074+0000 7fc931512740 1 --2- 172.21.15.84:0/277141321 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740d91390 0x55d74115a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.074+0000 7fc931512740 1 --2- 172.21.15.84:0/277141321 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d891b0 0x55d741166790 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.074+0000 7fc931512740 1 -- 172.21.15.84:0/277141321 >> 172.21.15.84:0/277141321 conn(0x55d740da6460 msgr2=0x55d74116fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.074+0000 7fc931512740 1 -- 172.21.15.84:0/277141321 shutdown_connections 2024-09-21T03:50:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.074+0000 7fc931512740 1 -- 172.21.15.84:0/277141321 wait complete. 2024-09-21T03:50:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.074+0000 7fc931512740 1 -- start start 2024-09-21T03:50:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.075+0000 7fc931512740 1 Processor -- start 2024-09-21T03:50:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.075+0000 7fc931512740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 0x55d74116d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.075+0000 7fc931512740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d740db2070 0x55d741168730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:56.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.075+0000 7fc931512740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740d45da0 0x55d741168c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.075+0000 7fc931512740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc9241adc20 con 0x55d740d91390 2024-09-21T03:50:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.075+0000 7fc931512740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc9241af090 con 0x55d740db2070 2024-09-21T03:50:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.075+0000 7fc931512740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc9241ae2f0 con 0x55d740d45da0 2024-09-21T03:50:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.075+0000 7fc931512740 10 client.0 _ll_register_callbacks cb 0x7fc91800a780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.075+0000 7fc923fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 0x55d74116d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.075+0000 7fc923fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 0x55d74116d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54328/0 (socket says 172.21.15.84:54328) 2024-09-21T03:50:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.075+0000 7fc923fff640 1 -- 172.21.15.84:0/2989633990 learned_addr learned my addr 172.21.15.84:0/2989633990 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.075+0000 7fc928d3a640 1 --2- 172.21.15.84:0/2989633990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d740db2070 0x55d741168730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.075+0000 7fc923fff640 1 --2- 172.21.15.84:0/2989633990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740d45da0 0x55d741168c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.076+0000 7fc923fff640 1 -- 172.21.15.84:0/2989633990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740d45da0 msgr2=0x55d741168c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.076+0000 7fc923fff640 1 --2- 172.21.15.84:0/2989633990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740d45da0 0x55d741168c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.076+0000 7fc923fff640 1 -- 172.21.15.84:0/2989633990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d740db2070 msgr2=0x55d741168730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.076+0000 7fc923fff640 1 --2- 172.21.15.84:0/2989633990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d740db2070 0x55d741168730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.076+0000 7fc923fff640 1 -- 172.21.15.84:0/2989633990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d741169230 con 0x55d740d91390 2024-09-21T03:50:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.076+0000 7fc923fff640 1 --2- 172.21.15.84:0/2989633990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 0x55d74116d280 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fc91000c580 tx=0x7fc91000c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44707f3e59a2ceb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.076+0000 7fc903fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.076+0000 7fc903fff640 1 -- 172.21.15.84:0/2989633990 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91003c060 con 0x55d740d91390 2024-09-21T03:50:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.076+0000 7fc903fff640 1 -- 172.21.15.84:0/2989633990 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fc91000f970 con 0x55d740d91390 2024-09-21T03:50:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.076+0000 7fc931512740 1 -- 172.21.15.84:0/2989633990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc91002e020 con 0x55d740d91390 2024-09-21T03:50:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.076+0000 7fc903fff640 1 -- 172.21.15.84:0/2989633990 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc91000fb70 con 0x55d740d91390 2024-09-21T03:50:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.076+0000 7fc931512740 10 client.17061 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.076+0000 7fc931512740 1 -- 172.21.15.84:0/2989633990 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d7411e58d0 con 0x55d740d91390 2024-09-21T03:50:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.076+0000 7fc903fff640 1 -- 172.21.15.84:0/2989633990 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc91002e020 con 0x55d740d91390 2024-09-21T03:50:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.077+0000 7fc903fff640 1 -- 172.21.15.84:0/2989633990 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc91002b040 con 0x55d740d91390 2024-09-21T03:50:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.077+0000 7fc931512740 10 client.17061 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.077+0000 7fc931512740 10 client.17061 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:50:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.077+0000 7fc931512740 20 client.17061 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:56.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.077+0000 7fc931512740 1 --2- 172.21.15.84:0/2989633990 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d7411e5d10 0x55d7411e8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:56.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.077+0000 7fc931512740 4 client.17061 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:50:56.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.077+0000 7fc931512740 1 -- 172.21.15.84:0/2989633990 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d7410cd850 con 0x55d7411e5d10 2024-09-21T03:50:56.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.077+0000 7fc928d3a640 1 --2- 172.21.15.84:0/2989633990 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d7411e5d10 0x55d7411e8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:56.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.077+0000 7fc928d3a640 1 --2- 172.21.15.84:0/2989633990 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d7411e5d10 0x55d7411e8130 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bacecec4d39960c1 server_cookie=81bceb8ead285350 in_seq=0 out_seq=0 2024-09-21T03:50:56.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.077+0000 7fc903fff640 10 client.17061 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:56.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.079+0000 7fc903fff640 1 -- 172.21.15.84:0/2989633990 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x55d7410cd850 con 0x55d7411e5d10 2024-09-21T03:50:56.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.079+0000 7fc903fff640 10 client.17061 handle_command_reply: tid=0 2024-09-21T03:50:56.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.079+0000 7fc931512740 1 client.17061 shutdown 2024-09-21T03:50:56.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.079+0000 7fc931512740 1 -- 172.21.15.84:0/2989633990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 msgr2=0x55d74116d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:56.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.079+0000 7fc931512740 1 --2- 172.21.15.84:0/2989633990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 0x55d74116d280 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fc91000c580 tx=0x7fc91000c510 comp rx=0 tx=0).stop 2024-09-21T03:50:56.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.079+0000 7fc931512740 1 -- 172.21.15.84:0/2989633990 shutdown_connections 2024-09-21T03:50:56.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.079+0000 7fc931512740 1 --2- 172.21.15.84:0/2989633990 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55d7411e5d10 0x55d7411e8130 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.079+0000 7fc931512740 1 --2- 172.21.15.84:0/2989633990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d740d45da0 0x55d741168c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.079+0000 7fc931512740 1 --2- 172.21.15.84:0/2989633990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d740db2070 0x55d741168730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.079+0000 7fc931512740 1 --2- 172.21.15.84:0/2989633990 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d740d91390 0x55d74116d280 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.079+0000 7fc903fff640 0 client.17061 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:50:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.079+0000 7fc931512740 1 -- 172.21.15.84:0/2989633990 >> 172.21.15.84:0/2989633990 conn(0x55d740da6460 msgr2=0x55d74116fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.079+0000 7fc931512740 1 -- 172.21.15.84:0/2989633990 shutdown_connections 2024-09-21T03:50:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.079+0000 7fc931512740 1 -- 172.21.15.84:0/2989633990 wait complete. 2024-09-21T03:50:56.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.080+0000 7fc931512740 20 client.17061 trim_cache size 0 max 16384 2024-09-21T03:50:56.085 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:50:56.085 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T03:50:56.085 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T03:50:56.085 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:50:56.085 INFO:teuthology.orchestra.run.smithi084.stdout: "d85cdf50-3fc8-467d-942f-2b77981ba106": { 2024-09-21T03:50:56.085 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:43.684286+0000", 2024-09-21T03:50:56.085 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:56.086 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:56.086 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:56.086 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:56.086 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:56.086 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:56.086 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:50:56.086 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:50:56.086 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:56.086 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:56.086 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:56.086 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:56.086 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:56.086 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:56.086 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:50:56.087 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:50:56.087 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:56.087 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:56.087 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:56.087 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:56.087 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:56.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:56.087 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:50:56.087 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:50:56.087 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:56.087 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:56.087 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:56.087 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:56.088 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:56.088 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:56.088 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:50:56.088 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:50:56.088 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:56.088 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:56.088 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:56.088 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:56.088 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:56.088 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:56.088 INFO:teuthology.orchestra.run.smithi084.stdout: "43a49cca-fc1c-4c36-a314-49033e7c3fb6": { 2024-09-21T03:50:56.088 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:49:17.366428+0000", 2024-09-21T03:50:56.088 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:56.088 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:56.088 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:56.089 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:56.089 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:56.089 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:56.089 INFO:teuthology.orchestra.run.smithi084.stdout: "0bb4e83d-6059-4d41-88f0-1562fa422c47": { 2024-09-21T03:50:56.089 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:54.511018+0000", 2024-09-21T03:50:56.089 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:56.089 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:56.089 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:56.089 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:56.089 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:56.089 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:56.089 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:50:56.089 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:50:56.090 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:56.090 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:56.090 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:56.090 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:56.090 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:56.090 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:56.090 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:50:56.090 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:50:56.090 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:56.090 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:56.090 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:56.090 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:56.090 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:56.090 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:56.091 INFO:teuthology.orchestra.run.smithi084.stdout: "27dcb84c-89fa-46b2-b980-58857966c697": { 2024-09-21T03:50:56.091 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:52.598527+0000", 2024-09-21T03:50:56.091 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:56.091 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:56.091 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:56.091 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:56.091 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:56.091 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:56.091 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:50:56.091 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:50:56.091 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:56.091 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:56.091 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:56.091 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:56.092 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:56.092 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:56.092 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:50:56.092 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:50:56.092 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:56.092 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:56.092 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:56.092 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:56.092 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:56.092 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:56.092 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:50:56.092 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:50:56.092 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:56.092 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:56.093 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:56.093 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:56.093 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:56.093 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:56.093 INFO:teuthology.orchestra.run.smithi084.stdout: "b2063a70-0b1f-4b6b-9c96-d886e156ea66": { 2024-09-21T03:50:56.093 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:48:34.864478+0000", 2024-09-21T03:50:56.093 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:56.093 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:56.093 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:56.093 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:56.093 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:56.093 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:50:56.093 INFO:teuthology.orchestra.run.smithi084.stdout: "33131451-f242-447a-b13f-9bdebc7884ec": { 2024-09-21T03:50:56.093 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:00.524357+0000", 2024-09-21T03:50:56.094 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:50:56.094 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:50:56.094 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:50:56.094 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:50:56.094 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:50:56.094 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:50:56.094 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:50:56.094 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:50:56.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.080+0000 7fc92af9e640 1 -- 172.21.15.84:0/3575193466 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc9140b6680 msgr2=0x7fc9140b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:56.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.080+0000 7fc92af9e640 1 --2- 172.21.15.84:0/3575193466 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc9140b6680 0x7fc9140b8b90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc91c1064a0 tx=0x7fc91c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.080+0000 7fc92af9e640 1 -- 172.21.15.84:0/3575193466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc92410de30 msgr2=0x7fc92419fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:56.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.080+0000 7fc92af9e640 1 --2- 172.21.15.84:0/3575193466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc92410de30 0x7fc92419fc40 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fc91c005cc0 tx=0x7fc91c02f380 comp rx=0 tx=0).stop 2024-09-21T03:50:56.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.080+0000 7fc92af9e640 1 -- 172.21.15.84:0/3575193466 shutdown_connections 2024-09-21T03:50:56.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.080+0000 7fc92af9e640 1 --2- 172.21.15.84:0/3575193466 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc9140b6680 0x7fc9140b8b90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.080+0000 7fc92af9e640 1 --2- 172.21.15.84:0/3575193466 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc92410de30 0x7fc92419fc40 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.080+0000 7fc92af9e640 1 --2- 172.21.15.84:0/3575193466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9241052b0 0x7fc92419a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.080+0000 7fc92af9e640 1 --2- 172.21.15.84:0/3575193466 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc924104880 0x7fc92419a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:56.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.080+0000 7fc92af9e640 1 -- 172.21.15.84:0/3575193466 >> 172.21.15.84:0/3575193466 conn(0x7fc924079730 msgr2=0x7fc924100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:56.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.080+0000 7fc92af9e640 1 -- 172.21.15.84:0/3575193466 shutdown_connections 2024-09-21T03:50:56.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:56.080+0000 7fc92af9e640 1 -- 172.21.15.84:0/3575193466 wait complete. 2024-09-21T03:50:56.791 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:50:56.791 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:50:56.814 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:56 smithi084 ceph-mon[30941]: pgmap v582: 97 pgs: 97 active+clean; 15 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 10 op/s 2024-09-21T03:50:56.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:56 smithi174 ceph-mon[34403]: pgmap v582: 97 pgs: 97 active+clean; 15 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 10 op/s 2024-09-21T03:50:56.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:56 smithi172 ceph-mon[34821]: pgmap v582: 97 pgs: 97 active+clean; 15 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 10 op/s 2024-09-21T03:50:57.036 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:50:57.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.537+0000 7f4695185640 1 -- 172.21.15.84:0/1567276845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4690108d30 msgr2=0x7f469010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:57.558 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.537+0000 7f4695185640 1 --2- 172.21.15.84:0/1567276845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4690108d30 0x7f469010f560 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f4688009ca0 tx=0x7f468802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:50:57.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.537+0000 7f4695185640 1 -- 172.21.15.84:0/1567276845 shutdown_connections 2024-09-21T03:50:57.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.537+0000 7f4695185640 1 --2- 172.21.15.84:0/1567276845 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4690108d30 0x7f469010f560 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:57.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.537+0000 7f4695185640 1 --2- 172.21.15.84:0/1567276845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46901083e0 0x7f46901087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:57.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.537+0000 7f4695185640 1 --2- 172.21.15.84:0/1567276845 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4690102aa0 0x7f4690102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:57.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.537+0000 7f4695185640 1 -- 172.21.15.84:0/1567276845 >> 172.21.15.84:0/1567276845 conn(0x7f46900797e0 msgr2=0x7f4690079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:57.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.537+0000 7f4695185640 1 -- 172.21.15.84:0/1567276845 shutdown_connections 2024-09-21T03:50:57.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.537+0000 7f4695185640 1 -- 172.21.15.84:0/1567276845 wait complete. 2024-09-21T03:50:57.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.538+0000 7f4695185640 1 Processor -- start 2024-09-21T03:50:57.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.538+0000 7f4695185640 1 -- start start 2024-09-21T03:50:57.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.538+0000 7f4695185640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4690102aa0 0x7f469019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:57.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.538+0000 7f4695185640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46901083e0 0x7f469019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:57.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.538+0000 7f4695185640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4690108d30 0x7f469019fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:57.559 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.538+0000 7f4695185640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f4690113ac0 con 0x7f4690102aa0 2024-09-21T03:50:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.538+0000 7f4695185640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4690113940 con 0x7f4690108d30 2024-09-21T03:50:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.538+0000 7f4695185640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f4690113c40 con 0x7f46901083e0 2024-09-21T03:50:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.538+0000 7f468ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4690102aa0 0x7f469019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.538+0000 7f468ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4690102aa0 0x7f469019a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:54358/0 (socket says 172.21.15.84:54358) 2024-09-21T03:50:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.538+0000 7f468ed9d640 1 -- 172.21.15.84:0/1099445528 learned_addr learned my addr 172.21.15.84:0/1099445528 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.539+0000 7f468e59c640 1 --2- 172.21.15.84:0/1099445528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46901083e0 0x7f469019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.539+0000 7f468f59e640 1 --2- 172.21.15.84:0/1099445528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4690108d30 0x7f469019fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.539+0000 7f468ed9d640 1 -- 172.21.15.84:0/1099445528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46901083e0 msgr2=0x7f469019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.539+0000 7f468ed9d640 1 --2- 172.21.15.84:0/1099445528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46901083e0 0x7f469019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.539+0000 7f468ed9d640 1 -- 172.21.15.84:0/1099445528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4690108d30 msgr2=0x7f469019fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.539+0000 7f468ed9d640 1 --2- 172.21.15.84:0/1099445528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4690108d30 0x7f469019fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.539+0000 7f468ed9d640 1 -- 172.21.15.84:0/1099445528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46901a02e0 con 0x7f4690102aa0 2024-09-21T03:50:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.539+0000 7f468e59c640 1 --2- 172.21.15.84:0/1099445528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46901083e0 0x7f469019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:57.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.539+0000 7f468ed9d640 1 --2- 172.21.15.84:0/1099445528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4690102aa0 0x7f469019a430 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f468000d770 tx=0x7f468000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.539+0000 7f4677fff640 1 -- 172.21.15.84:0/1099445528 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4680017070 con 0x7f4690102aa0 2024-09-21T03:50:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.539+0000 7f4677fff640 1 -- 172.21.15.84:0/1099445528 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46800054d0 con 0x7f4690102aa0 2024-09-21T03:50:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.539+0000 7f4695185640 1 -- 172.21.15.84:0/1099445528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46901a05d0 con 0x7f4690102aa0 2024-09-21T03:50:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.539+0000 7f4677fff640 1 -- 172.21.15.84:0/1099445528 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4680004c30 con 0x7f4690102aa0 2024-09-21T03:50:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.539+0000 7f4695185640 1 -- 172.21.15.84:0/1099445528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46901a6df0 con 0x7f4690102aa0 2024-09-21T03:50:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.540+0000 7f4695185640 1 -- 172.21.15.84:0/1099445528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4690103d20 con 0x7f4690102aa0 2024-09-21T03:50:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.542+0000 7f4677fff640 1 -- 172.21.15.84:0/1099445528 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f4680004dd0 con 0x7f4690102aa0 2024-09-21T03:50:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.543+0000 7f4677fff640 1 --2- 172.21.15.84:0/1099445528 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f46780b66b0 0x7f46780b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.543+0000 7f468e59c640 1 --2- 172.21.15.84:0/1099445528 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f46780b66b0 0x7f46780b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.543+0000 7f4677fff640 1 -- 172.21.15.84:0/1099445528 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f46800e7600 con 0x7f4690102aa0 2024-09-21T03:50:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.543+0000 7f468e59c640 1 --2- 172.21.15.84:0/1099445528 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f46780b66b0 0x7f46780b8bc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4690105ec0 tx=0x7f4684005d90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:57.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.547+0000 7f4677fff640 1 -- 172.21.15.84:0/1099445528 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f46800adba0 con 0x7f4690102aa0 2024-09-21T03:50:57.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.760+0000 7f4695185640 1 -- 172.21.15.84:0/1099445528 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4690102eb0 con 0x7f4690102aa0 2024-09-21T03:50:57.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.760+0000 7f4677fff640 1 -- 172.21.15.84:0/1099445528 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7f46800b1f80 con 0x7f4690102aa0 2024-09-21T03:50:57.763 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:50:57.763 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:50:57.763 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:50:57.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.762+0000 7f4695185640 1 -- 172.21.15.84:0/1099445528 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f46780b66b0 msgr2=0x7f46780b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:57.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.762+0000 7f4695185640 1 --2- 172.21.15.84:0/1099445528 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f46780b66b0 0x7f46780b8bc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4690105ec0 tx=0x7f4684005d90 comp rx=0 tx=0).stop 2024-09-21T03:50:57.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.762+0000 7f4695185640 1 -- 172.21.15.84:0/1099445528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4690102aa0 msgr2=0x7f469019a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:57.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.762+0000 7f4695185640 1 --2- 172.21.15.84:0/1099445528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4690102aa0 0x7f469019a430 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f468000d770 tx=0x7f468000dc30 comp rx=0 tx=0).stop 2024-09-21T03:50:57.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.763+0000 7f4695185640 1 -- 172.21.15.84:0/1099445528 shutdown_connections 2024-09-21T03:50:57.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.763+0000 7f4695185640 1 --2- 172.21.15.84:0/1099445528 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f46780b66b0 0x7f46780b8bc0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:57.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.763+0000 7f4695185640 1 --2- 172.21.15.84:0/1099445528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4690108d30 0x7f469019fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:57.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.763+0000 7f4695185640 1 --2- 172.21.15.84:0/1099445528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46901083e0 0x7f469019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:57.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.763+0000 7f4695185640 1 --2- 172.21.15.84:0/1099445528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f4690102aa0 0x7f469019a430 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:57.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.763+0000 7f4695185640 1 -- 172.21.15.84:0/1099445528 >> 172.21.15.84:0/1099445528 conn(0x7f46900797e0 msgr2=0x7f46901043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:57.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.763+0000 7f4695185640 1 -- 172.21.15.84:0/1099445528 shutdown_connections 2024-09-21T03:50:57.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:57.763+0000 7f4695185640 1 -- 172.21.15.84:0/1099445528 wait complete. 2024-09-21T03:50:58.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:57 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1099445528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:50:58.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:57 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1099445528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:50:58.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:57 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1099445528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:50:58.482 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:50:58.769 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:50:59.082 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:50:58 smithi084 ceph-mon[30941]: pgmap v583: 97 pgs: 97 active+clean; 16 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 14 op/s 2024-09-21T03:50:59.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:50:58 smithi174 ceph-mon[34403]: pgmap v583: 97 pgs: 97 active+clean; 16 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 14 op/s 2024-09-21T03:50:59.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:50:58 smithi172 ceph-mon[34821]: pgmap v583: 97 pgs: 97 active+clean; 16 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 14 op/s 2024-09-21T03:50:59.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.307+0000 7fc5ce8e5640 1 -- 172.21.15.84:0/1047849896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c8108d10 msgr2=0x7fc5c810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:59.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.307+0000 7fc5ce8e5640 1 --2- 172.21.15.84:0/1047849896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c8108d10 0x7fc5c810f540 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009ca0 tx=0x7fc5c002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.317 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.307+0000 7fc5ce8e5640 1 -- 172.21.15.84:0/1047849896 shutdown_connections 2024-09-21T03:50:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.307+0000 7fc5ce8e5640 1 --2- 172.21.15.84:0/1047849896 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c8108d10 0x7fc5c810f540 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.307+0000 7fc5ce8e5640 1 --2- 172.21.15.84:0/1047849896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5c81083c0 0x7fc5c81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.307+0000 7fc5ce8e5640 1 --2- 172.21.15.84:0/1047849896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5c8102a80 0x7fc5c8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.307+0000 7fc5ce8e5640 1 -- 172.21.15.84:0/1047849896 >> 172.21.15.84:0/1047849896 conn(0x7fc5c8079740 msgr2=0x7fc5c8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.307+0000 7fc5ce8e5640 1 -- 172.21.15.84:0/1047849896 shutdown_connections 2024-09-21T03:50:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.307+0000 7fc5ce8e5640 1 -- 172.21.15.84:0/1047849896 wait complete. 2024-09-21T03:50:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.307+0000 7fc5ce8e5640 1 Processor -- start 2024-09-21T03:50:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.307+0000 7fc5ce8e5640 1 -- start start 2024-09-21T03:50:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.308+0000 7fc5ce8e5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c8102a80 0x7fc5c81982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.308+0000 7fc5ce8e5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5c81083c0 0x7fc5c8198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.308+0000 7fc5ce8e5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5c8108d10 0x7fc5c819daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.308+0000 7fc5ce8e5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c81118e0 con 0x7fc5c8102a80 2024-09-21T03:50:59.318 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.308+0000 7fc5ce8e5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c8111760 con 0x7fc5c8108d10 2024-09-21T03:50:59.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.308+0000 7fc5ce8e5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c8111a60 con 0x7fc5c81083c0 2024-09-21T03:50:59.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.308+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c8102a80 0x7fc5c81982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:59.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.308+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c8102a80 0x7fc5c81982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33716/0 (socket says 172.21.15.84:33716) 2024-09-21T03:50:59.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.308+0000 7fc5c7fff640 1 -- 172.21.15.84:0/4235881701 learned_addr learned my addr 172.21.15.84:0/4235881701 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:59.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.308+0000 7fc5cce82640 1 --2- 172.21.15.84:0/4235881701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5c8108d10 0x7fc5c819daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:59.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.308+0000 7fc5c77fe640 1 --2- 172.21.15.84:0/4235881701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5c81083c0 0x7fc5c8198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:59.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.308+0000 7fc5c7fff640 1 -- 172.21.15.84:0/4235881701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5c81083c0 msgr2=0x7fc5c8198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:59.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.308+0000 7fc5c7fff640 1 --2- 172.21.15.84:0/4235881701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5c81083c0 0x7fc5c8198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.308+0000 7fc5c7fff640 1 -- 172.21.15.84:0/4235881701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5c8108d10 msgr2=0x7fc5c819daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:59.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.308+0000 7fc5c7fff640 1 --2- 172.21.15.84:0/4235881701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5c8108d10 0x7fc5c819daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.308+0000 7fc5c7fff640 1 -- 172.21.15.84:0/4235881701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c819e220 con 0x7fc5c8102a80 2024-09-21T03:50:59.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.308+0000 7fc5c77fe640 1 --2- 172.21.15.84:0/4235881701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5c81083c0 0x7fc5c8198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:59.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.308+0000 7fc5c7fff640 1 --2- 172.21.15.84:0/4235881701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c8102a80 0x7fc5c81982b0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800c890 tx=0x7fc5b800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:59.319 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.309+0000 7fc5c57fa640 1 -- 172.21.15.84:0/4235881701 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8004220 con 0x7fc5c8102a80 2024-09-21T03:50:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.309+0000 7fc5c57fa640 1 -- 172.21.15.84:0/4235881701 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5b80043c0 con 0x7fc5c8102a80 2024-09-21T03:50:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.309+0000 7fc5ce8e5640 1 -- 172.21.15.84:0/4235881701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c819e510 con 0x7fc5c8102a80 2024-09-21T03:50:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.309+0000 7fc5c57fa640 1 -- 172.21.15.84:0/4235881701 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8004a00 con 0x7fc5c8102a80 2024-09-21T03:50:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.309+0000 7fc5ce8e5640 1 -- 172.21.15.84:0/4235881701 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c81a4c70 con 0x7fc5c8102a80 2024-09-21T03:50:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.312+0000 7fc5c57fa640 1 -- 172.21.15.84:0/4235881701 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fc5b80079b0 con 0x7fc5c8102a80 2024-09-21T03:50:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.312+0000 7fc5d4e59740 1 Processor -- start 2024-09-21T03:50:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.312+0000 7fc5d4e59740 1 -- start start 2024-09-21T03:50:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.312+0000 7fc5d4e59740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557722692070 0x557722a396a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.312+0000 7fc5d4e59740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 0x557722a39be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.312+0000 7fc5d4e59740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557722671390 0x557722a3a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.312+0000 7fc5d4e59740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5577229afea0 con 0x5577226691b0 2024-09-21T03:50:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.312+0000 7fc5d4e59740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55772299f2d0 con 0x557722692070 2024-09-21T03:50:59.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.312+0000 7fc5d4e59740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5577229a30e0 con 0x557722671390 2024-09-21T03:50:59.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.312+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 0x557722a39be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:59.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.312+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 0x557722a39be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33718/0 (socket says 172.21.15.84:33718) 2024-09-21T03:50:59.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.312+0000 7fc5c7fff640 1 -- 172.21.15.84:0/1403469385 learned_addr learned my addr 172.21.15.84:0/1403469385 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:59.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.312+0000 7fc5cce82640 1 --2- 172.21.15.84:0/1403469385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557722692070 0x557722a396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:59.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.312+0000 7fc5c77fe640 1 --2- 172.21.15.84:0/1403469385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557722671390 0x557722a3a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:59.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.312+0000 7fc5c57fa640 1 --2- 172.21.15.84:0/4235881701 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc5b00b8890 0x7fc5b00bada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:59.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.312+0000 7fc5c7fff640 1 -- 172.21.15.84:0/1403469385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557722671390 msgr2=0x557722a3a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:59.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.312+0000 7fc5c7fff640 1 --2- 172.21.15.84:0/1403469385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557722671390 0x557722a3a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.312+0000 7fc5c7fff640 1 -- 172.21.15.84:0/1403469385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557722692070 msgr2=0x557722a396a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:59.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.312+0000 7fc5c7fff640 1 --2- 172.21.15.84:0/1403469385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557722692070 0x557722a396a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.313+0000 7fc5c7fff640 1 -- 172.21.15.84:0/1403469385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577226fd650 con 0x5577226691b0 2024-09-21T03:50:59.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.313+0000 7fc5cce82640 1 --2- 172.21.15.84:0/4235881701 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc5b00b8890 0x7fc5b00bada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:59.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.313+0000 7fc5c7fff640 1 --2- 172.21.15.84:0/1403469385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 0x557722a39be0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fc5b80e4c40 tx=0x7fc5b80ad590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efadb5432bfb34c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:59.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.313+0000 7fc5c57fa640 1 -- 172.21.15.84:0/4235881701 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fc5b80e7500 con 0x7fc5c8102a80 2024-09-21T03:50:59.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.313+0000 7fc5ae7fc640 1 -- 172.21.15.84:0/1403469385 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b80ad170 con 0x5577226691b0 2024-09-21T03:50:59.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.313+0000 7fc5ae7fc640 1 -- 172.21.15.84:0/1403469385 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5b8005290 con 0x5577226691b0 2024-09-21T03:50:59.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.313+0000 7fc5ae7fc640 1 -- 172.21.15.84:0/1403469385 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b80acb10 con 0x5577226691b0 2024-09-21T03:50:59.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.314+0000 7fc5d4e59740 1 -- 172.21.15.84:0/1403469385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 msgr2=0x557722a39be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:59.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.314+0000 7fc5cce82640 1 --2- 172.21.15.84:0/4235881701 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc5b00b8890 0x7fc5b00bada0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0005cc0 tx=0x7fc5c00095c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:59.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.314+0000 7fc5d4e59740 1 --2- 172.21.15.84:0/1403469385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 0x557722a39be0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fc5b80e4c40 tx=0x7fc5b80ad590 comp rx=0 tx=0).stop 2024-09-21T03:50:59.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.314+0000 7fc5d4e59740 1 -- 172.21.15.84:0/1403469385 shutdown_connections 2024-09-21T03:50:59.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.314+0000 7fc5d4e59740 1 --2- 172.21.15.84:0/1403469385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557722671390 0x557722a3a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.314+0000 7fc5d4e59740 1 --2- 172.21.15.84:0/1403469385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 0x557722a39be0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.314+0000 7fc5d4e59740 1 --2- 172.21.15.84:0/1403469385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557722692070 0x557722a396a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.314+0000 7fc5d4e59740 1 -- 172.21.15.84:0/1403469385 >> 172.21.15.84:0/1403469385 conn(0x557722686460 msgr2=0x557722a37590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:59.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.314+0000 7fc5d4e59740 1 -- 172.21.15.84:0/1403469385 shutdown_connections 2024-09-21T03:50:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.314+0000 7fc5d4e59740 1 -- 172.21.15.84:0/1403469385 wait complete. 2024-09-21T03:50:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.314+0000 7fc5d4e59740 1 -- start start 2024-09-21T03:50:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.315+0000 7fc5d4e59740 1 Processor -- start 2024-09-21T03:50:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.315+0000 7fc5d4e59740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 0x557722a44e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.315+0000 7fc5d4e59740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557722671390 0x557722a45360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.315+0000 7fc5d4e59740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557722692070 0x557722a51170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.315+0000 7fc5d4e59740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x557722800700 con 0x5577226691b0 2024-09-21T03:50:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.315+0000 7fc5d4e59740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55772293a160 con 0x557722671390 2024-09-21T03:50:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.315+0000 7fc5d4e59740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x557722a47e80 con 0x557722692070 2024-09-21T03:50:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.315+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 0x557722a44e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.315+0000 7fc5d4e59740 10 client.0 _ll_register_callbacks cb 0x5577229539e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.315+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 0x557722a44e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33720/0 (socket says 172.21.15.84:33720) 2024-09-21T03:50:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.315+0000 7fc5c7fff640 1 -- 172.21.15.84:0/569760974 learned_addr learned my addr 172.21.15.84:0/569760974 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:59.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.315+0000 7fc5c77fe640 1 --2- 172.21.15.84:0/569760974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557722671390 0x557722a45360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:59.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.315+0000 7fc5cce82640 1 --2- 172.21.15.84:0/569760974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557722692070 0x557722a51170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:59.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.316+0000 7fc5c7fff640 1 -- 172.21.15.84:0/569760974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557722692070 msgr2=0x557722a51170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:59.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.316+0000 7fc5c7fff640 1 --2- 172.21.15.84:0/569760974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557722692070 0x557722a51170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.316+0000 7fc5c7fff640 1 -- 172.21.15.84:0/569760974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557722671390 msgr2=0x557722a45360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:59.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.316+0000 7fc5c7fff640 1 --2- 172.21.15.84:0/569760974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557722671390 0x557722a45360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.316+0000 7fc5c7fff640 1 -- 172.21.15.84:0/569760974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557722967c90 con 0x5577226691b0 2024-09-21T03:50:59.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.316+0000 7fc5c7fff640 1 --2- 172.21.15.84:0/569760974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 0x557722a44e20 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8007f50 tx=0x7fc5b80e7800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b803fc55bb49bcce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:59.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.316+0000 7fc5a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.316+0000 7fc5a77fe640 1 -- 172.21.15.84:0/569760974 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8094070 con 0x5577226691b0 2024-09-21T03:50:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.316+0000 7fc5a77fe640 1 -- 172.21.15.84:0/569760974 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fc5b80b6930 con 0x5577226691b0 2024-09-21T03:50:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.316+0000 7fc5d4e59740 1 -- 172.21.15.84:0/569760974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5577229b1df0 con 0x5577226691b0 2024-09-21T03:50:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.316+0000 7fc5a77fe640 1 -- 172.21.15.84:0/569760974 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc5b801d040 con 0x5577226691b0 2024-09-21T03:50:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.316+0000 7fc5d4e59740 10 client.17079 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.316+0000 7fc5d4e59740 1 -- 172.21.15.84:0/569760974 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557722a53bf0 con 0x5577226691b0 2024-09-21T03:50:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.316+0000 7fc5a77fe640 1 -- 172.21.15.84:0/569760974 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5577229b1df0 con 0x5577226691b0 2024-09-21T03:50:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.316+0000 7fc5a77fe640 1 -- 172.21.15.84:0/569760974 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc5b80c3080 con 0x5577226691b0 2024-09-21T03:50:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.317+0000 7fc5d4e59740 10 client.17079 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.317+0000 7fc5d4e59740 10 client.17079 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:50:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.317+0000 7fc5d4e59740 20 client.17079 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.317+0000 7fc5d4e59740 1 --2- 172.21.15.84:0/569760974 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5577226509f0 0x557722a56f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.317+0000 7fc5d4e59740 4 client.17079 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:50:59.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.317+0000 7fc5d4e59740 1 -- 172.21.15.84:0/569760974 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577229ad8a0 con 0x5577226509f0 2024-09-21T03:50:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.317+0000 7fc5c77fe640 1 --2- 172.21.15.84:0/569760974 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5577226509f0 0x557722a56f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.317+0000 7fc5c77fe640 1 --2- 172.21.15.84:0/569760974 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5577226509f0 0x557722a56f50 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8e112f64dc3abf77 server_cookie=70f2f6d7fa8d9e8a in_seq=0 out_seq=0 2024-09-21T03:50:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.317+0000 7fc5a77fe640 10 client.17079 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:50:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.318+0000 7fc5a77fe640 1 -- 172.21.15.84:0/569760974 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5577229ad8a0 con 0x5577226509f0 2024-09-21T03:50:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.318+0000 7fc5a77fe640 10 client.17079 handle_command_reply: tid=0 2024-09-21T03:50:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.318+0000 7fc5d4e59740 1 client.17079 shutdown 2024-09-21T03:50:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.318+0000 7fc5d4e59740 1 -- 172.21.15.84:0/569760974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 msgr2=0x557722a44e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.318+0000 7fc5d4e59740 1 --2- 172.21.15.84:0/569760974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 0x557722a44e20 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8007f50 tx=0x7fc5b80e7800 comp rx=0 tx=0).stop 2024-09-21T03:50:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.319+0000 7fc5d4e59740 1 -- 172.21.15.84:0/569760974 shutdown_connections 2024-09-21T03:50:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.319+0000 7fc5d4e59740 1 --2- 172.21.15.84:0/569760974 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x5577226509f0 0x557722a56f50 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.319+0000 7fc5d4e59740 1 --2- 172.21.15.84:0/569760974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557722692070 0x557722a51170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.319+0000 7fc5d4e59740 1 --2- 172.21.15.84:0/569760974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557722671390 0x557722a45360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.319+0000 7fc5d4e59740 1 --2- 172.21.15.84:0/569760974 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 0x557722a44e20 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.319+0000 7fc5d4e59740 1 -- 172.21.15.84:0/569760974 >> 172.21.15.84:0/569760974 conn(0x557722686460 msgr2=0x557722a3c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:59.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.319+0000 7fc5a77fe640 0 client.17079 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:50:59.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.319+0000 7fc5d4e59740 1 -- 172.21.15.84:0/569760974 shutdown_connections 2024-09-21T03:50:59.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.319+0000 7fc5d4e59740 1 -- 172.21.15.84:0/569760974 wait complete. 2024-09-21T03:50:59.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.319+0000 7fc5d4e59740 20 client.17079 trim_cache size 0 max 16384 2024-09-21T03:50:59.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.332+0000 7fc5d4e59740 1 Processor -- start 2024-09-21T03:50:59.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.332+0000 7fc5d4e59740 1 -- start start 2024-09-21T03:50:59.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.332+0000 7fc5d4e59740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 0x557722a375e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:59.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.332+0000 7fc5d4e59740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557722671390 0x557722a510e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:59.334 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.332+0000 7fc5d4e59740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557722692070 0x557722a3c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:59.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.332+0000 7fc5d4e59740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c81afe10 con 0x5577226691b0 2024-09-21T03:50:59.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.332+0000 7fc5d4e59740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c81ad6e0 con 0x557722692070 2024-09-21T03:50:59.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.332+0000 7fc5d4e59740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c81ab550 con 0x557722671390 2024-09-21T03:50:59.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.332+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 0x557722a375e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:59.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.332+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 0x557722a375e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33736/0 (socket says 172.21.15.84:33736) 2024-09-21T03:50:59.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.332+0000 7fc5c7fff640 1 -- 172.21.15.84:0/2528173852 learned_addr learned my addr 172.21.15.84:0/2528173852 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:59.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.332+0000 7fc5cce82640 1 --2- 172.21.15.84:0/2528173852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557722692070 0x557722a3c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:59.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.332+0000 7fc5c7fff640 1 -- 172.21.15.84:0/2528173852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557722671390 msgr2=0x557722a510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:59.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.332+0000 7fc5c7fff640 1 --2- 172.21.15.84:0/2528173852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557722671390 0x557722a510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.332+0000 7fc5c7fff640 1 -- 172.21.15.84:0/2528173852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557722692070 msgr2=0x557722a3c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:59.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.332+0000 7fc5c7fff640 1 --2- 172.21.15.84:0/2528173852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557722692070 0x557722a3c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.332+0000 7fc5c7fff640 1 -- 172.21.15.84:0/2528173852 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557722a3b990 con 0x5577226691b0 2024-09-21T03:50:59.335 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.332+0000 7fc5cce82640 1 --2- 172.21.15.84:0/2528173852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557722692070 0x557722a3c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:50:59.336 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.332+0000 7fc5c7fff640 1 --2- 172.21.15.84:0/2528173852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 0x557722a375e0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8005fd0 tx=0x7fc5b80ad3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926884354ddff9b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:59.337 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.333+0000 7fc5adffb640 1 -- 172.21.15.84:0/2528173852 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b8094070 con 0x5577226691b0 2024-09-21T03:50:59.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.333+0000 7fc5adffb640 1 -- 172.21.15.84:0/2528173852 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5b80aceb0 con 0x5577226691b0 2024-09-21T03:50:59.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.333+0000 7fc5adffb640 1 -- 172.21.15.84:0/2528173852 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b80accf0 con 0x5577226691b0 2024-09-21T03:50:59.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.333+0000 7fc5d4e59740 1 -- 172.21.15.84:0/2528173852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 msgr2=0x557722a375e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:59.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.333+0000 7fc5d4e59740 1 --2- 172.21.15.84:0/2528173852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 0x557722a375e0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8005fd0 tx=0x7fc5b80ad3f0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.333+0000 7fc5d4e59740 1 -- 172.21.15.84:0/2528173852 shutdown_connections 2024-09-21T03:50:59.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.333+0000 7fc5d4e59740 1 --2- 172.21.15.84:0/2528173852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557722692070 0x557722a3c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.333+0000 7fc5d4e59740 1 --2- 172.21.15.84:0/2528173852 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557722671390 0x557722a510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.333+0000 7fc5d4e59740 1 --2- 172.21.15.84:0/2528173852 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5577226691b0 0x557722a375e0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.333+0000 7fc5d4e59740 1 -- 172.21.15.84:0/2528173852 >> 172.21.15.84:0/2528173852 conn(0x557722686460 msgr2=0x557722a36ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:59.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.333+0000 7fc5d4e59740 1 -- 172.21.15.84:0/2528173852 shutdown_connections 2024-09-21T03:50:59.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.334+0000 7fc5d4e59740 1 -- 172.21.15.84:0/2528173852 wait complete. 2024-09-21T03:50:59.338 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.334+0000 7fc5d4e59740 1 -- start start 2024-09-21T03:50:59.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.334+0000 7fc5d4e59740 1 Processor -- start 2024-09-21T03:50:59.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.334+0000 7fc5d4e59740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577226691b0 0x557722a57a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:59.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.334+0000 7fc5d4e59740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557722671390 0x557722a58020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:59.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.334+0000 7fc5d4e59740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557722692070 0x557722ab8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:59.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.334+0000 7fc5d4e59740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c81abba0 con 0x557722692070 2024-09-21T03:50:59.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.334+0000 7fc5d4e59740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c81ad010 con 0x5577226691b0 2024-09-21T03:50:59.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.334+0000 7fc5d4e59740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c81ac270 con 0x557722671390 2024-09-21T03:50:59.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.335+0000 7fc5d4e59740 10 client.0 _ll_register_callbacks cb 0x7fc5c0009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:50:59.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.335+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577226691b0 0x557722a57a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:59.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.335+0000 7fc5c7fff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577226691b0 0x557722a57a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:40936/0 (socket says 172.21.15.84:40936) 2024-09-21T03:50:59.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.335+0000 7fc5c7fff640 1 -- 172.21.15.84:0/3160851796 learned_addr learned my addr 172.21.15.84:0/3160851796 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:50:59.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.335+0000 7fc5cce82640 1 --2- 172.21.15.84:0/3160851796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557722692070 0x557722ab8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:59.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.335+0000 7fc5c77fe640 1 --2- 172.21.15.84:0/3160851796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557722671390 0x557722a58020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:59.339 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.335+0000 7fc5cce82640 1 -- 172.21.15.84:0/3160851796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557722671390 msgr2=0x557722a58020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:59.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.335+0000 7fc5cce82640 1 --2- 172.21.15.84:0/3160851796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557722671390 0x557722a58020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.335+0000 7fc5cce82640 1 -- 172.21.15.84:0/3160851796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577226691b0 msgr2=0x557722a57a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:50:59.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.335+0000 7fc5cce82640 1 --2- 172.21.15.84:0/3160851796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577226691b0 0x557722a57a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.335+0000 7fc5cce82640 1 -- 172.21.15.84:0/3160851796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557722ab8cf0 con 0x557722692070 2024-09-21T03:50:59.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.336+0000 7fc5c7fff640 1 --2- 172.21.15.84:0/3160851796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577226691b0 0x557722a57a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:50:59.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.336+0000 7fc5cce82640 1 --2- 172.21.15.84:0/3160851796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557722692070 0x557722ab8680 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fc5c002ade0 tx=0x7fc5c002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43fc978de89283bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:50:59.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.336+0000 7fc5a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:50:59.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.336+0000 7fc5a77fe640 1 -- 172.21.15.84:0/3160851796 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0004450 con 0x557722692070 2024-09-21T03:50:59.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.336+0000 7fc5a77fe640 1 -- 172.21.15.84:0/3160851796 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fc5c00045f0 con 0x557722692070 2024-09-21T03:50:59.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.336+0000 7fc5d4e59740 1 -- 172.21.15.84:0/3160851796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5b80aceb0 con 0x557722692070 2024-09-21T03:50:59.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.336+0000 7fc5a77fe640 1 -- 172.21.15.84:0/3160851796 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc5c00047f0 con 0x557722692070 2024-09-21T03:50:59.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.336+0000 7fc5d4e59740 10 client.17085 fetch_fsmap learned FSMap version 25 2024-09-21T03:50:59.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.336+0000 7fc5d4e59740 1 -- 172.21.15.84:0/3160851796 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557722ac0960 con 0x557722692070 2024-09-21T03:50:59.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.337+0000 7fc5a77fe640 1 -- 172.21.15.84:0/3160851796 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5b80aceb0 con 0x557722692070 2024-09-21T03:50:59.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.337+0000 7fc5a77fe640 1 -- 172.21.15.84:0/3160851796 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc5c0030780 con 0x557722692070 2024-09-21T03:50:59.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.337+0000 7fc5d4e59740 10 client.17085 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:50:59.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.337+0000 7fc5d4e59740 10 client.17085 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:50:59.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.337+0000 7fc5d4e59740 20 client.17085 populate_metadata read hostname 'smithi084' 2024-09-21T03:50:59.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.337+0000 7fc5d4e59740 1 --2- 172.21.15.84:0/3160851796 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x557722625da0 0x557722ac31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:50:59.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.337+0000 7fc5d4e59740 4 client.17085 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:50:59.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.337+0000 7fc5d4e59740 1 -- 172.21.15.84:0/3160851796 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5577229aacd0 con 0x557722625da0 2024-09-21T03:50:59.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.337+0000 7fc5c7fff640 1 --2- 172.21.15.84:0/3160851796 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x557722625da0 0x557722ac31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:50:59.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.337+0000 7fc5a77fe640 10 client.17085 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:50:59.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.337+0000 7fc5c7fff640 1 --2- 172.21.15.84:0/3160851796 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x557722625da0 0x557722ac31a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e6cdda970e603388 server_cookie=f757da367412c71a in_seq=0 out_seq=0 2024-09-21T03:50:59.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.338+0000 7fc5a77fe640 1 -- 172.21.15.84:0/3160851796 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5577229aacd0 con 0x557722625da0 2024-09-21T03:50:59.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.338+0000 7fc5a77fe640 10 client.17085 handle_command_reply: tid=0 2024-09-21T03:50:59.343 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.338+0000 7fc5d4e59740 1 client.17085 shutdown 2024-09-21T03:50:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.338+0000 7fc5d4e59740 1 -- 172.21.15.84:0/3160851796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557722692070 msgr2=0x557722ab8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.338+0000 7fc5d4e59740 1 --2- 172.21.15.84:0/3160851796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557722692070 0x557722ab8680 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fc5c002ade0 tx=0x7fc5c002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.338+0000 7fc5d4e59740 1 -- 172.21.15.84:0/3160851796 shutdown_connections 2024-09-21T03:50:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.338+0000 7fc5d4e59740 1 --2- 172.21.15.84:0/3160851796 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x557722625da0 0x557722ac31a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.338+0000 7fc5d4e59740 1 --2- 172.21.15.84:0/3160851796 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x557722692070 0x557722ab8680 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.338+0000 7fc5d4e59740 1 --2- 172.21.15.84:0/3160851796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557722671390 0x557722a58020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.338+0000 7fc5d4e59740 1 --2- 172.21.15.84:0/3160851796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577226691b0 0x557722a57a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.338+0000 7fc5d4e59740 1 -- 172.21.15.84:0/3160851796 >> 172.21.15.84:0/3160851796 conn(0x557722686460 msgr2=0x557722a432c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.338+0000 7fc5a77fe640 0 client.17085 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:50:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.338+0000 7fc5d4e59740 1 -- 172.21.15.84:0/3160851796 shutdown_connections 2024-09-21T03:50:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.338+0000 7fc5d4e59740 1 -- 172.21.15.84:0/3160851796 wait complete. 2024-09-21T03:50:59.344 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.338+0000 7fc5d4e59740 20 client.17085 trim_cache size 0 max 16384 2024-09-21T03:50:59.345 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:50:59.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.339+0000 7fc5ce8e5640 1 -- 172.21.15.84:0/4235881701 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc5b00b8890 msgr2=0x7fc5b00bada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:59.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.339+0000 7fc5ce8e5640 1 --2- 172.21.15.84:0/4235881701 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc5b00b8890 0x7fc5b00bada0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0005cc0 tx=0x7fc5c00095c0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.339+0000 7fc5ce8e5640 1 -- 172.21.15.84:0/4235881701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c8102a80 msgr2=0x7fc5c81982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:50:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.339+0000 7fc5ce8e5640 1 --2- 172.21.15.84:0/4235881701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c8102a80 0x7fc5c81982b0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fc5b800c890 tx=0x7fc5b800cd50 comp rx=0 tx=0).stop 2024-09-21T03:50:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.339+0000 7fc5ce8e5640 1 -- 172.21.15.84:0/4235881701 shutdown_connections 2024-09-21T03:50:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.339+0000 7fc5ce8e5640 1 --2- 172.21.15.84:0/4235881701 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc5b00b8890 0x7fc5b00bada0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.339+0000 7fc5ce8e5640 1 --2- 172.21.15.84:0/4235881701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5c8108d10 0x7fc5c819daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.339+0000 7fc5ce8e5640 1 --2- 172.21.15.84:0/4235881701 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5c81083c0 0x7fc5c8198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.339+0000 7fc5ce8e5640 1 --2- 172.21.15.84:0/4235881701 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc5c8102a80 0x7fc5c81982b0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:50:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.339+0000 7fc5ce8e5640 1 -- 172.21.15.84:0/4235881701 >> 172.21.15.84:0/4235881701 conn(0x7fc5c8079740 msgr2=0x7fc5c8105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:50:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.339+0000 7fc5ce8e5640 1 -- 172.21.15.84:0/4235881701 shutdown_connections 2024-09-21T03:50:59.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:50:59.339+0000 7fc5ce8e5640 1 -- 172.21.15.84:0/4235881701 wait complete. 2024-09-21T03:51:00.031 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:51:00.277 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:51:00.699 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:00 smithi084 ceph-mon[30941]: pgmap v584: 97 pgs: 97 active+clean; 16 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 9 op/s 2024-09-21T03:51:00.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.788+0000 7fd07fec6640 1 -- 172.21.15.84:0/851131575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0781094e0 msgr2=0x7fd0781098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:00.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.788+0000 7fd07fec6640 1 --2- 172.21.15.84:0/851131575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0781094e0 0x7fd0781098f0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fd06c009900 tx=0x7fd06c02a410 comp rx=0 tx=0).stop 2024-09-21T03:51:00.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.788+0000 7fd07fec6640 1 -- 172.21.15.84:0/851131575 shutdown_connections 2024-09-21T03:51:00.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.788+0000 7fd07fec6640 1 --2- 172.21.15.84:0/851131575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd078109e30 0x7fd078110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.788+0000 7fd07fec6640 1 --2- 172.21.15.84:0/851131575 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0781094e0 0x7fd0781098f0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.788+0000 7fd07fec6640 1 --2- 172.21.15.84:0/851131575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd078103ba0 0x7fd078103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.788+0000 7fd07fec6640 1 -- 172.21.15.84:0/851131575 >> 172.21.15.84:0/851131575 conn(0x7fd0780ff630 msgr2=0x7fd078101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:00.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.788+0000 7fd07fec6640 1 -- 172.21.15.84:0/851131575 shutdown_connections 2024-09-21T03:51:00.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.788+0000 7fd07fec6640 1 -- 172.21.15.84:0/851131575 wait complete. 2024-09-21T03:51:00.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.788+0000 7fd07fec6640 1 Processor -- start 2024-09-21T03:51:00.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.788+0000 7fd07fec6640 1 -- start start 2024-09-21T03:51:00.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.789+0000 7fd07fec6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd078103ba0 0x7fd078075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:00.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.789+0000 7fd07fec6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0781094e0 0x7fd078075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:00.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.789+0000 7fd07fec6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd078109e30 0x7fd078076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:00.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.789+0000 7fd07fec6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd078113af0 con 0x7fd0781094e0 2024-09-21T03:51:00.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.789+0000 7fd07fec6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd078113970 con 0x7fd078109e30 2024-09-21T03:51:00.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.789+0000 7fd07fec6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd078113c70 con 0x7fd078103ba0 2024-09-21T03:51:00.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.789+0000 7fd07d461640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0781094e0 0x7fd078075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:00.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.789+0000 7fd07d461640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0781094e0 0x7fd078075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33774/0 (socket says 172.21.15.84:33774) 2024-09-21T03:51:00.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.789+0000 7fd07d461640 1 -- 172.21.15.84:0/387007644 learned_addr learned my addr 172.21.15.84:0/387007644 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:00.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.789+0000 7fd07dc62640 1 --2- 172.21.15.84:0/387007644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd078103ba0 0x7fd078075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:00.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.789+0000 7fd07e463640 1 --2- 172.21.15.84:0/387007644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd078109e30 0x7fd078076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:00.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.789+0000 7fd07d461640 1 -- 172.21.15.84:0/387007644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd078103ba0 msgr2=0x7fd078075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:00.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.789+0000 7fd07d461640 1 --2- 172.21.15.84:0/387007644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd078103ba0 0x7fd078075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.789+0000 7fd07d461640 1 -- 172.21.15.84:0/387007644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd078109e30 msgr2=0x7fd078076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:00.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.789+0000 7fd07d461640 1 --2- 172.21.15.84:0/387007644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd078109e30 0x7fd078076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.789+0000 7fd07d461640 1 -- 172.21.15.84:0/387007644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0781a87a0 con 0x7fd0781094e0 2024-09-21T03:51:00.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.789+0000 7fd07d461640 1 --2- 172.21.15.84:0/387007644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0781094e0 0x7fd078075c50 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fd06c02a930 tx=0x7fd06c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:00.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.789+0000 7fd076ffd640 1 -- 172.21.15.84:0/387007644 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06c03f030 con 0x7fd0781094e0 2024-09-21T03:51:00.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.789+0000 7fd076ffd640 1 -- 172.21.15.84:0/387007644 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd06c003aa0 con 0x7fd0781094e0 2024-09-21T03:51:00.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.789+0000 7fd07fec6640 1 -- 172.21.15.84:0/387007644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0781a8a30 con 0x7fd0781094e0 2024-09-21T03:51:00.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.790+0000 7fd076ffd640 1 -- 172.21.15.84:0/387007644 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06c035070 con 0x7fd0781094e0 2024-09-21T03:51:00.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.790+0000 7fd07fec6640 1 -- 172.21.15.84:0/387007644 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0781a8f10 con 0x7fd0781094e0 2024-09-21T03:51:00.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.792+0000 7fd076ffd640 1 -- 172.21.15.84:0/387007644 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fd06c042030 con 0x7fd0781094e0 2024-09-21T03:51:00.802 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.792+0000 7fd08643a740 1 Processor -- start 2024-09-21T03:51:00.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.792+0000 7fd08643a740 1 -- start start 2024-09-21T03:51:00.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.793+0000 7fd08643a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b95070 0x55d924f3c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:00.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.793+0000 7fd08643a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b6c1b0 0x55d924f3cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:00.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.793+0000 7fd08643a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b74390 0x55d924f3d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:00.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.793+0000 7fd08643a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d924eb2ea0 con 0x55d924b95070 2024-09-21T03:51:00.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.793+0000 7fd08643a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d924ea22d0 con 0x55d924b74390 2024-09-21T03:51:00.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.793+0000 7fd08643a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d924ea60e0 con 0x55d924b6c1b0 2024-09-21T03:51:00.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.793+0000 7fd07e463640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b95070 0x55d924f3c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:00.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.793+0000 7fd07e463640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b95070 0x55d924f3c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33778/0 (socket says 172.21.15.84:33778) 2024-09-21T03:51:00.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.793+0000 7fd07e463640 1 -- 172.21.15.84:0/1648103246 learned_addr learned my addr 172.21.15.84:0/1648103246 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:00.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.793+0000 7fd07dc62640 1 --2- 172.21.15.84:0/1648103246 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b6c1b0 0x55d924f3cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:00.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.793+0000 7fd076ffd640 1 --2- 172.21.15.84:0/387007644 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd0600b6680 0x7fd0600b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:00.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.793+0000 7fd07d461640 1 --2- 172.21.15.84:0/1648103246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b74390 0x55d924f3d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:00.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.793+0000 7fd07e463640 1 -- 172.21.15.84:0/1648103246 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b6c1b0 msgr2=0x55d924f3cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:00.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.793+0000 7fd07e463640 1 --2- 172.21.15.84:0/1648103246 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b6c1b0 0x55d924f3cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.793+0000 7fd07e463640 1 -- 172.21.15.84:0/1648103246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b74390 msgr2=0x55d924f3d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:00.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.793+0000 7fd07e463640 1 --2- 172.21.15.84:0/1648103246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b74390 0x55d924f3d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.793+0000 7fd07e463640 1 -- 172.21.15.84:0/1648103246 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d924c00650 con 0x55d924b95070 2024-09-21T03:51:00.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.793+0000 7fd07e463640 1 --2- 172.21.15.84:0/387007644 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd0600b6680 0x7fd0600b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:00.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.794+0000 7fd076ffd640 1 -- 172.21.15.84:0/387007644 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fd06c107a70 con 0x7fd0781094e0 2024-09-21T03:51:00.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.794+0000 7fd07e463640 1 --2- 172.21.15.84:0/1648103246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b95070 0x55d924f3c6a0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fd07000cc40 tx=0x7fd07000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8852406b7ef6d9c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:00.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.794+0000 7fd05ffff640 1 -- 172.21.15.84:0/1648103246 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070022070 con 0x55d924b95070 2024-09-21T03:51:00.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.794+0000 7fd05ffff640 1 -- 172.21.15.84:0/1648103246 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd070018070 con 0x55d924b95070 2024-09-21T03:51:00.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.794+0000 7fd05ffff640 1 -- 172.21.15.84:0/1648103246 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07001c950 con 0x55d924b95070 2024-09-21T03:51:00.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.795+0000 7fd08643a740 1 -- 172.21.15.84:0/1648103246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b95070 msgr2=0x55d924f3c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:00.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.795+0000 7fd07e463640 1 --2- 172.21.15.84:0/387007644 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd0600b6680 0x7fd0600b8b90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd07001f000 tx=0x7fd070020000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:00.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.795+0000 7fd08643a740 1 --2- 172.21.15.84:0/1648103246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b95070 0x55d924f3c6a0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fd07000cc40 tx=0x7fd07000e720 comp rx=0 tx=0).stop 2024-09-21T03:51:00.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.795+0000 7fd08643a740 1 -- 172.21.15.84:0/1648103246 shutdown_connections 2024-09-21T03:51:00.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.795+0000 7fd08643a740 1 --2- 172.21.15.84:0/1648103246 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b74390 0x55d924f3d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.795+0000 7fd08643a740 1 --2- 172.21.15.84:0/1648103246 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b6c1b0 0x55d924f3cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.795+0000 7fd08643a740 1 --2- 172.21.15.84:0/1648103246 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b95070 0x55d924f3c6a0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.795+0000 7fd08643a740 1 -- 172.21.15.84:0/1648103246 >> 172.21.15.84:0/1648103246 conn(0x55d924b89460 msgr2=0x55d924f3a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:00.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.795+0000 7fd08643a740 1 -- 172.21.15.84:0/1648103246 shutdown_connections 2024-09-21T03:51:00.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.795+0000 7fd08643a740 1 -- 172.21.15.84:0/1648103246 wait complete. 2024-09-21T03:51:00.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.795+0000 7fd08643a740 1 -- start start 2024-09-21T03:51:00.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.795+0000 7fd08643a740 1 Processor -- start 2024-09-21T03:51:00.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.796+0000 7fd08643a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b6c1b0 0x55d924f47d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:00.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.796+0000 7fd08643a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b74390 0x55d924f482b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:00.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.796+0000 7fd08643a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b95070 0x55d924f541a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:00.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.796+0000 7fd08643a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d924d03700 con 0x55d924b74390 2024-09-21T03:51:00.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.796+0000 7fd08643a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d924e3d160 con 0x55d924b6c1b0 2024-09-21T03:51:00.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.796+0000 7fd08643a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d924f4ae80 con 0x55d924b95070 2024-09-21T03:51:00.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.796+0000 7fd08643a740 10 client.0 _ll_register_callbacks cb 0x55d924e569e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:51:00.805 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.796+0000 7fd07d461640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b74390 0x55d924f482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:00.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.796+0000 7fd07d461640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b74390 0x55d924f482b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33784/0 (socket says 172.21.15.84:33784) 2024-09-21T03:51:00.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.796+0000 7fd07d461640 1 -- 172.21.15.84:0/3636332908 learned_addr learned my addr 172.21.15.84:0/3636332908 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:00.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.796+0000 7fd07dc62640 1 --2- 172.21.15.84:0/3636332908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b6c1b0 0x55d924f47d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:00.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.796+0000 7fd07e463640 1 --2- 172.21.15.84:0/3636332908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b95070 0x55d924f541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:00.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.796+0000 7fd07d461640 1 -- 172.21.15.84:0/3636332908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b95070 msgr2=0x55d924f541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:00.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.796+0000 7fd07d461640 1 --2- 172.21.15.84:0/3636332908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b95070 0x55d924f541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.796+0000 7fd07d461640 1 -- 172.21.15.84:0/3636332908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b6c1b0 msgr2=0x55d924f47d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:00.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.796+0000 7fd07d461640 1 --2- 172.21.15.84:0/3636332908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b6c1b0 0x55d924f47d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.796+0000 7fd07d461640 1 -- 172.21.15.84:0/3636332908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d924e6ac90 con 0x55d924b74390 2024-09-21T03:51:00.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.796+0000 7fd07e463640 1 --2- 172.21.15.84:0/3636332908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b95070 0x55d924f541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:51:00.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.796+0000 7fd07dc62640 1 --2- 172.21.15.84:0/3636332908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b6c1b0 0x55d924f47d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:51:00.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.797+0000 7fd07d461640 1 --2- 172.21.15.84:0/3636332908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b74390 0x55d924f482b0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fd06c04a000 tx=0x7fd06c03b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ce3b86a013616c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:00.806 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.797+0000 7fd05d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:51:00.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.797+0000 7fd05d7fa640 1 -- 172.21.15.84:0/3636332908 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06c049070 con 0x55d924b74390 2024-09-21T03:51:00.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.797+0000 7fd05d7fa640 1 -- 172.21.15.84:0/3636332908 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fd06c105490 con 0x55d924b74390 2024-09-21T03:51:00.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.797+0000 7fd08643a740 1 -- 172.21.15.84:0/3636332908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd070018070 con 0x55d924b74390 2024-09-21T03:51:00.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.797+0000 7fd05d7fa640 1 -- 172.21.15.84:0/3636332908 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd06c0c9080 con 0x55d924b74390 2024-09-21T03:51:00.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.797+0000 7fd08643a740 10 client.17097 fetch_fsmap learned FSMap version 25 2024-09-21T03:51:00.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.797+0000 7fd08643a740 1 -- 172.21.15.84:0/3636332908 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d924f56b80 con 0x55d924b74390 2024-09-21T03:51:00.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.797+0000 7fd05d7fa640 1 -- 172.21.15.84:0/3636332908 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd070018070 con 0x55d924b74390 2024-09-21T03:51:00.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.797+0000 7fd05d7fa640 1 -- 172.21.15.84:0/3636332908 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd06c0c9b80 con 0x55d924b74390 2024-09-21T03:51:00.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.797+0000 7fd08643a740 10 client.17097 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:51:00.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.797+0000 7fd08643a740 10 client.17097 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:51:00.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.797+0000 7fd08643a740 20 client.17097 populate_metadata read hostname 'smithi084' 2024-09-21T03:51:00.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.797+0000 7fd08643a740 1 --2- 172.21.15.84:0/3636332908 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55d924b539f0 0x55d924f5a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:00.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.797+0000 7fd08643a740 4 client.17097 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:51:00.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.797+0000 7fd08643a740 1 -- 172.21.15.84:0/3636332908 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d924eb4df0 con 0x55d924b539f0 2024-09-21T03:51:00.807 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.798+0000 7fd07dc62640 1 --2- 172.21.15.84:0/3636332908 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55d924b539f0 0x55d924f5a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:00.808 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.798+0000 7fd05d7fa640 10 client.17097 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:51:00.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.798+0000 7fd07dc62640 1 --2- 172.21.15.84:0/3636332908 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55d924b539f0 0x55d924f5a0c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c577840f3d233460 server_cookie=9d85ee1911904cff in_seq=0 out_seq=0 2024-09-21T03:51:00.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.799+0000 7fd05d7fa640 1 -- 172.21.15.84:0/3636332908 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d924eb4df0 con 0x55d924b539f0 2024-09-21T03:51:00.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.799+0000 7fd05d7fa640 10 client.17097 handle_command_reply: tid=0 2024-09-21T03:51:00.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.799+0000 7fd08643a740 1 client.17097 shutdown 2024-09-21T03:51:00.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.799+0000 7fd08643a740 1 -- 172.21.15.84:0/3636332908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b74390 msgr2=0x55d924f482b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:00.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.799+0000 7fd08643a740 1 --2- 172.21.15.84:0/3636332908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b74390 0x55d924f482b0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fd06c04a000 tx=0x7fd06c03b6b0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.799+0000 7fd08643a740 1 -- 172.21.15.84:0/3636332908 shutdown_connections 2024-09-21T03:51:00.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.799+0000 7fd08643a740 1 --2- 172.21.15.84:0/3636332908 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55d924b539f0 0x55d924f5a0c0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.799+0000 7fd08643a740 1 --2- 172.21.15.84:0/3636332908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b95070 0x55d924f541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.799+0000 7fd08643a740 1 --2- 172.21.15.84:0/3636332908 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b74390 0x55d924f482b0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.799+0000 7fd08643a740 1 --2- 172.21.15.84:0/3636332908 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b6c1b0 0x55d924f47d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.799+0000 7fd05d7fa640 0 client.17097 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:51:00.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.799+0000 7fd08643a740 1 -- 172.21.15.84:0/3636332908 >> 172.21.15.84:0/3636332908 conn(0x55d924b89460 msgr2=0x55d924f3f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:00.809 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.799+0000 7fd08643a740 1 -- 172.21.15.84:0/3636332908 shutdown_connections 2024-09-21T03:51:00.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.799+0000 7fd08643a740 1 -- 172.21.15.84:0/3636332908 wait complete. 2024-09-21T03:51:00.810 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.800+0000 7fd08643a740 20 client.17097 trim_cache size 0 max 16384 2024-09-21T03:51:00.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.812+0000 7fd08643a740 1 Processor -- start 2024-09-21T03:51:00.814 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.812+0000 7fd08643a740 1 -- start start 2024-09-21T03:51:00.815 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.813+0000 7fd08643a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b6c1b0 0x55d924f48230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:00.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.813+0000 7fd08643a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b74390 0x55d924f3f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:00.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.813+0000 7fd08643a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b95070 0x55d924f3fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:00.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.813+0000 7fd08643a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781b4100 con 0x55d924b95070 2024-09-21T03:51:00.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.813+0000 7fd08643a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781b19d0 con 0x55d924b74390 2024-09-21T03:51:00.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.813+0000 7fd08643a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781af840 con 0x55d924b6c1b0 2024-09-21T03:51:00.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.813+0000 7fd07e463640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b95070 0x55d924f3fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:00.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.813+0000 7fd07e463640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b95070 0x55d924f3fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33794/0 (socket says 172.21.15.84:33794) 2024-09-21T03:51:00.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.813+0000 7fd07e463640 1 -- 172.21.15.84:0/624759159 learned_addr learned my addr 172.21.15.84:0/624759159 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:00.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.813+0000 7fd07dc62640 1 --2- 172.21.15.84:0/624759159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b6c1b0 0x55d924f48230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:00.816 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.813+0000 7fd07e463640 1 -- 172.21.15.84:0/624759159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b6c1b0 msgr2=0x55d924f48230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:00.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.813+0000 7fd07d461640 1 --2- 172.21.15.84:0/624759159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b74390 0x55d924f3f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:00.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.813+0000 7fd07e463640 1 --2- 172.21.15.84:0/624759159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b6c1b0 0x55d924f48230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.813+0000 7fd07e463640 1 -- 172.21.15.84:0/624759159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b74390 msgr2=0x55d924f3f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:00.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.813+0000 7fd07e463640 1 --2- 172.21.15.84:0/624759159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b74390 0x55d924f3f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.813+0000 7fd07e463640 1 -- 172.21.15.84:0/624759159 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d924f3e990 con 0x55d924b95070 2024-09-21T03:51:00.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.813+0000 7fd07dc62640 1 --2- 172.21.15.84:0/624759159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b6c1b0 0x55d924f48230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:51:00.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.813+0000 7fd07e463640 1 --2- 172.21.15.84:0/624759159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b95070 0x55d924f3fce0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fd070005ec0 tx=0x7fd070026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c171337ed829b3f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:00.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.814+0000 7fd05f7fe640 1 -- 172.21.15.84:0/624759159 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070022050 con 0x55d924b95070 2024-09-21T03:51:00.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.814+0000 7fd05f7fe640 1 -- 172.21.15.84:0/624759159 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd070018040 con 0x55d924b95070 2024-09-21T03:51:00.817 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.814+0000 7fd05f7fe640 1 -- 172.21.15.84:0/624759159 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070011d90 con 0x55d924b95070 2024-09-21T03:51:00.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.814+0000 7fd08643a740 1 -- 172.21.15.84:0/624759159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b95070 msgr2=0x55d924f3fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:00.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.814+0000 7fd08643a740 1 --2- 172.21.15.84:0/624759159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b95070 0x55d924f3fce0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fd070005ec0 tx=0x7fd070026000 comp rx=0 tx=0).stop 2024-09-21T03:51:00.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.814+0000 7fd08643a740 1 -- 172.21.15.84:0/624759159 shutdown_connections 2024-09-21T03:51:00.820 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.814+0000 7fd08643a740 1 --2- 172.21.15.84:0/624759159 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b95070 0x55d924f3fce0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.814+0000 7fd08643a740 1 --2- 172.21.15.84:0/624759159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b74390 0x55d924f3f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.814+0000 7fd08643a740 1 --2- 172.21.15.84:0/624759159 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b6c1b0 0x55d924f48230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.814+0000 7fd08643a740 1 -- 172.21.15.84:0/624759159 >> 172.21.15.84:0/624759159 conn(0x55d924b89460 msgr2=0x55d924f47b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:00.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.814+0000 7fd08643a740 1 -- 172.21.15.84:0/624759159 shutdown_connections 2024-09-21T03:51:00.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.814+0000 7fd08643a740 1 -- 172.21.15.84:0/624759159 wait complete. 2024-09-21T03:51:00.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.815+0000 7fd08643a740 1 -- start start 2024-09-21T03:51:00.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.815+0000 7fd08643a740 1 Processor -- start 2024-09-21T03:51:00.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.815+0000 7fd08643a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b6c1b0 0x55d924f4c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:00.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.815+0000 7fd08643a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b74390 0x55d924f4cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:00.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.815+0000 7fd08643a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b95070 0x55d924fc3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:00.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.815+0000 7fd08643a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781afe90 con 0x55d924b74390 2024-09-21T03:51:00.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.815+0000 7fd08643a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781b1300 con 0x55d924b95070 2024-09-21T03:51:00.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.815+0000 7fd08643a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781b0560 con 0x55d924b6c1b0 2024-09-21T03:51:00.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.815+0000 7fd08643a740 10 client.0 _ll_register_callbacks cb 0x7fd06c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:51:00.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.815+0000 7fd07d461640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b74390 0x55d924f4cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:00.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.815+0000 7fd07d461640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b74390 0x55d924f4cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33804/0 (socket says 172.21.15.84:33804) 2024-09-21T03:51:00.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.816+0000 7fd07d461640 1 -- 172.21.15.84:0/208007548 learned_addr learned my addr 172.21.15.84:0/208007548 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:00.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.816+0000 7fd07dc62640 1 --2- 172.21.15.84:0/208007548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b6c1b0 0x55d924f4c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:00.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.816+0000 7fd07e463640 1 --2- 172.21.15.84:0/208007548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b95070 0x55d924fc3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:00.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.816+0000 7fd07d461640 1 -- 172.21.15.84:0/208007548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b6c1b0 msgr2=0x55d924f4c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:00.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.816+0000 7fd07d461640 1 --2- 172.21.15.84:0/208007548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b6c1b0 0x55d924f4c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.816+0000 7fd07d461640 1 -- 172.21.15.84:0/208007548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b95070 msgr2=0x55d924fc3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:00.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.816+0000 7fd07d461640 1 --2- 172.21.15.84:0/208007548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b95070 0x55d924fc3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.816+0000 7fd07d461640 1 -- 172.21.15.84:0/208007548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d924fc3f90 con 0x55d924b74390 2024-09-21T03:51:00.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.816+0000 7fd07e463640 1 --2- 172.21.15.84:0/208007548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b95070 0x55d924fc3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:51:00.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.816+0000 7fd07d461640 1 --2- 172.21.15.84:0/208007548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b74390 0x55d924f4cd20 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0cd8a0 tx=0x7fd06c0db5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df7cd20779a53e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:00.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.816+0000 7fd05d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:51:00.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.816+0000 7fd05d7fa640 1 -- 172.21.15.84:0/208007548 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06c049070 con 0x55d924b74390 2024-09-21T03:51:00.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.816+0000 7fd05d7fa640 1 -- 172.21.15.84:0/208007548 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fd06c0d6ea0 con 0x55d924b74390 2024-09-21T03:51:00.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.816+0000 7fd08643a740 1 -- 172.21.15.84:0/208007548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd070018040 con 0x55d924b74390 2024-09-21T03:51:00.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.816+0000 7fd05d7fa640 1 -- 172.21.15.84:0/208007548 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd06c0cd6e0 con 0x55d924b74390 2024-09-21T03:51:00.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.816+0000 7fd08643a740 10 client.17103 fetch_fsmap learned FSMap version 25 2024-09-21T03:51:00.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.816+0000 7fd08643a740 1 -- 172.21.15.84:0/208007548 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d924fc5150 con 0x55d924b74390 2024-09-21T03:51:00.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.816+0000 7fd05d7fa640 1 -- 172.21.15.84:0/208007548 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd070018040 con 0x55d924b74390 2024-09-21T03:51:00.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.817+0000 7fd05d7fa640 1 -- 172.21.15.84:0/208007548 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd06c0ccb70 con 0x55d924b74390 2024-09-21T03:51:00.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.817+0000 7fd08643a740 10 client.17103 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:51:00.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.817+0000 7fd08643a740 10 client.17103 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:51:00.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.817+0000 7fd08643a740 20 client.17103 populate_metadata read hostname 'smithi084' 2024-09-21T03:51:00.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.817+0000 7fd08643a740 1 --2- 172.21.15.84:0/208007548 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55d924b28da0 0x55d924fc76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:00.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.817+0000 7fd08643a740 4 client.17103 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:51:00.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.817+0000 7fd08643a740 1 -- 172.21.15.84:0/208007548 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d924f359e0 con 0x55d924b28da0 2024-09-21T03:51:00.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.817+0000 7fd07dc62640 1 --2- 172.21.15.84:0/208007548 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55d924b28da0 0x55d924fc76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.817+0000 7fd07dc62640 1 --2- 172.21.15.84:0/208007548 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55d924b28da0 0x55d924fc76e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=37238f2c228ba293 server_cookie=5043cf5a66b69897 in_seq=0 out_seq=0 2024-09-21T03:51:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.817+0000 7fd05d7fa640 10 client.17103 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:51:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.818+0000 7fd05d7fa640 1 -- 172.21.15.84:0/208007548 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d924f359e0 con 0x55d924b28da0 2024-09-21T03:51:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.818+0000 7fd05d7fa640 10 client.17103 handle_command_reply: tid=0 2024-09-21T03:51:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.818+0000 7fd08643a740 1 client.17103 shutdown 2024-09-21T03:51:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.818+0000 7fd08643a740 1 -- 172.21.15.84:0/208007548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b74390 msgr2=0x55d924f4cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.818+0000 7fd08643a740 1 --2- 172.21.15.84:0/208007548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b74390 0x55d924f4cd20 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fd06c0cd8a0 tx=0x7fd06c0db5f0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.818+0000 7fd08643a740 1 -- 172.21.15.84:0/208007548 shutdown_connections 2024-09-21T03:51:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.818+0000 7fd08643a740 1 --2- 172.21.15.84:0/208007548 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55d924b28da0 0x55d924fc76e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.818+0000 7fd08643a740 1 --2- 172.21.15.84:0/208007548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d924b95070 0x55d924fc3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.818+0000 7fd05d7fa640 0 client.17103 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:51:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.818+0000 7fd08643a740 1 --2- 172.21.15.84:0/208007548 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d924b74390 0x55d924f4cd20 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.818+0000 7fd08643a740 1 --2- 172.21.15.84:0/208007548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d924b6c1b0 0x55d924f4c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.818+0000 7fd08643a740 1 -- 172.21.15.84:0/208007548 >> 172.21.15.84:0/208007548 conn(0x55d924b89460 msgr2=0x55d924f3d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:00.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.818+0000 7fd08643a740 1 -- 172.21.15.84:0/208007548 shutdown_connections 2024-09-21T03:51:00.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.818+0000 7fd08643a740 1 -- 172.21.15.84:0/208007548 wait complete. 2024-09-21T03:51:00.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.818+0000 7fd08643a740 20 client.17103 trim_cache size 0 max 16384 2024-09-21T03:51:00.825 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:51:00.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.819+0000 7fd07fec6640 1 -- 172.21.15.84:0/387007644 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd0600b6680 msgr2=0x7fd0600b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:00.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.819+0000 7fd07fec6640 1 --2- 172.21.15.84:0/387007644 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd0600b6680 0x7fd0600b8b90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd07001f000 tx=0x7fd070020000 comp rx=0 tx=0).stop 2024-09-21T03:51:00.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.819+0000 7fd07fec6640 1 -- 172.21.15.84:0/387007644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0781094e0 msgr2=0x7fd078075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:00.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.819+0000 7fd07fec6640 1 --2- 172.21.15.84:0/387007644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0781094e0 0x7fd078075c50 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fd06c02a930 tx=0x7fd06c004270 comp rx=0 tx=0).stop 2024-09-21T03:51:00.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.819+0000 7fd07fec6640 1 -- 172.21.15.84:0/387007644 shutdown_connections 2024-09-21T03:51:00.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.819+0000 7fd07fec6640 1 --2- 172.21.15.84:0/387007644 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd0600b6680 0x7fd0600b8b90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.819+0000 7fd07fec6640 1 --2- 172.21.15.84:0/387007644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd078109e30 0x7fd078076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.819+0000 7fd07fec6640 1 --2- 172.21.15.84:0/387007644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0781094e0 0x7fd078075c50 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.819+0000 7fd07fec6640 1 --2- 172.21.15.84:0/387007644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd078103ba0 0x7fd078075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:00.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.819+0000 7fd07fec6640 1 -- 172.21.15.84:0/387007644 >> 172.21.15.84:0/387007644 conn(0x7fd0780ff630 msgr2=0x7fd078101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:00.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.819+0000 7fd07fec6640 1 -- 172.21.15.84:0/387007644 shutdown_connections 2024-09-21T03:51:00.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:00.819+0000 7fd07fec6640 1 -- 172.21.15.84:0/387007644 wait complete. 2024-09-21T03:51:00.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:00 smithi174 ceph-mon[34403]: pgmap v584: 97 pgs: 97 active+clean; 16 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 9 op/s 2024-09-21T03:51:00.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:00 smithi172 ceph-mon[34821]: pgmap v584: 97 pgs: 97 active+clean; 16 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 9 op/s 2024-09-21T03:51:01.715 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:51:01.957 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:51:02.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.455+0000 7f9a1e89c640 1 -- 172.21.15.84:0/1836064604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a18102000 msgr2=0x7f9a18102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:02.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.455+0000 7f9a1e89c640 1 --2- 172.21.15.84:0/1836064604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a18102000 0x7f9a18102410 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f9a08009900 tx=0x7f9a0802a410 comp rx=0 tx=0).stop 2024-09-21T03:51:02.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.455+0000 7f9a1e89c640 1 -- 172.21.15.84:0/1836064604 shutdown_connections 2024-09-21T03:51:02.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.455+0000 7f9a1e89c640 1 --2- 172.21.15.84:0/1836064604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a18106c30 0x7f9a18110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.455+0000 7f9a1e89c640 1 --2- 172.21.15.84:0/1836064604 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a181062e0 0x7f9a181066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.455+0000 7f9a1e89c640 1 --2- 172.21.15.84:0/1836064604 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a18102000 0x7f9a18102410 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.455+0000 7f9a1e89c640 1 -- 172.21.15.84:0/1836064604 >> 172.21.15.84:0/1836064604 conn(0x7f9a18079e40 msgr2=0x7f9a1807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:02.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.455+0000 7f9a1e89c640 1 -- 172.21.15.84:0/1836064604 shutdown_connections 2024-09-21T03:51:02.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.455+0000 7f9a1e89c640 1 -- 172.21.15.84:0/1836064604 wait complete. 2024-09-21T03:51:02.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.455+0000 7f9a1e89c640 1 Processor -- start 2024-09-21T03:51:02.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.455+0000 7f9a1e89c640 1 -- start start 2024-09-21T03:51:02.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.456+0000 7f9a1e89c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a18102000 0x7f9a1819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.456+0000 7f9a1e89c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a181062e0 0x7f9a1819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.456+0000 7f9a1e89c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a18106c30 0x7f9a1819fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.456+0000 7f9a1e89c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9a18113bb0 con 0x7f9a18102000 2024-09-21T03:51:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.456+0000 7f9a1e89c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9a18113a30 con 0x7f9a18106c30 2024-09-21T03:51:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.456+0000 7f9a1e89c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9a18113d30 con 0x7f9a181062e0 2024-09-21T03:51:02.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.456+0000 7f9a17fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a18102000 0x7f9a1819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:02.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.456+0000 7f9a17fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a18102000 0x7f9a1819a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33832/0 (socket says 172.21.15.84:33832) 2024-09-21T03:51:02.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.456+0000 7f9a17fff640 1 -- 172.21.15.84:0/2882430421 learned_addr learned my addr 172.21.15.84:0/2882430421 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:02.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.456+0000 7f9a1ce39640 1 --2- 172.21.15.84:0/2882430421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a18106c30 0x7f9a1819fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:02.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.456+0000 7f9a177fe640 1 --2- 172.21.15.84:0/2882430421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a181062e0 0x7f9a1819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:02.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.456+0000 7f9a17fff640 1 -- 172.21.15.84:0/2882430421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a181062e0 msgr2=0x7f9a1819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:02.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.456+0000 7f9a17fff640 1 --2- 172.21.15.84:0/2882430421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a181062e0 0x7f9a1819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.456+0000 7f9a17fff640 1 -- 172.21.15.84:0/2882430421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a18106c30 msgr2=0x7f9a1819fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:02.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.456+0000 7f9a17fff640 1 --2- 172.21.15.84:0/2882430421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a18106c30 0x7f9a1819fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.456+0000 7f9a17fff640 1 -- 172.21.15.84:0/2882430421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a181a0530 con 0x7f9a18102000 2024-09-21T03:51:02.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.456+0000 7f9a177fe640 1 --2- 172.21.15.84:0/2882430421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a181062e0 0x7f9a1819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:51:02.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.456+0000 7f9a17fff640 1 --2- 172.21.15.84:0/2882430421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a18102000 0x7f9a1819a5c0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f9a08006010 tx=0x7f9a080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:02.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.457+0000 7f9a157fa640 1 -- 172.21.15.84:0/2882430421 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0803f030 con 0x7f9a18102000 2024-09-21T03:51:02.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.457+0000 7f9a1e89c640 1 -- 172.21.15.84:0/2882430421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a181a07c0 con 0x7f9a18102000 2024-09-21T03:51:02.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.457+0000 7f9a157fa640 1 -- 172.21.15.84:0/2882430421 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a08003800 con 0x7f9a18102000 2024-09-21T03:51:02.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.457+0000 7f9a157fa640 1 -- 172.21.15.84:0/2882430421 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08035070 con 0x7f9a18102000 2024-09-21T03:51:02.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.457+0000 7f9a1e89c640 1 -- 172.21.15.84:0/2882430421 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a181a6f80 con 0x7f9a18102000 2024-09-21T03:51:02.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.459+0000 7f9a24e10740 1 Processor -- start 2024-09-21T03:51:02.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.459+0000 7f9a157fa640 1 -- 172.21.15.84:0/2882430421 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f9a08003cb0 con 0x7f9a18102000 2024-09-21T03:51:02.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.459+0000 7f9a24e10740 1 -- start start 2024-09-21T03:51:02.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a24e10740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f439a5070 0x558f43d4c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:02.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a24e10740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558f4397c1b0 0x558f43d4cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:02.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a24e10740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f43984390 0x558f43d4d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:02.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a24e10740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558f43cc2ea0 con 0x558f439a5070 2024-09-21T03:51:02.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a24e10740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558f43cb22d0 con 0x558f43984390 2024-09-21T03:51:02.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a24e10740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558f43cb60e0 con 0x558f4397c1b0 2024-09-21T03:51:02.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a1ce39640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f439a5070 0x558f43d4c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:02.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a1ce39640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f439a5070 0x558f43d4c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33844/0 (socket says 172.21.15.84:33844) 2024-09-21T03:51:02.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a1ce39640 1 -- 172.21.15.84:0/2479240194 learned_addr learned my addr 172.21.15.84:0/2479240194 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:02.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a17fff640 1 --2- 172.21.15.84:0/2479240194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558f4397c1b0 0x558f43d4cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:02.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a177fe640 1 --2- 172.21.15.84:0/2479240194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f43984390 0x558f43d4d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:02.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a1ce39640 1 -- 172.21.15.84:0/2479240194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558f4397c1b0 msgr2=0x558f43d4cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:02.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a1ce39640 1 --2- 172.21.15.84:0/2479240194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558f4397c1b0 0x558f43d4cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a1ce39640 1 -- 172.21.15.84:0/2479240194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f43984390 msgr2=0x558f43d4d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:02.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a157fa640 1 --2- 172.21.15.84:0/2882430421 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9a000b6680 0x7f9a000b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:02.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a1ce39640 1 --2- 172.21.15.84:0/2479240194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f43984390 0x558f43d4d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a1ce39640 1 -- 172.21.15.84:0/2479240194 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f43a10650 con 0x558f439a5070 2024-09-21T03:51:02.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a177fe640 1 --2- 172.21.15.84:0/2479240194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f43984390 0x558f43d4d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:51:02.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a157fa640 1 -- 172.21.15.84:0/2882430421 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f9a08108170 con 0x7f9a18102000 2024-09-21T03:51:02.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a1ce39640 1 --2- 172.21.15.84:0/2479240194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f439a5070 0x558f43d4c6a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9a10009f20 tx=0x7f9a1000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5894c377bb3da11 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:02.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.460+0000 7f9a1ce39640 1 --2- 172.21.15.84:0/2882430421 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9a000b6680 0x7f9a000b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:02.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.461+0000 7f99fe7fc640 1 -- 172.21.15.84:0/2479240194 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1001a070 con 0x558f439a5070 2024-09-21T03:51:02.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.461+0000 7f99fe7fc640 1 -- 172.21.15.84:0/2479240194 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a10015a00 con 0x558f439a5070 2024-09-21T03:51:02.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.461+0000 7f99fe7fc640 1 -- 172.21.15.84:0/2479240194 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1000a900 con 0x558f439a5070 2024-09-21T03:51:02.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.461+0000 7f9a24e10740 1 -- 172.21.15.84:0/2479240194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f439a5070 msgr2=0x558f43d4c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:02.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.462+0000 7f9a24e10740 1 --2- 172.21.15.84:0/2479240194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f439a5070 0x558f43d4c6a0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9a10009f20 tx=0x7f9a1000c8b0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.462+0000 7f9a1ce39640 1 --2- 172.21.15.84:0/2882430421 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9a000b6680 0x7f9a000b8b90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9a1000c3f0 tx=0x7f9a10013000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:02.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.462+0000 7f9a24e10740 1 -- 172.21.15.84:0/2479240194 shutdown_connections 2024-09-21T03:51:02.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.462+0000 7f9a24e10740 1 --2- 172.21.15.84:0/2479240194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f43984390 0x558f43d4d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.462+0000 7f9a24e10740 1 --2- 172.21.15.84:0/2479240194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558f4397c1b0 0x558f43d4cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.462+0000 7f9a24e10740 1 --2- 172.21.15.84:0/2479240194 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f439a5070 0x558f43d4c6a0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.462+0000 7f9a24e10740 1 -- 172.21.15.84:0/2479240194 >> 172.21.15.84:0/2479240194 conn(0x558f43999460 msgr2=0x558f43d4a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:02.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.462+0000 7f9a24e10740 1 -- 172.21.15.84:0/2479240194 shutdown_connections 2024-09-21T03:51:02.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.462+0000 7f9a24e10740 1 -- 172.21.15.84:0/2479240194 wait complete. 2024-09-21T03:51:02.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.462+0000 7f9a24e10740 1 -- start start 2024-09-21T03:51:02.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.462+0000 7f9a24e10740 1 Processor -- start 2024-09-21T03:51:02.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f9a24e10740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558f4397c1b0 0x558f43d57d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:02.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f9a24e10740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f43984390 0x558f43d582c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:02.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f9a24e10740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f439a5070 0x558f43d64170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:02.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f9a24e10740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558f43b13700 con 0x558f43984390 2024-09-21T03:51:02.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f9a24e10740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558f43c4d160 con 0x558f439a5070 2024-09-21T03:51:02.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f9a24e10740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558f43d5ae80 con 0x558f4397c1b0 2024-09-21T03:51:02.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f9a24e10740 10 client.0 _ll_register_callbacks cb 0x558f43c669e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:51:02.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f9a177fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f43984390 0x558f43d582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:02.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f9a177fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f43984390 0x558f43d582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33850/0 (socket says 172.21.15.84:33850) 2024-09-21T03:51:02.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f9a177fe640 1 -- 172.21.15.84:0/1210805830 learned_addr learned my addr 172.21.15.84:0/1210805830 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:02.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f9a17fff640 1 --2- 172.21.15.84:0/1210805830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558f4397c1b0 0x558f43d57d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:02.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f9a1ce39640 1 --2- 172.21.15.84:0/1210805830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f439a5070 0x558f43d64170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:02.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f9a177fe640 1 -- 172.21.15.84:0/1210805830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558f4397c1b0 msgr2=0x558f43d57d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:02.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f9a177fe640 1 --2- 172.21.15.84:0/1210805830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558f4397c1b0 0x558f43d57d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f9a177fe640 1 -- 172.21.15.84:0/1210805830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f439a5070 msgr2=0x558f43d64170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:02.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f9a177fe640 1 --2- 172.21.15.84:0/1210805830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f439a5070 0x558f43d64170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f9a177fe640 1 -- 172.21.15.84:0/1210805830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f43c7ac90 con 0x558f43984390 2024-09-21T03:51:02.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f9a177fe640 1 --2- 172.21.15.84:0/1210805830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f43984390 0x558f43d582c0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00d270 tx=0x7f9a0c00d730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743aab599ea613d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:02.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f99f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:51:02.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f99f77fe640 1 -- 172.21.15.84:0/1210805830 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c016070 con 0x558f43984390 2024-09-21T03:51:02.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f99f77fe640 1 -- 172.21.15.84:0/1210805830 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f9a0c012870 con 0x558f43984390 2024-09-21T03:51:02.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.463+0000 7f9a24e10740 1 -- 172.21.15.84:0/1210805830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a10015a00 con 0x558f43984390 2024-09-21T03:51:02.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.464+0000 7f99f77fe640 1 -- 172.21.15.84:0/1210805830 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9a0c022050 con 0x558f43984390 2024-09-21T03:51:02.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.464+0000 7f9a24e10740 10 client.17115 fetch_fsmap learned FSMap version 25 2024-09-21T03:51:02.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.464+0000 7f9a24e10740 1 -- 172.21.15.84:0/1210805830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558f43d66b90 con 0x558f43984390 2024-09-21T03:51:02.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.464+0000 7f99f77fe640 1 -- 172.21.15.84:0/1210805830 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a10015a00 con 0x558f43984390 2024-09-21T03:51:02.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.464+0000 7f99f77fe640 1 -- 172.21.15.84:0/1210805830 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9a0c011b10 con 0x558f43984390 2024-09-21T03:51:02.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.464+0000 7f9a24e10740 10 client.17115 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:51:02.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.464+0000 7f9a24e10740 10 client.17115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:51:02.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.464+0000 7f9a24e10740 20 client.17115 populate_metadata read hostname 'smithi084' 2024-09-21T03:51:02.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.464+0000 7f9a24e10740 1 --2- 172.21.15.84:0/1210805830 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558f439639f0 0x558f43d6a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:02.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.464+0000 7f9a24e10740 4 client.17115 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:51:02.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.464+0000 7f9a24e10740 1 -- 172.21.15.84:0/1210805830 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f43cc4df0 con 0x558f439639f0 2024-09-21T03:51:02.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.464+0000 7f9a17fff640 1 --2- 172.21.15.84:0/1210805830 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558f439639f0 0x558f43d6a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:02.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.465+0000 7f9a17fff640 1 --2- 172.21.15.84:0/1210805830 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558f439639f0 0x558f43d6a0d0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a42937e10b84ff9e server_cookie=6ecfa2b7484aa974 in_seq=0 out_seq=0 2024-09-21T03:51:02.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.465+0000 7f99f77fe640 10 client.17115 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:02.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.466+0000 7f99f77fe640 1 -- 172.21.15.84:0/1210805830 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558f43cc4df0 con 0x558f439639f0 2024-09-21T03:51:02.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.466+0000 7f99f77fe640 10 client.17115 handle_command_reply: tid=0 2024-09-21T03:51:02.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.466+0000 7f9a24e10740 1 client.17115 shutdown 2024-09-21T03:51:02.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.466+0000 7f9a24e10740 1 -- 172.21.15.84:0/1210805830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f43984390 msgr2=0x558f43d582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:02.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.466+0000 7f9a24e10740 1 --2- 172.21.15.84:0/1210805830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f43984390 0x558f43d582c0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00d270 tx=0x7f9a0c00d730 comp rx=0 tx=0).stop 2024-09-21T03:51:02.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.466+0000 7f9a24e10740 1 -- 172.21.15.84:0/1210805830 shutdown_connections 2024-09-21T03:51:02.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.466+0000 7f9a24e10740 1 --2- 172.21.15.84:0/1210805830 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558f439639f0 0x558f43d6a0d0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.466+0000 7f9a24e10740 1 --2- 172.21.15.84:0/1210805830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f439a5070 0x558f43d64170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.466+0000 7f9a24e10740 1 --2- 172.21.15.84:0/1210805830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f43984390 0x558f43d582c0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.466+0000 7f9a24e10740 1 --2- 172.21.15.84:0/1210805830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558f4397c1b0 0x558f43d57d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.466+0000 7f9a24e10740 1 -- 172.21.15.84:0/1210805830 >> 172.21.15.84:0/1210805830 conn(0x558f43999460 msgr2=0x558f43d4f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:02.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.466+0000 7f99f77fe640 0 client.17115 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:02.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.466+0000 7f9a24e10740 1 -- 172.21.15.84:0/1210805830 shutdown_connections 2024-09-21T03:51:02.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.466+0000 7f9a24e10740 1 -- 172.21.15.84:0/1210805830 wait complete. 2024-09-21T03:51:02.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.466+0000 7f9a24e10740 20 client.17115 trim_cache size 0 max 16384 2024-09-21T03:51:02.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.479+0000 7f9a24e10740 1 Processor -- start 2024-09-21T03:51:02.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.479+0000 7f9a24e10740 1 -- start start 2024-09-21T03:51:02.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.480+0000 7f9a24e10740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f4397c1b0 0x558f43d58240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:02.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.480+0000 7f9a24e10740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558f43984390 0x558f43d64070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:02.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.480+0000 7f9a24e10740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f439a5070 0x558f43d54f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:02.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.480+0000 7f9a24e10740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9a181b1fa0 con 0x558f439a5070 2024-09-21T03:51:02.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.480+0000 7f9a24e10740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9a181af870 con 0x558f4397c1b0 2024-09-21T03:51:02.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.480+0000 7f9a24e10740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9a181ad6e0 con 0x558f43984390 2024-09-21T03:51:02.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.480+0000 7f9a1ce39640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f439a5070 0x558f43d54f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:02.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.480+0000 7f9a1ce39640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f439a5070 0x558f43d54f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33852/0 (socket says 172.21.15.84:33852) 2024-09-21T03:51:02.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.480+0000 7f9a1ce39640 1 -- 172.21.15.84:0/1533947836 learned_addr learned my addr 172.21.15.84:0/1533947836 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:02.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.480+0000 7f9a177fe640 1 --2- 172.21.15.84:0/1533947836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558f43984390 0x558f43d64070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:02.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.480+0000 7f9a17fff640 1 --2- 172.21.15.84:0/1533947836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f4397c1b0 0x558f43d58240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:02.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.480+0000 7f9a1ce39640 1 -- 172.21.15.84:0/1533947836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558f43984390 msgr2=0x558f43d64070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:02.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.480+0000 7f9a1ce39640 1 --2- 172.21.15.84:0/1533947836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558f43984390 0x558f43d64070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.480+0000 7f9a1ce39640 1 -- 172.21.15.84:0/1533947836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f4397c1b0 msgr2=0x558f43d58240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:02.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.480+0000 7f9a1ce39640 1 --2- 172.21.15.84:0/1533947836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f4397c1b0 0x558f43d58240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.480+0000 7f9a1ce39640 1 -- 172.21.15.84:0/1533947836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f43d58e20 con 0x558f439a5070 2024-09-21T03:51:02.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.480+0000 7f9a17fff640 1 --2- 172.21.15.84:0/1533947836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f4397c1b0 0x558f43d58240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:51:02.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.480+0000 7f9a1ce39640 1 --2- 172.21.15.84:0/1533947836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f439a5070 0x558f43d54f70 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f9a10021000 tx=0x7f9a10017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1969800d5506481f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:02.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.480+0000 7f99fdffb640 1 -- 172.21.15.84:0/1533947836 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a10024070 con 0x558f439a5070 2024-09-21T03:51:02.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.481+0000 7f99fdffb640 1 -- 172.21.15.84:0/1533947836 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a1002e070 con 0x558f439a5070 2024-09-21T03:51:02.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.481+0000 7f99fdffb640 1 -- 172.21.15.84:0/1533947836 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1001a040 con 0x558f439a5070 2024-09-21T03:51:02.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.481+0000 7f9a24e10740 1 -- 172.21.15.84:0/1533947836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f439a5070 msgr2=0x558f43d54f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:02.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.481+0000 7f9a24e10740 1 --2- 172.21.15.84:0/1533947836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f439a5070 0x558f43d54f70 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f9a10021000 tx=0x7f9a10017040 comp rx=0 tx=0).stop 2024-09-21T03:51:02.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.481+0000 7f9a24e10740 1 -- 172.21.15.84:0/1533947836 shutdown_connections 2024-09-21T03:51:02.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.481+0000 7f9a24e10740 1 --2- 172.21.15.84:0/1533947836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f439a5070 0x558f43d54f70 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.481+0000 7f9a24e10740 1 --2- 172.21.15.84:0/1533947836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558f43984390 0x558f43d64070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.481+0000 7f9a24e10740 1 --2- 172.21.15.84:0/1533947836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f4397c1b0 0x558f43d58240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.481+0000 7f9a24e10740 1 -- 172.21.15.84:0/1533947836 >> 172.21.15.84:0/1533947836 conn(0x558f43999460 msgr2=0x558f43d57b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.481+0000 7f9a24e10740 1 -- 172.21.15.84:0/1533947836 shutdown_connections 2024-09-21T03:51:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.482+0000 7f9a24e10740 1 -- 172.21.15.84:0/1533947836 wait complete. 2024-09-21T03:51:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.482+0000 7f9a24e10740 1 -- start start 2024-09-21T03:51:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.482+0000 7f9a24e10740 1 Processor -- start 2024-09-21T03:51:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.482+0000 7f9a24e10740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f4397c1b0 0x558f43d5bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.482+0000 7f9a24e10740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f43984390 0x558f43d5c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.482+0000 7f9a24e10740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558f439a5070 0x558f43d5ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.482+0000 7f9a24e10740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9a181add30 con 0x558f43984390 2024-09-21T03:51:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.482+0000 7f9a24e10740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9a181af1a0 con 0x558f4397c1b0 2024-09-21T03:51:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.482+0000 7f9a24e10740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9a181ae400 con 0x558f439a5070 2024-09-21T03:51:02.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.483+0000 7f9a24e10740 10 client.0 _ll_register_callbacks cb 0x7f9a0c00b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:51:02.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.483+0000 7f9a177fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f43984390 0x558f43d5c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:02.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.483+0000 7f9a177fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f43984390 0x558f43d5c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33856/0 (socket says 172.21.15.84:33856) 2024-09-21T03:51:02.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.483+0000 7f9a177fe640 1 -- 172.21.15.84:0/585574730 learned_addr learned my addr 172.21.15.84:0/585574730 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:02.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.483+0000 7f9a1ce39640 1 --2- 172.21.15.84:0/585574730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558f439a5070 0x558f43d5ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:02.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.483+0000 7f9a17fff640 1 --2- 172.21.15.84:0/585574730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f4397c1b0 0x558f43d5bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:02.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.483+0000 7f9a177fe640 1 -- 172.21.15.84:0/585574730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558f439a5070 msgr2=0x558f43d5ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:02.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.483+0000 7f9a177fe640 1 --2- 172.21.15.84:0/585574730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558f439a5070 0x558f43d5ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.483+0000 7f9a177fe640 1 -- 172.21.15.84:0/585574730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f4397c1b0 msgr2=0x558f43d5bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:02.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.483+0000 7f9a177fe640 1 --2- 172.21.15.84:0/585574730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f4397c1b0 0x558f43d5bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.483+0000 7f9a177fe640 1 -- 172.21.15.84:0/585574730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f43dd3a90 con 0x558f43984390 2024-09-21T03:51:02.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.483+0000 7f9a177fe640 1 --2- 172.21.15.84:0/585574730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f43984390 0x558f43d5c510 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c01a4a0 tx=0x7f9a0c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9018fa7d6f690021 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:02.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.483+0000 7f99f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:51:02.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.483+0000 7f99f77fe640 1 -- 172.21.15.84:0/585574730 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c016040 con 0x558f43984390 2024-09-21T03:51:02.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.483+0000 7f99f77fe640 1 -- 172.21.15.84:0/585574730 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7f9a0c012bc0 con 0x558f43984390 2024-09-21T03:51:02.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.483+0000 7f9a24e10740 1 -- 172.21.15.84:0/585574730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a1002e070 con 0x558f43984390 2024-09-21T03:51:02.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.484+0000 7f99f77fe640 1 -- 172.21.15.84:0/585574730 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9a0c012dc0 con 0x558f43984390 2024-09-21T03:51:02.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.484+0000 7f9a24e10740 10 client.17121 fetch_fsmap learned FSMap version 25 2024-09-21T03:51:02.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.484+0000 7f9a24e10740 1 -- 172.21.15.84:0/585574730 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558f43dd4ba0 con 0x558f43984390 2024-09-21T03:51:02.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.484+0000 7f99f77fe640 1 -- 172.21.15.84:0/585574730 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a1002e070 con 0x558f43984390 2024-09-21T03:51:02.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.484+0000 7f99f77fe640 1 -- 172.21.15.84:0/585574730 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9a0c01a640 con 0x558f43984390 2024-09-21T03:51:02.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.484+0000 7f9a24e10740 10 client.17121 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:51:02.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.484+0000 7f9a24e10740 10 client.17121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:51:02.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.484+0000 7f9a24e10740 20 client.17121 populate_metadata read hostname 'smithi084' 2024-09-21T03:51:02.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.484+0000 7f9a24e10740 1 --2- 172.21.15.84:0/585574730 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558f43938da0 0x558f43dd7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:02.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.484+0000 7f9a24e10740 4 client.17121 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:51:02.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.484+0000 7f9a24e10740 1 -- 172.21.15.84:0/585574730 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558f43cc08a0 con 0x558f43938da0 2024-09-21T03:51:02.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.485+0000 7f9a17fff640 1 --2- 172.21.15.84:0/585574730 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558f43938da0 0x558f43dd7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:02.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.485+0000 7f99f77fe640 10 client.17121 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:02.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.485+0000 7f9a17fff640 1 --2- 172.21.15.84:0/585574730 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558f43938da0 0x558f43dd7340 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=293bb7a3fa3caf00 server_cookie=5606a430c3f1e801 in_seq=0 out_seq=0 2024-09-21T03:51:02.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.485+0000 7f99f77fe640 1 -- 172.21.15.84:0/585574730 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558f43cc08a0 con 0x558f43938da0 2024-09-21T03:51:02.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.485+0000 7f99f77fe640 10 client.17121 handle_command_reply: tid=0 2024-09-21T03:51:02.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.485+0000 7f9a24e10740 1 client.17121 shutdown 2024-09-21T03:51:02.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.485+0000 7f9a24e10740 1 -- 172.21.15.84:0/585574730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f43984390 msgr2=0x558f43d5c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:02.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.485+0000 7f9a24e10740 1 --2- 172.21.15.84:0/585574730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f43984390 0x558f43d5c510 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c01a4a0 tx=0x7f9a0c00dc30 comp rx=0 tx=0).stop 2024-09-21T03:51:02.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.485+0000 7f9a24e10740 1 -- 172.21.15.84:0/585574730 shutdown_connections 2024-09-21T03:51:02.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.485+0000 7f9a24e10740 1 --2- 172.21.15.84:0/585574730 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558f43938da0 0x558f43dd7340 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.485+0000 7f9a24e10740 1 --2- 172.21.15.84:0/585574730 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558f439a5070 0x558f43d5ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.485+0000 7f9a24e10740 1 --2- 172.21.15.84:0/585574730 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558f43984390 0x558f43d5c510 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.485+0000 7f9a24e10740 1 --2- 172.21.15.84:0/585574730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558f4397c1b0 0x558f43d5bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.485+0000 7f9a24e10740 1 -- 172.21.15.84:0/585574730 >> 172.21.15.84:0/585574730 conn(0x558f43999460 msgr2=0x558f43d4d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:02.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.485+0000 7f99f77fe640 0 client.17121 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:02.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.486+0000 7f9a24e10740 1 -- 172.21.15.84:0/585574730 shutdown_connections 2024-09-21T03:51:02.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.486+0000 7f9a24e10740 1 -- 172.21.15.84:0/585574730 wait complete. 2024-09-21T03:51:02.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.486+0000 7f9a24e10740 20 client.17121 trim_cache size 0 max 16384 2024-09-21T03:51:02.501 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:51:02.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.486+0000 7f9a1e89c640 1 -- 172.21.15.84:0/2882430421 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9a000b6680 msgr2=0x7f9a000b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:02.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.486+0000 7f9a1e89c640 1 --2- 172.21.15.84:0/2882430421 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9a000b6680 0x7f9a000b8b90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9a1000c3f0 tx=0x7f9a10013000 comp rx=0 tx=0).stop 2024-09-21T03:51:02.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.486+0000 7f9a1e89c640 1 -- 172.21.15.84:0/2882430421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a18102000 msgr2=0x7f9a1819a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:02.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.486+0000 7f9a1e89c640 1 --2- 172.21.15.84:0/2882430421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a18102000 0x7f9a1819a5c0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f9a08006010 tx=0x7f9a080042f0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.486+0000 7f9a1e89c640 1 -- 172.21.15.84:0/2882430421 shutdown_connections 2024-09-21T03:51:02.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.486+0000 7f9a1e89c640 1 --2- 172.21.15.84:0/2882430421 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9a000b6680 0x7f9a000b8b90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.486+0000 7f9a1e89c640 1 --2- 172.21.15.84:0/2882430421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a18106c30 0x7f9a1819fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.486+0000 7f9a1e89c640 1 --2- 172.21.15.84:0/2882430421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a181062e0 0x7f9a1819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.486+0000 7f9a1e89c640 1 --2- 172.21.15.84:0/2882430421 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9a18102000 0x7f9a1819a5c0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:02.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.486+0000 7f9a1e89c640 1 -- 172.21.15.84:0/2882430421 >> 172.21.15.84:0/2882430421 conn(0x7f9a18079e40 msgr2=0x7f9a181080c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:02.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.487+0000 7f9a1e89c640 1 -- 172.21.15.84:0/2882430421 shutdown_connections 2024-09-21T03:51:02.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:02.487+0000 7f9a1e89c640 1 -- 172.21.15.84:0/2882430421 wait complete. 2024-09-21T03:51:02.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:02 smithi084 ceph-mon[30941]: pgmap v585: 97 pgs: 97 active+clean; 16 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 64 KiB/s wr, 13 op/s 2024-09-21T03:51:02.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:02 smithi174 ceph-mon[34403]: pgmap v585: 97 pgs: 97 active+clean; 16 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 64 KiB/s wr, 13 op/s 2024-09-21T03:51:02.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:02 smithi172 ceph-mon[34821]: pgmap v585: 97 pgs: 97 active+clean; 16 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 64 KiB/s wr, 13 op/s 2024-09-21T03:51:04.293 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:51:04.293 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:51:04.552 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:51:04.673 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:04 smithi084 ceph-mon[30941]: pgmap v586: 97 pgs: 97 active+clean; 16 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 108 KiB/s wr, 29 op/s 2024-09-21T03:51:04.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:04 smithi174 ceph-mon[34403]: pgmap v586: 97 pgs: 97 active+clean; 16 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 108 KiB/s wr, 29 op/s 2024-09-21T03:51:04.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:04 smithi172 ceph-mon[34821]: pgmap v586: 97 pgs: 97 active+clean; 16 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 108 KiB/s wr, 29 op/s 2024-09-21T03:51:05.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.078+0000 7fbb069d2640 1 -- 172.21.15.84:0/2868134552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb001049b0 msgr2=0x7fbb00104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:05.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.078+0000 7fbb069d2640 1 --2- 172.21.15.84:0/2868134552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb001049b0 0x7fbb00104dc0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0009900 tx=0x7fbaf002a410 comp rx=0 tx=0).stop 2024-09-21T03:51:05.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.078+0000 7fbb069d2640 1 -- 172.21.15.84:0/2868134552 shutdown_connections 2024-09-21T03:51:05.083 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.078+0000 7fbb069d2640 1 --2- 172.21.15.84:0/2868134552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb0010de10 0x7fbb00110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.078+0000 7fbb069d2640 1 --2- 172.21.15.84:0/2868134552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb00105300 0x7fbb0010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.078+0000 7fbb069d2640 1 --2- 172.21.15.84:0/2868134552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb001049b0 0x7fbb00104dc0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.078+0000 7fbb069d2640 1 -- 172.21.15.84:0/2868134552 >> 172.21.15.84:0/2868134552 conn(0x7fbb00079730 msgr2=0x7fbb00079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:05.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.078+0000 7fbb069d2640 1 -- 172.21.15.84:0/2868134552 shutdown_connections 2024-09-21T03:51:05.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.078+0000 7fbb069d2640 1 -- 172.21.15.84:0/2868134552 wait complete. 2024-09-21T03:51:05.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.079+0000 7fbb069d2640 1 Processor -- start 2024-09-21T03:51:05.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.079+0000 7fbb069d2640 1 -- start start 2024-09-21T03:51:05.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.079+0000 7fbb069d2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb001049b0 0x7fbb0019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:05.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.079+0000 7fbb069d2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb00105300 0x7fbb0019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:05.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.079+0000 7fbb069d2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb0010de10 0x7fbb0019fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:05.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.079+0000 7fbb069d2640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbb00113ba0 con 0x7fbb001049b0 2024-09-21T03:51:05.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.079+0000 7fbb069d2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb00113a20 con 0x7fbb00105300 2024-09-21T03:51:05.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.079+0000 7fbb069d2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbb00113d20 con 0x7fbb0010de10 2024-09-21T03:51:05.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.079+0000 7fbafffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb001049b0 0x7fbb0019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:05.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.079+0000 7fbafffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb001049b0 0x7fbb0019a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33878/0 (socket says 172.21.15.84:33878) 2024-09-21T03:51:05.084 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.079+0000 7fbafffff640 1 -- 172.21.15.84:0/4286058076 learned_addr learned my addr 172.21.15.84:0/4286058076 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:05.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.080+0000 7fbaf7fff640 1 --2- 172.21.15.84:0/4286058076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb00105300 0x7fbb0019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:05.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.080+0000 7fbb04f6f640 1 --2- 172.21.15.84:0/4286058076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb0010de10 0x7fbb0019fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:05.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.080+0000 7fbafffff640 1 -- 172.21.15.84:0/4286058076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb0010de10 msgr2=0x7fbb0019fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:05.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.080+0000 7fbafffff640 1 --2- 172.21.15.84:0/4286058076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb0010de10 0x7fbb0019fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.080+0000 7fbafffff640 1 -- 172.21.15.84:0/4286058076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb00105300 msgr2=0x7fbb0019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:05.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.080+0000 7fbafffff640 1 --2- 172.21.15.84:0/4286058076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb00105300 0x7fbb0019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.080+0000 7fbafffff640 1 -- 172.21.15.84:0/4286058076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb001a0580 con 0x7fbb001049b0 2024-09-21T03:51:05.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.080+0000 7fbafffff640 1 --2- 172.21.15.84:0/4286058076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb001049b0 0x7fbb0019a610 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0031440 tx=0x7fbaf0003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:05.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.080+0000 7fbafdffb640 1 -- 172.21.15.84:0/4286058076 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf003f070 con 0x7fbb001049b0 2024-09-21T03:51:05.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.080+0000 7fbb069d2640 1 -- 172.21.15.84:0/4286058076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb001a0810 con 0x7fbb001049b0 2024-09-21T03:51:05.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.080+0000 7fbafdffb640 1 -- 172.21.15.84:0/4286058076 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaf0031d60 con 0x7fbb001049b0 2024-09-21T03:51:05.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.080+0000 7fbafdffb640 1 -- 172.21.15.84:0/4286058076 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0035030 con 0x7fbb001049b0 2024-09-21T03:51:05.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.080+0000 7fbb069d2640 1 -- 172.21.15.84:0/4286058076 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb001a6fd0 con 0x7fbb001049b0 2024-09-21T03:51:05.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.083+0000 7fbafdffb640 1 -- 172.21.15.84:0/4286058076 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fbaf0042070 con 0x7fbb001049b0 2024-09-21T03:51:05.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.083+0000 7fbb0cf46740 1 Processor -- start 2024-09-21T03:51:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.083+0000 7fbb0cf46740 1 -- start start 2024-09-21T03:51:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.084+0000 7fbb0cf46740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c63c1350 0x5599c6768430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.084+0000 7fbb0cf46740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c6398490 0x5599c6768970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.084+0000 7fbb0cf46740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 0x5599c6768eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.084+0000 7fbb0cf46740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5599c66dee60 con 0x5599c63a0670 2024-09-21T03:51:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.084+0000 7fbb0cf46740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5599c66ce290 con 0x5599c6398490 2024-09-21T03:51:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.084+0000 7fbb0cf46740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5599c66d20a0 con 0x5599c63c1350 2024-09-21T03:51:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.084+0000 7fbaf7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 0x5599c6768eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.084+0000 7fbaf7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 0x5599c6768eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33886/0 (socket says 172.21.15.84:33886) 2024-09-21T03:51:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.084+0000 7fbb04f6f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c63c1350 0x5599c6768430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.084+0000 7fbaf7fff640 1 -- 172.21.15.84:0/1099316878 learned_addr learned my addr 172.21.15.84:0/1099316878 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.084+0000 7fbafffff640 1 --2- 172.21.15.84:0/1099316878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c6398490 0x5599c6768970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.084+0000 7fbaf7fff640 1 -- 172.21.15.84:0/1099316878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c63c1350 msgr2=0x5599c6768430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:05.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.084+0000 7fbaf7fff640 1 --2- 172.21.15.84:0/1099316878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c63c1350 0x5599c6768430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.084+0000 7fbaf7fff640 1 -- 172.21.15.84:0/1099316878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c6398490 msgr2=0x5599c6768970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.084+0000 7fbaf7fff640 1 --2- 172.21.15.84:0/1099316878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c6398490 0x5599c6768970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.084+0000 7fbaf7fff640 1 -- 172.21.15.84:0/1099316878 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599c642c930 con 0x5599c63a0670 2024-09-21T03:51:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.084+0000 7fbb04f6f640 1 --2- 172.21.15.84:0/1099316878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c63c1350 0x5599c6768430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:51:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.084+0000 7fbafdffb640 1 --2- 172.21.15.84:0/4286058076 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbaec0b6680 0x7fbaec0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.085+0000 7fbafffff640 1 --2- 172.21.15.84:0/1099316878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c6398490 0x5599c6768970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:51:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.085+0000 7fbb04f6f640 1 --2- 172.21.15.84:0/4286058076 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbaec0b6680 0x7fbaec0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.085+0000 7fbafdffb640 1 -- 172.21.15.84:0/4286058076 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fbaf01080a0 con 0x7fbb001049b0 2024-09-21T03:51:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.085+0000 7fbb04f6f640 1 --2- 172.21.15.84:0/4286058076 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbaec0b6680 0x7fbaec0b8b90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800f390 tx=0x7fbaf80075a0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.085+0000 7fbaf7fff640 1 --2- 172.21.15.84:0/1099316878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 0x5599c6768eb0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fbae800b790 tx=0x7fbae800bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5fd969edf63aed4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.085+0000 7fbaf67fc640 1 -- 172.21.15.84:0/1099316878 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae800d950 con 0x5599c63a0670 2024-09-21T03:51:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.085+0000 7fbaf67fc640 1 -- 172.21.15.84:0/1099316878 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbae8018070 con 0x5599c63a0670 2024-09-21T03:51:05.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.085+0000 7fbaf67fc640 1 -- 172.21.15.84:0/1099316878 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae80123e0 con 0x5599c63a0670 2024-09-21T03:51:05.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.086+0000 7fbb0cf46740 1 -- 172.21.15.84:0/1099316878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 msgr2=0x5599c6768eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:05.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.086+0000 7fbb0cf46740 1 --2- 172.21.15.84:0/1099316878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 0x5599c6768eb0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fbae800b790 tx=0x7fbae800bc50 comp rx=0 tx=0).stop 2024-09-21T03:51:05.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.086+0000 7fbb0cf46740 1 -- 172.21.15.84:0/1099316878 shutdown_connections 2024-09-21T03:51:05.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.086+0000 7fbb0cf46740 1 --2- 172.21.15.84:0/1099316878 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 0x5599c6768eb0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.086+0000 7fbb0cf46740 1 --2- 172.21.15.84:0/1099316878 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c6398490 0x5599c6768970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.086+0000 7fbb0cf46740 1 --2- 172.21.15.84:0/1099316878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c63c1350 0x5599c6768430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.086+0000 7fbb0cf46740 1 -- 172.21.15.84:0/1099316878 >> 172.21.15.84:0/1099316878 conn(0x5599c63b5740 msgr2=0x5599c6766320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.086+0000 7fbb0cf46740 1 -- 172.21.15.84:0/1099316878 shutdown_connections 2024-09-21T03:51:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.086+0000 7fbb0cf46740 1 -- 172.21.15.84:0/1099316878 wait complete. 2024-09-21T03:51:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.087+0000 7fbb0cf46740 1 -- start start 2024-09-21T03:51:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.087+0000 7fbb0cf46740 1 Processor -- start 2024-09-21T03:51:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.087+0000 7fbb0cf46740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c6398490 0x5599c6773fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.087+0000 7fbb0cf46740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c63a0670 0x5599c67744e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.087+0000 7fbb0cf46740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63c1350 0x5599c677ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.087+0000 7fbb0cf46740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5599c652f890 con 0x5599c63c1350 2024-09-21T03:51:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.087+0000 7fbb0cf46740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5599c6668d40 con 0x5599c63a0670 2024-09-21T03:51:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.087+0000 7fbb0cf46740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5599c6776c10 con 0x5599c6398490 2024-09-21T03:51:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.087+0000 7fbb0cf46740 10 client.0 _ll_register_callbacks cb 0x5599c66ccc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:51:05.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.087+0000 7fbb04f6f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63c1350 0x5599c677ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.087+0000 7fbb04f6f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63c1350 0x5599c677ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33896/0 (socket says 172.21.15.84:33896) 2024-09-21T03:51:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.087+0000 7fbb04f6f640 1 -- 172.21.15.84:0/3234949571 learned_addr learned my addr 172.21.15.84:0/3234949571 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.088+0000 7fbafffff640 1 --2- 172.21.15.84:0/3234949571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c6398490 0x5599c6773fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.088+0000 7fbaf7fff640 1 --2- 172.21.15.84:0/3234949571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c63a0670 0x5599c67744e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.088+0000 7fbb04f6f640 1 -- 172.21.15.84:0/3234949571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c6398490 msgr2=0x5599c6773fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.088+0000 7fbb04f6f640 1 --2- 172.21.15.84:0/3234949571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c6398490 0x5599c6773fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.088+0000 7fbb04f6f640 1 -- 172.21.15.84:0/3234949571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c63a0670 msgr2=0x5599c67744e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.088+0000 7fbb04f6f640 1 --2- 172.21.15.84:0/3234949571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c63a0670 0x5599c67744e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.088+0000 7fbb04f6f640 1 -- 172.21.15.84:0/3234949571 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599c6780490 con 0x5599c63c1350 2024-09-21T03:51:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.088+0000 7fbb04f6f640 1 --2- 172.21.15.84:0/3234949571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63c1350 0x5599c677ff00 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8012bf0 tx=0x7fbaf8004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290efb7f09075d20 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.088+0000 7fbadf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:51:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.088+0000 7fbadf7fe640 1 -- 172.21.15.84:0/3234949571 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8023020 con 0x5599c63c1350 2024-09-21T03:51:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.088+0000 7fbadf7fe640 1 -- 172.21.15.84:0/3234949571 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fbaf8011ba0 con 0x5599c63c1350 2024-09-21T03:51:05.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.088+0000 7fbb0cf46740 1 -- 172.21.15.84:0/3234949571 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbae8018070 con 0x5599c63c1350 2024-09-21T03:51:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.088+0000 7fbadf7fe640 1 -- 172.21.15.84:0/3234949571 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbaf802e050 con 0x5599c63c1350 2024-09-21T03:51:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.088+0000 7fbb0cf46740 10 client.17133 fetch_fsmap learned FSMap version 25 2024-09-21T03:51:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.088+0000 7fbb0cf46740 1 -- 172.21.15.84:0/3234949571 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5599c6782e00 con 0x5599c63c1350 2024-09-21T03:51:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.089+0000 7fbadf7fe640 1 -- 172.21.15.84:0/3234949571 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbae8018070 con 0x5599c63c1350 2024-09-21T03:51:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.089+0000 7fbadf7fe640 1 -- 172.21.15.84:0/3234949571 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbaf8011040 con 0x5599c63c1350 2024-09-21T03:51:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.089+0000 7fbb0cf46740 10 client.17133 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:51:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.089+0000 7fbb0cf46740 10 client.17133 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:51:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.089+0000 7fbb0cf46740 20 client.17133 populate_metadata read hostname 'smithi084' 2024-09-21T03:51:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.089+0000 7fbb0cf46740 1 --2- 172.21.15.84:0/3234949571 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5599c637fcd0 0x5599c6786370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.089+0000 7fbb0cf46740 4 client.17133 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:51:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.089+0000 7fbb0cf46740 1 -- 172.21.15.84:0/3234949571 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599c66e0db0 con 0x5599c637fcd0 2024-09-21T03:51:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.089+0000 7fbafffff640 1 --2- 172.21.15.84:0/3234949571 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5599c637fcd0 0x5599c6786370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:05.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.090+0000 7fbadf7fe640 10 client.17133 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:05.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.090+0000 7fbafffff640 1 --2- 172.21.15.84:0/3234949571 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5599c637fcd0 0x5599c6786370 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5783bb6db525d2c server_cookie=afb9e0f7e9dcb121 in_seq=0 out_seq=0 2024-09-21T03:51:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.091+0000 7fbadf7fe640 1 -- 172.21.15.84:0/3234949571 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5599c66e0db0 con 0x5599c637fcd0 2024-09-21T03:51:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.091+0000 7fbadf7fe640 10 client.17133 handle_command_reply: tid=0 2024-09-21T03:51:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.091+0000 7fbb0cf46740 1 client.17133 shutdown 2024-09-21T03:51:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.091+0000 7fbb0cf46740 1 -- 172.21.15.84:0/3234949571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63c1350 msgr2=0x5599c677ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.091+0000 7fbb0cf46740 1 --2- 172.21.15.84:0/3234949571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63c1350 0x5599c677ff00 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8012bf0 tx=0x7fbaf8004b50 comp rx=0 tx=0).stop 2024-09-21T03:51:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.091+0000 7fbb0cf46740 1 -- 172.21.15.84:0/3234949571 shutdown_connections 2024-09-21T03:51:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.091+0000 7fbb0cf46740 1 --2- 172.21.15.84:0/3234949571 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5599c637fcd0 0x5599c6786370 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.091+0000 7fbb0cf46740 1 --2- 172.21.15.84:0/3234949571 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63c1350 0x5599c677ff00 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.091+0000 7fbb0cf46740 1 --2- 172.21.15.84:0/3234949571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c63a0670 0x5599c67744e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.091+0000 7fbb0cf46740 1 --2- 172.21.15.84:0/3234949571 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c6398490 0x5599c6773fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.091+0000 7fbb0cf46740 1 -- 172.21.15.84:0/3234949571 >> 172.21.15.84:0/3234949571 conn(0x5599c63b5740 msgr2=0x5599c676b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.091+0000 7fbadf7fe640 0 client.17133 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.091+0000 7fbb0cf46740 1 -- 172.21.15.84:0/3234949571 shutdown_connections 2024-09-21T03:51:05.097 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.091+0000 7fbb0cf46740 1 -- 172.21.15.84:0/3234949571 wait complete. 2024-09-21T03:51:05.098 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.091+0000 7fbb0cf46740 20 client.17133 trim_cache size 0 max 16384 2024-09-21T03:51:05.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.108+0000 7fbb0cf46740 1 Processor -- start 2024-09-21T03:51:05.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.108+0000 7fbb0cf46740 1 -- start start 2024-09-21T03:51:05.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.109+0000 7fbb0cf46740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c6398490 0x5599c677fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:05.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.109+0000 7fbb0cf46740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 0x5599c6773630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:05.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.109+0000 7fbb0cf46740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c63c1350 0x5599c6775c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:05.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.109+0000 7fbb0cf46740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbb001b1fb0 con 0x5599c63a0670 2024-09-21T03:51:05.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.109+0000 7fbb0cf46740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb001af880 con 0x5599c63c1350 2024-09-21T03:51:05.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.109+0000 7fbb0cf46740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbb001ad6f0 con 0x5599c6398490 2024-09-21T03:51:05.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.109+0000 7fbaf7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 0x5599c6773630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:05.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.109+0000 7fbaf7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 0x5599c6773630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33906/0 (socket says 172.21.15.84:33906) 2024-09-21T03:51:05.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.109+0000 7fbaf7fff640 1 -- 172.21.15.84:0/3416436601 learned_addr learned my addr 172.21.15.84:0/3416436601 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:05.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.109+0000 7fbafffff640 1 --2- 172.21.15.84:0/3416436601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c6398490 0x5599c677fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:05.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.109+0000 7fbb04f6f640 1 --2- 172.21.15.84:0/3416436601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c63c1350 0x5599c6775c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:05.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.109+0000 7fbaf7fff640 1 -- 172.21.15.84:0/3416436601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c6398490 msgr2=0x5599c677fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:05.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.109+0000 7fbaf7fff640 1 --2- 172.21.15.84:0/3416436601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c6398490 0x5599c677fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.109+0000 7fbaf7fff640 1 -- 172.21.15.84:0/3416436601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c63c1350 msgr2=0x5599c6775c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:05.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.109+0000 7fbaf7fff640 1 --2- 172.21.15.84:0/3416436601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c63c1350 0x5599c6775c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.109+0000 7fbaf7fff640 1 -- 172.21.15.84:0/3416436601 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599c6766c10 con 0x5599c63a0670 2024-09-21T03:51:05.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.109+0000 7fbafffff640 1 --2- 172.21.15.84:0/3416436601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c6398490 0x5599c677fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:51:05.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.109+0000 7fbb04f6f640 1 --2- 172.21.15.84:0/3416436601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c63c1350 0x5599c6775c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:51:05.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.109+0000 7fbaf7fff640 1 --2- 172.21.15.84:0/3416436601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 0x5599c6773630 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fbae800b6e0 tx=0x7fbae800b180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394237d36fb61bab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:05.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.109+0000 7fbaf5ffb640 1 -- 172.21.15.84:0/3416436601 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8013db0 con 0x5599c63a0670 2024-09-21T03:51:05.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.110+0000 7fbaf5ffb640 1 -- 172.21.15.84:0/3416436601 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbae8018040 con 0x5599c63a0670 2024-09-21T03:51:05.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.110+0000 7fbaf5ffb640 1 -- 172.21.15.84:0/3416436601 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8024710 con 0x5599c63a0670 2024-09-21T03:51:05.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.110+0000 7fbb0cf46740 1 -- 172.21.15.84:0/3416436601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 msgr2=0x5599c6773630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:05.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.110+0000 7fbb0cf46740 1 --2- 172.21.15.84:0/3416436601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 0x5599c6773630 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fbae800b6e0 tx=0x7fbae800b180 comp rx=0 tx=0).stop 2024-09-21T03:51:05.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.110+0000 7fbb0cf46740 1 -- 172.21.15.84:0/3416436601 shutdown_connections 2024-09-21T03:51:05.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.110+0000 7fbb0cf46740 1 --2- 172.21.15.84:0/3416436601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c63c1350 0x5599c6775c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.110+0000 7fbb0cf46740 1 --2- 172.21.15.84:0/3416436601 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 0x5599c6773630 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.110+0000 7fbb0cf46740 1 --2- 172.21.15.84:0/3416436601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c6398490 0x5599c677fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.110+0000 7fbb0cf46740 1 -- 172.21.15.84:0/3416436601 >> 172.21.15.84:0/3416436601 conn(0x5599c63b5740 msgr2=0x5599c6769340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:05.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.111+0000 7fbb0cf46740 1 -- 172.21.15.84:0/3416436601 shutdown_connections 2024-09-21T03:51:05.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.111+0000 7fbb0cf46740 1 -- 172.21.15.84:0/3416436601 wait complete. 2024-09-21T03:51:05.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.111+0000 7fbb0cf46740 1 -- start start 2024-09-21T03:51:05.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.111+0000 7fbb0cf46740 1 Processor -- start 2024-09-21T03:51:05.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.111+0000 7fbb0cf46740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c6398490 0x5599c6778770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:05.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.111+0000 7fbb0cf46740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 0x5599c6778d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbb0cf46740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c63c1350 0x5599c67e9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbb0cf46740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbb001add40 con 0x5599c63a0670 2024-09-21T03:51:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbb0cf46740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb001af1b0 con 0x5599c6398490 2024-09-21T03:51:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbb0cf46740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbb001ae410 con 0x5599c63c1350 2024-09-21T03:51:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbb0cf46740 10 client.0 _ll_register_callbacks cb 0x7fbaf800ff90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:51:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbaf7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 0x5599c6778d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbaf7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 0x5599c6778d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33922/0 (socket says 172.21.15.84:33922) 2024-09-21T03:51:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbaf7fff640 1 -- 172.21.15.84:0/2890192235 learned_addr learned my addr 172.21.15.84:0/2890192235 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbafffff640 1 --2- 172.21.15.84:0/2890192235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c6398490 0x5599c6778770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbb04f6f640 1 --2- 172.21.15.84:0/2890192235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c63c1350 0x5599c67e9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbaf7fff640 1 -- 172.21.15.84:0/2890192235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c63c1350 msgr2=0x5599c67e9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbaf7fff640 1 --2- 172.21.15.84:0/2890192235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c63c1350 0x5599c67e9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbaf7fff640 1 -- 172.21.15.84:0/2890192235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c6398490 msgr2=0x5599c6778770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbaf7fff640 1 --2- 172.21.15.84:0/2890192235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c6398490 0x5599c6778770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.117 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbaf7fff640 1 -- 172.21.15.84:0/2890192235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599c67ea420 con 0x5599c63a0670 2024-09-21T03:51:05.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbafffff640 1 --2- 172.21.15.84:0/2890192235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c6398490 0x5599c6778770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:51:05.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbaf7fff640 1 --2- 172.21.15.84:0/2890192235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 0x5599c6778d30 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fbae8026040 tx=0x7fbae800d950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8cb202bdc31a20e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:05.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbadf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:51:05.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbadf7fe640 1 -- 172.21.15.84:0/2890192235 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8033060 con 0x5599c63a0670 2024-09-21T03:51:05.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbadf7fe640 1 -- 172.21.15.84:0/2890192235 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8441+0+0 (secure 0 0 0) 0x7fbae8013480 con 0x5599c63a0670 2024-09-21T03:51:05.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.112+0000 7fbb0cf46740 1 -- 172.21.15.84:0/2890192235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbae8018040 con 0x5599c63a0670 2024-09-21T03:51:05.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.113+0000 7fbadf7fe640 1 -- 172.21.15.84:0/2890192235 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbae8013680 con 0x5599c63a0670 2024-09-21T03:51:05.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.113+0000 7fbb0cf46740 10 client.17139 fetch_fsmap learned FSMap version 25 2024-09-21T03:51:05.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.113+0000 7fbb0cf46740 1 -- 172.21.15.84:0/2890192235 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5599c67f1760 con 0x5599c63a0670 2024-09-21T03:51:05.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.113+0000 7fbadf7fe640 1 -- 172.21.15.84:0/2890192235 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbae8018040 con 0x5599c63a0670 2024-09-21T03:51:05.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.113+0000 7fbadf7fe640 1 -- 172.21.15.84:0/2890192235 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbae801c3f0 con 0x5599c63a0670 2024-09-21T03:51:05.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.113+0000 7fbb0cf46740 10 client.17139 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:51:05.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.113+0000 7fbb0cf46740 10 client.17139 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:51:05.118 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.113+0000 7fbb0cf46740 20 client.17139 populate_metadata read hostname 'smithi084' 2024-09-21T03:51:05.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.113+0000 7fbb0cf46740 1 --2- 172.21.15.84:0/2890192235 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5599c6355080 0x5599c67f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:05.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.113+0000 7fbb0cf46740 4 client.17139 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:51:05.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.113+0000 7fbb0cf46740 1 -- 172.21.15.84:0/2890192235 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5599c66dc860 con 0x5599c6355080 2024-09-21T03:51:05.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.113+0000 7fbafffff640 1 --2- 172.21.15.84:0/2890192235 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5599c6355080 0x5599c67f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:05.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.114+0000 7fbadf7fe640 10 client.17139 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:05.119 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.114+0000 7fbafffff640 1 --2- 172.21.15.84:0/2890192235 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5599c6355080 0x5599c67f3be0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea650d3376faedf4 server_cookie=3a13649336134c02 in_seq=0 out_seq=0 2024-09-21T03:51:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.116+0000 7fbadf7fe640 1 -- 172.21.15.84:0/2890192235 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5599c66dc860 con 0x5599c6355080 2024-09-21T03:51:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.116+0000 7fbadf7fe640 10 client.17139 handle_command_reply: tid=0 2024-09-21T03:51:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.116+0000 7fbb0cf46740 1 client.17139 shutdown 2024-09-21T03:51:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.116+0000 7fbb0cf46740 1 -- 172.21.15.84:0/2890192235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 msgr2=0x5599c6778d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.116+0000 7fbb0cf46740 1 --2- 172.21.15.84:0/2890192235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 0x5599c6778d30 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fbae8026040 tx=0x7fbae800d950 comp rx=0 tx=0).stop 2024-09-21T03:51:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.116+0000 7fbb0cf46740 1 -- 172.21.15.84:0/2890192235 shutdown_connections 2024-09-21T03:51:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.116+0000 7fbb0cf46740 1 --2- 172.21.15.84:0/2890192235 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5599c6355080 0x5599c67f3be0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.116+0000 7fbb0cf46740 1 --2- 172.21.15.84:0/2890192235 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5599c63c1350 0x5599c67e9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.120 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.116+0000 7fbadf7fe640 0 client.17139 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:05.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.116+0000 7fbb0cf46740 1 --2- 172.21.15.84:0/2890192235 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5599c63a0670 0x5599c6778d30 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.116+0000 7fbb0cf46740 1 --2- 172.21.15.84:0/2890192235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599c6398490 0x5599c6778770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.116+0000 7fbb0cf46740 1 -- 172.21.15.84:0/2890192235 >> 172.21.15.84:0/2890192235 conn(0x5599c63b5740 msgr2=0x5599c6775150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:05.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.117+0000 7fbb0cf46740 1 -- 172.21.15.84:0/2890192235 shutdown_connections 2024-09-21T03:51:05.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.117+0000 7fbb0cf46740 1 -- 172.21.15.84:0/2890192235 wait complete. 2024-09-21T03:51:05.121 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.117+0000 7fbb0cf46740 20 client.17139 trim_cache size 0 max 16384 2024-09-21T03:51:05.121 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:51:05.121 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T03:51:05.121 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "2cbf94ea-caa1-4c9b-8007-8a0887103a5c", 2024-09-21T03:51:05.121 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T03:51:05.121 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:51:05.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.117+0000 7fbb069d2640 1 -- 172.21.15.84:0/4286058076 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbaec0b6680 msgr2=0x7fbaec0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:05.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.117+0000 7fbb069d2640 1 --2- 172.21.15.84:0/4286058076 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbaec0b6680 0x7fbaec0b8b90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800f390 tx=0x7fbaf80075a0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.117+0000 7fbb069d2640 1 -- 172.21.15.84:0/4286058076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb001049b0 msgr2=0x7fbb0019a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:05.122 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.117+0000 7fbb069d2640 1 --2- 172.21.15.84:0/4286058076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb001049b0 0x7fbb0019a610 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0031440 tx=0x7fbaf0003d50 comp rx=0 tx=0).stop 2024-09-21T03:51:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.117+0000 7fbb069d2640 1 -- 172.21.15.84:0/4286058076 shutdown_connections 2024-09-21T03:51:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.117+0000 7fbb069d2640 1 --2- 172.21.15.84:0/4286058076 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbaec0b6680 0x7fbaec0b8b90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.117+0000 7fbb069d2640 1 --2- 172.21.15.84:0/4286058076 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb0010de10 0x7fbb0019fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.117+0000 7fbb069d2640 1 --2- 172.21.15.84:0/4286058076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb00105300 0x7fbb0019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.117+0000 7fbb069d2640 1 --2- 172.21.15.84:0/4286058076 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbb001049b0 0x7fbb0019a610 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.117+0000 7fbb069d2640 1 -- 172.21.15.84:0/4286058076 >> 172.21.15.84:0/4286058076 conn(0x7fbb00079730 msgr2=0x7fbb001008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.118+0000 7fbb069d2640 1 -- 172.21.15.84:0/4286058076 shutdown_connections 2024-09-21T03:51:05.123 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:05.118+0000 7fbb069d2640 1 -- 172.21.15.84:0/4286058076 wait complete. 2024-09-21T03:51:05.926 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:51:06.179 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:51:06.810 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:06 smithi084 ceph-mon[30941]: scrub queued for path: / 2024-09-21T03:51:06.814 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:06 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:51:06.814 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:06 smithi084 ceph-mon[30941]: scrub summary: active paths [/] 2024-09-21T03:51:06.815 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:06 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:51:06.815 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:06 smithi084 ceph-mon[30941]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T03:51:06.815 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:06 smithi084 ceph-mon[30941]: pgmap v588: 97 pgs: 97 active+clean; 16 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 106 KiB/s wr, 32 op/s 2024-09-21T03:51:06.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.811+0000 7f8358ffb640 1 -- 172.21.15.84:0/1409636389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8354106bd0 msgr2=0x7f8354110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:06.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.811+0000 7f8358ffb640 1 --2- 172.21.15.84:0/1409636389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8354106bd0 0x7f8354110660 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f834c009ca0 tx=0x7f834c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.811+0000 7f8358ffb640 1 -- 172.21.15.84:0/1409636389 shutdown_connections 2024-09-21T03:51:06.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.811+0000 7f8358ffb640 1 --2- 172.21.15.84:0/1409636389 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8354106bd0 0x7f8354110660 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.811+0000 7f8358ffb640 1 --2- 172.21.15.84:0/1409636389 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8354106280 0x7f8354106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.811+0000 7f8358ffb640 1 --2- 172.21.15.84:0/1409636389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8354102030 0x7f8354102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.811+0000 7f8358ffb640 1 -- 172.21.15.84:0/1409636389 >> 172.21.15.84:0/1409636389 conn(0x7f8354077c60 msgr2=0x7f83540780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:06.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.811+0000 7f8358ffb640 1 -- 172.21.15.84:0/1409636389 shutdown_connections 2024-09-21T03:51:06.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.811+0000 7f8358ffb640 1 -- 172.21.15.84:0/1409636389 wait complete. 2024-09-21T03:51:06.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.812+0000 7f8358ffb640 1 Processor -- start 2024-09-21T03:51:06.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.812+0000 7f8358ffb640 1 -- start start 2024-09-21T03:51:06.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.812+0000 7f8358ffb640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8354102030 0x7f835419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:06.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.812+0000 7f8358ffb640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8354106280 0x7f835419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:06.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.812+0000 7f8358ffb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8354106bd0 0x7f835419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:06.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.812+0000 7f8358ffb640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8354113ac0 con 0x7f8354106bd0 2024-09-21T03:51:06.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.812+0000 7f8358ffb640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8354113940 con 0x7f8354102030 2024-09-21T03:51:06.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.812+0000 7f8358ffb640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8354113c40 con 0x7f8354106280 2024-09-21T03:51:06.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.812+0000 7f8352d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8354106bd0 0x7f835419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:06.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.813+0000 7f8352d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8354106bd0 0x7f835419fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33950/0 (socket says 172.21.15.84:33950) 2024-09-21T03:51:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.813+0000 7f8352d9d640 1 -- 172.21.15.84:0/2556426142 learned_addr learned my addr 172.21.15.84:0/2556426142 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.813+0000 7f835259c640 1 --2- 172.21.15.84:0/2556426142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8354102030 0x7f835419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.813+0000 7f834bfff640 1 --2- 172.21.15.84:0/2556426142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8354106280 0x7f835419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.813+0000 7f8352d9d640 1 -- 172.21.15.84:0/2556426142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8354106280 msgr2=0x7f835419aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.813+0000 7f8352d9d640 1 --2- 172.21.15.84:0/2556426142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8354106280 0x7f835419aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.813+0000 7f8352d9d640 1 -- 172.21.15.84:0/2556426142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8354102030 msgr2=0x7f835419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.813+0000 7f8352d9d640 1 --2- 172.21.15.84:0/2556426142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8354102030 0x7f835419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.830 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.813+0000 7f8352d9d640 1 -- 172.21.15.84:0/2556426142 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83541a0380 con 0x7f8354106bd0 2024-09-21T03:51:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.813+0000 7f835259c640 1 --2- 172.21.15.84:0/2556426142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8354102030 0x7f835419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:51:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.813+0000 7f8352d9d640 1 --2- 172.21.15.84:0/2556426142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8354106bd0 0x7f835419fd10 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f834c005cc0 tx=0x7f834c02f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.813+0000 7f834b7fe640 1 -- 172.21.15.84:0/2556426142 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c003cf0 con 0x7f8354106bd0 2024-09-21T03:51:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.813+0000 7f8358ffb640 1 -- 172.21.15.84:0/2556426142 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83541a0610 con 0x7f8354106bd0 2024-09-21T03:51:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.813+0000 7f834b7fe640 1 -- 172.21.15.84:0/2556426142 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f834c0044f0 con 0x7f8354106bd0 2024-09-21T03:51:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.813+0000 7f834b7fe640 1 -- 172.21.15.84:0/2556426142 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c02fca0 con 0x7f8354106bd0 2024-09-21T03:51:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.813+0000 7f8358ffb640 1 -- 172.21.15.84:0/2556426142 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83541a6e90 con 0x7f8354106bd0 2024-09-21T03:51:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.816+0000 7f834b7fe640 1 -- 172.21.15.84:0/2556426142 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f834c004040 con 0x7f8354106bd0 2024-09-21T03:51:06.831 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.816+0000 7f835f56f740 1 Processor -- start 2024-09-21T03:51:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.816+0000 7f835f56f740 1 -- start start 2024-09-21T03:51:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.817+0000 7f835f56f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5651ffcf3070 0x56520009a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.817+0000 7f835f56f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcca1b0 0x56520009ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.817+0000 7f835f56f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcd2390 0x56520009b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.817+0000 7f835f56f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x565200010e50 con 0x5651ffcd2390 2024-09-21T03:51:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.817+0000 7f835f56f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x565200000280 con 0x5651ffcf3070 2024-09-21T03:51:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.817+0000 7f835f56f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x565200004090 con 0x5651ffcca1b0 2024-09-21T03:51:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.817+0000 7f834bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcd2390 0x56520009b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:06.832 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.817+0000 7f834bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcd2390 0x56520009b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33962/0 (socket says 172.21.15.84:33962) 2024-09-21T03:51:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.817+0000 7f834bfff640 1 -- 172.21.15.84:0/1132983830 learned_addr learned my addr 172.21.15.84:0/1132983830 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.817+0000 7f834bfff640 1 --2- 172.21.15.84:0/1132983830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5651ffcf3070 0x56520009a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.817+0000 7f835259c640 1 --2- 172.21.15.84:0/1132983830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcca1b0 0x56520009ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.817+0000 7f834b7fe640 1 --2- 172.21.15.84:0/2556426142 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f83400b66b0 0x7f83400b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.817+0000 7f8352d9d640 1 --2- 172.21.15.84:0/2556426142 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f83400b66b0 0x7f83400b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.817+0000 7f834bfff640 1 -- 172.21.15.84:0/1132983830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcca1b0 msgr2=0x56520009ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:06.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.817+0000 7f834bfff640 1 --2- 172.21.15.84:0/1132983830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcca1b0 0x56520009ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.817+0000 7f834bfff640 1 -- 172.21.15.84:0/1132983830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5651ffcf3070 msgr2=0x56520009a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.817+0000 7f834bfff640 1 --2- 172.21.15.84:0/1132983830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5651ffcf3070 0x56520009a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.817+0000 7f834bfff640 1 -- 172.21.15.84:0/1132983830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651ffd5e650 con 0x5651ffcd2390 2024-09-21T03:51:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.818+0000 7f834b7fe640 1 -- 172.21.15.84:0/2556426142 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8485+0+0 (secure 0 0 0) 0x7f834c108ca0 con 0x7f8354106bd0 2024-09-21T03:51:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.818+0000 7f834bfff640 1 --2- 172.21.15.84:0/1132983830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcd2390 0x56520009b0d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f833c013890 tx=0x7f833c00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa876b75b7299ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.818+0000 7f8348ff9640 1 -- 172.21.15.84:0/1132983830 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c004020 con 0x5651ffcd2390 2024-09-21T03:51:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.818+0000 7f8348ff9640 1 -- 172.21.15.84:0/1132983830 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f833c0054d0 con 0x5651ffcd2390 2024-09-21T03:51:06.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.818+0000 7f8348ff9640 1 -- 172.21.15.84:0/1132983830 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c004a00 con 0x5651ffcd2390 2024-09-21T03:51:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.818+0000 7f8352d9d640 1 --2- 172.21.15.84:0/2556426142 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f83400b66b0 0x7f83400b8bc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f834c0cbd80 tx=0x7f834c0ff5b0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.819+0000 7f835f56f740 1 -- 172.21.15.84:0/1132983830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcd2390 msgr2=0x56520009b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.819+0000 7f835f56f740 1 --2- 172.21.15.84:0/1132983830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcd2390 0x56520009b0d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f833c013890 tx=0x7f833c00ef90 comp rx=0 tx=0).stop 2024-09-21T03:51:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.819+0000 7f835f56f740 1 -- 172.21.15.84:0/1132983830 shutdown_connections 2024-09-21T03:51:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.819+0000 7f835f56f740 1 --2- 172.21.15.84:0/1132983830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcd2390 0x56520009b0d0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.819+0000 7f835f56f740 1 --2- 172.21.15.84:0/1132983830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcca1b0 0x56520009ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.819+0000 7f835f56f740 1 --2- 172.21.15.84:0/1132983830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5651ffcf3070 0x56520009a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.819+0000 7f835f56f740 1 -- 172.21.15.84:0/1132983830 >> 172.21.15.84:0/1132983830 conn(0x5651ffce7460 msgr2=0x565200098540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.819+0000 7f835f56f740 1 -- 172.21.15.84:0/1132983830 shutdown_connections 2024-09-21T03:51:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.819+0000 7f835f56f740 1 -- 172.21.15.84:0/1132983830 wait complete. 2024-09-21T03:51:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.820+0000 7f835f56f740 1 -- start start 2024-09-21T03:51:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.820+0000 7f835f56f740 1 Processor -- start 2024-09-21T03:51:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.820+0000 7f835f56f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcca1b0 0x5652000a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.820+0000 7f835f56f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcd2390 0x5652000a6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:06.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.820+0000 7f835f56f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5651ffcf3070 0x5652000b2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.820+0000 7f835f56f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5651ffe61700 con 0x5651ffcca1b0 2024-09-21T03:51:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.820+0000 7f835f56f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5651fff9b110 con 0x5651ffcf3070 2024-09-21T03:51:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.820+0000 7f835f56f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5652000a8e30 con 0x5651ffcd2390 2024-09-21T03:51:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.820+0000 7f835f56f740 10 client.0 _ll_register_callbacks cb 0x5651fffb4990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:51:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.820+0000 7f834bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcca1b0 0x5652000a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.820+0000 7f834bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcca1b0 0x5652000a5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33964/0 (socket says 172.21.15.84:33964) 2024-09-21T03:51:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.820+0000 7f834bfff640 1 -- 172.21.15.84:0/885596732 learned_addr learned my addr 172.21.15.84:0/885596732 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:06.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.820+0000 7f834bfff640 1 -- 172.21.15.84:0/885596732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcd2390 msgr2=0x5652000a6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.820+0000 7f835259c640 1 --2- 172.21.15.84:0/885596732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcd2390 0x5652000a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.820+0000 7f834bfff640 1 --2- 172.21.15.84:0/885596732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcd2390 0x5652000a6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.820+0000 7f834bfff640 1 -- 172.21.15.84:0/885596732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5651ffcf3070 msgr2=0x5652000b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.820+0000 7f834bfff640 1 --2- 172.21.15.84:0/885596732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5651ffcf3070 0x5652000b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.820+0000 7f834bfff640 1 -- 172.21.15.84:0/885596732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651fffc8c40 con 0x5651ffcca1b0 2024-09-21T03:51:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.821+0000 7f834bfff640 1 --2- 172.21.15.84:0/885596732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcca1b0 0x5652000a5cf0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f833c0044b0 tx=0x7f833c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d68182f6477fe1b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:06.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.821+0000 7f8339ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:51:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.821+0000 7f8339ffb640 1 -- 172.21.15.84:0/885596732 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c024020 con 0x5651ffcca1b0 2024-09-21T03:51:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.821+0000 7f8339ffb640 1 -- 172.21.15.84:0/885596732 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8485+0+0 (secure 0 0 0) 0x7f833c0046c0 con 0x5651ffcca1b0 2024-09-21T03:51:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.821+0000 7f835f56f740 1 -- 172.21.15.84:0/885596732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f833c0054d0 con 0x5651ffcca1b0 2024-09-21T03:51:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.821+0000 7f8339ffb640 1 -- 172.21.15.84:0/885596732 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f833c02f050 con 0x5651ffcca1b0 2024-09-21T03:51:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.821+0000 7f835f56f740 10 client.17151 fetch_fsmap learned FSMap version 25 2024-09-21T03:51:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.821+0000 7f835f56f740 1 -- 172.21.15.84:0/885596732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5652000b4b80 con 0x5651ffcca1b0 2024-09-21T03:51:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.821+0000 7f8339ffb640 1 -- 172.21.15.84:0/885596732 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f833c0054d0 con 0x5651ffcca1b0 2024-09-21T03:51:06.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.821+0000 7f8339ffb640 1 -- 172.21.15.84:0/885596732 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f833c00baa0 con 0x5651ffcca1b0 2024-09-21T03:51:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.821+0000 7f835f56f740 10 client.17151 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:51:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.821+0000 7f835f56f740 10 client.17151 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:51:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.821+0000 7f835f56f740 20 client.17151 populate_metadata read hostname 'smithi084' 2024-09-21T03:51:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.821+0000 7f835f56f740 1 --2- 172.21.15.84:0/885596732 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5651ffcb19f0 0x5652000b7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.821+0000 7f835f56f740 4 client.17151 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:51:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.821+0000 7f835f56f740 1 -- 172.21.15.84:0/885596732 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565200012da0 con 0x5651ffcb19f0 2024-09-21T03:51:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.822+0000 7f835259c640 1 --2- 172.21.15.84:0/885596732 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5651ffcb19f0 0x5652000b7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.822+0000 7f8339ffb640 10 client.17151 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:06.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.822+0000 7f835259c640 1 --2- 172.21.15.84:0/885596732 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5651ffcb19f0 0x5652000b7ee0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1500cae97a107b31 server_cookie=2c1c9705e18c6a48 in_seq=0 out_seq=0 2024-09-21T03:51:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.823+0000 7f8339ffb640 1 -- 172.21.15.84:0/885596732 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565200012da0 con 0x5651ffcb19f0 2024-09-21T03:51:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.823+0000 7f8339ffb640 10 client.17151 handle_command_reply: tid=0 2024-09-21T03:51:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.823+0000 7f835f56f740 1 client.17151 shutdown 2024-09-21T03:51:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.823+0000 7f835f56f740 1 -- 172.21.15.84:0/885596732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcca1b0 msgr2=0x5652000a5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.823+0000 7f835f56f740 1 --2- 172.21.15.84:0/885596732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcca1b0 0x5652000a5cf0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f833c0044b0 tx=0x7f833c00eb20 comp rx=0 tx=0).stop 2024-09-21T03:51:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.823+0000 7f835f56f740 1 -- 172.21.15.84:0/885596732 shutdown_connections 2024-09-21T03:51:06.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.823+0000 7f835f56f740 1 --2- 172.21.15.84:0/885596732 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5651ffcb19f0 0x5652000b7ee0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.823+0000 7f835f56f740 1 --2- 172.21.15.84:0/885596732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5651ffcf3070 0x5652000b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.823+0000 7f835f56f740 1 --2- 172.21.15.84:0/885596732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcd2390 0x5652000a6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.823+0000 7f835f56f740 1 --2- 172.21.15.84:0/885596732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcca1b0 0x5652000a5cf0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.823+0000 7f835f56f740 1 -- 172.21.15.84:0/885596732 >> 172.21.15.84:0/885596732 conn(0x5651ffce7460 msgr2=0x56520009d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.823+0000 7f8339ffb640 0 client.17151 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.823+0000 7f835f56f740 1 -- 172.21.15.84:0/885596732 shutdown_connections 2024-09-21T03:51:06.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.823+0000 7f835f56f740 1 -- 172.21.15.84:0/885596732 wait complete. 2024-09-21T03:51:06.843 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.823+0000 7f835f56f740 20 client.17151 trim_cache size 0 max 16384 2024-09-21T03:51:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.840+0000 7f835f56f740 1 Processor -- start 2024-09-21T03:51:06.850 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.841+0000 7f835f56f740 1 -- start start 2024-09-21T03:51:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.841+0000 7f835f56f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5651ffcca1b0 0x5652000a7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.841+0000 7f835f56f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcd2390 0x56520009bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.841+0000 7f835f56f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcf3070 0x565200097b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.841+0000 7f835f56f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f83541b1f20 con 0x5651ffcf3070 2024-09-21T03:51:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.841+0000 7f835f56f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83541af7f0 con 0x5651ffcca1b0 2024-09-21T03:51:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.841+0000 7f835f56f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f83541ad660 con 0x5651ffcd2390 2024-09-21T03:51:06.851 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.841+0000 7f834bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcf3070 0x565200097b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.841+0000 7f834bfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcf3070 0x565200097b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33980/0 (socket says 172.21.15.84:33980) 2024-09-21T03:51:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.841+0000 7f834bfff640 1 -- 172.21.15.84:0/466606521 learned_addr learned my addr 172.21.15.84:0/466606521 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.841+0000 7f834bfff640 1 --2- 172.21.15.84:0/466606521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5651ffcca1b0 0x5652000a7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.841+0000 7f835259c640 1 --2- 172.21.15.84:0/466606521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcd2390 0x56520009bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.841+0000 7f834bfff640 1 -- 172.21.15.84:0/466606521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcd2390 msgr2=0x56520009bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.841+0000 7f834bfff640 1 --2- 172.21.15.84:0/466606521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcd2390 0x56520009bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.841+0000 7f834bfff640 1 -- 172.21.15.84:0/466606521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5651ffcca1b0 msgr2=0x5652000a7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:06.852 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.841+0000 7f834bfff640 1 --2- 172.21.15.84:0/466606521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5651ffcca1b0 0x5652000a7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.841+0000 7f834bfff640 1 -- 172.21.15.84:0/466606521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652000a6d90 con 0x5651ffcf3070 2024-09-21T03:51:06.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.841+0000 7f834bfff640 1 --2- 172.21.15.84:0/466606521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcf3070 0x565200097b70 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f833c00f010 tx=0x7f833c015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470066a9baa7b8ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:06.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.842+0000 7f833bfff640 1 -- 172.21.15.84:0/466606521 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c024070 con 0x5651ffcf3070 2024-09-21T03:51:06.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.842+0000 7f833bfff640 1 -- 172.21.15.84:0/466606521 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f833c01ed80 con 0x5651ffcf3070 2024-09-21T03:51:06.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.842+0000 7f833bfff640 1 -- 172.21.15.84:0/466606521 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c00b8f0 con 0x5651ffcf3070 2024-09-21T03:51:06.853 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.842+0000 7f835f56f740 1 -- 172.21.15.84:0/466606521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcf3070 msgr2=0x565200097b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.842+0000 7f835f56f740 1 --2- 172.21.15.84:0/466606521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcf3070 0x565200097b70 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f833c00f010 tx=0x7f833c015040 comp rx=0 tx=0).stop 2024-09-21T03:51:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.842+0000 7f835f56f740 1 -- 172.21.15.84:0/466606521 shutdown_connections 2024-09-21T03:51:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.842+0000 7f835f56f740 1 --2- 172.21.15.84:0/466606521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcf3070 0x565200097b70 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.842+0000 7f835f56f740 1 --2- 172.21.15.84:0/466606521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcd2390 0x56520009bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.842+0000 7f835f56f740 1 --2- 172.21.15.84:0/466606521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5651ffcca1b0 0x5652000a7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.842+0000 7f835f56f740 1 -- 172.21.15.84:0/466606521 >> 172.21.15.84:0/466606521 conn(0x5651ffce7460 msgr2=0x56520009b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.842+0000 7f835f56f740 1 -- 172.21.15.84:0/466606521 shutdown_connections 2024-09-21T03:51:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.842+0000 7f835f56f740 1 -- 172.21.15.84:0/466606521 wait complete. 2024-09-21T03:51:06.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.843+0000 7f835f56f740 1 -- start start 2024-09-21T03:51:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.843+0000 7f835f56f740 1 Processor -- start 2024-09-21T03:51:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.843+0000 7f835f56f740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5651ffcca1b0 0x5652000b86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.843+0000 7f835f56f740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcd2390 0x5652000b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.843+0000 7f835f56f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcf3070 0x565200120650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.843+0000 7f835f56f740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f83541adcb0 con 0x5651ffcd2390 2024-09-21T03:51:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.843+0000 7f835f56f740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83541af120 con 0x5651ffcca1b0 2024-09-21T03:51:06.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.843+0000 7f835f56f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f83541ae380 con 0x5651ffcf3070 2024-09-21T03:51:06.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.843+0000 7f835f56f740 10 client.0 _ll_register_callbacks cb 0x7f833c00edd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:51:06.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.843+0000 7f835259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcd2390 0x5652000b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:06.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.843+0000 7f835259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcd2390 0x5652000b8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:33992/0 (socket says 172.21.15.84:33992) 2024-09-21T03:51:06.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.843+0000 7f835259c640 1 -- 172.21.15.84:0/4043503876 learned_addr learned my addr 172.21.15.84:0/4043503876 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.843+0000 7f834bfff640 1 --2- 172.21.15.84:0/4043503876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5651ffcca1b0 0x5652000b86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.844+0000 7f834bfff640 1 --2- 172.21.15.84:0/4043503876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcf3070 0x565200120650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.844+0000 7f835259c640 1 -- 172.21.15.84:0/4043503876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcf3070 msgr2=0x565200120650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.844+0000 7f835259c640 1 --2- 172.21.15.84:0/4043503876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcf3070 0x565200120650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.844+0000 7f835259c640 1 -- 172.21.15.84:0/4043503876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5651ffcca1b0 msgr2=0x5652000b86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.844+0000 7f835259c640 1 --2- 172.21.15.84:0/4043503876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5651ffcca1b0 0x5652000b86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.844+0000 7f835259c640 1 -- 172.21.15.84:0/4043503876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565200120c40 con 0x5651ffcd2390 2024-09-21T03:51:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.844+0000 7f834bfff640 1 --2- 172.21.15.84:0/4043503876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcf3070 0x565200120650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:51:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.844+0000 7f835259c640 1 --2- 172.21.15.84:0/4043503876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcd2390 0x5652000b8c10 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8344008f80 tx=0x7f8344008b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b7fab8ba7b25375 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:06.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.844+0000 7f8339ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:51:06.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.844+0000 7f8339ffb640 1 -- 172.21.15.84:0/4043503876 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344011640 con 0x5651ffcd2390 2024-09-21T03:51:06.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.844+0000 7f8339ffb640 1 -- 172.21.15.84:0/4043503876 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8485+0+0 (secure 0 0 0) 0x7f83440117e0 con 0x5651ffcd2390 2024-09-21T03:51:06.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.844+0000 7f835f56f740 1 -- 172.21.15.84:0/4043503876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f833c01ed80 con 0x5651ffcd2390 2024-09-21T03:51:06.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.844+0000 7f8339ffb640 1 -- 172.21.15.84:0/4043503876 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8344003e20 con 0x5651ffcd2390 2024-09-21T03:51:06.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.844+0000 7f835f56f740 10 client.17157 fetch_fsmap learned FSMap version 25 2024-09-21T03:51:06.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.844+0000 7f835f56f740 1 -- 172.21.15.84:0/4043503876 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x565200121f40 con 0x5651ffcd2390 2024-09-21T03:51:06.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.844+0000 7f8339ffb640 1 -- 172.21.15.84:0/4043503876 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f833c01ed80 con 0x5651ffcd2390 2024-09-21T03:51:06.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.844+0000 7f8339ffb640 1 -- 172.21.15.84:0/4043503876 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8344022990 con 0x5651ffcd2390 2024-09-21T03:51:06.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.845+0000 7f835f56f740 10 client.17157 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:51:06.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.845+0000 7f835f56f740 10 client.17157 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:51:06.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.845+0000 7f835f56f740 20 client.17157 populate_metadata read hostname 'smithi084' 2024-09-21T03:51:06.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.845+0000 7f835f56f740 1 --2- 172.21.15.84:0/4043503876 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5651ffc86da0 0x565200124710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:06.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.845+0000 7f835f56f740 4 client.17157 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:51:06.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.845+0000 7f835f56f740 1 -- 172.21.15.84:0/4043503876 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56520000e850 con 0x5651ffc86da0 2024-09-21T03:51:06.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.845+0000 7f834bfff640 1 --2- 172.21.15.84:0/4043503876 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5651ffc86da0 0x565200124710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:06.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.845+0000 7f834bfff640 1 --2- 172.21.15.84:0/4043503876 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5651ffc86da0 0x565200124710 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e90f0d3812238a4 server_cookie=325204f804410e9a in_seq=0 out_seq=0 2024-09-21T03:51:06.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.845+0000 7f8339ffb640 10 client.17157 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:06.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.846+0000 7f8339ffb640 1 -- 172.21.15.84:0/4043503876 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4830 (crc 0 0 0) 0x56520000e850 con 0x5651ffc86da0 2024-09-21T03:51:06.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.846+0000 7f8339ffb640 10 client.17157 handle_command_reply: tid=0 2024-09-21T03:51:06.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.846+0000 7f835f56f740 1 client.17157 shutdown 2024-09-21T03:51:06.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.846+0000 7f835f56f740 1 -- 172.21.15.84:0/4043503876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcd2390 msgr2=0x5652000b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:06.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.846+0000 7f835f56f740 1 --2- 172.21.15.84:0/4043503876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcd2390 0x5652000b8c10 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8344008f80 tx=0x7f8344008b30 comp rx=0 tx=0).stop 2024-09-21T03:51:06.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.846+0000 7f835f56f740 1 -- 172.21.15.84:0/4043503876 shutdown_connections 2024-09-21T03:51:06.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.846+0000 7f835f56f740 1 --2- 172.21.15.84:0/4043503876 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5651ffc86da0 0x565200124710 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.846+0000 7f835f56f740 1 --2- 172.21.15.84:0/4043503876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5651ffcf3070 0x565200120650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.846+0000 7f835f56f740 1 --2- 172.21.15.84:0/4043503876 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5651ffcd2390 0x5652000b8c10 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.846+0000 7f835f56f740 1 --2- 172.21.15.84:0/4043503876 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5651ffcca1b0 0x5652000b86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.846+0000 7f835f56f740 1 -- 172.21.15.84:0/4043503876 >> 172.21.15.84:0/4043503876 conn(0x5651ffce7460 msgr2=0x5652000a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:06.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.846+0000 7f8339ffb640 0 client.17157 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:06.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.846+0000 7f835f56f740 1 -- 172.21.15.84:0/4043503876 shutdown_connections 2024-09-21T03:51:06.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.846+0000 7f835f56f740 1 -- 172.21.15.84:0/4043503876 wait complete. 2024-09-21T03:51:06.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.846+0000 7f835f56f740 20 client.17157 trim_cache size 0 max 16384 2024-09-21T03:51:06.861 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:51:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:51:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T03:51:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "2cbf94ea-caa1-4c9b-8007-8a0887103a5c": { 2024-09-21T03:51:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "2cbf94ea-caa1-4c9b-8007-8a0887103a5c", 2024-09-21T03:51:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T03:51:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:51:06.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:51:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "d85cdf50-3fc8-467d-942f-2b77981ba106": { 2024-09-21T03:51:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:43.684286+0000", 2024-09-21T03:51:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:06.863 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:51:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:51:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:51:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:51:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:06.864 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "2cbf94ea-caa1-4c9b-8007-8a0887103a5c": { 2024-09-21T03:51:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:51:05.114755+0000", 2024-09-21T03:51:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:06.865 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:51:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:51:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:06.866 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:51:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:51:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:06.867 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "43a49cca-fc1c-4c36-a314-49033e7c3fb6": { 2024-09-21T03:51:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:49:17.366428+0000", 2024-09-21T03:51:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:06.868 INFO:teuthology.orchestra.run.smithi084.stdout: "0bb4e83d-6059-4d41-88f0-1562fa422c47": { 2024-09-21T03:51:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:54.511018+0000", 2024-09-21T03:51:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:51:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:51:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:06.869 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:51:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:51:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:06.870 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "27dcb84c-89fa-46b2-b980-58857966c697": { 2024-09-21T03:51:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:52.598527+0000", 2024-09-21T03:51:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:51:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:51:06.871 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:51:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:51:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:06.872 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:51:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:51:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:06.873 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "b2063a70-0b1f-4b6b-9c96-d886e156ea66": { 2024-09-21T03:51:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:48:34.864478+0000", 2024-09-21T03:51:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "33131451-f242-447a-b13f-9bdebc7884ec": { 2024-09-21T03:51:06.874 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:00.524357+0000", 2024-09-21T03:51:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:51:06.875 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:51:06.875 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:51:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.847+0000 7f8358ffb640 1 -- 172.21.15.84:0/2556426142 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f83400b66b0 msgr2=0x7f83400b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:06.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.847+0000 7f8358ffb640 1 --2- 172.21.15.84:0/2556426142 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f83400b66b0 0x7f83400b8bc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f834c0cbd80 tx=0x7f834c0ff5b0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.847+0000 7f8358ffb640 1 -- 172.21.15.84:0/2556426142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8354106bd0 msgr2=0x7f835419fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:06.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.847+0000 7f8358ffb640 1 --2- 172.21.15.84:0/2556426142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8354106bd0 0x7f835419fd10 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f834c005cc0 tx=0x7f834c02f450 comp rx=0 tx=0).stop 2024-09-21T03:51:06.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.847+0000 7f8358ffb640 1 -- 172.21.15.84:0/2556426142 shutdown_connections 2024-09-21T03:51:06.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.847+0000 7f8358ffb640 1 --2- 172.21.15.84:0/2556426142 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f83400b66b0 0x7f83400b8bc0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.847+0000 7f8358ffb640 1 --2- 172.21.15.84:0/2556426142 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8354106bd0 0x7f835419fd10 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.847+0000 7f8358ffb640 1 --2- 172.21.15.84:0/2556426142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8354106280 0x7f835419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.847+0000 7f8358ffb640 1 --2- 172.21.15.84:0/2556426142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8354102030 0x7f835419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:06.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.847+0000 7f8358ffb640 1 -- 172.21.15.84:0/2556426142 >> 172.21.15.84:0/2556426142 conn(0x7f8354077c60 msgr2=0x7f8354107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:06.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.847+0000 7f8358ffb640 1 -- 172.21.15.84:0/2556426142 shutdown_connections 2024-09-21T03:51:06.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:06.847+0000 7f8358ffb640 1 -- 172.21.15.84:0/2556426142 wait complete. 2024-09-21T03:51:06.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:06 smithi174 ceph-mon[34403]: scrub queued for path: / 2024-09-21T03:51:06.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:06 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:51:06.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:06 smithi174 ceph-mon[34403]: scrub summary: active paths [/] 2024-09-21T03:51:06.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:06 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:51:06.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:06 smithi174 ceph-mon[34403]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T03:51:06.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:06 smithi174 ceph-mon[34403]: pgmap v588: 97 pgs: 97 active+clean; 16 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 106 KiB/s wr, 32 op/s 2024-09-21T03:51:06.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:06 smithi172 ceph-mon[34821]: scrub queued for path: / 2024-09-21T03:51:06.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:06 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:51:06.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:06 smithi172 ceph-mon[34821]: scrub summary: active paths [/] 2024-09-21T03:51:06.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:06 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:51:06.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:06 smithi172 ceph-mon[34821]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T03:51:06.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:06 smithi172 ceph-mon[34821]: pgmap v588: 97 pgs: 97 active+clean; 16 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 106 KiB/s wr, 32 op/s 2024-09-21T03:51:07.606 INFO:tasks.cephfs.filesystem:scrub status for tag:2cbf94ea-caa1-4c9b-8007-8a0887103a5c - {'path': '/', 'tag': '2cbf94ea-caa1-4c9b-8007-8a0887103a5c', 'options': 'recursive,force'} 2024-09-21T03:51:08.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:08 smithi084 ceph-mon[30941]: pgmap v589: 97 pgs: 97 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 32 op/s 2024-09-21T03:51:08.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:08 smithi174 ceph-mon[34403]: pgmap v589: 97 pgs: 97 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 32 op/s 2024-09-21T03:51:08.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:08 smithi172 ceph-mon[34821]: pgmap v589: 97 pgs: 97 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 32 op/s 2024-09-21T03:51:10.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:09 smithi084 ceph-mon[30941]: scrub summary: idle 2024-09-21T03:51:10.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:09 smithi174 ceph-mon[34403]: scrub summary: idle 2024-09-21T03:51:10.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:09 smithi172 ceph-mon[34821]: scrub summary: idle 2024-09-21T03:51:11.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:10 smithi084 ceph-mon[30941]: pgmap v590: 97 pgs: 97 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 32 op/s 2024-09-21T03:51:11.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:10 smithi174 ceph-mon[34403]: pgmap v590: 97 pgs: 97 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 32 op/s 2024-09-21T03:51:11.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:10 smithi172 ceph-mon[34821]: pgmap v590: 97 pgs: 97 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 32 op/s 2024-09-21T03:51:12.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:12 smithi084 ceph-mon[30941]: pgmap v591: 97 pgs: 97 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 81 KiB/s wr, 29 op/s 2024-09-21T03:51:12.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:12 smithi174 ceph-mon[34403]: pgmap v591: 97 pgs: 97 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 81 KiB/s wr, 29 op/s 2024-09-21T03:51:12.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:12 smithi172 ceph-mon[34821]: pgmap v591: 97 pgs: 97 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 81 KiB/s wr, 29 op/s 2024-09-21T03:51:14.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:14 smithi084 ceph-mon[30941]: pgmap v592: 97 pgs: 97 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-21T03:51:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:14 smithi174 ceph-mon[34403]: pgmap v592: 97 pgs: 97 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-21T03:51:14.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:14 smithi172 ceph-mon[34821]: pgmap v592: 97 pgs: 97 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-21T03:51:16.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:16 smithi084 ceph-mon[30941]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T03:51:16.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:16 smithi174 ceph-mon[34403]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T03:51:16.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:16 smithi172 ceph-mon[34821]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T03:51:17.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:17 smithi084 ceph-mon[30941]: pgmap v594: 97 pgs: 97 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-21T03:51:17.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:17 smithi174 ceph-mon[34403]: pgmap v594: 97 pgs: 97 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-21T03:51:17.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:17 smithi172 ceph-mon[34821]: pgmap v594: 97 pgs: 97 active+clean; 16 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-21T03:51:18.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:18 smithi084 ceph-mon[30941]: pgmap v595: 97 pgs: 97 active+clean; 17 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 53 KiB/s wr, 11 op/s 2024-09-21T03:51:18.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:18 smithi174 ceph-mon[34403]: pgmap v595: 97 pgs: 97 active+clean; 17 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 53 KiB/s wr, 11 op/s 2024-09-21T03:51:18.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:18 smithi172 ceph-mon[34821]: pgmap v595: 97 pgs: 97 active+clean; 17 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 53 KiB/s wr, 11 op/s 2024-09-21T03:51:20.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:20 smithi084 ceph-mon[30941]: pgmap v596: 97 pgs: 97 active+clean; 17 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 53 KiB/s wr, 11 op/s 2024-09-21T03:51:20.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:20 smithi174 ceph-mon[34403]: pgmap v596: 97 pgs: 97 active+clean; 17 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 53 KiB/s wr, 11 op/s 2024-09-21T03:51:20.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:20 smithi172 ceph-mon[34821]: pgmap v596: 97 pgs: 97 active+clean; 17 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 53 KiB/s wr, 11 op/s 2024-09-21T03:51:22.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:22 smithi084 ceph-mon[30941]: pgmap v597: 97 pgs: 97 active+clean; 17 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 53 KiB/s wr, 11 op/s 2024-09-21T03:51:22.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:22 smithi174 ceph-mon[34403]: pgmap v597: 97 pgs: 97 active+clean; 17 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 53 KiB/s wr, 11 op/s 2024-09-21T03:51:22.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:22 smithi172 ceph-mon[34821]: pgmap v597: 97 pgs: 97 active+clean; 17 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 53 KiB/s wr, 11 op/s 2024-09-21T03:51:24.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:24 smithi084 ceph-mon[30941]: pgmap v598: 97 pgs: 97 active+clean; 17 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 53 KiB/s wr, 11 op/s 2024-09-21T03:51:24.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:24 smithi174 ceph-mon[34403]: pgmap v598: 97 pgs: 97 active+clean; 17 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 53 KiB/s wr, 11 op/s 2024-09-21T03:51:24.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:24 smithi172 ceph-mon[34821]: pgmap v598: 97 pgs: 97 active+clean; 17 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 53 KiB/s wr, 11 op/s 2024-09-21T03:51:26.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:26 smithi084 ceph-mon[30941]: pgmap v599: 97 pgs: 97 active+clean; 17 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 10 op/s 2024-09-21T03:51:26.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:26 smithi174 ceph-mon[34403]: pgmap v599: 97 pgs: 97 active+clean; 17 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 10 op/s 2024-09-21T03:51:26.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:26 smithi172 ceph-mon[34821]: pgmap v599: 97 pgs: 97 active+clean; 17 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 10 op/s 2024-09-21T03:51:28.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:28 smithi084 ceph-mon[30941]: pgmap v600: 97 pgs: 97 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 67 KiB/s wr, 14 op/s 2024-09-21T03:51:28.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:28 smithi174 ceph-mon[34403]: pgmap v600: 97 pgs: 97 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 67 KiB/s wr, 14 op/s 2024-09-21T03:51:28.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:28 smithi172 ceph-mon[34821]: pgmap v600: 97 pgs: 97 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 67 KiB/s wr, 14 op/s 2024-09-21T03:51:30.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:30 smithi084 ceph-mon[30941]: pgmap v601: 97 pgs: 97 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 45 KiB/s wr, 9 op/s 2024-09-21T03:51:30.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:30 smithi174 ceph-mon[34403]: pgmap v601: 97 pgs: 97 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 45 KiB/s wr, 9 op/s 2024-09-21T03:51:30.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:30 smithi172 ceph-mon[34821]: pgmap v601: 97 pgs: 97 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 45 KiB/s wr, 9 op/s 2024-09-21T03:51:32.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:32 smithi084 ceph-mon[30941]: pgmap v602: 97 pgs: 97 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-21T03:51:32.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:32 smithi174 ceph-mon[34403]: pgmap v602: 97 pgs: 97 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-21T03:51:32.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:32 smithi172 ceph-mon[34821]: pgmap v602: 97 pgs: 97 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-21T03:51:34.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:34 smithi084 ceph-mon[30941]: pgmap v603: 97 pgs: 97 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 62 KiB/s wr, 12 op/s 2024-09-21T03:51:34.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:34 smithi174 ceph-mon[34403]: pgmap v603: 97 pgs: 97 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 62 KiB/s wr, 12 op/s 2024-09-21T03:51:34.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:34 smithi172 ceph-mon[34821]: pgmap v603: 97 pgs: 97 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 62 KiB/s wr, 12 op/s 2024-09-21T03:51:36.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:36 smithi084 ceph-mon[30941]: pgmap v604: 97 pgs: 97 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 40 KiB/s wr, 9 op/s 2024-09-21T03:51:36.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:36 smithi174 ceph-mon[34403]: pgmap v604: 97 pgs: 97 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 40 KiB/s wr, 9 op/s 2024-09-21T03:51:36.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:36 smithi172 ceph-mon[34821]: pgmap v604: 97 pgs: 97 active+clean; 17 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 40 KiB/s wr, 9 op/s 2024-09-21T03:51:37.608 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:51:37.872 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:51:38.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.472+0000 7fd4dd2f9640 1 -- 172.21.15.84:0/2053805578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4d8108cf0 msgr2=0x7fd4d810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:38.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.472+0000 7fd4dd2f9640 1 --2- 172.21.15.84:0/2053805578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4d8108cf0 0x7fd4d810f520 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009ca0 tx=0x7fd4d002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.472+0000 7fd4dd2f9640 1 -- 172.21.15.84:0/2053805578 shutdown_connections 2024-09-21T03:51:38.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.472+0000 7fd4dd2f9640 1 --2- 172.21.15.84:0/2053805578 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4d8108cf0 0x7fd4d810f520 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.472+0000 7fd4dd2f9640 1 --2- 172.21.15.84:0/2053805578 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4d81083a0 0x7fd4d81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.472+0000 7fd4dd2f9640 1 --2- 172.21.15.84:0/2053805578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4d8102a60 0x7fd4d8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.472+0000 7fd4dd2f9640 1 -- 172.21.15.84:0/2053805578 >> 172.21.15.84:0/2053805578 conn(0x7fd4d8079730 msgr2=0x7fd4d8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:38.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.472+0000 7fd4dd2f9640 1 -- 172.21.15.84:0/2053805578 shutdown_connections 2024-09-21T03:51:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.472+0000 7fd4dd2f9640 1 -- 172.21.15.84:0/2053805578 wait complete. 2024-09-21T03:51:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.473+0000 7fd4dd2f9640 1 Processor -- start 2024-09-21T03:51:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.473+0000 7fd4dd2f9640 1 -- start start 2024-09-21T03:51:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.474+0000 7fd4dd2f9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4d8102a60 0x7fd4d8199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.474+0000 7fd4dd2f9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4d81083a0 0x7fd4d81998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.474+0000 7fd4dd2f9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4d8108cf0 0x7fd4d819eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.474+0000 7fd4dd2f9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d8112960 con 0x7fd4d8102a60 2024-09-21T03:51:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.474+0000 7fd4dd2f9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81127e0 con 0x7fd4d81083a0 2024-09-21T03:51:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.474+0000 7fd4dd2f9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d8112ae0 con 0x7fd4d8108cf0 2024-09-21T03:51:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.474+0000 7fd4d6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4d8102a60 0x7fd4d8199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:38.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.474+0000 7fd4d6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4d8102a60 0x7fd4d8199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39970/0 (socket says 172.21.15.84:39970) 2024-09-21T03:51:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.474+0000 7fd4d6ffd640 1 -- 172.21.15.84:0/384373597 learned_addr learned my addr 172.21.15.84:0/384373597 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.474+0000 7fd4d67fc640 1 --2- 172.21.15.84:0/384373597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4d81083a0 0x7fd4d81998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.474+0000 7fd4d77fe640 1 --2- 172.21.15.84:0/384373597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4d8108cf0 0x7fd4d819eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.474+0000 7fd4d6ffd640 1 -- 172.21.15.84:0/384373597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4d8108cf0 msgr2=0x7fd4d819eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.474+0000 7fd4d6ffd640 1 --2- 172.21.15.84:0/384373597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4d8108cf0 0x7fd4d819eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.474+0000 7fd4d6ffd640 1 -- 172.21.15.84:0/384373597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4d81083a0 msgr2=0x7fd4d81998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.474+0000 7fd4d6ffd640 1 --2- 172.21.15.84:0/384373597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4d81083a0 0x7fd4d81998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.474+0000 7fd4d6ffd640 1 -- 172.21.15.84:0/384373597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d819f2c0 con 0x7fd4d8102a60 2024-09-21T03:51:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.474+0000 7fd4d6ffd640 1 --2- 172.21.15.84:0/384373597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4d8102a60 0x7fd4d8199350 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800eb00 tx=0x7fd4c8009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.474+0000 7fd4bffff640 1 -- 172.21.15.84:0/384373597 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c801c070 con 0x7fd4d8102a60 2024-09-21T03:51:38.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.475+0000 7fd4bffff640 1 -- 172.21.15.84:0/384373597 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4c800bc30 con 0x7fd4d8102a60 2024-09-21T03:51:38.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.475+0000 7fd4dd2f9640 1 -- 172.21.15.84:0/384373597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4d819f5b0 con 0x7fd4d8102a60 2024-09-21T03:51:38.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.475+0000 7fd4bffff640 1 -- 172.21.15.84:0/384373597 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c8016610 con 0x7fd4d8102a60 2024-09-21T03:51:38.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.475+0000 7fd4dd2f9640 1 -- 172.21.15.84:0/384373597 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4d806ae60 con 0x7fd4d8102a60 2024-09-21T03:51:38.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.478+0000 7fd4bffff640 1 -- 172.21.15.84:0/384373597 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fd4c801f070 con 0x7fd4d8102a60 2024-09-21T03:51:38.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.479+0000 7fd4e386d740 1 Processor -- start 2024-09-21T03:51:38.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.479+0000 7fd4bffff640 1 --2- 172.21.15.84:0/384373597 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4c00b6680 0x7fd4c00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:38.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.479+0000 7fd4e386d740 1 -- start start 2024-09-21T03:51:38.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.479+0000 7fd4d77fe640 1 --2- 172.21.15.84:0/384373597 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4c00b6680 0x7fd4c00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:38.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.479+0000 7fd4bffff640 1 -- 172.21.15.84:0/384373597 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fd4c80e8cb0 con 0x7fd4d8102a60 2024-09-21T03:51:38.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.479+0000 7fd4e386d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb1da23070 0x55fb1ddca650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:38.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.479+0000 7fd4e386d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 0x55fb1ddcab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:38.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.479+0000 7fd4e386d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb1da02390 0x55fb1ddcb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:38.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.479+0000 7fd4e386d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fb1dd40e50 con 0x55fb1d9fa1b0 2024-09-21T03:51:38.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.479+0000 7fd4e386d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fb1dd30280 con 0x55fb1da23070 2024-09-21T03:51:38.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.479+0000 7fd4e386d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55fb1dd34090 con 0x55fb1da02390 2024-09-21T03:51:38.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.479+0000 7fd4d67fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 0x55fb1ddcab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:38.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.479+0000 7fd4d67fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 0x55fb1ddcab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39976/0 (socket says 172.21.15.84:39976) 2024-09-21T03:51:38.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.479+0000 7fd4d67fc640 1 -- 172.21.15.84:0/3732935849 learned_addr learned my addr 172.21.15.84:0/3732935849 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:38.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.479+0000 7fd4d6ffd640 1 --2- 172.21.15.84:0/3732935849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb1da23070 0x55fb1ddca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:38.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.480+0000 7fd4d77fe640 1 --2- 172.21.15.84:0/384373597 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4c00b6680 0x7fd4c00b8b90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0006010 tx=0x7fd4d0009800 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:38.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.480+0000 7fd4d67fc640 1 -- 172.21.15.84:0/3732935849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb1da02390 msgr2=0x55fb1ddcb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:38.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.480+0000 7fd4d67fc640 1 --2- 172.21.15.84:0/3732935849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb1da02390 0x55fb1ddcb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.480+0000 7fd4d67fc640 1 -- 172.21.15.84:0/3732935849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb1da23070 msgr2=0x55fb1ddca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:38.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.480+0000 7fd4d67fc640 1 --2- 172.21.15.84:0/3732935849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb1da23070 0x55fb1ddca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.488 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.480+0000 7fd4d67fc640 1 -- 172.21.15.84:0/3732935849 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb1da8e650 con 0x55fb1d9fa1b0 2024-09-21T03:51:38.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.480+0000 7fd4d67fc640 1 --2- 172.21.15.84:0/3732935849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 0x55fb1ddcab90 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc009c60 tx=0x7fd4cc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9f51e262f7f454 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:38.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.480+0000 7fd4bd7fa640 1 -- 172.21.15.84:0/3732935849 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc004230 con 0x55fb1d9fa1b0 2024-09-21T03:51:38.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.480+0000 7fd4bd7fa640 1 -- 172.21.15.84:0/3732935849 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4cc0043d0 con 0x55fb1d9fa1b0 2024-09-21T03:51:38.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.480+0000 7fd4bd7fa640 1 -- 172.21.15.84:0/3732935849 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc019670 con 0x55fb1d9fa1b0 2024-09-21T03:51:38.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.481+0000 7fd4e386d740 1 -- 172.21.15.84:0/3732935849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 msgr2=0x55fb1ddcab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:38.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.481+0000 7fd4e386d740 1 --2- 172.21.15.84:0/3732935849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 0x55fb1ddcab90 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc009c60 tx=0x7fd4cc011810 comp rx=0 tx=0).stop 2024-09-21T03:51:38.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.481+0000 7fd4e386d740 1 -- 172.21.15.84:0/3732935849 shutdown_connections 2024-09-21T03:51:38.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.481+0000 7fd4e386d740 1 --2- 172.21.15.84:0/3732935849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb1da02390 0x55fb1ddcb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.481+0000 7fd4e386d740 1 --2- 172.21.15.84:0/3732935849 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 0x55fb1ddcab90 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.489 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.481+0000 7fd4e386d740 1 --2- 172.21.15.84:0/3732935849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb1da23070 0x55fb1ddca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.481+0000 7fd4e386d740 1 -- 172.21.15.84:0/3732935849 >> 172.21.15.84:0/3732935849 conn(0x55fb1da17460 msgr2=0x55fb1ddc8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.481+0000 7fd4e386d740 1 -- 172.21.15.84:0/3732935849 shutdown_connections 2024-09-21T03:51:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.481+0000 7fd4e386d740 1 -- 172.21.15.84:0/3732935849 wait complete. 2024-09-21T03:51:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.482+0000 7fd4e386d740 1 -- start start 2024-09-21T03:51:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.482+0000 7fd4e386d740 1 Processor -- start 2024-09-21T03:51:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.482+0000 7fd4e386d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 0x55fb1ddd5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.482+0000 7fd4e386d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb1da02390 0x55fb1ddd61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.482+0000 7fd4e386d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb1da23070 0x55fb1ddd6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.482+0000 7fd4e386d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55fb1db91700 con 0x55fb1d9fa1b0 2024-09-21T03:51:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.482+0000 7fd4e386d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fb1dccb110 con 0x55fb1da02390 2024-09-21T03:51:38.490 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.482+0000 7fd4e386d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55fb1ddd8e30 con 0x55fb1da23070 2024-09-21T03:51:38.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.482+0000 7fd4e386d740 10 client.0 _ll_register_callbacks cb 0x55fb1dce4990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:51:38.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.482+0000 7fd4d6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 0x55fb1ddd5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:38.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.482+0000 7fd4d6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 0x55fb1ddd5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39978/0 (socket says 172.21.15.84:39978) 2024-09-21T03:51:38.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.482+0000 7fd4d6ffd640 1 -- 172.21.15.84:0/3528414418 learned_addr learned my addr 172.21.15.84:0/3528414418 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:38.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.482+0000 7fd4d67fc640 1 --2- 172.21.15.84:0/3528414418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb1da02390 0x55fb1ddd61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:38.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.482+0000 7fd4d77fe640 1 --2- 172.21.15.84:0/3528414418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb1da23070 0x55fb1ddd6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:38.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.483+0000 7fd4d6ffd640 1 -- 172.21.15.84:0/3528414418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb1da23070 msgr2=0x55fb1ddd6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:38.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.483+0000 7fd4d6ffd640 1 --2- 172.21.15.84:0/3528414418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb1da23070 0x55fb1ddd6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.483+0000 7fd4d6ffd640 1 -- 172.21.15.84:0/3528414418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb1da02390 msgr2=0x55fb1ddd61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:38.491 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.483+0000 7fd4d6ffd640 1 --2- 172.21.15.84:0/3528414418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb1da02390 0x55fb1ddd61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.483+0000 7fd4d6ffd640 1 -- 172.21.15.84:0/3528414418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb1dcf8c40 con 0x55fb1d9fa1b0 2024-09-21T03:51:38.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.483+0000 7fd4d77fe640 1 --2- 172.21.15.84:0/3528414418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb1da23070 0x55fb1ddd6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:51:38.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.483+0000 7fd4d6ffd640 1 --2- 172.21.15.84:0/3528414418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 0x55fb1ddd5ca0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80e64b0 tx=0x7fd4c80aea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3cfd182524c2373 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:38.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.483+0000 7fd4baff5640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:51:38.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.483+0000 7fd4baff5640 1 -- 172.21.15.84:0/3528414418 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c80ae710 con 0x55fb1d9fa1b0 2024-09-21T03:51:38.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.483+0000 7fd4baff5640 1 -- 172.21.15.84:0/3528414418 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fd4c80ade60 con 0x55fb1d9fa1b0 2024-09-21T03:51:38.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.483+0000 7fd4e386d740 1 -- 172.21.15.84:0/3528414418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4cc0043d0 con 0x55fb1d9fa1b0 2024-09-21T03:51:38.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.483+0000 7fd4baff5640 1 -- 172.21.15.84:0/3528414418 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd4c800bde0 con 0x55fb1d9fa1b0 2024-09-21T03:51:38.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.483+0000 7fd4e386d740 10 client.17169 fetch_fsmap learned FSMap version 25 2024-09-21T03:51:38.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.483+0000 7fd4e386d740 1 -- 172.21.15.84:0/3528414418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fb1dde4a80 con 0x55fb1d9fa1b0 2024-09-21T03:51:38.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.483+0000 7fd4baff5640 1 -- 172.21.15.84:0/3528414418 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4c80b3630 con 0x55fb1d9fa1b0 2024-09-21T03:51:38.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.484+0000 7fd4baff5640 1 -- 172.21.15.84:0/3528414418 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd4c80aa550 con 0x55fb1d9fa1b0 2024-09-21T03:51:38.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.484+0000 7fd4e386d740 10 client.17169 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:51:38.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.484+0000 7fd4e386d740 10 client.17169 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:51:38.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.484+0000 7fd4e386d740 20 client.17169 populate_metadata read hostname 'smithi084' 2024-09-21T03:51:38.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.484+0000 7fd4e386d740 1 --2- 172.21.15.84:0/3528414418 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55fb1d9e19f0 0x55fb1dde7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:38.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.484+0000 7fd4e386d740 4 client.17169 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:51:38.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.484+0000 7fd4e386d740 1 -- 172.21.15.84:0/3528414418 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd4cc0043d0 con 0x55fb1d9e19f0 2024-09-21T03:51:38.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.484+0000 7fd4d67fc640 1 --2- 172.21.15.84:0/3528414418 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55fb1d9e19f0 0x55fb1dde7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:38.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.484+0000 7fd4baff5640 10 client.17169 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:38.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.484+0000 7fd4d67fc640 1 --2- 172.21.15.84:0/3528414418 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55fb1d9e19f0 0x55fb1dde7fe0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa39e1435303222a server_cookie=d6e23bfbe21ab7c0 in_seq=0 out_seq=0 2024-09-21T03:51:38.494 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.485+0000 7fd4baff5640 1 -- 172.21.15.84:0/3528414418 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fd4cc0043d0 con 0x55fb1d9e19f0 2024-09-21T03:51:38.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.485+0000 7fd4baff5640 10 client.17169 handle_command_reply: tid=0 2024-09-21T03:51:38.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.485+0000 7fd4e386d740 1 client.17169 shutdown 2024-09-21T03:51:38.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.485+0000 7fd4e386d740 1 -- 172.21.15.84:0/3528414418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 msgr2=0x55fb1ddd5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:38.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.485+0000 7fd4e386d740 1 --2- 172.21.15.84:0/3528414418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 0x55fb1ddd5ca0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80e64b0 tx=0x7fd4c80aea90 comp rx=0 tx=0).stop 2024-09-21T03:51:38.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.485+0000 7fd4e386d740 1 -- 172.21.15.84:0/3528414418 shutdown_connections 2024-09-21T03:51:38.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.485+0000 7fd4e386d740 1 --2- 172.21.15.84:0/3528414418 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55fb1d9e19f0 0x55fb1dde7fe0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.485+0000 7fd4e386d740 1 --2- 172.21.15.84:0/3528414418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb1da23070 0x55fb1ddd6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.485+0000 7fd4e386d740 1 --2- 172.21.15.84:0/3528414418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb1da02390 0x55fb1ddd61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.485+0000 7fd4baff5640 0 client.17169 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:38.495 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.485+0000 7fd4e386d740 1 --2- 172.21.15.84:0/3528414418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 0x55fb1ddd5ca0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.485+0000 7fd4e386d740 1 -- 172.21.15.84:0/3528414418 >> 172.21.15.84:0/3528414418 conn(0x55fb1da17460 msgr2=0x55fb1ddcd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:38.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.486+0000 7fd4e386d740 1 -- 172.21.15.84:0/3528414418 shutdown_connections 2024-09-21T03:51:38.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.486+0000 7fd4e386d740 1 -- 172.21.15.84:0/3528414418 wait complete. 2024-09-21T03:51:38.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.486+0000 7fd4e386d740 20 client.17169 trim_cache size 0 max 16384 2024-09-21T03:51:38.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.503+0000 7fd4e386d740 1 Processor -- start 2024-09-21T03:51:38.505 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.503+0000 7fd4e386d740 1 -- start start 2024-09-21T03:51:38.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.503+0000 7fd4e386d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb1d9e19f0 0x55fb1ddd78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:38.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.503+0000 7fd4e386d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 0x55fb1ddd2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:38.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.503+0000 7fd4e386d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb1da02390 0x55fb1ddd33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:38.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.503+0000 7fd4e386d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81afca0 con 0x55fb1d9fa1b0 2024-09-21T03:51:38.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.503+0000 7fd4e386d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81ad570 con 0x55fb1da02390 2024-09-21T03:51:38.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.503+0000 7fd4e386d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81ab3e0 con 0x55fb1d9e19f0 2024-09-21T03:51:38.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.503+0000 7fd4d67fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 0x55fb1ddd2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:38.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.503+0000 7fd4d67fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 0x55fb1ddd2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:39994/0 (socket says 172.21.15.84:39994) 2024-09-21T03:51:38.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.503+0000 7fd4d67fc640 1 -- 172.21.15.84:0/1849527589 learned_addr learned my addr 172.21.15.84:0/1849527589 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:38.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.503+0000 7fd4d6ffd640 1 --2- 172.21.15.84:0/1849527589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb1d9e19f0 0x55fb1ddd78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:38.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.504+0000 7fd4d77fe640 1 --2- 172.21.15.84:0/1849527589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb1da02390 0x55fb1ddd33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:38.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.504+0000 7fd4d67fc640 1 -- 172.21.15.84:0/1849527589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb1d9e19f0 msgr2=0x55fb1ddd78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:38.506 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.504+0000 7fd4d67fc640 1 --2- 172.21.15.84:0/1849527589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb1d9e19f0 0x55fb1ddd78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.504+0000 7fd4d67fc640 1 -- 172.21.15.84:0/1849527589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb1da02390 msgr2=0x55fb1ddd33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:38.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.504+0000 7fd4d67fc640 1 --2- 172.21.15.84:0/1849527589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb1da02390 0x55fb1ddd33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.507 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.504+0000 7fd4d67fc640 1 -- 172.21.15.84:0/1849527589 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb1ddd4c00 con 0x55fb1d9fa1b0 2024-09-21T03:51:38.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.504+0000 7fd4d67fc640 1 --2- 172.21.15.84:0/1849527589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 0x55fb1ddd2e90 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc004100 tx=0x7fd4cc009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406b7fa3216496cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:38.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.504+0000 7fd4bcff9640 1 -- 172.21.15.84:0/1849527589 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc01f040 con 0x55fb1d9fa1b0 2024-09-21T03:51:38.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.504+0000 7fd4bcff9640 1 -- 172.21.15.84:0/1849527589 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4cc0054e0 con 0x55fb1d9fa1b0 2024-09-21T03:51:38.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.504+0000 7fd4bcff9640 1 -- 172.21.15.84:0/1849527589 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc003a10 con 0x55fb1d9fa1b0 2024-09-21T03:51:38.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.505+0000 7fd4e386d740 1 -- 172.21.15.84:0/1849527589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 msgr2=0x55fb1ddd2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:38.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.505+0000 7fd4e386d740 1 --2- 172.21.15.84:0/1849527589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 0x55fb1ddd2e90 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc004100 tx=0x7fd4cc009950 comp rx=0 tx=0).stop 2024-09-21T03:51:38.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.505+0000 7fd4e386d740 1 -- 172.21.15.84:0/1849527589 shutdown_connections 2024-09-21T03:51:38.510 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.505+0000 7fd4e386d740 1 --2- 172.21.15.84:0/1849527589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb1da02390 0x55fb1ddd33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.505+0000 7fd4e386d740 1 --2- 172.21.15.84:0/1849527589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9fa1b0 0x55fb1ddd2e90 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.505+0000 7fd4e386d740 1 --2- 172.21.15.84:0/1849527589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb1d9e19f0 0x55fb1ddd78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.505+0000 7fd4e386d740 1 -- 172.21.15.84:0/1849527589 >> 172.21.15.84:0/1849527589 conn(0x55fb1da17460 msgr2=0x55fb1ddd71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:38.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.505+0000 7fd4e386d740 1 -- 172.21.15.84:0/1849527589 shutdown_connections 2024-09-21T03:51:38.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.505+0000 7fd4e386d740 1 -- 172.21.15.84:0/1849527589 wait complete. 2024-09-21T03:51:38.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.505+0000 7fd4e386d740 1 -- start start 2024-09-21T03:51:38.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.505+0000 7fd4e386d740 1 Processor -- start 2024-09-21T03:51:38.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.506+0000 7fd4e386d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9e19f0 0x55fb1ddda860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:38.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.506+0000 7fd4e386d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb1d9fa1b0 0x55fb1dddade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:38.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.506+0000 7fd4e386d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb1da02390 0x55fb1de55db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:38.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.506+0000 7fd4e386d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81aba30 con 0x55fb1d9e19f0 2024-09-21T03:51:38.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.506+0000 7fd4e386d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81acea0 con 0x55fb1da02390 2024-09-21T03:51:38.511 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.506+0000 7fd4e386d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81ac100 con 0x55fb1d9fa1b0 2024-09-21T03:51:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.506+0000 7fd4d6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9e19f0 0x55fb1ddda860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.506+0000 7fd4e386d740 10 client.0 _ll_register_callbacks cb 0x7fd4c80960b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:51:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.506+0000 7fd4d6ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9e19f0 0x55fb1ddda860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40006/0 (socket says 172.21.15.84:40006) 2024-09-21T03:51:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.506+0000 7fd4d6ffd640 1 -- 172.21.15.84:0/989706838 learned_addr learned my addr 172.21.15.84:0/989706838 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.506+0000 7fd4d67fc640 1 --2- 172.21.15.84:0/989706838 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb1d9fa1b0 0x55fb1dddade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.506+0000 7fd4d77fe640 1 --2- 172.21.15.84:0/989706838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb1da02390 0x55fb1de55db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.506+0000 7fd4d6ffd640 1 -- 172.21.15.84:0/989706838 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb1d9fa1b0 msgr2=0x55fb1dddade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.506+0000 7fd4d6ffd640 1 --2- 172.21.15.84:0/989706838 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb1d9fa1b0 0x55fb1dddade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.506+0000 7fd4d6ffd640 1 -- 172.21.15.84:0/989706838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb1da02390 msgr2=0x55fb1de55db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.506+0000 7fd4d6ffd640 1 --2- 172.21.15.84:0/989706838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb1da02390 0x55fb1de55db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.506+0000 7fd4d6ffd640 1 -- 172.21.15.84:0/989706838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb1de563c0 con 0x55fb1d9e19f0 2024-09-21T03:51:38.512 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.506+0000 7fd4d6ffd640 1 --2- 172.21.15.84:0/989706838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9e19f0 0x55fb1ddda860 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80961f0 tx=0x7fd4c8017c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cefdc150af497794 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:38.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.506+0000 7fd4baff5640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:51:38.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.507+0000 7fd4baff5640 1 -- 172.21.15.84:0/989706838 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c80ab250 con 0x55fb1d9e19f0 2024-09-21T03:51:38.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.507+0000 7fd4baff5640 1 -- 172.21.15.84:0/989706838 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fd4c80ad8d0 con 0x55fb1d9e19f0 2024-09-21T03:51:38.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.507+0000 7fd4e386d740 1 -- 172.21.15.84:0/989706838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4cc0054e0 con 0x55fb1d9e19f0 2024-09-21T03:51:38.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.507+0000 7fd4baff5640 1 -- 172.21.15.84:0/989706838 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd4c80aa8c0 con 0x55fb1d9e19f0 2024-09-21T03:51:38.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.507+0000 7fd4e386d740 10 client.17175 fetch_fsmap learned FSMap version 25 2024-09-21T03:51:38.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.507+0000 7fd4e386d740 1 -- 172.21.15.84:0/989706838 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fb1de57650 con 0x55fb1d9e19f0 2024-09-21T03:51:38.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.507+0000 7fd4baff5640 1 -- 172.21.15.84:0/989706838 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4cc0054e0 con 0x55fb1d9e19f0 2024-09-21T03:51:38.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.507+0000 7fd4baff5640 1 -- 172.21.15.84:0/989706838 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd4c80adad0 con 0x55fb1d9e19f0 2024-09-21T03:51:38.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.507+0000 7fd4e386d740 10 client.17175 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:51:38.513 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.507+0000 7fd4e386d740 10 client.17175 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:51:38.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.507+0000 7fd4e386d740 20 client.17175 populate_metadata read hostname 'smithi084' 2024-09-21T03:51:38.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.507+0000 7fd4e386d740 1 --2- 172.21.15.84:0/989706838 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55fb1da23070 0x55fb1de59cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:38.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.507+0000 7fd4e386d740 4 client.17175 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:51:38.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.507+0000 7fd4e386d740 1 -- 172.21.15.84:0/989706838 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fb1dd42da0 con 0x55fb1da23070 2024-09-21T03:51:38.514 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.508+0000 7fd4d67fc640 1 --2- 172.21.15.84:0/989706838 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55fb1da23070 0x55fb1de59cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:38.515 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.508+0000 7fd4d67fc640 1 --2- 172.21.15.84:0/989706838 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55fb1da23070 0x55fb1de59cd0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba79f1cd4dfeda5f server_cookie=8d2a8f7495b87185 in_seq=0 out_seq=0 2024-09-21T03:51:38.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.508+0000 7fd4baff5640 10 client.17175 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:38.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.509+0000 7fd4baff5640 1 -- 172.21.15.84:0/989706838 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4634 (crc 0 0 0) 0x55fb1dd42da0 con 0x55fb1da23070 2024-09-21T03:51:38.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.509+0000 7fd4baff5640 10 client.17175 handle_command_reply: tid=0 2024-09-21T03:51:38.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.509+0000 7fd4e386d740 1 client.17175 shutdown 2024-09-21T03:51:38.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.509+0000 7fd4e386d740 1 -- 172.21.15.84:0/989706838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9e19f0 msgr2=0x55fb1ddda860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:38.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.509+0000 7fd4e386d740 1 --2- 172.21.15.84:0/989706838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9e19f0 0x55fb1ddda860 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80961f0 tx=0x7fd4c8017c90 comp rx=0 tx=0).stop 2024-09-21T03:51:38.516 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.509+0000 7fd4e386d740 1 -- 172.21.15.84:0/989706838 shutdown_connections 2024-09-21T03:51:38.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.509+0000 7fd4e386d740 1 --2- 172.21.15.84:0/989706838 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55fb1da23070 0x55fb1de59cd0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.509+0000 7fd4e386d740 1 --2- 172.21.15.84:0/989706838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fb1da02390 0x55fb1de55db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.509+0000 7fd4e386d740 1 --2- 172.21.15.84:0/989706838 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55fb1d9fa1b0 0x55fb1dddade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.509+0000 7fd4e386d740 1 --2- 172.21.15.84:0/989706838 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55fb1d9e19f0 0x55fb1ddda860 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.509+0000 7fd4e386d740 1 -- 172.21.15.84:0/989706838 >> 172.21.15.84:0/989706838 conn(0x55fb1da17460 msgr2=0x55fb1ddcb680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:38.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.509+0000 7fd4baff5640 0 client.17175 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:38.518 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.509+0000 7fd4e386d740 1 -- 172.21.15.84:0/989706838 shutdown_connections 2024-09-21T03:51:38.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.509+0000 7fd4e386d740 1 -- 172.21.15.84:0/989706838 wait complete. 2024-09-21T03:51:38.519 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.509+0000 7fd4e386d740 20 client.17175 trim_cache size 0 max 16384 2024-09-21T03:51:38.519 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:51:38.519 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T03:51:38.519 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T03:51:38.520 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:51:38.520 INFO:teuthology.orchestra.run.smithi084.stdout: "d85cdf50-3fc8-467d-942f-2b77981ba106": { 2024-09-21T03:51:38.520 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:43.684286+0000", 2024-09-21T03:51:38.520 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:38.520 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:38.520 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:38.520 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:38.520 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:38.520 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:38.521 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:51:38.521 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:51:38.521 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:38.521 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:38.521 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:38.521 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:38.521 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:38.521 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:38.521 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:51:38.522 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:51:38.522 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:38.522 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:38.522 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:38.522 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:38.522 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:38.522 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:38.522 INFO:teuthology.orchestra.run.smithi084.stdout: "2cbf94ea-caa1-4c9b-8007-8a0887103a5c": { 2024-09-21T03:51:38.522 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:51:05.114755+0000", 2024-09-21T03:51:38.522 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:38.523 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:38.523 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:38.523 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:38.523 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:38.523 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:38.523 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:51:38.523 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:51:38.523 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:38.523 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:38.523 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:38.524 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:38.524 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:38.524 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:38.524 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:51:38.524 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:51:38.524 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:38.524 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:38.524 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:38.524 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:38.524 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:38.524 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:38.525 INFO:teuthology.orchestra.run.smithi084.stdout: "43a49cca-fc1c-4c36-a314-49033e7c3fb6": { 2024-09-21T03:51:38.525 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:49:17.366428+0000", 2024-09-21T03:51:38.525 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:38.525 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:38.525 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:38.525 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:38.525 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:38.525 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:38.525 INFO:teuthology.orchestra.run.smithi084.stdout: "0bb4e83d-6059-4d41-88f0-1562fa422c47": { 2024-09-21T03:51:38.525 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:54.511018+0000", 2024-09-21T03:51:38.526 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:38.526 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:38.526 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:38.526 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:38.526 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:38.526 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:38.526 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:51:38.526 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:51:38.526 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:38.526 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:38.527 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:38.527 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:38.527 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:38.527 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:38.527 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:51:38.527 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:51:38.527 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:38.527 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:38.527 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:38.527 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:38.528 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:38.528 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:38.528 INFO:teuthology.orchestra.run.smithi084.stdout: "27dcb84c-89fa-46b2-b980-58857966c697": { 2024-09-21T03:51:38.528 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:52.598527+0000", 2024-09-21T03:51:38.528 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:38.528 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:38.528 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:38.528 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:38.528 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:38.528 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:38.528 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:51:38.528 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:51:38.529 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:38.529 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:38.529 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:38.529 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:38.529 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:38.529 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:38.529 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:51:38.529 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:51:38.529 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:38.529 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:38.529 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:38.529 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:38.530 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:38.530 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:38.530 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:51:38.530 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:51:38.530 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:38.530 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:38.530 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:38.530 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:38.530 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:38.530 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:38.530 INFO:teuthology.orchestra.run.smithi084.stdout: "b2063a70-0b1f-4b6b-9c96-d886e156ea66": { 2024-09-21T03:51:38.530 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:48:34.864478+0000", 2024-09-21T03:51:38.531 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:38.531 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:38.531 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:38.531 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:38.531 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:38.531 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:38.531 INFO:teuthology.orchestra.run.smithi084.stdout: "33131451-f242-447a-b13f-9bdebc7884ec": { 2024-09-21T03:51:38.531 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:00.524357+0000", 2024-09-21T03:51:38.531 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:38.531 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:38.531 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:38.531 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:38.531 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:38.532 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:51:38.532 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:51:38.532 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:51:38.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.510+0000 7fd4dd2f9640 1 -- 172.21.15.84:0/384373597 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4c00b6680 msgr2=0x7fd4c00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:38.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.510+0000 7fd4dd2f9640 1 --2- 172.21.15.84:0/384373597 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4c00b6680 0x7fd4c00b8b90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0006010 tx=0x7fd4d0009800 comp rx=0 tx=0).stop 2024-09-21T03:51:38.532 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.510+0000 7fd4dd2f9640 1 -- 172.21.15.84:0/384373597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4d8102a60 msgr2=0x7fd4d8199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.510+0000 7fd4dd2f9640 1 --2- 172.21.15.84:0/384373597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4d8102a60 0x7fd4d8199350 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800eb00 tx=0x7fd4c8009f20 comp rx=0 tx=0).stop 2024-09-21T03:51:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.510+0000 7fd4dd2f9640 1 -- 172.21.15.84:0/384373597 shutdown_connections 2024-09-21T03:51:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.510+0000 7fd4dd2f9640 1 --2- 172.21.15.84:0/384373597 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd4c00b6680 0x7fd4c00b8b90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.510+0000 7fd4dd2f9640 1 --2- 172.21.15.84:0/384373597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd4d8108cf0 0x7fd4d819eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.510+0000 7fd4dd2f9640 1 --2- 172.21.15.84:0/384373597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4d81083a0 0x7fd4d81998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.510+0000 7fd4dd2f9640 1 --2- 172.21.15.84:0/384373597 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd4d8102a60 0x7fd4d8199350 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.510+0000 7fd4dd2f9640 1 -- 172.21.15.84:0/384373597 >> 172.21.15.84:0/384373597 conn(0x7fd4d8079730 msgr2=0x7fd4d81043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.510+0000 7fd4dd2f9640 1 -- 172.21.15.84:0/384373597 shutdown_connections 2024-09-21T03:51:38.533 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:38.510+0000 7fd4dd2f9640 1 -- 172.21.15.84:0/384373597 wait complete. 2024-09-21T03:51:38.604 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:38 smithi084 ceph-mon[30941]: pgmap v605: 97 pgs: 97 active+clean; 17 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 64 KiB/s wr, 14 op/s 2024-09-21T03:51:38.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:38 smithi174 ceph-mon[34403]: pgmap v605: 97 pgs: 97 active+clean; 17 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 64 KiB/s wr, 14 op/s 2024-09-21T03:51:38.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:38 smithi172 ceph-mon[34821]: pgmap v605: 97 pgs: 97 active+clean; 17 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 64 KiB/s wr, 14 op/s 2024-09-21T03:51:39.455 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:51:39.455 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:51:39.711 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:51:40.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.209+0000 7fb687a84640 1 -- 172.21.15.84:0/1951075702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680103bc0 msgr2=0x7fb680103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:40.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.209+0000 7fb687a84640 1 --2- 172.21.15.84:0/1951075702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680103bc0 0x7fb680103fd0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fb670009ca0 tx=0x7fb67002a8e0 comp rx=0 tx=0).stop 2024-09-21T03:51:40.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.209+0000 7fb687a84640 1 -- 172.21.15.84:0/1951075702 shutdown_connections 2024-09-21T03:51:40.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.209+0000 7fb687a84640 1 --2- 172.21.15.84:0/1951075702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb680109e00 0x7fb680110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:40.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.209+0000 7fb687a84640 1 --2- 172.21.15.84:0/1951075702 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb6801094b0 0x7fb6801098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:40.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.209+0000 7fb687a84640 1 --2- 172.21.15.84:0/1951075702 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680103bc0 0x7fb680103fd0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:40.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.209+0000 7fb687a84640 1 -- 172.21.15.84:0/1951075702 >> 172.21.15.84:0/1951075702 conn(0x7fb68007b910 msgr2=0x7fb68007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:40.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.209+0000 7fb687a84640 1 -- 172.21.15.84:0/1951075702 shutdown_connections 2024-09-21T03:51:40.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.209+0000 7fb687a84640 1 -- 172.21.15.84:0/1951075702 wait complete. 2024-09-21T03:51:40.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.210+0000 7fb687a84640 1 Processor -- start 2024-09-21T03:51:40.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.210+0000 7fb687a84640 1 -- start start 2024-09-21T03:51:40.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.210+0000 7fb687a84640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680103bc0 0x7fb68019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:40.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.210+0000 7fb687a84640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6801094b0 0x7fb68019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:40.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.210+0000 7fb687a84640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb680109e00 0x7fb68019fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:40.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.210+0000 7fb687a84640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb680113b80 con 0x7fb680103bc0 2024-09-21T03:51:40.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.210+0000 7fb687a84640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb680113a00 con 0x7fb6801094b0 2024-09-21T03:51:40.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.210+0000 7fb687a84640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb680113d00 con 0x7fb680109e00 2024-09-21T03:51:40.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.210+0000 7fb685820640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680103bc0 0x7fb68019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:40.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.210+0000 7fb685820640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680103bc0 0x7fb68019a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40028/0 (socket says 172.21.15.84:40028) 2024-09-21T03:51:40.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.210+0000 7fb685820640 1 -- 172.21.15.84:0/1939132001 learned_addr learned my addr 172.21.15.84:0/1939132001 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:40.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.210+0000 7fb68501f640 1 --2- 172.21.15.84:0/1939132001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6801094b0 0x7fb68019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:40.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.210+0000 7fb685820640 1 -- 172.21.15.84:0/1939132001 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb680109e00 msgr2=0x7fb68019fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:40.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.210+0000 7fb686021640 1 --2- 172.21.15.84:0/1939132001 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb680109e00 0x7fb68019fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:40.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.210+0000 7fb685820640 1 --2- 172.21.15.84:0/1939132001 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb680109e00 0x7fb68019fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:40.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.210+0000 7fb685820640 1 -- 172.21.15.84:0/1939132001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6801094b0 msgr2=0x7fb68019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:40.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.210+0000 7fb685820640 1 --2- 172.21.15.84:0/1939132001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6801094b0 0x7fb68019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:40.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.210+0000 7fb685820640 1 -- 172.21.15.84:0/1939132001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6801a0560 con 0x7fb680103bc0 2024-09-21T03:51:40.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.211+0000 7fb685820640 1 --2- 172.21.15.84:0/1939132001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680103bc0 0x7fb68019a5f0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fb67002ae00 tx=0x7fb670003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:40.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.211+0000 7fb67effd640 1 -- 172.21.15.84:0/1939132001 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb670004240 con 0x7fb680103bc0 2024-09-21T03:51:40.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.211+0000 7fb687a84640 1 -- 172.21.15.84:0/1939132001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6801a07f0 con 0x7fb680103bc0 2024-09-21T03:51:40.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.211+0000 7fb67effd640 1 -- 172.21.15.84:0/1939132001 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb670003e50 con 0x7fb680103bc0 2024-09-21T03:51:40.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.211+0000 7fb67effd640 1 -- 172.21.15.84:0/1939132001 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67003a400 con 0x7fb680103bc0 2024-09-21T03:51:40.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.211+0000 7fb687a84640 1 -- 172.21.15.84:0/1939132001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6801a6fb0 con 0x7fb680103bc0 2024-09-21T03:51:40.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.212+0000 7fb687a84640 1 -- 172.21.15.84:0/1939132001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb680104050 con 0x7fb680103bc0 2024-09-21T03:51:40.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.214+0000 7fb67effd640 1 -- 172.21.15.84:0/1939132001 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fb6700305e0 con 0x7fb680103bc0 2024-09-21T03:51:40.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.214+0000 7fb67effd640 1 --2- 172.21.15.84:0/1939132001 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb6680b6680 0x7fb6680b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:40.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.214+0000 7fb68501f640 1 --2- 172.21.15.84:0/1939132001 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb6680b6680 0x7fb6680b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:40.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.215+0000 7fb67effd640 1 -- 172.21.15.84:0/1939132001 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fb670108f10 con 0x7fb680103bc0 2024-09-21T03:51:40.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.215+0000 7fb68501f640 1 --2- 172.21.15.84:0/1939132001 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb6680b6680 0x7fb6680b8b90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb68007c390 tx=0x7fb674008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:40.224 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.217+0000 7fb67effd640 1 -- 172.21.15.84:0/1939132001 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb6700cf4b0 con 0x7fb680103bc0 2024-09-21T03:51:40.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.431+0000 7fb687a84640 1 -- 172.21.15.84:0/1939132001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb68019b720 con 0x7fb680103bc0 2024-09-21T03:51:40.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.431+0000 7fb67effd640 1 -- 172.21.15.84:0/1939132001 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7fb6700d3890 con 0x7fb680103bc0 2024-09-21T03:51:40.434 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:51:40.434 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:51:40.434 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:51:40.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.434+0000 7fb687a84640 1 -- 172.21.15.84:0/1939132001 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb6680b6680 msgr2=0x7fb6680b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:40.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.434+0000 7fb687a84640 1 --2- 172.21.15.84:0/1939132001 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb6680b6680 0x7fb6680b8b90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb68007c390 tx=0x7fb674008040 comp rx=0 tx=0).stop 2024-09-21T03:51:40.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.434+0000 7fb687a84640 1 -- 172.21.15.84:0/1939132001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680103bc0 msgr2=0x7fb68019a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:40.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.434+0000 7fb687a84640 1 --2- 172.21.15.84:0/1939132001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680103bc0 0x7fb68019a5f0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fb67002ae00 tx=0x7fb670003ba0 comp rx=0 tx=0).stop 2024-09-21T03:51:40.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.434+0000 7fb687a84640 1 -- 172.21.15.84:0/1939132001 shutdown_connections 2024-09-21T03:51:40.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.434+0000 7fb687a84640 1 --2- 172.21.15.84:0/1939132001 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb6680b6680 0x7fb6680b8b90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:40.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.434+0000 7fb687a84640 1 --2- 172.21.15.84:0/1939132001 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb680109e00 0x7fb68019fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:40.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.434+0000 7fb687a84640 1 --2- 172.21.15.84:0/1939132001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6801094b0 0x7fb68019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:40.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.434+0000 7fb687a84640 1 --2- 172.21.15.84:0/1939132001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb680103bc0 0x7fb68019a5f0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:40.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.434+0000 7fb687a84640 1 -- 172.21.15.84:0/1939132001 >> 172.21.15.84:0/1939132001 conn(0x7fb68007b910 msgr2=0x7fb680107660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:40.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.434+0000 7fb687a84640 1 -- 172.21.15.84:0/1939132001 shutdown_connections 2024-09-21T03:51:40.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:40.434+0000 7fb687a84640 1 -- 172.21.15.84:0/1939132001 wait complete. 2024-09-21T03:51:40.766 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:40 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1939132001' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:51:40.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:40 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1939132001' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:51:40.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:40 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1939132001' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:51:41.105 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:51:41.355 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:51:41.769 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:41 smithi084 ceph-mon[30941]: pgmap v606: 97 pgs: 97 active+clean; 17 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 KiB/s wr, 9 op/s 2024-09-21T03:51:41.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.858+0000 7f2926a27640 1 -- 172.21.15.84:0/3124165764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2920103230 msgr2=0x7f2920103640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:41.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.858+0000 7f2926a27640 1 --2- 172.21.15.84:0/3124165764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2920103230 0x7f2920103640 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f2910009900 tx=0x7f291002a410 comp rx=0 tx=0).stop 2024-09-21T03:51:41.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.858+0000 7f2926a27640 1 -- 172.21.15.84:0/3124165764 shutdown_connections 2024-09-21T03:51:41.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.858+0000 7f2926a27640 1 --2- 172.21.15.84:0/3124165764 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2920108db0 0x7f292010f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.858+0000 7f2926a27640 1 --2- 172.21.15.84:0/3124165764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2920108460 0x7f2920108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.858+0000 7f2926a27640 1 --2- 172.21.15.84:0/3124165764 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2920103230 0x7f2920103640 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.858+0000 7f2926a27640 1 -- 172.21.15.84:0/3124165764 >> 172.21.15.84:0/3124165764 conn(0x7f2920079ec0 msgr2=0x7f292007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:41.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.858+0000 7f2926a27640 1 -- 172.21.15.84:0/3124165764 shutdown_connections 2024-09-21T03:51:41.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.858+0000 7f2926a27640 1 -- 172.21.15.84:0/3124165764 wait complete. 2024-09-21T03:51:41.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.859+0000 7f2926a27640 1 Processor -- start 2024-09-21T03:51:41.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.859+0000 7f2926a27640 1 -- start start 2024-09-21T03:51:41.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.859+0000 7f2926a27640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2920103230 0x7f2920199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:41.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.859+0000 7f2926a27640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2920108460 0x7f29201999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:41.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.859+0000 7f2926a27640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2920108db0 0x7f292019ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:41.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.859+0000 7f2926a27640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2920112a70 con 0x7f2920108460 2024-09-21T03:51:41.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.859+0000 7f2926a27640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f29201128f0 con 0x7f2920103230 2024-09-21T03:51:41.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.859+0000 7f2926a27640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2920112bf0 con 0x7f2920108db0 2024-09-21T03:51:41.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.859+0000 7f291f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2920108460 0x7f29201999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:41.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.859+0000 7f291f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2920108460 0x7f29201999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40038/0 (socket says 172.21.15.84:40038) 2024-09-21T03:51:41.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.859+0000 7f291f7fe640 1 -- 172.21.15.84:0/256490356 learned_addr learned my addr 172.21.15.84:0/256490356 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:41.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.860+0000 7f291ffff640 1 --2- 172.21.15.84:0/256490356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2920103230 0x7f2920199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:41.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.860+0000 7f291f7fe640 1 -- 172.21.15.84:0/256490356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2920108db0 msgr2=0x7f292019ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:41.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.860+0000 7f291f7fe640 1 --2- 172.21.15.84:0/256490356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2920108db0 0x7f292019ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.860+0000 7f291f7fe640 1 -- 172.21.15.84:0/256490356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2920103230 msgr2=0x7f2920199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:41.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.860+0000 7f291f7fe640 1 --2- 172.21.15.84:0/256490356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2920103230 0x7f2920199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.860+0000 7f291f7fe640 1 -- 172.21.15.84:0/256490356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292019f2f0 con 0x7f2920108460 2024-09-21T03:51:41.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.860+0000 7f291f7fe640 1 --2- 172.21.15.84:0/256490356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2920108460 0x7f29201999e0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f291400c8c0 tx=0x7f291400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:41.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.860+0000 7f291d7fa640 1 -- 172.21.15.84:0/256490356 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2914007bb0 con 0x7f2920108460 2024-09-21T03:51:41.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.860+0000 7f291d7fa640 1 -- 172.21.15.84:0/256490356 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2914007d50 con 0x7f2920108460 2024-09-21T03:51:41.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.860+0000 7f2926a27640 1 -- 172.21.15.84:0/256490356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f292019f5e0 con 0x7f2920108460 2024-09-21T03:51:41.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.860+0000 7f291d7fa640 1 -- 172.21.15.84:0/256490356 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29140187c0 con 0x7f2920108460 2024-09-21T03:51:41.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.860+0000 7f2926a27640 1 -- 172.21.15.84:0/256490356 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29201a5e00 con 0x7f2920108460 2024-09-21T03:51:41.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.862+0000 7f292cf9b740 1 Processor -- start 2024-09-21T03:51:41.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.863+0000 7f292cf9b740 1 -- start start 2024-09-21T03:51:41.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.863+0000 7f291d7fa640 1 -- 172.21.15.84:0/256490356 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f291400fa20 con 0x7f2920108460 2024-09-21T03:51:41.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.863+0000 7f292cf9b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559853d3c070 0x5598540e32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:41.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.863+0000 7f292cf9b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559853d131b0 0x5598540e3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:41.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.863+0000 7f292cf9b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 0x5598540e3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:41.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.863+0000 7f292cf9b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559854059ea0 con 0x559853d1b390 2024-09-21T03:51:41.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.863+0000 7f292cf9b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5598540492d0 con 0x559853d3c070 2024-09-21T03:51:41.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.863+0000 7f292cf9b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55985404d0e0 con 0x559853d131b0 2024-09-21T03:51:41.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.863+0000 7f291f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 0x5598540e3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:41.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.863+0000 7f291f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 0x5598540e3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40052/0 (socket says 172.21.15.84:40052) 2024-09-21T03:51:41.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.863+0000 7f291f7fe640 1 -- 172.21.15.84:0/175521638 learned_addr learned my addr 172.21.15.84:0/175521638 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:41.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.863+0000 7f2924fc4640 1 --2- 172.21.15.84:0/175521638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559853d3c070 0x5598540e32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:41.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.863+0000 7f291ffff640 1 --2- 172.21.15.84:0/175521638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559853d131b0 0x5598540e3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:41.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.863+0000 7f291f7fe640 1 -- 172.21.15.84:0/175521638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559853d131b0 msgr2=0x5598540e3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:41.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.863+0000 7f291f7fe640 1 --2- 172.21.15.84:0/175521638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559853d131b0 0x5598540e3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.863+0000 7f291f7fe640 1 -- 172.21.15.84:0/175521638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559853d3c070 msgr2=0x5598540e32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:41.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.863+0000 7f291f7fe640 1 --2- 172.21.15.84:0/175521638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559853d3c070 0x5598540e32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.863+0000 7f291f7fe640 1 -- 172.21.15.84:0/175521638 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559853da7650 con 0x559853d1b390 2024-09-21T03:51:41.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.864+0000 7f291f7fe640 1 --2- 172.21.15.84:0/175521638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 0x5598540e3d40 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f29140e4f30 tx=0x7f29140eddb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8302c6de4aeffc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:41.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.864+0000 7f291d7fa640 1 --2- 172.21.15.84:0/256490356 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29080b66b0 0x7f29080b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:41.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.864+0000 7f2924fc4640 1 --2- 172.21.15.84:0/256490356 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29080b66b0 0x7f29080b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:41.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.864+0000 7f29067fc640 1 -- 172.21.15.84:0/175521638 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29140a9d10 con 0x559853d1b390 2024-09-21T03:51:41.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.864+0000 7f29067fc640 1 -- 172.21.15.84:0/175521638 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29140f4070 con 0x559853d1b390 2024-09-21T03:51:41.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.864+0000 7f291d7fa640 1 -- 172.21.15.84:0/256490356 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f29140e7820 con 0x7f2920108460 2024-09-21T03:51:41.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.864+0000 7f29067fc640 1 -- 172.21.15.84:0/175521638 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29140b4510 con 0x559853d1b390 2024-09-21T03:51:41.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.865+0000 7f292cf9b740 1 -- 172.21.15.84:0/175521638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 msgr2=0x5598540e3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:41.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.865+0000 7f292cf9b740 1 --2- 172.21.15.84:0/175521638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 0x5598540e3d40 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f29140e4f30 tx=0x7f29140eddb0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.865+0000 7f2924fc4640 1 --2- 172.21.15.84:0/256490356 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29080b66b0 0x7f29080b8bc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2918007750 tx=0x7f29180076e0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:41.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.865+0000 7f292cf9b740 1 -- 172.21.15.84:0/175521638 shutdown_connections 2024-09-21T03:51:41.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.865+0000 7f292cf9b740 1 --2- 172.21.15.84:0/175521638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 0x5598540e3d40 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.865+0000 7f292cf9b740 1 --2- 172.21.15.84:0/175521638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559853d131b0 0x5598540e3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.865+0000 7f292cf9b740 1 --2- 172.21.15.84:0/175521638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559853d3c070 0x5598540e32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.865+0000 7f292cf9b740 1 -- 172.21.15.84:0/175521638 >> 172.21.15.84:0/175521638 conn(0x559853d30460 msgr2=0x5598540e11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:41.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.865+0000 7f292cf9b740 1 -- 172.21.15.84:0/175521638 shutdown_connections 2024-09-21T03:51:41.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.865+0000 7f292cf9b740 1 -- 172.21.15.84:0/175521638 wait complete. 2024-09-21T03:51:41.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.865+0000 7f292cf9b740 1 -- start start 2024-09-21T03:51:41.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.866+0000 7f292cf9b740 1 Processor -- start 2024-09-21T03:51:41.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.866+0000 7f292cf9b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559853d131b0 0x5598540ee980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.866+0000 7f292cf9b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 0x5598540eeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.866+0000 7f292cf9b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559853d3c070 0x5598540fad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.866+0000 7f292cf9b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559853eaa700 con 0x559853d1b390 2024-09-21T03:51:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.866+0000 7f292cf9b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559853fe4160 con 0x559853d3c070 2024-09-21T03:51:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.866+0000 7f292cf9b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5598540f1aa0 con 0x559853d131b0 2024-09-21T03:51:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.866+0000 7f292cf9b740 10 client.0 _ll_register_callbacks cb 0x559853ffd9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:51:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.866+0000 7f291f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 0x5598540eeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.866+0000 7f291f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 0x5598540eeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40064/0 (socket says 172.21.15.84:40064) 2024-09-21T03:51:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.866+0000 7f291f7fe640 1 -- 172.21.15.84:0/691445377 learned_addr learned my addr 172.21.15.84:0/691445377 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.866+0000 7f2924fc4640 1 --2- 172.21.15.84:0/691445377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559853d3c070 0x5598540fad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.866+0000 7f291ffff640 1 --2- 172.21.15.84:0/691445377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559853d131b0 0x5598540ee980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.866+0000 7f291f7fe640 1 -- 172.21.15.84:0/691445377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559853d131b0 msgr2=0x5598540ee980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.866+0000 7f291f7fe640 1 --2- 172.21.15.84:0/691445377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559853d131b0 0x5598540ee980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.866+0000 7f291f7fe640 1 -- 172.21.15.84:0/691445377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559853d3c070 msgr2=0x5598540fad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:41.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.866+0000 7f291f7fe640 1 --2- 172.21.15.84:0/691445377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559853d3c070 0x5598540fad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.866+0000 7f291f7fe640 1 -- 172.21.15.84:0/691445377 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559854011c90 con 0x559853d1b390 2024-09-21T03:51:41.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.867+0000 7f291f7fe640 1 --2- 172.21.15.84:0/691445377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 0x5598540eeec0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f29140ad3c0 tx=0x7f29140e7b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ea55476b60f5b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:41.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.867+0000 7f28ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:51:41.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.867+0000 7f28ff7fe640 1 -- 172.21.15.84:0/691445377 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29140b4740 con 0x559853d1b390 2024-09-21T03:51:41.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.867+0000 7f28ff7fe640 1 -- 172.21.15.84:0/691445377 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f29140a9930 con 0x559853d1b390 2024-09-21T03:51:41.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.867+0000 7f292cf9b740 1 -- 172.21.15.84:0/691445377 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29140f4070 con 0x559853d1b390 2024-09-21T03:51:41.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.867+0000 7f28ff7fe640 1 -- 172.21.15.84:0/691445377 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f29140ac1d0 con 0x559853d1b390 2024-09-21T03:51:41.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.867+0000 7f292cf9b740 10 client.17193 fetch_fsmap learned FSMap version 25 2024-09-21T03:51:41.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.867+0000 7f292cf9b740 1 -- 172.21.15.84:0/691445377 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5598540fd7b0 con 0x559853d1b390 2024-09-21T03:51:41.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.867+0000 7f28ff7fe640 1 -- 172.21.15.84:0/691445377 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29140f4070 con 0x559853d1b390 2024-09-21T03:51:41.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.867+0000 7f28ff7fe640 1 -- 172.21.15.84:0/691445377 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f291401f300 con 0x559853d1b390 2024-09-21T03:51:41.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.867+0000 7f292cf9b740 10 client.17193 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:51:41.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.868+0000 7f292cf9b740 10 client.17193 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:51:41.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.868+0000 7f292cf9b740 20 client.17193 populate_metadata read hostname 'smithi084' 2024-09-21T03:51:41.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.868+0000 7f292cf9b740 1 --2- 172.21.15.84:0/691445377 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x559853cfa9f0 0x559854100b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:41.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.868+0000 7f292cf9b740 4 client.17193 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:51:41.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.868+0000 7f292cf9b740 1 -- 172.21.15.84:0/691445377 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55985405bdf0 con 0x559853cfa9f0 2024-09-21T03:51:41.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.868+0000 7f291ffff640 1 --2- 172.21.15.84:0/691445377 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x559853cfa9f0 0x559854100b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:41.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.868+0000 7f291ffff640 1 --2- 172.21.15.84:0/691445377 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x559853cfa9f0 0x559854100b10 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c926c805fd94428e server_cookie=6be11e2261801460 in_seq=0 out_seq=0 2024-09-21T03:51:41.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.868+0000 7f28ff7fe640 10 client.17193 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:51:41.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:41 smithi174 ceph-mon[34403]: pgmap v606: 97 pgs: 97 active+clean; 17 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 KiB/s wr, 9 op/s 2024-09-21T03:51:41.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.869+0000 7f28ff7fe640 1 -- 172.21.15.84:0/691445377 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55985405bdf0 con 0x559853cfa9f0 2024-09-21T03:51:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.869+0000 7f28ff7fe640 10 client.17193 handle_command_reply: tid=0 2024-09-21T03:51:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.869+0000 7f292cf9b740 1 client.17193 shutdown 2024-09-21T03:51:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.869+0000 7f292cf9b740 1 -- 172.21.15.84:0/691445377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 msgr2=0x5598540eeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.869+0000 7f292cf9b740 1 --2- 172.21.15.84:0/691445377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 0x5598540eeec0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f29140ad3c0 tx=0x7f29140e7b20 comp rx=0 tx=0).stop 2024-09-21T03:51:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.870+0000 7f292cf9b740 1 -- 172.21.15.84:0/691445377 shutdown_connections 2024-09-21T03:51:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.870+0000 7f292cf9b740 1 --2- 172.21.15.84:0/691445377 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x559853cfa9f0 0x559854100b10 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.870+0000 7f292cf9b740 1 --2- 172.21.15.84:0/691445377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559853d3c070 0x5598540fad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.870+0000 7f292cf9b740 1 --2- 172.21.15.84:0/691445377 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 0x5598540eeec0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.870+0000 7f28ff7fe640 0 client.17193 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:51:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.870+0000 7f292cf9b740 1 --2- 172.21.15.84:0/691445377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559853d131b0 0x5598540ee980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.870+0000 7f292cf9b740 1 -- 172.21.15.84:0/691445377 >> 172.21.15.84:0/691445377 conn(0x559853d30460 msgr2=0x5598540e64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.870+0000 7f292cf9b740 1 -- 172.21.15.84:0/691445377 shutdown_connections 2024-09-21T03:51:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.870+0000 7f292cf9b740 1 -- 172.21.15.84:0/691445377 wait complete. 2024-09-21T03:51:41.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.870+0000 7f292cf9b740 20 client.17193 trim_cache size 0 max 16384 2024-09-21T03:51:41.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.883+0000 7f292cf9b740 1 Processor -- start 2024-09-21T03:51:41.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.883+0000 7f292cf9b740 1 -- start start 2024-09-21T03:51:41.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.883+0000 7f292cf9b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559853d131b0 0x5598540e4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:41.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.883+0000 7f292cf9b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 0x5598540fad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:41.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.883+0000 7f292cf9b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559853d3c070 0x5598540ebb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:41.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.883+0000 7f292cf9b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f29201b0de0 con 0x559853d1b390 2024-09-21T03:51:41.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.883+0000 7f292cf9b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f29201ae6b0 con 0x559853d131b0 2024-09-21T03:51:41.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.883+0000 7f292cf9b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f29201ac520 con 0x559853d3c070 2024-09-21T03:51:41.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.883+0000 7f291f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 0x5598540fad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:41.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.883+0000 7f291f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 0x5598540fad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40072/0 (socket says 172.21.15.84:40072) 2024-09-21T03:51:41.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.883+0000 7f291f7fe640 1 -- 172.21.15.84:0/3709572155 learned_addr learned my addr 172.21.15.84:0/3709572155 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:41.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.883+0000 7f291f7fe640 1 -- 172.21.15.84:0/3709572155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559853d3c070 msgr2=0x5598540ebb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:41.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.883+0000 7f291f7fe640 1 --2- 172.21.15.84:0/3709572155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559853d3c070 0x5598540ebb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.883+0000 7f291f7fe640 1 -- 172.21.15.84:0/3709572155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559853d131b0 msgr2=0x5598540e4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:41.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.883+0000 7f291f7fe640 1 --2- 172.21.15.84:0/3709572155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559853d131b0 0x5598540e4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.883+0000 7f291f7fe640 1 -- 172.21.15.84:0/3709572155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598540efc40 con 0x559853d1b390 2024-09-21T03:51:41.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.883+0000 7f291f7fe640 1 --2- 172.21.15.84:0/3709572155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 0x5598540fad00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f29140aa930 tx=0x7f29140e4fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c368017eb6327a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:41.889 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.884+0000 7f2905ffb640 1 -- 172.21.15.84:0/3709572155 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29140ace30 con 0x559853d1b390 2024-09-21T03:51:41.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.884+0000 7f2905ffb640 1 -- 172.21.15.84:0/3709572155 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29140f4070 con 0x559853d1b390 2024-09-21T03:51:41.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.884+0000 7f2905ffb640 1 -- 172.21.15.84:0/3709572155 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29140ad010 con 0x559853d1b390 2024-09-21T03:51:41.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.884+0000 7f292cf9b740 1 -- 172.21.15.84:0/3709572155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 msgr2=0x5598540fad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:41.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.884+0000 7f292cf9b740 1 --2- 172.21.15.84:0/3709572155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 0x5598540fad00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f29140aa930 tx=0x7f29140e4fe0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.884+0000 7f292cf9b740 1 -- 172.21.15.84:0/3709572155 shutdown_connections 2024-09-21T03:51:41.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.884+0000 7f292cf9b740 1 --2- 172.21.15.84:0/3709572155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559853d3c070 0x5598540ebb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.884+0000 7f292cf9b740 1 --2- 172.21.15.84:0/3709572155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d1b390 0x5598540fad00 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.884+0000 7f292cf9b740 1 --2- 172.21.15.84:0/3709572155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559853d131b0 0x5598540e4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.884+0000 7f292cf9b740 1 -- 172.21.15.84:0/3709572155 >> 172.21.15.84:0/3709572155 conn(0x559853d30460 msgr2=0x5598540e42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:41.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.884+0000 7f292cf9b740 1 -- 172.21.15.84:0/3709572155 shutdown_connections 2024-09-21T03:51:41.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.884+0000 7f292cf9b740 1 -- 172.21.15.84:0/3709572155 wait complete. 2024-09-21T03:51:41.890 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.885+0000 7f292cf9b740 1 -- start start 2024-09-21T03:51:41.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.885+0000 7f292cf9b740 1 Processor -- start 2024-09-21T03:51:41.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.885+0000 7f292cf9b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559853d131b0 0x559854101e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:41.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.885+0000 7f292cf9b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559853d1b390 0x559854102340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:41.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.885+0000 7f292cf9b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d3c070 0x55985416e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:41.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.885+0000 7f292cf9b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f29201acb70 con 0x559853d3c070 2024-09-21T03:51:41.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.885+0000 7f292cf9b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f29201adfe0 con 0x559853d131b0 2024-09-21T03:51:41.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.885+0000 7f292cf9b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f29201ad240 con 0x559853d1b390 2024-09-21T03:51:41.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.885+0000 7f292cf9b740 10 client.0 _ll_register_callbacks cb 0x7f2918007340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:51:41.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.885+0000 7f2924fc4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d3c070 0x55985416e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:41.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.886+0000 7f2924fc4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d3c070 0x55985416e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40078/0 (socket says 172.21.15.84:40078) 2024-09-21T03:51:41.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.886+0000 7f2924fc4640 1 -- 172.21.15.84:0/2255757425 learned_addr learned my addr 172.21.15.84:0/2255757425 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:41.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.886+0000 7f291ffff640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559853d131b0 0x559854101e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:41.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.886+0000 7f291f7fe640 1 --2- 172.21.15.84:0/2255757425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559853d1b390 0x559854102340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:41.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.886+0000 7f2924fc4640 1 -- 172.21.15.84:0/2255757425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559853d1b390 msgr2=0x559854102340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:41.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.886+0000 7f2924fc4640 1 --2- 172.21.15.84:0/2255757425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559853d1b390 0x559854102340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.886+0000 7f2924fc4640 1 -- 172.21.15.84:0/2255757425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559853d131b0 msgr2=0x559854101e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:41.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.886+0000 7f2924fc4640 1 --2- 172.21.15.84:0/2255757425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559853d131b0 0x559854101e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.886+0000 7f2924fc4640 1 -- 172.21.15.84:0/2255757425 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559854102b90 con 0x559853d3c070 2024-09-21T03:51:41.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.886+0000 7f291ffff640 1 --2- 172.21.15.84:0/2255757425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559853d131b0 0x559854101e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:51:41.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.886+0000 7f2924fc4640 1 --2- 172.21.15.84:0/2255757425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d3c070 0x55985416e6a0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f291801ed80 tx=0x7f2918004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f748e054c5e0275c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:41.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.886+0000 7f28ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:51:41.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.886+0000 7f28ff7fe640 1 -- 172.21.15.84:0/2255757425 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29180197b0 con 0x559853d3c070 2024-09-21T03:51:41.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.886+0000 7f28ff7fe640 1 -- 172.21.15.84:0/2255757425 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f2918019950 con 0x559853d3c070 2024-09-21T03:51:41.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.886+0000 7f292cf9b740 1 -- 172.21.15.84:0/2255757425 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29140f4070 con 0x559853d3c070 2024-09-21T03:51:41.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.886+0000 7f28ff7fe640 1 -- 172.21.15.84:0/2255757425 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2918019b50 con 0x559853d3c070 2024-09-21T03:51:41.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.886+0000 7f292cf9b740 10 client.17199 fetch_fsmap learned FSMap version 25 2024-09-21T03:51:41.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.886+0000 7f292cf9b740 1 -- 172.21.15.84:0/2255757425 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55985416fc50 con 0x559853d3c070 2024-09-21T03:51:41.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.887+0000 7f28ff7fe640 1 -- 172.21.15.84:0/2255757425 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29140f4070 con 0x559853d3c070 2024-09-21T03:51:41.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.887+0000 7f28ff7fe640 1 -- 172.21.15.84:0/2255757425 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2918025070 con 0x559853d3c070 2024-09-21T03:51:41.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.887+0000 7f292cf9b740 10 client.17199 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:51:41.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.887+0000 7f292cf9b740 10 client.17199 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:51:41.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.887+0000 7f292cf9b740 20 client.17199 populate_metadata read hostname 'smithi084' 2024-09-21T03:51:41.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.887+0000 7f292cf9b740 1 --2- 172.21.15.84:0/2255757425 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x559853ccfda0 0x5598541723e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:41.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.887+0000 7f292cf9b740 4 client.17199 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:51:41.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.887+0000 7f292cf9b740 1 -- 172.21.15.84:0/2255757425 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5598540578a0 con 0x559853ccfda0 2024-09-21T03:51:41.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.887+0000 7f291ffff640 1 --2- 172.21.15.84:0/2255757425 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x559853ccfda0 0x5598541723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:41.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.888+0000 7f291ffff640 1 --2- 172.21.15.84:0/2255757425 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x559853ccfda0 0x5598541723e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dde7db614a4bc2cb server_cookie=b00a0d7a87d056ac in_seq=0 out_seq=0 2024-09-21T03:51:41.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.888+0000 7f28ff7fe640 10 client.17199 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:51:41.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.888+0000 7f28ff7fe640 1 -- 172.21.15.84:0/2255757425 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5598540578a0 con 0x559853ccfda0 2024-09-21T03:51:41.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.888+0000 7f28ff7fe640 10 client.17199 handle_command_reply: tid=0 2024-09-21T03:51:41.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.888+0000 7f292cf9b740 1 client.17199 shutdown 2024-09-21T03:51:41.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.888+0000 7f292cf9b740 1 -- 172.21.15.84:0/2255757425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d3c070 msgr2=0x55985416e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:41.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.888+0000 7f292cf9b740 1 --2- 172.21.15.84:0/2255757425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d3c070 0x55985416e6a0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f291801ed80 tx=0x7f2918004a40 comp rx=0 tx=0).stop 2024-09-21T03:51:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.888+0000 7f292cf9b740 1 -- 172.21.15.84:0/2255757425 shutdown_connections 2024-09-21T03:51:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.888+0000 7f292cf9b740 1 --2- 172.21.15.84:0/2255757425 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x559853ccfda0 0x5598541723e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.888+0000 7f292cf9b740 1 --2- 172.21.15.84:0/2255757425 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559853d3c070 0x55985416e6a0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.888+0000 7f292cf9b740 1 --2- 172.21.15.84:0/2255757425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559853d1b390 0x559854102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.888+0000 7f292cf9b740 1 --2- 172.21.15.84:0/2255757425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559853d131b0 0x559854101e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.888+0000 7f28ff7fe640 0 client.17199 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:51:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.888+0000 7f292cf9b740 1 -- 172.21.15.84:0/2255757425 >> 172.21.15.84:0/2255757425 conn(0x559853d30460 msgr2=0x5598540e6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.888+0000 7f292cf9b740 1 -- 172.21.15.84:0/2255757425 shutdown_connections 2024-09-21T03:51:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.888+0000 7f292cf9b740 1 -- 172.21.15.84:0/2255757425 wait complete. 2024-09-21T03:51:41.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.888+0000 7f292cf9b740 20 client.17199 trim_cache size 0 max 16384 2024-09-21T03:51:41.895 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:51:41.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.889+0000 7f2926a27640 1 -- 172.21.15.84:0/256490356 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29080b66b0 msgr2=0x7f29080b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:41.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.889+0000 7f2926a27640 1 --2- 172.21.15.84:0/256490356 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29080b66b0 0x7f29080b8bc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2918007750 tx=0x7f29180076e0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.889+0000 7f2926a27640 1 -- 172.21.15.84:0/256490356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2920108460 msgr2=0x7f29201999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:41.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.889+0000 7f2926a27640 1 --2- 172.21.15.84:0/256490356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2920108460 0x7f29201999e0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f291400c8c0 tx=0x7f291400cd80 comp rx=0 tx=0).stop 2024-09-21T03:51:41.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.889+0000 7f2926a27640 1 -- 172.21.15.84:0/256490356 shutdown_connections 2024-09-21T03:51:41.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.889+0000 7f2926a27640 1 --2- 172.21.15.84:0/256490356 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29080b66b0 0x7f29080b8bc0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.889+0000 7f2926a27640 1 --2- 172.21.15.84:0/256490356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2920108db0 0x7f292019ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.889+0000 7f2926a27640 1 --2- 172.21.15.84:0/256490356 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2920108460 0x7f29201999e0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.889+0000 7f2926a27640 1 --2- 172.21.15.84:0/256490356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2920103230 0x7f2920199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:41.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.889+0000 7f2926a27640 1 -- 172.21.15.84:0/256490356 >> 172.21.15.84:0/256490356 conn(0x7f2920079ec0 msgr2=0x7f2920106550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:41.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.889+0000 7f2926a27640 1 -- 172.21.15.84:0/256490356 shutdown_connections 2024-09-21T03:51:41.897 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:41.889+0000 7f2926a27640 1 -- 172.21.15.84:0/256490356 wait complete. 2024-09-21T03:51:41.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:41 smithi172 ceph-mon[34821]: pgmap v606: 97 pgs: 97 active+clean; 17 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 KiB/s wr, 9 op/s 2024-09-21T03:51:42.568 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:51:42.811 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:51:43.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.367+0000 7f5f9a6b0640 1 -- 172.21.15.84:0/3780177490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f94103b80 msgr2=0x7f5f94103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:43.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.367+0000 7f5f9a6b0640 1 --2- 172.21.15.84:0/3780177490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f94103b80 0x7f5f94103f90 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f5f84009900 tx=0x7f5f8402a410 comp rx=0 tx=0).stop 2024-09-21T03:51:43.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.367+0000 7f5f9a6b0640 1 -- 172.21.15.84:0/3780177490 shutdown_connections 2024-09-21T03:51:43.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.367+0000 7f5f9a6b0640 1 --2- 172.21.15.84:0/3780177490 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f94109e10 0x7f5f94110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.367+0000 7f5f9a6b0640 1 --2- 172.21.15.84:0/3780177490 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f941094c0 0x7f5f941098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.367+0000 7f5f9a6b0640 1 --2- 172.21.15.84:0/3780177490 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f94103b80 0x7f5f94103f90 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.367+0000 7f5f9a6b0640 1 -- 172.21.15.84:0/3780177490 >> 172.21.15.84:0/3780177490 conn(0x7f5f940ff5d0 msgr2=0x7f5f94101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:43.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.368+0000 7f5f9a6b0640 1 -- 172.21.15.84:0/3780177490 shutdown_connections 2024-09-21T03:51:43.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.368+0000 7f5f9a6b0640 1 -- 172.21.15.84:0/3780177490 wait complete. 2024-09-21T03:51:43.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.368+0000 7f5f9a6b0640 1 Processor -- start 2024-09-21T03:51:43.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.368+0000 7f5f9a6b0640 1 -- start start 2024-09-21T03:51:43.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.369+0000 7f5f9a6b0640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f94103b80 0x7f5f9419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:43.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.369+0000 7f5f9a6b0640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f941094c0 0x7f5f9419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:43.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.369+0000 7f5f9a6b0640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f94109e10 0x7f5f9419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:43.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.369+0000 7f5f9a6b0640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5f94113b10 con 0x7f5f941094c0 2024-09-21T03:51:43.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.369+0000 7f5f9a6b0640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5f94113990 con 0x7f5f94109e10 2024-09-21T03:51:43.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.369+0000 7f5f9a6b0640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5f94113c90 con 0x7f5f94103b80 2024-09-21T03:51:43.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.369+0000 7f5f937fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f941094c0 0x7f5f9419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:43.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.369+0000 7f5f937fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f941094c0 0x7f5f9419aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40082/0 (socket says 172.21.15.84:40082) 2024-09-21T03:51:43.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.369+0000 7f5f937fe640 1 -- 172.21.15.84:0/1453129665 learned_addr learned my addr 172.21.15.84:0/1453129665 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:43.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.369+0000 7f5f93fff640 1 --2- 172.21.15.84:0/1453129665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f94103b80 0x7f5f9419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:43.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.369+0000 7f5f98c4d640 1 --2- 172.21.15.84:0/1453129665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f94109e10 0x7f5f9419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:43.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.369+0000 7f5f937fe640 1 -- 172.21.15.84:0/1453129665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f94103b80 msgr2=0x7f5f9419a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:43.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.369+0000 7f5f937fe640 1 --2- 172.21.15.84:0/1453129665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f94103b80 0x7f5f9419a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.369+0000 7f5f937fe640 1 -- 172.21.15.84:0/1453129665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f94109e10 msgr2=0x7f5f9419fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:43.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.369+0000 7f5f937fe640 1 --2- 172.21.15.84:0/1453129665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f94109e10 0x7f5f9419fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.369+0000 7f5f937fe640 1 -- 172.21.15.84:0/1453129665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f941a0450 con 0x7f5f941094c0 2024-09-21T03:51:43.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.369+0000 7f5f937fe640 1 --2- 172.21.15.84:0/1453129665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f941094c0 0x7f5f9419aa80 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f5f88006fd0 tx=0x7f5f8800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:43.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.370+0000 7f5f917fa640 1 -- 172.21.15.84:0/1453129665 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88011830 con 0x7f5f941094c0 2024-09-21T03:51:43.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.370+0000 7f5f917fa640 1 -- 172.21.15.84:0/1453129665 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f88016070 con 0x7f5f941094c0 2024-09-21T03:51:43.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.370+0000 7f5f9a6b0640 1 -- 172.21.15.84:0/1453129665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f941a0740 con 0x7f5f941094c0 2024-09-21T03:51:43.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.370+0000 7f5f917fa640 1 -- 172.21.15.84:0/1453129665 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88010e00 con 0x7f5f941094c0 2024-09-21T03:51:43.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.370+0000 7f5f9a6b0640 1 -- 172.21.15.84:0/1453129665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f941a6f20 con 0x7f5f941094c0 2024-09-21T03:51:43.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.372+0000 7f5fa0c24740 1 Processor -- start 2024-09-21T03:51:43.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.372+0000 7f5f917fa640 1 -- 172.21.15.84:0/1453129665 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f5f8801b460 con 0x7f5f941094c0 2024-09-21T03:51:43.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.372+0000 7f5fa0c24740 1 -- start start 2024-09-21T03:51:43.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.372+0000 7f5fa0c24740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8da1070 0x5591d91486a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:43.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.372+0000 7f5fa0c24740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8d781b0 0x5591d9148be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:43.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.372+0000 7f5fa0c24740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 0x5591d9149120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:43.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.373+0000 7f5fa0c24740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5591d90beea0 con 0x5591d8d80390 2024-09-21T03:51:43.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.373+0000 7f5fa0c24740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5591d90ae2d0 con 0x5591d8d781b0 2024-09-21T03:51:43.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.373+0000 7f5fa0c24740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5591d90b20e0 con 0x5591d8da1070 2024-09-21T03:51:43.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.373+0000 7f5f937fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 0x5591d9149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:43.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.373+0000 7f5f937fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 0x5591d9149120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40090/0 (socket says 172.21.15.84:40090) 2024-09-21T03:51:43.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.373+0000 7f5f937fe640 1 -- 172.21.15.84:0/854136988 learned_addr learned my addr 172.21.15.84:0/854136988 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:43.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.373+0000 7f5f98c4d640 1 --2- 172.21.15.84:0/854136988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8da1070 0x5591d91486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:43.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.373+0000 7f5f93fff640 1 --2- 172.21.15.84:0/854136988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8d781b0 0x5591d9148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:43.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.373+0000 7f5f937fe640 1 -- 172.21.15.84:0/854136988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8da1070 msgr2=0x5591d91486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:43.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.373+0000 7f5f937fe640 1 --2- 172.21.15.84:0/854136988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8da1070 0x5591d91486a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.373+0000 7f5f937fe640 1 -- 172.21.15.84:0/854136988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8d781b0 msgr2=0x5591d9148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:43.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.373+0000 7f5f937fe640 1 --2- 172.21.15.84:0/854136988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8d781b0 0x5591d9148be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.373+0000 7f5f937fe640 1 -- 172.21.15.84:0/854136988 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591d8e0c650 con 0x5591d8d80390 2024-09-21T03:51:43.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.373+0000 7f5f917fa640 1 --2- 172.21.15.84:0/1453129665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f7c0b6700 0x7f5f7c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:43.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.373+0000 7f5f937fe640 1 --2- 172.21.15.84:0/854136988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 0x5591d9149120 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f5f880e41c0 tx=0x7f5f880ef220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418e755cd93d8c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:43.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.373+0000 7f5f98c4d640 1 --2- 172.21.15.84:0/1453129665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f7c0b6700 0x7f5f7c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:43.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.373+0000 7f5f917fa640 1 -- 172.21.15.84:0/1453129665 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f5f880e6ab0 con 0x7f5f941094c0 2024-09-21T03:51:43.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.374+0000 7f5f7a7fc640 1 -- 172.21.15.84:0/854136988 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f880a8fa0 con 0x5591d8d80390 2024-09-21T03:51:43.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.374+0000 7f5f7a7fc640 1 -- 172.21.15.84:0/854136988 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f880ec050 con 0x5591d8d80390 2024-09-21T03:51:43.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.374+0000 7f5f7a7fc640 1 -- 172.21.15.84:0/854136988 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f880ac0c0 con 0x5591d8d80390 2024-09-21T03:51:43.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.374+0000 7f5fa0c24740 1 -- 172.21.15.84:0/854136988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 msgr2=0x5591d9149120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:43.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.374+0000 7f5fa0c24740 1 --2- 172.21.15.84:0/854136988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 0x5591d9149120 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f5f880e41c0 tx=0x7f5f880ef220 comp rx=0 tx=0).stop 2024-09-21T03:51:43.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.374+0000 7f5f98c4d640 1 --2- 172.21.15.84:0/1453129665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f7c0b6700 0x7f5f7c0b8c10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c005fd0 tx=0x7f5f8c009600 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:43.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.375+0000 7f5fa0c24740 1 -- 172.21.15.84:0/854136988 shutdown_connections 2024-09-21T03:51:43.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.375+0000 7f5fa0c24740 1 --2- 172.21.15.84:0/854136988 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 0x5591d9149120 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.375+0000 7f5fa0c24740 1 --2- 172.21.15.84:0/854136988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8d781b0 0x5591d9148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.375+0000 7f5fa0c24740 1 --2- 172.21.15.84:0/854136988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8da1070 0x5591d91486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.375+0000 7f5fa0c24740 1 -- 172.21.15.84:0/854136988 >> 172.21.15.84:0/854136988 conn(0x5591d8d95460 msgr2=0x5591d9146590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:43.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.375+0000 7f5fa0c24740 1 -- 172.21.15.84:0/854136988 shutdown_connections 2024-09-21T03:51:43.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.375+0000 7f5fa0c24740 1 -- 172.21.15.84:0/854136988 wait complete. 2024-09-21T03:51:43.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.375+0000 7f5fa0c24740 1 -- start start 2024-09-21T03:51:43.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.375+0000 7f5fa0c24740 1 Processor -- start 2024-09-21T03:51:43.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5fa0c24740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8d781b0 0x5591d9153d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:43.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5fa0c24740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 0x5591d9154290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:43.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5fa0c24740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8da1070 0x5591d91601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:43.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5fa0c24740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5591d8f0f700 con 0x5591d8d80390 2024-09-21T03:51:43.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5fa0c24740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5591d9049160 con 0x5591d8da1070 2024-09-21T03:51:43.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5fa0c24740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5591d9156e80 con 0x5591d8d781b0 2024-09-21T03:51:43.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5fa0c24740 10 client.0 _ll_register_callbacks cb 0x5591d90629e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:51:43.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5f937fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 0x5591d9154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:43.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5f937fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 0x5591d9154290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40100/0 (socket says 172.21.15.84:40100) 2024-09-21T03:51:43.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5f937fe640 1 -- 172.21.15.84:0/463829271 learned_addr learned my addr 172.21.15.84:0/463829271 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:43.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5f93fff640 1 --2- 172.21.15.84:0/463829271 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8d781b0 0x5591d9153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:43.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5f98c4d640 1 --2- 172.21.15.84:0/463829271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8da1070 0x5591d91601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:43.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5f937fe640 1 -- 172.21.15.84:0/463829271 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8d781b0 msgr2=0x5591d9153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:43.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5f937fe640 1 --2- 172.21.15.84:0/463829271 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8d781b0 0x5591d9153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5f937fe640 1 -- 172.21.15.84:0/463829271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8da1070 msgr2=0x5591d91601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:43.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5f937fe640 1 --2- 172.21.15.84:0/463829271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8da1070 0x5591d91601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5f937fe640 1 -- 172.21.15.84:0/463829271 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591d9076c90 con 0x5591d8d80390 2024-09-21T03:51:43.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5f937fe640 1 --2- 172.21.15.84:0/463829271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 0x5591d9154290 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f5f88000c00 tx=0x7f5f8800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcfd73805379505 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:43.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5f737fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:51:43.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5f737fe640 1 -- 172.21.15.84:0/463829271 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f880ac2a0 con 0x5591d8d80390 2024-09-21T03:51:43.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5f737fe640 1 -- 172.21.15.84:0/463829271 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f5f880b60f0 con 0x5591d8d80390 2024-09-21T03:51:43.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.376+0000 7f5fa0c24740 1 -- 172.21.15.84:0/463829271 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f880ec050 con 0x5591d8d80390 2024-09-21T03:51:43.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.377+0000 7f5f737fe640 1 -- 172.21.15.84:0/463829271 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5f880ac720 con 0x5591d8d80390 2024-09-21T03:51:43.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.377+0000 7f5fa0c24740 10 client.17211 fetch_fsmap learned FSMap version 25 2024-09-21T03:51:43.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.377+0000 7f5fa0c24740 1 -- 172.21.15.84:0/463829271 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5591d9162bc0 con 0x5591d8d80390 2024-09-21T03:51:43.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.377+0000 7f5f737fe640 1 -- 172.21.15.84:0/463829271 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f880ec050 con 0x5591d8d80390 2024-09-21T03:51:43.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.377+0000 7f5f737fe640 1 -- 172.21.15.84:0/463829271 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5f880c2b00 con 0x5591d8d80390 2024-09-21T03:51:43.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.377+0000 7f5fa0c24740 10 client.17211 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:51:43.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.377+0000 7f5fa0c24740 10 client.17211 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:51:43.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.377+0000 7f5fa0c24740 20 client.17211 populate_metadata read hostname 'smithi084' 2024-09-21T03:51:43.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.377+0000 7f5fa0c24740 1 --2- 172.21.15.84:0/463829271 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5591d8d5f9f0 0x5591d9165d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:43.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.377+0000 7f5fa0c24740 4 client.17211 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:51:43.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.377+0000 7f5fa0c24740 1 -- 172.21.15.84:0/463829271 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591d90c0df0 con 0x5591d8d5f9f0 2024-09-21T03:51:43.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.377+0000 7f5f93fff640 1 --2- 172.21.15.84:0/463829271 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5591d8d5f9f0 0x5591d9165d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:43.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.378+0000 7f5f737fe640 10 client.17211 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:51:43.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.378+0000 7f5f93fff640 1 --2- 172.21.15.84:0/463829271 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5591d8d5f9f0 0x5591d9165d50 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=41bf738cf979d7cc server_cookie=409274419bd46844 in_seq=0 out_seq=0 2024-09-21T03:51:43.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.378+0000 7f5f737fe640 1 -- 172.21.15.84:0/463829271 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5591d90c0df0 con 0x5591d8d5f9f0 2024-09-21T03:51:43.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.379+0000 7f5f737fe640 10 client.17211 handle_command_reply: tid=0 2024-09-21T03:51:43.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.379+0000 7f5fa0c24740 1 client.17211 shutdown 2024-09-21T03:51:43.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.379+0000 7f5fa0c24740 1 -- 172.21.15.84:0/463829271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 msgr2=0x5591d9154290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:43.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.379+0000 7f5fa0c24740 1 --2- 172.21.15.84:0/463829271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 0x5591d9154290 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f5f88000c00 tx=0x7f5f8800bf90 comp rx=0 tx=0).stop 2024-09-21T03:51:43.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.379+0000 7f5fa0c24740 1 -- 172.21.15.84:0/463829271 shutdown_connections 2024-09-21T03:51:43.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.379+0000 7f5fa0c24740 1 --2- 172.21.15.84:0/463829271 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5591d8d5f9f0 0x5591d9165d50 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.379+0000 7f5fa0c24740 1 --2- 172.21.15.84:0/463829271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8da1070 0x5591d91601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.379+0000 7f5fa0c24740 1 --2- 172.21.15.84:0/463829271 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 0x5591d9154290 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.379+0000 7f5f737fe640 0 client.17211 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:51:43.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.379+0000 7f5fa0c24740 1 --2- 172.21.15.84:0/463829271 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8d781b0 0x5591d9153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.379+0000 7f5fa0c24740 1 -- 172.21.15.84:0/463829271 >> 172.21.15.84:0/463829271 conn(0x5591d8d95460 msgr2=0x5591d914b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:43.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.379+0000 7f5fa0c24740 1 -- 172.21.15.84:0/463829271 shutdown_connections 2024-09-21T03:51:43.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.379+0000 7f5fa0c24740 1 -- 172.21.15.84:0/463829271 wait complete. 2024-09-21T03:51:43.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.379+0000 7f5fa0c24740 20 client.17211 trim_cache size 0 max 16384 2024-09-21T03:51:43.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.392+0000 7f5fa0c24740 1 Processor -- start 2024-09-21T03:51:43.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.392+0000 7f5fa0c24740 1 -- start start 2024-09-21T03:51:43.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.392+0000 7f5fa0c24740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8d781b0 0x5591d9152c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:43.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.392+0000 7f5fa0c24740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 0x5591d9149de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:43.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.392+0000 7f5fa0c24740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8da1070 0x5591d9160110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:43.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.392+0000 7f5fa0c24740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5f941b1fc0 con 0x5591d8d80390 2024-09-21T03:51:43.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.392+0000 7f5fa0c24740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5f941af890 con 0x5591d8d781b0 2024-09-21T03:51:43.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.392+0000 7f5fa0c24740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5f941ad700 con 0x5591d8da1070 2024-09-21T03:51:43.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.392+0000 7f5f937fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 0x5591d9149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:43.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.392+0000 7f5f937fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 0x5591d9149de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40102/0 (socket says 172.21.15.84:40102) 2024-09-21T03:51:43.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.392+0000 7f5f937fe640 1 -- 172.21.15.84:0/892486251 learned_addr learned my addr 172.21.15.84:0/892486251 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:43.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.393+0000 7f5f98c4d640 1 --2- 172.21.15.84:0/892486251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8da1070 0x5591d9160110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:43.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.393+0000 7f5f937fe640 1 -- 172.21.15.84:0/892486251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8da1070 msgr2=0x5591d9160110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:43.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.393+0000 7f5f93fff640 1 --2- 172.21.15.84:0/892486251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8d781b0 0x5591d9152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:43.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.393+0000 7f5f937fe640 1 --2- 172.21.15.84:0/892486251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8da1070 0x5591d9160110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.393+0000 7f5f937fe640 1 -- 172.21.15.84:0/892486251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8d781b0 msgr2=0x5591d9152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:43.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.393+0000 7f5f937fe640 1 --2- 172.21.15.84:0/892486251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8d781b0 0x5591d9152c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.393+0000 7f5f937fe640 1 -- 172.21.15.84:0/892486251 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591d91473c0 con 0x5591d8d80390 2024-09-21T03:51:43.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.393+0000 7f5f98c4d640 1 --2- 172.21.15.84:0/892486251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8da1070 0x5591d9160110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:51:43.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.393+0000 7f5f937fe640 1 --2- 172.21.15.84:0/892486251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 0x5591d9149de0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f5f880e4850 tx=0x7f5f880e4300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4da964c0236fff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:43.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.393+0000 7f5f79ffb640 1 -- 172.21.15.84:0/892486251 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f880c6070 con 0x5591d8d80390 2024-09-21T03:51:43.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.393+0000 7f5f79ffb640 1 -- 172.21.15.84:0/892486251 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f880ec070 con 0x5591d8d80390 2024-09-21T03:51:43.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.393+0000 7f5f79ffb640 1 -- 172.21.15.84:0/892486251 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f880a87f0 con 0x5591d8d80390 2024-09-21T03:51:43.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.394+0000 7f5fa0c24740 1 -- 172.21.15.84:0/892486251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 msgr2=0x5591d9149de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:43.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.394+0000 7f5fa0c24740 1 --2- 172.21.15.84:0/892486251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 0x5591d9149de0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f5f880e4850 tx=0x7f5f880e4300 comp rx=0 tx=0).stop 2024-09-21T03:51:43.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.394+0000 7f5fa0c24740 1 -- 172.21.15.84:0/892486251 shutdown_connections 2024-09-21T03:51:43.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.394+0000 7f5fa0c24740 1 --2- 172.21.15.84:0/892486251 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8da1070 0x5591d9160110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.394+0000 7f5fa0c24740 1 --2- 172.21.15.84:0/892486251 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8d80390 0x5591d9149de0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.394+0000 7f5fa0c24740 1 --2- 172.21.15.84:0/892486251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8d781b0 0x5591d9152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.394+0000 7f5fa0c24740 1 -- 172.21.15.84:0/892486251 >> 172.21.15.84:0/892486251 conn(0x5591d8d95460 msgr2=0x5591d91496d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:43.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.394+0000 7f5fa0c24740 1 -- 172.21.15.84:0/892486251 shutdown_connections 2024-09-21T03:51:43.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.394+0000 7f5fa0c24740 1 -- 172.21.15.84:0/892486251 wait complete. 2024-09-21T03:51:43.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.394+0000 7f5fa0c24740 1 -- start start 2024-09-21T03:51:43.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.395+0000 7f5fa0c24740 1 Processor -- start 2024-09-21T03:51:43.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.395+0000 7f5fa0c24740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8d781b0 0x5591d91696c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:43.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.395+0000 7f5fa0c24740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8d80390 0x5591d9166b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:43.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.395+0000 7f5fa0c24740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8da1070 0x5591d9167230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:43.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.395+0000 7f5fa0c24740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5f941add50 con 0x5591d8da1070 2024-09-21T03:51:43.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.395+0000 7f5fa0c24740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5f941af1c0 con 0x5591d8d781b0 2024-09-21T03:51:43.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.395+0000 7f5fa0c24740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5f941ae420 con 0x5591d8d80390 2024-09-21T03:51:43.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.395+0000 7f5fa0c24740 10 client.0 _ll_register_callbacks cb 0x7f5f8c009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:51:43.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.395+0000 7f5f937fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8d80390 0x5591d9166b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:43.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.395+0000 7f5f98c4d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8da1070 0x5591d9167230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:43.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.395+0000 7f5f937fe640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8d80390 0x5591d9166b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.84:44118/0 (socket says 172.21.15.84:44118) 2024-09-21T03:51:43.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.395+0000 7f5f937fe640 1 -- 172.21.15.84:0/1948653428 learned_addr learned my addr 172.21.15.84:0/1948653428 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:43.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.395+0000 7f5f93fff640 1 --2- 172.21.15.84:0/1948653428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8d781b0 0x5591d91696c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:43.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.395+0000 7f5f937fe640 1 -- 172.21.15.84:0/1948653428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8d781b0 msgr2=0x5591d91696c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:43.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.395+0000 7f5f937fe640 1 --2- 172.21.15.84:0/1948653428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8d781b0 0x5591d91696c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.395+0000 7f5f937fe640 1 -- 172.21.15.84:0/1948653428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8da1070 msgr2=0x5591d9167230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:43.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.395+0000 7f5f937fe640 1 --2- 172.21.15.84:0/1948653428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8da1070 0x5591d9167230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.395+0000 7f5f937fe640 1 -- 172.21.15.84:0/1948653428 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591d91679c0 con 0x5591d8d80390 2024-09-21T03:51:43.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.395+0000 7f5f93fff640 1 --2- 172.21.15.84:0/1948653428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8d781b0 0x5591d91696c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:51:43.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.395+0000 7f5f98c4d640 1 --2- 172.21.15.84:0/1948653428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8da1070 0x5591d9167230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:51:43.403 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.396+0000 7f5f937fe640 1 --2- 172.21.15.84:0/1948653428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8d80390 0x5591d9166b90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5f880c2fd0 tx=0x7f5f880e4750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75033c6cfadcfec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:43.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.396+0000 7f5f737fe640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-09-21T03:51:43.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.396+0000 7f5f737fe640 1 -- 172.21.15.84:0/1948653428 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f880c6070 con 0x5591d8d80390 2024-09-21T03:51:43.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.396+0000 7f5f737fe640 1 -- 172.21.15.84:0/1948653428 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f5f880ea450 con 0x5591d8d80390 2024-09-21T03:51:43.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.396+0000 7f5fa0c24740 1 -- 172.21.15.84:0/1948653428 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f880ec070 con 0x5591d8d80390 2024-09-21T03:51:43.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.396+0000 7f5f737fe640 1 -- 172.21.15.84:0/1948653428 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5f880ac2a0 con 0x5591d8d80390 2024-09-21T03:51:43.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.396+0000 7f5fa0c24740 10 client.26206 fetch_fsmap learned FSMap version 25 2024-09-21T03:51:43.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.396+0000 7f5fa0c24740 1 -- 172.21.15.84:0/1948653428 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5591d91d04f0 con 0x5591d8d80390 2024-09-21T03:51:43.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.396+0000 7f5f737fe640 1 -- 172.21.15.84:0/1948653428 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f880ec070 con 0x5591d8d80390 2024-09-21T03:51:43.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.396+0000 7f5f737fe640 1 -- 172.21.15.84:0/1948653428 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5f880a82a0 con 0x5591d8d80390 2024-09-21T03:51:43.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.397+0000 7f5fa0c24740 10 client.26206 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:51:43.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.397+0000 7f5fa0c24740 10 client.26206 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:51:43.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.397+0000 7f5fa0c24740 20 client.26206 populate_metadata read hostname 'smithi084' 2024-09-21T03:51:43.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.397+0000 7f5fa0c24740 1 --2- 172.21.15.84:0/1948653428 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5591d8d34da0 0x5591d91d28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:43.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.397+0000 7f5fa0c24740 4 client.26206 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:51:43.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.397+0000 7f5fa0c24740 1 -- 172.21.15.84:0/1948653428 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5591d90bc8a0 con 0x5591d8d34da0 2024-09-21T03:51:43.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.397+0000 7f5f93fff640 1 --2- 172.21.15.84:0/1948653428 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5591d8d34da0 0x5591d91d28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:43.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.397+0000 7f5f737fe640 10 client.26206 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:51:43.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.397+0000 7f5f93fff640 1 --2- 172.21.15.84:0/1948653428 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5591d8d34da0 0x5591d91d28e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=49d3f7604edcf413 server_cookie=ff4ce6f7266f420e in_seq=0 out_seq=0 2024-09-21T03:51:43.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.398+0000 7f5f737fe640 1 -- 172.21.15.84:0/1948653428 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5591d90bc8a0 con 0x5591d8d34da0 2024-09-21T03:51:43.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.398+0000 7f5f737fe640 10 client.26206 handle_command_reply: tid=0 2024-09-21T03:51:43.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.398+0000 7f5fa0c24740 1 client.26206 shutdown 2024-09-21T03:51:43.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.398+0000 7f5fa0c24740 1 -- 172.21.15.84:0/1948653428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8d80390 msgr2=0x5591d9166b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:43.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.398+0000 7f5fa0c24740 1 --2- 172.21.15.84:0/1948653428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8d80390 0x5591d9166b90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5f880c2fd0 tx=0x7f5f880e4750 comp rx=0 tx=0).stop 2024-09-21T03:51:43.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.398+0000 7f5fa0c24740 1 -- 172.21.15.84:0/1948653428 shutdown_connections 2024-09-21T03:51:43.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.398+0000 7f5fa0c24740 1 --2- 172.21.15.84:0/1948653428 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x5591d8d34da0 0x5591d91d28e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.398+0000 7f5fa0c24740 1 --2- 172.21.15.84:0/1948653428 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5591d8da1070 0x5591d9167230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.398+0000 7f5fa0c24740 1 --2- 172.21.15.84:0/1948653428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5591d8d80390 0x5591d9166b90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.398+0000 7f5fa0c24740 1 --2- 172.21.15.84:0/1948653428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5591d8d781b0 0x5591d91696c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.398+0000 7f5fa0c24740 1 -- 172.21.15.84:0/1948653428 >> 172.21.15.84:0/1948653428 conn(0x5591d8d95460 msgr2=0x5591d9149f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:43.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.398+0000 7f5f737fe640 0 client.26206 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:51:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.398+0000 7f5fa0c24740 1 -- 172.21.15.84:0/1948653428 shutdown_connections 2024-09-21T03:51:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.398+0000 7f5fa0c24740 1 -- 172.21.15.84:0/1948653428 wait complete. 2024-09-21T03:51:43.407 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.398+0000 7f5fa0c24740 20 client.26206 trim_cache size 0 max 16384 2024-09-21T03:51:43.407 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:51:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.399+0000 7f5f9a6b0640 1 -- 172.21.15.84:0/1453129665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f7c0b6700 msgr2=0x7f5f7c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.399+0000 7f5f9a6b0640 1 --2- 172.21.15.84:0/1453129665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f7c0b6700 0x7f5f7c0b8c10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c005fd0 tx=0x7f5f8c009600 comp rx=0 tx=0).stop 2024-09-21T03:51:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.399+0000 7f5f9a6b0640 1 -- 172.21.15.84:0/1453129665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f941094c0 msgr2=0x7f5f9419aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.399+0000 7f5f9a6b0640 1 --2- 172.21.15.84:0/1453129665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f941094c0 0x7f5f9419aa80 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f5f88006fd0 tx=0x7f5f8800b8e0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.399+0000 7f5f9a6b0640 1 -- 172.21.15.84:0/1453129665 shutdown_connections 2024-09-21T03:51:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.399+0000 7f5f9a6b0640 1 --2- 172.21.15.84:0/1453129665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5f7c0b6700 0x7f5f7c0b8c10 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.399+0000 7f5f9a6b0640 1 --2- 172.21.15.84:0/1453129665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f94109e10 0x7f5f9419fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.399+0000 7f5f9a6b0640 1 --2- 172.21.15.84:0/1453129665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5f941094c0 0x7f5f9419aa80 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.399+0000 7f5f9a6b0640 1 --2- 172.21.15.84:0/1453129665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f94103b80 0x7f5f9419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.399+0000 7f5f9a6b0640 1 -- 172.21.15.84:0/1453129665 >> 172.21.15.84:0/1453129665 conn(0x7f5f940ff5d0 msgr2=0x7f5f941019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.399+0000 7f5f9a6b0640 1 -- 172.21.15.84:0/1453129665 shutdown_connections 2024-09-21T03:51:43.408 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:43.399+0000 7f5f9a6b0640 1 -- 172.21.15.84:0/1453129665 wait complete. 2024-09-21T03:51:43.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:43 smithi084 ceph-mon[30941]: pgmap v607: 97 pgs: 97 active+clean; 17 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-21T03:51:43.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:43 smithi174 ceph-mon[34403]: pgmap v607: 97 pgs: 97 active+clean; 17 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-21T03:51:43.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:43 smithi172 ceph-mon[34821]: pgmap v607: 97 pgs: 97 active+clean; 17 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-09-21T03:51:44.109 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:51:44.354 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:51:44.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.849+0000 7f9d18530640 1 -- 172.21.15.84:0/3332784966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d10103ba0 msgr2=0x7f9d10103fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:44.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.849+0000 7f9d18530640 1 --2- 172.21.15.84:0/3332784966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d10103ba0 0x7f9d10103fb0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009ca0 tx=0x7f9d0002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.849+0000 7f9d18530640 1 -- 172.21.15.84:0/3332784966 shutdown_connections 2024-09-21T03:51:44.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.849+0000 7f9d18530640 1 --2- 172.21.15.84:0/3332784966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d10109e30 0x7f9d10110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.849+0000 7f9d18530640 1 --2- 172.21.15.84:0/3332784966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d101094e0 0x7f9d101098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.849+0000 7f9d18530640 1 --2- 172.21.15.84:0/3332784966 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d10103ba0 0x7f9d10103fb0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.849+0000 7f9d18530640 1 -- 172.21.15.84:0/3332784966 >> 172.21.15.84:0/3332784966 conn(0x7f9d100ff630 msgr2=0x7f9d10101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:44.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.849+0000 7f9d18530640 1 -- 172.21.15.84:0/3332784966 shutdown_connections 2024-09-21T03:51:44.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.849+0000 7f9d18530640 1 -- 172.21.15.84:0/3332784966 wait complete. 2024-09-21T03:51:44.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.850+0000 7f9d18530640 1 Processor -- start 2024-09-21T03:51:44.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.850+0000 7f9d18530640 1 -- start start 2024-09-21T03:51:44.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.850+0000 7f9d18530640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d10103ba0 0x7f9d1019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:44.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.850+0000 7f9d18530640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d101094e0 0x7f9d1019aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:44.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.850+0000 7f9d18530640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d10109e30 0x7f9d1019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:44.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.850+0000 7f9d18530640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9d10113af0 con 0x7f9d101094e0 2024-09-21T03:51:44.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.850+0000 7f9d18530640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9d10113970 con 0x7f9d10109e30 2024-09-21T03:51:44.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.850+0000 7f9d18530640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9d10113c70 con 0x7f9d10103ba0 2024-09-21T03:51:44.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.850+0000 7f9d15acb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d101094e0 0x7f9d1019aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:44.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.850+0000 7f9d15acb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d101094e0 0x7f9d1019aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40126/0 (socket says 172.21.15.84:40126) 2024-09-21T03:51:44.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.850+0000 7f9d15acb640 1 -- 172.21.15.84:0/2648108836 learned_addr learned my addr 172.21.15.84:0/2648108836 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:44.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.851+0000 7f9d162cc640 1 --2- 172.21.15.84:0/2648108836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d10103ba0 0x7f9d1019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:44.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.851+0000 7f9d16acd640 1 --2- 172.21.15.84:0/2648108836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d10109e30 0x7f9d1019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:44.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.851+0000 7f9d15acb640 1 -- 172.21.15.84:0/2648108836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d10103ba0 msgr2=0x7f9d1019a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:44.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.851+0000 7f9d15acb640 1 --2- 172.21.15.84:0/2648108836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d10103ba0 0x7f9d1019a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.863 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.851+0000 7f9d15acb640 1 -- 172.21.15.84:0/2648108836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d10109e30 msgr2=0x7f9d1019fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:44.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.851+0000 7f9d15acb640 1 --2- 172.21.15.84:0/2648108836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d10109e30 0x7f9d1019fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.851+0000 7f9d15acb640 1 -- 172.21.15.84:0/2648108836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d101a04b0 con 0x7f9d101094e0 2024-09-21T03:51:44.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.851+0000 7f9d15acb640 1 --2- 172.21.15.84:0/2648108836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d101094e0 0x7f9d1019aae0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400d740 tx=0x7f9d0400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:44.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.851+0000 7f9d0f7fe640 1 -- 172.21.15.84:0/2648108836 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04017070 con 0x7f9d101094e0 2024-09-21T03:51:44.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.851+0000 7f9d0f7fe640 1 -- 172.21.15.84:0/2648108836 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d0400de50 con 0x7f9d101094e0 2024-09-21T03:51:44.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.851+0000 7f9d18530640 1 -- 172.21.15.84:0/2648108836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d101a07a0 con 0x7f9d101094e0 2024-09-21T03:51:44.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.851+0000 7f9d0f7fe640 1 -- 172.21.15.84:0/2648108836 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0400f620 con 0x7f9d101094e0 2024-09-21T03:51:44.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.851+0000 7f9d18530640 1 -- 172.21.15.84:0/2648108836 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d101a6f00 con 0x7f9d101094e0 2024-09-21T03:51:44.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.854+0000 7f9d1eaa4740 1 Processor -- start 2024-09-21T03:51:44.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.854+0000 7f9d0f7fe640 1 -- 172.21.15.84:0/2648108836 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f9d0401a070 con 0x7f9d101094e0 2024-09-21T03:51:44.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.854+0000 7f9d1eaa4740 1 -- start start 2024-09-21T03:51:44.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.854+0000 7f9d1eaa4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e3a085070 0x558e3a42c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:44.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.854+0000 7f9d1eaa4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a42cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:44.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.854+0000 7f9d1eaa4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3a064390 0x558e3a42d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:44.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.854+0000 7f9d1eaa4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558e3a3a2ea0 con 0x558e3a05c1b0 2024-09-21T03:51:44.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.854+0000 7f9d1eaa4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558e3a3922d0 con 0x558e3a064390 2024-09-21T03:51:44.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.854+0000 7f9d1eaa4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558e3a3960e0 con 0x558e3a085070 2024-09-21T03:51:44.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.854+0000 7f9d162cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a42cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:44.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.854+0000 7f9d162cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a42cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40142/0 (socket says 172.21.15.84:40142) 2024-09-21T03:51:44.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.854+0000 7f9d162cc640 1 -- 172.21.15.84:0/1517464564 learned_addr learned my addr 172.21.15.84:0/1517464564 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:44.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.854+0000 7f9d15acb640 1 --2- 172.21.15.84:0/1517464564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3a064390 0x558e3a42d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:44.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.854+0000 7f9d16acd640 1 --2- 172.21.15.84:0/1517464564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e3a085070 0x558e3a42c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:44.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.855+0000 7f9d162cc640 1 -- 172.21.15.84:0/1517464564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e3a085070 msgr2=0x558e3a42c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:44.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.855+0000 7f9d162cc640 1 --2- 172.21.15.84:0/1517464564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e3a085070 0x558e3a42c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.855+0000 7f9d162cc640 1 -- 172.21.15.84:0/1517464564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3a064390 msgr2=0x558e3a42d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:44.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.855+0000 7f9d162cc640 1 --2- 172.21.15.84:0/1517464564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3a064390 0x558e3a42d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.855+0000 7f9d162cc640 1 -- 172.21.15.84:0/1517464564 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3a0f0650 con 0x558e3a05c1b0 2024-09-21T03:51:44.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.855+0000 7f9d0f7fe640 1 --2- 172.21.15.84:0/2648108836 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9cf80b6680 0x7f9cf80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:44.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.855+0000 7f9d162cc640 1 --2- 172.21.15.84:0/1517464564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a42cbe0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f9d00035000 tx=0x7f9d0002f4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5ac6cbc5fb5de6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:44.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.855+0000 7f9d16acd640 1 --2- 172.21.15.84:0/2648108836 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9cf80b6680 0x7f9cf80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:44.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.855+0000 7f9d0f7fe640 1 -- 172.21.15.84:0/2648108836 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f9d040e71a0 con 0x7f9d101094e0 2024-09-21T03:51:44.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.855+0000 7f9d0cff9640 1 -- 172.21.15.84:0/1517464564 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d00031cf0 con 0x558e3a05c1b0 2024-09-21T03:51:44.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.855+0000 7f9d0cff9640 1 -- 172.21.15.84:0/1517464564 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d00036040 con 0x558e3a05c1b0 2024-09-21T03:51:44.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.855+0000 7f9d0cff9640 1 -- 172.21.15.84:0/1517464564 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d00003e60 con 0x558e3a05c1b0 2024-09-21T03:51:44.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.856+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/1517464564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 msgr2=0x558e3a42cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:44.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.856+0000 7f9d1eaa4740 1 --2- 172.21.15.84:0/1517464564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a42cbe0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f9d00035000 tx=0x7f9d0002f4c0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.856+0000 7f9d16acd640 1 --2- 172.21.15.84:0/2648108836 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9cf80b6680 0x7f9cf80b8b90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9d0800ead0 tx=0x7f9d08005e50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:44.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.856+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/1517464564 shutdown_connections 2024-09-21T03:51:44.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.856+0000 7f9d1eaa4740 1 --2- 172.21.15.84:0/1517464564 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3a064390 0x558e3a42d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.856+0000 7f9d1eaa4740 1 --2- 172.21.15.84:0/1517464564 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a42cbe0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.856+0000 7f9d1eaa4740 1 --2- 172.21.15.84:0/1517464564 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e3a085070 0x558e3a42c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.856+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/1517464564 >> 172.21.15.84:0/1517464564 conn(0x558e3a079460 msgr2=0x558e3a42a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:44.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.856+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/1517464564 shutdown_connections 2024-09-21T03:51:44.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.856+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/1517464564 wait complete. 2024-09-21T03:51:44.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.856+0000 7f9d1eaa4740 1 -- start start 2024-09-21T03:51:44.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9d1eaa4740 1 Processor -- start 2024-09-21T03:51:44.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9d1eaa4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a437d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:44.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9d1eaa4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3a064390 0x558e3a4382a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:44.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9d1eaa4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e3a085070 0x558e3a444140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:44.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9d1eaa4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558e3a1f3700 con 0x558e3a05c1b0 2024-09-21T03:51:44.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9d1eaa4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558e3a32d160 con 0x558e3a064390 2024-09-21T03:51:44.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9d1eaa4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558e3a43ae20 con 0x558e3a085070 2024-09-21T03:51:44.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9d1eaa4740 10 client.0 _ll_register_callbacks cb 0x558e3a3469e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:51:44.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9d162cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a437d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:44.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9d162cc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a437d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40144/0 (socket says 172.21.15.84:40144) 2024-09-21T03:51:44.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9d162cc640 1 -- 172.21.15.84:0/3197833104 learned_addr learned my addr 172.21.15.84:0/3197833104 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:44.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9d16acd640 1 --2- 172.21.15.84:0/3197833104 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e3a085070 0x558e3a444140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:44.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9d162cc640 1 -- 172.21.15.84:0/3197833104 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e3a085070 msgr2=0x558e3a444140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:44.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9d15acb640 1 --2- 172.21.15.84:0/3197833104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3a064390 0x558e3a4382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:44.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9d162cc640 1 --2- 172.21.15.84:0/3197833104 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e3a085070 0x558e3a444140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9d162cc640 1 -- 172.21.15.84:0/3197833104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3a064390 msgr2=0x558e3a4382a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:44.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9d162cc640 1 --2- 172.21.15.84:0/3197833104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3a064390 0x558e3a4382a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9d162cc640 1 -- 172.21.15.84:0/3197833104 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e3a35ac90 con 0x558e3a05c1b0 2024-09-21T03:51:44.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9d16acd640 1 --2- 172.21.15.84:0/3197833104 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e3a085070 0x558e3a444140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:51:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9d162cc640 1 --2- 172.21.15.84:0/3197833104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a437d60 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f9d00003c40 tx=0x7f9d0002afc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27786c9a088c696 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.857+0000 7f9cf5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:51:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.858+0000 7f9cf5ffb640 1 -- 172.21.15.84:0/3197833104 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d00052020 con 0x558e3a05c1b0 2024-09-21T03:51:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.858+0000 7f9cf5ffb640 1 -- 172.21.15.84:0/3197833104 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f9d00031cf0 con 0x558e3a05c1b0 2024-09-21T03:51:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.858+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/3197833104 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d00036040 con 0x558e3a05c1b0 2024-09-21T03:51:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.858+0000 7f9cf5ffb640 1 -- 172.21.15.84:0/3197833104 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9d0005d050 con 0x558e3a05c1b0 2024-09-21T03:51:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.858+0000 7f9d1eaa4740 10 client.17229 fetch_fsmap learned FSMap version 25 2024-09-21T03:51:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.858+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/3197833104 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558e3a446b00 con 0x558e3a05c1b0 2024-09-21T03:51:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.858+0000 7f9cf5ffb640 1 -- 172.21.15.84:0/3197833104 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d00036040 con 0x558e3a05c1b0 2024-09-21T03:51:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.858+0000 7f9cf5ffb640 1 -- 172.21.15.84:0/3197833104 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9d0004d030 con 0x558e3a05c1b0 2024-09-21T03:51:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.858+0000 7f9d1eaa4740 10 client.17229 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:51:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.858+0000 7f9d1eaa4740 10 client.17229 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:51:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.858+0000 7f9d1eaa4740 20 client.17229 populate_metadata read hostname 'smithi084' 2024-09-21T03:51:44.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.858+0000 7f9d1eaa4740 1 --2- 172.21.15.84:0/3197833104 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558e3a0439f0 0x558e3a449e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.858+0000 7f9d1eaa4740 4 client.17229 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:51:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.858+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/3197833104 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e3a3a4df0 con 0x558e3a0439f0 2024-09-21T03:51:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.859+0000 7f9d15acb640 1 --2- 172.21.15.84:0/3197833104 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558e3a0439f0 0x558e3a449e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.859+0000 7f9cf5ffb640 10 client.17229 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:44.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.859+0000 7f9d15acb640 1 --2- 172.21.15.84:0/3197833104 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558e3a0439f0 0x558e3a449e60 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=309c1592ec292aa7 server_cookie=3aeab9caa4ed556a in_seq=0 out_seq=0 2024-09-21T03:51:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.860+0000 7f9cf5ffb640 1 -- 172.21.15.84:0/3197833104 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558e3a3a4df0 con 0x558e3a0439f0 2024-09-21T03:51:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.860+0000 7f9cf5ffb640 10 client.17229 handle_command_reply: tid=0 2024-09-21T03:51:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.860+0000 7f9d1eaa4740 1 client.17229 shutdown 2024-09-21T03:51:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.860+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/3197833104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 msgr2=0x558e3a437d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.860+0000 7f9d1eaa4740 1 --2- 172.21.15.84:0/3197833104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a437d60 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f9d00003c40 tx=0x7f9d0002afc0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.860+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/3197833104 shutdown_connections 2024-09-21T03:51:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.860+0000 7f9d1eaa4740 1 --2- 172.21.15.84:0/3197833104 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558e3a0439f0 0x558e3a449e60 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.860+0000 7f9d1eaa4740 1 --2- 172.21.15.84:0/3197833104 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e3a085070 0x558e3a444140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.860+0000 7f9d1eaa4740 1 --2- 172.21.15.84:0/3197833104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3a064390 0x558e3a4382a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.860+0000 7f9cf5ffb640 0 client.17229 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.860+0000 7f9d1eaa4740 1 --2- 172.21.15.84:0/3197833104 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a437d60 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.860+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/3197833104 >> 172.21.15.84:0/3197833104 conn(0x558e3a079460 msgr2=0x558e3a42f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.860+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/3197833104 shutdown_connections 2024-09-21T03:51:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.860+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/3197833104 wait complete. 2024-09-21T03:51:44.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.860+0000 7f9d1eaa4740 20 client.17229 trim_cache size 0 max 16384 2024-09-21T03:51:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.873+0000 7f9d1eaa4740 1 Processor -- start 2024-09-21T03:51:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.873+0000 7f9d1eaa4740 1 -- start start 2024-09-21T03:51:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.873+0000 7f9d1eaa4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3a0439f0 0x558e3a438220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:44.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.874+0000 7f9d1eaa4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a429bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.874+0000 7f9d1eaa4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e3a064390 0x558e3a42a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.874+0000 7f9d1eaa4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9d101b1f60 con 0x558e3a05c1b0 2024-09-21T03:51:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.874+0000 7f9d1eaa4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9d101af830 con 0x558e3a0439f0 2024-09-21T03:51:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.874+0000 7f9d1eaa4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9d101ad6a0 con 0x558e3a064390 2024-09-21T03:51:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.874+0000 7f9d15acb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a429bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.874+0000 7f9d15acb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a429bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40160/0 (socket says 172.21.15.84:40160) 2024-09-21T03:51:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.874+0000 7f9d15acb640 1 -- 172.21.15.84:0/1732158888 learned_addr learned my addr 172.21.15.84:0/1732158888 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.874+0000 7f9d15acb640 1 -- 172.21.15.84:0/1732158888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e3a064390 msgr2=0x558e3a42a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.874+0000 7f9d15acb640 1 --2- 172.21.15.84:0/1732158888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e3a064390 0x558e3a42a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.874+0000 7f9d15acb640 1 -- 172.21.15.84:0/1732158888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3a0439f0 msgr2=0x558e3a438220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.874+0000 7f9d15acb640 1 --2- 172.21.15.84:0/1732158888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3a0439f0 0x558e3a438220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.874+0000 7f9d15acb640 1 -- 172.21.15.84:0/1732158888 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3a43a4a0 con 0x558e3a05c1b0 2024-09-21T03:51:44.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.874+0000 7f9d15acb640 1 --2- 172.21.15.84:0/1732158888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a429bc0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f9d040acd40 tx=0x7f9d040e96b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606da2bc79f8e97f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:44.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.874+0000 7f9cf7fff640 1 -- 172.21.15.84:0/1732158888 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04021040 con 0x558e3a05c1b0 2024-09-21T03:51:44.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.874+0000 7f9cf7fff640 1 -- 172.21.15.84:0/1732158888 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d040acb50 con 0x558e3a05c1b0 2024-09-21T03:51:44.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.874+0000 7f9cf7fff640 1 -- 172.21.15.84:0/1732158888 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d040a92b0 con 0x558e3a05c1b0 2024-09-21T03:51:44.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.875+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/1732158888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 msgr2=0x558e3a429bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:44.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.875+0000 7f9d1eaa4740 1 --2- 172.21.15.84:0/1732158888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a429bc0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f9d040acd40 tx=0x7f9d040e96b0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.875+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/1732158888 shutdown_connections 2024-09-21T03:51:44.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.875+0000 7f9d1eaa4740 1 --2- 172.21.15.84:0/1732158888 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e3a064390 0x558e3a42a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.875+0000 7f9d1eaa4740 1 --2- 172.21.15.84:0/1732158888 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a429bc0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.875+0000 7f9d1eaa4740 1 --2- 172.21.15.84:0/1732158888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3a0439f0 0x558e3a438220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.875+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/1732158888 >> 172.21.15.84:0/1732158888 conn(0x558e3a079460 msgr2=0x558e3a437b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:44.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.875+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/1732158888 shutdown_connections 2024-09-21T03:51:44.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.875+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/1732158888 wait complete. 2024-09-21T03:51:44.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.876+0000 7f9d1eaa4740 1 -- start start 2024-09-21T03:51:44.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.876+0000 7f9d1eaa4740 1 Processor -- start 2024-09-21T03:51:44.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.876+0000 7f9d1eaa4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e3a0439f0 0x558e3a44d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:44.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.876+0000 7f9d1eaa4740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a44ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:44.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.876+0000 7f9d1eaa4740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3a064390 0x558e3a44b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:44.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.876+0000 7f9d1eaa4740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9d101adcf0 con 0x558e3a05c1b0 2024-09-21T03:51:44.882 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.876+0000 7f9d1eaa4740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9d101af160 con 0x558e3a064390 2024-09-21T03:51:44.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.876+0000 7f9d1eaa4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9d101ae3c0 con 0x558e3a0439f0 2024-09-21T03:51:44.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.876+0000 7f9d1eaa4740 10 client.0 _ll_register_callbacks cb 0x7f9d0002f410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:51:44.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.876+0000 7f9d15acb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a44ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:44.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.876+0000 7f9d15acb640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a44ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40164/0 (socket says 172.21.15.84:40164) 2024-09-21T03:51:44.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.876+0000 7f9d15acb640 1 -- 172.21.15.84:0/3945703325 learned_addr learned my addr 172.21.15.84:0/3945703325 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:44.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.876+0000 7f9d16acd640 1 --2- 172.21.15.84:0/3945703325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3a064390 0x558e3a44b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:44.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.877+0000 7f9d15acb640 1 -- 172.21.15.84:0/3945703325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e3a0439f0 msgr2=0x558e3a44d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:44.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.877+0000 7f9d15acb640 1 --2- 172.21.15.84:0/3945703325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e3a0439f0 0x558e3a44d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.877+0000 7f9d15acb640 1 -- 172.21.15.84:0/3945703325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3a064390 msgr2=0x558e3a44b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:44.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.877+0000 7f9d15acb640 1 --2- 172.21.15.84:0/3945703325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3a064390 0x558e3a44b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.877+0000 7f9d15acb640 1 -- 172.21.15.84:0/3945703325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e3a4b35e0 con 0x558e3a05c1b0 2024-09-21T03:51:44.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.877+0000 7f9d16acd640 1 --2- 172.21.15.84:0/3945703325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3a064390 0x558e3a44b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:51:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.877+0000 7f9d15acb640 1 --2- 172.21.15.84:0/3945703325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a44ade0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9d040e4f40 tx=0x7f9d04010c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd1836174cb90fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.877+0000 7f9cf5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:51:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.877+0000 7f9cf5ffb640 1 -- 172.21.15.84:0/3945703325 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04021040 con 0x558e3a05c1b0 2024-09-21T03:51:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.877+0000 7f9cf5ffb640 1 -- 172.21.15.84:0/3945703325 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f9d040a8990 con 0x558e3a05c1b0 2024-09-21T03:51:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.877+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/3945703325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d040acb50 con 0x558e3a05c1b0 2024-09-21T03:51:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.877+0000 7f9cf5ffb640 1 -- 172.21.15.84:0/3945703325 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9d040b1b20 con 0x558e3a05c1b0 2024-09-21T03:51:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.877+0000 7f9d1eaa4740 10 client.17235 fetch_fsmap learned FSMap version 25 2024-09-21T03:51:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.877+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/3945703325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558e3a4b4730 con 0x558e3a05c1b0 2024-09-21T03:51:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.877+0000 7f9cf5ffb640 1 -- 172.21.15.84:0/3945703325 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d040acb50 con 0x558e3a05c1b0 2024-09-21T03:51:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.878+0000 7f9cf5ffb640 1 -- 172.21.15.84:0/3945703325 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9d040b2cb0 con 0x558e3a05c1b0 2024-09-21T03:51:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.878+0000 7f9d1eaa4740 10 client.17235 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:51:44.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.878+0000 7f9d1eaa4740 10 client.17235 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:51:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.878+0000 7f9d1eaa4740 20 client.17235 populate_metadata read hostname 'smithi084' 2024-09-21T03:51:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.878+0000 7f9d1eaa4740 1 --2- 172.21.15.84:0/3945703325 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558e3a085070 0x558e3a4b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.878+0000 7f9d1eaa4740 4 client.17235 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:51:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.878+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/3945703325 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558e3a3a08a0 con 0x558e3a085070 2024-09-21T03:51:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.878+0000 7f9d162cc640 1 --2- 172.21.15.84:0/3945703325 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558e3a085070 0x558e3a4b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.879+0000 7f9cf5ffb640 10 client.17235 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.879+0000 7f9d162cc640 1 --2- 172.21.15.84:0/3945703325 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558e3a085070 0x558e3a4b6e00 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad8c9d8e1f47f441 server_cookie=9572c29a6cc3b500 in_seq=0 out_seq=0 2024-09-21T03:51:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.879+0000 7f9cf5ffb640 1 -- 172.21.15.84:0/3945703325 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558e3a3a08a0 con 0x558e3a085070 2024-09-21T03:51:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.879+0000 7f9cf5ffb640 10 client.17235 handle_command_reply: tid=0 2024-09-21T03:51:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.879+0000 7f9d1eaa4740 1 client.17235 shutdown 2024-09-21T03:51:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.879+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/3945703325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 msgr2=0x558e3a44ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.879+0000 7f9d1eaa4740 1 --2- 172.21.15.84:0/3945703325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a44ade0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9d040e4f40 tx=0x7f9d04010c70 comp rx=0 tx=0).stop 2024-09-21T03:51:44.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.879+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/3945703325 shutdown_connections 2024-09-21T03:51:44.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.879+0000 7f9d1eaa4740 1 --2- 172.21.15.84:0/3945703325 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x558e3a085070 0x558e3a4b6e00 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.879+0000 7f9d1eaa4740 1 --2- 172.21.15.84:0/3945703325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3a064390 0x558e3a44b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.879+0000 7f9d1eaa4740 1 --2- 172.21.15.84:0/3945703325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558e3a05c1b0 0x558e3a44ade0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.879+0000 7f9d1eaa4740 1 --2- 172.21.15.84:0/3945703325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558e3a0439f0 0x558e3a44d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.879+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/3945703325 >> 172.21.15.84:0/3945703325 conn(0x558e3a079460 msgr2=0x558e3a42d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:44.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.879+0000 7f9cf5ffb640 0 client.17235 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:44.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.879+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/3945703325 shutdown_connections 2024-09-21T03:51:44.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.879+0000 7f9d1eaa4740 1 -- 172.21.15.84:0/3945703325 wait complete. 2024-09-21T03:51:44.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.879+0000 7f9d1eaa4740 20 client.17235 trim_cache size 0 max 16384 2024-09-21T03:51:44.886 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:51:44.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.880+0000 7f9d18530640 1 -- 172.21.15.84:0/2648108836 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9cf80b6680 msgr2=0x7f9cf80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:44.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.880+0000 7f9d18530640 1 --2- 172.21.15.84:0/2648108836 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9cf80b6680 0x7f9cf80b8b90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9d0800ead0 tx=0x7f9d08005e50 comp rx=0 tx=0).stop 2024-09-21T03:51:44.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.880+0000 7f9d18530640 1 -- 172.21.15.84:0/2648108836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d101094e0 msgr2=0x7f9d1019aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:44.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.880+0000 7f9d18530640 1 --2- 172.21.15.84:0/2648108836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d101094e0 0x7f9d1019aae0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400d740 tx=0x7f9d0400dc00 comp rx=0 tx=0).stop 2024-09-21T03:51:44.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.880+0000 7f9d18530640 1 -- 172.21.15.84:0/2648108836 shutdown_connections 2024-09-21T03:51:44.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.880+0000 7f9d18530640 1 --2- 172.21.15.84:0/2648108836 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9cf80b6680 0x7f9cf80b8b90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.880+0000 7f9d18530640 1 --2- 172.21.15.84:0/2648108836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d10109e30 0x7f9d1019fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.880+0000 7f9d18530640 1 --2- 172.21.15.84:0/2648108836 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9d101094e0 0x7f9d1019aae0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.880+0000 7f9d18530640 1 --2- 172.21.15.84:0/2648108836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9d10103ba0 0x7f9d1019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:44.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.880+0000 7f9d18530640 1 -- 172.21.15.84:0/2648108836 >> 172.21.15.84:0/2648108836 conn(0x7f9d100ff630 msgr2=0x7f9d10101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:44.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.880+0000 7f9d18530640 1 -- 172.21.15.84:0/2648108836 shutdown_connections 2024-09-21T03:51:44.888 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:44.880+0000 7f9d18530640 1 -- 172.21.15.84:0/2648108836 wait complete. 2024-09-21T03:51:45.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:45 smithi084 ceph-mon[30941]: pgmap v608: 97 pgs: 97 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 62 KiB/s wr, 13 op/s 2024-09-21T03:51:45.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:45 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:51:45.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:45 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:45.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:45 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:45.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:45 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:51:45.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:45 smithi174 ceph-mon[34403]: pgmap v608: 97 pgs: 97 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 62 KiB/s wr, 13 op/s 2024-09-21T03:51:45.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:45 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:51:45.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:45 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:45.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:45 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:45.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:45 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:51:45.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:45 smithi172 ceph-mon[34821]: pgmap v608: 97 pgs: 97 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 62 KiB/s wr, 13 op/s 2024-09-21T03:51:45.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:45 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:51:45.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:45 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:45.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:45 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:51:45.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:45 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:51:46.600 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:51:46.601 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:51:46.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:46 smithi084 ceph-mon[30941]: pgmap v609: 97 pgs: 97 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 10 op/s 2024-09-21T03:51:46.851 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:51:46.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:46 smithi174 ceph-mon[34403]: pgmap v609: 97 pgs: 97 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 10 op/s 2024-09-21T03:51:46.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:46 smithi172 ceph-mon[34821]: pgmap v609: 97 pgs: 97 active+clean; 18 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 10 op/s 2024-09-21T03:51:47.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.395+0000 7fd2c4e5d640 1 -- 172.21.15.84:0/3180573240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2c0108cf0 msgr2=0x7fd2c010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:47.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.395+0000 7fd2c4e5d640 1 --2- 172.21.15.84:0/3180573240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2c0108cf0 0x7fd2c010f520 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8009ca0 tx=0x7fd2b802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.396+0000 7fd2c4e5d640 1 -- 172.21.15.84:0/3180573240 shutdown_connections 2024-09-21T03:51:47.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.396+0000 7fd2c4e5d640 1 --2- 172.21.15.84:0/3180573240 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2c0108cf0 0x7fd2c010f520 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.396+0000 7fd2c4e5d640 1 --2- 172.21.15.84:0/3180573240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2c01083a0 0x7fd2c01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.396+0000 7fd2c4e5d640 1 --2- 172.21.15.84:0/3180573240 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2c0102a60 0x7fd2c0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.396+0000 7fd2c4e5d640 1 -- 172.21.15.84:0/3180573240 >> 172.21.15.84:0/3180573240 conn(0x7fd2c0079730 msgr2=0x7fd2c0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:47.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.396+0000 7fd2c4e5d640 1 -- 172.21.15.84:0/3180573240 shutdown_connections 2024-09-21T03:51:47.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.396+0000 7fd2c4e5d640 1 -- 172.21.15.84:0/3180573240 wait complete. 2024-09-21T03:51:47.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.396+0000 7fd2c4e5d640 1 Processor -- start 2024-09-21T03:51:47.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.396+0000 7fd2c4e5d640 1 -- start start 2024-09-21T03:51:47.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.397+0000 7fd2c4e5d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2c0102a60 0x7fd2c0199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:47.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.397+0000 7fd2c4e5d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2c01083a0 0x7fd2c01998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:47.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.397+0000 7fd2c4e5d640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2c0108cf0 0x7fd2c019eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:47.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.397+0000 7fd2c4e5d640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c0112960 con 0x7fd2c01083a0 2024-09-21T03:51:47.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.397+0000 7fd2c4e5d640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c01127e0 con 0x7fd2c0102a60 2024-09-21T03:51:47.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.397+0000 7fd2c4e5d640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c0112ae0 con 0x7fd2c0108cf0 2024-09-21T03:51:47.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.397+0000 7fd2bdd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2c01083a0 0x7fd2c01998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:47.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.397+0000 7fd2bdd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2c01083a0 0x7fd2c01998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40182/0 (socket says 172.21.15.84:40182) 2024-09-21T03:51:47.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.397+0000 7fd2bdd9b640 1 -- 172.21.15.84:0/3190867552 learned_addr learned my addr 172.21.15.84:0/3190867552 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:47.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.397+0000 7fd2bed9d640 1 --2- 172.21.15.84:0/3190867552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2c0108cf0 0x7fd2c019eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:47.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.397+0000 7fd2be59c640 1 --2- 172.21.15.84:0/3190867552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2c0102a60 0x7fd2c0199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:47.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.397+0000 7fd2bdd9b640 1 -- 172.21.15.84:0/3190867552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2c0108cf0 msgr2=0x7fd2c019eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:47.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.397+0000 7fd2bdd9b640 1 --2- 172.21.15.84:0/3190867552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2c0108cf0 0x7fd2c019eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.397+0000 7fd2bdd9b640 1 -- 172.21.15.84:0/3190867552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2c0102a60 msgr2=0x7fd2c0199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:47.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.397+0000 7fd2bdd9b640 1 --2- 172.21.15.84:0/3190867552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2c0102a60 0x7fd2c0199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.397+0000 7fd2bdd9b640 1 -- 172.21.15.84:0/3190867552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c019f2a0 con 0x7fd2c01083a0 2024-09-21T03:51:47.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.397+0000 7fd2be59c640 1 --2- 172.21.15.84:0/3190867552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2c0102a60 0x7fd2c0199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:51:47.401 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.397+0000 7fd2bdd9b640 1 --2- 172.21.15.84:0/3190867552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2c01083a0 0x7fd2c01998d0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fd2b400e9c0 tx=0x7fd2b400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:47.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.398+0000 7fd2af7fe640 1 -- 172.21.15.84:0/3190867552 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b400cd80 con 0x7fd2c01083a0 2024-09-21T03:51:47.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.398+0000 7fd2c4e5d640 1 -- 172.21.15.84:0/3190867552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c019f590 con 0x7fd2c01083a0 2024-09-21T03:51:47.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.398+0000 7fd2af7fe640 1 -- 172.21.15.84:0/3190867552 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2b40054d0 con 0x7fd2c01083a0 2024-09-21T03:51:47.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.398+0000 7fd2af7fe640 1 -- 172.21.15.84:0/3190867552 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b4010430 con 0x7fd2c01083a0 2024-09-21T03:51:47.402 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.398+0000 7fd2c4e5d640 1 -- 172.21.15.84:0/3190867552 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c01a5cf0 con 0x7fd2c01083a0 2024-09-21T03:51:47.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.400+0000 7fd2cb3d1740 1 Processor -- start 2024-09-21T03:51:47.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.400+0000 7fd2cb3d1740 1 -- start start 2024-09-21T03:51:47.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.400+0000 7fd2af7fe640 1 -- 172.21.15.84:0/3190867552 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fd2b4004fd0 con 0x7fd2c01083a0 2024-09-21T03:51:47.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.401+0000 7fd2cb3d1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b719350 0x55ac9bac50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:47.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.401+0000 7fd2cb3d1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b6f0490 0x55ac9bac2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:47.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.401+0000 7fd2cb3d1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f8670 0x55ac9bac2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:47.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.401+0000 7fd2cb3d1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ac9ba36e60 con 0x55ac9b6f8670 2024-09-21T03:51:47.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.401+0000 7fd2cb3d1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ac9ba26290 con 0x55ac9b719350 2024-09-21T03:51:47.404 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.401+0000 7fd2cb3d1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ac9ba2a0a0 con 0x55ac9b6f0490 2024-09-21T03:51:47.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.401+0000 7fd2bdd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f8670 0x55ac9bac2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:47.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.401+0000 7fd2bdd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f8670 0x55ac9bac2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40188/0 (socket says 172.21.15.84:40188) 2024-09-21T03:51:47.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.401+0000 7fd2bdd9b640 1 -- 172.21.15.84:0/933585027 learned_addr learned my addr 172.21.15.84:0/933585027 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:47.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.401+0000 7fd2bed9d640 1 --2- 172.21.15.84:0/933585027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b719350 0x55ac9bac50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:47.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.401+0000 7fd2be59c640 1 --2- 172.21.15.84:0/933585027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b6f0490 0x55ac9bac2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:47.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.401+0000 7fd2bdd9b640 1 -- 172.21.15.84:0/933585027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b6f0490 msgr2=0x55ac9bac2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:47.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.401+0000 7fd2bdd9b640 1 --2- 172.21.15.84:0/933585027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b6f0490 0x55ac9bac2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.401+0000 7fd2bdd9b640 1 -- 172.21.15.84:0/933585027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b719350 msgr2=0x55ac9bac50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:47.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.401+0000 7fd2bdd9b640 1 --2- 172.21.15.84:0/933585027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b719350 0x55ac9bac50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.401+0000 7fd2bdd9b640 1 -- 172.21.15.84:0/933585027 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac9b784930 con 0x55ac9b6f8670 2024-09-21T03:51:47.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.401+0000 7fd2bed9d640 1 --2- 172.21.15.84:0/933585027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b719350 0x55ac9bac50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:51:47.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.401+0000 7fd2af7fe640 1 --2- 172.21.15.84:0/3190867552 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd2a80b6680 0x7fd2a80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:47.405 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.402+0000 7fd2bed9d640 1 --2- 172.21.15.84:0/3190867552 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd2a80b6680 0x7fd2a80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:47.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.402+0000 7fd2bdd9b640 1 --2- 172.21.15.84:0/933585027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f8670 0x55ac9bac2cf0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40e5320 tx=0x7fd2b40ebd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16eadf08d009c24 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:47.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.402+0000 7fd2af7fe640 1 -- 172.21.15.84:0/3190867552 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fd2b40e7c10 con 0x7fd2c01083a0 2024-09-21T03:51:47.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.402+0000 7fd2acff9640 1 -- 172.21.15.84:0/933585027 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40aa100 con 0x55ac9b6f8670 2024-09-21T03:51:47.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.402+0000 7fd2acff9640 1 -- 172.21.15.84:0/933585027 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2b40a9210 con 0x55ac9b6f8670 2024-09-21T03:51:47.406 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.402+0000 7fd2acff9640 1 -- 172.21.15.84:0/933585027 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40ad220 con 0x55ac9b6f8670 2024-09-21T03:51:47.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.403+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/933585027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f8670 msgr2=0x55ac9bac2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:47.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.403+0000 7fd2bed9d640 1 --2- 172.21.15.84:0/3190867552 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd2a80b6680 0x7fd2a80b8b90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8005e30 tx=0x7fd2b8005c30 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:47.409 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.403+0000 7fd2cb3d1740 1 --2- 172.21.15.84:0/933585027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f8670 0x55ac9bac2cf0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40e5320 tx=0x7fd2b40ebd50 comp rx=0 tx=0).stop 2024-09-21T03:51:47.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.403+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/933585027 shutdown_connections 2024-09-21T03:51:47.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.403+0000 7fd2cb3d1740 1 --2- 172.21.15.84:0/933585027 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f8670 0x55ac9bac2cf0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.403+0000 7fd2cb3d1740 1 --2- 172.21.15.84:0/933585027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b6f0490 0x55ac9bac2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.403+0000 7fd2cb3d1740 1 --2- 172.21.15.84:0/933585027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b719350 0x55ac9bac50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.403+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/933585027 >> 172.21.15.84:0/933585027 conn(0x55ac9b70d740 msgr2=0x55ac9bac0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:47.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.403+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/933585027 shutdown_connections 2024-09-21T03:51:47.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.403+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/933585027 wait complete. 2024-09-21T03:51:47.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.404+0000 7fd2cb3d1740 1 -- start start 2024-09-21T03:51:47.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.404+0000 7fd2cb3d1740 1 Processor -- start 2024-09-21T03:51:47.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.404+0000 7fd2cb3d1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b6f0490 0x55ac9bad05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:47.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.404+0000 7fd2cb3d1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f8670 0x55ac9bad0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:47.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.404+0000 7fd2cb3d1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b719350 0x55ac9badc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:47.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.404+0000 7fd2cb3d1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55ac9b887890 con 0x55ac9b6f8670 2024-09-21T03:51:47.410 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.404+0000 7fd2cb3d1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ac9b9c0d40 con 0x55ac9b6f0490 2024-09-21T03:51:47.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.404+0000 7fd2cb3d1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55ac9bad2f90 con 0x55ac9b719350 2024-09-21T03:51:47.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.404+0000 7fd2cb3d1740 10 client.0 _ll_register_callbacks cb 0x55ac9ba24c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:51:47.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.404+0000 7fd2bdd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f8670 0x55ac9bad0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:47.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.404+0000 7fd2bdd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f8670 0x55ac9bad0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40196/0 (socket says 172.21.15.84:40196) 2024-09-21T03:51:47.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.404+0000 7fd2bdd9b640 1 -- 172.21.15.84:0/3889383348 learned_addr learned my addr 172.21.15.84:0/3889383348 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:47.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.404+0000 7fd2be59c640 1 --2- 172.21.15.84:0/3889383348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b6f0490 0x55ac9bad05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:47.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.404+0000 7fd2bed9d640 1 --2- 172.21.15.84:0/3889383348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b719350 0x55ac9badc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:47.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.404+0000 7fd2bdd9b640 1 -- 172.21.15.84:0/3889383348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b719350 msgr2=0x55ac9badc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:47.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.404+0000 7fd2bdd9b640 1 --2- 172.21.15.84:0/3889383348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b719350 0x55ac9badc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.404+0000 7fd2bdd9b640 1 -- 172.21.15.84:0/3889383348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b6f0490 msgr2=0x55ac9bad05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:47.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.404+0000 7fd2bdd9b640 1 --2- 172.21.15.84:0/3889383348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b6f0490 0x55ac9bad05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.404+0000 7fd2bdd9b640 1 -- 172.21.15.84:0/3889383348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac9badc880 con 0x55ac9b6f8670 2024-09-21T03:51:47.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.405+0000 7fd2bdd9b640 1 --2- 172.21.15.84:0/3889383348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f8670 0x55ac9bad0b20 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40ad7b0 tx=0x7fd2b40eb9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8d67f11113c306 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:47.411 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.405+0000 7fd2a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:51:47.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.405+0000 7fd2a5ffb640 1 -- 172.21.15.84:0/3889383348 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40ad400 con 0x55ac9b6f8670 2024-09-21T03:51:47.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.405+0000 7fd2a5ffb640 1 -- 172.21.15.84:0/3889383348 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fd2b40b2180 con 0x55ac9b6f8670 2024-09-21T03:51:47.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.405+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/3889383348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2b40a9210 con 0x55ac9b6f8670 2024-09-21T03:51:47.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.405+0000 7fd2a5ffb640 1 -- 172.21.15.84:0/3889383348 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd2b40ad880 con 0x55ac9b6f8670 2024-09-21T03:51:47.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.405+0000 7fd2cb3d1740 10 client.17247 fetch_fsmap learned FSMap version 25 2024-09-21T03:51:47.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.405+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/3889383348 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ac9badf1b0 con 0x55ac9b6f8670 2024-09-21T03:51:47.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.405+0000 7fd2a5ffb640 1 -- 172.21.15.84:0/3889383348 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2b40a9210 con 0x55ac9b6f8670 2024-09-21T03:51:47.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.405+0000 7fd2a5ffb640 1 -- 172.21.15.84:0/3889383348 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd2b40b7040 con 0x55ac9b6f8670 2024-09-21T03:51:47.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.405+0000 7fd2cb3d1740 10 client.17247 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:51:47.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.405+0000 7fd2cb3d1740 10 client.17247 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:51:47.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.405+0000 7fd2cb3d1740 20 client.17247 populate_metadata read hostname 'smithi084' 2024-09-21T03:51:47.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.405+0000 7fd2cb3d1740 1 --2- 172.21.15.84:0/3889383348 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ac9b6d7cd0 0x55ac9bae2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:47.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.405+0000 7fd2cb3d1740 4 client.17247 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:51:47.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.405+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/3889383348 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac9ba38db0 con 0x55ac9b6d7cd0 2024-09-21T03:51:47.412 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.406+0000 7fd2be59c640 1 --2- 172.21.15.84:0/3889383348 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ac9b6d7cd0 0x55ac9bae2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:47.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.406+0000 7fd2be59c640 1 --2- 172.21.15.84:0/3889383348 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ac9b6d7cd0 0x55ac9bae2510 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=816340f6b0f13b04 server_cookie=58e7a5c43ccada18 in_seq=0 out_seq=0 2024-09-21T03:51:47.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.406+0000 7fd2a5ffb640 10 client.17247 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:47.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.407+0000 7fd2a5ffb640 1 -- 172.21.15.84:0/3889383348 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ac9ba38db0 con 0x55ac9b6d7cd0 2024-09-21T03:51:47.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.407+0000 7fd2a5ffb640 10 client.17247 handle_command_reply: tid=0 2024-09-21T03:51:47.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.407+0000 7fd2cb3d1740 1 client.17247 shutdown 2024-09-21T03:51:47.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.407+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/3889383348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f8670 msgr2=0x55ac9bad0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:47.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.407+0000 7fd2cb3d1740 1 --2- 172.21.15.84:0/3889383348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f8670 0x55ac9bad0b20 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40ad7b0 tx=0x7fd2b40eb9a0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.407+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/3889383348 shutdown_connections 2024-09-21T03:51:47.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.407+0000 7fd2cb3d1740 1 --2- 172.21.15.84:0/3889383348 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ac9b6d7cd0 0x55ac9bae2510 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.407+0000 7fd2a5ffb640 0 client.17247 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:47.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.407+0000 7fd2cb3d1740 1 --2- 172.21.15.84:0/3889383348 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b719350 0x55ac9badc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.407+0000 7fd2cb3d1740 1 --2- 172.21.15.84:0/3889383348 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f8670 0x55ac9bad0b20 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.407+0000 7fd2cb3d1740 1 --2- 172.21.15.84:0/3889383348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b6f0490 0x55ac9bad05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.407+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/3889383348 >> 172.21.15.84:0/3889383348 conn(0x55ac9b70d740 msgr2=0x55ac9bac4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:47.413 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.407+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/3889383348 shutdown_connections 2024-09-21T03:51:47.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.407+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/3889383348 wait complete. 2024-09-21T03:51:47.414 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.407+0000 7fd2cb3d1740 20 client.17247 trim_cache size 0 max 16384 2024-09-21T03:51:47.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.424+0000 7fd2cb3d1740 1 Processor -- start 2024-09-21T03:51:47.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.424+0000 7fd2cb3d1740 1 -- start start 2024-09-21T03:51:47.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.424+0000 7fd2cb3d1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b6d7cd0 0x55ac9bac2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:47.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.424+0000 7fd2cb3d1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f0490 0x55ac9bacdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:47.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.425+0000 7fd2cb3d1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b6f8670 0x55ac9babe3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:47.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.425+0000 7fd2cb3d1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c01afd30 con 0x55ac9b6f0490 2024-09-21T03:51:47.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.425+0000 7fd2cb3d1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c01ad600 con 0x55ac9b6d7cd0 2024-09-21T03:51:47.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.425+0000 7fd2cb3d1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c01ab470 con 0x55ac9b6f8670 2024-09-21T03:51:47.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.425+0000 7fd2bdd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f0490 0x55ac9bacdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:47.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.425+0000 7fd2bdd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f0490 0x55ac9bacdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40206/0 (socket says 172.21.15.84:40206) 2024-09-21T03:51:47.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.425+0000 7fd2bdd9b640 1 -- 172.21.15.84:0/455274900 learned_addr learned my addr 172.21.15.84:0/455274900 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:47.428 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.425+0000 7fd2be59c640 1 --2- 172.21.15.84:0/455274900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b6d7cd0 0x55ac9bac2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:47.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.425+0000 7fd2bdd9b640 1 -- 172.21.15.84:0/455274900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b6f8670 msgr2=0x55ac9babe3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:47.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.425+0000 7fd2bed9d640 1 --2- 172.21.15.84:0/455274900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b6f8670 0x55ac9babe3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:47.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.425+0000 7fd2bdd9b640 1 --2- 172.21.15.84:0/455274900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b6f8670 0x55ac9babe3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.425+0000 7fd2bdd9b640 1 -- 172.21.15.84:0/455274900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b6d7cd0 msgr2=0x55ac9bac2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:47.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.425+0000 7fd2bdd9b640 1 --2- 172.21.15.84:0/455274900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b6d7cd0 0x55ac9bac2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.425+0000 7fd2bdd9b640 1 -- 172.21.15.84:0/455274900 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac9bac8780 con 0x55ac9b6f0490 2024-09-21T03:51:47.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.425+0000 7fd2bed9d640 1 --2- 172.21.15.84:0/455274900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b6f8670 0x55ac9babe3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:51:47.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.425+0000 7fd2bdd9b640 1 --2- 172.21.15.84:0/455274900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f0490 0x55ac9bacdd90 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40ada40 tx=0x7fd2b40eba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfeb295e104be8e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:47.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.425+0000 7fd2a7fff640 1 -- 172.21.15.84:0/455274900 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40a9950 con 0x55ac9b6f0490 2024-09-21T03:51:47.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.425+0000 7fd2a7fff640 1 -- 172.21.15.84:0/455274900 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2b40a9210 con 0x55ac9b6f0490 2024-09-21T03:51:47.429 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.425+0000 7fd2a7fff640 1 -- 172.21.15.84:0/455274900 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40ad400 con 0x55ac9b6f0490 2024-09-21T03:51:47.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.426+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/455274900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f0490 msgr2=0x55ac9bacdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:47.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.426+0000 7fd2cb3d1740 1 --2- 172.21.15.84:0/455274900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f0490 0x55ac9bacdd90 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40ada40 tx=0x7fd2b40eba10 comp rx=0 tx=0).stop 2024-09-21T03:51:47.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.426+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/455274900 shutdown_connections 2024-09-21T03:51:47.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.426+0000 7fd2cb3d1740 1 --2- 172.21.15.84:0/455274900 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b6f8670 0x55ac9babe3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.426+0000 7fd2cb3d1740 1 --2- 172.21.15.84:0/455274900 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f0490 0x55ac9bacdd90 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.426+0000 7fd2cb3d1740 1 --2- 172.21.15.84:0/455274900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b6d7cd0 0x55ac9bac2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.426+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/455274900 >> 172.21.15.84:0/455274900 conn(0x55ac9b70d740 msgr2=0x55ac9babca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:47.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.426+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/455274900 shutdown_connections 2024-09-21T03:51:47.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.426+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/455274900 wait complete. 2024-09-21T03:51:47.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.426+0000 7fd2cb3d1740 1 -- start start 2024-09-21T03:51:47.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.427+0000 7fd2cb3d1740 1 Processor -- start 2024-09-21T03:51:47.432 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.427+0000 7fd2cb3d1740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b6d7cd0 0x55ac9bae5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:47.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.427+0000 7fd2cb3d1740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f0490 0x55ac9bae2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:47.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.427+0000 7fd2cb3d1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b6f8670 0x55ac9bae2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:47.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.427+0000 7fd2cb3d1740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c01abac0 con 0x55ac9b6f0490 2024-09-21T03:51:47.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.427+0000 7fd2cb3d1740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c01acf30 con 0x55ac9b6d7cd0 2024-09-21T03:51:47.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.427+0000 7fd2cb3d1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c01ac190 con 0x55ac9b6f8670 2024-09-21T03:51:47.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.427+0000 7fd2cb3d1740 10 client.0 _ll_register_callbacks cb 0x7fd2b4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:51:47.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.427+0000 7fd2bdd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f0490 0x55ac9bae2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:47.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.427+0000 7fd2bdd9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f0490 0x55ac9bae2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40218/0 (socket says 172.21.15.84:40218) 2024-09-21T03:51:47.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.427+0000 7fd2bdd9b640 1 -- 172.21.15.84:0/3102381521 learned_addr learned my addr 172.21.15.84:0/3102381521 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:47.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.427+0000 7fd2be59c640 1 --2- 172.21.15.84:0/3102381521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b6d7cd0 0x55ac9bae5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:47.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.427+0000 7fd2bed9d640 1 --2- 172.21.15.84:0/3102381521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b6f8670 0x55ac9bae2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:47.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.427+0000 7fd2bdd9b640 1 -- 172.21.15.84:0/3102381521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b6f8670 msgr2=0x55ac9bae2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:47.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.427+0000 7fd2bdd9b640 1 --2- 172.21.15.84:0/3102381521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b6f8670 0x55ac9bae2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.427+0000 7fd2bdd9b640 1 -- 172.21.15.84:0/3102381521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b6d7cd0 msgr2=0x55ac9bae5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.427+0000 7fd2bdd9b640 1 --2- 172.21.15.84:0/3102381521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b6d7cd0 0x55ac9bae5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.427+0000 7fd2bdd9b640 1 -- 172.21.15.84:0/3102381521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac9bae2fc0 con 0x55ac9b6f0490 2024-09-21T03:51:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.427+0000 7fd2bdd9b640 1 --2- 172.21.15.84:0/3102381521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f0490 0x55ac9bae2510 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40ad390 tx=0x7fd2b40eb9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc2909ab640a020 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.428+0000 7fd2a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:51:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.428+0000 7fd2a5ffb640 1 -- 172.21.15.84:0/3102381521 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40ad400 con 0x55ac9b6f0490 2024-09-21T03:51:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.428+0000 7fd2a5ffb640 1 -- 172.21.15.84:0/3102381521 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7fd2b40acd10 con 0x55ac9b6f0490 2024-09-21T03:51:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.428+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/3102381521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2b40a9210 con 0x55ac9b6f0490 2024-09-21T03:51:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.428+0000 7fd2a5ffb640 1 -- 172.21.15.84:0/3102381521 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd2b40b7250 con 0x55ac9b6f0490 2024-09-21T03:51:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.428+0000 7fd2cb3d1740 10 client.17253 fetch_fsmap learned FSMap version 25 2024-09-21T03:51:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.428+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/3102381521 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ac9bae2fc0 con 0x55ac9b6f0490 2024-09-21T03:51:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.428+0000 7fd2a5ffb640 1 -- 172.21.15.84:0/3102381521 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2b40a9210 con 0x55ac9b6f0490 2024-09-21T03:51:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.428+0000 7fd2a5ffb640 1 -- 172.21.15.84:0/3102381521 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd2b40a9400 con 0x55ac9b6f0490 2024-09-21T03:51:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.428+0000 7fd2cb3d1740 10 client.17253 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:51:47.434 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.428+0000 7fd2cb3d1740 10 client.17253 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:51:47.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.428+0000 7fd2cb3d1740 20 client.17253 populate_metadata read hostname 'smithi084' 2024-09-21T03:51:47.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.428+0000 7fd2cb3d1740 1 --2- 172.21.15.84:0/3102381521 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ac9b719350 0x55ac9bb4fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:47.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.428+0000 7fd2cb3d1740 4 client.17253 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:51:47.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.428+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/3102381521 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ac9ba34860 con 0x55ac9b719350 2024-09-21T03:51:47.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.429+0000 7fd2be59c640 1 --2- 172.21.15.84:0/3102381521 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ac9b719350 0x55ac9bb4fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:47.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.429+0000 7fd2be59c640 1 --2- 172.21.15.84:0/3102381521 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ac9b719350 0x55ac9bb4fc20 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=714427429dcc1d26 server_cookie=217f2c80c289444d in_seq=0 out_seq=0 2024-09-21T03:51:47.435 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.429+0000 7fd2a5ffb640 10 client.17253 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:47.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.431+0000 7fd2a5ffb640 1 -- 172.21.15.84:0/3102381521 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ac9ba34860 con 0x55ac9b719350 2024-09-21T03:51:47.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.431+0000 7fd2a5ffb640 10 client.17253 handle_command_reply: tid=0 2024-09-21T03:51:47.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.431+0000 7fd2cb3d1740 1 client.17253 shutdown 2024-09-21T03:51:47.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.431+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/3102381521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f0490 msgr2=0x55ac9bae2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:47.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.431+0000 7fd2cb3d1740 1 --2- 172.21.15.84:0/3102381521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f0490 0x55ac9bae2510 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fd2b40ad390 tx=0x7fd2b40eb9a0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.431+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/3102381521 shutdown_connections 2024-09-21T03:51:47.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.431+0000 7fd2cb3d1740 1 --2- 172.21.15.84:0/3102381521 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55ac9b719350 0x55ac9bb4fc20 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.431+0000 7fd2cb3d1740 1 --2- 172.21.15.84:0/3102381521 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ac9b6f8670 0x55ac9bae2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.431+0000 7fd2cb3d1740 1 --2- 172.21.15.84:0/3102381521 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55ac9b6f0490 0x55ac9bae2510 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.431+0000 7fd2cb3d1740 1 --2- 172.21.15.84:0/3102381521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ac9b6d7cd0 0x55ac9bae5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.431+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/3102381521 >> 172.21.15.84:0/3102381521 conn(0x55ac9b70d740 msgr2=0x55ac9babe3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:47.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.431+0000 7fd2a5ffb640 0 client.17253 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:47.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.431+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/3102381521 shutdown_connections 2024-09-21T03:51:47.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.431+0000 7fd2cb3d1740 1 -- 172.21.15.84:0/3102381521 wait complete. 2024-09-21T03:51:47.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.431+0000 7fd2cb3d1740 20 client.17253 trim_cache size 0 max 16384 2024-09-21T03:51:47.437 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:51:47.437 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T03:51:47.437 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "5435e7df-7d39-4687-a715-54c7af6bc3b1", 2024-09-21T03:51:47.437 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T03:51:47.438 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:51:47.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.432+0000 7fd2c4e5d640 1 -- 172.21.15.84:0/3190867552 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd2a80b6680 msgr2=0x7fd2a80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:47.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.432+0000 7fd2c4e5d640 1 --2- 172.21.15.84:0/3190867552 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd2a80b6680 0x7fd2a80b8b90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8005e30 tx=0x7fd2b8005c30 comp rx=0 tx=0).stop 2024-09-21T03:51:47.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.432+0000 7fd2c4e5d640 1 -- 172.21.15.84:0/3190867552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2c01083a0 msgr2=0x7fd2c01998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:47.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.432+0000 7fd2c4e5d640 1 --2- 172.21.15.84:0/3190867552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2c01083a0 0x7fd2c01998d0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fd2b400e9c0 tx=0x7fd2b400ee80 comp rx=0 tx=0).stop 2024-09-21T03:51:47.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.432+0000 7fd2c4e5d640 1 -- 172.21.15.84:0/3190867552 shutdown_connections 2024-09-21T03:51:47.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.432+0000 7fd2c4e5d640 1 --2- 172.21.15.84:0/3190867552 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd2a80b6680 0x7fd2a80b8b90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.438 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.432+0000 7fd2c4e5d640 1 --2- 172.21.15.84:0/3190867552 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd2c0108cf0 0x7fd2c019eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.432+0000 7fd2c4e5d640 1 --2- 172.21.15.84:0/3190867552 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd2c01083a0 0x7fd2c01998d0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.432+0000 7fd2c4e5d640 1 --2- 172.21.15.84:0/3190867552 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2c0102a60 0x7fd2c0199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:47.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.432+0000 7fd2c4e5d640 1 -- 172.21.15.84:0/3190867552 >> 172.21.15.84:0/3190867552 conn(0x7fd2c0079730 msgr2=0x7fd2c01043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:47.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.432+0000 7fd2c4e5d640 1 -- 172.21.15.84:0/3190867552 shutdown_connections 2024-09-21T03:51:47.439 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:47.432+0000 7fd2c4e5d640 1 -- 172.21.15.84:0/3190867552 wait complete. 2024-09-21T03:51:48.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:47 smithi084 ceph-mon[30941]: scrub queued for path: / 2024-09-21T03:51:48.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:47 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:51:48.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:47 smithi084 ceph-mon[30941]: scrub summary: active paths [/] 2024-09-21T03:51:48.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:47 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:51:48.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:47 smithi174 ceph-mon[34403]: scrub queued for path: / 2024-09-21T03:51:48.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:47 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:51:48.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:47 smithi174 ceph-mon[34403]: scrub summary: active paths [/] 2024-09-21T03:51:48.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:47 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:51:48.151 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:51:48.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:47 smithi172 ceph-mon[34821]: scrub queued for path: / 2024-09-21T03:51:48.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:47 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:51:48.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:47 smithi172 ceph-mon[34821]: scrub summary: active paths [/] 2024-09-21T03:51:48.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:47 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:51:48.396 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:51:48.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.893+0000 7f29b0a53640 1 -- 172.21.15.84:0/2170182222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac1083c0 msgr2=0x7f29ac1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:48.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.893+0000 7f29b0a53640 1 --2- 172.21.15.84:0/2170182222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac1083c0 0x7f29ac1087d0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f2994009900 tx=0x7f299402a410 comp rx=0 tx=0).stop 2024-09-21T03:51:48.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.893+0000 7f29b0a53640 1 -- 172.21.15.84:0/2170182222 shutdown_connections 2024-09-21T03:51:48.903 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.893+0000 7f29b0a53640 1 --2- 172.21.15.84:0/2170182222 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29ac108d10 0x7f29ac10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.893+0000 7f29b0a53640 1 --2- 172.21.15.84:0/2170182222 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac1083c0 0x7f29ac1087d0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.893+0000 7f29b0a53640 1 --2- 172.21.15.84:0/2170182222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac102a80 0x7f29ac102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.893+0000 7f29b0a53640 1 -- 172.21.15.84:0/2170182222 >> 172.21.15.84:0/2170182222 conn(0x7f29ac079740 msgr2=0x7f29ac079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:48.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.893+0000 7f29b0a53640 1 -- 172.21.15.84:0/2170182222 shutdown_connections 2024-09-21T03:51:48.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.893+0000 7f29b0a53640 1 -- 172.21.15.84:0/2170182222 wait complete. 2024-09-21T03:51:48.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.894+0000 7f29b0a53640 1 Processor -- start 2024-09-21T03:51:48.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.894+0000 7f29b0a53640 1 -- start start 2024-09-21T03:51:48.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.894+0000 7f29b0a53640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac102a80 0x7f29ac199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:48.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.894+0000 7f29b0a53640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29ac1083c0 0x7f29ac199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:48.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.894+0000 7f29b0a53640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac108d10 0x7f29ac19edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:48.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.894+0000 7f29b0a53640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac1129c0 con 0x7f29ac102a80 2024-09-21T03:51:48.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.894+0000 7f29b0a53640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac112840 con 0x7f29ac108d10 2024-09-21T03:51:48.904 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.894+0000 7f29b0a53640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac112b40 con 0x7f29ac1083c0 2024-09-21T03:51:48.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.894+0000 7f29aa59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac102a80 0x7f29ac199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:48.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.894+0000 7f29aa59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac102a80 0x7f29ac199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48338/0 (socket says 172.21.15.84:48338) 2024-09-21T03:51:48.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.894+0000 7f29aa59c640 1 -- 172.21.15.84:0/1213398029 learned_addr learned my addr 172.21.15.84:0/1213398029 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:48.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.895+0000 7f29aad9d640 1 --2- 172.21.15.84:0/1213398029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac108d10 0x7f29ac19edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:48.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.895+0000 7f29a9d9b640 1 --2- 172.21.15.84:0/1213398029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29ac1083c0 0x7f29ac199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:48.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.895+0000 7f29aa59c640 1 -- 172.21.15.84:0/1213398029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29ac1083c0 msgr2=0x7f29ac199b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:48.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.895+0000 7f29aa59c640 1 --2- 172.21.15.84:0/1213398029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29ac1083c0 0x7f29ac199b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.895+0000 7f29aa59c640 1 -- 172.21.15.84:0/1213398029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac108d10 msgr2=0x7f29ac19edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:48.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.895+0000 7f29aa59c640 1 --2- 172.21.15.84:0/1213398029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac108d10 0x7f29ac19edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.895+0000 7f29aa59c640 1 -- 172.21.15.84:0/1213398029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ac19f420 con 0x7f29ac102a80 2024-09-21T03:51:48.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.895+0000 7f29aad9d640 1 --2- 172.21.15.84:0/1213398029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac108d10 0x7f29ac19edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:51:48.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.895+0000 7f29aa59c640 1 --2- 172.21.15.84:0/1213398029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac102a80 0x7f29ac199570 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f299c00cce0 tx=0x7f299c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:48.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.895+0000 7f29a37fe640 1 -- 172.21.15.84:0/1213398029 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c00f650 con 0x7f29ac102a80 2024-09-21T03:51:48.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.895+0000 7f29b0a53640 1 -- 172.21.15.84:0/1213398029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29ac19f710 con 0x7f29ac102a80 2024-09-21T03:51:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.895+0000 7f29a37fe640 1 -- 172.21.15.84:0/1213398029 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f299c00fca0 con 0x7f29ac102a80 2024-09-21T03:51:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.895+0000 7f29a37fe640 1 -- 172.21.15.84:0/1213398029 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299c018b40 con 0x7f29ac102a80 2024-09-21T03:51:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.895+0000 7f29b0a53640 1 -- 172.21.15.84:0/1213398029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29ac1a5f30 con 0x7f29ac102a80 2024-09-21T03:51:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.897+0000 7f29b6fc7740 1 Processor -- start 2024-09-21T03:51:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.898+0000 7f29b6fc7740 1 -- start start 2024-09-21T03:51:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.898+0000 7f29b6fc7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5623807f0070 0x562380b97270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.898+0000 7f29b6fc7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807c71b0 0x562380b977b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.898+0000 7f29b6fc7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807cf390 0x562380b97cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.898+0000 7f29b6fc7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562380b0de50 con 0x5623807cf390 2024-09-21T03:51:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.898+0000 7f29b6fc7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562380afd280 con 0x5623807c71b0 2024-09-21T03:51:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.898+0000 7f29b6fc7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562380b01090 con 0x5623807f0070 2024-09-21T03:51:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.898+0000 7f29a37fe640 1 -- 172.21.15.84:0/1213398029 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f299c018ce0 con 0x7f29ac102a80 2024-09-21T03:51:48.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.898+0000 7f29a9d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807cf390 0x562380b97cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.898+0000 7f29a9d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807cf390 0x562380b97cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48352/0 (socket says 172.21.15.84:48352) 2024-09-21T03:51:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.898+0000 7f29a9d9b640 1 -- 172.21.15.84:0/2644440461 learned_addr learned my addr 172.21.15.84:0/2644440461 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.898+0000 7f29aad9d640 1 --2- 172.21.15.84:0/2644440461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5623807f0070 0x562380b97270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.899+0000 7f29a9d9b640 1 -- 172.21.15.84:0/2644440461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5623807f0070 msgr2=0x562380b97270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.899+0000 7f29aa59c640 1 --2- 172.21.15.84:0/2644440461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807c71b0 0x562380b977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.899+0000 7f29a9d9b640 1 --2- 172.21.15.84:0/2644440461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5623807f0070 0x562380b97270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.899+0000 7f29a9d9b640 1 -- 172.21.15.84:0/2644440461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807c71b0 msgr2=0x562380b977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.899+0000 7f29a9d9b640 1 --2- 172.21.15.84:0/2644440461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807c71b0 0x562380b977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.899+0000 7f29a9d9b640 1 -- 172.21.15.84:0/2644440461 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56238085b650 con 0x5623807cf390 2024-09-21T03:51:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.899+0000 7f29aa59c640 1 --2- 172.21.15.84:0/2644440461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807c71b0 0x562380b977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:51:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.899+0000 7f29a9d9b640 1 --2- 172.21.15.84:0/2644440461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807cf390 0x562380b97cf0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f29ac06b6c0 tx=0x7f2994031cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33bd59d8d9b6bc19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.899+0000 7f29a0ff9640 1 -- 172.21.15.84:0/2644440461 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299403f070 con 0x5623807cf390 2024-09-21T03:51:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.899+0000 7f29a0ff9640 1 -- 172.21.15.84:0/2644440461 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29940316a0 con 0x5623807cf390 2024-09-21T03:51:48.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.899+0000 7f29a0ff9640 1 -- 172.21.15.84:0/2644440461 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994035070 con 0x5623807cf390 2024-09-21T03:51:48.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.899+0000 7f29a37fe640 1 --2- 172.21.15.84:0/1213398029 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29980b66b0 0x7f29980b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:48.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.899+0000 7f29aad9d640 1 --2- 172.21.15.84:0/1213398029 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29980b66b0 0x7f29980b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:48.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.899+0000 7f29a37fe640 1 -- 172.21.15.84:0/1213398029 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f299c0e7c20 con 0x7f29ac102a80 2024-09-21T03:51:48.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.900+0000 7f29b6fc7740 1 -- 172.21.15.84:0/2644440461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807cf390 msgr2=0x562380b97cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:48.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.900+0000 7f29b6fc7740 1 --2- 172.21.15.84:0/2644440461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807cf390 0x562380b97cf0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f29ac06b6c0 tx=0x7f2994031cd0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.901+0000 7f29aad9d640 1 --2- 172.21.15.84:0/1213398029 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29980b66b0 0x7f29980b8bc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f29a400bad0 tx=0x7f29a4008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:48.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.901+0000 7f29b6fc7740 1 -- 172.21.15.84:0/2644440461 shutdown_connections 2024-09-21T03:51:48.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.901+0000 7f29b6fc7740 1 --2- 172.21.15.84:0/2644440461 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807cf390 0x562380b97cf0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.901+0000 7f29b6fc7740 1 --2- 172.21.15.84:0/2644440461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807c71b0 0x562380b977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.901+0000 7f29b6fc7740 1 --2- 172.21.15.84:0/2644440461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5623807f0070 0x562380b97270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.901+0000 7f29b6fc7740 1 -- 172.21.15.84:0/2644440461 >> 172.21.15.84:0/2644440461 conn(0x5623807e4460 msgr2=0x562380b95160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:48.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.901+0000 7f29b6fc7740 1 -- 172.21.15.84:0/2644440461 shutdown_connections 2024-09-21T03:51:48.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.901+0000 7f29b6fc7740 1 -- 172.21.15.84:0/2644440461 wait complete. 2024-09-21T03:51:48.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.901+0000 7f29b6fc7740 1 -- start start 2024-09-21T03:51:48.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.901+0000 7f29b6fc7740 1 Processor -- start 2024-09-21T03:51:48.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.902+0000 7f29b6fc7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5623807c71b0 0x562380ba4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:48.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.902+0000 7f29b6fc7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807cf390 0x562380ba4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:48.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.902+0000 7f29b6fc7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807f0070 0x562380ba5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:48.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.902+0000 7f29b6fc7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56238095e700 con 0x5623807f0070 2024-09-21T03:51:48.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.902+0000 7f29b6fc7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562380a98110 con 0x5623807cf390 2024-09-21T03:51:48.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.902+0000 7f29b6fc7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562380ba7b50 con 0x5623807c71b0 2024-09-21T03:51:48.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.902+0000 7f29b6fc7740 10 client.0 _ll_register_callbacks cb 0x562380ab1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:51:48.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.902+0000 7f29aad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807f0070 0x562380ba5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:48.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.902+0000 7f29aad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807f0070 0x562380ba5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48356/0 (socket says 172.21.15.84:48356) 2024-09-21T03:51:48.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.902+0000 7f29aad9d640 1 -- 172.21.15.84:0/2727840993 learned_addr learned my addr 172.21.15.84:0/2727840993 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:48.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.902+0000 7f29a9d9b640 1 --2- 172.21.15.84:0/2727840993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807cf390 0x562380ba4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:48.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.902+0000 7f29aa59c640 1 --2- 172.21.15.84:0/2727840993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5623807c71b0 0x562380ba4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:48.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.902+0000 7f29aad9d640 1 -- 172.21.15.84:0/2727840993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5623807c71b0 msgr2=0x562380ba4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:48.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.902+0000 7f29aad9d640 1 --2- 172.21.15.84:0/2727840993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5623807c71b0 0x562380ba4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.902+0000 7f29aad9d640 1 -- 172.21.15.84:0/2727840993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807cf390 msgr2=0x562380ba4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:48.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.902+0000 7f29aad9d640 1 --2- 172.21.15.84:0/2727840993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807cf390 0x562380ba4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.902+0000 7f29aad9d640 1 -- 172.21.15.84:0/2727840993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562380ac5c40 con 0x5623807f0070 2024-09-21T03:51:48.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.902+0000 7f29aad9d640 1 --2- 172.21.15.84:0/2727840993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807f0070 0x562380ba5530 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f29a40167d0 tx=0x7f29a40047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823bdd0c476d5a99 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:48.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.902+0000 7f2991ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:51:48.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.903+0000 7f2991ffb640 1 -- 172.21.15.84:0/2727840993 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a401c050 con 0x5623807f0070 2024-09-21T03:51:48.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.903+0000 7f29b6fc7740 1 -- 172.21.15.84:0/2727840993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29940316a0 con 0x5623807f0070 2024-09-21T03:51:48.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.903+0000 7f2991ffb640 1 -- 172.21.15.84:0/2727840993 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f29a40148e0 con 0x5623807f0070 2024-09-21T03:51:48.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.903+0000 7f2991ffb640 1 -- 172.21.15.84:0/2727840993 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f29a4014ae0 con 0x5623807f0070 2024-09-21T03:51:48.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.903+0000 7f29b6fc7740 10 client.17265 fetch_fsmap learned FSMap version 25 2024-09-21T03:51:48.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.903+0000 7f29b6fc7740 1 -- 172.21.15.84:0/2727840993 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562380bb3800 con 0x5623807f0070 2024-09-21T03:51:48.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.903+0000 7f2991ffb640 1 -- 172.21.15.84:0/2727840993 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29940316a0 con 0x5623807f0070 2024-09-21T03:51:48.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.903+0000 7f2991ffb640 1 -- 172.21.15.84:0/2727840993 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f29a40063e0 con 0x5623807f0070 2024-09-21T03:51:48.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.903+0000 7f29b6fc7740 10 client.17265 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:51:48.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.903+0000 7f29b6fc7740 10 client.17265 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:51:48.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.903+0000 7f29b6fc7740 20 client.17265 populate_metadata read hostname 'smithi084' 2024-09-21T03:51:48.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.903+0000 7f29b6fc7740 1 --2- 172.21.15.84:0/2727840993 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5623807ae9f0 0x562380bb6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:48.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.903+0000 7f29b6fc7740 4 client.17265 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:51:48.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.903+0000 7f29b6fc7740 1 -- 172.21.15.84:0/2727840993 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562380b0fda0 con 0x5623807ae9f0 2024-09-21T03:51:48.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.904+0000 7f29aa59c640 1 --2- 172.21.15.84:0/2727840993 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5623807ae9f0 0x562380bb6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:48.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.904+0000 7f29aa59c640 1 --2- 172.21.15.84:0/2727840993 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5623807ae9f0 0x562380bb6d30 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=593d8cb1cacb2397 server_cookie=d095ae2d63690819 in_seq=0 out_seq=0 2024-09-21T03:51:48.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.904+0000 7f2991ffb640 10 client.17265 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:48.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.905+0000 7f2991ffb640 1 -- 172.21.15.84:0/2727840993 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562380b0fda0 con 0x5623807ae9f0 2024-09-21T03:51:48.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.905+0000 7f2991ffb640 10 client.17265 handle_command_reply: tid=0 2024-09-21T03:51:48.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.905+0000 7f29b6fc7740 1 client.17265 shutdown 2024-09-21T03:51:48.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.905+0000 7f29b6fc7740 1 -- 172.21.15.84:0/2727840993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807f0070 msgr2=0x562380ba5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:48.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.905+0000 7f29b6fc7740 1 --2- 172.21.15.84:0/2727840993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807f0070 0x562380ba5530 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f29a40167d0 tx=0x7f29a40047d0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.905+0000 7f29b6fc7740 1 -- 172.21.15.84:0/2727840993 shutdown_connections 2024-09-21T03:51:48.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.905+0000 7f29b6fc7740 1 --2- 172.21.15.84:0/2727840993 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5623807ae9f0 0x562380bb6d30 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.905+0000 7f29b6fc7740 1 --2- 172.21.15.84:0/2727840993 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807f0070 0x562380ba5530 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.905+0000 7f29b6fc7740 1 --2- 172.21.15.84:0/2727840993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807cf390 0x562380ba4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.905+0000 7f29b6fc7740 1 --2- 172.21.15.84:0/2727840993 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5623807c71b0 0x562380ba4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.905+0000 7f29b6fc7740 1 -- 172.21.15.84:0/2727840993 >> 172.21.15.84:0/2727840993 conn(0x5623807e4460 msgr2=0x562380b93700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:48.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.905+0000 7f2991ffb640 0 client.17265 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:48.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.905+0000 7f29b6fc7740 1 -- 172.21.15.84:0/2727840993 shutdown_connections 2024-09-21T03:51:48.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.905+0000 7f29b6fc7740 1 -- 172.21.15.84:0/2727840993 wait complete. 2024-09-21T03:51:48.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.905+0000 7f29b6fc7740 20 client.17265 trim_cache size 0 max 16384 2024-09-21T03:51:48.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.922+0000 7f29b6fc7740 1 Processor -- start 2024-09-21T03:51:48.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.922+0000 7f29b6fc7740 1 -- start start 2024-09-21T03:51:48.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.922+0000 7f29b6fc7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5623807c71b0 0x562380ba66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:48.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.922+0000 7f29b6fc7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807cf390 0x562380ba1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:48.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.922+0000 7f29b6fc7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807f0070 0x562380ba21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:48.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.922+0000 7f29b6fc7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac1afc80 con 0x5623807f0070 2024-09-21T03:51:48.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.922+0000 7f29b6fc7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac1ad550 con 0x5623807cf390 2024-09-21T03:51:48.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.922+0000 7f29b6fc7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac1ab3c0 con 0x5623807c71b0 2024-09-21T03:51:48.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.923+0000 7f29aad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807f0070 0x562380ba21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:48.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.923+0000 7f29aad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807f0070 0x562380ba21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48370/0 (socket says 172.21.15.84:48370) 2024-09-21T03:51:48.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.923+0000 7f29aad9d640 1 -- 172.21.15.84:0/2364220228 learned_addr learned my addr 172.21.15.84:0/2364220228 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:48.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.923+0000 7f29a9d9b640 1 --2- 172.21.15.84:0/2364220228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807cf390 0x562380ba1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:48.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.923+0000 7f29aa59c640 1 --2- 172.21.15.84:0/2364220228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5623807c71b0 0x562380ba66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:48.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.923+0000 7f29aad9d640 1 -- 172.21.15.84:0/2364220228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5623807c71b0 msgr2=0x562380ba66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:48.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.923+0000 7f29aad9d640 1 --2- 172.21.15.84:0/2364220228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5623807c71b0 0x562380ba66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.923+0000 7f29aad9d640 1 -- 172.21.15.84:0/2364220228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807cf390 msgr2=0x562380ba1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:48.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.923+0000 7f29aad9d640 1 --2- 172.21.15.84:0/2364220228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807cf390 0x562380ba1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.923+0000 7f29aad9d640 1 -- 172.21.15.84:0/2364220228 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562380ba5d70 con 0x5623807f0070 2024-09-21T03:51:48.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.923+0000 7f29a9d9b640 1 --2- 172.21.15.84:0/2364220228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807cf390 0x562380ba1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:51:48.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.923+0000 7f29aad9d640 1 --2- 172.21.15.84:0/2364220228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807f0070 0x562380ba21e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f29a4010620 tx=0x7f29a400b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd74d81b8e64bca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:48.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.923+0000 7f2993fff640 1 -- 172.21.15.84:0/2364220228 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a401c040 con 0x5623807f0070 2024-09-21T03:51:48.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.923+0000 7f2993fff640 1 -- 172.21.15.84:0/2364220228 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29a4039070 con 0x5623807f0070 2024-09-21T03:51:48.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.923+0000 7f2993fff640 1 -- 172.21.15.84:0/2364220228 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a4021730 con 0x5623807f0070 2024-09-21T03:51:48.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.924+0000 7f29b6fc7740 1 -- 172.21.15.84:0/2364220228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807f0070 msgr2=0x562380ba21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:48.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.924+0000 7f29b6fc7740 1 --2- 172.21.15.84:0/2364220228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807f0070 0x562380ba21e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f29a4010620 tx=0x7f29a400b4d0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.924+0000 7f29b6fc7740 1 -- 172.21.15.84:0/2364220228 shutdown_connections 2024-09-21T03:51:48.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.924+0000 7f29b6fc7740 1 --2- 172.21.15.84:0/2364220228 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807f0070 0x562380ba21e0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.924+0000 7f29b6fc7740 1 --2- 172.21.15.84:0/2364220228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807cf390 0x562380ba1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.924+0000 7f29b6fc7740 1 --2- 172.21.15.84:0/2364220228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5623807c71b0 0x562380ba66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.924+0000 7f29b6fc7740 1 -- 172.21.15.84:0/2364220228 >> 172.21.15.84:0/2364220228 conn(0x5623807e4460 msgr2=0x562380ba5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:48.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.924+0000 7f29b6fc7740 1 -- 172.21.15.84:0/2364220228 shutdown_connections 2024-09-21T03:51:48.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.924+0000 7f29b6fc7740 1 -- 172.21.15.84:0/2364220228 wait complete. 2024-09-21T03:51:48.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.924+0000 7f29b6fc7740 1 -- start start 2024-09-21T03:51:48.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.925+0000 7f29b6fc7740 1 Processor -- start 2024-09-21T03:51:48.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.925+0000 7f29b6fc7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5623807c71b0 0x562380bad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:48.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.925+0000 7f29b6fc7740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807cf390 0x562380ba8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:48.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.925+0000 7f29b6fc7740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807f0070 0x562380ba8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:48.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.925+0000 7f29b6fc7740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac1aba10 con 0x5623807cf390 2024-09-21T03:51:48.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.925+0000 7f29b6fc7740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac1ace80 con 0x5623807f0070 2024-09-21T03:51:48.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.925+0000 7f29b6fc7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac1ac0e0 con 0x5623807c71b0 2024-09-21T03:51:48.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.925+0000 7f29b6fc7740 10 client.0 _ll_register_callbacks cb 0x7f29a400b720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:51:48.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.925+0000 7f29a9d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807cf390 0x562380ba8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:48.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.925+0000 7f29a9d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807cf390 0x562380ba8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:48386/0 (socket says 172.21.15.84:48386) 2024-09-21T03:51:48.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.925+0000 7f29a9d9b640 1 -- 172.21.15.84:0/3975290632 learned_addr learned my addr 172.21.15.84:0/3975290632 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:51:48.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.925+0000 7f29aad9d640 1 --2- 172.21.15.84:0/3975290632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807f0070 0x562380ba8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:48.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.925+0000 7f29aa59c640 1 --2- 172.21.15.84:0/3975290632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5623807c71b0 0x562380bad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:48.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.925+0000 7f29a9d9b640 1 -- 172.21.15.84:0/3975290632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5623807c71b0 msgr2=0x562380bad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:48.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.925+0000 7f29a9d9b640 1 --2- 172.21.15.84:0/3975290632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5623807c71b0 0x562380bad3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.925+0000 7f29a9d9b640 1 -- 172.21.15.84:0/3975290632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807f0070 msgr2=0x562380ba8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:51:48.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.925+0000 7f29a9d9b640 1 --2- 172.21.15.84:0/3975290632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807f0070 0x562380ba8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.925+0000 7f29a9d9b640 1 -- 172.21.15.84:0/3975290632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562380ba9390 con 0x5623807cf390 2024-09-21T03:51:48.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.925+0000 7f29aad9d640 1 --2- 172.21.15.84:0/3975290632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807f0070 0x562380ba8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:51:48.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.926+0000 7f29a9d9b640 1 --2- 172.21.15.84:0/3975290632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807cf390 0x562380ba8890 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f2994009900 tx=0x7f2994004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5a680a1561eedf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:51:48.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.926+0000 7f2991ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:51:48.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.926+0000 7f2991ffb640 1 -- 172.21.15.84:0/3975290632 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994052060 con 0x5623807cf390 2024-09-21T03:51:48.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.926+0000 7f2991ffb640 1 -- 172.21.15.84:0/3975290632 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8441+0+0 (secure 0 0 0) 0x7f29940316a0 con 0x5623807cf390 2024-09-21T03:51:48.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.926+0000 7f29b6fc7740 1 -- 172.21.15.84:0/3975290632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29a4039070 con 0x5623807cf390 2024-09-21T03:51:48.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.926+0000 7f2991ffb640 1 -- 172.21.15.84:0/3975290632 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2994035050 con 0x5623807cf390 2024-09-21T03:51:48.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.926+0000 7f29b6fc7740 10 client.17271 fetch_fsmap learned FSMap version 25 2024-09-21T03:51:48.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.926+0000 7f29b6fc7740 1 -- 172.21.15.84:0/3975290632 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562380c21450 con 0x5623807cf390 2024-09-21T03:51:48.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.926+0000 7f2991ffb640 1 -- 172.21.15.84:0/3975290632 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29a4039070 con 0x5623807cf390 2024-09-21T03:51:48.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.926+0000 7f2991ffb640 1 -- 172.21.15.84:0/3975290632 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f299404c070 con 0x5623807cf390 2024-09-21T03:51:48.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.926+0000 7f29b6fc7740 10 client.17271 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:51:48.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.926+0000 7f29b6fc7740 10 client.17271 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:51:48.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.926+0000 7f29b6fc7740 20 client.17271 populate_metadata read hostname 'smithi084' 2024-09-21T03:51:48.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.926+0000 7f29b6fc7740 1 --2- 172.21.15.84:0/3975290632 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x562380783da0 0x562380c23790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:51:48.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.926+0000 7f29b6fc7740 4 client.17271 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:51:48.933 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.926+0000 7f29b6fc7740 1 -- 172.21.15.84:0/3975290632 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562380b0b850 con 0x562380783da0 2024-09-21T03:51:48.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.927+0000 7f29aa59c640 1 --2- 172.21.15.84:0/3975290632 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x562380783da0 0x562380c23790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:51:48.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.927+0000 7f29aa59c640 1 --2- 172.21.15.84:0/3975290632 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x562380783da0 0x562380c23790 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97cf6c9806899333 server_cookie=f39fa9181fb1f4f8 in_seq=0 out_seq=0 2024-09-21T03:51:48.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.927+0000 7f2991ffb640 10 client.17271 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:48.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.928+0000 7f2991ffb640 1 -- 172.21.15.84:0/3975290632 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5114 (crc 0 0 0) 0x562380b0b850 con 0x562380783da0 2024-09-21T03:51:48.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.928+0000 7f2991ffb640 10 client.17271 handle_command_reply: tid=0 2024-09-21T03:51:48.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.928+0000 7f29b6fc7740 1 client.17271 shutdown 2024-09-21T03:51:48.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.928+0000 7f29b6fc7740 1 -- 172.21.15.84:0/3975290632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807cf390 msgr2=0x562380ba8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:48.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.928+0000 7f29b6fc7740 1 --2- 172.21.15.84:0/3975290632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807cf390 0x562380ba8890 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f2994009900 tx=0x7f2994004270 comp rx=0 tx=0).stop 2024-09-21T03:51:48.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.928+0000 7f29b6fc7740 1 -- 172.21.15.84:0/3975290632 shutdown_connections 2024-09-21T03:51:48.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.928+0000 7f29b6fc7740 1 --2- 172.21.15.84:0/3975290632 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x562380783da0 0x562380c23790 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.928+0000 7f29b6fc7740 1 --2- 172.21.15.84:0/3975290632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5623807f0070 0x562380ba8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.928+0000 7f29b6fc7740 1 --2- 172.21.15.84:0/3975290632 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5623807cf390 0x562380ba8890 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.928+0000 7f29b6fc7740 1 --2- 172.21.15.84:0/3975290632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5623807c71b0 0x562380bad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.934 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.928+0000 7f2991ffb640 0 client.17271 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:51:48.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.928+0000 7f29b6fc7740 1 -- 172.21.15.84:0/3975290632 >> 172.21.15.84:0/3975290632 conn(0x5623807e4460 msgr2=0x562380b980c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:48.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.928+0000 7f29b6fc7740 1 -- 172.21.15.84:0/3975290632 shutdown_connections 2024-09-21T03:51:48.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.928+0000 7f29b6fc7740 1 -- 172.21.15.84:0/3975290632 wait complete. 2024-09-21T03:51:48.935 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.928+0000 7f29b6fc7740 20 client.17271 trim_cache size 0 max 16384 2024-09-21T03:51:48.935 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:51:48.935 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:51:48.935 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T03:51:48.936 INFO:teuthology.orchestra.run.smithi084.stdout: "5435e7df-7d39-4687-a715-54c7af6bc3b1": { 2024-09-21T03:51:48.936 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:48.936 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "5435e7df-7d39-4687-a715-54c7af6bc3b1", 2024-09-21T03:51:48.936 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T03:51:48.936 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:51:48.936 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:48.936 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:51:48.936 INFO:teuthology.orchestra.run.smithi084.stdout: "d85cdf50-3fc8-467d-942f-2b77981ba106": { 2024-09-21T03:51:48.936 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:43.684286+0000", 2024-09-21T03:51:48.936 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:48.936 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:48.936 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:48.936 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:48.936 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:48.937 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:48.937 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:51:48.937 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:51:48.937 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:48.937 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:48.937 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:48.937 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:48.937 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:48.937 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:48.937 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:51:48.937 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:51:48.937 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:48.937 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:48.937 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:48.938 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:48.938 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:48.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:48.938 INFO:teuthology.orchestra.run.smithi084.stdout: "2cbf94ea-caa1-4c9b-8007-8a0887103a5c": { 2024-09-21T03:51:48.938 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:51:05.114755+0000", 2024-09-21T03:51:48.938 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:48.938 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:48.938 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:48.938 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:48.938 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:48.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:48.938 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:51:48.938 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:51:48.938 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:48.938 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:48.939 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:48.939 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:48.939 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:48.939 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:48.939 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:51:48.939 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:51:48.939 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:48.939 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:48.939 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:48.939 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:48.939 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:48.939 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:48.939 INFO:teuthology.orchestra.run.smithi084.stdout: "43a49cca-fc1c-4c36-a314-49033e7c3fb6": { 2024-09-21T03:51:48.939 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:49:17.366428+0000", 2024-09-21T03:51:48.940 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:48.940 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:48.940 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:48.940 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:48.940 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:48.940 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:48.940 INFO:teuthology.orchestra.run.smithi084.stdout: "0bb4e83d-6059-4d41-88f0-1562fa422c47": { 2024-09-21T03:51:48.940 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:54.511018+0000", 2024-09-21T03:51:48.940 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:48.940 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:48.940 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:48.940 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:48.940 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:48.940 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:48.940 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:51:48.941 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:51:48.941 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:48.941 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:48.941 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:48.941 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:48.941 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:48.941 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:48.941 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:51:48.941 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:51:48.941 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:48.941 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:48.941 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:48.941 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:48.941 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:48.942 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:48.942 INFO:teuthology.orchestra.run.smithi084.stdout: "5435e7df-7d39-4687-a715-54c7af6bc3b1": { 2024-09-21T03:51:48.942 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:51:47.429708+0000", 2024-09-21T03:51:48.942 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:48.942 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:48.942 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:48.942 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:48.942 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:48.942 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:48.942 INFO:teuthology.orchestra.run.smithi084.stdout: "27dcb84c-89fa-46b2-b980-58857966c697": { 2024-09-21T03:51:48.942 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:52.598527+0000", 2024-09-21T03:51:48.942 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:48.942 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:48.942 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:48.943 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:48.943 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:48.943 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:48.943 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:51:48.943 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:51:48.943 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:48.943 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:48.943 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:48.943 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:48.943 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:48.943 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:48.943 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:51:48.943 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:51:48.943 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:48.943 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:48.944 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:48.944 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:48.944 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:48.944 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:48.944 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:51:48.944 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:51:48.944 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:48.944 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:48.944 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:48.944 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:48.944 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:48.944 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:48.944 INFO:teuthology.orchestra.run.smithi084.stdout: "b2063a70-0b1f-4b6b-9c96-d886e156ea66": { 2024-09-21T03:51:48.944 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:48:34.864478+0000", 2024-09-21T03:51:48.945 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:48.945 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:48.945 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:48.945 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:48.945 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:48.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:51:48.945 INFO:teuthology.orchestra.run.smithi084.stdout: "33131451-f242-447a-b13f-9bdebc7884ec": { 2024-09-21T03:51:48.945 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:00.524357+0000", 2024-09-21T03:51:48.945 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:51:48.945 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:51:48.945 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:51:48.945 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:51:48.945 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:51:48.945 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:51:48.945 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:51:48.946 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:51:48.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.929+0000 7f29b0a53640 1 -- 172.21.15.84:0/1213398029 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29980b66b0 msgr2=0x7f29980b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:48.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.929+0000 7f29b0a53640 1 --2- 172.21.15.84:0/1213398029 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29980b66b0 0x7f29980b8bc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f29a400bad0 tx=0x7f29a4008040 comp rx=0 tx=0).stop 2024-09-21T03:51:48.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.929+0000 7f29b0a53640 1 -- 172.21.15.84:0/1213398029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac102a80 msgr2=0x7f29ac199570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:51:48.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.929+0000 7f29b0a53640 1 --2- 172.21.15.84:0/1213398029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac102a80 0x7f29ac199570 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f299c00cce0 tx=0x7f299c00a620 comp rx=0 tx=0).stop 2024-09-21T03:51:48.946 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.929+0000 7f29b0a53640 1 -- 172.21.15.84:0/1213398029 shutdown_connections 2024-09-21T03:51:48.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.929+0000 7f29b0a53640 1 --2- 172.21.15.84:0/1213398029 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f29980b66b0 0x7f29980b8bc0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.929+0000 7f29b0a53640 1 --2- 172.21.15.84:0/1213398029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29ac108d10 0x7f29ac19edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.929+0000 7f29b0a53640 1 --2- 172.21.15.84:0/1213398029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f29ac1083c0 0x7f29ac199b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.929+0000 7f29b0a53640 1 --2- 172.21.15.84:0/1213398029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f29ac102a80 0x7f29ac199570 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:51:48.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.929+0000 7f29b0a53640 1 -- 172.21.15.84:0/1213398029 >> 172.21.15.84:0/1213398029 conn(0x7f29ac079740 msgr2=0x7f29ac1053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:51:48.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.929+0000 7f29b0a53640 1 -- 172.21.15.84:0/1213398029 shutdown_connections 2024-09-21T03:51:48.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:51:48.929+0000 7f29b0a53640 1 -- 172.21.15.84:0/1213398029 wait complete. 2024-09-21T03:51:49.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:48 smithi084 ceph-mon[30941]: pgmap v610: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 69 KiB/s wr, 15 op/s 2024-09-21T03:51:49.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:48 smithi174 ceph-mon[34403]: pgmap v610: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 69 KiB/s wr, 15 op/s 2024-09-21T03:51:49.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:48 smithi172 ceph-mon[34821]: pgmap v610: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 69 KiB/s wr, 15 op/s 2024-09-21T03:51:49.754 INFO:tasks.cephfs.filesystem:scrub status for tag:5435e7df-7d39-4687-a715-54c7af6bc3b1 - {'path': '/', 'tag': '5435e7df-7d39-4687-a715-54c7af6bc3b1', 'options': 'recursive,force'} 2024-09-21T03:51:50.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:49 smithi084 ceph-mon[30941]: scrub summary: idle 2024-09-21T03:51:50.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:49 smithi174 ceph-mon[34403]: scrub summary: idle 2024-09-21T03:51:50.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:49 smithi172 ceph-mon[34821]: scrub summary: idle 2024-09-21T03:51:51.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:50 smithi084 ceph-mon[30941]: pgmap v611: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 10 op/s 2024-09-21T03:51:51.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:50 smithi174 ceph-mon[34403]: pgmap v611: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 10 op/s 2024-09-21T03:51:51.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:50 smithi172 ceph-mon[34821]: pgmap v611: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 10 op/s 2024-09-21T03:51:52.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:52 smithi084 ceph-mon[30941]: pgmap v612: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-21T03:51:52.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:52 smithi174 ceph-mon[34403]: pgmap v612: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-21T03:51:52.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:52 smithi172 ceph-mon[34821]: pgmap v612: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-21T03:51:54.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:54 smithi084 ceph-mon[30941]: pgmap v613: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 67 KiB/s wr, 13 op/s 2024-09-21T03:51:54.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:54 smithi174 ceph-mon[34403]: pgmap v613: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 67 KiB/s wr, 13 op/s 2024-09-21T03:51:54.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:54 smithi172 ceph-mon[34821]: pgmap v613: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 67 KiB/s wr, 13 op/s 2024-09-21T03:51:56.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:56 smithi084 ceph-mon[30941]: pgmap v614: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 10 op/s 2024-09-21T03:51:56.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:56 smithi174 ceph-mon[34403]: pgmap v614: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 10 op/s 2024-09-21T03:51:56.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:56 smithi172 ceph-mon[34821]: pgmap v614: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 10 op/s 2024-09-21T03:51:57.622 INFO:tasks.workunit.client.0.smithi084.stdout:437/600: open fd = 3 2024-09-21T03:51:57.622 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.622 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.622 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.622 INFO:tasks.workunit.client.0.smithi084.stdout:438/600: open fd = 3 2024-09-21T03:51:57.622 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.622 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.622 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.622 INFO:tasks.workunit.client.0.smithi084.stdout:439/600: open fd = 3 2024-09-21T03:51:57.623 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.623 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.623 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.623 INFO:tasks.workunit.client.0.smithi084.stdout:440/600: open fd = 3 2024-09-21T03:51:57.623 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.623 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.623 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.623 INFO:tasks.workunit.client.0.smithi084.stdout:441/600: open fd = 3 2024-09-21T03:51:57.623 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.623 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.623 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.623 INFO:tasks.workunit.client.0.smithi084.stdout:442/600: open fd = 3 2024-09-21T03:51:57.623 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.623 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.624 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.624 INFO:tasks.workunit.client.0.smithi084.stdout:443/600: open fd = 3 2024-09-21T03:51:57.624 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.624 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.624 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.624 INFO:tasks.workunit.client.0.smithi084.stdout:444/600: open fd = 3 2024-09-21T03:51:57.624 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.624 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.624 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.624 INFO:tasks.workunit.client.0.smithi084.stdout:445/600: open fd = 3 2024-09-21T03:51:57.624 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.624 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.624 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.624 INFO:tasks.workunit.client.0.smithi084.stdout:446/600: open fd = 3 2024-09-21T03:51:57.624 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.625 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.625 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.625 INFO:tasks.workunit.client.0.smithi084.stdout:447/600: open fd = 3 2024-09-21T03:51:57.625 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.625 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.625 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.625 INFO:tasks.workunit.client.0.smithi084.stdout:448/600: open fd = 3 2024-09-21T03:51:57.625 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.625 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.625 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.625 INFO:tasks.workunit.client.0.smithi084.stdout:449/600: open fd = 3 2024-09-21T03:51:57.625 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.625 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.625 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.625 INFO:tasks.workunit.client.0.smithi084.stdout:450/600: open fd = 3 2024-09-21T03:51:57.626 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.626 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.626 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.626 INFO:tasks.workunit.client.0.smithi084.stdout:451/600: open fd = 3 2024-09-21T03:51:57.626 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.626 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.626 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.626 INFO:tasks.workunit.client.0.smithi084.stdout:452/600: open fd = 3 2024-09-21T03:51:57.626 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.626 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.626 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.626 INFO:tasks.workunit.client.0.smithi084.stdout:453/600: open fd = 3 2024-09-21T03:51:57.626 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.626 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.627 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.627 INFO:tasks.workunit.client.0.smithi084.stdout:454/600: open fd = 3 2024-09-21T03:51:57.627 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.627 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.627 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.627 INFO:tasks.workunit.client.0.smithi084.stdout:455/600: open fd = 3 2024-09-21T03:51:57.627 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.627 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.627 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.627 INFO:tasks.workunit.client.0.smithi084.stdout:456/600: open fd = 3 2024-09-21T03:51:57.627 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.627 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.627 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.627 INFO:tasks.workunit.client.0.smithi084.stdout:457/600: open fd = 3 2024-09-21T03:51:57.627 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.628 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.628 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.628 INFO:tasks.workunit.client.0.smithi084.stdout:458/600: open fd = 3 2024-09-21T03:51:57.628 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.628 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.628 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.628 INFO:tasks.workunit.client.0.smithi084.stdout:459/600: open fd = 3 2024-09-21T03:51:57.628 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.628 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.628 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.628 INFO:tasks.workunit.client.0.smithi084.stdout:460/600: open fd = 3 2024-09-21T03:51:57.628 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.628 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.628 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.628 INFO:tasks.workunit.client.0.smithi084.stdout:461/600: open fd = 3 2024-09-21T03:51:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:462/600: open fd = 3 2024-09-21T03:51:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:463/600: open fd = 3 2024-09-21T03:51:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:464/600: open fd = 3 2024-09-21T03:51:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.629 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.630 INFO:tasks.workunit.client.0.smithi084.stdout:465/600: open fd = 3 2024-09-21T03:51:57.630 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.630 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.630 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.630 INFO:tasks.workunit.client.0.smithi084.stdout:466/600: open fd = 3 2024-09-21T03:51:57.630 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.630 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.630 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.630 INFO:tasks.workunit.client.0.smithi084.stdout:467/600: open fd = 3 2024-09-21T03:51:57.630 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.630 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.630 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.630 INFO:tasks.workunit.client.0.smithi084.stdout:468/600: open fd = 3 2024-09-21T03:51:57.630 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.631 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.631 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.631 INFO:tasks.workunit.client.0.smithi084.stdout:469/600: open fd = 3 2024-09-21T03:51:57.631 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.631 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.631 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.631 INFO:tasks.workunit.client.0.smithi084.stdout:470/600: open fd = 3 2024-09-21T03:51:57.631 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.631 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.631 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.631 INFO:tasks.workunit.client.0.smithi084.stdout:471/600: open fd = 3 2024-09-21T03:51:57.631 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.631 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.631 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.631 INFO:tasks.workunit.client.0.smithi084.stdout:472/600: open fd = 3 2024-09-21T03:51:57.632 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.632 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.632 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.632 INFO:tasks.workunit.client.0.smithi084.stdout:473/600: open fd = 3 2024-09-21T03:51:57.632 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.632 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.632 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.632 INFO:tasks.workunit.client.0.smithi084.stdout:474/600: open fd = 3 2024-09-21T03:51:57.632 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.632 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.632 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.632 INFO:tasks.workunit.client.0.smithi084.stdout:475/600: open fd = 3 2024-09-21T03:51:57.632 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.632 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.632 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.633 INFO:tasks.workunit.client.0.smithi084.stdout:476/600: open fd = 3 2024-09-21T03:51:57.633 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.633 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.633 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.633 INFO:tasks.workunit.client.0.smithi084.stdout:477/600: open fd = 3 2024-09-21T03:51:57.633 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.633 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.633 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.633 INFO:tasks.workunit.client.0.smithi084.stdout:478/600: open fd = 3 2024-09-21T03:51:57.633 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.633 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.633 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.633 INFO:tasks.workunit.client.0.smithi084.stdout:479/600: open fd = 3 2024-09-21T03:51:57.633 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.634 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.634 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.634 INFO:tasks.workunit.client.0.smithi084.stdout:480/600: open fd = 3 2024-09-21T03:51:57.634 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.634 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.634 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.634 INFO:tasks.workunit.client.0.smithi084.stdout:481/600: open fd = 3 2024-09-21T03:51:57.634 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.634 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.634 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.634 INFO:tasks.workunit.client.0.smithi084.stdout:482/600: open fd = 3 2024-09-21T03:51:57.634 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.634 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.634 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.634 INFO:tasks.workunit.client.0.smithi084.stdout:483/600: open fd = 3 2024-09-21T03:51:57.635 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.635 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.635 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.635 INFO:tasks.workunit.client.0.smithi084.stdout:484/600: open fd = 3 2024-09-21T03:51:57.635 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.635 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.635 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.635 INFO:tasks.workunit.client.0.smithi084.stdout:485/600: open fd = 3 2024-09-21T03:51:57.635 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.635 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.635 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.635 INFO:tasks.workunit.client.0.smithi084.stdout:486/600: open fd = 3 2024-09-21T03:51:57.635 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.635 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.635 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.636 INFO:tasks.workunit.client.0.smithi084.stdout:487/600: open fd = 3 2024-09-21T03:51:57.636 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.636 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.636 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.636 INFO:tasks.workunit.client.0.smithi084.stdout:488/600: open fd = 3 2024-09-21T03:51:57.636 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.636 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.636 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.636 INFO:tasks.workunit.client.0.smithi084.stdout:489/600: open fd = 3 2024-09-21T03:51:57.636 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.636 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.636 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.636 INFO:tasks.workunit.client.0.smithi084.stdout:490/600: open fd = 3 2024-09-21T03:51:57.636 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.636 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.637 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.637 INFO:tasks.workunit.client.0.smithi084.stdout:491/600: open fd = 3 2024-09-21T03:51:57.637 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.637 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.637 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.637 INFO:tasks.workunit.client.0.smithi084.stdout:492/600: open fd = 3 2024-09-21T03:51:57.637 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.637 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.637 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.637 INFO:tasks.workunit.client.0.smithi084.stdout:493/600: open fd = 3 2024-09-21T03:51:57.637 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.637 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.637 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.637 INFO:tasks.workunit.client.0.smithi084.stdout:494/600: open fd = 3 2024-09-21T03:51:57.637 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.638 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.638 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.638 INFO:tasks.workunit.client.0.smithi084.stdout:495/600: open fd = 3 2024-09-21T03:51:57.638 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.638 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.638 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.638 INFO:tasks.workunit.client.0.smithi084.stdout:496/600: open fd = 3 2024-09-21T03:51:57.638 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.638 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.638 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.638 INFO:tasks.workunit.client.0.smithi084.stdout:497/600: open fd = 3 2024-09-21T03:51:57.638 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.638 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.638 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:57.639 INFO:tasks.workunit.client.0.smithi084.stdout:498/600: open fd = 3 2024-09-21T03:51:57.639 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.639 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:51:57.639 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:51:58.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:51:58 smithi084 ceph-mon[30941]: pgmap v615: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 69 KiB/s wr, 14 op/s 2024-09-21T03:51:58.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:51:58 smithi174 ceph-mon[34403]: pgmap v615: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 69 KiB/s wr, 14 op/s 2024-09-21T03:51:58.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:51:58 smithi172 ceph-mon[34821]: pgmap v615: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 69 KiB/s wr, 14 op/s 2024-09-21T03:52:01.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:01 smithi174 ceph-mon[34403]: pgmap v616: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 45 KiB/s wr, 9 op/s 2024-09-21T03:52:01.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:01 smithi172 ceph-mon[34821]: pgmap v616: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 45 KiB/s wr, 9 op/s 2024-09-21T03:52:01.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:01 smithi084 ceph-mon[30941]: pgmap v616: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 45 KiB/s wr, 9 op/s 2024-09-21T03:52:02.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:02 smithi084 ceph-mon[30941]: pgmap v617: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 67 KiB/s wr, 13 op/s 2024-09-21T03:52:02.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:02 smithi174 ceph-mon[34403]: pgmap v617: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 67 KiB/s wr, 13 op/s 2024-09-21T03:52:02.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:02 smithi172 ceph-mon[34821]: pgmap v617: 97 pgs: 97 active+clean; 18 MiB data, 452 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 67 KiB/s wr, 13 op/s 2024-09-21T03:52:04.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:04 smithi084 ceph-mon[30941]: pgmap v618: 97 pgs: 97 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 112 KiB/s wr, 29 op/s 2024-09-21T03:52:04.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:04 smithi174 ceph-mon[34403]: pgmap v618: 97 pgs: 97 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 112 KiB/s wr, 29 op/s 2024-09-21T03:52:04.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:04 smithi172 ceph-mon[34821]: pgmap v618: 97 pgs: 97 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 112 KiB/s wr, 29 op/s 2024-09-21T03:52:06.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:06 smithi084 ceph-mon[30941]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T03:52:06.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:06 smithi084 ceph-mon[30941]: pgmap v620: 97 pgs: 97 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 109 KiB/s wr, 31 op/s 2024-09-21T03:52:06.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:06 smithi174 ceph-mon[34403]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T03:52:06.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:06 smithi174 ceph-mon[34403]: pgmap v620: 97 pgs: 97 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 109 KiB/s wr, 31 op/s 2024-09-21T03:52:06.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:06 smithi172 ceph-mon[34821]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T03:52:06.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:06 smithi172 ceph-mon[34821]: pgmap v620: 97 pgs: 97 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 109 KiB/s wr, 31 op/s 2024-09-21T03:52:08.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:08 smithi084 ceph-mon[30941]: pgmap v621: 97 pgs: 97 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 109 KiB/s wr, 31 op/s 2024-09-21T03:52:08.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:08 smithi174 ceph-mon[34403]: pgmap v621: 97 pgs: 97 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 109 KiB/s wr, 31 op/s 2024-09-21T03:52:08.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:08 smithi172 ceph-mon[34821]: pgmap v621: 97 pgs: 97 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 109 KiB/s wr, 31 op/s 2024-09-21T03:52:10.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:10 smithi084 ceph-mon[30941]: pgmap v622: 97 pgs: 97 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 109 KiB/s wr, 31 op/s 2024-09-21T03:52:10.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:10 smithi174 ceph-mon[34403]: pgmap v622: 97 pgs: 97 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 109 KiB/s wr, 31 op/s 2024-09-21T03:52:10.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:10 smithi172 ceph-mon[34821]: pgmap v622: 97 pgs: 97 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 109 KiB/s wr, 31 op/s 2024-09-21T03:52:12.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:12 smithi084 ceph-mon[30941]: pgmap v623: 97 pgs: 97 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 82 KiB/s wr, 28 op/s 2024-09-21T03:52:12.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:12 smithi174 ceph-mon[34403]: pgmap v623: 97 pgs: 97 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 82 KiB/s wr, 28 op/s 2024-09-21T03:52:12.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:12 smithi172 ceph-mon[34821]: pgmap v623: 97 pgs: 97 active+clean; 19 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 82 KiB/s wr, 28 op/s 2024-09-21T03:52:14.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:14 smithi084 ceph-mon[30941]: pgmap v624: 97 pgs: 97 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-21T03:52:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:14 smithi174 ceph-mon[34403]: pgmap v624: 97 pgs: 97 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-21T03:52:14.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:14 smithi172 ceph-mon[34821]: pgmap v624: 97 pgs: 97 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-21T03:52:16.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:16 smithi174 ceph-mon[34403]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T03:52:16.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:16 smithi172 ceph-mon[34821]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T03:52:16.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:16 smithi084 ceph-mon[30941]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T03:52:17.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:17 smithi174 ceph-mon[34403]: pgmap v626: 97 pgs: 97 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-21T03:52:17.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:17 smithi172 ceph-mon[34821]: pgmap v626: 97 pgs: 97 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-21T03:52:17.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:17 smithi084 ceph-mon[30941]: pgmap v626: 97 pgs: 97 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 11 op/s 2024-09-21T03:52:18.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:18 smithi084 ceph-mon[30941]: pgmap v627: 97 pgs: 97 active+clean; 20 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-09-21T03:52:18.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:18 smithi174 ceph-mon[34403]: pgmap v627: 97 pgs: 97 active+clean; 20 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-09-21T03:52:18.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:18 smithi172 ceph-mon[34821]: pgmap v627: 97 pgs: 97 active+clean; 20 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-09-21T03:52:19.755 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:52:20.015 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.544+0000 7f326dca6640 1 -- 172.21.15.84:0/1442110217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3268108d70 msgr2=0x7f326810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.544+0000 7f326dca6640 1 --2- 172.21.15.84:0/1442110217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3268108d70 0x7f326810f5a0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f3260009ca0 tx=0x7f326002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.544+0000 7f326dca6640 1 -- 172.21.15.84:0/1442110217 shutdown_connections 2024-09-21T03:52:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.544+0000 7f326dca6640 1 --2- 172.21.15.84:0/1442110217 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3268108d70 0x7f326810f5a0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.544+0000 7f326dca6640 1 --2- 172.21.15.84:0/1442110217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3268108420 0x7f3268108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.544+0000 7f326dca6640 1 --2- 172.21.15.84:0/1442110217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3268102ae0 0x7f3268102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.564 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.544+0000 7f326dca6640 1 -- 172.21.15.84:0/1442110217 >> 172.21.15.84:0/1442110217 conn(0x7f3268079770 msgr2=0x7f3268079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.544+0000 7f326dca6640 1 -- 172.21.15.84:0/1442110217 shutdown_connections 2024-09-21T03:52:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.544+0000 7f326dca6640 1 -- 172.21.15.84:0/1442110217 wait complete. 2024-09-21T03:52:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.544+0000 7f326dca6640 1 Processor -- start 2024-09-21T03:52:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.545+0000 7f326dca6640 1 -- start start 2024-09-21T03:52:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.545+0000 7f326dca6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3268102ae0 0x7f32681993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.545+0000 7f326dca6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3268108420 0x7f3268199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.545+0000 7f326dca6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3268108d70 0x7f326819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.545+0000 7f326dca6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3268112a30 con 0x7f3268108d70 2024-09-21T03:52:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.545+0000 7f326dca6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f32681128b0 con 0x7f3268102ae0 2024-09-21T03:52:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.545+0000 7f326dca6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3268112bb0 con 0x7f3268108420 2024-09-21T03:52:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.545+0000 7f3267fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3268108d70 0x7f326819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.545+0000 7f3267fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3268108d70 0x7f326819ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56328/0 (socket says 172.21.15.84:56328) 2024-09-21T03:52:20.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.545+0000 7f3267fff640 1 -- 172.21.15.84:0/1242447665 learned_addr learned my addr 172.21.15.84:0/1242447665 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.545+0000 7f32677fe640 1 --2- 172.21.15.84:0/1242447665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3268102ae0 0x7f32681993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.545+0000 7f3266ffd640 1 --2- 172.21.15.84:0/1242447665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3268108420 0x7f3268199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.545+0000 7f3267fff640 1 -- 172.21.15.84:0/1242447665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3268108420 msgr2=0x7f3268199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.545+0000 7f3267fff640 1 --2- 172.21.15.84:0/1242447665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3268108420 0x7f3268199940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.545+0000 7f3267fff640 1 -- 172.21.15.84:0/1242447665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3268102ae0 msgr2=0x7f32681993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.545+0000 7f3267fff640 1 --2- 172.21.15.84:0/1242447665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3268102ae0 0x7f32681993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.545+0000 7f3267fff640 1 -- 172.21.15.84:0/1242447665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f326819f250 con 0x7f3268108d70 2024-09-21T03:52:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.546+0000 7f3267fff640 1 --2- 172.21.15.84:0/1242447665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3268108d70 0x7f326819ebe0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f3260005cc0 tx=0x7f326002f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.546+0000 7f3264ff9640 1 -- 172.21.15.84:0/1242447665 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3260003cf0 con 0x7f3268108d70 2024-09-21T03:52:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.546+0000 7f326dca6640 1 -- 172.21.15.84:0/1242447665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f326819f4e0 con 0x7f3268108d70 2024-09-21T03:52:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.546+0000 7f326dca6640 1 -- 172.21.15.84:0/1242447665 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32681a5d60 con 0x7f3268108d70 2024-09-21T03:52:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.546+0000 7f3264ff9640 1 -- 172.21.15.84:0/1242447665 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32600044f0 con 0x7f3268108d70 2024-09-21T03:52:20.566 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.546+0000 7f3264ff9640 1 -- 172.21.15.84:0/1242447665 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326002fc70 con 0x7f3268108d70 2024-09-21T03:52:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.548+0000 7f3264ff9640 1 -- 172.21.15.84:0/1242447665 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f32600305c0 con 0x7f3268108d70 2024-09-21T03:52:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.549+0000 7f327421a740 1 Processor -- start 2024-09-21T03:52:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.549+0000 7f327421a740 1 -- start start 2024-09-21T03:52:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.549+0000 7f327421a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5618e5e15070 0x5618e61bc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.549+0000 7f327421a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 0x5618e61bc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.549+0000 7f327421a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5618e5df4390 0x5618e61bccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.549+0000 7f327421a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5618e6132e50 con 0x5618e5dec1b0 2024-09-21T03:52:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.549+0000 7f327421a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5618e6122280 con 0x5618e5e15070 2024-09-21T03:52:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.549+0000 7f327421a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5618e6126090 con 0x5618e5df4390 2024-09-21T03:52:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.549+0000 7f32677fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 0x5618e61bc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.549+0000 7f32677fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 0x5618e61bc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56332/0 (socket says 172.21.15.84:56332) 2024-09-21T03:52:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.549+0000 7f3264ff9640 1 --2- 172.21.15.84:0/1242447665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f32500b66b0 0x7f32500b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.549+0000 7f32677fe640 1 -- 172.21.15.84:0/165913917 learned_addr learned my addr 172.21.15.84:0/165913917 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:20.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.549+0000 7f3266ffd640 1 --2- 172.21.15.84:0/165913917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5618e5e15070 0x5618e61bc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.550+0000 7f3266ffd640 1 --2- 172.21.15.84:0/165913917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5618e5df4390 0x5618e61bccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.550+0000 7f3267fff640 1 --2- 172.21.15.84:0/1242447665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f32500b66b0 0x7f32500b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.550+0000 7f32677fe640 1 -- 172.21.15.84:0/165913917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5618e5df4390 msgr2=0x5618e61bccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.550+0000 7f32677fe640 1 --2- 172.21.15.84:0/165913917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5618e5df4390 0x5618e61bccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.550+0000 7f32677fe640 1 -- 172.21.15.84:0/165913917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5618e5e15070 msgr2=0x5618e61bc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.550+0000 7f32677fe640 1 --2- 172.21.15.84:0/165913917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5618e5e15070 0x5618e61bc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.550+0000 7f32677fe640 1 -- 172.21.15.84:0/165913917 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618e5e80650 con 0x5618e5dec1b0 2024-09-21T03:52:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.550+0000 7f3266ffd640 1 --2- 172.21.15.84:0/165913917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5618e5e15070 0x5618e61bc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:52:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.550+0000 7f3264ff9640 1 -- 172.21.15.84:0/1242447665 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f32600ca2e0 con 0x7f3268108d70 2024-09-21T03:52:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.550+0000 7f32677fe640 1 --2- 172.21.15.84:0/165913917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 0x5618e61bc7b0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f325800cc60 tx=0x7f325800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03f8698b44057ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.550+0000 7f3267fff640 1 --2- 172.21.15.84:0/1242447665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f32500b66b0 0x7f32500b8bc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3260045000 tx=0x7f326002a8c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.550+0000 7f324dffb640 1 -- 172.21.15.84:0/165913917 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3258014070 con 0x5618e5dec1b0 2024-09-21T03:52:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.550+0000 7f324dffb640 1 -- 172.21.15.84:0/165913917 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32580047a0 con 0x5618e5dec1b0 2024-09-21T03:52:20.568 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.550+0000 7f324dffb640 1 -- 172.21.15.84:0/165913917 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3258010690 con 0x5618e5dec1b0 2024-09-21T03:52:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.551+0000 7f327421a740 1 -- 172.21.15.84:0/165913917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 msgr2=0x5618e61bc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.551+0000 7f327421a740 1 --2- 172.21.15.84:0/165913917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 0x5618e61bc7b0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f325800cc60 tx=0x7f325800e720 comp rx=0 tx=0).stop 2024-09-21T03:52:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.551+0000 7f327421a740 1 -- 172.21.15.84:0/165913917 shutdown_connections 2024-09-21T03:52:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.551+0000 7f327421a740 1 --2- 172.21.15.84:0/165913917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5618e5df4390 0x5618e61bccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.551+0000 7f327421a740 1 --2- 172.21.15.84:0/165913917 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 0x5618e61bc7b0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.551+0000 7f327421a740 1 --2- 172.21.15.84:0/165913917 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5618e5e15070 0x5618e61bc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.551+0000 7f327421a740 1 -- 172.21.15.84:0/165913917 >> 172.21.15.84:0/165913917 conn(0x5618e5e09460 msgr2=0x5618e61ba160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.551+0000 7f327421a740 1 -- 172.21.15.84:0/165913917 shutdown_connections 2024-09-21T03:52:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.551+0000 7f327421a740 1 -- 172.21.15.84:0/165913917 wait complete. 2024-09-21T03:52:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.552+0000 7f327421a740 1 -- start start 2024-09-21T03:52:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.552+0000 7f327421a740 1 Processor -- start 2024-09-21T03:52:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.552+0000 7f327421a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5618e5dec1b0 0x5618e61c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:20.569 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.552+0000 7f327421a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5df4390 0x5618e61c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.552+0000 7f327421a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5618e5e15070 0x5618e61c8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.552+0000 7f327421a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5618e5f83700 con 0x5618e5df4390 2024-09-21T03:52:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.552+0000 7f327421a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5618e60bd110 con 0x5618e5dec1b0 2024-09-21T03:52:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.552+0000 7f327421a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5618e61cee60 con 0x5618e5e15070 2024-09-21T03:52:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.552+0000 7f327421a740 10 client.0 _ll_register_callbacks cb 0x5618e60d6990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.552+0000 7f32677fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5df4390 0x5618e61c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.552+0000 7f32677fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5df4390 0x5618e61c7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56342/0 (socket says 172.21.15.84:56342) 2024-09-21T03:52:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.553+0000 7f32677fe640 1 -- 172.21.15.84:0/333658364 learned_addr learned my addr 172.21.15.84:0/333658364 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.553+0000 7f3266ffd640 1 --2- 172.21.15.84:0/333658364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5618e5dec1b0 0x5618e61c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.553+0000 7f3266ffd640 1 --2- 172.21.15.84:0/333658364 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5618e5e15070 0x5618e61c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.553+0000 7f32677fe640 1 -- 172.21.15.84:0/333658364 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5618e5e15070 msgr2=0x5618e61c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.553+0000 7f32677fe640 1 --2- 172.21.15.84:0/333658364 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5618e5e15070 0x5618e61c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.553+0000 7f32677fe640 1 -- 172.21.15.84:0/333658364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5618e5dec1b0 msgr2=0x5618e61c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.553+0000 7f32677fe640 1 --2- 172.21.15.84:0/333658364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5618e5dec1b0 0x5618e61c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.570 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.553+0000 7f32677fe640 1 -- 172.21.15.84:0/333658364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618e60eac40 con 0x5618e5df4390 2024-09-21T03:52:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.553+0000 7f32677fe640 1 --2- 172.21.15.84:0/333658364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5df4390 0x5618e61c7e30 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f325800cc30 tx=0x7f325800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98d5663b613948d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.553+0000 7f3246ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.556+0000 7f3246ffd640 1 -- 172.21.15.84:0/333658364 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3258014070 con 0x5618e5df4390 2024-09-21T03:52:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.556+0000 7f327421a740 1 -- 172.21.15.84:0/333658364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32580047a0 con 0x5618e5df4390 2024-09-21T03:52:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.556+0000 7f3246ffd640 1 -- 172.21.15.84:0/333658364 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f3258005210 con 0x5618e5df4390 2024-09-21T03:52:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.556+0000 7f3246ffd640 1 -- 172.21.15.84:0/333658364 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3258004e10 con 0x5618e5df4390 2024-09-21T03:52:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.556+0000 7f327421a740 10 client.17283 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.556+0000 7f327421a740 1 -- 172.21.15.84:0/333658364 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5618e61dab70 con 0x5618e5df4390 2024-09-21T03:52:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.556+0000 7f3246ffd640 1 -- 172.21.15.84:0/333658364 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32580047a0 con 0x5618e5df4390 2024-09-21T03:52:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.556+0000 7f3246ffd640 1 -- 172.21.15.84:0/333658364 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3258022410 con 0x5618e5df4390 2024-09-21T03:52:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.556+0000 7f327421a740 10 client.17283 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.556+0000 7f327421a740 10 client.17283 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:52:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.556+0000 7f327421a740 20 client.17283 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.556+0000 7f327421a740 1 --2- 172.21.15.84:0/333658364 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5618e5dd39f0 0x5618e61ddf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:20.571 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.556+0000 7f327421a740 4 client.17283 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:52:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.556+0000 7f327421a740 1 -- 172.21.15.84:0/333658364 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618e6134da0 con 0x5618e5dd39f0 2024-09-21T03:52:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.557+0000 7f3266ffd640 1 --2- 172.21.15.84:0/333658364 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5618e5dd39f0 0x5618e61ddf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.557+0000 7f3246ffd640 10 client.17283 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.557+0000 7f3266ffd640 1 --2- 172.21.15.84:0/333658364 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5618e5dd39f0 0x5618e61ddf30 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12ed875a84ecc4ba server_cookie=b4220212f8e71874 in_seq=0 out_seq=0 2024-09-21T03:52:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.558+0000 7f3246ffd640 1 -- 172.21.15.84:0/333658364 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5618e6134da0 con 0x5618e5dd39f0 2024-09-21T03:52:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.558+0000 7f3246ffd640 10 client.17283 handle_command_reply: tid=0 2024-09-21T03:52:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.558+0000 7f327421a740 1 client.17283 shutdown 2024-09-21T03:52:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.558+0000 7f327421a740 1 -- 172.21.15.84:0/333658364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5df4390 msgr2=0x5618e61c7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.558+0000 7f327421a740 1 --2- 172.21.15.84:0/333658364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5df4390 0x5618e61c7e30 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f325800cc30 tx=0x7f325800c9a0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.558+0000 7f327421a740 1 -- 172.21.15.84:0/333658364 shutdown_connections 2024-09-21T03:52:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.558+0000 7f327421a740 1 --2- 172.21.15.84:0/333658364 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5618e5dd39f0 0x5618e61ddf30 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.558+0000 7f327421a740 1 --2- 172.21.15.84:0/333658364 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5618e5e15070 0x5618e61c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.558+0000 7f3246ffd640 0 client.17283 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.558+0000 7f327421a740 1 --2- 172.21.15.84:0/333658364 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5df4390 0x5618e61c7e30 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.558+0000 7f327421a740 1 --2- 172.21.15.84:0/333658364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5618e5dec1b0 0x5618e61c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.572 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.558+0000 7f327421a740 1 -- 172.21.15.84:0/333658364 >> 172.21.15.84:0/333658364 conn(0x5618e5e09460 msgr2=0x5618e61bf400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.559+0000 7f327421a740 1 -- 172.21.15.84:0/333658364 shutdown_connections 2024-09-21T03:52:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.559+0000 7f327421a740 1 -- 172.21.15.84:0/333658364 wait complete. 2024-09-21T03:52:20.573 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.559+0000 7f327421a740 20 client.17283 trim_cache size 0 max 16384 2024-09-21T03:52:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.576+0000 7f327421a740 1 Processor -- start 2024-09-21T03:52:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.576+0000 7f327421a740 1 -- start start 2024-09-21T03:52:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.576+0000 7f327421a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 0x5618e61bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.576+0000 7f327421a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5618e5df4390 0x5618e61c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.576+0000 7f327421a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5618e5e15070 0x5618e61d80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.576+0000 7f327421a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3254010f60 con 0x5618e5dec1b0 2024-09-21T03:52:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.576+0000 7f327421a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f325400e830 con 0x5618e5df4390 2024-09-21T03:52:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.576+0000 7f327421a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f325400c6a0 con 0x5618e5e15070 2024-09-21T03:52:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.576+0000 7f3266ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 0x5618e61bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.576+0000 7f3266ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 0x5618e61bdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56354/0 (socket says 172.21.15.84:56354) 2024-09-21T03:52:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.576+0000 7f3266ffd640 1 -- 172.21.15.84:0/165859739 learned_addr learned my addr 172.21.15.84:0/165859739 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.576+0000 7f3266ffd640 1 -- 172.21.15.84:0/165859739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5618e5e15070 msgr2=0x5618e61d80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:20.579 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.576+0000 7f3266ffd640 1 --2- 172.21.15.84:0/165859739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5618e5e15070 0x5618e61d80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.576+0000 7f3266ffd640 1 -- 172.21.15.84:0/165859739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5618e5df4390 msgr2=0x5618e61c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:20.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.576+0000 7f3266ffd640 1 --2- 172.21.15.84:0/165859739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5618e5df4390 0x5618e61c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.576+0000 7f3266ffd640 1 -- 172.21.15.84:0/165859739 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618e61c5df0 con 0x5618e5dec1b0 2024-09-21T03:52:20.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.577+0000 7f3266ffd640 1 --2- 172.21.15.84:0/165859739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 0x5618e61bdd70 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f326806b650 tx=0x7f325c00eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14aef4a901c58ab8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:20.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.577+0000 7f324d7fa640 1 -- 172.21.15.84:0/165859739 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c005020 con 0x5618e5dec1b0 2024-09-21T03:52:20.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.577+0000 7f324d7fa640 1 -- 172.21.15.84:0/165859739 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f325c0047a0 con 0x5618e5dec1b0 2024-09-21T03:52:20.580 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.577+0000 7f324d7fa640 1 -- 172.21.15.84:0/165859739 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c003850 con 0x5618e5dec1b0 2024-09-21T03:52:20.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.578+0000 7f327421a740 1 -- 172.21.15.84:0/165859739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 msgr2=0x5618e61bdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:20.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.578+0000 7f327421a740 1 --2- 172.21.15.84:0/165859739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 0x5618e61bdd70 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f326806b650 tx=0x7f325c00eb10 comp rx=0 tx=0).stop 2024-09-21T03:52:20.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.578+0000 7f327421a740 1 -- 172.21.15.84:0/165859739 shutdown_connections 2024-09-21T03:52:20.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.578+0000 7f327421a740 1 --2- 172.21.15.84:0/165859739 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5618e5e15070 0x5618e61d80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.578+0000 7f327421a740 1 --2- 172.21.15.84:0/165859739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5618e5df4390 0x5618e61c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.578+0000 7f327421a740 1 --2- 172.21.15.84:0/165859739 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 0x5618e61bdd70 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.578+0000 7f327421a740 1 -- 172.21.15.84:0/165859739 >> 172.21.15.84:0/165859739 conn(0x5618e5e09460 msgr2=0x5618e61c6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:20.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.578+0000 7f327421a740 1 -- 172.21.15.84:0/165859739 shutdown_connections 2024-09-21T03:52:20.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.578+0000 7f327421a740 1 -- 172.21.15.84:0/165859739 wait complete. 2024-09-21T03:52:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.578+0000 7f327421a740 1 -- start start 2024-09-21T03:52:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.578+0000 7f327421a740 1 Processor -- start 2024-09-21T03:52:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.579+0000 7f327421a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 0x5618e61d4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.579+0000 7f327421a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5618e5df4390 0x5618e61cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.579+0000 7f327421a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5618e5e15070 0x5618e61d0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.579+0000 7f327421a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f325400ccf0 con 0x5618e5dec1b0 2024-09-21T03:52:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.579+0000 7f327421a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f325400e160 con 0x5618e5e15070 2024-09-21T03:52:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.579+0000 7f327421a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f325400d3c0 con 0x5618e5df4390 2024-09-21T03:52:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.579+0000 7f327421a740 10 client.0 _ll_register_callbacks cb 0x7f325c00e9b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.579+0000 7f3266ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 0x5618e61d4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.579+0000 7f3266ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 0x5618e61d4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56358/0 (socket says 172.21.15.84:56358) 2024-09-21T03:52:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.579+0000 7f3266ffd640 1 -- 172.21.15.84:0/1510561334 learned_addr learned my addr 172.21.15.84:0/1510561334 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.579+0000 7f32677fe640 1 --2- 172.21.15.84:0/1510561334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5618e5df4390 0x5618e61cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.579+0000 7f3266ffd640 1 --2- 172.21.15.84:0/1510561334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5618e5e15070 0x5618e61d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:20.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.579+0000 7f3266ffd640 1 -- 172.21.15.84:0/1510561334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5618e5df4390 msgr2=0x5618e61cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:20.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.579+0000 7f3266ffd640 1 --2- 172.21.15.84:0/1510561334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5618e5df4390 0x5618e61cff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.579+0000 7f3266ffd640 1 -- 172.21.15.84:0/1510561334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5618e5e15070 msgr2=0x5618e61d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:20.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.579+0000 7f3266ffd640 1 --2- 172.21.15.84:0/1510561334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5618e5e15070 0x5618e61d0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.579+0000 7f3266ffd640 1 -- 172.21.15.84:0/1510561334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618e61d0d20 con 0x5618e5dec1b0 2024-09-21T03:52:20.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.579+0000 7f3266ffd640 1 --2- 172.21.15.84:0/1510561334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 0x5618e61d4a40 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f325c0041d0 tx=0x7f325c004160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dac4ad6de1eb56 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:20.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.579+0000 7f3246ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:20.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.579+0000 7f3246ffd640 1 -- 172.21.15.84:0/1510561334 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325c039060 con 0x5618e5dec1b0 2024-09-21T03:52:20.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.580+0000 7f3246ffd640 1 -- 172.21.15.84:0/1510561334 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f325c005410 con 0x5618e5dec1b0 2024-09-21T03:52:20.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.580+0000 7f327421a740 1 -- 172.21.15.84:0/1510561334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f325c0047a0 con 0x5618e5dec1b0 2024-09-21T03:52:20.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.580+0000 7f3246ffd640 1 -- 172.21.15.84:0/1510561334 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f325c02b030 con 0x5618e5dec1b0 2024-09-21T03:52:20.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.580+0000 7f327421a740 10 client.17289 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:20.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.580+0000 7f327421a740 1 -- 172.21.15.84:0/1510561334 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5618e62487c0 con 0x5618e5dec1b0 2024-09-21T03:52:20.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.580+0000 7f3246ffd640 1 -- 172.21.15.84:0/1510561334 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f325c0047a0 con 0x5618e5dec1b0 2024-09-21T03:52:20.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.580+0000 7f3246ffd640 1 -- 172.21.15.84:0/1510561334 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f325c011440 con 0x5618e5dec1b0 2024-09-21T03:52:20.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.580+0000 7f327421a740 10 client.17289 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:20.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.580+0000 7f327421a740 10 client.17289 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:52:20.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.580+0000 7f327421a740 20 client.17289 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:20.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.580+0000 7f327421a740 1 --2- 172.21.15.84:0/1510561334 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5618e5da8da0 0x5618e624af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:20.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.580+0000 7f327421a740 4 client.17289 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:52:20.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.580+0000 7f327421a740 1 -- 172.21.15.84:0/1510561334 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5618e6130850 con 0x5618e5da8da0 2024-09-21T03:52:20.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.581+0000 7f32677fe640 1 --2- 172.21.15.84:0/1510561334 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5618e5da8da0 0x5618e624af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:20.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.581+0000 7f32677fe640 1 --2- 172.21.15.84:0/1510561334 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5618e5da8da0 0x5618e624af00 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7e2ab102511ae15 server_cookie=70c836ec0dfc6026 in_seq=0 out_seq=0 2024-09-21T03:52:20.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.581+0000 7f3246ffd640 10 client.17289 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:20.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.581+0000 7f3246ffd640 1 -- 172.21.15.84:0/1510561334 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4918 (crc 0 0 0) 0x5618e6130850 con 0x5618e5da8da0 2024-09-21T03:52:20.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.581+0000 7f3246ffd640 10 client.17289 handle_command_reply: tid=0 2024-09-21T03:52:20.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.581+0000 7f327421a740 1 client.17289 shutdown 2024-09-21T03:52:20.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.581+0000 7f327421a740 1 -- 172.21.15.84:0/1510561334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 msgr2=0x5618e61d4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:20.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.581+0000 7f327421a740 1 --2- 172.21.15.84:0/1510561334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 0x5618e61d4a40 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f325c0041d0 tx=0x7f325c004160 comp rx=0 tx=0).stop 2024-09-21T03:52:20.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.581+0000 7f327421a740 1 -- 172.21.15.84:0/1510561334 shutdown_connections 2024-09-21T03:52:20.587 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.581+0000 7f327421a740 1 --2- 172.21.15.84:0/1510561334 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5618e5da8da0 0x5618e624af00 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.582+0000 7f327421a740 1 --2- 172.21.15.84:0/1510561334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5618e5e15070 0x5618e61d0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.582+0000 7f327421a740 1 --2- 172.21.15.84:0/1510561334 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5618e5df4390 0x5618e61cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.582+0000 7f3246ffd640 0 client.17289 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:20.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.582+0000 7f327421a740 1 --2- 172.21.15.84:0/1510561334 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5618e5dec1b0 0x5618e61d4a40 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.582+0000 7f327421a740 1 -- 172.21.15.84:0/1510561334 >> 172.21.15.84:0/1510561334 conn(0x5618e5e09460 msgr2=0x5618e61c9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:20.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.582+0000 7f327421a740 1 -- 172.21.15.84:0/1510561334 shutdown_connections 2024-09-21T03:52:20.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.582+0000 7f327421a740 1 -- 172.21.15.84:0/1510561334 wait complete. 2024-09-21T03:52:20.588 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.582+0000 7f327421a740 20 client.17289 trim_cache size 0 max 16384 2024-09-21T03:52:20.588 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:52:20.588 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T03:52:20.588 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T03:52:20.589 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:52:20.589 INFO:teuthology.orchestra.run.smithi084.stdout: "d85cdf50-3fc8-467d-942f-2b77981ba106": { 2024-09-21T03:52:20.589 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:43.684286+0000", 2024-09-21T03:52:20.589 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:20.589 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:20.589 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:20.589 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:20.589 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:20.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:20.589 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:52:20.589 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:52:20.589 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:20.589 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:20.589 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:20.589 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:20.590 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:20.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:20.590 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:52:20.590 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:52:20.590 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:20.590 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:20.590 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:20.590 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:20.590 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:20.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:20.590 INFO:teuthology.orchestra.run.smithi084.stdout: "2cbf94ea-caa1-4c9b-8007-8a0887103a5c": { 2024-09-21T03:52:20.590 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:51:05.114755+0000", 2024-09-21T03:52:20.590 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:20.590 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:20.590 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:20.591 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:20.591 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:20.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:20.591 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:52:20.591 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:52:20.591 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:20.591 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:20.591 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:20.591 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:20.591 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:20.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:20.591 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:52:20.591 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:52:20.591 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:20.591 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:20.592 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:20.592 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:20.592 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:20.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:20.592 INFO:teuthology.orchestra.run.smithi084.stdout: "43a49cca-fc1c-4c36-a314-49033e7c3fb6": { 2024-09-21T03:52:20.592 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:49:17.366428+0000", 2024-09-21T03:52:20.592 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:20.592 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:20.592 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:20.592 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:20.592 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:20.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:20.592 INFO:teuthology.orchestra.run.smithi084.stdout: "0bb4e83d-6059-4d41-88f0-1562fa422c47": { 2024-09-21T03:52:20.592 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:54.511018+0000", 2024-09-21T03:52:20.592 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:20.592 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:20.593 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:20.593 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:20.593 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:20.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:20.593 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:52:20.593 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:52:20.593 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:20.593 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:20.593 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:20.593 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:20.593 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:20.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:20.593 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:52:20.593 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:52:20.593 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:20.593 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:20.594 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:20.594 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:20.594 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:20.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:20.594 INFO:teuthology.orchestra.run.smithi084.stdout: "5435e7df-7d39-4687-a715-54c7af6bc3b1": { 2024-09-21T03:52:20.594 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:51:47.429708+0000", 2024-09-21T03:52:20.594 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:20.594 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:20.594 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:20.594 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:20.594 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:20.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:20.594 INFO:teuthology.orchestra.run.smithi084.stdout: "27dcb84c-89fa-46b2-b980-58857966c697": { 2024-09-21T03:52:20.594 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:52.598527+0000", 2024-09-21T03:52:20.595 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:20.595 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:20.595 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:20.595 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:20.595 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:20.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:20.595 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:52:20.595 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:52:20.595 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:20.595 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:20.595 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:20.595 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:20.595 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:20.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:20.596 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:52:20.596 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:52:20.596 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:20.596 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:20.596 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:20.596 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:20.596 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:20.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:20.596 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:52:20.596 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:52:20.596 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:20.596 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:20.596 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:20.596 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:20.596 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:20.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:20.597 INFO:teuthology.orchestra.run.smithi084.stdout: "b2063a70-0b1f-4b6b-9c96-d886e156ea66": { 2024-09-21T03:52:20.597 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:48:34.864478+0000", 2024-09-21T03:52:20.597 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:20.597 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:20.597 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:20.597 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:20.597 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:20.597 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:20.597 INFO:teuthology.orchestra.run.smithi084.stdout: "33131451-f242-447a-b13f-9bdebc7884ec": { 2024-09-21T03:52:20.597 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:00.524357+0000", 2024-09-21T03:52:20.597 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:20.597 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:20.597 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:20.597 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:20.597 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:20.597 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:52:20.598 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:52:20.598 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:52:20.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.582+0000 7f326dca6640 1 -- 172.21.15.84:0/1242447665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f32500b66b0 msgr2=0x7f32500b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:20.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.582+0000 7f326dca6640 1 --2- 172.21.15.84:0/1242447665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f32500b66b0 0x7f32500b8bc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3260045000 tx=0x7f326002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.582+0000 7f326dca6640 1 -- 172.21.15.84:0/1242447665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3268108d70 msgr2=0x7f326819ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:20.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.582+0000 7f326dca6640 1 --2- 172.21.15.84:0/1242447665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3268108d70 0x7f326819ebe0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f3260005cc0 tx=0x7f326002f470 comp rx=0 tx=0).stop 2024-09-21T03:52:20.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.582+0000 7f326dca6640 1 -- 172.21.15.84:0/1242447665 shutdown_connections 2024-09-21T03:52:20.598 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.582+0000 7f326dca6640 1 --2- 172.21.15.84:0/1242447665 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f32500b66b0 0x7f32500b8bc0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.582+0000 7f326dca6640 1 --2- 172.21.15.84:0/1242447665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3268108d70 0x7f326819ebe0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.582+0000 7f326dca6640 1 --2- 172.21.15.84:0/1242447665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3268108420 0x7f3268199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.582+0000 7f326dca6640 1 --2- 172.21.15.84:0/1242447665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3268102ae0 0x7f32681993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:20.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.582+0000 7f326dca6640 1 -- 172.21.15.84:0/1242447665 >> 172.21.15.84:0/1242447665 conn(0x7f3268079770 msgr2=0x7f3268106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:20.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.583+0000 7f326dca6640 1 -- 172.21.15.84:0/1242447665 shutdown_connections 2024-09-21T03:52:20.599 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:20.583+0000 7f326dca6640 1 -- 172.21.15.84:0/1242447665 wait complete. 2024-09-21T03:52:20.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:20 smithi084 ceph-mon[30941]: pgmap v628: 97 pgs: 97 active+clean; 20 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-09-21T03:52:20.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:20 smithi174 ceph-mon[34403]: pgmap v628: 97 pgs: 97 active+clean; 20 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-09-21T03:52:20.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:20 smithi172 ceph-mon[34821]: pgmap v628: 97 pgs: 97 active+clean; 20 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-09-21T03:52:21.397 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:52:21.397 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:52:21.642 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:22.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.134+0000 7f3134d57640 1 -- 172.21.15.84:0/1057533038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3130108cf0 msgr2=0x7f313010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:22.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.134+0000 7f3134d57640 1 --2- 172.21.15.84:0/1057533038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3130108cf0 0x7f313010f520 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f3128009ca0 tx=0x7f312802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:52:22.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.134+0000 7f3134d57640 1 -- 172.21.15.84:0/1057533038 shutdown_connections 2024-09-21T03:52:22.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.134+0000 7f3134d57640 1 --2- 172.21.15.84:0/1057533038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3130108cf0 0x7f313010f520 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:22.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.134+0000 7f3134d57640 1 --2- 172.21.15.84:0/1057533038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31301083a0 0x7f31301087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:22.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.134+0000 7f3134d57640 1 --2- 172.21.15.84:0/1057533038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3130102a60 0x7f3130102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:22.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.134+0000 7f3134d57640 1 -- 172.21.15.84:0/1057533038 >> 172.21.15.84:0/1057533038 conn(0x7f3130079760 msgr2=0x7f3130079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.134+0000 7f3134d57640 1 -- 172.21.15.84:0/1057533038 shutdown_connections 2024-09-21T03:52:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.134+0000 7f3134d57640 1 -- 172.21.15.84:0/1057533038 wait complete. 2024-09-21T03:52:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.135+0000 7f3134d57640 1 Processor -- start 2024-09-21T03:52:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.135+0000 7f3134d57640 1 -- start start 2024-09-21T03:52:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.135+0000 7f3134d57640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3130102a60 0x7f3130199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f3134d57640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31301083a0 0x7f31301999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f3134d57640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3130108cf0 0x7f313019ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f3134d57640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3130112a60 con 0x7f3130108cf0 2024-09-21T03:52:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f3134d57640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f31301128e0 con 0x7f31301083a0 2024-09-21T03:52:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f3134d57640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3130112be0 con 0x7f3130102a60 2024-09-21T03:52:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f312ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3130108cf0 0x7f313019ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f312ed9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3130108cf0 0x7f313019ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56374/0 (socket says 172.21.15.84:56374) 2024-09-21T03:52:22.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f312ed9d640 1 -- 172.21.15.84:0/759842210 learned_addr learned my addr 172.21.15.84:0/759842210 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f312e59c640 1 --2- 172.21.15.84:0/759842210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3130102a60 0x7f3130199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f312dd9b640 1 --2- 172.21.15.84:0/759842210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31301083a0 0x7f31301999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f312ed9d640 1 -- 172.21.15.84:0/759842210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3130102a60 msgr2=0x7f3130199410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f312ed9d640 1 --2- 172.21.15.84:0/759842210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3130102a60 0x7f3130199410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f312ed9d640 1 -- 172.21.15.84:0/759842210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31301083a0 msgr2=0x7f31301999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f312ed9d640 1 --2- 172.21.15.84:0/759842210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31301083a0 0x7f31301999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f312ed9d640 1 -- 172.21.15.84:0/759842210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313019f2c0 con 0x7f3130108cf0 2024-09-21T03:52:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f312e59c640 1 --2- 172.21.15.84:0/759842210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3130102a60 0x7f3130199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:52:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f312ed9d640 1 --2- 172.21.15.84:0/759842210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3130108cf0 0x7f313019ec50 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f3128031a20 tx=0x7f3128031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f311f7fe640 1 -- 172.21.15.84:0/759842210 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312804a070 con 0x7f3130108cf0 2024-09-21T03:52:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f311f7fe640 1 -- 172.21.15.84:0/759842210 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3128003cc0 con 0x7f3130108cf0 2024-09-21T03:52:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f3134d57640 1 -- 172.21.15.84:0/759842210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f313019f550 con 0x7f3130108cf0 2024-09-21T03:52:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f311f7fe640 1 -- 172.21.15.84:0/759842210 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312802fad0 con 0x7f3130108cf0 2024-09-21T03:52:22.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.136+0000 7f3134d57640 1 -- 172.21.15.84:0/759842210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f313019fa90 con 0x7f3130108cf0 2024-09-21T03:52:22.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.137+0000 7f3134d57640 1 -- 172.21.15.84:0/759842210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3130103ce0 con 0x7f3130108cf0 2024-09-21T03:52:22.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.139+0000 7f311f7fe640 1 -- 172.21.15.84:0/759842210 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f312804d070 con 0x7f3130108cf0 2024-09-21T03:52:22.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.140+0000 7f311f7fe640 1 --2- 172.21.15.84:0/759842210 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f31180b66b0 0x7f31180b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:22.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.140+0000 7f312e59c640 1 --2- 172.21.15.84:0/759842210 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f31180b66b0 0x7f31180b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:22.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.140+0000 7f311f7fe640 1 -- 172.21.15.84:0/759842210 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f3128109f60 con 0x7f3130108cf0 2024-09-21T03:52:22.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.140+0000 7f312e59c640 1 --2- 172.21.15.84:0/759842210 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f31180b66b0 0x7f31180b8bc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3120009930 tx=0x7f3120008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:22.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.143+0000 7f311f7fe640 1 -- 172.21.15.84:0/759842210 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f31280d0590 con 0x7f3130108cf0 2024-09-21T03:52:22.359 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.357+0000 7f3134d57640 1 -- 172.21.15.84:0/759842210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3130102e70 con 0x7f3130108cf0 2024-09-21T03:52:22.360 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.358+0000 7f311f7fe640 1 -- 172.21.15.84:0/759842210 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7f3130102e70 con 0x7f3130108cf0 2024-09-21T03:52:22.360 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:52:22.361 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:52:22.361 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:52:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.360+0000 7f3134d57640 1 -- 172.21.15.84:0/759842210 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f31180b66b0 msgr2=0x7f31180b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.360+0000 7f3134d57640 1 --2- 172.21.15.84:0/759842210 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f31180b66b0 0x7f31180b8bc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3120009930 tx=0x7f3120008040 comp rx=0 tx=0).stop 2024-09-21T03:52:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.360+0000 7f3134d57640 1 -- 172.21.15.84:0/759842210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3130108cf0 msgr2=0x7f313019ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.360+0000 7f3134d57640 1 --2- 172.21.15.84:0/759842210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3130108cf0 0x7f313019ec50 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f3128031a20 tx=0x7f3128031a50 comp rx=0 tx=0).stop 2024-09-21T03:52:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.360+0000 7f3134d57640 1 -- 172.21.15.84:0/759842210 shutdown_connections 2024-09-21T03:52:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.360+0000 7f3134d57640 1 --2- 172.21.15.84:0/759842210 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f31180b66b0 0x7f31180b8bc0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.360+0000 7f3134d57640 1 --2- 172.21.15.84:0/759842210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3130108cf0 0x7f313019ec50 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.360+0000 7f3134d57640 1 --2- 172.21.15.84:0/759842210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31301083a0 0x7f31301999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.360+0000 7f3134d57640 1 --2- 172.21.15.84:0/759842210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3130102a60 0x7f3130199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.361+0000 7f3134d57640 1 -- 172.21.15.84:0/759842210 >> 172.21.15.84:0/759842210 conn(0x7f3130079760 msgr2=0x7f31301063f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.361+0000 7f3134d57640 1 -- 172.21.15.84:0/759842210 shutdown_connections 2024-09-21T03:52:22.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:22.361+0000 7f3134d57640 1 -- 172.21.15.84:0/759842210 wait complete. 2024-09-21T03:52:22.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:22 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/759842210' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:22.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:22 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/759842210' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:22.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:22 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/759842210' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:23.096 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:52:23.340 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:23.676 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:23 smithi084 ceph-mon[30941]: pgmap v629: 97 pgs: 97 active+clean; 20 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-09-21T03:52:23.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:23 smithi174 ceph-mon[34403]: pgmap v629: 97 pgs: 97 active+clean; 20 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-09-21T03:52:23.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:23 smithi172 ceph-mon[34821]: pgmap v629: 97 pgs: 97 active+clean; 20 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-09-21T03:52:23.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.886+0000 7f0ac2ae9640 1 -- 172.21.15.84:0/2296093533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0abc103b60 msgr2=0x7f0abc103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:23.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.886+0000 7f0ac2ae9640 1 --2- 172.21.15.84:0/2296093533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0abc103b60 0x7f0abc103f70 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009900 tx=0x7f0aac02a410 comp rx=0 tx=0).stop 2024-09-21T03:52:23.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.886+0000 7f0ac2ae9640 1 -- 172.21.15.84:0/2296093533 shutdown_connections 2024-09-21T03:52:23.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.886+0000 7f0ac2ae9640 1 --2- 172.21.15.84:0/2296093533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0abc109df0 0x7f0abc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.886+0000 7f0ac2ae9640 1 --2- 172.21.15.84:0/2296093533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0abc1094a0 0x7f0abc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.886+0000 7f0ac2ae9640 1 --2- 172.21.15.84:0/2296093533 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0abc103b60 0x7f0abc103f70 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.886+0000 7f0ac2ae9640 1 -- 172.21.15.84:0/2296093533 >> 172.21.15.84:0/2296093533 conn(0x7f0abc07b850 msgr2=0x7f0abc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:23.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.886+0000 7f0ac2ae9640 1 -- 172.21.15.84:0/2296093533 shutdown_connections 2024-09-21T03:52:23.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.886+0000 7f0ac2ae9640 1 -- 172.21.15.84:0/2296093533 wait complete. 2024-09-21T03:52:23.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.886+0000 7f0ac2ae9640 1 Processor -- start 2024-09-21T03:52:23.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.886+0000 7f0ac2ae9640 1 -- start start 2024-09-21T03:52:23.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.887+0000 7f0ac2ae9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0abc103b60 0x7f0abc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:23.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.887+0000 7f0ac2ae9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0abc1094a0 0x7f0abc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:23.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.887+0000 7f0ac2ae9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0abc109df0 0x7f0abc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:23.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.887+0000 7f0ac2ae9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc113ab0 con 0x7f0abc1094a0 2024-09-21T03:52:23.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.887+0000 7f0ac2ae9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc113930 con 0x7f0abc109df0 2024-09-21T03:52:23.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.887+0000 7f0ac2ae9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc113c30 con 0x7f0abc103b60 2024-09-21T03:52:23.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.887+0000 7f0abbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0abc1094a0 0x7f0abc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:23.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.887+0000 7f0abbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0abc1094a0 0x7f0abc075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56386/0 (socket says 172.21.15.84:56386) 2024-09-21T03:52:23.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.887+0000 7f0abbfff640 1 -- 172.21.15.84:0/3179861961 learned_addr learned my addr 172.21.15.84:0/3179861961 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:23.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.887+0000 7f0ac0885640 1 --2- 172.21.15.84:0/3179861961 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0abc103b60 0x7f0abc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:23.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.887+0000 7f0ac1086640 1 --2- 172.21.15.84:0/3179861961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0abc109df0 0x7f0abc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:23.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.887+0000 7f0abbfff640 1 -- 172.21.15.84:0/3179861961 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0abc103b60 msgr2=0x7f0abc075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:23.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.887+0000 7f0abbfff640 1 --2- 172.21.15.84:0/3179861961 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0abc103b60 0x7f0abc075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.887+0000 7f0abbfff640 1 -- 172.21.15.84:0/3179861961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0abc109df0 msgr2=0x7f0abc076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:23.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.887+0000 7f0abbfff640 1 --2- 172.21.15.84:0/3179861961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0abc109df0 0x7f0abc076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.887+0000 7f0abbfff640 1 -- 172.21.15.84:0/3179861961 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0abc1a87e0 con 0x7f0abc1094a0 2024-09-21T03:52:23.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.887+0000 7f0ac1086640 1 --2- 172.21.15.84:0/3179861961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0abc109df0 0x7f0abc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:52:23.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.887+0000 7f0abbfff640 1 --2- 172.21.15.84:0/3179861961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0abc1094a0 0x7f0abc075c50 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f0ab000d750 tx=0x7f0ab000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:23.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.887+0000 7f0ab9ffb640 1 -- 172.21.15.84:0/3179861961 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0017070 con 0x7f0abc1094a0 2024-09-21T03:52:23.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.887+0000 7f0ac2ae9640 1 -- 172.21.15.84:0/3179861961 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0abc1a8ad0 con 0x7f0abc1094a0 2024-09-21T03:52:23.907 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.888+0000 7f0ab9ffb640 1 -- 172.21.15.84:0/3179861961 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ab00054d0 con 0x7f0abc1094a0 2024-09-21T03:52:23.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.888+0000 7f0ab9ffb640 1 -- 172.21.15.84:0/3179861961 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0004c30 con 0x7f0abc1094a0 2024-09-21T03:52:23.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.888+0000 7f0ac2ae9640 1 -- 172.21.15.84:0/3179861961 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0abc1a9010 con 0x7f0abc1094a0 2024-09-21T03:52:23.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.890+0000 7f0ab9ffb640 1 -- 172.21.15.84:0/3179861961 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f0ab0004dd0 con 0x7f0abc1094a0 2024-09-21T03:52:23.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.890+0000 7f0ac905d740 1 Processor -- start 2024-09-21T03:52:23.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.890+0000 7f0ac905d740 1 -- start start 2024-09-21T03:52:23.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.890+0000 7f0ac905d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c91070 0x558c930386a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:23.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.890+0000 7f0ac905d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c681b0 0x558c93038be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:23.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.890+0000 7f0ac905d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c70390 0x558c93039120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:23.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0ac905d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558c92faeea0 con 0x558c92c91070 2024-09-21T03:52:23.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0ac905d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558c92f9e2d0 con 0x558c92c70390 2024-09-21T03:52:23.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0ac905d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558c92fa20e0 con 0x558c92c681b0 2024-09-21T03:52:23.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0ac1086640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c91070 0x558c930386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:23.908 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0ac1086640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c91070 0x558c930386a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56390/0 (socket says 172.21.15.84:56390) 2024-09-21T03:52:23.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0ac1086640 1 -- 172.21.15.84:0/3563691178 learned_addr learned my addr 172.21.15.84:0/3563691178 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:23.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0abbfff640 1 --2- 172.21.15.84:0/3563691178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c70390 0x558c93039120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:23.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0ac0885640 1 --2- 172.21.15.84:0/3563691178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c681b0 0x558c93038be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:23.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0ac1086640 1 -- 172.21.15.84:0/3563691178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c681b0 msgr2=0x558c93038be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:23.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0ac1086640 1 --2- 172.21.15.84:0/3563691178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c681b0 0x558c93038be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0ac1086640 1 -- 172.21.15.84:0/3563691178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c70390 msgr2=0x558c93039120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:23.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0ac1086640 1 --2- 172.21.15.84:0/3563691178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c70390 0x558c93039120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0ac1086640 1 -- 172.21.15.84:0/3563691178 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c92cfc650 con 0x558c92c91070 2024-09-21T03:52:23.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0ab9ffb640 1 --2- 172.21.15.84:0/3179861961 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0aa40b6680 0x7f0aa40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:23.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0ac0885640 1 --2- 172.21.15.84:0/3563691178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c681b0 0x558c93038be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:52:23.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0abbfff640 1 --2- 172.21.15.84:0/3563691178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c70390 0x558c93039120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:52:23.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0ac0885640 1 --2- 172.21.15.84:0/3179861961 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0aa40b6680 0x7f0aa40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:23.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0ac1086640 1 --2- 172.21.15.84:0/3563691178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c91070 0x558c930386a0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400ae80 tx=0x7f0ab400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866f9491f54b45f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:23.909 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0ab9ffb640 1 -- 172.21.15.84:0/3179861961 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f0ab00e70e0 con 0x7f0abc1094a0 2024-09-21T03:52:23.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0aa2ffd640 1 -- 172.21.15.84:0/3563691178 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4003b70 con 0x558c92c91070 2024-09-21T03:52:23.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0aa2ffd640 1 -- 172.21.15.84:0/3563691178 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ab4003d10 con 0x558c92c91070 2024-09-21T03:52:23.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.891+0000 7f0aa2ffd640 1 -- 172.21.15.84:0/3563691178 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab40109c0 con 0x558c92c91070 2024-09-21T03:52:23.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.892+0000 7f0ac905d740 1 -- 172.21.15.84:0/3563691178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c91070 msgr2=0x558c930386a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:23.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.892+0000 7f0ac0885640 1 --2- 172.21.15.84:0/3179861961 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0aa40b6680 0x7f0aa40b8b90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0aac000c00 tx=0x7f0aac031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:23.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.892+0000 7f0ac905d740 1 --2- 172.21.15.84:0/3563691178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c91070 0x558c930386a0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400ae80 tx=0x7f0ab400e720 comp rx=0 tx=0).stop 2024-09-21T03:52:23.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.892+0000 7f0ac905d740 1 -- 172.21.15.84:0/3563691178 shutdown_connections 2024-09-21T03:52:23.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.892+0000 7f0ac905d740 1 --2- 172.21.15.84:0/3563691178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c70390 0x558c93039120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.892+0000 7f0ac905d740 1 --2- 172.21.15.84:0/3563691178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c681b0 0x558c93038be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.892+0000 7f0ac905d740 1 --2- 172.21.15.84:0/3563691178 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c91070 0x558c930386a0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.892+0000 7f0ac905d740 1 -- 172.21.15.84:0/3563691178 >> 172.21.15.84:0/3563691178 conn(0x558c92c85460 msgr2=0x558c93036590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:23.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.892+0000 7f0ac905d740 1 -- 172.21.15.84:0/3563691178 shutdown_connections 2024-09-21T03:52:23.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.892+0000 7f0ac905d740 1 -- 172.21.15.84:0/3563691178 wait complete. 2024-09-21T03:52:23.910 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.893+0000 7f0ac905d740 1 -- start start 2024-09-21T03:52:23.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.893+0000 7f0ac905d740 1 Processor -- start 2024-09-21T03:52:23.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.893+0000 7f0ac905d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c681b0 0x558c93043d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:23.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.893+0000 7f0ac905d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c70390 0x558c93044250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:23.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.893+0000 7f0ac905d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c91070 0x558c93050170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:23.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.893+0000 7f0ac905d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x558c92dff700 con 0x558c92c91070 2024-09-21T03:52:23.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.893+0000 7f0ac905d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558c92f39160 con 0x558c92c681b0 2024-09-21T03:52:23.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.893+0000 7f0ac905d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x558c93046e80 con 0x558c92c70390 2024-09-21T03:52:23.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.893+0000 7f0ac905d740 10 client.0 _ll_register_callbacks cb 0x558c92f529e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:23.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.893+0000 7f0ac1086640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c91070 0x558c93050170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:23.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.893+0000 7f0ac1086640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c91070 0x558c93050170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56396/0 (socket says 172.21.15.84:56396) 2024-09-21T03:52:23.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.894+0000 7f0ac1086640 1 -- 172.21.15.84:0/3102317081 learned_addr learned my addr 172.21.15.84:0/3102317081 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:23.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.894+0000 7f0abbfff640 1 --2- 172.21.15.84:0/3102317081 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c70390 0x558c93044250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:23.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.894+0000 7f0ac0885640 1 --2- 172.21.15.84:0/3102317081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c681b0 0x558c93043d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:23.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.894+0000 7f0ac1086640 1 -- 172.21.15.84:0/3102317081 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c70390 msgr2=0x558c93044250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:23.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.894+0000 7f0ac1086640 1 --2- 172.21.15.84:0/3102317081 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c70390 0x558c93044250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.894+0000 7f0ac1086640 1 -- 172.21.15.84:0/3102317081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c681b0 msgr2=0x558c93043d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:23.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.894+0000 7f0ac1086640 1 --2- 172.21.15.84:0/3102317081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c681b0 0x558c93043d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.894+0000 7f0ac1086640 1 -- 172.21.15.84:0/3102317081 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c92f66c90 con 0x558c92c91070 2024-09-21T03:52:23.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.894+0000 7f0ac0885640 1 --2- 172.21.15.84:0/3102317081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c681b0 0x558c93043d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:52:23.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.894+0000 7f0ac1086640 1 --2- 172.21.15.84:0/3102317081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c91070 0x558c93050170 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400abc0 tx=0x7f0ab400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a62a4c93ad83278 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:23.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.894+0000 7f0a9bfff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:23.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.894+0000 7f0a9bfff640 1 -- 172.21.15.84:0/3102317081 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab402a060 con 0x558c92c91070 2024-09-21T03:52:23.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.894+0000 7f0a9bfff640 1 -- 172.21.15.84:0/3102317081 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f0ab4004360 con 0x558c92c91070 2024-09-21T03:52:23.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.894+0000 7f0ac905d740 1 -- 172.21.15.84:0/3102317081 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ab4003d10 con 0x558c92c91070 2024-09-21T03:52:23.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.894+0000 7f0a9bfff640 1 -- 172.21.15.84:0/3102317081 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0ab4004560 con 0x558c92c91070 2024-09-21T03:52:23.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.894+0000 7f0ac905d740 10 client.17307 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:23.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.894+0000 7f0ac905d740 1 -- 172.21.15.84:0/3102317081 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558c93052b50 con 0x558c92c91070 2024-09-21T03:52:23.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.895+0000 7f0a9bfff640 1 -- 172.21.15.84:0/3102317081 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ab4003d10 con 0x558c92c91070 2024-09-21T03:52:23.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.895+0000 7f0a9bfff640 1 -- 172.21.15.84:0/3102317081 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0ab401a830 con 0x558c92c91070 2024-09-21T03:52:23.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.895+0000 7f0ac905d740 10 client.17307 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:23.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.895+0000 7f0ac905d740 10 client.17307 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:52:23.913 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.895+0000 7f0ac905d740 20 client.17307 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.895+0000 7f0ac905d740 1 --2- 172.21.15.84:0/3102317081 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x558c92c4f9f0 0x558c93055f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.895+0000 7f0ac905d740 4 client.17307 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:52:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.895+0000 7f0ac905d740 1 -- 172.21.15.84:0/3102317081 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c92fb0df0 con 0x558c92c4f9f0 2024-09-21T03:52:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.895+0000 7f0ac0885640 1 --2- 172.21.15.84:0/3102317081 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x558c92c4f9f0 0x558c93055f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.896+0000 7f0a9bfff640 10 client.17307 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:52:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.896+0000 7f0ac0885640 1 --2- 172.21.15.84:0/3102317081 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x558c92c4f9f0 0x558c93055f60 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3454f32b98fe460d server_cookie=14081470eccc11dd in_seq=0 out_seq=0 2024-09-21T03:52:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.896+0000 7f0a9bfff640 1 -- 172.21.15.84:0/3102317081 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558c92fb0df0 con 0x558c92c4f9f0 2024-09-21T03:52:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.896+0000 7f0a9bfff640 10 client.17307 handle_command_reply: tid=0 2024-09-21T03:52:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.896+0000 7f0ac905d740 1 client.17307 shutdown 2024-09-21T03:52:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.897+0000 7f0ac905d740 1 -- 172.21.15.84:0/3102317081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c91070 msgr2=0x558c93050170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.897+0000 7f0ac905d740 1 --2- 172.21.15.84:0/3102317081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c91070 0x558c93050170 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400abc0 tx=0x7f0ab400ef60 comp rx=0 tx=0).stop 2024-09-21T03:52:23.914 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.897+0000 7f0ac905d740 1 -- 172.21.15.84:0/3102317081 shutdown_connections 2024-09-21T03:52:23.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.897+0000 7f0ac905d740 1 --2- 172.21.15.84:0/3102317081 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x558c92c4f9f0 0x558c93055f60 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.897+0000 7f0ac905d740 1 --2- 172.21.15.84:0/3102317081 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c91070 0x558c93050170 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.897+0000 7f0ac905d740 1 --2- 172.21.15.84:0/3102317081 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c70390 0x558c93044250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.897+0000 7f0a9bfff640 0 client.17307 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:52:23.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.897+0000 7f0ac905d740 1 --2- 172.21.15.84:0/3102317081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c681b0 0x558c93043d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.897+0000 7f0ac905d740 1 -- 172.21.15.84:0/3102317081 >> 172.21.15.84:0/3102317081 conn(0x558c92c85460 msgr2=0x558c9303b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:23.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.897+0000 7f0ac905d740 1 -- 172.21.15.84:0/3102317081 shutdown_connections 2024-09-21T03:52:23.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.897+0000 7f0ac905d740 1 -- 172.21.15.84:0/3102317081 wait complete. 2024-09-21T03:52:23.915 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.897+0000 7f0ac905d740 20 client.17307 trim_cache size 0 max 16384 2024-09-21T03:52:23.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.910+0000 7f0ac905d740 1 Processor -- start 2024-09-21T03:52:23.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.910+0000 7f0ac905d740 1 -- start start 2024-09-21T03:52:23.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.910+0000 7f0ac905d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c4f9f0 0x558c93044480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:23.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.910+0000 7f0ac905d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c681b0 0x558c930500e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:23.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.910+0000 7f0ac905d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c70390 0x558c93045940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:23.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.910+0000 7f0ac905d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc1b41f0 con 0x558c92c4f9f0 2024-09-21T03:52:23.920 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.910+0000 7f0ac905d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc1b1ac0 con 0x558c92c681b0 2024-09-21T03:52:23.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.910+0000 7f0ac905d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc1af930 con 0x558c92c70390 2024-09-21T03:52:23.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.910+0000 7f0ac0885640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c4f9f0 0x558c93044480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:23.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.910+0000 7f0ac0885640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c4f9f0 0x558c93044480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56406/0 (socket says 172.21.15.84:56406) 2024-09-21T03:52:23.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.910+0000 7f0ac0885640 1 -- 172.21.15.84:0/538852484 learned_addr learned my addr 172.21.15.84:0/538852484 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:23.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.911+0000 7f0ac1086640 1 --2- 172.21.15.84:0/538852484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c70390 0x558c93045940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:23.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.911+0000 7f0abbfff640 1 --2- 172.21.15.84:0/538852484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c681b0 0x558c930500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:23.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.911+0000 7f0ac0885640 1 -- 172.21.15.84:0/538852484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c70390 msgr2=0x558c93045940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:23.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.911+0000 7f0ac0885640 1 --2- 172.21.15.84:0/538852484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c70390 0x558c93045940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.911+0000 7f0ac0885640 1 -- 172.21.15.84:0/538852484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c681b0 msgr2=0x558c930500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:23.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.911+0000 7f0ac0885640 1 --2- 172.21.15.84:0/538852484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c681b0 0x558c930500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.911+0000 7f0ac0885640 1 -- 172.21.15.84:0/538852484 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c93044fd0 con 0x558c92c4f9f0 2024-09-21T03:52:23.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.911+0000 7f0ac1086640 1 --2- 172.21.15.84:0/538852484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c70390 0x558c93045940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:52:23.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.911+0000 7f0abbfff640 1 --2- 172.21.15.84:0/538852484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c681b0 0x558c930500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:52:23.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.911+0000 7f0ac0885640 1 --2- 172.21.15.84:0/538852484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c4f9f0 0x558c93044480 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f0aac02a930 tx=0x7f0aac03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f24262d00031c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:23.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.911+0000 7f0aa27fc640 1 -- 172.21.15.84:0/538852484 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac057070 con 0x558c92c4f9f0 2024-09-21T03:52:23.921 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.911+0000 7f0aa27fc640 1 -- 172.21.15.84:0/538852484 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aac0054f0 con 0x558c92c4f9f0 2024-09-21T03:52:23.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.911+0000 7f0aa27fc640 1 -- 172.21.15.84:0/538852484 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac035040 con 0x558c92c4f9f0 2024-09-21T03:52:23.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.912+0000 7f0ac905d740 1 -- 172.21.15.84:0/538852484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c4f9f0 msgr2=0x558c93044480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:23.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.912+0000 7f0ac905d740 1 --2- 172.21.15.84:0/538852484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c4f9f0 0x558c93044480 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f0aac02a930 tx=0x7f0aac03e000 comp rx=0 tx=0).stop 2024-09-21T03:52:23.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.912+0000 7f0ac905d740 1 -- 172.21.15.84:0/538852484 shutdown_connections 2024-09-21T03:52:23.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.912+0000 7f0ac905d740 1 --2- 172.21.15.84:0/538852484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c70390 0x558c93045940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.912+0000 7f0ac905d740 1 --2- 172.21.15.84:0/538852484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c681b0 0x558c930500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.912+0000 7f0ac905d740 1 --2- 172.21.15.84:0/538852484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c4f9f0 0x558c93044480 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.912+0000 7f0ac905d740 1 -- 172.21.15.84:0/538852484 >> 172.21.15.84:0/538852484 conn(0x558c92c85460 msgr2=0x558c93045230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:23.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.912+0000 7f0ac905d740 1 -- 172.21.15.84:0/538852484 shutdown_connections 2024-09-21T03:52:23.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.912+0000 7f0ac905d740 1 -- 172.21.15.84:0/538852484 wait complete. 2024-09-21T03:52:23.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.912+0000 7f0ac905d740 1 -- start start 2024-09-21T03:52:23.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.912+0000 7f0ac905d740 1 Processor -- start 2024-09-21T03:52:23.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.913+0000 7f0ac905d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c4f9f0 0x558c93057270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:23.922 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.913+0000 7f0ac905d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c681b0 0x558c930577b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:23.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.913+0000 7f0ac905d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c70390 0x558c930bf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:23.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.913+0000 7f0ac905d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc1aff80 con 0x558c92c70390 2024-09-21T03:52:23.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.913+0000 7f0ac905d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc1b13f0 con 0x558c92c681b0 2024-09-21T03:52:23.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.913+0000 7f0ac905d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc1b0650 con 0x558c92c4f9f0 2024-09-21T03:52:23.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.913+0000 7f0ac905d740 10 client.0 _ll_register_callbacks cb 0x7f0ab4014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:23.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.913+0000 7f0ac1086640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c70390 0x558c930bf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:23.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.913+0000 7f0ac1086640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c70390 0x558c930bf6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56410/0 (socket says 172.21.15.84:56410) 2024-09-21T03:52:23.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.913+0000 7f0ac1086640 1 -- 172.21.15.84:0/547140295 learned_addr learned my addr 172.21.15.84:0/547140295 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:23.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.913+0000 7f0abbfff640 1 --2- 172.21.15.84:0/547140295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c681b0 0x558c930577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:23.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.913+0000 7f0ac0885640 1 --2- 172.21.15.84:0/547140295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c4f9f0 0x558c93057270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:23.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.913+0000 7f0ac1086640 1 -- 172.21.15.84:0/547140295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c4f9f0 msgr2=0x558c93057270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:23.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.913+0000 7f0ac1086640 1 --2- 172.21.15.84:0/547140295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c4f9f0 0x558c93057270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.923 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.913+0000 7f0ac1086640 1 -- 172.21.15.84:0/547140295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c681b0 msgr2=0x558c930577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:23.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.913+0000 7f0ac1086640 1 --2- 172.21.15.84:0/547140295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c681b0 0x558c930577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.913+0000 7f0ac1086640 1 -- 172.21.15.84:0/547140295 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c93058030 con 0x558c92c70390 2024-09-21T03:52:23.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.913+0000 7f0abbfff640 1 --2- 172.21.15.84:0/547140295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c681b0 0x558c930577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:52:23.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.913+0000 7f0ac0885640 1 --2- 172.21.15.84:0/547140295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c4f9f0 0x558c93057270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:52:23.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.914+0000 7f0ac1086640 1 --2- 172.21.15.84:0/547140295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c70390 0x558c930bf6e0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4005e10 tx=0x7f0ab400a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9376507a2b641411 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:23.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.914+0000 7f0a9bfff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:23.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.914+0000 7f0a9bfff640 1 -- 172.21.15.84:0/547140295 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab402a050 con 0x558c92c70390 2024-09-21T03:52:23.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.914+0000 7f0ac905d740 1 -- 172.21.15.84:0/547140295 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0aac0054f0 con 0x558c92c70390 2024-09-21T03:52:23.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.914+0000 7f0a9bfff640 1 -- 172.21.15.84:0/547140295 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f0ab4022040 con 0x558c92c70390 2024-09-21T03:52:23.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.914+0000 7f0a9bfff640 1 -- 172.21.15.84:0/547140295 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0ab400a6f0 con 0x558c92c70390 2024-09-21T03:52:23.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.914+0000 7f0ac905d740 10 client.17313 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:23.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.914+0000 7f0ac905d740 1 -- 172.21.15.84:0/547140295 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558c930c0b40 con 0x558c92c70390 2024-09-21T03:52:23.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.914+0000 7f0a9bfff640 1 -- 172.21.15.84:0/547140295 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aac0054f0 con 0x558c92c70390 2024-09-21T03:52:23.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.914+0000 7f0a9bfff640 1 -- 172.21.15.84:0/547140295 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0ab4010b60 con 0x558c92c70390 2024-09-21T03:52:23.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.914+0000 7f0ac905d740 10 client.17313 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:23.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.914+0000 7f0ac905d740 10 client.17313 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:52:23.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.914+0000 7f0ac905d740 20 client.17313 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:23.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.914+0000 7f0ac905d740 1 --2- 172.21.15.84:0/547140295 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x558c92c91070 0x558c930c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:23.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.914+0000 7f0ac905d740 4 client.17313 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:52:23.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.914+0000 7f0ac905d740 1 -- 172.21.15.84:0/547140295 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558c92fac8a0 con 0x558c92c91070 2024-09-21T03:52:23.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.915+0000 7f0ac0885640 1 --2- 172.21.15.84:0/547140295 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x558c92c91070 0x558c930c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:23.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.915+0000 7f0ac0885640 1 --2- 172.21.15.84:0/547140295 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x558c92c91070 0x558c930c32f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=34aad01ea1e07da3 server_cookie=a4dae41faa04c5e5 in_seq=0 out_seq=0 2024-09-21T03:52:23.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.915+0000 7f0a9bfff640 10 client.17313 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:52:23.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.915+0000 7f0a9bfff640 1 -- 172.21.15.84:0/547140295 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558c92fac8a0 con 0x558c92c91070 2024-09-21T03:52:23.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.915+0000 7f0a9bfff640 10 client.17313 handle_command_reply: tid=0 2024-09-21T03:52:23.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.915+0000 7f0ac905d740 1 client.17313 shutdown 2024-09-21T03:52:23.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.915+0000 7f0ac905d740 1 -- 172.21.15.84:0/547140295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c70390 msgr2=0x558c930bf6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.915+0000 7f0ac905d740 1 --2- 172.21.15.84:0/547140295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c70390 0x558c930bf6e0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4005e10 tx=0x7f0ab400a5b0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.916+0000 7f0ac905d740 1 -- 172.21.15.84:0/547140295 shutdown_connections 2024-09-21T03:52:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.916+0000 7f0ac905d740 1 --2- 172.21.15.84:0/547140295 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x558c92c91070 0x558c930c32f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.916+0000 7f0ac905d740 1 --2- 172.21.15.84:0/547140295 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x558c92c70390 0x558c930bf6e0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.916+0000 7f0ac905d740 1 --2- 172.21.15.84:0/547140295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c92c681b0 0x558c930577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.916+0000 7f0ac905d740 1 --2- 172.21.15.84:0/547140295 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x558c92c4f9f0 0x558c93057270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.916+0000 7f0ac905d740 1 -- 172.21.15.84:0/547140295 >> 172.21.15.84:0/547140295 conn(0x558c92c85460 msgr2=0x558c93044250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.916+0000 7f0a9bfff640 0 client.17313 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:52:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.916+0000 7f0ac905d740 1 -- 172.21.15.84:0/547140295 shutdown_connections 2024-09-21T03:52:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.916+0000 7f0ac905d740 1 -- 172.21.15.84:0/547140295 wait complete. 2024-09-21T03:52:23.926 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.916+0000 7f0ac905d740 20 client.17313 trim_cache size 0 max 16384 2024-09-21T03:52:23.927 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:52:23.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.916+0000 7f0ac2ae9640 1 -- 172.21.15.84:0/3179861961 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0aa40b6680 msgr2=0x7f0aa40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:23.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.916+0000 7f0ac2ae9640 1 --2- 172.21.15.84:0/3179861961 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0aa40b6680 0x7f0aa40b8b90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0aac000c00 tx=0x7f0aac031400 comp rx=0 tx=0).stop 2024-09-21T03:52:23.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.916+0000 7f0ac2ae9640 1 -- 172.21.15.84:0/3179861961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0abc1094a0 msgr2=0x7f0abc075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.916+0000 7f0ac2ae9640 1 --2- 172.21.15.84:0/3179861961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0abc1094a0 0x7f0abc075c50 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f0ab000d750 tx=0x7f0ab000dc10 comp rx=0 tx=0).stop 2024-09-21T03:52:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.916+0000 7f0ac2ae9640 1 -- 172.21.15.84:0/3179861961 shutdown_connections 2024-09-21T03:52:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.916+0000 7f0ac2ae9640 1 --2- 172.21.15.84:0/3179861961 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f0aa40b6680 0x7f0aa40b8b90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.916+0000 7f0ac2ae9640 1 --2- 172.21.15.84:0/3179861961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0abc109df0 0x7f0abc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.916+0000 7f0ac2ae9640 1 --2- 172.21.15.84:0/3179861961 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f0abc1094a0 0x7f0abc075c50 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.916+0000 7f0ac2ae9640 1 --2- 172.21.15.84:0/3179861961 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0abc103b60 0x7f0abc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.916+0000 7f0ac2ae9640 1 -- 172.21.15.84:0/3179861961 >> 172.21.15.84:0/3179861961 conn(0x7f0abc07b850 msgr2=0x7f0abc1075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.917+0000 7f0ac2ae9640 1 -- 172.21.15.84:0/3179861961 shutdown_connections 2024-09-21T03:52:23.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:23.917+0000 7f0ac2ae9640 1 -- 172.21.15.84:0/3179861961 wait complete. 2024-09-21T03:52:24.632 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:52:24.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:24 smithi084 ceph-mon[30941]: pgmap v630: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-09-21T03:52:24.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:24 smithi174 ceph-mon[34403]: pgmap v630: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-09-21T03:52:24.880 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:24.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:24 smithi172 ceph-mon[34821]: pgmap v630: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-09-21T03:52:25.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.353+0000 7f6bcad51640 1 -- 172.21.15.84:0/607211241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc4102a60 msgr2=0x7f6bc4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:25.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.353+0000 7f6bcad51640 1 --2- 172.21.15.84:0/607211241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc4102a60 0x7f6bc4102e70 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009900 tx=0x7f6bc002a410 comp rx=0 tx=0).stop 2024-09-21T03:52:25.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.354+0000 7f6bcad51640 1 -- 172.21.15.84:0/607211241 shutdown_connections 2024-09-21T03:52:25.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.354+0000 7f6bcad51640 1 --2- 172.21.15.84:0/607211241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc4108cf0 0x7f6bc410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.354+0000 7f6bcad51640 1 --2- 172.21.15.84:0/607211241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bc41083a0 0x7f6bc41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.354+0000 7f6bcad51640 1 --2- 172.21.15.84:0/607211241 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc4102a60 0x7f6bc4102e70 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.354+0000 7f6bcad51640 1 -- 172.21.15.84:0/607211241 >> 172.21.15.84:0/607211241 conn(0x7f6bc4079730 msgr2=0x7f6bc4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:25.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.354+0000 7f6bcad51640 1 -- 172.21.15.84:0/607211241 shutdown_connections 2024-09-21T03:52:25.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.354+0000 7f6bcad51640 1 -- 172.21.15.84:0/607211241 wait complete. 2024-09-21T03:52:25.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.354+0000 7f6bcad51640 1 Processor -- start 2024-09-21T03:52:25.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.354+0000 7f6bcad51640 1 -- start start 2024-09-21T03:52:25.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.354+0000 7f6bcad51640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc4102a60 0x7f6bc419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.355+0000 7f6bcad51640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc41083a0 0x7f6bc419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.355+0000 7f6bcad51640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bc4108cf0 0x7f6bc419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.355+0000 7f6bcad51640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc41129c0 con 0x7f6bc4102a60 2024-09-21T03:52:25.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.355+0000 7f6bcad51640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc4112840 con 0x7f6bc41083a0 2024-09-21T03:52:25.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.355+0000 7f6bcad51640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc4112b40 con 0x7f6bc4108cf0 2024-09-21T03:52:25.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.355+0000 7f6bc8aed640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc4102a60 0x7f6bc419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.355+0000 7f6bc8aed640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc4102a60 0x7f6bc419a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56420/0 (socket says 172.21.15.84:56420) 2024-09-21T03:52:25.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.355+0000 7f6bc8aed640 1 -- 172.21.15.84:0/1502975734 learned_addr learned my addr 172.21.15.84:0/1502975734 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:25.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.355+0000 7f6bc92ee640 1 --2- 172.21.15.84:0/1502975734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bc4108cf0 0x7f6bc419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.355+0000 7f6bbbfff640 1 --2- 172.21.15.84:0/1502975734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc41083a0 0x7f6bc419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.355+0000 7f6bc8aed640 1 -- 172.21.15.84:0/1502975734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bc4108cf0 msgr2=0x7f6bc419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:25.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.355+0000 7f6bc8aed640 1 --2- 172.21.15.84:0/1502975734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bc4108cf0 0x7f6bc419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.355+0000 7f6bc8aed640 1 -- 172.21.15.84:0/1502975734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc41083a0 msgr2=0x7f6bc419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:25.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.355+0000 7f6bc8aed640 1 --2- 172.21.15.84:0/1502975734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc41083a0 0x7f6bc419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.355+0000 7f6bc8aed640 1 -- 172.21.15.84:0/1502975734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc41a0430 con 0x7f6bc4102a60 2024-09-21T03:52:25.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.355+0000 7f6bc8aed640 1 --2- 172.21.15.84:0/1502975734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc4102a60 0x7f6bc419a4c0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0006010 tx=0x7f6bc00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:25.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.355+0000 7f6bb9ffb640 1 -- 172.21.15.84:0/1502975734 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc003f030 con 0x7f6bc4102a60 2024-09-21T03:52:25.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.355+0000 7f6bb9ffb640 1 -- 172.21.15.84:0/1502975734 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bc0003800 con 0x7f6bc4102a60 2024-09-21T03:52:25.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.355+0000 7f6bcad51640 1 -- 172.21.15.84:0/1502975734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc41a06c0 con 0x7f6bc4102a60 2024-09-21T03:52:25.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.355+0000 7f6bb9ffb640 1 -- 172.21.15.84:0/1502975734 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0035070 con 0x7f6bc4102a60 2024-09-21T03:52:25.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.356+0000 7f6bcad51640 1 -- 172.21.15.84:0/1502975734 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc41a6e80 con 0x7f6bc4102a60 2024-09-21T03:52:25.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.358+0000 7f6bd12c5740 1 Processor -- start 2024-09-21T03:52:25.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.358+0000 7f6bb9ffb640 1 -- 172.21.15.84:0/1502975734 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f6bc0003cb0 con 0x7f6bc4102a60 2024-09-21T03:52:25.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.358+0000 7f6bd12c5740 1 -- start start 2024-09-21T03:52:25.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.358+0000 7f6bd12c5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0db070 0x55e3fa4822c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.358+0000 7f6bd12c5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0b21b0 0x55e3fa482800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.358+0000 7f6bd12c5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3fa0ba390 0x55e3fa482d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.358+0000 7f6bd12c5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e3fa3f8ea0 con 0x55e3fa0b21b0 2024-09-21T03:52:25.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.358+0000 7f6bd12c5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e3fa3e82d0 con 0x55e3fa0ba390 2024-09-21T03:52:25.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.358+0000 7f6bd12c5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e3fa3ec0e0 con 0x55e3fa0db070 2024-09-21T03:52:25.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.359+0000 7f6bc8aed640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0b21b0 0x55e3fa482800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.359+0000 7f6bc8aed640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0b21b0 0x55e3fa482800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56428/0 (socket says 172.21.15.84:56428) 2024-09-21T03:52:25.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.359+0000 7f6bc8aed640 1 -- 172.21.15.84:0/388948205 learned_addr learned my addr 172.21.15.84:0/388948205 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:25.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.359+0000 7f6bc92ee640 1 --2- 172.21.15.84:0/388948205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0db070 0x55e3fa4822c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.359+0000 7f6bbbfff640 1 --2- 172.21.15.84:0/388948205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3fa0ba390 0x55e3fa482d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.359+0000 7f6bc8aed640 1 -- 172.21.15.84:0/388948205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0db070 msgr2=0x55e3fa4822c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:25.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.359+0000 7f6bc8aed640 1 --2- 172.21.15.84:0/388948205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0db070 0x55e3fa4822c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.359+0000 7f6bc8aed640 1 -- 172.21.15.84:0/388948205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3fa0ba390 msgr2=0x55e3fa482d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:25.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.359+0000 7f6bc8aed640 1 --2- 172.21.15.84:0/388948205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3fa0ba390 0x55e3fa482d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.359+0000 7f6bb9ffb640 1 --2- 172.21.15.84:0/1502975734 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6bac0b6680 0x7f6bac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.359+0000 7f6bc8aed640 1 -- 172.21.15.84:0/388948205 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3fa146650 con 0x55e3fa0b21b0 2024-09-21T03:52:25.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.359+0000 7f6bbbfff640 1 --2- 172.21.15.84:0/388948205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3fa0ba390 0x55e3fa482d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:52:25.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.359+0000 7f6bc92ee640 1 --2- 172.21.15.84:0/1502975734 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6bac0b6680 0x7f6bac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.359+0000 7f6bc8aed640 1 --2- 172.21.15.84:0/388948205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0b21b0 0x55e3fa482800 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6bc01058a0 tx=0x7f6bc01104b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7edecf88b0e4f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:25.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.359+0000 7f6bb9ffb640 1 -- 172.21.15.84:0/1502975734 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f6bc0108190 con 0x7f6bc4102a60 2024-09-21T03:52:25.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.359+0000 7f6baaffd640 1 -- 172.21.15.84:0/388948205 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0049020 con 0x55e3fa0b21b0 2024-09-21T03:52:25.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.360+0000 7f6baaffd640 1 -- 172.21.15.84:0/388948205 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bc00cdb40 con 0x55e3fa0b21b0 2024-09-21T03:52:25.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.360+0000 7f6baaffd640 1 -- 172.21.15.84:0/388948205 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00cd980 con 0x55e3fa0b21b0 2024-09-21T03:52:25.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.360+0000 7f6bd12c5740 1 -- 172.21.15.84:0/388948205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0b21b0 msgr2=0x55e3fa482800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:25.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.360+0000 7f6bc92ee640 1 --2- 172.21.15.84:0/1502975734 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6bac0b6680 0x7f6bac0b8b90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc008e40 tx=0x7f6bbc0085f0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:25.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.360+0000 7f6bd12c5740 1 --2- 172.21.15.84:0/388948205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0b21b0 0x55e3fa482800 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6bc01058a0 tx=0x7f6bc01104b0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.360+0000 7f6bd12c5740 1 -- 172.21.15.84:0/388948205 shutdown_connections 2024-09-21T03:52:25.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.360+0000 7f6bd12c5740 1 --2- 172.21.15.84:0/388948205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3fa0ba390 0x55e3fa482d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.360+0000 7f6bd12c5740 1 --2- 172.21.15.84:0/388948205 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0b21b0 0x55e3fa482800 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.360+0000 7f6bd12c5740 1 --2- 172.21.15.84:0/388948205 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0db070 0x55e3fa4822c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.360+0000 7f6bd12c5740 1 -- 172.21.15.84:0/388948205 >> 172.21.15.84:0/388948205 conn(0x55e3fa0cf460 msgr2=0x55e3fa4801b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:25.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.361+0000 7f6bd12c5740 1 -- 172.21.15.84:0/388948205 shutdown_connections 2024-09-21T03:52:25.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.361+0000 7f6bd12c5740 1 -- 172.21.15.84:0/388948205 wait complete. 2024-09-21T03:52:25.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.361+0000 7f6bd12c5740 1 -- start start 2024-09-21T03:52:25.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.361+0000 7f6bd12c5740 1 Processor -- start 2024-09-21T03:52:25.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6bd12c5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3fa0b21b0 0x55e3fa48d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6bd12c5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 0x55e3fa48df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6bd12c5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0db070 0x55e3fa499ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6bd12c5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e3fa249700 con 0x55e3fa0ba390 2024-09-21T03:52:25.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6bd12c5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e3fa383160 con 0x55e3fa0b21b0 2024-09-21T03:52:25.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6bd12c5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e3fa490860 con 0x55e3fa0db070 2024-09-21T03:52:25.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6bd12c5740 10 client.0 _ll_register_callbacks cb 0x55e3fa39c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:25.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6bbbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 0x55e3fa48df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6bbbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 0x55e3fa48df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56434/0 (socket says 172.21.15.84:56434) 2024-09-21T03:52:25.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6bbbfff640 1 -- 172.21.15.84:0/2577305975 learned_addr learned my addr 172.21.15.84:0/2577305975 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:25.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6bc92ee640 1 --2- 172.21.15.84:0/2577305975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0db070 0x55e3fa499ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6bc8aed640 1 --2- 172.21.15.84:0/2577305975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3fa0b21b0 0x55e3fa48d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6bbbfff640 1 -- 172.21.15.84:0/2577305975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0db070 msgr2=0x55e3fa499ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:25.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6bbbfff640 1 --2- 172.21.15.84:0/2577305975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0db070 0x55e3fa499ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6bbbfff640 1 -- 172.21.15.84:0/2577305975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3fa0b21b0 msgr2=0x55e3fa48d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:25.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6bbbfff640 1 --2- 172.21.15.84:0/2577305975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3fa0b21b0 0x55e3fa48d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6bbbfff640 1 -- 172.21.15.84:0/2577305975 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3fa3b0c90 con 0x55e3fa0ba390 2024-09-21T03:52:25.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6bbbfff640 1 --2- 172.21.15.84:0/2577305975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 0x55e3fa48df10 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400e1f0 tx=0x7f6bb400e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46417f44d31025f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:25.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6ba3fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:25.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6ba3fff640 1 -- 172.21.15.84:0/2577305975 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4017020 con 0x55e3fa0ba390 2024-09-21T03:52:25.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6ba3fff640 1 -- 172.21.15.84:0/2577305975 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f6bb4013610 con 0x55e3fa0ba390 2024-09-21T03:52:25.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.362+0000 7f6bd12c5740 1 -- 172.21.15.84:0/2577305975 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bc00cdb40 con 0x55e3fa0ba390 2024-09-21T03:52:25.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.363+0000 7f6ba3fff640 1 -- 172.21.15.84:0/2577305975 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6bb4022050 con 0x55e3fa0ba390 2024-09-21T03:52:25.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.363+0000 7f6bd12c5740 10 client.17325 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:25.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.363+0000 7f6bd12c5740 1 -- 172.21.15.84:0/2577305975 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e3fa49c4b0 con 0x55e3fa0ba390 2024-09-21T03:52:25.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.363+0000 7f6ba3fff640 1 -- 172.21.15.84:0/2577305975 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bc00cdb40 con 0x55e3fa0ba390 2024-09-21T03:52:25.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.363+0000 7f6ba3fff640 1 -- 172.21.15.84:0/2577305975 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6bb4012050 con 0x55e3fa0ba390 2024-09-21T03:52:25.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.363+0000 7f6bd12c5740 10 client.17325 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:25.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.363+0000 7f6bd12c5740 10 client.17325 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:52:25.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.363+0000 7f6bd12c5740 20 client.17325 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:25.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.363+0000 7f6bd12c5740 1 --2- 172.21.15.84:0/2577305975 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55e3fa0999f0 0x55e3fa49fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.363+0000 7f6bd12c5740 4 client.17325 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:52:25.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.363+0000 7f6bd12c5740 1 -- 172.21.15.84:0/2577305975 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3fa3fadf0 con 0x55e3fa0999f0 2024-09-21T03:52:25.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.364+0000 7f6bc8aed640 1 --2- 172.21.15.84:0/2577305975 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55e3fa0999f0 0x55e3fa49fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.364+0000 7f6bc8aed640 1 --2- 172.21.15.84:0/2577305975 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55e3fa0999f0 0x55e3fa49fa60 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9441fc039f0b0721 server_cookie=5324ce63de4230ca in_seq=0 out_seq=0 2024-09-21T03:52:25.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.364+0000 7f6ba3fff640 10 client.17325 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:52:25.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.365+0000 7f6ba3fff640 1 -- 172.21.15.84:0/2577305975 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e3fa3fadf0 con 0x55e3fa0999f0 2024-09-21T03:52:25.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.365+0000 7f6ba3fff640 10 client.17325 handle_command_reply: tid=0 2024-09-21T03:52:25.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.365+0000 7f6bd12c5740 1 client.17325 shutdown 2024-09-21T03:52:25.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.365+0000 7f6bd12c5740 1 -- 172.21.15.84:0/2577305975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 msgr2=0x55e3fa48df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:25.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.365+0000 7f6bd12c5740 1 --2- 172.21.15.84:0/2577305975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 0x55e3fa48df10 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400e1f0 tx=0x7f6bb400e6b0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.365+0000 7f6bd12c5740 1 -- 172.21.15.84:0/2577305975 shutdown_connections 2024-09-21T03:52:25.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.365+0000 7f6bd12c5740 1 --2- 172.21.15.84:0/2577305975 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55e3fa0999f0 0x55e3fa49fa60 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.365+0000 7f6bd12c5740 1 --2- 172.21.15.84:0/2577305975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0db070 0x55e3fa499ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.365+0000 7f6bd12c5740 1 --2- 172.21.15.84:0/2577305975 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 0x55e3fa48df10 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.365+0000 7f6bd12c5740 1 --2- 172.21.15.84:0/2577305975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3fa0b21b0 0x55e3fa48d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.365+0000 7f6bd12c5740 1 -- 172.21.15.84:0/2577305975 >> 172.21.15.84:0/2577305975 conn(0x55e3fa0cf460 msgr2=0x55e3fa485450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:25.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.365+0000 7f6ba3fff640 0 client.17325 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:52:25.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.365+0000 7f6bd12c5740 1 -- 172.21.15.84:0/2577305975 shutdown_connections 2024-09-21T03:52:25.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.365+0000 7f6bd12c5740 1 -- 172.21.15.84:0/2577305975 wait complete. 2024-09-21T03:52:25.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.365+0000 7f6bd12c5740 20 client.17325 trim_cache size 0 max 16384 2024-09-21T03:52:25.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.378+0000 7f6bd12c5740 1 Processor -- start 2024-09-21T03:52:25.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.378+0000 7f6bd12c5740 1 -- start start 2024-09-21T03:52:25.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.379+0000 7f6bd12c5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0b21b0 0x55e3fa48c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.379+0000 7f6bd12c5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 0x55e3fa485ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.379+0000 7f6bd12c5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3fa0db070 0x55e3fa48abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.379+0000 7f6bd12c5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc41b1f50 con 0x55e3fa0ba390 2024-09-21T03:52:25.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.379+0000 7f6bd12c5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc41af820 con 0x55e3fa0db070 2024-09-21T03:52:25.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.379+0000 7f6bd12c5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc41ad690 con 0x55e3fa0b21b0 2024-09-21T03:52:25.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.379+0000 7f6bbbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 0x55e3fa485ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.379+0000 7f6bbbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 0x55e3fa485ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56446/0 (socket says 172.21.15.84:56446) 2024-09-21T03:52:25.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.379+0000 7f6bbbfff640 1 -- 172.21.15.84:0/646348387 learned_addr learned my addr 172.21.15.84:0/646348387 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:25.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.379+0000 7f6bc8aed640 1 --2- 172.21.15.84:0/646348387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0b21b0 0x55e3fa48c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.379+0000 7f6bbbfff640 1 -- 172.21.15.84:0/646348387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0b21b0 msgr2=0x55e3fa48c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:25.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.379+0000 7f6bbbfff640 1 --2- 172.21.15.84:0/646348387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0b21b0 0x55e3fa48c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.379+0000 7f6bbbfff640 1 -- 172.21.15.84:0/646348387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3fa0db070 msgr2=0x55e3fa48abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:25.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.379+0000 7f6bbbfff640 1 --2- 172.21.15.84:0/646348387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3fa0db070 0x55e3fa48abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.379+0000 7f6bbbfff640 1 -- 172.21.15.84:0/646348387 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3fa48ec90 con 0x55e3fa0ba390 2024-09-21T03:52:25.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.379+0000 7f6bbbfff640 1 --2- 172.21.15.84:0/646348387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 0x55e3fa485ad0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009bd0 tx=0x7f6bb4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b37fa9ec36e8f01 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:25.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.379+0000 7f6baa7fc640 1 -- 172.21.15.84:0/646348387 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4017070 con 0x55e3fa0ba390 2024-09-21T03:52:25.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.379+0000 7f6baa7fc640 1 -- 172.21.15.84:0/646348387 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bb400ee60 con 0x55e3fa0ba390 2024-09-21T03:52:25.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.379+0000 7f6baa7fc640 1 -- 172.21.15.84:0/646348387 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb400f040 con 0x55e3fa0ba390 2024-09-21T03:52:25.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.380+0000 7f6bd12c5740 1 -- 172.21.15.84:0/646348387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 msgr2=0x55e3fa485ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:25.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.380+0000 7f6bd12c5740 1 --2- 172.21.15.84:0/646348387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 0x55e3fa485ad0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009bd0 tx=0x7f6bb4009c00 comp rx=0 tx=0).stop 2024-09-21T03:52:25.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.380+0000 7f6bd12c5740 1 -- 172.21.15.84:0/646348387 shutdown_connections 2024-09-21T03:52:25.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.380+0000 7f6bd12c5740 1 --2- 172.21.15.84:0/646348387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3fa0db070 0x55e3fa48abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.380+0000 7f6bd12c5740 1 --2- 172.21.15.84:0/646348387 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 0x55e3fa485ad0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.380+0000 7f6bd12c5740 1 --2- 172.21.15.84:0/646348387 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0b21b0 0x55e3fa48c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.380+0000 7f6bd12c5740 1 -- 172.21.15.84:0/646348387 >> 172.21.15.84:0/646348387 conn(0x55e3fa0cf460 msgr2=0x55e3fa4853c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:25.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.380+0000 7f6bd12c5740 1 -- 172.21.15.84:0/646348387 shutdown_connections 2024-09-21T03:52:25.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.380+0000 7f6bd12c5740 1 -- 172.21.15.84:0/646348387 wait complete. 2024-09-21T03:52:25.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.380+0000 7f6bd12c5740 1 -- start start 2024-09-21T03:52:25.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.381+0000 7f6bd12c5740 1 Processor -- start 2024-09-21T03:52:25.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.381+0000 7f6bd12c5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0b21b0 0x55e3fa491cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.381+0000 7f6bd12c5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 0x55e3fa492230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.381+0000 7f6bd12c5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3fa0db070 0x55e3fa509460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.381+0000 7f6bd12c5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc41adce0 con 0x55e3fa0ba390 2024-09-21T03:52:25.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.381+0000 7f6bd12c5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc41af150 con 0x55e3fa0db070 2024-09-21T03:52:25.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.381+0000 7f6bd12c5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc41ae3b0 con 0x55e3fa0b21b0 2024-09-21T03:52:25.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.381+0000 7f6bd12c5740 10 client.0 _ll_register_callbacks cb 0x7f6bb4009120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:25.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.381+0000 7f6bbbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 0x55e3fa492230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.381+0000 7f6bbbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 0x55e3fa492230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56454/0 (socket says 172.21.15.84:56454) 2024-09-21T03:52:25.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.381+0000 7f6bbbfff640 1 -- 172.21.15.84:0/1975980830 learned_addr learned my addr 172.21.15.84:0/1975980830 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:25.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.381+0000 7f6bc92ee640 1 --2- 172.21.15.84:0/1975980830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3fa0db070 0x55e3fa509460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.381+0000 7f6bc8aed640 1 --2- 172.21.15.84:0/1975980830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0b21b0 0x55e3fa491cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.381+0000 7f6bbbfff640 1 -- 172.21.15.84:0/1975980830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0b21b0 msgr2=0x55e3fa491cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:25.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.381+0000 7f6bbbfff640 1 --2- 172.21.15.84:0/1975980830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0b21b0 0x55e3fa491cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.381+0000 7f6bbbfff640 1 -- 172.21.15.84:0/1975980830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3fa0db070 msgr2=0x55e3fa509460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:25.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.381+0000 7f6bbbfff640 1 --2- 172.21.15.84:0/1975980830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3fa0db070 0x55e3fa509460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.381+0000 7f6bbbfff640 1 -- 172.21.15.84:0/1975980830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3fa492ab0 con 0x55e3fa0ba390 2024-09-21T03:52:25.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.382+0000 7f6bc8aed640 1 --2- 172.21.15.84:0/1975980830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0b21b0 0x55e3fa491cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:52:25.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.382+0000 7f6bbbfff640 1 --2- 172.21.15.84:0/1975980830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 0x55e3fa492230 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4004700 tx=0x7f6bb401bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2addde2ded0b536 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:25.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.382+0000 7f6ba3fff640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:25.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.382+0000 7f6ba3fff640 1 -- 172.21.15.84:0/1975980830 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4035060 con 0x55e3fa0ba390 2024-09-21T03:52:25.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.382+0000 7f6ba3fff640 1 -- 172.21.15.84:0/1975980830 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f6bb401b3a0 con 0x55e3fa0ba390 2024-09-21T03:52:25.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.382+0000 7f6bd12c5740 1 -- 172.21.15.84:0/1975980830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bb400ee60 con 0x55e3fa0ba390 2024-09-21T03:52:25.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.382+0000 7f6ba3fff640 1 -- 172.21.15.84:0/1975980830 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6bb4017050 con 0x55e3fa0ba390 2024-09-21T03:52:25.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.382+0000 7f6bd12c5740 10 client.17331 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:25.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.382+0000 7f6bd12c5740 1 -- 172.21.15.84:0/1975980830 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e3fa50a9e0 con 0x55e3fa0ba390 2024-09-21T03:52:25.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.382+0000 7f6ba3fff640 1 -- 172.21.15.84:0/1975980830 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bb400ee60 con 0x55e3fa0ba390 2024-09-21T03:52:25.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.382+0000 7f6ba3fff640 1 -- 172.21.15.84:0/1975980830 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6bb4012040 con 0x55e3fa0ba390 2024-09-21T03:52:25.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.382+0000 7f6bd12c5740 10 client.17331 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:25.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.383+0000 7f6bd12c5740 10 client.17331 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:52:25.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.383+0000 7f6bd12c5740 20 client.17331 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:25.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.383+0000 7f6bd12c5740 1 --2- 172.21.15.84:0/1975980830 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55e3fa06eda0 0x55e3fa50d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:25.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.383+0000 7f6bd12c5740 4 client.17331 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:52:25.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.383+0000 7f6bd12c5740 1 -- 172.21.15.84:0/1975980830 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e3fa3f68a0 con 0x55e3fa06eda0 2024-09-21T03:52:25.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.383+0000 7f6bc8aed640 1 --2- 172.21.15.84:0/1975980830 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55e3fa06eda0 0x55e3fa50d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:25.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.383+0000 7f6ba3fff640 10 client.17331 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:52:25.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.383+0000 7f6bc8aed640 1 --2- 172.21.15.84:0/1975980830 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55e3fa06eda0 0x55e3fa50d080 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4e950fbcfe259ad6 server_cookie=7e9c6624a17c3fd0 in_seq=0 out_seq=0 2024-09-21T03:52:25.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.384+0000 7f6ba3fff640 1 -- 172.21.15.84:0/1975980830 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e3fa3f68a0 con 0x55e3fa06eda0 2024-09-21T03:52:25.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.384+0000 7f6ba3fff640 10 client.17331 handle_command_reply: tid=0 2024-09-21T03:52:25.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.384+0000 7f6bd12c5740 1 client.17331 shutdown 2024-09-21T03:52:25.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.384+0000 7f6bd12c5740 1 -- 172.21.15.84:0/1975980830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 msgr2=0x55e3fa492230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:25.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.384+0000 7f6bd12c5740 1 --2- 172.21.15.84:0/1975980830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 0x55e3fa492230 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4004700 tx=0x7f6bb401bc40 comp rx=0 tx=0).stop 2024-09-21T03:52:25.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.384+0000 7f6bd12c5740 1 -- 172.21.15.84:0/1975980830 shutdown_connections 2024-09-21T03:52:25.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.384+0000 7f6bd12c5740 1 --2- 172.21.15.84:0/1975980830 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55e3fa06eda0 0x55e3fa50d080 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.384+0000 7f6bd12c5740 1 --2- 172.21.15.84:0/1975980830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3fa0db070 0x55e3fa509460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.384+0000 7f6bd12c5740 1 --2- 172.21.15.84:0/1975980830 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e3fa0ba390 0x55e3fa492230 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.384+0000 7f6bd12c5740 1 --2- 172.21.15.84:0/1975980830 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e3fa0b21b0 0x55e3fa491cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.384+0000 7f6bd12c5740 1 -- 172.21.15.84:0/1975980830 >> 172.21.15.84:0/1975980830 conn(0x55e3fa0cf460 msgr2=0x55e3fa4832f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:25.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.384+0000 7f6ba3fff640 0 client.17331 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:52:25.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.384+0000 7f6bd12c5740 1 -- 172.21.15.84:0/1975980830 shutdown_connections 2024-09-21T03:52:25.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.384+0000 7f6bd12c5740 1 -- 172.21.15.84:0/1975980830 wait complete. 2024-09-21T03:52:25.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.384+0000 7f6bd12c5740 20 client.17331 trim_cache size 0 max 16384 2024-09-21T03:52:25.397 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:52:25.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.385+0000 7f6bcad51640 1 -- 172.21.15.84:0/1502975734 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6bac0b6680 msgr2=0x7f6bac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:25.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.385+0000 7f6bcad51640 1 --2- 172.21.15.84:0/1502975734 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6bac0b6680 0x7f6bac0b8b90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc008e40 tx=0x7f6bbc0085f0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.385+0000 7f6bcad51640 1 -- 172.21.15.84:0/1502975734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc4102a60 msgr2=0x7f6bc419a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:25.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.385+0000 7f6bcad51640 1 --2- 172.21.15.84:0/1502975734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc4102a60 0x7f6bc419a4c0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0006010 tx=0x7f6bc00042f0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.385+0000 7f6bcad51640 1 -- 172.21.15.84:0/1502975734 shutdown_connections 2024-09-21T03:52:25.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.385+0000 7f6bcad51640 1 --2- 172.21.15.84:0/1502975734 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6bac0b6680 0x7f6bac0b8b90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.385+0000 7f6bcad51640 1 --2- 172.21.15.84:0/1502975734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6bc4108cf0 0x7f6bc419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.385+0000 7f6bcad51640 1 --2- 172.21.15.84:0/1502975734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6bc41083a0 0x7f6bc419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.385+0000 7f6bcad51640 1 --2- 172.21.15.84:0/1502975734 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6bc4102a60 0x7f6bc419a4c0 secure :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0006010 tx=0x7f6bc00042f0 comp rx=0 tx=0).stop 2024-09-21T03:52:25.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.385+0000 7f6bcad51640 1 -- 172.21.15.84:0/1502975734 >> 172.21.15.84:0/1502975734 conn(0x7f6bc4079730 msgr2=0x7f6bc4101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:25.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.385+0000 7f6bcad51640 1 -- 172.21.15.84:0/1502975734 shutdown_connections 2024-09-21T03:52:25.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:25.385+0000 7f6bcad51640 1 -- 172.21.15.84:0/1502975734 wait complete. 2024-09-21T03:52:26.106 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:52:26.352 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:26.756 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:26 smithi084 ceph-mon[30941]: pgmap v631: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 52 KiB/s wr, 10 op/s 2024-09-21T03:52:26.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.844+0000 7fa7cf8e4640 1 -- 172.21.15.84:0/1293649396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7c8102080 msgr2=0x7fa7c8102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:26.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.844+0000 7fa7cf8e4640 1 --2- 172.21.15.84:0/1293649396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7c8102080 0x7fa7c8102490 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009900 tx=0x7fa7c402a410 comp rx=0 tx=0).stop 2024-09-21T03:52:26.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.844+0000 7fa7cf8e4640 1 -- 172.21.15.84:0/1293649396 shutdown_connections 2024-09-21T03:52:26.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.844+0000 7fa7cf8e4640 1 --2- 172.21.15.84:0/1293649396 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7c8109eb0 0x7fa7c81106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.845+0000 7fa7cf8e4640 1 --2- 172.21.15.84:0/1293649396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7c8109560 0x7fa7c8109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.856 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.845+0000 7fa7cf8e4640 1 --2- 172.21.15.84:0/1293649396 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7c8102080 0x7fa7c8102490 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.845+0000 7fa7cf8e4640 1 -- 172.21.15.84:0/1293649396 >> 172.21.15.84:0/1293649396 conn(0x7fa7c8079ec0 msgr2=0x7fa7c807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:26.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.845+0000 7fa7cf8e4640 1 -- 172.21.15.84:0/1293649396 shutdown_connections 2024-09-21T03:52:26.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.845+0000 7fa7cf8e4640 1 -- 172.21.15.84:0/1293649396 wait complete. 2024-09-21T03:52:26.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.845+0000 7fa7cf8e4640 1 Processor -- start 2024-09-21T03:52:26.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.845+0000 7fa7cf8e4640 1 -- start start 2024-09-21T03:52:26.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.846+0000 7fa7cf8e4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7c8102080 0x7fa7c819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:26.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.846+0000 7fa7cf8e4640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7c8109560 0x7fa7c819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:26.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.846+0000 7fa7cf8e4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7c8109eb0 0x7fa7c819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:26.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.846+0000 7fa7cf8e4640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c8113b70 con 0x7fa7c8109eb0 2024-09-21T03:52:26.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.846+0000 7fa7cf8e4640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c81139f0 con 0x7fa7c8109560 2024-09-21T03:52:26.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.846+0000 7fa7cf8e4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c8113cf0 con 0x7fa7c8102080 2024-09-21T03:52:26.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.846+0000 7fa7cde81640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7c8109eb0 0x7fa7c819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:26.857 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.846+0000 7fa7cde81640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7c8109eb0 0x7fa7c819fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56464/0 (socket says 172.21.15.84:56464) 2024-09-21T03:52:26.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.846+0000 7fa7cde81640 1 -- 172.21.15.84:0/2873140484 learned_addr learned my addr 172.21.15.84:0/2873140484 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:26.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.846+0000 7fa7cd680640 1 --2- 172.21.15.84:0/2873140484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7c8102080 0x7fa7c819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:26.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.846+0000 7fa7cce7f640 1 --2- 172.21.15.84:0/2873140484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7c8109560 0x7fa7c819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:26.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.846+0000 7fa7cde81640 1 -- 172.21.15.84:0/2873140484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7c8102080 msgr2=0x7fa7c819a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:26.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.846+0000 7fa7cde81640 1 --2- 172.21.15.84:0/2873140484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7c8102080 0x7fa7c819a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.846+0000 7fa7cde81640 1 -- 172.21.15.84:0/2873140484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7c8109560 msgr2=0x7fa7c819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:26.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.846+0000 7fa7cde81640 1 --2- 172.21.15.84:0/2873140484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7c8109560 0x7fa7c819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.846+0000 7fa7cde81640 1 -- 172.21.15.84:0/2873140484 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c81a0410 con 0x7fa7c8109eb0 2024-09-21T03:52:26.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.846+0000 7fa7cce7f640 1 --2- 172.21.15.84:0/2873140484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7c8109560 0x7fa7c819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:52:26.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.846+0000 7fa7cde81640 1 --2- 172.21.15.84:0/2873140484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7c8109eb0 0x7fa7c819fda0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000cad0 tx=0x7fa7c000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:26.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.847+0000 7fa7be7fc640 1 -- 172.21.15.84:0/2873140484 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c000ae20 con 0x7fa7c8109eb0 2024-09-21T03:52:26.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.847+0000 7fa7be7fc640 1 -- 172.21.15.84:0/2873140484 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7c0005020 con 0x7fa7c8109eb0 2024-09-21T03:52:26.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.847+0000 7fa7cf8e4640 1 -- 172.21.15.84:0/2873140484 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c81a0700 con 0x7fa7c8109eb0 2024-09-21T03:52:26.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.847+0000 7fa7be7fc640 1 -- 172.21.15.84:0/2873140484 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c000f6b0 con 0x7fa7c8109eb0 2024-09-21T03:52:26.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.847+0000 7fa7cf8e4640 1 -- 172.21.15.84:0/2873140484 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c81a0bf0 con 0x7fa7c8109eb0 2024-09-21T03:52:26.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.849+0000 7fa7d5e58740 1 Processor -- start 2024-09-21T03:52:26.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.850+0000 7fa7be7fc640 1 -- 172.21.15.84:0/2873140484 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fa7c00051d0 con 0x7fa7c8109eb0 2024-09-21T03:52:26.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.850+0000 7fa7d5e58740 1 -- start start 2024-09-21T03:52:26.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.850+0000 7fa7d5e58740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b3827070 0x55a2b3bce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:26.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.850+0000 7fa7d5e58740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2b37fe1b0 0x55a2b3bcebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:26.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.850+0000 7fa7d5e58740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b3806390 0x55a2b3bcf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:26.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.850+0000 7fa7d5e58740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a2b3b44ea0 con 0x55a2b3827070 2024-09-21T03:52:26.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.850+0000 7fa7d5e58740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a2b3b342d0 con 0x55a2b3806390 2024-09-21T03:52:26.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.850+0000 7fa7d5e58740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a2b3b380e0 con 0x55a2b37fe1b0 2024-09-21T03:52:26.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.850+0000 7fa7cce7f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b3827070 0x55a2b3bce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:26.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.850+0000 7fa7cce7f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b3827070 0x55a2b3bce6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56474/0 (socket says 172.21.15.84:56474) 2024-09-21T03:52:26.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.850+0000 7fa7cce7f640 1 -- 172.21.15.84:0/1143457818 learned_addr learned my addr 172.21.15.84:0/1143457818 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:26.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.851+0000 7fa7cd680640 1 --2- 172.21.15.84:0/1143457818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2b37fe1b0 0x55a2b3bcebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:26.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.851+0000 7fa7be7fc640 1 --2- 172.21.15.84:0/2873140484 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa7b40b66b0 0x7fa7b40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:26.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.851+0000 7fa7cce7f640 1 --2- 172.21.15.84:0/1143457818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b3806390 0x55a2b3bcf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:26.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.851+0000 7fa7cce7f640 1 -- 172.21.15.84:0/1143457818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2b37fe1b0 msgr2=0x55a2b3bcebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:26.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.851+0000 7fa7cce7f640 1 --2- 172.21.15.84:0/1143457818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2b37fe1b0 0x55a2b3bcebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.851+0000 7fa7cce7f640 1 -- 172.21.15.84:0/1143457818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b3806390 msgr2=0x55a2b3bcf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:26.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.851+0000 7fa7cce7f640 1 --2- 172.21.15.84:0/1143457818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b3806390 0x55a2b3bcf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.851+0000 7fa7cce7f640 1 -- 172.21.15.84:0/1143457818 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b3892650 con 0x55a2b3827070 2024-09-21T03:52:26.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.851+0000 7fa7cde81640 1 --2- 172.21.15.84:0/2873140484 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa7b40b66b0 0x7fa7b40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:26.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.851+0000 7fa7cce7f640 1 --2- 172.21.15.84:0/1143457818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b3827070 0x55a2b3bce6a0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8008e50 tx=0x7fa7b80085e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24603aebc1f8332f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:26.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.851+0000 7fa7be7fc640 1 -- 172.21.15.84:0/2873140484 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7fa7c00e7700 con 0x7fa7c8109eb0 2024-09-21T03:52:26.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.851+0000 7fa7b37fe640 1 -- 172.21.15.84:0/1143457818 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8005220 con 0x55a2b3827070 2024-09-21T03:52:26.860 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.851+0000 7fa7b37fe640 1 -- 172.21.15.84:0/1143457818 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7b8016030 con 0x55a2b3827070 2024-09-21T03:52:26.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.851+0000 7fa7b37fe640 1 -- 172.21.15.84:0/1143457818 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8012790 con 0x55a2b3827070 2024-09-21T03:52:26.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.852+0000 7fa7d5e58740 1 -- 172.21.15.84:0/1143457818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b3827070 msgr2=0x55a2b3bce6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:26.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.852+0000 7fa7cde81640 1 --2- 172.21.15.84:0/2873140484 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa7b40b66b0 0x7fa7b40b8bc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00e4f50 tx=0x7fa7c00760c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:26.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.852+0000 7fa7d5e58740 1 --2- 172.21.15.84:0/1143457818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b3827070 0x55a2b3bce6a0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8008e50 tx=0x7fa7b80085e0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.852+0000 7fa7d5e58740 1 -- 172.21.15.84:0/1143457818 shutdown_connections 2024-09-21T03:52:26.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.852+0000 7fa7d5e58740 1 --2- 172.21.15.84:0/1143457818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b3806390 0x55a2b3bcf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.852+0000 7fa7d5e58740 1 --2- 172.21.15.84:0/1143457818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2b37fe1b0 0x55a2b3bcebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.852+0000 7fa7d5e58740 1 --2- 172.21.15.84:0/1143457818 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b3827070 0x55a2b3bce6a0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.852+0000 7fa7d5e58740 1 -- 172.21.15.84:0/1143457818 >> 172.21.15.84:0/1143457818 conn(0x55a2b381b460 msgr2=0x55a2b3bcc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:26.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.852+0000 7fa7d5e58740 1 -- 172.21.15.84:0/1143457818 shutdown_connections 2024-09-21T03:52:26.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.852+0000 7fa7d5e58740 1 -- 172.21.15.84:0/1143457818 wait complete. 2024-09-21T03:52:26.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.852+0000 7fa7d5e58740 1 -- start start 2024-09-21T03:52:26.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.853+0000 7fa7d5e58740 1 Processor -- start 2024-09-21T03:52:26.861 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.853+0000 7fa7d5e58740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b37fe1b0 0x55a2b3bd9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.853+0000 7fa7d5e58740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b3806390 0x55a2b3bda250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.853+0000 7fa7d5e58740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2b3827070 0x55a2b3be6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.853+0000 7fa7d5e58740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55a2b3995700 con 0x55a2b37fe1b0 2024-09-21T03:52:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.853+0000 7fa7d5e58740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a2b3acf160 con 0x55a2b3806390 2024-09-21T03:52:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.853+0000 7fa7d5e58740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55a2b3bdce80 con 0x55a2b3827070 2024-09-21T03:52:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.853+0000 7fa7d5e58740 10 client.0 _ll_register_callbacks cb 0x55a2b3ae89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.853+0000 7fa7cce7f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b37fe1b0 0x55a2b3bd9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.853+0000 7fa7cce7f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b37fe1b0 0x55a2b3bd9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56488/0 (socket says 172.21.15.84:56488) 2024-09-21T03:52:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.853+0000 7fa7cce7f640 1 -- 172.21.15.84:0/3596307385 learned_addr learned my addr 172.21.15.84:0/3596307385 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.853+0000 7fa7cd680640 1 --2- 172.21.15.84:0/3596307385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b3806390 0x55a2b3bda250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:26.862 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.853+0000 7fa7cce7f640 1 --2- 172.21.15.84:0/3596307385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2b3827070 0x55a2b3be6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:26.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.854+0000 7fa7cce7f640 1 -- 172.21.15.84:0/3596307385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2b3827070 msgr2=0x55a2b3be6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:26.864 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.854+0000 7fa7cce7f640 1 --2- 172.21.15.84:0/3596307385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2b3827070 0x55a2b3be6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.854+0000 7fa7cce7f640 1 -- 172.21.15.84:0/3596307385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b3806390 msgr2=0x55a2b3bda250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.854+0000 7fa7cce7f640 1 --2- 172.21.15.84:0/3596307385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b3806390 0x55a2b3bda250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.854+0000 7fa7cce7f640 1 -- 172.21.15.84:0/3596307385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2b3afcc90 con 0x55a2b37fe1b0 2024-09-21T03:52:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.854+0000 7fa7cce7f640 1 --2- 172.21.15.84:0/3596307385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b37fe1b0 0x55a2b3bd9d10 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fa7b80085b0 tx=0x7fa7b8008540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4dd6d4ff6f54605 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.854+0000 7fa7b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.855+0000 7fa7b0ff9640 1 -- 172.21.15.84:0/3596307385 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8005530 con 0x55a2b37fe1b0 2024-09-21T03:52:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.855+0000 7fa7b0ff9640 1 -- 172.21.15.84:0/3596307385 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7fa7b8012530 con 0x55a2b37fe1b0 2024-09-21T03:52:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.855+0000 7fa7d5e58740 1 -- 172.21.15.84:0/3596307385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7b8016030 con 0x55a2b37fe1b0 2024-09-21T03:52:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.855+0000 7fa7b0ff9640 1 -- 172.21.15.84:0/3596307385 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa7b80056d0 con 0x55a2b37fe1b0 2024-09-21T03:52:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.855+0000 7fa7d5e58740 10 client.17343 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.855+0000 7fa7d5e58740 1 -- 172.21.15.84:0/3596307385 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a2b3be8b50 con 0x55a2b37fe1b0 2024-09-21T03:52:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.855+0000 7fa7b0ff9640 1 -- 172.21.15.84:0/3596307385 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7b8016030 con 0x55a2b37fe1b0 2024-09-21T03:52:26.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.855+0000 7fa7b0ff9640 1 -- 172.21.15.84:0/3596307385 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa7b801b810 con 0x55a2b37fe1b0 2024-09-21T03:52:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.855+0000 7fa7d5e58740 10 client.17343 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.855+0000 7fa7d5e58740 10 client.17343 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:52:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.855+0000 7fa7d5e58740 20 client.17343 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.855+0000 7fa7d5e58740 1 --2- 172.21.15.84:0/3596307385 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55a2b37e59f0 0x55a2b3bebf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.855+0000 7fa7d5e58740 4 client.17343 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:52:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.855+0000 7fa7d5e58740 1 -- 172.21.15.84:0/3596307385 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2b3b46df0 con 0x55a2b37e59f0 2024-09-21T03:52:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.856+0000 7fa7cd680640 1 --2- 172.21.15.84:0/3596307385 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55a2b37e59f0 0x55a2b3bebf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.856+0000 7fa7cd680640 1 --2- 172.21.15.84:0/3596307385 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55a2b37e59f0 0x55a2b3bebf10 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=323a5762df95a270 server_cookie=e8544de1cc3ca821 in_seq=0 out_seq=0 2024-09-21T03:52:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.856+0000 7fa7b0ff9640 10 client.17343 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.857+0000 7fa7b0ff9640 1 -- 172.21.15.84:0/3596307385 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a2b3b46df0 con 0x55a2b37e59f0 2024-09-21T03:52:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.857+0000 7fa7b0ff9640 10 client.17343 handle_command_reply: tid=0 2024-09-21T03:52:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.857+0000 7fa7d5e58740 1 client.17343 shutdown 2024-09-21T03:52:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.857+0000 7fa7d5e58740 1 -- 172.21.15.84:0/3596307385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b37fe1b0 msgr2=0x55a2b3bd9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:26.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.857+0000 7fa7d5e58740 1 --2- 172.21.15.84:0/3596307385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b37fe1b0 0x55a2b3bd9d10 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fa7b80085b0 tx=0x7fa7b8008540 comp rx=0 tx=0).stop 2024-09-21T03:52:26.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.857+0000 7fa7d5e58740 1 -- 172.21.15.84:0/3596307385 shutdown_connections 2024-09-21T03:52:26.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.857+0000 7fa7d5e58740 1 --2- 172.21.15.84:0/3596307385 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55a2b37e59f0 0x55a2b3bebf10 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.857+0000 7fa7d5e58740 1 --2- 172.21.15.84:0/3596307385 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2b3827070 0x55a2b3be6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.857+0000 7fa7d5e58740 1 --2- 172.21.15.84:0/3596307385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b3806390 0x55a2b3bda250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.857+0000 7fa7d5e58740 1 --2- 172.21.15.84:0/3596307385 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b37fe1b0 0x55a2b3bd9d10 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.857+0000 7fa7d5e58740 1 -- 172.21.15.84:0/3596307385 >> 172.21.15.84:0/3596307385 conn(0x55a2b381b460 msgr2=0x55a2b3bd1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:26.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.857+0000 7fa7b0ff9640 0 client.17343 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:26.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.857+0000 7fa7d5e58740 1 -- 172.21.15.84:0/3596307385 shutdown_connections 2024-09-21T03:52:26.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.857+0000 7fa7d5e58740 1 -- 172.21.15.84:0/3596307385 wait complete. 2024-09-21T03:52:26.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.858+0000 7fa7d5e58740 20 client.17343 trim_cache size 0 max 16384 2024-09-21T03:52:26.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.871+0000 7fa7d5e58740 1 Processor -- start 2024-09-21T03:52:26.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.871+0000 7fa7d5e58740 1 -- start start 2024-09-21T03:52:26.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.871+0000 7fa7d5e58740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b37fe1b0 0x55a2b3bdbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:26.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.871+0000 7fa7d5e58740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b3806390 0x55a2b3bcfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:26.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.871+0000 7fa7d5e58740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2b3827070 0x55a2b3bcbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:26.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.871+0000 7fa7d5e58740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c81b1ef0 con 0x55a2b3806390 2024-09-21T03:52:26.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.871+0000 7fa7d5e58740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c81af7c0 con 0x55a2b37fe1b0 2024-09-21T03:52:26.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.871+0000 7fa7d5e58740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c81ad630 con 0x55a2b3827070 2024-09-21T03:52:26.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.871+0000 7fa7cd680640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b3806390 0x55a2b3bcfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:26.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.871+0000 7fa7cce7f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b37fe1b0 0x55a2b3bdbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:26.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.871+0000 7fa7cd680640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b3806390 0x55a2b3bcfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56492/0 (socket says 172.21.15.84:56492) 2024-09-21T03:52:26.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.871+0000 7fa7cd680640 1 -- 172.21.15.84:0/45575132 learned_addr learned my addr 172.21.15.84:0/45575132 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:26.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.871+0000 7fa7cce7f640 1 --2- 172.21.15.84:0/45575132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2b3827070 0x55a2b3bcbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:26.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.872+0000 7fa7cd680640 1 -- 172.21.15.84:0/45575132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2b3827070 msgr2=0x55a2b3bcbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:26.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.872+0000 7fa7cd680640 1 --2- 172.21.15.84:0/45575132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2b3827070 0x55a2b3bcbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.872+0000 7fa7cd680640 1 -- 172.21.15.84:0/45575132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b37fe1b0 msgr2=0x55a2b3bdbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:26.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.872+0000 7fa7cd680640 1 --2- 172.21.15.84:0/45575132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b37fe1b0 0x55a2b3bdbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.872+0000 7fa7cd680640 1 -- 172.21.15.84:0/45575132 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b3bd0bc0 con 0x55a2b3806390 2024-09-21T03:52:26.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.872+0000 7fa7cd680640 1 --2- 172.21.15.84:0/45575132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b3806390 0x55a2b3bcfde0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009900 tx=0x7fa7c4009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b356e1ce4cacb657 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:26.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.872+0000 7fa7b2ffd640 1 -- 172.21.15.84:0/45575132 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4035040 con 0x55a2b3806390 2024-09-21T03:52:26.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.872+0000 7fa7b2ffd640 1 -- 172.21.15.84:0/45575132 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7c4031950 con 0x55a2b3806390 2024-09-21T03:52:26.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.872+0000 7fa7b2ffd640 1 -- 172.21.15.84:0/45575132 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c403c440 con 0x55a2b3806390 2024-09-21T03:52:26.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.873+0000 7fa7d5e58740 1 -- 172.21.15.84:0/45575132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b3806390 msgr2=0x55a2b3bcfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:26.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.873+0000 7fa7d5e58740 1 --2- 172.21.15.84:0/45575132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b3806390 0x55a2b3bcfde0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009900 tx=0x7fa7c4009630 comp rx=0 tx=0).stop 2024-09-21T03:52:26.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.873+0000 7fa7d5e58740 1 -- 172.21.15.84:0/45575132 shutdown_connections 2024-09-21T03:52:26.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.873+0000 7fa7d5e58740 1 --2- 172.21.15.84:0/45575132 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2b3827070 0x55a2b3bcbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.873+0000 7fa7d5e58740 1 --2- 172.21.15.84:0/45575132 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b3806390 0x55a2b3bcfde0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.878 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.873+0000 7fa7d5e58740 1 --2- 172.21.15.84:0/45575132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b37fe1b0 0x55a2b3bdbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.873+0000 7fa7d5e58740 1 -- 172.21.15.84:0/45575132 >> 172.21.15.84:0/45575132 conn(0x55a2b381b460 msgr2=0x55a2b3bcf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.873+0000 7fa7d5e58740 1 -- 172.21.15.84:0/45575132 shutdown_connections 2024-09-21T03:52:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.873+0000 7fa7d5e58740 1 -- 172.21.15.84:0/45575132 wait complete. 2024-09-21T03:52:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.873+0000 7fa7d5e58740 1 -- start start 2024-09-21T03:52:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.873+0000 7fa7d5e58740 1 Processor -- start 2024-09-21T03:52:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.874+0000 7fa7d5e58740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b37fe1b0 0x55a2b3bef900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.874+0000 7fa7d5e58740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b3806390 0x55a2b3becdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.874+0000 7fa7d5e58740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2b3827070 0x55a2b3bed4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.874+0000 7fa7d5e58740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c81adc80 con 0x55a2b37fe1b0 2024-09-21T03:52:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.874+0000 7fa7d5e58740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c81af0f0 con 0x55a2b3806390 2024-09-21T03:52:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.874+0000 7fa7d5e58740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c81ae350 con 0x55a2b3827070 2024-09-21T03:52:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.874+0000 7fa7d5e58740 10 client.0 _ll_register_callbacks cb 0x7fa7b8008cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.874+0000 7fa7cce7f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b37fe1b0 0x55a2b3bef900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:26.879 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.874+0000 7fa7cce7f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b37fe1b0 0x55a2b3bef900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:56496/0 (socket says 172.21.15.84:56496) 2024-09-21T03:52:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.874+0000 7fa7cce7f640 1 -- 172.21.15.84:0/1118655510 learned_addr learned my addr 172.21.15.84:0/1118655510 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.874+0000 7fa7cd680640 1 --2- 172.21.15.84:0/1118655510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b3806390 0x55a2b3becdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.874+0000 7fa7cce7f640 1 --2- 172.21.15.84:0/1118655510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2b3827070 0x55a2b3bed4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.874+0000 7fa7cce7f640 1 -- 172.21.15.84:0/1118655510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2b3827070 msgr2=0x55a2b3bed4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.874+0000 7fa7cce7f640 1 --2- 172.21.15.84:0/1118655510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2b3827070 0x55a2b3bed4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.874+0000 7fa7cce7f640 1 -- 172.21.15.84:0/1118655510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b3806390 msgr2=0x55a2b3becdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.875+0000 7fa7cce7f640 1 --2- 172.21.15.84:0/1118655510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b3806390 0x55a2b3becdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.875+0000 7fa7cce7f640 1 -- 172.21.15.84:0/1118655510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2b3c55690 con 0x55a2b37fe1b0 2024-09-21T03:52:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.875+0000 7fa7cd680640 1 --2- 172.21.15.84:0/1118655510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b3806390 0x55a2b3becdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:52:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.875+0000 7fa7cce7f640 1 --2- 172.21.15.84:0/1118655510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b37fe1b0 0x55a2b3bef900 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fa7b801bbe0 tx=0x7fa7b8008ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fe395d32d92ece server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.875+0000 7fa7b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.875+0000 7fa7b0ff9640 1 -- 172.21.15.84:0/1118655510 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b801b900 con 0x55a2b37fe1b0 2024-09-21T03:52:26.880 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.875+0000 7fa7b0ff9640 1 -- 172.21.15.84:0/1118655510 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7fa7b800e520 con 0x55a2b37fe1b0 2024-09-21T03:52:26.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.875+0000 7fa7d5e58740 1 -- 172.21.15.84:0/1118655510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7c4031950 con 0x55a2b37fe1b0 2024-09-21T03:52:26.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.875+0000 7fa7b0ff9640 1 -- 172.21.15.84:0/1118655510 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa7b8049050 con 0x55a2b37fe1b0 2024-09-21T03:52:26.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.875+0000 7fa7d5e58740 10 client.17349 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:26.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.875+0000 7fa7d5e58740 1 -- 172.21.15.84:0/1118655510 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a2b3c567b0 con 0x55a2b37fe1b0 2024-09-21T03:52:26.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.875+0000 7fa7b0ff9640 1 -- 172.21.15.84:0/1118655510 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7c4031950 con 0x55a2b37fe1b0 2024-09-21T03:52:26.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.875+0000 7fa7b0ff9640 1 -- 172.21.15.84:0/1118655510 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa7b8012750 con 0x55a2b37fe1b0 2024-09-21T03:52:26.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.876+0000 7fa7d5e58740 10 client.17349 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:26.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.876+0000 7fa7d5e58740 10 client.17349 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:52:26.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.876+0000 7fa7d5e58740 20 client.17349 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:26.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.876+0000 7fa7d5e58740 1 --2- 172.21.15.84:0/1118655510 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55a2b37bada0 0x55a2b3c58dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:26.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.876+0000 7fa7d5e58740 4 client.17349 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:52:26.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.876+0000 7fa7d5e58740 1 -- 172.21.15.84:0/1118655510 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a2b3b428a0 con 0x55a2b37bada0 2024-09-21T03:52:26.881 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.876+0000 7fa7cd680640 1 --2- 172.21.15.84:0/1118655510 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55a2b37bada0 0x55a2b3c58dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:26.882 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:26 smithi174 ceph-mon[34403]: pgmap v631: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 52 KiB/s wr, 10 op/s 2024-09-21T03:52:26.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.876+0000 7fa7b0ff9640 10 client.17349 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:26.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.876+0000 7fa7cd680640 1 --2- 172.21.15.84:0/1118655510 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55a2b37bada0 0x55a2b3c58dc0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d061496e84b62bad server_cookie=bf7db7062f020cfe in_seq=0 out_seq=0 2024-09-21T03:52:26.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.877+0000 7fa7b0ff9640 1 -- 172.21.15.84:0/1118655510 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a2b3b428a0 con 0x55a2b37bada0 2024-09-21T03:52:26.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.877+0000 7fa7b0ff9640 10 client.17349 handle_command_reply: tid=0 2024-09-21T03:52:26.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.877+0000 7fa7d5e58740 1 client.17349 shutdown 2024-09-21T03:52:26.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.877+0000 7fa7d5e58740 1 -- 172.21.15.84:0/1118655510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b37fe1b0 msgr2=0x55a2b3bef900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:26.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.877+0000 7fa7d5e58740 1 --2- 172.21.15.84:0/1118655510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b37fe1b0 0x55a2b3bef900 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fa7b801bbe0 tx=0x7fa7b8008ae0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.877+0000 7fa7d5e58740 1 -- 172.21.15.84:0/1118655510 shutdown_connections 2024-09-21T03:52:26.883 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.877+0000 7fa7d5e58740 1 --2- 172.21.15.84:0/1118655510 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55a2b37bada0 0x55a2b3c58dc0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.877+0000 7fa7b0ff9640 0 client.17349 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:26.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.877+0000 7fa7d5e58740 1 --2- 172.21.15.84:0/1118655510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a2b3827070 0x55a2b3bed4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.877+0000 7fa7d5e58740 1 --2- 172.21.15.84:0/1118655510 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a2b3806390 0x55a2b3becdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.877+0000 7fa7d5e58740 1 --2- 172.21.15.84:0/1118655510 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55a2b37fe1b0 0x55a2b3bef900 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.877+0000 7fa7d5e58740 1 -- 172.21.15.84:0/1118655510 >> 172.21.15.84:0/1118655510 conn(0x55a2b381b460 msgr2=0x55a2b3bdb890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:26.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.877+0000 7fa7d5e58740 1 -- 172.21.15.84:0/1118655510 shutdown_connections 2024-09-21T03:52:26.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.877+0000 7fa7d5e58740 1 -- 172.21.15.84:0/1118655510 wait complete. 2024-09-21T03:52:26.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.877+0000 7fa7d5e58740 20 client.17349 trim_cache size 0 max 16384 2024-09-21T03:52:26.884 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:52:26.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.878+0000 7fa7cf8e4640 1 -- 172.21.15.84:0/2873140484 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa7b40b66b0 msgr2=0x7fa7b40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:26.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.878+0000 7fa7cf8e4640 1 --2- 172.21.15.84:0/2873140484 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa7b40b66b0 0x7fa7b40b8bc0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00e4f50 tx=0x7fa7c00760c0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.878+0000 7fa7cf8e4640 1 -- 172.21.15.84:0/2873140484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7c8109eb0 msgr2=0x7fa7c819fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:26.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.878+0000 7fa7cf8e4640 1 --2- 172.21.15.84:0/2873140484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7c8109eb0 0x7fa7c819fda0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000cad0 tx=0x7fa7c000cf90 comp rx=0 tx=0).stop 2024-09-21T03:52:26.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.878+0000 7fa7cf8e4640 1 -- 172.21.15.84:0/2873140484 shutdown_connections 2024-09-21T03:52:26.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.878+0000 7fa7cf8e4640 1 --2- 172.21.15.84:0/2873140484 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa7b40b66b0 0x7fa7b40b8bc0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.878+0000 7fa7cf8e4640 1 --2- 172.21.15.84:0/2873140484 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa7c8109eb0 0x7fa7c819fda0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.878+0000 7fa7cf8e4640 1 --2- 172.21.15.84:0/2873140484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7c8109560 0x7fa7c819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.878+0000 7fa7cf8e4640 1 --2- 172.21.15.84:0/2873140484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa7c8102080 0x7fa7c819a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:26.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.878+0000 7fa7cf8e4640 1 -- 172.21.15.84:0/2873140484 >> 172.21.15.84:0/2873140484 conn(0x7fa7c8079ec0 msgr2=0x7fa7c8107610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:26.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.878+0000 7fa7cf8e4640 1 -- 172.21.15.84:0/2873140484 shutdown_connections 2024-09-21T03:52:26.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:26.878+0000 7fa7cf8e4640 1 -- 172.21.15.84:0/2873140484 wait complete. 2024-09-21T03:52:26.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:26 smithi172 ceph-mon[34821]: pgmap v631: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 52 KiB/s wr, 10 op/s 2024-09-21T03:52:28.583 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:52:28.584 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:52:28.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:28 smithi084 ceph-mon[30941]: pgmap v632: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 72 KiB/s wr, 14 op/s 2024-09-21T03:52:28.840 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:28.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:28 smithi174 ceph-mon[34403]: pgmap v632: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 72 KiB/s wr, 14 op/s 2024-09-21T03:52:28.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:28 smithi172 ceph-mon[34821]: pgmap v632: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 72 KiB/s wr, 14 op/s 2024-09-21T03:52:29.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.345+0000 7fbae8a10640 1 -- 172.21.15.84:0/2255755436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae4102a70 msgr2=0x7fbae4102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:29.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.345+0000 7fbae8a10640 1 --2- 172.21.15.84:0/2255755436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae4102a70 0x7fbae4102e80 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fbad4009900 tx=0x7fbad402a410 comp rx=0 tx=0).stop 2024-09-21T03:52:29.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.345+0000 7fbae8a10640 1 -- 172.21.15.84:0/2255755436 shutdown_connections 2024-09-21T03:52:29.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.345+0000 7fbae8a10640 1 --2- 172.21.15.84:0/2255755436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbae4108d00 0x7fbae410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.345+0000 7fbae8a10640 1 --2- 172.21.15.84:0/2255755436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbae41083b0 0x7fbae41087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.345+0000 7fbae8a10640 1 --2- 172.21.15.84:0/2255755436 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae4102a70 0x7fbae4102e80 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.345+0000 7fbae8a10640 1 -- 172.21.15.84:0/2255755436 >> 172.21.15.84:0/2255755436 conn(0x7fbae4079710 msgr2=0x7fbae4079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:29.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.345+0000 7fbae8a10640 1 -- 172.21.15.84:0/2255755436 shutdown_connections 2024-09-21T03:52:29.361 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.345+0000 7fbae8a10640 1 -- 172.21.15.84:0/2255755436 wait complete. 2024-09-21T03:52:29.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.346+0000 7fbae8a10640 1 Processor -- start 2024-09-21T03:52:29.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.346+0000 7fbae8a10640 1 -- start start 2024-09-21T03:52:29.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.346+0000 7fbae8a10640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae4102a70 0x7fbae4110010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.346+0000 7fbae8a10640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbae41083b0 0x7fbae4110550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.346+0000 7fbae8a10640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbae4108d00 0x7fbae4110a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.346+0000 7fbae8a10640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbae4113b40 con 0x7fbae4102a70 2024-09-21T03:52:29.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.346+0000 7fbae8a10640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbae41139c0 con 0x7fbae41083b0 2024-09-21T03:52:29.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.346+0000 7fbae8a10640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbae4113cc0 con 0x7fbae4108d00 2024-09-21T03:52:29.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.347+0000 7fbae259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae4102a70 0x7fbae4110010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.347+0000 7fbae259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae4102a70 0x7fbae4110010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34036/0 (socket says 172.21.15.84:34036) 2024-09-21T03:52:29.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.347+0000 7fbae259c640 1 -- 172.21.15.84:0/1261713051 learned_addr learned my addr 172.21.15.84:0/1261713051 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:29.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.347+0000 7fbae2d9d640 1 --2- 172.21.15.84:0/1261713051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbae4108d00 0x7fbae4110a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.347+0000 7fbae1d9b640 1 --2- 172.21.15.84:0/1261713051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbae41083b0 0x7fbae4110550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.347+0000 7fbae259c640 1 -- 172.21.15.84:0/1261713051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbae4108d00 msgr2=0x7fbae4110a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:29.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.347+0000 7fbae259c640 1 --2- 172.21.15.84:0/1261713051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbae4108d00 0x7fbae4110a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.347+0000 7fbae259c640 1 -- 172.21.15.84:0/1261713051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbae41083b0 msgr2=0x7fbae4110550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:29.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.347+0000 7fbae259c640 1 --2- 172.21.15.84:0/1261713051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbae41083b0 0x7fbae4110550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.347+0000 7fbae259c640 1 -- 172.21.15.84:0/1261713051 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae41a8870 con 0x7fbae4102a70 2024-09-21T03:52:29.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.347+0000 7fbae259c640 1 --2- 172.21.15.84:0/1261713051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae4102a70 0x7fbae4110010 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fbad4006010 tx=0x7fbad40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:29.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.347+0000 7fbad37fe640 1 -- 172.21.15.84:0/1261713051 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad403f030 con 0x7fbae4102a70 2024-09-21T03:52:29.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.347+0000 7fbad37fe640 1 -- 172.21.15.84:0/1261713051 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbad4003800 con 0x7fbae4102a70 2024-09-21T03:52:29.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.347+0000 7fbae8a10640 1 -- 172.21.15.84:0/1261713051 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbae41a8b00 con 0x7fbae4102a70 2024-09-21T03:52:29.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.348+0000 7fbad37fe640 1 -- 172.21.15.84:0/1261713051 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad4035070 con 0x7fbae4102a70 2024-09-21T03:52:29.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.348+0000 7fbae8a10640 1 -- 172.21.15.84:0/1261713051 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbae41a8fe0 con 0x7fbae4102a70 2024-09-21T03:52:29.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.350+0000 7fbaeef84740 1 Processor -- start 2024-09-21T03:52:29.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.350+0000 7fbaeef84740 1 -- start start 2024-09-21T03:52:29.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.350+0000 7fbad37fe640 1 -- 172.21.15.84:0/1261713051 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fbad4003cb0 con 0x7fbae4102a70 2024-09-21T03:52:29.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.351+0000 7fbaeef84740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafedb350 0x563db0282430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.351+0000 7fbaeef84740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeb2490 0x563db0282970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.351+0000 7fbaeef84740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafeba670 0x563db0282eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.351+0000 7fbaeef84740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563db01f8e60 con 0x563dafeb2490 2024-09-21T03:52:29.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.351+0000 7fbaeef84740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563db01e8290 con 0x563dafedb350 2024-09-21T03:52:29.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.351+0000 7fbaeef84740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x563db01ec0a0 con 0x563dafeba670 2024-09-21T03:52:29.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.351+0000 7fbae2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafedb350 0x563db0282430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.351+0000 7fbae2d9d640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafedb350 0x563db0282430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:49786/0 (socket says 172.21.15.84:49786) 2024-09-21T03:52:29.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.351+0000 7fbae2d9d640 1 -- 172.21.15.84:0/3724548036 learned_addr learned my addr 172.21.15.84:0/3724548036 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:29.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.351+0000 7fbae1d9b640 1 --2- 172.21.15.84:0/3724548036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafeba670 0x563db0282eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.364 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.352+0000 7fbae259c640 1 --2- 172.21.15.84:0/3724548036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeb2490 0x563db0282970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.353+0000 7fbae1d9b640 1 -- 172.21.15.84:0/3724548036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafedb350 msgr2=0x563db0282430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:29.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.353+0000 7fbae1d9b640 1 --2- 172.21.15.84:0/3724548036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafedb350 0x563db0282430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.353+0000 7fbae1d9b640 1 -- 172.21.15.84:0/3724548036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeb2490 msgr2=0x563db0282970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:29.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.353+0000 7fbae1d9b640 1 --2- 172.21.15.84:0/3724548036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeb2490 0x563db0282970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.353+0000 7fbae1d9b640 1 -- 172.21.15.84:0/3724548036 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563daff46930 con 0x563dafeba670 2024-09-21T03:52:29.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.353+0000 7fbad37fe640 1 --2- 172.21.15.84:0/1261713051 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbacc0b6680 0x7fbacc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.353+0000 7fbae1d9b640 1 --2- 172.21.15.84:0/3724548036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafeba670 0x563db0282eb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbad80058c0 tx=0x7fbad800f3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1b6f814ffd9388d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:29.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.354+0000 7fbad37fe640 1 -- 172.21.15.84:0/1261713051 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7fbad4108030 con 0x7fbae4102a70 2024-09-21T03:52:29.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.354+0000 7fbad0ff9640 1 -- 172.21.15.84:0/3724548036 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8004020 con 0x563dafeba670 2024-09-21T03:52:29.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.354+0000 7fbae2d9d640 1 --2- 172.21.15.84:0/1261713051 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbacc0b6680 0x7fbacc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.354+0000 7fbad0ff9640 1 -- 172.21.15.84:0/3724548036 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbad80041c0 con 0x563dafeba670 2024-09-21T03:52:29.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.354+0000 7fbad0ff9640 1 -- 172.21.15.84:0/3724548036 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8018730 con 0x563dafeba670 2024-09-21T03:52:29.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.355+0000 7fbaeef84740 1 -- 172.21.15.84:0/3724548036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafeba670 msgr2=0x563db0282eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:29.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.355+0000 7fbae2d9d640 1 --2- 172.21.15.84:0/1261713051 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbacc0b6680 0x7fbacc0b8b90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00a510 tx=0x7fbadc00d040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:29.365 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.355+0000 7fbaeef84740 1 --2- 172.21.15.84:0/3724548036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafeba670 0x563db0282eb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbad80058c0 tx=0x7fbad800f3c0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.355+0000 7fbaeef84740 1 -- 172.21.15.84:0/3724548036 shutdown_connections 2024-09-21T03:52:29.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.355+0000 7fbaeef84740 1 --2- 172.21.15.84:0/3724548036 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafeba670 0x563db0282eb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.355+0000 7fbaeef84740 1 --2- 172.21.15.84:0/3724548036 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeb2490 0x563db0282970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.355+0000 7fbaeef84740 1 --2- 172.21.15.84:0/3724548036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafedb350 0x563db0282430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.355+0000 7fbaeef84740 1 -- 172.21.15.84:0/3724548036 >> 172.21.15.84:0/3724548036 conn(0x563dafecf740 msgr2=0x563db0280320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:29.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.355+0000 7fbaeef84740 1 -- 172.21.15.84:0/3724548036 shutdown_connections 2024-09-21T03:52:29.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.355+0000 7fbaeef84740 1 -- 172.21.15.84:0/3724548036 wait complete. 2024-09-21T03:52:29.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.356+0000 7fbaeef84740 1 -- start start 2024-09-21T03:52:29.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.356+0000 7fbaeef84740 1 Processor -- start 2024-09-21T03:52:29.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.356+0000 7fbaeef84740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeb2490 0x563db028dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.356+0000 7fbaeef84740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafeba670 0x563db028e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.356+0000 7fbaeef84740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafedb350 0x563db0299f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.356+0000 7fbaeef84740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563db0049890 con 0x563dafeb2490 2024-09-21T03:52:29.366 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.356+0000 7fbaeef84740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563db0182d40 con 0x563dafedb350 2024-09-21T03:52:29.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.356+0000 7fbaeef84740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x563db0290c10 con 0x563dafeba670 2024-09-21T03:52:29.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.356+0000 7fbaeef84740 10 client.0 _ll_register_callbacks cb 0x563db01e6c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:29.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.356+0000 7fbae259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeb2490 0x563db028dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.356+0000 7fbae259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeb2490 0x563db028dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34060/0 (socket says 172.21.15.84:34060) 2024-09-21T03:52:29.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.356+0000 7fbae259c640 1 -- 172.21.15.84:0/3089323567 learned_addr learned my addr 172.21.15.84:0/3089323567 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:29.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.357+0000 7fbae1d9b640 1 --2- 172.21.15.84:0/3089323567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafeba670 0x563db028e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.357+0000 7fbae2d9d640 1 --2- 172.21.15.84:0/3089323567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafedb350 0x563db0299f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.357+0000 7fbae259c640 1 -- 172.21.15.84:0/3089323567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafeba670 msgr2=0x563db028e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:29.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.357+0000 7fbae259c640 1 --2- 172.21.15.84:0/3089323567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafeba670 0x563db028e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.357+0000 7fbae259c640 1 -- 172.21.15.84:0/3089323567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafedb350 msgr2=0x563db0299f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:29.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.357+0000 7fbae259c640 1 --2- 172.21.15.84:0/3089323567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafedb350 0x563db0299f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.357+0000 7fbae259c640 1 -- 172.21.15.84:0/3089323567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563db029a490 con 0x563dafeb2490 2024-09-21T03:52:29.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.357+0000 7fbae259c640 1 --2- 172.21.15.84:0/3089323567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeb2490 0x563db028dfd0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fbad404a000 tx=0x7fbad410bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccadc4fa160a40b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:29.367 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.357+0000 7fbac9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:29.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.357+0000 7fbac9ffb640 1 -- 172.21.15.84:0/3089323567 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad4049070 con 0x563dafeb2490 2024-09-21T03:52:29.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.357+0000 7fbac9ffb640 1 -- 172.21.15.84:0/3089323567 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7fbad410a110 con 0x563dafeb2490 2024-09-21T03:52:29.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.357+0000 7fbaeef84740 1 -- 172.21.15.84:0/3089323567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbad80041c0 con 0x563dafeb2490 2024-09-21T03:52:29.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.357+0000 7fbac9ffb640 1 -- 172.21.15.84:0/3089323567 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbad40c9e20 con 0x563dafeb2490 2024-09-21T03:52:29.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.358+0000 7fbaeef84740 10 client.17361 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:29.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.358+0000 7fbaeef84740 1 -- 172.21.15.84:0/3089323567 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563db029cdc0 con 0x563dafeb2490 2024-09-21T03:52:29.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.358+0000 7fbac9ffb640 1 -- 172.21.15.84:0/3089323567 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbad80041c0 con 0x563dafeb2490 2024-09-21T03:52:29.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.358+0000 7fbac9ffb640 1 -- 172.21.15.84:0/3089323567 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbad40d7460 con 0x563dafeb2490 2024-09-21T03:52:29.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.358+0000 7fbaeef84740 10 client.17361 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:29.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.358+0000 7fbaeef84740 10 client.17361 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:52:29.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.358+0000 7fbaeef84740 20 client.17361 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:29.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.358+0000 7fbaeef84740 1 --2- 172.21.15.84:0/3089323567 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x563dafe99cd0 0x563db02a02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.358+0000 7fbaeef84740 4 client.17361 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:52:29.368 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.358+0000 7fbaeef84740 1 -- 172.21.15.84:0/3089323567 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563db01fadb0 con 0x563dafe99cd0 2024-09-21T03:52:29.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.358+0000 7fbae1d9b640 1 --2- 172.21.15.84:0/3089323567 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x563dafe99cd0 0x563db02a02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.359+0000 7fbac9ffb640 10 client.17361 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:29.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.359+0000 7fbae1d9b640 1 --2- 172.21.15.84:0/3089323567 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x563dafe99cd0 0x563db02a02d0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19b6a821e6d65bdb server_cookie=21bdc77fddf28f43 in_seq=0 out_seq=0 2024-09-21T03:52:29.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.359+0000 7fbac9ffb640 1 -- 172.21.15.84:0/3089323567 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563db01fadb0 con 0x563dafe99cd0 2024-09-21T03:52:29.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.359+0000 7fbac9ffb640 10 client.17361 handle_command_reply: tid=0 2024-09-21T03:52:29.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.359+0000 7fbaeef84740 1 client.17361 shutdown 2024-09-21T03:52:29.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.360+0000 7fbaeef84740 1 -- 172.21.15.84:0/3089323567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeb2490 msgr2=0x563db028dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:29.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.360+0000 7fbaeef84740 1 --2- 172.21.15.84:0/3089323567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeb2490 0x563db028dfd0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fbad404a000 tx=0x7fbad410bf60 comp rx=0 tx=0).stop 2024-09-21T03:52:29.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.360+0000 7fbaeef84740 1 -- 172.21.15.84:0/3089323567 shutdown_connections 2024-09-21T03:52:29.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.360+0000 7fbaeef84740 1 --2- 172.21.15.84:0/3089323567 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x563dafe99cd0 0x563db02a02d0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.360+0000 7fbaeef84740 1 --2- 172.21.15.84:0/3089323567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafedb350 0x563db0299f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.360+0000 7fbaeef84740 1 --2- 172.21.15.84:0/3089323567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafeba670 0x563db028e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.360+0000 7fbac9ffb640 0 client.17361 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:29.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.360+0000 7fbaeef84740 1 --2- 172.21.15.84:0/3089323567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeb2490 0x563db028dfd0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.360+0000 7fbaeef84740 1 -- 172.21.15.84:0/3089323567 >> 172.21.15.84:0/3089323567 conn(0x563dafecf740 msgr2=0x563db0285610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:29.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.360+0000 7fbaeef84740 1 -- 172.21.15.84:0/3089323567 shutdown_connections 2024-09-21T03:52:29.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.360+0000 7fbaeef84740 1 -- 172.21.15.84:0/3089323567 wait complete. 2024-09-21T03:52:29.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.360+0000 7fbaeef84740 20 client.17361 trim_cache size 0 max 16384 2024-09-21T03:52:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.377+0000 7fbaeef84740 1 Processor -- start 2024-09-21T03:52:29.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.377+0000 7fbaeef84740 1 -- start start 2024-09-21T03:52:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.378+0000 7fbaeef84740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafe99cd0 0x563db0299e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.378+0000 7fbaeef84740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeb2490 0x563db0288550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.378+0000 7fbaeef84740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafeba670 0x563db028afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.378+0000 7fbaeef84740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbae41b4170 con 0x563dafeb2490 2024-09-21T03:52:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.378+0000 7fbaeef84740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbae41b1a40 con 0x563dafe99cd0 2024-09-21T03:52:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.378+0000 7fbaeef84740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbae41af8b0 con 0x563dafeba670 2024-09-21T03:52:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.378+0000 7fbae1d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeb2490 0x563db0288550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.378+0000 7fbae1d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeb2490 0x563db0288550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34076/0 (socket says 172.21.15.84:34076) 2024-09-21T03:52:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.378+0000 7fbae1d9b640 1 -- 172.21.15.84:0/2401013777 learned_addr learned my addr 172.21.15.84:0/2401013777 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.378+0000 7fbae259c640 1 --2- 172.21.15.84:0/2401013777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafe99cd0 0x563db0299e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.378+0000 7fbae2d9d640 1 --2- 172.21.15.84:0/2401013777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafeba670 0x563db028afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.378+0000 7fbae1d9b640 1 -- 172.21.15.84:0/2401013777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafeba670 msgr2=0x563db028afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:29.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.378+0000 7fbae1d9b640 1 --2- 172.21.15.84:0/2401013777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafeba670 0x563db028afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.378+0000 7fbae1d9b640 1 -- 172.21.15.84:0/2401013777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafe99cd0 msgr2=0x563db0299e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:29.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.378+0000 7fbae1d9b640 1 --2- 172.21.15.84:0/2401013777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafe99cd0 0x563db0299e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.378+0000 7fbae1d9b640 1 -- 172.21.15.84:0/2401013777 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563db0284720 con 0x563dafeb2490 2024-09-21T03:52:29.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.378+0000 7fbae259c640 1 --2- 172.21.15.84:0/2401013777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafe99cd0 0x563db0299e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:52:29.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.378+0000 7fbae1d9b640 1 --2- 172.21.15.84:0/2401013777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeb2490 0x563db0288550 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fbad800aa90 tx=0x7fbad800a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e51113dbf4216ac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:29.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.378+0000 7fbacbfff640 1 -- 172.21.15.84:0/2401013777 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8030070 con 0x563dafeb2490 2024-09-21T03:52:29.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.379+0000 7fbacbfff640 1 -- 172.21.15.84:0/2401013777 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbad8005040 con 0x563dafeb2490 2024-09-21T03:52:29.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.379+0000 7fbacbfff640 1 -- 172.21.15.84:0/2401013777 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad80035f0 con 0x563dafeb2490 2024-09-21T03:52:29.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.379+0000 7fbaeef84740 1 -- 172.21.15.84:0/2401013777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeb2490 msgr2=0x563db0288550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:29.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.379+0000 7fbaeef84740 1 --2- 172.21.15.84:0/2401013777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeb2490 0x563db0288550 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fbad800aa90 tx=0x7fbad800a250 comp rx=0 tx=0).stop 2024-09-21T03:52:29.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.379+0000 7fbaeef84740 1 -- 172.21.15.84:0/2401013777 shutdown_connections 2024-09-21T03:52:29.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.379+0000 7fbaeef84740 1 --2- 172.21.15.84:0/2401013777 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafeba670 0x563db028afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.379+0000 7fbaeef84740 1 --2- 172.21.15.84:0/2401013777 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeb2490 0x563db0288550 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.379+0000 7fbaeef84740 1 --2- 172.21.15.84:0/2401013777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafe99cd0 0x563db0299e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.379+0000 7fbaeef84740 1 -- 172.21.15.84:0/2401013777 >> 172.21.15.84:0/2401013777 conn(0x563dafecf740 msgr2=0x563db028c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.379+0000 7fbaeef84740 1 -- 172.21.15.84:0/2401013777 shutdown_connections 2024-09-21T03:52:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.379+0000 7fbaeef84740 1 -- 172.21.15.84:0/2401013777 wait complete. 2024-09-21T03:52:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.380+0000 7fbaeef84740 1 -- start start 2024-09-21T03:52:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.380+0000 7fbaeef84740 1 Processor -- start 2024-09-21T03:52:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.380+0000 7fbaeef84740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafe99cd0 0x563db02965c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.380+0000 7fbaeef84740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeba670 0x563db0292a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.380+0000 7fbaeef84740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafedb350 0x563db0292fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.380+0000 7fbaeef84740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fbae41aff00 con 0x563dafeba670 2024-09-21T03:52:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.380+0000 7fbaeef84740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbae41b1370 con 0x563dafedb350 2024-09-21T03:52:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.380+0000 7fbaeef84740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fbae41b05d0 con 0x563dafe99cd0 2024-09-21T03:52:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.380+0000 7fbaeef84740 10 client.0 _ll_register_callbacks cb 0x7fbad410b870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:29.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.380+0000 7fbae1d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeba670 0x563db0292a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.380+0000 7fbae1d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeba670 0x563db0292a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34084/0 (socket says 172.21.15.84:34084) 2024-09-21T03:52:29.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.380+0000 7fbae1d9b640 1 -- 172.21.15.84:0/2214413684 learned_addr learned my addr 172.21.15.84:0/2214413684 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:29.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.380+0000 7fbae259c640 1 --2- 172.21.15.84:0/2214413684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafe99cd0 0x563db02965c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.380+0000 7fbae2d9d640 1 --2- 172.21.15.84:0/2214413684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafedb350 0x563db0292fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.381+0000 7fbae1d9b640 1 -- 172.21.15.84:0/2214413684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafe99cd0 msgr2=0x563db02965c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:29.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.381+0000 7fbae1d9b640 1 --2- 172.21.15.84:0/2214413684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafe99cd0 0x563db02965c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.381+0000 7fbae1d9b640 1 -- 172.21.15.84:0/2214413684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafedb350 msgr2=0x563db0292fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:29.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.381+0000 7fbae1d9b640 1 --2- 172.21.15.84:0/2214413684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafedb350 0x563db0292fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.381+0000 7fbae1d9b640 1 -- 172.21.15.84:0/2214413684 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563db02936b0 con 0x563dafeba670 2024-09-21T03:52:29.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.381+0000 7fbae1d9b640 1 --2- 172.21.15.84:0/2214413684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeba670 0x563db0292a80 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fbad802e040 tx=0x7fbad800a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae87857a4c7d0520 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:29.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.381+0000 7fbac9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:29.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.381+0000 7fbac9ffb640 1 -- 172.21.15.84:0/2214413684 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8030030 con 0x563dafeba670 2024-09-21T03:52:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.381+0000 7fbac9ffb640 1 -- 172.21.15.84:0/2214413684 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7fbad802a040 con 0x563dafeba670 2024-09-21T03:52:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.381+0000 7fbaeef84740 1 -- 172.21.15.84:0/2214413684 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbad8005040 con 0x563dafeba670 2024-09-21T03:52:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.381+0000 7fbac9ffb640 1 -- 172.21.15.84:0/2214413684 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbad80051f0 con 0x563dafeba670 2024-09-21T03:52:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.381+0000 7fbaeef84740 10 client.17367 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.381+0000 7fbaeef84740 1 -- 172.21.15.84:0/2214413684 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563db030baf0 con 0x563dafeba670 2024-09-21T03:52:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.381+0000 7fbac9ffb640 1 -- 172.21.15.84:0/2214413684 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbad8005040 con 0x563dafeba670 2024-09-21T03:52:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.382+0000 7fbac9ffb640 1 -- 172.21.15.84:0/2214413684 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbad8004660 con 0x563dafeba670 2024-09-21T03:52:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.382+0000 7fbaeef84740 10 client.17367 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.382+0000 7fbaeef84740 10 client.17367 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:52:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.382+0000 7fbaeef84740 20 client.17367 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.382+0000 7fbaeef84740 1 --2- 172.21.15.84:0/2214413684 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x563dafe6f080 0x563db030df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.382+0000 7fbaeef84740 4 client.17367 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:52:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.382+0000 7fbaeef84740 1 -- 172.21.15.84:0/2214413684 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563db01f6860 con 0x563dafe6f080 2024-09-21T03:52:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.382+0000 7fbae259c640 1 --2- 172.21.15.84:0/2214413684 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x563dafe6f080 0x563db030df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.382+0000 7fbae259c640 1 --2- 172.21.15.84:0/2214413684 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x563dafe6f080 0x563db030df70 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=104e064ca3c749fd server_cookie=4242b26e4897285c in_seq=0 out_seq=0 2024-09-21T03:52:29.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.382+0000 7fbac9ffb640 10 client.17367 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:29.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.384+0000 7fbac9ffb640 1 -- 172.21.15.84:0/2214413684 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563db01f6860 con 0x563dafe6f080 2024-09-21T03:52:29.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.384+0000 7fbac9ffb640 10 client.17367 handle_command_reply: tid=0 2024-09-21T03:52:29.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.384+0000 7fbaeef84740 1 client.17367 shutdown 2024-09-21T03:52:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.384+0000 7fbaeef84740 1 -- 172.21.15.84:0/2214413684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeba670 msgr2=0x563db0292a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.384+0000 7fbaeef84740 1 --2- 172.21.15.84:0/2214413684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeba670 0x563db0292a80 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fbad802e040 tx=0x7fbad800a8a0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.384+0000 7fbaeef84740 1 -- 172.21.15.84:0/2214413684 shutdown_connections 2024-09-21T03:52:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.384+0000 7fbaeef84740 1 --2- 172.21.15.84:0/2214413684 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x563dafe6f080 0x563db030df70 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.384+0000 7fbaeef84740 1 --2- 172.21.15.84:0/2214413684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563dafedb350 0x563db0292fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.384+0000 7fbaeef84740 1 --2- 172.21.15.84:0/2214413684 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563dafeba670 0x563db0292a80 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.384+0000 7fbaeef84740 1 --2- 172.21.15.84:0/2214413684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563dafe99cd0 0x563db02965c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.384+0000 7fbaeef84740 1 -- 172.21.15.84:0/2214413684 >> 172.21.15.84:0/2214413684 conn(0x563dafecf740 msgr2=0x563db0283460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.384+0000 7fbac9ffb640 0 client.17367 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.385+0000 7fbaeef84740 1 -- 172.21.15.84:0/2214413684 shutdown_connections 2024-09-21T03:52:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.385+0000 7fbaeef84740 1 -- 172.21.15.84:0/2214413684 wait complete. 2024-09-21T03:52:29.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.385+0000 7fbaeef84740 20 client.17367 trim_cache size 0 max 16384 2024-09-21T03:52:29.391 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:52:29.391 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T03:52:29.391 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "1583169c-207f-40ad-b200-4ef92de62783", 2024-09-21T03:52:29.391 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T03:52:29.391 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:52:29.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.385+0000 7fbae8a10640 1 -- 172.21.15.84:0/1261713051 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbacc0b6680 msgr2=0x7fbacc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:29.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.385+0000 7fbae8a10640 1 --2- 172.21.15.84:0/1261713051 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbacc0b6680 0x7fbacc0b8b90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00a510 tx=0x7fbadc00d040 comp rx=0 tx=0).stop 2024-09-21T03:52:29.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.385+0000 7fbae8a10640 1 -- 172.21.15.84:0/1261713051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae4102a70 msgr2=0x7fbae4110010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:29.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.385+0000 7fbae8a10640 1 --2- 172.21.15.84:0/1261713051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae4102a70 0x7fbae4110010 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fbad4006010 tx=0x7fbad40042f0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.385+0000 7fbae8a10640 1 -- 172.21.15.84:0/1261713051 shutdown_connections 2024-09-21T03:52:29.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.385+0000 7fbae8a10640 1 --2- 172.21.15.84:0/1261713051 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fbacc0b6680 0x7fbacc0b8b90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.385+0000 7fbae8a10640 1 --2- 172.21.15.84:0/1261713051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbae4108d00 0x7fbae4110a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.385+0000 7fbae8a10640 1 --2- 172.21.15.84:0/1261713051 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbae41083b0 0x7fbae4110550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.385+0000 7fbae8a10640 1 --2- 172.21.15.84:0/1261713051 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fbae4102a70 0x7fbae4110010 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:29.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.385+0000 7fbae8a10640 1 -- 172.21.15.84:0/1261713051 >> 172.21.15.84:0/1261713051 conn(0x7fbae4079710 msgr2=0x7fbae41064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:29.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.386+0000 7fbae8a10640 1 -- 172.21.15.84:0/1261713051 shutdown_connections 2024-09-21T03:52:29.392 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:29.386+0000 7fbae8a10640 1 -- 172.21.15.84:0/1261713051 wait complete. 2024-09-21T03:52:30.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:29 smithi084 ceph-mon[30941]: scrub queued for path: / 2024-09-21T03:52:30.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:29 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:52:30.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:29 smithi084 ceph-mon[30941]: scrub summary: active paths [/] 2024-09-21T03:52:30.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:29 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:52:30.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:29 smithi084 ceph-mon[30941]: scrub summary: idle 2024-09-21T03:52:30.100 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:52:30.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:29 smithi174 ceph-mon[34403]: scrub queued for path: / 2024-09-21T03:52:30.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:29 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:52:30.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:29 smithi174 ceph-mon[34403]: scrub summary: active paths [/] 2024-09-21T03:52:30.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:29 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:52:30.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:29 smithi174 ceph-mon[34403]: scrub summary: idle 2024-09-21T03:52:30.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:29 smithi172 ceph-mon[34821]: scrub queued for path: / 2024-09-21T03:52:30.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:29 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:52:30.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:29 smithi172 ceph-mon[34821]: scrub summary: active paths [/] 2024-09-21T03:52:30.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:29 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:52:30.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:29 smithi172 ceph-mon[34821]: scrub summary: idle 2024-09-21T03:52:30.351 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:30.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.853+0000 7f6b5c92c640 1 -- 172.21.15.84:0/165510665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b58104a10 msgr2=0x7f6b58104e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:30.865 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.853+0000 7f6b5c92c640 1 --2- 172.21.15.84:0/165510665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b58104a10 0x7f6b58104e20 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009ca0 tx=0x7f6b4802a8e0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.853+0000 7f6b5c92c640 1 -- 172.21.15.84:0/165510665 shutdown_connections 2024-09-21T03:52:30.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.853+0000 7f6b5c92c640 1 --2- 172.21.15.84:0/165510665 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b5810de40 0x7f6b58110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.853+0000 7f6b5c92c640 1 --2- 172.21.15.84:0/165510665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b58105360 0x7f6b5810d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.853+0000 7f6b5c92c640 1 --2- 172.21.15.84:0/165510665 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b58104a10 0x7f6b58104e20 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.853+0000 7f6b5c92c640 1 -- 172.21.15.84:0/165510665 >> 172.21.15.84:0/165510665 conn(0x7f6b58079790 msgr2=0x7f6b58079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:30.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.853+0000 7f6b5c92c640 1 -- 172.21.15.84:0/165510665 shutdown_connections 2024-09-21T03:52:30.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.853+0000 7f6b5c92c640 1 -- 172.21.15.84:0/165510665 wait complete. 2024-09-21T03:52:30.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.854+0000 7f6b5c92c640 1 Processor -- start 2024-09-21T03:52:30.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.854+0000 7f6b5c92c640 1 -- start start 2024-09-21T03:52:30.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.854+0000 7f6b5c92c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b58104a10 0x7f6b5819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:30.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.854+0000 7f6b5c92c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b58105360 0x7f6b5819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:30.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.854+0000 7f6b5c92c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b5810de40 0x7f6b5819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:30.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.854+0000 7f6b5c92c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6b58113ae0 con 0x7f6b5810de40 2024-09-21T03:52:30.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.854+0000 7f6b5c92c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6b58113960 con 0x7f6b58104a10 2024-09-21T03:52:30.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.854+0000 7f6b5c92c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6b58113c60 con 0x7f6b58105360 2024-09-21T03:52:30.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.854+0000 7f6b56d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b5810de40 0x7f6b5819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:30.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.855+0000 7f6b56d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b5810de40 0x7f6b5819fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34114/0 (socket says 172.21.15.84:34114) 2024-09-21T03:52:30.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.855+0000 7f6b56d9d640 1 -- 172.21.15.84:0/3336311937 learned_addr learned my addr 172.21.15.84:0/3336311937 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:30.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.855+0000 7f6b55d9b640 1 --2- 172.21.15.84:0/3336311937 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b58105360 0x7f6b5819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:30.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.855+0000 7f6b5659c640 1 --2- 172.21.15.84:0/3336311937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b58104a10 0x7f6b5819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:30.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.855+0000 7f6b56d9d640 1 -- 172.21.15.84:0/3336311937 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b58105360 msgr2=0x7f6b5819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:30.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.855+0000 7f6b56d9d640 1 --2- 172.21.15.84:0/3336311937 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b58105360 0x7f6b5819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.855+0000 7f6b56d9d640 1 -- 172.21.15.84:0/3336311937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b58104a10 msgr2=0x7f6b5819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:30.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.855+0000 7f6b56d9d640 1 --2- 172.21.15.84:0/3336311937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b58104a10 0x7f6b5819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.855+0000 7f6b56d9d640 1 -- 172.21.15.84:0/3336311937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b581a0500 con 0x7f6b5810de40 2024-09-21T03:52:30.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.855+0000 7f6b56d9d640 1 --2- 172.21.15.84:0/3336311937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b5810de40 0x7f6b5819fdd0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000c970 tx=0x7f6b5000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:30.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.855+0000 7f6b4f7fe640 1 -- 172.21.15.84:0/3336311937 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b50007bb0 con 0x7f6b5810de40 2024-09-21T03:52:30.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.855+0000 7f6b5c92c640 1 -- 172.21.15.84:0/3336311937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b581a07f0 con 0x7f6b5810de40 2024-09-21T03:52:30.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.855+0000 7f6b4f7fe640 1 -- 172.21.15.84:0/3336311937 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b50007d50 con 0x7f6b5810de40 2024-09-21T03:52:30.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.855+0000 7f6b4f7fe640 1 -- 172.21.15.84:0/3336311937 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b50004e60 con 0x7f6b5810de40 2024-09-21T03:52:30.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.855+0000 7f6b5c92c640 1 -- 172.21.15.84:0/3336311937 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b581a6f50 con 0x7f6b5810de40 2024-09-21T03:52:30.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.858+0000 7f6b62ea0740 1 Processor -- start 2024-09-21T03:52:30.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.858+0000 7f6b4f7fe640 1 -- 172.21.15.84:0/3336311937 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f6b50005020 con 0x7f6b5810de40 2024-09-21T03:52:30.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.858+0000 7f6b62ea0740 1 -- start start 2024-09-21T03:52:30.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.858+0000 7f6b62ea0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef6c070 0x55e20f313650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:30.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.858+0000 7f6b62ea0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef431b0 0x55e20f313b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:30.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b62ea0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e20ef4b390 0x55e20f3140d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:30.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b62ea0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e20f289e50 con 0x55e20ef6c070 2024-09-21T03:52:30.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b62ea0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e20f279280 con 0x55e20ef431b0 2024-09-21T03:52:30.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b62ea0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e20f27d090 con 0x55e20ef4b390 2024-09-21T03:52:30.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b55d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef6c070 0x55e20f313650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:30.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b55d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef6c070 0x55e20f313650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34130/0 (socket says 172.21.15.84:34130) 2024-09-21T03:52:30.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b55d9b640 1 -- 172.21.15.84:0/1168904128 learned_addr learned my addr 172.21.15.84:0/1168904128 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:30.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b5659c640 1 --2- 172.21.15.84:0/1168904128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef431b0 0x55e20f313b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:30.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b55d9b640 1 --2- 172.21.15.84:0/1168904128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e20ef4b390 0x55e20f3140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:30.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b55d9b640 1 -- 172.21.15.84:0/1168904128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e20ef4b390 msgr2=0x55e20f3140d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:30.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b55d9b640 1 --2- 172.21.15.84:0/1168904128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e20ef4b390 0x55e20f3140d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b55d9b640 1 -- 172.21.15.84:0/1168904128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef431b0 msgr2=0x55e20f313b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:30.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b55d9b640 1 --2- 172.21.15.84:0/1168904128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef431b0 0x55e20f313b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b55d9b640 1 -- 172.21.15.84:0/1168904128 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e20efd7650 con 0x55e20ef6c070 2024-09-21T03:52:30.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b5659c640 1 --2- 172.21.15.84:0/1168904128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef431b0 0x55e20f313b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:52:30.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b55d9b640 1 --2- 172.21.15.84:0/1168904128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef6c070 0x55e20f313650 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f6b40006aa0 tx=0x7f6b4000b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660e64055d59295f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:30.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b4f7fe640 1 --2- 172.21.15.84:0/3336311937 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6b440b6680 0x7f6b440b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:30.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b4cff9640 1 -- 172.21.15.84:0/1168904128 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b400173f0 con 0x55e20ef6c070 2024-09-21T03:52:30.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b5659c640 1 --2- 172.21.15.84:0/3336311937 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6b440b6680 0x7f6b440b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:30.870 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b4cff9640 1 -- 172.21.15.84:0/1168904128 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b40010040 con 0x55e20ef6c070 2024-09-21T03:52:30.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.859+0000 7f6b4cff9640 1 -- 172.21.15.84:0/1168904128 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b400169e0 con 0x55e20ef6c070 2024-09-21T03:52:30.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.860+0000 7f6b4f7fe640 1 -- 172.21.15.84:0/3336311937 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f6b500e7430 con 0x7f6b5810de40 2024-09-21T03:52:30.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.860+0000 7f6b62ea0740 1 -- 172.21.15.84:0/1168904128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef6c070 msgr2=0x55e20f313650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:30.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.860+0000 7f6b5659c640 1 --2- 172.21.15.84:0/3336311937 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6b440b6680 0x7f6b440b8b90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009a60 tx=0x7f6b48009890 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:30.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.860+0000 7f6b62ea0740 1 --2- 172.21.15.84:0/1168904128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef6c070 0x55e20f313650 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f6b40006aa0 tx=0x7f6b4000b400 comp rx=0 tx=0).stop 2024-09-21T03:52:30.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.861+0000 7f6b62ea0740 1 -- 172.21.15.84:0/1168904128 shutdown_connections 2024-09-21T03:52:30.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.861+0000 7f6b62ea0740 1 --2- 172.21.15.84:0/1168904128 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e20ef4b390 0x55e20f3140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.861+0000 7f6b62ea0740 1 --2- 172.21.15.84:0/1168904128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef431b0 0x55e20f313b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.861+0000 7f6b62ea0740 1 --2- 172.21.15.84:0/1168904128 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef6c070 0x55e20f313650 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.861+0000 7f6b62ea0740 1 -- 172.21.15.84:0/1168904128 >> 172.21.15.84:0/1168904128 conn(0x55e20ef60460 msgr2=0x55e20f311540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:30.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.861+0000 7f6b62ea0740 1 -- 172.21.15.84:0/1168904128 shutdown_connections 2024-09-21T03:52:30.871 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.861+0000 7f6b62ea0740 1 -- 172.21.15.84:0/1168904128 wait complete. 2024-09-21T03:52:30.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.861+0000 7f6b62ea0740 1 -- start start 2024-09-21T03:52:30.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.861+0000 7f6b62ea0740 1 Processor -- start 2024-09-21T03:52:30.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.861+0000 7f6b62ea0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef431b0 0x55e20f323120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:30.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.861+0000 7f6b62ea0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e20ef4b390 0x55e20f323660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:30.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.861+0000 7f6b62ea0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef6c070 0x55e20f32f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:30.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.862+0000 7f6b62ea0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e20f0da700 con 0x55e20ef431b0 2024-09-21T03:52:30.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.862+0000 7f6b62ea0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e20f214110 con 0x55e20ef6c070 2024-09-21T03:52:30.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.862+0000 7f6b62ea0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e20f3260d0 con 0x55e20ef4b390 2024-09-21T03:52:30.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.862+0000 7f6b62ea0740 10 client.0 _ll_register_callbacks cb 0x55e20f22d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:30.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.862+0000 7f6b5659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef431b0 0x55e20f323120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:30.872 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.862+0000 7f6b5659c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef431b0 0x55e20f323120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34144/0 (socket says 172.21.15.84:34144) 2024-09-21T03:52:30.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.862+0000 7f6b5659c640 1 -- 172.21.15.84:0/3691336335 learned_addr learned my addr 172.21.15.84:0/3691336335 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:30.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.862+0000 7f6b56d9d640 1 --2- 172.21.15.84:0/3691336335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef6c070 0x55e20f32f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:30.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.862+0000 7f6b55d9b640 1 --2- 172.21.15.84:0/3691336335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e20ef4b390 0x55e20f323660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:30.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.862+0000 7f6b5659c640 1 -- 172.21.15.84:0/3691336335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e20ef4b390 msgr2=0x55e20f323660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:30.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.862+0000 7f6b5659c640 1 --2- 172.21.15.84:0/3691336335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e20ef4b390 0x55e20f323660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.862+0000 7f6b5659c640 1 -- 172.21.15.84:0/3691336335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef6c070 msgr2=0x55e20f32f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:30.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.862+0000 7f6b5659c640 1 --2- 172.21.15.84:0/3691336335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef6c070 0x55e20f32f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.862+0000 7f6b5659c640 1 -- 172.21.15.84:0/3691336335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e20f241c40 con 0x55e20ef431b0 2024-09-21T03:52:30.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.862+0000 7f6b56d9d640 1 --2- 172.21.15.84:0/3691336335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef6c070 0x55e20f32f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:52:30.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.862+0000 7f6b5659c640 1 --2- 172.21.15.84:0/3691336335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef431b0 0x55e20f323120 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f6b48035000 tx=0x7f6b480095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78ea7516eded1b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:30.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.862+0000 7f6b3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:30.873 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.862+0000 7f6b3dffb640 1 -- 172.21.15.84:0/3691336335 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b480305e0 con 0x55e20ef431b0 2024-09-21T03:52:30.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.862+0000 7f6b3dffb640 1 -- 172.21.15.84:0/3691336335 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f6b48030780 con 0x55e20ef431b0 2024-09-21T03:52:30.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.862+0000 7f6b62ea0740 1 -- 172.21.15.84:0/3691336335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b40010040 con 0x55e20ef431b0 2024-09-21T03:52:30.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.863+0000 7f6b3dffb640 1 -- 172.21.15.84:0/3691336335 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6b48030980 con 0x55e20ef431b0 2024-09-21T03:52:30.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.863+0000 7f6b62ea0740 10 client.17379 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:30.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.863+0000 7f6b62ea0740 1 -- 172.21.15.84:0/3691336335 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e20f331e20 con 0x55e20ef431b0 2024-09-21T03:52:30.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.863+0000 7f6b3dffb640 1 -- 172.21.15.84:0/3691336335 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b40010040 con 0x55e20ef431b0 2024-09-21T03:52:30.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.863+0000 7f6b3dffb640 1 -- 172.21.15.84:0/3691336335 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6b4804e070 con 0x55e20ef431b0 2024-09-21T03:52:30.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.863+0000 7f6b62ea0740 10 client.17379 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:30.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.863+0000 7f6b62ea0740 10 client.17379 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:52:30.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.863+0000 7f6b62ea0740 20 client.17379 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:30.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.863+0000 7f6b62ea0740 1 --2- 172.21.15.84:0/3691336335 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55e20ef2a9f0 0x55e20f3352f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:30.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.863+0000 7f6b62ea0740 4 client.17379 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:52:30.874 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.863+0000 7f6b62ea0740 1 -- 172.21.15.84:0/3691336335 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e20f28bda0 con 0x55e20ef2a9f0 2024-09-21T03:52:30.875 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.863+0000 7f6b55d9b640 1 --2- 172.21.15.84:0/3691336335 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55e20ef2a9f0 0x55e20f3352f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:30.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.864+0000 7f6b3dffb640 10 client.17379 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:30.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.864+0000 7f6b55d9b640 1 --2- 172.21.15.84:0/3691336335 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55e20ef2a9f0 0x55e20f3352f0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=369ef1449f6886a0 server_cookie=fa8d9b91e38e8158 in_seq=0 out_seq=0 2024-09-21T03:52:30.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.865+0000 7f6b3dffb640 1 -- 172.21.15.84:0/3691336335 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e20f28bda0 con 0x55e20ef2a9f0 2024-09-21T03:52:30.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.865+0000 7f6b3dffb640 10 client.17379 handle_command_reply: tid=0 2024-09-21T03:52:30.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.865+0000 7f6b62ea0740 1 client.17379 shutdown 2024-09-21T03:52:30.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.865+0000 7f6b62ea0740 1 -- 172.21.15.84:0/3691336335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef431b0 msgr2=0x55e20f323120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:30.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.865+0000 7f6b62ea0740 1 --2- 172.21.15.84:0/3691336335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef431b0 0x55e20f323120 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f6b48035000 tx=0x7f6b480095c0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.876 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.865+0000 7f6b62ea0740 1 -- 172.21.15.84:0/3691336335 shutdown_connections 2024-09-21T03:52:30.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.865+0000 7f6b62ea0740 1 --2- 172.21.15.84:0/3691336335 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55e20ef2a9f0 0x55e20f3352f0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.865+0000 7f6b62ea0740 1 --2- 172.21.15.84:0/3691336335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef6c070 0x55e20f32f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.865+0000 7f6b62ea0740 1 --2- 172.21.15.84:0/3691336335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e20ef4b390 0x55e20f323660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.865+0000 7f6b3dffb640 0 client.17379 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:30.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.865+0000 7f6b62ea0740 1 --2- 172.21.15.84:0/3691336335 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef431b0 0x55e20f323120 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.865+0000 7f6b62ea0740 1 -- 172.21.15.84:0/3691336335 >> 172.21.15.84:0/3691336335 conn(0x55e20ef60460 msgr2=0x55e20f315040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:30.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.865+0000 7f6b62ea0740 1 -- 172.21.15.84:0/3691336335 shutdown_connections 2024-09-21T03:52:30.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.865+0000 7f6b62ea0740 1 -- 172.21.15.84:0/3691336335 wait complete. 2024-09-21T03:52:30.877 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.865+0000 7f6b62ea0740 20 client.17379 trim_cache size 0 max 16384 2024-09-21T03:52:30.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.882+0000 7f6b62ea0740 1 Processor -- start 2024-09-21T03:52:30.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.882+0000 7f6b62ea0740 1 -- start start 2024-09-21T03:52:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.883+0000 7f6b62ea0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef431b0 0x55e20f322ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.883+0000 7f6b62ea0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef4b390 0x55e20f323410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.883+0000 7f6b62ea0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e20ef6c070 0x55e20f320310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.883+0000 7f6b62ea0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581afd00 con 0x55e20ef4b390 2024-09-21T03:52:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.883+0000 7f6b62ea0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581ad5d0 con 0x55e20ef431b0 2024-09-21T03:52:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.883+0000 7f6b62ea0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581ab440 con 0x55e20ef6c070 2024-09-21T03:52:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.883+0000 7f6b55d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef4b390 0x55e20f323410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.883+0000 7f6b55d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef4b390 0x55e20f323410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34158/0 (socket says 172.21.15.84:34158) 2024-09-21T03:52:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.883+0000 7f6b55d9b640 1 -- 172.21.15.84:0/963513325 learned_addr learned my addr 172.21.15.84:0/963513325 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.883+0000 7f6b56d9d640 1 --2- 172.21.15.84:0/963513325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e20ef6c070 0x55e20f320310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:30.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.883+0000 7f6b5659c640 1 --2- 172.21.15.84:0/963513325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef431b0 0x55e20f322ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.883+0000 7f6b55d9b640 1 -- 172.21.15.84:0/963513325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e20ef6c070 msgr2=0x55e20f320310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.883+0000 7f6b55d9b640 1 --2- 172.21.15.84:0/963513325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e20ef6c070 0x55e20f320310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.883+0000 7f6b55d9b640 1 -- 172.21.15.84:0/963513325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef431b0 msgr2=0x55e20f322ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.883+0000 7f6b55d9b640 1 --2- 172.21.15.84:0/963513325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef431b0 0x55e20f322ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.883+0000 7f6b55d9b640 1 -- 172.21.15.84:0/963513325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e20f31ec50 con 0x55e20ef4b390 2024-09-21T03:52:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.883+0000 7f6b55d9b640 1 --2- 172.21.15.84:0/963513325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef4b390 0x55e20f323410 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000f9e0 tx=0x7f6b40008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996edb2a943482b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.883+0000 7f6b3ffff640 1 -- 172.21.15.84:0/963513325 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40016590 con 0x55e20ef4b390 2024-09-21T03:52:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.884+0000 7f6b3ffff640 1 -- 172.21.15.84:0/963513325 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b40016be0 con 0x55e20ef4b390 2024-09-21T03:52:30.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.884+0000 7f6b3ffff640 1 -- 172.21.15.84:0/963513325 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40017a60 con 0x55e20ef4b390 2024-09-21T03:52:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.884+0000 7f6b62ea0740 1 -- 172.21.15.84:0/963513325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef4b390 msgr2=0x55e20f323410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.884+0000 7f6b62ea0740 1 --2- 172.21.15.84:0/963513325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef4b390 0x55e20f323410 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000f9e0 tx=0x7f6b40008040 comp rx=0 tx=0).stop 2024-09-21T03:52:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.884+0000 7f6b62ea0740 1 -- 172.21.15.84:0/963513325 shutdown_connections 2024-09-21T03:52:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.884+0000 7f6b62ea0740 1 --2- 172.21.15.84:0/963513325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e20ef6c070 0x55e20f320310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.891 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.884+0000 7f6b62ea0740 1 --2- 172.21.15.84:0/963513325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef4b390 0x55e20f323410 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.884+0000 7f6b62ea0740 1 --2- 172.21.15.84:0/963513325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef431b0 0x55e20f322ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.884+0000 7f6b62ea0740 1 -- 172.21.15.84:0/963513325 >> 172.21.15.84:0/963513325 conn(0x55e20ef60460 msgr2=0x55e20f3219a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.884+0000 7f6b62ea0740 1 -- 172.21.15.84:0/963513325 shutdown_connections 2024-09-21T03:52:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.884+0000 7f6b62ea0740 1 -- 172.21.15.84:0/963513325 wait complete. 2024-09-21T03:52:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.885+0000 7f6b62ea0740 1 -- start start 2024-09-21T03:52:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.885+0000 7f6b62ea0740 1 Processor -- start 2024-09-21T03:52:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.885+0000 7f6b62ea0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e20ef431b0 0x55e20f3277a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.885+0000 7f6b62ea0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef4b390 0x55e20f327d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.885+0000 7f6b62ea0740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef6c070 0x55e20f39ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.885+0000 7f6b62ea0740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581aba90 con 0x55e20ef6c070 2024-09-21T03:52:30.892 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.885+0000 7f6b62ea0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581acf00 con 0x55e20ef4b390 2024-09-21T03:52:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.885+0000 7f6b62ea0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6b581ac160 con 0x55e20ef431b0 2024-09-21T03:52:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.885+0000 7f6b62ea0740 10 client.0 _ll_register_callbacks cb 0x7f6b48009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.885+0000 7f6b56d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef6c070 0x55e20f39ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.885+0000 7f6b56d9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef6c070 0x55e20f39ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34166/0 (socket says 172.21.15.84:34166) 2024-09-21T03:52:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.885+0000 7f6b56d9d640 1 -- 172.21.15.84:0/1808612513 learned_addr learned my addr 172.21.15.84:0/1808612513 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.885+0000 7f6b55d9b640 1 --2- 172.21.15.84:0/1808612513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef4b390 0x55e20f327d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.886+0000 7f6b5659c640 1 --2- 172.21.15.84:0/1808612513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e20ef431b0 0x55e20f3277a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.886+0000 7f6b56d9d640 1 -- 172.21.15.84:0/1808612513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e20ef431b0 msgr2=0x55e20f3277a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.886+0000 7f6b56d9d640 1 --2- 172.21.15.84:0/1808612513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e20ef431b0 0x55e20f3277a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.886+0000 7f6b56d9d640 1 -- 172.21.15.84:0/1808612513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef4b390 msgr2=0x55e20f327d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.886+0000 7f6b56d9d640 1 --2- 172.21.15.84:0/1808612513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef4b390 0x55e20f327d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.893 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.886+0000 7f6b56d9d640 1 -- 172.21.15.84:0/1808612513 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e20f39f1f0 con 0x55e20ef6c070 2024-09-21T03:52:30.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.886+0000 7f6b56d9d640 1 --2- 172.21.15.84:0/1808612513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef6c070 0x55e20f39ecb0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f6b500ad260 tx=0x7f6b500e50d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91bfc7134450e72f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:30.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.886+0000 7f6b3dffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:30.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.886+0000 7f6b3dffb640 1 -- 172.21.15.84:0/1808612513 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5001d070 con 0x55e20ef6c070 2024-09-21T03:52:30.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.886+0000 7f6b3dffb640 1 -- 172.21.15.84:0/1808612513 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f6b500ac730 con 0x55e20ef6c070 2024-09-21T03:52:30.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.886+0000 7f6b62ea0740 1 -- 172.21.15.84:0/1808612513 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b40016be0 con 0x55e20ef6c070 2024-09-21T03:52:30.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.886+0000 7f6b3dffb640 1 -- 172.21.15.84:0/1808612513 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6b500b1db0 con 0x55e20ef6c070 2024-09-21T03:52:30.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.886+0000 7f6b62ea0740 10 client.17385 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:30.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.886+0000 7f6b62ea0740 1 -- 172.21.15.84:0/1808612513 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e20f3a0380 con 0x55e20ef6c070 2024-09-21T03:52:30.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.886+0000 7f6b3dffb640 1 -- 172.21.15.84:0/1808612513 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b40016be0 con 0x55e20ef6c070 2024-09-21T03:52:30.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.887+0000 7f6b3dffb640 1 -- 172.21.15.84:0/1808612513 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6b500b2f40 con 0x55e20ef6c070 2024-09-21T03:52:30.894 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.887+0000 7f6b62ea0740 10 client.17385 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:30.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.887+0000 7f6b62ea0740 10 client.17385 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:52:30.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.887+0000 7f6b62ea0740 20 client.17385 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:30.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.887+0000 7f6b62ea0740 1 --2- 172.21.15.84:0/1808612513 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55e20eeffda0 0x55e20f3a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:30.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.887+0000 7f6b62ea0740 4 client.17385 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:52:30.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.887+0000 7f6b62ea0740 1 -- 172.21.15.84:0/1808612513 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e20f287850 con 0x55e20eeffda0 2024-09-21T03:52:30.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.887+0000 7f6b5659c640 1 --2- 172.21.15.84:0/1808612513 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55e20eeffda0 0x55e20f3a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:30.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.887+0000 7f6b5659c640 1 --2- 172.21.15.84:0/1808612513 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55e20eeffda0 0x55e20f3a2b90 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8290e481e32016 server_cookie=8d30eae55859b336 in_seq=0 out_seq=0 2024-09-21T03:52:30.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.887+0000 7f6b3dffb640 10 client.17385 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:30.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.888+0000 7f6b3dffb640 1 -- 172.21.15.84:0/1808612513 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5202 (crc 0 0 0) 0x55e20f287850 con 0x55e20eeffda0 2024-09-21T03:52:30.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.888+0000 7f6b3dffb640 10 client.17385 handle_command_reply: tid=0 2024-09-21T03:52:30.895 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.888+0000 7f6b62ea0740 1 client.17385 shutdown 2024-09-21T03:52:30.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.888+0000 7f6b62ea0740 1 -- 172.21.15.84:0/1808612513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef6c070 msgr2=0x55e20f39ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:30.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.888+0000 7f6b62ea0740 1 --2- 172.21.15.84:0/1808612513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef6c070 0x55e20f39ecb0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f6b500ad260 tx=0x7f6b500e50d0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.888+0000 7f6b62ea0740 1 -- 172.21.15.84:0/1808612513 shutdown_connections 2024-09-21T03:52:30.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.888+0000 7f6b62ea0740 1 --2- 172.21.15.84:0/1808612513 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55e20eeffda0 0x55e20f3a2b90 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.888+0000 7f6b62ea0740 1 --2- 172.21.15.84:0/1808612513 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e20ef6c070 0x55e20f39ecb0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.888+0000 7f6b62ea0740 1 --2- 172.21.15.84:0/1808612513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e20ef4b390 0x55e20f327d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.888+0000 7f6b62ea0740 1 --2- 172.21.15.84:0/1808612513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e20ef431b0 0x55e20f3277a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.888+0000 7f6b62ea0740 1 -- 172.21.15.84:0/1808612513 >> 172.21.15.84:0/1808612513 conn(0x55e20ef60460 msgr2=0x55e20f322ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:30.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.888+0000 7f6b3dffb640 0 client.17385 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:30.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.888+0000 7f6b62ea0740 1 -- 172.21.15.84:0/1808612513 shutdown_connections 2024-09-21T03:52:30.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.888+0000 7f6b62ea0740 1 -- 172.21.15.84:0/1808612513 wait complete. 2024-09-21T03:52:30.896 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.888+0000 7f6b62ea0740 20 client.17385 trim_cache size 0 max 16384 2024-09-21T03:52:30.897 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:52:30.897 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T03:52:30.897 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T03:52:30.897 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:52:30.897 INFO:teuthology.orchestra.run.smithi084.stdout: "1583169c-207f-40ad-b200-4ef92de62783": { 2024-09-21T03:52:30.897 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:52:29.382669+0000", 2024-09-21T03:52:30.897 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:30.897 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:30.897 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:30.897 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:30.898 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:30.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:30.898 INFO:teuthology.orchestra.run.smithi084.stdout: "d85cdf50-3fc8-467d-942f-2b77981ba106": { 2024-09-21T03:52:30.898 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:43.684286+0000", 2024-09-21T03:52:30.898 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:30.898 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:30.898 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:30.898 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:30.898 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:30.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:30.898 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:52:30.898 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:52:30.899 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:30.899 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:30.899 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:30.899 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:30.899 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:30.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:30.899 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:52:30.899 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:52:30.899 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:30.899 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:30.899 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:30.899 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:30.900 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:30.900 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:30.900 INFO:teuthology.orchestra.run.smithi084.stdout: "2cbf94ea-caa1-4c9b-8007-8a0887103a5c": { 2024-09-21T03:52:30.900 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:51:05.114755+0000", 2024-09-21T03:52:30.900 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:30.901 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:30.901 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:30.902 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:30.902 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:30.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:30.902 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:52:30.902 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:52:30.902 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:30.902 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:30.902 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:30.902 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:30.902 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:30.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:30.903 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:52:30.903 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:52:30.903 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:30.903 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:30.903 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:30.903 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:30.903 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:30.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:30.903 INFO:teuthology.orchestra.run.smithi084.stdout: "43a49cca-fc1c-4c36-a314-49033e7c3fb6": { 2024-09-21T03:52:30.903 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:49:17.366428+0000", 2024-09-21T03:52:30.903 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:30.904 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:30.904 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:30.904 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:30.904 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:30.904 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:30.904 INFO:teuthology.orchestra.run.smithi084.stdout: "0bb4e83d-6059-4d41-88f0-1562fa422c47": { 2024-09-21T03:52:30.904 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:54.511018+0000", 2024-09-21T03:52:30.904 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:30.904 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:30.904 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:30.904 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:30.905 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:30.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:30.905 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:52:30.905 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:52:30.905 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:30.905 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:30.905 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:30.905 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:30.905 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:30.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:30.905 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:52:30.905 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:52:30.906 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:30.906 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:30.906 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:30.906 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:30.906 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:30.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:30.906 INFO:teuthology.orchestra.run.smithi084.stdout: "5435e7df-7d39-4687-a715-54c7af6bc3b1": { 2024-09-21T03:52:30.906 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:51:47.429708+0000", 2024-09-21T03:52:30.906 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:30.906 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:30.906 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:30.907 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:30.907 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:30.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:30.907 INFO:teuthology.orchestra.run.smithi084.stdout: "27dcb84c-89fa-46b2-b980-58857966c697": { 2024-09-21T03:52:30.907 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:52.598527+0000", 2024-09-21T03:52:30.907 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:30.907 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:30.907 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:30.907 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:30.907 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:30.907 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:30.907 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:52:30.907 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:52:30.908 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:30.908 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:30.908 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:30.908 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:30.908 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:30.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:30.908 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:52:30.908 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:52:30.908 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:30.908 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:30.908 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:30.908 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:30.909 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:30.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:30.909 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:52:30.909 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:52:30.909 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:30.909 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:30.909 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:30.909 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:30.909 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:30.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:30.909 INFO:teuthology.orchestra.run.smithi084.stdout: "b2063a70-0b1f-4b6b-9c96-d886e156ea66": { 2024-09-21T03:52:30.909 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:48:34.864478+0000", 2024-09-21T03:52:30.909 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:30.910 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:30.910 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:30.910 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:30.910 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:30.910 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:30.910 INFO:teuthology.orchestra.run.smithi084.stdout: "33131451-f242-447a-b13f-9bdebc7884ec": { 2024-09-21T03:52:30.910 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:00.524357+0000", 2024-09-21T03:52:30.910 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:30.910 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:30.910 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:30.910 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:30.910 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:30.910 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:52:30.911 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:52:30.911 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:52:30.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.888+0000 7f6b5c92c640 1 -- 172.21.15.84:0/3336311937 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6b440b6680 msgr2=0x7f6b440b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:30.911 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.888+0000 7f6b5c92c640 1 --2- 172.21.15.84:0/3336311937 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6b440b6680 0x7f6b440b8b90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009a60 tx=0x7f6b48009890 comp rx=0 tx=0).stop 2024-09-21T03:52:30.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.888+0000 7f6b5c92c640 1 -- 172.21.15.84:0/3336311937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b5810de40 msgr2=0x7f6b5819fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:30.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.888+0000 7f6b5c92c640 1 --2- 172.21.15.84:0/3336311937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b5810de40 0x7f6b5819fdd0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000c970 tx=0x7f6b5000ce30 comp rx=0 tx=0).stop 2024-09-21T03:52:30.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.889+0000 7f6b5c92c640 1 -- 172.21.15.84:0/3336311937 shutdown_connections 2024-09-21T03:52:30.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.889+0000 7f6b5c92c640 1 --2- 172.21.15.84:0/3336311937 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6b440b6680 0x7f6b440b8b90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.889+0000 7f6b5c92c640 1 --2- 172.21.15.84:0/3336311937 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6b5810de40 0x7f6b5819fdd0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.889+0000 7f6b5c92c640 1 --2- 172.21.15.84:0/3336311937 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b58105360 0x7f6b5819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.889+0000 7f6b5c92c640 1 --2- 172.21.15.84:0/3336311937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b58104a10 0x7f6b5819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:30.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.889+0000 7f6b5c92c640 1 -- 172.21.15.84:0/3336311937 >> 172.21.15.84:0/3336311937 conn(0x7f6b58079790 msgr2=0x7f6b580ff770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:30.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.889+0000 7f6b5c92c640 1 -- 172.21.15.84:0/3336311937 shutdown_connections 2024-09-21T03:52:30.912 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:30.889+0000 7f6b5c92c640 1 -- 172.21.15.84:0/3336311937 wait complete. 2024-09-21T03:52:31.616 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:52:31.616 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:52:31.864 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:31.984 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:31 smithi084 ceph-mon[30941]: pgmap v633: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 46 KiB/s wr, 9 op/s 2024-09-21T03:52:32.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:31 smithi174 ceph-mon[34403]: pgmap v633: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 46 KiB/s wr, 9 op/s 2024-09-21T03:52:32.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:31 smithi172 ceph-mon[34821]: pgmap v633: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 46 KiB/s wr, 9 op/s 2024-09-21T03:52:32.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.374+0000 7fe1b9ea5640 1 -- 172.21.15.84:0/1165368528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1b4103200 msgr2=0x7fe1b4103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:32.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.374+0000 7fe1b9ea5640 1 --2- 172.21.15.84:0/1165368528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1b4103200 0x7fe1b4103610 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009900 tx=0x7fe1a402a410 comp rx=0 tx=0).stop 2024-09-21T03:52:32.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.374+0000 7fe1b9ea5640 1 -- 172.21.15.84:0/1165368528 shutdown_connections 2024-09-21T03:52:32.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.374+0000 7fe1b9ea5640 1 --2- 172.21.15.84:0/1165368528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1b4105b20 0x7fe1b410f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:32.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.374+0000 7fe1b9ea5640 1 --2- 172.21.15.84:0/1165368528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1b41051d0 0x7fe1b41055e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:32.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.374+0000 7fe1b9ea5640 1 --2- 172.21.15.84:0/1165368528 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1b4103200 0x7fe1b4103610 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:32.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.374+0000 7fe1b9ea5640 1 -- 172.21.15.84:0/1165368528 >> 172.21.15.84:0/1165368528 conn(0x7fe1b4079e10 msgr2=0x7fe1b407a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:32.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.374+0000 7fe1b9ea5640 1 -- 172.21.15.84:0/1165368528 shutdown_connections 2024-09-21T03:52:32.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.374+0000 7fe1b9ea5640 1 -- 172.21.15.84:0/1165368528 wait complete. 2024-09-21T03:52:32.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.375+0000 7fe1b9ea5640 1 Processor -- start 2024-09-21T03:52:32.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.375+0000 7fe1b9ea5640 1 -- start start 2024-09-21T03:52:32.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.375+0000 7fe1b9ea5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1b4103200 0x7fe1b419b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:32.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.375+0000 7fe1b9ea5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1b41051d0 0x7fe1b419b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:32.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.375+0000 7fe1b9ea5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1b4105b20 0x7fe1b419bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:32.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.375+0000 7fe1b9ea5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b41129c0 con 0x7fe1b41051d0 2024-09-21T03:52:32.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.375+0000 7fe1b9ea5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b4112840 con 0x7fe1b4103200 2024-09-21T03:52:32.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.375+0000 7fe1b9ea5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b4112b40 con 0x7fe1b4105b20 2024-09-21T03:52:32.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.375+0000 7fe1b2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1b41051d0 0x7fe1b419b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:32.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.376+0000 7fe1b2ffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1b41051d0 0x7fe1b419b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34184/0 (socket says 172.21.15.84:34184) 2024-09-21T03:52:32.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.376+0000 7fe1b2ffd640 1 -- 172.21.15.84:0/3883886602 learned_addr learned my addr 172.21.15.84:0/3883886602 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:32.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.376+0000 7fe1b37fe640 1 --2- 172.21.15.84:0/3883886602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1b4103200 0x7fe1b419b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:32.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.376+0000 7fe1b3fff640 1 --2- 172.21.15.84:0/3883886602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1b4105b20 0x7fe1b419bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:32.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.376+0000 7fe1b2ffd640 1 -- 172.21.15.84:0/3883886602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1b4105b20 msgr2=0x7fe1b419bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:32.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.376+0000 7fe1b2ffd640 1 --2- 172.21.15.84:0/3883886602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1b4105b20 0x7fe1b419bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.376+0000 7fe1b2ffd640 1 -- 172.21.15.84:0/3883886602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1b4103200 msgr2=0x7fe1b419b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.376+0000 7fe1b2ffd640 1 --2- 172.21.15.84:0/3883886602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1b4103200 0x7fe1b419b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.376+0000 7fe1b2ffd640 1 -- 172.21.15.84:0/3883886602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b41a65e0 con 0x7fe1b41051d0 2024-09-21T03:52:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.376+0000 7fe1b2ffd640 1 --2- 172.21.15.84:0/3883886602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1b41051d0 0x7fe1b419b810 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fe1a800d770 tx=0x7fe1a800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.376+0000 7fe1b0ff9640 1 -- 172.21.15.84:0/3883886602 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8017070 con 0x7fe1b41051d0 2024-09-21T03:52:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.376+0000 7fe1b9ea5640 1 -- 172.21.15.84:0/3883886602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b41a68d0 con 0x7fe1b41051d0 2024-09-21T03:52:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.376+0000 7fe1b0ff9640 1 -- 172.21.15.84:0/3883886602 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1a8009c30 con 0x7fe1b41051d0 2024-09-21T03:52:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.376+0000 7fe1b0ff9640 1 -- 172.21.15.84:0/3883886602 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a800f620 con 0x7fe1b41051d0 2024-09-21T03:52:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.376+0000 7fe1b9ea5640 1 -- 172.21.15.84:0/3883886602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1b41a6e60 con 0x7fe1b41051d0 2024-09-21T03:52:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.377+0000 7fe1b9ea5640 1 -- 172.21.15.84:0/3883886602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1b41022d0 con 0x7fe1b41051d0 2024-09-21T03:52:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.379+0000 7fe1b0ff9640 1 -- 172.21.15.84:0/3883886602 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fe1a801a070 con 0x7fe1b41051d0 2024-09-21T03:52:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.379+0000 7fe1b0ff9640 1 --2- 172.21.15.84:0/3883886602 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe19c0b6680 0x7fe19c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.380+0000 7fe1b37fe640 1 --2- 172.21.15.84:0/3883886602 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe19c0b6680 0x7fe19c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:32.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.380+0000 7fe1b0ff9640 1 -- 172.21.15.84:0/3883886602 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7fe1a80e70c0 con 0x7fe1b41051d0 2024-09-21T03:52:32.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.380+0000 7fe1b37fe640 1 --2- 172.21.15.84:0/3883886602 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe19c0b6680 0x7fe19c0b8b90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4000c00 tx=0x7fe1a4031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:32.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.384+0000 7fe1b0ff9640 1 -- 172.21.15.84:0/3883886602 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe1a8009de0 con 0x7fe1b41051d0 2024-09-21T03:52:32.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.600+0000 7fe1b9ea5640 1 -- 172.21.15.84:0/3883886602 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1b402e640 con 0x7fe1b41051d0 2024-09-21T03:52:32.602 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.600+0000 7fe1b0ff9640 1 -- 172.21.15.84:0/3883886602 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7fe1a80c6ea0 con 0x7fe1b41051d0 2024-09-21T03:52:32.603 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:52:32.603 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:52:32.603 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:52:32.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.603+0000 7fe1b9ea5640 1 -- 172.21.15.84:0/3883886602 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe19c0b6680 msgr2=0x7fe19c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:32.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.603+0000 7fe1b9ea5640 1 --2- 172.21.15.84:0/3883886602 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe19c0b6680 0x7fe19c0b8b90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4000c00 tx=0x7fe1a4031400 comp rx=0 tx=0).stop 2024-09-21T03:52:32.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.603+0000 7fe1b9ea5640 1 -- 172.21.15.84:0/3883886602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1b41051d0 msgr2=0x7fe1b419b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:32.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.603+0000 7fe1b9ea5640 1 --2- 172.21.15.84:0/3883886602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1b41051d0 0x7fe1b419b810 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fe1a800d770 tx=0x7fe1a800dc30 comp rx=0 tx=0).stop 2024-09-21T03:52:32.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.603+0000 7fe1b9ea5640 1 -- 172.21.15.84:0/3883886602 shutdown_connections 2024-09-21T03:52:32.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.603+0000 7fe1b9ea5640 1 --2- 172.21.15.84:0/3883886602 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fe19c0b6680 0x7fe19c0b8b90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:32.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.603+0000 7fe1b9ea5640 1 --2- 172.21.15.84:0/3883886602 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1b4105b20 0x7fe1b419bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:32.605 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.603+0000 7fe1b9ea5640 1 --2- 172.21.15.84:0/3883886602 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fe1b41051d0 0x7fe1b419b810 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:32.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.603+0000 7fe1b9ea5640 1 --2- 172.21.15.84:0/3883886602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1b4103200 0x7fe1b419b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:32.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.603+0000 7fe1b9ea5640 1 -- 172.21.15.84:0/3883886602 >> 172.21.15.84:0/3883886602 conn(0x7fe1b4079e10 msgr2=0x7fe1b4107470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:32.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.603+0000 7fe1b9ea5640 1 -- 172.21.15.84:0/3883886602 shutdown_connections 2024-09-21T03:52:32.606 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:32.603+0000 7fe1b9ea5640 1 -- 172.21.15.84:0/3883886602 wait complete. 2024-09-21T03:52:33.020 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:32 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3883886602' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:33.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:32 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3883886602' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:33.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:32 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3883886602' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:52:33.320 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:52:33.564 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:33.986 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:33 smithi084 ceph-mon[30941]: pgmap v634: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 46 KiB/s wr, 10 op/s 2024-09-21T03:52:34.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.075+0000 7fc1257d8640 1 -- 172.21.15.84:0/131744516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc120104880 msgr2=0x7fc120104c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:34.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.075+0000 7fc1257d8640 1 --2- 172.21.15.84:0/131744516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc120104880 0x7fc120104c90 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc110009900 tx=0x7fc11002a410 comp rx=0 tx=0).stop 2024-09-21T03:52:34.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.075+0000 7fc1257d8640 1 -- 172.21.15.84:0/131744516 shutdown_connections 2024-09-21T03:52:34.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.075+0000 7fc1257d8640 1 --2- 172.21.15.84:0/131744516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc12010de30 0x7fc120110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.075+0000 7fc1257d8640 1 --2- 172.21.15.84:0/131744516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1201052b0 0x7fc12010d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.075+0000 7fc1257d8640 1 --2- 172.21.15.84:0/131744516 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc120104880 0x7fc120104c90 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.075+0000 7fc1257d8640 1 -- 172.21.15.84:0/131744516 >> 172.21.15.84:0/131744516 conn(0x7fc120079730 msgr2=0x7fc120079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:34.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.075+0000 7fc1257d8640 1 -- 172.21.15.84:0/131744516 shutdown_connections 2024-09-21T03:52:34.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.075+0000 7fc1257d8640 1 -- 172.21.15.84:0/131744516 wait complete. 2024-09-21T03:52:34.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.076+0000 7fc1257d8640 1 Processor -- start 2024-09-21T03:52:34.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.076+0000 7fc1257d8640 1 -- start start 2024-09-21T03:52:34.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.076+0000 7fc1257d8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc120104880 0x7fc12019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.076+0000 7fc1257d8640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1201052b0 0x7fc12019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.076+0000 7fc1257d8640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc12010de30 0x7fc12019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.076+0000 7fc1257d8640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc120113ad0 con 0x7fc120104880 2024-09-21T03:52:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.076+0000 7fc1257d8640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc120113950 con 0x7fc12010de30 2024-09-21T03:52:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.076+0000 7fc1257d8640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc120113c50 con 0x7fc1201052b0 2024-09-21T03:52:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.076+0000 7fc11effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc120104880 0x7fc12019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.076+0000 7fc11effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc120104880 0x7fc12019a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34188/0 (socket says 172.21.15.84:34188) 2024-09-21T03:52:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.076+0000 7fc11effd640 1 -- 172.21.15.84:0/1415537063 learned_addr learned my addr 172.21.15.84:0/1415537063 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.077+0000 7fc11e7fc640 1 --2- 172.21.15.84:0/1415537063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1201052b0 0x7fc12019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.077+0000 7fc11f7fe640 1 --2- 172.21.15.84:0/1415537063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc12010de30 0x7fc12019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.077+0000 7fc11effd640 1 -- 172.21.15.84:0/1415537063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1201052b0 msgr2=0x7fc12019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.077+0000 7fc11effd640 1 --2- 172.21.15.84:0/1415537063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1201052b0 0x7fc12019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.077+0000 7fc11effd640 1 -- 172.21.15.84:0/1415537063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc12010de30 msgr2=0x7fc12019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:34.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.077+0000 7fc11effd640 1 --2- 172.21.15.84:0/1415537063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc12010de30 0x7fc12019fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.077+0000 7fc11effd640 1 -- 172.21.15.84:0/1415537063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1201a0430 con 0x7fc120104880 2024-09-21T03:52:34.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.077+0000 7fc11effd640 1 --2- 172.21.15.84:0/1415537063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc120104880 0x7fc12019a4c0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fc110032fd0 tx=0x7fc110004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:34.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.077+0000 7fc117fff640 1 -- 172.21.15.84:0/1415537063 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11003f030 con 0x7fc120104880 2024-09-21T03:52:34.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.077+0000 7fc1257d8640 1 -- 172.21.15.84:0/1415537063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1201a06c0 con 0x7fc120104880 2024-09-21T03:52:34.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.077+0000 7fc117fff640 1 -- 172.21.15.84:0/1415537063 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc110004490 con 0x7fc120104880 2024-09-21T03:52:34.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.077+0000 7fc117fff640 1 -- 172.21.15.84:0/1415537063 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc110035070 con 0x7fc120104880 2024-09-21T03:52:34.082 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.077+0000 7fc1257d8640 1 -- 172.21.15.84:0/1415537063 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1201a6e80 con 0x7fc120104880 2024-09-21T03:52:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.080+0000 7fc12bd4c740 1 Processor -- start 2024-09-21T03:52:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.080+0000 7fc12bd4c740 1 -- start start 2024-09-21T03:52:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.080+0000 7fc117fff640 1 -- 172.21.15.84:0/1415537063 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fc110042030 con 0x7fc120104880 2024-09-21T03:52:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.080+0000 7fc12bd4c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d739070 0x562b2dae06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.080+0000 7fc12bd4c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d7101b0 0x562b2dae0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.080+0000 7fc12bd4c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d718390 0x562b2dae1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.080+0000 7fc12bd4c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562b2da56ea0 con 0x562b2d739070 2024-09-21T03:52:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.080+0000 7fc12bd4c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562b2da462d0 con 0x562b2d7101b0 2024-09-21T03:52:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.080+0000 7fc12bd4c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562b2da4a0e0 con 0x562b2d718390 2024-09-21T03:52:34.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.081+0000 7fc11f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d739070 0x562b2dae06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.081+0000 7fc11f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d739070 0x562b2dae06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34190/0 (socket says 172.21.15.84:34190) 2024-09-21T03:52:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.081+0000 7fc11f7fe640 1 -- 172.21.15.84:0/3624302614 learned_addr learned my addr 172.21.15.84:0/3624302614 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.081+0000 7fc11e7fc640 1 --2- 172.21.15.84:0/3624302614 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d718390 0x562b2dae1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.081+0000 7fc11effd640 1 --2- 172.21.15.84:0/3624302614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d7101b0 0x562b2dae0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.081+0000 7fc11f7fe640 1 -- 172.21.15.84:0/3624302614 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d718390 msgr2=0x562b2dae1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.081+0000 7fc11f7fe640 1 --2- 172.21.15.84:0/3624302614 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d718390 0x562b2dae1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.081+0000 7fc11f7fe640 1 -- 172.21.15.84:0/3624302614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d7101b0 msgr2=0x562b2dae0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.081+0000 7fc11f7fe640 1 --2- 172.21.15.84:0/3624302614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d7101b0 0x562b2dae0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.081+0000 7fc11f7fe640 1 -- 172.21.15.84:0/3624302614 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b2d7a4650 con 0x562b2d739070 2024-09-21T03:52:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.081+0000 7fc11e7fc640 1 --2- 172.21.15.84:0/3624302614 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d718390 0x562b2dae1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:52:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.081+0000 7fc11effd640 1 --2- 172.21.15.84:0/3624302614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d7101b0 0x562b2dae0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:52:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.081+0000 7fc11f7fe640 1 --2- 172.21.15.84:0/3624302614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d739070 0x562b2dae06a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fc118009df0 tx=0x7fc11800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa9eae1da504fee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:34.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.081+0000 7fc117fff640 1 --2- 172.21.15.84:0/1415537063 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc10c0b6680 0x7fc10c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.081+0000 7fc1157fa640 1 -- 172.21.15.84:0/3624302614 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc118003970 con 0x562b2d739070 2024-09-21T03:52:34.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.081+0000 7fc11effd640 1 --2- 172.21.15.84:0/1415537063 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc10c0b6680 0x7fc10c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.081+0000 7fc1157fa640 1 -- 172.21.15.84:0/3624302614 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc118004030 con 0x562b2d739070 2024-09-21T03:52:34.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.081+0000 7fc1157fa640 1 -- 172.21.15.84:0/3624302614 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc118011770 con 0x562b2d739070 2024-09-21T03:52:34.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.082+0000 7fc117fff640 1 -- 172.21.15.84:0/1415537063 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7fc110107c50 con 0x7fc120104880 2024-09-21T03:52:34.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.082+0000 7fc12bd4c740 1 -- 172.21.15.84:0/3624302614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d739070 msgr2=0x562b2dae06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:34.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.082+0000 7fc11effd640 1 --2- 172.21.15.84:0/1415537063 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc10c0b6680 0x7fc10c0b8b90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc1101054a0 tx=0x7fc110009260 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:34.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.082+0000 7fc12bd4c740 1 --2- 172.21.15.84:0/3624302614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d739070 0x562b2dae06a0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fc118009df0 tx=0x7fc11800f730 comp rx=0 tx=0).stop 2024-09-21T03:52:34.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.082+0000 7fc12bd4c740 1 -- 172.21.15.84:0/3624302614 shutdown_connections 2024-09-21T03:52:34.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.082+0000 7fc12bd4c740 1 --2- 172.21.15.84:0/3624302614 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d718390 0x562b2dae1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.082+0000 7fc12bd4c740 1 --2- 172.21.15.84:0/3624302614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d7101b0 0x562b2dae0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.082+0000 7fc12bd4c740 1 --2- 172.21.15.84:0/3624302614 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d739070 0x562b2dae06a0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.082+0000 7fc12bd4c740 1 -- 172.21.15.84:0/3624302614 >> 172.21.15.84:0/3624302614 conn(0x562b2d72d460 msgr2=0x562b2dade590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:34.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.083+0000 7fc12bd4c740 1 -- 172.21.15.84:0/3624302614 shutdown_connections 2024-09-21T03:52:34.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.083+0000 7fc12bd4c740 1 -- 172.21.15.84:0/3624302614 wait complete. 2024-09-21T03:52:34.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.083+0000 7fc12bd4c740 1 -- start start 2024-09-21T03:52:34.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.083+0000 7fc12bd4c740 1 Processor -- start 2024-09-21T03:52:34.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.083+0000 7fc12bd4c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d7101b0 0x562b2daebde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.083+0000 7fc12bd4c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d718390 0x562b2daec320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.083+0000 7fc12bd4c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d739070 0x562b2dafc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.083+0000 7fc12bd4c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x562b2d8a7700 con 0x562b2d739070 2024-09-21T03:52:34.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.083+0000 7fc12bd4c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562b2d9e1160 con 0x562b2d718390 2024-09-21T03:52:34.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.083+0000 7fc12bd4c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x562b2daf3290 con 0x562b2d7101b0 2024-09-21T03:52:34.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.083+0000 7fc12bd4c740 10 client.0 _ll_register_callbacks cb 0x562b2d9fa9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:34.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.084+0000 7fc11f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d739070 0x562b2dafc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.084+0000 7fc11f7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d739070 0x562b2dafc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34196/0 (socket says 172.21.15.84:34196) 2024-09-21T03:52:34.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.084+0000 7fc11f7fe640 1 -- 172.21.15.84:0/2875327210 learned_addr learned my addr 172.21.15.84:0/2875327210 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:34.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.084+0000 7fc11f7fe640 1 --2- 172.21.15.84:0/2875327210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d7101b0 0x562b2daebde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.084+0000 7fc11e7fc640 1 --2- 172.21.15.84:0/2875327210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d718390 0x562b2daec320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.084+0000 7fc11f7fe640 1 -- 172.21.15.84:0/2875327210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d7101b0 msgr2=0x562b2daebde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:34.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.084+0000 7fc11f7fe640 1 --2- 172.21.15.84:0/2875327210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d7101b0 0x562b2daebde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.084+0000 7fc11f7fe640 1 -- 172.21.15.84:0/2875327210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d718390 msgr2=0x562b2daec320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:34.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.084+0000 7fc11f7fe640 1 --2- 172.21.15.84:0/2875327210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d718390 0x562b2daec320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.084+0000 7fc11f7fe640 1 -- 172.21.15.84:0/2875327210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b2da0ec90 con 0x562b2d739070 2024-09-21T03:52:34.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.084+0000 7fc11f7fe640 1 --2- 172.21.15.84:0/2875327210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d739070 0x562b2dafc580 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x562b2dae2b40 tx=0x7fc118009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe50444796286bd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:34.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.084+0000 7fc1067fc640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:34.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.084+0000 7fc1067fc640 1 -- 172.21.15.84:0/2875327210 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc118023040 con 0x562b2d739070 2024-09-21T03:52:34.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.084+0000 7fc1067fc640 1 -- 172.21.15.84:0/2875327210 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7fc118003da0 con 0x562b2d739070 2024-09-21T03:52:34.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.084+0000 7fc12bd4c740 1 -- 172.21.15.84:0/2875327210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc118004030 con 0x562b2d739070 2024-09-21T03:52:34.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.085+0000 7fc1067fc640 1 -- 172.21.15.84:0/2875327210 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc118011510 con 0x562b2d739070 2024-09-21T03:52:34.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.085+0000 7fc12bd4c740 10 client.17403 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:34.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.085+0000 7fc12bd4c740 1 -- 172.21.15.84:0/2875327210 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562b2dafef40 con 0x562b2d739070 2024-09-21T03:52:34.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.085+0000 7fc1067fc640 1 -- 172.21.15.84:0/2875327210 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc118004030 con 0x562b2d739070 2024-09-21T03:52:34.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.085+0000 7fc1067fc640 1 -- 172.21.15.84:0/2875327210 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc11801a430 con 0x562b2d739070 2024-09-21T03:52:34.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.085+0000 7fc12bd4c740 10 client.17403 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:34.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.085+0000 7fc12bd4c740 10 client.17403 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:52:34.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.085+0000 7fc12bd4c740 20 client.17403 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:34.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.085+0000 7fc12bd4c740 1 --2- 172.21.15.84:0/2875327210 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x562b2d6f79f0 0x562b2db023b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.085+0000 7fc12bd4c740 4 client.17403 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:52:34.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.085+0000 7fc12bd4c740 1 -- 172.21.15.84:0/2875327210 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b2da58df0 con 0x562b2d6f79f0 2024-09-21T03:52:34.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.086+0000 7fc11e7fc640 1 --2- 172.21.15.84:0/2875327210 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x562b2d6f79f0 0x562b2db023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.086+0000 7fc11e7fc640 1 --2- 172.21.15.84:0/2875327210 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x562b2d6f79f0 0x562b2db023b0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=968dd2381793d229 server_cookie=70c476bfa1900dc5 in_seq=0 out_seq=0 2024-09-21T03:52:34.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.086+0000 7fc1067fc640 10 client.17403 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:52:34.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.087+0000 7fc1067fc640 1 -- 172.21.15.84:0/2875327210 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562b2da58df0 con 0x562b2d6f79f0 2024-09-21T03:52:34.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.087+0000 7fc1067fc640 10 client.17403 handle_command_reply: tid=0 2024-09-21T03:52:34.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.087+0000 7fc12bd4c740 1 client.17403 shutdown 2024-09-21T03:52:34.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.087+0000 7fc12bd4c740 1 -- 172.21.15.84:0/2875327210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d739070 msgr2=0x562b2dafc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:34.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.087+0000 7fc12bd4c740 1 --2- 172.21.15.84:0/2875327210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d739070 0x562b2dafc580 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x562b2dae2b40 tx=0x7fc118009940 comp rx=0 tx=0).stop 2024-09-21T03:52:34.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.087+0000 7fc12bd4c740 1 -- 172.21.15.84:0/2875327210 shutdown_connections 2024-09-21T03:52:34.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.087+0000 7fc12bd4c740 1 --2- 172.21.15.84:0/2875327210 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x562b2d6f79f0 0x562b2db023b0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.087+0000 7fc12bd4c740 1 --2- 172.21.15.84:0/2875327210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d739070 0x562b2dafc580 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.087+0000 7fc12bd4c740 1 --2- 172.21.15.84:0/2875327210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d718390 0x562b2daec320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.087+0000 7fc12bd4c740 1 --2- 172.21.15.84:0/2875327210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d7101b0 0x562b2daebde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.087+0000 7fc1067fc640 0 client.17403 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:52:34.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.087+0000 7fc12bd4c740 1 -- 172.21.15.84:0/2875327210 >> 172.21.15.84:0/2875327210 conn(0x562b2d72d460 msgr2=0x562b2dae3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:34.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.087+0000 7fc12bd4c740 1 -- 172.21.15.84:0/2875327210 shutdown_connections 2024-09-21T03:52:34.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.087+0000 7fc12bd4c740 1 -- 172.21.15.84:0/2875327210 wait complete. 2024-09-21T03:52:34.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.087+0000 7fc12bd4c740 20 client.17403 trim_cache size 0 max 16384 2024-09-21T03:52:34.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.101+0000 7fc12bd4c740 1 Processor -- start 2024-09-21T03:52:34.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.101+0000 7fc12bd4c740 1 -- start start 2024-09-21T03:52:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.102+0000 7fc12bd4c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d6f79f0 0x562b2daec360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.102+0000 7fc12bd4c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d7101b0 0x562b2dae1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.102+0000 7fc12bd4c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d718390 0x562b2dae8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.102+0000 7fc12bd4c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc1201afd80 con 0x562b2d7101b0 2024-09-21T03:52:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.102+0000 7fc12bd4c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc1201ad650 con 0x562b2d718390 2024-09-21T03:52:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.102+0000 7fc12bd4c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc1201ab4c0 con 0x562b2d6f79f0 2024-09-21T03:52:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.102+0000 7fc11e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d7101b0 0x562b2dae1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.102+0000 7fc11e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d7101b0 0x562b2dae1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34198/0 (socket says 172.21.15.84:34198) 2024-09-21T03:52:34.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.102+0000 7fc11e7fc640 1 -- 172.21.15.84:0/1003520268 learned_addr learned my addr 172.21.15.84:0/1003520268 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:34.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.102+0000 7fc11f7fe640 1 --2- 172.21.15.84:0/1003520268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d6f79f0 0x562b2daec360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.102+0000 7fc11f7fe640 1 --2- 172.21.15.84:0/1003520268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d718390 0x562b2dae8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.102+0000 7fc11e7fc640 1 -- 172.21.15.84:0/1003520268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d6f79f0 msgr2=0x562b2daec360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:34.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.102+0000 7fc11e7fc640 1 --2- 172.21.15.84:0/1003520268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d6f79f0 0x562b2daec360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.102+0000 7fc11e7fc640 1 -- 172.21.15.84:0/1003520268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d718390 msgr2=0x562b2dae8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:34.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.102+0000 7fc11e7fc640 1 --2- 172.21.15.84:0/1003520268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d718390 0x562b2dae8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.102+0000 7fc11e7fc640 1 -- 172.21.15.84:0/1003520268 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b2daea2e0 con 0x562b2d7101b0 2024-09-21T03:52:34.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.102+0000 7fc11f7fe640 1 --2- 172.21.15.84:0/1003520268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d718390 0x562b2dae8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:52:34.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.103+0000 7fc11e7fc640 1 --2- 172.21.15.84:0/1003520268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d7101b0 0x562b2dae1de0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fc108004810 tx=0x7fc108008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42eff6ca24e2778 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:34.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.103+0000 7fc114ff9640 1 -- 172.21.15.84:0/1003520268 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108026420 con 0x562b2d7101b0 2024-09-21T03:52:34.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.103+0000 7fc114ff9640 1 -- 172.21.15.84:0/1003520268 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc108021030 con 0x562b2d7101b0 2024-09-21T03:52:34.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.103+0000 7fc114ff9640 1 -- 172.21.15.84:0/1003520268 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1080153c0 con 0x562b2d7101b0 2024-09-21T03:52:34.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.104+0000 7fc12bd4c740 1 -- 172.21.15.84:0/1003520268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d7101b0 msgr2=0x562b2dae1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:34.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.104+0000 7fc12bd4c740 1 --2- 172.21.15.84:0/1003520268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d7101b0 0x562b2dae1de0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fc108004810 tx=0x7fc108008040 comp rx=0 tx=0).stop 2024-09-21T03:52:34.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.104+0000 7fc12bd4c740 1 -- 172.21.15.84:0/1003520268 shutdown_connections 2024-09-21T03:52:34.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.104+0000 7fc12bd4c740 1 --2- 172.21.15.84:0/1003520268 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d718390 0x562b2dae8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.104+0000 7fc12bd4c740 1 --2- 172.21.15.84:0/1003520268 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d7101b0 0x562b2dae1de0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.104+0000 7fc12bd4c740 1 --2- 172.21.15.84:0/1003520268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d6f79f0 0x562b2daec360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.104+0000 7fc12bd4c740 1 -- 172.21.15.84:0/1003520268 >> 172.21.15.84:0/1003520268 conn(0x562b2d72d460 msgr2=0x562b2dae16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:34.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.104+0000 7fc12bd4c740 1 -- 172.21.15.84:0/1003520268 shutdown_connections 2024-09-21T03:52:34.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.104+0000 7fc12bd4c740 1 -- 172.21.15.84:0/1003520268 wait complete. 2024-09-21T03:52:34.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.104+0000 7fc12bd4c740 1 -- start start 2024-09-21T03:52:34.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.104+0000 7fc12bd4c740 1 Processor -- start 2024-09-21T03:52:34.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.104+0000 7fc12bd4c740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d6f79f0 0x562b2daf8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.104+0000 7fc12bd4c740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d7101b0 0x562b2daf6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.104+0000 7fc12bd4c740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d718390 0x562b2daf67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.105+0000 7fc12bd4c740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc1201abb10 con 0x562b2d7101b0 2024-09-21T03:52:34.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.105+0000 7fc12bd4c740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc1201acf80 con 0x562b2d718390 2024-09-21T03:52:34.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.105+0000 7fc12bd4c740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc1201ac1e0 con 0x562b2d6f79f0 2024-09-21T03:52:34.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.105+0000 7fc12bd4c740 10 client.0 _ll_register_callbacks cb 0x7fc118009c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:34.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.105+0000 7fc11e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d7101b0 0x562b2daf6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.105+0000 7fc11e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d7101b0 0x562b2daf6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34200/0 (socket says 172.21.15.84:34200) 2024-09-21T03:52:34.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.105+0000 7fc11e7fc640 1 -- 172.21.15.84:0/3979097325 learned_addr learned my addr 172.21.15.84:0/3979097325 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:34.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.105+0000 7fc11f7fe640 1 --2- 172.21.15.84:0/3979097325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d6f79f0 0x562b2daf8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.105+0000 7fc11f7fe640 1 --2- 172.21.15.84:0/3979097325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d718390 0x562b2daf67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.105+0000 7fc11e7fc640 1 -- 172.21.15.84:0/3979097325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d6f79f0 msgr2=0x562b2daf8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:34.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.105+0000 7fc11e7fc640 1 --2- 172.21.15.84:0/3979097325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d6f79f0 0x562b2daf8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.105+0000 7fc11e7fc640 1 -- 172.21.15.84:0/3979097325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d718390 msgr2=0x562b2daf67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:34.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.105+0000 7fc11e7fc640 1 --2- 172.21.15.84:0/3979097325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d718390 0x562b2daf67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.105+0000 7fc11e7fc640 1 -- 172.21.15.84:0/3979097325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b2daf6f30 con 0x562b2d7101b0 2024-09-21T03:52:34.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.105+0000 7fc11e7fc640 1 --2- 172.21.15.84:0/3979097325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d7101b0 0x562b2daf6200 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fc108000c00 tx=0x7fc108009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346200814a9722f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:34.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.105+0000 7fc1067fc640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:34.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.105+0000 7fc1067fc640 1 -- 172.21.15.84:0/3979097325 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10802c070 con 0x562b2d7101b0 2024-09-21T03:52:34.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.105+0000 7fc1067fc640 1 -- 172.21.15.84:0/3979097325 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7fc1080255d0 con 0x562b2d7101b0 2024-09-21T03:52:34.112 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.105+0000 7fc12bd4c740 1 -- 172.21.15.84:0/3979097325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc108021030 con 0x562b2d7101b0 2024-09-21T03:52:34.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.105+0000 7fc1067fc640 1 -- 172.21.15.84:0/3979097325 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc1080257d0 con 0x562b2d7101b0 2024-09-21T03:52:34.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.106+0000 7fc12bd4c740 10 client.17409 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:34.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.106+0000 7fc12bd4c740 1 -- 172.21.15.84:0/3979097325 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562b2db6cb10 con 0x562b2d7101b0 2024-09-21T03:52:34.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.106+0000 7fc1067fc640 1 -- 172.21.15.84:0/3979097325 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc108021030 con 0x562b2d7101b0 2024-09-21T03:52:34.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.106+0000 7fc1067fc640 1 -- 172.21.15.84:0/3979097325 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc1080153c0 con 0x562b2d7101b0 2024-09-21T03:52:34.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.106+0000 7fc12bd4c740 10 client.17409 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:34.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.106+0000 7fc12bd4c740 10 client.17409 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:52:34.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.106+0000 7fc12bd4c740 20 client.17409 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:34.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.106+0000 7fc12bd4c740 1 --2- 172.21.15.84:0/3979097325 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x562b2d739070 0x562b2db6f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:34.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.106+0000 7fc12bd4c740 4 client.17409 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:52:34.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.106+0000 7fc12bd4c740 1 -- 172.21.15.84:0/3979097325 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562b2da548a0 con 0x562b2d739070 2024-09-21T03:52:34.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.106+0000 7fc11f7fe640 1 --2- 172.21.15.84:0/3979097325 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x562b2d739070 0x562b2db6f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:34.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.107+0000 7fc11f7fe640 1 --2- 172.21.15.84:0/3979097325 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x562b2d739070 0x562b2db6f210 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=732db11bacd802d6 server_cookie=90362ca8688581ad in_seq=0 out_seq=0 2024-09-21T03:52:34.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.107+0000 7fc1067fc640 10 client.17409 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:52:34.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.107+0000 7fc1067fc640 1 -- 172.21.15.84:0/3979097325 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562b2da548a0 con 0x562b2d739070 2024-09-21T03:52:34.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.107+0000 7fc1067fc640 10 client.17409 handle_command_reply: tid=0 2024-09-21T03:52:34.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.107+0000 7fc12bd4c740 1 client.17409 shutdown 2024-09-21T03:52:34.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.107+0000 7fc12bd4c740 1 -- 172.21.15.84:0/3979097325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d7101b0 msgr2=0x562b2daf6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:34.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.107+0000 7fc12bd4c740 1 --2- 172.21.15.84:0/3979097325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d7101b0 0x562b2daf6200 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fc108000c00 tx=0x7fc108009d20 comp rx=0 tx=0).stop 2024-09-21T03:52:34.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.107+0000 7fc12bd4c740 1 -- 172.21.15.84:0/3979097325 shutdown_connections 2024-09-21T03:52:34.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.107+0000 7fc12bd4c740 1 --2- 172.21.15.84:0/3979097325 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x562b2d739070 0x562b2db6f210 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.107+0000 7fc12bd4c740 1 --2- 172.21.15.84:0/3979097325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b2d718390 0x562b2daf67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.107+0000 7fc12bd4c740 1 --2- 172.21.15.84:0/3979097325 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x562b2d7101b0 0x562b2daf6200 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.107+0000 7fc1067fc640 0 client.17409 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:52:34.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.107+0000 7fc12bd4c740 1 --2- 172.21.15.84:0/3979097325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562b2d6f79f0 0x562b2daf8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.114 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.107+0000 7fc12bd4c740 1 -- 172.21.15.84:0/3979097325 >> 172.21.15.84:0/3979097325 conn(0x562b2d72d460 msgr2=0x562b2dae16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:34.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.107+0000 7fc12bd4c740 1 -- 172.21.15.84:0/3979097325 shutdown_connections 2024-09-21T03:52:34.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.107+0000 7fc12bd4c740 1 -- 172.21.15.84:0/3979097325 wait complete. 2024-09-21T03:52:34.115 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.107+0000 7fc12bd4c740 20 client.17409 trim_cache size 0 max 16384 2024-09-21T03:52:34.115 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:52:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.108+0000 7fc1257d8640 1 -- 172.21.15.84:0/1415537063 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc10c0b6680 msgr2=0x7fc10c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.108+0000 7fc1257d8640 1 --2- 172.21.15.84:0/1415537063 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc10c0b6680 0x7fc10c0b8b90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc1101054a0 tx=0x7fc110009260 comp rx=0 tx=0).stop 2024-09-21T03:52:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.108+0000 7fc1257d8640 1 -- 172.21.15.84:0/1415537063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc120104880 msgr2=0x7fc12019a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.108+0000 7fc1257d8640 1 --2- 172.21.15.84:0/1415537063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc120104880 0x7fc12019a4c0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fc110032fd0 tx=0x7fc110004270 comp rx=0 tx=0).stop 2024-09-21T03:52:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.108+0000 7fc1257d8640 1 -- 172.21.15.84:0/1415537063 shutdown_connections 2024-09-21T03:52:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.108+0000 7fc1257d8640 1 --2- 172.21.15.84:0/1415537063 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc10c0b6680 0x7fc10c0b8b90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.108+0000 7fc1257d8640 1 --2- 172.21.15.84:0/1415537063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc12010de30 0x7fc12019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.108+0000 7fc1257d8640 1 --2- 172.21.15.84:0/1415537063 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1201052b0 0x7fc12019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.108+0000 7fc1257d8640 1 --2- 172.21.15.84:0/1415537063 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc120104880 0x7fc12019a4c0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.108+0000 7fc1257d8640 1 -- 172.21.15.84:0/1415537063 >> 172.21.15.84:0/1415537063 conn(0x7fc120079730 msgr2=0x7fc120100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.108+0000 7fc1257d8640 1 -- 172.21.15.84:0/1415537063 shutdown_connections 2024-09-21T03:52:34.116 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:34.108+0000 7fc1257d8640 1 -- 172.21.15.84:0/1415537063 wait complete. 2024-09-21T03:52:34.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:33 smithi174 ceph-mon[34403]: pgmap v634: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 46 KiB/s wr, 10 op/s 2024-09-21T03:52:34.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:33 smithi172 ceph-mon[34821]: pgmap v634: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 46 KiB/s wr, 10 op/s 2024-09-21T03:52:34.814 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:52:35.063 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.591+0000 7febc1c8b640 1 -- 172.21.15.84:0/3516802567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febbc102a60 msgr2=0x7febbc102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.591+0000 7febc1c8b640 1 --2- 172.21.15.84:0/3516802567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febbc102a60 0x7febbc102e70 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7febac009900 tx=0x7febac02a410 comp rx=0 tx=0).stop 2024-09-21T03:52:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.591+0000 7febc1c8b640 1 -- 172.21.15.84:0/3516802567 shutdown_connections 2024-09-21T03:52:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.591+0000 7febc1c8b640 1 --2- 172.21.15.84:0/3516802567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febbc108cf0 0x7febbc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.591+0000 7febc1c8b640 1 --2- 172.21.15.84:0/3516802567 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febbc1083a0 0x7febbc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.591+0000 7febc1c8b640 1 --2- 172.21.15.84:0/3516802567 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febbc102a60 0x7febbc102e70 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.709 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.591+0000 7febc1c8b640 1 -- 172.21.15.84:0/3516802567 >> 172.21.15.84:0/3516802567 conn(0x7febbc079730 msgr2=0x7febbc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.591+0000 7febc1c8b640 1 -- 172.21.15.84:0/3516802567 shutdown_connections 2024-09-21T03:52:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.591+0000 7febc1c8b640 1 -- 172.21.15.84:0/3516802567 wait complete. 2024-09-21T03:52:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.592+0000 7febc1c8b640 1 Processor -- start 2024-09-21T03:52:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.593+0000 7febc1c8b640 1 -- start start 2024-09-21T03:52:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.593+0000 7febc1c8b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febbc102a60 0x7febbc19b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.593+0000 7febc1c8b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febbc1083a0 0x7febbc19b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.593+0000 7febc1c8b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febbc108cf0 0x7febbc19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.593+0000 7febc1c8b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7febbc1129c0 con 0x7febbc1083a0 2024-09-21T03:52:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.593+0000 7febc1c8b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7febbc112840 con 0x7febbc102a60 2024-09-21T03:52:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.593+0000 7febc1c8b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7febbc112b40 con 0x7febbc108cf0 2024-09-21T03:52:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.593+0000 7febbaffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febbc1083a0 0x7febbc19b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.593+0000 7febbaffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febbc1083a0 0x7febbc19b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34216/0 (socket says 172.21.15.84:34216) 2024-09-21T03:52:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.593+0000 7febbaffd640 1 -- 172.21.15.84:0/1528865851 learned_addr learned my addr 172.21.15.84:0/1528865851 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:35.710 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.593+0000 7febbb7fe640 1 --2- 172.21.15.84:0/1528865851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febbc102a60 0x7febbc19b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:35.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.593+0000 7febbbfff640 1 --2- 172.21.15.84:0/1528865851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febbc108cf0 0x7febbc19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:35.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.593+0000 7febbaffd640 1 -- 172.21.15.84:0/1528865851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febbc108cf0 msgr2=0x7febbc19bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:35.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.593+0000 7febbaffd640 1 --2- 172.21.15.84:0/1528865851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febbc108cf0 0x7febbc19bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.593+0000 7febbaffd640 1 -- 172.21.15.84:0/1528865851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febbc102a60 msgr2=0x7febbc19b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:35.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.593+0000 7febbaffd640 1 --2- 172.21.15.84:0/1528865851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febbc102a60 0x7febbc19b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.593+0000 7febbaffd640 1 -- 172.21.15.84:0/1528865851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febbc1a6590 con 0x7febbc1083a0 2024-09-21T03:52:35.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.594+0000 7febbaffd640 1 --2- 172.21.15.84:0/1528865851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febbc1083a0 0x7febbc19b810 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7febb000b450 tx=0x7febb000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:35.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.594+0000 7febb8ff9640 1 -- 172.21.15.84:0/1528865851 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb0015020 con 0x7febbc1083a0 2024-09-21T03:52:35.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.594+0000 7febc1c8b640 1 -- 172.21.15.84:0/1528865851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febbc1a6880 con 0x7febbc1083a0 2024-09-21T03:52:35.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.594+0000 7febb8ff9640 1 -- 172.21.15.84:0/1528865851 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febb0011d40 con 0x7febbc1083a0 2024-09-21T03:52:35.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.594+0000 7febb8ff9640 1 -- 172.21.15.84:0/1528865851 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb000f340 con 0x7febbc1083a0 2024-09-21T03:52:35.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.594+0000 7febc1c8b640 1 -- 172.21.15.84:0/1528865851 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febbc1a6e40 con 0x7febbc1083a0 2024-09-21T03:52:35.711 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.596+0000 7febc81ff740 1 Processor -- start 2024-09-21T03:52:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.596+0000 7febc81ff740 1 -- start start 2024-09-21T03:52:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.597+0000 7febb8ff9640 1 -- 172.21.15.84:0/1528865851 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7febb0018020 con 0x7febbc1083a0 2024-09-21T03:52:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.597+0000 7febc81ff740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10d9070 0x55e6d14806a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.597+0000 7febc81ff740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6d10b01b0 0x55e6d1480be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.597+0000 7febc81ff740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e6d10b8390 0x55e6d1481120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.597+0000 7febc81ff740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e6d13f6ea0 con 0x55e6d10d9070 2024-09-21T03:52:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.597+0000 7febc81ff740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e6d13e62d0 con 0x55e6d10b01b0 2024-09-21T03:52:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.597+0000 7febc81ff740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e6d13ea0e0 con 0x55e6d10b8390 2024-09-21T03:52:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.597+0000 7febbbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10d9070 0x55e6d14806a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.597+0000 7febbbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10d9070 0x55e6d14806a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34226/0 (socket says 172.21.15.84:34226) 2024-09-21T03:52:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.597+0000 7febbbfff640 1 -- 172.21.15.84:0/1270233237 learned_addr learned my addr 172.21.15.84:0/1270233237 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.597+0000 7febbb7fe640 1 --2- 172.21.15.84:0/1270233237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6d10b01b0 0x55e6d1480be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.597+0000 7febbbfff640 1 -- 172.21.15.84:0/1270233237 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e6d10b8390 msgr2=0x55e6d1481120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:35.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.597+0000 7febbbfff640 1 --2- 172.21.15.84:0/1270233237 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e6d10b8390 0x55e6d1481120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.597+0000 7febbbfff640 1 -- 172.21.15.84:0/1270233237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6d10b01b0 msgr2=0x55e6d1480be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:35.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.597+0000 7febbbfff640 1 --2- 172.21.15.84:0/1270233237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6d10b01b0 0x55e6d1480be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.597+0000 7febbbfff640 1 -- 172.21.15.84:0/1270233237 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6d1144650 con 0x55e6d10d9070 2024-09-21T03:52:35.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.597+0000 7febbbfff640 1 --2- 172.21.15.84:0/1270233237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10d9070 0x55e6d14806a0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7febb4008dc0 tx=0x7febb400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193d219a13dde00e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:35.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.598+0000 7feba1ffb640 1 -- 172.21.15.84:0/1270233237 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb4014070 con 0x55e6d10d9070 2024-09-21T03:52:35.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.598+0000 7febb8ff9640 1 --2- 172.21.15.84:0/1528865851 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7feba40b6680 0x7feba40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:35.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.598+0000 7feba1ffb640 1 -- 172.21.15.84:0/1270233237 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febb4003b70 con 0x55e6d10d9070 2024-09-21T03:52:35.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.598+0000 7feba1ffb640 1 -- 172.21.15.84:0/1270233237 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb40107b0 con 0x55e6d10d9070 2024-09-21T03:52:35.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.598+0000 7febbb7fe640 1 --2- 172.21.15.84:0/1528865851 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7feba40b6680 0x7feba40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:35.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.598+0000 7febb8ff9640 1 -- 172.21.15.84:0/1528865851 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7febb00e70d0 con 0x7febbc1083a0 2024-09-21T03:52:35.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.599+0000 7febc81ff740 1 -- 172.21.15.84:0/1270233237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10d9070 msgr2=0x55e6d14806a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:35.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.599+0000 7febc81ff740 1 --2- 172.21.15.84:0/1270233237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10d9070 0x55e6d14806a0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7febb4008dc0 tx=0x7febb400e720 comp rx=0 tx=0).stop 2024-09-21T03:52:35.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.599+0000 7febbb7fe640 1 --2- 172.21.15.84:0/1528865851 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7feba40b6680 0x7feba40b8b90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7febac000c00 tx=0x7febac031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.599+0000 7febc81ff740 1 -- 172.21.15.84:0/1270233237 shutdown_connections 2024-09-21T03:52:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.599+0000 7febc81ff740 1 --2- 172.21.15.84:0/1270233237 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e6d10b8390 0x55e6d1481120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.599+0000 7febc81ff740 1 --2- 172.21.15.84:0/1270233237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6d10b01b0 0x55e6d1480be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.599+0000 7febc81ff740 1 --2- 172.21.15.84:0/1270233237 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10d9070 0x55e6d14806a0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.599+0000 7febc81ff740 1 -- 172.21.15.84:0/1270233237 >> 172.21.15.84:0/1270233237 conn(0x55e6d10cd460 msgr2=0x55e6d147e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.599+0000 7febc81ff740 1 -- 172.21.15.84:0/1270233237 shutdown_connections 2024-09-21T03:52:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.599+0000 7febc81ff740 1 -- 172.21.15.84:0/1270233237 wait complete. 2024-09-21T03:52:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.599+0000 7febc81ff740 1 -- start start 2024-09-21T03:52:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.599+0000 7febc81ff740 1 Processor -- start 2024-09-21T03:52:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.600+0000 7febc81ff740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10b01b0 0x55e6d148be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.600+0000 7febc81ff740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6d10b8390 0x55e6d148c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.600+0000 7febc81ff740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e6d10d9070 0x55e6d1498170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:35.714 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.600+0000 7febc81ff740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55e6d1247700 con 0x55e6d10b01b0 2024-09-21T03:52:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.600+0000 7febc81ff740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e6d1381160 con 0x55e6d10b8390 2024-09-21T03:52:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.600+0000 7febc81ff740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55e6d148ee80 con 0x55e6d10d9070 2024-09-21T03:52:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.600+0000 7febc81ff740 10 client.0 _ll_register_callbacks cb 0x55e6d139a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.600+0000 7febbb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10b01b0 0x55e6d148be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.600+0000 7febbb7fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10b01b0 0x55e6d148be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34240/0 (socket says 172.21.15.84:34240) 2024-09-21T03:52:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.600+0000 7febbb7fe640 1 -- 172.21.15.84:0/1659130985 learned_addr learned my addr 172.21.15.84:0/1659130985 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.600+0000 7febbaffd640 1 --2- 172.21.15.84:0/1659130985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6d10b8390 0x55e6d148c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.600+0000 7febbbfff640 1 --2- 172.21.15.84:0/1659130985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e6d10d9070 0x55e6d1498170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.600+0000 7febbb7fe640 1 -- 172.21.15.84:0/1659130985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e6d10d9070 msgr2=0x55e6d1498170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.600+0000 7febbb7fe640 1 --2- 172.21.15.84:0/1659130985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e6d10d9070 0x55e6d1498170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.600+0000 7febbb7fe640 1 -- 172.21.15.84:0/1659130985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6d10b8390 msgr2=0x55e6d148c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.600+0000 7febbb7fe640 1 --2- 172.21.15.84:0/1659130985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6d10b8390 0x55e6d148c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.715 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.600+0000 7febbb7fe640 1 -- 172.21.15.84:0/1659130985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6d13aec90 con 0x55e6d10b01b0 2024-09-21T03:52:35.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.600+0000 7febbb7fe640 1 --2- 172.21.15.84:0/1659130985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10b01b0 0x55e6d148be50 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7febac009900 tx=0x7febac02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9aba62f61ac1a0e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:35.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.600+0000 7feb9affd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:35.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.601+0000 7feb9affd640 1 -- 172.21.15.84:0/1659130985 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febac04c070 con 0x55e6d10b01b0 2024-09-21T03:52:35.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.601+0000 7feb9affd640 1 -- 172.21.15.84:0/1659130985 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7febac004250 con 0x55e6d10b01b0 2024-09-21T03:52:35.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.601+0000 7febc81ff740 1 -- 172.21.15.84:0/1659130985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febb4003b70 con 0x55e6d10b01b0 2024-09-21T03:52:35.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.601+0000 7feb9affd640 1 -- 172.21.15.84:0/1659130985 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7febac058050 con 0x55e6d10b01b0 2024-09-21T03:52:35.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.601+0000 7febc81ff740 10 client.17421 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:35.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.601+0000 7febc81ff740 1 -- 172.21.15.84:0/1659130985 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e6d149ac30 con 0x55e6d10b01b0 2024-09-21T03:52:35.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.601+0000 7feb9affd640 1 -- 172.21.15.84:0/1659130985 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febb4003b70 con 0x55e6d10b01b0 2024-09-21T03:52:35.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.601+0000 7feb9affd640 1 -- 172.21.15.84:0/1659130985 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7febac03c600 con 0x55e6d10b01b0 2024-09-21T03:52:35.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.601+0000 7febc81ff740 10 client.17421 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:35.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.601+0000 7febc81ff740 10 client.17421 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:52:35.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.601+0000 7febc81ff740 20 client.17421 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:35.716 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.601+0000 7febc81ff740 1 --2- 172.21.15.84:0/1659130985 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55e6d10979f0 0x55e6d149e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.601+0000 7febc81ff740 4 client.17421 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:52:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.601+0000 7febc81ff740 1 -- 172.21.15.84:0/1659130985 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6d13f8df0 con 0x55e6d10979f0 2024-09-21T03:52:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.602+0000 7febbaffd640 1 --2- 172.21.15.84:0/1659130985 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55e6d10979f0 0x55e6d149e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.602+0000 7feb9affd640 10 client.17421 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:52:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.602+0000 7febbaffd640 1 --2- 172.21.15.84:0/1659130985 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55e6d10979f0 0x55e6d149e0f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3cbebe762a9a735d server_cookie=5d1c9ca98e71ad40 in_seq=0 out_seq=0 2024-09-21T03:52:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.603+0000 7feb9affd640 1 -- 172.21.15.84:0/1659130985 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e6d13f8df0 con 0x55e6d10979f0 2024-09-21T03:52:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.603+0000 7feb9affd640 10 client.17421 handle_command_reply: tid=0 2024-09-21T03:52:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.603+0000 7febc81ff740 1 client.17421 shutdown 2024-09-21T03:52:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.603+0000 7febc81ff740 1 -- 172.21.15.84:0/1659130985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10b01b0 msgr2=0x55e6d148be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.603+0000 7febc81ff740 1 --2- 172.21.15.84:0/1659130985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10b01b0 0x55e6d148be50 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7febac009900 tx=0x7febac02a410 comp rx=0 tx=0).stop 2024-09-21T03:52:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.603+0000 7febc81ff740 1 -- 172.21.15.84:0/1659130985 shutdown_connections 2024-09-21T03:52:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.603+0000 7febc81ff740 1 --2- 172.21.15.84:0/1659130985 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55e6d10979f0 0x55e6d149e0f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.717 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.603+0000 7febc81ff740 1 --2- 172.21.15.84:0/1659130985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e6d10d9070 0x55e6d1498170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.603+0000 7febc81ff740 1 --2- 172.21.15.84:0/1659130985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6d10b8390 0x55e6d148c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.603+0000 7febc81ff740 1 --2- 172.21.15.84:0/1659130985 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10b01b0 0x55e6d148be50 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.603+0000 7feb9affd640 0 client.17421 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:52:35.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.603+0000 7febc81ff740 1 -- 172.21.15.84:0/1659130985 >> 172.21.15.84:0/1659130985 conn(0x55e6d10cd460 msgr2=0x55e6d1483850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:35.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.603+0000 7febc81ff740 1 -- 172.21.15.84:0/1659130985 shutdown_connections 2024-09-21T03:52:35.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.603+0000 7febc81ff740 1 -- 172.21.15.84:0/1659130985 wait complete. 2024-09-21T03:52:35.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.603+0000 7febc81ff740 20 client.17421 trim_cache size 0 max 16384 2024-09-21T03:52:35.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.616+0000 7febc81ff740 1 Processor -- start 2024-09-21T03:52:35.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.616+0000 7febc81ff740 1 -- start start 2024-09-21T03:52:35.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.616+0000 7febc81ff740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6d10b01b0 0x55e6d1483eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:35.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.616+0000 7febc81ff740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e6d10b8390 0x55e6d1498070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:35.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.616+0000 7febc81ff740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10d9070 0x55e6d1489040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:35.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.616+0000 7febc81ff740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7febbc1b1fc0 con 0x55e6d10d9070 2024-09-21T03:52:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.616+0000 7febc81ff740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7febbc1af890 con 0x55e6d10b01b0 2024-09-21T03:52:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.616+0000 7febc81ff740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7febbc1ad700 con 0x55e6d10b8390 2024-09-21T03:52:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.616+0000 7febbbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10d9070 0x55e6d1489040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.616+0000 7febbbfff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10d9070 0x55e6d1489040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34242/0 (socket says 172.21.15.84:34242) 2024-09-21T03:52:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.616+0000 7febbbfff640 1 -- 172.21.15.84:0/2584849310 learned_addr learned my addr 172.21.15.84:0/2584849310 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.617+0000 7febbbfff640 1 -- 172.21.15.84:0/2584849310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e6d10b8390 msgr2=0x55e6d1498070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.617+0000 7febbbfff640 1 --2- 172.21.15.84:0/2584849310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e6d10b8390 0x55e6d1498070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.617+0000 7febbbfff640 1 -- 172.21.15.84:0/2584849310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6d10b01b0 msgr2=0x55e6d1483eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.617+0000 7febbbfff640 1 --2- 172.21.15.84:0/2584849310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6d10b01b0 0x55e6d1483eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.617+0000 7febbbfff640 1 -- 172.21.15.84:0/2584849310 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6d1486ab0 con 0x55e6d10d9070 2024-09-21T03:52:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.617+0000 7febbbfff640 1 --2- 172.21.15.84:0/2584849310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10d9070 0x55e6d1489040 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7febb4004940 tx=0x7febb4010570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce4b75fe3f58e3a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.617+0000 7feba17fa640 1 -- 172.21.15.84:0/2584849310 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb4014050 con 0x55e6d10d9070 2024-09-21T03:52:35.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.617+0000 7feba17fa640 1 -- 172.21.15.84:0/2584849310 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febb4028070 con 0x55e6d10d9070 2024-09-21T03:52:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.617+0000 7feba17fa640 1 -- 172.21.15.84:0/2584849310 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb4018b30 con 0x55e6d10d9070 2024-09-21T03:52:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.618+0000 7febc81ff740 1 -- 172.21.15.84:0/2584849310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10d9070 msgr2=0x55e6d1489040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.618+0000 7febc81ff740 1 --2- 172.21.15.84:0/2584849310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10d9070 0x55e6d1489040 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7febb4004940 tx=0x7febb4010570 comp rx=0 tx=0).stop 2024-09-21T03:52:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.618+0000 7febc81ff740 1 -- 172.21.15.84:0/2584849310 shutdown_connections 2024-09-21T03:52:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.618+0000 7febc81ff740 1 --2- 172.21.15.84:0/2584849310 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10d9070 0x55e6d1489040 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.618+0000 7febc81ff740 1 --2- 172.21.15.84:0/2584849310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e6d10b8390 0x55e6d1498070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.618+0000 7febc81ff740 1 --2- 172.21.15.84:0/2584849310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6d10b01b0 0x55e6d1483eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.618+0000 7febc81ff740 1 -- 172.21.15.84:0/2584849310 >> 172.21.15.84:0/2584849310 conn(0x55e6d10cd460 msgr2=0x55e6d14837a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.618+0000 7febc81ff740 1 -- 172.21.15.84:0/2584849310 shutdown_connections 2024-09-21T03:52:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.618+0000 7febc81ff740 1 -- 172.21.15.84:0/2584849310 wait complete. 2024-09-21T03:52:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.618+0000 7febc81ff740 1 -- start start 2024-09-21T03:52:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.618+0000 7febc81ff740 1 Processor -- start 2024-09-21T03:52:35.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7febc81ff740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6d10b01b0 0x55e6d1490300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7febc81ff740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10b8390 0x55e6d1490840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7febc81ff740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e6d10d9070 0x55e6d1507ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7febc81ff740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7febbc1add50 con 0x55e6d10b8390 2024-09-21T03:52:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7febc81ff740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7febbc1af1c0 con 0x55e6d10b01b0 2024-09-21T03:52:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7febc81ff740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7febbc1ae420 con 0x55e6d10d9070 2024-09-21T03:52:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7febc81ff740 10 client.0 _ll_register_callbacks cb 0x7febac040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7febbaffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10b8390 0x55e6d1490840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7febbaffd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10b8390 0x55e6d1490840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34244/0 (socket says 172.21.15.84:34244) 2024-09-21T03:52:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7febbaffd640 1 -- 172.21.15.84:0/3095261303 learned_addr learned my addr 172.21.15.84:0/3095261303 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7febbbfff640 1 --2- 172.21.15.84:0/3095261303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e6d10d9070 0x55e6d1507ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7febbaffd640 1 -- 172.21.15.84:0/3095261303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e6d10d9070 msgr2=0x55e6d1507ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7febbaffd640 1 --2- 172.21.15.84:0/3095261303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e6d10d9070 0x55e6d1507ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7febbaffd640 1 -- 172.21.15.84:0/3095261303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6d10b01b0 msgr2=0x55e6d1490300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:35.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7febbaffd640 1 --2- 172.21.15.84:0/3095261303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6d10b01b0 0x55e6d1490300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7febbaffd640 1 -- 172.21.15.84:0/3095261303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6d1491030 con 0x55e6d10b8390 2024-09-21T03:52:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7febbaffd640 1 --2- 172.21.15.84:0/3095261303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10b8390 0x55e6d1490840 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7febb00a9540 tx=0x7febb000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39508ac9484df8d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7feb9affd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7feb9affd640 1 -- 172.21.15.84:0/3095261303 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb00ad670 con 0x55e6d10b8390 2024-09-21T03:52:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7feb9affd640 1 -- 172.21.15.84:0/3095261303 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7febb0010500 con 0x55e6d10b8390 2024-09-21T03:52:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7febc81ff740 1 -- 172.21.15.84:0/3095261303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febb4028070 con 0x55e6d10b8390 2024-09-21T03:52:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7feb9affd640 1 -- 172.21.15.84:0/3095261303 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7febb00b1a50 con 0x55e6d10b8390 2024-09-21T03:52:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.619+0000 7febc81ff740 10 client.17427 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.620+0000 7febc81ff740 1 -- 172.21.15.84:0/3095261303 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e6d1509000 con 0x55e6d10b8390 2024-09-21T03:52:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.620+0000 7feb9affd640 1 -- 172.21.15.84:0/3095261303 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febb4028070 con 0x55e6d10b8390 2024-09-21T03:52:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.620+0000 7feb9affd640 1 -- 172.21.15.84:0/3095261303 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7febb00940b0 con 0x55e6d10b8390 2024-09-21T03:52:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.620+0000 7febc81ff740 10 client.17427 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.620+0000 7febc81ff740 10 client.17427 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:52:35.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.620+0000 7febc81ff740 20 client.17427 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.620+0000 7febc81ff740 1 --2- 172.21.15.84:0/3095261303 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55e6d106cda0 0x55e6d150b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.620+0000 7febc81ff740 4 client.17427 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:52:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.620+0000 7febc81ff740 1 -- 172.21.15.84:0/3095261303 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e6d13f48a0 con 0x55e6d106cda0 2024-09-21T03:52:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.620+0000 7febbb7fe640 1 --2- 172.21.15.84:0/3095261303 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55e6d106cda0 0x55e6d150b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.621+0000 7feb9affd640 10 client.17427 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:52:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.621+0000 7febbb7fe640 1 --2- 172.21.15.84:0/3095261303 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55e6d106cda0 0x55e6d150b6e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7d9d3ce9c5a122bc server_cookie=ebd36fea5d671d52 in_seq=0 out_seq=0 2024-09-21T03:52:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.621+0000 7feb9affd640 1 -- 172.21.15.84:0/3095261303 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e6d13f48a0 con 0x55e6d106cda0 2024-09-21T03:52:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.621+0000 7feb9affd640 10 client.17427 handle_command_reply: tid=0 2024-09-21T03:52:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.621+0000 7febc81ff740 1 client.17427 shutdown 2024-09-21T03:52:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.621+0000 7febc81ff740 1 -- 172.21.15.84:0/3095261303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10b8390 msgr2=0x55e6d1490840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.621+0000 7febc81ff740 1 --2- 172.21.15.84:0/3095261303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10b8390 0x55e6d1490840 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7febb00a9540 tx=0x7febb000bf40 comp rx=0 tx=0).stop 2024-09-21T03:52:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.621+0000 7febc81ff740 1 -- 172.21.15.84:0/3095261303 shutdown_connections 2024-09-21T03:52:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.621+0000 7febc81ff740 1 --2- 172.21.15.84:0/3095261303 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55e6d106cda0 0x55e6d150b6e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.621+0000 7febc81ff740 1 --2- 172.21.15.84:0/3095261303 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e6d10d9070 0x55e6d1507ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.621+0000 7febc81ff740 1 --2- 172.21.15.84:0/3095261303 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55e6d10b8390 0x55e6d1490840 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.621+0000 7febc81ff740 1 --2- 172.21.15.84:0/3095261303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e6d10b01b0 0x55e6d1490300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.621+0000 7febc81ff740 1 -- 172.21.15.84:0/3095261303 >> 172.21.15.84:0/3095261303 conn(0x55e6d10cd460 msgr2=0x55e6d14816d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:35.724 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:52:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.621+0000 7feb9affd640 0 client.17427 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:52:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.621+0000 7febc81ff740 1 -- 172.21.15.84:0/3095261303 shutdown_connections 2024-09-21T03:52:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.621+0000 7febc81ff740 1 -- 172.21.15.84:0/3095261303 wait complete. 2024-09-21T03:52:35.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.621+0000 7febc81ff740 20 client.17427 trim_cache size 0 max 16384 2024-09-21T03:52:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.622+0000 7febc1c8b640 1 -- 172.21.15.84:0/1528865851 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7feba40b6680 msgr2=0x7feba40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.622+0000 7febc1c8b640 1 --2- 172.21.15.84:0/1528865851 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7feba40b6680 0x7feba40b8b90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7febac000c00 tx=0x7febac031400 comp rx=0 tx=0).stop 2024-09-21T03:52:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.622+0000 7febc1c8b640 1 -- 172.21.15.84:0/1528865851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febbc1083a0 msgr2=0x7febbc19b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.622+0000 7febc1c8b640 1 --2- 172.21.15.84:0/1528865851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febbc1083a0 0x7febbc19b810 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7febb000b450 tx=0x7febb000b910 comp rx=0 tx=0).stop 2024-09-21T03:52:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.622+0000 7febc1c8b640 1 -- 172.21.15.84:0/1528865851 shutdown_connections 2024-09-21T03:52:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.622+0000 7febc1c8b640 1 --2- 172.21.15.84:0/1528865851 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7feba40b6680 0x7feba40b8b90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.622+0000 7febc1c8b640 1 --2- 172.21.15.84:0/1528865851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7febbc108cf0 0x7febbc19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.622+0000 7febc1c8b640 1 --2- 172.21.15.84:0/1528865851 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7febbc1083a0 0x7febbc19b810 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.622+0000 7febc1c8b640 1 --2- 172.21.15.84:0/1528865851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febbc102a60 0x7febbc19b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.622+0000 7febc1c8b640 1 -- 172.21.15.84:0/1528865851 >> 172.21.15.84:0/1528865851 conn(0x7febbc079730 msgr2=0x7febbc101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.622+0000 7febc1c8b640 1 -- 172.21.15.84:0/1528865851 shutdown_connections 2024-09-21T03:52:35.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:35.622+0000 7febc1c8b640 1 -- 172.21.15.84:0/1528865851 wait complete. 2024-09-21T03:52:36.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:35 smithi174 ceph-mon[34403]: pgmap v635: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 69 KiB/s wr, 12 op/s 2024-09-21T03:52:36.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:35 smithi172 ceph-mon[34821]: pgmap v635: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 69 KiB/s wr, 12 op/s 2024-09-21T03:52:36.191 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:35 smithi084 ceph-mon[30941]: pgmap v635: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 69 KiB/s wr, 12 op/s 2024-09-21T03:52:36.508 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:52:36.757 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:37.286 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.251+0000 7f79584c6640 1 -- 172.21.15.84:0/1439662893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79501051c0 msgr2=0x7f79501055d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:37.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.251+0000 7f79584c6640 1 --2- 172.21.15.84:0/1439662893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79501051c0 0x7f79501055d0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f7940009900 tx=0x7f794002a410 comp rx=0 tx=0).stop 2024-09-21T03:52:37.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.251+0000 7f79584c6640 1 -- 172.21.15.84:0/1439662893 shutdown_connections 2024-09-21T03:52:37.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.251+0000 7f79584c6640 1 --2- 172.21.15.84:0/1439662893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7950105b10 0x7f795010f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.251+0000 7f79584c6640 1 --2- 172.21.15.84:0/1439662893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f79501051c0 0x7f79501055d0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.251+0000 7f79584c6640 1 --2- 172.21.15.84:0/1439662893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79501031b0 0x7f79501035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.251+0000 7f79584c6640 1 -- 172.21.15.84:0/1439662893 >> 172.21.15.84:0/1439662893 conn(0x7f7950079f90 msgr2=0x7f795007a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:37.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.251+0000 7f79584c6640 1 -- 172.21.15.84:0/1439662893 shutdown_connections 2024-09-21T03:52:37.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.251+0000 7f79584c6640 1 -- 172.21.15.84:0/1439662893 wait complete. 2024-09-21T03:52:37.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.252+0000 7f79584c6640 1 Processor -- start 2024-09-21T03:52:37.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.252+0000 7f79584c6640 1 -- start start 2024-09-21T03:52:37.287 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.252+0000 7f79584c6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79501031b0 0x7f7950199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:37.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.252+0000 7f79584c6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79501051c0 0x7f7950199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:37.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.252+0000 7f79584c6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7950105b10 0x7f795019ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:37.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.252+0000 7f79584c6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7950112a10 con 0x7f7950105b10 2024-09-21T03:52:37.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.252+0000 7f79584c6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7950112890 con 0x7f79501031b0 2024-09-21T03:52:37.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.252+0000 7f79584c6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7950112b90 con 0x7f79501051c0 2024-09-21T03:52:37.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.252+0000 7f7956a63640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7950105b10 0x7f795019ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:37.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.252+0000 7f7956a63640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7950105b10 0x7f795019ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34260/0 (socket says 172.21.15.84:34260) 2024-09-21T03:52:37.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.252+0000 7f7956a63640 1 -- 172.21.15.84:0/3449477232 learned_addr learned my addr 172.21.15.84:0/3449477232 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:37.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.253+0000 7f7955a61640 1 --2- 172.21.15.84:0/3449477232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79501051c0 0x7f7950199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:37.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.253+0000 7f7956a63640 1 -- 172.21.15.84:0/3449477232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79501051c0 msgr2=0x7f7950199a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:37.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.253+0000 7f7956262640 1 --2- 172.21.15.84:0/3449477232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79501031b0 0x7f7950199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:37.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.253+0000 7f7956a63640 1 --2- 172.21.15.84:0/3449477232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79501051c0 0x7f7950199a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.288 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.253+0000 7f7956a63640 1 -- 172.21.15.84:0/3449477232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79501031b0 msgr2=0x7f7950199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:37.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.253+0000 7f7956a63640 1 --2- 172.21.15.84:0/3449477232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79501031b0 0x7f7950199480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.253+0000 7f7956a63640 1 -- 172.21.15.84:0/3449477232 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795019f330 con 0x7f7950105b10 2024-09-21T03:52:37.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.253+0000 7f7955a61640 1 --2- 172.21.15.84:0/3449477232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79501051c0 0x7f7950199a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:52:37.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.253+0000 7f7956a63640 1 --2- 172.21.15.84:0/3449477232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7950105b10 0x7f795019ecc0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f794800ebb0 tx=0x7f7948007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:37.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.253+0000 7f79477fe640 1 -- 172.21.15.84:0/3449477232 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7948007ca0 con 0x7f7950105b10 2024-09-21T03:52:37.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.253+0000 7f79584c6640 1 -- 172.21.15.84:0/3449477232 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f795019f5c0 con 0x7f7950105b10 2024-09-21T03:52:37.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.253+0000 7f79477fe640 1 -- 172.21.15.84:0/3449477232 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7948007e40 con 0x7f7950105b10 2024-09-21T03:52:37.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.253+0000 7f79477fe640 1 -- 172.21.15.84:0/3449477232 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79480057d0 con 0x7f7950105b10 2024-09-21T03:52:37.289 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.253+0000 7f79584c6640 1 -- 172.21.15.84:0/3449477232 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f795019fad0 con 0x7f7950105b10 2024-09-21T03:52:37.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.256+0000 7f795ea3a740 1 Processor -- start 2024-09-21T03:52:37.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.256+0000 7f79477fe640 1 -- 172.21.15.84:0/3449477232 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f7948004a40 con 0x7f7950105b10 2024-09-21T03:52:37.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.257+0000 7f795ea3a740 1 -- start start 2024-09-21T03:52:37.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.257+0000 7f795ea3a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c542011070 0x55c5423b86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:37.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.257+0000 7f795ea3a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c541fe81b0 0x55c5423b8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:37.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.257+0000 7f795ea3a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c541ff0390 0x55c5423b9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:37.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.257+0000 7f795ea3a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c54232eea0 con 0x55c542011070 2024-09-21T03:52:37.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.257+0000 7f795ea3a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c54231e2d0 con 0x55c541fe81b0 2024-09-21T03:52:37.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.257+0000 7f795ea3a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c5423220e0 con 0x55c541ff0390 2024-09-21T03:52:37.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.257+0000 7f7955a61640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c542011070 0x55c5423b86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:37.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.257+0000 7f7955a61640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c542011070 0x55c5423b86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34262/0 (socket says 172.21.15.84:34262) 2024-09-21T03:52:37.290 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.257+0000 7f7955a61640 1 -- 172.21.15.84:0/3370261787 learned_addr learned my addr 172.21.15.84:0/3370261787 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:37.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.257+0000 7f7956262640 1 --2- 172.21.15.84:0/3370261787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c541fe81b0 0x55c5423b8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:37.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.257+0000 7f79477fe640 1 --2- 172.21.15.84:0/3449477232 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f793c0b66b0 0x7f793c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:37.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.258+0000 7f7955a61640 1 -- 172.21.15.84:0/3370261787 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c541ff0390 msgr2=0x55c5423b9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:37.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.258+0000 7f7955a61640 1 --2- 172.21.15.84:0/3370261787 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c541ff0390 0x55c5423b9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.258+0000 7f7955a61640 1 -- 172.21.15.84:0/3370261787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c541fe81b0 msgr2=0x55c5423b8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:37.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.258+0000 7f7955a61640 1 --2- 172.21.15.84:0/3370261787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c541fe81b0 0x55c5423b8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.258+0000 7f7955a61640 1 -- 172.21.15.84:0/3370261787 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c54207c650 con 0x55c542011070 2024-09-21T03:52:37.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.258+0000 7f7956a63640 1 --2- 172.21.15.84:0/3449477232 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f793c0b66b0 0x7f793c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:37.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.258+0000 7f79477fe640 1 -- 172.21.15.84:0/3449477232 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f79480e8ca0 con 0x7f7950105b10 2024-09-21T03:52:37.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.258+0000 7f7955a61640 1 --2- 172.21.15.84:0/3370261787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c542011070 0x55c5423b86a0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f7940031440 tx=0x7f7940032df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f3d967ccbfd5d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:37.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.258+0000 7f7944ff9640 1 -- 172.21.15.84:0/3370261787 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7940035050 con 0x55c542011070 2024-09-21T03:52:37.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.258+0000 7f7944ff9640 1 -- 172.21.15.84:0/3370261787 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79400316a0 con 0x55c542011070 2024-09-21T03:52:37.291 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.258+0000 7f7944ff9640 1 -- 172.21.15.84:0/3370261787 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79400046c0 con 0x55c542011070 2024-09-21T03:52:37.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.259+0000 7f795ea3a740 1 -- 172.21.15.84:0/3370261787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c542011070 msgr2=0x55c5423b86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:37.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.259+0000 7f795ea3a740 1 --2- 172.21.15.84:0/3370261787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c542011070 0x55c5423b86a0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f7940031440 tx=0x7f7940032df0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.259+0000 7f7956a63640 1 --2- 172.21.15.84:0/3449477232 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f793c0b66b0 0x7f793c0b8bc0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f79480aead0 tx=0x7f794808cf90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:37.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.259+0000 7f795ea3a740 1 -- 172.21.15.84:0/3370261787 shutdown_connections 2024-09-21T03:52:37.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.259+0000 7f795ea3a740 1 --2- 172.21.15.84:0/3370261787 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c541ff0390 0x55c5423b9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.292 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:52:37.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.259+0000 7f795ea3a740 1 --2- 172.21.15.84:0/3370261787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c541fe81b0 0x55c5423b8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.259+0000 7f795ea3a740 1 --2- 172.21.15.84:0/3370261787 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c542011070 0x55c5423b86a0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.259+0000 7f795ea3a740 1 -- 172.21.15.84:0/3370261787 >> 172.21.15.84:0/3370261787 conn(0x55c542005460 msgr2=0x55c5423b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:37.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.259+0000 7f795ea3a740 1 -- 172.21.15.84:0/3370261787 shutdown_connections 2024-09-21T03:52:37.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.259+0000 7f795ea3a740 1 -- 172.21.15.84:0/3370261787 wait complete. 2024-09-21T03:52:37.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.260+0000 7f795ea3a740 1 -- start start 2024-09-21T03:52:37.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.260+0000 7f795ea3a740 1 Processor -- start 2024-09-21T03:52:37.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.260+0000 7f795ea3a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c541fe81b0 0x55c5423c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:37.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.260+0000 7f795ea3a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c541ff0390 0x55c5423c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:37.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.260+0000 7f795ea3a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c542011070 0x55c5423d0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:37.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.260+0000 7f795ea3a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c54217f700 con 0x55c541ff0390 2024-09-21T03:52:37.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.260+0000 7f795ea3a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c5422b9160 con 0x55c541fe81b0 2024-09-21T03:52:37.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.260+0000 7f795ea3a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c5423c6e20 con 0x55c542011070 2024-09-21T03:52:37.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.260+0000 7f795ea3a740 10 client.0 _ll_register_callbacks cb 0x55c5422d29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:37.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.260+0000 7f7956262640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c541ff0390 0x55c5423c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:37.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.260+0000 7f7956262640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c541ff0390 0x55c5423c42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34270/0 (socket says 172.21.15.84:34270) 2024-09-21T03:52:37.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.260+0000 7f7956262640 1 -- 172.21.15.84:0/3060856032 learned_addr learned my addr 172.21.15.84:0/3060856032 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:37.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.260+0000 7f7955a61640 1 --2- 172.21.15.84:0/3060856032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c541fe81b0 0x55c5423c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:37.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.260+0000 7f7955a61640 1 --2- 172.21.15.84:0/3060856032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c542011070 0x55c5423d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:37.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.260+0000 7f7956262640 1 -- 172.21.15.84:0/3060856032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c542011070 msgr2=0x55c5423d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:37.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.260+0000 7f7956262640 1 --2- 172.21.15.84:0/3060856032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c542011070 0x55c5423d0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.260+0000 7f7956262640 1 -- 172.21.15.84:0/3060856032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c541fe81b0 msgr2=0x55c5423c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:37.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.260+0000 7f7956262640 1 --2- 172.21.15.84:0/3060856032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c541fe81b0 0x55c5423c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.260+0000 7f7956262640 1 -- 172.21.15.84:0/3060856032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5422e6c90 con 0x55c541ff0390 2024-09-21T03:52:37.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.261+0000 7f7956262640 1 --2- 172.21.15.84:0/3060856032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c541ff0390 0x55c5423c42f0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f794c010770 tx=0x7f794c010c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a155cdf18b8c4f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:37.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.261+0000 7f7939ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:37.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.261+0000 7f7939ffb640 1 -- 172.21.15.84:0/3060856032 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f794c01d060 con 0x55c541ff0390 2024-09-21T03:52:37.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.261+0000 7f7939ffb640 1 -- 172.21.15.84:0/3060856032 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f794c00eda0 con 0x55c541ff0390 2024-09-21T03:52:37.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.261+0000 7f795ea3a740 1 -- 172.21.15.84:0/3060856032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79400316a0 con 0x55c541ff0390 2024-09-21T03:52:37.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.261+0000 7f7939ffb640 1 -- 172.21.15.84:0/3060856032 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f794c022460 con 0x55c541ff0390 2024-09-21T03:52:37.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.261+0000 7f795ea3a740 10 client.17439 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:37.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.261+0000 7f795ea3a740 1 -- 172.21.15.84:0/3060856032 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c5423d2be0 con 0x55c541ff0390 2024-09-21T03:52:37.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.261+0000 7f7939ffb640 1 -- 172.21.15.84:0/3060856032 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79400316a0 con 0x55c541ff0390 2024-09-21T03:52:37.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.261+0000 7f7939ffb640 1 -- 172.21.15.84:0/3060856032 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f794c00d480 con 0x55c541ff0390 2024-09-21T03:52:37.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.261+0000 7f795ea3a740 10 client.17439 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:37.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.261+0000 7f795ea3a740 10 client.17439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:52:37.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.261+0000 7f795ea3a740 20 client.17439 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:37.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.261+0000 7f795ea3a740 1 --2- 172.21.15.84:0/3060856032 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c541fcf9f0 0x55c5423d6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:37.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.261+0000 7f795ea3a740 4 client.17439 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:52:37.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.261+0000 7f795ea3a740 1 -- 172.21.15.84:0/3060856032 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c542330df0 con 0x55c541fcf9f0 2024-09-21T03:52:37.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.262+0000 7f7955a61640 1 --2- 172.21.15.84:0/3060856032 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c541fcf9f0 0x55c5423d6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:37.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.262+0000 7f7955a61640 1 --2- 172.21.15.84:0/3060856032 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c541fcf9f0 0x55c5423d6130 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67ec99a69d065079 server_cookie=389f6491ee8d162 in_seq=0 out_seq=0 2024-09-21T03:52:37.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.262+0000 7f7939ffb640 10 client.17439 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:37.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.263+0000 7f7939ffb640 1 -- 172.21.15.84:0/3060856032 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c542330df0 con 0x55c541fcf9f0 2024-09-21T03:52:37.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.263+0000 7f7939ffb640 10 client.17439 handle_command_reply: tid=0 2024-09-21T03:52:37.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.263+0000 7f795ea3a740 1 client.17439 shutdown 2024-09-21T03:52:37.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.263+0000 7f795ea3a740 1 -- 172.21.15.84:0/3060856032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c541ff0390 msgr2=0x55c5423c42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:37.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.263+0000 7f795ea3a740 1 --2- 172.21.15.84:0/3060856032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c541ff0390 0x55c5423c42f0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f794c010770 tx=0x7f794c010c30 comp rx=0 tx=0).stop 2024-09-21T03:52:37.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.263+0000 7f795ea3a740 1 -- 172.21.15.84:0/3060856032 shutdown_connections 2024-09-21T03:52:37.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.263+0000 7f795ea3a740 1 --2- 172.21.15.84:0/3060856032 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c541fcf9f0 0x55c5423d6130 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.263+0000 7f795ea3a740 1 --2- 172.21.15.84:0/3060856032 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c542011070 0x55c5423d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.263+0000 7f795ea3a740 1 --2- 172.21.15.84:0/3060856032 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c541ff0390 0x55c5423c42f0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.263+0000 7f7939ffb640 0 client.17439 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:37.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.263+0000 7f795ea3a740 1 --2- 172.21.15.84:0/3060856032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c541fe81b0 0x55c5423c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.263+0000 7f795ea3a740 1 -- 172.21.15.84:0/3060856032 >> 172.21.15.84:0/3060856032 conn(0x55c542005460 msgr2=0x55c5423bb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:37.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.263+0000 7f795ea3a740 1 -- 172.21.15.84:0/3060856032 shutdown_connections 2024-09-21T03:52:37.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.263+0000 7f795ea3a740 1 -- 172.21.15.84:0/3060856032 wait complete. 2024-09-21T03:52:37.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.263+0000 7f795ea3a740 20 client.17439 trim_cache size 0 max 16384 2024-09-21T03:52:37.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.276+0000 7f795ea3a740 1 Processor -- start 2024-09-21T03:52:37.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.276+0000 7f795ea3a740 1 -- start start 2024-09-21T03:52:37.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.276+0000 7f795ea3a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c541fe81b0 0x55c5423b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:37.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.276+0000 7f795ea3a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c541ff0390 0x55c5423d0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:37.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.276+0000 7f795ea3a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c542011070 0x55c5423cc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:37.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.276+0000 7f795ea3a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f79501afc10 con 0x55c541fe81b0 2024-09-21T03:52:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.276+0000 7f795ea3a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79501ad4e0 con 0x55c542011070 2024-09-21T03:52:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.276+0000 7f795ea3a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f79501ab350 con 0x55c541ff0390 2024-09-21T03:52:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.276+0000 7f7955a61640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c541fe81b0 0x55c5423b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.277+0000 7f7955a61640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c541fe81b0 0x55c5423b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34278/0 (socket says 172.21.15.84:34278) 2024-09-21T03:52:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.277+0000 7f7955a61640 1 -- 172.21.15.84:0/3690104920 learned_addr learned my addr 172.21.15.84:0/3690104920 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.277+0000 7f7955a61640 1 -- 172.21.15.84:0/3690104920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c541ff0390 msgr2=0x55c5423d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.277+0000 7f7956262640 1 --2- 172.21.15.84:0/3690104920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c541ff0390 0x55c5423d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.277+0000 7f7955a61640 1 --2- 172.21.15.84:0/3690104920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c541ff0390 0x55c5423d0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.277+0000 7f7955a61640 1 -- 172.21.15.84:0/3690104920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c542011070 msgr2=0x55c5423cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.277+0000 7f7955a61640 1 --2- 172.21.15.84:0/3690104920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c542011070 0x55c5423cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.277+0000 7f7955a61640 1 -- 172.21.15.84:0/3690104920 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5423c5070 con 0x55c541fe81b0 2024-09-21T03:52:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.277+0000 7f7956262640 1 --2- 172.21.15.84:0/3690104920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c541ff0390 0x55c5423d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:52:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.277+0000 7f7955a61640 1 --2- 172.21.15.84:0/3690104920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c541fe81b0 0x55c5423b65e0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f79400053f0 tx=0x7f79400058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8694856ee76dc9f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:37.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.277+0000 7f793bfff640 1 -- 172.21.15.84:0/3690104920 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7940035040 con 0x55c541fe81b0 2024-09-21T03:52:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.277+0000 7f793bfff640 1 -- 172.21.15.84:0/3690104920 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7940005040 con 0x55c541fe81b0 2024-09-21T03:52:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.277+0000 7f793bfff640 1 -- 172.21.15.84:0/3690104920 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79400046c0 con 0x55c541fe81b0 2024-09-21T03:52:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.278+0000 7f795ea3a740 1 -- 172.21.15.84:0/3690104920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c541fe81b0 msgr2=0x55c5423b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.278+0000 7f795ea3a740 1 --2- 172.21.15.84:0/3690104920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c541fe81b0 0x55c5423b65e0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f79400053f0 tx=0x7f79400058b0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.278+0000 7f795ea3a740 1 -- 172.21.15.84:0/3690104920 shutdown_connections 2024-09-21T03:52:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.278+0000 7f795ea3a740 1 --2- 172.21.15.84:0/3690104920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c542011070 0x55c5423cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.278+0000 7f795ea3a740 1 --2- 172.21.15.84:0/3690104920 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c541ff0390 0x55c5423d0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.278+0000 7f795ea3a740 1 --2- 172.21.15.84:0/3690104920 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c541fe81b0 0x55c5423b65e0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.278+0000 7f795ea3a740 1 -- 172.21.15.84:0/3690104920 >> 172.21.15.84:0/3690104920 conn(0x55c542005460 msgr2=0x55c5423b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.278+0000 7f795ea3a740 1 -- 172.21.15.84:0/3690104920 shutdown_connections 2024-09-21T03:52:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.278+0000 7f795ea3a740 1 -- 172.21.15.84:0/3690104920 wait complete. 2024-09-21T03:52:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.278+0000 7f795ea3a740 1 -- start start 2024-09-21T03:52:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.278+0000 7f795ea3a740 1 Processor -- start 2024-09-21T03:52:37.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.279+0000 7f795ea3a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c541fe81b0 0x55c542439230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:37.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.279+0000 7f795ea3a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c541ff0390 0x55c542439810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:37.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.279+0000 7f795ea3a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c542011070 0x55c54243d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:37.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.279+0000 7f795ea3a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f79501ab9a0 con 0x55c542011070 2024-09-21T03:52:37.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.279+0000 7f795ea3a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79501ace10 con 0x55c541fe81b0 2024-09-21T03:52:37.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.279+0000 7f795ea3a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f79501ac070 con 0x55c541ff0390 2024-09-21T03:52:37.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.279+0000 7f795ea3a740 10 client.0 _ll_register_callbacks cb 0x7f794c00b640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:37.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.279+0000 7f7955a61640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c542011070 0x55c54243d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:37.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.279+0000 7f7955a61640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c542011070 0x55c54243d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34280/0 (socket says 172.21.15.84:34280) 2024-09-21T03:52:37.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.279+0000 7f7955a61640 1 -- 172.21.15.84:0/4124010761 learned_addr learned my addr 172.21.15.84:0/4124010761 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:37.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.279+0000 7f7955a61640 1 --2- 172.21.15.84:0/4124010761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c541fe81b0 0x55c542439230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:37.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.279+0000 7f7956262640 1 --2- 172.21.15.84:0/4124010761 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c541ff0390 0x55c542439810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:37.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.279+0000 7f7955a61640 1 -- 172.21.15.84:0/4124010761 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c541ff0390 msgr2=0x55c542439810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:37.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.279+0000 7f7955a61640 1 --2- 172.21.15.84:0/4124010761 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c541ff0390 0x55c542439810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.279+0000 7f7955a61640 1 -- 172.21.15.84:0/4124010761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c541fe81b0 msgr2=0x55c542439230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:37.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.279+0000 7f7955a61640 1 --2- 172.21.15.84:0/4124010761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c541fe81b0 0x55c542439230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.279+0000 7f7955a61640 1 -- 172.21.15.84:0/4124010761 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c54243d910 con 0x55c542011070 2024-09-21T03:52:37.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.279+0000 7f7955a61640 1 --2- 172.21.15.84:0/4124010761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c542011070 0x55c54243d2a0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f79400052b0 tx=0x7f7940009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab697e84083edb2c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:37.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.279+0000 7f7939ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:37.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.279+0000 7f7939ffb640 1 -- 172.21.15.84:0/4124010761 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7940035070 con 0x55c542011070 2024-09-21T03:52:37.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.280+0000 7f795ea3a740 1 -- 172.21.15.84:0/4124010761 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7940005040 con 0x55c542011070 2024-09-21T03:52:37.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.280+0000 7f7939ffb640 1 -- 172.21.15.84:0/4124010761 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f7940004270 con 0x55c542011070 2024-09-21T03:52:37.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.280+0000 7f7939ffb640 1 -- 172.21.15.84:0/4124010761 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f794006a050 con 0x55c542011070 2024-09-21T03:52:37.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.280+0000 7f795ea3a740 10 client.17445 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:37.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.280+0000 7f795ea3a740 1 -- 172.21.15.84:0/4124010761 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c542444c70 con 0x55c542011070 2024-09-21T03:52:37.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.280+0000 7f7939ffb640 1 -- 172.21.15.84:0/4124010761 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7940005040 con 0x55c542011070 2024-09-21T03:52:37.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.280+0000 7f7939ffb640 1 -- 172.21.15.84:0/4124010761 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7940059040 con 0x55c542011070 2024-09-21T03:52:37.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.280+0000 7f795ea3a740 10 client.17445 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:37.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.280+0000 7f795ea3a740 10 client.17445 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:52:37.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.280+0000 7f795ea3a740 20 client.17445 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:37.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.280+0000 7f795ea3a740 1 --2- 172.21.15.84:0/4124010761 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c541fa4da0 0x55c542446f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:37.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.280+0000 7f795ea3a740 4 client.17445 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:52:37.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.280+0000 7f795ea3a740 1 -- 172.21.15.84:0/4124010761 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c54232c8a0 con 0x55c541fa4da0 2024-09-21T03:52:37.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.280+0000 7f7956262640 1 --2- 172.21.15.84:0/4124010761 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c541fa4da0 0x55c542446f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:37.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.281+0000 7f7939ffb640 10 client.17445 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:37.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.281+0000 7f7956262640 1 --2- 172.21.15.84:0/4124010761 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c541fa4da0 0x55c542446f70 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ab7a2663131cf60 server_cookie=52a233076300f207 in_seq=0 out_seq=0 2024-09-21T03:52:37.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.281+0000 7f7939ffb640 1 -- 172.21.15.84:0/4124010761 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c54232c8a0 con 0x55c541fa4da0 2024-09-21T03:52:37.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.281+0000 7f7939ffb640 10 client.17445 handle_command_reply: tid=0 2024-09-21T03:52:37.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.281+0000 7f795ea3a740 1 client.17445 shutdown 2024-09-21T03:52:37.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.281+0000 7f795ea3a740 1 -- 172.21.15.84:0/4124010761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c542011070 msgr2=0x55c54243d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:37.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.281+0000 7f795ea3a740 1 --2- 172.21.15.84:0/4124010761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c542011070 0x55c54243d2a0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f79400052b0 tx=0x7f7940009640 comp rx=0 tx=0).stop 2024-09-21T03:52:37.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.281+0000 7f795ea3a740 1 -- 172.21.15.84:0/4124010761 shutdown_connections 2024-09-21T03:52:37.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.281+0000 7f795ea3a740 1 --2- 172.21.15.84:0/4124010761 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55c541fa4da0 0x55c542446f70 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.281+0000 7f7939ffb640 0 client.17445 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:37.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.281+0000 7f795ea3a740 1 --2- 172.21.15.84:0/4124010761 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c542011070 0x55c54243d2a0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.281+0000 7f795ea3a740 1 --2- 172.21.15.84:0/4124010761 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c541ff0390 0x55c542439810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.281+0000 7f795ea3a740 1 --2- 172.21.15.84:0/4124010761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c541fe81b0 0x55c542439230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.281+0000 7f795ea3a740 1 -- 172.21.15.84:0/4124010761 >> 172.21.15.84:0/4124010761 conn(0x55c542005460 msgr2=0x55c5423c5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:37.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.281+0000 7f795ea3a740 1 -- 172.21.15.84:0/4124010761 shutdown_connections 2024-09-21T03:52:37.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.281+0000 7f795ea3a740 1 -- 172.21.15.84:0/4124010761 wait complete. 2024-09-21T03:52:37.303 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.281+0000 7f795ea3a740 20 client.17445 trim_cache size 0 max 16384 2024-09-21T03:52:37.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.282+0000 7f79584c6640 1 -- 172.21.15.84:0/3449477232 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f793c0b66b0 msgr2=0x7f793c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:37.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.282+0000 7f79584c6640 1 --2- 172.21.15.84:0/3449477232 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f793c0b66b0 0x7f793c0b8bc0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f79480aead0 tx=0x7f794808cf90 comp rx=0 tx=0).stop 2024-09-21T03:52:37.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.282+0000 7f79584c6640 1 -- 172.21.15.84:0/3449477232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7950105b10 msgr2=0x7f795019ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:37.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.282+0000 7f79584c6640 1 --2- 172.21.15.84:0/3449477232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7950105b10 0x7f795019ecc0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f794800ebb0 tx=0x7f7948007590 comp rx=0 tx=0).stop 2024-09-21T03:52:37.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.282+0000 7f79584c6640 1 -- 172.21.15.84:0/3449477232 shutdown_connections 2024-09-21T03:52:37.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.282+0000 7f79584c6640 1 --2- 172.21.15.84:0/3449477232 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f793c0b66b0 0x7f793c0b8bc0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.282+0000 7f79584c6640 1 --2- 172.21.15.84:0/3449477232 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7950105b10 0x7f795019ecc0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.282+0000 7f79584c6640 1 --2- 172.21.15.84:0/3449477232 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f79501051c0 0x7f7950199a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.282+0000 7f79584c6640 1 --2- 172.21.15.84:0/3449477232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f79501031b0 0x7f7950199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:37.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.282+0000 7f79584c6640 1 -- 172.21.15.84:0/3449477232 >> 172.21.15.84:0/3449477232 conn(0x7f7950079f90 msgr2=0x7f7950106540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:37.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.282+0000 7f79584c6640 1 -- 172.21.15.84:0/3449477232 shutdown_connections 2024-09-21T03:52:37.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:37.282+0000 7f79584c6640 1 -- 172.21.15.84:0/3449477232 wait complete. 2024-09-21T03:52:38.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:37 smithi174 ceph-mon[34403]: pgmap v636: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 10 op/s 2024-09-21T03:52:38.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:37 smithi172 ceph-mon[34821]: pgmap v636: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 10 op/s 2024-09-21T03:52:38.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:37 smithi084 ceph-mon[30941]: pgmap v636: 97 pgs: 97 active+clean; 20 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 10 op/s 2024-09-21T03:52:39.021 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:52:39.021 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:52:39.281 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:39.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.794+0000 7f93ca117640 1 -- 172.21.15.84:0/449102524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c4108450 msgr2=0x7f93c4108860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:39.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.794+0000 7f93ca117640 1 --2- 172.21.15.84:0/449102524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c4108450 0x7f93c4108860 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009900 tx=0x7f93ac02a410 comp rx=0 tx=0).stop 2024-09-21T03:52:39.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.794+0000 7f93ca117640 1 -- 172.21.15.84:0/449102524 shutdown_connections 2024-09-21T03:52:39.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.794+0000 7f93ca117640 1 --2- 172.21.15.84:0/449102524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93c4108da0 0x7f93c410f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.794+0000 7f93ca117640 1 --2- 172.21.15.84:0/449102524 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c4108450 0x7f93c4108860 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.794+0000 7f93ca117640 1 --2- 172.21.15.84:0/449102524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93c4102b10 0x7f93c4102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.794+0000 7f93ca117640 1 -- 172.21.15.84:0/449102524 >> 172.21.15.84:0/449102524 conn(0x7f93c4079750 msgr2=0x7f93c4079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:39.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.794+0000 7f93ca117640 1 -- 172.21.15.84:0/449102524 shutdown_connections 2024-09-21T03:52:39.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.794+0000 7f93ca117640 1 -- 172.21.15.84:0/449102524 wait complete. 2024-09-21T03:52:39.821 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.795+0000 7f93ca117640 1 Processor -- start 2024-09-21T03:52:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.795+0000 7f93ca117640 1 -- start start 2024-09-21T03:52:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.796+0000 7f93ca117640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c4102b10 0x7f93c419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.796+0000 7f93ca117640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93c4108450 0x7f93c419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.796+0000 7f93ca117640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93c4108da0 0x7f93c419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.796+0000 7f93ca117640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f93c4113ae0 con 0x7f93c4102b10 2024-09-21T03:52:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.796+0000 7f93ca117640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f93c4113960 con 0x7f93c4108da0 2024-09-21T03:52:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.796+0000 7f93ca117640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f93c4113c60 con 0x7f93c4108450 2024-09-21T03:52:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.796+0000 7f93c37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c4102b10 0x7f93c419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.796+0000 7f93c37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c4102b10 0x7f93c419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53070/0 (socket says 172.21.15.84:53070) 2024-09-21T03:52:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.796+0000 7f93c37fe640 1 -- 172.21.15.84:0/1059880230 learned_addr learned my addr 172.21.15.84:0/1059880230 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.796+0000 7f93bbfff640 1 --2- 172.21.15.84:0/1059880230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93c4108450 0x7f93c419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.796+0000 7f93c37fe640 1 -- 172.21.15.84:0/1059880230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93c4108450 msgr2=0x7f93c419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:39.822 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.796+0000 7f93c37fe640 1 --2- 172.21.15.84:0/1059880230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93c4108450 0x7f93c419aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.796+0000 7f93c37fe640 1 -- 172.21.15.84:0/1059880230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93c4108da0 msgr2=0x7f93c419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:39.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.796+0000 7f93c37fe640 1 --2- 172.21.15.84:0/1059880230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93c4108da0 0x7f93c419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.796+0000 7f93c37fe640 1 -- 172.21.15.84:0/1059880230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c41a03a0 con 0x7f93c4102b10 2024-09-21T03:52:39.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.796+0000 7f93c37fe640 1 --2- 172.21.15.84:0/1059880230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c4102b10 0x7f93c419a4f0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f93b400c970 tx=0x7f93b400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:39.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.796+0000 7f93c17fa640 1 -- 172.21.15.84:0/1059880230 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4007bb0 con 0x7f93c4102b10 2024-09-21T03:52:39.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.796+0000 7f93c17fa640 1 -- 172.21.15.84:0/1059880230 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93b4007d50 con 0x7f93c4102b10 2024-09-21T03:52:39.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.796+0000 7f93ca117640 1 -- 172.21.15.84:0/1059880230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93c41a0690 con 0x7f93c4102b10 2024-09-21T03:52:39.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.796+0000 7f93c17fa640 1 -- 172.21.15.84:0/1059880230 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b400f450 con 0x7f93c4102b10 2024-09-21T03:52:39.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.797+0000 7f93ca117640 1 -- 172.21.15.84:0/1059880230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93c41a0b50 con 0x7f93c4102b10 2024-09-21T03:52:39.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.799+0000 7f93d068b740 1 Processor -- start 2024-09-21T03:52:39.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.799+0000 7f93d068b740 1 -- start start 2024-09-21T03:52:39.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.800+0000 7f93c17fa640 1 -- 172.21.15.84:0/1059880230 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f93b4004ee0 con 0x7f93c4102b10 2024-09-21T03:52:39.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.800+0000 7f93d068b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5ff350 0x55835b9a6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:39.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.800+0000 7f93d068b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55835b5d6490 0x55835b9a6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:39.823 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.800+0000 7f93d068b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55835b5de670 0x55835b9a6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:39.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.800+0000 7f93d068b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55835b91ce60 con 0x55835b5ff350 2024-09-21T03:52:39.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.800+0000 7f93d068b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55835b90c290 con 0x55835b5d6490 2024-09-21T03:52:39.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.800+0000 7f93d068b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55835b9100a0 con 0x55835b5de670 2024-09-21T03:52:39.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.800+0000 7f93c3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5ff350 0x55835b9a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:39.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.800+0000 7f93c3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5ff350 0x55835b9a6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53086/0 (socket says 172.21.15.84:53086) 2024-09-21T03:52:39.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.800+0000 7f93c3fff640 1 -- 172.21.15.84:0/3981131374 learned_addr learned my addr 172.21.15.84:0/3981131374 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:39.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.800+0000 7f93c37fe640 1 --2- 172.21.15.84:0/3981131374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55835b5d6490 0x55835b9a6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:39.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.800+0000 7f93bbfff640 1 --2- 172.21.15.84:0/3981131374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55835b5de670 0x55835b9a6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:39.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.800+0000 7f93c3fff640 1 -- 172.21.15.84:0/3981131374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55835b5de670 msgr2=0x55835b9a6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:39.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.800+0000 7f93c3fff640 1 --2- 172.21.15.84:0/3981131374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55835b5de670 0x55835b9a6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.800+0000 7f93c3fff640 1 -- 172.21.15.84:0/3981131374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55835b5d6490 msgr2=0x55835b9a6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:39.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.800+0000 7f93c3fff640 1 --2- 172.21.15.84:0/3981131374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55835b5d6490 0x55835b9a6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.800+0000 7f93c3fff640 1 -- 172.21.15.84:0/3981131374 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55835b66a930 con 0x55835b5ff350 2024-09-21T03:52:39.824 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.800+0000 7f93bbfff640 1 --2- 172.21.15.84:0/3981131374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55835b5de670 0x55835b9a6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:52:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.800+0000 7f93c3fff640 1 --2- 172.21.15.84:0/3981131374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5ff350 0x55835b9a6430 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f93bc007cf0 tx=0x7f93bc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189447727b6c9976 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.800+0000 7f93c17fa640 1 --2- 172.21.15.84:0/1059880230 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f93b00b66b0 0x7f93b00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.801+0000 7f93b9ffb640 1 -- 172.21.15.84:0/3981131374 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc014070 con 0x55835b5ff350 2024-09-21T03:52:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.801+0000 7f93c37fe640 1 --2- 172.21.15.84:0/1059880230 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f93b00b66b0 0x7f93b00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.801+0000 7f93b9ffb640 1 -- 172.21.15.84:0/3981131374 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93bc00fb00 con 0x55835b5ff350 2024-09-21T03:52:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.801+0000 7f93b9ffb640 1 -- 172.21.15.84:0/3981131374 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc00ea90 con 0x55835b5ff350 2024-09-21T03:52:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.801+0000 7f93c17fa640 1 -- 172.21.15.84:0/1059880230 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f93b40e7450 con 0x7f93c4102b10 2024-09-21T03:52:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.802+0000 7f93d068b740 1 -- 172.21.15.84:0/3981131374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5ff350 msgr2=0x55835b9a6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.802+0000 7f93c37fe640 1 --2- 172.21.15.84:0/1059880230 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f93b00b66b0 0x7f93b00b8bc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f93b40e4ca0 tx=0x7f93b40ed060 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.802+0000 7f93d068b740 1 --2- 172.21.15.84:0/3981131374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5ff350 0x55835b9a6430 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f93bc007cf0 tx=0x7f93bc00c6a0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.802+0000 7f93d068b740 1 -- 172.21.15.84:0/3981131374 shutdown_connections 2024-09-21T03:52:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.802+0000 7f93d068b740 1 --2- 172.21.15.84:0/3981131374 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55835b5de670 0x55835b9a6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.825 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.802+0000 7f93d068b740 1 --2- 172.21.15.84:0/3981131374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55835b5d6490 0x55835b9a6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.802+0000 7f93d068b740 1 --2- 172.21.15.84:0/3981131374 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5ff350 0x55835b9a6430 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.802+0000 7f93d068b740 1 -- 172.21.15.84:0/3981131374 >> 172.21.15.84:0/3981131374 conn(0x55835b5f3740 msgr2=0x55835b9a4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.802+0000 7f93d068b740 1 -- 172.21.15.84:0/3981131374 shutdown_connections 2024-09-21T03:52:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.802+0000 7f93d068b740 1 -- 172.21.15.84:0/3981131374 wait complete. 2024-09-21T03:52:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.802+0000 7f93d068b740 1 -- start start 2024-09-21T03:52:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.802+0000 7f93d068b740 1 Processor -- start 2024-09-21T03:52:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93d068b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5d6490 0x55835b9b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93d068b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55835b5de670 0x55835b9b2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93d068b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55835b5ff350 0x55835b9bdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93d068b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55835b76d890 con 0x55835b5d6490 2024-09-21T03:52:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93d068b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55835b8a6d40 con 0x55835b5de670 2024-09-21T03:52:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93d068b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55835b9b4c10 con 0x55835b5ff350 2024-09-21T03:52:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93d068b740 10 client.0 _ll_register_callbacks cb 0x55835b90ac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:39.826 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93c3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5d6490 0x55835b9b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93c3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5d6490 0x55835b9b1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53088/0 (socket says 172.21.15.84:53088) 2024-09-21T03:52:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93c3fff640 1 -- 172.21.15.84:0/3519200769 learned_addr learned my addr 172.21.15.84:0/3519200769 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93bbfff640 1 --2- 172.21.15.84:0/3519200769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55835b5de670 0x55835b9b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93c3fff640 1 -- 172.21.15.84:0/3519200769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55835b5ff350 msgr2=0x55835b9bdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93c3fff640 1 --2- 172.21.15.84:0/3519200769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55835b5ff350 0x55835b9bdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93c3fff640 1 -- 172.21.15.84:0/3519200769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55835b5de670 msgr2=0x55835b9b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93c3fff640 1 --2- 172.21.15.84:0/3519200769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55835b5de670 0x55835b9b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93c3fff640 1 -- 172.21.15.84:0/3519200769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55835b9be470 con 0x55835b5d6490 2024-09-21T03:52:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93c3fff640 1 --2- 172.21.15.84:0/3519200769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5d6490 0x55835b9b1ff0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f93bc00e610 tx=0x7f93bc0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec3806daf3c2d7a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93a2ffd640 1 -- 172.21.15.84:0/3519200769 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc014050 con 0x55835b5d6490 2024-09-21T03:52:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93a2ffd640 1 -- 172.21.15.84:0/3519200769 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f93bc00f450 con 0x55835b5d6490 2024-09-21T03:52:39.827 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.803+0000 7f93d068b740 1 -- 172.21.15.84:0/3519200769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93bc00fb00 con 0x55835b5d6490 2024-09-21T03:52:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.804+0000 7f93a2ffd640 1 -- 172.21.15.84:0/3519200769 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f93bc00f650 con 0x55835b5d6490 2024-09-21T03:52:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.804+0000 7f93d068b740 10 client.17457 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.804+0000 7f93d068b740 1 -- 172.21.15.84:0/3519200769 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55835b9c0da0 con 0x55835b5d6490 2024-09-21T03:52:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.804+0000 7f93a2ffd640 1 -- 172.21.15.84:0/3519200769 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93bc023070 con 0x55835b5d6490 2024-09-21T03:52:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.804+0000 7f93a2ffd640 1 -- 172.21.15.84:0/3519200769 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f93bc004200 con 0x55835b5d6490 2024-09-21T03:52:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.804+0000 7f93d068b740 10 client.17457 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.804+0000 7f93d068b740 10 client.17457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:52:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.804+0000 7f93d068b740 20 client.17457 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.804+0000 7f93d068b740 1 --2- 172.21.15.84:0/3519200769 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55835b5bdcd0 0x55835b9c4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.804+0000 7f93d068b740 4 client.17457 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:52:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.804+0000 7f93d068b740 1 -- 172.21.15.84:0/3519200769 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f93bc00fb00 con 0x55835b5bdcd0 2024-09-21T03:52:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.804+0000 7f93bbfff640 1 --2- 172.21.15.84:0/3519200769 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55835b5bdcd0 0x55835b9c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.805+0000 7f93bbfff640 1 --2- 172.21.15.84:0/3519200769 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55835b5bdcd0 0x55835b9c4100 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b2c16648a349622 server_cookie=50025ecd5733e892 in_seq=0 out_seq=0 2024-09-21T03:52:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.805+0000 7f93a2ffd640 10 client.17457 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:39.828 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.806+0000 7f93a2ffd640 1 -- 172.21.15.84:0/3519200769 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f93bc00fb00 con 0x55835b5bdcd0 2024-09-21T03:52:39.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.806+0000 7f93a2ffd640 10 client.17457 handle_command_reply: tid=0 2024-09-21T03:52:39.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.806+0000 7f93d068b740 1 client.17457 shutdown 2024-09-21T03:52:39.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.806+0000 7f93d068b740 1 -- 172.21.15.84:0/3519200769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5d6490 msgr2=0x55835b9b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:39.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.806+0000 7f93d068b740 1 --2- 172.21.15.84:0/3519200769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5d6490 0x55835b9b1ff0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f93bc00e610 tx=0x7f93bc0039c0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.806+0000 7f93d068b740 1 -- 172.21.15.84:0/3519200769 shutdown_connections 2024-09-21T03:52:39.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.806+0000 7f93d068b740 1 --2- 172.21.15.84:0/3519200769 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55835b5bdcd0 0x55835b9c4100 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.806+0000 7f93d068b740 1 --2- 172.21.15.84:0/3519200769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55835b5ff350 0x55835b9bdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.806+0000 7f93d068b740 1 --2- 172.21.15.84:0/3519200769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55835b5de670 0x55835b9b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.806+0000 7f93a2ffd640 0 client.17457 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:39.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.806+0000 7f93d068b740 1 --2- 172.21.15.84:0/3519200769 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5d6490 0x55835b9b1ff0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.806+0000 7f93d068b740 1 -- 172.21.15.84:0/3519200769 >> 172.21.15.84:0/3519200769 conn(0x55835b5f3740 msgr2=0x55835b9a9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:39.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.806+0000 7f93d068b740 1 -- 172.21.15.84:0/3519200769 shutdown_connections 2024-09-21T03:52:39.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.806+0000 7f93d068b740 1 -- 172.21.15.84:0/3519200769 wait complete. 2024-09-21T03:52:39.829 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.806+0000 7f93d068b740 20 client.17457 trim_cache size 0 max 16384 2024-09-21T03:52:39.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.824+0000 7f93d068b740 1 Processor -- start 2024-09-21T03:52:39.833 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.824+0000 7f93d068b740 1 -- start start 2024-09-21T03:52:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.824+0000 7f93d068b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55835b5d6490 0x55835b9ad5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.824+0000 7f93d068b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55835b5de670 0x55835b9bde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.824+0000 7f93d068b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5ff350 0x55835b9b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.824+0000 7f93d068b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41afc80 con 0x55835b5ff350 2024-09-21T03:52:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.824+0000 7f93d068b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41ad550 con 0x55835b5d6490 2024-09-21T03:52:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.824+0000 7f93d068b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41ab3c0 con 0x55835b5de670 2024-09-21T03:52:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.824+0000 7f93c3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5ff350 0x55835b9b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.824+0000 7f93c3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5ff350 0x55835b9b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53094/0 (socket says 172.21.15.84:53094) 2024-09-21T03:52:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.824+0000 7f93c3fff640 1 -- 172.21.15.84:0/3425609799 learned_addr learned my addr 172.21.15.84:0/3425609799 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.824+0000 7f93bbfff640 1 --2- 172.21.15.84:0/3425609799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55835b5de670 0x55835b9bde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.824+0000 7f93c3fff640 1 --2- 172.21.15.84:0/3425609799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55835b5d6490 0x55835b9ad5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:39.834 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.824+0000 7f93c3fff640 1 -- 172.21.15.84:0/3425609799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55835b5de670 msgr2=0x55835b9bde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.824+0000 7f93c3fff640 1 --2- 172.21.15.84:0/3425609799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55835b5de670 0x55835b9bde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.824+0000 7f93c3fff640 1 -- 172.21.15.84:0/3425609799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55835b5d6490 msgr2=0x55835b9ad5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.824+0000 7f93c3fff640 1 --2- 172.21.15.84:0/3425609799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55835b5d6490 0x55835b9ad5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.825+0000 7f93c3fff640 1 -- 172.21.15.84:0/3425609799 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55835b9b02f0 con 0x55835b5ff350 2024-09-21T03:52:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.825+0000 7f93c3fff640 1 --2- 172.21.15.84:0/3425609799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5ff350 0x55835b9b3cd0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f93bc006010 tx=0x7f93bc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f2157dd6fa6e22 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.826+0000 7f93b97fa640 1 -- 172.21.15.84:0/3425609799 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc014070 con 0x55835b5ff350 2024-09-21T03:52:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.826+0000 7f93b97fa640 1 -- 172.21.15.84:0/3425609799 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93bc023040 con 0x55835b5ff350 2024-09-21T03:52:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.826+0000 7f93b97fa640 1 -- 172.21.15.84:0/3425609799 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc034040 con 0x55835b5ff350 2024-09-21T03:52:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.827+0000 7f93d068b740 1 -- 172.21.15.84:0/3425609799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5ff350 msgr2=0x55835b9b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.827+0000 7f93d068b740 1 --2- 172.21.15.84:0/3425609799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5ff350 0x55835b9b3cd0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f93bc006010 tx=0x7f93bc00c6a0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.827+0000 7f93d068b740 1 -- 172.21.15.84:0/3425609799 shutdown_connections 2024-09-21T03:52:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.827+0000 7f93d068b740 1 --2- 172.21.15.84:0/3425609799 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5ff350 0x55835b9b3cd0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.827+0000 7f93d068b740 1 --2- 172.21.15.84:0/3425609799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55835b5de670 0x55835b9bde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.835 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.827+0000 7f93d068b740 1 --2- 172.21.15.84:0/3425609799 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55835b5d6490 0x55835b9ad5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.827+0000 7f93d068b740 1 -- 172.21.15.84:0/3425609799 >> 172.21.15.84:0/3425609799 conn(0x55835b5f3740 msgr2=0x55835b9a9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.827+0000 7f93d068b740 1 -- 172.21.15.84:0/3425609799 shutdown_connections 2024-09-21T03:52:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.827+0000 7f93d068b740 1 -- 172.21.15.84:0/3425609799 wait complete. 2024-09-21T03:52:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.827+0000 7f93d068b740 1 -- start start 2024-09-21T03:52:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.827+0000 7f93d068b740 1 Processor -- start 2024-09-21T03:52:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.828+0000 7f93d068b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5d6490 0x55835b9c5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.828+0000 7f93d068b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55835b5de670 0x55835b9c5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.828+0000 7f93d068b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55835b5ff350 0x55835ba2d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.828+0000 7f93d068b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41aba10 con 0x55835b5d6490 2024-09-21T03:52:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.828+0000 7f93d068b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41ace80 con 0x55835b5ff350 2024-09-21T03:52:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.828+0000 7f93d068b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f93c41ac0e0 con 0x55835b5de670 2024-09-21T03:52:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.828+0000 7f93d068b740 10 client.0 _ll_register_callbacks cb 0x7f93b40eae70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.828+0000 7f93c3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5d6490 0x55835b9c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:39.836 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.828+0000 7f93c3fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5d6490 0x55835b9c5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53104/0 (socket says 172.21.15.84:53104) 2024-09-21T03:52:39.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.828+0000 7f93c3fff640 1 -- 172.21.15.84:0/1333677643 learned_addr learned my addr 172.21.15.84:0/1333677643 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:39.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.828+0000 7f93bbfff640 1 --2- 172.21.15.84:0/1333677643 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55835b5de670 0x55835b9c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:39.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.828+0000 7f93c3fff640 1 --2- 172.21.15.84:0/1333677643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55835b5ff350 0x55835ba2d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:39.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.828+0000 7f93c3fff640 1 -- 172.21.15.84:0/1333677643 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55835b5de670 msgr2=0x55835b9c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:39.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.828+0000 7f93c3fff640 1 --2- 172.21.15.84:0/1333677643 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55835b5de670 0x55835b9c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.828+0000 7f93c3fff640 1 -- 172.21.15.84:0/1333677643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55835b5ff350 msgr2=0x55835ba2d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:39.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.828+0000 7f93c3fff640 1 --2- 172.21.15.84:0/1333677643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55835b5ff350 0x55835ba2d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.828+0000 7f93c3fff640 1 -- 172.21.15.84:0/1333677643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55835b9c6210 con 0x55835b5d6490 2024-09-21T03:52:39.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.828+0000 7f93c3fff640 1 --2- 172.21.15.84:0/1333677643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5d6490 0x55835b9c5450 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f93bc004080 tx=0x7f93bc0076f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e0f293a52b03fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:39.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.828+0000 7f93a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:39.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.829+0000 7f93a2ffd640 1 -- 172.21.15.84:0/1333677643 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc034070 con 0x55835b5d6490 2024-09-21T03:52:39.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.829+0000 7f93a2ffd640 1 -- 172.21.15.84:0/1333677643 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f93bc003e00 con 0x55835b5d6490 2024-09-21T03:52:39.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.829+0000 7f93d068b740 1 -- 172.21.15.84:0/1333677643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93bc023040 con 0x55835b5d6490 2024-09-21T03:52:39.837 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.829+0000 7f93a2ffd640 1 -- 172.21.15.84:0/1333677643 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f93bc014030 con 0x55835b5d6490 2024-09-21T03:52:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.829+0000 7f93d068b740 10 client.17463 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.829+0000 7f93d068b740 1 -- 172.21.15.84:0/1333677643 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55835ba2ee10 con 0x55835b5d6490 2024-09-21T03:52:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.829+0000 7f93a2ffd640 1 -- 172.21.15.84:0/1333677643 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93bc023040 con 0x55835b5d6490 2024-09-21T03:52:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.829+0000 7f93a2ffd640 1 -- 172.21.15.84:0/1333677643 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f93bc01f7a0 con 0x55835b5d6490 2024-09-21T03:52:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.829+0000 7f93d068b740 10 client.17463 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.829+0000 7f93d068b740 10 client.17463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:52:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.829+0000 7f93d068b740 20 client.17463 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.829+0000 7f93d068b740 1 --2- 172.21.15.84:0/1333677643 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55835b593080 0x55835ba31460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.829+0000 7f93d068b740 4 client.17463 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:52:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.829+0000 7f93d068b740 1 -- 172.21.15.84:0/1333677643 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55835b91edb0 con 0x55835b593080 2024-09-21T03:52:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.830+0000 7f93bbfff640 1 --2- 172.21.15.84:0/1333677643 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55835b593080 0x55835ba31460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.830+0000 7f93a2ffd640 10 client.17463 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.830+0000 7f93bbfff640 1 --2- 172.21.15.84:0/1333677643 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55835b593080 0x55835ba31460 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36ec957af0e3ef7 server_cookie=bc7ede68687e923f in_seq=0 out_seq=0 2024-09-21T03:52:39.838 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.832+0000 7f93a2ffd640 1 -- 172.21.15.84:0/1333677643 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55835b91edb0 con 0x55835b593080 2024-09-21T03:52:39.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.832+0000 7f93a2ffd640 10 client.17463 handle_command_reply: tid=0 2024-09-21T03:52:39.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.832+0000 7f93d068b740 1 client.17463 shutdown 2024-09-21T03:52:39.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.832+0000 7f93d068b740 1 -- 172.21.15.84:0/1333677643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5d6490 msgr2=0x55835b9c5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:39.839 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.832+0000 7f93d068b740 1 --2- 172.21.15.84:0/1333677643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5d6490 0x55835b9c5450 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f93bc004080 tx=0x7f93bc0076f0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.832+0000 7f93d068b740 1 -- 172.21.15.84:0/1333677643 shutdown_connections 2024-09-21T03:52:39.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.832+0000 7f93d068b740 1 --2- 172.21.15.84:0/1333677643 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55835b593080 0x55835ba31460 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.832+0000 7f93d068b740 1 --2- 172.21.15.84:0/1333677643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55835b5ff350 0x55835ba2d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.832+0000 7f93d068b740 1 --2- 172.21.15.84:0/1333677643 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55835b5de670 0x55835b9c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.832+0000 7f93d068b740 1 --2- 172.21.15.84:0/1333677643 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55835b5d6490 0x55835b9c5450 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.832+0000 7f93a2ffd640 0 client.17463 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:39.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.832+0000 7f93d068b740 1 -- 172.21.15.84:0/1333677643 >> 172.21.15.84:0/1333677643 conn(0x55835b5f3740 msgr2=0x55835b9a9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:39.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.832+0000 7f93d068b740 1 -- 172.21.15.84:0/1333677643 shutdown_connections 2024-09-21T03:52:39.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.832+0000 7f93d068b740 1 -- 172.21.15.84:0/1333677643 wait complete. 2024-09-21T03:52:39.840 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.832+0000 7f93d068b740 20 client.17463 trim_cache size 0 max 16384 2024-09-21T03:52:39.840 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:52:39.841 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T03:52:39.841 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "60214753-df43-47aa-b007-fe33bbde062a", 2024-09-21T03:52:39.841 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T03:52:39.841 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:52:39.841 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.833+0000 7f93ca117640 1 -- 172.21.15.84:0/1059880230 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f93b00b66b0 msgr2=0x7f93b00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:39.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.833+0000 7f93ca117640 1 --2- 172.21.15.84:0/1059880230 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f93b00b66b0 0x7f93b00b8bc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f93b40e4ca0 tx=0x7f93b40ed060 comp rx=0 tx=0).stop 2024-09-21T03:52:39.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.833+0000 7f93ca117640 1 -- 172.21.15.84:0/1059880230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c4102b10 msgr2=0x7f93c419a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:39.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.833+0000 7f93ca117640 1 --2- 172.21.15.84:0/1059880230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c4102b10 0x7f93c419a4f0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f93b400c970 tx=0x7f93b400ce30 comp rx=0 tx=0).stop 2024-09-21T03:52:39.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.833+0000 7f93ca117640 1 -- 172.21.15.84:0/1059880230 shutdown_connections 2024-09-21T03:52:39.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.833+0000 7f93ca117640 1 --2- 172.21.15.84:0/1059880230 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f93b00b66b0 0x7f93b00b8bc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.833+0000 7f93ca117640 1 --2- 172.21.15.84:0/1059880230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93c4108da0 0x7f93c419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.833+0000 7f93ca117640 1 --2- 172.21.15.84:0/1059880230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f93c4108450 0x7f93c419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.833+0000 7f93ca117640 1 --2- 172.21.15.84:0/1059880230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f93c4102b10 0x7f93c419a4f0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:39.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.833+0000 7f93ca117640 1 -- 172.21.15.84:0/1059880230 >> 172.21.15.84:0/1059880230 conn(0x7f93c4079750 msgr2=0x7f93c41044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:39.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.833+0000 7f93ca117640 1 -- 172.21.15.84:0/1059880230 shutdown_connections 2024-09-21T03:52:39.842 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:39.833+0000 7f93ca117640 1 -- 172.21.15.84:0/1059880230 wait complete. 2024-09-21T03:52:40.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:39 smithi084 ceph-mon[30941]: pgmap v637: 97 pgs: 97 active+clean; 21 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 71 KiB/s wr, 14 op/s 2024-09-21T03:52:40.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:39 smithi174 ceph-mon[34403]: pgmap v637: 97 pgs: 97 active+clean; 21 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 71 KiB/s wr, 14 op/s 2024-09-21T03:52:40.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:39 smithi172 ceph-mon[34821]: pgmap v637: 97 pgs: 97 active+clean; 21 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 71 KiB/s wr, 14 op/s 2024-09-21T03:52:40.554 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:52:40.802 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:41.087 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:40 smithi084 ceph-mon[30941]: scrub queued for path: / 2024-09-21T03:52:41.087 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:40 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:52:41.087 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:40 smithi084 ceph-mon[30941]: scrub summary: active paths [/] 2024-09-21T03:52:41.087 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:40 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:52:41.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:40 smithi174 ceph-mon[34403]: scrub queued for path: / 2024-09-21T03:52:41.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:40 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:52:41.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:40 smithi174 ceph-mon[34403]: scrub summary: active paths [/] 2024-09-21T03:52:41.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:40 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:52:41.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:40 smithi172 ceph-mon[34821]: scrub queued for path: / 2024-09-21T03:52:41.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:40 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:52:41.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:40 smithi172 ceph-mon[34821]: scrub summary: active paths [/] 2024-09-21T03:52:41.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:40 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:52:41.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.308+0000 7f5b9530e640 1 -- 172.21.15.84:0/1472480711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b901049c0 msgr2=0x7f5b90104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:41.320 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.308+0000 7f5b9530e640 1 --2- 172.21.15.84:0/1472480711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b901049c0 0x7f5b90104dd0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f5b80009ca0 tx=0x7f5b8002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.308+0000 7f5b9530e640 1 -- 172.21.15.84:0/1472480711 shutdown_connections 2024-09-21T03:52:41.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.308+0000 7f5b9530e640 1 --2- 172.21.15.84:0/1472480711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b9010de20 0x7f5b90110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.308+0000 7f5b9530e640 1 --2- 172.21.15.84:0/1472480711 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b90105310 0x7f5b9010d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.308+0000 7f5b9530e640 1 --2- 172.21.15.84:0/1472480711 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b901049c0 0x7f5b90104dd0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.308+0000 7f5b9530e640 1 -- 172.21.15.84:0/1472480711 >> 172.21.15.84:0/1472480711 conn(0x7f5b90079730 msgr2=0x7f5b90079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:41.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.308+0000 7f5b9530e640 1 -- 172.21.15.84:0/1472480711 shutdown_connections 2024-09-21T03:52:41.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.308+0000 7f5b9530e640 1 -- 172.21.15.84:0/1472480711 wait complete. 2024-09-21T03:52:41.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.309+0000 7f5b9530e640 1 Processor -- start 2024-09-21T03:52:41.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.309+0000 7f5b9530e640 1 -- start start 2024-09-21T03:52:41.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.309+0000 7f5b9530e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b901049c0 0x7f5b9019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:41.321 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.309+0000 7f5b9530e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b90105310 0x7f5b9019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:41.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.309+0000 7f5b9530e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b9010de20 0x7f5b9019fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:41.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.309+0000 7f5b9530e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5b90113b20 con 0x7f5b901049c0 2024-09-21T03:52:41.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.309+0000 7f5b9530e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5b901139a0 con 0x7f5b9010de20 2024-09-21T03:52:41.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.309+0000 7f5b9530e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5b90113ca0 con 0x7f5b90105310 2024-09-21T03:52:41.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.309+0000 7f5b8effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b901049c0 0x7f5b9019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:41.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.309+0000 7f5b8effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b901049c0 0x7f5b9019a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53122/0 (socket says 172.21.15.84:53122) 2024-09-21T03:52:41.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.309+0000 7f5b8effd640 1 -- 172.21.15.84:0/3232120488 learned_addr learned my addr 172.21.15.84:0/3232120488 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:41.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.309+0000 7f5b8f7fe640 1 --2- 172.21.15.84:0/3232120488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b9010de20 0x7f5b9019fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:41.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.309+0000 7f5b8e7fc640 1 --2- 172.21.15.84:0/3232120488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b90105310 0x7f5b9019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:41.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.309+0000 7f5b8effd640 1 -- 172.21.15.84:0/3232120488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b90105310 msgr2=0x7f5b9019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:41.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.309+0000 7f5b8effd640 1 --2- 172.21.15.84:0/3232120488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b90105310 0x7f5b9019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.309+0000 7f5b8effd640 1 -- 172.21.15.84:0/3232120488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b9010de20 msgr2=0x7f5b9019fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:41.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.309+0000 7f5b8effd640 1 --2- 172.21.15.84:0/3232120488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b9010de20 0x7f5b9019fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.322 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.309+0000 7f5b8effd640 1 -- 172.21.15.84:0/3232120488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b901a0500 con 0x7f5b901049c0 2024-09-21T03:52:41.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.309+0000 7f5b8e7fc640 1 --2- 172.21.15.84:0/3232120488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b90105310 0x7f5b9019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:52:41.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.310+0000 7f5b8effd640 1 --2- 172.21.15.84:0/3232120488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b901049c0 0x7f5b9019a590 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f5b8002ade0 tx=0x7f5b80003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:41.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.310+0000 7f5b77fff640 1 -- 172.21.15.84:0/3232120488 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b80003d60 con 0x7f5b901049c0 2024-09-21T03:52:41.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.310+0000 7f5b77fff640 1 -- 172.21.15.84:0/3232120488 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b800044f0 con 0x7f5b901049c0 2024-09-21T03:52:41.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.310+0000 7f5b9530e640 1 -- 172.21.15.84:0/3232120488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b901a0790 con 0x7f5b901049c0 2024-09-21T03:52:41.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.310+0000 7f5b77fff640 1 -- 172.21.15.84:0/3232120488 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8002fce0 con 0x7f5b901049c0 2024-09-21T03:52:41.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.310+0000 7f5b9530e640 1 -- 172.21.15.84:0/3232120488 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b901a6f50 con 0x7f5b901049c0 2024-09-21T03:52:41.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.312+0000 7f5b77fff640 1 -- 172.21.15.84:0/3232120488 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f5b800046a0 con 0x7f5b901049c0 2024-09-21T03:52:41.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.313+0000 7f5b9b882740 1 Processor -- start 2024-09-21T03:52:41.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.313+0000 7f5b9b882740 1 -- start start 2024-09-21T03:52:41.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.313+0000 7f5b9b882740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56438317f070 0x564383526270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:41.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.313+0000 7f5b9b882740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643831561b0 0x5643835267b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:41.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.313+0000 7f5b9b882740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56438315e390 0x564383526cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:41.323 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.313+0000 7f5b9b882740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x56438349ce50 con 0x5643831561b0 2024-09-21T03:52:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.313+0000 7f5b9b882740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56438348c280 con 0x56438315e390 2024-09-21T03:52:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.313+0000 7f5b9b882740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564383490090 con 0x56438317f070 2024-09-21T03:52:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.313+0000 7f5b8effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643831561b0 0x5643835267b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.313+0000 7f5b8effd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643831561b0 0x5643835267b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53130/0 (socket says 172.21.15.84:53130) 2024-09-21T03:52:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.313+0000 7f5b8effd640 1 -- 172.21.15.84:0/3324539763 learned_addr learned my addr 172.21.15.84:0/3324539763 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.313+0000 7f5b77fff640 1 --2- 172.21.15.84:0/3232120488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5b780b6680 0x7f5b780b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.313+0000 7f5b8f7fe640 1 --2- 172.21.15.84:0/3324539763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56438317f070 0x564383526270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.313+0000 7f5b8e7fc640 1 --2- 172.21.15.84:0/3324539763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56438315e390 0x564383526cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.313+0000 7f5b8f7fe640 1 --2- 172.21.15.84:0/3232120488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5b780b6680 0x7f5b780b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.313+0000 7f5b8effd640 1 -- 172.21.15.84:0/3324539763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56438317f070 msgr2=0x564383526270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.313+0000 7f5b8effd640 1 --2- 172.21.15.84:0/3324539763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56438317f070 0x564383526270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.314+0000 7f5b8effd640 1 -- 172.21.15.84:0/3324539763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56438315e390 msgr2=0x564383526cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.314+0000 7f5b8effd640 1 --2- 172.21.15.84:0/3324539763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56438315e390 0x564383526cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.324 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.314+0000 7f5b8effd640 1 -- 172.21.15.84:0/3324539763 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643831ea650 con 0x5643831561b0 2024-09-21T03:52:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.314+0000 7f5b77fff640 1 -- 172.21.15.84:0/3232120488 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f5b80108c70 con 0x7f5b901049c0 2024-09-21T03:52:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.314+0000 7f5b8effd640 1 --2- 172.21.15.84:0/3324539763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643831561b0 0x5643835267b0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f5b801063b0 tx=0x7f5b800c3370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b970382607481d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.314+0000 7f5b8f7fe640 1 --2- 172.21.15.84:0/3232120488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5b780b6680 0x7f5b780b8b90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009c10 tx=0x7f5b880090e0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.314+0000 7f5b757fa640 1 -- 172.21.15.84:0/3324539763 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8002f660 con 0x5643831561b0 2024-09-21T03:52:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.314+0000 7f5b757fa640 1 -- 172.21.15.84:0/3324539763 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b8010c070 con 0x5643831561b0 2024-09-21T03:52:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.314+0000 7f5b757fa640 1 -- 172.21.15.84:0/3324539763 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b800ce620 con 0x5643831561b0 2024-09-21T03:52:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.315+0000 7f5b9b882740 1 -- 172.21.15.84:0/3324539763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643831561b0 msgr2=0x5643835267b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.315+0000 7f5b9b882740 1 --2- 172.21.15.84:0/3324539763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643831561b0 0x5643835267b0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f5b801063b0 tx=0x7f5b800c3370 comp rx=0 tx=0).stop 2024-09-21T03:52:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.315+0000 7f5b9b882740 1 -- 172.21.15.84:0/3324539763 shutdown_connections 2024-09-21T03:52:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.315+0000 7f5b9b882740 1 --2- 172.21.15.84:0/3324539763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56438315e390 0x564383526cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.315+0000 7f5b9b882740 1 --2- 172.21.15.84:0/3324539763 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643831561b0 0x5643835267b0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.315+0000 7f5b9b882740 1 --2- 172.21.15.84:0/3324539763 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56438317f070 0x564383526270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.315+0000 7f5b9b882740 1 -- 172.21.15.84:0/3324539763 >> 172.21.15.84:0/3324539763 conn(0x564383173460 msgr2=0x564383524160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:41.325 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.315+0000 7f5b9b882740 1 -- 172.21.15.84:0/3324539763 shutdown_connections 2024-09-21T03:52:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.315+0000 7f5b9b882740 1 -- 172.21.15.84:0/3324539763 wait complete. 2024-09-21T03:52:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.315+0000 7f5b9b882740 1 -- start start 2024-09-21T03:52:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.315+0000 7f5b9b882740 1 Processor -- start 2024-09-21T03:52:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.316+0000 7f5b9b882740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5643831561b0 0x5643835319a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.316+0000 7f5b9b882740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56438315e390 0x564383531ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.316+0000 7f5b9b882740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56438317f070 0x56438353d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.316+0000 7f5b9b882740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5643832ed700 con 0x56438315e390 2024-09-21T03:52:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.316+0000 7f5b9b882740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564383427110 con 0x56438317f070 2024-09-21T03:52:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.316+0000 7f5b9b882740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x56438349ce50 con 0x5643831561b0 2024-09-21T03:52:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.316+0000 7f5b9b882740 10 client.0 _ll_register_callbacks cb 0x564383440990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.316+0000 7f5b8e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56438315e390 0x564383531ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.316+0000 7f5b8e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56438315e390 0x564383531ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53138/0 (socket says 172.21.15.84:53138) 2024-09-21T03:52:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.316+0000 7f5b8e7fc640 1 -- 172.21.15.84:0/2610827266 learned_addr learned my addr 172.21.15.84:0/2610827266 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.316+0000 7f5b8effd640 1 --2- 172.21.15.84:0/2610827266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5643831561b0 0x5643835319a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:41.326 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.316+0000 7f5b8f7fe640 1 --2- 172.21.15.84:0/2610827266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56438317f070 0x56438353d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.316+0000 7f5b8e7fc640 1 -- 172.21.15.84:0/2610827266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5643831561b0 msgr2=0x5643835319a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.316+0000 7f5b8e7fc640 1 --2- 172.21.15.84:0/2610827266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5643831561b0 0x5643835319a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.316+0000 7f5b8e7fc640 1 -- 172.21.15.84:0/2610827266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56438317f070 msgr2=0x56438353d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.316+0000 7f5b8e7fc640 1 --2- 172.21.15.84:0/2610827266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56438317f070 0x56438353d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.316+0000 7f5b8e7fc640 1 -- 172.21.15.84:0/2610827266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564383454c40 con 0x56438315e390 2024-09-21T03:52:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.317+0000 7f5b8e7fc640 1 --2- 172.21.15.84:0/2610827266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56438315e390 0x564383531ee0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f5b8400f6f0 tx=0x7f5b8400fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee088ef72fce44d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.317+0000 7f5b72ff5640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.317+0000 7f5b72ff5640 1 -- 172.21.15.84:0/2610827266 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b84016070 con 0x56438315e390 2024-09-21T03:52:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.317+0000 7f5b72ff5640 1 -- 172.21.15.84:0/2610827266 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f5b8400bb00 con 0x56438315e390 2024-09-21T03:52:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.317+0000 7f5b9b882740 1 -- 172.21.15.84:0/2610827266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b8010c070 con 0x56438315e390 2024-09-21T03:52:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.318+0000 7f5b72ff5640 1 -- 172.21.15.84:0/2610827266 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5b8400bd00 con 0x56438315e390 2024-09-21T03:52:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.318+0000 7f5b9b882740 10 client.17475 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.318+0000 7f5b9b882740 1 -- 172.21.15.84:0/2610827266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564383540390 con 0x56438315e390 2024-09-21T03:52:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.318+0000 7f5b72ff5640 1 -- 172.21.15.84:0/2610827266 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b8010c070 con 0x56438315e390 2024-09-21T03:52:41.327 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.318+0000 7f5b72ff5640 1 -- 172.21.15.84:0/2610827266 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5b840234a0 con 0x56438315e390 2024-09-21T03:52:41.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.318+0000 7f5b9b882740 10 client.17475 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:41.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.318+0000 7f5b9b882740 10 client.17475 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:52:41.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.318+0000 7f5b9b882740 20 client.17475 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:41.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.318+0000 7f5b9b882740 1 --2- 172.21.15.84:0/2610827266 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56438313d9f0 0x564383543920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:41.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.318+0000 7f5b9b882740 4 client.17475 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:52:41.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.318+0000 7f5b9b882740 1 -- 172.21.15.84:0/2610827266 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56438349eda0 con 0x56438313d9f0 2024-09-21T03:52:41.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.318+0000 7f5b8effd640 1 --2- 172.21.15.84:0/2610827266 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56438313d9f0 0x564383543920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:41.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.319+0000 7f5b72ff5640 10 client.17475 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:41.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.319+0000 7f5b8effd640 1 --2- 172.21.15.84:0/2610827266 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56438313d9f0 0x564383543920 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fa6cda38173c61f server_cookie=2f892b68eee10f4 in_seq=0 out_seq=0 2024-09-21T03:52:41.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.320+0000 7f5b72ff5640 1 -- 172.21.15.84:0/2610827266 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56438349eda0 con 0x56438313d9f0 2024-09-21T03:52:41.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.320+0000 7f5b72ff5640 10 client.17475 handle_command_reply: tid=0 2024-09-21T03:52:41.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.320+0000 7f5b9b882740 1 client.17475 shutdown 2024-09-21T03:52:41.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.320+0000 7f5b9b882740 1 -- 172.21.15.84:0/2610827266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56438315e390 msgr2=0x564383531ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:41.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.320+0000 7f5b9b882740 1 --2- 172.21.15.84:0/2610827266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56438315e390 0x564383531ee0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f5b8400f6f0 tx=0x7f5b8400fbb0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.320+0000 7f5b9b882740 1 -- 172.21.15.84:0/2610827266 shutdown_connections 2024-09-21T03:52:41.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.320+0000 7f5b9b882740 1 --2- 172.21.15.84:0/2610827266 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56438313d9f0 0x564383543920 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.320+0000 7f5b9b882740 1 --2- 172.21.15.84:0/2610827266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56438317f070 0x56438353d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.320+0000 7f5b72ff5640 0 client.17475 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:41.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.320+0000 7f5b9b882740 1 --2- 172.21.15.84:0/2610827266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56438315e390 0x564383531ee0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.320+0000 7f5b9b882740 1 --2- 172.21.15.84:0/2610827266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5643831561b0 0x5643835319a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.320+0000 7f5b9b882740 1 -- 172.21.15.84:0/2610827266 >> 172.21.15.84:0/2610827266 conn(0x564383173460 msgr2=0x5643835272a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:41.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.320+0000 7f5b9b882740 1 -- 172.21.15.84:0/2610827266 shutdown_connections 2024-09-21T03:52:41.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.320+0000 7f5b9b882740 1 -- 172.21.15.84:0/2610827266 wait complete. 2024-09-21T03:52:41.330 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.320+0000 7f5b9b882740 20 client.17475 trim_cache size 0 max 16384 2024-09-21T03:52:41.340 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.337+0000 7f5b9b882740 1 Processor -- start 2024-09-21T03:52:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.337+0000 7f5b9b882740 1 -- start start 2024-09-21T03:52:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.338+0000 7f5b9b882740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564383173460 0x5643835335d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.338+0000 7f5b9b882740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56438313d9f0 0x56438353d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.338+0000 7f5b9b882740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5643831561b0 0x56438352eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.338+0000 7f5b9b882740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5b901b2050 con 0x56438313d9f0 2024-09-21T03:52:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.338+0000 7f5b9b882740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5b901af920 con 0x564383173460 2024-09-21T03:52:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.338+0000 7f5b9b882740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5b901ad790 con 0x5643831561b0 2024-09-21T03:52:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.338+0000 7f5b8e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56438313d9f0 0x56438353d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.338+0000 7f5b8e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56438313d9f0 0x56438353d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53144/0 (socket says 172.21.15.84:53144) 2024-09-21T03:52:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.338+0000 7f5b8e7fc640 1 -- 172.21.15.84:0/498797029 learned_addr learned my addr 172.21.15.84:0/498797029 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.338+0000 7f5b8f7fe640 1 --2- 172.21.15.84:0/498797029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5643831561b0 0x56438352eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.338+0000 7f5b8effd640 1 --2- 172.21.15.84:0/498797029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564383173460 0x5643835335d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.338+0000 7f5b8e7fc640 1 -- 172.21.15.84:0/498797029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5643831561b0 msgr2=0x56438352eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:41.341 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.338+0000 7f5b8e7fc640 1 --2- 172.21.15.84:0/498797029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5643831561b0 0x56438352eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.338+0000 7f5b8e7fc640 1 -- 172.21.15.84:0/498797029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564383173460 msgr2=0x5643835335d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:41.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.338+0000 7f5b8e7fc640 1 --2- 172.21.15.84:0/498797029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564383173460 0x5643835335d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.338+0000 7f5b8e7fc640 1 -- 172.21.15.84:0/498797029 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56438352fea0 con 0x56438313d9f0 2024-09-21T03:52:41.342 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.339+0000 7f5b8e7fc640 1 --2- 172.21.15.84:0/498797029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56438313d9f0 0x56438353d790 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f5b8400f6c0 tx=0x7f5b8400db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5209d49cbea52722 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:41.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.339+0000 7f5b74ff9640 1 -- 172.21.15.84:0/498797029 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b84032070 con 0x56438313d9f0 2024-09-21T03:52:41.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.339+0000 7f5b74ff9640 1 -- 172.21.15.84:0/498797029 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b8400b6f0 con 0x56438313d9f0 2024-09-21T03:52:41.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.339+0000 7f5b74ff9640 1 -- 172.21.15.84:0/498797029 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b84016040 con 0x56438313d9f0 2024-09-21T03:52:41.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.340+0000 7f5b9b882740 1 -- 172.21.15.84:0/498797029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56438313d9f0 msgr2=0x56438353d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:41.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.340+0000 7f5b9b882740 1 --2- 172.21.15.84:0/498797029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56438313d9f0 0x56438353d790 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f5b8400f6c0 tx=0x7f5b8400db30 comp rx=0 tx=0).stop 2024-09-21T03:52:41.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.340+0000 7f5b9b882740 1 -- 172.21.15.84:0/498797029 shutdown_connections 2024-09-21T03:52:41.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.340+0000 7f5b9b882740 1 --2- 172.21.15.84:0/498797029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5643831561b0 0x56438352eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.345 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.340+0000 7f5b9b882740 1 --2- 172.21.15.84:0/498797029 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x56438313d9f0 0x56438353d790 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.340+0000 7f5b9b882740 1 --2- 172.21.15.84:0/498797029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564383173460 0x5643835335d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.340+0000 7f5b9b882740 1 -- 172.21.15.84:0/498797029 >> 172.21.15.84:0/498797029 conn(0x564383532060 msgr2=0x564383532ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:41.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.340+0000 7f5b9b882740 1 -- 172.21.15.84:0/498797029 shutdown_connections 2024-09-21T03:52:41.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.340+0000 7f5b9b882740 1 -- 172.21.15.84:0/498797029 wait complete. 2024-09-21T03:52:41.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.340+0000 7f5b9b882740 1 -- start start 2024-09-21T03:52:41.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.340+0000 7f5b9b882740 1 Processor -- start 2024-09-21T03:52:41.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.341+0000 7f5b9b882740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56438313d9f0 0x564383535e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:41.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.341+0000 7f5b9b882740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643831561b0 0x5643835363b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:41.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.341+0000 7f5b9b882740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564383173460 0x5643835ad290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:41.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.341+0000 7f5b9b882740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5b901adde0 con 0x5643831561b0 2024-09-21T03:52:41.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.341+0000 7f5b9b882740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5b901af250 con 0x564383173460 2024-09-21T03:52:41.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.341+0000 7f5b9b882740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5b901ae4b0 con 0x56438313d9f0 2024-09-21T03:52:41.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.341+0000 7f5b9b882740 10 client.0 _ll_register_callbacks cb 0x7f5b8400d340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:52:41.346 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.341+0000 7f5b8e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643831561b0 0x5643835363b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:41.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.341+0000 7f5b8e7fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643831561b0 0x5643835363b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:53146/0 (socket says 172.21.15.84:53146) 2024-09-21T03:52:41.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.341+0000 7f5b8e7fc640 1 -- 172.21.15.84:0/2735547146 learned_addr learned my addr 172.21.15.84:0/2735547146 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:52:41.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.341+0000 7f5b8f7fe640 1 --2- 172.21.15.84:0/2735547146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564383173460 0x5643835ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:41.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.341+0000 7f5b8effd640 1 --2- 172.21.15.84:0/2735547146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56438313d9f0 0x564383535e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:41.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.341+0000 7f5b8e7fc640 1 -- 172.21.15.84:0/2735547146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56438313d9f0 msgr2=0x564383535e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:41.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.341+0000 7f5b8e7fc640 1 --2- 172.21.15.84:0/2735547146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56438313d9f0 0x564383535e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.341+0000 7f5b8e7fc640 1 -- 172.21.15.84:0/2735547146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564383173460 msgr2=0x5643835ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:52:41.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.341+0000 7f5b8e7fc640 1 --2- 172.21.15.84:0/2735547146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564383173460 0x5643835ad290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.341+0000 7f5b8e7fc640 1 -- 172.21.15.84:0/2735547146 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643835ad7d0 con 0x5643831561b0 2024-09-21T03:52:41.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.341+0000 7f5b8e7fc640 1 --2- 172.21.15.84:0/2735547146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643831561b0 0x5643835363b0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f5b8400d4b0 tx=0x7f5b84023720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286e0d6880ad067a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:52:41.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.341+0000 7f5b72ff5640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:52:41.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.342+0000 7f5b72ff5640 1 -- 172.21.15.84:0/2735547146 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b84032070 con 0x5643831561b0 2024-09-21T03:52:41.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.342+0000 7f5b9b882740 1 -- 172.21.15.84:0/2735547146 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b8400b6f0 con 0x5643831561b0 2024-09-21T03:52:41.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.342+0000 7f5b72ff5640 1 -- 172.21.15.84:0/2735547146 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8441+0+0 (secure 0 0 0) 0x7f5b84005040 con 0x5643831561b0 2024-09-21T03:52:41.347 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.342+0000 7f5b72ff5640 1 -- 172.21.15.84:0/2735547146 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5b84016040 con 0x5643831561b0 2024-09-21T03:52:41.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.342+0000 7f5b9b882740 10 client.17481 fetch_fsmap learned FSMap version 25 2024-09-21T03:52:41.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.342+0000 7f5b9b882740 1 -- 172.21.15.84:0/2735547146 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5643835ae9c0 con 0x5643831561b0 2024-09-21T03:52:41.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.342+0000 7f5b72ff5640 1 -- 172.21.15.84:0/2735547146 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b8400b6f0 con 0x5643831561b0 2024-09-21T03:52:41.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.342+0000 7f5b72ff5640 1 -- 172.21.15.84:0/2735547146 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5b8402c070 con 0x5643831561b0 2024-09-21T03:52:41.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.342+0000 7f5b9b882740 10 client.17481 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:52:41.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.342+0000 7f5b9b882740 10 client.17481 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:52:41.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.342+0000 7f5b9b882740 20 client.17481 populate_metadata read hostname 'smithi084' 2024-09-21T03:52:41.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.342+0000 7f5b9b882740 1 --2- 172.21.15.84:0/2735547146 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56438315e390 0x5643835b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:52:41.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.342+0000 7f5b9b882740 4 client.17481 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:52:41.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.342+0000 7f5b9b882740 1 -- 172.21.15.84:0/2735547146 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56438349a850 con 0x56438315e390 2024-09-21T03:52:41.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.343+0000 7f5b8effd640 1 --2- 172.21.15.84:0/2735547146 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56438315e390 0x5643835b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:52:41.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.343+0000 7f5b72ff5640 10 client.17481 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:41.348 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.343+0000 7f5b8effd640 1 --2- 172.21.15.84:0/2735547146 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56438315e390 0x5643835b1090 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac1767f7b8fa71c1 server_cookie=ca5702868374ee6b in_seq=0 out_seq=0 2024-09-21T03:52:41.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.343+0000 7f5b72ff5640 1 -- 172.21.15.84:0/2735547146 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5682 (crc 0 0 0) 0x56438349a850 con 0x56438315e390 2024-09-21T03:52:41.349 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.343+0000 7f5b72ff5640 10 client.17481 handle_command_reply: tid=0 2024-09-21T03:52:41.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.343+0000 7f5b9b882740 1 client.17481 shutdown 2024-09-21T03:52:41.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.344+0000 7f5b9b882740 1 -- 172.21.15.84:0/2735547146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643831561b0 msgr2=0x5643835363b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:41.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.344+0000 7f5b9b882740 1 --2- 172.21.15.84:0/2735547146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643831561b0 0x5643835363b0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f5b8400d4b0 tx=0x7f5b84023720 comp rx=0 tx=0).stop 2024-09-21T03:52:41.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.344+0000 7f5b9b882740 1 -- 172.21.15.84:0/2735547146 shutdown_connections 2024-09-21T03:52:41.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.344+0000 7f5b9b882740 1 --2- 172.21.15.84:0/2735547146 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x56438315e390 0x5643835b1090 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.344+0000 7f5b9b882740 1 --2- 172.21.15.84:0/2735547146 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564383173460 0x5643835ad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.344+0000 7f5b9b882740 1 --2- 172.21.15.84:0/2735547146 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5643831561b0 0x5643835363b0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.344+0000 7f5b9b882740 1 --2- 172.21.15.84:0/2735547146 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56438313d9f0 0x564383535e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.344+0000 7f5b9b882740 1 -- 172.21.15.84:0/2735547146 >> 172.21.15.84:0/2735547146 conn(0x564383532060 msgr2=0x56438352b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:41.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.344+0000 7f5b72ff5640 0 client.17481 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:52:41.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.344+0000 7f5b9b882740 1 -- 172.21.15.84:0/2735547146 shutdown_connections 2024-09-21T03:52:41.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.344+0000 7f5b9b882740 1 -- 172.21.15.84:0/2735547146 wait complete. 2024-09-21T03:52:41.350 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.344+0000 7f5b9b882740 20 client.17481 trim_cache size 0 max 16384 2024-09-21T03:52:41.351 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:52:41.351 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:52:41.351 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T03:52:41.351 INFO:teuthology.orchestra.run.smithi084.stdout: "60214753-df43-47aa-b007-fe33bbde062a": { 2024-09-21T03:52:41.351 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:41.351 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "60214753-df43-47aa-b007-fe33bbde062a", 2024-09-21T03:52:41.351 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T03:52:41.351 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:52:41.351 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:41.351 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:52:41.351 INFO:teuthology.orchestra.run.smithi084.stdout: "1583169c-207f-40ad-b200-4ef92de62783": { 2024-09-21T03:52:41.351 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:52:29.382669+0000", 2024-09-21T03:52:41.351 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:41.352 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:41.352 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:41.352 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:41.352 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:41.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:41.352 INFO:teuthology.orchestra.run.smithi084.stdout: "d85cdf50-3fc8-467d-942f-2b77981ba106": { 2024-09-21T03:52:41.352 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:43.684286+0000", 2024-09-21T03:52:41.352 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:41.352 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:41.352 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:41.352 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:41.352 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:41.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:41.352 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:52:41.353 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:52:41.353 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:41.353 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:41.353 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:41.353 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:41.353 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:41.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:41.353 INFO:teuthology.orchestra.run.smithi084.stdout: "60214753-df43-47aa-b007-fe33bbde062a": { 2024-09-21T03:52:41.353 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:52:39.830410+0000", 2024-09-21T03:52:41.353 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:41.353 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:41.353 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:41.353 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:41.353 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:41.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:41.353 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:52:41.354 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:52:41.354 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:41.354 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:41.354 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:41.354 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:41.354 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:41.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:41.354 INFO:teuthology.orchestra.run.smithi084.stdout: "2cbf94ea-caa1-4c9b-8007-8a0887103a5c": { 2024-09-21T03:52:41.354 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:51:05.114755+0000", 2024-09-21T03:52:41.354 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:41.354 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:41.354 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:41.354 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:41.354 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:41.355 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:41.355 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:52:41.355 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:52:41.355 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:41.355 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:41.355 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:41.355 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:41.355 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:41.355 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:41.355 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:52:41.355 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:52:41.355 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:41.355 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:41.355 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:41.355 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:41.356 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:41.356 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:41.356 INFO:teuthology.orchestra.run.smithi084.stdout: "43a49cca-fc1c-4c36-a314-49033e7c3fb6": { 2024-09-21T03:52:41.356 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:49:17.366428+0000", 2024-09-21T03:52:41.356 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:41.356 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:41.356 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:41.356 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:41.356 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:41.356 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:41.356 INFO:teuthology.orchestra.run.smithi084.stdout: "0bb4e83d-6059-4d41-88f0-1562fa422c47": { 2024-09-21T03:52:41.356 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:54.511018+0000", 2024-09-21T03:52:41.357 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:41.357 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:41.357 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:41.357 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:41.357 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:41.357 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:41.357 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:52:41.357 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:52:41.357 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:41.357 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:41.357 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:41.357 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:41.357 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:41.357 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:41.357 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:52:41.357 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:52:41.358 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:41.358 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:41.358 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:41.358 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:41.358 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:41.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:41.358 INFO:teuthology.orchestra.run.smithi084.stdout: "5435e7df-7d39-4687-a715-54c7af6bc3b1": { 2024-09-21T03:52:41.358 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:51:47.429708+0000", 2024-09-21T03:52:41.358 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:41.358 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:41.358 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:41.358 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:41.358 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:41.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:41.359 INFO:teuthology.orchestra.run.smithi084.stdout: "27dcb84c-89fa-46b2-b980-58857966c697": { 2024-09-21T03:52:41.359 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:52.598527+0000", 2024-09-21T03:52:41.359 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:41.359 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:41.359 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:41.359 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:41.359 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:41.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:41.359 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:52:41.359 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:52:41.359 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:41.359 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:41.359 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:41.359 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:41.360 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:41.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:41.360 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:52:41.360 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:52:41.360 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:41.360 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:41.360 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:41.360 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:41.360 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:41.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:41.360 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:52:41.360 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:52:41.360 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:41.360 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:41.360 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:41.360 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:41.361 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:41.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:41.361 INFO:teuthology.orchestra.run.smithi084.stdout: "b2063a70-0b1f-4b6b-9c96-d886e156ea66": { 2024-09-21T03:52:41.361 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:48:34.864478+0000", 2024-09-21T03:52:41.361 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:41.361 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:41.361 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:41.361 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:41.361 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:41.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:52:41.361 INFO:teuthology.orchestra.run.smithi084.stdout: "33131451-f242-447a-b13f-9bdebc7884ec": { 2024-09-21T03:52:41.361 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:00.524357+0000", 2024-09-21T03:52:41.361 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:52:41.361 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:52:41.361 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:52:41.361 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:52:41.362 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:52:41.362 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:52:41.362 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:52:41.362 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:52:41.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.345+0000 7f5b9530e640 1 -- 172.21.15.84:0/3232120488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5b780b6680 msgr2=0x7f5b780b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:41.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.345+0000 7f5b9530e640 1 --2- 172.21.15.84:0/3232120488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5b780b6680 0x7f5b780b8b90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009c10 tx=0x7f5b880090e0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.345+0000 7f5b9530e640 1 -- 172.21.15.84:0/3232120488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b901049c0 msgr2=0x7f5b9019a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:52:41.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.345+0000 7f5b9530e640 1 --2- 172.21.15.84:0/3232120488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b901049c0 0x7f5b9019a590 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f5b8002ade0 tx=0x7f5b80003970 comp rx=0 tx=0).stop 2024-09-21T03:52:41.362 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.345+0000 7f5b9530e640 1 -- 172.21.15.84:0/3232120488 shutdown_connections 2024-09-21T03:52:41.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.345+0000 7f5b9530e640 1 --2- 172.21.15.84:0/3232120488 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5b780b6680 0x7f5b780b8b90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.345+0000 7f5b9530e640 1 --2- 172.21.15.84:0/3232120488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b9010de20 0x7f5b9019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.345+0000 7f5b9530e640 1 --2- 172.21.15.84:0/3232120488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b90105310 0x7f5b9019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.345+0000 7f5b9530e640 1 --2- 172.21.15.84:0/3232120488 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5b901049c0 0x7f5b9019a590 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:52:41.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.345+0000 7f5b9530e640 1 -- 172.21.15.84:0/3232120488 >> 172.21.15.84:0/3232120488 conn(0x7f5b90079730 msgr2=0x7f5b90106850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:52:41.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.345+0000 7f5b9530e640 1 -- 172.21.15.84:0/3232120488 shutdown_connections 2024-09-21T03:52:41.363 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:52:41.345+0000 7f5b9530e640 1 -- 172.21.15.84:0/3232120488 wait complete. 2024-09-21T03:52:42.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:41 smithi174 ceph-mon[34403]: pgmap v638: 97 pgs: 97 active+clean; 21 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 9 op/s 2024-09-21T03:52:42.149 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:41 smithi084 ceph-mon[30941]: pgmap v638: 97 pgs: 97 active+clean; 21 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 9 op/s 2024-09-21T03:52:42.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:41 smithi172 ceph-mon[34821]: pgmap v638: 97 pgs: 97 active+clean; 21 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 9 op/s 2024-09-21T03:52:42.177 INFO:tasks.cephfs.filesystem:scrub status for tag:60214753-df43-47aa-b007-fe33bbde062a - {'path': '/', 'tag': '60214753-df43-47aa-b007-fe33bbde062a', 'options': 'recursive,force'} 2024-09-21T03:52:44.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:43 smithi174 ceph-mon[34403]: pgmap v639: 97 pgs: 97 active+clean; 21 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 11 op/s 2024-09-21T03:52:44.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:43 smithi172 ceph-mon[34821]: pgmap v639: 97 pgs: 97 active+clean; 21 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 11 op/s 2024-09-21T03:52:44.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:43 smithi084 ceph-mon[30941]: pgmap v639: 97 pgs: 97 active+clean; 21 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 11 op/s 2024-09-21T03:52:45.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:44 smithi174 ceph-mon[34403]: scrub summary: idle 2024-09-21T03:52:45.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:44 smithi172 ceph-mon[34821]: scrub summary: idle 2024-09-21T03:52:45.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:44 smithi084 ceph-mon[30941]: scrub summary: idle 2024-09-21T03:52:46.108 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:45 smithi084 ceph-mon[30941]: pgmap v640: 97 pgs: 97 active+clean; 21 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 13 op/s 2024-09-21T03:52:46.108 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:45 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:46.122 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:45 smithi174 ceph-mon[34403]: pgmap v640: 97 pgs: 97 active+clean; 21 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 13 op/s 2024-09-21T03:52:46.122 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:45 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:46.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:45 smithi172 ceph-mon[34821]: pgmap v640: 97 pgs: 97 active+clean; 21 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 13 op/s 2024-09-21T03:52:46.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:45 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:48.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:47 smithi084 ceph-mon[30941]: pgmap v641: 97 pgs: 97 active+clean; 21 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 10 op/s 2024-09-21T03:52:48.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:48.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:48.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:48.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:48.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:48.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:48.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:48.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:52:48.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:48.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:47 smithi174 ceph-mon[34403]: pgmap v641: 97 pgs: 97 active+clean; 21 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 10 op/s 2024-09-21T03:52:48.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:48.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:48.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:48.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:48.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:48.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:48.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:48.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:52:48.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:48.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:47 smithi172 ceph-mon[34821]: pgmap v641: 97 pgs: 97 active+clean; 21 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 10 op/s 2024-09-21T03:52:48.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:48.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:48.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:48.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:48.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:48.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:48.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:48.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:52:48.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:52:50.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:49 smithi084 ceph-mon[30941]: pgmap v642: 97 pgs: 97 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 14 op/s 2024-09-21T03:52:50.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:49 smithi174 ceph-mon[34403]: pgmap v642: 97 pgs: 97 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 14 op/s 2024-09-21T03:52:50.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:49 smithi172 ceph-mon[34821]: pgmap v642: 97 pgs: 97 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 14 op/s 2024-09-21T03:52:52.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:51 smithi084 ceph-mon[30941]: pgmap v643: 97 pgs: 97 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 9 op/s 2024-09-21T03:52:52.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:51 smithi174 ceph-mon[34403]: pgmap v643: 97 pgs: 97 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 9 op/s 2024-09-21T03:52:52.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:51 smithi172 ceph-mon[34821]: pgmap v643: 97 pgs: 97 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 47 KiB/s wr, 9 op/s 2024-09-21T03:52:54.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:53 smithi084 ceph-mon[30941]: pgmap v644: 97 pgs: 97 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 11 op/s 2024-09-21T03:52:54.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:53 smithi174 ceph-mon[34403]: pgmap v644: 97 pgs: 97 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 11 op/s 2024-09-21T03:52:54.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:53 smithi172 ceph-mon[34821]: pgmap v644: 97 pgs: 97 active+clean; 21 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 47 KiB/s wr, 11 op/s 2024-09-21T03:52:56.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:55 smithi084 ceph-mon[30941]: pgmap v645: 97 pgs: 97 active+clean; 22 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 13 op/s 2024-09-21T03:52:56.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:55 smithi174 ceph-mon[34403]: pgmap v645: 97 pgs: 97 active+clean; 22 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 13 op/s 2024-09-21T03:52:56.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:55 smithi172 ceph-mon[34821]: pgmap v645: 97 pgs: 97 active+clean; 22 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 13 op/s 2024-09-21T03:52:58.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:57 smithi084 ceph-mon[30941]: pgmap v646: 97 pgs: 97 active+clean; 22 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 10 op/s 2024-09-21T03:52:58.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:57 smithi174 ceph-mon[34403]: pgmap v646: 97 pgs: 97 active+clean; 22 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 10 op/s 2024-09-21T03:52:58.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:57 smithi172 ceph-mon[34821]: pgmap v646: 97 pgs: 97 active+clean; 22 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 10 op/s 2024-09-21T03:53:00.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:52:59 smithi084 ceph-mon[30941]: pgmap v647: 97 pgs: 97 active+clean; 22 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 12 op/s 2024-09-21T03:53:00.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:52:59 smithi174 ceph-mon[34403]: pgmap v647: 97 pgs: 97 active+clean; 22 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 12 op/s 2024-09-21T03:53:00.143 INFO:tasks.workunit.client.0.smithi084.stdout:499/600: open fd = 3 2024-09-21T03:53:00.143 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.143 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.143 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.143 INFO:tasks.workunit.client.0.smithi084.stdout:500/600: open fd = 3 2024-09-21T03:53:00.143 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.143 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.143 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.144 INFO:tasks.workunit.client.0.smithi084.stdout:501/600: open fd = 3 2024-09-21T03:53:00.144 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.144 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.144 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.144 INFO:tasks.workunit.client.0.smithi084.stdout:502/600: open fd = 3 2024-09-21T03:53:00.144 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.144 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.144 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.144 INFO:tasks.workunit.client.0.smithi084.stdout:503/600: open fd = 3 2024-09-21T03:53:00.144 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.144 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.144 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.144 INFO:tasks.workunit.client.0.smithi084.stdout:504/600: open fd = 3 2024-09-21T03:53:00.144 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.145 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.145 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.145 INFO:tasks.workunit.client.0.smithi084.stdout:505/600: open fd = 3 2024-09-21T03:53:00.145 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.145 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.145 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.145 INFO:tasks.workunit.client.0.smithi084.stdout:506/600: open fd = 3 2024-09-21T03:53:00.145 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.145 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.145 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.145 INFO:tasks.workunit.client.0.smithi084.stdout:507/600: open fd = 3 2024-09-21T03:53:00.145 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.145 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.146 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.146 INFO:tasks.workunit.client.0.smithi084.stdout:508/600: open fd = 3 2024-09-21T03:53:00.146 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.146 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.146 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.146 INFO:tasks.workunit.client.0.smithi084.stdout:509/600: open fd = 3 2024-09-21T03:53:00.146 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.146 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.146 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.146 INFO:tasks.workunit.client.0.smithi084.stdout:510/600: open fd = 3 2024-09-21T03:53:00.146 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.146 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.146 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.147 INFO:tasks.workunit.client.0.smithi084.stdout:511/600: open fd = 3 2024-09-21T03:53:00.147 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.147 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.147 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.147 INFO:tasks.workunit.client.0.smithi084.stdout:512/600: open fd = 3 2024-09-21T03:53:00.147 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.147 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.147 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.147 INFO:tasks.workunit.client.0.smithi084.stdout:513/600: open fd = 3 2024-09-21T03:53:00.147 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.147 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.147 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.147 INFO:tasks.workunit.client.0.smithi084.stdout:514/600: open fd = 3 2024-09-21T03:53:00.147 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.148 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.148 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.148 INFO:tasks.workunit.client.0.smithi084.stdout:515/600: open fd = 3 2024-09-21T03:53:00.148 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.148 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.148 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.148 INFO:tasks.workunit.client.0.smithi084.stdout:516/600: open fd = 3 2024-09-21T03:53:00.148 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.148 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.148 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.148 INFO:tasks.workunit.client.0.smithi084.stdout:517/600: open fd = 3 2024-09-21T03:53:00.148 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.148 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.148 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.149 INFO:tasks.workunit.client.0.smithi084.stdout:518/600: open fd = 3 2024-09-21T03:53:00.149 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.149 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.149 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.149 INFO:tasks.workunit.client.0.smithi084.stdout:519/600: open fd = 3 2024-09-21T03:53:00.149 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.149 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.149 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.149 INFO:tasks.workunit.client.0.smithi084.stdout:520/600: open fd = 3 2024-09-21T03:53:00.149 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.149 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.149 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.150 INFO:tasks.workunit.client.0.smithi084.stdout:521/600: open fd = 3 2024-09-21T03:53:00.150 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.150 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.150 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.150 INFO:tasks.workunit.client.0.smithi084.stdout:522/600: open fd = 3 2024-09-21T03:53:00.150 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.150 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.150 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.150 INFO:tasks.workunit.client.0.smithi084.stdout:523/600: open fd = 3 2024-09-21T03:53:00.150 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.150 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.150 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.150 INFO:tasks.workunit.client.0.smithi084.stdout:524/600: open fd = 3 2024-09-21T03:53:00.150 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.151 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.151 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.151 INFO:tasks.workunit.client.0.smithi084.stdout:525/600: open fd = 3 2024-09-21T03:53:00.151 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.151 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.151 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.151 INFO:tasks.workunit.client.0.smithi084.stdout:526/600: open fd = 3 2024-09-21T03:53:00.151 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.151 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.151 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.151 INFO:tasks.workunit.client.0.smithi084.stdout:527/600: open fd = 3 2024-09-21T03:53:00.151 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.152 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.152 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.152 INFO:tasks.workunit.client.0.smithi084.stdout:528/600: open fd = 3 2024-09-21T03:53:00.152 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.152 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.152 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.152 INFO:tasks.workunit.client.0.smithi084.stdout:529/600: open fd = 3 2024-09-21T03:53:00.152 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.152 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.152 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.152 INFO:tasks.workunit.client.0.smithi084.stdout:530/600: open fd = 3 2024-09-21T03:53:00.152 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.152 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.153 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.153 INFO:tasks.workunit.client.0.smithi084.stdout:531/600: open fd = 3 2024-09-21T03:53:00.153 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.153 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.153 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.153 INFO:tasks.workunit.client.0.smithi084.stdout:532/600: open fd = 3 2024-09-21T03:53:00.153 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.153 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.153 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.153 INFO:tasks.workunit.client.0.smithi084.stdout:533/600: open fd = 3 2024-09-21T03:53:00.153 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.153 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.153 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.153 INFO:tasks.workunit.client.0.smithi084.stdout:534/600: open fd = 3 2024-09-21T03:53:00.153 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.154 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.154 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.154 INFO:tasks.workunit.client.0.smithi084.stdout:535/600: open fd = 3 2024-09-21T03:53:00.154 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.154 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.154 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.154 INFO:tasks.workunit.client.0.smithi084.stdout:536/600: open fd = 3 2024-09-21T03:53:00.154 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.154 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.154 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.154 INFO:tasks.workunit.client.0.smithi084.stdout:537/600: open fd = 3 2024-09-21T03:53:00.154 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.155 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.155 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.155 INFO:tasks.workunit.client.0.smithi084.stdout:538/600: open fd = 3 2024-09-21T03:53:00.155 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.155 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.155 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.155 INFO:tasks.workunit.client.0.smithi084.stdout:539/600: open fd = 3 2024-09-21T03:53:00.155 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.155 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.155 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.155 INFO:tasks.workunit.client.0.smithi084.stdout:540/600: open fd = 3 2024-09-21T03:53:00.156 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.156 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.156 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.156 INFO:tasks.workunit.client.0.smithi084.stdout:541/600: open fd = 3 2024-09-21T03:53:00.156 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.156 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.156 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.156 INFO:tasks.workunit.client.0.smithi084.stdout:542/600: open fd = 3 2024-09-21T03:53:00.156 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.156 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.156 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.156 INFO:tasks.workunit.client.0.smithi084.stdout:543/600: open fd = 3 2024-09-21T03:53:00.157 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.157 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.157 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.157 INFO:tasks.workunit.client.0.smithi084.stdout:544/600: open fd = 3 2024-09-21T03:53:00.157 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.157 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.157 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.157 INFO:tasks.workunit.client.0.smithi084.stdout:545/600: open fd = 3 2024-09-21T03:53:00.157 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.157 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.157 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.157 INFO:tasks.workunit.client.0.smithi084.stdout:546/600: open fd = 3 2024-09-21T03:53:00.157 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.157 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.158 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.158 INFO:tasks.workunit.client.0.smithi084.stdout:547/600: open fd = 3 2024-09-21T03:53:00.158 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.158 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.158 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.158 INFO:tasks.workunit.client.0.smithi084.stdout:548/600: open fd = 3 2024-09-21T03:53:00.158 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.158 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.158 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.158 INFO:tasks.workunit.client.0.smithi084.stdout:549/600: open fd = 3 2024-09-21T03:53:00.158 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.158 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.159 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.159 INFO:tasks.workunit.client.0.smithi084.stdout:550/600: open fd = 3 2024-09-21T03:53:00.159 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.159 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.159 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.159 INFO:tasks.workunit.client.0.smithi084.stdout:551/600: open fd = 3 2024-09-21T03:53:00.159 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.159 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.159 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.159 INFO:tasks.workunit.client.0.smithi084.stdout:552/600: open fd = 3 2024-09-21T03:53:00.159 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.159 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.159 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.160 INFO:tasks.workunit.client.0.smithi084.stdout:553/600: open fd = 3 2024-09-21T03:53:00.160 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.160 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.160 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.160 INFO:tasks.workunit.client.0.smithi084.stdout:554/600: open fd = 3 2024-09-21T03:53:00.160 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.160 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.160 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.160 INFO:tasks.workunit.client.0.smithi084.stdout:555/600: open fd = 3 2024-09-21T03:53:00.160 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.160 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.160 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.160 INFO:tasks.workunit.client.0.smithi084.stdout:556/600: open fd = 3 2024-09-21T03:53:00.160 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.161 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.161 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.161 INFO:tasks.workunit.client.0.smithi084.stdout:557/600: open fd = 3 2024-09-21T03:53:00.161 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.161 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.161 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.161 INFO:tasks.workunit.client.0.smithi084.stdout:558/600: open fd = 3 2024-09-21T03:53:00.161 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.161 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.161 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.161 INFO:tasks.workunit.client.0.smithi084.stdout:559/600: open fd = 3 2024-09-21T03:53:00.161 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.161 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.162 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.162 INFO:tasks.workunit.client.0.smithi084.stdout:560/600: open fd = 3 2024-09-21T03:53:00.162 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.162 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:00.162 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:00.162 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:52:59 smithi172 ceph-mon[34821]: pgmap v647: 97 pgs: 97 active+clean; 22 MiB data, 461 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 50 KiB/s wr, 12 op/s 2024-09-21T03:53:02.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:01 smithi084 ceph-mon[30941]: pgmap v648: 97 pgs: 97 active+clean; 22 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 10 op/s 2024-09-21T03:53:02.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:01 smithi174 ceph-mon[34403]: pgmap v648: 97 pgs: 97 active+clean; 22 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 10 op/s 2024-09-21T03:53:02.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:01 smithi172 ceph-mon[34821]: pgmap v648: 97 pgs: 97 active+clean; 22 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 10 op/s 2024-09-21T03:53:04.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:03 smithi084 ceph-mon[30941]: pgmap v649: 97 pgs: 97 active+clean; 22 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 74 KiB/s wr, 14 op/s 2024-09-21T03:53:04.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:03 smithi174 ceph-mon[34403]: pgmap v649: 97 pgs: 97 active+clean; 22 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 74 KiB/s wr, 14 op/s 2024-09-21T03:53:04.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:03 smithi172 ceph-mon[34821]: pgmap v649: 97 pgs: 97 active+clean; 22 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 74 KiB/s wr, 14 op/s 2024-09-21T03:53:06.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:05 smithi084 ceph-mon[30941]: pgmap v650: 97 pgs: 97 active+clean; 22 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 122 KiB/s wr, 30 op/s 2024-09-21T03:53:06.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:05 smithi084 ceph-mon[30941]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T03:53:06.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:05 smithi174 ceph-mon[34403]: pgmap v650: 97 pgs: 97 active+clean; 22 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 122 KiB/s wr, 30 op/s 2024-09-21T03:53:06.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:05 smithi174 ceph-mon[34403]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T03:53:06.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:05 smithi172 ceph-mon[34821]: pgmap v650: 97 pgs: 97 active+clean; 22 MiB data, 462 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 122 KiB/s wr, 30 op/s 2024-09-21T03:53:06.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:05 smithi172 ceph-mon[34821]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T03:53:08.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:07 smithi084 ceph-mon[30941]: pgmap v652: 97 pgs: 97 active+clean; 22 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 32 op/s 2024-09-21T03:53:08.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:07 smithi174 ceph-mon[34403]: pgmap v652: 97 pgs: 97 active+clean; 22 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 32 op/s 2024-09-21T03:53:08.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:07 smithi172 ceph-mon[34821]: pgmap v652: 97 pgs: 97 active+clean; 22 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 32 op/s 2024-09-21T03:53:10.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:09 smithi084 ceph-mon[30941]: pgmap v653: 97 pgs: 97 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 31 op/s 2024-09-21T03:53:10.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:09 smithi174 ceph-mon[34403]: pgmap v653: 97 pgs: 97 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 31 op/s 2024-09-21T03:53:10.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:09 smithi172 ceph-mon[34821]: pgmap v653: 97 pgs: 97 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 31 op/s 2024-09-21T03:53:12.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:11 smithi084 ceph-mon[30941]: pgmap v654: 97 pgs: 97 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 31 op/s 2024-09-21T03:53:12.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:11 smithi174 ceph-mon[34403]: pgmap v654: 97 pgs: 97 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 31 op/s 2024-09-21T03:53:12.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:11 smithi172 ceph-mon[34821]: pgmap v654: 97 pgs: 97 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 31 op/s 2024-09-21T03:53:12.178 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:53:12.438 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:12.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.953+0000 7f6aea60a640 1 -- 172.21.15.84:0/1688770441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ae4104a30 msgr2=0x7f6ae4104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:12.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.953+0000 7f6aea60a640 1 --2- 172.21.15.84:0/1688770441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ae4104a30 0x7f6ae4104e40 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009900 tx=0x7f6ad402a410 comp rx=0 tx=0).stop 2024-09-21T03:53:12.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.953+0000 7f6aea60a640 1 -- 172.21.15.84:0/1688770441 shutdown_connections 2024-09-21T03:53:12.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.953+0000 7f6aea60a640 1 --2- 172.21.15.84:0/1688770441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae410de90 0x7f6ae4110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.953+0000 7f6aea60a640 1 --2- 172.21.15.84:0/1688770441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae4105380 0x7f6ae410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.953+0000 7f6aea60a640 1 --2- 172.21.15.84:0/1688770441 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ae4104a30 0x7f6ae4104e40 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.953+0000 7f6aea60a640 1 -- 172.21.15.84:0/1688770441 >> 172.21.15.84:0/1688770441 conn(0x7f6ae4079770 msgr2=0x7f6ae4079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:12.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.953+0000 7f6aea60a640 1 -- 172.21.15.84:0/1688770441 shutdown_connections 2024-09-21T03:53:12.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.953+0000 7f6aea60a640 1 -- 172.21.15.84:0/1688770441 wait complete. 2024-09-21T03:53:12.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.953+0000 7f6aea60a640 1 Processor -- start 2024-09-21T03:53:12.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.953+0000 7f6aea60a640 1 -- start start 2024-09-21T03:53:12.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.954+0000 7f6aea60a640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae4104a30 0x7f6ae419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.954+0000 7f6aea60a640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae4105380 0x7f6ae419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.954+0000 7f6aea60a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ae410de90 0x7f6ae419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.954+0000 7f6aea60a640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae4113b10 con 0x7f6ae410de90 2024-09-21T03:53:12.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.954+0000 7f6aea60a640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae4113990 con 0x7f6ae4104a30 2024-09-21T03:53:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.954+0000 7f6aea60a640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae4113c90 con 0x7f6ae4105380 2024-09-21T03:53:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.954+0000 7f6ae8ba7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ae410de90 0x7f6ae419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.954+0000 7f6ae8ba7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ae410de90 0x7f6ae419fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34928/0 (socket says 172.21.15.84:34928) 2024-09-21T03:53:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.954+0000 7f6ae8ba7640 1 -- 172.21.15.84:0/1447495704 learned_addr learned my addr 172.21.15.84:0/1447495704 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.954+0000 7f6ae3fff640 1 --2- 172.21.15.84:0/1447495704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae4104a30 0x7f6ae419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.954+0000 7f6ae37fe640 1 --2- 172.21.15.84:0/1447495704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae4105380 0x7f6ae419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.954+0000 7f6ae8ba7640 1 -- 172.21.15.84:0/1447495704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae4105380 msgr2=0x7f6ae419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.954+0000 7f6ae8ba7640 1 --2- 172.21.15.84:0/1447495704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae4105380 0x7f6ae419aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.954+0000 7f6ae8ba7640 1 -- 172.21.15.84:0/1447495704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae4104a30 msgr2=0x7f6ae419a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.954+0000 7f6ae8ba7640 1 --2- 172.21.15.84:0/1447495704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae4104a30 0x7f6ae419a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.954+0000 7f6ae8ba7640 1 -- 172.21.15.84:0/1447495704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae41a0450 con 0x7f6ae410de90 2024-09-21T03:53:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.955+0000 7f6ae8ba7640 1 --2- 172.21.15.84:0/1447495704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ae410de90 0x7f6ae419fd20 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f6adc00eaa0 tx=0x7f6adc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:12.971 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.955+0000 7f6ae17fa640 1 -- 172.21.15.84:0/1447495704 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc00cdb0 con 0x7f6ae410de90 2024-09-21T03:53:12.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.955+0000 7f6ae17fa640 1 -- 172.21.15.84:0/1447495704 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6adc005020 con 0x7f6ae410de90 2024-09-21T03:53:12.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.955+0000 7f6aea60a640 1 -- 172.21.15.84:0/1447495704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae41a0740 con 0x7f6ae410de90 2024-09-21T03:53:12.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.955+0000 7f6ae17fa640 1 -- 172.21.15.84:0/1447495704 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc0116d0 con 0x7f6ae410de90 2024-09-21T03:53:12.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.955+0000 7f6aea60a640 1 -- 172.21.15.84:0/1447495704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae41a6ea0 con 0x7f6ae410de90 2024-09-21T03:53:12.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.958+0000 7f6af0b7e740 1 Processor -- start 2024-09-21T03:53:12.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.958+0000 7f6ae17fa640 1 -- 172.21.15.84:0/1447495704 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f6adc0051d0 con 0x7f6ae410de90 2024-09-21T03:53:12.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.958+0000 7f6af0b7e740 1 -- start start 2024-09-21T03:53:12.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.958+0000 7f6af0b7e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367629070 0x5593679d0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.958+0000 7f6af0b7e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593676001b0 0x5593679d0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.958+0000 7f6af0b7e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559367608390 0x5593679d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.958+0000 7f6af0b7e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559367946e50 con 0x559367629070 2024-09-21T03:53:12.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.959+0000 7f6af0b7e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559367936280 con 0x559367608390 2024-09-21T03:53:12.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.959+0000 7f6af0b7e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55936793a090 con 0x5593676001b0 2024-09-21T03:53:12.972 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.959+0000 7f6ae37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367629070 0x5593679d0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.959+0000 7f6ae37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367629070 0x5593679d0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34940/0 (socket says 172.21.15.84:34940) 2024-09-21T03:53:12.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.959+0000 7f6ae37fe640 1 -- 172.21.15.84:0/480303636 learned_addr learned my addr 172.21.15.84:0/480303636 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:12.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.959+0000 7f6ae3fff640 1 --2- 172.21.15.84:0/480303636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593676001b0 0x5593679d0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.959+0000 7f6ae37fe640 1 -- 172.21.15.84:0/480303636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593676001b0 msgr2=0x5593679d0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:12.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.959+0000 7f6ae37fe640 1 --2- 172.21.15.84:0/480303636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593676001b0 0x5593679d0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.959+0000 7f6ae37fe640 1 -- 172.21.15.84:0/480303636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559367608390 msgr2=0x5593679d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:12.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.959+0000 7f6ae37fe640 1 --2- 172.21.15.84:0/480303636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559367608390 0x5593679d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.959+0000 7f6ae37fe640 1 -- 172.21.15.84:0/480303636 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559367694650 con 0x559367629070 2024-09-21T03:53:12.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.959+0000 7f6ae17fa640 1 --2- 172.21.15.84:0/1447495704 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6acc0b6700 0x7f6acc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.959+0000 7f6ae37fe640 1 --2- 172.21.15.84:0/480303636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367629070 0x5593679d0650 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800bd30 tx=0x7f6ad80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac493fb748f358e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:12.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.959+0000 7f6ae3fff640 1 --2- 172.21.15.84:0/1447495704 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6acc0b6700 0x7f6acc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.959+0000 7f6aca7fc640 1 -- 172.21.15.84:0/480303636 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8004030 con 0x559367629070 2024-09-21T03:53:12.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.959+0000 7f6ae17fa640 1 -- 172.21.15.84:0/1447495704 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8485+0+0 (secure 0 0 0) 0x7f6adc0e7760 con 0x7f6ae410de90 2024-09-21T03:53:12.973 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.959+0000 7f6aca7fc640 1 -- 172.21.15.84:0/480303636 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ad80054d0 con 0x559367629070 2024-09-21T03:53:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.959+0000 7f6aca7fc640 1 -- 172.21.15.84:0/480303636 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8004bb0 con 0x559367629070 2024-09-21T03:53:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.960+0000 7f6af0b7e740 1 -- 172.21.15.84:0/480303636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367629070 msgr2=0x5593679d0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.960+0000 7f6ae3fff640 1 --2- 172.21.15.84:0/1447495704 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6acc0b6700 0x7f6acc0b8c10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4031440 tx=0x7f6ad4009610 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.960+0000 7f6af0b7e740 1 --2- 172.21.15.84:0/480303636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367629070 0x5593679d0650 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800bd30 tx=0x7f6ad80107a0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.960+0000 7f6af0b7e740 1 -- 172.21.15.84:0/480303636 shutdown_connections 2024-09-21T03:53:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.960+0000 7f6af0b7e740 1 --2- 172.21.15.84:0/480303636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559367608390 0x5593679d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.960+0000 7f6af0b7e740 1 --2- 172.21.15.84:0/480303636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593676001b0 0x5593679d0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.960+0000 7f6af0b7e740 1 --2- 172.21.15.84:0/480303636 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367629070 0x5593679d0650 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.960+0000 7f6af0b7e740 1 -- 172.21.15.84:0/480303636 >> 172.21.15.84:0/480303636 conn(0x55936761d460 msgr2=0x5593679ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.960+0000 7f6af0b7e740 1 -- 172.21.15.84:0/480303636 shutdown_connections 2024-09-21T03:53:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.960+0000 7f6af0b7e740 1 -- 172.21.15.84:0/480303636 wait complete. 2024-09-21T03:53:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.961+0000 7f6af0b7e740 1 -- start start 2024-09-21T03:53:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.961+0000 7f6af0b7e740 1 Processor -- start 2024-09-21T03:53:12.974 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.961+0000 7f6af0b7e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593676001b0 0x5593679e0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.961+0000 7f6af0b7e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367608390 0x5593679e05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.961+0000 7f6af0b7e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559367629070 0x5593679e0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.961+0000 7f6af0b7e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x559367797700 con 0x559367608390 2024-09-21T03:53:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.961+0000 7f6af0b7e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5593678d1110 con 0x559367629070 2024-09-21T03:53:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.961+0000 7f6af0b7e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5593679e3190 con 0x5593676001b0 2024-09-21T03:53:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.961+0000 7f6af0b7e740 10 client.0 _ll_register_callbacks cb 0x5593678ea990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:53:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.961+0000 7f6ae37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367608390 0x5593679e05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.961+0000 7f6ae37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367608390 0x5593679e05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34944/0 (socket says 172.21.15.84:34944) 2024-09-21T03:53:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.961+0000 7f6ae37fe640 1 -- 172.21.15.84:0/113282881 learned_addr learned my addr 172.21.15.84:0/113282881 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.962+0000 7f6ae3fff640 1 --2- 172.21.15.84:0/113282881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593676001b0 0x5593679e0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.962+0000 7f6ae8ba7640 1 --2- 172.21.15.84:0/113282881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559367629070 0x5593679e0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.962+0000 7f6ae37fe640 1 -- 172.21.15.84:0/113282881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593676001b0 msgr2=0x5593679e0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.962+0000 7f6ae37fe640 1 --2- 172.21.15.84:0/113282881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593676001b0 0x5593679e0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.962+0000 7f6ae37fe640 1 -- 172.21.15.84:0/113282881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559367629070 msgr2=0x5593679e0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:12.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.962+0000 7f6ae37fe640 1 --2- 172.21.15.84:0/113282881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559367629070 0x5593679e0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.962+0000 7f6ae37fe640 1 -- 172.21.15.84:0/113282881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593678fec40 con 0x559367608390 2024-09-21T03:53:12.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.962+0000 7f6ae37fe640 1 --2- 172.21.15.84:0/113282881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367608390 0x5593679e05d0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800b3d0 tx=0x7f6ad800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efc581396041338 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:12.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.962+0000 7f6ac37fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:53:12.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.962+0000 7f6ac37fe640 1 -- 172.21.15.84:0/113282881 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad802a060 con 0x559367608390 2024-09-21T03:53:12.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.962+0000 7f6ac37fe640 1 -- 172.21.15.84:0/113282881 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8485+0+0 (secure 0 0 0) 0x7f6ad8005230 con 0x559367608390 2024-09-21T03:53:12.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.962+0000 7f6af0b7e740 1 -- 172.21.15.84:0/113282881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ad80054d0 con 0x559367608390 2024-09-21T03:53:12.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.962+0000 7f6ac37fe640 1 -- 172.21.15.84:0/113282881 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6ad80048b0 con 0x559367608390 2024-09-21T03:53:12.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.962+0000 7f6af0b7e740 10 client.17493 fetch_fsmap learned FSMap version 25 2024-09-21T03:53:12.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.962+0000 7f6af0b7e740 1 -- 172.21.15.84:0/113282881 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5593679eee50 con 0x559367608390 2024-09-21T03:53:12.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.962+0000 7f6ac37fe640 1 -- 172.21.15.84:0/113282881 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ad80054d0 con 0x559367608390 2024-09-21T03:53:12.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.963+0000 7f6ac37fe640 1 -- 172.21.15.84:0/113282881 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6ad8011ae0 con 0x559367608390 2024-09-21T03:53:12.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.963+0000 7f6af0b7e740 10 client.17493 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:53:12.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.963+0000 7f6af0b7e740 10 client.17493 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:53:12.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.963+0000 7f6af0b7e740 20 client.17493 populate_metadata read hostname 'smithi084' 2024-09-21T03:53:12.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.963+0000 7f6af0b7e740 1 --2- 172.21.15.84:0/113282881 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5593675e79f0 0x5593679f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.963+0000 7f6af0b7e740 4 client.17493 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:53:12.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.963+0000 7f6af0b7e740 1 -- 172.21.15.84:0/113282881 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559367948da0 con 0x5593675e79f0 2024-09-21T03:53:12.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.963+0000 7f6ae3fff640 1 --2- 172.21.15.84:0/113282881 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5593675e79f0 0x5593679f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.963+0000 7f6ae3fff640 1 --2- 172.21.15.84:0/113282881 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5593675e79f0 0x5593679f22c0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21dafa4bd761a259 server_cookie=b412fdc5455c317e in_seq=0 out_seq=0 2024-09-21T03:53:12.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.963+0000 7f6ac37fe640 10 client.17493 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:53:12.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.964+0000 7f6ac37fe640 1 -- 172.21.15.84:0/113282881 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559367948da0 con 0x5593675e79f0 2024-09-21T03:53:12.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.964+0000 7f6ac37fe640 10 client.17493 handle_command_reply: tid=0 2024-09-21T03:53:12.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.964+0000 7f6af0b7e740 1 client.17493 shutdown 2024-09-21T03:53:12.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.964+0000 7f6af0b7e740 1 -- 172.21.15.84:0/113282881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367608390 msgr2=0x5593679e05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:12.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.964+0000 7f6af0b7e740 1 --2- 172.21.15.84:0/113282881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367608390 0x5593679e05d0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800b3d0 tx=0x7f6ad800b8c0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.965+0000 7f6af0b7e740 1 -- 172.21.15.84:0/113282881 shutdown_connections 2024-09-21T03:53:12.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.965+0000 7f6af0b7e740 1 --2- 172.21.15.84:0/113282881 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5593675e79f0 0x5593679f22c0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.965+0000 7f6af0b7e740 1 --2- 172.21.15.84:0/113282881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559367629070 0x5593679e0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.965+0000 7f6af0b7e740 1 --2- 172.21.15.84:0/113282881 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367608390 0x5593679e05d0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.965+0000 7f6af0b7e740 1 --2- 172.21.15.84:0/113282881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5593676001b0 0x5593679e0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.965+0000 7f6af0b7e740 1 -- 172.21.15.84:0/113282881 >> 172.21.15.84:0/113282881 conn(0x55936761d460 msgr2=0x5593679ccb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:12.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.965+0000 7f6ac37fe640 0 client.17493 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:53:12.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.965+0000 7f6af0b7e740 1 -- 172.21.15.84:0/113282881 shutdown_connections 2024-09-21T03:53:12.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.965+0000 7f6af0b7e740 1 -- 172.21.15.84:0/113282881 wait complete. 2024-09-21T03:53:12.978 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.965+0000 7f6af0b7e740 20 client.17493 trim_cache size 0 max 16384 2024-09-21T03:53:12.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.982+0000 7f6af0b7e740 1 Processor -- start 2024-09-21T03:53:12.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.982+0000 7f6af0b7e740 1 -- start start 2024-09-21T03:53:12.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.982+0000 7f6af0b7e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593676001b0 0x5593679ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.982+0000 7f6af0b7e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367608390 0x5593679e1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.982+0000 7f6af0b7e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559367629070 0x5593679dd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.982+0000 7f6af0b7e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae41afd30 con 0x559367608390 2024-09-21T03:53:12.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.982+0000 7f6af0b7e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae41ad600 con 0x5593676001b0 2024-09-21T03:53:12.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.982+0000 7f6af0b7e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae41ab490 con 0x559367629070 2024-09-21T03:53:12.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.983+0000 7f6ae37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367608390 0x5593679e1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.983+0000 7f6ae37fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367608390 0x5593679e1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34954/0 (socket says 172.21.15.84:34954) 2024-09-21T03:53:12.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.983+0000 7f6ae37fe640 1 -- 172.21.15.84:0/772789372 learned_addr learned my addr 172.21.15.84:0/772789372 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:12.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.983+0000 7f6ae3fff640 1 --2- 172.21.15.84:0/772789372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593676001b0 0x5593679ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.983+0000 7f6ae8ba7640 1 --2- 172.21.15.84:0/772789372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559367629070 0x5593679dd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.983+0000 7f6ae37fe640 1 -- 172.21.15.84:0/772789372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559367629070 msgr2=0x5593679dd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:12.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.983+0000 7f6ae37fe640 1 --2- 172.21.15.84:0/772789372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559367629070 0x5593679dd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.983+0000 7f6ae37fe640 1 -- 172.21.15.84:0/772789372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593676001b0 msgr2=0x5593679ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:12.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.983+0000 7f6ae37fe640 1 --2- 172.21.15.84:0/772789372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593676001b0 0x5593679ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.983+0000 7f6ae37fe640 1 -- 172.21.15.84:0/772789372 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593679deff0 con 0x559367608390 2024-09-21T03:53:12.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.983+0000 7f6ae37fe640 1 --2- 172.21.15.84:0/772789372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367608390 0x5593679e1cc0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8010f50 tx=0x7f6ad801b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd799e288130d87 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:12.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.983+0000 7f6ac9ffb640 1 -- 172.21.15.84:0/772789372 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad802a040 con 0x559367608390 2024-09-21T03:53:12.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.983+0000 7f6ac9ffb640 1 -- 172.21.15.84:0/772789372 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ad8004a50 con 0x559367608390 2024-09-21T03:53:12.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.983+0000 7f6ac9ffb640 1 -- 172.21.15.84:0/772789372 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad80046a0 con 0x559367608390 2024-09-21T03:53:12.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.984+0000 7f6af0b7e740 1 -- 172.21.15.84:0/772789372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367608390 msgr2=0x5593679e1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:12.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.984+0000 7f6af0b7e740 1 --2- 172.21.15.84:0/772789372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367608390 0x5593679e1cc0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8010f50 tx=0x7f6ad801b540 comp rx=0 tx=0).stop 2024-09-21T03:53:12.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.984+0000 7f6af0b7e740 1 -- 172.21.15.84:0/772789372 shutdown_connections 2024-09-21T03:53:12.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.984+0000 7f6af0b7e740 1 --2- 172.21.15.84:0/772789372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559367629070 0x5593679dd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.984+0000 7f6af0b7e740 1 --2- 172.21.15.84:0/772789372 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367608390 0x5593679e1cc0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.984+0000 7f6af0b7e740 1 --2- 172.21.15.84:0/772789372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593676001b0 0x5593679ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.984+0000 7f6af0b7e740 1 -- 172.21.15.84:0/772789372 >> 172.21.15.84:0/772789372 conn(0x55936761d460 msgr2=0x5593679e15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:12.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.984+0000 7f6af0b7e740 1 -- 172.21.15.84:0/772789372 shutdown_connections 2024-09-21T03:53:12.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.984+0000 7f6af0b7e740 1 -- 172.21.15.84:0/772789372 wait complete. 2024-09-21T03:53:12.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.985+0000 7f6af0b7e740 1 -- start start 2024-09-21T03:53:12.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.985+0000 7f6af0b7e740 1 Processor -- start 2024-09-21T03:53:12.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.985+0000 7f6af0b7e740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593676001b0 0x5593679f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.985+0000 7f6af0b7e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559367608390 0x5593679f2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.985+0000 7f6af0b7e740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367629070 0x5593679f3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.985+0000 7f6af0b7e740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae41abae0 con 0x559367629070 2024-09-21T03:53:12.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.985+0000 7f6af0b7e740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae41acf30 con 0x5593676001b0 2024-09-21T03:53:12.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.985+0000 7f6af0b7e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae41ac190 con 0x559367608390 2024-09-21T03:53:12.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.985+0000 7f6af0b7e740 10 client.0 _ll_register_callbacks cb 0x7f6ad4009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:53:12.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.985+0000 7f6ae8ba7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367629070 0x5593679f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.985+0000 7f6ae8ba7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367629070 0x5593679f3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34966/0 (socket says 172.21.15.84:34966) 2024-09-21T03:53:12.992 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.985+0000 7f6ae8ba7640 1 -- 172.21.15.84:0/2039953965 learned_addr learned my addr 172.21.15.84:0/2039953965 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:12.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.986+0000 7f6ae37fe640 1 --2- 172.21.15.84:0/2039953965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559367608390 0x5593679f2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.986+0000 7f6ae3fff640 1 --2- 172.21.15.84:0/2039953965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593676001b0 0x5593679f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.986+0000 7f6ae8ba7640 1 -- 172.21.15.84:0/2039953965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559367608390 msgr2=0x5593679f2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:12.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.986+0000 7f6ae8ba7640 1 --2- 172.21.15.84:0/2039953965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559367608390 0x5593679f2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.986+0000 7f6ae8ba7640 1 -- 172.21.15.84:0/2039953965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593676001b0 msgr2=0x5593679f58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:12.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.986+0000 7f6ae8ba7640 1 --2- 172.21.15.84:0/2039953965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593676001b0 0x5593679f58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.986+0000 7f6ae8ba7640 1 -- 172.21.15.84:0/2039953965 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593679f3940 con 0x559367629070 2024-09-21T03:53:12.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.986+0000 7f6ae8ba7640 1 --2- 172.21.15.84:0/2039953965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367629070 0x5593679f3380 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009270 tx=0x7f6adc0acf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b60dde0db8b99f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:12.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.986+0000 7f6ac37fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:53:12.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.986+0000 7f6ac37fe640 1 -- 172.21.15.84:0/2039953965 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc01f040 con 0x559367629070 2024-09-21T03:53:12.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.986+0000 7f6ac37fe640 1 -- 172.21.15.84:0/2039953965 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8485+0+0 (secure 0 0 0) 0x7f6adc0a8fd0 con 0x559367629070 2024-09-21T03:53:12.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.986+0000 7f6af0b7e740 1 -- 172.21.15.84:0/2039953965 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ad8004a50 con 0x559367629070 2024-09-21T03:53:12.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.986+0000 7f6ac37fe640 1 -- 172.21.15.84:0/2039953965 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6adc0b6ff0 con 0x559367629070 2024-09-21T03:53:12.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.986+0000 7f6af0b7e740 10 client.17499 fetch_fsmap learned FSMap version 25 2024-09-21T03:53:12.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.986+0000 7f6af0b7e740 1 -- 172.21.15.84:0/2039953965 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559367a5c780 con 0x559367629070 2024-09-21T03:53:12.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.987+0000 7f6ac37fe640 1 -- 172.21.15.84:0/2039953965 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ad8004a50 con 0x559367629070 2024-09-21T03:53:12.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.987+0000 7f6ac37fe640 1 -- 172.21.15.84:0/2039953965 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6adc00f040 con 0x559367629070 2024-09-21T03:53:12.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.987+0000 7f6af0b7e740 10 client.17499 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:53:12.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.987+0000 7f6af0b7e740 10 client.17499 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:53:12.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.987+0000 7f6af0b7e740 20 client.17499 populate_metadata read hostname 'smithi084' 2024-09-21T03:53:12.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.987+0000 7f6af0b7e740 1 --2- 172.21.15.84:0/2039953965 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5593675bcda0 0x559367a5eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:12.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.987+0000 7f6af0b7e740 4 client.17499 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:53:12.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.987+0000 7f6af0b7e740 1 -- 172.21.15.84:0/2039953965 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559367944850 con 0x5593675bcda0 2024-09-21T03:53:12.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.987+0000 7f6ae3fff640 1 --2- 172.21.15.84:0/2039953965 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5593675bcda0 0x559367a5eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:12.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.987+0000 7f6ac37fe640 10 client.17499 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:53:12.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.987+0000 7f6ae3fff640 1 --2- 172.21.15.84:0/2039953965 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5593675bcda0 0x559367a5eef0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f6d67a531aa18a4 server_cookie=e9b7a67009452e3f in_seq=0 out_seq=0 2024-09-21T03:53:12.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.988+0000 7f6ac37fe640 1 -- 172.21.15.84:0/2039953965 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5486 (crc 0 0 0) 0x559367944850 con 0x5593675bcda0 2024-09-21T03:53:12.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.988+0000 7f6ac37fe640 10 client.17499 handle_command_reply: tid=0 2024-09-21T03:53:12.994 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.988+0000 7f6af0b7e740 1 client.17499 shutdown 2024-09-21T03:53:12.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.988+0000 7f6af0b7e740 1 -- 172.21.15.84:0/2039953965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367629070 msgr2=0x5593679f3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:12.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.988+0000 7f6af0b7e740 1 --2- 172.21.15.84:0/2039953965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367629070 0x5593679f3380 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f6adc009270 tx=0x7f6adc0acf20 comp rx=0 tx=0).stop 2024-09-21T03:53:12.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.988+0000 7f6af0b7e740 1 -- 172.21.15.84:0/2039953965 shutdown_connections 2024-09-21T03:53:12.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.988+0000 7f6af0b7e740 1 --2- 172.21.15.84:0/2039953965 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5593675bcda0 0x559367a5eef0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.988+0000 7f6ac37fe640 0 client.17499 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:53:12.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.988+0000 7f6af0b7e740 1 --2- 172.21.15.84:0/2039953965 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x559367629070 0x5593679f3380 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.988+0000 7f6af0b7e740 1 --2- 172.21.15.84:0/2039953965 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559367608390 0x5593679f2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.988+0000 7f6af0b7e740 1 --2- 172.21.15.84:0/2039953965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593676001b0 0x5593679f58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:12.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.988+0000 7f6af0b7e740 1 -- 172.21.15.84:0/2039953965 >> 172.21.15.84:0/2039953965 conn(0x55936761d460 msgr2=0x5593679eb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:12.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.988+0000 7f6af0b7e740 1 -- 172.21.15.84:0/2039953965 shutdown_connections 2024-09-21T03:53:12.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.988+0000 7f6af0b7e740 1 -- 172.21.15.84:0/2039953965 wait complete. 2024-09-21T03:53:12.995 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.988+0000 7f6af0b7e740 20 client.17499 trim_cache size 0 max 16384 2024-09-21T03:53:12.996 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:53:12.996 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T03:53:12.996 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T03:53:12.996 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:53:12.996 INFO:teuthology.orchestra.run.smithi084.stdout: "1583169c-207f-40ad-b200-4ef92de62783": { 2024-09-21T03:53:12.996 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:52:29.382669+0000", 2024-09-21T03:53:12.996 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:12.996 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:12.996 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:12.996 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:12.996 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:12.996 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:12.996 INFO:teuthology.orchestra.run.smithi084.stdout: "d85cdf50-3fc8-467d-942f-2b77981ba106": { 2024-09-21T03:53:12.997 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:43.684286+0000", 2024-09-21T03:53:12.997 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:12.997 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:12.997 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:12.997 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:12.997 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:12.997 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:12.997 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:53:12.997 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:53:12.997 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:12.997 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:12.997 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:12.997 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:12.998 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:12.998 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:12.998 INFO:teuthology.orchestra.run.smithi084.stdout: "60214753-df43-47aa-b007-fe33bbde062a": { 2024-09-21T03:53:12.998 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:52:39.830410+0000", 2024-09-21T03:53:12.998 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:12.998 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:12.998 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:12.998 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:12.998 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:12.998 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:12.998 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:53:12.998 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:53:12.998 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:12.998 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:12.999 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:12.999 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:12.999 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:12.999 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:12.999 INFO:teuthology.orchestra.run.smithi084.stdout: "2cbf94ea-caa1-4c9b-8007-8a0887103a5c": { 2024-09-21T03:53:12.999 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:51:05.114755+0000", 2024-09-21T03:53:12.999 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:12.999 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:12.999 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:12.999 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:12.999 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:12.999 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:12.999 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:53:12.999 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:53:12.999 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:13.000 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:13.000 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:13.000 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:13.000 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:13.000 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:13.000 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:53:13.000 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:53:13.000 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:13.000 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:13.000 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:13.000 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:13.000 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:13.000 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:13.000 INFO:teuthology.orchestra.run.smithi084.stdout: "43a49cca-fc1c-4c36-a314-49033e7c3fb6": { 2024-09-21T03:53:13.001 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:49:17.366428+0000", 2024-09-21T03:53:13.001 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:13.001 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:13.001 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:13.001 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:13.001 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:13.001 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:13.001 INFO:teuthology.orchestra.run.smithi084.stdout: "0bb4e83d-6059-4d41-88f0-1562fa422c47": { 2024-09-21T03:53:13.001 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:54.511018+0000", 2024-09-21T03:53:13.001 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:13.001 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:13.001 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:13.001 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:13.001 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:13.001 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:13.002 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:53:13.002 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:53:13.002 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:13.002 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:13.002 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:13.002 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:13.002 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:13.002 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:13.002 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:53:13.002 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:53:13.002 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:13.002 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:13.002 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:13.002 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:13.003 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:13.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:13.003 INFO:teuthology.orchestra.run.smithi084.stdout: "5435e7df-7d39-4687-a715-54c7af6bc3b1": { 2024-09-21T03:53:13.003 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:51:47.429708+0000", 2024-09-21T03:53:13.003 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:13.003 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:13.003 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:13.003 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:13.003 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:13.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:13.003 INFO:teuthology.orchestra.run.smithi084.stdout: "27dcb84c-89fa-46b2-b980-58857966c697": { 2024-09-21T03:53:13.003 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:52.598527+0000", 2024-09-21T03:53:13.003 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:13.003 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:13.004 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:13.004 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:13.004 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:13.004 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:13.004 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:53:13.004 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:53:13.004 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:13.004 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:13.004 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:13.004 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:13.004 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:13.004 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:13.004 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:53:13.004 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:53:13.004 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:13.005 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:13.005 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:13.005 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:13.005 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:13.005 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:13.005 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:53:13.005 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:53:13.005 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:13.005 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:13.005 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:13.005 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:13.005 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:13.005 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:13.005 INFO:teuthology.orchestra.run.smithi084.stdout: "b2063a70-0b1f-4b6b-9c96-d886e156ea66": { 2024-09-21T03:53:13.006 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:48:34.864478+0000", 2024-09-21T03:53:13.006 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:13.006 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:13.006 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:13.006 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:13.006 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:13.006 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:13.006 INFO:teuthology.orchestra.run.smithi084.stdout: "33131451-f242-447a-b13f-9bdebc7884ec": { 2024-09-21T03:53:13.006 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:00.524357+0000", 2024-09-21T03:53:13.006 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:13.006 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:13.006 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:13.006 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:13.006 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:13.006 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:53:13.007 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:53:13.007 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:53:13.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.989+0000 7f6aea60a640 1 -- 172.21.15.84:0/1447495704 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6acc0b6700 msgr2=0x7f6acc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:13.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.989+0000 7f6aea60a640 1 --2- 172.21.15.84:0/1447495704 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6acc0b6700 0x7f6acc0b8c10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4031440 tx=0x7f6ad4009610 comp rx=0 tx=0).stop 2024-09-21T03:53:13.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.989+0000 7f6aea60a640 1 -- 172.21.15.84:0/1447495704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ae410de90 msgr2=0x7f6ae419fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:13.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.989+0000 7f6aea60a640 1 --2- 172.21.15.84:0/1447495704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ae410de90 0x7f6ae419fd20 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f6adc00eaa0 tx=0x7f6adc00ef60 comp rx=0 tx=0).stop 2024-09-21T03:53:13.007 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.989+0000 7f6aea60a640 1 -- 172.21.15.84:0/1447495704 shutdown_connections 2024-09-21T03:53:13.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.989+0000 7f6aea60a640 1 --2- 172.21.15.84:0/1447495704 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6acc0b6700 0x7f6acc0b8c10 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:13.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.989+0000 7f6aea60a640 1 --2- 172.21.15.84:0/1447495704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6ae410de90 0x7f6ae419fd20 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:13.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.989+0000 7f6aea60a640 1 --2- 172.21.15.84:0/1447495704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ae4105380 0x7f6ae419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:13.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.989+0000 7f6aea60a640 1 --2- 172.21.15.84:0/1447495704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6ae4104a30 0x7f6ae419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:13.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.989+0000 7f6aea60a640 1 -- 172.21.15.84:0/1447495704 >> 172.21.15.84:0/1447495704 conn(0x7f6ae4079770 msgr2=0x7f6ae4100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:13.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.989+0000 7f6aea60a640 1 -- 172.21.15.84:0/1447495704 shutdown_connections 2024-09-21T03:53:13.008 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:12.989+0000 7f6aea60a640 1 -- 172.21.15.84:0/1447495704 wait complete. 2024-09-21T03:53:13.874 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:13 smithi084 ceph-mon[30941]: pgmap v655: 97 pgs: 97 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 87 KiB/s wr, 28 op/s 2024-09-21T03:53:13.902 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:53:13.903 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:53:14.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:13 smithi174 ceph-mon[34403]: pgmap v655: 97 pgs: 97 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 87 KiB/s wr, 28 op/s 2024-09-21T03:53:14.148 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:14.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:13 smithi172 ceph-mon[34821]: pgmap v655: 97 pgs: 97 active+clean; 22 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 87 KiB/s wr, 28 op/s 2024-09-21T03:53:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.674+0000 7fb6259d2640 1 -- 172.21.15.84:0/2416211134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb620108d10 msgr2=0x7fb62010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.674+0000 7fb6259d2640 1 --2- 172.21.15.84:0/2416211134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb620108d10 0x7fb62010f540 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fb618009900 tx=0x7fb61802a410 comp rx=0 tx=0).stop 2024-09-21T03:53:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.674+0000 7fb6259d2640 1 -- 172.21.15.84:0/2416211134 shutdown_connections 2024-09-21T03:53:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.674+0000 7fb6259d2640 1 --2- 172.21.15.84:0/2416211134 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb620108d10 0x7fb62010f540 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.674+0000 7fb6259d2640 1 --2- 172.21.15.84:0/2416211134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6201083c0 0x7fb6201087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.674+0000 7fb6259d2640 1 --2- 172.21.15.84:0/2416211134 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb620102a80 0x7fb620102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.674+0000 7fb6259d2640 1 -- 172.21.15.84:0/2416211134 >> 172.21.15.84:0/2416211134 conn(0x7fb620079740 msgr2=0x7fb620079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.674+0000 7fb6259d2640 1 -- 172.21.15.84:0/2416211134 shutdown_connections 2024-09-21T03:53:14.686 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.674+0000 7fb6259d2640 1 -- 172.21.15.84:0/2416211134 wait complete. 2024-09-21T03:53:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.675+0000 7fb6259d2640 1 Processor -- start 2024-09-21T03:53:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.675+0000 7fb6259d2640 1 -- start start 2024-09-21T03:53:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.676+0000 7fb6259d2640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb620102a80 0x7fb62019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.676+0000 7fb6259d2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6201083c0 0x7fb62019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.676+0000 7fb6259d2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb620108d10 0x7fb62019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.676+0000 7fb6259d2640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb620112980 con 0x7fb6201083c0 2024-09-21T03:53:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.676+0000 7fb6259d2640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb620112800 con 0x7fb620102a80 2024-09-21T03:53:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.676+0000 7fb6259d2640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb620112b00 con 0x7fb620108d10 2024-09-21T03:53:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.676+0000 7fb6167fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6201083c0 0x7fb62019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.676+0000 7fb6167fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6201083c0 0x7fb62019a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:34990/0 (socket says 172.21.15.84:34990) 2024-09-21T03:53:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.676+0000 7fb6167fc640 1 -- 172.21.15.84:0/1806556418 learned_addr learned my addr 172.21.15.84:0/1806556418 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.676+0000 7fb61effd640 1 --2- 172.21.15.84:0/1806556418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb620102a80 0x7fb62019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:14.687 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.676+0000 7fb61f7fe640 1 --2- 172.21.15.84:0/1806556418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb620108d10 0x7fb62019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.676+0000 7fb6167fc640 1 -- 172.21.15.84:0/1806556418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb620108d10 msgr2=0x7fb62019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.676+0000 7fb6167fc640 1 --2- 172.21.15.84:0/1806556418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb620108d10 0x7fb62019fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.676+0000 7fb6167fc640 1 -- 172.21.15.84:0/1806556418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb620102a80 msgr2=0x7fb62019a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.676+0000 7fb6167fc640 1 --2- 172.21.15.84:0/1806556418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb620102a80 0x7fb62019a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.676+0000 7fb6167fc640 1 -- 172.21.15.84:0/1806556418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6201a0370 con 0x7fb6201083c0 2024-09-21T03:53:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.676+0000 7fb6167fc640 1 --2- 172.21.15.84:0/1806556418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6201083c0 0x7fb62019a9a0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fb60800e9c0 tx=0x7fb60800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.677+0000 7fb6249d0640 1 -- 172.21.15.84:0/1806556418 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60800cd80 con 0x7fb6201083c0 2024-09-21T03:53:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.677+0000 7fb6259d2640 1 -- 172.21.15.84:0/1806556418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6201a0660 con 0x7fb6201083c0 2024-09-21T03:53:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.677+0000 7fb6249d0640 1 -- 172.21.15.84:0/1806556418 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6080054d0 con 0x7fb6201083c0 2024-09-21T03:53:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.677+0000 7fb6249d0640 1 -- 172.21.15.84:0/1806556418 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb608010430 con 0x7fb6201083c0 2024-09-21T03:53:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.677+0000 7fb6259d2640 1 -- 172.21.15.84:0/1806556418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6201a6dc0 con 0x7fb6201083c0 2024-09-21T03:53:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.678+0000 7fb6259d2640 1 -- 172.21.15.84:0/1806556418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb620102e90 con 0x7fb6201083c0 2024-09-21T03:53:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.679+0000 7fb6249d0640 1 -- 172.21.15.84:0/1806556418 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fb608004fb0 con 0x7fb6201083c0 2024-09-21T03:53:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.680+0000 7fb6249d0640 1 --2- 172.21.15.84:0/1806556418 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb60c0b6680 0x7fb60c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:14.688 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.680+0000 7fb61effd640 1 --2- 172.21.15.84:0/1806556418 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb60c0b6680 0x7fb60c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:14.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.680+0000 7fb6249d0640 1 -- 172.21.15.84:0/1806556418 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8485+0+0 (secure 0 0 0) 0x7fb6080e7eb0 con 0x7fb6201083c0 2024-09-21T03:53:14.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.681+0000 7fb61effd640 1 --2- 172.21.15.84:0/1806556418 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb60c0b6680 0x7fb60c0b8b90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb610005fd0 tx=0x7fb610009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:14.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.684+0000 7fb6249d0640 1 -- 172.21.15.84:0/1806556418 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb608056710 con 0x7fb6201083c0 2024-09-21T03:53:14.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.899+0000 7fb6259d2640 1 -- 172.21.15.84:0/1806556418 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb62019b530 con 0x7fb6201083c0 2024-09-21T03:53:14.902 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.899+0000 7fb6249d0640 1 -- 172.21.15.84:0/1806556418 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7fb62019b530 con 0x7fb6201083c0 2024-09-21T03:53:14.903 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:53:14.903 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:53:14.903 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:53:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.901+0000 7fb6259d2640 1 -- 172.21.15.84:0/1806556418 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb60c0b6680 msgr2=0x7fb60c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.901+0000 7fb6259d2640 1 --2- 172.21.15.84:0/1806556418 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb60c0b6680 0x7fb60c0b8b90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb610005fd0 tx=0x7fb610009500 comp rx=0 tx=0).stop 2024-09-21T03:53:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.901+0000 7fb6259d2640 1 -- 172.21.15.84:0/1806556418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6201083c0 msgr2=0x7fb62019a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.901+0000 7fb6259d2640 1 --2- 172.21.15.84:0/1806556418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6201083c0 0x7fb62019a9a0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fb60800e9c0 tx=0x7fb60800ee80 comp rx=0 tx=0).stop 2024-09-21T03:53:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.902+0000 7fb6259d2640 1 -- 172.21.15.84:0/1806556418 shutdown_connections 2024-09-21T03:53:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.902+0000 7fb6259d2640 1 --2- 172.21.15.84:0/1806556418 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb60c0b6680 0x7fb60c0b8b90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.902+0000 7fb6259d2640 1 --2- 172.21.15.84:0/1806556418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb620108d10 0x7fb62019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.902+0000 7fb6259d2640 1 --2- 172.21.15.84:0/1806556418 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb6201083c0 0x7fb62019a9a0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.902+0000 7fb6259d2640 1 --2- 172.21.15.84:0/1806556418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb620102a80 0x7fb62019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.902+0000 7fb6259d2640 1 -- 172.21.15.84:0/1806556418 >> 172.21.15.84:0/1806556418 conn(0x7fb620079740 msgr2=0x7fb62006bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:14.905 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.902+0000 7fb6259d2640 1 -- 172.21.15.84:0/1806556418 shutdown_connections 2024-09-21T03:53:14.906 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:14.902+0000 7fb6259d2640 1 -- 172.21.15.84:0/1806556418 wait complete. 2024-09-21T03:53:15.595 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:53:15.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:15 smithi084 ceph-mon[30941]: pgmap v656: 97 pgs: 97 active+clean; 23 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 11 op/s 2024-09-21T03:53:15.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:15 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1806556418' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:53:15.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:15 smithi084 ceph-mon[30941]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T03:53:15.839 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:16.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:15 smithi174 ceph-mon[34403]: pgmap v656: 97 pgs: 97 active+clean; 23 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 11 op/s 2024-09-21T03:53:16.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:15 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1806556418' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:53:16.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:15 smithi174 ceph-mon[34403]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T03:53:16.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:15 smithi172 ceph-mon[34821]: pgmap v656: 97 pgs: 97 active+clean; 23 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 11 op/s 2024-09-21T03:53:16.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:15 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1806556418' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:53:16.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:15 smithi172 ceph-mon[34821]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T03:53:16.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.351+0000 7ff45de97640 1 -- 172.21.15.84:0/4073816406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff458109df0 msgr2=0x7ff458110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:16.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.351+0000 7ff45de97640 1 --2- 172.21.15.84:0/4073816406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff458109df0 0x7ff458110620 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7ff450009ca0 tx=0x7ff45002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.351+0000 7ff45de97640 1 -- 172.21.15.84:0/4073816406 shutdown_connections 2024-09-21T03:53:16.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.351+0000 7ff45de97640 1 --2- 172.21.15.84:0/4073816406 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff458109df0 0x7ff458110620 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.351+0000 7ff45de97640 1 --2- 172.21.15.84:0/4073816406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4581094a0 0x7ff4581098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.351+0000 7ff45de97640 1 --2- 172.21.15.84:0/4073816406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff458103b60 0x7ff458103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.351+0000 7ff45de97640 1 -- 172.21.15.84:0/4073816406 >> 172.21.15.84:0/4073816406 conn(0x7ff45807b850 msgr2=0x7ff45807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:16.369 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.351+0000 7ff45de97640 1 -- 172.21.15.84:0/4073816406 shutdown_connections 2024-09-21T03:53:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.351+0000 7ff45de97640 1 -- 172.21.15.84:0/4073816406 wait complete. 2024-09-21T03:53:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.352+0000 7ff45de97640 1 Processor -- start 2024-09-21T03:53:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.352+0000 7ff45de97640 1 -- start start 2024-09-21T03:53:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.352+0000 7ff45de97640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff458103b60 0x7ff45819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.352+0000 7ff45de97640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4581094a0 0x7ff45819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.352+0000 7ff45de97640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff458109df0 0x7ff45819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.352+0000 7ff45de97640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff458113b00 con 0x7ff458109df0 2024-09-21T03:53:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.352+0000 7ff45de97640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff458113980 con 0x7ff458103b60 2024-09-21T03:53:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.352+0000 7ff45de97640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff458113c80 con 0x7ff4581094a0 2024-09-21T03:53:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.352+0000 7ff457fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff458109df0 0x7ff45819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.352+0000 7ff457fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff458109df0 0x7ff45819fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35016/0 (socket says 172.21.15.84:35016) 2024-09-21T03:53:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.352+0000 7ff457fff640 1 -- 172.21.15.84:0/1519095043 learned_addr learned my addr 172.21.15.84:0/1519095043 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:16.370 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.352+0000 7ff44ffff640 1 --2- 172.21.15.84:0/1519095043 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4581094a0 0x7ff45819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.353+0000 7ff4577fe640 1 --2- 172.21.15.84:0/1519095043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff458103b60 0x7ff45819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.353+0000 7ff457fff640 1 -- 172.21.15.84:0/1519095043 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4581094a0 msgr2=0x7ff45819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.353+0000 7ff457fff640 1 --2- 172.21.15.84:0/1519095043 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4581094a0 0x7ff45819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.353+0000 7ff457fff640 1 -- 172.21.15.84:0/1519095043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff458103b60 msgr2=0x7ff45819a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.353+0000 7ff457fff640 1 --2- 172.21.15.84:0/1519095043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff458103b60 0x7ff45819a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.353+0000 7ff457fff640 1 -- 172.21.15.84:0/1519095043 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4581a02e0 con 0x7ff458109df0 2024-09-21T03:53:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.353+0000 7ff4577fe640 1 --2- 172.21.15.84:0/1519095043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff458103b60 0x7ff45819a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.353+0000 7ff457fff640 1 --2- 172.21.15.84:0/1519095043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff458109df0 0x7ff45819fc70 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7ff450009430 tx=0x7ff4500319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.353+0000 7ff4557fa640 1 -- 172.21.15.84:0/1519095043 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff450003c30 con 0x7ff458109df0 2024-09-21T03:53:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.353+0000 7ff45de97640 1 -- 172.21.15.84:0/1519095043 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4581a0570 con 0x7ff458109df0 2024-09-21T03:53:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.353+0000 7ff4557fa640 1 -- 172.21.15.84:0/1519095043 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff450003dd0 con 0x7ff458109df0 2024-09-21T03:53:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.353+0000 7ff4557fa640 1 -- 172.21.15.84:0/1519095043 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45002faa0 con 0x7ff458109df0 2024-09-21T03:53:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.353+0000 7ff45de97640 1 -- 172.21.15.84:0/1519095043 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4581a0ab0 con 0x7ff458109df0 2024-09-21T03:53:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.356+0000 7ff46440b740 1 Processor -- start 2024-09-21T03:53:16.371 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.356+0000 7ff4557fa640 1 -- 172.21.15.84:0/1519095043 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7ff45002fc60 con 0x7ff458109df0 2024-09-21T03:53:16.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.356+0000 7ff46440b740 1 -- start start 2024-09-21T03:53:16.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.356+0000 7ff46440b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa52a070 0x55d1fa8d16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.356+0000 7ff46440b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa5011b0 0x55d1fa8d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.356+0000 7ff46440b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d1fa509390 0x55d1fa8d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.356+0000 7ff46440b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d1fa847ea0 con 0x55d1fa52a070 2024-09-21T03:53:16.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.356+0000 7ff46440b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d1fa8372d0 con 0x55d1fa509390 2024-09-21T03:53:16.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.356+0000 7ff46440b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d1fa83b0e0 con 0x55d1fa5011b0 2024-09-21T03:53:16.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.356+0000 7ff44ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa52a070 0x55d1fa8d16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.356+0000 7ff44ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa52a070 0x55d1fa8d16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35028/0 (socket says 172.21.15.84:35028) 2024-09-21T03:53:16.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.356+0000 7ff44ffff640 1 -- 172.21.15.84:0/3985059455 learned_addr learned my addr 172.21.15.84:0/3985059455 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:16.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.356+0000 7ff4577fe640 1 --2- 172.21.15.84:0/3985059455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa5011b0 0x55d1fa8d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.356+0000 7ff44ffff640 1 -- 172.21.15.84:0/3985059455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa5011b0 msgr2=0x55d1fa8d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:16.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.356+0000 7ff44ffff640 1 --2- 172.21.15.84:0/3985059455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa5011b0 0x55d1fa8d1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.372 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.356+0000 7ff44ffff640 1 -- 172.21.15.84:0/3985059455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d1fa509390 msgr2=0x55d1fa8d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:16.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.356+0000 7ff44ffff640 1 --2- 172.21.15.84:0/3985059455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d1fa509390 0x55d1fa8d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.356+0000 7ff44ffff640 1 -- 172.21.15.84:0/3985059455 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1fa595650 con 0x55d1fa52a070 2024-09-21T03:53:16.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.356+0000 7ff4557fa640 1 --2- 172.21.15.84:0/1519095043 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff4440b66b0 0x7ff4440b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.357+0000 7ff44ffff640 1 --2- 172.21.15.84:0/3985059455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa52a070 0x55d1fa8d16a0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7ff44000bcd0 tx=0x7ff4400127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b43e49a5f9be440 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:16.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.357+0000 7ff4577fe640 1 --2- 172.21.15.84:0/1519095043 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff4440b66b0 0x7ff4440b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.357+0000 7ff4557fa640 1 -- 172.21.15.84:0/1519095043 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7ff450108ac0 con 0x7ff458109df0 2024-09-21T03:53:16.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.357+0000 7ff44dffb640 1 -- 172.21.15.84:0/3985059455 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4400120d0 con 0x55d1fa52a070 2024-09-21T03:53:16.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.357+0000 7ff44dffb640 1 -- 172.21.15.84:0/3985059455 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff440016070 con 0x55d1fa52a070 2024-09-21T03:53:16.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.357+0000 7ff44dffb640 1 -- 172.21.15.84:0/3985059455 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff440004a00 con 0x55d1fa52a070 2024-09-21T03:53:16.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.358+0000 7ff46440b740 1 -- 172.21.15.84:0/3985059455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa52a070 msgr2=0x55d1fa8d16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:16.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.358+0000 7ff4577fe640 1 --2- 172.21.15.84:0/1519095043 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff4440b66b0 0x7ff4440b8bc0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff448005fd0 tx=0x7ff448005f40 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:16.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.358+0000 7ff46440b740 1 --2- 172.21.15.84:0/3985059455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa52a070 0x55d1fa8d16a0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7ff44000bcd0 tx=0x7ff4400127c0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.358+0000 7ff46440b740 1 -- 172.21.15.84:0/3985059455 shutdown_connections 2024-09-21T03:53:16.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.358+0000 7ff46440b740 1 --2- 172.21.15.84:0/3985059455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d1fa509390 0x55d1fa8d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.373 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.358+0000 7ff46440b740 1 --2- 172.21.15.84:0/3985059455 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa5011b0 0x55d1fa8d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.358+0000 7ff46440b740 1 --2- 172.21.15.84:0/3985059455 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa52a070 0x55d1fa8d16a0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.358+0000 7ff46440b740 1 -- 172.21.15.84:0/3985059455 >> 172.21.15.84:0/3985059455 conn(0x55d1fa51e460 msgr2=0x55d1fa8cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:16.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.358+0000 7ff46440b740 1 -- 172.21.15.84:0/3985059455 shutdown_connections 2024-09-21T03:53:16.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.358+0000 7ff46440b740 1 -- 172.21.15.84:0/3985059455 wait complete. 2024-09-21T03:53:16.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.358+0000 7ff46440b740 1 -- start start 2024-09-21T03:53:16.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.358+0000 7ff46440b740 1 Processor -- start 2024-09-21T03:53:16.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.359+0000 7ff46440b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 0x55d1fa8dcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.359+0000 7ff46440b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d1fa509390 0x55d1fa8dd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.359+0000 7ff46440b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa52a070 0x55d1fa8e9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.359+0000 7ff46440b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55d1fa698700 con 0x55d1fa5011b0 2024-09-21T03:53:16.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.359+0000 7ff46440b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d1fa7d2160 con 0x55d1fa509390 2024-09-21T03:53:16.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.359+0000 7ff46440b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55d1fa8dfe80 con 0x55d1fa52a070 2024-09-21T03:53:16.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.359+0000 7ff46440b740 10 client.0 _ll_register_callbacks cb 0x55d1fa7eb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:53:16.374 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.359+0000 7ff4577fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 0x55d1fa8dcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.359+0000 7ff4577fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 0x55d1fa8dcd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35036/0 (socket says 172.21.15.84:35036) 2024-09-21T03:53:16.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.359+0000 7ff4577fe640 1 -- 172.21.15.84:0/2517712538 learned_addr learned my addr 172.21.15.84:0/2517712538 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:16.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.359+0000 7ff44ffff640 1 --2- 172.21.15.84:0/2517712538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d1fa509390 0x55d1fa8dd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.359+0000 7ff457fff640 1 --2- 172.21.15.84:0/2517712538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa52a070 0x55d1fa8e9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.359+0000 7ff4577fe640 1 -- 172.21.15.84:0/2517712538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa52a070 msgr2=0x55d1fa8e9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:16.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.359+0000 7ff4577fe640 1 --2- 172.21.15.84:0/2517712538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa52a070 0x55d1fa8e9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.359+0000 7ff4577fe640 1 -- 172.21.15.84:0/2517712538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d1fa509390 msgr2=0x55d1fa8dd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:16.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.359+0000 7ff4577fe640 1 --2- 172.21.15.84:0/2517712538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d1fa509390 0x55d1fa8dd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.359+0000 7ff4577fe640 1 -- 172.21.15.84:0/2517712538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1fa7ffc90 con 0x55d1fa5011b0 2024-09-21T03:53:16.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.359+0000 7ff4577fe640 1 --2- 172.21.15.84:0/2517712538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 0x55d1fa8dcd50 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7ff448011e40 tx=0x7ff4480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4bcf34e4f46e22 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:16.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.359+0000 7ff436ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:53:16.375 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.359+0000 7ff436ffd640 1 -- 172.21.15.84:0/2517712538 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44801e620 con 0x55d1fa5011b0 2024-09-21T03:53:16.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.360+0000 7ff436ffd640 1 -- 172.21.15.84:0/2517712538 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7ff44801e7c0 con 0x55d1fa5011b0 2024-09-21T03:53:16.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.360+0000 7ff46440b740 1 -- 172.21.15.84:0/2517712538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff440016070 con 0x55d1fa5011b0 2024-09-21T03:53:16.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.360+0000 7ff436ffd640 1 -- 172.21.15.84:0/2517712538 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff44801ea00 con 0x55d1fa5011b0 2024-09-21T03:53:16.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.360+0000 7ff46440b740 10 client.17517 fetch_fsmap learned FSMap version 25 2024-09-21T03:53:16.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.360+0000 7ff46440b740 1 -- 172.21.15.84:0/2517712538 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d1fa8ebbf0 con 0x55d1fa5011b0 2024-09-21T03:53:16.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.360+0000 7ff436ffd640 1 -- 172.21.15.84:0/2517712538 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff440016070 con 0x55d1fa5011b0 2024-09-21T03:53:16.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.360+0000 7ff436ffd640 1 -- 172.21.15.84:0/2517712538 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff448030ae0 con 0x55d1fa5011b0 2024-09-21T03:53:16.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.360+0000 7ff46440b740 10 client.17517 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:53:16.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.360+0000 7ff46440b740 10 client.17517 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:53:16.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.360+0000 7ff46440b740 20 client.17517 populate_metadata read hostname 'smithi084' 2024-09-21T03:53:16.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.360+0000 7ff46440b740 1 --2- 172.21.15.84:0/2517712538 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55d1fa4e89f0 0x55d1fa8ef0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.360+0000 7ff46440b740 4 client.17517 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:53:16.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.360+0000 7ff46440b740 1 -- 172.21.15.84:0/2517712538 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1fa849df0 con 0x55d1fa4e89f0 2024-09-21T03:53:16.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.361+0000 7ff44ffff640 1 --2- 172.21.15.84:0/2517712538 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55d1fa4e89f0 0x55d1fa8ef0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.361+0000 7ff436ffd640 10 client.17517 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:53:16.376 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.361+0000 7ff44ffff640 1 --2- 172.21.15.84:0/2517712538 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55d1fa4e89f0 0x55d1fa8ef0a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=48560af6707c9f8d server_cookie=3f326e8f1328281b in_seq=0 out_seq=0 2024-09-21T03:53:16.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.362+0000 7ff436ffd640 1 -- 172.21.15.84:0/2517712538 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d1fa849df0 con 0x55d1fa4e89f0 2024-09-21T03:53:16.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.362+0000 7ff436ffd640 10 client.17517 handle_command_reply: tid=0 2024-09-21T03:53:16.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.362+0000 7ff46440b740 1 client.17517 shutdown 2024-09-21T03:53:16.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.362+0000 7ff46440b740 1 -- 172.21.15.84:0/2517712538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 msgr2=0x55d1fa8dcd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:16.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.362+0000 7ff46440b740 1 --2- 172.21.15.84:0/2517712538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 0x55d1fa8dcd50 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7ff448011e40 tx=0x7ff4480046c0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.362+0000 7ff46440b740 1 -- 172.21.15.84:0/2517712538 shutdown_connections 2024-09-21T03:53:16.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.362+0000 7ff46440b740 1 --2- 172.21.15.84:0/2517712538 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55d1fa4e89f0 0x55d1fa8ef0a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.362+0000 7ff46440b740 1 --2- 172.21.15.84:0/2517712538 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa52a070 0x55d1fa8e9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.362+0000 7ff46440b740 1 --2- 172.21.15.84:0/2517712538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d1fa509390 0x55d1fa8dd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.362+0000 7ff436ffd640 0 client.17517 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:53:16.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.362+0000 7ff46440b740 1 --2- 172.21.15.84:0/2517712538 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 0x55d1fa8dcd50 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.362+0000 7ff46440b740 1 -- 172.21.15.84:0/2517712538 >> 172.21.15.84:0/2517712538 conn(0x55d1fa51e460 msgr2=0x55d1fa8d4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:16.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.362+0000 7ff46440b740 1 -- 172.21.15.84:0/2517712538 shutdown_connections 2024-09-21T03:53:16.377 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.362+0000 7ff46440b740 1 -- 172.21.15.84:0/2517712538 wait complete. 2024-09-21T03:53:16.378 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.362+0000 7ff46440b740 20 client.17517 trim_cache size 0 max 16384 2024-09-21T03:53:16.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.375+0000 7ff46440b740 1 Processor -- start 2024-09-21T03:53:16.379 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.375+0000 7ff46440b740 1 -- start start 2024-09-21T03:53:16.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.376+0000 7ff46440b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 0x55d1fa8de980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.376+0000 7ff46440b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d1fa509390 0x55d1fa8cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.376+0000 7ff46440b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa52a070 0x55d1fa8cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.376+0000 7ff46440b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff4581b1de0 con 0x55d1fa5011b0 2024-09-21T03:53:16.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.376+0000 7ff46440b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff4581af6b0 con 0x55d1fa509390 2024-09-21T03:53:16.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.376+0000 7ff46440b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff4581ad520 con 0x55d1fa52a070 2024-09-21T03:53:16.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.376+0000 7ff4577fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 0x55d1fa8de980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.376+0000 7ff4577fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 0x55d1fa8de980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35044/0 (socket says 172.21.15.84:35044) 2024-09-21T03:53:16.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.376+0000 7ff4577fe640 1 -- 172.21.15.84:0/1868180668 learned_addr learned my addr 172.21.15.84:0/1868180668 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:16.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.376+0000 7ff457fff640 1 --2- 172.21.15.84:0/1868180668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa52a070 0x55d1fa8cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.376+0000 7ff44ffff640 1 --2- 172.21.15.84:0/1868180668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d1fa509390 0x55d1fa8cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.380 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.376+0000 7ff4577fe640 1 -- 172.21.15.84:0/1868180668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa52a070 msgr2=0x55d1fa8cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:16.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.376+0000 7ff4577fe640 1 --2- 172.21.15.84:0/1868180668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa52a070 0x55d1fa8cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.376+0000 7ff4577fe640 1 -- 172.21.15.84:0/1868180668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d1fa509390 msgr2=0x55d1fa8cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:16.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.376+0000 7ff4577fe640 1 --2- 172.21.15.84:0/1868180668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d1fa509390 0x55d1fa8cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.376+0000 7ff4577fe640 1 -- 172.21.15.84:0/1868180668 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1fa8d4500 con 0x55d1fa5011b0 2024-09-21T03:53:16.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.376+0000 7ff4577fe640 1 --2- 172.21.15.84:0/1868180668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 0x55d1fa8de980 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7ff44800c5a0 tx=0x7ff448005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbd9c0335a7812 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:16.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.376+0000 7ff44d7fa640 1 -- 172.21.15.84:0/1868180668 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448036040 con 0x55d1fa5011b0 2024-09-21T03:53:16.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.376+0000 7ff44d7fa640 1 -- 172.21.15.84:0/1868180668 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff44801eda0 con 0x55d1fa5011b0 2024-09-21T03:53:16.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.376+0000 7ff44d7fa640 1 -- 172.21.15.84:0/1868180668 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448004430 con 0x55d1fa5011b0 2024-09-21T03:53:16.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.377+0000 7ff46440b740 1 -- 172.21.15.84:0/1868180668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 msgr2=0x55d1fa8de980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:16.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.377+0000 7ff46440b740 1 --2- 172.21.15.84:0/1868180668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 0x55d1fa8de980 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7ff44800c5a0 tx=0x7ff448005780 comp rx=0 tx=0).stop 2024-09-21T03:53:16.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.377+0000 7ff46440b740 1 -- 172.21.15.84:0/1868180668 shutdown_connections 2024-09-21T03:53:16.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.377+0000 7ff46440b740 1 --2- 172.21.15.84:0/1868180668 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa52a070 0x55d1fa8cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.377+0000 7ff46440b740 1 --2- 172.21.15.84:0/1868180668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d1fa509390 0x55d1fa8cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.377+0000 7ff46440b740 1 --2- 172.21.15.84:0/1868180668 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 0x55d1fa8de980 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.381 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.377+0000 7ff46440b740 1 -- 172.21.15.84:0/1868180668 >> 172.21.15.84:0/1868180668 conn(0x55d1fa51e460 msgr2=0x55d1fa8de270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:16.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.377+0000 7ff46440b740 1 -- 172.21.15.84:0/1868180668 shutdown_connections 2024-09-21T03:53:16.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.377+0000 7ff46440b740 1 -- 172.21.15.84:0/1868180668 wait complete. 2024-09-21T03:53:16.382 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.378+0000 7ff46440b740 1 -- start start 2024-09-21T03:53:16.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.378+0000 7ff46440b740 1 Processor -- start 2024-09-21T03:53:16.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.378+0000 7ff46440b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 0x55d1fa8e59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.378+0000 7ff46440b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d1fa509390 0x55d1fa8e0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.378+0000 7ff46440b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa52a070 0x55d1fa8e1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.378+0000 7ff46440b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7ff4581adb70 con 0x55d1fa5011b0 2024-09-21T03:53:16.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.378+0000 7ff46440b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff4581aefe0 con 0x55d1fa509390 2024-09-21T03:53:16.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.378+0000 7ff46440b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7ff4581ae240 con 0x55d1fa52a070 2024-09-21T03:53:16.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.378+0000 7ff46440b740 10 client.0 _ll_register_callbacks cb 0x7ff44800c450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:53:16.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.378+0000 7ff4577fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 0x55d1fa8e59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.378+0000 7ff4577fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 0x55d1fa8e59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35058/0 (socket says 172.21.15.84:35058) 2024-09-21T03:53:16.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.378+0000 7ff4577fe640 1 -- 172.21.15.84:0/490898807 learned_addr learned my addr 172.21.15.84:0/490898807 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:16.385 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.378+0000 7ff44ffff640 1 --2- 172.21.15.84:0/490898807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d1fa509390 0x55d1fa8e0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.379+0000 7ff457fff640 1 --2- 172.21.15.84:0/490898807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa52a070 0x55d1fa8e1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.379+0000 7ff4577fe640 1 -- 172.21.15.84:0/490898807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa52a070 msgr2=0x55d1fa8e1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:16.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.379+0000 7ff4577fe640 1 --2- 172.21.15.84:0/490898807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa52a070 0x55d1fa8e1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.379+0000 7ff4577fe640 1 -- 172.21.15.84:0/490898807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d1fa509390 msgr2=0x55d1fa8e0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:16.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.379+0000 7ff4577fe640 1 --2- 172.21.15.84:0/490898807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d1fa509390 0x55d1fa8e0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.379+0000 7ff4577fe640 1 -- 172.21.15.84:0/490898807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1fa8e1d00 con 0x55d1fa5011b0 2024-09-21T03:53:16.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.379+0000 7ff457fff640 1 --2- 172.21.15.84:0/490898807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa52a070 0x55d1fa8e1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:53:16.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.379+0000 7ff4577fe640 1 --2- 172.21.15.84:0/490898807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 0x55d1fa8e59f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7ff448005dd0 tx=0x7ff44800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45ddcda8b285c73 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:16.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.379+0000 7ff436ffd640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:53:16.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.379+0000 7ff436ffd640 1 -- 172.21.15.84:0/490898807 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448048060 con 0x55d1fa5011b0 2024-09-21T03:53:16.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.379+0000 7ff436ffd640 1 -- 172.21.15.84:0/490898807 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7ff448005190 con 0x55d1fa5011b0 2024-09-21T03:53:16.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.379+0000 7ff46440b740 1 -- 172.21.15.84:0/490898807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff44801eda0 con 0x55d1fa5011b0 2024-09-21T03:53:16.386 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.379+0000 7ff436ffd640 1 -- 172.21.15.84:0/490898807 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff448036040 con 0x55d1fa5011b0 2024-09-21T03:53:16.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.379+0000 7ff46440b740 10 client.17523 fetch_fsmap learned FSMap version 25 2024-09-21T03:53:16.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.379+0000 7ff46440b740 1 -- 172.21.15.84:0/490898807 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d1fa959b20 con 0x55d1fa5011b0 2024-09-21T03:53:16.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.380+0000 7ff436ffd640 1 -- 172.21.15.84:0/490898807 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff44801eda0 con 0x55d1fa5011b0 2024-09-21T03:53:16.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.380+0000 7ff436ffd640 1 -- 172.21.15.84:0/490898807 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff448030510 con 0x55d1fa5011b0 2024-09-21T03:53:16.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.380+0000 7ff46440b740 10 client.17523 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:53:16.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.380+0000 7ff46440b740 10 client.17523 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:53:16.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.380+0000 7ff46440b740 20 client.17523 populate_metadata read hostname 'smithi084' 2024-09-21T03:53:16.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.380+0000 7ff46440b740 1 --2- 172.21.15.84:0/490898807 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55d1fa4bdda0 0x55d1fa95c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:16.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.380+0000 7ff46440b740 4 client.17523 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:53:16.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.380+0000 7ff46440b740 1 -- 172.21.15.84:0/490898807 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d1fa8458a0 con 0x55d1fa4bdda0 2024-09-21T03:53:16.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.380+0000 7ff44ffff640 1 --2- 172.21.15.84:0/490898807 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55d1fa4bdda0 0x55d1fa95c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:16.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.380+0000 7ff44ffff640 1 --2- 172.21.15.84:0/490898807 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55d1fa4bdda0 0x55d1fa95c1a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=48275e01007cffe6 server_cookie=dd14d0d30ee40ae7 in_seq=0 out_seq=0 2024-09-21T03:53:16.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.380+0000 7ff436ffd640 10 client.17523 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:53:16.387 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.381+0000 7ff436ffd640 1 -- 172.21.15.84:0/490898807 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d1fa8458a0 con 0x55d1fa4bdda0 2024-09-21T03:53:16.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.381+0000 7ff436ffd640 10 client.17523 handle_command_reply: tid=0 2024-09-21T03:53:16.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.381+0000 7ff46440b740 1 client.17523 shutdown 2024-09-21T03:53:16.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.381+0000 7ff46440b740 1 -- 172.21.15.84:0/490898807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 msgr2=0x55d1fa8e59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:16.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.381+0000 7ff46440b740 1 --2- 172.21.15.84:0/490898807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 0x55d1fa8e59f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7ff448005dd0 tx=0x7ff44800c980 comp rx=0 tx=0).stop 2024-09-21T03:53:16.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.381+0000 7ff46440b740 1 -- 172.21.15.84:0/490898807 shutdown_connections 2024-09-21T03:53:16.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.381+0000 7ff46440b740 1 --2- 172.21.15.84:0/490898807 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x55d1fa4bdda0 0x55d1fa95c1a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.381+0000 7ff46440b740 1 --2- 172.21.15.84:0/490898807 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d1fa52a070 0x55d1fa8e1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.381+0000 7ff46440b740 1 --2- 172.21.15.84:0/490898807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d1fa509390 0x55d1fa8e0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.381+0000 7ff436ffd640 0 client.17523 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:53:16.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.381+0000 7ff46440b740 1 --2- 172.21.15.84:0/490898807 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55d1fa5011b0 0x55d1fa8e59f0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.381+0000 7ff46440b740 1 -- 172.21.15.84:0/490898807 >> 172.21.15.84:0/490898807 conn(0x55d1fa51e460 msgr2=0x55d1fa8de010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:16.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.381+0000 7ff46440b740 1 -- 172.21.15.84:0/490898807 shutdown_connections 2024-09-21T03:53:16.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.381+0000 7ff46440b740 1 -- 172.21.15.84:0/490898807 wait complete. 2024-09-21T03:53:16.388 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.381+0000 7ff46440b740 20 client.17523 trim_cache size 0 max 16384 2024-09-21T03:53:16.389 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:53:16.389 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.382+0000 7ff45de97640 1 -- 172.21.15.84:0/1519095043 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff4440b66b0 msgr2=0x7ff4440b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:16.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.382+0000 7ff45de97640 1 --2- 172.21.15.84:0/1519095043 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff4440b66b0 0x7ff4440b8bc0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff448005fd0 tx=0x7ff448005f40 comp rx=0 tx=0).stop 2024-09-21T03:53:16.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.382+0000 7ff45de97640 1 -- 172.21.15.84:0/1519095043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff458109df0 msgr2=0x7ff45819fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:16.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.382+0000 7ff45de97640 1 --2- 172.21.15.84:0/1519095043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff458109df0 0x7ff45819fc70 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7ff450009430 tx=0x7ff4500319f0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.382+0000 7ff45de97640 1 -- 172.21.15.84:0/1519095043 shutdown_connections 2024-09-21T03:53:16.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.382+0000 7ff45de97640 1 --2- 172.21.15.84:0/1519095043 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7ff4440b66b0 0x7ff4440b8bc0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.382+0000 7ff45de97640 1 --2- 172.21.15.84:0/1519095043 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7ff458109df0 0x7ff45819fc70 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.382+0000 7ff45de97640 1 --2- 172.21.15.84:0/1519095043 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff4581094a0 0x7ff45819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.382+0000 7ff45de97640 1 --2- 172.21.15.84:0/1519095043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff458103b60 0x7ff45819a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:16.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.382+0000 7ff45de97640 1 -- 172.21.15.84:0/1519095043 >> 172.21.15.84:0/1519095043 conn(0x7ff45807b850 msgr2=0x7ff458107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:16.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.382+0000 7ff45de97640 1 -- 172.21.15.84:0/1519095043 shutdown_connections 2024-09-21T03:53:16.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:16.382+0000 7ff45de97640 1 -- 172.21.15.84:0/1519095043 wait complete. 2024-09-21T03:53:17.103 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:53:17.347 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:17.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.946+0000 7f6f23ec3640 1 -- 172.21.15.84:0/824065724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c108d10 msgr2=0x7f6f1c10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:17.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.946+0000 7f6f23ec3640 1 --2- 172.21.15.84:0/824065724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c108d10 0x7f6f1c10f540 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009ca0 tx=0x7f6f1402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.946+0000 7f6f23ec3640 1 -- 172.21.15.84:0/824065724 shutdown_connections 2024-09-21T03:53:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.946+0000 7f6f23ec3640 1 --2- 172.21.15.84:0/824065724 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c108d10 0x7f6f1c10f540 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.946+0000 7f6f23ec3640 1 --2- 172.21.15.84:0/824065724 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f1c1083c0 0x7f6f1c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.946+0000 7f6f23ec3640 1 --2- 172.21.15.84:0/824065724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f1c102a80 0x7f6f1c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.946+0000 7f6f23ec3640 1 -- 172.21.15.84:0/824065724 >> 172.21.15.84:0/824065724 conn(0x7f6f1c079740 msgr2=0x7f6f1c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.947+0000 7f6f23ec3640 1 -- 172.21.15.84:0/824065724 shutdown_connections 2024-09-21T03:53:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.947+0000 7f6f23ec3640 1 -- 172.21.15.84:0/824065724 wait complete. 2024-09-21T03:53:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.947+0000 7f6f23ec3640 1 Processor -- start 2024-09-21T03:53:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.947+0000 7f6f23ec3640 1 -- start start 2024-09-21T03:53:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.947+0000 7f6f23ec3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c102a80 0x7f6f1c10ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.947+0000 7f6f23ec3640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f1c1083c0 0x7f6f1c110510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.947+0000 7f6f23ec3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f1c108d10 0x7f6f1c110a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.947+0000 7f6f23ec3640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c113aa0 con 0x7f6f1c102a80 2024-09-21T03:53:17.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.947+0000 7f6f23ec3640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c113920 con 0x7f6f1c108d10 2024-09-21T03:53:17.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.947+0000 7f6f23ec3640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c113c20 con 0x7f6f1c1083c0 2024-09-21T03:53:17.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.948+0000 7f6f21c5f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c102a80 0x7f6f1c10ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.948+0000 7f6f21c5f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c102a80 0x7f6f1c10ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35064/0 (socket says 172.21.15.84:35064) 2024-09-21T03:53:17.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.948+0000 7f6f21c5f640 1 -- 172.21.15.84:0/771529443 learned_addr learned my addr 172.21.15.84:0/771529443 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:17.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.948+0000 7f6f2145e640 1 --2- 172.21.15.84:0/771529443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f1c1083c0 0x7f6f1c110510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.948+0000 7f6f21c5f640 1 -- 172.21.15.84:0/771529443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f1c1083c0 msgr2=0x7f6f1c110510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:17.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.948+0000 7f6f21c5f640 1 --2- 172.21.15.84:0/771529443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f1c1083c0 0x7f6f1c110510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.948+0000 7f6f22460640 1 --2- 172.21.15.84:0/771529443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f1c108d10 0x7f6f1c110a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.948+0000 7f6f21c5f640 1 -- 172.21.15.84:0/771529443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f1c108d10 msgr2=0x7f6f1c110a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:17.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.948+0000 7f6f21c5f640 1 --2- 172.21.15.84:0/771529443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f1c108d10 0x7f6f1c110a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.948+0000 7f6f21c5f640 1 -- 172.21.15.84:0/771529443 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1c1a87d0 con 0x7f6f1c102a80 2024-09-21T03:53:17.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.948+0000 7f6f2145e640 1 --2- 172.21.15.84:0/771529443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f1c1083c0 0x7f6f1c110510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:17.963 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.948+0000 7f6f21c5f640 1 --2- 172.21.15.84:0/771529443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c102a80 0x7f6f1c10ffd0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800d950 tx=0x7f6f1800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:17.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.948+0000 7f6f12ffd640 1 -- 172.21.15.84:0/771529443 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f18017070 con 0x7f6f1c102a80 2024-09-21T03:53:17.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.948+0000 7f6f12ffd640 1 -- 172.21.15.84:0/771529443 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f18009c30 con 0x7f6f1c102a80 2024-09-21T03:53:17.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.948+0000 7f6f23ec3640 1 -- 172.21.15.84:0/771529443 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f1c1a8ac0 con 0x7f6f1c102a80 2024-09-21T03:53:17.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.948+0000 7f6f12ffd640 1 -- 172.21.15.84:0/771529443 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1800f620 con 0x7f6f1c102a80 2024-09-21T03:53:17.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.948+0000 7f6f23ec3640 1 -- 172.21.15.84:0/771529443 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f1c1a9000 con 0x7f6f1c102a80 2024-09-21T03:53:17.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.951+0000 7f6f2a437740 1 Processor -- start 2024-09-21T03:53:17.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.951+0000 7f6f2a437740 1 -- start start 2024-09-21T03:53:17.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.951+0000 7f6f2a437740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c02d070 0x563d6c3d46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.951+0000 7f6f2a437740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d6c0041b0 0x563d6c3d4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.951+0000 7f6f2a437740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d6c00c390 0x563d6c3d5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.951+0000 7f6f2a437740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563d6c34aea0 con 0x563d6c02d070 2024-09-21T03:53:17.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.951+0000 7f6f2a437740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563d6c33a2d0 con 0x563d6c00c390 2024-09-21T03:53:17.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.952+0000 7f6f2a437740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x563d6c33e0e0 con 0x563d6c0041b0 2024-09-21T03:53:17.964 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.952+0000 7f6f22460640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c02d070 0x563d6c3d46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.952+0000 7f6f12ffd640 1 -- 172.21.15.84:0/771529443 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f6f18010460 con 0x7f6f1c102a80 2024-09-21T03:53:17.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.952+0000 7f6f22460640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c02d070 0x563d6c3d46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35078/0 (socket says 172.21.15.84:35078) 2024-09-21T03:53:17.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.952+0000 7f6f22460640 1 -- 172.21.15.84:0/905596208 learned_addr learned my addr 172.21.15.84:0/905596208 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:17.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.952+0000 7f6f2145e640 1 --2- 172.21.15.84:0/905596208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d6c00c390 0x563d6c3d5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.952+0000 7f6f22460640 1 -- 172.21.15.84:0/905596208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d6c0041b0 msgr2=0x563d6c3d4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:17.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.952+0000 7f6f22460640 1 --2- 172.21.15.84:0/905596208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d6c0041b0 0x563d6c3d4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.952+0000 7f6f22460640 1 -- 172.21.15.84:0/905596208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d6c00c390 msgr2=0x563d6c3d5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:17.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.952+0000 7f6f22460640 1 --2- 172.21.15.84:0/905596208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d6c00c390 0x563d6c3d5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.952+0000 7f6f22460640 1 -- 172.21.15.84:0/905596208 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d6c098650 con 0x563d6c02d070 2024-09-21T03:53:17.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.952+0000 7f6f22460640 1 --2- 172.21.15.84:0/905596208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c02d070 0x563d6c3d46a0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f6f14005cc0 tx=0x7f6f14009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea5f10a86531eee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:17.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.953+0000 7f6f07fff640 1 -- 172.21.15.84:0/905596208 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14031cf0 con 0x563d6c02d070 2024-09-21T03:53:17.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.953+0000 7f6f07fff640 1 -- 172.21.15.84:0/905596208 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f14036070 con 0x563d6c02d070 2024-09-21T03:53:17.965 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.953+0000 7f6f07fff640 1 -- 172.21.15.84:0/905596208 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14003e60 con 0x563d6c02d070 2024-09-21T03:53:17.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.953+0000 7f6f12ffd640 1 --2- 172.21.15.84:0/771529443 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6f080b6680 0x7f6f080b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.953+0000 7f6f21c5f640 1 --2- 172.21.15.84:0/771529443 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6f080b6680 0x7f6f080b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.953+0000 7f6f12ffd640 1 -- 172.21.15.84:0/771529443 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f6f180e73f0 con 0x7f6f1c102a80 2024-09-21T03:53:17.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.954+0000 7f6f21c5f640 1 --2- 172.21.15.84:0/771529443 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6f080b6680 0x7f6f080b8b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x563d6c3d3320 tx=0x7f6f180a99c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:17.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.954+0000 7f6f2a437740 1 -- 172.21.15.84:0/905596208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c02d070 msgr2=0x563d6c3d46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:17.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.954+0000 7f6f2a437740 1 --2- 172.21.15.84:0/905596208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c02d070 0x563d6c3d46a0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f6f14005cc0 tx=0x7f6f14009800 comp rx=0 tx=0).stop 2024-09-21T03:53:17.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.954+0000 7f6f2a437740 1 -- 172.21.15.84:0/905596208 shutdown_connections 2024-09-21T03:53:17.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.954+0000 7f6f2a437740 1 --2- 172.21.15.84:0/905596208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d6c00c390 0x563d6c3d5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.954+0000 7f6f2a437740 1 --2- 172.21.15.84:0/905596208 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d6c0041b0 0x563d6c3d4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.954+0000 7f6f2a437740 1 --2- 172.21.15.84:0/905596208 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c02d070 0x563d6c3d46a0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.954+0000 7f6f2a437740 1 -- 172.21.15.84:0/905596208 >> 172.21.15.84:0/905596208 conn(0x563d6c021460 msgr2=0x563d6c3d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:17.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.954+0000 7f6f2a437740 1 -- 172.21.15.84:0/905596208 shutdown_connections 2024-09-21T03:53:17.966 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.954+0000 7f6f2a437740 1 -- 172.21.15.84:0/905596208 wait complete. 2024-09-21T03:53:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.954+0000 7f6f2a437740 1 -- start start 2024-09-21T03:53:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.954+0000 7f6f2a437740 1 Processor -- start 2024-09-21T03:53:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.955+0000 7f6f2a437740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d6c0041b0 0x563d6c3dfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.955+0000 7f6f2a437740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d6c00c390 0x563d6c3e0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.955+0000 7f6f2a437740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c02d070 0x563d6c3e0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.955+0000 7f6f2a437740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x563d6c19b700 con 0x563d6c02d070 2024-09-21T03:53:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.955+0000 7f6f2a437740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563d6c2d5160 con 0x563d6c0041b0 2024-09-21T03:53:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.955+0000 7f6f2a437740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x563d6c3e2e20 con 0x563d6c00c390 2024-09-21T03:53:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.955+0000 7f6f2a437740 10 client.0 _ll_register_callbacks cb 0x563d6c2ee9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:53:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.955+0000 7f6f22460640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c02d070 0x563d6c3e0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.955+0000 7f6f22460640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c02d070 0x563d6c3e0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35084/0 (socket says 172.21.15.84:35084) 2024-09-21T03:53:17.967 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.955+0000 7f6f22460640 1 -- 172.21.15.84:0/2604429052 learned_addr learned my addr 172.21.15.84:0/2604429052 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.955+0000 7f6f2145e640 1 --2- 172.21.15.84:0/2604429052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d6c00c390 0x563d6c3e0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.955+0000 7f6f22460640 1 --2- 172.21.15.84:0/2604429052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d6c0041b0 0x563d6c3dfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.955+0000 7f6f22460640 1 -- 172.21.15.84:0/2604429052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d6c00c390 msgr2=0x563d6c3e0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.955+0000 7f6f22460640 1 --2- 172.21.15.84:0/2604429052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d6c00c390 0x563d6c3e0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.955+0000 7f6f22460640 1 -- 172.21.15.84:0/2604429052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d6c0041b0 msgr2=0x563d6c3dfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.955+0000 7f6f22460640 1 --2- 172.21.15.84:0/2604429052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d6c0041b0 0x563d6c3dfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.955+0000 7f6f22460640 1 -- 172.21.15.84:0/2604429052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d6c302c90 con 0x563d6c02d070 2024-09-21T03:53:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.956+0000 7f6f22460640 1 --2- 172.21.15.84:0/2604429052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c02d070 0x563d6c3e0780 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f6f1402f470 tx=0x7f6f140099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e328e1d197387f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.956+0000 7f6f057fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:53:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.956+0000 7f6f057fa640 1 -- 172.21.15.84:0/2604429052 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14056060 con 0x563d6c02d070 2024-09-21T03:53:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.956+0000 7f6f057fa640 1 -- 172.21.15.84:0/2604429052 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f6f14031450 con 0x563d6c02d070 2024-09-21T03:53:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.956+0000 7f6f2a437740 1 -- 172.21.15.84:0/2604429052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f14036070 con 0x563d6c02d070 2024-09-21T03:53:17.968 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.956+0000 7f6f057fa640 1 -- 172.21.15.84:0/2604429052 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6f14049040 con 0x563d6c02d070 2024-09-21T03:53:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.956+0000 7f6f2a437740 10 client.17535 fetch_fsmap learned FSMap version 25 2024-09-21T03:53:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.956+0000 7f6f2a437740 1 -- 172.21.15.84:0/2604429052 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563d6c3eead0 con 0x563d6c02d070 2024-09-21T03:53:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.956+0000 7f6f057fa640 1 -- 172.21.15.84:0/2604429052 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f14036070 con 0x563d6c02d070 2024-09-21T03:53:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.957+0000 7f6f057fa640 1 -- 172.21.15.84:0/2604429052 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6f1402f660 con 0x563d6c02d070 2024-09-21T03:53:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.957+0000 7f6f2a437740 10 client.17535 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:53:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.957+0000 7f6f2a437740 10 client.17535 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:53:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.957+0000 7f6f2a437740 20 client.17535 populate_metadata read hostname 'smithi084' 2024-09-21T03:53:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.957+0000 7f6f2a437740 1 --2- 172.21.15.84:0/2604429052 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x563d6bfeb9f0 0x563d6c3f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.957+0000 7f6f2a437740 4 client.17535 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:53:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.957+0000 7f6f2a437740 1 -- 172.21.15.84:0/2604429052 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d6c34cdf0 con 0x563d6bfeb9f0 2024-09-21T03:53:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.957+0000 7f6f2145e640 1 --2- 172.21.15.84:0/2604429052 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x563d6bfeb9f0 0x563d6c3f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.958+0000 7f6f2145e640 1 --2- 172.21.15.84:0/2604429052 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x563d6bfeb9f0 0x563d6c3f1e30 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bcf1378e0d2d9be server_cookie=ac301d1de4d1827c in_seq=0 out_seq=0 2024-09-21T03:53:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.958+0000 7f6f057fa640 10 client.17535 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:53:17.969 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.959+0000 7f6f057fa640 1 -- 172.21.15.84:0/2604429052 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563d6c34cdf0 con 0x563d6bfeb9f0 2024-09-21T03:53:17.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.959+0000 7f6f057fa640 10 client.17535 handle_command_reply: tid=0 2024-09-21T03:53:17.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.959+0000 7f6f2a437740 1 client.17535 shutdown 2024-09-21T03:53:17.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.959+0000 7f6f2a437740 1 -- 172.21.15.84:0/2604429052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c02d070 msgr2=0x563d6c3e0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:17.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.959+0000 7f6f2a437740 1 --2- 172.21.15.84:0/2604429052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c02d070 0x563d6c3e0780 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f6f1402f470 tx=0x7f6f140099f0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.959+0000 7f6f2a437740 1 -- 172.21.15.84:0/2604429052 shutdown_connections 2024-09-21T03:53:17.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.959+0000 7f6f2a437740 1 --2- 172.21.15.84:0/2604429052 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x563d6bfeb9f0 0x563d6c3f1e30 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.959+0000 7f6f2a437740 1 --2- 172.21.15.84:0/2604429052 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c02d070 0x563d6c3e0780 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.959+0000 7f6f2a437740 1 --2- 172.21.15.84:0/2604429052 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d6c00c390 0x563d6c3e0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.959+0000 7f6f057fa640 0 client.17535 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:53:17.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.959+0000 7f6f2a437740 1 --2- 172.21.15.84:0/2604429052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d6c0041b0 0x563d6c3dfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.959+0000 7f6f2a437740 1 -- 172.21.15.84:0/2604429052 >> 172.21.15.84:0/2604429052 conn(0x563d6c021460 msgr2=0x563d6c3d7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:17.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.959+0000 7f6f2a437740 1 -- 172.21.15.84:0/2604429052 shutdown_connections 2024-09-21T03:53:17.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.959+0000 7f6f2a437740 1 -- 172.21.15.84:0/2604429052 wait complete. 2024-09-21T03:53:17.970 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.959+0000 7f6f2a437740 20 client.17535 trim_cache size 0 max 16384 2024-09-21T03:53:17.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.972+0000 7f6f2a437740 1 Processor -- start 2024-09-21T03:53:17.975 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.972+0000 7f6f2a437740 1 -- start start 2024-09-21T03:53:17.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.972+0000 7f6f2a437740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d6c0041b0 0x563d6c3e1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.972+0000 7f6f2a437740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c00c390 0x563d6c3d6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.973+0000 7f6f2a437740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d6c02d070 0x563d6c3eb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.973+0000 7f6f2a437740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c1b4120 con 0x563d6c00c390 2024-09-21T03:53:17.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.973+0000 7f6f2a437740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c1b19f0 con 0x563d6c0041b0 2024-09-21T03:53:17.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.973+0000 7f6f2a437740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c1af860 con 0x563d6c02d070 2024-09-21T03:53:17.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.973+0000 7f6f2145e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c00c390 0x563d6c3d6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.973+0000 7f6f2145e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c00c390 0x563d6c3d6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35092/0 (socket says 172.21.15.84:35092) 2024-09-21T03:53:17.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.973+0000 7f6f2145e640 1 -- 172.21.15.84:0/3085790164 learned_addr learned my addr 172.21.15.84:0/3085790164 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:17.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.973+0000 7f6f22460640 1 --2- 172.21.15.84:0/3085790164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d6c02d070 0x563d6c3eb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.973+0000 7f6f22460640 1 --2- 172.21.15.84:0/3085790164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d6c0041b0 0x563d6c3e1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.976 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.973+0000 7f6f2145e640 1 -- 172.21.15.84:0/3085790164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d6c02d070 msgr2=0x563d6c3eb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:17.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.973+0000 7f6f2145e640 1 --2- 172.21.15.84:0/3085790164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d6c02d070 0x563d6c3eb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.973+0000 7f6f2145e640 1 -- 172.21.15.84:0/3085790164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d6c0041b0 msgr2=0x563d6c3e1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:17.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.973+0000 7f6f2145e640 1 --2- 172.21.15.84:0/3085790164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d6c0041b0 0x563d6c3e1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.973+0000 7f6f2145e640 1 -- 172.21.15.84:0/3085790164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d6c3e0ac0 con 0x563d6c00c390 2024-09-21T03:53:17.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.973+0000 7f6f2145e640 1 --2- 172.21.15.84:0/3085790164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c00c390 0x563d6c3d6090 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00bdd0 tx=0x7f6f0c011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11cb9c11d5b8a71c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:17.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.973+0000 7f6f077fe640 1 -- 172.21.15.84:0/3085790164 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c005020 con 0x563d6c00c390 2024-09-21T03:53:17.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.973+0000 7f6f077fe640 1 -- 172.21.15.84:0/3085790164 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f0c010800 con 0x563d6c00c390 2024-09-21T03:53:17.977 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.973+0000 7f6f077fe640 1 -- 172.21.15.84:0/3085790164 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c004a00 con 0x563d6c00c390 2024-09-21T03:53:17.980 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.974+0000 7f6f2a437740 1 -- 172.21.15.84:0/3085790164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c00c390 msgr2=0x563d6c3d6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.974+0000 7f6f2a437740 1 --2- 172.21.15.84:0/3085790164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c00c390 0x563d6c3d6090 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00bdd0 tx=0x7f6f0c011ba0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.974+0000 7f6f2a437740 1 -- 172.21.15.84:0/3085790164 shutdown_connections 2024-09-21T03:53:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.974+0000 7f6f2a437740 1 --2- 172.21.15.84:0/3085790164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d6c02d070 0x563d6c3eb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.974+0000 7f6f2a437740 1 --2- 172.21.15.84:0/3085790164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c00c390 0x563d6c3d6090 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.974+0000 7f6f2a437740 1 --2- 172.21.15.84:0/3085790164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d6c0041b0 0x563d6c3e1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.974+0000 7f6f2a437740 1 -- 172.21.15.84:0/3085790164 >> 172.21.15.84:0/3085790164 conn(0x563d6c021460 msgr2=0x563d6c3eb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.974+0000 7f6f2a437740 1 -- 172.21.15.84:0/3085790164 shutdown_connections 2024-09-21T03:53:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.974+0000 7f6f2a437740 1 -- 172.21.15.84:0/3085790164 wait complete. 2024-09-21T03:53:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.975+0000 7f6f2a437740 1 -- start start 2024-09-21T03:53:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.975+0000 7f6f2a437740 1 Processor -- start 2024-09-21T03:53:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.975+0000 7f6f2a437740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d6c0041b0 0x563d6c3f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.975+0000 7f6f2a437740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c00c390 0x563d6c3f3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.981 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.975+0000 7f6f2a437740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d6c02d070 0x563d6c3f3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.975+0000 7f6f2a437740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c1afeb0 con 0x563d6c00c390 2024-09-21T03:53:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.975+0000 7f6f2a437740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c1b1320 con 0x563d6c02d070 2024-09-21T03:53:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.975+0000 7f6f2a437740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c1b0580 con 0x563d6c0041b0 2024-09-21T03:53:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.976+0000 7f6f2a437740 10 client.0 _ll_register_callbacks cb 0x7f6f0c00b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:53:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.976+0000 7f6f2145e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c00c390 0x563d6c3f3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.976+0000 7f6f2145e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c00c390 0x563d6c3f3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:35108/0 (socket says 172.21.15.84:35108) 2024-09-21T03:53:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.976+0000 7f6f2145e640 1 -- 172.21.15.84:0/1635103910 learned_addr learned my addr 172.21.15.84:0/1635103910 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.976+0000 7f6f22460640 1 --2- 172.21.15.84:0/1635103910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d6c0041b0 0x563d6c3f2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.976+0000 7f6f22460640 1 --2- 172.21.15.84:0/1635103910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d6c02d070 0x563d6c3f3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.976+0000 7f6f2145e640 1 -- 172.21.15.84:0/1635103910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d6c0041b0 msgr2=0x563d6c3f2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.976+0000 7f6f2145e640 1 --2- 172.21.15.84:0/1635103910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d6c0041b0 0x563d6c3f2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.976+0000 7f6f2145e640 1 -- 172.21.15.84:0/1635103910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d6c02d070 msgr2=0x563d6c3f3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:17.982 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.976+0000 7f6f2145e640 1 --2- 172.21.15.84:0/1635103910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d6c02d070 0x563d6c3f3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.976+0000 7f6f2145e640 1 -- 172.21.15.84:0/1635103910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d6c45b5e0 con 0x563d6c00c390 2024-09-21T03:53:17.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.976+0000 7f6f22460640 1 --2- 172.21.15.84:0/1635103910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d6c0041b0 0x563d6c3f2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:53:17.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.976+0000 7f6f2145e640 1 --2- 172.21.15.84:0/1635103910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c00c390 0x563d6c3f3400 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c022000 tx=0x7f6f0c013f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4e2d866fe8d151 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:17.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.976+0000 7f6f057fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:53:17.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.976+0000 7f6f057fa640 1 -- 172.21.15.84:0/1635103910 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c010e40 con 0x563d6c00c390 2024-09-21T03:53:17.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.976+0000 7f6f057fa640 1 -- 172.21.15.84:0/1635103910 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f6f0c005020 con 0x563d6c00c390 2024-09-21T03:53:17.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.976+0000 7f6f2a437740 1 -- 172.21.15.84:0/1635103910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f0c010800 con 0x563d6c00c390 2024-09-21T03:53:17.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.976+0000 7f6f057fa640 1 -- 172.21.15.84:0/1635103910 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6f0c005240 con 0x563d6c00c390 2024-09-21T03:53:17.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.976+0000 7f6f2a437740 10 client.17541 fetch_fsmap learned FSMap version 25 2024-09-21T03:53:17.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.976+0000 7f6f2a437740 1 -- 172.21.15.84:0/1635103910 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563d6c45c840 con 0x563d6c00c390 2024-09-21T03:53:17.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.977+0000 7f6f057fa640 1 -- 172.21.15.84:0/1635103910 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f0c010800 con 0x563d6c00c390 2024-09-21T03:53:17.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.977+0000 7f6f057fa640 1 -- 172.21.15.84:0/1635103910 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6f0c01d460 con 0x563d6c00c390 2024-09-21T03:53:17.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.977+0000 7f6f2a437740 10 client.17541 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:53:17.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.977+0000 7f6f2a437740 10 client.17541 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:53:17.983 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.977+0000 7f6f2a437740 20 client.17541 populate_metadata read hostname 'smithi084' 2024-09-21T03:53:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.977+0000 7f6f2a437740 1 --2- 172.21.15.84:0/1635103910 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x563d6bfc0da0 0x563d6c45ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.977+0000 7f6f2a437740 4 client.17541 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:53:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.977+0000 7f6f2a437740 1 -- 172.21.15.84:0/1635103910 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563d6c3488a0 con 0x563d6bfc0da0 2024-09-21T03:53:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.977+0000 7f6f22460640 1 --2- 172.21.15.84:0/1635103910 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x563d6bfc0da0 0x563d6c45ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.978+0000 7f6f057fa640 10 client.17541 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:53:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.978+0000 7f6f22460640 1 --2- 172.21.15.84:0/1635103910 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x563d6bfc0da0 0x563d6c45ef40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9b40ac4778dccdf6 server_cookie=5dc4b4f7c3789e78 in_seq=0 out_seq=0 2024-09-21T03:53:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.978+0000 7f6f057fa640 1 -- 172.21.15.84:0/1635103910 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563d6c3488a0 con 0x563d6bfc0da0 2024-09-21T03:53:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.978+0000 7f6f057fa640 10 client.17541 handle_command_reply: tid=0 2024-09-21T03:53:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.978+0000 7f6f2a437740 1 client.17541 shutdown 2024-09-21T03:53:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.978+0000 7f6f2a437740 1 -- 172.21.15.84:0/1635103910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c00c390 msgr2=0x563d6c3f3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.978+0000 7f6f2a437740 1 --2- 172.21.15.84:0/1635103910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c00c390 0x563d6c3f3400 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c022000 tx=0x7f6f0c013f10 comp rx=0 tx=0).stop 2024-09-21T03:53:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.978+0000 7f6f2a437740 1 -- 172.21.15.84:0/1635103910 shutdown_connections 2024-09-21T03:53:17.984 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.978+0000 7f6f2a437740 1 --2- 172.21.15.84:0/1635103910 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x563d6bfc0da0 0x563d6c45ef40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.978+0000 7f6f2a437740 1 --2- 172.21.15.84:0/1635103910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d6c02d070 0x563d6c3f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.978+0000 7f6f2a437740 1 --2- 172.21.15.84:0/1635103910 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x563d6c00c390 0x563d6c3f3400 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.978+0000 7f6f2a437740 1 --2- 172.21.15.84:0/1635103910 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563d6c0041b0 0x563d6c3f2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.978+0000 7f6f057fa640 0 client.17541 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:53:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.978+0000 7f6f2a437740 1 -- 172.21.15.84:0/1635103910 >> 172.21.15.84:0/1635103910 conn(0x563d6c021460 msgr2=0x563d6c3d6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.978+0000 7f6f2a437740 1 -- 172.21.15.84:0/1635103910 shutdown_connections 2024-09-21T03:53:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.978+0000 7f6f2a437740 1 -- 172.21.15.84:0/1635103910 wait complete. 2024-09-21T03:53:17.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.978+0000 7f6f2a437740 20 client.17541 trim_cache size 0 max 16384 2024-09-21T03:53:17.985 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:53:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.979+0000 7f6f23ec3640 1 -- 172.21.15.84:0/771529443 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6f080b6680 msgr2=0x7f6f080b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.979+0000 7f6f23ec3640 1 --2- 172.21.15.84:0/771529443 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6f080b6680 0x7f6f080b8b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x563d6c3d3320 tx=0x7f6f180a99c0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.979+0000 7f6f23ec3640 1 -- 172.21.15.84:0/771529443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c102a80 msgr2=0x7f6f1c10ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.979+0000 7f6f23ec3640 1 --2- 172.21.15.84:0/771529443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c102a80 0x7f6f1c10ffd0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800d950 tx=0x7f6f1800de10 comp rx=0 tx=0).stop 2024-09-21T03:53:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.979+0000 7f6f23ec3640 1 -- 172.21.15.84:0/771529443 shutdown_connections 2024-09-21T03:53:17.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.979+0000 7f6f23ec3640 1 --2- 172.21.15.84:0/771529443 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6f080b6680 0x7f6f080b8b90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.979+0000 7f6f23ec3640 1 --2- 172.21.15.84:0/771529443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f1c108d10 0x7f6f1c110a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.979+0000 7f6f23ec3640 1 --2- 172.21.15.84:0/771529443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f1c1083c0 0x7f6f1c110510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.979+0000 7f6f23ec3640 1 --2- 172.21.15.84:0/771529443 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f1c102a80 0x7f6f1c10ffd0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.979+0000 7f6f23ec3640 1 -- 172.21.15.84:0/771529443 >> 172.21.15.84:0/771529443 conn(0x7f6f1c079740 msgr2=0x7f6f1c104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.979+0000 7f6f23ec3640 1 -- 172.21.15.84:0/771529443 shutdown_connections 2024-09-21T03:53:17.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:17.979+0000 7f6f23ec3640 1 -- 172.21.15.84:0/771529443 wait complete. 2024-09-21T03:53:17.987 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:17 smithi084 ceph-mon[30941]: pgmap v658: 97 pgs: 97 active+clean; 23 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 11 op/s 2024-09-21T03:53:18.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:17 smithi174 ceph-mon[34403]: pgmap v658: 97 pgs: 97 active+clean; 23 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 11 op/s 2024-09-21T03:53:18.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:17 smithi172 ceph-mon[34821]: pgmap v658: 97 pgs: 97 active+clean; 23 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 11 op/s 2024-09-21T03:53:18.708 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:53:18.954 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:19.476 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.464+0000 7f7eee9d9640 1 -- 172.21.15.84:0/813015155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee81094a0 msgr2=0x7f7ee81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:19.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.464+0000 7f7eee9d9640 1 --2- 172.21.15.84:0/813015155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee81094a0 0x7f7ee81098b0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009900 tx=0x7f7edc02a410 comp rx=0 tx=0).stop 2024-09-21T03:53:19.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.464+0000 7f7eee9d9640 1 -- 172.21.15.84:0/813015155 shutdown_connections 2024-09-21T03:53:19.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.464+0000 7f7eee9d9640 1 --2- 172.21.15.84:0/813015155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ee8109df0 0x7f7ee8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.464+0000 7f7eee9d9640 1 --2- 172.21.15.84:0/813015155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee81094a0 0x7f7ee81098b0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.464+0000 7f7eee9d9640 1 --2- 172.21.15.84:0/813015155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ee8103b60 0x7f7ee8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.464+0000 7f7eee9d9640 1 -- 172.21.15.84:0/813015155 >> 172.21.15.84:0/813015155 conn(0x7f7ee807b850 msgr2=0x7f7ee807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:19.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.464+0000 7f7eee9d9640 1 -- 172.21.15.84:0/813015155 shutdown_connections 2024-09-21T03:53:19.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.464+0000 7f7eee9d9640 1 -- 172.21.15.84:0/813015155 wait complete. 2024-09-21T03:53:19.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.465+0000 7f7eee9d9640 1 Processor -- start 2024-09-21T03:53:19.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.465+0000 7f7eee9d9640 1 -- start start 2024-09-21T03:53:19.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.465+0000 7f7eee9d9640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ee8103b60 0x7f7ee819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.477 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.465+0000 7f7eee9d9640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ee81094a0 0x7f7ee819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.465+0000 7f7eee9d9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee8109df0 0x7f7ee819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.465+0000 7f7eee9d9640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee8113ab0 con 0x7f7ee8109df0 2024-09-21T03:53:19.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.465+0000 7f7eee9d9640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee8113930 con 0x7f7ee8103b60 2024-09-21T03:53:19.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.465+0000 7f7eee9d9640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee8113c30 con 0x7f7ee81094a0 2024-09-21T03:53:19.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.465+0000 7f7eecf76640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee8109df0 0x7f7ee819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.465+0000 7f7eecf76640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee8109df0 0x7f7ee819fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40518/0 (socket says 172.21.15.84:40518) 2024-09-21T03:53:19.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.465+0000 7f7eecf76640 1 -- 172.21.15.84:0/1212781446 learned_addr learned my addr 172.21.15.84:0/1212781446 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:19.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.466+0000 7f7ee77fe640 1 --2- 172.21.15.84:0/1212781446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ee81094a0 0x7f7ee819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.466+0000 7f7ee7fff640 1 --2- 172.21.15.84:0/1212781446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ee8103b60 0x7f7ee819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.466+0000 7f7eecf76640 1 -- 172.21.15.84:0/1212781446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ee81094a0 msgr2=0x7f7ee819aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:19.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.466+0000 7f7eecf76640 1 --2- 172.21.15.84:0/1212781446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ee81094a0 0x7f7ee819aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.478 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.466+0000 7f7eecf76640 1 -- 172.21.15.84:0/1212781446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ee8103b60 msgr2=0x7f7ee819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:19.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.466+0000 7f7eecf76640 1 --2- 172.21.15.84:0/1212781446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ee8103b60 0x7f7ee819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.466+0000 7f7eecf76640 1 -- 172.21.15.84:0/1212781446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee81a03f0 con 0x7f7ee8109df0 2024-09-21T03:53:19.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.466+0000 7f7ee7fff640 1 --2- 172.21.15.84:0/1212781446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ee8103b60 0x7f7ee819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:19.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.466+0000 7f7ee77fe640 1 --2- 172.21.15.84:0/1212781446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ee81094a0 0x7f7ee819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:19.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.466+0000 7f7eecf76640 1 --2- 172.21.15.84:0/1212781446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee8109df0 0x7f7ee819fcc0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000eaa0 tx=0x7f7ee000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:19.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.466+0000 7f7ee57fa640 1 -- 172.21.15.84:0/1212781446 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee000cdb0 con 0x7f7ee8109df0 2024-09-21T03:53:19.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.466+0000 7f7ee57fa640 1 -- 172.21.15.84:0/1212781446 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ee0005020 con 0x7f7ee8109df0 2024-09-21T03:53:19.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.466+0000 7f7eee9d9640 1 -- 172.21.15.84:0/1212781446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ee81a06e0 con 0x7f7ee8109df0 2024-09-21T03:53:19.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.466+0000 7f7ee57fa640 1 -- 172.21.15.84:0/1212781446 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee00116d0 con 0x7f7ee8109df0 2024-09-21T03:53:19.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.466+0000 7f7eee9d9640 1 -- 172.21.15.84:0/1212781446 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ee81a6e40 con 0x7f7ee8109df0 2024-09-21T03:53:19.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.469+0000 7f7ef4f4d740 1 Processor -- start 2024-09-21T03:53:19.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.469+0000 7f7ee57fa640 1 -- 172.21.15.84:0/1212781446 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f7ee0011870 con 0x7f7ee8109df0 2024-09-21T03:53:19.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.469+0000 7f7ef4f4d740 1 -- start start 2024-09-21T03:53:19.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.469+0000 7f7ef4f4d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea60070 0x5592aee076a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.479 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.469+0000 7f7ef4f4d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea371b0 0x5592aee07be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.469+0000 7f7ef4f4d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea3f390 0x5592aee08120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.469+0000 7f7ef4f4d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5592aed7dea0 con 0x5592aea371b0 2024-09-21T03:53:19.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.469+0000 7f7ef4f4d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5592aed6d2d0 con 0x5592aea60070 2024-09-21T03:53:19.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.469+0000 7f7ef4f4d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5592aed710e0 con 0x5592aea3f390 2024-09-21T03:53:19.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.470+0000 7f7ee7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea371b0 0x5592aee07be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.470+0000 7f7ee7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea371b0 0x5592aee07be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40532/0 (socket says 172.21.15.84:40532) 2024-09-21T03:53:19.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.470+0000 7f7ee7fff640 1 -- 172.21.15.84:0/1983973748 learned_addr learned my addr 172.21.15.84:0/1983973748 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:19.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.470+0000 7f7ee77fe640 1 --2- 172.21.15.84:0/1983973748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea3f390 0x5592aee08120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.470+0000 7f7ee77fe640 1 --2- 172.21.15.84:0/1983973748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea60070 0x5592aee076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.470+0000 7f7ee7fff640 1 -- 172.21.15.84:0/1983973748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea3f390 msgr2=0x5592aee08120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:19.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.470+0000 7f7ee7fff640 1 --2- 172.21.15.84:0/1983973748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea3f390 0x5592aee08120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.470+0000 7f7ee7fff640 1 -- 172.21.15.84:0/1983973748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea60070 msgr2=0x5592aee076a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:19.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.470+0000 7f7ee7fff640 1 --2- 172.21.15.84:0/1983973748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea60070 0x5592aee076a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.470+0000 7f7ee7fff640 1 -- 172.21.15.84:0/1983973748 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592aeacb650 con 0x5592aea371b0 2024-09-21T03:53:19.480 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.470+0000 7f7ee77fe640 1 --2- 172.21.15.84:0/1983973748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea60070 0x5592aee076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:53:19.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.470+0000 7f7ee57fa640 1 --2- 172.21.15.84:0/1212781446 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7ed00b6680 0x7f7ed00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.470+0000 7f7ee77fe640 1 --2- 172.21.15.84:0/1212781446 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7ed00b6680 0x7f7ed00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.470+0000 7f7ee7fff640 1 --2- 172.21.15.84:0/1983973748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea371b0 0x5592aee07be0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f7ed800bd40 tx=0x7f7ed800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57241f68ac87bfe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:19.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.470+0000 7f7ee57fa640 1 -- 172.21.15.84:0/1212781446 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f7ee00e78b0 con 0x7f7ee8109df0 2024-09-21T03:53:19.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.470+0000 7f7ece7fc640 1 -- 172.21.15.84:0/1983973748 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8004220 con 0x5592aea371b0 2024-09-21T03:53:19.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.470+0000 7f7ece7fc640 1 -- 172.21.15.84:0/1983973748 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ed800be30 con 0x5592aea371b0 2024-09-21T03:53:19.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.470+0000 7f7ece7fc640 1 -- 172.21.15.84:0/1983973748 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed80116a0 con 0x5592aea371b0 2024-09-21T03:53:19.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.471+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/1983973748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea371b0 msgr2=0x5592aee07be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:19.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.471+0000 7f7ee77fe640 1 --2- 172.21.15.84:0/1212781446 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7ed00b6680 0x7f7ed00b8b90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009230 tx=0x7f7edc031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:19.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.471+0000 7f7ef4f4d740 1 --2- 172.21.15.84:0/1983973748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea371b0 0x5592aee07be0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f7ed800bd40 tx=0x7f7ed800f730 comp rx=0 tx=0).stop 2024-09-21T03:53:19.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.471+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/1983973748 shutdown_connections 2024-09-21T03:53:19.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.471+0000 7f7ef4f4d740 1 --2- 172.21.15.84:0/1983973748 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea3f390 0x5592aee08120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.471+0000 7f7ef4f4d740 1 --2- 172.21.15.84:0/1983973748 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea371b0 0x5592aee07be0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.471+0000 7f7ef4f4d740 1 --2- 172.21.15.84:0/1983973748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea60070 0x5592aee076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.481 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.471+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/1983973748 >> 172.21.15.84:0/1983973748 conn(0x5592aea54460 msgr2=0x5592aee05590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:19.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.471+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/1983973748 shutdown_connections 2024-09-21T03:53:19.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.471+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/1983973748 wait complete. 2024-09-21T03:53:19.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.472+0000 7f7ef4f4d740 1 -- start start 2024-09-21T03:53:19.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.472+0000 7f7ef4f4d740 1 Processor -- start 2024-09-21T03:53:19.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.472+0000 7f7ef4f4d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea371b0 0x5592aee12d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.472+0000 7f7ef4f4d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea3f390 0x5592aee13260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.472+0000 7f7ef4f4d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea60070 0x5592aee137c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.472+0000 7f7ef4f4d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5592aebce700 con 0x5592aea60070 2024-09-21T03:53:19.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.472+0000 7f7ef4f4d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5592aed08160 con 0x5592aea3f390 2024-09-21T03:53:19.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.472+0000 7f7ef4f4d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5592aee15e80 con 0x5592aea371b0 2024-09-21T03:53:19.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.473+0000 7f7ef4f4d740 10 client.0 _ll_register_callbacks cb 0x5592aed219e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:53:19.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.473+0000 7f7eecf76640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea60070 0x5592aee137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.473+0000 7f7eecf76640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea60070 0x5592aee137c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40538/0 (socket says 172.21.15.84:40538) 2024-09-21T03:53:19.482 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.473+0000 7f7eecf76640 1 -- 172.21.15.84:0/3377598829 learned_addr learned my addr 172.21.15.84:0/3377598829 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:19.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.473+0000 7f7ee7fff640 1 --2- 172.21.15.84:0/3377598829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea371b0 0x5592aee12d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.473+0000 7f7ee77fe640 1 --2- 172.21.15.84:0/3377598829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea3f390 0x5592aee13260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.473+0000 7f7eecf76640 1 -- 172.21.15.84:0/3377598829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea371b0 msgr2=0x5592aee12d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:19.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.473+0000 7f7eecf76640 1 --2- 172.21.15.84:0/3377598829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea371b0 0x5592aee12d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.473+0000 7f7eecf76640 1 -- 172.21.15.84:0/3377598829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea3f390 msgr2=0x5592aee13260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:19.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.473+0000 7f7eecf76640 1 --2- 172.21.15.84:0/3377598829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea3f390 0x5592aee13260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.473+0000 7f7eecf76640 1 -- 172.21.15.84:0/3377598829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592aed35c90 con 0x5592aea60070 2024-09-21T03:53:19.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.473+0000 7f7ee77fe640 1 --2- 172.21.15.84:0/3377598829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea3f390 0x5592aee13260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:53:19.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.473+0000 7f7eecf76640 1 --2- 172.21.15.84:0/3377598829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea60070 0x5592aee137c0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00a9d20 tx=0x7f7ee00ad110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346d2bd484fd2200 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:19.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.473+0000 7f7ec77fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:53:19.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.473+0000 7f7ec77fe640 1 -- 172.21.15.84:0/3377598829 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee001f030 con 0x5592aea60070 2024-09-21T03:53:19.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.473+0000 7f7ec77fe640 1 -- 172.21.15.84:0/3377598829 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f7ee00acbb0 con 0x5592aea60070 2024-09-21T03:53:19.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.473+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/3377598829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ed800be30 con 0x5592aea60070 2024-09-21T03:53:19.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.473+0000 7f7ec77fe640 1 -- 172.21.15.84:0/3377598829 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7ee00d3020 con 0x5592aea60070 2024-09-21T03:53:19.483 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.473+0000 7f7ef4f4d740 10 client.17553 fetch_fsmap learned FSMap version 25 2024-09-21T03:53:19.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.473+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/3377598829 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5592aee21b00 con 0x5592aea60070 2024-09-21T03:53:19.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.474+0000 7f7ec77fe640 1 -- 172.21.15.84:0/3377598829 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ed800be30 con 0x5592aea60070 2024-09-21T03:53:19.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.474+0000 7f7ec77fe640 1 -- 172.21.15.84:0/3377598829 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7ee000f040 con 0x5592aea60070 2024-09-21T03:53:19.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.474+0000 7f7ef4f4d740 10 client.17553 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:53:19.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.474+0000 7f7ef4f4d740 10 client.17553 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:53:19.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.474+0000 7f7ef4f4d740 20 client.17553 populate_metadata read hostname 'smithi084' 2024-09-21T03:53:19.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.474+0000 7f7ef4f4d740 1 --2- 172.21.15.84:0/3377598829 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5592aea1e9f0 0x5592aee25040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.474+0000 7f7ef4f4d740 4 client.17553 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:53:19.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.474+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/3377598829 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592aed7fdf0 con 0x5592aea1e9f0 2024-09-21T03:53:19.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.474+0000 7f7ee7fff640 1 --2- 172.21.15.84:0/3377598829 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5592aea1e9f0 0x5592aee25040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.475+0000 7f7ec77fe640 10 client.17553 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:53:19.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.475+0000 7f7ee7fff640 1 --2- 172.21.15.84:0/3377598829 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5592aea1e9f0 0x5592aee25040 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dda608a00883ed1 server_cookie=c6425df3c5461ebd in_seq=0 out_seq=0 2024-09-21T03:53:19.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.475+0000 7f7ec77fe640 1 -- 172.21.15.84:0/3377598829 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5592aed7fdf0 con 0x5592aea1e9f0 2024-09-21T03:53:19.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.475+0000 7f7ec77fe640 10 client.17553 handle_command_reply: tid=0 2024-09-21T03:53:19.485 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.476+0000 7f7ef4f4d740 1 client.17553 shutdown 2024-09-21T03:53:19.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.476+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/3377598829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea60070 msgr2=0x5592aee137c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:19.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.476+0000 7f7ef4f4d740 1 --2- 172.21.15.84:0/3377598829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea60070 0x5592aee137c0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00a9d20 tx=0x7f7ee00ad110 comp rx=0 tx=0).stop 2024-09-21T03:53:19.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.476+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/3377598829 shutdown_connections 2024-09-21T03:53:19.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.476+0000 7f7ef4f4d740 1 --2- 172.21.15.84:0/3377598829 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5592aea1e9f0 0x5592aee25040 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.476+0000 7f7ef4f4d740 1 --2- 172.21.15.84:0/3377598829 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea60070 0x5592aee137c0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.476+0000 7f7ef4f4d740 1 --2- 172.21.15.84:0/3377598829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea3f390 0x5592aee13260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.476+0000 7f7ef4f4d740 1 --2- 172.21.15.84:0/3377598829 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea371b0 0x5592aee12d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.476+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/3377598829 >> 172.21.15.84:0/3377598829 conn(0x5592aea54460 msgr2=0x5592aee0a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:19.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.476+0000 7f7ec77fe640 0 client.17553 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:53:19.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.476+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/3377598829 shutdown_connections 2024-09-21T03:53:19.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.476+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/3377598829 wait complete. 2024-09-21T03:53:19.486 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.476+0000 7f7ef4f4d740 20 client.17553 trim_cache size 0 max 16384 2024-09-21T03:53:19.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.489+0000 7f7ef4f4d740 1 Processor -- start 2024-09-21T03:53:19.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.489+0000 7f7ef4f4d740 1 -- start start 2024-09-21T03:53:19.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.489+0000 7f7ef4f4d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea371b0 0x5592aee091a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.489+0000 7f7ef4f4d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea3f390 0x5592aee14c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.489+0000 7f7ef4f4d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea60070 0x5592aee1e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.489+0000 7f7ef4f4d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee81b1ec0 con 0x5592aea60070 2024-09-21T03:53:19.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.489+0000 7f7ef4f4d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee81af790 con 0x5592aea371b0 2024-09-21T03:53:19.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.489+0000 7f7ef4f4d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee81ad600 con 0x5592aea3f390 2024-09-21T03:53:19.492 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.489+0000 7f7eecf76640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea60070 0x5592aee1e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.489+0000 7f7eecf76640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea60070 0x5592aee1e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40546/0 (socket says 172.21.15.84:40546) 2024-09-21T03:53:19.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.489+0000 7f7eecf76640 1 -- 172.21.15.84:0/258671706 learned_addr learned my addr 172.21.15.84:0/258671706 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:19.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.489+0000 7f7ee77fe640 1 --2- 172.21.15.84:0/258671706 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea3f390 0x5592aee14c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.489+0000 7f7ee7fff640 1 --2- 172.21.15.84:0/258671706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea371b0 0x5592aee091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.490+0000 7f7eecf76640 1 -- 172.21.15.84:0/258671706 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea3f390 msgr2=0x5592aee14c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:19.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.490+0000 7f7eecf76640 1 --2- 172.21.15.84:0/258671706 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea3f390 0x5592aee14c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.490+0000 7f7eecf76640 1 -- 172.21.15.84:0/258671706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea371b0 msgr2=0x5592aee091a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:19.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.490+0000 7f7eecf76640 1 --2- 172.21.15.84:0/258671706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea371b0 0x5592aee091a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.490+0000 7f7eecf76640 1 -- 172.21.15.84:0/258671706 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592aee0a500 con 0x5592aea60070 2024-09-21T03:53:19.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.490+0000 7f7eecf76640 1 --2- 172.21.15.84:0/258671706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea60070 0x5592aee1e7a0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000efd0 tx=0x7f7ee00a9720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9919be17edb9a386 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:19.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.490+0000 7f7ecdffb640 1 -- 172.21.15.84:0/258671706 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee001f070 con 0x5592aea60070 2024-09-21T03:53:19.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.490+0000 7f7ecdffb640 1 -- 172.21.15.84:0/258671706 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ee00a7e50 con 0x5592aea60070 2024-09-21T03:53:19.493 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.490+0000 7f7ecdffb640 1 -- 172.21.15.84:0/258671706 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee005c040 con 0x5592aea60070 2024-09-21T03:53:19.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.491+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/258671706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea60070 msgr2=0x5592aee1e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:19.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.491+0000 7f7ef4f4d740 1 --2- 172.21.15.84:0/258671706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea60070 0x5592aee1e7a0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000efd0 tx=0x7f7ee00a9720 comp rx=0 tx=0).stop 2024-09-21T03:53:19.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.491+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/258671706 shutdown_connections 2024-09-21T03:53:19.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.491+0000 7f7ef4f4d740 1 --2- 172.21.15.84:0/258671706 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea60070 0x5592aee1e7a0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.491+0000 7f7ef4f4d740 1 --2- 172.21.15.84:0/258671706 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea3f390 0x5592aee14c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.491+0000 7f7ef4f4d740 1 --2- 172.21.15.84:0/258671706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea371b0 0x5592aee091a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.491+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/258671706 >> 172.21.15.84:0/258671706 conn(0x5592aea54460 msgr2=0x5592aee1e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:19.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.491+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/258671706 shutdown_connections 2024-09-21T03:53:19.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.491+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/258671706 wait complete. 2024-09-21T03:53:19.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.491+0000 7f7ef4f4d740 1 -- start start 2024-09-21T03:53:19.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.492+0000 7f7ef4f4d740 1 Processor -- start 2024-09-21T03:53:19.496 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.492+0000 7f7ef4f4d740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea371b0 0x5592aee170d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.492+0000 7f7ef4f4d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea3f390 0x5592aee17610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.492+0000 7f7ef4f4d740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea60070 0x5592aee17b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.492+0000 7f7ef4f4d740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee81adc50 con 0x5592aea371b0 2024-09-21T03:53:19.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.492+0000 7f7ef4f4d740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee81af0c0 con 0x5592aea60070 2024-09-21T03:53:19.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.492+0000 7f7ef4f4d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee81ae320 con 0x5592aea3f390 2024-09-21T03:53:19.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.492+0000 7f7ef4f4d740 10 client.0 _ll_register_callbacks cb 0x7f7ee0009270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:53:19.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.492+0000 7f7ee7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea371b0 0x5592aee170d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.492+0000 7f7ee7fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea371b0 0x5592aee170d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40552/0 (socket says 172.21.15.84:40552) 2024-09-21T03:53:19.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.492+0000 7f7ee7fff640 1 -- 172.21.15.84:0/1122567832 learned_addr learned my addr 172.21.15.84:0/1122567832 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:19.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.492+0000 7f7ee77fe640 1 --2- 172.21.15.84:0/1122567832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea3f390 0x5592aee17610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.492+0000 7f7eecf76640 1 --2- 172.21.15.84:0/1122567832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea60070 0x5592aee17b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.492+0000 7f7ee7fff640 1 -- 172.21.15.84:0/1122567832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea3f390 msgr2=0x5592aee17610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:19.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.492+0000 7f7ee7fff640 1 --2- 172.21.15.84:0/1122567832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea3f390 0x5592aee17610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.492+0000 7f7ee7fff640 1 -- 172.21.15.84:0/1122567832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea60070 msgr2=0x5592aee17b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:19.497 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.492+0000 7f7ee7fff640 1 --2- 172.21.15.84:0/1122567832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea60070 0x5592aee17b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.492+0000 7f7ee7fff640 1 -- 172.21.15.84:0/1122567832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592aee92e10 con 0x5592aea371b0 2024-09-21T03:53:19.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.492+0000 7f7ee77fe640 1 --2- 172.21.15.84:0/1122567832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea3f390 0x5592aee17610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:19.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.492+0000 7f7eecf76640 1 --2- 172.21.15.84:0/1122567832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea60070 0x5592aee17b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:53:19.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.493+0000 7f7ee7fff640 1 --2- 172.21.15.84:0/1122567832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea371b0 0x5592aee170d0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f7ed800bd40 tx=0x7f7ed8003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22bb9dc80c2e6e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:19.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.493+0000 7f7ec77fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:53:19.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.493+0000 7f7ec77fe640 1 -- 172.21.15.84:0/1122567832 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8004340 con 0x5592aea371b0 2024-09-21T03:53:19.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.493+0000 7f7ec77fe640 1 -- 172.21.15.84:0/1122567832 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f7ed80035f0 con 0x5592aea371b0 2024-09-21T03:53:19.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.493+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/1122567832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ee00a7e50 con 0x5592aea371b0 2024-09-21T03:53:19.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.493+0000 7f7ec77fe640 1 -- 172.21.15.84:0/1122567832 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7ed803c050 con 0x5592aea371b0 2024-09-21T03:53:19.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.493+0000 7f7ef4f4d740 10 client.17559 fetch_fsmap learned FSMap version 25 2024-09-21T03:53:19.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.493+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/1122567832 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5592aee940c0 con 0x5592aea371b0 2024-09-21T03:53:19.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.493+0000 7f7ec77fe640 1 -- 172.21.15.84:0/1122567832 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ee00a7e50 con 0x5592aea371b0 2024-09-21T03:53:19.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.493+0000 7f7ec77fe640 1 -- 172.21.15.84:0/1122567832 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7ed802d070 con 0x5592aea371b0 2024-09-21T03:53:19.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.493+0000 7f7ef4f4d740 10 client.17559 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:53:19.498 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.493+0000 7f7ef4f4d740 10 client.17559 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:53:19.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.493+0000 7f7ef4f4d740 20 client.17559 populate_metadata read hostname 'smithi084' 2024-09-21T03:53:19.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.493+0000 7f7ef4f4d740 1 --2- 172.21.15.84:0/1122567832 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5592ae9f3da0 0x5592aee96630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:19.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.493+0000 7f7ef4f4d740 4 client.17559 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:53:19.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.493+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/1122567832 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5592aee0e8d0 con 0x5592ae9f3da0 2024-09-21T03:53:19.499 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.494+0000 7f7ee77fe640 1 --2- 172.21.15.84:0/1122567832 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5592ae9f3da0 0x5592aee96630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:19.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.494+0000 7f7ec77fe640 10 client.17559 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:53:19.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.494+0000 7f7ee77fe640 1 --2- 172.21.15.84:0/1122567832 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5592ae9f3da0 0x5592aee96630 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c31e834684025e83 server_cookie=97d662b7187e9530 in_seq=0 out_seq=0 2024-09-21T03:53:19.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.495+0000 7f7ec77fe640 1 -- 172.21.15.84:0/1122567832 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5592aee0e8d0 con 0x5592ae9f3da0 2024-09-21T03:53:19.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.495+0000 7f7ec77fe640 10 client.17559 handle_command_reply: tid=0 2024-09-21T03:53:19.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.495+0000 7f7ef4f4d740 1 client.17559 shutdown 2024-09-21T03:53:19.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.495+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/1122567832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea371b0 msgr2=0x5592aee170d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:19.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.495+0000 7f7ef4f4d740 1 --2- 172.21.15.84:0/1122567832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea371b0 0x5592aee170d0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f7ed800bd40 tx=0x7f7ed8003d70 comp rx=0 tx=0).stop 2024-09-21T03:53:19.500 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.495+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/1122567832 shutdown_connections 2024-09-21T03:53:19.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.495+0000 7f7ef4f4d740 1 --2- 172.21.15.84:0/1122567832 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5592ae9f3da0 0x5592aee96630 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.495+0000 7f7ef4f4d740 1 --2- 172.21.15.84:0/1122567832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5592aea60070 0x5592aee17b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.495+0000 7f7ef4f4d740 1 --2- 172.21.15.84:0/1122567832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5592aea3f390 0x5592aee17610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.495+0000 7f7ec77fe640 0 client.17559 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:53:19.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.495+0000 7f7ef4f4d740 1 --2- 172.21.15.84:0/1122567832 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5592aea371b0 0x5592aee170d0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.495+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/1122567832 >> 172.21.15.84:0/1122567832 conn(0x5592aea54460 msgr2=0x5592aee03bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:19.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.495+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/1122567832 shutdown_connections 2024-09-21T03:53:19.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.495+0000 7f7ef4f4d740 1 -- 172.21.15.84:0/1122567832 wait complete. 2024-09-21T03:53:19.501 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.495+0000 7f7ef4f4d740 20 client.17559 trim_cache size 0 max 16384 2024-09-21T03:53:19.501 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:53:19.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.496+0000 7f7eee9d9640 1 -- 172.21.15.84:0/1212781446 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7ed00b6680 msgr2=0x7f7ed00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:19.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.496+0000 7f7eee9d9640 1 --2- 172.21.15.84:0/1212781446 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7ed00b6680 0x7f7ed00b8b90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009230 tx=0x7f7edc031400 comp rx=0 tx=0).stop 2024-09-21T03:53:19.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.496+0000 7f7eee9d9640 1 -- 172.21.15.84:0/1212781446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee8109df0 msgr2=0x7f7ee819fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:19.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.496+0000 7f7eee9d9640 1 --2- 172.21.15.84:0/1212781446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee8109df0 0x7f7ee819fcc0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000eaa0 tx=0x7f7ee000ef60 comp rx=0 tx=0).stop 2024-09-21T03:53:19.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.496+0000 7f7eee9d9640 1 -- 172.21.15.84:0/1212781446 shutdown_connections 2024-09-21T03:53:19.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.496+0000 7f7eee9d9640 1 --2- 172.21.15.84:0/1212781446 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7ed00b6680 0x7f7ed00b8b90 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.496+0000 7f7eee9d9640 1 --2- 172.21.15.84:0/1212781446 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7ee8109df0 0x7f7ee819fcc0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.496+0000 7f7eee9d9640 1 --2- 172.21.15.84:0/1212781446 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7ee81094a0 0x7f7ee819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.502 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.496+0000 7f7eee9d9640 1 --2- 172.21.15.84:0/1212781446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ee8103b60 0x7f7ee819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:19.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.496+0000 7f7eee9d9640 1 -- 172.21.15.84:0/1212781446 >> 172.21.15.84:0/1212781446 conn(0x7f7ee807b850 msgr2=0x7f7ee8107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:19.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.496+0000 7f7eee9d9640 1 -- 172.21.15.84:0/1212781446 shutdown_connections 2024-09-21T03:53:19.503 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:19.496+0000 7f7eee9d9640 1 -- 172.21.15.84:0/1212781446 wait complete. 2024-09-21T03:53:20.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:19 smithi084 ceph-mon[30941]: pgmap v659: 97 pgs: 97 active+clean; 23 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 11 op/s 2024-09-21T03:53:20.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:19 smithi174 ceph-mon[34403]: pgmap v659: 97 pgs: 97 active+clean; 23 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 11 op/s 2024-09-21T03:53:20.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:19 smithi172 ceph-mon[34821]: pgmap v659: 97 pgs: 97 active+clean; 23 MiB data, 467 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 60 KiB/s wr, 11 op/s 2024-09-21T03:53:21.258 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:53:21.259 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:53:21.519 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:21.976 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:21 smithi084 ceph-mon[30941]: pgmap v660: 97 pgs: 97 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 11 op/s 2024-09-21T03:53:22.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.067+0000 7fa6708f5640 1 -- 172.21.15.84:0/4018992589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa66c102a60 msgr2=0x7fa66c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:22.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.067+0000 7fa6708f5640 1 --2- 172.21.15.84:0/4018992589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa66c102a60 0x7fa66c102e70 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fa65c009900 tx=0x7fa65c02a410 comp rx=0 tx=0).stop 2024-09-21T03:53:22.076 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.067+0000 7fa6708f5640 1 -- 172.21.15.84:0/4018992589 shutdown_connections 2024-09-21T03:53:22.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.067+0000 7fa6708f5640 1 --2- 172.21.15.84:0/4018992589 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa66c108cf0 0x7fa66c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.067+0000 7fa6708f5640 1 --2- 172.21.15.84:0/4018992589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa66c1083a0 0x7fa66c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.067+0000 7fa6708f5640 1 --2- 172.21.15.84:0/4018992589 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa66c102a60 0x7fa66c102e70 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.067+0000 7fa6708f5640 1 -- 172.21.15.84:0/4018992589 >> 172.21.15.84:0/4018992589 conn(0x7fa66c079760 msgr2=0x7fa66c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:22.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.067+0000 7fa6708f5640 1 -- 172.21.15.84:0/4018992589 shutdown_connections 2024-09-21T03:53:22.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.067+0000 7fa6708f5640 1 -- 172.21.15.84:0/4018992589 wait complete. 2024-09-21T03:53:22.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.067+0000 7fa6708f5640 1 Processor -- start 2024-09-21T03:53:22.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.068+0000 7fa6708f5640 1 -- start start 2024-09-21T03:53:22.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.068+0000 7fa6708f5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa66c102a60 0x7fa66c19c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:22.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.068+0000 7fa6708f5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa66c1083a0 0x7fa66c19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:22.077 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.068+0000 7fa6708f5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa66c108cf0 0x7fa66c1a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:22.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.068+0000 7fa6708f5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c1129b0 con 0x7fa66c102a60 2024-09-21T03:53:22.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.068+0000 7fa6708f5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c112830 con 0x7fa66c108cf0 2024-09-21T03:53:22.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.068+0000 7fa6708f5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c112b30 con 0x7fa66c1083a0 2024-09-21T03:53:22.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.068+0000 7fa66a59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa66c102a60 0x7fa66c19c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:22.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.068+0000 7fa66a59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa66c102a60 0x7fa66c19c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40570/0 (socket says 172.21.15.84:40570) 2024-09-21T03:53:22.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.068+0000 7fa66a59c640 1 -- 172.21.15.84:0/1782418045 learned_addr learned my addr 172.21.15.84:0/1782418045 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:22.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.068+0000 7fa66ad9d640 1 --2- 172.21.15.84:0/1782418045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa66c108cf0 0x7fa66c1a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:22.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.068+0000 7fa661d9b640 1 --2- 172.21.15.84:0/1782418045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa66c1083a0 0x7fa66c19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:22.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.068+0000 7fa66a59c640 1 -- 172.21.15.84:0/1782418045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa66c1083a0 msgr2=0x7fa66c19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:22.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.068+0000 7fa66a59c640 1 --2- 172.21.15.84:0/1782418045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa66c1083a0 0x7fa66c19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.068+0000 7fa66a59c640 1 -- 172.21.15.84:0/1782418045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa66c108cf0 msgr2=0x7fa66c1a1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:22.078 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.068+0000 7fa66a59c640 1 --2- 172.21.15.84:0/1782418045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa66c108cf0 0x7fa66c1a1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.068+0000 7fa66a59c640 1 -- 172.21.15.84:0/1782418045 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66c1a2650 con 0x7fa66c102a60 2024-09-21T03:53:22.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.068+0000 7fa661d9b640 1 --2- 172.21.15.84:0/1782418045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa66c1083a0 0x7fa66c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:53:22.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.069+0000 7fa66a59c640 1 --2- 172.21.15.84:0/1782418045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa66c102a60 0x7fa66c19c6e0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fa65c006010 tx=0x7fa65c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:22.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.069+0000 7fa663fff640 1 -- 172.21.15.84:0/1782418045 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c03f030 con 0x7fa66c102a60 2024-09-21T03:53:22.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.069+0000 7fa663fff640 1 -- 172.21.15.84:0/1782418045 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa65c003800 con 0x7fa66c102a60 2024-09-21T03:53:22.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.069+0000 7fa6708f5640 1 -- 172.21.15.84:0/1782418045 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa66c1a28e0 con 0x7fa66c102a60 2024-09-21T03:53:22.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.069+0000 7fa663fff640 1 -- 172.21.15.84:0/1782418045 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c035070 con 0x7fa66c102a60 2024-09-21T03:53:22.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.069+0000 7fa6708f5640 1 -- 172.21.15.84:0/1782418045 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa66c1a90a0 con 0x7fa66c102a60 2024-09-21T03:53:22.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.072+0000 7fa676e69740 1 Processor -- start 2024-09-21T03:53:22.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.072+0000 7fa663fff640 1 -- 172.21.15.84:0/1782418045 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fa65c003cb0 con 0x7fa66c102a60 2024-09-21T03:53:22.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.072+0000 7fa676e69740 1 -- start start 2024-09-21T03:53:22.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.072+0000 7fa676e69740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556a1c429350 0x556a1c7d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:22.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.072+0000 7fa676e69740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c400490 0x556a1c7d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:22.079 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.072+0000 7fa676e69740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c408670 0x556a1c7d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.072+0000 7fa676e69740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556a1c746e60 con 0x556a1c408670 2024-09-21T03:53:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.072+0000 7fa676e69740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556a1c736290 con 0x556a1c400490 2024-09-21T03:53:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.072+0000 7fa676e69740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x556a1c73a0a0 con 0x556a1c429350 2024-09-21T03:53:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.072+0000 7fa661d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c408670 0x556a1c7d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.072+0000 7fa661d9b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c408670 0x556a1c7d0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40582/0 (socket says 172.21.15.84:40582) 2024-09-21T03:53:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.072+0000 7fa661d9b640 1 -- 172.21.15.84:0/342474288 learned_addr learned my addr 172.21.15.84:0/342474288 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.073+0000 7fa66a59c640 1 --2- 172.21.15.84:0/342474288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c400490 0x556a1c7d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.073+0000 7fa66ad9d640 1 --2- 172.21.15.84:0/342474288 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556a1c429350 0x556a1c7d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.073+0000 7fa663fff640 1 --2- 172.21.15.84:0/1782418045 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa6580b6680 0x7fa6580b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.073+0000 7fa661d9b640 1 -- 172.21.15.84:0/342474288 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556a1c429350 msgr2=0x556a1c7d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.073+0000 7fa661d9b640 1 --2- 172.21.15.84:0/342474288 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556a1c429350 0x556a1c7d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.073+0000 7fa661d9b640 1 -- 172.21.15.84:0/342474288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c400490 msgr2=0x556a1c7d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.073+0000 7fa661d9b640 1 --2- 172.21.15.84:0/342474288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c400490 0x556a1c7d0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.080 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.073+0000 7fa661d9b640 1 -- 172.21.15.84:0/342474288 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a1c494930 con 0x556a1c408670 2024-09-21T03:53:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.073+0000 7fa66a59c640 1 --2- 172.21.15.84:0/342474288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c400490 0x556a1c7d0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.073+0000 7fa66ad9d640 1 --2- 172.21.15.84:0/1782418045 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa6580b6680 0x7fa6580b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.073+0000 7fa663fff640 1 -- 172.21.15.84:0/1782418045 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7fa65c1080c0 con 0x7fa66c102a60 2024-09-21T03:53:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.073+0000 7fa661d9b640 1 --2- 172.21.15.84:0/342474288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c408670 0x556a1c7d0eb0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fa65400bae0 tx=0x7fa65400d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4462c87b5126314c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.073+0000 7fa660d99640 1 -- 172.21.15.84:0/342474288 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa654017420 con 0x556a1c408670 2024-09-21T03:53:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.073+0000 7fa660d99640 1 -- 172.21.15.84:0/342474288 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa654017a70 con 0x556a1c408670 2024-09-21T03:53:22.081 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.073+0000 7fa660d99640 1 -- 172.21.15.84:0/342474288 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65400fa50 con 0x556a1c408670 2024-09-21T03:53:22.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.074+0000 7fa676e69740 1 -- 172.21.15.84:0/342474288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c408670 msgr2=0x556a1c7d0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:22.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.074+0000 7fa676e69740 1 --2- 172.21.15.84:0/342474288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c408670 0x556a1c7d0eb0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fa65400bae0 tx=0x7fa65400d340 comp rx=0 tx=0).stop 2024-09-21T03:53:22.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.074+0000 7fa66ad9d640 1 --2- 172.21.15.84:0/1782418045 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa6580b6680 0x7fa6580b8b90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa66400a2c0 tx=0x7fa664004a40 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:22.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.075+0000 7fa676e69740 1 -- 172.21.15.84:0/342474288 shutdown_connections 2024-09-21T03:53:22.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.075+0000 7fa676e69740 1 --2- 172.21.15.84:0/342474288 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c408670 0x556a1c7d0eb0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.075+0000 7fa676e69740 1 --2- 172.21.15.84:0/342474288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c400490 0x556a1c7d0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.075+0000 7fa676e69740 1 --2- 172.21.15.84:0/342474288 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556a1c429350 0x556a1c7d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.075+0000 7fa676e69740 1 -- 172.21.15.84:0/342474288 >> 172.21.15.84:0/342474288 conn(0x556a1c41d740 msgr2=0x556a1c7ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:22.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.075+0000 7fa676e69740 1 -- 172.21.15.84:0/342474288 shutdown_connections 2024-09-21T03:53:22.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.075+0000 7fa676e69740 1 -- 172.21.15.84:0/342474288 wait complete. 2024-09-21T03:53:22.085 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.075+0000 7fa676e69740 1 -- start start 2024-09-21T03:53:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.075+0000 7fa676e69740 1 Processor -- start 2024-09-21T03:53:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa676e69740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556a1c400490 0x556a1c7dbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa676e69740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c408670 0x556a1c7dc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa676e69740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c429350 0x556a1c7e7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa676e69740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x556a1c597890 con 0x556a1c429350 2024-09-21T03:53:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa676e69740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556a1c6d0d40 con 0x556a1c408670 2024-09-21T03:53:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa676e69740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x556a1c7dec10 con 0x556a1c400490 2024-09-21T03:53:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa676e69740 10 client.0 _ll_register_callbacks cb 0x556a1c734c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:53:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa66ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c429350 0x556a1c7e7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa66ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c429350 0x556a1c7e7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40594/0 (socket says 172.21.15.84:40594) 2024-09-21T03:53:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa66ad9d640 1 -- 172.21.15.84:0/416875266 learned_addr learned my addr 172.21.15.84:0/416875266 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa66a59c640 1 --2- 172.21.15.84:0/416875266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556a1c400490 0x556a1c7dbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa661d9b640 1 --2- 172.21.15.84:0/416875266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c408670 0x556a1c7dc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:22.086 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa66ad9d640 1 -- 172.21.15.84:0/416875266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556a1c400490 msgr2=0x556a1c7dbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:22.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa66ad9d640 1 --2- 172.21.15.84:0/416875266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556a1c400490 0x556a1c7dbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa66ad9d640 1 -- 172.21.15.84:0/416875266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c408670 msgr2=0x556a1c7dc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:22.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa66ad9d640 1 --2- 172.21.15.84:0/416875266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c408670 0x556a1c7dc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa66ad9d640 1 -- 172.21.15.84:0/416875266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a1c7e8490 con 0x556a1c429350 2024-09-21T03:53:22.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa66ad9d640 1 --2- 172.21.15.84:0/416875266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c429350 0x556a1c7e7f00 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fa66400a720 tx=0x7fa664004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffeedbef359afa64 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:22.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa651ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:53:22.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa651ffb640 1 -- 172.21.15.84:0/416875266 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa664027670 con 0x556a1c429350 2024-09-21T03:53:22.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa651ffb640 1 -- 172.21.15.84:0/416875266 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7fa664027810 con 0x556a1c429350 2024-09-21T03:53:22.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.076+0000 7fa676e69740 1 -- 172.21.15.84:0/416875266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa654017a70 con 0x556a1c429350 2024-09-21T03:53:22.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.077+0000 7fa651ffb640 1 -- 172.21.15.84:0/416875266 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa664027a10 con 0x556a1c429350 2024-09-21T03:53:22.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.077+0000 7fa676e69740 10 client.17571 fetch_fsmap learned FSMap version 25 2024-09-21T03:53:22.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.077+0000 7fa676e69740 1 -- 172.21.15.84:0/416875266 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556a1c7eae00 con 0x556a1c429350 2024-09-21T03:53:22.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.077+0000 7fa651ffb640 1 -- 172.21.15.84:0/416875266 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa654017a70 con 0x556a1c429350 2024-09-21T03:53:22.087 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.077+0000 7fa651ffb640 1 -- 172.21.15.84:0/416875266 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa66401b530 con 0x556a1c429350 2024-09-21T03:53:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.077+0000 7fa676e69740 10 client.17571 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:53:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.077+0000 7fa676e69740 10 client.17571 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:53:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.077+0000 7fa676e69740 20 client.17571 populate_metadata read hostname 'smithi084' 2024-09-21T03:53:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.077+0000 7fa676e69740 1 --2- 172.21.15.84:0/416875266 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556a1c3e7cd0 0x556a1c7ee370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.077+0000 7fa676e69740 4 client.17571 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:53:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.077+0000 7fa676e69740 1 -- 172.21.15.84:0/416875266 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a1c748db0 con 0x556a1c3e7cd0 2024-09-21T03:53:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.077+0000 7fa66a59c640 1 --2- 172.21.15.84:0/416875266 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556a1c3e7cd0 0x556a1c7ee370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.078+0000 7fa651ffb640 10 client.17571 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:53:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.078+0000 7fa66a59c640 1 --2- 172.21.15.84:0/416875266 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556a1c3e7cd0 0x556a1c7ee370 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7da9e15641cc19 server_cookie=351b29ac402e0b23 in_seq=0 out_seq=0 2024-09-21T03:53:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.079+0000 7fa651ffb640 1 -- 172.21.15.84:0/416875266 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556a1c748db0 con 0x556a1c3e7cd0 2024-09-21T03:53:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.079+0000 7fa651ffb640 10 client.17571 handle_command_reply: tid=0 2024-09-21T03:53:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.079+0000 7fa676e69740 1 client.17571 shutdown 2024-09-21T03:53:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.079+0000 7fa676e69740 1 -- 172.21.15.84:0/416875266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c429350 msgr2=0x556a1c7e7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:22.088 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.079+0000 7fa676e69740 1 --2- 172.21.15.84:0/416875266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c429350 0x556a1c7e7f00 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fa66400a720 tx=0x7fa664004ab0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.079+0000 7fa676e69740 1 -- 172.21.15.84:0/416875266 shutdown_connections 2024-09-21T03:53:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.079+0000 7fa676e69740 1 --2- 172.21.15.84:0/416875266 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556a1c3e7cd0 0x556a1c7ee370 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.079+0000 7fa676e69740 1 --2- 172.21.15.84:0/416875266 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c429350 0x556a1c7e7f00 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.079+0000 7fa676e69740 1 --2- 172.21.15.84:0/416875266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c408670 0x556a1c7dc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.079+0000 7fa676e69740 1 --2- 172.21.15.84:0/416875266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556a1c400490 0x556a1c7dbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.079+0000 7fa651ffb640 0 client.17571 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:53:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.079+0000 7fa676e69740 1 -- 172.21.15.84:0/416875266 >> 172.21.15.84:0/416875266 conn(0x556a1c41d740 msgr2=0x556a1c7d35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.079+0000 7fa676e69740 1 -- 172.21.15.84:0/416875266 shutdown_connections 2024-09-21T03:53:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.079+0000 7fa676e69740 1 -- 172.21.15.84:0/416875266 wait complete. 2024-09-21T03:53:22.089 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.079+0000 7fa676e69740 20 client.17571 trim_cache size 0 max 16384 2024-09-21T03:53:22.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.096+0000 7fa676e69740 1 Processor -- start 2024-09-21T03:53:22.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.096+0000 7fa676e69740 1 -- start start 2024-09-21T03:53:22.099 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.096+0000 7fa676e69740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c400490 0x556a1c7e7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.096+0000 7fa676e69740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556a1c408670 0x556a1c7d6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.096+0000 7fa676e69740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c429350 0x556a1c7d8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.096+0000 7fa676e69740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c1b40e0 con 0x556a1c400490 2024-09-21T03:53:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.096+0000 7fa676e69740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c1b19b0 con 0x556a1c429350 2024-09-21T03:53:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.096+0000 7fa676e69740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c1af820 con 0x556a1c408670 2024-09-21T03:53:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.096+0000 7fa66a59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c400490 0x556a1c7e7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.096+0000 7fa66a59c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c400490 0x556a1c7e7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40598/0 (socket says 172.21.15.84:40598) 2024-09-21T03:53:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.096+0000 7fa66a59c640 1 -- 172.21.15.84:0/2415955531 learned_addr learned my addr 172.21.15.84:0/2415955531 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.097+0000 7fa66a59c640 1 -- 172.21.15.84:0/2415955531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556a1c408670 msgr2=0x556a1c7d6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.097+0000 7fa66a59c640 1 --2- 172.21.15.84:0/2415955531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556a1c408670 0x556a1c7d6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.097+0000 7fa66a59c640 1 -- 172.21.15.84:0/2415955531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c429350 msgr2=0x556a1c7d8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.097+0000 7fa66a59c640 1 --2- 172.21.15.84:0/2415955531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c429350 0x556a1c7d8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.097+0000 7fa66a59c640 1 -- 172.21.15.84:0/2415955531 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a1c7d7630 con 0x556a1c400490 2024-09-21T03:53:22.100 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.097+0000 7fa66a59c640 1 --2- 172.21.15.84:0/2415955531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c400490 0x556a1c7e7e00 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0cdc60 tx=0x7fa65c10a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf0b3fb93b1d176 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:22.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.097+0000 7fa653fff640 1 -- 172.21.15.84:0/2415955531 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c049040 con 0x556a1c400490 2024-09-21T03:53:22.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.097+0000 7fa653fff640 1 -- 172.21.15.84:0/2415955531 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa65c0ce660 con 0x556a1c400490 2024-09-21T03:53:22.101 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.097+0000 7fa653fff640 1 -- 172.21.15.84:0/2415955531 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c0d74f0 con 0x556a1c400490 2024-09-21T03:53:22.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.098+0000 7fa676e69740 1 -- 172.21.15.84:0/2415955531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c400490 msgr2=0x556a1c7e7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:22.103 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.098+0000 7fa676e69740 1 --2- 172.21.15.84:0/2415955531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c400490 0x556a1c7e7e00 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0cdc60 tx=0x7fa65c10a5d0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.098+0000 7fa676e69740 1 -- 172.21.15.84:0/2415955531 shutdown_connections 2024-09-21T03:53:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.098+0000 7fa676e69740 1 --2- 172.21.15.84:0/2415955531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c429350 0x556a1c7d8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.098+0000 7fa676e69740 1 --2- 172.21.15.84:0/2415955531 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556a1c408670 0x556a1c7d6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.098+0000 7fa676e69740 1 --2- 172.21.15.84:0/2415955531 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c400490 0x556a1c7e7e00 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.098+0000 7fa676e69740 1 -- 172.21.15.84:0/2415955531 >> 172.21.15.84:0/2415955531 conn(0x556a1c41d740 msgr2=0x556a1c7da620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.098+0000 7fa676e69740 1 -- 172.21.15.84:0/2415955531 shutdown_connections 2024-09-21T03:53:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.098+0000 7fa676e69740 1 -- 172.21.15.84:0/2415955531 wait complete. 2024-09-21T03:53:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.098+0000 7fa676e69740 1 -- start start 2024-09-21T03:53:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.098+0000 7fa676e69740 1 Processor -- start 2024-09-21T03:53:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa676e69740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c400490 0x556a1c7e08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa676e69740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556a1c408670 0x556a1c7e0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa676e69740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c429350 0x556a1c851e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa676e69740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c1afe70 con 0x556a1c429350 2024-09-21T03:53:22.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa676e69740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c1b12e0 con 0x556a1c400490 2024-09-21T03:53:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa676e69740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c1b0540 con 0x556a1c408670 2024-09-21T03:53:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa676e69740 10 client.0 _ll_register_callbacks cb 0x7fa66400ab90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:53:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa66ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c429350 0x556a1c851e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa66ad9d640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c429350 0x556a1c851e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40612/0 (socket says 172.21.15.84:40612) 2024-09-21T03:53:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa66ad9d640 1 -- 172.21.15.84:0/3981594388 learned_addr learned my addr 172.21.15.84:0/3981594388 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa66a59c640 1 --2- 172.21.15.84:0/3981594388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c400490 0x556a1c7e08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa661d9b640 1 --2- 172.21.15.84:0/3981594388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556a1c408670 0x556a1c7e0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa66ad9d640 1 -- 172.21.15.84:0/3981594388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556a1c408670 msgr2=0x556a1c7e0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa66ad9d640 1 --2- 172.21.15.84:0/3981594388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556a1c408670 0x556a1c7e0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa66ad9d640 1 -- 172.21.15.84:0/3981594388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c400490 msgr2=0x556a1c7e08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa66ad9d640 1 --2- 172.21.15.84:0/3981594388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c400490 0x556a1c7e08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa66ad9d640 1 -- 172.21.15.84:0/3981594388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a1c8524b0 con 0x556a1c429350 2024-09-21T03:53:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa66a59c640 1 --2- 172.21.15.84:0/3981594388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c400490 0x556a1c7e08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:53:22.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa66ad9d640 1 --2- 172.21.15.84:0/3981594388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c429350 0x556a1c851e40 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fa664011010 tx=0x7fa66400ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b26e2473f3df54 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:22.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa651ffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:53:22.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa651ffb640 1 -- 172.21.15.84:0/3981594388 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa664027470 con 0x556a1c429350 2024-09-21T03:53:22.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa651ffb640 1 -- 172.21.15.84:0/3981594388 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7fa664027610 con 0x556a1c429350 2024-09-21T03:53:22.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.099+0000 7fa676e69740 1 -- 172.21.15.84:0/3981594388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa65c0ce660 con 0x556a1c429350 2024-09-21T03:53:22.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.100+0000 7fa651ffb640 1 -- 172.21.15.84:0/3981594388 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa664040050 con 0x556a1c429350 2024-09-21T03:53:22.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.100+0000 7fa676e69740 10 client.17577 fetch_fsmap learned FSMap version 25 2024-09-21T03:53:22.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.100+0000 7fa676e69740 1 -- 172.21.15.84:0/3981594388 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556a1c859910 con 0x556a1c429350 2024-09-21T03:53:22.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.100+0000 7fa651ffb640 1 -- 172.21.15.84:0/3981594388 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa65c0ce660 con 0x556a1c429350 2024-09-21T03:53:22.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.100+0000 7fa651ffb640 1 -- 172.21.15.84:0/3981594388 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa664031ab0 con 0x556a1c429350 2024-09-21T03:53:22.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.100+0000 7fa676e69740 10 client.17577 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:53:22.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.100+0000 7fa676e69740 10 client.17577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:53:22.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.100+0000 7fa676e69740 20 client.17577 populate_metadata read hostname 'smithi084' 2024-09-21T03:53:22.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.100+0000 7fa676e69740 1 --2- 172.21.15.84:0/3981594388 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556a1c3bd080 0x556a1c85c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:22.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.100+0000 7fa676e69740 4 client.17577 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:53:22.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.100+0000 7fa676e69740 1 -- 172.21.15.84:0/3981594388 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556a1c744860 con 0x556a1c3bd080 2024-09-21T03:53:22.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.100+0000 7fa66a59c640 1 --2- 172.21.15.84:0/3981594388 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556a1c3bd080 0x556a1c85c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:22.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.101+0000 7fa651ffb640 10 client.17577 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:53:22.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.101+0000 7fa66a59c640 1 --2- 172.21.15.84:0/3981594388 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556a1c3bd080 0x556a1c85c150 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36ed0351a936a758 server_cookie=872df9db9a27e227 in_seq=0 out_seq=0 2024-09-21T03:53:22.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.103+0000 7fa651ffb640 1 -- 172.21.15.84:0/3981594388 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556a1c744860 con 0x556a1c3bd080 2024-09-21T03:53:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.103+0000 7fa651ffb640 10 client.17577 handle_command_reply: tid=0 2024-09-21T03:53:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.103+0000 7fa676e69740 1 client.17577 shutdown 2024-09-21T03:53:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.103+0000 7fa676e69740 1 -- 172.21.15.84:0/3981594388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c429350 msgr2=0x556a1c851e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.103+0000 7fa676e69740 1 --2- 172.21.15.84:0/3981594388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c429350 0x556a1c851e40 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fa664011010 tx=0x7fa66400ff30 comp rx=0 tx=0).stop 2024-09-21T03:53:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.103+0000 7fa676e69740 1 -- 172.21.15.84:0/3981594388 shutdown_connections 2024-09-21T03:53:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.103+0000 7fa676e69740 1 --2- 172.21.15.84:0/3981594388 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x556a1c3bd080 0x556a1c85c150 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.103+0000 7fa651ffb640 0 client.17577 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:53:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.103+0000 7fa676e69740 1 --2- 172.21.15.84:0/3981594388 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x556a1c429350 0x556a1c851e40 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.103+0000 7fa676e69740 1 --2- 172.21.15.84:0/3981594388 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x556a1c408670 0x556a1c7e0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.103+0000 7fa676e69740 1 --2- 172.21.15.84:0/3981594388 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556a1c400490 0x556a1c7e08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.103+0000 7fa676e69740 1 -- 172.21.15.84:0/3981594388 >> 172.21.15.84:0/3981594388 conn(0x556a1c41d740 msgr2=0x556a1c7d1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.103+0000 7fa676e69740 1 -- 172.21.15.84:0/3981594388 shutdown_connections 2024-09-21T03:53:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.103+0000 7fa676e69740 1 -- 172.21.15.84:0/3981594388 wait complete. 2024-09-21T03:53:22.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.103+0000 7fa676e69740 20 client.17577 trim_cache size 0 max 16384 2024-09-21T03:53:22.109 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:53:22.109 INFO:teuthology.orchestra.run.smithi084.stdout: "return_code": 0, 2024-09-21T03:53:22.109 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_tag": "31a6ce4e-761a-4c6c-86d8-849dce60d2f5", 2024-09-21T03:53:22.109 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": "asynchronous" 2024-09-21T03:53:22.109 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:53:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.104+0000 7fa6708f5640 1 -- 172.21.15.84:0/1782418045 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa6580b6680 msgr2=0x7fa6580b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.104+0000 7fa6708f5640 1 --2- 172.21.15.84:0/1782418045 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa6580b6680 0x7fa6580b8b90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa66400a2c0 tx=0x7fa664004a40 comp rx=0 tx=0).stop 2024-09-21T03:53:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.104+0000 7fa6708f5640 1 -- 172.21.15.84:0/1782418045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa66c102a60 msgr2=0x7fa66c19c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.104+0000 7fa6708f5640 1 --2- 172.21.15.84:0/1782418045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa66c102a60 0x7fa66c19c6e0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fa65c006010 tx=0x7fa65c0042f0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.104+0000 7fa6708f5640 1 -- 172.21.15.84:0/1782418045 shutdown_connections 2024-09-21T03:53:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.104+0000 7fa6708f5640 1 --2- 172.21.15.84:0/1782418045 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fa6580b6680 0x7fa6580b8b90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.104+0000 7fa6708f5640 1 --2- 172.21.15.84:0/1782418045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa66c108cf0 0x7fa66c1a1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.104+0000 7fa6708f5640 1 --2- 172.21.15.84:0/1782418045 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa66c1083a0 0x7fa66c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.104+0000 7fa6708f5640 1 --2- 172.21.15.84:0/1782418045 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fa66c102a60 0x7fa66c19c6e0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:22.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.104+0000 7fa6708f5640 1 -- 172.21.15.84:0/1782418045 >> 172.21.15.84:0/1782418045 conn(0x7fa66c079760 msgr2=0x7fa66c06bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:22.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.104+0000 7fa6708f5640 1 -- 172.21.15.84:0/1782418045 shutdown_connections 2024-09-21T03:53:22.111 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:22.104+0000 7fa6708f5640 1 -- 172.21.15.84:0/1782418045 wait complete. 2024-09-21T03:53:22.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:21 smithi174 ceph-mon[34403]: pgmap v660: 97 pgs: 97 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 11 op/s 2024-09-21T03:53:22.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:21 smithi172 ceph-mon[34821]: pgmap v660: 97 pgs: 97 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 11 op/s 2024-09-21T03:53:22.893 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:53:23.070 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:22 smithi084 ceph-mon[30941]: scrub queued for path: / 2024-09-21T03:53:23.070 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:22 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:53:23.070 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:22 smithi084 ceph-mon[30941]: scrub summary: active paths [/] 2024-09-21T03:53:23.070 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:22 smithi084 ceph-mon[30941]: scrub summary: idle+waiting paths [/] 2024-09-21T03:53:23.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:22 smithi174 ceph-mon[34403]: scrub queued for path: / 2024-09-21T03:53:23.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:22 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:53:23.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:22 smithi174 ceph-mon[34403]: scrub summary: active paths [/] 2024-09-21T03:53:23.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:22 smithi174 ceph-mon[34403]: scrub summary: idle+waiting paths [/] 2024-09-21T03:53:23.137 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:23.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:22 smithi172 ceph-mon[34821]: scrub queued for path: / 2024-09-21T03:53:23.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:22 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:53:23.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:22 smithi172 ceph-mon[34821]: scrub summary: active paths [/] 2024-09-21T03:53:23.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:22 smithi172 ceph-mon[34821]: scrub summary: idle+waiting paths [/] 2024-09-21T03:53:23.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.657+0000 7f884c361640 1 -- 172.21.15.84:0/517280903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88441094a0 msgr2=0x7f88441098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:23.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.657+0000 7f884c361640 1 --2- 172.21.15.84:0/517280903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88441094a0 0x7f88441098b0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f8834009900 tx=0x7f883402a410 comp rx=0 tx=0).stop 2024-09-21T03:53:23.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.657+0000 7f884c361640 1 -- 172.21.15.84:0/517280903 shutdown_connections 2024-09-21T03:53:23.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.657+0000 7f884c361640 1 --2- 172.21.15.84:0/517280903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8844109df0 0x7f8844110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.657+0000 7f884c361640 1 --2- 172.21.15.84:0/517280903 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f88441094a0 0x7f88441098b0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.657+0000 7f884c361640 1 --2- 172.21.15.84:0/517280903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8844103b60 0x7f8844103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.657+0000 7f884c361640 1 -- 172.21.15.84:0/517280903 >> 172.21.15.84:0/517280903 conn(0x7f884407b850 msgr2=0x7f884407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:23.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.657+0000 7f884c361640 1 -- 172.21.15.84:0/517280903 shutdown_connections 2024-09-21T03:53:23.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.657+0000 7f884c361640 1 -- 172.21.15.84:0/517280903 wait complete. 2024-09-21T03:53:23.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.657+0000 7f884c361640 1 Processor -- start 2024-09-21T03:53:23.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.657+0000 7f884c361640 1 -- start start 2024-09-21T03:53:23.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.658+0000 7f884c361640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8844103b60 0x7f884419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.658+0000 7f884c361640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88441094a0 0x7f884419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.658+0000 7f884c361640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8844109df0 0x7f884419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.658+0000 7f884c361640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f8844113ad0 con 0x7f8844109df0 2024-09-21T03:53:23.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.658+0000 7f884c361640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8844113950 con 0x7f88441094a0 2024-09-21T03:53:23.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.658+0000 7f884c361640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8844113c50 con 0x7f8844103b60 2024-09-21T03:53:23.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.658+0000 7f884a8fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8844109df0 0x7f884419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:23.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.658+0000 7f884a8fe640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8844109df0 0x7f884419fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40632/0 (socket says 172.21.15.84:40632) 2024-09-21T03:53:23.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.658+0000 7f884a8fe640 1 -- 172.21.15.84:0/1333689155 learned_addr learned my addr 172.21.15.84:0/1333689155 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:23.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.658+0000 7f884a0fd640 1 --2- 172.21.15.84:0/1333689155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8844103b60 0x7f884419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:23.677 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.658+0000 7f88498fc640 1 --2- 172.21.15.84:0/1333689155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88441094a0 0x7f884419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:23.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.658+0000 7f884a8fe640 1 -- 172.21.15.84:0/1333689155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8844103b60 msgr2=0x7f884419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:23.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.658+0000 7f884a8fe640 1 --2- 172.21.15.84:0/1333689155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8844103b60 0x7f884419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.658+0000 7f884a8fe640 1 -- 172.21.15.84:0/1333689155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88441094a0 msgr2=0x7f884419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:23.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.658+0000 7f884a8fe640 1 --2- 172.21.15.84:0/1333689155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88441094a0 0x7f884419ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.658+0000 7f884a8fe640 1 -- 172.21.15.84:0/1333689155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88441a0510 con 0x7f8844109df0 2024-09-21T03:53:23.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.658+0000 7f884a8fe640 1 --2- 172.21.15.84:0/1333689155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8844109df0 0x7f884419fde0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f883c00b970 tx=0x7f883c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:23.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.658+0000 7f883b7fe640 1 -- 172.21.15.84:0/1333689155 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c019070 con 0x7f8844109df0 2024-09-21T03:53:23.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.659+0000 7f883b7fe640 1 -- 172.21.15.84:0/1333689155 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f883c014440 con 0x7f8844109df0 2024-09-21T03:53:23.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.659+0000 7f884c361640 1 -- 172.21.15.84:0/1333689155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88441a0800 con 0x7f8844109df0 2024-09-21T03:53:23.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.659+0000 7f883b7fe640 1 -- 172.21.15.84:0/1333689155 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c0075d0 con 0x7f8844109df0 2024-09-21T03:53:23.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.659+0000 7f884c361640 1 -- 172.21.15.84:0/1333689155 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88441a6f60 con 0x7f8844109df0 2024-09-21T03:53:23.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.661+0000 7f88528d5740 1 Processor -- start 2024-09-21T03:53:23.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.662+0000 7f883b7fe640 1 -- 172.21.15.84:0/1333689155 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f883c01c070 con 0x7f8844109df0 2024-09-21T03:53:23.678 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.662+0000 7f88528d5740 1 -- start start 2024-09-21T03:53:23.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.662+0000 7f88528d5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622acce8070 0x5622ad08f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.662+0000 7f88528d5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622accbf1b0 0x5622ad08fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.662+0000 7f88528d5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622accc7390 0x5622ad0900d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.662+0000 7f88528d5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5622ad005e50 con 0x5622acce8070 2024-09-21T03:53:23.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.662+0000 7f88528d5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5622acff5280 con 0x5622accc7390 2024-09-21T03:53:23.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.662+0000 7f88528d5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5622acff9090 con 0x5622accbf1b0 2024-09-21T03:53:23.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.663+0000 7f88498fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622acce8070 0x5622ad08f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:23.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.663+0000 7f88498fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622acce8070 0x5622ad08f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40638/0 (socket says 172.21.15.84:40638) 2024-09-21T03:53:23.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.663+0000 7f88498fc640 1 -- 172.21.15.84:0/2985231108 learned_addr learned my addr 172.21.15.84:0/2985231108 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:23.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.663+0000 7f884a0fd640 1 --2- 172.21.15.84:0/2985231108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622accbf1b0 0x5622ad08fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:23.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.663+0000 7f88498fc640 1 -- 172.21.15.84:0/2985231108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622accbf1b0 msgr2=0x5622ad08fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:23.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.663+0000 7f88498fc640 1 --2- 172.21.15.84:0/2985231108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622accbf1b0 0x5622ad08fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.663+0000 7f88498fc640 1 -- 172.21.15.84:0/2985231108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622accc7390 msgr2=0x5622ad0900d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:23.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.663+0000 7f88498fc640 1 --2- 172.21.15.84:0/2985231108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622accc7390 0x5622ad0900d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.679 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.663+0000 7f88498fc640 1 -- 172.21.15.84:0/2985231108 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622acd53650 con 0x5622acce8070 2024-09-21T03:53:23.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.663+0000 7f883b7fe640 1 --2- 172.21.15.84:0/1333689155 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f88300b6680 0x7f88300b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.663+0000 7f88498fc640 1 --2- 172.21.15.84:0/2985231108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622acce8070 0x5622ad08f650 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f8834000c00 tx=0x7f8834005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a21f14a6c4b48ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:23.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.663+0000 7f884a0fd640 1 --2- 172.21.15.84:0/1333689155 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f88300b6680 0x7f88300b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:23.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.663+0000 7f8838d9a640 1 -- 172.21.15.84:0/2985231108 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8834035050 con 0x5622acce8070 2024-09-21T03:53:23.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.663+0000 7f883b7fe640 1 -- 172.21.15.84:0/1333689155 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f883c0e6bf0 con 0x7f8844109df0 2024-09-21T03:53:23.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.663+0000 7f8838d9a640 1 -- 172.21.15.84:0/2985231108 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88340316a0 con 0x5622acce8070 2024-09-21T03:53:23.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.664+0000 7f8838d9a640 1 -- 172.21.15.84:0/2985231108 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88340046c0 con 0x5622acce8070 2024-09-21T03:53:23.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.664+0000 7f88528d5740 1 -- 172.21.15.84:0/2985231108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622acce8070 msgr2=0x5622ad08f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:23.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.664+0000 7f884a0fd640 1 --2- 172.21.15.84:0/1333689155 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f88300b6680 0x7f88300b8b90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x5622ad08e2d0 tx=0x7f884000b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:23.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.664+0000 7f88528d5740 1 --2- 172.21.15.84:0/2985231108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622acce8070 0x5622ad08f650 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f8834000c00 tx=0x7f8834005ee0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.664+0000 7f88528d5740 1 -- 172.21.15.84:0/2985231108 shutdown_connections 2024-09-21T03:53:23.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.664+0000 7f88528d5740 1 --2- 172.21.15.84:0/2985231108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622accc7390 0x5622ad0900d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.664+0000 7f88528d5740 1 --2- 172.21.15.84:0/2985231108 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622accbf1b0 0x5622ad08fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.664+0000 7f88528d5740 1 --2- 172.21.15.84:0/2985231108 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622acce8070 0x5622ad08f650 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.680 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.664+0000 7f88528d5740 1 -- 172.21.15.84:0/2985231108 >> 172.21.15.84:0/2985231108 conn(0x5622accdc460 msgr2=0x5622ad08d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:23.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.664+0000 7f88528d5740 1 -- 172.21.15.84:0/2985231108 shutdown_connections 2024-09-21T03:53:23.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.665+0000 7f88528d5740 1 -- 172.21.15.84:0/2985231108 wait complete. 2024-09-21T03:53:23.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.665+0000 7f88528d5740 1 -- start start 2024-09-21T03:53:23.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.665+0000 7f88528d5740 1 Processor -- start 2024-09-21T03:53:23.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.665+0000 7f88528d5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622accbf1b0 0x5622ad09acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.665+0000 7f88528d5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622accc7390 0x5622ad09b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.665+0000 7f88528d5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622acce8070 0x5622ad0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.665+0000 7f88528d5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5622ace56700 con 0x5622accbf1b0 2024-09-21T03:53:23.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.665+0000 7f88528d5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5622acf90110 con 0x5622acce8070 2024-09-21T03:53:23.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.665+0000 7f88528d5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5622ad09ddd0 con 0x5622accc7390 2024-09-21T03:53:23.681 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.665+0000 7f88528d5740 10 client.0 _ll_register_callbacks cb 0x5622acfa9990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:53:23.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.665+0000 7f884a0fd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622accbf1b0 0x5622ad09acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:23.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.665+0000 7f884a0fd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622accbf1b0 0x5622ad09acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40648/0 (socket says 172.21.15.84:40648) 2024-09-21T03:53:23.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.665+0000 7f884a0fd640 1 -- 172.21.15.84:0/4075363001 learned_addr learned my addr 172.21.15.84:0/4075363001 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:23.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.666+0000 7f88498fc640 1 --2- 172.21.15.84:0/4075363001 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622accc7390 0x5622ad09b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:23.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.666+0000 7f884a0fd640 1 -- 172.21.15.84:0/4075363001 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622accc7390 msgr2=0x5622ad09b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:23.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.666+0000 7f884a0fd640 1 --2- 172.21.15.84:0/4075363001 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622accc7390 0x5622ad09b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.666+0000 7f884a0fd640 1 -- 172.21.15.84:0/4075363001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622acce8070 msgr2=0x5622ad0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:23.682 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.666+0000 7f884a0fd640 1 --2- 172.21.15.84:0/4075363001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622acce8070 0x5622ad0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.666+0000 7f884a0fd640 1 -- 172.21.15.84:0/4075363001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622acfbdc40 con 0x5622accbf1b0 2024-09-21T03:53:23.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.666+0000 7f88498fc640 1 --2- 172.21.15.84:0/4075363001 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622accc7390 0x5622ad09b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:53:23.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.666+0000 7f884a0fd640 1 --2- 172.21.15.84:0/4075363001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622accbf1b0 0x5622ad09acf0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f884001f520 tx=0x7f8840004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa335cabfb47897e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:23.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.666+0000 7f882dffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:53:23.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.666+0000 7f882dffb640 1 -- 172.21.15.84:0/4075363001 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884002c060 con 0x5622accbf1b0 2024-09-21T03:53:23.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.666+0000 7f88528d5740 1 -- 172.21.15.84:0/4075363001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88340316a0 con 0x5622accbf1b0 2024-09-21T03:53:23.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.666+0000 7f882dffb640 1 -- 172.21.15.84:0/4075363001 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f8840017030 con 0x5622accbf1b0 2024-09-21T03:53:23.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.666+0000 7f882dffb640 1 -- 172.21.15.84:0/4075363001 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f884001c6c0 con 0x5622accbf1b0 2024-09-21T03:53:23.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.666+0000 7f88528d5740 10 client.17589 fetch_fsmap learned FSMap version 25 2024-09-21T03:53:23.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.666+0000 7f88528d5740 1 -- 172.21.15.84:0/4075363001 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5622ad0a9b70 con 0x5622accbf1b0 2024-09-21T03:53:23.683 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.666+0000 7f882dffb640 1 -- 172.21.15.84:0/4075363001 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88340316a0 con 0x5622accbf1b0 2024-09-21T03:53:23.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.667+0000 7f882dffb640 1 -- 172.21.15.84:0/4075363001 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f88400109c0 con 0x5622accbf1b0 2024-09-21T03:53:23.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.667+0000 7f88528d5740 10 client.17589 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:53:23.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.667+0000 7f88528d5740 10 client.17589 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:53:23.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.667+0000 7f88528d5740 20 client.17589 populate_metadata read hostname 'smithi084' 2024-09-21T03:53:23.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.667+0000 7f88528d5740 1 --2- 172.21.15.84:0/4075363001 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5622acca69f0 0x5622ad0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.667+0000 7f88528d5740 4 client.17589 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:53:23.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.667+0000 7f88528d5740 1 -- 172.21.15.84:0/4075363001 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622ad007da0 con 0x5622acca69f0 2024-09-21T03:53:23.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.667+0000 7f88498fc640 1 --2- 172.21.15.84:0/4075363001 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5622acca69f0 0x5622ad0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:23.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.667+0000 7f882dffb640 10 client.17589 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:53:23.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.667+0000 7f88498fc640 1 --2- 172.21.15.84:0/4075363001 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5622acca69f0 0x5622ad0ad0c0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2c731bf3c0c767e server_cookie=5e6817b20e389889 in_seq=0 out_seq=0 2024-09-21T03:53:23.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.668+0000 7f882dffb640 1 -- 172.21.15.84:0/4075363001 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5622ad007da0 con 0x5622acca69f0 2024-09-21T03:53:23.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.668+0000 7f882dffb640 10 client.17589 handle_command_reply: tid=0 2024-09-21T03:53:23.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.668+0000 7f88528d5740 1 client.17589 shutdown 2024-09-21T03:53:23.684 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.668+0000 7f88528d5740 1 -- 172.21.15.84:0/4075363001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622accbf1b0 msgr2=0x5622ad09acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:23.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.668+0000 7f88528d5740 1 --2- 172.21.15.84:0/4075363001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622accbf1b0 0x5622ad09acf0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f884001f520 tx=0x7f8840004730 comp rx=0 tx=0).stop 2024-09-21T03:53:23.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.668+0000 7f88528d5740 1 -- 172.21.15.84:0/4075363001 shutdown_connections 2024-09-21T03:53:23.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.668+0000 7f88528d5740 1 --2- 172.21.15.84:0/4075363001 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5622acca69f0 0x5622ad0ad0c0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.668+0000 7f88528d5740 1 --2- 172.21.15.84:0/4075363001 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622acce8070 0x5622ad0a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.668+0000 7f88528d5740 1 --2- 172.21.15.84:0/4075363001 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622accc7390 0x5622ad09b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.668+0000 7f882dffb640 0 client.17589 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:53:23.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.668+0000 7f88528d5740 1 --2- 172.21.15.84:0/4075363001 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622accbf1b0 0x5622ad09acf0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.668+0000 7f88528d5740 1 -- 172.21.15.84:0/4075363001 >> 172.21.15.84:0/4075363001 conn(0x5622accdc460 msgr2=0x5622ad092830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:23.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.668+0000 7f88528d5740 1 -- 172.21.15.84:0/4075363001 shutdown_connections 2024-09-21T03:53:23.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.668+0000 7f88528d5740 1 -- 172.21.15.84:0/4075363001 wait complete. 2024-09-21T03:53:23.685 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.669+0000 7f88528d5740 20 client.17589 trim_cache size 0 max 16384 2024-09-21T03:53:23.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.686+0000 7f88528d5740 1 Processor -- start 2024-09-21T03:53:23.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.686+0000 7f88528d5740 1 -- start start 2024-09-21T03:53:23.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.686+0000 7f88528d5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622acca69f0 0x5622ad09c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.686+0000 7f88528d5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622accbf1b0 0x5622ad097ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.686+0000 7f88528d5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622accc7390 0x5622ad098420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.686+0000 7f88528d5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f88441b1e80 con 0x5622accbf1b0 2024-09-21T03:53:23.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.686+0000 7f88528d5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f88441af750 con 0x5622acca69f0 2024-09-21T03:53:23.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.686+0000 7f88528d5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f88441ad5c0 con 0x5622accc7390 2024-09-21T03:53:23.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.686+0000 7f88498fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622accbf1b0 0x5622ad097ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:23.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.686+0000 7f88498fc640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622accbf1b0 0x5622ad097ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40664/0 (socket says 172.21.15.84:40664) 2024-09-21T03:53:23.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.686+0000 7f88498fc640 1 -- 172.21.15.84:0/4029257642 learned_addr learned my addr 172.21.15.84:0/4029257642 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:23.689 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.686+0000 7f884a0fd640 1 --2- 172.21.15.84:0/4029257642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622acca69f0 0x5622ad09c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:23.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.686+0000 7f88498fc640 1 -- 172.21.15.84:0/4029257642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622accc7390 msgr2=0x5622ad098420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:23.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.686+0000 7f88498fc640 1 --2- 172.21.15.84:0/4029257642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622accc7390 0x5622ad098420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.686+0000 7f88498fc640 1 -- 172.21.15.84:0/4029257642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622acca69f0 msgr2=0x5622ad09c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:23.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.686+0000 7f88498fc640 1 --2- 172.21.15.84:0/4029257642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622acca69f0 0x5622ad09c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.686+0000 7f88498fc640 1 -- 172.21.15.84:0/4029257642 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622ad0924b0 con 0x5622accbf1b0 2024-09-21T03:53:23.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.687+0000 7f88498fc640 1 --2- 172.21.15.84:0/4029257642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622accbf1b0 0x5622ad097ee0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f8834005f70 tx=0x7f8834031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113dca449a5dd8a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:23.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.687+0000 7f882ffff640 1 -- 172.21.15.84:0/4029257642 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8834053070 con 0x5622accbf1b0 2024-09-21T03:53:23.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.687+0000 7f882ffff640 1 -- 172.21.15.84:0/4029257642 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8834031680 con 0x5622accbf1b0 2024-09-21T03:53:23.690 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.687+0000 7f882ffff640 1 -- 172.21.15.84:0/4029257642 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8834035040 con 0x5622accbf1b0 2024-09-21T03:53:23.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.687+0000 7f88528d5740 1 -- 172.21.15.84:0/4029257642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622accbf1b0 msgr2=0x5622ad097ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:23.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.687+0000 7f88528d5740 1 --2- 172.21.15.84:0/4029257642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622accbf1b0 0x5622ad097ee0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f8834005f70 tx=0x7f8834031400 comp rx=0 tx=0).stop 2024-09-21T03:53:23.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.688+0000 7f88528d5740 1 -- 172.21.15.84:0/4029257642 shutdown_connections 2024-09-21T03:53:23.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.688+0000 7f88528d5740 1 --2- 172.21.15.84:0/4029257642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622accc7390 0x5622ad098420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.688+0000 7f88528d5740 1 --2- 172.21.15.84:0/4029257642 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622accbf1b0 0x5622ad097ee0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.688+0000 7f88528d5740 1 --2- 172.21.15.84:0/4029257642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622acca69f0 0x5622ad09c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.688+0000 7f88528d5740 1 -- 172.21.15.84:0/4029257642 >> 172.21.15.84:0/4029257642 conn(0x5622accdc460 msgr2=0x5622ad09c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:23.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.688+0000 7f88528d5740 1 -- 172.21.15.84:0/4029257642 shutdown_connections 2024-09-21T03:53:23.694 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.688+0000 7f88528d5740 1 -- 172.21.15.84:0/4029257642 wait complete. 2024-09-21T03:53:23.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.688+0000 7f88528d5740 1 -- start start 2024-09-21T03:53:23.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.688+0000 7f88528d5740 1 Processor -- start 2024-09-21T03:53:23.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.688+0000 7f88528d5740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622acca69f0 0x5622ad0a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.688+0000 7f88528d5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622accbf1b0 0x5622ad0a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.688+0000 7f88528d5740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622accc7390 0x5622ad0a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.688+0000 7f88528d5740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f88441adc10 con 0x5622acca69f0 2024-09-21T03:53:23.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.688+0000 7f88528d5740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f88441af080 con 0x5622accc7390 2024-09-21T03:53:23.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.688+0000 7f88528d5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f88441ae2e0 con 0x5622accbf1b0 2024-09-21T03:53:23.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.688+0000 7f88528d5740 10 client.0 _ll_register_callbacks cb 0x7f884000bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:53:23.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.688+0000 7f884a0fd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622acca69f0 0x5622ad0a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:23.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.689+0000 7f884a0fd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622acca69f0 0x5622ad0a38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:40676/0 (socket says 172.21.15.84:40676) 2024-09-21T03:53:23.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.689+0000 7f884a0fd640 1 -- 172.21.15.84:0/2192238230 learned_addr learned my addr 172.21.15.84:0/2192238230 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:23.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.689+0000 7f88498fc640 1 --2- 172.21.15.84:0/2192238230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622accbf1b0 0x5622ad0a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:23.695 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.689+0000 7f884a8fe640 1 --2- 172.21.15.84:0/2192238230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622accc7390 0x5622ad0a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:23.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.689+0000 7f884a0fd640 1 -- 172.21.15.84:0/2192238230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622accbf1b0 msgr2=0x5622ad0a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:23.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.689+0000 7f884a0fd640 1 --2- 172.21.15.84:0/2192238230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622accbf1b0 0x5622ad0a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.689+0000 7f884a0fd640 1 -- 172.21.15.84:0/2192238230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622accc7390 msgr2=0x5622ad0a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:23.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.689+0000 7f884a0fd640 1 --2- 172.21.15.84:0/2192238230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622accc7390 0x5622ad0a13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.689+0000 7f884a0fd640 1 -- 172.21.15.84:0/2192238230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622ad0a1b40 con 0x5622acca69f0 2024-09-21T03:53:23.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.689+0000 7f884a0fd640 1 --2- 172.21.15.84:0/2192238230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622acca69f0 0x5622ad0a38b0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f8840000c00 tx=0x7f884001dba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a333610e77a0918 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:23.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.689+0000 7f882dffb640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:53:23.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.689+0000 7f882dffb640 1 -- 172.21.15.84:0/2192238230 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8840010630 con 0x5622acca69f0 2024-09-21T03:53:23.696 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.689+0000 7f882dffb640 1 -- 172.21.15.84:0/2192238230 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f88400107d0 con 0x5622acca69f0 2024-09-21T03:53:23.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.689+0000 7f88528d5740 1 -- 172.21.15.84:0/2192238230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8834031680 con 0x5622acca69f0 2024-09-21T03:53:23.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.689+0000 7f882dffb640 1 -- 172.21.15.84:0/2192238230 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8840040050 con 0x5622acca69f0 2024-09-21T03:53:23.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.689+0000 7f88528d5740 10 client.17595 fetch_fsmap learned FSMap version 25 2024-09-21T03:53:23.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.689+0000 7f88528d5740 1 -- 172.21.15.84:0/2192238230 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5622ad11bf00 con 0x5622acca69f0 2024-09-21T03:53:23.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.690+0000 7f882dffb640 1 -- 172.21.15.84:0/2192238230 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8834031680 con 0x5622acca69f0 2024-09-21T03:53:23.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.690+0000 7f882dffb640 1 -- 172.21.15.84:0/2192238230 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8840039060 con 0x5622acca69f0 2024-09-21T03:53:23.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.690+0000 7f88528d5740 10 client.17595 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:53:23.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.690+0000 7f88528d5740 10 client.17595 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:53:23.697 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.690+0000 7f88528d5740 20 client.17595 populate_metadata read hostname 'smithi084' 2024-09-21T03:53:23.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.690+0000 7f88528d5740 1 --2- 172.21.15.84:0/2192238230 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5622acce8070 0x5622ad11e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:23.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.690+0000 7f88528d5740 4 client.17595 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:53:23.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.690+0000 7f88528d5740 1 -- 172.21.15.84:0/2192238230 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5622ad003850 con 0x5622acce8070 2024-09-21T03:53:23.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.690+0000 7f88498fc640 1 --2- 172.21.15.84:0/2192238230 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5622acce8070 0x5622ad11e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:23.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.690+0000 7f88498fc640 1 --2- 172.21.15.84:0/2192238230 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5622acce8070 0x5622ad11e710 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23e93883b95648a5 server_cookie=9f866811641d78bc in_seq=0 out_seq=0 2024-09-21T03:53:23.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.690+0000 7f882dffb640 10 client.17595 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:53:23.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.691+0000 7f882dffb640 1 -- 172.21.15.84:0/2192238230 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5966 (crc 0 0 0) 0x5622ad003850 con 0x5622acce8070 2024-09-21T03:53:23.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.691+0000 7f882dffb640 10 client.17595 handle_command_reply: tid=0 2024-09-21T03:53:23.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.691+0000 7f88528d5740 1 client.17595 shutdown 2024-09-21T03:53:23.698 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.691+0000 7f88528d5740 1 -- 172.21.15.84:0/2192238230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622acca69f0 msgr2=0x5622ad0a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:23.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.691+0000 7f88528d5740 1 --2- 172.21.15.84:0/2192238230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622acca69f0 0x5622ad0a38b0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f8840000c00 tx=0x7f884001dba0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.691+0000 7f88528d5740 1 -- 172.21.15.84:0/2192238230 shutdown_connections 2024-09-21T03:53:23.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.691+0000 7f88528d5740 1 --2- 172.21.15.84:0/2192238230 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5622acce8070 0x5622ad11e710 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.691+0000 7f88528d5740 1 --2- 172.21.15.84:0/2192238230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5622accc7390 0x5622ad0a13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.691+0000 7f88528d5740 1 --2- 172.21.15.84:0/2192238230 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5622accbf1b0 0x5622ad0a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.691+0000 7f882dffb640 0 client.17595 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:53:23.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.691+0000 7f88528d5740 1 --2- 172.21.15.84:0/2192238230 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5622acca69f0 0x5622ad0a38b0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.691+0000 7f88528d5740 1 -- 172.21.15.84:0/2192238230 >> 172.21.15.84:0/2192238230 conn(0x5622accdc460 msgr2=0x5622ad09c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:23.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.691+0000 7f88528d5740 1 -- 172.21.15.84:0/2192238230 shutdown_connections 2024-09-21T03:53:23.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.691+0000 7f88528d5740 1 -- 172.21.15.84:0/2192238230 wait complete. 2024-09-21T03:53:23.699 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.691+0000 7f88528d5740 20 client.17595 trim_cache size 0 max 16384 2024-09-21T03:53:23.700 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:53:23.700 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:53:23.700 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": { 2024-09-21T03:53:23.700 INFO:teuthology.orchestra.run.smithi084.stdout: "31a6ce4e-761a-4c6c-86d8-849dce60d2f5": { 2024-09-21T03:53:23.700 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.700 INFO:teuthology.orchestra.run.smithi084.stdout: "tag": "31a6ce4e-761a-4c6c-86d8-849dce60d2f5", 2024-09-21T03:53:23.700 INFO:teuthology.orchestra.run.smithi084.stdout: "options": "recursive,force" 2024-09-21T03:53:23.700 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:53:23.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:23.700 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:53:23.700 INFO:teuthology.orchestra.run.smithi084.stdout: "31a6ce4e-761a-4c6c-86d8-849dce60d2f5": { 2024-09-21T03:53:23.701 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:53:22.101362+0000", 2024-09-21T03:53:23.701 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.701 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:23.701 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:23.701 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:23.701 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:23.701 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:23.701 INFO:teuthology.orchestra.run.smithi084.stdout: "1583169c-207f-40ad-b200-4ef92de62783": { 2024-09-21T03:53:23.701 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:52:29.382669+0000", 2024-09-21T03:53:23.701 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.701 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:23.701 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:23.701 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:23.701 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: "d85cdf50-3fc8-467d-942f-2b77981ba106": { 2024-09-21T03:53:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:43.684286+0000", 2024-09-21T03:53:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:53:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:53:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.702 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "60214753-df43-47aa-b007-fe33bbde062a": { 2024-09-21T03:53:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:52:39.830410+0000", 2024-09-21T03:53:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:53:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:53:23.703 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "2cbf94ea-caa1-4c9b-8007-8a0887103a5c": { 2024-09-21T03:53:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:51:05.114755+0000", 2024-09-21T03:53:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:53:23.704 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:53:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:53:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:53:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:23.705 INFO:teuthology.orchestra.run.smithi084.stdout: "43a49cca-fc1c-4c36-a314-49033e7c3fb6": { 2024-09-21T03:53:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:49:17.366428+0000", 2024-09-21T03:53:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "0bb4e83d-6059-4d41-88f0-1562fa422c47": { 2024-09-21T03:53:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:54.511018+0000", 2024-09-21T03:53:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:23.706 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:53:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:53:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:53:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:53:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:23.707 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "5435e7df-7d39-4687-a715-54c7af6bc3b1": { 2024-09-21T03:53:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:51:47.429708+0000", 2024-09-21T03:53:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "27dcb84c-89fa-46b2-b980-58857966c697": { 2024-09-21T03:53:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:52.598527+0000", 2024-09-21T03:53:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.708 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:53:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:53:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:53:23.709 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:53:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:53:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:53:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:23.710 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "b2063a70-0b1f-4b6b-9c96-d886e156ea66": { 2024-09-21T03:53:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:48:34.864478+0000", 2024-09-21T03:53:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "33131451-f242-447a-b13f-9bdebc7884ec": { 2024-09-21T03:53:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:00.524357+0000", 2024-09-21T03:53:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:23.711 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:23.712 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:23.712 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:53:23.712 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:53:23.712 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:53:23.712 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.692+0000 7f884c361640 1 -- 172.21.15.84:0/1333689155 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f88300b6680 msgr2=0x7f88300b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:23.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.692+0000 7f884c361640 1 --2- 172.21.15.84:0/1333689155 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f88300b6680 0x7f88300b8b90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x5622ad08e2d0 tx=0x7f884000b410 comp rx=0 tx=0).stop 2024-09-21T03:53:23.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.692+0000 7f884c361640 1 -- 172.21.15.84:0/1333689155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8844109df0 msgr2=0x7f884419fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:23.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.692+0000 7f884c361640 1 --2- 172.21.15.84:0/1333689155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8844109df0 0x7f884419fde0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f883c00b970 tx=0x7f883c00be30 comp rx=0 tx=0).stop 2024-09-21T03:53:23.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.692+0000 7f884c361640 1 -- 172.21.15.84:0/1333689155 shutdown_connections 2024-09-21T03:53:23.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.692+0000 7f884c361640 1 --2- 172.21.15.84:0/1333689155 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f88300b6680 0x7f88300b8b90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.692+0000 7f884c361640 1 --2- 172.21.15.84:0/1333689155 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f8844109df0 0x7f884419fde0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.692+0000 7f884c361640 1 --2- 172.21.15.84:0/1333689155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88441094a0 0x7f884419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.692+0000 7f884c361640 1 --2- 172.21.15.84:0/1333689155 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8844103b60 0x7f884419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:23.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.692+0000 7f884c361640 1 -- 172.21.15.84:0/1333689155 >> 172.21.15.84:0/1333689155 conn(0x7f884407b850 msgr2=0x7f88441075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:23.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.692+0000 7f884c361640 1 -- 172.21.15.84:0/1333689155 shutdown_connections 2024-09-21T03:53:23.713 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:23.692+0000 7f884c361640 1 -- 172.21.15.84:0/1333689155 wait complete. 2024-09-21T03:53:24.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:23 smithi174 ceph-mon[34403]: pgmap v661: 97 pgs: 97 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 63 KiB/s wr, 11 op/s 2024-09-21T03:53:24.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:23 smithi172 ceph-mon[34821]: pgmap v661: 97 pgs: 97 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 63 KiB/s wr, 11 op/s 2024-09-21T03:53:24.163 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:23 smithi084 ceph-mon[30941]: pgmap v661: 97 pgs: 97 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 63 KiB/s wr, 11 op/s 2024-09-21T03:53:24.511 INFO:tasks.cephfs.filesystem:scrub status for tag:31a6ce4e-761a-4c6c-86d8-849dce60d2f5 - {'path': '/', 'tag': '31a6ce4e-761a-4c6c-86d8-849dce60d2f5', 'options': 'recursive,force'} 2024-09-21T03:53:25.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:24 smithi174 ceph-mon[34403]: scrub summary: idle 2024-09-21T03:53:25.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:24 smithi172 ceph-mon[34821]: scrub summary: idle 2024-09-21T03:53:25.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:24 smithi084 ceph-mon[30941]: scrub summary: idle 2024-09-21T03:53:26.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:25 smithi174 ceph-mon[34403]: pgmap v662: 97 pgs: 97 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 65 KiB/s wr, 12 op/s 2024-09-21T03:53:26.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:25 smithi172 ceph-mon[34821]: pgmap v662: 97 pgs: 97 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 65 KiB/s wr, 12 op/s 2024-09-21T03:53:26.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:25 smithi084 ceph-mon[30941]: pgmap v662: 97 pgs: 97 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 65 KiB/s wr, 12 op/s 2024-09-21T03:53:28.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:27 smithi174 ceph-mon[34403]: pgmap v663: 97 pgs: 97 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-09-21T03:53:28.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:27 smithi172 ceph-mon[34821]: pgmap v663: 97 pgs: 97 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-09-21T03:53:28.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:27 smithi084 ceph-mon[30941]: pgmap v663: 97 pgs: 97 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-09-21T03:53:30.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:29 smithi174 ceph-mon[34403]: pgmap v664: 97 pgs: 97 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 12 op/s 2024-09-21T03:53:30.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:29 smithi172 ceph-mon[34821]: pgmap v664: 97 pgs: 97 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 12 op/s 2024-09-21T03:53:30.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:29 smithi084 ceph-mon[30941]: pgmap v664: 97 pgs: 97 active+clean; 23 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 12 op/s 2024-09-21T03:53:32.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:31 smithi174 ceph-mon[34403]: pgmap v665: 97 pgs: 97 active+clean; 23 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 74 KiB/s wr, 12 op/s 2024-09-21T03:53:32.150 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:31 smithi172 ceph-mon[34821]: pgmap v665: 97 pgs: 97 active+clean; 23 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 74 KiB/s wr, 12 op/s 2024-09-21T03:53:32.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:31 smithi084 ceph-mon[30941]: pgmap v665: 97 pgs: 97 active+clean; 23 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 74 KiB/s wr, 12 op/s 2024-09-21T03:53:34.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:33 smithi174 ceph-mon[34403]: pgmap v666: 97 pgs: 97 active+clean; 23 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-09-21T03:53:34.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:33 smithi172 ceph-mon[34821]: pgmap v666: 97 pgs: 97 active+clean; 23 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-09-21T03:53:34.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:33 smithi084 ceph-mon[30941]: pgmap v666: 97 pgs: 97 active+clean; 23 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 46 KiB/s wr, 11 op/s 2024-09-21T03:53:36.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:35 smithi174 ceph-mon[34403]: pgmap v667: 97 pgs: 97 active+clean; 24 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 70 KiB/s wr, 12 op/s 2024-09-21T03:53:36.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:35 smithi172 ceph-mon[34821]: pgmap v667: 97 pgs: 97 active+clean; 24 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 70 KiB/s wr, 12 op/s 2024-09-21T03:53:36.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:35 smithi084 ceph-mon[30941]: pgmap v667: 97 pgs: 97 active+clean; 24 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 70 KiB/s wr, 12 op/s 2024-09-21T03:53:38.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:37 smithi174 ceph-mon[34403]: pgmap v668: 97 pgs: 97 active+clean; 24 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 45 KiB/s wr, 9 op/s 2024-09-21T03:53:38.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:37 smithi172 ceph-mon[34821]: pgmap v668: 97 pgs: 97 active+clean; 24 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 45 KiB/s wr, 9 op/s 2024-09-21T03:53:38.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:37 smithi084 ceph-mon[30941]: pgmap v668: 97 pgs: 97 active+clean; 24 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 45 KiB/s wr, 9 op/s 2024-09-21T03:53:40.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:39 smithi174 ceph-mon[34403]: pgmap v669: 97 pgs: 97 active+clean; 24 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-21T03:53:40.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:39 smithi172 ceph-mon[34821]: pgmap v669: 97 pgs: 97 active+clean; 24 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-21T03:53:40.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:39 smithi084 ceph-mon[30941]: pgmap v669: 97 pgs: 97 active+clean; 24 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 45 KiB/s wr, 11 op/s 2024-09-21T03:53:40.513 INFO:tasks.workunit.client.0.smithi084.stdout:561/600: open fd = 3 2024-09-21T03:53:40.513 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.513 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.513 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.513 INFO:tasks.workunit.client.0.smithi084.stdout:562/600: open fd = 3 2024-09-21T03:53:40.513 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.513 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.513 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.513 INFO:tasks.workunit.client.0.smithi084.stdout:563/600: open fd = 3 2024-09-21T03:53:40.513 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.513 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.514 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.514 INFO:tasks.workunit.client.0.smithi084.stdout:564/600: open fd = 3 2024-09-21T03:53:40.514 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.514 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.514 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.514 INFO:tasks.workunit.client.0.smithi084.stdout:565/600: open fd = 3 2024-09-21T03:53:40.514 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.514 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.514 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.514 INFO:tasks.workunit.client.0.smithi084.stdout:566/600: open fd = 3 2024-09-21T03:53:40.514 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.514 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.514 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.515 INFO:tasks.workunit.client.0.smithi084.stdout:567/600: open fd = 3 2024-09-21T03:53:40.515 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.515 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.515 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.515 INFO:tasks.workunit.client.0.smithi084.stdout:568/600: open fd = 3 2024-09-21T03:53:40.515 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.515 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.515 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.515 INFO:tasks.workunit.client.0.smithi084.stdout:569/600: open fd = 3 2024-09-21T03:53:40.515 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.515 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.515 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.515 INFO:tasks.workunit.client.0.smithi084.stdout:570/600: open fd = 3 2024-09-21T03:53:40.515 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.515 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.516 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.516 INFO:tasks.workunit.client.0.smithi084.stdout:571/600: open fd = 3 2024-09-21T03:53:40.516 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.516 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.516 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.516 INFO:tasks.workunit.client.0.smithi084.stdout:572/600: open fd = 3 2024-09-21T03:53:40.516 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.516 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.516 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.516 INFO:tasks.workunit.client.0.smithi084.stdout:573/600: open fd = 3 2024-09-21T03:53:40.516 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.516 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.516 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.516 INFO:tasks.workunit.client.0.smithi084.stdout:574/600: open fd = 3 2024-09-21T03:53:40.517 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.517 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.517 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.517 INFO:tasks.workunit.client.0.smithi084.stdout:575/600: open fd = 3 2024-09-21T03:53:40.517 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.517 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.517 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.517 INFO:tasks.workunit.client.0.smithi084.stdout:576/600: open fd = 3 2024-09-21T03:53:40.517 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.517 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.517 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.517 INFO:tasks.workunit.client.0.smithi084.stdout:577/600: open fd = 3 2024-09-21T03:53:40.517 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.517 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.517 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.518 INFO:tasks.workunit.client.0.smithi084.stdout:578/600: open fd = 3 2024-09-21T03:53:40.518 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.518 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.518 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.518 INFO:tasks.workunit.client.0.smithi084.stdout:579/600: open fd = 3 2024-09-21T03:53:40.518 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.518 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.518 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.518 INFO:tasks.workunit.client.0.smithi084.stdout:580/600: open fd = 3 2024-09-21T03:53:40.518 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.518 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.518 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.518 INFO:tasks.workunit.client.0.smithi084.stdout:581/600: open fd = 3 2024-09-21T03:53:40.518 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.518 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.519 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.519 INFO:tasks.workunit.client.0.smithi084.stdout:582/600: open fd = 3 2024-09-21T03:53:40.519 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.519 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.519 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.519 INFO:tasks.workunit.client.0.smithi084.stdout:583/600: open fd = 3 2024-09-21T03:53:40.519 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.519 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.519 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.519 INFO:tasks.workunit.client.0.smithi084.stdout:584/600: open fd = 3 2024-09-21T03:53:40.519 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.519 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.519 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.519 INFO:tasks.workunit.client.0.smithi084.stdout:585/600: open fd = 3 2024-09-21T03:53:40.520 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.520 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.520 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.520 INFO:tasks.workunit.client.0.smithi084.stdout:586/600: open fd = 3 2024-09-21T03:53:40.520 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.520 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.520 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.520 INFO:tasks.workunit.client.0.smithi084.stdout:587/600: open fd = 3 2024-09-21T03:53:40.520 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.520 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.520 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.520 INFO:tasks.workunit.client.0.smithi084.stdout:588/600: open fd = 3 2024-09-21T03:53:40.520 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.520 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.520 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.521 INFO:tasks.workunit.client.0.smithi084.stdout:589/600: open fd = 3 2024-09-21T03:53:40.521 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.521 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.521 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.521 INFO:tasks.workunit.client.0.smithi084.stdout:590/600: open fd = 3 2024-09-21T03:53:40.521 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.521 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.521 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.521 INFO:tasks.workunit.client.0.smithi084.stdout:591/600: open fd = 3 2024-09-21T03:53:40.521 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.521 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.521 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.521 INFO:tasks.workunit.client.0.smithi084.stdout:592/600: open fd = 3 2024-09-21T03:53:40.521 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.521 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.522 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.522 INFO:tasks.workunit.client.0.smithi084.stdout:593/600: open fd = 3 2024-09-21T03:53:40.522 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.522 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.522 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.522 INFO:tasks.workunit.client.0.smithi084.stdout:594/600: open fd = 3 2024-09-21T03:53:40.522 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.522 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.522 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.522 INFO:tasks.workunit.client.0.smithi084.stdout:595/600: open fd = 3 2024-09-21T03:53:40.522 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.522 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.522 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.522 INFO:tasks.workunit.client.0.smithi084.stdout:596/600: open fd = 3 2024-09-21T03:53:40.523 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.523 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.523 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.523 INFO:tasks.workunit.client.0.smithi084.stdout:597/600: open fd = 3 2024-09-21T03:53:40.523 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.523 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.523 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.523 INFO:tasks.workunit.client.0.smithi084.stdout:598/600: open fd = 3 2024-09-21T03:53:40.523 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.523 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.523 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.523 INFO:tasks.workunit.client.0.smithi084.stdout:599/600: open fd = 3 2024-09-21T03:53:40.523 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.523 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.523 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.524 INFO:tasks.workunit.client.0.smithi084.stdout:600/600: open fd = 3 2024-09-21T03:53:40.524 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.524 INFO:tasks.workunit.client.0.smithi084.stdout:write ret = 32 2024-09-21T03:53:40.524 INFO:tasks.workunit.client.0.smithi084.stdout:pread ret = 64 2024-09-21T03:53:40.524 INFO:tasks.workunit.client.0.smithi084.stderr:+ echo OK 2024-09-21T03:53:40.525 INFO:tasks.workunit.client.0.smithi084.stdout:OK 2024-09-21T03:53:40.525 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T03:53:40.525 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T03:53:40.568 INFO:tasks.workunit:Stopping ['fs/test_o_trunc.sh'] on client.0... 2024-09-21T03:53:40.568 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T03:53:40.892 DEBUG:teuthology.parallel:result is None 2024-09-21T03:53:40.892 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T03:53:40.927 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T03:53:40.927 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-21T03:53:40.937 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-21T03:53:40.937 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T03:53:40.937 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T03:53:40.937 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-21T03:53:40.993 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-21T03:53:41.062 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T03:53:41.212 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.210+0000 7f236b8b6640 1 -- 172.21.15.84:0/2315915742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2364101f10 msgr2=0x7f2364102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:41.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.210+0000 7f236b8b6640 1 --2- 172.21.15.84:0/2315915742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2364101f10 0x7f2364102320 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f2354009900 tx=0x7f235402a410 comp rx=0 tx=0).stop 2024-09-21T03:53:41.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.210+0000 7f236b8b6640 1 -- 172.21.15.84:0/2315915742 shutdown_connections 2024-09-21T03:53:41.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.210+0000 7f236b8b6640 1 --2- 172.21.15.84:0/2315915742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2364109d90 0x7f23641105c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.210+0000 7f236b8b6640 1 --2- 172.21.15.84:0/2315915742 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2364109440 0x7f2364109850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.210+0000 7f236b8b6640 1 --2- 172.21.15.84:0/2315915742 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2364101f10 0x7f2364102320 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.210+0000 7f236b8b6640 1 -- 172.21.15.84:0/2315915742 >> 172.21.15.84:0/2315915742 conn(0x7f2364079d00 msgr2=0x7f236407a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:41.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.210+0000 7f236b8b6640 1 -- 172.21.15.84:0/2315915742 shutdown_connections 2024-09-21T03:53:41.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.210+0000 7f236b8b6640 1 -- 172.21.15.84:0/2315915742 wait complete. 2024-09-21T03:53:41.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.211+0000 7f236b8b6640 1 Processor -- start 2024-09-21T03:53:41.213 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.211+0000 7f236b8b6640 1 -- start start 2024-09-21T03:53:41.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.211+0000 7f236b8b6640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2364101f10 0x7f2364102ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:41.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.211+0000 7f236b8b6640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2364109440 0x7f23641033e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:41.215 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.211+0000 7f236b8b6640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2364109d90 0x7f2364103920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:41.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.211+0000 7f236b8b6640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2364113a50 con 0x7f2364109440 2024-09-21T03:53:41.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.211+0000 7f236b8b6640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f23641138d0 con 0x7f2364101f10 2024-09-21T03:53:41.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.211+0000 7f236b8b6640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2364113bd0 con 0x7f2364109d90 2024-09-21T03:53:41.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.211+0000 7f2368e51640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2364109440 0x7f23641033e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:41.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.211+0000 7f2368e51640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2364109440 0x7f23641033e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36440/0 (socket says 172.21.15.84:36440) 2024-09-21T03:53:41.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.211+0000 7f2368e51640 1 -- 172.21.15.84:0/2609887084 learned_addr learned my addr 172.21.15.84:0/2609887084 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:41.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.211+0000 7f2369652640 1 --2- 172.21.15.84:0/2609887084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2364101f10 0x7f2364102ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:41.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.211+0000 7f2368e51640 1 -- 172.21.15.84:0/2609887084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2364109d90 msgr2=0x7f2364103920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:41.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.211+0000 7f2368e51640 1 --2- 172.21.15.84:0/2609887084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2364109d90 0x7f2364103920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.211+0000 7f2368e51640 1 -- 172.21.15.84:0/2609887084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2364101f10 msgr2=0x7f2364102ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:41.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.211+0000 7f2368e51640 1 --2- 172.21.15.84:0/2609887084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2364101f10 0x7f2364102ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.211+0000 7f2368e51640 1 -- 172.21.15.84:0/2609887084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23641a87e0 con 0x7f2364109440 2024-09-21T03:53:41.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.211+0000 7f2369652640 1 --2- 172.21.15.84:0/2609887084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2364101f10 0x7f2364102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:41.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.212+0000 7f2368e51640 1 --2- 172.21.15.84:0/2609887084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2364109440 0x7f23641033e0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f236000d750 tx=0x7f236000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:41.216 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.212+0000 7f235a7fc640 1 -- 172.21.15.84:0/2609887084 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2360017070 con 0x7f2364109440 2024-09-21T03:53:41.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.212+0000 7f235a7fc640 1 -- 172.21.15.84:0/2609887084 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23600054d0 con 0x7f2364109440 2024-09-21T03:53:41.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.212+0000 7f236b8b6640 1 -- 172.21.15.84:0/2609887084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23641a8ad0 con 0x7f2364109440 2024-09-21T03:53:41.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.212+0000 7f235a7fc640 1 -- 172.21.15.84:0/2609887084 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2360004c30 con 0x7f2364109440 2024-09-21T03:53:41.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.212+0000 7f236b8b6640 1 -- 172.21.15.84:0/2609887084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23641a8fd0 con 0x7f2364109440 2024-09-21T03:53:41.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.213+0000 7f236b8b6640 1 -- 172.21.15.84:0/2609887084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2364102320 con 0x7f2364109440 2024-09-21T03:53:41.217 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.215+0000 7f235a7fc640 1 -- 172.21.15.84:0/2609887084 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f2360004dd0 con 0x7f2364109440 2024-09-21T03:53:41.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.216+0000 7f235a7fc640 1 --2- 172.21.15.84:0/2609887084 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f23500b66b0 0x7f23500b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:41.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.216+0000 7f2369652640 1 --2- 172.21.15.84:0/2609887084 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f23500b66b0 0x7f23500b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:41.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.216+0000 7f235a7fc640 1 -- 172.21.15.84:0/2609887084 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f23600e7570 con 0x7f2364109440 2024-09-21T03:53:41.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.216+0000 7f2369652640 1 --2- 172.21.15.84:0/2609887084 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f23500b66b0 0x7f23500b8bc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2354000c00 tx=0x7f2354009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:41.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.219+0000 7f235a7fc640 1 -- 172.21.15.84:0/2609887084 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f23600adb10 con 0x7f2364109440 2024-09-21T03:53:41.425 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.423+0000 7f236b8b6640 1 -- 172.21.15.84:0/2609887084 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f2364063800 con 0x7f23500b66b0 2024-09-21T03:53:41.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.431+0000 7f235a7fc640 1 -- 172.21.15.84:0/2609887084 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f2364063800 con 0x7f23500b66b0 2024-09-21T03:53:41.434 INFO:teuthology.orchestra.run.smithi084.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T03:42:29", "first": "2024-09-21T03:43:00", "last": "2024-09-21T03:53:00", "last_pruned": "2024-09-21T03:53:00", "created_count": 11, "pruned_count": 5, "active": true} 2024-09-21T03:53:41.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.434+0000 7f236b8b6640 1 -- 172.21.15.84:0/2609887084 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f23500b66b0 msgr2=0x7f23500b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:41.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.434+0000 7f236b8b6640 1 --2- 172.21.15.84:0/2609887084 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f23500b66b0 0x7f23500b8bc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2354000c00 tx=0x7f2354009680 comp rx=0 tx=0).stop 2024-09-21T03:53:41.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.434+0000 7f236b8b6640 1 -- 172.21.15.84:0/2609887084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2364109440 msgr2=0x7f23641033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:41.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.434+0000 7f236b8b6640 1 --2- 172.21.15.84:0/2609887084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2364109440 0x7f23641033e0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f236000d750 tx=0x7f236000dc10 comp rx=0 tx=0).stop 2024-09-21T03:53:41.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.434+0000 7f236b8b6640 1 -- 172.21.15.84:0/2609887084 shutdown_connections 2024-09-21T03:53:41.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.434+0000 7f236b8b6640 1 --2- 172.21.15.84:0/2609887084 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f23500b66b0 0x7f23500b8bc0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.434+0000 7f236b8b6640 1 --2- 172.21.15.84:0/2609887084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2364109d90 0x7f2364103920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.434+0000 7f236b8b6640 1 --2- 172.21.15.84:0/2609887084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2364109440 0x7f23641033e0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.436 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.434+0000 7f236b8b6640 1 --2- 172.21.15.84:0/2609887084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2364101f10 0x7f2364102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.434+0000 7f236b8b6640 1 -- 172.21.15.84:0/2609887084 >> 172.21.15.84:0/2609887084 conn(0x7f2364079d00 msgr2=0x7f2364107580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:41.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.434+0000 7f236b8b6640 1 -- 172.21.15.84:0/2609887084 shutdown_connections 2024-09-21T03:53:41.437 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.434+0000 7f236b8b6640 1 -- 172.21.15.84:0/2609887084 wait complete. 2024-09-21T03:53:41.447 DEBUG:teuthology.orchestra.run.smithi084:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T03:53:41.560 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.556+0000 7f6f86230640 1 -- 172.21.15.84:0/3316245780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f801029e0 msgr2=0x7f6f80102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:41.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.556+0000 7f6f86230640 1 --2- 172.21.15.84:0/3316245780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f801029e0 0x7f6f80102df0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f6f70009900 tx=0x7f6f7002a410 comp rx=0 tx=0).stop 2024-09-21T03:53:41.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.556+0000 7f6f86230640 1 -- 172.21.15.84:0/3316245780 shutdown_connections 2024-09-21T03:53:41.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.556+0000 7f6f86230640 1 --2- 172.21.15.84:0/3316245780 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f80108c60 0x7f6f8010f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.556+0000 7f6f86230640 1 --2- 172.21.15.84:0/3316245780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f80108310 0x7f6f80108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.556+0000 7f6f86230640 1 --2- 172.21.15.84:0/3316245780 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f801029e0 0x7f6f80102df0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.556+0000 7f6f86230640 1 -- 172.21.15.84:0/3316245780 >> 172.21.15.84:0/3316245780 conn(0x7f6f800fe3c0 msgr2=0x7f6f80100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:41.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.556+0000 7f6f86230640 1 -- 172.21.15.84:0/3316245780 shutdown_connections 2024-09-21T03:53:41.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.556+0000 7f6f86230640 1 -- 172.21.15.84:0/3316245780 wait complete. 2024-09-21T03:53:41.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.557+0000 7f6f86230640 1 Processor -- start 2024-09-21T03:53:41.561 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.557+0000 7f6f86230640 1 -- start start 2024-09-21T03:53:41.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.557+0000 7f6f86230640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f801029e0 0x7f6f80199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:41.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.557+0000 7f6f86230640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f80108310 0x7f6f80199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:41.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.557+0000 7f6f86230640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f80108c60 0x7f6f8019ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:41.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.557+0000 7f6f86230640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6f80112920 con 0x7f6f80108310 2024-09-21T03:53:41.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.557+0000 7f6f86230640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6f801127a0 con 0x7f6f801029e0 2024-09-21T03:53:41.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.557+0000 7f6f86230640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6f80112aa0 con 0x7f6f80108c60 2024-09-21T03:53:41.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.557+0000 7f6f77fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f80108310 0x7f6f80199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:41.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.558+0000 7f6f77fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f80108310 0x7f6f80199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:36452/0 (socket says 172.21.15.84:36452) 2024-09-21T03:53:41.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.558+0000 7f6f77fff640 1 -- 172.21.15.84:0/3738209504 learned_addr learned my addr 172.21.15.84:0/3738209504 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:41.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.558+0000 7f6f77fff640 1 -- 172.21.15.84:0/3738209504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f80108c60 msgr2=0x7f6f8019ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:41.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.558+0000 7f6f7f7fe640 1 --2- 172.21.15.84:0/3738209504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f801029e0 0x7f6f80199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:41.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.558+0000 7f6f7ffff640 1 --2- 172.21.15.84:0/3738209504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f80108c60 0x7f6f8019ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:41.562 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.558+0000 7f6f77fff640 1 --2- 172.21.15.84:0/3738209504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f80108c60 0x7f6f8019ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.558+0000 7f6f77fff640 1 -- 172.21.15.84:0/3738209504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f801029e0 msgr2=0x7f6f80199380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:41.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.558+0000 7f6f77fff640 1 --2- 172.21.15.84:0/3738209504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f801029e0 0x7f6f80199380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.558+0000 7f6f77fff640 1 -- 172.21.15.84:0/3738209504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8019f2b0 con 0x7f6f80108310 2024-09-21T03:53:41.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.558+0000 7f6f7f7fe640 1 --2- 172.21.15.84:0/3738209504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f801029e0 0x7f6f80199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:53:41.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.558+0000 7f6f77fff640 1 --2- 172.21.15.84:0/3738209504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f80108310 0x7f6f80199920 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800e9f0 tx=0x7f6f6800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:41.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.558+0000 7f6f7d7fa640 1 -- 172.21.15.84:0/3738209504 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6800ccc0 con 0x7f6f80108310 2024-09-21T03:53:41.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.558+0000 7f6f86230640 1 -- 172.21.15.84:0/3738209504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f8019f5a0 con 0x7f6f80108310 2024-09-21T03:53:41.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.558+0000 7f6f7d7fa640 1 -- 172.21.15.84:0/3738209504 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f680108e0 con 0x7f6f80108310 2024-09-21T03:53:41.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.558+0000 7f6f7d7fa640 1 -- 172.21.15.84:0/3738209504 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f68018860 con 0x7f6f80108310 2024-09-21T03:53:41.563 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.558+0000 7f6f86230640 1 -- 172.21.15.84:0/3738209504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f801a5d30 con 0x7f6f80108310 2024-09-21T03:53:41.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.559+0000 7f6f86230640 1 -- 172.21.15.84:0/3738209504 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f80102df0 con 0x7f6f80108310 2024-09-21T03:53:41.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.561+0000 7f6f7d7fa640 1 -- 172.21.15.84:0/3738209504 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f6f68010430 con 0x7f6f80108310 2024-09-21T03:53:41.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.562+0000 7f6f7d7fa640 1 --2- 172.21.15.84:0/3738209504 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6f6c0b6680 0x7f6f6c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:41.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.562+0000 7f6f7f7fe640 1 --2- 172.21.15.84:0/3738209504 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6f6c0b6680 0x7f6f6c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:41.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.562+0000 7f6f7d7fa640 1 -- 172.21.15.84:0/3738209504 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f6f680e7fa0 con 0x7f6f80108310 2024-09-21T03:53:41.565 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.563+0000 7f6f7f7fe640 1 --2- 172.21.15.84:0/3738209504 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6f6c0b6680 0x7f6f6c0b8b90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6f700096c0 tx=0x7f6f70031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:41.567 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.565+0000 7f6f7d7fa640 1 -- 172.21.15.84:0/3738209504 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6f680ae540 con 0x7f6f80108310 2024-09-21T03:53:41.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.764+0000 7f6f86230640 1 -- 172.21.15.84:0/3738209504 --> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f6f80063800 con 0x7f6f6c0b6680 2024-09-21T03:53:41.773 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.771+0000 7f6f7d7fa640 1 -- 172.21.15.84:0/3738209504 <== mgr.14226 v2:172.21.15.84:6800/4090897078 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f6f80063800 con 0x7f6f6c0b6680 2024-09-21T03:53:41.773 INFO:teuthology.orchestra.run.smithi084.stdout:/ 1m 6m3h 2024-09-21T03:53:41.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.773+0000 7f6f86230640 1 -- 172.21.15.84:0/3738209504 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6f6c0b6680 msgr2=0x7f6f6c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:41.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.773+0000 7f6f86230640 1 --2- 172.21.15.84:0/3738209504 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6f6c0b6680 0x7f6f6c0b8b90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6f700096c0 tx=0x7f6f70031400 comp rx=0 tx=0).stop 2024-09-21T03:53:41.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.773+0000 7f6f86230640 1 -- 172.21.15.84:0/3738209504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f80108310 msgr2=0x7f6f80199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:41.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.773+0000 7f6f86230640 1 --2- 172.21.15.84:0/3738209504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f80108310 0x7f6f80199920 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f6f6800e9f0 tx=0x7f6f6800eeb0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.774+0000 7f6f86230640 1 -- 172.21.15.84:0/3738209504 shutdown_connections 2024-09-21T03:53:41.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.774+0000 7f6f86230640 1 --2- 172.21.15.84:0/3738209504 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f6f6c0b6680 0x7f6f6c0b8b90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.774+0000 7f6f86230640 1 --2- 172.21.15.84:0/3738209504 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f80108c60 0x7f6f8019ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.774+0000 7f6f86230640 1 --2- 172.21.15.84:0/3738209504 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6f80108310 0x7f6f80199920 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.774+0000 7f6f86230640 1 --2- 172.21.15.84:0/3738209504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f801029e0 0x7f6f80199380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:41.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.774+0000 7f6f86230640 1 -- 172.21.15.84:0/3738209504 >> 172.21.15.84:0/3738209504 conn(0x7f6f800fe3c0 msgr2=0x7f6f80101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:41.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.774+0000 7f6f86230640 1 -- 172.21.15.84:0/3738209504 shutdown_connections 2024-09-21T03:53:41.777 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:41.774+0000 7f6f86230640 1 -- 172.21.15.84:0/3738209504 wait complete. 2024-09-21T03:53:41.787 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-21T03:53:41.797 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-21T03:53:42.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:41 smithi084 ceph-mon[30941]: pgmap v670: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 72 KiB/s wr, 11 op/s 2024-09-21T03:53:42.069 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:41 smithi084 ceph-mon[30941]: from='client.17601 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:42.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:41 smithi174 ceph-mon[34403]: pgmap v670: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 72 KiB/s wr, 11 op/s 2024-09-21T03:53:42.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:41 smithi174 ceph-mon[34403]: from='client.17601 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:42.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:41 smithi172 ceph-mon[34821]: pgmap v670: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 72 KiB/s wr, 11 op/s 2024-09-21T03:53:42.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:41 smithi172 ceph-mon[34821]: from='client.17601 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:43.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:42 smithi174 ceph-mon[34403]: from='client.17607 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:43.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:42 smithi172 ceph-mon[34821]: from='client.17607 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:43.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:42 smithi084 ceph-mon[30941]: from='client.17607 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:44.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:43 smithi174 ceph-mon[34403]: pgmap v671: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 11 op/s 2024-09-21T03:53:44.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:43 smithi172 ceph-mon[34821]: pgmap v671: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 11 op/s 2024-09-21T03:53:44.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:43 smithi084 ceph-mon[30941]: pgmap v671: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 11 op/s 2024-09-21T03:53:46.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:45 smithi174 ceph-mon[34403]: pgmap v672: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 13 op/s 2024-09-21T03:53:46.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:45 smithi172 ceph-mon[34821]: pgmap v672: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 13 op/s 2024-09-21T03:53:46.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:45 smithi084 ceph-mon[30941]: pgmap v672: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 13 op/s 2024-09-21T03:53:48.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:47 smithi174 ceph-mon[34403]: pgmap v673: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 11 op/s 2024-09-21T03:53:48.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:48.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:48.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:48.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:48.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:48.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:48.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:47 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:48.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:47 smithi172 ceph-mon[34821]: pgmap v673: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 11 op/s 2024-09-21T03:53:48.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:48.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:48.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:48.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:48.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:48.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:48.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:47 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:48.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:47 smithi084 ceph-mon[30941]: pgmap v673: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 11 op/s 2024-09-21T03:53:48.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:48.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:48.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:48.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:48.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:48.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:48.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:47 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:49.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:48 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:49.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:48 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:49.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:48 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:49.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:48 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:49.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:48 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:49.151 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:48 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:49.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:48 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:49.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:48 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:49.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:48 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' 2024-09-21T03:53:50.319 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:49 smithi084 ceph-mon[30941]: pgmap v674: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-09-21T03:53:50.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:49 smithi174 ceph-mon[34403]: pgmap v674: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-09-21T03:53:50.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:49 smithi172 ceph-mon[34821]: pgmap v674: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 KiB/s wr, 13 op/s 2024-09-21T03:53:52.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:51 smithi084 ceph-mon[30941]: pgmap v675: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-21T03:53:52.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:51 smithi174 ceph-mon[34403]: pgmap v675: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-21T03:53:52.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:51 smithi172 ceph-mon[34821]: pgmap v675: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-09-21T03:53:54.318 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:53 smithi084 ceph-mon[30941]: pgmap v676: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-21T03:53:54.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:53 smithi174 ceph-mon[34403]: pgmap v676: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-21T03:53:54.401 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:53 smithi172 ceph-mon[34821]: pgmap v676: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-21T03:53:54.512 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:53:54.773 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:55.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.273+0000 7fd0c34f7640 1 -- 172.21.15.84:0/4118516853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0bc108d10 msgr2=0x7fd0bc10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.273+0000 7fd0c34f7640 1 --2- 172.21.15.84:0/4118516853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0bc108d10 0x7fd0bc10f540 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009ca0 tx=0x7fd0b402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.273+0000 7fd0c34f7640 1 -- 172.21.15.84:0/4118516853 shutdown_connections 2024-09-21T03:53:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.273+0000 7fd0c34f7640 1 --2- 172.21.15.84:0/4118516853 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0bc108d10 0x7fd0bc10f540 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.273+0000 7fd0c34f7640 1 --2- 172.21.15.84:0/4118516853 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0bc1083c0 0x7fd0bc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.273+0000 7fd0c34f7640 1 --2- 172.21.15.84:0/4118516853 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0bc102a80 0x7fd0bc102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.273+0000 7fd0c34f7640 1 -- 172.21.15.84:0/4118516853 >> 172.21.15.84:0/4118516853 conn(0x7fd0bc079740 msgr2=0x7fd0bc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.273+0000 7fd0c34f7640 1 -- 172.21.15.84:0/4118516853 shutdown_connections 2024-09-21T03:53:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.273+0000 7fd0c34f7640 1 -- 172.21.15.84:0/4118516853 wait complete. 2024-09-21T03:53:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.274+0000 7fd0c34f7640 1 Processor -- start 2024-09-21T03:53:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.274+0000 7fd0c34f7640 1 -- start start 2024-09-21T03:53:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.274+0000 7fd0c34f7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0bc102a80 0x7fd0bc199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.293 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.274+0000 7fd0c34f7640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0bc1083c0 0x7fd0bc1998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.274+0000 7fd0c34f7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0bc108d10 0x7fd0bc19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.274+0000 7fd0c34f7640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc112980 con 0x7fd0bc108d10 2024-09-21T03:53:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.274+0000 7fd0c34f7640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc112800 con 0x7fd0bc1083c0 2024-09-21T03:53:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.274+0000 7fd0c34f7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc112b00 con 0x7fd0bc102a80 2024-09-21T03:53:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.275+0000 7fd0c1a94640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0bc108d10 0x7fd0bc19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.275+0000 7fd0c1a94640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0bc108d10 0x7fd0bc19eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45158/0 (socket says 172.21.15.84:45158) 2024-09-21T03:53:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.275+0000 7fd0c1a94640 1 -- 172.21.15.84:0/2979637957 learned_addr learned my addr 172.21.15.84:0/2979637957 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.275+0000 7fd0c1293640 1 --2- 172.21.15.84:0/2979637957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0bc102a80 0x7fd0bc199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.275+0000 7fd0c0a92640 1 --2- 172.21.15.84:0/2979637957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0bc1083c0 0x7fd0bc1998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.275+0000 7fd0c1a94640 1 -- 172.21.15.84:0/2979637957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0bc102a80 msgr2=0x7fd0bc199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.275+0000 7fd0c1a94640 1 --2- 172.21.15.84:0/2979637957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0bc102a80 0x7fd0bc199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.275+0000 7fd0c1a94640 1 -- 172.21.15.84:0/2979637957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0bc1083c0 msgr2=0x7fd0bc1998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.294 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.275+0000 7fd0c1a94640 1 --2- 172.21.15.84:0/2979637957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0bc1083c0 0x7fd0bc1998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.275+0000 7fd0c1a94640 1 -- 172.21.15.84:0/2979637957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0bc19f2c0 con 0x7fd0bc108d10 2024-09-21T03:53:55.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.275+0000 7fd0c0a92640 1 --2- 172.21.15.84:0/2979637957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0bc1083c0 0x7fd0bc1998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:55.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.275+0000 7fd0c1a94640 1 --2- 172.21.15.84:0/2979637957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0bc108d10 0x7fd0bc19eb90 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4005cc0 tx=0x7fd0b402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:55.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.275+0000 7fd0b27fc640 1 -- 172.21.15.84:0/2979637957 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4003bf0 con 0x7fd0bc108d10 2024-09-21T03:53:55.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.275+0000 7fd0b27fc640 1 -- 172.21.15.84:0/2979637957 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0b4003d90 con 0x7fd0bc108d10 2024-09-21T03:53:55.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.275+0000 7fd0c34f7640 1 -- 172.21.15.84:0/2979637957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0bc19f550 con 0x7fd0bc108d10 2024-09-21T03:53:55.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.275+0000 7fd0b27fc640 1 -- 172.21.15.84:0/2979637957 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b402fbc0 con 0x7fd0bc108d10 2024-09-21T03:53:55.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.275+0000 7fd0c34f7640 1 -- 172.21.15.84:0/2979637957 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0bc1a5d10 con 0x7fd0bc108d10 2024-09-21T03:53:55.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.278+0000 7fd0c9a6b740 1 Processor -- start 2024-09-21T03:53:55.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.278+0000 7fd0b27fc640 1 -- 172.21.15.84:0/2979637957 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fd0b402fd60 con 0x7fd0bc108d10 2024-09-21T03:53:55.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.278+0000 7fd0c9a6b740 1 -- start start 2024-09-21T03:53:55.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.278+0000 7fd0c9a6b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b03b0070 0x5626b0757270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.278+0000 7fd0c9a6b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b03871b0 0x5626b07577b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.295 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.278+0000 7fd0c9a6b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b038f390 0x5626b0757cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.278+0000 7fd0c9a6b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5626b06cde50 con 0x5626b03871b0 2024-09-21T03:53:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.278+0000 7fd0c9a6b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5626b06bd280 con 0x5626b03b0070 2024-09-21T03:53:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.278+0000 7fd0c9a6b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5626b06c1090 con 0x5626b038f390 2024-09-21T03:53:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.279+0000 7fd0c1293640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b03871b0 0x5626b07577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.279+0000 7fd0c1293640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b03871b0 0x5626b07577b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45164/0 (socket says 172.21.15.84:45164) 2024-09-21T03:53:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.279+0000 7fd0c1293640 1 -- 172.21.15.84:0/2805421355 learned_addr learned my addr 172.21.15.84:0/2805421355 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.279+0000 7fd0c0a92640 1 --2- 172.21.15.84:0/2805421355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b03b0070 0x5626b0757270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.279+0000 7fd0c0a92640 1 --2- 172.21.15.84:0/2805421355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b038f390 0x5626b0757cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.279+0000 7fd0c1293640 1 -- 172.21.15.84:0/2805421355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b038f390 msgr2=0x5626b0757cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.279+0000 7fd0c1293640 1 --2- 172.21.15.84:0/2805421355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b038f390 0x5626b0757cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.279+0000 7fd0c1293640 1 -- 172.21.15.84:0/2805421355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b03b0070 msgr2=0x5626b0757270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.279+0000 7fd0c1293640 1 --2- 172.21.15.84:0/2805421355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b03b0070 0x5626b0757270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.279+0000 7fd0c1293640 1 -- 172.21.15.84:0/2805421355 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626b041b650 con 0x5626b03871b0 2024-09-21T03:53:55.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.279+0000 7fd0c0a92640 1 --2- 172.21.15.84:0/2805421355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b03b0070 0x5626b0757270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.279+0000 7fd0b27fc640 1 --2- 172.21.15.84:0/2979637957 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd0a80b6680 0x7fd0a80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.279+0000 7fd0c0a92640 1 --2- 172.21.15.84:0/2979637957 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd0a80b6680 0x7fd0a80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.279+0000 7fd0c1293640 1 --2- 172.21.15.84:0/2805421355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b03871b0 0x5626b07577b0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800bd50 tx=0x7fd0b80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef50810bdf523915 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.279+0000 7fd0b27fc640 1 -- 172.21.15.84:0/2979637957 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7fd0b4108cb0 con 0x7fd0bc108d10 2024-09-21T03:53:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.279+0000 7fd0a77fe640 1 -- 172.21.15.84:0/2805421355 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8005220 con 0x5626b03871b0 2024-09-21T03:53:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.279+0000 7fd0a77fe640 1 -- 172.21.15.84:0/2805421355 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0b800be40 con 0x5626b03871b0 2024-09-21T03:53:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.279+0000 7fd0a77fe640 1 -- 172.21.15.84:0/2805421355 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b80117c0 con 0x5626b03871b0 2024-09-21T03:53:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.280+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/2805421355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b03871b0 msgr2=0x5626b07577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.280+0000 7fd0c0a92640 1 --2- 172.21.15.84:0/2979637957 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd0a80b6680 0x7fd0a80b8b90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0058c0 tx=0x7fd0ac00c490 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.280+0000 7fd0c9a6b740 1 --2- 172.21.15.84:0/2805421355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b03871b0 0x5626b07577b0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800bd50 tx=0x7fd0b80107a0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.280+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/2805421355 shutdown_connections 2024-09-21T03:53:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.280+0000 7fd0c9a6b740 1 --2- 172.21.15.84:0/2805421355 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b038f390 0x5626b0757cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.280+0000 7fd0c9a6b740 1 --2- 172.21.15.84:0/2805421355 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b03871b0 0x5626b07577b0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.280+0000 7fd0c9a6b740 1 --2- 172.21.15.84:0/2805421355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b03b0070 0x5626b0757270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.280+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/2805421355 >> 172.21.15.84:0/2805421355 conn(0x5626b03a4460 msgr2=0x5626b0755160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:55.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.280+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/2805421355 shutdown_connections 2024-09-21T03:53:55.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.280+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/2805421355 wait complete. 2024-09-21T03:53:55.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.281+0000 7fd0c9a6b740 1 -- start start 2024-09-21T03:53:55.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.281+0000 7fd0c9a6b740 1 Processor -- start 2024-09-21T03:53:55.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.281+0000 7fd0c9a6b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b03871b0 0x5626b0762930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.281+0000 7fd0c9a6b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b038f390 0x5626b0762e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.281+0000 7fd0c9a6b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b03b0070 0x5626b076ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.281+0000 7fd0c9a6b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x5626b051e700 con 0x5626b03871b0 2024-09-21T03:53:55.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.281+0000 7fd0c9a6b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5626b0658110 con 0x5626b038f390 2024-09-21T03:53:55.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.281+0000 7fd0c9a6b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x5626b0765a50 con 0x5626b03b0070 2024-09-21T03:53:55.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.281+0000 7fd0c9a6b740 10 client.0 _ll_register_callbacks cb 0x5626b0671990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:53:55.298 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.281+0000 7fd0c1293640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b03871b0 0x5626b0762930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.281+0000 7fd0c1293640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b03871b0 0x5626b0762930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45172/0 (socket says 172.21.15.84:45172) 2024-09-21T03:53:55.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.281+0000 7fd0c1293640 1 -- 172.21.15.84:0/2800253732 learned_addr learned my addr 172.21.15.84:0/2800253732 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:55.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.282+0000 7fd0c0a92640 1 --2- 172.21.15.84:0/2800253732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b038f390 0x5626b0762e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.282+0000 7fd0c1a94640 1 --2- 172.21.15.84:0/2800253732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b03b0070 0x5626b076ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.282+0000 7fd0c1293640 1 -- 172.21.15.84:0/2800253732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b03b0070 msgr2=0x5626b076ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:55.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.282+0000 7fd0c1293640 1 --2- 172.21.15.84:0/2800253732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b03b0070 0x5626b076ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.282+0000 7fd0c1293640 1 -- 172.21.15.84:0/2800253732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b038f390 msgr2=0x5626b0762e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:55.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.282+0000 7fd0c1293640 1 --2- 172.21.15.84:0/2800253732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b038f390 0x5626b0762e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.282+0000 7fd0c1293640 1 -- 172.21.15.84:0/2800253732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626b0685c40 con 0x5626b03871b0 2024-09-21T03:53:55.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.282+0000 7fd0c1a94640 1 --2- 172.21.15.84:0/2800253732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b03b0070 0x5626b076ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:55.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.282+0000 7fd0c1293640 1 --2- 172.21.15.84:0/2800253732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b03871b0 0x5626b0762930 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800bd20 tx=0x7fd0b801e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99d29b1f3c7e538 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:55.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.282+0000 7fd0a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:53:55.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.282+0000 7fd0a4ff9640 1 -- 172.21.15.84:0/2800253732 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b802c060 con 0x5626b03871b0 2024-09-21T03:53:55.299 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.282+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/2800253732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5626b06cfda0 con 0x5626b03871b0 2024-09-21T03:53:55.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.282+0000 7fd0a4ff9640 1 -- 172.21.15.84:0/2800253732 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7fd0b801ec80 con 0x5626b03871b0 2024-09-21T03:53:55.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.282+0000 7fd0a4ff9640 1 -- 172.21.15.84:0/2800253732 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd0b8011540 con 0x5626b03871b0 2024-09-21T03:53:55.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.282+0000 7fd0c9a6b740 10 client.17619 fetch_fsmap learned FSMap version 25 2024-09-21T03:53:55.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.282+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/2800253732 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5626b0771730 con 0x5626b03871b0 2024-09-21T03:53:55.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.283+0000 7fd0a4ff9640 1 -- 172.21.15.84:0/2800253732 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5626b06cfda0 con 0x5626b03871b0 2024-09-21T03:53:55.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.283+0000 7fd0a4ff9640 1 -- 172.21.15.84:0/2800253732 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd0b8031790 con 0x5626b03871b0 2024-09-21T03:53:55.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.283+0000 7fd0c9a6b740 10 client.17619 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:53:55.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.283+0000 7fd0c9a6b740 10 client.17619 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:53:55.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.283+0000 7fd0c9a6b740 20 client.17619 populate_metadata read hostname 'smithi084' 2024-09-21T03:53:55.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.283+0000 7fd0c9a6b740 1 --2- 172.21.15.84:0/2800253732 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5626b036e9f0 0x5626b0774a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.283+0000 7fd0c9a6b740 4 client.17619 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:53:55.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.283+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/2800253732 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626b06cb850 con 0x5626b036e9f0 2024-09-21T03:53:55.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.283+0000 7fd0c0a92640 1 --2- 172.21.15.84:0/2800253732 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5626b036e9f0 0x5626b0774a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.284+0000 7fd0a4ff9640 10 client.17619 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:53:55.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.284+0000 7fd0c0a92640 1 --2- 172.21.15.84:0/2800253732 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5626b036e9f0 0x5626b0774a90 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5020b016e3900470 server_cookie=6690d711c3efde4 in_seq=0 out_seq=0 2024-09-21T03:53:55.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.284+0000 7fd0a4ff9640 1 -- 172.21.15.84:0/2800253732 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5626b06cb850 con 0x5626b036e9f0 2024-09-21T03:53:55.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.284+0000 7fd0a4ff9640 10 client.17619 handle_command_reply: tid=0 2024-09-21T03:53:55.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.284+0000 7fd0c9a6b740 1 client.17619 shutdown 2024-09-21T03:53:55.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.284+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/2800253732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b03871b0 msgr2=0x5626b0762930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.284+0000 7fd0c9a6b740 1 --2- 172.21.15.84:0/2800253732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b03871b0 0x5626b0762930 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800bd20 tx=0x7fd0b801e880 comp rx=0 tx=0).stop 2024-09-21T03:53:55.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.285+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/2800253732 shutdown_connections 2024-09-21T03:53:55.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.285+0000 7fd0c9a6b740 1 --2- 172.21.15.84:0/2800253732 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5626b036e9f0 0x5626b0774a90 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.285+0000 7fd0c9a6b740 1 --2- 172.21.15.84:0/2800253732 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b03b0070 0x5626b076ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.285+0000 7fd0a4ff9640 0 client.17619 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:53:55.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.285+0000 7fd0c9a6b740 1 --2- 172.21.15.84:0/2800253732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b038f390 0x5626b0762e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.285+0000 7fd0c9a6b740 1 --2- 172.21.15.84:0/2800253732 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b03871b0 0x5626b0762930 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.285+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/2800253732 >> 172.21.15.84:0/2800253732 conn(0x5626b03a4460 msgr2=0x5626b075a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:55.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.285+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/2800253732 shutdown_connections 2024-09-21T03:53:55.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.285+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/2800253732 wait complete. 2024-09-21T03:53:55.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.285+0000 7fd0c9a6b740 20 client.17619 trim_cache size 0 max 16384 2024-09-21T03:53:55.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.303+0000 7fd0c9a6b740 1 Processor -- start 2024-09-21T03:53:55.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.303+0000 7fd0c9a6b740 1 -- start start 2024-09-21T03:53:55.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.303+0000 7fd0c9a6b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b036e9f0 0x5626b0762df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.303+0000 7fd0c9a6b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b03871b0 0x5626b076ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.303+0000 7fd0c9a6b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b038f390 0x5626b075fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.303+0000 7fd0c9a6b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc1afcb0 con 0x5626b038f390 2024-09-21T03:53:55.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.303+0000 7fd0c9a6b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc1ad580 con 0x5626b03871b0 2024-09-21T03:53:55.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.303+0000 7fd0c9a6b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc1ab3f0 con 0x5626b036e9f0 2024-09-21T03:53:55.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.303+0000 7fd0c1a94640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b038f390 0x5626b075fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.303+0000 7fd0c1a94640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b038f390 0x5626b075fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45188/0 (socket says 172.21.15.84:45188) 2024-09-21T03:53:55.306 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.303+0000 7fd0c1a94640 1 -- 172.21.15.84:0/4046919165 learned_addr learned my addr 172.21.15.84:0/4046919165 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:55.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.303+0000 7fd0c1293640 1 --2- 172.21.15.84:0/4046919165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b036e9f0 0x5626b0762df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.303+0000 7fd0c0a92640 1 --2- 172.21.15.84:0/4046919165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b03871b0 0x5626b076ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.303+0000 7fd0c1a94640 1 -- 172.21.15.84:0/4046919165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b036e9f0 msgr2=0x5626b0762df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:55.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.303+0000 7fd0c1a94640 1 --2- 172.21.15.84:0/4046919165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b036e9f0 0x5626b0762df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.303+0000 7fd0c1a94640 1 -- 172.21.15.84:0/4046919165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b03871b0 msgr2=0x5626b076ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:55.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.303+0000 7fd0c1a94640 1 --2- 172.21.15.84:0/4046919165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b03871b0 0x5626b076ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.303+0000 7fd0c1a94640 1 -- 172.21.15.84:0/4046919165 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626b0763bf0 con 0x5626b038f390 2024-09-21T03:53:55.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.303+0000 7fd0c0a92640 1 --2- 172.21.15.84:0/4046919165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b03871b0 0x5626b076ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:55.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.304+0000 7fd0c1a94640 1 --2- 172.21.15.84:0/4046919165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b038f390 0x5626b075fb20 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40ce7f0 tx=0x7fd0b402f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ddc8d6dbe486c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:55.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.304+0000 7fd0a6ffd640 1 -- 172.21.15.84:0/4046919165 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b40ce600 con 0x5626b038f390 2024-09-21T03:53:55.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.304+0000 7fd0a6ffd640 1 -- 172.21.15.84:0/4046919165 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0b4036040 con 0x5626b038f390 2024-09-21T03:53:55.307 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.304+0000 7fd0a6ffd640 1 -- 172.21.15.84:0/4046919165 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b40d8510 con 0x5626b038f390 2024-09-21T03:53:55.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.305+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/4046919165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b038f390 msgr2=0x5626b075fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.305+0000 7fd0c9a6b740 1 --2- 172.21.15.84:0/4046919165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b038f390 0x5626b075fb20 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40ce7f0 tx=0x7fd0b402f660 comp rx=0 tx=0).stop 2024-09-21T03:53:55.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.305+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/4046919165 shutdown_connections 2024-09-21T03:53:55.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.305+0000 7fd0c9a6b740 1 --2- 172.21.15.84:0/4046919165 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b038f390 0x5626b075fb20 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.305+0000 7fd0c9a6b740 1 --2- 172.21.15.84:0/4046919165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b03871b0 0x5626b076ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.305+0000 7fd0c9a6b740 1 --2- 172.21.15.84:0/4046919165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b036e9f0 0x5626b0762df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.305+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/4046919165 >> 172.21.15.84:0/4046919165 conn(0x5626b03a4460 msgr2=0x5626b07626e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:55.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.305+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/4046919165 shutdown_connections 2024-09-21T03:53:55.311 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.305+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/4046919165 wait complete. 2024-09-21T03:53:55.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.305+0000 7fd0c9a6b740 1 -- start start 2024-09-21T03:53:55.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.305+0000 7fd0c9a6b740 1 Processor -- start 2024-09-21T03:53:55.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.306+0000 7fd0c9a6b740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b036e9f0 0x5626b0778290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.306+0000 7fd0c9a6b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b03871b0 0x5626b0775760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.306+0000 7fd0c9a6b740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b038f390 0x5626b0775ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.306+0000 7fd0c9a6b740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc1aba40 con 0x5626b036e9f0 2024-09-21T03:53:55.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.306+0000 7fd0c9a6b740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc1aceb0 con 0x5626b038f390 2024-09-21T03:53:55.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.306+0000 7fd0c9a6b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc1ac110 con 0x5626b03871b0 2024-09-21T03:53:55.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.306+0000 7fd0c9a6b740 10 client.0 _ll_register_callbacks cb 0x7fd0b800bba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:53:55.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.306+0000 7fd0c1293640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b036e9f0 0x5626b0778290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.306+0000 7fd0c1293640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b036e9f0 0x5626b0778290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45196/0 (socket says 172.21.15.84:45196) 2024-09-21T03:53:55.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.306+0000 7fd0c1293640 1 -- 172.21.15.84:0/500363704 learned_addr learned my addr 172.21.15.84:0/500363704 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:55.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.306+0000 7fd0c0a92640 1 --2- 172.21.15.84:0/500363704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b03871b0 0x5626b0775760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.312 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.306+0000 7fd0c1a94640 1 --2- 172.21.15.84:0/500363704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b038f390 0x5626b0775ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.306+0000 7fd0c1293640 1 -- 172.21.15.84:0/500363704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b03871b0 msgr2=0x5626b0775760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:55.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.306+0000 7fd0c1293640 1 --2- 172.21.15.84:0/500363704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b03871b0 0x5626b0775760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.306+0000 7fd0c1293640 1 -- 172.21.15.84:0/500363704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b038f390 msgr2=0x5626b0775ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:55.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.306+0000 7fd0c1293640 1 --2- 172.21.15.84:0/500363704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b038f390 0x5626b0775ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.306+0000 7fd0c1293640 1 -- 172.21.15.84:0/500363704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626b0776410 con 0x5626b036e9f0 2024-09-21T03:53:55.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.306+0000 7fd0c1a94640 1 --2- 172.21.15.84:0/500363704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b038f390 0x5626b0775ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:55.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.306+0000 7fd0c1293640 1 --2- 172.21.15.84:0/500363704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b036e9f0 0x5626b0778290 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800bd50 tx=0x7fd0b8011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e523f4fba2c54060 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:55.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.306+0000 7fd0a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:53:55.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.307+0000 7fd0a4ff9640 1 -- 172.21.15.84:0/500363704 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b802c070 con 0x5626b036e9f0 2024-09-21T03:53:55.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.307+0000 7fd0a4ff9640 1 -- 172.21.15.84:0/500363704 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7fd0b8005640 con 0x5626b036e9f0 2024-09-21T03:53:55.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.307+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/500363704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0b4036040 con 0x5626b036e9f0 2024-09-21T03:53:55.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.307+0000 7fd0a4ff9640 1 -- 172.21.15.84:0/500363704 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd0b800b410 con 0x5626b036e9f0 2024-09-21T03:53:55.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.307+0000 7fd0c9a6b740 10 client.17625 fetch_fsmap learned FSMap version 25 2024-09-21T03:53:55.313 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.307+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/500363704 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5626b07df140 con 0x5626b036e9f0 2024-09-21T03:53:55.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.307+0000 7fd0a4ff9640 1 -- 172.21.15.84:0/500363704 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0b4036040 con 0x5626b036e9f0 2024-09-21T03:53:55.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.307+0000 7fd0a4ff9640 1 -- 172.21.15.84:0/500363704 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd0b8039070 con 0x5626b036e9f0 2024-09-21T03:53:55.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.307+0000 7fd0c9a6b740 10 client.17625 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:53:55.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.307+0000 7fd0c9a6b740 10 client.17625 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:53:55.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.307+0000 7fd0c9a6b740 20 client.17625 populate_metadata read hostname 'smithi084' 2024-09-21T03:53:55.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.307+0000 7fd0c9a6b740 1 --2- 172.21.15.84:0/500363704 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5626b03b0070 0x5626b07e18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.307+0000 7fd0c9a6b740 4 client.17625 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:53:55.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.307+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/500363704 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5626b06c8c80 con 0x5626b03b0070 2024-09-21T03:53:55.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.308+0000 7fd0c0a92640 1 --2- 172.21.15.84:0/500363704 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5626b03b0070 0x5626b07e18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.308+0000 7fd0c0a92640 1 --2- 172.21.15.84:0/500363704 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5626b03b0070 0x5626b07e18d0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5da04e879887b1f3 server_cookie=f50f241c95ded33e in_seq=0 out_seq=0 2024-09-21T03:53:55.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.308+0000 7fd0a4ff9640 10 client.17625 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:53:55.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.308+0000 7fd0a4ff9640 1 -- 172.21.15.84:0/500363704 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5770 (crc 0 0 0) 0x5626b06c8c80 con 0x5626b03b0070 2024-09-21T03:53:55.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.308+0000 7fd0a4ff9640 10 client.17625 handle_command_reply: tid=0 2024-09-21T03:53:55.314 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.308+0000 7fd0c9a6b740 1 client.17625 shutdown 2024-09-21T03:53:55.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.308+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/500363704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b036e9f0 msgr2=0x5626b0778290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.308+0000 7fd0c9a6b740 1 --2- 172.21.15.84:0/500363704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b036e9f0 0x5626b0778290 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800bd50 tx=0x7fd0b8011440 comp rx=0 tx=0).stop 2024-09-21T03:53:55.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.308+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/500363704 shutdown_connections 2024-09-21T03:53:55.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.308+0000 7fd0c9a6b740 1 --2- 172.21.15.84:0/500363704 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x5626b03b0070 0x5626b07e18d0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.308+0000 7fd0c9a6b740 1 --2- 172.21.15.84:0/500363704 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5626b038f390 0x5626b0775ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.308+0000 7fd0c9a6b740 1 --2- 172.21.15.84:0/500363704 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5626b03871b0 0x5626b0775760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.308+0000 7fd0a4ff9640 0 client.17625 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:53:55.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.308+0000 7fd0c9a6b740 1 --2- 172.21.15.84:0/500363704 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x5626b036e9f0 0x5626b0778290 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.309+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/500363704 >> 172.21.15.84:0/500363704 conn(0x5626b03a4460 msgr2=0x5626b0760d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:55.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.309+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/500363704 shutdown_connections 2024-09-21T03:53:55.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.309+0000 7fd0c9a6b740 1 -- 172.21.15.84:0/500363704 wait complete. 2024-09-21T03:53:55.315 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.309+0000 7fd0c9a6b740 20 client.17625 trim_cache size 0 max 16384 2024-09-21T03:53:55.316 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:53:55.316 INFO:teuthology.orchestra.run.smithi084.stdout: "status": "no active scrubs running", 2024-09-21T03:53:55.316 INFO:teuthology.orchestra.run.smithi084.stdout: "scrubs": {}, 2024-09-21T03:53:55.316 INFO:teuthology.orchestra.run.smithi084.stdout: "scrub_stats": { 2024-09-21T03:53:55.316 INFO:teuthology.orchestra.run.smithi084.stdout: "31a6ce4e-761a-4c6c-86d8-849dce60d2f5": { 2024-09-21T03:53:55.316 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:53:22.101362+0000", 2024-09-21T03:53:55.316 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:55.316 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:55.316 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:55.316 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:55.317 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:55.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:55.317 INFO:teuthology.orchestra.run.smithi084.stdout: "1583169c-207f-40ad-b200-4ef92de62783": { 2024-09-21T03:53:55.317 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:52:29.382669+0000", 2024-09-21T03:53:55.317 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:55.317 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:55.317 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:55.317 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:55.317 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:55.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:55.317 INFO:teuthology.orchestra.run.smithi084.stdout: "d85cdf50-3fc8-467d-942f-2b77981ba106": { 2024-09-21T03:53:55.317 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:43.684286+0000", 2024-09-21T03:53:55.317 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:55.317 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:55.317 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:55.318 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:55.318 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:55.318 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:55.318 INFO:teuthology.orchestra.run.smithi084.stdout: "e42cb821-db94-475b-a21a-8d8d086f7207": { 2024-09-21T03:53:55.318 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:42:29.560542+0000", 2024-09-21T03:53:55.318 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:55.318 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:55.318 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:55.318 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:55.318 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:55.318 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:55.318 INFO:teuthology.orchestra.run.smithi084.stdout: "60214753-df43-47aa-b007-fe33bbde062a": { 2024-09-21T03:53:55.318 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:52:39.830410+0000", 2024-09-21T03:53:55.319 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:55.319 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:55.319 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:55.319 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:55.319 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:55.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:55.319 INFO:teuthology.orchestra.run.smithi084.stdout: "e4317214-6a95-4e1b-9027-1cadb386ea43": { 2024-09-21T03:53:55.319 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:13.061466+0000", 2024-09-21T03:53:55.319 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:55.319 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:55.319 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:55.319 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:55.319 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:55.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:55.320 INFO:teuthology.orchestra.run.smithi084.stdout: "2cbf94ea-caa1-4c9b-8007-8a0887103a5c": { 2024-09-21T03:53:55.320 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:51:05.114755+0000", 2024-09-21T03:53:55.320 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:55.320 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:55.320 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:55.320 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:55.320 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:55.320 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:55.320 INFO:teuthology.orchestra.run.smithi084.stdout: "a134896d-df56-4c5c-9871-49e10f1f62c3": { 2024-09-21T03:53:55.320 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:43:25.319162+0000", 2024-09-21T03:53:55.320 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:55.320 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:55.320 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:55.320 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:55.321 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:55.321 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:55.321 INFO:teuthology.orchestra.run.smithi084.stdout: "40ac7eb4-6391-480d-a65f-40f0a2621b24": { 2024-09-21T03:53:55.321 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:09.430070+0000", 2024-09-21T03:53:55.321 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:55.321 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:55.321 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:55.321 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:55.321 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:55.321 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:55.321 INFO:teuthology.orchestra.run.smithi084.stdout: "43a49cca-fc1c-4c36-a314-49033e7c3fb6": { 2024-09-21T03:53:55.321 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:49:17.366428+0000", 2024-09-21T03:53:55.321 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:55.321 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:55.322 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:55.322 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:55.322 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:55.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:55.322 INFO:teuthology.orchestra.run.smithi084.stdout: "0bb4e83d-6059-4d41-88f0-1562fa422c47": { 2024-09-21T03:53:55.322 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:54.511018+0000", 2024-09-21T03:53:55.322 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:55.322 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:55.322 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:55.322 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:55.322 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:55.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:55.322 INFO:teuthology.orchestra.run.smithi084.stdout: "d1c765c2-f7d2-44d4-9027-7b22ad50e3ed": { 2024-09-21T03:53:55.322 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:44:19.903810+0000", 2024-09-21T03:53:55.323 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:55.323 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:55.323 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:55.323 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:55.323 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:55.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:55.323 INFO:teuthology.orchestra.run.smithi084.stdout: "da2f3db0-feaa-467d-a9dc-66ee7b9e5de3": { 2024-09-21T03:53:55.323 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:02.370757+0000", 2024-09-21T03:53:55.323 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:55.323 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:55.323 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:55.323 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:55.323 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:55.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:55.324 INFO:teuthology.orchestra.run.smithi084.stdout: "5435e7df-7d39-4687-a715-54c7af6bc3b1": { 2024-09-21T03:53:55.324 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:51:47.429708+0000", 2024-09-21T03:53:55.324 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:55.324 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:55.324 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:55.324 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:55.324 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:55.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:55.324 INFO:teuthology.orchestra.run.smithi084.stdout: "27dcb84c-89fa-46b2-b980-58857966c697": { 2024-09-21T03:53:55.324 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:52.598527+0000", 2024-09-21T03:53:55.324 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:55.324 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:55.324 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:55.324 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:55.324 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:55.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:55.325 INFO:teuthology.orchestra.run.smithi084.stdout: "954d2649-ab71-4fff-8083-23a07798c7f1": { 2024-09-21T03:53:55.325 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:45:45.232693+0000", 2024-09-21T03:53:55.325 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:55.325 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:55.325 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:55.325 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:55.325 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:55.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:55.325 INFO:teuthology.orchestra.run.smithi084.stdout: "76fe28fc-001d-4a83-89c6-36f23b2fbf13": { 2024-09-21T03:53:55.325 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:46:27.677638+0000", 2024-09-21T03:53:55.325 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:55.325 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:55.325 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:55.326 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:55.326 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:55.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:55.326 INFO:teuthology.orchestra.run.smithi084.stdout: "3227fa23-3635-4300-9e54-df2b6386d541": { 2024-09-21T03:53:55.326 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:47:10.278579+0000", 2024-09-21T03:53:55.326 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:55.326 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:55.326 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:55.326 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:55.326 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:55.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:55.326 INFO:teuthology.orchestra.run.smithi084.stdout: "b2063a70-0b1f-4b6b-9c96-d886e156ea66": { 2024-09-21T03:53:55.326 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:48:34.864478+0000", 2024-09-21T03:53:55.326 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:55.327 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:55.327 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:55.327 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:55.327 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:55.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:53:55.327 INFO:teuthology.orchestra.run.smithi084.stdout: "33131451-f242-447a-b13f-9bdebc7884ec": { 2024-09-21T03:53:55.327 INFO:teuthology.orchestra.run.smithi084.stdout: "start_time": "2024-09-21T03:50:00.524357+0000", 2024-09-21T03:53:55.327 INFO:teuthology.orchestra.run.smithi084.stdout: "path": "/", 2024-09-21T03:53:55.327 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_started": 0, 2024-09-21T03:53:55.327 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_passed": 0, 2024-09-21T03:53:55.327 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_failed": 0, 2024-09-21T03:53:55.327 INFO:teuthology.orchestra.run.smithi084.stdout: "uninline_skipped": 0 2024-09-21T03:53:55.327 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:53:55.327 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:53:55.327 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:53:55.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.309+0000 7fd0c34f7640 1 -- 172.21.15.84:0/2979637957 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd0a80b6680 msgr2=0x7fd0a80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.309+0000 7fd0c34f7640 1 --2- 172.21.15.84:0/2979637957 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd0a80b6680 0x7fd0a80b8b90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0058c0 tx=0x7fd0ac00c490 comp rx=0 tx=0).stop 2024-09-21T03:53:55.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.309+0000 7fd0c34f7640 1 -- 172.21.15.84:0/2979637957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0bc108d10 msgr2=0x7fd0bc19eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.309+0000 7fd0c34f7640 1 --2- 172.21.15.84:0/2979637957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0bc108d10 0x7fd0bc19eb90 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4005cc0 tx=0x7fd0b402f380 comp rx=0 tx=0).stop 2024-09-21T03:53:55.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.309+0000 7fd0c34f7640 1 -- 172.21.15.84:0/2979637957 shutdown_connections 2024-09-21T03:53:55.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.309+0000 7fd0c34f7640 1 --2- 172.21.15.84:0/2979637957 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd0a80b6680 0x7fd0a80b8b90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.309+0000 7fd0c34f7640 1 --2- 172.21.15.84:0/2979637957 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd0bc108d10 0x7fd0bc19eb90 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.309+0000 7fd0c34f7640 1 --2- 172.21.15.84:0/2979637957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0bc1083c0 0x7fd0bc1998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.328 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.309+0000 7fd0c34f7640 1 --2- 172.21.15.84:0/2979637957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd0bc102a80 0x7fd0bc199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.309+0000 7fd0c34f7640 1 -- 172.21.15.84:0/2979637957 >> 172.21.15.84:0/2979637957 conn(0x7fd0bc079740 msgr2=0x7fd0bc1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:55.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.309+0000 7fd0c34f7640 1 -- 172.21.15.84:0/2979637957 shutdown_connections 2024-09-21T03:53:55.329 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:55.310+0000 7fd0c34f7640 1 -- 172.21.15.84:0/2979637957 wait complete. 2024-09-21T03:53:56.195 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:53:56.196 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:53:56.446 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:56.566 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:56 smithi084 ceph-mon[30941]: pgmap v677: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 11 op/s 2024-09-21T03:53:56.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:56 smithi174 ceph-mon[34403]: pgmap v677: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 11 op/s 2024-09-21T03:53:56.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:56 smithi172 ceph-mon[34821]: pgmap v677: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 11 op/s 2024-09-21T03:53:56.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.942+0000 7f7941681640 1 -- 172.21.15.84:0/2223592131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f793c10de10 msgr2=0x7f793c110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:56.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.942+0000 7f7941681640 1 --2- 172.21.15.84:0/2223592131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f793c10de10 0x7f793c110300 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f7934009900 tx=0x7f793402a410 comp rx=0 tx=0).stop 2024-09-21T03:53:56.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.942+0000 7f7941681640 1 -- 172.21.15.84:0/2223592131 shutdown_connections 2024-09-21T03:53:56.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.942+0000 7f7941681640 1 --2- 172.21.15.84:0/2223592131 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f793c10de10 0x7f793c110300 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:56.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.942+0000 7f7941681640 1 --2- 172.21.15.84:0/2223592131 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f793c105300 0x7f793c10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:56.959 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.942+0000 7f7941681640 1 --2- 172.21.15.84:0/2223592131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c1049b0 0x7f793c104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.943+0000 7f7941681640 1 -- 172.21.15.84:0/2223592131 >> 172.21.15.84:0/2223592131 conn(0x7f793c079730 msgr2=0x7f793c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.943+0000 7f7941681640 1 -- 172.21.15.84:0/2223592131 shutdown_connections 2024-09-21T03:53:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.943+0000 7f7941681640 1 -- 172.21.15.84:0/2223592131 wait complete. 2024-09-21T03:53:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.943+0000 7f7941681640 1 Processor -- start 2024-09-21T03:53:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.943+0000 7f7941681640 1 -- start start 2024-09-21T03:53:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.944+0000 7f7941681640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f793c1049b0 0x7f793c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.944+0000 7f7941681640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f793c105300 0x7f793c19ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.944+0000 7f7941681640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c10de10 0x7f793c19fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.944+0000 7f7941681640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f793c113b70 con 0x7f793c1049b0 2024-09-21T03:53:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.944+0000 7f7941681640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f793c1139f0 con 0x7f793c10de10 2024-09-21T03:53:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.944+0000 7f7941681640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f793c113cf0 con 0x7f793c105300 2024-09-21T03:53:56.960 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.944+0000 7f793affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f793c1049b0 0x7f793c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:56.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.944+0000 7f793affd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f793c1049b0 0x7f793c19a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:45214/0 (socket says 172.21.15.84:45214) 2024-09-21T03:53:56.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.944+0000 7f793affd640 1 -- 172.21.15.84:0/2283601661 learned_addr learned my addr 172.21.15.84:0/2283601661 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:56.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.944+0000 7f793a7fc640 1 --2- 172.21.15.84:0/2283601661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f793c105300 0x7f793c19ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:56.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.944+0000 7f793b7fe640 1 --2- 172.21.15.84:0/2283601661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c10de10 0x7f793c19fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:56.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.944+0000 7f793affd640 1 -- 172.21.15.84:0/2283601661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f793c105300 msgr2=0x7f793c19ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:56.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.944+0000 7f793affd640 1 --2- 172.21.15.84:0/2283601661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f793c105300 0x7f793c19ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:56.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.944+0000 7f793affd640 1 -- 172.21.15.84:0/2283601661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c10de10 msgr2=0x7f793c19fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:56.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.944+0000 7f793affd640 1 --2- 172.21.15.84:0/2283601661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c10de10 0x7f793c19fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:56.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.944+0000 7f793affd640 1 -- 172.21.15.84:0/2283601661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793c1a05d0 con 0x7f793c1049b0 2024-09-21T03:53:56.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.944+0000 7f793b7fe640 1 --2- 172.21.15.84:0/2283601661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c10de10 0x7f793c19fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:53:56.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.944+0000 7f793affd640 1 --2- 172.21.15.84:0/2283601661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f793c1049b0 0x7f793c19a660 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f792c00b9c0 tx=0x7f792c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:56.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.944+0000 7f7923fff640 1 -- 172.21.15.84:0/2283601661 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c019070 con 0x7f793c1049b0 2024-09-21T03:53:56.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.945+0000 7f7923fff640 1 -- 172.21.15.84:0/2283601661 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f792c00cba0 con 0x7f793c1049b0 2024-09-21T03:53:56.961 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.945+0000 7f7941681640 1 -- 172.21.15.84:0/2283601661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f793c1a08c0 con 0x7f793c1049b0 2024-09-21T03:53:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.945+0000 7f7923fff640 1 -- 172.21.15.84:0/2283601661 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c0125a0 con 0x7f793c1049b0 2024-09-21T03:53:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.945+0000 7f7941681640 1 -- 172.21.15.84:0/2283601661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f793c1a7020 con 0x7f793c1049b0 2024-09-21T03:53:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.946+0000 7f7941681640 1 -- 172.21.15.84:0/2283601661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f793c104e40 con 0x7f793c1049b0 2024-09-21T03:53:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.947+0000 7f7923fff640 1 -- 172.21.15.84:0/2283601661 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f792c01c070 con 0x7f793c1049b0 2024-09-21T03:53:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.948+0000 7f7923fff640 1 --2- 172.21.15.84:0/2283601661 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f79240b6680 0x7f79240b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.948+0000 7f793a7fc640 1 --2- 172.21.15.84:0/2283601661 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f79240b6680 0x7f79240b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.948+0000 7f7923fff640 1 -- 172.21.15.84:0/2283601661 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f792c0e7190 con 0x7f793c1049b0 2024-09-21T03:53:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.949+0000 7f793a7fc640 1 --2- 172.21.15.84:0/2283601661 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f79240b6680 0x7f79240b8b90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f793c07a110 tx=0x7f7930008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:56.962 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:56.952+0000 7f7923fff640 1 -- 172.21.15.84:0/2283601661 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f792c0ad730 con 0x7f793c1049b0 2024-09-21T03:53:57.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:57.165+0000 7f7941681640 1 -- 172.21.15.84:0/2283601661 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f793c19b790 con 0x7f793c1049b0 2024-09-21T03:53:57.167 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:57.165+0000 7f7923fff640 1 -- 172.21.15.84:0/2283601661 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7f793c19b790 con 0x7f793c1049b0 2024-09-21T03:53:57.168 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:53:57.168 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:53:57.168 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:53:57.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:57.168+0000 7f7941681640 1 -- 172.21.15.84:0/2283601661 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f79240b6680 msgr2=0x7f79240b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:57.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:57.168+0000 7f7941681640 1 --2- 172.21.15.84:0/2283601661 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f79240b6680 0x7f79240b8b90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f793c07a110 tx=0x7f7930008040 comp rx=0 tx=0).stop 2024-09-21T03:53:57.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:57.168+0000 7f7941681640 1 -- 172.21.15.84:0/2283601661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f793c1049b0 msgr2=0x7f793c19a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:57.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:57.168+0000 7f7941681640 1 --2- 172.21.15.84:0/2283601661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f793c1049b0 0x7f793c19a660 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f792c00b9c0 tx=0x7f792c00be80 comp rx=0 tx=0).stop 2024-09-21T03:53:57.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:57.168+0000 7f7941681640 1 -- 172.21.15.84:0/2283601661 shutdown_connections 2024-09-21T03:53:57.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:57.168+0000 7f7941681640 1 --2- 172.21.15.84:0/2283601661 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f79240b6680 0x7f79240b8b90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:57.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:57.168+0000 7f7941681640 1 --2- 172.21.15.84:0/2283601661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793c10de10 0x7f793c19fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:57.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:57.168+0000 7f7941681640 1 --2- 172.21.15.84:0/2283601661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f793c105300 0x7f793c19ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:57.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:57.168+0000 7f7941681640 1 --2- 172.21.15.84:0/2283601661 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f793c1049b0 0x7f793c19a660 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:57.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:57.168+0000 7f7941681640 1 -- 172.21.15.84:0/2283601661 >> 172.21.15.84:0/2283601661 conn(0x7f793c079730 msgr2=0x7f793c100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:57.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:57.168+0000 7f7941681640 1 -- 172.21.15.84:0/2283601661 shutdown_connections 2024-09-21T03:53:57.171 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:57.168+0000 7f7941681640 1 -- 172.21.15.84:0/2283601661 wait complete. 2024-09-21T03:53:57.538 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:57 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2283601661' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:53:57.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:57 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2283601661' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:53:57.650 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:57 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2283601661' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:53:57.883 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:53:58.128 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:58.550 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:53:58 smithi084 ceph-mon[30941]: pgmap v678: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.1 KiB/s wr, 7 op/s 2024-09-21T03:53:58.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:53:58 smithi174 ceph-mon[34403]: pgmap v678: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.1 KiB/s wr, 7 op/s 2024-09-21T03:53:58.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:53:58 smithi172 ceph-mon[34821]: pgmap v678: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.1 KiB/s wr, 7 op/s 2024-09-21T03:53:58.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.640+0000 7fd22bf0c640 1 -- 172.21.15.84:0/1781227520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd224103230 msgr2=0x7fd224103640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:58.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.640+0000 7fd22bf0c640 1 --2- 172.21.15.84:0/1781227520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd224103230 0x7fd224103640 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fd218009900 tx=0x7fd21802a410 comp rx=0 tx=0).stop 2024-09-21T03:53:58.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.640+0000 7fd22bf0c640 1 -- 172.21.15.84:0/1781227520 shutdown_connections 2024-09-21T03:53:58.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.640+0000 7fd22bf0c640 1 --2- 172.21.15.84:0/1781227520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd224108db0 0x7fd22410f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.640+0000 7fd22bf0c640 1 --2- 172.21.15.84:0/1781227520 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd224108460 0x7fd224108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.640+0000 7fd22bf0c640 1 --2- 172.21.15.84:0/1781227520 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd224103230 0x7fd224103640 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.640+0000 7fd22bf0c640 1 -- 172.21.15.84:0/1781227520 >> 172.21.15.84:0/1781227520 conn(0x7fd224079ec0 msgr2=0x7fd22407a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:58.718 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.640+0000 7fd22bf0c640 1 -- 172.21.15.84:0/1781227520 shutdown_connections 2024-09-21T03:53:58.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.640+0000 7fd22bf0c640 1 -- 172.21.15.84:0/1781227520 wait complete. 2024-09-21T03:53:58.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.641+0000 7fd22bf0c640 1 Processor -- start 2024-09-21T03:53:58.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.641+0000 7fd22bf0c640 1 -- start start 2024-09-21T03:53:58.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.641+0000 7fd22bf0c640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd224103230 0x7fd2240feef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.641+0000 7fd22bf0c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd224108460 0x7fd2240ff430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd22bf0c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd224108db0 0x7fd2240ff970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd22bf0c640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd224112a70 con 0x7fd224108460 2024-09-21T03:53:58.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd22bf0c640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241128f0 con 0x7fd224103230 2024-09-21T03:53:58.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd22bf0c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd224112bf0 con 0x7fd224108db0 2024-09-21T03:53:58.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd2294a7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd224108460 0x7fd2240ff430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd2294a7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd224108460 0x7fd2240ff430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46220/0 (socket says 172.21.15.84:46220) 2024-09-21T03:53:58.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd2294a7640 1 -- 172.21.15.84:0/1232194946 learned_addr learned my addr 172.21.15.84:0/1232194946 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:58.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd22a4a9640 1 --2- 172.21.15.84:0/1232194946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd224108db0 0x7fd2240ff970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.719 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd229ca8640 1 --2- 172.21.15.84:0/1232194946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd224103230 0x7fd2240feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd2294a7640 1 -- 172.21.15.84:0/1232194946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd224108db0 msgr2=0x7fd2240ff970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:58.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd2294a7640 1 --2- 172.21.15.84:0/1232194946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd224108db0 0x7fd2240ff970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd2294a7640 1 -- 172.21.15.84:0/1232194946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd224103230 msgr2=0x7fd2240feef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:58.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd2294a7640 1 --2- 172.21.15.84:0/1232194946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd224103230 0x7fd2240feef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd2294a7640 1 -- 172.21.15.84:0/1232194946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2241a8870 con 0x7fd224108460 2024-09-21T03:53:58.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd229ca8640 1 --2- 172.21.15.84:0/1232194946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd224103230 0x7fd2240feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:53:58.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd22a4a9640 1 --2- 172.21.15.84:0/1232194946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd224108db0 0x7fd2240ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:58.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd2294a7640 1 --2- 172.21.15.84:0/1232194946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd224108460 0x7fd2240ff430 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fd22000d750 tx=0x7fd22000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:58.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd216ffd640 1 -- 172.21.15.84:0/1232194946 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd220017070 con 0x7fd224108460 2024-09-21T03:53:58.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd22bf0c640 1 -- 172.21.15.84:0/1232194946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2241a8b60 con 0x7fd224108460 2024-09-21T03:53:58.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd216ffd640 1 -- 172.21.15.84:0/1232194946 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2200054d0 con 0x7fd224108460 2024-09-21T03:53:58.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd216ffd640 1 -- 172.21.15.84:0/1232194946 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd220004c30 con 0x7fd224108460 2024-09-21T03:53:58.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.642+0000 7fd22bf0c640 1 -- 172.21.15.84:0/1232194946 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2241a90a0 con 0x7fd224108460 2024-09-21T03:53:58.720 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.645+0000 7fd216ffd640 1 -- 172.21.15.84:0/1232194946 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fd220004dd0 con 0x7fd224108460 2024-09-21T03:53:58.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.645+0000 7fd232480740 1 Processor -- start 2024-09-21T03:53:58.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.645+0000 7fd232480740 1 -- start start 2024-09-21T03:53:58.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.645+0000 7fd232480740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d4f070 0x564ed50f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.645+0000 7fd232480740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed4d261b0 0x564ed50f6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.645+0000 7fd232480740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d2e390 0x564ed50f7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.645+0000 7fd232480740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564ed506cea0 con 0x564ed4d4f070 2024-09-21T03:53:58.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.645+0000 7fd232480740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564ed505c2d0 con 0x564ed4d2e390 2024-09-21T03:53:58.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.645+0000 7fd232480740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564ed50600e0 con 0x564ed4d261b0 2024-09-21T03:53:58.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.646+0000 7fd22a4a9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d4f070 0x564ed50f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.646+0000 7fd22a4a9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d4f070 0x564ed50f66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46222/0 (socket says 172.21.15.84:46222) 2024-09-21T03:53:58.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.646+0000 7fd22a4a9640 1 -- 172.21.15.84:0/4260169038 learned_addr learned my addr 172.21.15.84:0/4260169038 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:58.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.646+0000 7fd229ca8640 1 --2- 172.21.15.84:0/4260169038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed4d261b0 0x564ed50f6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.646+0000 7fd2294a7640 1 --2- 172.21.15.84:0/4260169038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d2e390 0x564ed50f7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.646+0000 7fd22a4a9640 1 -- 172.21.15.84:0/4260169038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed4d261b0 msgr2=0x564ed50f6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:58.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.646+0000 7fd22a4a9640 1 --2- 172.21.15.84:0/4260169038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed4d261b0 0x564ed50f6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.646+0000 7fd22a4a9640 1 -- 172.21.15.84:0/4260169038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d2e390 msgr2=0x564ed50f7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:58.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.646+0000 7fd22a4a9640 1 --2- 172.21.15.84:0/4260169038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d2e390 0x564ed50f7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.646+0000 7fd22a4a9640 1 -- 172.21.15.84:0/4260169038 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ed4dba650 con 0x564ed4d4f070 2024-09-21T03:53:58.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.646+0000 7fd216ffd640 1 --2- 172.21.15.84:0/1232194946 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd2100b6680 0x7fd2100b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.646+0000 7fd2294a7640 1 --2- 172.21.15.84:0/4260169038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d2e390 0x564ed50f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:53:58.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.646+0000 7fd229ca8640 1 --2- 172.21.15.84:0/1232194946 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd2100b6680 0x7fd2100b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.646+0000 7fd22a4a9640 1 --2- 172.21.15.84:0/4260169038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d4f070 0x564ed50f66a0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00ae80 tx=0x7fd21c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa7dea64d765439 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:58.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.646+0000 7fd216ffd640 1 -- 172.21.15.84:0/1232194946 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7fd2200e7190 con 0x7fd224108460 2024-09-21T03:53:58.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.646+0000 7fd20ffff640 1 -- 172.21.15.84:0/4260169038 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c003b70 con 0x564ed4d4f070 2024-09-21T03:53:58.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.646+0000 7fd20ffff640 1 -- 172.21.15.84:0/4260169038 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd21c010af0 con 0x564ed4d4f070 2024-09-21T03:53:58.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.646+0000 7fd20ffff640 1 -- 172.21.15.84:0/4260169038 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c00fa20 con 0x564ed4d4f070 2024-09-21T03:53:58.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.647+0000 7fd232480740 1 -- 172.21.15.84:0/4260169038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d4f070 msgr2=0x564ed50f66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:58.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.647+0000 7fd229ca8640 1 --2- 172.21.15.84:0/1232194946 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd2100b6680 0x7fd2100b8b90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd218031440 tx=0x7fd218005ee0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:58.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.647+0000 7fd232480740 1 --2- 172.21.15.84:0/4260169038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d4f070 0x564ed50f66a0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00ae80 tx=0x7fd21c00e720 comp rx=0 tx=0).stop 2024-09-21T03:53:58.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.647+0000 7fd232480740 1 -- 172.21.15.84:0/4260169038 shutdown_connections 2024-09-21T03:53:58.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.647+0000 7fd232480740 1 --2- 172.21.15.84:0/4260169038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d2e390 0x564ed50f7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.647+0000 7fd232480740 1 --2- 172.21.15.84:0/4260169038 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed4d261b0 0x564ed50f6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.647+0000 7fd232480740 1 --2- 172.21.15.84:0/4260169038 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d4f070 0x564ed50f66a0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.647+0000 7fd232480740 1 -- 172.21.15.84:0/4260169038 >> 172.21.15.84:0/4260169038 conn(0x564ed4d43460 msgr2=0x564ed50f4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:58.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.647+0000 7fd232480740 1 -- 172.21.15.84:0/4260169038 shutdown_connections 2024-09-21T03:53:58.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.647+0000 7fd232480740 1 -- 172.21.15.84:0/4260169038 wait complete. 2024-09-21T03:53:58.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.648+0000 7fd232480740 1 -- start start 2024-09-21T03:53:58.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.648+0000 7fd232480740 1 Processor -- start 2024-09-21T03:53:58.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.648+0000 7fd232480740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed4d261b0 0x564ed5101d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.648+0000 7fd232480740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d2e390 0x564ed5102250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.648+0000 7fd232480740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d4f070 0x564ed510e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.723 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.648+0000 7fd232480740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x564ed4ebd700 con 0x564ed4d4f070 2024-09-21T03:53:58.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.648+0000 7fd232480740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564ed4ff7160 con 0x564ed4d2e390 2024-09-21T03:53:58.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.648+0000 7fd232480740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x564ed5104e80 con 0x564ed4d261b0 2024-09-21T03:53:58.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.648+0000 7fd232480740 10 client.0 _ll_register_callbacks cb 0x564ed50109e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:53:58.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.649+0000 7fd22a4a9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d4f070 0x564ed510e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.649+0000 7fd22a4a9640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d4f070 0x564ed510e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46230/0 (socket says 172.21.15.84:46230) 2024-09-21T03:53:58.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.649+0000 7fd22a4a9640 1 -- 172.21.15.84:0/2736017650 learned_addr learned my addr 172.21.15.84:0/2736017650 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:58.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.649+0000 7fd229ca8640 1 --2- 172.21.15.84:0/2736017650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed4d261b0 0x564ed5101d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.649+0000 7fd2294a7640 1 --2- 172.21.15.84:0/2736017650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d2e390 0x564ed5102250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.649+0000 7fd22a4a9640 1 -- 172.21.15.84:0/2736017650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed4d261b0 msgr2=0x564ed5101d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:58.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.649+0000 7fd22a4a9640 1 --2- 172.21.15.84:0/2736017650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed4d261b0 0x564ed5101d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.649+0000 7fd22a4a9640 1 -- 172.21.15.84:0/2736017650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d2e390 msgr2=0x564ed5102250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:58.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.649+0000 7fd22a4a9640 1 --2- 172.21.15.84:0/2736017650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d2e390 0x564ed5102250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.649+0000 7fd22a4a9640 1 -- 172.21.15.84:0/2736017650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ed5024c90 con 0x564ed4d4f070 2024-09-21T03:53:58.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.649+0000 7fd2294a7640 1 --2- 172.21.15.84:0/2736017650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d2e390 0x564ed5102250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:58.724 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.649+0000 7fd22a4a9640 1 --2- 172.21.15.84:0/2736017650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d4f070 0x564ed510e170 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00abc0 tx=0x7fd21c00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469db73a1e5af3cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.649+0000 7fd20d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:53:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.649+0000 7fd20d7fa640 1 -- 172.21.15.84:0/2736017650 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c02a060 con 0x564ed4d4f070 2024-09-21T03:53:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.649+0000 7fd20d7fa640 1 -- 172.21.15.84:0/2736017650 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7fd21c004c50 con 0x564ed4d4f070 2024-09-21T03:53:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.649+0000 7fd232480740 1 -- 172.21.15.84:0/2736017650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd21c010af0 con 0x564ed4d4f070 2024-09-21T03:53:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.650+0000 7fd20d7fa640 1 -- 172.21.15.84:0/2736017650 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd21c004e50 con 0x564ed4d4f070 2024-09-21T03:53:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.650+0000 7fd232480740 10 client.17643 fetch_fsmap learned FSMap version 25 2024-09-21T03:53:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.650+0000 7fd232480740 1 -- 172.21.15.84:0/2736017650 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564ed5110ac0 con 0x564ed4d4f070 2024-09-21T03:53:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.650+0000 7fd20d7fa640 1 -- 172.21.15.84:0/2736017650 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd21c010af0 con 0x564ed4d4f070 2024-09-21T03:53:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.650+0000 7fd20d7fa640 1 -- 172.21.15.84:0/2736017650 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd21c005310 con 0x564ed4d4f070 2024-09-21T03:53:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.650+0000 7fd232480740 10 client.17643 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:53:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.650+0000 7fd232480740 10 client.17643 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:53:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.650+0000 7fd232480740 20 client.17643 populate_metadata read hostname 'smithi084' 2024-09-21T03:53:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.650+0000 7fd232480740 1 --2- 172.21.15.84:0/2736017650 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x564ed4d0d9f0 0x564ed5113f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.725 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.650+0000 7fd232480740 4 client.17643 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:53:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.650+0000 7fd232480740 1 -- 172.21.15.84:0/2736017650 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ed506edf0 con 0x564ed4d0d9f0 2024-09-21T03:53:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.650+0000 7fd229ca8640 1 --2- 172.21.15.84:0/2736017650 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x564ed4d0d9f0 0x564ed5113f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.651+0000 7fd20d7fa640 10 client.17643 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:53:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.651+0000 7fd229ca8640 1 --2- 172.21.15.84:0/2736017650 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x564ed4d0d9f0 0x564ed5113f30 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=15b784abaff0b5a6 server_cookie=44c6d873223eb763 in_seq=0 out_seq=0 2024-09-21T03:53:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.651+0000 7fd20d7fa640 1 -- 172.21.15.84:0/2736017650 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564ed506edf0 con 0x564ed4d0d9f0 2024-09-21T03:53:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.651+0000 7fd20d7fa640 10 client.17643 handle_command_reply: tid=0 2024-09-21T03:53:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.651+0000 7fd232480740 1 client.17643 shutdown 2024-09-21T03:53:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.652+0000 7fd232480740 1 -- 172.21.15.84:0/2736017650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d4f070 msgr2=0x564ed510e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.652+0000 7fd232480740 1 --2- 172.21.15.84:0/2736017650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d4f070 0x564ed510e170 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00abc0 tx=0x7fd21c00f3c0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.652+0000 7fd232480740 1 -- 172.21.15.84:0/2736017650 shutdown_connections 2024-09-21T03:53:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.652+0000 7fd232480740 1 --2- 172.21.15.84:0/2736017650 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x564ed4d0d9f0 0x564ed5113f30 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.652+0000 7fd232480740 1 --2- 172.21.15.84:0/2736017650 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d4f070 0x564ed510e170 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.652+0000 7fd232480740 1 --2- 172.21.15.84:0/2736017650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d2e390 0x564ed5102250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.726 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.652+0000 7fd20d7fa640 0 client.17643 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:53:58.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.652+0000 7fd232480740 1 --2- 172.21.15.84:0/2736017650 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed4d261b0 0x564ed5101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.652+0000 7fd232480740 1 -- 172.21.15.84:0/2736017650 >> 172.21.15.84:0/2736017650 conn(0x564ed4d43460 msgr2=0x564ed50f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:58.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.652+0000 7fd232480740 1 -- 172.21.15.84:0/2736017650 shutdown_connections 2024-09-21T03:53:58.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.652+0000 7fd232480740 1 -- 172.21.15.84:0/2736017650 wait complete. 2024-09-21T03:53:58.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.652+0000 7fd232480740 20 client.17643 trim_cache size 0 max 16384 2024-09-21T03:53:58.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.665+0000 7fd232480740 1 Processor -- start 2024-09-21T03:53:58.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.665+0000 7fd232480740 1 -- start start 2024-09-21T03:53:58.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.665+0000 7fd232480740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d261b0 0x564ed5103bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.665+0000 7fd232480740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed4d2e390 0x564ed50f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.665+0000 7fd232480740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d4f070 0x564ed510e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.665+0000 7fd232480740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241b4120 con 0x564ed4d261b0 2024-09-21T03:53:58.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.665+0000 7fd232480740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241b19f0 con 0x564ed4d4f070 2024-09-21T03:53:58.727 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.665+0000 7fd232480740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241af860 con 0x564ed4d2e390 2024-09-21T03:53:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.665+0000 7fd229ca8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d261b0 0x564ed5103bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.665+0000 7fd229ca8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d261b0 0x564ed5103bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46232/0 (socket says 172.21.15.84:46232) 2024-09-21T03:53:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.665+0000 7fd229ca8640 1 -- 172.21.15.84:0/2235521258 learned_addr learned my addr 172.21.15.84:0/2235521258 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.665+0000 7fd22a4a9640 1 --2- 172.21.15.84:0/2235521258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d4f070 0x564ed510e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.665+0000 7fd2294a7640 1 --2- 172.21.15.84:0/2235521258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed4d2e390 0x564ed50f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.665+0000 7fd229ca8640 1 -- 172.21.15.84:0/2235521258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed4d2e390 msgr2=0x564ed50f7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.665+0000 7fd229ca8640 1 --2- 172.21.15.84:0/2235521258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed4d2e390 0x564ed50f7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.665+0000 7fd229ca8640 1 -- 172.21.15.84:0/2235521258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d4f070 msgr2=0x564ed510e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.665+0000 7fd229ca8640 1 --2- 172.21.15.84:0/2235521258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d4f070 0x564ed510e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.666+0000 7fd229ca8640 1 -- 172.21.15.84:0/2235521258 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ed5104cd0 con 0x564ed4d261b0 2024-09-21T03:53:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.666+0000 7fd229ca8640 1 --2- 172.21.15.84:0/2235521258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d261b0 0x564ed5103bf0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fd2180096c0 tx=0x7fd21803f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fcc5ccee491752a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.666+0000 7fd20f7fe640 1 -- 172.21.15.84:0/2235521258 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd218035050 con 0x564ed4d261b0 2024-09-21T03:53:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.666+0000 7fd20f7fe640 1 -- 172.21.15.84:0/2235521258 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd218005020 con 0x564ed4d261b0 2024-09-21T03:53:58.728 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.666+0000 7fd20f7fe640 1 -- 172.21.15.84:0/2235521258 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2180047b0 con 0x564ed4d261b0 2024-09-21T03:53:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.667+0000 7fd232480740 1 -- 172.21.15.84:0/2235521258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d261b0 msgr2=0x564ed5103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.667+0000 7fd232480740 1 --2- 172.21.15.84:0/2235521258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d261b0 0x564ed5103bf0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fd2180096c0 tx=0x7fd21803f000 comp rx=0 tx=0).stop 2024-09-21T03:53:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.667+0000 7fd232480740 1 -- 172.21.15.84:0/2235521258 shutdown_connections 2024-09-21T03:53:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.667+0000 7fd232480740 1 --2- 172.21.15.84:0/2235521258 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d4f070 0x564ed510e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.667+0000 7fd232480740 1 --2- 172.21.15.84:0/2235521258 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed4d2e390 0x564ed50f7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.667+0000 7fd232480740 1 --2- 172.21.15.84:0/2235521258 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d261b0 0x564ed5103bf0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.667+0000 7fd232480740 1 -- 172.21.15.84:0/2235521258 >> 172.21.15.84:0/2235521258 conn(0x564ed4d43460 msgr2=0x564ed50f7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.667+0000 7fd232480740 1 -- 172.21.15.84:0/2235521258 shutdown_connections 2024-09-21T03:53:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.667+0000 7fd232480740 1 -- 172.21.15.84:0/2235521258 wait complete. 2024-09-21T03:53:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.667+0000 7fd232480740 1 -- start start 2024-09-21T03:53:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.667+0000 7fd232480740 1 Processor -- start 2024-09-21T03:53:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd232480740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed4d261b0 0x564ed5115000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.729 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd232480740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d2e390 0x564ed5115540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd232480740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d4f070 0x564ed5115a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd232480740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241afeb0 con 0x564ed4d2e390 2024-09-21T03:53:58.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd232480740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241b1320 con 0x564ed4d4f070 2024-09-21T03:53:58.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd232480740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241b0580 con 0x564ed4d261b0 2024-09-21T03:53:58.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd232480740 10 client.0 _ll_register_callbacks cb 0x7fd21c014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:53:58.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd2294a7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d2e390 0x564ed5115540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd2294a7640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d2e390 0x564ed5115540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46240/0 (socket says 172.21.15.84:46240) 2024-09-21T03:53:58.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd2294a7640 1 -- 172.21.15.84:0/2882128951 learned_addr learned my addr 172.21.15.84:0/2882128951 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:53:58.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd22a4a9640 1 --2- 172.21.15.84:0/2882128951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d4f070 0x564ed5115a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd229ca8640 1 --2- 172.21.15.84:0/2882128951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed4d261b0 0x564ed5115000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd2294a7640 1 -- 172.21.15.84:0/2882128951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed4d261b0 msgr2=0x564ed5115000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:58.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd2294a7640 1 --2- 172.21.15.84:0/2882128951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed4d261b0 0x564ed5115000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd2294a7640 1 -- 172.21.15.84:0/2882128951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d4f070 msgr2=0x564ed5115a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:53:58.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd2294a7640 1 --2- 172.21.15.84:0/2882128951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d4f070 0x564ed5115a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.730 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd2294a7640 1 -- 172.21.15.84:0/2882128951 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ed517d760 con 0x564ed4d2e390 2024-09-21T03:53:58.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd2294a7640 1 --2- 172.21.15.84:0/2882128951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d2e390 0x564ed5115540 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fd2200aa2a0 tx=0x7fd2200ac860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c623d61d9f2d7e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:58.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd20d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:53:58.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd20d7fa640 1 -- 172.21.15.84:0/2882128951 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd220020040 con 0x564ed4d2e390 2024-09-21T03:53:58.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd20d7fa640 1 -- 172.21.15.84:0/2882128951 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7fd2200a92a0 con 0x564ed4d2e390 2024-09-21T03:53:58.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.668+0000 7fd232480740 1 -- 172.21.15.84:0/2882128951 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd218005020 con 0x564ed4d2e390 2024-09-21T03:53:58.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.669+0000 7fd20d7fa640 1 -- 172.21.15.84:0/2882128951 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd2200b1b10 con 0x564ed4d2e390 2024-09-21T03:53:58.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.669+0000 7fd232480740 10 client.17649 fetch_fsmap learned FSMap version 25 2024-09-21T03:53:58.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.669+0000 7fd232480740 1 -- 172.21.15.84:0/2882128951 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564ed517ea40 con 0x564ed4d2e390 2024-09-21T03:53:58.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.669+0000 7fd20d7fa640 1 -- 172.21.15.84:0/2882128951 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd218005020 con 0x564ed4d2e390 2024-09-21T03:53:58.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.669+0000 7fd20d7fa640 1 -- 172.21.15.84:0/2882128951 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd2200a8aa0 con 0x564ed4d2e390 2024-09-21T03:53:58.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.669+0000 7fd232480740 10 client.17649 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:53:58.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.669+0000 7fd232480740 10 client.17649 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-21T03:53:58.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.669+0000 7fd232480740 20 client.17649 populate_metadata read hostname 'smithi084' 2024-09-21T03:53:58.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.669+0000 7fd232480740 1 --2- 172.21.15.84:0/2882128951 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x564ed4ce2da0 0x564ed5181250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:58.731 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.669+0000 7fd232480740 4 client.17649 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:53:58.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.669+0000 7fd232480740 1 -- 172.21.15.84:0/2882128951 --> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564ed506a8a0 con 0x564ed4ce2da0 2024-09-21T03:53:58.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.669+0000 7fd229ca8640 1 --2- 172.21.15.84:0/2882128951 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x564ed4ce2da0 0x564ed5181250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:58.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.670+0000 7fd229ca8640 1 --2- 172.21.15.84:0/2882128951 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x564ed4ce2da0 0x564ed5181250 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cf64489dc4293ce5 server_cookie=7596eaaab7b7174b in_seq=0 out_seq=0 2024-09-21T03:53:58.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.670+0000 7fd20d7fa640 10 client.17649 ms_handle_connect on v2:172.21.15.174:6838/386916231 2024-09-21T03:53:58.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.670+0000 7fd20d7fa640 1 -- 172.21.15.84:0/2882128951 <== mds.2 v2:172.21.15.174:6838/386916231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564ed506a8a0 con 0x564ed4ce2da0 2024-09-21T03:53:58.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.670+0000 7fd20d7fa640 10 client.17649 handle_command_reply: tid=0 2024-09-21T03:53:58.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.670+0000 7fd232480740 1 client.17649 shutdown 2024-09-21T03:53:58.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.670+0000 7fd232480740 1 -- 172.21.15.84:0/2882128951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d2e390 msgr2=0x564ed5115540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:58.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.670+0000 7fd232480740 1 --2- 172.21.15.84:0/2882128951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d2e390 0x564ed5115540 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fd2200aa2a0 tx=0x7fd2200ac860 comp rx=0 tx=0).stop 2024-09-21T03:53:58.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.670+0000 7fd232480740 1 -- 172.21.15.84:0/2882128951 shutdown_connections 2024-09-21T03:53:58.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.670+0000 7fd232480740 1 --2- 172.21.15.84:0/2882128951 >> [v2:172.21.15.174:6838/386916231,v1:172.21.15.174:6839/386916231] conn(0x564ed4ce2da0 0x564ed5181250 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.670+0000 7fd232480740 1 --2- 172.21.15.84:0/2882128951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ed4d4f070 0x564ed5115a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.670+0000 7fd232480740 1 --2- 172.21.15.84:0/2882128951 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x564ed4d2e390 0x564ed5115540 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.732 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.670+0000 7fd20d7fa640 0 client.17649 ms_handle_reset on v2:172.21.15.174:6838/386916231 2024-09-21T03:53:58.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.670+0000 7fd232480740 1 --2- 172.21.15.84:0/2882128951 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564ed4d261b0 0x564ed5115000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.670+0000 7fd232480740 1 -- 172.21.15.84:0/2882128951 >> 172.21.15.84:0/2882128951 conn(0x564ed4d43460 msgr2=0x564ed5103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:58.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.670+0000 7fd232480740 1 -- 172.21.15.84:0/2882128951 shutdown_connections 2024-09-21T03:53:58.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.670+0000 7fd232480740 1 -- 172.21.15.84:0/2882128951 wait complete. 2024-09-21T03:53:58.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.670+0000 7fd232480740 20 client.17649 trim_cache size 0 max 16384 2024-09-21T03:53:58.733 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:53:58.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.671+0000 7fd22bf0c640 1 -- 172.21.15.84:0/1232194946 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd2100b6680 msgr2=0x7fd2100b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:58.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.671+0000 7fd22bf0c640 1 --2- 172.21.15.84:0/1232194946 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd2100b6680 0x7fd2100b8b90 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd218031440 tx=0x7fd218005ee0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.733 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.671+0000 7fd22bf0c640 1 -- 172.21.15.84:0/1232194946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd224108460 msgr2=0x7fd2240ff430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:58.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.671+0000 7fd22bf0c640 1 --2- 172.21.15.84:0/1232194946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd224108460 0x7fd2240ff430 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fd22000d750 tx=0x7fd22000dc10 comp rx=0 tx=0).stop 2024-09-21T03:53:58.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.671+0000 7fd22bf0c640 1 -- 172.21.15.84:0/1232194946 shutdown_connections 2024-09-21T03:53:58.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.671+0000 7fd22bf0c640 1 --2- 172.21.15.84:0/1232194946 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fd2100b6680 0x7fd2100b8b90 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.671+0000 7fd22bf0c640 1 --2- 172.21.15.84:0/1232194946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd224108db0 0x7fd2240ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.671+0000 7fd22bf0c640 1 --2- 172.21.15.84:0/1232194946 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fd224108460 0x7fd2240ff430 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.671+0000 7fd22bf0c640 1 --2- 172.21.15.84:0/1232194946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd224103230 0x7fd2240feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:58.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.671+0000 7fd22bf0c640 1 -- 172.21.15.84:0/1232194946 >> 172.21.15.84:0/1232194946 conn(0x7fd224079ec0 msgr2=0x7fd2241011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:58.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.671+0000 7fd22bf0c640 1 -- 172.21.15.84:0/1232194946 shutdown_connections 2024-09-21T03:53:58.734 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:53:58.671+0000 7fd22bf0c640 1 -- 172.21.15.84:0/1232194946 wait complete. 2024-09-21T03:53:59.479 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:53:59.729 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:00.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.206+0000 7fb7cf316640 1 -- 172.21.15.84:0/2796643893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7c81094a0 msgr2=0x7fb7c81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:00.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.206+0000 7fb7cf316640 1 --2- 172.21.15.84:0/2796643893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7c81094a0 0x7fb7c81098b0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc009900 tx=0x7fb7bc02a410 comp rx=0 tx=0).stop 2024-09-21T03:54:00.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.206+0000 7fb7cf316640 1 -- 172.21.15.84:0/2796643893 shutdown_connections 2024-09-21T03:54:00.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.206+0000 7fb7cf316640 1 --2- 172.21.15.84:0/2796643893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7c8109df0 0x7fb7c8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.206+0000 7fb7cf316640 1 --2- 172.21.15.84:0/2796643893 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7c81094a0 0x7fb7c81098b0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.206+0000 7fb7cf316640 1 --2- 172.21.15.84:0/2796643893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7c8103b60 0x7fb7c8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.206+0000 7fb7cf316640 1 -- 172.21.15.84:0/2796643893 >> 172.21.15.84:0/2796643893 conn(0x7fb7c807b850 msgr2=0x7fb7c807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:00.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.206+0000 7fb7cf316640 1 -- 172.21.15.84:0/2796643893 shutdown_connections 2024-09-21T03:54:00.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.206+0000 7fb7cf316640 1 -- 172.21.15.84:0/2796643893 wait complete. 2024-09-21T03:54:00.218 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.207+0000 7fb7cf316640 1 Processor -- start 2024-09-21T03:54:00.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.207+0000 7fb7cf316640 1 -- start start 2024-09-21T03:54:00.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.207+0000 7fb7cf316640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7c8103b60 0x7fb7c8077120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:00.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.207+0000 7fb7cf316640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7c81094a0 0x7fb7c8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:00.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.207+0000 7fb7cf316640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7c8109df0 0x7fb7c8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:00.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.207+0000 7fb7cf316640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c8113ab0 con 0x7fb7c8103b60 2024-09-21T03:54:00.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.207+0000 7fb7cf316640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c8113930 con 0x7fb7c8109df0 2024-09-21T03:54:00.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.207+0000 7fb7cf316640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c8113c30 con 0x7fb7c81094a0 2024-09-21T03:54:00.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.208+0000 7fb7cd8b3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7c8109df0 0x7fb7c8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:00.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.208+0000 7fb7cd8b3640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7c8109df0 0x7fb7c8075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.84:57220/0 (socket says 172.21.15.84:57220) 2024-09-21T03:54:00.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.208+0000 7fb7cd8b3640 1 -- 172.21.15.84:0/3844413313 learned_addr learned my addr 172.21.15.84:0/3844413313 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:00.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.208+0000 7fb7cd0b2640 1 --2- 172.21.15.84:0/3844413313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7c8103b60 0x7fb7c8077120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:00.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.208+0000 7fb7cc8b1640 1 --2- 172.21.15.84:0/3844413313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7c81094a0 0x7fb7c8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:00.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.208+0000 7fb7cd8b3640 1 -- 172.21.15.84:0/3844413313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7c81094a0 msgr2=0x7fb7c8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:00.219 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.208+0000 7fb7cd8b3640 1 --2- 172.21.15.84:0/3844413313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7c81094a0 0x7fb7c8075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.208+0000 7fb7cd8b3640 1 -- 172.21.15.84:0/3844413313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7c8103b60 msgr2=0x7fb7c8077120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:00.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.208+0000 7fb7cd8b3640 1 --2- 172.21.15.84:0/3844413313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7c8103b60 0x7fb7c8077120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.208+0000 7fb7cd8b3640 1 -- 172.21.15.84:0/3844413313 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c8076470 con 0x7fb7c8109df0 2024-09-21T03:54:00.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.208+0000 7fb7cd8b3640 1 --2- 172.21.15.84:0/3844413313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7c8109df0 0x7fb7c8075c50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000d750 tx=0x7fb7c000dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:00.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.209+0000 7fb7c67fc640 1 -- 172.21.15.84:0/3844413313 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0017070 con 0x7fb7c8109df0 2024-09-21T03:54:00.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.209+0000 7fb7cf316640 1 -- 172.21.15.84:0/3844413313 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7c819e700 con 0x7fb7c8109df0 2024-09-21T03:54:00.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.209+0000 7fb7c67fc640 1 -- 172.21.15.84:0/3844413313 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7c00054d0 con 0x7fb7c8109df0 2024-09-21T03:54:00.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.209+0000 7fb7c67fc640 1 -- 172.21.15.84:0/3844413313 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0004c60 con 0x7fb7c8109df0 2024-09-21T03:54:00.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.209+0000 7fb7cf316640 1 -- 172.21.15.84:0/3844413313 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7c819ec40 con 0x7fb7c8109df0 2024-09-21T03:54:00.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.211+0000 7fb7d588a740 1 Processor -- start 2024-09-21T03:54:00.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.212+0000 7fb7c67fc640 1 -- 172.21.15.84:0/3844413313 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fb7c0009bd0 con 0x7fb7c8109df0 2024-09-21T03:54:00.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.212+0000 7fb7d588a740 1 -- start start 2024-09-21T03:54:00.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.212+0000 7fb7d588a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d48a5070 0x55c2d4c4c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:00.220 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.212+0000 7fb7d588a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d487c1b0 0x55c2d4c4cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:00.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.212+0000 7fb7d588a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d4884390 0x55c2d4c4d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:00.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.212+0000 7fb7d588a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c2d4bc2ea0 con 0x55c2d487c1b0 2024-09-21T03:54:00.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.212+0000 7fb7d588a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c2d4bb22d0 con 0x55c2d48a5070 2024-09-21T03:54:00.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.212+0000 7fb7d588a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c2d4bb60e0 con 0x55c2d4884390 2024-09-21T03:54:00.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.212+0000 7fb7cd0b2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d487c1b0 0x55c2d4c4cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:00.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.213+0000 7fb7cd0b2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d487c1b0 0x55c2d4c4cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46268/0 (socket says 172.21.15.84:46268) 2024-09-21T03:54:00.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.213+0000 7fb7cd0b2640 1 -- 172.21.15.84:0/3036633651 learned_addr learned my addr 172.21.15.84:0/3036633651 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:00.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.213+0000 7fb7cc8b1640 1 --2- 172.21.15.84:0/3036633651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d48a5070 0x55c2d4c4c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:00.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.213+0000 7fb7cc8b1640 1 --2- 172.21.15.84:0/3036633651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d4884390 0x55c2d4c4d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:00.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.213+0000 7fb7cd0b2640 1 -- 172.21.15.84:0/3036633651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d4884390 msgr2=0x55c2d4c4d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:00.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.213+0000 7fb7cd0b2640 1 --2- 172.21.15.84:0/3036633651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d4884390 0x55c2d4c4d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.213+0000 7fb7cd0b2640 1 -- 172.21.15.84:0/3036633651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d48a5070 msgr2=0x55c2d4c4c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:00.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.213+0000 7fb7cd0b2640 1 --2- 172.21.15.84:0/3036633651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d48a5070 0x55c2d4c4c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.221 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.213+0000 7fb7cd0b2640 1 -- 172.21.15.84:0/3036633651 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2d4910650 con 0x55c2d487c1b0 2024-09-21T03:54:00.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.213+0000 7fb7cc8b1640 1 --2- 172.21.15.84:0/3036633651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d4884390 0x55c2d4c4d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:54:00.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.213+0000 7fb7c67fc640 1 --2- 172.21.15.84:0/3844413313 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb7b00b6680 0x7fb7b00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:00.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.213+0000 7fb7cd0b2640 1 --2- 172.21.15.84:0/3036633651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d487c1b0 0x55c2d4c4cbe0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009fd0 tx=0x7fb7b8003e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5633419ba564e877 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:00.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.213+0000 7fb7cc8b1640 1 --2- 172.21.15.84:0/3844413313 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb7b00b6680 0x7fb7b00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:00.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.213+0000 7fb7af7fe640 1 -- 172.21.15.84:0/3036633651 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8012450 con 0x55c2d487c1b0 2024-09-21T03:54:00.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.213+0000 7fb7af7fe640 1 -- 172.21.15.84:0/3036633651 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7b8012aa0 con 0x55c2d487c1b0 2024-09-21T03:54:00.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.213+0000 7fb7af7fe640 1 -- 172.21.15.84:0/3036633651 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b801aa90 con 0x55c2d487c1b0 2024-09-21T03:54:00.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.213+0000 7fb7c67fc640 1 -- 172.21.15.84:0/3844413313 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7fb7c00e70d0 con 0x7fb7c8109df0 2024-09-21T03:54:00.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.214+0000 7fb7d588a740 1 -- 172.21.15.84:0/3036633651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d487c1b0 msgr2=0x55c2d4c4cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:00.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.214+0000 7fb7cc8b1640 1 --2- 172.21.15.84:0/3844413313 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb7b00b6680 0x7fb7b00b8b90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc02a930 tx=0x7fb7bc031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:00.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.214+0000 7fb7d588a740 1 --2- 172.21.15.84:0/3036633651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d487c1b0 0x55c2d4c4cbe0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8009fd0 tx=0x7fb7b8003e80 comp rx=0 tx=0).stop 2024-09-21T03:54:00.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.214+0000 7fb7d588a740 1 -- 172.21.15.84:0/3036633651 shutdown_connections 2024-09-21T03:54:00.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.214+0000 7fb7d588a740 1 --2- 172.21.15.84:0/3036633651 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d4884390 0x55c2d4c4d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.214+0000 7fb7d588a740 1 --2- 172.21.15.84:0/3036633651 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d487c1b0 0x55c2d4c4cbe0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.222 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.214+0000 7fb7d588a740 1 --2- 172.21.15.84:0/3036633651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d48a5070 0x55c2d4c4c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.214+0000 7fb7d588a740 1 -- 172.21.15.84:0/3036633651 >> 172.21.15.84:0/3036633651 conn(0x55c2d4899460 msgr2=0x55c2d4c4a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:00.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.215+0000 7fb7d588a740 1 -- 172.21.15.84:0/3036633651 shutdown_connections 2024-09-21T03:54:00.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.215+0000 7fb7d588a740 1 -- 172.21.15.84:0/3036633651 wait complete. 2024-09-21T03:54:00.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.216+0000 7fb7d588a740 1 -- start start 2024-09-21T03:54:00.223 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.216+0000 7fb7d588a740 1 Processor -- start 2024-09-21T03:54:00.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.217+0000 7fb7d588a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d487c1b0 0x55c2d4c57dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:00.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.217+0000 7fb7d588a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d4884390 0x55c2d4c58300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:00.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.217+0000 7fb7d588a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d48a5070 0x55c2d4c64170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:00.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.217+0000 7fb7d588a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55c2d4a13700 con 0x55c2d48a5070 2024-09-21T03:54:00.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.217+0000 7fb7d588a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c2d4b4d160 con 0x55c2d4884390 2024-09-21T03:54:00.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.217+0000 7fb7d588a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55c2d4c5ae80 con 0x55c2d487c1b0 2024-09-21T03:54:00.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.217+0000 7fb7d588a740 10 client.0 _ll_register_callbacks cb 0x55c2d4b669e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:54:00.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.217+0000 7fb7cd0b2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d487c1b0 0x55c2d4c57dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:00.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.217+0000 7fb7cd0b2640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d487c1b0 0x55c2d4c57dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.84:43130/0 (socket says 172.21.15.84:43130) 2024-09-21T03:54:00.227 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.217+0000 7fb7cd0b2640 1 -- 172.21.15.84:0/4167141638 learned_addr learned my addr 172.21.15.84:0/4167141638 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:00.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.217+0000 7fb7cd8b3640 1 --2- 172.21.15.84:0/4167141638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d48a5070 0x55c2d4c64170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:00.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.217+0000 7fb7cc8b1640 1 --2- 172.21.15.84:0/4167141638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d4884390 0x55c2d4c58300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:00.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.217+0000 7fb7cc8b1640 1 -- 172.21.15.84:0/4167141638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d487c1b0 msgr2=0x55c2d4c57dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:00.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.217+0000 7fb7cc8b1640 1 --2- 172.21.15.84:0/4167141638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d487c1b0 0x55c2d4c57dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.217+0000 7fb7cc8b1640 1 -- 172.21.15.84:0/4167141638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d48a5070 msgr2=0x55c2d4c64170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:00.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.217+0000 7fb7cc8b1640 1 --2- 172.21.15.84:0/4167141638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d48a5070 0x55c2d4c64170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.217+0000 7fb7cc8b1640 1 -- 172.21.15.84:0/4167141638 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2d4b7ac90 con 0x55c2d4884390 2024-09-21T03:54:00.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.217+0000 7fb7cd8b3640 1 --2- 172.21.15.84:0/4167141638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d48a5070 0x55c2d4c64170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:54:00.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.217+0000 7fb7cd0b2640 1 --2- 172.21.15.84:0/4167141638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d487c1b0 0x55c2d4c57dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:54:00.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.218+0000 7fb7cc8b1640 1 --2- 172.21.15.84:0/4167141638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d4884390 0x55c2d4c58300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc009230 tx=0x7fb7bc02a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e8010b53993d108 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:00.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.218+0000 7fb7acff9640 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-09-21T03:54:00.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.218+0000 7fb7acff9640 1 -- 172.21.15.84:0/4167141638 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc043070 con 0x55c2d4884390 2024-09-21T03:54:00.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.218+0000 7fb7d588a740 1 -- 172.21.15.84:0/4167141638 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7b8012aa0 con 0x55c2d4884390 2024-09-21T03:54:00.228 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.218+0000 7fb7acff9640 1 -- 172.21.15.84:0/4167141638 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7fb7bc004240 con 0x55c2d4884390 2024-09-21T03:54:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.218+0000 7fb7acff9640 1 -- 172.21.15.84:0/4167141638 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb7bc058050 con 0x55c2d4884390 2024-09-21T03:54:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.218+0000 7fb7d588a740 10 client.26630 fetch_fsmap learned FSMap version 25 2024-09-21T03:54:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.218+0000 7fb7d588a740 1 -- 172.21.15.84:0/4167141638 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c2d4c66b50 con 0x55c2d4884390 2024-09-21T03:54:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.219+0000 7fb7acff9640 1 -- 172.21.15.84:0/4167141638 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7b8012aa0 con 0x55c2d4884390 2024-09-21T03:54:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.219+0000 7fb7acff9640 1 -- 172.21.15.84:0/4167141638 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb7bc03a040 con 0x55c2d4884390 2024-09-21T03:54:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.219+0000 7fb7d588a740 10 client.26630 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:54:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.219+0000 7fb7d588a740 10 client.26630 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:54:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.219+0000 7fb7d588a740 20 client.26630 populate_metadata read hostname 'smithi084' 2024-09-21T03:54:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.219+0000 7fb7d588a740 1 --2- 172.21.15.84:0/4167141638 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55c2d48639f0 0x55c2d4c6a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.219+0000 7fb7d588a740 4 client.26630 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:54:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.219+0000 7fb7d588a740 1 -- 172.21.15.84:0/4167141638 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2d4bc4df0 con 0x55c2d48639f0 2024-09-21T03:54:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.219+0000 7fb7cd0b2640 1 --2- 172.21.15.84:0/4167141638 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55c2d48639f0 0x55c2d4c6a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.220+0000 7fb7cd0b2640 1 --2- 172.21.15.84:0/4167141638 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55c2d48639f0 0x55c2d4c6a050 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e991d24222c24ecc server_cookie=ae5757f9174822f in_seq=0 out_seq=0 2024-09-21T03:54:00.229 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.220+0000 7fb7acff9640 10 client.26630 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:54:00.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.221+0000 7fb7acff9640 1 -- 172.21.15.84:0/4167141638 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c2d4bc4df0 con 0x55c2d48639f0 2024-09-21T03:54:00.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.221+0000 7fb7acff9640 10 client.26630 handle_command_reply: tid=0 2024-09-21T03:54:00.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.221+0000 7fb7d588a740 1 client.26630 shutdown 2024-09-21T03:54:00.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.221+0000 7fb7d588a740 1 -- 172.21.15.84:0/4167141638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d4884390 msgr2=0x55c2d4c58300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:00.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.221+0000 7fb7d588a740 1 --2- 172.21.15.84:0/4167141638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d4884390 0x55c2d4c58300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc009230 tx=0x7fb7bc02a410 comp rx=0 tx=0).stop 2024-09-21T03:54:00.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.221+0000 7fb7d588a740 1 -- 172.21.15.84:0/4167141638 shutdown_connections 2024-09-21T03:54:00.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.221+0000 7fb7d588a740 1 --2- 172.21.15.84:0/4167141638 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55c2d48639f0 0x55c2d4c6a050 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.221+0000 7fb7d588a740 1 --2- 172.21.15.84:0/4167141638 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d48a5070 0x55c2d4c64170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.221+0000 7fb7d588a740 1 --2- 172.21.15.84:0/4167141638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d4884390 0x55c2d4c58300 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.221+0000 7fb7acff9640 0 client.26630 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:54:00.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.221+0000 7fb7d588a740 1 --2- 172.21.15.84:0/4167141638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d487c1b0 0x55c2d4c57dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.221+0000 7fb7d588a740 1 -- 172.21.15.84:0/4167141638 >> 172.21.15.84:0/4167141638 conn(0x55c2d4899460 msgr2=0x55c2d4c4f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:00.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.221+0000 7fb7d588a740 1 -- 172.21.15.84:0/4167141638 shutdown_connections 2024-09-21T03:54:00.230 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.221+0000 7fb7d588a740 1 -- 172.21.15.84:0/4167141638 wait complete. 2024-09-21T03:54:00.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.221+0000 7fb7d588a740 20 client.26630 trim_cache size 0 max 16384 2024-09-21T03:54:00.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.244+0000 7fb7d588a740 1 Processor -- start 2024-09-21T03:54:00.246 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.244+0000 7fb7d588a740 1 -- start start 2024-09-21T03:54:00.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.245+0000 7fb7d588a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d487c1b0 0x55c2d4c599f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:00.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.245+0000 7fb7d588a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d4884390 0x55c2d4c54fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:00.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.245+0000 7fb7d588a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d48a5070 0x55c2d4c554f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:00.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.245+0000 7fb7d588a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c81c0dc0 con 0x55c2d4884390 2024-09-21T03:54:00.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.245+0000 7fb7d588a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c81be690 con 0x55c2d48a5070 2024-09-21T03:54:00.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.245+0000 7fb7d588a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c81a54b0 con 0x55c2d487c1b0 2024-09-21T03:54:00.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.245+0000 7fb7cc8b1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d4884390 0x55c2d4c54fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:00.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.245+0000 7fb7cc8b1640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d4884390 0x55c2d4c54fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46286/0 (socket says 172.21.15.84:46286) 2024-09-21T03:54:00.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.245+0000 7fb7cc8b1640 1 -- 172.21.15.84:0/539904837 learned_addr learned my addr 172.21.15.84:0/539904837 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:00.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.245+0000 7fb7cd0b2640 1 --2- 172.21.15.84:0/539904837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d487c1b0 0x55c2d4c599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:00.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.245+0000 7fb7cd8b3640 1 --2- 172.21.15.84:0/539904837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d48a5070 0x55c2d4c554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:00.248 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.245+0000 7fb7cc8b1640 1 -- 172.21.15.84:0/539904837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d487c1b0 msgr2=0x55c2d4c599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:00.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.245+0000 7fb7cc8b1640 1 --2- 172.21.15.84:0/539904837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d487c1b0 0x55c2d4c599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.245+0000 7fb7cc8b1640 1 -- 172.21.15.84:0/539904837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d48a5070 msgr2=0x55c2d4c554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:00.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.245+0000 7fb7cc8b1640 1 --2- 172.21.15.84:0/539904837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d48a5070 0x55c2d4c554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.245+0000 7fb7cc8b1640 1 -- 172.21.15.84:0/539904837 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2d4c5a990 con 0x55c2d4884390 2024-09-21T03:54:00.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.245+0000 7fb7cd8b3640 1 --2- 172.21.15.84:0/539904837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d48a5070 0x55c2d4c554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:00.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.245+0000 7fb7cc8b1640 1 --2- 172.21.15.84:0/539904837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d4884390 0x55c2d4c54fb0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0057c0 tx=0x7fb7bc03d610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46e9b01c14ea171 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:00.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.246+0000 7fb7aeffd640 1 -- 172.21.15.84:0/539904837 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc043070 con 0x55c2d4884390 2024-09-21T03:54:00.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.246+0000 7fb7aeffd640 1 -- 172.21.15.84:0/539904837 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7bc04f070 con 0x55c2d4884390 2024-09-21T03:54:00.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.246+0000 7fb7aeffd640 1 -- 172.21.15.84:0/539904837 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc035040 con 0x55c2d4884390 2024-09-21T03:54:00.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.246+0000 7fb7d588a740 1 -- 172.21.15.84:0/539904837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d4884390 msgr2=0x55c2d4c54fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:00.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.246+0000 7fb7d588a740 1 --2- 172.21.15.84:0/539904837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d4884390 0x55c2d4c54fb0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0057c0 tx=0x7fb7bc03d610 comp rx=0 tx=0).stop 2024-09-21T03:54:00.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.247+0000 7fb7d588a740 1 -- 172.21.15.84:0/539904837 shutdown_connections 2024-09-21T03:54:00.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.247+0000 7fb7d588a740 1 --2- 172.21.15.84:0/539904837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d48a5070 0x55c2d4c554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.247+0000 7fb7d588a740 1 --2- 172.21.15.84:0/539904837 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d4884390 0x55c2d4c54fb0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.247+0000 7fb7d588a740 1 --2- 172.21.15.84:0/539904837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d487c1b0 0x55c2d4c599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.247+0000 7fb7d588a740 1 -- 172.21.15.84:0/539904837 >> 172.21.15.84:0/539904837 conn(0x55c2d4899460 msgr2=0x55c2d4c592e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:00.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.247+0000 7fb7d588a740 1 -- 172.21.15.84:0/539904837 shutdown_connections 2024-09-21T03:54:00.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.247+0000 7fb7d588a740 1 -- 172.21.15.84:0/539904837 wait complete. 2024-09-21T03:54:00.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.247+0000 7fb7d588a740 1 -- start start 2024-09-21T03:54:00.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.247+0000 7fb7d588a740 1 Processor -- start 2024-09-21T03:54:00.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7d588a740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d487c1b0 0x55c2d4c5d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:00.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7d588a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d4884390 0x55c2d4c5df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:00.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7d588a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d48a5070 0x55c2d4cd2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:00.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7d588a740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c81a5b00 con 0x55c2d487c1b0 2024-09-21T03:54:00.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7d588a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c81bdfc0 con 0x55c2d48a5070 2024-09-21T03:54:00.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7d588a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c81a61d0 con 0x55c2d4884390 2024-09-21T03:54:00.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7d588a740 10 client.0 _ll_register_callbacks cb 0x7fb7bc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:54:00.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7cd0b2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d487c1b0 0x55c2d4c5d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:00.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7cd0b2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d487c1b0 0x55c2d4c5d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46290/0 (socket says 172.21.15.84:46290) 2024-09-21T03:54:00.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7cd0b2640 1 -- 172.21.15.84:0/1107229678 learned_addr learned my addr 172.21.15.84:0/1107229678 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:00.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7cc8b1640 1 --2- 172.21.15.84:0/1107229678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d4884390 0x55c2d4c5df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:00.253 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7cd8b3640 1 --2- 172.21.15.84:0/1107229678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d48a5070 0x55c2d4cd2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:00.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7cd0b2640 1 -- 172.21.15.84:0/1107229678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d4884390 msgr2=0x55c2d4c5df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:00.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7cd0b2640 1 --2- 172.21.15.84:0/1107229678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d4884390 0x55c2d4c5df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7cd0b2640 1 -- 172.21.15.84:0/1107229678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d48a5070 msgr2=0x55c2d4cd2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:00.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7cd0b2640 1 --2- 172.21.15.84:0/1107229678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d48a5070 0x55c2d4cd2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7cd0b2640 1 -- 172.21.15.84:0/1107229678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2d4cd3080 con 0x55c2d487c1b0 2024-09-21T03:54:00.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7cc8b1640 1 --2- 172.21.15.84:0/1107229678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d4884390 0x55c2d4c5df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:00.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7cd8b3640 1 --2- 172.21.15.84:0/1107229678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d48a5070 0x55c2d4cd2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:00.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7cd0b2640 1 --2- 172.21.15.84:0/1107229678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d487c1b0 0x55c2d4c5d940 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8005c10 tx=0x7fb7b8009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ce92e82ae4d36d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:00.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.248+0000 7fb7acff9640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:54:00.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.249+0000 7fb7acff9640 1 -- 172.21.15.84:0/1107229678 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8033060 con 0x55c2d487c1b0 2024-09-21T03:54:00.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.249+0000 7fb7acff9640 1 -- 172.21.15.84:0/1107229678 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7fb7b801a720 con 0x55c2d487c1b0 2024-09-21T03:54:00.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.249+0000 7fb7d588a740 1 -- 172.21.15.84:0/1107229678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7bc04f070 con 0x55c2d487c1b0 2024-09-21T03:54:00.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.249+0000 7fb7acff9640 1 -- 172.21.15.84:0/1107229678 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb7b801a920 con 0x55c2d487c1b0 2024-09-21T03:54:00.254 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.249+0000 7fb7d588a740 10 client.17667 fetch_fsmap learned FSMap version 25 2024-09-21T03:54:00.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.249+0000 7fb7d588a740 1 -- 172.21.15.84:0/1107229678 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c2d4cd4300 con 0x55c2d487c1b0 2024-09-21T03:54:00.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.249+0000 7fb7acff9640 1 -- 172.21.15.84:0/1107229678 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7b8038460 con 0x55c2d487c1b0 2024-09-21T03:54:00.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.249+0000 7fb7acff9640 1 -- 172.21.15.84:0/1107229678 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb7b800f040 con 0x55c2d487c1b0 2024-09-21T03:54:00.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.249+0000 7fb7d588a740 10 client.17667 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:54:00.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.249+0000 7fb7d588a740 10 client.17667 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-21T03:54:00.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.249+0000 7fb7d588a740 20 client.17667 populate_metadata read hostname 'smithi084' 2024-09-21T03:54:00.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.249+0000 7fb7d588a740 1 --2- 172.21.15.84:0/1107229678 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55c2d4838da0 0x55c2d4cd6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:00.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.249+0000 7fb7d588a740 4 client.17667 mds_command: new command op to 24638 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:54:00.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.249+0000 7fb7d588a740 1 -- 172.21.15.84:0/1107229678 --> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fb7bc04f070 con 0x55c2d4838da0 2024-09-21T03:54:00.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.250+0000 7fb7cc8b1640 1 --2- 172.21.15.84:0/1107229678 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55c2d4838da0 0x55c2d4cd6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:00.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.250+0000 7fb7acff9640 10 client.17667 ms_handle_connect on v2:172.21.15.172:6836/2515764700 2024-09-21T03:54:00.255 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.250+0000 7fb7cc8b1640 1 --2- 172.21.15.84:0/1107229678 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55c2d4838da0 0x55c2d4cd6960 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9cf8a7d21dc3a6e8 server_cookie=92d24cdd8e21f2ac in_seq=0 out_seq=0 2024-09-21T03:54:00.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.250+0000 7fb7acff9640 1 -- 172.21.15.84:0/1107229678 <== mds.1 v2:172.21.15.172:6836/2515764700 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fb7bc04f070 con 0x55c2d4838da0 2024-09-21T03:54:00.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.250+0000 7fb7acff9640 10 client.17667 handle_command_reply: tid=0 2024-09-21T03:54:00.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.250+0000 7fb7d588a740 1 client.17667 shutdown 2024-09-21T03:54:00.256 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.251+0000 7fb7d588a740 1 -- 172.21.15.84:0/1107229678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d487c1b0 msgr2=0x55c2d4c5d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:00.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.251+0000 7fb7d588a740 1 --2- 172.21.15.84:0/1107229678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d487c1b0 0x55c2d4c5d940 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8005c10 tx=0x7fb7b8009710 comp rx=0 tx=0).stop 2024-09-21T03:54:00.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.251+0000 7fb7d588a740 1 -- 172.21.15.84:0/1107229678 shutdown_connections 2024-09-21T03:54:00.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.251+0000 7fb7d588a740 1 --2- 172.21.15.84:0/1107229678 >> [v2:172.21.15.172:6836/2515764700,v1:172.21.15.172:6837/2515764700] conn(0x55c2d4838da0 0x55c2d4cd6960 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.251+0000 7fb7d588a740 1 --2- 172.21.15.84:0/1107229678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c2d48a5070 0x55c2d4cd2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.251+0000 7fb7d588a740 1 --2- 172.21.15.84:0/1107229678 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d4884390 0x55c2d4c5df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.251+0000 7fb7d588a740 1 --2- 172.21.15.84:0/1107229678 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55c2d487c1b0 0x55c2d4c5d940 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.251+0000 7fb7d588a740 1 -- 172.21.15.84:0/1107229678 >> 172.21.15.84:0/1107229678 conn(0x55c2d4899460 msgr2=0x55c2d4c59080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:00.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.251+0000 7fb7acff9640 0 client.17667 ms_handle_reset on v2:172.21.15.172:6836/2515764700 2024-09-21T03:54:00.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.251+0000 7fb7d588a740 1 -- 172.21.15.84:0/1107229678 shutdown_connections 2024-09-21T03:54:00.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.251+0000 7fb7d588a740 1 -- 172.21.15.84:0/1107229678 wait complete. 2024-09-21T03:54:00.257 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.251+0000 7fb7d588a740 20 client.17667 trim_cache size 0 max 16384 2024-09-21T03:54:00.257 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:54:00.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.251+0000 7fb7cf316640 1 -- 172.21.15.84:0/3844413313 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb7b00b6680 msgr2=0x7fb7b00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:00.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.251+0000 7fb7cf316640 1 --2- 172.21.15.84:0/3844413313 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb7b00b6680 0x7fb7b00b8b90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc02a930 tx=0x7fb7bc031400 comp rx=0 tx=0).stop 2024-09-21T03:54:00.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.251+0000 7fb7cf316640 1 -- 172.21.15.84:0/3844413313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7c8109df0 msgr2=0x7fb7c8075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:00.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.251+0000 7fb7cf316640 1 --2- 172.21.15.84:0/3844413313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7c8109df0 0x7fb7c8075c50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000d750 tx=0x7fb7c000dc10 comp rx=0 tx=0).stop 2024-09-21T03:54:00.258 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.252+0000 7fb7cf316640 1 -- 172.21.15.84:0/3844413313 shutdown_connections 2024-09-21T03:54:00.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.252+0000 7fb7cf316640 1 --2- 172.21.15.84:0/3844413313 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb7b00b6680 0x7fb7b00b8b90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.252+0000 7fb7cf316640 1 --2- 172.21.15.84:0/3844413313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7c8109df0 0x7fb7c8075c50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.252+0000 7fb7cf316640 1 --2- 172.21.15.84:0/3844413313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb7c81094a0 0x7fb7c8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.252+0000 7fb7cf316640 1 --2- 172.21.15.84:0/3844413313 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb7c8103b60 0x7fb7c8077120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:00.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.252+0000 7fb7cf316640 1 -- 172.21.15.84:0/3844413313 >> 172.21.15.84:0/3844413313 conn(0x7fb7c807b850 msgr2=0x7fb7c8107600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:00.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.252+0000 7fb7cf316640 1 -- 172.21.15.84:0/3844413313 shutdown_connections 2024-09-21T03:54:00.259 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:00.252+0000 7fb7cf316640 1 -- 172.21.15.84:0/3844413313 wait complete. 2024-09-21T03:54:00.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:00 smithi084 ceph-mon[30941]: pgmap v679: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.3 KiB/s wr, 8 op/s 2024-09-21T03:54:00.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:00 smithi174 ceph-mon[34403]: pgmap v679: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.3 KiB/s wr, 8 op/s 2024-09-21T03:54:00.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:00 smithi172 ceph-mon[34821]: pgmap v679: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.3 KiB/s wr, 8 op/s 2024-09-21T03:54:00.981 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:54:01.225 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:01.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.747+0000 7f2b8e74b640 1 -- 172.21.15.84:0/2567522595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b881083a0 msgr2=0x7f2b881087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.747+0000 7f2b8e74b640 1 --2- 172.21.15.84:0/2567522595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b881083a0 0x7f2b881087b0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009900 tx=0x7f2b7002a410 comp rx=0 tx=0).stop 2024-09-21T03:54:01.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.747+0000 7f2b8e74b640 1 -- 172.21.15.84:0/2567522595 shutdown_connections 2024-09-21T03:54:01.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.747+0000 7f2b8e74b640 1 --2- 172.21.15.84:0/2567522595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b88108cf0 0x7f2b8810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.747+0000 7f2b8e74b640 1 --2- 172.21.15.84:0/2567522595 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b881083a0 0x7f2b881087b0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.759 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.747+0000 7f2b8e74b640 1 --2- 172.21.15.84:0/2567522595 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b88102a60 0x7f2b88102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.747+0000 7f2b8e74b640 1 -- 172.21.15.84:0/2567522595 >> 172.21.15.84:0/2567522595 conn(0x7f2b88079730 msgr2=0x7f2b88079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:01.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.747+0000 7f2b8e74b640 1 -- 172.21.15.84:0/2567522595 shutdown_connections 2024-09-21T03:54:01.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.747+0000 7f2b8e74b640 1 -- 172.21.15.84:0/2567522595 wait complete. 2024-09-21T03:54:01.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.748+0000 7f2b8e74b640 1 Processor -- start 2024-09-21T03:54:01.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.748+0000 7f2b8e74b640 1 -- start start 2024-09-21T03:54:01.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.748+0000 7f2b8e74b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b88102a60 0x7f2b88199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.748+0000 7f2b8e74b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b881083a0 0x7f2b881998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.760 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.748+0000 7f2b8e74b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b88108cf0 0x7f2b8819eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.748+0000 7f2b8e74b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2b88112960 con 0x7f2b88108cf0 2024-09-21T03:54:01.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.748+0000 7f2b8e74b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2b881127e0 con 0x7f2b881083a0 2024-09-21T03:54:01.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.748+0000 7f2b8e74b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2b88112ae0 con 0x7f2b88102a60 2024-09-21T03:54:01.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.748+0000 7f2b8cce8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b88108cf0 0x7f2b8819eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.761 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.748+0000 7f2b8cce8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b88108cf0 0x7f2b8819eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46310/0 (socket says 172.21.15.84:46310) 2024-09-21T03:54:01.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.749+0000 7f2b8cce8640 1 -- 172.21.15.84:0/175985397 learned_addr learned my addr 172.21.15.84:0/175985397 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:01.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.749+0000 7f2b87fff640 1 --2- 172.21.15.84:0/175985397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b88102a60 0x7f2b88199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.749+0000 7f2b7ffff640 1 --2- 172.21.15.84:0/175985397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b881083a0 0x7f2b881998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.749+0000 7f2b8cce8640 1 -- 172.21.15.84:0/175985397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b88102a60 msgr2=0x7f2b88199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.749+0000 7f2b8cce8640 1 --2- 172.21.15.84:0/175985397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b88102a60 0x7f2b88199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.749+0000 7f2b8cce8640 1 -- 172.21.15.84:0/175985397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b881083a0 msgr2=0x7f2b881998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.749+0000 7f2b8cce8640 1 --2- 172.21.15.84:0/175985397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b881083a0 0x7f2b881998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.749+0000 7f2b8cce8640 1 -- 172.21.15.84:0/175985397 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8819f1e0 con 0x7f2b88108cf0 2024-09-21T03:54:01.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.749+0000 7f2b8cce8640 1 --2- 172.21.15.84:0/175985397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b88108cf0 0x7f2b8819eb70 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000cce0 tx=0x7f2b8000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:01.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.749+0000 7f2b85ffb640 1 -- 172.21.15.84:0/175985397 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8000f450 con 0x7f2b88108cf0 2024-09-21T03:54:01.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.749+0000 7f2b85ffb640 1 -- 172.21.15.84:0/175985397 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b8000faa0 con 0x7f2b88108cf0 2024-09-21T03:54:01.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.749+0000 7f2b85ffb640 1 -- 172.21.15.84:0/175985397 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80018b70 con 0x7f2b88108cf0 2024-09-21T03:54:01.762 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.749+0000 7f2b8e74b640 1 -- 172.21.15.84:0/175985397 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b8819f4d0 con 0x7f2b88108cf0 2024-09-21T03:54:01.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.749+0000 7f2b8e74b640 1 -- 172.21.15.84:0/175985397 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b8819f990 con 0x7f2b88108cf0 2024-09-21T03:54:01.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.752+0000 7f2b94cbf740 1 Processor -- start 2024-09-21T03:54:01.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.752+0000 7f2b85ffb640 1 -- 172.21.15.84:0/175985397 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f2b80018d10 con 0x7f2b88108cf0 2024-09-21T03:54:01.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.752+0000 7f2b94cbf740 1 -- start start 2024-09-21T03:54:01.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.752+0000 7f2b94cbf740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea26a070 0x55f4ea6112c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.752+0000 7f2b94cbf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea2411b0 0x55f4ea611800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.752+0000 7f2b94cbf740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4ea249390 0x55f4ea611d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.752+0000 7f2b94cbf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f4ea587ea0 con 0x55f4ea2411b0 2024-09-21T03:54:01.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.752+0000 7f2b94cbf740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f4ea5772d0 con 0x55f4ea26a070 2024-09-21T03:54:01.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.752+0000 7f2b94cbf740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f4ea57b0e0 con 0x55f4ea249390 2024-09-21T03:54:01.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.752+0000 7f2b87fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea2411b0 0x55f4ea611800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.752+0000 7f2b87fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea2411b0 0x55f4ea611800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46314/0 (socket says 172.21.15.84:46314) 2024-09-21T03:54:01.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.752+0000 7f2b87fff640 1 -- 172.21.15.84:0/77454376 learned_addr learned my addr 172.21.15.84:0/77454376 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:01.763 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.752+0000 7f2b7ffff640 1 --2- 172.21.15.84:0/77454376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea26a070 0x55f4ea6112c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.753+0000 7f2b87fff640 1 -- 172.21.15.84:0/77454376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4ea249390 msgr2=0x55f4ea611d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:01.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.753+0000 7f2b87fff640 1 --2- 172.21.15.84:0/77454376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4ea249390 0x55f4ea611d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.753+0000 7f2b87fff640 1 -- 172.21.15.84:0/77454376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea26a070 msgr2=0x55f4ea6112c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:01.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.753+0000 7f2b87fff640 1 --2- 172.21.15.84:0/77454376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea26a070 0x55f4ea6112c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.753+0000 7f2b87fff640 1 -- 172.21.15.84:0/77454376 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4ea2d5650 con 0x55f4ea2411b0 2024-09-21T03:54:01.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.753+0000 7f2b85ffb640 1 --2- 172.21.15.84:0/175985397 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2b740b66b0 0x7f2b740b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.753+0000 7f2b87fff640 1 --2- 172.21.15.84:0/77454376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea2411b0 0x55f4ea611800 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800cc60 tx=0x7f2b7800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17a4c8a6287c2c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:01.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.753+0000 7f2b7ffff640 1 --2- 172.21.15.84:0/175985397 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2b740b66b0 0x7f2b740b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.753+0000 7f2b85ffb640 1 -- 172.21.15.84:0/175985397 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f2b800e7bd0 con 0x7f2b88108cf0 2024-09-21T03:54:01.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.753+0000 7f2b7e7fc640 1 -- 172.21.15.84:0/77454376 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b78014070 con 0x55f4ea2411b0 2024-09-21T03:54:01.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.753+0000 7f2b7e7fc640 1 -- 172.21.15.84:0/77454376 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b780047a0 con 0x55f4ea2411b0 2024-09-21T03:54:01.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.753+0000 7f2b7e7fc640 1 -- 172.21.15.84:0/77454376 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b78010690 con 0x55f4ea2411b0 2024-09-21T03:54:01.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.754+0000 7f2b94cbf740 1 -- 172.21.15.84:0/77454376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea2411b0 msgr2=0x55f4ea611800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.764 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.754+0000 7f2b7ffff640 1 --2- 172.21.15.84:0/175985397 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2b740b66b0 0x7f2b740b8bc0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2b70000c00 tx=0x7f2b70009640 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:01.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.754+0000 7f2b94cbf740 1 --2- 172.21.15.84:0/77454376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea2411b0 0x55f4ea611800 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800cc60 tx=0x7f2b7800e720 comp rx=0 tx=0).stop 2024-09-21T03:54:01.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.754+0000 7f2b94cbf740 1 -- 172.21.15.84:0/77454376 shutdown_connections 2024-09-21T03:54:01.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.754+0000 7f2b94cbf740 1 --2- 172.21.15.84:0/77454376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4ea249390 0x55f4ea611d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.754+0000 7f2b94cbf740 1 --2- 172.21.15.84:0/77454376 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea2411b0 0x55f4ea611800 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.754+0000 7f2b94cbf740 1 --2- 172.21.15.84:0/77454376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea26a070 0x55f4ea6112c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.754+0000 7f2b94cbf740 1 -- 172.21.15.84:0/77454376 >> 172.21.15.84:0/77454376 conn(0x55f4ea25e460 msgr2=0x55f4ea60f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:01.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.754+0000 7f2b94cbf740 1 -- 172.21.15.84:0/77454376 shutdown_connections 2024-09-21T03:54:01.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.754+0000 7f2b94cbf740 1 -- 172.21.15.84:0/77454376 wait complete. 2024-09-21T03:54:01.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.754+0000 7f2b94cbf740 1 -- start start 2024-09-21T03:54:01.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.755+0000 7f2b94cbf740 1 Processor -- start 2024-09-21T03:54:01.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.755+0000 7f2b94cbf740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4ea2411b0 0x55f4ea61eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.755+0000 7f2b94cbf740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea249390 0x55f4ea61f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.755+0000 7f2b94cbf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea26a070 0x55f4ea61f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.765 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.755+0000 7f2b94cbf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x55f4ea3d8700 con 0x55f4ea26a070 2024-09-21T03:54:01.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.755+0000 7f2b94cbf740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f4ea512160 con 0x55f4ea249390 2024-09-21T03:54:01.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.755+0000 7f2b94cbf740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x55f4ea621c00 con 0x55f4ea2411b0 2024-09-21T03:54:01.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.755+0000 7f2b94cbf740 10 client.0 _ll_register_callbacks cb 0x55f4ea52b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:54:01.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.755+0000 7f2b8cce8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea26a070 0x55f4ea61f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.755+0000 7f2b8cce8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea26a070 0x55f4ea61f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46322/0 (socket says 172.21.15.84:46322) 2024-09-21T03:54:01.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.755+0000 7f2b8cce8640 1 -- 172.21.15.84:0/4149899084 learned_addr learned my addr 172.21.15.84:0/4149899084 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:01.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.755+0000 7f2b87fff640 1 --2- 172.21.15.84:0/4149899084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4ea2411b0 0x55f4ea61eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.755+0000 7f2b7ffff640 1 --2- 172.21.15.84:0/4149899084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea249390 0x55f4ea61f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.755+0000 7f2b8cce8640 1 -- 172.21.15.84:0/4149899084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4ea2411b0 msgr2=0x55f4ea61eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:01.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.755+0000 7f2b8cce8640 1 --2- 172.21.15.84:0/4149899084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4ea2411b0 0x55f4ea61eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.755+0000 7f2b8cce8640 1 -- 172.21.15.84:0/4149899084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea249390 msgr2=0x55f4ea61f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:01.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.755+0000 7f2b8cce8640 1 --2- 172.21.15.84:0/4149899084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea249390 0x55f4ea61f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.766 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.755+0000 7f2b8cce8640 1 -- 172.21.15.84:0/4149899084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4ea53fc90 con 0x55f4ea26a070 2024-09-21T03:54:01.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.755+0000 7f2b7ffff640 1 --2- 172.21.15.84:0/4149899084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea249390 0x55f4ea61f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:01.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.756+0000 7f2b8cce8640 1 --2- 172.21.15.84:0/4149899084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea26a070 0x55f4ea61f600 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f2b800ad770 tx=0x7f2b800ad480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81965db5679e00b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:01.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.756+0000 7f2b677fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:54:01.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.756+0000 7f2b677fe640 1 -- 172.21.15.84:0/4149899084 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b800a9070 con 0x55f4ea26a070 2024-09-21T03:54:01.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.756+0000 7f2b677fe640 1 -- 172.21.15.84:0/4149899084 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f2b800b2170 con 0x55f4ea26a070 2024-09-21T03:54:01.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.756+0000 7f2b94cbf740 1 -- 172.21.15.84:0/4149899084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b780047a0 con 0x55f4ea26a070 2024-09-21T03:54:01.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.756+0000 7f2b677fe640 1 -- 172.21.15.84:0/4149899084 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2b800b2550 con 0x55f4ea26a070 2024-09-21T03:54:01.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.756+0000 7f2b94cbf740 10 client.17679 fetch_fsmap learned FSMap version 25 2024-09-21T03:54:01.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.756+0000 7f2b94cbf740 1 -- 172.21.15.84:0/4149899084 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f4ea62d8e0 con 0x55f4ea26a070 2024-09-21T03:54:01.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.756+0000 7f2b677fe640 1 -- 172.21.15.84:0/4149899084 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b780047a0 con 0x55f4ea26a070 2024-09-21T03:54:01.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.756+0000 7f2b677fe640 1 -- 172.21.15.84:0/4149899084 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2b800a93c0 con 0x55f4ea26a070 2024-09-21T03:54:01.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.756+0000 7f2b94cbf740 10 client.17679 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:54:01.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.756+0000 7f2b94cbf740 10 client.17679 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:54:01.767 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.756+0000 7f2b94cbf740 20 client.17679 populate_metadata read hostname 'smithi084' 2024-09-21T03:54:01.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.757+0000 7f2b94cbf740 1 --2- 172.21.15.84:0/4149899084 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55f4ea2289f0 0x55f4ea630e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.757+0000 7f2b94cbf740 4 client.17679 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:54:01.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.757+0000 7f2b94cbf740 1 -- 172.21.15.84:0/4149899084 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4ea589df0 con 0x55f4ea2289f0 2024-09-21T03:54:01.768 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.757+0000 7f2b87fff640 1 --2- 172.21.15.84:0/4149899084 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55f4ea2289f0 0x55f4ea630e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.757+0000 7f2b677fe640 10 client.17679 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:54:01.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.757+0000 7f2b87fff640 1 --2- 172.21.15.84:0/4149899084 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55f4ea2289f0 0x55f4ea630e00 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4f06a2213d17ebd server_cookie=73957a7ae6e4175c in_seq=0 out_seq=0 2024-09-21T03:54:01.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.758+0000 7f2b677fe640 1 -- 172.21.15.84:0/4149899084 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f4ea589df0 con 0x55f4ea2289f0 2024-09-21T03:54:01.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.758+0000 7f2b677fe640 10 client.17679 handle_command_reply: tid=0 2024-09-21T03:54:01.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.758+0000 7f2b94cbf740 1 client.17679 shutdown 2024-09-21T03:54:01.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.758+0000 7f2b94cbf740 1 -- 172.21.15.84:0/4149899084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea26a070 msgr2=0x55f4ea61f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.758+0000 7f2b94cbf740 1 --2- 172.21.15.84:0/4149899084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea26a070 0x55f4ea61f600 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f2b800ad770 tx=0x7f2b800ad480 comp rx=0 tx=0).stop 2024-09-21T03:54:01.769 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.758+0000 7f2b94cbf740 1 -- 172.21.15.84:0/4149899084 shutdown_connections 2024-09-21T03:54:01.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.758+0000 7f2b94cbf740 1 --2- 172.21.15.84:0/4149899084 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55f4ea2289f0 0x55f4ea630e00 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.758+0000 7f2b677fe640 0 client.17679 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:54:01.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.758+0000 7f2b94cbf740 1 --2- 172.21.15.84:0/4149899084 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea26a070 0x55f4ea61f600 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.758+0000 7f2b94cbf740 1 --2- 172.21.15.84:0/4149899084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea249390 0x55f4ea61f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.758+0000 7f2b94cbf740 1 --2- 172.21.15.84:0/4149899084 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4ea2411b0 0x55f4ea61eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.758+0000 7f2b94cbf740 1 -- 172.21.15.84:0/4149899084 >> 172.21.15.84:0/4149899084 conn(0x55f4ea25e460 msgr2=0x55f4ea612cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:01.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.759+0000 7f2b94cbf740 1 -- 172.21.15.84:0/4149899084 shutdown_connections 2024-09-21T03:54:01.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.759+0000 7f2b94cbf740 1 -- 172.21.15.84:0/4149899084 wait complete. 2024-09-21T03:54:01.770 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.759+0000 7f2b94cbf740 20 client.17679 trim_cache size 0 max 16384 2024-09-21T03:54:01.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.771+0000 7f2b94cbf740 1 Processor -- start 2024-09-21T03:54:01.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.772+0000 7f2b94cbf740 1 -- start start 2024-09-21T03:54:01.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.772+0000 7f2b94cbf740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea2289f0 0x55f4ea620a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.772+0000 7f2b94cbf740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4ea2411b0 0x55f4ea612a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.772+0000 7f2b94cbf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea249390 0x55f4ea61bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.772+0000 7f2b94cbf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2b881afb80 con 0x55f4ea249390 2024-09-21T03:54:01.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.772+0000 7f2b94cbf740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2b881ad450 con 0x55f4ea2289f0 2024-09-21T03:54:01.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.772+0000 7f2b94cbf740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2b881ab2c0 con 0x55f4ea2411b0 2024-09-21T03:54:01.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.772+0000 7f2b8cce8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea249390 0x55f4ea61bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.772+0000 7f2b8cce8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea249390 0x55f4ea61bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46326/0 (socket says 172.21.15.84:46326) 2024-09-21T03:54:01.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.772+0000 7f2b8cce8640 1 -- 172.21.15.84:0/377693610 learned_addr learned my addr 172.21.15.84:0/377693610 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:01.775 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.772+0000 7f2b87fff640 1 --2- 172.21.15.84:0/377693610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea2289f0 0x55f4ea620a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.772+0000 7f2b7ffff640 1 --2- 172.21.15.84:0/377693610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4ea2411b0 0x55f4ea612a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.772+0000 7f2b8cce8640 1 -- 172.21.15.84:0/377693610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4ea2411b0 msgr2=0x55f4ea612a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:01.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.772+0000 7f2b8cce8640 1 --2- 172.21.15.84:0/377693610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4ea2411b0 0x55f4ea612a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.772+0000 7f2b8cce8640 1 -- 172.21.15.84:0/377693610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea2289f0 msgr2=0x55f4ea620a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:01.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.772+0000 7f2b8cce8640 1 --2- 172.21.15.84:0/377693610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea2289f0 0x55f4ea620a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.772+0000 7f2b8cce8640 1 -- 172.21.15.84:0/377693610 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4ea612100 con 0x55f4ea249390 2024-09-21T03:54:01.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.772+0000 7f2b87fff640 1 --2- 172.21.15.84:0/377693610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea2289f0 0x55f4ea620a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:01.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.772+0000 7f2b8cce8640 1 --2- 172.21.15.84:0/377693610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea249390 0x55f4ea61bd30 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000ccb0 tx=0x7f2b800d5170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a89c77d6d1ba3a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:01.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.773+0000 7f2b7dffb640 1 -- 172.21.15.84:0/377693610 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b800e5e60 con 0x55f4ea249390 2024-09-21T03:54:01.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.773+0000 7f2b7dffb640 1 -- 172.21.15.84:0/377693610 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b8000f800 con 0x55f4ea249390 2024-09-21T03:54:01.776 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.773+0000 7f2b7dffb640 1 -- 172.21.15.84:0/377693610 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b800a9040 con 0x55f4ea249390 2024-09-21T03:54:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.773+0000 7f2b94cbf740 1 -- 172.21.15.84:0/377693610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea249390 msgr2=0x55f4ea61bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.773+0000 7f2b94cbf740 1 --2- 172.21.15.84:0/377693610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea249390 0x55f4ea61bd30 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000ccb0 tx=0x7f2b800d5170 comp rx=0 tx=0).stop 2024-09-21T03:54:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.773+0000 7f2b94cbf740 1 -- 172.21.15.84:0/377693610 shutdown_connections 2024-09-21T03:54:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.773+0000 7f2b94cbf740 1 --2- 172.21.15.84:0/377693610 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea249390 0x55f4ea61bd30 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.773+0000 7f2b94cbf740 1 --2- 172.21.15.84:0/377693610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4ea2411b0 0x55f4ea612a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.773+0000 7f2b94cbf740 1 --2- 172.21.15.84:0/377693610 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea2289f0 0x55f4ea620a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.773+0000 7f2b94cbf740 1 -- 172.21.15.84:0/377693610 >> 172.21.15.84:0/377693610 conn(0x55f4ea25e460 msgr2=0x55f4ea6122f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.773+0000 7f2b94cbf740 1 -- 172.21.15.84:0/377693610 shutdown_connections 2024-09-21T03:54:01.780 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.774+0000 7f2b94cbf740 1 -- 172.21.15.84:0/377693610 wait complete. 2024-09-21T03:54:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.774+0000 7f2b94cbf740 1 -- start start 2024-09-21T03:54:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.774+0000 7f2b94cbf740 1 Processor -- start 2024-09-21T03:54:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.774+0000 7f2b94cbf740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4ea2289f0 0x55f4ea626ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b94cbf740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea2411b0 0x55f4ea6273e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b94cbf740 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea249390 0x55f4ea621e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b94cbf740 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f2b881ab910 con 0x55f4ea249390 2024-09-21T03:54:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b94cbf740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2b881acd80 con 0x55f4ea2411b0 2024-09-21T03:54:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b94cbf740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f2b881abfe0 con 0x55f4ea2289f0 2024-09-21T03:54:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b94cbf740 10 client.0 _ll_register_callbacks cb 0x7f2b80018400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:54:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b8cce8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea249390 0x55f4ea621e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b8cce8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea249390 0x55f4ea621e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46328/0 (socket says 172.21.15.84:46328) 2024-09-21T03:54:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b8cce8640 1 -- 172.21.15.84:0/256516715 learned_addr learned my addr 172.21.15.84:0/256516715 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b87fff640 1 --2- 172.21.15.84:0/256516715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4ea2289f0 0x55f4ea626ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.781 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b8cce8640 1 -- 172.21.15.84:0/256516715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4ea2289f0 msgr2=0x55f4ea626ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b8cce8640 1 --2- 172.21.15.84:0/256516715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4ea2289f0 0x55f4ea626ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b7ffff640 1 --2- 172.21.15.84:0/256516715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea2411b0 0x55f4ea6273e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b8cce8640 1 -- 172.21.15.84:0/256516715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea2411b0 msgr2=0x55f4ea6273e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:54:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b8cce8640 1 --2- 172.21.15.84:0/256516715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea2411b0 0x55f4ea6273e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b8cce8640 1 -- 172.21.15.84:0/256516715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4ea627a20 con 0x55f4ea249390 2024-09-21T03:54:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b7ffff640 1 --2- 172.21.15.84:0/256516715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea2411b0 0x55f4ea6273e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:54:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b8cce8640 1 --2- 172.21.15.84:0/256516715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea249390 0x55f4ea621e50 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f2b800e5970 tx=0x7f2b800a9310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64bea2d0ac6d715a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b677fe640 10 client.0 ms_handle_connect on v2:172.21.15.84:3300/0 2024-09-21T03:54:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b677fe640 1 -- 172.21.15.84:0/256516715 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b800e5e60 con 0x55f4ea249390 2024-09-21T03:54:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b677fe640 1 -- 172.21.15.84:0/256516715 <== mon.0 v2:172.21.15.84:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f2b800accd0 con 0x55f4ea249390 2024-09-21T03:54:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b94cbf740 1 -- 172.21.15.84:0/256516715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b8000f800 con 0x55f4ea249390 2024-09-21T03:54:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.775+0000 7f2b677fe640 1 -- 172.21.15.84:0/256516715 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2b8006f020 con 0x55f4ea249390 2024-09-21T03:54:01.782 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.776+0000 7f2b94cbf740 10 client.17685 fetch_fsmap learned FSMap version 25 2024-09-21T03:54:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.776+0000 7f2b94cbf740 1 -- 172.21.15.84:0/256516715 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f4ea69df20 con 0x55f4ea249390 2024-09-21T03:54:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.776+0000 7f2b677fe640 1 -- 172.21.15.84:0/256516715 <== mon.0 v2:172.21.15.84:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b8000f800 con 0x55f4ea249390 2024-09-21T03:54:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.776+0000 7f2b677fe640 1 -- 172.21.15.84:0/256516715 <== mon.0 v2:172.21.15.84:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2b800b36e0 con 0x55f4ea249390 2024-09-21T03:54:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.776+0000 7f2b94cbf740 10 client.17685 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:54:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.776+0000 7f2b94cbf740 10 client.17685 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T03:54:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.776+0000 7f2b94cbf740 20 client.17685 populate_metadata read hostname 'smithi084' 2024-09-21T03:54:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.776+0000 7f2b94cbf740 1 --2- 172.21.15.84:0/256516715 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55f4ea26a070 0x55f4ea6a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.776+0000 7f2b94cbf740 4 client.17685 mds_command: new command op to 24668 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:54:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.776+0000 7f2b94cbf740 1 -- 172.21.15.84:0/256516715 --> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f4ea5858a0 con 0x55f4ea26a070 2024-09-21T03:54:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.776+0000 7f2b87fff640 1 --2- 172.21.15.84:0/256516715 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55f4ea26a070 0x55f4ea6a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.777+0000 7f2b87fff640 1 --2- 172.21.15.84:0/256516715 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55f4ea26a070 0x55f4ea6a03b0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36fce79acf9fff82 server_cookie=af47d7546df6fb5 in_seq=0 out_seq=0 2024-09-21T03:54:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.777+0000 7f2b677fe640 10 client.17685 ms_handle_connect on v2:172.21.15.172:6838/3909390777 2024-09-21T03:54:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.777+0000 7f2b677fe640 1 -- 172.21.15.84:0/256516715 <== mds.0 v2:172.21.15.172:6838/3909390777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f4ea5858a0 con 0x55f4ea26a070 2024-09-21T03:54:01.783 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.777+0000 7f2b677fe640 10 client.17685 handle_command_reply: tid=0 2024-09-21T03:54:01.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.777+0000 7f2b94cbf740 1 client.17685 shutdown 2024-09-21T03:54:01.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.777+0000 7f2b94cbf740 1 -- 172.21.15.84:0/256516715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea249390 msgr2=0x55f4ea621e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.777+0000 7f2b94cbf740 1 --2- 172.21.15.84:0/256516715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea249390 0x55f4ea621e50 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f2b800e5970 tx=0x7f2b800a9310 comp rx=0 tx=0).stop 2024-09-21T03:54:01.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.777+0000 7f2b94cbf740 1 -- 172.21.15.84:0/256516715 shutdown_connections 2024-09-21T03:54:01.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.777+0000 7f2b94cbf740 1 --2- 172.21.15.84:0/256516715 >> [v2:172.21.15.172:6838/3909390777,v1:172.21.15.172:6839/3909390777] conn(0x55f4ea26a070 0x55f4ea6a03b0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.777+0000 7f2b94cbf740 1 --2- 172.21.15.84:0/256516715 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x55f4ea249390 0x55f4ea621e50 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.777+0000 7f2b94cbf740 1 --2- 172.21.15.84:0/256516715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f4ea2411b0 0x55f4ea6273e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.777+0000 7f2b94cbf740 1 --2- 172.21.15.84:0/256516715 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4ea2289f0 0x55f4ea626ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.777+0000 7f2b677fe640 0 client.17685 ms_handle_reset on v2:172.21.15.172:6838/3909390777 2024-09-21T03:54:01.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.777+0000 7f2b94cbf740 1 -- 172.21.15.84:0/256516715 >> 172.21.15.84:0/256516715 conn(0x55f4ea25e460 msgr2=0x55f4ea62a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:01.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.777+0000 7f2b94cbf740 1 -- 172.21.15.84:0/256516715 shutdown_connections 2024-09-21T03:54:01.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.777+0000 7f2b94cbf740 1 -- 172.21.15.84:0/256516715 wait complete. 2024-09-21T03:54:01.784 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.777+0000 7f2b94cbf740 20 client.17685 trim_cache size 0 max 16384 2024-09-21T03:54:01.785 INFO:teuthology.orchestra.run.smithi084.stdout:[] 2024-09-21T03:54:01.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.778+0000 7f2b8e74b640 1 -- 172.21.15.84:0/175985397 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2b740b66b0 msgr2=0x7f2b740b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.778+0000 7f2b8e74b640 1 --2- 172.21.15.84:0/175985397 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2b740b66b0 0x7f2b740b8bc0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2b70000c00 tx=0x7f2b70009640 comp rx=0 tx=0).stop 2024-09-21T03:54:01.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.778+0000 7f2b8e74b640 1 -- 172.21.15.84:0/175985397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b88108cf0 msgr2=0x7f2b8819eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:01.785 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.778+0000 7f2b8e74b640 1 --2- 172.21.15.84:0/175985397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b88108cf0 0x7f2b8819eb70 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000cce0 tx=0x7f2b8000a620 comp rx=0 tx=0).stop 2024-09-21T03:54:01.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.778+0000 7f2b8e74b640 1 -- 172.21.15.84:0/175985397 shutdown_connections 2024-09-21T03:54:01.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.778+0000 7f2b8e74b640 1 --2- 172.21.15.84:0/175985397 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f2b740b66b0 0x7f2b740b8bc0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.778+0000 7f2b8e74b640 1 --2- 172.21.15.84:0/175985397 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f2b88108cf0 0x7f2b8819eb70 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.778+0000 7f2b8e74b640 1 --2- 172.21.15.84:0/175985397 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2b881083a0 0x7f2b881998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.778+0000 7f2b8e74b640 1 --2- 172.21.15.84:0/175985397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2b88102a60 0x7f2b88199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:01.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.778+0000 7f2b8e74b640 1 -- 172.21.15.84:0/175985397 >> 172.21.15.84:0/175985397 conn(0x7f2b88079730 msgr2=0x7f2b88104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:01.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.778+0000 7f2b8e74b640 1 -- 172.21.15.84:0/175985397 shutdown_connections 2024-09-21T03:54:01.786 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:01.778+0000 7f2b8e74b640 1 -- 172.21.15.84:0/175985397 wait complete. 2024-09-21T03:54:02.513 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:02 smithi084 ceph-mon[30941]: pgmap v680: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 7 op/s 2024-09-21T03:54:02.542 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-21T03:54:02.542 INFO:tasks.fwd_scrub:done joining 2024-09-21T03:54:02.542 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T03:54:02.552 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:54:02.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:02 smithi174 ceph-mon[34403]: pgmap v680: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 7 op/s 2024-09-21T03:54:02.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:02 smithi172 ceph-mon[34821]: pgmap v680: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 7 op/s 2024-09-21T03:54:02.665 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.662+0000 7f898c39b640 1 -- 172.21.15.84:0/3971521154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f898410dd40 msgr2=0x7f8984110230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:02.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.662+0000 7f898c39b640 1 --2- 172.21.15.84:0/3971521154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f898410dd40 0x7f8984110230 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f897c009ca0 tx=0x7f897c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:54:02.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.662+0000 7f898c39b640 1 -- 172.21.15.84:0/3971521154 shutdown_connections 2024-09-21T03:54:02.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.662+0000 7f898c39b640 1 --2- 172.21.15.84:0/3971521154 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f898410dd40 0x7f8984110230 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:02.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.662+0000 7f898c39b640 1 --2- 172.21.15.84:0/3971521154 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8984105230 0x7f898410d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:02.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.662+0000 7f898c39b640 1 --2- 172.21.15.84:0/3971521154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89841048e0 0x7f8984104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:02.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.662+0000 7f898c39b640 1 -- 172.21.15.84:0/3971521154 >> 172.21.15.84:0/3971521154 conn(0x7f89840fe350 msgr2=0x7f89841007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:02.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.662+0000 7f898c39b640 1 -- 172.21.15.84:0/3971521154 shutdown_connections 2024-09-21T03:54:02.666 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.662+0000 7f898c39b640 1 -- 172.21.15.84:0/3971521154 wait complete. 2024-09-21T03:54:02.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.663+0000 7f898c39b640 1 Processor -- start 2024-09-21T03:54:02.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.663+0000 7f898c39b640 1 -- start start 2024-09-21T03:54:02.668 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.663+0000 7f898c39b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89841048e0 0x7f898419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:02.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.663+0000 7f898c39b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8984105230 0x7f898419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:02.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.663+0000 7f898c39b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f898410dd40 0x7f898419fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:02.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.663+0000 7f898c39b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f89841139a0 con 0x7f89841048e0 2024-09-21T03:54:02.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.663+0000 7f898c39b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8984113820 con 0x7f898410dd40 2024-09-21T03:54:02.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.663+0000 7f898c39b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f8984113b20 con 0x7f8984105230 2024-09-21T03:54:02.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.663+0000 7f898a137640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89841048e0 0x7f898419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:02.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.663+0000 7f898a137640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89841048e0 0x7f898419a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46350/0 (socket says 172.21.15.84:46350) 2024-09-21T03:54:02.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.663+0000 7f898a137640 1 -- 172.21.15.84:0/2325456400 learned_addr learned my addr 172.21.15.84:0/2325456400 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:02.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.664+0000 7f898a137640 1 -- 172.21.15.84:0/2325456400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8984105230 msgr2=0x7f898419a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:02.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.664+0000 7f8989936640 1 --2- 172.21.15.84:0/2325456400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8984105230 0x7f898419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:02.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.664+0000 7f898a938640 1 --2- 172.21.15.84:0/2325456400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f898410dd40 0x7f898419fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:02.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.664+0000 7f898a137640 1 --2- 172.21.15.84:0/2325456400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8984105230 0x7f898419a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:02.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.664+0000 7f898a137640 1 -- 172.21.15.84:0/2325456400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f898410dd40 msgr2=0x7f898419fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:02.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.664+0000 7f898a137640 1 --2- 172.21.15.84:0/2325456400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f898410dd40 0x7f898419fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:02.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.664+0000 7f898a137640 1 -- 172.21.15.84:0/2325456400 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89841a0240 con 0x7f89841048e0 2024-09-21T03:54:02.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.664+0000 7f898a938640 1 --2- 172.21.15.84:0/2325456400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f898410dd40 0x7f898419fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:54:02.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.664+0000 7f898a137640 1 --2- 172.21.15.84:0/2325456400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89841048e0 0x7f898419a3a0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f897400e9f0 tx=0x7f897400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:02.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.664+0000 7f897b7fe640 1 -- 172.21.15.84:0/2325456400 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897400cd80 con 0x7f89841048e0 2024-09-21T03:54:02.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.664+0000 7f897b7fe640 1 -- 172.21.15.84:0/2325456400 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89740108e0 con 0x7f89841048e0 2024-09-21T03:54:02.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.664+0000 7f898c39b640 1 -- 172.21.15.84:0/2325456400 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89841a0530 con 0x7f89841048e0 2024-09-21T03:54:02.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.664+0000 7f897b7fe640 1 -- 172.21.15.84:0/2325456400 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8974018980 con 0x7f89841048e0 2024-09-21T03:54:02.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.664+0000 7f898c39b640 1 -- 172.21.15.84:0/2325456400 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89841a6d50 con 0x7f89841048e0 2024-09-21T03:54:02.670 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.665+0000 7f898c39b640 1 -- 172.21.15.84:0/2325456400 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8984104cf0 con 0x7f89841048e0 2024-09-21T03:54:02.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.667+0000 7f897b7fe640 1 -- 172.21.15.84:0/2325456400 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f8974010430 con 0x7f89841048e0 2024-09-21T03:54:02.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.668+0000 7f897b7fe640 1 --2- 172.21.15.84:0/2325456400 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f89700b6680 0x7f89700b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:02.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.668+0000 7f8989936640 1 --2- 172.21.15.84:0/2325456400 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f89700b6680 0x7f89700b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:02.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.668+0000 7f897b7fe640 1 -- 172.21.15.84:0/2325456400 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f89740e8040 con 0x7f89841048e0 2024-09-21T03:54:02.671 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.668+0000 7f8989936640 1 --2- 172.21.15.84:0/2325456400 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f89700b6680 0x7f89700b8b90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f898410ef70 tx=0x7f8980005cc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:02.673 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.671+0000 7f897b7fe640 1 -- 172.21.15.84:0/2325456400 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f89740ae5e0 con 0x7f89841048e0 2024-09-21T03:54:02.854 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.851+0000 7f898c39b640 1 -- 172.21.15.84:0/2325456400 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89841a7030 con 0x7f89841048e0 2024-09-21T03:54:02.855 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.852+0000 7f897b7fe640 1 -- 172.21.15.84:0/2325456400 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+23109 (secure 0 0 0) 0x7f89740b29c0 con 0x7f89841048e0 2024-09-21T03:54:02.856 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:54:02.856 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":87,"fsid":"e3f8c18e-77c9-11ef-baf5-efdc52797490","created":"2024-09-21T03:31:55.307035+0000","modified":"2024-09-21T03:53:15.330643+0000","last_up_change":"2024-09-21T03:39:38.786385+0000","last_in_change":"2024-09-21T03:39:15.267368+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:35:50.488653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:40:25.934375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:40:27.981681+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":86,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d283ba0-18f3-4668-90c4-884e9e957a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6803","nonce":508132562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6805","nonce":508132562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6809","nonce":508132562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6807","nonce":508132562}]},"public_addr":"172.21.15.84:6803/508132562","cluster_addr":"172.21.15.84:6805/508132562","heartbeat_back_addr":"172.21.15.84:6809/508132562","heartbeat_front_addr":"172.21.15.84:6807/508132562","state":["exists","up"]},{"osd":1,"uuid":"f115c5b6-812d-430f-9f0e-cb5311b7581e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6801","nonce":2931872350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6803","nonce":2931872350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6807","nonce":2931872350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6805","nonce":2931872350}]},"public_addr":"172.21.15.172:6801/2931872350","cluster_addr":"172.21.15.172:6803/2931872350","heartbeat_back_addr":"172.21.15.172:6807/2931872350","heartbeat_front_addr":"172.21.15.172:6805/2931872350","state":["exists","up"]},{"osd":2,"uuid":"36489240-e233-4aa7-ae9c-089d76683172","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6801","nonce":1847612335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6803","nonce":1847612335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6807","nonce":1847612335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6805","nonce":1847612335}]},"public_addr":"172.21.15.174:6801/1847612335","cluster_addr":"172.21.15.174:6803/1847612335","heartbeat_back_addr":"172.21.15.174:6807/1847612335","heartbeat_front_addr":"172.21.15.174:6805/1847612335","state":["exists","up"]},{"osd":3,"uuid":"1f35b404-b658-4e94-a5f4-74a6431a6a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6811","nonce":2230529863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6813","nonce":2230529863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6817","nonce":2230529863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6815","nonce":2230529863}]},"public_addr":"172.21.15.84:6811/2230529863","cluster_addr":"172.21.15.84:6813/2230529863","heartbeat_back_addr":"172.21.15.84:6817/2230529863","heartbeat_front_addr":"172.21.15.84:6815/2230529863","state":["exists","up"]},{"osd":4,"uuid":"91a2f83b-4c7d-4661-86a1-63a09888939d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6809","nonce":3069862739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6811","nonce":3069862739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6815","nonce":3069862739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6813","nonce":3069862739}]},"public_addr":"172.21.15.172:6809/3069862739","cluster_addr":"172.21.15.172:6811/3069862739","heartbeat_back_addr":"172.21.15.172:6815/3069862739","heartbeat_front_addr":"172.21.15.172:6813/3069862739","state":["exists","up"]},{"osd":5,"uuid":"e8f06b34-3956-499f-8073-09011cf1ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6809","nonce":1987010600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6811","nonce":1987010600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6815","nonce":1987010600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6813","nonce":1987010600}]},"public_addr":"172.21.15.174:6809/1987010600","cluster_addr":"172.21.15.174:6811/1987010600","heartbeat_back_addr":"172.21.15.174:6815/1987010600","heartbeat_front_addr":"172.21.15.174:6813/1987010600","state":["exists","up"]},{"osd":6,"uuid":"23d55e96-4987-4cbe-8c6b-cece4de9269b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6819","nonce":3418459345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6821","nonce":3418459345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6825","nonce":3418459345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6823","nonce":3418459345}]},"public_addr":"172.21.15.84:6819/3418459345","cluster_addr":"172.21.15.84:6821/3418459345","heartbeat_back_addr":"172.21.15.84:6825/3418459345","heartbeat_front_addr":"172.21.15.84:6823/3418459345","state":["exists","up"]},{"osd":7,"uuid":"ca91a34c-d8b1-48b8-93f4-72a5c15939d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6817","nonce":4056019738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6819","nonce":4056019738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6823","nonce":4056019738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6821","nonce":4056019738}]},"public_addr":"172.21.15.172:6817/4056019738","cluster_addr":"172.21.15.172:6819/4056019738","heartbeat_back_addr":"172.21.15.172:6823/4056019738","heartbeat_front_addr":"172.21.15.172:6821/4056019738","state":["exists","up"]},{"osd":8,"uuid":"37da8c61-d72f-4b58-b10c-7c7539ecffd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6817","nonce":2162992546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6819","nonce":2162992546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6823","nonce":2162992546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6821","nonce":2162992546}]},"public_addr":"172.21.15.174:6817/2162992546","cluster_addr":"172.21.15.174:6819/2162992546","heartbeat_back_addr":"172.21.15.174:6823/2162992546","heartbeat_front_addr":"172.21.15.174:6821/2162992546","state":["exists","up"]},{"osd":9,"uuid":"c9179f33-622d-44bd-9d8a-c92951afb1e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6827","nonce":3230873673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6829","nonce":3230873673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6833","nonce":3230873673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6831","nonce":3230873673}]},"public_addr":"172.21.15.84:6827/3230873673","cluster_addr":"172.21.15.84:6829/3230873673","heartbeat_back_addr":"172.21.15.84:6833/3230873673","heartbeat_front_addr":"172.21.15.84:6831/3230873673","state":["exists","up"]},{"osd":10,"uuid":"9788fa2d-49fb-431b-a0e3-62d6e421e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6825","nonce":2667099391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6827","nonce":2667099391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6831","nonce":2667099391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6829","nonce":2667099391}]},"public_addr":"172.21.15.172:6825/2667099391","cluster_addr":"172.21.15.172:6827/2667099391","heartbeat_back_addr":"172.21.15.172:6831/2667099391","heartbeat_front_addr":"172.21.15.172:6829/2667099391","state":["exists","up"]},{"osd":11,"uuid":"a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6825","nonce":3452825924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6827","nonce":3452825924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6831","nonce":3452825924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6829","nonce":3452825924}]},"public_addr":"172.21.15.174:6825/3452825924","cluster_addr":"172.21.15.174:6827/3452825924","heartbeat_back_addr":"172.21.15.174:6831/3452825924","heartbeat_front_addr":"172.21.15.174:6829/3452825924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:34:57.413946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:22.813846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:47.074625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:12.871112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:38.705563+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:04.277966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:29.661290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:55.475432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:20.644247+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:46.151594+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:11.499623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:36.688459+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6800/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3308084314":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3663660709":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/1794153935":"2024-09-22T03:32:49.459372+0000","172.21.15.84:6800/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6800/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1874814897":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6801/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/390051797":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/2148206075":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1916019809":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6801/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3491731835":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3418048965":"2024-09-22T03:33:50.188998+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:54:02.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.855+0000 7f898c39b640 1 -- 172.21.15.84:0/2325456400 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f89700b6680 msgr2=0x7f89700b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:02.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.855+0000 7f898c39b640 1 --2- 172.21.15.84:0/2325456400 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f89700b6680 0x7f89700b8b90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f898410ef70 tx=0x7f8980005cc0 comp rx=0 tx=0).stop 2024-09-21T03:54:02.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.855+0000 7f898c39b640 1 -- 172.21.15.84:0/2325456400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89841048e0 msgr2=0x7f898419a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:02.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.855+0000 7f898c39b640 1 --2- 172.21.15.84:0/2325456400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89841048e0 0x7f898419a3a0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f897400e9f0 tx=0x7f897400eeb0 comp rx=0 tx=0).stop 2024-09-21T03:54:02.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.855+0000 7f898c39b640 1 -- 172.21.15.84:0/2325456400 shutdown_connections 2024-09-21T03:54:02.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.855+0000 7f898c39b640 1 --2- 172.21.15.84:0/2325456400 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f89700b6680 0x7f89700b8b90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:02.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.855+0000 7f898c39b640 1 --2- 172.21.15.84:0/2325456400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f898410dd40 0x7f898419fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:02.858 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.855+0000 7f898c39b640 1 --2- 172.21.15.84:0/2325456400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8984105230 0x7f898419a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:02.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.855+0000 7f898c39b640 1 --2- 172.21.15.84:0/2325456400 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f89841048e0 0x7f898419a3a0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:02.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.855+0000 7f898c39b640 1 -- 172.21.15.84:0/2325456400 >> 172.21.15.84:0/2325456400 conn(0x7f89840fe350 msgr2=0x7f89841077c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:02.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.855+0000 7f898c39b640 1 -- 172.21.15.84:0/2325456400 shutdown_connections 2024-09-21T03:54:02.859 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.855+0000 7f898c39b640 1 -- 172.21.15.84:0/2325456400 wait complete. 2024-09-21T03:54:02.870 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:35:50.488653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T03:40:25.934375+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T03:40:27.981681+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 86, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T03:54:02.870 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T03:54:02.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.980+0000 7fb24ed57640 1 -- 172.21.15.84:0/296831031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb248102a20 msgr2=0x7fb248102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:02.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.980+0000 7fb24ed57640 1 --2- 172.21.15.84:0/296831031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb248102a20 0x7fb248102e30 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009900 tx=0x7fb23c02a410 comp rx=0 tx=0).stop 2024-09-21T03:54:02.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.980+0000 7fb24ed57640 1 -- 172.21.15.84:0/296831031 shutdown_connections 2024-09-21T03:54:02.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.980+0000 7fb24ed57640 1 --2- 172.21.15.84:0/296831031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb248108c50 0x7fb24810f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:02.985 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.980+0000 7fb24ed57640 1 --2- 172.21.15.84:0/296831031 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb248108300 0x7fb248108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.980+0000 7fb24ed57640 1 --2- 172.21.15.84:0/296831031 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb248102a20 0x7fb248102e30 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.980+0000 7fb24ed57640 1 -- 172.21.15.84:0/296831031 >> 172.21.15.84:0/296831031 conn(0x7fb248079630 msgr2=0x7fb248079a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.980+0000 7fb24ed57640 1 -- 172.21.15.84:0/296831031 shutdown_connections 2024-09-21T03:54:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.980+0000 7fb24ed57640 1 -- 172.21.15.84:0/296831031 wait complete. 2024-09-21T03:54:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.981+0000 7fb24ed57640 1 Processor -- start 2024-09-21T03:54:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.981+0000 7fb24ed57640 1 -- start start 2024-09-21T03:54:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.981+0000 7fb24ed57640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb248102a20 0x7fb24819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.981+0000 7fb24ed57640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb248108300 0x7fb24819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.981+0000 7fb24ed57640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb248108c50 0x7fb24819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.981+0000 7fb24ed57640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fb248113a30 con 0x7fb248108300 2024-09-21T03:54:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.981+0000 7fb24ed57640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb2481138b0 con 0x7fb248108c50 2024-09-21T03:54:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.981+0000 7fb24ed57640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fb248113bb0 con 0x7fb248102a20 2024-09-21T03:54:02.986 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.981+0000 7fb247fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb248108300 0x7fb24819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:02.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.981+0000 7fb247fff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb248108300 0x7fb24819a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46356/0 (socket says 172.21.15.84:46356) 2024-09-21T03:54:02.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.981+0000 7fb247fff640 1 -- 172.21.15.84:0/2706228138 learned_addr learned my addr 172.21.15.84:0/2706228138 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:02.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.981+0000 7fb24caf3640 1 --2- 172.21.15.84:0/2706228138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb248102a20 0x7fb24819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:02.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.981+0000 7fb247fff640 1 -- 172.21.15.84:0/2706228138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb248102a20 msgr2=0x7fb24819a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:02.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.981+0000 7fb247fff640 1 --2- 172.21.15.84:0/2706228138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb248102a20 0x7fb24819a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:02.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.981+0000 7fb247fff640 1 -- 172.21.15.84:0/2706228138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb248108c50 msgr2=0x7fb24819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:02.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.981+0000 7fb24d2f4640 1 --2- 172.21.15.84:0/2706228138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb248108c50 0x7fb24819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:02.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.981+0000 7fb247fff640 1 --2- 172.21.15.84:0/2706228138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb248108c50 0x7fb24819fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:02.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.981+0000 7fb247fff640 1 -- 172.21.15.84:0/2706228138 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2481a0340 con 0x7fb248108300 2024-09-21T03:54:02.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.981+0000 7fb24caf3640 1 --2- 172.21.15.84:0/2706228138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb248102a20 0x7fb24819a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:54:02.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.982+0000 7fb247fff640 1 --2- 172.21.15.84:0/2706228138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb248108300 0x7fb24819a9b0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fb23400c970 tx=0x7fb23400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:02.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.982+0000 7fb245ffb640 1 -- 172.21.15.84:0/2706228138 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb234004220 con 0x7fb248108300 2024-09-21T03:54:02.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.982+0000 7fb245ffb640 1 -- 172.21.15.84:0/2706228138 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2340043c0 con 0x7fb248108300 2024-09-21T03:54:02.987 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.982+0000 7fb24ed57640 1 -- 172.21.15.84:0/2706228138 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2481a0630 con 0x7fb248108300 2024-09-21T03:54:02.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.982+0000 7fb245ffb640 1 -- 172.21.15.84:0/2706228138 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb234004a00 con 0x7fb248108300 2024-09-21T03:54:02.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.982+0000 7fb24ed57640 1 -- 172.21.15.84:0/2706228138 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2481a6dc0 con 0x7fb248108300 2024-09-21T03:54:02.988 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.983+0000 7fb24ed57640 1 -- 172.21.15.84:0/2706228138 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb248102e30 con 0x7fb248108300 2024-09-21T03:54:02.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.984+0000 7fb245ffb640 1 -- 172.21.15.84:0/2706228138 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fb2340079b0 con 0x7fb248108300 2024-09-21T03:54:02.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.985+0000 7fb245ffb640 1 --2- 172.21.15.84:0/2706228138 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2380b6680 0x7fb2380b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:02.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.986+0000 7fb24caf3640 1 --2- 172.21.15.84:0/2706228138 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2380b6680 0x7fb2380b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:02.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.986+0000 7fb245ffb640 1 -- 172.21.15.84:0/2706228138 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7fb2340e7530 con 0x7fb248108300 2024-09-21T03:54:02.989 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.986+0000 7fb24caf3640 1 --2- 172.21.15.84:0/2706228138 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2380b6680 0x7fb2380b8b90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0096c0 tx=0x7fb23c031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:02.993 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:02.990+0000 7fb245ffb640 1 -- 172.21.15.84:0/2706228138 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb234014030 con 0x7fb248108300 2024-09-21T03:54:03.169 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.166+0000 7fb24ed57640 1 -- 172.21.15.84:0/2706228138 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb24802e640 con 0x7fb248108300 2024-09-21T03:54:03.170 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.167+0000 7fb245ffb640 1 -- 172.21.15.84:0/2706228138 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7fb2340adad0 con 0x7fb248108300 2024-09-21T03:54:03.170 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 1 2024-09-21T03:54:03.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.169+0000 7fb24ed57640 1 -- 172.21.15.84:0/2706228138 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2380b6680 msgr2=0x7fb2380b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:03.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.169+0000 7fb24ed57640 1 --2- 172.21.15.84:0/2706228138 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2380b6680 0x7fb2380b8b90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0096c0 tx=0x7fb23c031400 comp rx=0 tx=0).stop 2024-09-21T03:54:03.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.169+0000 7fb24ed57640 1 -- 172.21.15.84:0/2706228138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb248108300 msgr2=0x7fb24819a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:03.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.169+0000 7fb24ed57640 1 --2- 172.21.15.84:0/2706228138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb248108300 0x7fb24819a9b0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fb23400c970 tx=0x7fb23400ce30 comp rx=0 tx=0).stop 2024-09-21T03:54:03.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.169+0000 7fb24ed57640 1 -- 172.21.15.84:0/2706228138 shutdown_connections 2024-09-21T03:54:03.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.169+0000 7fb24ed57640 1 --2- 172.21.15.84:0/2706228138 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fb2380b6680 0x7fb2380b8b90 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.169+0000 7fb24ed57640 1 --2- 172.21.15.84:0/2706228138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb248108c50 0x7fb24819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.169+0000 7fb24ed57640 1 --2- 172.21.15.84:0/2706228138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fb248108300 0x7fb24819a9b0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.169+0000 7fb24ed57640 1 --2- 172.21.15.84:0/2706228138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb248102a20 0x7fb24819a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.169+0000 7fb24ed57640 1 -- 172.21.15.84:0/2706228138 >> 172.21.15.84:0/2706228138 conn(0x7fb248079630 msgr2=0x7fb248106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:03.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.169+0000 7fb24ed57640 1 -- 172.21.15.84:0/2706228138 shutdown_connections 2024-09-21T03:54:03.173 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.169+0000 7fb24ed57640 1 -- 172.21.15.84:0/2706228138 wait complete. 2024-09-21T03:54:03.184 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T03:54:03.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.292+0000 7fc1bacbd640 1 -- 172.21.15.84:0/3301218198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1b4110080 msgr2=0x7fc1b41124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:03.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.292+0000 7fc1bacbd640 1 --2- 172.21.15.84:0/3301218198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1b4110080 0x7fc1b41124a0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac009ca0 tx=0x7fc1ac02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.293+0000 7fc1bacbd640 1 -- 172.21.15.84:0/3301218198 shutdown_connections 2024-09-21T03:54:03.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.293+0000 7fc1bacbd640 1 --2- 172.21.15.84:0/3301218198 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1b4110080 0x7fc1b41124a0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.293+0000 7fc1bacbd640 1 --2- 172.21.15.84:0/3301218198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1b4076080 0x7fc1b410fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.293+0000 7fc1bacbd640 1 --2- 172.21.15.84:0/3301218198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1b4075730 0x7fc1b4075b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.293+0000 7fc1bacbd640 1 -- 172.21.15.84:0/3301218198 >> 172.21.15.84:0/3301218198 conn(0x7fc1b40ff4d0 msgr2=0x7fc1b4101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:03.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.293+0000 7fc1bacbd640 1 -- 172.21.15.84:0/3301218198 shutdown_connections 2024-09-21T03:54:03.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.293+0000 7fc1bacbd640 1 -- 172.21.15.84:0/3301218198 wait complete. 2024-09-21T03:54:03.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.293+0000 7fc1bacbd640 1 Processor -- start 2024-09-21T03:54:03.297 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.293+0000 7fc1bacbd640 1 -- start start 2024-09-21T03:54:03.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.293+0000 7fc1bacbd640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1b4075730 0x7fc1b419c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:03.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.293+0000 7fc1bacbd640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1b4076080 0x7fc1b419cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:03.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.293+0000 7fc1bacbd640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1b4110080 0x7fc1b41a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:03.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.293+0000 7fc1bacbd640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b4115bc0 con 0x7fc1b4110080 2024-09-21T03:54:03.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.293+0000 7fc1bacbd640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b4115a40 con 0x7fc1b4076080 2024-09-21T03:54:03.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.293+0000 7fc1bacbd640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b4115d40 con 0x7fc1b4075730 2024-09-21T03:54:03.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.294+0000 7fc1b925a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1b4110080 0x7fc1b41a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:03.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.294+0000 7fc1b925a640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1b4110080 0x7fc1b41a1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46370/0 (socket says 172.21.15.84:46370) 2024-09-21T03:54:03.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.294+0000 7fc1b925a640 1 -- 172.21.15.84:0/2536396290 learned_addr learned my addr 172.21.15.84:0/2536396290 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:03.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.294+0000 7fc1b8a59640 1 --2- 172.21.15.84:0/2536396290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1b4075730 0x7fc1b419c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:03.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.294+0000 7fc1b3fff640 1 --2- 172.21.15.84:0/2536396290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1b4076080 0x7fc1b419cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:03.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.294+0000 7fc1b925a640 1 -- 172.21.15.84:0/2536396290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1b4075730 msgr2=0x7fc1b419c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:03.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.294+0000 7fc1b925a640 1 --2- 172.21.15.84:0/2536396290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1b4075730 0x7fc1b419c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.300 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.294+0000 7fc1b925a640 1 -- 172.21.15.84:0/2536396290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1b4076080 msgr2=0x7fc1b419cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:03.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.294+0000 7fc1b925a640 1 --2- 172.21.15.84:0/2536396290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1b4076080 0x7fc1b419cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.294+0000 7fc1b925a640 1 -- 172.21.15.84:0/2536396290 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b41a2530 con 0x7fc1b4110080 2024-09-21T03:54:03.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.294+0000 7fc1b8a59640 1 --2- 172.21.15.84:0/2536396290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1b4075730 0x7fc1b419c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:03.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.294+0000 7fc1b3fff640 1 --2- 172.21.15.84:0/2536396290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1b4076080 0x7fc1b419cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:54:03.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.294+0000 7fc1b925a640 1 --2- 172.21.15.84:0/2536396290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1b4110080 0x7fc1b41a1e30 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac005cc0 tx=0x7fc1ac02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:03.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.294+0000 7fc1b1ffb640 1 -- 172.21.15.84:0/2536396290 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac003bf0 con 0x7fc1b4110080 2024-09-21T03:54:03.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.294+0000 7fc1b1ffb640 1 -- 172.21.15.84:0/2536396290 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1ac003d90 con 0x7fc1b4110080 2024-09-21T03:54:03.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.294+0000 7fc1bacbd640 1 -- 172.21.15.84:0/2536396290 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b41a27c0 con 0x7fc1b4110080 2024-09-21T03:54:03.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.294+0000 7fc1b1ffb640 1 -- 172.21.15.84:0/2536396290 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac02fbc0 con 0x7fc1b4110080 2024-09-21T03:54:03.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.295+0000 7fc1bacbd640 1 -- 172.21.15.84:0/2536396290 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b41a8fb0 con 0x7fc1b4110080 2024-09-21T03:54:03.301 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.296+0000 7fc1bacbd640 1 -- 172.21.15.84:0/2536396290 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b4075b40 con 0x7fc1b4110080 2024-09-21T03:54:03.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.297+0000 7fc1b1ffb640 1 -- 172.21.15.84:0/2536396290 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7fc1ac02fd60 con 0x7fc1b4110080 2024-09-21T03:54:03.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.298+0000 7fc1b1ffb640 1 --2- 172.21.15.84:0/2536396290 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc1a40b6680 0x7fc1a40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:03.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.298+0000 7fc1b8a59640 1 --2- 172.21.15.84:0/2536396290 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc1a40b6680 0x7fc1a40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:03.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.299+0000 7fc1b1ffb640 1 -- 172.21.15.84:0/2536396290 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7fc1ac108e50 con 0x7fc1b4110080 2024-09-21T03:54:03.302 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.299+0000 7fc1b8a59640 1 --2- 172.21.15.84:0/2536396290 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc1a40b6680 0x7fc1a40b8b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc1a80058c0 tx=0x7fc1a8005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:03.304 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.302+0000 7fc1b1ffb640 1 -- 172.21.15.84:0/2536396290 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc1ac0cf3f0 con 0x7fc1b4110080 2024-09-21T03:54:03.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.481+0000 7fc1bacbd640 1 -- 172.21.15.84:0/2536396290 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc1b41a91e0 con 0x7fc1b4110080 2024-09-21T03:54:03.484 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.481+0000 7fc1b1ffb640 1 -- 172.21.15.84:0/2536396290 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) ==== 104+0+11 (secure 0 0 0) 0x7fc1ac0d37d0 con 0x7fc1b4110080 2024-09-21T03:54:03.484 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 32 2024-09-21T03:54:03.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.483+0000 7fc1bacbd640 1 -- 172.21.15.84:0/2536396290 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc1a40b6680 msgr2=0x7fc1a40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:03.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.483+0000 7fc1bacbd640 1 --2- 172.21.15.84:0/2536396290 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc1a40b6680 0x7fc1a40b8b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc1a80058c0 tx=0x7fc1a8005850 comp rx=0 tx=0).stop 2024-09-21T03:54:03.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.483+0000 7fc1bacbd640 1 -- 172.21.15.84:0/2536396290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1b4110080 msgr2=0x7fc1b41a1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:03.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.483+0000 7fc1bacbd640 1 --2- 172.21.15.84:0/2536396290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1b4110080 0x7fc1b41a1e30 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac005cc0 tx=0x7fc1ac02f380 comp rx=0 tx=0).stop 2024-09-21T03:54:03.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.483+0000 7fc1bacbd640 1 -- 172.21.15.84:0/2536396290 shutdown_connections 2024-09-21T03:54:03.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.483+0000 7fc1bacbd640 1 --2- 172.21.15.84:0/2536396290 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7fc1a40b6680 0x7fc1a40b8b90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.483+0000 7fc1bacbd640 1 --2- 172.21.15.84:0/2536396290 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7fc1b4110080 0x7fc1b41a1e30 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.483+0000 7fc1bacbd640 1 --2- 172.21.15.84:0/2536396290 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1b4076080 0x7fc1b419cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.483+0000 7fc1bacbd640 1 --2- 172.21.15.84:0/2536396290 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc1b4075730 0x7fc1b419c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.483+0000 7fc1bacbd640 1 -- 172.21.15.84:0/2536396290 >> 172.21.15.84:0/2536396290 conn(0x7fc1b40ff4d0 msgr2=0x7fc1b4109b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:03.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.484+0000 7fc1bacbd640 1 -- 172.21.15.84:0/2536396290 shutdown_connections 2024-09-21T03:54:03.487 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.484+0000 7fc1bacbd640 1 -- 172.21.15.84:0/2536396290 wait complete. 2024-09-21T03:54:03.497 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:03 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2325456400' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:54:03.497 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:03 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2706228138' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:54:03.498 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T03:54:03.613 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.608+0000 7f9f7af2b640 1 -- 172.21.15.84:0/1230245226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f741029c0 msgr2=0x7f9f74102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:03.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.608+0000 7f9f7af2b640 1 --2- 172.21.15.84:0/1230245226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f741029c0 0x7f9f74102dd0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f9f64009900 tx=0x7f9f6402a410 comp rx=0 tx=0).stop 2024-09-21T03:54:03.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.608+0000 7f9f7af2b640 1 -- 172.21.15.84:0/1230245226 shutdown_connections 2024-09-21T03:54:03.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.608+0000 7f9f7af2b640 1 --2- 172.21.15.84:0/1230245226 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f74108c40 0x7f9f7410f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.608+0000 7f9f7af2b640 1 --2- 172.21.15.84:0/1230245226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f741082f0 0x7f9f74108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.608+0000 7f9f7af2b640 1 --2- 172.21.15.84:0/1230245226 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f741029c0 0x7f9f74102dd0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.608+0000 7f9f7af2b640 1 -- 172.21.15.84:0/1230245226 >> 172.21.15.84:0/1230245226 conn(0x7f9f740fe400 msgr2=0x7f9f74100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:03.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.608+0000 7f9f7af2b640 1 -- 172.21.15.84:0/1230245226 shutdown_connections 2024-09-21T03:54:03.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.608+0000 7f9f7af2b640 1 -- 172.21.15.84:0/1230245226 wait complete. 2024-09-21T03:54:03.614 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.608+0000 7f9f7af2b640 1 Processor -- start 2024-09-21T03:54:03.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.609+0000 7f9f7af2b640 1 -- start start 2024-09-21T03:54:03.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.609+0000 7f9f7af2b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f741029c0 0x7f9f7419b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:03.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.609+0000 7f9f7af2b640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f741082f0 0x7f9f7419b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:03.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.609+0000 7f9f7af2b640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f74108c40 0x7f9f7419bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:03.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.609+0000 7f9f7af2b640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9f74112900 con 0x7f9f74108c40 2024-09-21T03:54:03.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.609+0000 7f9f7af2b640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9f74112780 con 0x7f9f741082f0 2024-09-21T03:54:03.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.609+0000 7f9f7af2b640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9f74112a80 con 0x7f9f741029c0 2024-09-21T03:54:03.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.609+0000 7f9f794c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f74108c40 0x7f9f7419bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:03.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.609+0000 7f9f794c8640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f74108c40 0x7f9f7419bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46384/0 (socket says 172.21.15.84:46384) 2024-09-21T03:54:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.609+0000 7f9f794c8640 1 -- 172.21.15.84:0/708659519 learned_addr learned my addr 172.21.15.84:0/708659519 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.609+0000 7f9f78cc7640 1 --2- 172.21.15.84:0/708659519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f741029c0 0x7f9f7419b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.609+0000 7f9f73fff640 1 --2- 172.21.15.84:0/708659519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f741082f0 0x7f9f7419b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.609+0000 7f9f794c8640 1 -- 172.21.15.84:0/708659519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f741029c0 msgr2=0x7f9f7419b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.609+0000 7f9f794c8640 1 --2- 172.21.15.84:0/708659519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f741029c0 0x7f9f7419b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.609+0000 7f9f794c8640 1 -- 172.21.15.84:0/708659519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f741082f0 msgr2=0x7f9f7419b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.609+0000 7f9f794c8640 1 --2- 172.21.15.84:0/708659519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f741082f0 0x7f9f7419b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.609+0000 7f9f794c8640 1 -- 172.21.15.84:0/708659519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f741a6540 con 0x7f9f74108c40 2024-09-21T03:54:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.609+0000 7f9f794c8640 1 --2- 172.21.15.84:0/708659519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f74108c40 0x7f9f7419bd30 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c00cad0 tx=0x7f9f6c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.610+0000 7f9f71ffb640 1 -- 172.21.15.84:0/708659519 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c00ae20 con 0x7f9f74108c40 2024-09-21T03:54:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.610+0000 7f9f71ffb640 1 -- 172.21.15.84:0/708659519 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f6c005020 con 0x7f9f74108c40 2024-09-21T03:54:03.616 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.610+0000 7f9f71ffb640 1 -- 172.21.15.84:0/708659519 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c00f6b0 con 0x7f9f74108c40 2024-09-21T03:54:03.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.610+0000 7f9f7af2b640 1 -- 172.21.15.84:0/708659519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f741a6830 con 0x7f9f74108c40 2024-09-21T03:54:03.617 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.610+0000 7f9f7af2b640 1 -- 172.21.15.84:0/708659519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f741a6d80 con 0x7f9f74108c40 2024-09-21T03:54:03.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.611+0000 7f9f7af2b640 1 -- 172.21.15.84:0/708659519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f74102dd0 con 0x7f9f74108c40 2024-09-21T03:54:03.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.612+0000 7f9f71ffb640 1 -- 172.21.15.84:0/708659519 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f9f6c0051d0 con 0x7f9f74108c40 2024-09-21T03:54:03.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.613+0000 7f9f71ffb640 1 --2- 172.21.15.84:0/708659519 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9f5c0b6700 0x7f9f5c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:03.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.613+0000 7f9f78cc7640 1 --2- 172.21.15.84:0/708659519 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9f5c0b6700 0x7f9f5c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:03.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.613+0000 7f9f71ffb640 1 -- 172.21.15.84:0/708659519 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f9f6c0e7960 con 0x7f9f74108c40 2024-09-21T03:54:03.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.614+0000 7f9f78cc7640 1 --2- 172.21.15.84:0/708659519 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9f5c0b6700 0x7f9f5c0b8c10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9f64000c00 tx=0x7f9f64031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:03.619 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.616+0000 7f9f71ffb640 1 -- 172.21.15.84:0/708659519 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9f6c014030 con 0x7f9f74108c40 2024-09-21T03:54:03.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:03 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2325456400' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:54:03.628 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:03 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2706228138' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:54:03.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:03 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2325456400' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:54:03.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:03 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2706228138' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:54:03.800 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.797+0000 7f9f7af2b640 1 -- 172.21.15.84:0/708659519 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9f7402e640 con 0x7f9f74108c40 2024-09-21T03:54:03.801 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.798+0000 7f9f71ffb640 1 -- 172.21.15.84:0/708659519 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) ==== 100+0+11 (secure 0 0 0) 0x7f9f6c0b2360 con 0x7f9f74108c40 2024-09-21T03:54:03.801 INFO:teuthology.orchestra.run.smithi084.stdout:pg_num: 64 2024-09-21T03:54:03.803 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.800+0000 7f9f7af2b640 1 -- 172.21.15.84:0/708659519 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9f5c0b6700 msgr2=0x7f9f5c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:03.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.800+0000 7f9f7af2b640 1 --2- 172.21.15.84:0/708659519 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9f5c0b6700 0x7f9f5c0b8c10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9f64000c00 tx=0x7f9f64031400 comp rx=0 tx=0).stop 2024-09-21T03:54:03.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.800+0000 7f9f7af2b640 1 -- 172.21.15.84:0/708659519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f74108c40 msgr2=0x7f9f7419bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:03.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.800+0000 7f9f7af2b640 1 --2- 172.21.15.84:0/708659519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f74108c40 0x7f9f7419bd30 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c00cad0 tx=0x7f9f6c00cf90 comp rx=0 tx=0).stop 2024-09-21T03:54:03.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.800+0000 7f9f7af2b640 1 -- 172.21.15.84:0/708659519 shutdown_connections 2024-09-21T03:54:03.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.800+0000 7f9f7af2b640 1 --2- 172.21.15.84:0/708659519 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9f5c0b6700 0x7f9f5c0b8c10 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.800+0000 7f9f7af2b640 1 --2- 172.21.15.84:0/708659519 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9f74108c40 0x7f9f7419bd30 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.800+0000 7f9f7af2b640 1 --2- 172.21.15.84:0/708659519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9f741082f0 0x7f9f7419b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.800+0000 7f9f7af2b640 1 --2- 172.21.15.84:0/708659519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9f741029c0 0x7f9f7419b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.800+0000 7f9f7af2b640 1 -- 172.21.15.84:0/708659519 >> 172.21.15.84:0/708659519 conn(0x7f9f740fe400 msgr2=0x7f9f74100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:03.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.800+0000 7f9f7af2b640 1 -- 172.21.15.84:0/708659519 shutdown_connections 2024-09-21T03:54:03.804 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.800+0000 7f9f7af2b640 1 -- 172.21.15.84:0/708659519 wait complete. 2024-09-21T03:54:03.815 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T03:54:03.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.920+0000 7f1676a30640 1 -- 172.21.15.84:0/1694259103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16701029d0 msgr2=0x7f1670102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:03.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.920+0000 7f1676a30640 1 --2- 172.21.15.84:0/1694259103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16701029d0 0x7f1670102de0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f1660009900 tx=0x7f166002a410 comp rx=0 tx=0).stop 2024-09-21T03:54:03.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.920+0000 7f1676a30640 1 -- 172.21.15.84:0/1694259103 shutdown_connections 2024-09-21T03:54:03.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.920+0000 7f1676a30640 1 --2- 172.21.15.84:0/1694259103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1670108c50 0x7f167010f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.920+0000 7f1676a30640 1 --2- 172.21.15.84:0/1694259103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1670108300 0x7f1670108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.924 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.920+0000 7f1676a30640 1 --2- 172.21.15.84:0/1694259103 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16701029d0 0x7f1670102de0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.920+0000 7f1676a30640 1 -- 172.21.15.84:0/1694259103 >> 172.21.15.84:0/1694259103 conn(0x7f167007a680 msgr2=0x7f167007aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:03.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.920+0000 7f1676a30640 1 -- 172.21.15.84:0/1694259103 shutdown_connections 2024-09-21T03:54:03.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.920+0000 7f1676a30640 1 -- 172.21.15.84:0/1694259103 wait complete. 2024-09-21T03:54:03.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.921+0000 7f1676a30640 1 Processor -- start 2024-09-21T03:54:03.925 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.921+0000 7f1676a30640 1 -- start start 2024-09-21T03:54:03.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f1676a30640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16701029d0 0x7f167019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:03.927 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f1676a30640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1670108300 0x7f167019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:03.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f1676a30640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1670108c50 0x7f167019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:03.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f1676a30640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f1670112970 con 0x7f16701029d0 2024-09-21T03:54:03.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f1676a30640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f16701127f0 con 0x7f1670108300 2024-09-21T03:54:03.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f1676a30640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f1670112af0 con 0x7f1670108c50 2024-09-21T03:54:03.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f166ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16701029d0 0x7f167019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:03.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f166ffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16701029d0 0x7f167019a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:46394/0 (socket says 172.21.15.84:46394) 2024-09-21T03:54:03.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f166ffff640 1 -- 172.21.15.84:0/4065127164 learned_addr learned my addr 172.21.15.84:0/4065127164 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:03.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f166f7fe640 1 --2- 172.21.15.84:0/4065127164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1670108300 0x7f167019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:03.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f166ffff640 1 -- 172.21.15.84:0/4065127164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1670108c50 msgr2=0x7f167019fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:03.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f1674fcd640 1 --2- 172.21.15.84:0/4065127164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1670108c50 0x7f167019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:03.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f166ffff640 1 --2- 172.21.15.84:0/4065127164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1670108c50 0x7f167019fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f166ffff640 1 -- 172.21.15.84:0/4065127164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1670108300 msgr2=0x7f167019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:03.928 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f166ffff640 1 --2- 172.21.15.84:0/4065127164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1670108300 0x7f167019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f166ffff640 1 -- 172.21.15.84:0/4065127164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16701a03f0 con 0x7f16701029d0 2024-09-21T03:54:03.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f166f7fe640 1 --2- 172.21.15.84:0/4065127164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1670108300 0x7f167019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:03.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f166ffff640 1 --2- 172.21.15.84:0/4065127164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16701029d0 0x7f167019a4c0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f1660006010 tx=0x7f16600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:03.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f166d7fa640 1 -- 172.21.15.84:0/4065127164 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166003f030 con 0x7f16701029d0 2024-09-21T03:54:03.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f1676a30640 1 -- 172.21.15.84:0/4065127164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16701a0680 con 0x7f16701029d0 2024-09-21T03:54:03.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f166d7fa640 1 -- 172.21.15.84:0/4065127164 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1660003800 con 0x7f16701029d0 2024-09-21T03:54:03.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.922+0000 7f166d7fa640 1 -- 172.21.15.84:0/4065127164 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1660035070 con 0x7f16701029d0 2024-09-21T03:54:03.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.923+0000 7f1676a30640 1 -- 172.21.15.84:0/4065127164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16701a6e70 con 0x7f16701029d0 2024-09-21T03:54:03.929 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.923+0000 7f1676a30640 1 -- 172.21.15.84:0/4065127164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1670102de0 con 0x7f16701029d0 2024-09-21T03:54:03.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.925+0000 7f166d7fa640 1 -- 172.21.15.84:0/4065127164 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f1660003cb0 con 0x7f16701029d0 2024-09-21T03:54:03.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.926+0000 7f166d7fa640 1 --2- 172.21.15.84:0/4065127164 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f165c0b6680 0x7f165c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:03.930 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.926+0000 7f166f7fe640 1 --2- 172.21.15.84:0/4065127164 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f165c0b6680 0x7f165c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:03.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.926+0000 7f166d7fa640 1 -- 172.21.15.84:0/4065127164 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8441+0+0 (secure 0 0 0) 0x7f1660108300 con 0x7f16701029d0 2024-09-21T03:54:03.931 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.926+0000 7f166f7fe640 1 --2- 172.21.15.84:0/4065127164 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f165c0b6680 0x7f165c0b8b90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f167006a410 tx=0x7f1658005ec0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:03.932 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:03.929+0000 7f166d7fa640 1 -- 172.21.15.84:0/4065127164 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f16600ce8a0 con 0x7f16701029d0 2024-09-21T03:54:04.155 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:04.152+0000 7f1676a30640 1 -- 172.21.15.84:0/4065127164 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f167002e640 con 0x7f16701029d0 2024-09-21T03:54:04.163 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:04.160+0000 7f166d7fa640 1 -- 172.21.15.84:0/4065127164 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v27) ==== 81+0+834053 (secure 0 0 0) 0x7f16600f1020 con 0x7f16701029d0 2024-09-21T03:54:04.173 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:54:04.173 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:54:04.173 INFO:teuthology.orchestra.run.smithi084.stdout: "epoch": 27, 2024-09-21T03:54:04.173 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.173 INFO:teuthology.orchestra.run.smithi084.stdout: "active_gid": 14226, 2024-09-21T03:54:04.173 INFO:teuthology.orchestra.run.smithi084.stdout: "active_name": "x", 2024-09-21T03:54:04.173 INFO:teuthology.orchestra.run.smithi084.stdout: "active_addrs": { 2024-09-21T03:54:04.173 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2024-09-21T03:54:04.173 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.173 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2024-09-21T03:54:04.173 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:6800", 2024-09-21T03:54:04.173 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 4090897078 2024-09-21T03:54:04.174 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.174 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.174 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v1", 2024-09-21T03:54:04.174 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:6801", 2024-09-21T03:54:04.174 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 4090897078 2024-09-21T03:54:04.174 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.174 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T03:54:04.174 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.174 INFO:teuthology.orchestra.run.smithi084.stdout: "active_addr": "172.21.15.84:6801/4090897078", 2024-09-21T03:54:04.174 INFO:teuthology.orchestra.run.smithi084.stdout: "active_change": "2024-09-21T03:33:50.189121+0000", 2024-09-21T03:54:04.174 INFO:teuthology.orchestra.run.smithi084.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T03:54:04.174 INFO:teuthology.orchestra.run.smithi084.stdout: "available": true, 2024-09-21T03:54:04.174 INFO:teuthology.orchestra.run.smithi084.stdout: "standbys": [ 2024-09-21T03:54:04.175 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.175 INFO:teuthology.orchestra.run.smithi084.stdout: "gid": 24133, 2024-09-21T03:54:04.175 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "z", 2024-09-21T03:54:04.175 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr_features": 4540719139924082687, 2024-09-21T03:54:04.175 INFO:teuthology.orchestra.run.smithi084.stdout: "available_modules": [ 2024-09-21T03:54:04.175 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.175 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "alerts", 2024-09-21T03:54:04.175 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.175 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.175 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.175 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T03:54:04.175 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T03:54:04.175 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.175 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.176 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.176 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T03:54:04.176 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.176 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.176 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.176 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T03:54:04.176 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.176 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.176 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.176 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.176 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.176 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.176 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.176 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.177 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.177 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.177 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.177 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.177 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.177 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.177 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.177 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.177 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.177 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.177 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.177 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.177 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.178 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.178 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.178 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.178 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.178 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.178 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.178 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.178 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.178 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.178 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.178 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.178 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.178 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.179 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.179 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.179 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.179 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.179 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.179 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.179 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.179 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.179 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.179 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.179 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.180 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.180 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.180 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.180 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.180 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.180 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.180 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.180 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.180 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.180 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.180 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.181 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.181 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.181 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.181 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.181 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.181 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.181 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.181 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.181 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.181 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.181 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.181 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.182 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.182 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.182 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.182 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.182 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_destination": { 2024-09-21T03:54:04.182 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_destination", 2024-09-21T03:54:04.182 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.182 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.182 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.182 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.183 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.183 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.183 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.183 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T03:54:04.183 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.183 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.183 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.183 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.183 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_from_name": { 2024-09-21T03:54:04.183 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_from_name", 2024-09-21T03:54:04.183 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.184 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.184 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.184 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "Ceph", 2024-09-21T03:54:04.184 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.184 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.184 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.184 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email From: name", 2024-09-21T03:54:04.184 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.184 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.184 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.184 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_host": { 2024-09-21T03:54:04.184 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_host", 2024-09-21T03:54:04.184 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.185 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.185 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.185 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.185 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.185 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.185 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.185 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP server", 2024-09-21T03:54:04.185 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.185 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.185 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.186 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_password": { 2024-09-21T03:54:04.186 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_password", 2024-09-21T03:54:04.186 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.186 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.186 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.186 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.186 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.186 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.186 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.186 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Password to authenticate with", 2024-09-21T03:54:04.186 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.186 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.186 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.187 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.187 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_port": { 2024-09-21T03:54:04.187 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_port", 2024-09-21T03:54:04.187 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.187 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.187 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.187 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "465", 2024-09-21T03:54:04.187 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.187 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.187 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.188 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP port", 2024-09-21T03:54:04.188 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.188 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.188 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.188 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.188 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_sender": { 2024-09-21T03:54:04.188 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_sender", 2024-09-21T03:54:04.188 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.188 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.188 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.188 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.188 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.189 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.189 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.189 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP envelope sender", 2024-09-21T03:54:04.189 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.189 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.189 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.189 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_ssl": { 2024-09-21T03:54:04.189 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_ssl", 2024-09-21T03:54:04.190 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.190 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.190 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.190 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.190 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.190 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.190 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.190 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T03:54:04.190 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.190 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.191 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.191 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.191 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_user": { 2024-09-21T03:54:04.191 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_user", 2024-09-21T03:54:04.191 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.191 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.191 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.191 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.191 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.191 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.192 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.192 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "User to authenticate as", 2024-09-21T03:54:04.192 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.192 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.192 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.192 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.192 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.192 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.192 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.193 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.193 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.193 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.193 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.193 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.193 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.193 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.193 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.193 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.193 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.193 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.194 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.194 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.194 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "balancer", 2024-09-21T03:54:04.194 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.194 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.194 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.194 INFO:teuthology.orchestra.run.smithi084.stdout: "active": { 2024-09-21T03:54:04.194 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "active", 2024-09-21T03:54:04.194 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.194 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.194 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.194 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.195 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.195 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.195 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.195 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T03:54:04.195 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.195 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.195 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.195 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_time": { 2024-09-21T03:54:04.195 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_time", 2024-09-21T03:54:04.195 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.195 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.195 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.196 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0000", 2024-09-21T03:54:04.196 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.196 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.196 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.196 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T03:54:04.196 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T03:54:04.196 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.196 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.196 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.196 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_weekday": { 2024-09-21T03:54:04.196 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_weekday", 2024-09-21T03:54:04.196 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T03:54:04.196 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.196 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.197 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.197 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2024-09-21T03:54:04.197 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2024-09-21T03:54:04.197 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.197 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T03:54:04.197 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T03:54:04.197 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.197 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.197 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.197 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_max_iterations": { 2024-09-21T03:54:04.197 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_max_iterations", 2024-09-21T03:54:04.197 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T03:54:04.197 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.197 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.198 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "25", 2024-09-21T03:54:04.198 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T03:54:04.198 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "250", 2024-09-21T03:54:04.198 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.198 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T03:54:04.198 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.198 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.198 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.198 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.198 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_metrics": { 2024-09-21T03:54:04.198 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_metrics", 2024-09-21T03:54:04.198 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.198 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.198 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.198 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T03:54:04.199 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.199 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.199 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.199 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T03:54:04.199 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T03:54:04.199 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.199 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.199 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_step": { 2024-09-21T03:54:04.199 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_step", 2024-09-21T03:54:04.199 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:04.199 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.199 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.200 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.5", 2024-09-21T03:54:04.200 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0.001", 2024-09-21T03:54:04.200 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "0.999", 2024-09-21T03:54:04.200 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.200 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "aggressiveness of optimization", 2024-09-21T03:54:04.200 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T03:54:04.200 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.200 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.200 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.200 INFO:teuthology.orchestra.run.smithi084.stdout: "end_time": { 2024-09-21T03:54:04.200 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_time", 2024-09-21T03:54:04.200 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.200 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.200 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.200 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2359", 2024-09-21T03:54:04.201 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.201 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.201 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.201 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T03:54:04.201 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T03:54:04.201 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.201 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.201 INFO:teuthology.orchestra.run.smithi084.stdout: "end_weekday": { 2024-09-21T03:54:04.201 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_weekday", 2024-09-21T03:54:04.201 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T03:54:04.201 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.201 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.201 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.201 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2024-09-21T03:54:04.202 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2024-09-21T03:54:04.202 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.202 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T03:54:04.202 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T03:54:04.202 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.202 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.202 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.202 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.202 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.202 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.202 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.202 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.203 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.203 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.203 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.203 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.203 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.203 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.203 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.203 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.203 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.203 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.203 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.204 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.204 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.204 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.204 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.204 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.204 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.204 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.204 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.204 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.204 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.204 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.204 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.204 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.204 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.205 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.205 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.205 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.205 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.205 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.205 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.205 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.205 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.205 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.205 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.205 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.205 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.206 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.206 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.206 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.206 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.206 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.206 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.206 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.206 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.206 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.206 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.206 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.206 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.206 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.207 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.207 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.207 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.207 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.207 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.207 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.207 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.207 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.207 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.207 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.207 INFO:teuthology.orchestra.run.smithi084.stdout: "min_score": { 2024-09-21T03:54:04.207 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_score", 2024-09-21T03:54:04.207 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:04.208 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.208 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.208 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.208 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.208 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.208 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.208 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T03:54:04.208 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.208 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.208 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.208 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2024-09-21T03:54:04.208 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2024-09-21T03:54:04.208 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.208 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.209 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.209 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "upmap", 2024-09-21T03:54:04.209 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.209 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.209 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.209 INFO:teuthology.orchestra.run.smithi084.stdout: "crush-compat", 2024-09-21T03:54:04.209 INFO:teuthology.orchestra.run.smithi084.stdout: "none", 2024-09-21T03:54:04.209 INFO:teuthology.orchestra.run.smithi084.stdout: "read", 2024-09-21T03:54:04.209 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap", 2024-09-21T03:54:04.209 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap-read" 2024-09-21T03:54:04.209 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.209 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Balancer mode", 2024-09-21T03:54:04.209 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.209 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.210 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.210 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_ids": { 2024-09-21T03:54:04.210 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_ids", 2024-09-21T03:54:04.210 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.210 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.210 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.210 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.210 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.210 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.210 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.210 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T03:54:04.210 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.210 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.210 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.211 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T03:54:04.211 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T03:54:04.211 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.211 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.211 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.211 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T03:54:04.211 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.211 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.211 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.211 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T03:54:04.211 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.211 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.211 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.212 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.212 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.212 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.212 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.212 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.212 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.212 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.212 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.212 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.212 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.212 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.212 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.212 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.212 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.213 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_deviation": { 2024-09-21T03:54:04.213 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_deviation", 2024-09-21T03:54:04.213 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.213 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.213 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.213 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T03:54:04.213 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T03:54:04.213 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.213 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.213 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T03:54:04.213 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T03:54:04.213 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.213 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.213 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_optimizations": { 2024-09-21T03:54:04.214 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_optimizations", 2024-09-21T03:54:04.214 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T03:54:04.214 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.214 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.214 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:04.214 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.214 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.214 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.214 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T03:54:04.214 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.214 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.214 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.214 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.214 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.215 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.215 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephadm", 2024-09-21T03:54:04.215 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.215 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.215 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.215 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_down_multiplier": { 2024-09-21T03:54:04.215 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_down_multiplier", 2024-09-21T03:54:04.215 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:04.215 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.215 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.216 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2024-09-21T03:54:04.216 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.216 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.216 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.216 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T03:54:04.216 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.216 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.216 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.216 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.216 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_refresh_rate": { 2024-09-21T03:54:04.216 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_refresh_rate", 2024-09-21T03:54:04.216 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.216 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.217 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.217 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "20", 2024-09-21T03:54:04.217 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.217 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.217 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.217 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T03:54:04.217 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.217 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.217 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.217 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_starting_port": { 2024-09-21T03:54:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_starting_port", 2024-09-21T03:54:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4721", 2024-09-21T03:54:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T03:54:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_ptrace": { 2024-09-21T03:54:04.218 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_ptrace", 2024-09-21T03:54:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T03:54:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T03:54:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.219 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_interval": { 2024-09-21T03:54:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_interval", 2024-09-21T03:54:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T03:54:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T03:54:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.220 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_memory_target_ratio": { 2024-09-21T03:54:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T03:54:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.7", 2024-09-21T03:54:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.221 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T03:54:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm_log_destination": { 2024-09-21T03:54:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephadm_log_destination", 2024-09-21T03:54:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.222 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "file", 2024-09-21T03:54:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "file,syslog", 2024-09-21T03:54:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "syslog" 2024-09-21T03:54:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T03:54:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.223 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: "cgroups_split": { 2024-09-21T03:54:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cgroups_split", 2024-09-21T03:54:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.224 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T03:54:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: "config_checks_enabled": { 2024-09-21T03:54:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_checks_enabled", 2024-09-21T03:54:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.225 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T03:54:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: "config_dashboard": { 2024-09-21T03:54:04.226 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_dashboard", 2024-09-21T03:54:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T03:54:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.227 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_alertmanager": { 2024-09-21T03:54:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_alertmanager", 2024-09-21T03:54:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T03:54:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T03:54:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_base": { 2024-09-21T03:54:04.228 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_base", 2024-09-21T03:54:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T03:54:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Container image name, without the tag", 2024-09-21T03:54:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_elasticsearch": { 2024-09-21T03:54:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_elasticsearch", 2024-09-21T03:54:04.229 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T03:54:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "elasticsearch container image", 2024-09-21T03:54:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_grafana": { 2024-09-21T03:54:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_grafana", 2024-09-21T03:54:04.230 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T03:54:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T03:54:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_haproxy": { 2024-09-21T03:54:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_haproxy", 2024-09-21T03:54:04.231 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T03:54:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "HAproxy container image", 2024-09-21T03:54:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_agent": { 2024-09-21T03:54:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_agent", 2024-09-21T03:54:04.232 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T03:54:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger agent container image", 2024-09-21T03:54:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_collector": { 2024-09-21T03:54:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_collector", 2024-09-21T03:54:04.233 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T03:54:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger collector container image", 2024-09-21T03:54:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_query": { 2024-09-21T03:54:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_query", 2024-09-21T03:54:04.234 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T03:54:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger query container image", 2024-09-21T03:54:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_keepalived": { 2024-09-21T03:54:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_keepalived", 2024-09-21T03:54:04.235 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T03:54:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Keepalived container image", 2024-09-21T03:54:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_loki": { 2024-09-21T03:54:04.236 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_loki", 2024-09-21T03:54:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T03:54:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Loki container image", 2024-09-21T03:54:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_nginx": { 2024-09-21T03:54:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_nginx", 2024-09-21T03:54:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.237 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T03:54:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Nginx container image", 2024-09-21T03:54:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_node_exporter": { 2024-09-21T03:54:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_node_exporter", 2024-09-21T03:54:04.238 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T03:54:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T03:54:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_nvmeof": { 2024-09-21T03:54:04.239 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_nvmeof", 2024-09-21T03:54:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T03:54:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Nvme-of container image", 2024-09-21T03:54:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_oauth2_proxy": { 2024-09-21T03:54:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T03:54:04.240 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T03:54:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "oauth2-proxy container image", 2024-09-21T03:54:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_prometheus": { 2024-09-21T03:54:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_prometheus", 2024-09-21T03:54:04.241 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T03:54:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T03:54:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_promtail": { 2024-09-21T03:54:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_promtail", 2024-09-21T03:54:04.242 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T03:54:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Promtail container image", 2024-09-21T03:54:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_samba": { 2024-09-21T03:54:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_samba", 2024-09-21T03:54:04.243 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T03:54:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Samba/SMB container image", 2024-09-21T03:54:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_samba_metrics": { 2024-09-21T03:54:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_samba_metrics", 2024-09-21T03:54:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.244 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T03:54:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T03:54:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_snmp_gateway": { 2024-09-21T03:54:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_snmp_gateway", 2024-09-21T03:54:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.245 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T03:54:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SNMP Gateway container image", 2024-09-21T03:54:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.246 INFO:teuthology.orchestra.run.smithi084.stdout: "container_init": { 2024-09-21T03:54:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_init", 2024-09-21T03:54:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T03:54:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "daemon_cache_timeout": { 2024-09-21T03:54:04.247 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "daemon_cache_timeout", 2024-09-21T03:54:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T03:54:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T03:54:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: "default_cephadm_command_timeout": { 2024-09-21T03:54:04.248 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T03:54:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "900", 2024-09-21T03:54:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T03:54:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "default_registry": { 2024-09-21T03:54:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_registry", 2024-09-21T03:54:04.249 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io", 2024-09-21T03:54:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T03:54:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "device_cache_timeout": { 2024-09-21T03:54:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_cache_timeout", 2024-09-21T03:54:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.250 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1800", 2024-09-21T03:54:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache device inventory", 2024-09-21T03:54:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "device_enhanced_scan": { 2024-09-21T03:54:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_enhanced_scan", 2024-09-21T03:54:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.251 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T03:54:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "facts_cache_timeout": { 2024-09-21T03:54:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "facts_cache_timeout", 2024-09-21T03:54:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.252 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T03:54:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache host facts data", 2024-09-21T03:54:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "grafana_dashboards_path": { 2024-09-21T03:54:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "grafana_dashboards_path", 2024-09-21T03:54:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T03:54:04.253 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T03:54:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: "host_check_interval": { 2024-09-21T03:54:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "host_check_interval", 2024-09-21T03:54:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.254 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T03:54:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to perform a host check", 2024-09-21T03:54:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: "hw_monitoring": { 2024-09-21T03:54:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "hw_monitoring", 2024-09-21T03:54:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.255 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T03:54:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "inventory_list_all": { 2024-09-21T03:54:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "inventory_list_all", 2024-09-21T03:54:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.256 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T03:54:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.257 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.258 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "log_refresh_metadata": { 2024-09-21T03:54:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_refresh_metadata", 2024-09-21T03:54:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T03:54:04.259 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T03:54:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.260 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.261 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.262 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T03:54:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T03:54:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.263 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T03:54:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T03:54:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T03:54:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.264 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "*", 2024-09-21T03:54:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T03:54:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.265 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "max_count_per_host": { 2024-09-21T03:54:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_count_per_host", 2024-09-21T03:54:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.266 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of daemons per service per host", 2024-09-21T03:54:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "max_osd_draining_count": { 2024-09-21T03:54:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_osd_draining_count", 2024-09-21T03:54:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.267 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T03:54:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: "migration_current": { 2024-09-21T03:54:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "migration_current", 2024-09-21T03:54:04.268 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "internal - do not modify", 2024-09-21T03:54:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.269 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2024-09-21T03:54:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2024-09-21T03:54:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "root", 2024-09-21T03:54:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.270 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm-package", 2024-09-21T03:54:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: "root" 2024-09-21T03:54:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T03:54:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: "oob_default_addr": { 2024-09-21T03:54:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "oob_default_addr", 2024-09-21T03:54:04.271 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "169.254.1.1", 2024-09-21T03:54:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T03:54:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.272 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: "prometheus_alerts_path": { 2024-09-21T03:54:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus_alerts_path", 2024-09-21T03:54:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T03:54:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T03:54:04.273 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.274 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.274 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.274 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.274 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_insecure": { 2024-09-21T03:54:04.274 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_insecure", 2024-09-21T03:54:04.274 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.274 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.274 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.274 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.274 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.274 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.274 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.274 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T03:54:04.274 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.275 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.275 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.275 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.275 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_password": { 2024-09-21T03:54:04.275 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_password", 2024-09-21T03:54:04.275 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.275 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.275 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.275 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.275 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.275 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.275 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.275 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T03:54:04.275 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.275 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_url": { 2024-09-21T03:54:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_url", 2024-09-21T03:54:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T03:54:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.276 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_username": { 2024-09-21T03:54:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_username", 2024-09-21T03:54:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T03:54:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "secure_monitoring_stack": { 2024-09-21T03:54:04.277 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "secure_monitoring_stack", 2024-09-21T03:54:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T03:54:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "service_discovery_port": { 2024-09-21T03:54:04.278 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "service_discovery_port", 2024-09-21T03:54:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8765", 2024-09-21T03:54:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "cephadm service discovery port", 2024-09-21T03:54:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.279 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_config_file": { 2024-09-21T03:54:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_config_file", 2024-09-21T03:54:04.280 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T03:54:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_keepalive_count_max": { 2024-09-21T03:54:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T03:54:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.281 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3", 2024-09-21T03:54:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T03:54:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_keepalive_interval": { 2024-09-21T03:54:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_keepalive_interval", 2024-09-21T03:54:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.282 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7", 2024-09-21T03:54:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T03:54:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "use_agent": { 2024-09-21T03:54:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_agent", 2024-09-21T03:54:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.283 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T03:54:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: "use_repo_digest": { 2024-09-21T03:54:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_repo_digest", 2024-09-21T03:54:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.284 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T03:54:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_failed_host_check": { 2024-09-21T03:54:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_failed_host_check", 2024-09-21T03:54:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.285 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T03:54:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_daemons": { 2024-09-21T03:54:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_daemons", 2024-09-21T03:54:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.286 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T03:54:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_hosts": { 2024-09-21T03:54:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_hosts", 2024-09-21T03:54:04.287 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T03:54:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.288 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crash", 2024-09-21T03:54:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.289 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.290 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.291 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.292 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.293 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.294 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "retain_interval": { 2024-09-21T03:54:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retain_interval", 2024-09-21T03:54:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "31536000", 2024-09-21T03:54:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.295 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T03:54:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.296 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_recent_interval": { 2024-09-21T03:54:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_recent_interval", 2024-09-21T03:54:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.297 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1209600", 2024-09-21T03:54:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T03:54:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.298 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dashboard", 2024-09-21T03:54:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T03:54:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T03:54:04.299 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.300 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T03:54:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T03:54:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.301 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T03:54:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T03:54:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.302 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_ENABLED": { 2024-09-21T03:54:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T03:54:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.303 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T03:54:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T03:54:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.304 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T03:54:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T03:54:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.305 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T03:54:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T03:54:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.306 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T03:54:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T03:54:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.307 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T03:54:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T03:54:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.308 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T03:54:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T03:54:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.309 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T03:54:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T03:54:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.310 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T03:54:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T03:54:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T03:54:04.311 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T03:54:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T03:54:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T03:54:04.312 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T03:54:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T03:54:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.313 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T03:54:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T03:54:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T03:54:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.314 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.315 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.315 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.315 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.315 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.315 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.315 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.315 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.315 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.315 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_URL": { 2024-09-21T03:54:04.315 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_URL", 2024-09-21T03:54:04.315 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.315 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.315 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.315 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.315 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.316 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.316 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.316 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.316 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.316 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.316 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.316 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.316 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T03:54:04.316 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T03:54:04.316 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.316 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.316 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.316 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T03:54:04.316 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.316 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.316 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.317 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.317 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.317 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.317 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.317 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T03:54:04.317 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T03:54:04.317 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.317 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.317 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.317 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.317 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.317 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.317 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.317 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.317 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.318 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.318 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.318 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.318 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T03:54:04.318 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T03:54:04.318 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.318 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.318 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.318 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.318 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.318 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.318 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.318 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.318 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.318 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.318 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.319 INFO:teuthology.orchestra.run.smithi084.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T03:54:04.319 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T03:54:04.319 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.319 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.319 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.319 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.319 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.319 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.319 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.319 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.319 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.319 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.319 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.320 INFO:teuthology.orchestra.run.smithi084.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T03:54:04.320 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T03:54:04.320 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.320 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.320 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.320 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.320 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.320 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.320 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.320 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.320 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.320 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.320 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.320 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.320 INFO:teuthology.orchestra.run.smithi084.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T03:54:04.321 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T03:54:04.321 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.321 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.321 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.321 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "[]", 2024-09-21T03:54:04.321 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.321 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.321 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.321 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.321 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.322 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.322 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.322 INFO:teuthology.orchestra.run.smithi084.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T03:54:04.322 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T03:54:04.322 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.322 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.322 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.322 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "{}", 2024-09-21T03:54:04.322 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.322 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.322 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.322 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.322 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.323 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.323 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.323 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T03:54:04.323 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T03:54:04.323 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.323 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.323 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.323 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.323 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.323 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.323 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.323 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.323 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.324 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.324 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.324 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T03:54:04.324 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T03:54:04.324 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.324 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.324 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.324 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.324 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.324 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.324 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.324 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.325 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.325 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.325 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.325 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T03:54:04.325 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T03:54:04.325 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.325 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.325 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.325 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.325 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.325 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.325 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.325 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.325 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.326 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.326 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.326 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T03:54:04.326 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T03:54:04.326 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.326 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.326 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.327 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.327 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.327 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.327 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.327 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.327 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.327 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.327 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.327 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T03:54:04.327 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T03:54:04.327 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.327 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.327 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.327 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.328 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.328 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.328 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.328 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.328 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.328 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.328 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.328 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T03:54:04.328 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T03:54:04.328 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.328 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.329 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.329 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.329 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.329 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.329 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.329 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.329 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.329 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.329 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.329 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.329 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T03:54:04.329 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T03:54:04.329 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.329 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.329 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.330 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.330 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.330 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.330 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.330 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.330 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.330 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.330 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.330 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.330 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T03:54:04.330 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T03:54:04.331 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.331 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.331 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.331 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.331 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.331 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.331 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.331 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.331 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.331 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.331 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.331 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.331 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T03:54:04.332 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T03:54:04.332 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.332 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.332 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.332 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.332 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.332 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.332 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.332 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.332 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.332 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.332 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.332 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.333 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T03:54:04.333 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T03:54:04.333 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.333 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.333 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.333 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.333 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.333 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.333 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.333 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.333 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.334 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.334 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.334 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T03:54:04.334 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T03:54:04.334 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.334 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.334 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.334 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T03:54:04.334 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.334 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.334 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.334 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.335 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.335 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.335 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.335 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T03:54:04.335 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T03:54:04.335 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.335 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.335 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.335 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:04.335 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.335 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.335 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.336 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.336 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.336 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.336 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.336 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.336 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T03:54:04.336 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T03:54:04.336 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.336 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.336 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.336 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8", 2024-09-21T03:54:04.336 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.336 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.336 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.336 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.337 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.337 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.337 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.337 INFO:teuthology.orchestra.run.smithi084.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T03:54:04.337 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T03:54:04.337 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.337 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.337 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.337 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "45", 2024-09-21T03:54:04.337 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.337 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.337 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.337 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.337 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.337 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.338 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.338 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.338 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T03:54:04.338 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T03:54:04.338 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.338 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.338 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.338 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.338 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.338 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.338 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.338 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.338 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.338 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.338 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.339 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.339 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T03:54:04.339 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T03:54:04.339 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.339 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.339 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.339 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T03:54:04.339 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.339 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.339 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.339 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.339 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.339 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.339 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.340 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.340 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T03:54:04.340 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T03:54:04.340 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.340 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.340 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.340 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.340 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.340 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.340 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.340 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.340 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.340 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.340 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.340 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.341 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T03:54:04.341 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T03:54:04.341 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.341 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.341 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.341 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.341 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.341 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.341 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.341 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.341 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.341 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.341 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.342 INFO:teuthology.orchestra.run.smithi084.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T03:54:04.342 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T03:54:04.342 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.342 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.342 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.342 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.342 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.342 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.342 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.342 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.342 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.342 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.342 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.342 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.343 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T03:54:04.343 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T03:54:04.343 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.343 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.343 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.343 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.343 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.343 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.343 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.343 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.343 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.343 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.343 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.344 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T03:54:04.344 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T03:54:04.344 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.344 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.344 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.344 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:04.344 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.344 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.344 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.344 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.344 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.344 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.344 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.345 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.345 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T03:54:04.345 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T03:54:04.345 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.345 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.345 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.345 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T03:54:04.345 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.345 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.345 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.345 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.345 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.345 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.345 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.346 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.346 INFO:teuthology.orchestra.run.smithi084.stdout: "cross_origin_url": { 2024-09-21T03:54:04.346 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cross_origin_url", 2024-09-21T03:54:04.346 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.346 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.346 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.346 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.346 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.346 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.346 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.346 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.346 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.346 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.346 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.347 INFO:teuthology.orchestra.run.smithi084.stdout: "crt_file": { 2024-09-21T03:54:04.347 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crt_file", 2024-09-21T03:54:04.347 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.347 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.347 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.347 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.347 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.347 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.347 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.347 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.347 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.347 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.347 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.348 INFO:teuthology.orchestra.run.smithi084.stdout: "debug": { 2024-09-21T03:54:04.348 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "debug", 2024-09-21T03:54:04.348 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.348 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.348 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.348 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.348 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.348 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.348 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.348 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable/disable debug options", 2024-09-21T03:54:04.348 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.348 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.348 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.349 INFO:teuthology.orchestra.run.smithi084.stdout: "jwt_token_ttl": { 2024-09-21T03:54:04.349 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "jwt_token_ttl", 2024-09-21T03:54:04.349 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.349 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.349 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.349 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "28800", 2024-09-21T03:54:04.349 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.349 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.349 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.349 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.349 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.349 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.349 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.350 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2024-09-21T03:54:04.350 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2024-09-21T03:54:04.350 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.350 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.350 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.350 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.350 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.350 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.350 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.350 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.350 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.350 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.350 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.351 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.351 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.351 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.351 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.351 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.351 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.351 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.351 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.351 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.351 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.351 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.351 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.351 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.351 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.351 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.352 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.352 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.352 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.352 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.352 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.352 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.352 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.352 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.352 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.352 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.352 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.352 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.352 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.352 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.353 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.353 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.353 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.353 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.353 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.353 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.353 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.353 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.353 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.353 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.353 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.353 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.353 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.353 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.354 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.354 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.354 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.354 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.354 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.354 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.354 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.354 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.354 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.354 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.354 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.354 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.354 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.354 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.355 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.355 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.355 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.355 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.355 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.355 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.355 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.355 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.355 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.355 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.355 INFO:teuthology.orchestra.run.smithi084.stdout: "motd": { 2024-09-21T03:54:04.355 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "motd", 2024-09-21T03:54:04.355 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.356 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.356 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.356 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.356 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.356 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.356 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.356 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "The message of the day", 2024-09-21T03:54:04.356 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.356 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.356 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.356 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.356 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect_resolve_ip_addr": { 2024-09-21T03:54:04.357 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T03:54:04.357 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.357 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.357 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.357 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.357 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.357 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.357 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.357 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.357 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.357 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.357 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.357 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.358 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T03:54:04.358 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T03:54:04.358 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.358 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.358 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.358 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2024-09-21T03:54:04.358 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.358 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.358 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.358 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.358 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.358 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.358 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.359 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T03:54:04.359 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T03:54:04.359 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.359 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.359 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.359 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8080", 2024-09-21T03:54:04.359 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.359 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.359 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.359 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.359 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.360 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.360 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.360 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.360 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.360 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.360 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.360 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.360 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.360 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.360 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.360 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.360 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.360 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.360 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.361 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.361 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.361 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2024-09-21T03:54:04.361 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2024-09-21T03:54:04.361 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.361 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.361 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.361 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.361 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.361 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.361 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.361 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.361 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.361 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.362 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.362 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.362 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl_server_port": { 2024-09-21T03:54:04.362 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl_server_port", 2024-09-21T03:54:04.362 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.362 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.362 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.362 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8443", 2024-09-21T03:54:04.362 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.362 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.362 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.362 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.362 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.362 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.363 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.363 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.363 INFO:teuthology.orchestra.run.smithi084.stdout: "sso_oauth2": { 2024-09-21T03:54:04.363 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sso_oauth2", 2024-09-21T03:54:04.363 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.363 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.363 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.363 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.363 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.363 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.363 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.363 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.363 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.363 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.364 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.364 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2024-09-21T03:54:04.364 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2024-09-21T03:54:04.364 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.364 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.364 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.364 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "redirect", 2024-09-21T03:54:04.364 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.364 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.365 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.365 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.365 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect" 2024-09-21T03:54:04.365 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.365 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.365 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.365 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.365 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.365 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.365 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2024-09-21T03:54:04.365 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2024-09-21T03:54:04.365 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.365 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.365 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.365 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T03:54:04.366 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2024-09-21T03:54:04.366 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2024-09-21T03:54:04.366 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.366 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.366 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.366 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.366 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.366 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.366 INFO:teuthology.orchestra.run.smithi084.stdout: "url_prefix": { 2024-09-21T03:54:04.367 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url_prefix", 2024-09-21T03:54:04.367 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.367 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.367 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.367 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.367 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.367 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.367 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.367 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.367 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.367 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.367 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.367 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.368 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.368 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.368 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "devicehealth", 2024-09-21T03:54:04.368 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.368 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.368 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.368 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_monitoring": { 2024-09-21T03:54:04.368 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_monitoring", 2024-09-21T03:54:04.368 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.368 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.369 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.369 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.369 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.369 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.369 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.369 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "monitor device health metrics", 2024-09-21T03:54:04.369 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.369 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.369 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.369 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.369 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.370 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.370 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.370 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.370 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.370 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.370 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.370 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.370 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.370 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.371 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.371 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.371 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.371 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.371 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.371 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.371 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.371 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.371 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.372 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.372 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.372 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.372 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.372 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.372 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.372 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.372 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.372 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.373 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.373 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.373 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.373 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.373 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.373 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.373 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.373 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.373 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.373 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.373 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.373 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.373 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.373 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.373 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.374 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.374 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.374 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.374 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.374 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.374 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.374 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.374 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.374 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.374 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.374 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.374 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.374 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.374 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.374 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.374 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.375 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.375 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.375 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.375 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.375 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.375 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.375 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.375 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.375 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.375 INFO:teuthology.orchestra.run.smithi084.stdout: "mark_out_threshold": { 2024-09-21T03:54:04.375 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mark_out_threshold", 2024-09-21T03:54:04.375 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.375 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.375 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.375 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2419200", 2024-09-21T03:54:04.376 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.376 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.376 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.376 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T03:54:04.376 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.376 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.376 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.376 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.376 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_name": { 2024-09-21T03:54:04.376 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_name", 2024-09-21T03:54:04.376 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.376 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.376 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.376 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "device_health_metrics", 2024-09-21T03:54:04.376 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.377 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.377 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.377 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T03:54:04.377 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.377 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.377 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.377 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.377 INFO:teuthology.orchestra.run.smithi084.stdout: "retention_period": { 2024-09-21T03:54:04.377 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retention_period", 2024-09-21T03:54:04.377 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.377 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.377 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.377 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15552000", 2024-09-21T03:54:04.377 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.377 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.378 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.378 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain device health metrics", 2024-09-21T03:54:04.378 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.378 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.378 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.378 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.378 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_frequency": { 2024-09-21T03:54:04.378 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_frequency", 2024-09-21T03:54:04.378 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.378 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.378 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.378 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2024-09-21T03:54:04.378 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.378 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.379 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.379 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T03:54:04.379 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.379 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.379 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.379 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.379 INFO:teuthology.orchestra.run.smithi084.stdout: "self_heal": { 2024-09-21T03:54:04.379 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "self_heal", 2024-09-21T03:54:04.379 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.379 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.379 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.379 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.379 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.379 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.379 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.380 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T03:54:04.380 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.380 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.380 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.380 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.380 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T03:54:04.380 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T03:54:04.380 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.380 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.380 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.380 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T03:54:04.380 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.380 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.380 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.380 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T03:54:04.380 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.381 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.381 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.381 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.381 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.381 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.381 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.381 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.381 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.381 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.381 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.381 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.381 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.381 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.381 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.381 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.381 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.382 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.382 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_threshold": { 2024-09-21T03:54:04.382 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_threshold", 2024-09-21T03:54:04.382 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.382 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.382 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.382 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7257600", 2024-09-21T03:54:04.382 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.382 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.382 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.382 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T03:54:04.382 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.382 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.382 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.382 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.383 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.383 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.383 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.383 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "diskprediction_local", 2024-09-21T03:54:04.383 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.383 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.383 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.383 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.383 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.383 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.383 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.383 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.383 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.383 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.383 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.384 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.384 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.384 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.384 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.384 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.384 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.384 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.384 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.384 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.384 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.384 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.384 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.384 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.384 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.384 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.384 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.385 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.385 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.385 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.385 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.385 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.385 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.385 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.385 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.385 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.385 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.385 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.385 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.385 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.385 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.385 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.385 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.386 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.386 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.386 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.386 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.386 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.386 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.386 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.386 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.386 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.386 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.386 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.386 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.386 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.386 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.387 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.387 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.387 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.387 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.387 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.387 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.387 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.387 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.387 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.387 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.387 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.387 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.387 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.387 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.387 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.387 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.388 INFO:teuthology.orchestra.run.smithi084.stdout: "predict_interval": { 2024-09-21T03:54:04.388 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predict_interval", 2024-09-21T03:54:04.388 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.388 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.388 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.388 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2024-09-21T03:54:04.388 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.388 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.388 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.388 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.388 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.388 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.388 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.388 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.388 INFO:teuthology.orchestra.run.smithi084.stdout: "predictor_model": { 2024-09-21T03:54:04.389 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predictor_model", 2024-09-21T03:54:04.389 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.389 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.389 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.389 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "prophetstor", 2024-09-21T03:54:04.389 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.389 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.389 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.389 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.389 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.389 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.389 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.389 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.389 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T03:54:04.390 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T03:54:04.390 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.390 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.390 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.390 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T03:54:04.390 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.390 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.390 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.390 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.390 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.390 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.390 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.390 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.391 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.391 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.391 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.391 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.391 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.391 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.391 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.391 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.391 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.391 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.391 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.391 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.391 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.391 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.391 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.392 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.392 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.392 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "influx", 2024-09-21T03:54:04.392 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": false, 2024-09-21T03:54:04.392 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "influxdb python module not found", 2024-09-21T03:54:04.392 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.392 INFO:teuthology.orchestra.run.smithi084.stdout: "batch_size": { 2024-09-21T03:54:04.392 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "batch_size", 2024-09-21T03:54:04.392 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.392 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.392 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.392 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5000", 2024-09-21T03:54:04.392 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.392 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.392 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.393 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T03:54:04.393 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.393 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.393 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.393 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.393 INFO:teuthology.orchestra.run.smithi084.stdout: "database": { 2024-09-21T03:54:04.393 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "database", 2024-09-21T03:54:04.393 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.393 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.393 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.394 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "ceph", 2024-09-21T03:54:04.394 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.394 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.394 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.394 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T03:54:04.394 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.394 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.394 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.394 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.394 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": { 2024-09-21T03:54:04.394 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "hostname", 2024-09-21T03:54:04.394 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.394 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.394 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.394 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.395 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.395 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.395 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.395 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server hostname", 2024-09-21T03:54:04.395 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.395 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.395 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.395 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.395 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T03:54:04.395 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T03:54:04.395 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.396 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.396 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.396 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "30", 2024-09-21T03:54:04.396 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "5", 2024-09-21T03:54:04.396 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.396 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.396 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T03:54:04.396 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.396 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.396 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.396 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.396 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.396 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.396 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.396 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.397 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.397 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.397 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.397 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.397 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.397 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.397 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.397 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.397 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.397 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.397 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.397 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.397 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.397 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.398 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.398 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.398 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.398 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.398 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.398 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.398 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.398 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.398 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.398 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.398 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.398 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.399 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.399 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.399 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.399 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.399 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.399 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.399 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.399 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.399 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.399 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.399 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.399 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.399 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.400 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.400 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.400 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.400 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.400 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.400 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.400 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.400 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.400 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.400 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.400 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.400 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.400 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.400 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.401 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.401 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.401 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.401 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.401 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.401 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.401 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.401 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.401 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.401 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.401 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.401 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.402 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.402 INFO:teuthology.orchestra.run.smithi084.stdout: "password": { 2024-09-21T03:54:04.402 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "password", 2024-09-21T03:54:04.402 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.402 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.402 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.402 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.402 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.402 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.402 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.403 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "password of InfluxDB server user", 2024-09-21T03:54:04.403 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.403 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.403 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.403 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.403 INFO:teuthology.orchestra.run.smithi084.stdout: "port": { 2024-09-21T03:54:04.403 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "port", 2024-09-21T03:54:04.403 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.403 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.403 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.403 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8086", 2024-09-21T03:54:04.403 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.404 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.404 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.404 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server port", 2024-09-21T03:54:04.404 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.404 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.404 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.404 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.404 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.404 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.405 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.405 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.405 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.405 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.405 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.405 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.405 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.405 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.405 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.406 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.406 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.406 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.406 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2024-09-21T03:54:04.406 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2024-09-21T03:54:04.406 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.406 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.406 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.406 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "false", 2024-09-21T03:54:04.406 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.406 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.406 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.407 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T03:54:04.407 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.407 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.407 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.407 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.407 INFO:teuthology.orchestra.run.smithi084.stdout: "threads": { 2024-09-21T03:54:04.407 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threads", 2024-09-21T03:54:04.407 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.407 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.407 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.407 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T03:54:04.407 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T03:54:04.407 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "32", 2024-09-21T03:54:04.407 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.407 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T03:54:04.408 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.408 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.408 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.408 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.408 INFO:teuthology.orchestra.run.smithi084.stdout: "username": { 2024-09-21T03:54:04.408 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "username", 2024-09-21T03:54:04.408 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.408 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.408 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.408 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.408 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.408 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.408 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.408 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "username of InfluxDB server user", 2024-09-21T03:54:04.408 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.408 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.408 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.409 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.409 INFO:teuthology.orchestra.run.smithi084.stdout: "verify_ssl": { 2024-09-21T03:54:04.409 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "verify_ssl", 2024-09-21T03:54:04.409 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.409 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.409 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.409 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "true", 2024-09-21T03:54:04.409 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.409 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.409 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.409 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T03:54:04.409 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.409 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.410 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.410 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.410 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.410 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.410 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.410 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "insights", 2024-09-21T03:54:04.410 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.410 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.410 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.410 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.410 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.410 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.410 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.410 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.411 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.411 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.411 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.411 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.411 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.411 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.411 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.411 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.411 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.411 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.411 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.411 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.411 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.411 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.411 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.412 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.412 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.412 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.412 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.412 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.412 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.412 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.412 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.412 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.412 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.412 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.412 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.412 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.412 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.413 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.413 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.413 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.413 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.413 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.413 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.413 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.413 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.413 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.413 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.413 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.413 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.414 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.414 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.414 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.414 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.414 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.414 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.414 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.414 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.414 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.414 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.414 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.415 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.415 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.415 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.415 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.415 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.415 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.415 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.415 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.415 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.415 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.415 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.415 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.415 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.416 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.416 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.416 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.416 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.416 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.416 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.416 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.416 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.416 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.416 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.416 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.416 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.416 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.417 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.417 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.417 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.417 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.417 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "iostat", 2024-09-21T03:54:04.417 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.417 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.417 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.417 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.417 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.417 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.417 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.417 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.417 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.418 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.418 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.418 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.418 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.418 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.418 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.418 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.418 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.418 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.418 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.418 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.418 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.418 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.418 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.419 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.419 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.419 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.419 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.419 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.419 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.419 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.419 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.419 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.419 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.419 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.419 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.419 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.420 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.420 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.420 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.420 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.420 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.420 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.420 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.420 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.420 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.420 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.420 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.420 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.420 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.420 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.420 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.420 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.421 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.421 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.421 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.421 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.421 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.421 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.421 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.421 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.421 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.421 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.421 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.421 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.421 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.421 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.421 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.422 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.422 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.422 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.422 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.422 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.422 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.422 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.422 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.422 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.422 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.422 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.422 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.422 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.422 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.423 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.423 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.423 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.423 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.423 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.423 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.423 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.423 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.423 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.423 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "k8sevents", 2024-09-21T03:54:04.423 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.423 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.423 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.423 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_event_retention_days": { 2024-09-21T03:54:04.423 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ceph_event_retention_days", 2024-09-21T03:54:04.424 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.424 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.424 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.424 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7", 2024-09-21T03:54:04.424 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.424 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.424 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.424 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T03:54:04.424 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.424 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.424 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.424 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.424 INFO:teuthology.orchestra.run.smithi084.stdout: "config_check_secs": { 2024-09-21T03:54:04.424 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_check_secs", 2024-09-21T03:54:04.424 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.424 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.425 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.425 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:04.425 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "10", 2024-09-21T03:54:04.425 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.425 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.425 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T03:54:04.425 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.425 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.425 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.425 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.425 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.425 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.425 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.425 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.425 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.426 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.426 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.426 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.426 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.426 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.426 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.426 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.426 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.426 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.426 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.426 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.426 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.426 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.426 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.426 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.427 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.427 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.427 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.427 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.427 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.427 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.427 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.427 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.427 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.427 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.427 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.428 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.428 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.428 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.428 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.428 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.428 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.428 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.428 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.428 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.428 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.428 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.428 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.428 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.428 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.428 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.428 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.429 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.429 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.429 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.429 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.429 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.429 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.429 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.429 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.429 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.429 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.430 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.430 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.430 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.430 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.430 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.430 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.430 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.430 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.430 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.430 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.430 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.430 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.430 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.430 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.431 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.431 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.431 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.431 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.431 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.431 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.431 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.431 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.431 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.431 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.431 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.432 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.432 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.432 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.432 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.432 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.432 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "localpool", 2024-09-21T03:54:04.432 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.432 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.432 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.432 INFO:teuthology.orchestra.run.smithi084.stdout: "failure_domain": { 2024-09-21T03:54:04.432 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "failure_domain", 2024-09-21T03:54:04.432 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.432 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.432 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.432 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "host", 2024-09-21T03:54:04.433 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.433 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.433 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.433 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "failure domain for any created local pool", 2024-09-21T03:54:04.433 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T03:54:04.433 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.433 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.433 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.433 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.433 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.433 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.433 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.433 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.434 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.434 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.434 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.434 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.434 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.434 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.434 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.434 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.434 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.434 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.434 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.434 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.434 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.434 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.435 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.435 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.435 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.435 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.435 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.435 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.435 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.435 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.435 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.435 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.435 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.435 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.435 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.435 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.435 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.436 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.436 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.436 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.436 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.436 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.436 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.436 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.436 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.436 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.436 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.436 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.436 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.437 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.437 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.437 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.437 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.437 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.437 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.437 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.437 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.437 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.437 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.437 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.437 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.437 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.437 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.438 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.438 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.438 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.438 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.438 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.438 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.438 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.438 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.438 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.438 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.438 INFO:teuthology.orchestra.run.smithi084.stdout: "min_size": { 2024-09-21T03:54:04.439 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_size", 2024-09-21T03:54:04.439 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.439 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.439 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.439 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.439 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.439 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.439 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.439 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default min_size for any created local pool", 2024-09-21T03:54:04.439 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T03:54:04.439 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.440 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.440 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.440 INFO:teuthology.orchestra.run.smithi084.stdout: "num_rep": { 2024-09-21T03:54:04.440 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "num_rep", 2024-09-21T03:54:04.440 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.440 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.440 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.440 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3", 2024-09-21T03:54:04.440 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.440 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.440 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.441 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default replica count for any created local pool", 2024-09-21T03:54:04.441 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.441 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.441 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.441 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.441 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_num": { 2024-09-21T03:54:04.441 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_num", 2024-09-21T03:54:04.441 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.441 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.441 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.441 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "128", 2024-09-21T03:54:04.442 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.442 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.442 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.442 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T03:54:04.442 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.442 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.442 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.442 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.442 INFO:teuthology.orchestra.run.smithi084.stdout: "prefix": { 2024-09-21T03:54:04.443 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prefix", 2024-09-21T03:54:04.443 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.443 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.443 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.443 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.443 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.443 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.443 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.443 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name prefix for any created local pool", 2024-09-21T03:54:04.443 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.443 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.443 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.443 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.443 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.444 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.444 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.444 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.444 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.444 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.444 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.444 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.444 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.444 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.444 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.444 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.444 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.444 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.444 INFO:teuthology.orchestra.run.smithi084.stdout: "subtree": { 2024-09-21T03:54:04.444 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "subtree", 2024-09-21T03:54:04.445 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.445 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.445 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.445 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "rack", 2024-09-21T03:54:04.445 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.445 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.445 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.445 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T03:54:04.445 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T03:54:04.445 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.445 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.445 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.445 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.445 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.445 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.446 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mds_autoscaler", 2024-09-21T03:54:04.446 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.446 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.446 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.446 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.446 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.446 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.446 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.446 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.446 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.446 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.446 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.446 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.446 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.446 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.446 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.447 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.447 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.447 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.447 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.447 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.447 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.447 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.447 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.447 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.447 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.447 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.447 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.447 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.447 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.448 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.448 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.448 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.448 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.448 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.448 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.448 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.448 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.448 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.448 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.448 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.448 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.448 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.448 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.448 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.449 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.449 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.449 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.449 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.449 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.449 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.449 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.449 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.449 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.449 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.449 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.449 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.449 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.449 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.449 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.449 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.450 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.450 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.450 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.450 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.450 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.450 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.450 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.450 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.450 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.450 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.450 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.450 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.450 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.450 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.450 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.451 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.451 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.451 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.451 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.451 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.451 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.451 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.451 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.451 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.451 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.451 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.451 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.451 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.451 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.451 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.452 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirroring", 2024-09-21T03:54:04.452 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.452 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.452 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.452 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.452 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.452 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.452 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.452 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.452 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.452 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.452 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.452 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.452 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.452 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.452 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.453 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.453 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.453 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.453 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.453 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.453 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.453 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.453 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.453 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.453 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.453 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.453 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.453 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.453 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.453 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.453 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.454 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.454 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.454 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.454 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.454 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.454 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.454 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.454 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.454 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.454 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.454 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.454 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.454 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.454 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.454 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.455 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.455 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.455 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.455 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.455 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.455 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.455 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.455 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.455 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.455 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.455 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.455 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.455 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.455 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.456 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.456 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.456 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.456 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.456 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.456 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.456 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.456 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.456 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.456 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.456 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.456 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.456 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.456 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.456 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.457 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.457 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.457 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.457 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.457 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.457 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.457 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.457 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.457 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.457 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.457 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.457 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.457 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.457 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.457 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.457 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "nfs", 2024-09-21T03:54:04.458 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.458 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.458 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.458 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.458 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.458 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.458 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.458 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.458 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.458 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.458 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.458 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.458 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.458 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.458 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.459 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.459 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.459 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.459 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.459 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.459 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.459 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.459 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.459 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.459 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.459 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.459 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.459 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.460 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.460 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.460 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.460 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.460 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.460 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.460 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.460 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.460 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.460 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.460 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.460 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.460 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.460 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.461 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.461 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.461 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.461 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.461 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.461 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.461 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.461 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.461 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.461 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.461 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.461 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.461 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.461 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.462 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.463 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2024-09-21T03:54:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.464 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "fail_fs": { 2024-09-21T03:54:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "fail_fs", 2024-09-21T03:54:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T03:54:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.465 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.466 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.467 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.468 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.469 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.470 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator": { 2024-09-21T03:54:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2024-09-21T03:54:04.471 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm", 2024-09-21T03:54:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "rook", 2024-09-21T03:54:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "test_orchestrator" 2024-09-21T03:54:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Orchestrator backend", 2024-09-21T03:54:04.472 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.473 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_perf_query", 2024-09-21T03:54:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.474 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.475 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.476 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.477 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.478 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.479 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.480 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_support", 2024-09-21T03:54:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.481 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.482 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.483 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.484 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.485 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.486 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_autoscaler", 2024-09-21T03:54:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.487 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.489 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.490 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.491 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T03:54:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T03:54:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T03:54:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.492 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.493 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "threshold": { 2024-09-21T03:54:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threshold", 2024-09-21T03:54:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2024-09-21T03:54:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1.0", 2024-09-21T03:54:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "scaling threshold", 2024-09-21T03:54:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T03:54:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.494 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "progress", 2024-09-21T03:54:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_pg_recovery_event": { 2024-09-21T03:54:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_pg_recovery_event", 2024-09-21T03:54:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.495 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T03:54:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2024-09-21T03:54:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2024-09-21T03:54:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.496 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.497 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.498 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.499 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.500 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.501 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: "max_completed_events": { 2024-09-21T03:54:04.502 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_completed_events", 2024-09-21T03:54:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "50", 2024-09-21T03:54:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "number of past completed events to remember", 2024-09-21T03:54:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.503 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T03:54:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T03:54:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T03:54:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long the module is going to sleep", 2024-09-21T03:54:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.504 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.505 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus", 2024-09-21T03:54:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: "cache": { 2024-09-21T03:54:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cache", 2024-09-21T03:54:04.506 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.507 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.507 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.507 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.507 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.507 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.507 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.507 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.507 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.507 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.507 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.507 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.507 INFO:teuthology.orchestra.run.smithi084.stdout: "exclude_perf_counters": { 2024-09-21T03:54:04.507 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "exclude_perf_counters", 2024-09-21T03:54:04.507 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.507 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.507 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.508 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.508 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.508 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.508 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.508 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T03:54:04.508 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T03:54:04.508 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.508 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.508 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.508 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.508 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.508 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.508 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.508 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.508 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.508 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.509 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.509 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.509 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.509 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.509 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.509 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.509 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.509 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.509 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.509 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.509 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.509 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.509 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.509 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.509 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.510 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.510 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.510 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.510 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.510 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.510 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.510 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.510 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.510 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.510 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.511 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.511 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.511 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.511 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.511 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.511 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.511 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.511 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.511 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.511 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.512 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.512 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.512 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.512 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.512 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.512 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.512 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.512 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.512 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.512 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.512 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.513 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.513 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.513 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.513 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.513 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.513 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.513 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.513 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.513 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.513 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.513 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.513 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.513 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.513 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.513 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.514 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.514 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.514 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools": { 2024-09-21T03:54:04.514 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools", 2024-09-21T03:54:04.514 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.514 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.514 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.514 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.514 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.514 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.514 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.514 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.514 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.514 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.514 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.515 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.515 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T03:54:04.515 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T03:54:04.515 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.515 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.515 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.515 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "300", 2024-09-21T03:54:04.515 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.515 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.515 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.515 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.515 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.515 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.515 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.515 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.515 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_interval": { 2024-09-21T03:54:04.515 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_interval", 2024-09-21T03:54:04.516 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:04.516 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.516 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.516 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15.0", 2024-09-21T03:54:04.516 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.516 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.516 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.516 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.516 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.516 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.516 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.516 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.516 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T03:54:04.516 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T03:54:04.516 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.517 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.517 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.517 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2024-09-21T03:54:04.517 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.517 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.517 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.517 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T03:54:04.517 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.517 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.517 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.517 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.517 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T03:54:04.517 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T03:54:04.517 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.517 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.518 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.518 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "9283", 2024-09-21T03:54:04.518 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.518 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.518 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.518 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T03:54:04.518 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.518 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.518 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.518 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.518 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.518 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.518 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.518 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.518 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.519 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.519 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.519 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.519 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.519 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.519 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.519 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.519 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.519 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.519 INFO:teuthology.orchestra.run.smithi084.stdout: "stale_cache_strategy": { 2024-09-21T03:54:04.519 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stale_cache_strategy", 2024-09-21T03:54:04.519 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.519 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.519 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.519 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "log", 2024-09-21T03:54:04.520 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.520 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.520 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.520 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.520 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.520 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.520 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.520 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.520 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2024-09-21T03:54:04.520 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2024-09-21T03:54:04.520 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.520 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.520 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.520 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "default", 2024-09-21T03:54:04.520 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.521 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.521 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.521 INFO:teuthology.orchestra.run.smithi084.stdout: "default", 2024-09-21T03:54:04.521 INFO:teuthology.orchestra.run.smithi084.stdout: "error" 2024-09-21T03:54:04.521 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.521 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.521 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.521 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.521 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.521 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.521 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2024-09-21T03:54:04.521 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2024-09-21T03:54:04.521 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.521 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.521 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.522 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T03:54:04.522 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2024-09-21T03:54:04.522 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2024-09-21T03:54:04.522 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.522 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.522 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.522 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.522 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.522 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.522 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.522 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.522 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.522 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_support", 2024-09-21T03:54:04.522 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.523 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.523 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.523 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.523 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.523 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.523 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.523 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.523 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.523 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.523 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.523 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.523 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.523 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.523 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.523 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.523 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.524 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.524 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.524 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.524 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.524 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.524 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.524 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.524 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.524 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.524 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.524 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.524 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.524 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.524 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.524 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.525 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.525 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.525 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.525 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.525 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.525 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.525 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.525 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.525 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.525 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.525 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.525 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.525 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.526 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.526 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.526 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.526 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.526 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.526 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.526 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.526 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.526 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.526 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.526 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.526 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.526 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.526 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.527 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.527 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.527 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.527 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.527 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.527 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.527 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.527 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.527 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.527 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.527 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.527 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.527 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.527 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.527 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_snap_create": { 2024-09-21T03:54:04.528 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_snap_create", 2024-09-21T03:54:04.528 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.528 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.528 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.528 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:04.528 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.528 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.528 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.528 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.528 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.528 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.528 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.528 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.528 INFO:teuthology.orchestra.run.smithi084.stdout: "mirror_snapshot_schedule": { 2024-09-21T03:54:04.528 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T03:54:04.528 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.529 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.529 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.529 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.529 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.529 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.529 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.529 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.529 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.529 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.529 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.529 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.529 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.529 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.529 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.529 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.530 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.530 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.530 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.530 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.530 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.530 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.530 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.530 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.530 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.530 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.530 INFO:teuthology.orchestra.run.smithi084.stdout: "trash_purge_schedule": { 2024-09-21T03:54:04.530 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "trash_purge_schedule", 2024-09-21T03:54:04.530 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.530 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.530 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.531 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.531 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.531 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.531 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.531 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.531 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.531 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.531 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.531 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.531 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.531 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.531 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.531 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "restful", 2024-09-21T03:54:04.531 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.531 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.531 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.532 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_auth": { 2024-09-21T03:54:04.532 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_auth", 2024-09-21T03:54:04.532 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.532 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.532 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.532 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.532 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.532 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.532 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.532 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.532 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.532 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.532 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.532 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.532 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2024-09-21T03:54:04.533 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2024-09-21T03:54:04.533 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.533 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.533 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.533 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.533 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.533 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.533 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.533 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.533 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.533 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.533 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.533 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.534 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.534 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.534 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.534 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.534 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.534 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.534 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.534 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.534 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.534 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.534 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.534 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.535 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.535 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.535 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.535 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.535 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.535 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.535 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.535 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.535 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.535 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.535 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.535 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.535 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.535 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.536 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.536 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.536 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.536 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.536 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.536 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.536 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.536 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.536 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.536 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.536 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.536 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.536 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.537 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.537 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.537 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.537 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.537 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.537 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.537 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.537 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.537 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.537 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.537 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.537 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.537 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.537 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.537 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.538 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.538 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.538 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.538 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.538 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.538 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.538 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.538 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.538 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.538 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.539 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.539 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.539 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.539 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.539 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.539 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.539 INFO:teuthology.orchestra.run.smithi084.stdout: "max_requests": { 2024-09-21T03:54:04.539 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_requests", 2024-09-21T03:54:04.539 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.539 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.539 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.539 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T03:54:04.539 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.540 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.540 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.540 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T03:54:04.540 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.540 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.540 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.540 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.540 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T03:54:04.540 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T03:54:04.540 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.540 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.540 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.540 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.541 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.541 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.541 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.541 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.541 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.541 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.541 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.541 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.541 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T03:54:04.541 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T03:54:04.542 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.542 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.542 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.542 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.542 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.542 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.542 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.542 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.542 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.542 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.542 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.542 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.542 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.543 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.543 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.543 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.543 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.543 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.543 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.543 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.543 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.543 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.543 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.543 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.543 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.544 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.544 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.544 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.544 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.544 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rgw", 2024-09-21T03:54:04.544 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.544 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.544 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.544 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.544 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.544 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.544 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.544 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.545 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.545 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.545 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.545 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.545 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.545 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.545 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.545 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.545 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.545 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.545 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.546 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.546 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.546 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.546 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.546 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.546 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.546 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.546 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.546 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.546 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.546 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.546 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.547 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.547 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.547 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.547 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.547 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.547 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.547 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.547 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.547 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.547 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.547 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.547 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.547 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.547 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.548 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.548 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.548 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.548 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.548 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.548 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.548 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.548 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.548 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.548 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.548 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.548 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.548 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.548 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.548 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.549 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.549 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.549 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.549 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.549 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.549 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.549 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.549 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.549 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.549 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.549 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.549 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.549 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.549 INFO:teuthology.orchestra.run.smithi084.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T03:54:04.549 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T03:54:04.549 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.550 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.550 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.550 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T03:54:04.550 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.550 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.550 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.550 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T03:54:04.550 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.550 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.550 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.550 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.550 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.550 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.550 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.550 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.551 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.551 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.551 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.551 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.551 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.551 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.551 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.551 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.551 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.551 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.551 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.551 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.551 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.551 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rook", 2024-09-21T03:54:04.551 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.551 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.552 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.552 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.552 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.552 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.552 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.552 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.552 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.552 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.552 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.552 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.552 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.552 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.552 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.552 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.552 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.552 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.553 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.553 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.553 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.553 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.553 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.553 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.553 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.553 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.553 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.553 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.553 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.553 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.553 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.553 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.553 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.554 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.554 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.554 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.554 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.554 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.554 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.554 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.554 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.554 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.554 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.554 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.554 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.554 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.554 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.554 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.554 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.555 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.555 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.555 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.555 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.555 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.555 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.555 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.555 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.555 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.555 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.555 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.555 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.555 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.555 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.555 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.555 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.556 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.556 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.556 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.556 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.556 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.556 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.556 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.556 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.556 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.556 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.556 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.556 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.556 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.556 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.557 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.557 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.557 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.557 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.557 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.557 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.557 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.557 INFO:teuthology.orchestra.run.smithi084.stdout: "storage_class": { 2024-09-21T03:54:04.557 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "storage_class", 2024-09-21T03:54:04.557 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.557 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.557 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.557 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "local", 2024-09-21T03:54:04.557 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.557 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.557 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.558 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T03:54:04.558 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.558 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.558 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.558 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.558 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.558 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.558 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "selftest", 2024-09-21T03:54:04.558 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.558 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.558 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.558 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.558 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.558 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.559 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.559 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.559 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.559 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.559 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.559 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.559 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.559 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.559 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.559 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.559 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.559 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.559 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.559 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.559 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.559 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.560 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.560 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.560 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.560 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.560 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.560 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.560 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.560 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.560 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.560 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.560 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.560 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.560 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.560 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.560 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.561 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.561 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.561 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.561 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.561 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.561 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.561 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.561 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.561 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.561 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.561 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.561 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.561 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.561 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.561 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.562 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.562 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.562 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.562 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.562 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.562 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.562 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.562 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.562 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.562 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.562 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.562 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.562 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.562 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.562 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.563 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.563 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.563 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.563 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.563 INFO:teuthology.orchestra.run.smithi084.stdout: "roption1": { 2024-09-21T03:54:04.563 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption1", 2024-09-21T03:54:04.563 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.563 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.563 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.563 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.563 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.563 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.563 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.563 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.563 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.564 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.564 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.564 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.564 INFO:teuthology.orchestra.run.smithi084.stdout: "roption2": { 2024-09-21T03:54:04.564 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption2", 2024-09-21T03:54:04.564 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.564 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.564 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.564 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "xyz", 2024-09-21T03:54:04.564 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.564 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.564 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.564 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.564 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.564 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.564 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.565 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption1": { 2024-09-21T03:54:04.565 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption1", 2024-09-21T03:54:04.565 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.565 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.565 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.565 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.565 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.565 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.565 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.565 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.565 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.565 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.565 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.565 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption2": { 2024-09-21T03:54:04.566 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption2", 2024-09-21T03:54:04.566 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.566 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.566 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.566 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.566 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.566 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.566 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.566 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.566 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.566 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.566 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.566 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.567 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption3": { 2024-09-21T03:54:04.567 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption3", 2024-09-21T03:54:04.567 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:04.567 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.567 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.567 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.567 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.567 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.567 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.567 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.567 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.567 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.567 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.568 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption4": { 2024-09-21T03:54:04.568 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption4", 2024-09-21T03:54:04.568 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.568 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.568 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.568 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.568 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.568 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.568 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.568 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.568 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.568 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.568 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.568 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.569 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption5": { 2024-09-21T03:54:04.569 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption5", 2024-09-21T03:54:04.569 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.569 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.569 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.569 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.569 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.569 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.569 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.569 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.570 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.570 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.570 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.570 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption6": { 2024-09-21T03:54:04.570 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption6", 2024-09-21T03:54:04.570 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.570 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.570 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.570 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.570 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.570 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.570 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.570 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.570 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.571 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.571 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.571 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.571 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption7": { 2024-09-21T03:54:04.571 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption7", 2024-09-21T03:54:04.571 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.571 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.571 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.571 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.571 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T03:54:04.571 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "42", 2024-09-21T03:54:04.572 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.572 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.572 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.572 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.572 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.572 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.572 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.572 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.572 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.572 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.572 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.572 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.572 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.573 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.573 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.573 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.573 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.573 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.573 INFO:teuthology.orchestra.run.smithi084.stdout: "testkey": { 2024-09-21T03:54:04.573 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testkey", 2024-09-21T03:54:04.573 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.573 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.573 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.574 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.574 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.574 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.574 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.574 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.574 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.574 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.574 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.574 INFO:teuthology.orchestra.run.smithi084.stdout: "testlkey": { 2024-09-21T03:54:04.574 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testlkey", 2024-09-21T03:54:04.574 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.574 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.575 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.575 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.575 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.575 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.575 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.575 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.575 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.575 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.575 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.575 INFO:teuthology.orchestra.run.smithi084.stdout: "testnewline": { 2024-09-21T03:54:04.575 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testnewline", 2024-09-21T03:54:04.575 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.576 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.576 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.576 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.576 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.576 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.576 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.576 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.576 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.576 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.576 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.576 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.576 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.577 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.577 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.577 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smb", 2024-09-21T03:54:04.577 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.577 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.577 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.577 INFO:teuthology.orchestra.run.smithi084.stdout: "internal_store_backend": { 2024-09-21T03:54:04.577 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "internal_store_backend", 2024-09-21T03:54:04.577 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.577 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.577 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.577 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.577 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.577 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.577 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.578 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T03:54:04.578 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.578 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.578 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.578 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.578 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.578 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.578 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.578 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.578 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.578 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.578 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.578 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.579 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.579 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.579 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.579 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.579 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.579 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.579 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.579 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.579 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.579 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.579 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.579 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.579 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.579 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.580 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.580 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.580 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.580 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.580 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.580 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.580 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.580 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.580 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.580 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.581 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.581 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.581 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.581 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.581 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.581 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.581 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.581 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.581 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.581 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.582 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.582 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.582 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.582 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.582 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.582 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.582 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.582 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.582 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.582 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.582 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.582 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.582 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.583 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.583 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.583 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.583 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.583 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.583 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.583 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.583 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.583 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.583 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.583 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.583 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.583 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.583 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.583 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.584 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.584 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.584 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.584 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.584 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.584 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.584 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.584 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.584 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.584 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.584 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.584 INFO:teuthology.orchestra.run.smithi084.stdout: "update_orchestration": { 2024-09-21T03:54:04.584 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "update_orchestration", 2024-09-21T03:54:04.584 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.584 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.585 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.585 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.585 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.585 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.585 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.585 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T03:54:04.585 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.585 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.585 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.585 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.585 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.585 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.585 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.585 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snap_schedule", 2024-09-21T03:54:04.585 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.586 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.586 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.586 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_m_granularity": { 2024-09-21T03:54:04.586 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_m_granularity", 2024-09-21T03:54:04.586 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.586 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.586 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.586 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.586 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.586 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.586 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.586 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T03:54:04.586 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.586 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.586 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.587 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.587 INFO:teuthology.orchestra.run.smithi084.stdout: "dump_on_update": { 2024-09-21T03:54:04.587 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dump_on_update", 2024-09-21T03:54:04.587 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.587 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.587 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.587 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.587 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.587 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.587 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.587 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "dump database to debug log on update", 2024-09-21T03:54:04.587 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.587 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.587 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.587 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.588 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.588 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.588 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.588 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.588 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.588 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.588 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.588 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.588 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.588 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.588 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.588 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.588 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.588 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.588 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.588 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.589 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.589 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.589 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.589 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.589 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.589 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.589 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.589 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.589 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.589 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.589 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.589 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.589 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.589 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.589 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.590 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.590 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.590 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.590 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.590 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.590 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.590 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.590 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.590 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.590 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.590 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.590 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.590 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.590 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.590 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.591 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.591 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.591 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.591 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.591 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.591 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.591 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.591 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.591 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.591 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.591 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.591 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.591 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.591 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.591 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.592 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.592 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.592 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.592 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.592 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.592 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.592 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.592 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.592 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.592 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.592 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.592 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.592 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.592 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.593 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.593 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.593 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.593 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.593 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.593 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.593 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.593 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.593 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stats", 2024-09-21T03:54:04.593 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.593 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.593 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.593 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.594 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.594 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.594 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.594 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.594 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.594 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.594 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.594 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.594 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.594 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.594 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.594 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.594 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.594 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.594 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.595 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.595 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.595 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.595 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.595 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.595 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.595 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.595 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.595 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.595 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.595 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.595 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.595 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.596 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.596 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.596 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.596 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.596 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.596 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.596 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.596 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.596 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.596 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.596 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.596 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.596 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.596 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.596 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.597 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.597 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.597 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.597 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.597 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.597 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.597 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.597 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.597 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.597 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.597 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.597 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.597 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.597 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.597 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.598 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.598 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.598 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.598 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.598 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.598 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.598 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.598 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.598 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.598 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.598 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.598 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.598 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.598 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.599 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.599 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.599 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.599 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.599 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.599 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.599 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.599 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.599 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.599 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.599 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.599 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.599 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "status", 2024-09-21T03:54:04.599 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.599 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.599 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.600 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.600 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.600 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.600 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.600 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.600 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.600 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.600 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.600 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.600 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.600 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.600 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.600 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.600 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.600 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.600 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.601 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.601 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.601 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.601 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.601 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.601 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.601 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.601 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.601 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.601 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.601 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.601 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.601 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.601 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.601 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.602 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.602 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.602 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.602 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.602 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.602 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.602 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.602 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.602 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.602 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.602 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.602 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.602 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.603 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.603 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.603 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.603 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.603 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.603 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.603 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.603 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.603 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.604 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.604 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.604 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.604 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.604 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.604 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.604 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.604 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.604 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.604 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.604 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.604 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.604 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.604 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.605 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.605 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.605 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.605 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.605 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.605 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.605 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.605 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.605 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.605 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.605 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.605 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telegraf", 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi084.stdout: "address": { 2024-09-21T03:54:04.606 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "address", 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.607 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T03:54:04.608 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T03:54:04.608 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.608 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.608 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.608 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15", 2024-09-21T03:54:04.608 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.608 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.608 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.608 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.608 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.608 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.609 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.609 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.609 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.609 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.609 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.609 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.609 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.609 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.609 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.609 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.609 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.609 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.610 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.610 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.610 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.610 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.610 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.610 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.610 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.610 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.610 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.610 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.610 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.610 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.611 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.611 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.611 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.611 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.611 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.611 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.611 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.611 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.611 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.611 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.611 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.611 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.611 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.612 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.612 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.612 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.612 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.612 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.612 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.612 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.612 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.612 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.612 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.612 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.613 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.613 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.613 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.613 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.613 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.613 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.613 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.613 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.613 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.613 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.613 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.613 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.614 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.614 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.614 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.614 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.614 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.614 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.614 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.614 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.614 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.615 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.615 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.615 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.615 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.615 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.615 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.615 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.615 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.615 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.615 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.616 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.616 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.616 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.616 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.616 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.616 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.616 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.616 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.616 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.616 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telemetry", 2024-09-21T03:54:04.616 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.616 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.616 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.616 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_basic": { 2024-09-21T03:54:04.617 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_basic", 2024-09-21T03:54:04.617 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.617 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.617 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.617 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.617 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.617 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.617 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.617 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T03:54:04.617 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.617 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.618 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.618 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.618 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_crash": { 2024-09-21T03:54:04.618 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_crash", 2024-09-21T03:54:04.618 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.618 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.618 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.618 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.618 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.618 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.618 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.618 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T03:54:04.618 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.618 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.619 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.619 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_device": { 2024-09-21T03:54:04.619 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_device", 2024-09-21T03:54:04.619 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.619 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.619 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.619 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.619 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.619 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.619 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.619 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T03:54:04.619 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.619 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.620 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.620 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.620 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_ident": { 2024-09-21T03:54:04.620 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_ident", 2024-09-21T03:54:04.620 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.620 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.620 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.620 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.620 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.620 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.620 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.620 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T03:54:04.620 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.620 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.620 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.620 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_perf": { 2024-09-21T03:54:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_perf", 2024-09-21T03:54:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T03:54:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: "contact": { 2024-09-21T03:54:04.621 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "contact", 2024-09-21T03:54:04.622 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.622 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.622 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.622 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.622 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.622 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.622 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.622 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.622 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.622 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.622 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.622 INFO:teuthology.orchestra.run.smithi084.stdout: "description": { 2024-09-21T03:54:04.622 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "description", 2024-09-21T03:54:04.623 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.623 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.623 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.623 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.623 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.623 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.623 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.623 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.623 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.623 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.623 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.623 INFO:teuthology.orchestra.run.smithi084.stdout: "device_url": { 2024-09-21T03:54:04.623 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_url", 2024-09-21T03:54:04.624 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.624 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.624 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.624 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T03:54:04.624 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.624 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.624 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.624 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.624 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.624 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.624 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.624 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.624 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2024-09-21T03:54:04.624 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2024-09-21T03:54:04.624 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.624 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.625 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.625 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.625 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.625 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.625 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.625 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.625 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.625 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.625 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.625 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.625 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T03:54:04.625 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T03:54:04.625 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.625 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.625 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.626 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "24", 2024-09-21T03:54:04.626 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "8", 2024-09-21T03:54:04.626 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.626 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.626 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.626 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.626 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.626 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.626 INFO:teuthology.orchestra.run.smithi084.stdout: "last_opt_revision": { 2024-09-21T03:54:04.626 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "last_opt_revision", 2024-09-21T03:54:04.626 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.626 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.627 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.627 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1", 2024-09-21T03:54:04.627 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.627 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.627 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.627 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.627 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.627 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.627 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.627 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.627 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard": { 2024-09-21T03:54:04.627 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard", 2024-09-21T03:54:04.627 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.627 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.627 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.628 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.628 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.628 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.628 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.628 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.628 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.628 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.628 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.628 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard_description": { 2024-09-21T03:54:04.628 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard_description", 2024-09-21T03:54:04.628 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.628 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.629 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.629 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.629 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.629 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.629 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.629 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.629 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.629 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.629 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.629 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.629 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.629 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.629 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.629 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.630 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.630 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.630 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.630 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.630 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.630 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.630 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.630 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.630 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.630 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.630 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.630 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.630 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.630 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.631 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.631 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.631 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.631 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.631 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.631 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.631 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.631 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.631 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.631 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.631 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.631 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.631 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.631 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.631 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.631 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.632 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.632 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.632 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.632 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.632 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.632 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.632 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.632 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.632 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.632 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.632 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.632 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.632 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.632 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.632 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.633 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.633 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.633 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.633 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.633 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.633 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.633 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.633 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.633 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.633 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.633 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.633 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.633 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.633 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.634 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.634 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.634 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.634 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.634 INFO:teuthology.orchestra.run.smithi084.stdout: "organization": { 2024-09-21T03:54:04.634 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "organization", 2024-09-21T03:54:04.634 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.634 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.634 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.634 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.634 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.634 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.634 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.634 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.635 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.635 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.635 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.635 INFO:teuthology.orchestra.run.smithi084.stdout: "proxy": { 2024-09-21T03:54:04.635 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "proxy", 2024-09-21T03:54:04.635 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.635 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.635 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.635 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.635 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.635 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.635 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.635 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.635 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.636 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.636 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.636 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.636 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.636 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.636 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.636 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.636 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.636 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.636 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.636 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.636 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.637 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.637 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.637 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.637 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.637 INFO:teuthology.orchestra.run.smithi084.stdout: "url": { 2024-09-21T03:54:04.637 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url", 2024-09-21T03:54:04.637 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.637 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.637 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.637 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T03:54:04.637 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.637 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.637 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.638 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.638 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.638 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.638 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.638 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.638 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.638 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.638 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "test_orchestrator", 2024-09-21T03:54:04.638 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.638 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.638 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.639 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.639 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.639 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.639 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.639 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.639 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.639 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.639 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.639 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.639 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.639 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.639 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.640 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.640 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.640 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.640 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.640 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.641 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.641 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.641 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.642 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.642 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.642 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.642 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.642 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.642 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.642 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.642 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.642 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.642 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.643 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.643 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.643 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.643 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.643 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.643 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.643 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.643 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.643 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.643 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.644 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.644 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.644 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.644 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.644 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.644 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.644 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.644 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.644 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.644 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.644 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.645 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.645 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.645 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.645 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.645 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.645 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.645 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.645 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.645 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.645 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.646 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.646 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.646 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.646 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.646 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.646 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.646 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.646 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.646 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.646 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.646 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.647 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.647 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.647 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.647 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.647 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.647 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.647 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.647 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.647 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.647 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.648 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.648 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2024-09-21T03:54:04.648 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.648 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.648 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.648 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.648 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.648 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.648 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.649 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.649 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.649 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.649 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.649 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.649 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.649 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.649 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.649 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.649 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.650 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.650 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.650 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.650 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.650 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.650 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.650 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.650 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.650 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.650 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.650 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.650 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.650 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.651 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.651 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.651 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.651 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.651 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.651 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.651 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.651 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.651 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.651 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.651 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.651 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.651 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.651 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.652 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.652 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.652 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.652 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.652 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.652 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.652 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.652 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.652 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.652 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.652 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.652 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.652 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.653 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.653 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.653 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.653 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.653 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.653 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.653 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.653 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.654 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.654 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.654 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.654 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.654 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.654 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.654 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_clones": { 2024-09-21T03:54:04.654 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_clones", 2024-09-21T03:54:04.654 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.654 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.654 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.654 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4", 2024-09-21T03:54:04.655 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.655 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.655 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.655 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T03:54:04.655 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.655 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.655 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.655 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.655 INFO:teuthology.orchestra.run.smithi084.stdout: "periodic_async_work": { 2024-09-21T03:54:04.655 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "periodic_async_work", 2024-09-21T03:54:04.655 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.655 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.655 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.655 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.656 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.656 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.656 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.656 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Periodically check for async work", 2024-09-21T03:54:04.656 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.656 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.656 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.656 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot_clone_delay": { 2024-09-21T03:54:04.656 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snapshot_clone_delay", 2024-09-21T03:54:04.656 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.656 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.656 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.656 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.656 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.657 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.657 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.657 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T03:54:04.657 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.657 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.657 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.657 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot_clone_no_wait": { 2024-09-21T03:54:04.657 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T03:54:04.657 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.657 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.657 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.658 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.658 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.658 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.658 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.658 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T03:54:04.658 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.658 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.658 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.658 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.658 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.658 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.658 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.659 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.659 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.659 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.659 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.659 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.659 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.659 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.659 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.659 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.659 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.659 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.659 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.659 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix", 2024-09-21T03:54:04.659 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.660 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.660 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.660 INFO:teuthology.orchestra.run.smithi084.stdout: "discovery_interval": { 2024-09-21T03:54:04.660 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "discovery_interval", 2024-09-21T03:54:04.660 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T03:54:04.660 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.660 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.660 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "100", 2024-09-21T03:54:04.660 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.660 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.660 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.660 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.660 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.660 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.660 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.661 INFO:teuthology.orchestra.run.smithi084.stdout: "identifier": { 2024-09-21T03:54:04.661 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "identifier", 2024-09-21T03:54:04.661 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.661 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.661 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.661 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.661 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.661 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.661 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.661 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.661 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.661 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.661 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.662 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T03:54:04.662 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T03:54:04.662 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.662 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.662 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.662 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T03:54:04.662 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.662 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.662 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.662 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.662 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.662 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.662 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.663 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.663 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.663 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.663 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.663 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.663 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.663 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.663 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.663 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.663 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.663 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.663 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.663 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.663 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.664 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.664 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.664 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.664 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.664 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.664 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.664 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.664 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.664 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.664 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.664 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.664 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.664 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.665 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.665 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.665 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.665 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.665 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.665 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.665 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.665 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.665 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.665 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.665 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.665 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.665 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.665 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.666 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.666 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.666 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.666 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.666 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.666 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.666 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.666 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.666 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.666 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.666 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.666 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.666 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.666 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.666 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.667 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.667 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.667 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.667 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.667 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.667 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.667 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.667 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.667 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.667 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.667 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.667 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.667 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.667 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.668 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.668 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.668 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.668 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.668 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.668 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.668 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.668 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.668 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.668 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.668 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.668 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.668 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.668 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_host": { 2024-09-21T03:54:04.668 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_host", 2024-09-21T03:54:04.668 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.669 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.669 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.669 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.669 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.669 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.669 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.669 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.669 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.669 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.669 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.669 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_port": { 2024-09-21T03:54:04.669 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_port", 2024-09-21T03:54:04.669 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.669 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.669 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.670 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10051", 2024-09-21T03:54:04.670 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.670 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.670 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.670 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.670 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.670 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.670 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.670 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_sender": { 2024-09-21T03:54:04.670 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_sender", 2024-09-21T03:54:04.670 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.670 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.670 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.671 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T03:54:04.671 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.671 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.671 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.671 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.671 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.671 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.671 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.671 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.671 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.671 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.671 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T03:54:04.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.671 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.672 INFO:teuthology.orchestra.run.smithi084.stdout: "gid": 24155, 2024-09-21T03:54:04.672 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "y", 2024-09-21T03:54:04.672 INFO:teuthology.orchestra.run.smithi084.stdout: "mgr_features": 4540719139924082687, 2024-09-21T03:54:04.672 INFO:teuthology.orchestra.run.smithi084.stdout: "available_modules": [ 2024-09-21T03:54:04.672 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.672 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "alerts", 2024-09-21T03:54:04.672 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.672 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.672 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.672 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T03:54:04.672 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T03:54:04.672 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.672 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.672 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.672 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T03:54:04.673 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.673 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.673 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.673 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T03:54:04.673 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.673 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.673 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.673 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.674 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.674 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.674 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.674 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.674 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.674 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.674 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.674 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.674 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.674 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.674 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.674 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.674 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.674 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.675 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.675 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.675 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.675 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.675 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.675 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.675 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.675 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.675 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.676 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.676 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.676 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.676 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.676 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.676 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.676 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.676 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.676 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.676 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.676 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.676 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.676 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.676 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.677 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.677 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.677 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.677 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.677 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.677 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.677 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.677 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.677 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.677 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.678 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.678 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.678 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.678 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.678 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.678 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.678 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.678 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.678 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.678 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.678 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.678 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.679 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.679 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.679 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.679 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.679 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.679 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.679 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.679 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.679 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.679 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_destination": { 2024-09-21T03:54:04.679 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_destination", 2024-09-21T03:54:04.680 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.680 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.680 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.680 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.680 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.680 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.680 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.680 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T03:54:04.680 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.680 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.680 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.680 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_from_name": { 2024-09-21T03:54:04.680 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_from_name", 2024-09-21T03:54:04.680 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.681 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.681 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.681 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "Ceph", 2024-09-21T03:54:04.681 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.681 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.681 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.681 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email From: name", 2024-09-21T03:54:04.681 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.681 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.681 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.681 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_host": { 2024-09-21T03:54:04.682 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_host", 2024-09-21T03:54:04.682 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.682 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.682 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.682 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.682 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.682 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.682 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.682 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP server", 2024-09-21T03:54:04.682 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.683 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.683 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.683 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.683 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_password": { 2024-09-21T03:54:04.683 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_password", 2024-09-21T03:54:04.683 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.683 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.683 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.683 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.683 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.683 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.684 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.684 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Password to authenticate with", 2024-09-21T03:54:04.684 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.684 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.684 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.684 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.684 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_port": { 2024-09-21T03:54:04.684 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_port", 2024-09-21T03:54:04.684 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.684 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.685 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.685 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "465", 2024-09-21T03:54:04.685 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.685 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.685 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.685 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP port", 2024-09-21T03:54:04.685 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.685 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.685 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.685 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.685 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_sender": { 2024-09-21T03:54:04.685 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_sender", 2024-09-21T03:54:04.686 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.686 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.686 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.686 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.686 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.686 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.686 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.686 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP envelope sender", 2024-09-21T03:54:04.686 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.686 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.686 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.686 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_ssl": { 2024-09-21T03:54:04.686 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_ssl", 2024-09-21T03:54:04.686 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.687 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.687 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.687 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.687 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.687 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.687 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.687 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T03:54:04.687 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.687 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.687 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.687 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_user": { 2024-09-21T03:54:04.688 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_user", 2024-09-21T03:54:04.688 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.688 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.688 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.688 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.688 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.688 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.688 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.688 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "User to authenticate as", 2024-09-21T03:54:04.688 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.688 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.688 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.689 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.689 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.689 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.689 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.689 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.689 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.689 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.689 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.689 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.689 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.689 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.689 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.689 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.689 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.689 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.690 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.690 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.690 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "balancer", 2024-09-21T03:54:04.690 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.690 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.690 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.690 INFO:teuthology.orchestra.run.smithi084.stdout: "active": { 2024-09-21T03:54:04.690 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "active", 2024-09-21T03:54:04.690 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.690 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.690 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.690 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.690 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.691 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.691 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.691 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T03:54:04.691 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.691 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.691 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.691 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.691 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_time": { 2024-09-21T03:54:04.691 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_time", 2024-09-21T03:54:04.691 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.691 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.691 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.691 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0000", 2024-09-21T03:54:04.691 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.691 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.692 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.692 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T03:54:04.692 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T03:54:04.692 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.692 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.692 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.692 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_weekday": { 2024-09-21T03:54:04.692 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_weekday", 2024-09-21T03:54:04.692 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T03:54:04.692 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.692 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.692 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.692 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2024-09-21T03:54:04.692 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2024-09-21T03:54:04.693 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.693 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T03:54:04.693 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T03:54:04.693 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.693 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.693 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_max_iterations": { 2024-09-21T03:54:04.693 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_max_iterations", 2024-09-21T03:54:04.693 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T03:54:04.693 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.693 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.693 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "25", 2024-09-21T03:54:04.693 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T03:54:04.693 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "250", 2024-09-21T03:54:04.694 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.694 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T03:54:04.694 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.694 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.694 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.694 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_metrics": { 2024-09-21T03:54:04.694 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_metrics", 2024-09-21T03:54:04.694 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.694 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.694 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.694 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T03:54:04.694 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.694 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.694 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.695 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T03:54:04.695 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T03:54:04.695 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.695 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.695 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.695 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_step": { 2024-09-21T03:54:04.695 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_step", 2024-09-21T03:54:04.695 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:04.695 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.695 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.695 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.5", 2024-09-21T03:54:04.695 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0.001", 2024-09-21T03:54:04.695 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "0.999", 2024-09-21T03:54:04.696 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.696 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "aggressiveness of optimization", 2024-09-21T03:54:04.696 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T03:54:04.696 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.696 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.696 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.696 INFO:teuthology.orchestra.run.smithi084.stdout: "end_time": { 2024-09-21T03:54:04.696 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_time", 2024-09-21T03:54:04.696 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.696 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.696 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.696 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2359", 2024-09-21T03:54:04.696 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.696 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.697 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.697 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T03:54:04.697 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T03:54:04.697 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.697 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.697 INFO:teuthology.orchestra.run.smithi084.stdout: "end_weekday": { 2024-09-21T03:54:04.697 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_weekday", 2024-09-21T03:54:04.697 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T03:54:04.697 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.697 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.697 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.697 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2024-09-21T03:54:04.697 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2024-09-21T03:54:04.697 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.698 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T03:54:04.698 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T03:54:04.698 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.698 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.698 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.698 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.698 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.698 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.698 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.698 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.698 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.698 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.699 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.699 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.699 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.699 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.699 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.699 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.699 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.699 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.699 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.699 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.699 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.699 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.699 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.699 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.700 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.700 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.700 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.700 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.700 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.700 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.700 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.700 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.700 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.700 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.700 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.700 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.700 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.700 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.701 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.701 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.701 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.701 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.701 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.701 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.701 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.701 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.701 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.701 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.701 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.701 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.701 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.701 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.701 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.701 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.701 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.702 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.702 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.702 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.702 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.702 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.702 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.702 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.702 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.702 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.702 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.702 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.702 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.702 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.702 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.703 INFO:teuthology.orchestra.run.smithi084.stdout: "min_score": { 2024-09-21T03:54:04.703 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_score", 2024-09-21T03:54:04.703 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:04.703 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.703 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.703 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.703 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.703 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.703 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.703 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T03:54:04.703 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.703 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.703 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.703 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2024-09-21T03:54:04.704 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2024-09-21T03:54:04.704 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.704 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.704 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.704 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "upmap", 2024-09-21T03:54:04.704 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.704 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.704 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.704 INFO:teuthology.orchestra.run.smithi084.stdout: "crush-compat", 2024-09-21T03:54:04.704 INFO:teuthology.orchestra.run.smithi084.stdout: "none", 2024-09-21T03:54:04.704 INFO:teuthology.orchestra.run.smithi084.stdout: "read", 2024-09-21T03:54:04.704 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap", 2024-09-21T03:54:04.704 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap-read" 2024-09-21T03:54:04.705 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.705 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Balancer mode", 2024-09-21T03:54:04.705 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.705 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.705 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.705 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_ids": { 2024-09-21T03:54:04.705 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_ids", 2024-09-21T03:54:04.705 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.706 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.706 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.706 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.706 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.706 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.706 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.706 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T03:54:04.706 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.706 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.706 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.706 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T03:54:04.706 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T03:54:04.707 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.707 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.707 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.707 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T03:54:04.707 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.707 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.707 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.707 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T03:54:04.707 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.707 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.707 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.708 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.708 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.708 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.708 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.708 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.708 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.708 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.708 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.708 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.708 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.708 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.708 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.708 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.708 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_deviation": { 2024-09-21T03:54:04.709 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_deviation", 2024-09-21T03:54:04.709 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.709 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.709 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.709 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T03:54:04.709 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T03:54:04.709 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.709 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.709 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T03:54:04.710 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T03:54:04.710 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.710 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.710 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_optimizations": { 2024-09-21T03:54:04.710 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_optimizations", 2024-09-21T03:54:04.710 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T03:54:04.710 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.710 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.710 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:04.710 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.710 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.711 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.711 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T03:54:04.711 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.711 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.711 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.711 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.711 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.711 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.711 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.711 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephadm", 2024-09-21T03:54:04.712 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.712 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.712 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.712 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_down_multiplier": { 2024-09-21T03:54:04.712 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_down_multiplier", 2024-09-21T03:54:04.712 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:04.712 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.712 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.712 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2024-09-21T03:54:04.712 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.712 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.713 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.713 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T03:54:04.713 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.713 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.713 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.713 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.713 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_refresh_rate": { 2024-09-21T03:54:04.713 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_refresh_rate", 2024-09-21T03:54:04.713 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.713 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.713 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.714 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "20", 2024-09-21T03:54:04.714 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.714 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.714 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.714 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T03:54:04.714 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.714 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.714 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.714 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.714 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_starting_port": { 2024-09-21T03:54:04.715 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_starting_port", 2024-09-21T03:54:04.715 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.715 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.715 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.715 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4721", 2024-09-21T03:54:04.715 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.715 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.715 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.715 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T03:54:04.715 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.716 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.716 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.716 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_ptrace": { 2024-09-21T03:54:04.716 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_ptrace", 2024-09-21T03:54:04.716 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.716 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.716 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.717 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.717 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.717 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.717 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.717 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T03:54:04.717 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T03:54:04.717 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.717 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.717 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_interval": { 2024-09-21T03:54:04.717 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_interval", 2024-09-21T03:54:04.717 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.717 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.718 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.718 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T03:54:04.718 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.718 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.718 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.718 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T03:54:04.718 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.718 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.718 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.718 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.718 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_memory_target_ratio": { 2024-09-21T03:54:04.718 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T03:54:04.718 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:04.718 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.719 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.719 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.7", 2024-09-21T03:54:04.719 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.719 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.719 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.719 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T03:54:04.719 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.719 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.719 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.719 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.719 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm_log_destination": { 2024-09-21T03:54:04.719 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephadm_log_destination", 2024-09-21T03:54:04.719 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.719 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.720 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.720 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.720 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.720 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.720 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.720 INFO:teuthology.orchestra.run.smithi084.stdout: "file", 2024-09-21T03:54:04.720 INFO:teuthology.orchestra.run.smithi084.stdout: "file,syslog", 2024-09-21T03:54:04.720 INFO:teuthology.orchestra.run.smithi084.stdout: "syslog" 2024-09-21T03:54:04.720 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.720 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T03:54:04.720 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.720 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.720 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.720 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.720 INFO:teuthology.orchestra.run.smithi084.stdout: "cgroups_split": { 2024-09-21T03:54:04.721 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cgroups_split", 2024-09-21T03:54:04.721 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.721 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.721 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.721 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.721 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.721 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.721 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.721 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T03:54:04.721 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.721 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.721 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.721 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.721 INFO:teuthology.orchestra.run.smithi084.stdout: "config_checks_enabled": { 2024-09-21T03:54:04.721 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_checks_enabled", 2024-09-21T03:54:04.721 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.722 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.722 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.722 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.722 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.722 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.722 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.722 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T03:54:04.722 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.722 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.722 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.722 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.722 INFO:teuthology.orchestra.run.smithi084.stdout: "config_dashboard": { 2024-09-21T03:54:04.722 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_dashboard", 2024-09-21T03:54:04.722 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.723 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.723 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.723 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.723 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.723 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.723 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.723 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T03:54:04.723 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.723 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.723 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.723 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.723 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_alertmanager": { 2024-09-21T03:54:04.723 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_alertmanager", 2024-09-21T03:54:04.723 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.723 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.724 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.724 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T03:54:04.724 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.724 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.724 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.724 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T03:54:04.724 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.724 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.724 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.724 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.724 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_base": { 2024-09-21T03:54:04.724 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_base", 2024-09-21T03:54:04.724 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.724 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.725 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.725 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T03:54:04.725 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.725 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.725 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.725 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Container image name, without the tag", 2024-09-21T03:54:04.725 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.725 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.725 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.725 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.725 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_elasticsearch": { 2024-09-21T03:54:04.725 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_elasticsearch", 2024-09-21T03:54:04.725 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.725 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.725 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.726 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T03:54:04.726 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.726 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.726 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.726 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "elasticsearch container image", 2024-09-21T03:54:04.726 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.726 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.726 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.726 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.726 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_grafana": { 2024-09-21T03:54:04.726 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_grafana", 2024-09-21T03:54:04.726 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.726 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.726 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.727 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T03:54:04.727 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.727 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.727 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.727 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T03:54:04.727 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.727 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.727 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.727 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.727 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_haproxy": { 2024-09-21T03:54:04.727 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_haproxy", 2024-09-21T03:54:04.727 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.727 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.727 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.728 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T03:54:04.728 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.728 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.728 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.728 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "HAproxy container image", 2024-09-21T03:54:04.728 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.728 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.728 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.728 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.728 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_agent": { 2024-09-21T03:54:04.728 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_agent", 2024-09-21T03:54:04.728 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.728 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.728 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.728 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T03:54:04.729 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.729 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.729 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.729 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger agent container image", 2024-09-21T03:54:04.729 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.729 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.729 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.729 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.729 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_collector": { 2024-09-21T03:54:04.729 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_collector", 2024-09-21T03:54:04.729 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.729 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.729 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.729 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T03:54:04.729 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.730 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.730 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.730 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger collector container image", 2024-09-21T03:54:04.730 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.730 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.730 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.730 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.730 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_query": { 2024-09-21T03:54:04.730 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_query", 2024-09-21T03:54:04.730 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.730 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.730 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.730 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T03:54:04.731 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.731 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.731 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.731 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger query container image", 2024-09-21T03:54:04.731 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.731 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.731 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.731 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.731 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_keepalived": { 2024-09-21T03:54:04.731 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_keepalived", 2024-09-21T03:54:04.731 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.731 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.731 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.731 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T03:54:04.731 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.732 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.732 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.732 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Keepalived container image", 2024-09-21T03:54:04.732 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.732 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.732 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.732 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.732 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_loki": { 2024-09-21T03:54:04.732 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_loki", 2024-09-21T03:54:04.732 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.732 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.732 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.732 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T03:54:04.732 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.732 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.733 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.733 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Loki container image", 2024-09-21T03:54:04.733 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.733 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.733 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.733 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.733 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_nginx": { 2024-09-21T03:54:04.733 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_nginx", 2024-09-21T03:54:04.733 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.733 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.733 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.733 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T03:54:04.733 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.733 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.733 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.733 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Nginx container image", 2024-09-21T03:54:04.734 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.734 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.734 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.734 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.734 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_node_exporter": { 2024-09-21T03:54:04.734 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_node_exporter", 2024-09-21T03:54:04.734 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.734 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.734 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.734 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T03:54:04.734 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.734 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.734 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.734 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T03:54:04.735 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.735 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.735 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.735 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.735 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_nvmeof": { 2024-09-21T03:54:04.735 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_nvmeof", 2024-09-21T03:54:04.735 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.735 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.735 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.735 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T03:54:04.735 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.735 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.735 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.735 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Nvme-of container image", 2024-09-21T03:54:04.736 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.736 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.736 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.736 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.736 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_oauth2_proxy": { 2024-09-21T03:54:04.736 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T03:54:04.736 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.736 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.736 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.736 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T03:54:04.736 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.736 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.736 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.736 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "oauth2-proxy container image", 2024-09-21T03:54:04.736 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.737 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.737 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.737 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.737 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_prometheus": { 2024-09-21T03:54:04.737 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_prometheus", 2024-09-21T03:54:04.737 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.737 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.737 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.737 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T03:54:04.737 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.737 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.737 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.737 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T03:54:04.737 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.738 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.738 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.738 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.738 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_promtail": { 2024-09-21T03:54:04.738 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_promtail", 2024-09-21T03:54:04.738 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.738 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.738 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.738 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T03:54:04.738 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.739 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.739 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.739 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Promtail container image", 2024-09-21T03:54:04.739 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.739 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.739 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.739 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.739 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_samba": { 2024-09-21T03:54:04.739 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_samba", 2024-09-21T03:54:04.739 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.739 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.739 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.739 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T03:54:04.739 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.740 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.740 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.740 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Samba/SMB container image", 2024-09-21T03:54:04.740 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.740 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.740 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.740 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.740 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_samba_metrics": { 2024-09-21T03:54:04.740 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_samba_metrics", 2024-09-21T03:54:04.740 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.740 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.741 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.741 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T03:54:04.741 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.741 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.741 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.741 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T03:54:04.741 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.741 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.741 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.741 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.741 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_snmp_gateway": { 2024-09-21T03:54:04.741 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_snmp_gateway", 2024-09-21T03:54:04.741 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.741 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.741 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.742 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T03:54:04.742 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.742 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.742 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.742 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SNMP Gateway container image", 2024-09-21T03:54:04.742 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.742 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.742 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.742 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.743 INFO:teuthology.orchestra.run.smithi084.stdout: "container_init": { 2024-09-21T03:54:04.743 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_init", 2024-09-21T03:54:04.743 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.743 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.743 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.743 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.743 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.743 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.743 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.743 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T03:54:04.743 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.743 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.743 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.744 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.744 INFO:teuthology.orchestra.run.smithi084.stdout: "daemon_cache_timeout": { 2024-09-21T03:54:04.744 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "daemon_cache_timeout", 2024-09-21T03:54:04.744 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.744 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.744 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.744 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T03:54:04.744 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.744 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.744 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.744 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T03:54:04.745 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.745 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.745 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.745 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.745 INFO:teuthology.orchestra.run.smithi084.stdout: "default_cephadm_command_timeout": { 2024-09-21T03:54:04.745 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T03:54:04.745 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.745 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.745 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.745 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "900", 2024-09-21T03:54:04.745 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.745 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.745 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.746 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T03:54:04.746 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.746 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.746 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.746 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.746 INFO:teuthology.orchestra.run.smithi084.stdout: "default_registry": { 2024-09-21T03:54:04.746 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_registry", 2024-09-21T03:54:04.746 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.746 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.746 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.746 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io", 2024-09-21T03:54:04.747 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.747 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.747 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.747 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T03:54:04.747 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.747 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.747 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.747 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.747 INFO:teuthology.orchestra.run.smithi084.stdout: "device_cache_timeout": { 2024-09-21T03:54:04.747 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_cache_timeout", 2024-09-21T03:54:04.747 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.748 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.748 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.748 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1800", 2024-09-21T03:54:04.748 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.748 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.748 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.748 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache device inventory", 2024-09-21T03:54:04.748 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.748 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.748 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.749 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.749 INFO:teuthology.orchestra.run.smithi084.stdout: "device_enhanced_scan": { 2024-09-21T03:54:04.749 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_enhanced_scan", 2024-09-21T03:54:04.749 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.749 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.749 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.749 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.749 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.749 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.750 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.750 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T03:54:04.750 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.750 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.750 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.750 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.750 INFO:teuthology.orchestra.run.smithi084.stdout: "facts_cache_timeout": { 2024-09-21T03:54:04.750 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "facts_cache_timeout", 2024-09-21T03:54:04.750 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.750 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.750 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.750 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T03:54:04.750 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.751 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.751 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.751 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache host facts data", 2024-09-21T03:54:04.751 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.751 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.751 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.751 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.751 INFO:teuthology.orchestra.run.smithi084.stdout: "grafana_dashboards_path": { 2024-09-21T03:54:04.751 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "grafana_dashboards_path", 2024-09-21T03:54:04.751 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.751 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.751 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.751 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T03:54:04.751 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.751 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.752 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.752 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T03:54:04.752 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.752 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.752 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.752 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.752 INFO:teuthology.orchestra.run.smithi084.stdout: "host_check_interval": { 2024-09-21T03:54:04.752 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "host_check_interval", 2024-09-21T03:54:04.752 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.752 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.752 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.752 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T03:54:04.752 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.753 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.753 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.753 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to perform a host check", 2024-09-21T03:54:04.753 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.753 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.753 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.753 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.753 INFO:teuthology.orchestra.run.smithi084.stdout: "hw_monitoring": { 2024-09-21T03:54:04.753 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "hw_monitoring", 2024-09-21T03:54:04.753 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.753 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.753 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.754 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.754 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.754 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.754 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.754 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T03:54:04.754 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.754 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.754 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.754 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.754 INFO:teuthology.orchestra.run.smithi084.stdout: "inventory_list_all": { 2024-09-21T03:54:04.754 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "inventory_list_all", 2024-09-21T03:54:04.754 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.754 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.755 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.755 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.755 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.755 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.755 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.755 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T03:54:04.755 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.755 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.755 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.755 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.755 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.755 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.755 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.756 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.756 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.756 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.756 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.756 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.756 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.756 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.756 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.756 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.756 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.756 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.756 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.756 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.756 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.756 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.757 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.757 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.757 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.757 INFO:teuthology.orchestra.run.smithi084.stdout: "log_refresh_metadata": { 2024-09-21T03:54:04.757 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_refresh_metadata", 2024-09-21T03:54:04.757 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.757 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.757 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.757 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.757 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.757 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.757 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.757 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T03:54:04.757 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.758 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.758 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.758 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.758 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.758 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.758 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.758 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.758 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.758 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.758 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.758 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.758 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.758 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T03:54:04.759 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.759 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.759 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.759 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.759 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.759 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.759 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.759 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.759 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.759 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.759 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.759 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.759 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.759 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.760 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.760 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.760 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.760 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.760 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.760 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.760 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.760 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.760 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.760 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.760 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.760 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.760 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.760 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.760 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.761 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.761 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.761 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.761 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.761 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.761 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.761 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.761 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.761 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.761 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.761 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T03:54:04.761 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T03:54:04.761 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.761 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.762 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.762 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.762 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.762 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.762 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.762 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T03:54:04.762 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.762 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.762 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.762 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.762 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T03:54:04.762 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T03:54:04.762 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.762 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.763 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.763 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "*", 2024-09-21T03:54:04.763 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.763 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.763 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.763 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T03:54:04.763 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.763 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.763 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.763 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.763 INFO:teuthology.orchestra.run.smithi084.stdout: "max_count_per_host": { 2024-09-21T03:54:04.763 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_count_per_host", 2024-09-21T03:54:04.763 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.763 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.763 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.764 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:04.764 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.764 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.764 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.764 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of daemons per service per host", 2024-09-21T03:54:04.764 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.764 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.764 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.764 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.764 INFO:teuthology.orchestra.run.smithi084.stdout: "max_osd_draining_count": { 2024-09-21T03:54:04.764 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_osd_draining_count", 2024-09-21T03:54:04.764 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.764 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.764 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.764 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:04.765 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.765 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.765 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.765 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T03:54:04.765 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.765 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.765 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.765 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.765 INFO:teuthology.orchestra.run.smithi084.stdout: "migration_current": { 2024-09-21T03:54:04.765 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "migration_current", 2024-09-21T03:54:04.765 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.765 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.766 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.766 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.766 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.766 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.766 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.766 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "internal - do not modify", 2024-09-21T03:54:04.766 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.766 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.766 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.766 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.766 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2024-09-21T03:54:04.766 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2024-09-21T03:54:04.766 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.767 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.767 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.767 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "root", 2024-09-21T03:54:04.767 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.767 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.767 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.767 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm-package", 2024-09-21T03:54:04.767 INFO:teuthology.orchestra.run.smithi084.stdout: "root" 2024-09-21T03:54:04.767 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.767 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T03:54:04.767 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.767 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.767 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.767 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.768 INFO:teuthology.orchestra.run.smithi084.stdout: "oob_default_addr": { 2024-09-21T03:54:04.768 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "oob_default_addr", 2024-09-21T03:54:04.768 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.768 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.768 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.768 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "169.254.1.1", 2024-09-21T03:54:04.768 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.768 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.768 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.768 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T03:54:04.768 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.768 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.768 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.768 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.769 INFO:teuthology.orchestra.run.smithi084.stdout: "prometheus_alerts_path": { 2024-09-21T03:54:04.769 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus_alerts_path", 2024-09-21T03:54:04.769 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.769 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.769 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.769 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T03:54:04.769 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.769 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.769 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.770 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T03:54:04.770 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.770 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.770 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.770 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.770 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_insecure": { 2024-09-21T03:54:04.770 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_insecure", 2024-09-21T03:54:04.770 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.770 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.770 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.770 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.770 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.770 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.771 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.771 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T03:54:04.771 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.771 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.771 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.771 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.771 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_password": { 2024-09-21T03:54:04.771 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_password", 2024-09-21T03:54:04.771 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.771 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.772 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.772 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.772 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.772 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.772 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.772 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T03:54:04.772 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.772 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.772 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.772 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.772 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_url": { 2024-09-21T03:54:04.772 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_url", 2024-09-21T03:54:04.772 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.773 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.773 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.773 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.773 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.773 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.773 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.773 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T03:54:04.773 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.773 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.773 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.774 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.774 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_username": { 2024-09-21T03:54:04.774 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_username", 2024-09-21T03:54:04.774 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.774 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.774 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.774 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.774 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.774 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.774 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.774 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T03:54:04.775 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.775 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.775 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.775 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.775 INFO:teuthology.orchestra.run.smithi084.stdout: "secure_monitoring_stack": { 2024-09-21T03:54:04.775 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "secure_monitoring_stack", 2024-09-21T03:54:04.775 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.775 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.776 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.776 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.776 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.776 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.776 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.776 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T03:54:04.776 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.776 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.776 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.776 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.776 INFO:teuthology.orchestra.run.smithi084.stdout: "service_discovery_port": { 2024-09-21T03:54:04.776 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "service_discovery_port", 2024-09-21T03:54:04.776 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.777 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.777 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.777 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8765", 2024-09-21T03:54:04.777 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.777 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.777 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.777 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "cephadm service discovery port", 2024-09-21T03:54:04.777 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.777 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.777 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.777 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.778 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.778 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.778 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.778 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.778 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.778 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.778 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.778 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.778 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.778 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.779 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.779 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.779 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.779 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.779 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_config_file": { 2024-09-21T03:54:04.779 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_config_file", 2024-09-21T03:54:04.779 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.779 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.779 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.779 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.779 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.780 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.780 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.780 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T03:54:04.780 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.780 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.780 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.780 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.780 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_keepalive_count_max": { 2024-09-21T03:54:04.781 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T03:54:04.781 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.781 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.781 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.781 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3", 2024-09-21T03:54:04.781 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.781 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.781 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.781 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T03:54:04.781 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.781 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.781 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.782 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.782 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_keepalive_interval": { 2024-09-21T03:54:04.782 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_keepalive_interval", 2024-09-21T03:54:04.782 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.782 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.782 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.782 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7", 2024-09-21T03:54:04.782 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.782 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.782 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.782 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T03:54:04.782 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.783 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.783 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.783 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.783 INFO:teuthology.orchestra.run.smithi084.stdout: "use_agent": { 2024-09-21T03:54:04.783 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_agent", 2024-09-21T03:54:04.783 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.783 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.783 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.783 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.783 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.783 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.783 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.783 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T03:54:04.783 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.783 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.784 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.784 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.784 INFO:teuthology.orchestra.run.smithi084.stdout: "use_repo_digest": { 2024-09-21T03:54:04.784 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_repo_digest", 2024-09-21T03:54:04.784 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.784 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.784 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.784 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.784 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.784 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.784 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.784 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T03:54:04.784 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.784 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.785 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.785 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.785 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_failed_host_check": { 2024-09-21T03:54:04.785 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_failed_host_check", 2024-09-21T03:54:04.785 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.785 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.785 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.785 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.785 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.785 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.785 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.785 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T03:54:04.785 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.786 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.786 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.786 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.786 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_daemons": { 2024-09-21T03:54:04.786 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_daemons", 2024-09-21T03:54:04.786 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.786 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.786 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.786 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.786 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.786 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.786 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.786 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T03:54:04.787 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.787 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.787 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.787 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.787 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_hosts": { 2024-09-21T03:54:04.787 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_hosts", 2024-09-21T03:54:04.787 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.787 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.787 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.787 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.787 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.787 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.787 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.787 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T03:54:04.788 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.788 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.788 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.788 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.788 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.788 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.788 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.788 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crash", 2024-09-21T03:54:04.788 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.788 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.788 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.788 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.788 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.788 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.788 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.789 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.789 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.789 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.789 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.789 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.789 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.789 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.789 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.789 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.789 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.789 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.789 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.789 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.789 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.789 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.790 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.790 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.790 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.790 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.790 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.790 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.790 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.790 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.790 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.790 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.790 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.790 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.790 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.790 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.791 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.791 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.791 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.791 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.791 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.791 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.791 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.791 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.791 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.791 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.791 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.791 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.791 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.791 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.791 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.792 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.792 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.792 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.792 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.792 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.792 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.792 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.792 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.792 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.792 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.792 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.792 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.792 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.793 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.793 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.793 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.793 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.793 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.793 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.793 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.793 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.793 INFO:teuthology.orchestra.run.smithi084.stdout: "retain_interval": { 2024-09-21T03:54:04.793 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retain_interval", 2024-09-21T03:54:04.793 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.793 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.793 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.793 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "31536000", 2024-09-21T03:54:04.794 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.794 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.794 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.794 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T03:54:04.794 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.794 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.794 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.794 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.794 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.794 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.794 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.794 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.794 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.794 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.795 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.795 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.795 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.795 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.795 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.795 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.795 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.795 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.795 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_recent_interval": { 2024-09-21T03:54:04.795 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_recent_interval", 2024-09-21T03:54:04.795 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.795 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.795 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.795 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1209600", 2024-09-21T03:54:04.796 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.796 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.796 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.796 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T03:54:04.796 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.796 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.796 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.796 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.796 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.796 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.796 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.796 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dashboard", 2024-09-21T03:54:04.796 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.796 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.796 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.797 INFO:teuthology.orchestra.run.smithi084.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T03:54:04.797 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T03:54:04.797 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.797 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.797 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.797 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:04.797 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.797 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.797 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.797 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.797 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.797 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.797 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.797 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.798 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T03:54:04.798 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T03:54:04.798 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.798 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.798 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.798 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.798 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.798 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.798 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.798 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.798 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.798 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.798 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.798 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.799 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T03:54:04.799 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T03:54:04.799 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.799 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.799 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.799 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.799 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.799 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.799 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.799 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.799 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.799 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.800 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.800 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.800 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_ENABLED": { 2024-09-21T03:54:04.800 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T03:54:04.800 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.800 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.800 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.800 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.800 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.800 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.800 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.800 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.800 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.800 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.801 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.801 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.801 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T03:54:04.801 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T03:54:04.801 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.801 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.801 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.801 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.801 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.801 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.801 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.801 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.801 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.801 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.801 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.802 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.802 INFO:teuthology.orchestra.run.smithi084.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T03:54:04.802 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T03:54:04.802 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.802 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.802 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.802 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.802 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.802 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.803 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.803 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.803 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.803 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.803 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.803 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.803 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T03:54:04.803 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T03:54:04.803 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.803 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.803 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.803 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.803 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.804 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.804 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.804 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.804 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.804 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.804 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.804 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.804 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T03:54:04.804 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T03:54:04.804 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.804 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.804 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.804 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.804 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.804 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.805 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.806 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.807 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.807 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.807 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.807 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.807 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.807 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.807 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.807 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.807 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T03:54:04.807 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T03:54:04.807 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.808 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.808 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.808 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.808 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.808 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.808 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.808 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.808 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.808 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.808 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.809 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.809 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T03:54:04.809 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T03:54:04.809 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.809 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.809 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.809 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.809 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.809 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.809 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.809 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.809 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.809 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.809 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.810 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.810 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T03:54:04.810 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T03:54:04.810 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.810 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.810 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.810 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.810 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.810 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.810 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.810 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.811 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.811 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.811 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.811 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.811 INFO:teuthology.orchestra.run.smithi084.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T03:54:04.811 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T03:54:04.811 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.811 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.811 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.811 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.811 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.811 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.812 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.812 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.812 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.812 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.812 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.812 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.812 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T03:54:04.812 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T03:54:04.812 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.812 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.812 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.813 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T03:54:04.813 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.813 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.813 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.813 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.813 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.813 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.813 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.813 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.813 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T03:54:04.813 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T03:54:04.814 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.814 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.814 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.814 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.814 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.814 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.814 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.814 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.814 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.814 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.814 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.815 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.815 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_URL": { 2024-09-21T03:54:04.815 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_URL", 2024-09-21T03:54:04.815 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.815 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.815 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.815 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.815 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.815 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.815 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.815 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.815 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.815 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.815 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.816 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.816 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T03:54:04.816 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T03:54:04.816 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.816 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.816 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.816 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T03:54:04.816 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.816 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.816 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.816 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.816 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.816 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.816 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.816 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.817 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T03:54:04.817 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T03:54:04.817 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.817 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.817 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.817 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.817 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.817 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.817 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.817 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.817 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.817 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.817 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.817 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.817 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T03:54:04.818 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T03:54:04.818 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.818 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.818 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.818 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.818 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.818 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.818 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.818 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.818 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.818 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.818 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.818 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.818 INFO:teuthology.orchestra.run.smithi084.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T03:54:04.819 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T03:54:04.819 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.819 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.819 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.819 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.819 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.819 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.819 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.819 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.819 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.819 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.819 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.819 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.819 INFO:teuthology.orchestra.run.smithi084.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T03:54:04.819 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T03:54:04.820 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.820 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.820 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.820 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.820 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.820 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.820 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.820 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.820 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.820 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.820 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.820 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.820 INFO:teuthology.orchestra.run.smithi084.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T03:54:04.820 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T03:54:04.820 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.820 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.821 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.821 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "[]", 2024-09-21T03:54:04.821 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.821 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.821 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.821 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.821 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.821 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.821 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.821 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.821 INFO:teuthology.orchestra.run.smithi084.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T03:54:04.821 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T03:54:04.821 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.822 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.822 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.822 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "{}", 2024-09-21T03:54:04.822 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.822 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.822 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.822 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.822 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.822 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.822 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.822 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.822 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T03:54:04.822 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T03:54:04.822 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.823 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.823 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.823 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.823 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.823 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.823 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.823 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.823 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.823 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.823 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.823 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.823 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T03:54:04.823 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T03:54:04.823 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.824 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.824 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.824 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.824 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.824 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.824 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.824 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.824 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.824 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.824 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.824 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.824 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T03:54:04.824 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T03:54:04.824 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.824 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.825 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.825 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.825 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.825 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.825 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.825 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.825 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.825 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.825 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.825 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.825 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T03:54:04.825 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T03:54:04.825 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.825 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.826 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.826 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.826 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.826 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.826 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.826 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.826 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.826 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.826 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.826 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.826 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T03:54:04.826 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T03:54:04.826 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.827 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.827 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.827 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.827 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.827 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.827 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.827 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.827 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.827 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.827 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.827 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.827 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T03:54:04.827 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T03:54:04.827 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.827 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.828 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.828 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.828 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.828 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.828 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.828 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.828 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.828 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.828 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.828 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.828 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T03:54:04.828 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T03:54:04.828 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.828 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.829 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.829 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.829 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.829 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.829 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.829 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.829 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.829 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.829 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.829 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.829 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T03:54:04.829 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T03:54:04.829 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.829 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.830 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.830 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.830 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.830 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.830 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.830 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.830 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.830 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.830 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.830 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.830 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T03:54:04.831 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T03:54:04.831 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.831 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.831 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.831 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.831 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.831 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.831 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.831 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.831 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.831 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.831 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.831 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.831 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T03:54:04.831 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T03:54:04.832 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.832 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.832 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.832 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.832 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.832 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.832 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.832 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.832 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.832 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.832 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.832 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.832 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T03:54:04.832 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T03:54:04.833 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.833 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.833 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.833 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T03:54:04.833 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.833 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.833 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.833 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.833 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.833 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.833 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.834 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.834 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T03:54:04.834 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T03:54:04.834 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.834 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.834 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.834 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:04.834 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.834 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.834 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.834 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.834 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.834 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.835 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.835 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.835 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T03:54:04.835 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T03:54:04.835 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.835 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.835 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.835 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8", 2024-09-21T03:54:04.835 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.835 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.835 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.835 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.836 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.836 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.836 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.836 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.836 INFO:teuthology.orchestra.run.smithi084.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T03:54:04.836 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T03:54:04.836 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.836 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.836 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.836 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "45", 2024-09-21T03:54:04.836 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.836 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.837 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.837 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.837 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.837 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.837 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.837 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.837 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T03:54:04.837 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T03:54:04.837 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.837 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.837 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.837 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.838 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.838 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.838 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.838 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.838 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.838 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.838 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.838 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.838 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T03:54:04.838 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T03:54:04.838 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.838 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.838 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.838 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T03:54:04.839 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.839 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.839 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.839 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.839 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.839 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.839 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.839 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.839 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T03:54:04.839 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T03:54:04.839 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.839 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.839 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.840 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.840 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.840 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.840 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.840 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.840 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.840 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.840 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.840 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.840 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T03:54:04.840 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T03:54:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.841 INFO:teuthology.orchestra.run.smithi084.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T03:54:04.842 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T03:54:04.842 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.842 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.842 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.842 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.842 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.842 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.842 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.842 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.842 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.843 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.843 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.843 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.843 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T03:54:04.843 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T03:54:04.843 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.843 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.843 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.843 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.843 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.843 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.844 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.844 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.844 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.844 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.844 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.844 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.844 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T03:54:04.844 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T03:54:04.844 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.844 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.844 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.844 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:04.845 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.845 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.845 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.845 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.845 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.845 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.845 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.845 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.845 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T03:54:04.845 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T03:54:04.845 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.846 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.846 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.846 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T03:54:04.846 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.846 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.846 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.846 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.846 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.846 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.846 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.846 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.847 INFO:teuthology.orchestra.run.smithi084.stdout: "cross_origin_url": { 2024-09-21T03:54:04.847 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cross_origin_url", 2024-09-21T03:54:04.847 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.847 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.847 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.847 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.847 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.848 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.848 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.848 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.848 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.848 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.848 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.848 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.848 INFO:teuthology.orchestra.run.smithi084.stdout: "crt_file": { 2024-09-21T03:54:04.848 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crt_file", 2024-09-21T03:54:04.848 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.848 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.848 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.849 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.849 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.849 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.849 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.849 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.849 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.849 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.849 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.849 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.849 INFO:teuthology.orchestra.run.smithi084.stdout: "debug": { 2024-09-21T03:54:04.849 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "debug", 2024-09-21T03:54:04.849 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.849 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.850 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.850 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.850 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.850 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.850 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.850 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable/disable debug options", 2024-09-21T03:54:04.850 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.850 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.850 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.850 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.850 INFO:teuthology.orchestra.run.smithi084.stdout: "jwt_token_ttl": { 2024-09-21T03:54:04.850 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "jwt_token_ttl", 2024-09-21T03:54:04.850 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.850 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.851 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.851 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "28800", 2024-09-21T03:54:04.851 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.851 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.851 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.851 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.851 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.851 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.851 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.851 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.851 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2024-09-21T03:54:04.851 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2024-09-21T03:54:04.851 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.851 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.852 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.852 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.852 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.852 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.852 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.852 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.852 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.852 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.852 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.852 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.852 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.852 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.853 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.853 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.853 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.853 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.853 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.853 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.853 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.853 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.853 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.853 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.854 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.854 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.854 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.854 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.854 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.854 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.854 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.854 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.854 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.854 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.854 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.854 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.855 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.855 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.855 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.855 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.855 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.855 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.855 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.855 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.855 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.855 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.855 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.855 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.855 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.856 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.856 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.856 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.856 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.856 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.856 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.856 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.856 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.856 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.856 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.856 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.856 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.856 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.856 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.856 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.857 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.857 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.857 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.857 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.857 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.857 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.857 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.857 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.857 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.857 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.857 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.857 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.857 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.857 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.858 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.858 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.858 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.858 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.858 INFO:teuthology.orchestra.run.smithi084.stdout: "motd": { 2024-09-21T03:54:04.858 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "motd", 2024-09-21T03:54:04.858 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.858 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.858 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.858 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.858 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.858 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.858 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.858 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "The message of the day", 2024-09-21T03:54:04.859 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.859 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.859 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.859 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.859 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect_resolve_ip_addr": { 2024-09-21T03:54:04.859 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T03:54:04.859 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.859 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.859 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.859 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.859 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.859 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.859 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.859 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.859 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.860 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.860 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.860 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.860 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T03:54:04.860 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T03:54:04.860 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.860 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.860 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.860 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2024-09-21T03:54:04.860 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.860 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.860 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.860 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.860 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.861 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.861 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.861 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.861 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T03:54:04.861 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T03:54:04.861 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.861 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.861 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.861 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8080", 2024-09-21T03:54:04.861 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.861 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.861 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.861 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.861 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.862 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.862 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.862 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.862 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.862 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.862 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.862 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.862 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.862 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.862 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.862 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.862 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.862 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.862 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.863 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.863 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.863 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.863 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2024-09-21T03:54:04.863 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2024-09-21T03:54:04.863 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.863 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.863 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.863 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.863 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.863 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.863 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.863 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.863 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.864 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.864 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.864 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.864 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl_server_port": { 2024-09-21T03:54:04.864 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl_server_port", 2024-09-21T03:54:04.864 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.864 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.864 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.864 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8443", 2024-09-21T03:54:04.864 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.864 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.864 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.864 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.864 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.864 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.865 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.865 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.865 INFO:teuthology.orchestra.run.smithi084.stdout: "sso_oauth2": { 2024-09-21T03:54:04.865 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sso_oauth2", 2024-09-21T03:54:04.865 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.865 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.865 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.865 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.865 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.865 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.866 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.866 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.866 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.866 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.866 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.866 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.866 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2024-09-21T03:54:04.866 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2024-09-21T03:54:04.866 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.866 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.867 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.867 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "redirect", 2024-09-21T03:54:04.867 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.867 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.867 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.867 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.867 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect" 2024-09-21T03:54:04.867 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.867 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.868 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.868 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.868 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.868 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.868 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2024-09-21T03:54:04.868 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2024-09-21T03:54:04.868 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.868 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.868 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.868 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T03:54:04.868 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2024-09-21T03:54:04.868 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2024-09-21T03:54:04.868 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.869 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.869 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.869 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.869 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.869 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.869 INFO:teuthology.orchestra.run.smithi084.stdout: "url_prefix": { 2024-09-21T03:54:04.869 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url_prefix", 2024-09-21T03:54:04.870 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.870 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.870 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.870 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.870 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.870 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.870 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.870 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.870 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.870 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.870 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.870 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.870 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.870 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.871 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.871 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "devicehealth", 2024-09-21T03:54:04.871 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.871 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.871 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.872 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_monitoring": { 2024-09-21T03:54:04.872 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_monitoring", 2024-09-21T03:54:04.872 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.872 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.872 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.872 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.872 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.872 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.872 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.872 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "monitor device health metrics", 2024-09-21T03:54:04.872 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.872 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.872 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.872 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.873 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.873 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.873 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.873 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.873 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.873 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.873 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.873 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.873 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.873 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.873 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.873 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.873 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.873 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.874 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.874 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.874 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.874 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.874 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.874 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.874 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.874 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.874 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.874 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.874 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.874 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.874 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.874 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.875 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.875 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.875 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.875 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.875 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.875 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.875 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.876 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.876 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.876 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.876 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.876 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.876 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.876 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.876 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.876 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.877 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.877 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.877 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.877 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.877 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.877 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.877 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.877 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.877 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.877 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.878 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.878 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.878 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.878 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.878 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.878 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.878 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.879 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.879 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.879 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.879 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.879 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.879 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.880 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.880 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.880 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.880 INFO:teuthology.orchestra.run.smithi084.stdout: "mark_out_threshold": { 2024-09-21T03:54:04.881 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mark_out_threshold", 2024-09-21T03:54:04.881 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.881 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.881 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.881 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2419200", 2024-09-21T03:54:04.881 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.881 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.881 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.881 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T03:54:04.881 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.882 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.882 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.882 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.882 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_name": { 2024-09-21T03:54:04.882 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_name", 2024-09-21T03:54:04.882 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.882 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.882 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.882 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "device_health_metrics", 2024-09-21T03:54:04.882 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.882 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.882 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.882 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T03:54:04.882 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.882 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.883 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.883 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.883 INFO:teuthology.orchestra.run.smithi084.stdout: "retention_period": { 2024-09-21T03:54:04.883 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retention_period", 2024-09-21T03:54:04.883 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.883 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.883 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.883 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15552000", 2024-09-21T03:54:04.883 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.883 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.883 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.883 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain device health metrics", 2024-09-21T03:54:04.883 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.883 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.884 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.884 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.884 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_frequency": { 2024-09-21T03:54:04.884 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_frequency", 2024-09-21T03:54:04.884 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.884 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.884 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.884 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2024-09-21T03:54:04.884 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.884 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.884 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.884 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T03:54:04.884 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.884 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.885 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.885 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.885 INFO:teuthology.orchestra.run.smithi084.stdout: "self_heal": { 2024-09-21T03:54:04.885 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "self_heal", 2024-09-21T03:54:04.885 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.885 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.885 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.885 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:04.885 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.885 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.885 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.885 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T03:54:04.885 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.885 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.886 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.886 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.886 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T03:54:04.886 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T03:54:04.886 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.886 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.886 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.886 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T03:54:04.886 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.886 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.886 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.886 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T03:54:04.886 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.886 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.887 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.887 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.887 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.887 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.887 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.887 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.887 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.887 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.887 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.887 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.887 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.887 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.887 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.887 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.888 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.888 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.888 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_threshold": { 2024-09-21T03:54:04.888 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_threshold", 2024-09-21T03:54:04.888 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.888 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.888 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.888 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7257600", 2024-09-21T03:54:04.888 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.888 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.888 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.888 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T03:54:04.888 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.888 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.889 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.889 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.889 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.889 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.889 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.889 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "diskprediction_local", 2024-09-21T03:54:04.889 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.889 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.889 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.889 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.889 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.889 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.889 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.889 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.889 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.890 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.890 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.890 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.890 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.890 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.890 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.890 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.890 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.890 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.890 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.890 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.890 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.890 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.890 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.890 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.891 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.891 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.891 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.891 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.891 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.891 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.891 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.891 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.891 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.891 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.891 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.891 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.891 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.891 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.892 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.892 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.892 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.892 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.892 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.892 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.892 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.892 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.892 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.892 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.892 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.892 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.892 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.892 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.892 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.892 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.893 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.893 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.893 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.893 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.893 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.893 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.893 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.893 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.893 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.893 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.893 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.893 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.893 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.893 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.894 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.894 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.894 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.894 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.894 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.894 INFO:teuthology.orchestra.run.smithi084.stdout: "predict_interval": { 2024-09-21T03:54:04.894 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predict_interval", 2024-09-21T03:54:04.894 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.894 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.894 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.894 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2024-09-21T03:54:04.894 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.894 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.894 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.894 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.895 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.895 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.895 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.895 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.895 INFO:teuthology.orchestra.run.smithi084.stdout: "predictor_model": { 2024-09-21T03:54:04.895 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predictor_model", 2024-09-21T03:54:04.895 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.895 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.895 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.895 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "prophetstor", 2024-09-21T03:54:04.895 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.895 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.895 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.895 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.896 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.896 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.896 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.896 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.896 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T03:54:04.896 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T03:54:04.896 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.896 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.896 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.896 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T03:54:04.896 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.896 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.896 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.896 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.896 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.897 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.897 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.897 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.897 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.897 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.897 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.897 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.897 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.897 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.897 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.897 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.897 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.897 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.897 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.897 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.897 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.897 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.898 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.898 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.898 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.898 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "influx", 2024-09-21T03:54:04.898 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": false, 2024-09-21T03:54:04.898 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "influxdb python module not found", 2024-09-21T03:54:04.898 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.898 INFO:teuthology.orchestra.run.smithi084.stdout: "batch_size": { 2024-09-21T03:54:04.898 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "batch_size", 2024-09-21T03:54:04.898 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.898 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.898 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.898 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5000", 2024-09-21T03:54:04.898 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.898 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.899 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.899 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T03:54:04.899 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.899 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.899 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.899 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.899 INFO:teuthology.orchestra.run.smithi084.stdout: "database": { 2024-09-21T03:54:04.899 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "database", 2024-09-21T03:54:04.899 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.899 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.899 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.900 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "ceph", 2024-09-21T03:54:04.900 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.900 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.900 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.900 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T03:54:04.900 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.900 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.900 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.901 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.901 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": { 2024-09-21T03:54:04.901 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "hostname", 2024-09-21T03:54:04.901 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.901 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.901 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.901 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.901 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.901 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.901 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.901 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server hostname", 2024-09-21T03:54:04.901 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.901 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.902 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.902 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.902 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T03:54:04.902 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T03:54:04.902 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:04.902 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.902 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.902 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "30", 2024-09-21T03:54:04.902 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "5", 2024-09-21T03:54:04.902 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.903 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.903 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T03:54:04.903 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.903 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.903 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.903 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.903 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.903 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.903 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.903 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.903 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.904 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.904 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.904 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.904 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.904 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.904 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.904 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.904 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.904 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.904 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.904 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.905 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.905 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.905 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.905 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.905 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.905 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.905 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.905 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.905 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.905 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.905 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.906 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.906 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.906 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.906 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.906 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.906 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.906 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.906 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.906 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.906 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.906 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.907 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.907 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.907 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.907 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.907 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.907 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.907 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.907 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.907 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.907 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.908 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.908 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.908 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.908 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.908 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.908 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.908 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.908 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.908 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.908 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.909 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.909 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.909 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.909 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.909 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.909 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.909 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.909 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.909 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.909 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.909 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.909 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.910 INFO:teuthology.orchestra.run.smithi084.stdout: "password": { 2024-09-21T03:54:04.910 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "password", 2024-09-21T03:54:04.910 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.910 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.910 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.910 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.910 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.910 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "password of InfluxDB server user", 2024-09-21T03:54:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: "port": { 2024-09-21T03:54:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "port", 2024-09-21T03:54:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.911 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8086", 2024-09-21T03:54:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server port", 2024-09-21T03:54:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.912 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2024-09-21T03:54:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2024-09-21T03:54:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "false", 2024-09-21T03:54:04.913 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T03:54:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: "threads": { 2024-09-21T03:54:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threads", 2024-09-21T03:54:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T03:54:04.914 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T03:54:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "32", 2024-09-21T03:54:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T03:54:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: "username": { 2024-09-21T03:54:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "username", 2024-09-21T03:54:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.915 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "username of InfluxDB server user", 2024-09-21T03:54:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: "verify_ssl": { 2024-09-21T03:54:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "verify_ssl", 2024-09-21T03:54:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.916 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "true", 2024-09-21T03:54:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T03:54:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "insights", 2024-09-21T03:54:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.917 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.918 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.919 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.920 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.921 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.922 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.922 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.922 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.922 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.922 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.922 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.922 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.922 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.922 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.922 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.922 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.922 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.922 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.922 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.922 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.923 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.923 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.923 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.923 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.923 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.923 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.923 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.923 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.923 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.923 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.923 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.923 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "iostat", 2024-09-21T03:54:04.923 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.923 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.924 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.924 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.924 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.924 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.924 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.924 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.924 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.924 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.924 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.924 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.924 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.924 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.924 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.924 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.924 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.925 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.925 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.925 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.925 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.925 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.925 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.925 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.925 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.925 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.925 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.925 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.925 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.925 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.925 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.925 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.926 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.926 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.926 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.926 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.926 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.926 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.926 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.926 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.926 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.926 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.926 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.926 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.926 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.927 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.927 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.927 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.927 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.927 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.927 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.927 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.927 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.927 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.927 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.927 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.927 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.927 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.927 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.928 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.928 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.928 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.928 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.928 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.928 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.928 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.928 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.928 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.928 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.928 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.928 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.928 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.928 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.928 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.929 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.929 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.929 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.929 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.929 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.929 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.929 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.929 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.929 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.929 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.930 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.930 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.930 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.930 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.930 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.930 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.930 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "k8sevents", 2024-09-21T03:54:04.930 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.930 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.930 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.930 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_event_retention_days": { 2024-09-21T03:54:04.931 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ceph_event_retention_days", 2024-09-21T03:54:04.931 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.931 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.931 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.931 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7", 2024-09-21T03:54:04.931 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.931 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.931 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.931 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T03:54:04.931 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.931 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.931 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.932 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.932 INFO:teuthology.orchestra.run.smithi084.stdout: "config_check_secs": { 2024-09-21T03:54:04.932 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_check_secs", 2024-09-21T03:54:04.932 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.932 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.932 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.932 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:04.932 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "10", 2024-09-21T03:54:04.932 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.932 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.932 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T03:54:04.933 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.933 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.933 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.933 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.933 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.933 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.933 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.933 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.933 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.933 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.934 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.934 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.934 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.934 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.934 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.934 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.934 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.934 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.934 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.934 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.934 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.934 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.935 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.935 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.935 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.935 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.935 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.935 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.935 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.935 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.936 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.936 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.936 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.936 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.936 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.936 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.936 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.936 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.936 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.936 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.936 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.937 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.937 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.937 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.937 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.937 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.937 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.937 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.937 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.937 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.937 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.938 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.938 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.938 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.938 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.938 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.938 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.938 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.938 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.938 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.938 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.938 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.938 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.938 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.938 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.939 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.939 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.939 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.939 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.939 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.939 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.939 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.939 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.939 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.939 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.939 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.939 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.939 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.939 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.939 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.939 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.940 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.940 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.940 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.940 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.940 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.940 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.940 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.940 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.941 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.941 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.941 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "localpool", 2024-09-21T03:54:04.941 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.941 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.941 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.941 INFO:teuthology.orchestra.run.smithi084.stdout: "failure_domain": { 2024-09-21T03:54:04.941 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "failure_domain", 2024-09-21T03:54:04.941 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.941 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.942 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.942 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "host", 2024-09-21T03:54:04.942 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.942 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.942 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.942 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "failure domain for any created local pool", 2024-09-21T03:54:04.943 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T03:54:04.943 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.943 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.943 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.943 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.943 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.943 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.943 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.944 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.944 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.944 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.944 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.944 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.944 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.944 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.944 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.944 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.944 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.944 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.944 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.944 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.945 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.945 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.945 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.945 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.945 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.945 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.945 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.945 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.945 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.945 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.945 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.945 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.945 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.945 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.946 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.946 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.946 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.946 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.946 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.946 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.946 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.946 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.946 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.946 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.946 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.946 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.946 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.946 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.947 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.947 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.947 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.947 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.947 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.947 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.947 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.947 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.947 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.947 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.947 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.947 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.947 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.947 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.947 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.948 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.948 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.948 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.948 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.948 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.948 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.948 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.948 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.948 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.948 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.948 INFO:teuthology.orchestra.run.smithi084.stdout: "min_size": { 2024-09-21T03:54:04.948 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_size", 2024-09-21T03:54:04.948 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.948 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.948 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.948 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.948 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.949 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.949 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.949 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default min_size for any created local pool", 2024-09-21T03:54:04.949 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T03:54:04.949 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.949 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.949 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.949 INFO:teuthology.orchestra.run.smithi084.stdout: "num_rep": { 2024-09-21T03:54:04.949 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "num_rep", 2024-09-21T03:54:04.949 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.949 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.949 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.949 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3", 2024-09-21T03:54:04.949 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.949 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.949 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.950 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default replica count for any created local pool", 2024-09-21T03:54:04.950 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.950 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.950 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.950 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.950 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_num": { 2024-09-21T03:54:04.950 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_num", 2024-09-21T03:54:04.950 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.950 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.950 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.950 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "128", 2024-09-21T03:54:04.950 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.950 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.950 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.951 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T03:54:04.951 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.951 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.951 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.951 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.951 INFO:teuthology.orchestra.run.smithi084.stdout: "prefix": { 2024-09-21T03:54:04.951 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prefix", 2024-09-21T03:54:04.951 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.951 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.951 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.951 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.951 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.951 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.951 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.952 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name prefix for any created local pool", 2024-09-21T03:54:04.952 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.952 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.952 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.952 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.952 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.952 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.952 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.952 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.952 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.952 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.952 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.952 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.952 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.952 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.953 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.953 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.953 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.953 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.953 INFO:teuthology.orchestra.run.smithi084.stdout: "subtree": { 2024-09-21T03:54:04.953 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "subtree", 2024-09-21T03:54:04.953 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.953 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.953 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.953 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "rack", 2024-09-21T03:54:04.953 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.953 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.953 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.953 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T03:54:04.953 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T03:54:04.954 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.954 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.954 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.954 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.954 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.954 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.954 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mds_autoscaler", 2024-09-21T03:54:04.954 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.954 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.954 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.954 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.954 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.954 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.954 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.954 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.955 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.955 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.955 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.955 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.955 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.955 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.955 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.955 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.955 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.955 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.955 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.955 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.955 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.955 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.956 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.956 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.956 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.956 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.956 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.956 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.956 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.956 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.956 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.956 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.956 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.956 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.956 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.956 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.956 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.957 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.957 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.957 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.957 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.957 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.957 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.957 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.957 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.957 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.957 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.957 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.957 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.957 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.957 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.957 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.957 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.958 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.958 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.958 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.958 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.958 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.958 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.958 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.958 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.958 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.958 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.958 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.958 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.958 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.958 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.958 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.959 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.959 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.959 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.959 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.959 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.959 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.959 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.959 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.959 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.959 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.959 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.960 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.960 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.960 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.960 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.960 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.960 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.960 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.960 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.960 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.960 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.960 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.960 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirroring", 2024-09-21T03:54:04.960 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.960 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.960 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.961 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.961 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.961 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.961 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.961 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.961 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.961 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.961 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.961 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.961 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.961 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.961 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.961 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.961 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.962 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.962 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.962 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.962 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.962 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.962 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.962 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.962 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.962 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.962 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.962 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.963 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.963 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.963 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.963 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.963 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.963 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.963 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.963 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.963 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.963 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.963 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.963 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.964 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.964 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.964 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.964 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.964 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.964 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.964 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.964 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.964 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.964 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.964 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.964 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.965 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.965 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.965 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.965 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.965 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.965 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.965 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.965 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.965 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.965 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.965 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.965 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.965 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.966 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.966 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.966 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.966 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.966 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.966 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.966 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.966 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.966 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.966 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.966 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.966 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.967 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.967 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.967 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.967 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.967 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.967 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.967 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.967 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.967 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.967 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.967 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.967 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.968 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.968 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "nfs", 2024-09-21T03:54:04.968 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.968 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.968 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.968 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.968 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.968 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.968 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.968 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.969 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.969 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.969 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.969 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.969 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.969 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.969 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.969 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.969 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.969 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.969 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.970 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.970 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.970 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.970 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.970 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.970 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.970 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.970 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.970 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.970 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.970 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.970 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.971 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.971 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.971 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.971 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.971 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.971 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.971 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.971 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.971 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.972 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.972 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.972 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.972 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.972 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.972 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.972 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.972 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.972 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.973 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.973 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.973 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.973 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.973 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.973 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.973 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.973 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.973 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.973 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.974 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.974 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.974 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.974 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.974 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.974 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.974 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.974 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.974 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.974 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.975 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.975 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.975 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.975 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.975 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.975 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.975 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.975 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.975 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.975 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.975 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.975 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.975 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.976 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.976 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.976 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.976 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.976 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.976 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.976 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.976 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.976 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2024-09-21T03:54:04.976 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.976 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.976 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.977 INFO:teuthology.orchestra.run.smithi084.stdout: "fail_fs": { 2024-09-21T03:54:04.977 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "fail_fs", 2024-09-21T03:54:04.977 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.977 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.977 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:04.977 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.977 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.977 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.977 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.977 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T03:54:04.977 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.977 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.977 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.978 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.978 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.978 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.978 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.978 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.978 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.978 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.978 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.978 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.978 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.978 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.978 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.979 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.979 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.979 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.979 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.979 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.979 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.979 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.979 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.979 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.979 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.979 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.979 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.979 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.979 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.980 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.980 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.980 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.980 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.980 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.980 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.980 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.980 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.980 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.980 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.980 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.980 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.980 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.980 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.981 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.981 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.981 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.981 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.981 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.981 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.981 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.981 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.981 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.981 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.981 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.981 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.981 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.981 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.981 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.982 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.982 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.982 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.982 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.982 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.982 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.982 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.982 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.982 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.982 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.982 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.982 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.982 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.982 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.982 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.983 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.983 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator": { 2024-09-21T03:54:04.983 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2024-09-21T03:54:04.983 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.983 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.983 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.983 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.983 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.983 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.983 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.983 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm", 2024-09-21T03:54:04.983 INFO:teuthology.orchestra.run.smithi084.stdout: "rook", 2024-09-21T03:54:04.983 INFO:teuthology.orchestra.run.smithi084.stdout: "test_orchestrator" 2024-09-21T03:54:04.983 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.984 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Orchestrator backend", 2024-09-21T03:54:04.984 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.984 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.984 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.984 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.984 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.984 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.984 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.984 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.984 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.984 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.984 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.984 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.984 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.984 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.985 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.985 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.985 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.985 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.985 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.985 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.985 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.985 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_perf_query", 2024-09-21T03:54:04.985 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.985 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.985 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.985 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.985 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.985 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.986 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.986 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.986 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.986 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.986 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.986 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.986 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.986 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.986 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.986 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.986 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.986 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.986 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.987 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.987 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.987 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.987 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.987 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.987 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.987 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.987 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.987 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.987 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.987 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.987 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.987 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.987 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.988 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.988 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.988 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.988 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.988 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.988 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.988 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.988 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.988 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.988 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.988 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.988 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.988 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.988 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.989 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.989 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.989 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.989 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.989 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.989 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.989 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.989 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.989 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.989 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.989 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.989 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.989 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.989 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.990 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.990 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.990 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.990 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.990 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.990 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.990 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.990 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.990 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.990 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.990 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.990 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.990 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.990 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.991 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.991 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.991 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.991 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.991 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.991 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.991 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.991 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.991 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.991 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.991 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.991 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.991 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.991 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.992 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.992 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_support", 2024-09-21T03:54:04.992 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:04.992 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:04.992 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:04.992 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:04.992 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:04.992 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.992 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.992 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.992 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:04.992 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.992 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.993 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.993 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.993 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.993 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.993 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.993 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.993 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.993 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.993 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.993 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.994 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.994 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.994 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.994 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:04.994 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:04.994 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.994 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.994 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.994 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.994 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.994 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.994 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.994 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.995 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.995 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.995 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.995 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.995 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:04.995 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:04.995 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:04.995 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.996 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.996 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:04.996 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.996 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.996 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:04.996 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:04.996 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:04.996 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:04.996 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:04.996 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:04.996 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:04.996 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:04.996 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.996 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.996 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.997 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.997 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.997 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:04.997 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:04.997 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:04.997 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:04.997 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.997 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:04.997 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.997 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.998 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.998 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.998 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.998 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.998 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.998 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.998 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:04.998 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:04.998 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:04.998 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:04.998 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:04.998 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:04.998 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:04.999 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:04.999 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:04.999 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:04.999 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:04.999 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:04.999 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:04.999 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.999 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:04.999 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:04.999 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:04.999 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_autoscaler", 2024-09-21T03:54:05.000 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.000 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.000 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.000 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.000 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.000 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.000 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.000 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.000 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.000 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.000 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.001 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.001 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.001 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.001 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.001 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.001 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.001 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.001 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.001 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.001 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.001 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.001 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.001 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.002 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.002 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.002 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.002 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.002 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.002 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.002 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.002 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.002 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.002 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.002 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.003 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.003 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.003 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.003 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.003 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.003 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.003 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.003 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.003 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.003 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.003 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.003 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.003 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.003 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.003 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.004 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.004 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.004 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.004 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.004 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.004 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.004 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.004 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.004 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.004 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.004 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.004 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.005 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.005 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.005 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.005 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.005 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.005 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.005 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.005 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.005 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.006 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.006 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.006 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T03:54:05.006 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T03:54:05.006 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.006 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.006 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.006 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T03:54:05.006 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.006 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.007 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.007 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.007 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.007 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.007 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.007 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.007 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.007 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.007 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.007 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.007 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.007 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.007 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.007 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.008 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.008 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.008 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.008 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.008 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.008 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.008 INFO:teuthology.orchestra.run.smithi084.stdout: "threshold": { 2024-09-21T03:54:05.008 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threshold", 2024-09-21T03:54:05.008 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:05.008 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.008 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.008 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2024-09-21T03:54:05.008 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1.0", 2024-09-21T03:54:05.008 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.009 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.009 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "scaling threshold", 2024-09-21T03:54:05.009 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T03:54:05.009 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.009 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.009 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.009 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.009 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.009 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.009 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "progress", 2024-09-21T03:54:05.009 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.009 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.010 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.010 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_pg_recovery_event": { 2024-09-21T03:54:05.010 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_pg_recovery_event", 2024-09-21T03:54:05.010 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.010 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.010 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.010 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.010 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.010 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.010 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.010 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T03:54:05.010 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.010 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.010 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.010 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.011 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2024-09-21T03:54:05.011 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2024-09-21T03:54:05.011 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.011 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.011 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.011 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.011 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.011 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.011 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.011 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.011 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.011 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.011 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.012 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.012 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.012 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.012 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.012 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.012 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.012 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.012 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.012 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.012 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.012 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.012 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.012 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.013 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.014 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.014 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.014 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.014 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.014 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.014 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.014 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.014 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.014 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.014 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.014 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.014 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.014 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.015 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.015 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.015 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.015 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.015 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.015 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.015 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.015 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.015 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.015 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.015 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.015 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.016 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.016 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.016 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.016 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.016 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.016 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.016 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.016 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.016 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.016 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.016 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.016 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.016 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.017 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.017 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.017 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.017 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.017 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.017 INFO:teuthology.orchestra.run.smithi084.stdout: "max_completed_events": { 2024-09-21T03:54:05.017 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_completed_events", 2024-09-21T03:54:05.017 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.017 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.017 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.017 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "50", 2024-09-21T03:54:05.017 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.017 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.017 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.017 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "number of past completed events to remember", 2024-09-21T03:54:05.018 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.018 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.018 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.018 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.018 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T03:54:05.018 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T03:54:05.018 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.018 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.018 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.018 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T03:54:05.018 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.018 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.018 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.019 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long the module is going to sleep", 2024-09-21T03:54:05.019 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.019 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.019 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.019 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.019 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.019 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.019 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.019 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.019 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.019 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.019 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.019 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.019 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.019 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.020 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.020 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.020 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.020 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.020 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.020 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.020 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.020 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus", 2024-09-21T03:54:05.020 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.020 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.020 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.020 INFO:teuthology.orchestra.run.smithi084.stdout: "cache": { 2024-09-21T03:54:05.020 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cache", 2024-09-21T03:54:05.021 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.021 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.021 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.021 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.021 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.021 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.021 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.021 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.021 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.021 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.021 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.021 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.021 INFO:teuthology.orchestra.run.smithi084.stdout: "exclude_perf_counters": { 2024-09-21T03:54:05.021 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "exclude_perf_counters", 2024-09-21T03:54:05.022 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.022 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.022 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.022 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.022 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.022 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.022 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.022 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T03:54:05.022 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T03:54:05.022 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.022 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.022 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.022 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.022 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.023 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.023 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.023 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.023 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.023 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.023 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.023 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.023 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.023 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.023 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.023 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.023 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.023 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.023 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.024 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.024 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.024 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.024 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.024 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.024 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.024 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.024 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.024 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.024 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.024 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.024 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.024 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.024 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.024 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.025 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.025 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.025 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.025 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.025 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.025 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.025 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.025 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.026 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.026 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.026 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.026 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.026 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.026 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.026 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.026 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.026 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.026 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.026 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.026 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.027 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.027 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.027 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.027 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.027 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.027 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.027 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.027 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.027 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.027 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.027 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.027 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.028 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.028 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.028 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.028 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.028 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.028 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.028 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.028 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools": { 2024-09-21T03:54:05.028 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools", 2024-09-21T03:54:05.028 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.028 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.028 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.028 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.028 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.028 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.029 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.029 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.029 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.029 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.029 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.029 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.029 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T03:54:05.029 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T03:54:05.029 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.029 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.029 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.030 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "300", 2024-09-21T03:54:05.030 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.030 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.030 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.030 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.030 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.030 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.030 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.030 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.030 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_interval": { 2024-09-21T03:54:05.030 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_interval", 2024-09-21T03:54:05.030 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:05.030 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.030 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.031 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15.0", 2024-09-21T03:54:05.031 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.031 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.031 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.031 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.031 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.031 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.031 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.031 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.031 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T03:54:05.031 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T03:54:05.032 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.032 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.032 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.032 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2024-09-21T03:54:05.032 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.032 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.032 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.032 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T03:54:05.032 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.032 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.032 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.032 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.032 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T03:54:05.033 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T03:54:05.033 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.033 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.033 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.033 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "9283", 2024-09-21T03:54:05.033 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.033 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.033 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.033 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T03:54:05.033 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.033 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.033 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.033 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.034 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.034 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.034 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.034 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.034 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.034 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.034 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.034 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.034 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.034 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.034 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.035 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.035 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.035 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.035 INFO:teuthology.orchestra.run.smithi084.stdout: "stale_cache_strategy": { 2024-09-21T03:54:05.035 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stale_cache_strategy", 2024-09-21T03:54:05.035 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.035 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.035 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.035 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "log", 2024-09-21T03:54:05.035 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.036 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.036 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.036 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.036 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.036 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.036 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.036 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.036 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2024-09-21T03:54:05.036 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2024-09-21T03:54:05.036 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.037 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.037 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.037 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "default", 2024-09-21T03:54:05.037 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.037 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.037 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.037 INFO:teuthology.orchestra.run.smithi084.stdout: "default", 2024-09-21T03:54:05.037 INFO:teuthology.orchestra.run.smithi084.stdout: "error" 2024-09-21T03:54:05.037 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.037 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.037 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.037 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.038 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.038 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.038 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2024-09-21T03:54:05.038 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2024-09-21T03:54:05.038 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.038 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.038 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.038 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T03:54:05.038 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2024-09-21T03:54:05.038 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2024-09-21T03:54:05.038 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.038 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.038 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.038 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.039 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.039 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.039 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.039 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.039 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.039 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_support", 2024-09-21T03:54:05.039 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.039 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.039 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.039 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.039 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.039 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.039 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.039 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.039 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.040 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.040 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.040 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.040 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.040 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.040 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.040 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.040 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.040 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.040 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.040 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.040 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.040 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.040 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.041 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.041 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.041 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.041 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.041 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.041 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.041 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.041 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.041 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.041 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.041 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.041 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.041 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.041 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.041 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.042 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.042 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.042 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.042 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.042 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.042 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.042 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.042 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.042 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.042 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.042 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.042 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.042 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.042 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.042 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.043 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.043 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.043 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.043 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.043 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.043 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.043 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.043 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.043 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.043 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.043 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.043 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.043 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.043 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.044 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.044 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.044 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.044 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.044 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.044 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.044 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_snap_create": { 2024-09-21T03:54:05.044 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_snap_create", 2024-09-21T03:54:05.044 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.044 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.044 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.044 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:05.044 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.044 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.045 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.045 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.045 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.045 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.045 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.045 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.045 INFO:teuthology.orchestra.run.smithi084.stdout: "mirror_snapshot_schedule": { 2024-09-21T03:54:05.045 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T03:54:05.045 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.045 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.045 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.045 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.045 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.045 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.046 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.046 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.046 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.046 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.046 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.046 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.046 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.046 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.046 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.046 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.046 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.046 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.046 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.046 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.046 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.047 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.047 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.047 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.047 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.047 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.047 INFO:teuthology.orchestra.run.smithi084.stdout: "trash_purge_schedule": { 2024-09-21T03:54:05.047 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "trash_purge_schedule", 2024-09-21T03:54:05.047 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.047 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.047 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.047 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.047 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.047 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.047 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.047 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.048 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.048 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.048 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.048 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.048 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.048 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.048 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.048 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "restful", 2024-09-21T03:54:05.048 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.048 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.048 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.048 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_auth": { 2024-09-21T03:54:05.048 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_auth", 2024-09-21T03:54:05.048 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.048 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.048 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.049 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.049 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.049 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.049 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.049 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.049 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.049 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.049 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.049 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.049 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2024-09-21T03:54:05.049 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2024-09-21T03:54:05.049 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.049 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.049 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.050 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.050 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.050 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.050 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.050 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.050 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.050 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.050 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.050 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.050 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.050 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.050 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.050 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.050 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.050 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.051 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.051 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.051 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.051 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.051 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.051 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.051 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.051 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.051 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.051 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.051 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.051 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.051 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.051 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.051 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.052 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.052 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.052 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.052 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.052 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.052 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.052 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.052 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.052 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.052 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.052 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.052 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.052 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.052 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.052 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.053 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.053 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.053 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.053 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.053 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.053 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.053 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.053 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.053 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.053 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.053 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.053 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.053 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.053 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.053 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.054 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.054 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.054 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.054 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.054 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.054 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.054 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.054 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.054 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.054 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.054 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.054 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.054 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.054 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.054 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.055 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.055 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.055 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.055 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.055 INFO:teuthology.orchestra.run.smithi084.stdout: "max_requests": { 2024-09-21T03:54:05.055 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_requests", 2024-09-21T03:54:05.055 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.055 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.055 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.055 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T03:54:05.055 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.055 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.055 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.056 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T03:54:05.056 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.056 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.056 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.056 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.056 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T03:54:05.056 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T03:54:05.056 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.056 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.056 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.056 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.056 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.056 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.056 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.057 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.057 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.057 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.057 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.057 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.057 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T03:54:05.057 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T03:54:05.057 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.057 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.057 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.057 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.058 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.058 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.058 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.058 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.058 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.058 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.058 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.058 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.058 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.058 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.058 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.058 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.058 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.058 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.059 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.059 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.059 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.059 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.059 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.059 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.059 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.059 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.059 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.060 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.060 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.060 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rgw", 2024-09-21T03:54:05.060 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.060 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.060 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.060 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.060 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.060 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.060 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.060 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.060 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.060 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.060 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.060 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.061 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.061 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.061 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.061 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.061 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.061 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.061 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.061 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.061 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.061 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.062 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.062 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.062 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.062 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.062 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.062 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.062 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.062 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.062 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.062 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.062 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.062 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.062 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.063 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.063 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.063 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.063 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.063 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.063 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.063 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.063 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.063 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.064 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.064 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.064 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.064 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.064 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.064 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.064 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.064 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.064 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.064 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.064 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.064 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.065 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.065 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.065 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.065 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.065 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.065 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.065 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.065 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.065 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.065 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.065 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.065 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.066 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.066 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.066 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.066 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.066 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.066 INFO:teuthology.orchestra.run.smithi084.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T03:54:05.066 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T03:54:05.066 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.066 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.066 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.067 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T03:54:05.067 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.067 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.067 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.067 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T03:54:05.067 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.067 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.067 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.067 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.067 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.067 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.068 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.068 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.068 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.068 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.068 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.068 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.068 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.068 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.068 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.068 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.068 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.069 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.069 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.069 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.069 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.069 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rook", 2024-09-21T03:54:05.069 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.069 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.069 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.069 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.069 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.069 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.069 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.070 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.070 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.070 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.070 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.070 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.070 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.070 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.070 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.070 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.070 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.070 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.070 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.071 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.071 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.071 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.071 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.071 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.071 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.071 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.071 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.072 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.072 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.072 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.072 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.072 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.072 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.072 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.072 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.072 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.072 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.072 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.072 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.072 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.072 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.072 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.073 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.073 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.073 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.073 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.073 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.073 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.073 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.073 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.073 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.073 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.073 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.073 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.073 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.073 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.073 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.074 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.074 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.074 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.074 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.074 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.074 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.074 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.074 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.074 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.074 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.074 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.074 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.074 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.074 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.074 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.075 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.075 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.075 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.075 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.075 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.075 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.075 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.075 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.075 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.075 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.075 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.075 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.075 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.076 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.076 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.076 INFO:teuthology.orchestra.run.smithi084.stdout: "storage_class": { 2024-09-21T03:54:05.076 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "storage_class", 2024-09-21T03:54:05.076 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.076 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.076 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.076 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "local", 2024-09-21T03:54:05.076 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.076 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.076 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.076 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T03:54:05.076 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.076 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.077 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.077 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.077 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.077 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.077 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.077 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "selftest", 2024-09-21T03:54:05.077 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.077 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.077 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.077 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.077 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.077 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.077 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.077 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.078 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.078 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.078 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.078 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.078 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.078 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.078 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.078 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.078 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.078 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.078 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.078 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.078 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.078 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.079 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.079 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.079 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.079 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.079 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.079 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.079 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.079 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.079 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.079 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.079 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.079 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.079 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.079 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.080 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.080 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.080 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.080 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.080 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.080 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.080 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.080 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.080 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.080 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.080 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.080 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.081 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.081 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.081 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.081 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.081 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.081 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.081 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.081 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.081 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.081 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.081 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.081 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.081 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.081 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.081 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.082 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.082 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.082 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.082 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.082 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.082 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.082 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.082 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.082 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.082 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.082 INFO:teuthology.orchestra.run.smithi084.stdout: "roption1": { 2024-09-21T03:54:05.082 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption1", 2024-09-21T03:54:05.082 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.083 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.083 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.083 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.083 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.083 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.083 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.083 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.083 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.083 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.083 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.083 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.083 INFO:teuthology.orchestra.run.smithi084.stdout: "roption2": { 2024-09-21T03:54:05.083 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption2", 2024-09-21T03:54:05.083 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.084 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.084 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.084 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "xyz", 2024-09-21T03:54:05.084 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.084 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.084 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.084 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.084 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.084 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.084 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.084 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.084 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption1": { 2024-09-21T03:54:05.084 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption1", 2024-09-21T03:54:05.085 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.085 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.085 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.085 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.085 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.085 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.085 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.085 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.085 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.085 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.085 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.085 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.085 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption2": { 2024-09-21T03:54:05.086 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption2", 2024-09-21T03:54:05.086 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.086 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.086 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.086 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.086 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.086 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.086 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.086 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.086 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.086 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.086 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.086 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.086 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption3": { 2024-09-21T03:54:05.087 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption3", 2024-09-21T03:54:05.087 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:05.087 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.087 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.087 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.087 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.087 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.087 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.087 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.087 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.087 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.087 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.087 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.087 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption4": { 2024-09-21T03:54:05.088 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption4", 2024-09-21T03:54:05.088 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.088 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.088 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.088 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.088 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.088 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.088 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.088 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.088 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.088 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.088 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.088 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.088 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption5": { 2024-09-21T03:54:05.088 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption5", 2024-09-21T03:54:05.089 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.089 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.089 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.089 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.089 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.089 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.089 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.089 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.089 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.089 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.089 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.089 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.089 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption6": { 2024-09-21T03:54:05.090 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption6", 2024-09-21T03:54:05.090 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.090 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.090 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.090 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.090 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.090 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.090 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.090 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.090 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.090 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.091 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.091 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.091 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption7": { 2024-09-21T03:54:05.091 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption7", 2024-09-21T03:54:05.091 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.091 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.091 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.091 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.091 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T03:54:05.091 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "42", 2024-09-21T03:54:05.091 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.091 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.091 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.091 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.092 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.092 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.092 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.092 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.092 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.092 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.092 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.092 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.092 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.092 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.092 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.092 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.092 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.093 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.093 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.093 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.093 INFO:teuthology.orchestra.run.smithi084.stdout: "testkey": { 2024-09-21T03:54:05.093 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testkey", 2024-09-21T03:54:05.093 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.093 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.093 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.093 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.093 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.093 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.093 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.094 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.094 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.094 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.094 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.094 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.094 INFO:teuthology.orchestra.run.smithi084.stdout: "testlkey": { 2024-09-21T03:54:05.094 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testlkey", 2024-09-21T03:54:05.094 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.094 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.094 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.094 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.094 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.094 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.095 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.095 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.095 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.095 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.095 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.095 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.095 INFO:teuthology.orchestra.run.smithi084.stdout: "testnewline": { 2024-09-21T03:54:05.095 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testnewline", 2024-09-21T03:54:05.095 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.095 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.095 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.096 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.096 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.096 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.096 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.096 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.096 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.096 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.096 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.096 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.096 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.096 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.097 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.097 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smb", 2024-09-21T03:54:05.097 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.097 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.097 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.097 INFO:teuthology.orchestra.run.smithi084.stdout: "internal_store_backend": { 2024-09-21T03:54:05.097 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "internal_store_backend", 2024-09-21T03:54:05.097 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.097 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.097 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.097 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.097 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.097 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.098 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.098 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T03:54:05.098 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.098 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.098 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.098 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.098 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.098 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.098 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.098 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.098 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.099 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.100 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.101 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.102 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.103 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.104 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.105 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.105 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.105 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.105 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.105 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.105 INFO:teuthology.orchestra.run.smithi084.stdout: "update_orchestration": { 2024-09-21T03:54:05.105 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "update_orchestration", 2024-09-21T03:54:05.105 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.105 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.105 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.105 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.105 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.105 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.106 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.106 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T03:54:05.106 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.106 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.106 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.106 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.106 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.106 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.106 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.106 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snap_schedule", 2024-09-21T03:54:05.106 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.106 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.106 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.106 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_m_granularity": { 2024-09-21T03:54:05.107 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_m_granularity", 2024-09-21T03:54:05.107 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.107 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.107 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.107 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.107 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.107 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.107 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.107 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T03:54:05.107 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.107 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.107 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.107 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.107 INFO:teuthology.orchestra.run.smithi084.stdout: "dump_on_update": { 2024-09-21T03:54:05.107 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dump_on_update", 2024-09-21T03:54:05.108 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.108 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.108 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.108 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.108 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.108 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.108 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.108 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "dump database to debug log on update", 2024-09-21T03:54:05.108 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.108 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.108 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.108 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.108 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.108 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.109 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.109 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.109 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.109 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.109 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.109 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.109 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.109 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.109 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.109 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.109 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.109 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.109 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.109 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.109 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.109 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.110 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.110 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.110 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.110 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.110 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.110 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.110 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.110 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.110 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.110 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.110 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.110 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.110 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.110 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.110 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.111 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.111 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.111 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.111 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.111 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.111 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.111 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.111 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.111 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.111 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.111 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.111 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.111 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.111 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.111 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.112 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.112 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.112 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.112 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.112 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.112 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.112 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.112 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.112 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.112 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.112 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.112 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.112 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.112 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.112 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.113 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.113 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.113 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.113 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.113 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.113 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.113 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.113 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.113 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.113 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.113 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.113 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.113 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.113 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.113 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.114 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.114 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.114 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.114 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.114 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.114 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.114 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.114 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.114 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.114 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stats", 2024-09-21T03:54:05.114 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.114 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.114 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.114 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.115 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.115 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.115 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.115 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.115 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.115 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.115 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.115 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.115 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.115 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.115 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.115 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.115 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.115 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.116 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.116 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.116 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.116 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.116 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.116 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.116 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.116 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.116 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.116 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.116 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.116 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.116 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.116 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.116 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.117 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.117 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.117 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.117 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.117 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.117 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.117 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.117 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.117 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.117 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.117 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.117 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.117 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.117 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.118 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.118 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.118 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.118 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.118 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.118 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.118 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.118 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.118 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.118 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.118 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.118 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.118 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.118 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.118 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.119 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.119 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.119 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.119 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.119 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.119 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.119 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.119 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.119 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.119 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.119 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.119 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.119 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.119 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.119 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.120 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.120 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.120 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.120 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.120 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.120 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.120 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.120 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.120 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.120 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.120 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.120 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.120 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.120 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "status", 2024-09-21T03:54:05.121 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.121 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.121 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.121 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.121 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.121 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.121 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.121 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.121 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.121 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.121 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.121 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.121 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.122 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.122 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.122 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.122 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.122 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.122 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.122 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.122 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.122 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.122 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.122 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.122 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.122 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.123 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.123 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.123 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.123 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.123 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.123 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.123 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.123 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.123 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.123 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.123 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.123 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.123 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.124 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.124 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.124 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.124 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.124 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.124 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.124 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.124 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.124 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.125 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.125 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.125 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.125 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.125 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.125 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.125 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.125 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.125 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.125 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.125 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.125 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.126 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.126 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.126 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.126 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.126 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.126 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.126 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.126 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.126 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.126 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.127 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.127 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.127 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.127 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.127 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.127 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.127 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.127 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.127 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.127 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.127 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.128 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.128 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.128 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.128 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.128 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.128 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telegraf", 2024-09-21T03:54:05.128 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.128 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.128 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.128 INFO:teuthology.orchestra.run.smithi084.stdout: "address": { 2024-09-21T03:54:05.128 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "address", 2024-09-21T03:54:05.128 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.128 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.129 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.129 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T03:54:05.129 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.129 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.129 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.129 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.129 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.129 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.129 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.129 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.129 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T03:54:05.130 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T03:54:05.130 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.130 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.130 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.130 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15", 2024-09-21T03:54:05.130 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.130 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.130 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.130 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.130 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.130 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.131 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.131 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.131 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.131 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.131 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.131 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.131 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.131 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.131 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.131 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.131 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.131 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.131 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.132 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.132 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.132 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.132 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.132 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.132 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.132 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.132 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.132 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.133 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.133 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.133 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.133 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.133 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.133 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.133 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.133 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.133 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.134 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.134 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.134 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.134 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.134 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.134 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.134 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.134 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.134 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.134 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.134 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.134 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.134 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.134 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.135 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.135 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.135 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.135 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.135 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.135 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.135 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.135 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.135 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.135 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.135 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.135 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.135 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.135 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.136 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.136 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.136 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.136 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.136 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.136 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.136 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.136 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.136 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.136 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.136 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.136 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.136 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.136 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.136 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.137 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.137 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.137 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.137 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.137 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.137 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.137 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.137 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.137 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.137 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.137 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.137 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.137 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.137 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.138 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.138 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telemetry", 2024-09-21T03:54:05.138 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.138 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.138 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.138 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_basic": { 2024-09-21T03:54:05.138 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_basic", 2024-09-21T03:54:05.138 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.138 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.138 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.138 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.138 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.138 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.138 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.139 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T03:54:05.139 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.139 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.139 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.139 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.139 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_crash": { 2024-09-21T03:54:05.139 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_crash", 2024-09-21T03:54:05.139 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.139 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.139 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.139 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.139 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.139 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.139 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.139 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T03:54:05.140 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.140 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.140 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.140 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.140 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_device": { 2024-09-21T03:54:05.140 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_device", 2024-09-21T03:54:05.140 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.140 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.140 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.140 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.140 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.140 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.140 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.140 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T03:54:05.141 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.141 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.141 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.141 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.141 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_ident": { 2024-09-21T03:54:05.141 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_ident", 2024-09-21T03:54:05.141 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.141 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.141 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.141 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.141 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.141 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.141 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.141 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T03:54:05.141 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.142 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.142 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.142 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.142 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_perf": { 2024-09-21T03:54:05.142 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_perf", 2024-09-21T03:54:05.142 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.142 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.142 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.142 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.142 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.142 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.142 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.142 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T03:54:05.142 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.143 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.143 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.143 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.143 INFO:teuthology.orchestra.run.smithi084.stdout: "contact": { 2024-09-21T03:54:05.143 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "contact", 2024-09-21T03:54:05.143 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.143 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.143 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.143 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.143 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.143 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.143 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.143 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.143 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.144 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.144 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.144 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.144 INFO:teuthology.orchestra.run.smithi084.stdout: "description": { 2024-09-21T03:54:05.144 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "description", 2024-09-21T03:54:05.144 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.144 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.144 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.144 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.144 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.144 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.144 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.144 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.144 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.144 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.145 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.145 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.145 INFO:teuthology.orchestra.run.smithi084.stdout: "device_url": { 2024-09-21T03:54:05.145 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_url", 2024-09-21T03:54:05.145 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.145 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.145 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.145 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T03:54:05.145 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.145 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.145 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.145 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.145 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.145 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.145 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.146 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.146 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2024-09-21T03:54:05.146 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2024-09-21T03:54:05.146 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.146 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.146 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.146 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.146 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.146 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.146 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.146 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.146 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.146 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.146 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.147 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T03:54:05.147 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T03:54:05.147 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.147 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.147 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.147 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "24", 2024-09-21T03:54:05.147 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "8", 2024-09-21T03:54:05.147 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.147 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.147 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.147 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.147 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.147 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.147 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.148 INFO:teuthology.orchestra.run.smithi084.stdout: "last_opt_revision": { 2024-09-21T03:54:05.148 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "last_opt_revision", 2024-09-21T03:54:05.148 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.148 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.148 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.148 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1", 2024-09-21T03:54:05.148 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.148 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.148 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.148 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.148 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.148 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.148 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.148 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.149 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard": { 2024-09-21T03:54:05.149 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard", 2024-09-21T03:54:05.149 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.149 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.149 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.149 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.149 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.149 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.149 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.149 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.149 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.149 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.149 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.149 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.149 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard_description": { 2024-09-21T03:54:05.150 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard_description", 2024-09-21T03:54:05.150 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.150 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.150 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.150 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.150 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.150 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.150 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.150 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.150 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.150 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.150 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.150 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.150 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.151 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.151 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.151 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.151 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.151 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.151 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.151 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.151 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.151 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.151 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.151 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.151 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.151 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.151 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.152 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.152 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.152 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.152 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.152 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.152 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.152 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.152 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.152 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.152 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.152 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.152 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.152 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.152 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.153 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.153 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.153 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.153 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.153 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.153 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.153 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.153 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.153 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.153 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.153 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.153 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.153 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.153 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.154 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.154 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.154 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.154 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.154 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.154 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.154 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.154 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.154 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.154 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.154 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.154 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.154 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.154 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.155 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.155 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.155 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.155 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.155 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.155 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.155 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.155 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.155 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.155 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.155 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.155 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.155 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.155 INFO:teuthology.orchestra.run.smithi084.stdout: "organization": { 2024-09-21T03:54:05.156 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "organization", 2024-09-21T03:54:05.156 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.156 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.156 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.156 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.156 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.156 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.156 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.156 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.156 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.157 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.157 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.157 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.157 INFO:teuthology.orchestra.run.smithi084.stdout: "proxy": { 2024-09-21T03:54:05.157 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "proxy", 2024-09-21T03:54:05.157 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.157 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.157 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.157 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.157 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.157 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.157 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.157 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.157 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.157 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.158 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.158 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.158 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.158 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.158 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.158 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.158 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.158 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.158 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.158 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.159 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.159 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.159 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.159 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.159 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.159 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.159 INFO:teuthology.orchestra.run.smithi084.stdout: "url": { 2024-09-21T03:54:05.159 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url", 2024-09-21T03:54:05.159 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.159 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.159 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.159 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T03:54:05.159 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.159 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.160 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.160 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.160 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.160 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.160 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.160 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.160 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.160 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.160 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.160 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "test_orchestrator", 2024-09-21T03:54:05.161 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.161 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.161 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.161 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.161 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.161 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.161 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.161 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.161 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.161 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.161 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.161 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.161 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.161 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.162 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.162 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.162 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.162 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.162 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.162 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.162 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.162 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.162 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.162 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.163 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.163 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.163 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.163 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.163 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.163 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.163 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.163 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.163 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.163 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.163 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.163 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.164 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.164 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.164 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.164 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.164 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.164 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.164 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.164 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.164 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.164 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.164 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.164 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.164 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.165 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.165 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.165 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.165 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.165 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.165 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.165 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.165 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.165 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.165 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.166 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.166 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.166 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.166 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.166 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.166 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.166 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.166 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.166 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.166 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.166 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.167 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.167 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.167 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.167 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.167 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.167 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.167 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.167 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.167 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.168 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.168 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.168 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.168 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.168 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.168 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.168 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.168 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.168 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.168 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.168 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.168 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2024-09-21T03:54:05.168 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.169 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.169 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.169 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.169 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.169 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.169 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.169 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.169 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.169 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.169 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.169 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.169 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.169 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.169 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.169 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.170 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.170 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.170 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.170 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.170 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.170 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.170 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.170 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.170 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.170 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.170 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.170 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.170 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.170 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.171 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.171 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.171 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.171 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.171 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.171 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.171 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.171 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.171 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.171 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.171 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.171 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.171 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.171 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.172 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.172 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.172 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.172 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.172 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.172 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.172 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.172 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.172 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.172 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.172 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.172 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.172 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.172 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.172 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.173 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.173 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.173 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.173 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.173 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.173 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.173 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.173 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.173 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.173 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.173 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.173 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.173 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.173 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.174 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_clones": { 2024-09-21T03:54:05.174 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_clones", 2024-09-21T03:54:05.174 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.174 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.174 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.174 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4", 2024-09-21T03:54:05.174 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.174 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.174 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.174 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T03:54:05.174 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.174 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.174 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.174 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.174 INFO:teuthology.orchestra.run.smithi084.stdout: "periodic_async_work": { 2024-09-21T03:54:05.175 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "periodic_async_work", 2024-09-21T03:54:05.175 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.175 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.175 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.175 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.175 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.175 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.175 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.175 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Periodically check for async work", 2024-09-21T03:54:05.175 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.175 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.175 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.175 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.176 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot_clone_delay": { 2024-09-21T03:54:05.176 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snapshot_clone_delay", 2024-09-21T03:54:05.176 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.176 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.176 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.176 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.176 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.176 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.176 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.176 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T03:54:05.176 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.176 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.176 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.176 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.176 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot_clone_no_wait": { 2024-09-21T03:54:05.177 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T03:54:05.177 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.177 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.177 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.177 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.177 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.177 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.177 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.177 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T03:54:05.177 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.177 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.177 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.177 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.178 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.178 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.178 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.178 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.178 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.178 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.178 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.178 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.178 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.178 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.178 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.178 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.178 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.178 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.179 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.179 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.179 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.179 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix", 2024-09-21T03:54:05.179 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.179 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.179 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.179 INFO:teuthology.orchestra.run.smithi084.stdout: "discovery_interval": { 2024-09-21T03:54:05.179 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "discovery_interval", 2024-09-21T03:54:05.179 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T03:54:05.179 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.180 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.180 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "100", 2024-09-21T03:54:05.180 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.180 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.180 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.180 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.180 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.180 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.180 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.180 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.180 INFO:teuthology.orchestra.run.smithi084.stdout: "identifier": { 2024-09-21T03:54:05.180 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "identifier", 2024-09-21T03:54:05.180 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.181 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.181 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.181 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.181 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.181 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.181 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.181 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.181 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.181 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.181 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.181 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.181 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T03:54:05.181 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T03:54:05.181 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.182 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.182 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.182 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T03:54:05.182 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.182 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.182 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.182 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.182 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.182 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.182 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.182 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.182 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.182 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.183 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.183 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.183 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.183 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.183 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.183 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.183 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.183 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.183 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.183 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.183 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.183 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.183 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.184 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.184 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.184 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.184 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.184 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.184 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.184 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.184 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.184 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.184 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.184 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.184 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.184 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.185 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.185 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.185 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.185 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.185 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.185 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.185 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.185 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.185 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.185 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.185 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.185 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.185 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.185 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.185 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.186 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.186 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.186 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.186 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.186 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.186 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.186 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.186 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.186 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.186 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.186 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.186 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.186 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.186 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.187 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.187 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.187 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.187 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.187 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.187 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.187 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.187 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.187 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.187 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.187 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.187 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.187 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.188 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.188 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.188 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.188 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.188 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.188 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.188 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.188 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.188 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.188 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.188 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.189 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.189 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.189 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.189 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_host": { 2024-09-21T03:54:05.189 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_host", 2024-09-21T03:54:05.189 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.189 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.189 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.189 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.189 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.189 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.189 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.189 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.189 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.190 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.190 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.190 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.190 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_port": { 2024-09-21T03:54:05.190 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_port", 2024-09-21T03:54:05.190 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.190 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.190 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.190 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10051", 2024-09-21T03:54:05.190 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.191 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.191 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.191 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.191 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.191 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.191 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.191 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.191 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_sender": { 2024-09-21T03:54:05.191 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_sender", 2024-09-21T03:54:05.191 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.191 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.191 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.192 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T03:54:05.192 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.192 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.192 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.192 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.192 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.192 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.192 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.192 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.192 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.193 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.193 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T03:54:05.193 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.193 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.193 INFO:teuthology.orchestra.run.smithi084.stdout: "modules": [ 2024-09-21T03:54:05.193 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm", 2024-09-21T03:54:05.193 INFO:teuthology.orchestra.run.smithi084.stdout: "dashboard", 2024-09-21T03:54:05.193 INFO:teuthology.orchestra.run.smithi084.stdout: "iostat", 2024-09-21T03:54:05.193 INFO:teuthology.orchestra.run.smithi084.stdout: "nfs", 2024-09-21T03:54:05.193 INFO:teuthology.orchestra.run.smithi084.stdout: "restful", 2024-09-21T03:54:05.193 INFO:teuthology.orchestra.run.smithi084.stdout: "snap_schedule" 2024-09-21T03:54:05.193 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.193 INFO:teuthology.orchestra.run.smithi084.stdout: "available_modules": [ 2024-09-21T03:54:05.194 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.194 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "alerts", 2024-09-21T03:54:05.194 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.194 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.194 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.194 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T03:54:05.194 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T03:54:05.194 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.194 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.194 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.195 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T03:54:05.195 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.195 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.195 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.195 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T03:54:05.195 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.195 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.195 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.195 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.195 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.195 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.195 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.196 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.196 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.196 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.196 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.196 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.196 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.196 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.196 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.196 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.196 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.196 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.197 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.197 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.197 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.197 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.197 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.197 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.197 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.197 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.197 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.197 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.198 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.198 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.198 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.198 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.198 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.198 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.198 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.198 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.198 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.198 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.199 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.199 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.199 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.199 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.199 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.199 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.199 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.199 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.199 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.200 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.200 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.200 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.200 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.200 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.200 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.200 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.200 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.200 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.200 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.201 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.201 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.201 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.201 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.201 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.201 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.201 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.201 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.201 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.201 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.201 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.201 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.201 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.201 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.202 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.202 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.202 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.202 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_destination": { 2024-09-21T03:54:05.202 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_destination", 2024-09-21T03:54:05.202 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.202 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.202 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.202 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.202 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.202 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.202 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.202 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T03:54:05.203 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.203 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.203 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.203 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.203 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_from_name": { 2024-09-21T03:54:05.203 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_from_name", 2024-09-21T03:54:05.203 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.203 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.203 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.203 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "Ceph", 2024-09-21T03:54:05.203 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.203 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.203 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.204 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Email From: name", 2024-09-21T03:54:05.204 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.204 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.204 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.204 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.204 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_host": { 2024-09-21T03:54:05.204 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_host", 2024-09-21T03:54:05.204 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.204 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.204 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.204 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.204 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.204 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.205 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.205 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP server", 2024-09-21T03:54:05.205 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.205 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.205 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.205 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.205 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_password": { 2024-09-21T03:54:05.205 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_password", 2024-09-21T03:54:05.205 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.205 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.205 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.205 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.206 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.206 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.206 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.206 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Password to authenticate with", 2024-09-21T03:54:05.206 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.206 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.206 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.206 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.206 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_port": { 2024-09-21T03:54:05.206 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_port", 2024-09-21T03:54:05.206 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.206 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.206 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.207 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "465", 2024-09-21T03:54:05.207 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.207 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.207 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.207 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP port", 2024-09-21T03:54:05.207 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.207 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.207 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.207 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.207 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_sender": { 2024-09-21T03:54:05.207 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_sender", 2024-09-21T03:54:05.207 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.207 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.207 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.208 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.208 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.208 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.208 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.208 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SMTP envelope sender", 2024-09-21T03:54:05.208 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.208 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.208 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.208 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.208 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_ssl": { 2024-09-21T03:54:05.208 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_ssl", 2024-09-21T03:54:05.208 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.208 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.209 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.209 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.209 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.209 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.209 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.209 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T03:54:05.209 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.209 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.209 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.209 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.209 INFO:teuthology.orchestra.run.smithi084.stdout: "smtp_user": { 2024-09-21T03:54:05.209 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smtp_user", 2024-09-21T03:54:05.209 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.209 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.209 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.210 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.210 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.210 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.210 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.210 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "User to authenticate as", 2024-09-21T03:54:05.210 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.210 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.210 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.210 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.210 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.210 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.210 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.210 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.210 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.211 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.211 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.211 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.211 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.211 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.211 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.211 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.211 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.211 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.211 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.211 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.211 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.211 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "balancer", 2024-09-21T03:54:05.211 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.211 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.212 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.212 INFO:teuthology.orchestra.run.smithi084.stdout: "active": { 2024-09-21T03:54:05.212 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "active", 2024-09-21T03:54:05.212 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.212 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.212 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.212 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.212 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.212 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.212 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.212 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T03:54:05.212 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.212 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.213 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.213 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.213 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_time": { 2024-09-21T03:54:05.213 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_time", 2024-09-21T03:54:05.213 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.213 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.213 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.213 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0000", 2024-09-21T03:54:05.213 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.213 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.213 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.213 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T03:54:05.213 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T03:54:05.213 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.214 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.214 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.214 INFO:teuthology.orchestra.run.smithi084.stdout: "begin_weekday": { 2024-09-21T03:54:05.214 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "begin_weekday", 2024-09-21T03:54:05.214 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T03:54:05.214 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.214 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.214 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.214 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2024-09-21T03:54:05.214 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2024-09-21T03:54:05.214 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.214 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T03:54:05.214 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T03:54:05.214 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.215 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.215 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.215 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_max_iterations": { 2024-09-21T03:54:05.215 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_max_iterations", 2024-09-21T03:54:05.215 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T03:54:05.215 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.215 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.215 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "25", 2024-09-21T03:54:05.215 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T03:54:05.215 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "250", 2024-09-21T03:54:05.215 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.215 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T03:54:05.215 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.215 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.216 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.216 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.216 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_metrics": { 2024-09-21T03:54:05.216 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_metrics", 2024-09-21T03:54:05.216 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.216 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.216 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.216 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T03:54:05.216 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.216 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.216 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.216 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T03:54:05.216 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T03:54:05.216 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.217 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.217 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.217 INFO:teuthology.orchestra.run.smithi084.stdout: "crush_compat_step": { 2024-09-21T03:54:05.217 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crush_compat_step", 2024-09-21T03:54:05.217 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:05.217 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.217 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.217 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.5", 2024-09-21T03:54:05.217 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0.001", 2024-09-21T03:54:05.217 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "0.999", 2024-09-21T03:54:05.217 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.217 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "aggressiveness of optimization", 2024-09-21T03:54:05.217 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T03:54:05.217 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.218 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.218 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.218 INFO:teuthology.orchestra.run.smithi084.stdout: "end_time": { 2024-09-21T03:54:05.218 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_time", 2024-09-21T03:54:05.218 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.218 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.218 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.218 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2359", 2024-09-21T03:54:05.218 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.218 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.218 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.218 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T03:54:05.218 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T03:54:05.218 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.218 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.219 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.219 INFO:teuthology.orchestra.run.smithi084.stdout: "end_weekday": { 2024-09-21T03:54:05.219 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "end_weekday", 2024-09-21T03:54:05.219 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T03:54:05.219 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.219 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.219 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.219 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "0", 2024-09-21T03:54:05.219 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "6", 2024-09-21T03:54:05.219 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.219 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T03:54:05.219 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T03:54:05.219 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.219 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.220 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.220 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.220 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.220 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.220 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.220 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.220 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.220 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.220 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.220 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.220 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.220 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.221 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.221 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.221 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.221 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.221 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.221 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.221 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.221 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.221 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.221 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.221 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.221 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.221 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.222 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.222 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.222 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.222 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.222 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.222 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.222 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.222 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.222 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.222 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.222 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.222 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.223 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.223 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.223 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.223 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.223 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.223 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.223 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.223 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.223 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.223 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.223 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.223 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.223 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.224 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.224 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.224 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.224 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.224 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.224 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.224 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.224 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.224 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.224 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.224 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.224 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.224 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.224 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.225 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.225 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.225 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.225 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.225 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.225 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.225 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.225 INFO:teuthology.orchestra.run.smithi084.stdout: "min_score": { 2024-09-21T03:54:05.225 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_score", 2024-09-21T03:54:05.225 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:05.225 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.225 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.225 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.225 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.226 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.226 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.226 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T03:54:05.226 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.226 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.226 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.226 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.226 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2024-09-21T03:54:05.226 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2024-09-21T03:54:05.226 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.226 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.226 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.226 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "upmap", 2024-09-21T03:54:05.226 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.226 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.227 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.227 INFO:teuthology.orchestra.run.smithi084.stdout: "crush-compat", 2024-09-21T03:54:05.227 INFO:teuthology.orchestra.run.smithi084.stdout: "none", 2024-09-21T03:54:05.227 INFO:teuthology.orchestra.run.smithi084.stdout: "read", 2024-09-21T03:54:05.227 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap", 2024-09-21T03:54:05.227 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap-read" 2024-09-21T03:54:05.227 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.227 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Balancer mode", 2024-09-21T03:54:05.227 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.227 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.227 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.228 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.228 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_ids": { 2024-09-21T03:54:05.228 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_ids", 2024-09-21T03:54:05.228 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.228 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.228 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.228 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.228 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.228 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.228 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.228 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T03:54:05.229 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.229 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.229 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.229 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.229 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T03:54:05.229 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T03:54:05.229 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.229 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.229 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.229 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T03:54:05.229 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.230 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.230 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.230 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T03:54:05.230 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.230 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.230 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.230 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.230 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.230 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.230 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.230 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.231 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.231 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.231 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.231 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.231 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.231 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.231 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.231 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.231 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.231 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.231 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_deviation": { 2024-09-21T03:54:05.231 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_deviation", 2024-09-21T03:54:05.232 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.232 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.232 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.232 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T03:54:05.232 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T03:54:05.232 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.232 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.232 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T03:54:05.232 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T03:54:05.232 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.233 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.233 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.233 INFO:teuthology.orchestra.run.smithi084.stdout: "upmap_max_optimizations": { 2024-09-21T03:54:05.233 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "upmap_max_optimizations", 2024-09-21T03:54:05.233 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T03:54:05.233 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.233 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.233 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:05.233 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.234 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.234 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.234 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T03:54:05.234 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.234 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.234 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.234 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.234 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.234 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.234 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.234 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephadm", 2024-09-21T03:54:05.235 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.235 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.235 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.235 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_down_multiplier": { 2024-09-21T03:54:05.235 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_down_multiplier", 2024-09-21T03:54:05.235 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:05.235 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.235 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.235 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2024-09-21T03:54:05.235 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.236 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.236 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.236 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T03:54:05.236 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.236 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.236 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.236 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.236 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_refresh_rate": { 2024-09-21T03:54:05.236 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_refresh_rate", 2024-09-21T03:54:05.236 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.236 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.236 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.236 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "20", 2024-09-21T03:54:05.236 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.237 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.237 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.237 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T03:54:05.237 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.237 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.237 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.237 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.237 INFO:teuthology.orchestra.run.smithi084.stdout: "agent_starting_port": { 2024-09-21T03:54:05.237 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "agent_starting_port", 2024-09-21T03:54:05.237 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.237 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.237 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.237 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4721", 2024-09-21T03:54:05.237 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.237 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.238 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.238 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T03:54:05.238 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.238 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.238 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.238 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.238 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_ptrace": { 2024-09-21T03:54:05.238 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_ptrace", 2024-09-21T03:54:05.238 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.238 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.238 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.238 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.238 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.238 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.239 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.239 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T03:54:05.239 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T03:54:05.239 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.239 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.239 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.239 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_interval": { 2024-09-21T03:54:05.239 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_interval", 2024-09-21T03:54:05.239 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.239 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.239 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.239 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T03:54:05.239 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.239 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.239 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.240 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T03:54:05.240 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.240 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.240 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.240 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.240 INFO:teuthology.orchestra.run.smithi084.stdout: "autotune_memory_target_ratio": { 2024-09-21T03:54:05.240 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T03:54:05.240 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:05.240 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.240 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.240 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0.7", 2024-09-21T03:54:05.240 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.240 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.240 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.241 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T03:54:05.241 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.241 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.241 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.241 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.241 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm_log_destination": { 2024-09-21T03:54:05.241 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cephadm_log_destination", 2024-09-21T03:54:05.241 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.241 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.241 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.241 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.241 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.241 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.241 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.242 INFO:teuthology.orchestra.run.smithi084.stdout: "file", 2024-09-21T03:54:05.242 INFO:teuthology.orchestra.run.smithi084.stdout: "file,syslog", 2024-09-21T03:54:05.242 INFO:teuthology.orchestra.run.smithi084.stdout: "syslog" 2024-09-21T03:54:05.242 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.242 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T03:54:05.242 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.242 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.242 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.242 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.242 INFO:teuthology.orchestra.run.smithi084.stdout: "cgroups_split": { 2024-09-21T03:54:05.242 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cgroups_split", 2024-09-21T03:54:05.242 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.242 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.242 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T03:54:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "config_checks_enabled": { 2024-09-21T03:54:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_checks_enabled", 2024-09-21T03:54:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.243 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T03:54:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "config_dashboard": { 2024-09-21T03:54:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_dashboard", 2024-09-21T03:54:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.244 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.245 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.245 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.245 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.245 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.245 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T03:54:05.245 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.245 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.245 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.245 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.245 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_alertmanager": { 2024-09-21T03:54:05.245 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_alertmanager", 2024-09-21T03:54:05.245 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.245 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.245 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.246 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T03:54:05.246 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.246 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.246 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.246 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T03:54:05.246 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.246 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.246 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.246 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.246 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_base": { 2024-09-21T03:54:05.246 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_base", 2024-09-21T03:54:05.246 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.246 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.246 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.247 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T03:54:05.247 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.247 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.247 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.247 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Container image name, without the tag", 2024-09-21T03:54:05.247 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.247 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.247 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.247 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.247 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_elasticsearch": { 2024-09-21T03:54:05.247 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_elasticsearch", 2024-09-21T03:54:05.247 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.247 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.247 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.248 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T03:54:05.248 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.248 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.248 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.248 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "elasticsearch container image", 2024-09-21T03:54:05.248 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.248 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.248 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.248 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.248 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_grafana": { 2024-09-21T03:54:05.248 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_grafana", 2024-09-21T03:54:05.248 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.248 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.248 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.248 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T03:54:05.249 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.249 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.249 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.249 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T03:54:05.249 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.249 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.249 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.249 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.249 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_haproxy": { 2024-09-21T03:54:05.249 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_haproxy", 2024-09-21T03:54:05.249 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.249 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.249 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.249 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T03:54:05.249 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.250 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.250 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.250 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "HAproxy container image", 2024-09-21T03:54:05.250 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.250 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.250 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.250 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.250 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_agent": { 2024-09-21T03:54:05.250 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_agent", 2024-09-21T03:54:05.250 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.250 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.250 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.250 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T03:54:05.250 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.250 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.251 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.251 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger agent container image", 2024-09-21T03:54:05.251 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.251 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.251 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.251 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.251 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_collector": { 2024-09-21T03:54:05.251 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_collector", 2024-09-21T03:54:05.251 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.251 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.251 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.251 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T03:54:05.251 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.251 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.252 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.252 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger collector container image", 2024-09-21T03:54:05.252 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.252 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.252 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.253 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.253 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_jaeger_query": { 2024-09-21T03:54:05.253 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_jaeger_query", 2024-09-21T03:54:05.253 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.254 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.254 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.254 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T03:54:05.254 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.254 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.254 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.254 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Jaeger query container image", 2024-09-21T03:54:05.254 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.254 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.254 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.254 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.254 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_keepalived": { 2024-09-21T03:54:05.254 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_keepalived", 2024-09-21T03:54:05.254 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.255 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.255 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.255 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T03:54:05.255 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.255 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.255 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.255 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Keepalived container image", 2024-09-21T03:54:05.255 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.255 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.255 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.256 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.256 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_loki": { 2024-09-21T03:54:05.256 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_loki", 2024-09-21T03:54:05.256 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.256 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.256 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.256 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T03:54:05.256 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.256 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.256 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.256 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Loki container image", 2024-09-21T03:54:05.256 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.256 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.257 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.257 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.257 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_nginx": { 2024-09-21T03:54:05.257 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_nginx", 2024-09-21T03:54:05.257 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.257 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.257 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.257 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T03:54:05.257 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.257 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.257 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.258 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Nginx container image", 2024-09-21T03:54:05.258 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.258 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.258 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.258 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.258 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_node_exporter": { 2024-09-21T03:54:05.258 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_node_exporter", 2024-09-21T03:54:05.258 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.258 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.258 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.258 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T03:54:05.258 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.258 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.259 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.259 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T03:54:05.259 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.259 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.259 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.259 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.259 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_nvmeof": { 2024-09-21T03:54:05.259 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_nvmeof", 2024-09-21T03:54:05.259 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.259 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.259 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.259 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T03:54:05.260 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.260 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.260 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.260 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Nvme-of container image", 2024-09-21T03:54:05.260 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.260 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.260 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.260 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.260 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_oauth2_proxy": { 2024-09-21T03:54:05.260 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T03:54:05.260 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.261 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.261 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.261 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T03:54:05.261 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.261 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.261 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.261 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "oauth2-proxy container image", 2024-09-21T03:54:05.261 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.261 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.261 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.261 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.262 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_prometheus": { 2024-09-21T03:54:05.262 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_prometheus", 2024-09-21T03:54:05.262 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.262 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.262 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.262 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T03:54:05.262 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.262 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.262 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.262 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Prometheus container image", 2024-09-21T03:54:05.263 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.263 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.263 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.263 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.263 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_promtail": { 2024-09-21T03:54:05.263 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_promtail", 2024-09-21T03:54:05.263 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.263 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.263 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.263 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T03:54:05.263 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.264 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.264 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.264 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Promtail container image", 2024-09-21T03:54:05.264 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.264 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.264 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.264 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.264 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_samba": { 2024-09-21T03:54:05.264 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_samba", 2024-09-21T03:54:05.265 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.265 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.265 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.265 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T03:54:05.265 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.265 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.265 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.265 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Samba/SMB container image", 2024-09-21T03:54:05.265 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.265 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.265 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.266 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.266 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_samba_metrics": { 2024-09-21T03:54:05.266 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_samba_metrics", 2024-09-21T03:54:05.266 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.266 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.266 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.266 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T03:54:05.266 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.267 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.267 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.267 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T03:54:05.267 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.267 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.267 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.267 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.267 INFO:teuthology.orchestra.run.smithi084.stdout: "container_image_snmp_gateway": { 2024-09-21T03:54:05.267 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_image_snmp_gateway", 2024-09-21T03:54:05.267 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.268 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.268 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.268 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T03:54:05.268 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.268 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.268 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.268 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "SNMP Gateway container image", 2024-09-21T03:54:05.268 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.268 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.268 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.268 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.268 INFO:teuthology.orchestra.run.smithi084.stdout: "container_init": { 2024-09-21T03:54:05.268 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "container_init", 2024-09-21T03:54:05.268 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.269 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.269 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.269 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.269 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.269 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.269 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.269 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T03:54:05.269 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.269 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.269 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.269 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.269 INFO:teuthology.orchestra.run.smithi084.stdout: "daemon_cache_timeout": { 2024-09-21T03:54:05.269 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "daemon_cache_timeout", 2024-09-21T03:54:05.269 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.269 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.270 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.270 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T03:54:05.270 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.270 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.270 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.270 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T03:54:05.270 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.270 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.270 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.270 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.270 INFO:teuthology.orchestra.run.smithi084.stdout: "default_cephadm_command_timeout": { 2024-09-21T03:54:05.270 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T03:54:05.270 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.270 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.271 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.271 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "900", 2024-09-21T03:54:05.271 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.271 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.271 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.271 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T03:54:05.271 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.271 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.271 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.271 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.271 INFO:teuthology.orchestra.run.smithi084.stdout: "default_registry": { 2024-09-21T03:54:05.271 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "default_registry", 2024-09-21T03:54:05.271 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.271 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.271 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.272 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "docker.io", 2024-09-21T03:54:05.272 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.272 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.272 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.272 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T03:54:05.272 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.272 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.272 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.272 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.272 INFO:teuthology.orchestra.run.smithi084.stdout: "device_cache_timeout": { 2024-09-21T03:54:05.272 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_cache_timeout", 2024-09-21T03:54:05.272 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.272 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.272 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.273 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1800", 2024-09-21T03:54:05.273 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.273 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.273 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.273 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache device inventory", 2024-09-21T03:54:05.273 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.273 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.273 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.273 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.273 INFO:teuthology.orchestra.run.smithi084.stdout: "device_enhanced_scan": { 2024-09-21T03:54:05.273 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_enhanced_scan", 2024-09-21T03:54:05.273 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.273 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.273 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.274 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.274 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.274 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.274 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.274 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T03:54:05.274 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.274 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.274 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.274 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.274 INFO:teuthology.orchestra.run.smithi084.stdout: "facts_cache_timeout": { 2024-09-21T03:54:05.274 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "facts_cache_timeout", 2024-09-21T03:54:05.274 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.274 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.274 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.275 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T03:54:05.275 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.275 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.275 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.275 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "seconds to cache host facts data", 2024-09-21T03:54:05.275 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.275 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.275 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.275 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.275 INFO:teuthology.orchestra.run.smithi084.stdout: "grafana_dashboards_path": { 2024-09-21T03:54:05.275 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "grafana_dashboards_path", 2024-09-21T03:54:05.275 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.275 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.275 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.276 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T03:54:05.276 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.276 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.276 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.276 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T03:54:05.276 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.276 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.276 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.276 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.276 INFO:teuthology.orchestra.run.smithi084.stdout: "host_check_interval": { 2024-09-21T03:54:05.276 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "host_check_interval", 2024-09-21T03:54:05.276 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.276 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.276 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.277 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T03:54:05.277 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.277 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.277 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.277 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to perform a host check", 2024-09-21T03:54:05.277 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.277 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.277 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.277 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.277 INFO:teuthology.orchestra.run.smithi084.stdout: "hw_monitoring": { 2024-09-21T03:54:05.277 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "hw_monitoring", 2024-09-21T03:54:05.277 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.277 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.277 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.278 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.278 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.278 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.278 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.278 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T03:54:05.278 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.278 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.278 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.278 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.278 INFO:teuthology.orchestra.run.smithi084.stdout: "inventory_list_all": { 2024-09-21T03:54:05.278 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "inventory_list_all", 2024-09-21T03:54:05.278 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.278 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.278 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.279 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.279 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.279 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.279 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.279 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T03:54:05.279 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.279 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.279 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.279 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.279 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.279 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.279 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.279 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.279 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.279 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.280 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.280 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.280 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.280 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.280 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.280 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.280 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.280 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.280 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.280 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.280 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.280 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.280 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.280 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.281 INFO:teuthology.orchestra.run.smithi084.stdout: "log_refresh_metadata": { 2024-09-21T03:54:05.281 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_refresh_metadata", 2024-09-21T03:54:05.281 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.281 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.281 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.281 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.281 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.281 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.281 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.281 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T03:54:05.281 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.281 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.281 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.281 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.282 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.282 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.282 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.282 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.282 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.282 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.282 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.282 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.282 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.282 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T03:54:05.282 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.282 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.282 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.282 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.283 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.283 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.283 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.283 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.283 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.283 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.283 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.283 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.283 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.283 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.283 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.283 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.283 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.283 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.284 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.284 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.284 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.284 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.284 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.284 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.284 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.284 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.284 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.284 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.284 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.284 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.284 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.284 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.284 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.285 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.285 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.285 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.285 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.285 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.285 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.285 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T03:54:05.285 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T03:54:05.285 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.285 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.285 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.285 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.285 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.285 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.285 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.286 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T03:54:05.286 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.286 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.286 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.286 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.286 INFO:teuthology.orchestra.run.smithi084.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T03:54:05.286 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T03:54:05.286 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.286 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.286 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.286 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "*", 2024-09-21T03:54:05.287 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.287 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.287 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.287 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T03:54:05.287 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.287 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.287 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.287 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.287 INFO:teuthology.orchestra.run.smithi084.stdout: "max_count_per_host": { 2024-09-21T03:54:05.287 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_count_per_host", 2024-09-21T03:54:05.287 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.287 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.288 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.288 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:05.288 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.288 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.288 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.288 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of daemons per service per host", 2024-09-21T03:54:05.288 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.288 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.288 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.288 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.288 INFO:teuthology.orchestra.run.smithi084.stdout: "max_osd_draining_count": { 2024-09-21T03:54:05.288 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_osd_draining_count", 2024-09-21T03:54:05.288 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.288 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.288 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.289 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:05.289 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.289 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.289 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.289 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T03:54:05.289 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.289 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.289 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.289 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.289 INFO:teuthology.orchestra.run.smithi084.stdout: "migration_current": { 2024-09-21T03:54:05.290 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "migration_current", 2024-09-21T03:54:05.290 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.290 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.290 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.290 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.290 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.290 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.290 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.290 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "internal - do not modify", 2024-09-21T03:54:05.290 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.290 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.290 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.290 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.290 INFO:teuthology.orchestra.run.smithi084.stdout: "mode": { 2024-09-21T03:54:05.291 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mode", 2024-09-21T03:54:05.291 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.291 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.291 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.291 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "root", 2024-09-21T03:54:05.291 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.291 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.291 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.291 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm-package", 2024-09-21T03:54:05.291 INFO:teuthology.orchestra.run.smithi084.stdout: "root" 2024-09-21T03:54:05.292 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.292 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T03:54:05.292 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.292 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.292 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.292 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.292 INFO:teuthology.orchestra.run.smithi084.stdout: "oob_default_addr": { 2024-09-21T03:54:05.292 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "oob_default_addr", 2024-09-21T03:54:05.292 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.292 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.292 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.292 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "169.254.1.1", 2024-09-21T03:54:05.292 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.292 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.293 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.293 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T03:54:05.293 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.293 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.293 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.293 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.293 INFO:teuthology.orchestra.run.smithi084.stdout: "prometheus_alerts_path": { 2024-09-21T03:54:05.293 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus_alerts_path", 2024-09-21T03:54:05.293 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.293 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.293 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.293 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T03:54:05.293 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.293 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.293 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.294 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T03:54:05.294 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.294 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.294 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.294 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.294 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_insecure": { 2024-09-21T03:54:05.294 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_insecure", 2024-09-21T03:54:05.294 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.294 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.294 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.294 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.294 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.294 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.294 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.295 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T03:54:05.295 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.295 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.295 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.295 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.295 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_password": { 2024-09-21T03:54:05.295 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_password", 2024-09-21T03:54:05.295 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.296 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.296 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.296 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.296 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.296 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.296 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.296 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T03:54:05.296 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.296 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.296 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.296 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.296 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_url": { 2024-09-21T03:54:05.296 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_url", 2024-09-21T03:54:05.297 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.297 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.297 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.297 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.297 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.297 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.297 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.297 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T03:54:05.297 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.297 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.297 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.298 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.298 INFO:teuthology.orchestra.run.smithi084.stdout: "registry_username": { 2024-09-21T03:54:05.298 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "registry_username", 2024-09-21T03:54:05.298 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.298 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.298 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.298 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.298 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.298 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.298 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.299 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T03:54:05.299 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.299 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.299 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.299 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.299 INFO:teuthology.orchestra.run.smithi084.stdout: "secure_monitoring_stack": { 2024-09-21T03:54:05.299 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "secure_monitoring_stack", 2024-09-21T03:54:05.299 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.299 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.299 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.299 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.300 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.300 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.300 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.300 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T03:54:05.300 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.300 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.300 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.300 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.300 INFO:teuthology.orchestra.run.smithi084.stdout: "service_discovery_port": { 2024-09-21T03:54:05.300 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "service_discovery_port", 2024-09-21T03:54:05.300 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.301 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.301 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.301 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8765", 2024-09-21T03:54:05.301 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.301 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.301 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.301 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "cephadm service discovery port", 2024-09-21T03:54:05.301 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.301 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.301 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.301 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.301 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.302 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.302 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.302 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.302 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.302 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.302 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.302 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.302 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.302 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.302 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.302 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.302 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.302 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.302 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_config_file": { 2024-09-21T03:54:05.303 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_config_file", 2024-09-21T03:54:05.303 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.303 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.303 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.303 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.303 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.303 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.303 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.303 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T03:54:05.303 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.303 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.303 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.303 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.303 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_keepalive_count_max": { 2024-09-21T03:54:05.303 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T03:54:05.303 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.304 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.304 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.304 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3", 2024-09-21T03:54:05.304 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.304 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.304 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.304 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T03:54:05.304 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.304 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.304 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.304 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.304 INFO:teuthology.orchestra.run.smithi084.stdout: "ssh_keepalive_interval": { 2024-09-21T03:54:05.304 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssh_keepalive_interval", 2024-09-21T03:54:05.304 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.305 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.305 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.305 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7", 2024-09-21T03:54:05.305 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.305 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.305 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.305 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T03:54:05.305 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.305 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.305 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.305 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.305 INFO:teuthology.orchestra.run.smithi084.stdout: "use_agent": { 2024-09-21T03:54:05.305 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_agent", 2024-09-21T03:54:05.305 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.305 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.306 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.306 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.306 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.306 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.306 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.306 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T03:54:05.306 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.306 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.306 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.306 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.306 INFO:teuthology.orchestra.run.smithi084.stdout: "use_repo_digest": { 2024-09-21T03:54:05.306 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "use_repo_digest", 2024-09-21T03:54:05.306 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.306 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.307 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.307 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.307 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.307 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.307 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.307 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T03:54:05.307 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.307 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.307 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.307 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.307 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_failed_host_check": { 2024-09-21T03:54:05.307 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_failed_host_check", 2024-09-21T03:54:05.307 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.307 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.308 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.308 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.308 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.308 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.308 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.308 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T03:54:05.308 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.308 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.308 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.308 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.308 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_daemons": { 2024-09-21T03:54:05.308 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_daemons", 2024-09-21T03:54:05.308 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.308 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.309 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.309 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.309 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.309 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.309 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.309 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T03:54:05.309 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.309 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.309 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.309 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.309 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_on_stray_hosts": { 2024-09-21T03:54:05.309 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_on_stray_hosts", 2024-09-21T03:54:05.310 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.310 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.310 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.310 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.310 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.310 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.310 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.310 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T03:54:05.310 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.310 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.310 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.310 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.310 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.311 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.311 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.311 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crash", 2024-09-21T03:54:05.311 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.311 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.311 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.311 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.311 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.311 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.311 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.311 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.311 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.311 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.312 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.312 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.312 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.312 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.312 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.312 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.312 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.312 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.312 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.312 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.312 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.312 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.312 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.313 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.313 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.313 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.313 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.313 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.313 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.313 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.313 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.313 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.313 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.313 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.313 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.313 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.314 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.314 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.314 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.314 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.314 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.314 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.314 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.314 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.314 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.314 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.314 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.314 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.315 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.315 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.315 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.315 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.315 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.315 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.315 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.315 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.315 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.315 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.315 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.315 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.315 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.315 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.315 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.316 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.316 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.316 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.316 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.316 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.316 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.316 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.316 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.316 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.316 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.316 INFO:teuthology.orchestra.run.smithi084.stdout: "retain_interval": { 2024-09-21T03:54:05.316 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retain_interval", 2024-09-21T03:54:05.316 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.316 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.317 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.317 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "31536000", 2024-09-21T03:54:05.317 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.317 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.317 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.317 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T03:54:05.317 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.317 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.317 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.317 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.317 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.317 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.317 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.317 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.317 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.318 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.318 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.318 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.318 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.318 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.318 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.318 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.318 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.318 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.318 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_recent_interval": { 2024-09-21T03:54:05.318 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_recent_interval", 2024-09-21T03:54:05.318 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.318 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.318 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.318 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1209600", 2024-09-21T03:54:05.319 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.319 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.319 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.319 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T03:54:05.319 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.319 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.319 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.319 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.319 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.319 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.319 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.319 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dashboard", 2024-09-21T03:54:05.319 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.319 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.319 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.319 INFO:teuthology.orchestra.run.smithi084.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T03:54:05.320 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T03:54:05.320 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.320 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.320 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.320 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:05.320 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.320 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.320 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.320 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.320 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.320 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.320 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.320 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.320 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T03:54:05.321 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T03:54:05.321 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.321 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.321 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.321 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.321 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.321 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.321 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.321 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.321 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.321 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.321 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.322 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.322 INFO:teuthology.orchestra.run.smithi084.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T03:54:05.322 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T03:54:05.322 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.322 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.322 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.322 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.322 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.322 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.322 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.322 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.323 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.323 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.323 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.323 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.323 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_ENABLED": { 2024-09-21T03:54:05.323 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T03:54:05.323 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.323 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.323 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.323 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.323 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.323 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.323 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.324 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.324 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.324 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.324 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.324 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.324 INFO:teuthology.orchestra.run.smithi084.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T03:54:05.324 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T03:54:05.324 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.324 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.324 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.324 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.324 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.325 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.325 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.325 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.325 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.325 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.325 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.325 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.325 INFO:teuthology.orchestra.run.smithi084.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T03:54:05.325 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T03:54:05.325 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.325 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.325 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.326 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.326 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.326 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.326 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.326 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.326 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.326 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.326 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.326 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.326 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T03:54:05.326 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T03:54:05.326 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.327 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.327 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.327 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.327 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.327 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.327 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.327 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.327 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.327 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.327 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.327 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.328 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T03:54:05.328 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T03:54:05.328 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.328 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.328 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.328 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.328 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.328 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.328 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.328 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.328 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.328 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.328 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.328 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.329 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T03:54:05.329 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T03:54:05.329 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.329 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.329 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.329 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.329 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.329 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.329 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.329 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.329 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.330 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.330 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.330 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.330 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T03:54:05.330 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T03:54:05.330 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.330 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.330 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.330 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.330 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.330 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.330 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.331 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.331 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.331 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.331 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.331 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.331 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T03:54:05.331 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T03:54:05.331 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.331 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.331 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.331 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.331 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.332 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.332 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.332 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.332 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.332 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.332 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.332 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.332 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T03:54:05.332 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T03:54:05.332 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.332 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.333 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.333 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.333 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.333 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.333 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.333 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.333 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.333 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.333 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.333 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.333 INFO:teuthology.orchestra.run.smithi084.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T03:54:05.334 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T03:54:05.334 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.334 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.334 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.334 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.334 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.334 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.334 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.334 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.334 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.334 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.334 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.334 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.335 INFO:teuthology.orchestra.run.smithi084.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T03:54:05.335 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T03:54:05.335 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.335 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.335 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.335 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.335 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.335 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.335 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.335 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.335 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.335 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.335 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.335 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.335 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T03:54:05.336 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T03:54:05.336 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.336 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.336 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.336 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T03:54:05.336 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.336 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.336 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.336 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.336 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.336 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.336 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.336 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.336 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T03:54:05.336 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T03:54:05.337 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.337 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.337 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.337 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.337 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.337 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.337 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.337 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.337 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.337 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.337 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.337 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.337 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_URL": { 2024-09-21T03:54:05.337 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_URL", 2024-09-21T03:54:05.337 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.338 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.338 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.338 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.338 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.338 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.338 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.338 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.338 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.338 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.338 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.338 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.338 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T03:54:05.338 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T03:54:05.338 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.338 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.338 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.339 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T03:54:05.339 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.339 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.339 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.339 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.339 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.339 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.339 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.339 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.339 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T03:54:05.339 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T03:54:05.339 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.339 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.339 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.340 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.340 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.340 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.340 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.340 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.340 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.340 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.340 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.340 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.340 INFO:teuthology.orchestra.run.smithi084.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T03:54:05.340 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T03:54:05.340 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.340 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.340 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.340 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.340 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.341 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.341 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.341 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.341 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.341 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.341 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.341 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.341 INFO:teuthology.orchestra.run.smithi084.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T03:54:05.341 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T03:54:05.341 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.341 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.341 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.341 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.341 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.341 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.341 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.341 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.342 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.342 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.342 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.342 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.342 INFO:teuthology.orchestra.run.smithi084.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T03:54:05.342 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T03:54:05.342 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.342 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.342 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.342 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.342 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.342 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.342 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.342 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.342 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.343 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.343 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.343 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.343 INFO:teuthology.orchestra.run.smithi084.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T03:54:05.343 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T03:54:05.343 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.343 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.343 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.343 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "[]", 2024-09-21T03:54:05.343 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.343 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.343 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.343 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.343 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.343 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.344 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.344 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.344 INFO:teuthology.orchestra.run.smithi084.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T03:54:05.344 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T03:54:05.344 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.344 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.344 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.344 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "{}", 2024-09-21T03:54:05.344 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.344 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.344 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.344 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.344 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.344 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.345 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.345 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.345 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T03:54:05.345 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T03:54:05.345 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.345 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.345 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.345 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.345 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.345 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.345 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.345 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.345 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.345 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.346 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.346 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.346 INFO:teuthology.orchestra.run.smithi084.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T03:54:05.346 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T03:54:05.346 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.346 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.346 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.346 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.346 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.346 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.346 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.346 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.346 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.346 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.347 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.347 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.347 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T03:54:05.347 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T03:54:05.347 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.347 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.347 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.347 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.347 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.347 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.347 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.347 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.347 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.347 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.347 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.348 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.348 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T03:54:05.348 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T03:54:05.348 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.348 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.348 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.348 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.348 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.348 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.348 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.348 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.348 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.348 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.348 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.348 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.348 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T03:54:05.349 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T03:54:05.349 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.349 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.349 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.349 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.349 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.349 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.349 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.349 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.349 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.349 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.349 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.349 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.349 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T03:54:05.350 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T03:54:05.350 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.350 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.350 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.350 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.350 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.350 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.350 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.350 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.350 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.350 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.350 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.350 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.350 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T03:54:05.351 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T03:54:05.351 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.351 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.351 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.351 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.351 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.351 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.351 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.351 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.351 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.351 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.351 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.351 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.351 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T03:54:05.351 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T03:54:05.351 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.352 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.352 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.352 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.352 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.352 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.352 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.352 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.352 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.352 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.352 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.352 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.352 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T03:54:05.352 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T03:54:05.352 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.353 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.353 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.353 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.353 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.353 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.353 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.353 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.353 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.353 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.353 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.353 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.353 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T03:54:05.353 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T03:54:05.353 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.353 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.354 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.354 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.354 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.354 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.354 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.354 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.354 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.354 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.354 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.354 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.354 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T03:54:05.354 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T03:54:05.354 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.355 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.355 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.355 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T03:54:05.355 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.355 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.355 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.355 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.355 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.355 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.355 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.355 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.355 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T03:54:05.355 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T03:54:05.356 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.356 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.356 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.356 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:05.356 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.356 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.356 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.356 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.357 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.357 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.357 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.357 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.357 INFO:teuthology.orchestra.run.smithi084.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T03:54:05.357 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T03:54:05.357 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.357 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.357 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.357 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8", 2024-09-21T03:54:05.357 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.357 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.357 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.357 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.358 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.358 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.358 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.358 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.358 INFO:teuthology.orchestra.run.smithi084.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T03:54:05.358 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T03:54:05.358 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.359 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.359 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.359 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "45", 2024-09-21T03:54:05.359 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.359 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.359 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.359 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.359 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.359 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.359 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.359 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.359 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T03:54:05.359 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T03:54:05.359 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.360 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.360 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.360 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.360 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.360 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.360 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.360 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.360 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.361 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.361 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.361 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.361 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T03:54:05.361 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T03:54:05.361 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.361 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.361 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.361 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "admin", 2024-09-21T03:54:05.361 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.362 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.362 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.362 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.362 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.362 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.362 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.362 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.362 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T03:54:05.362 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T03:54:05.362 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.362 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.363 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.363 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.363 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.363 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.363 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.363 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.363 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.363 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.363 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.363 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.363 INFO:teuthology.orchestra.run.smithi084.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T03:54:05.363 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T03:54:05.363 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.363 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.364 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.364 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.364 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.364 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.364 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.364 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.364 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.364 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.364 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.364 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.364 INFO:teuthology.orchestra.run.smithi084.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T03:54:05.364 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T03:54:05.364 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.364 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.364 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.365 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.365 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.365 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.365 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.365 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.365 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.365 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.365 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.365 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.365 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T03:54:05.365 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T03:54:05.365 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.365 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.365 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.366 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.366 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.366 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.366 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.366 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.366 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.367 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.367 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.367 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T03:54:05.367 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T03:54:05.367 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.367 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.367 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.367 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:05.368 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.368 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.368 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.368 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.368 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.368 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.368 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.368 INFO:teuthology.orchestra.run.smithi084.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T03:54:05.369 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T03:54:05.369 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.369 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.369 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.369 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T03:54:05.369 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.369 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.369 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.369 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.369 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.369 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.369 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.369 INFO:teuthology.orchestra.run.smithi084.stdout: "cross_origin_url": { 2024-09-21T03:54:05.370 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cross_origin_url", 2024-09-21T03:54:05.370 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.370 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.370 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.370 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.370 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.370 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.370 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.370 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.370 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.370 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.370 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.370 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.370 INFO:teuthology.orchestra.run.smithi084.stdout: "crt_file": { 2024-09-21T03:54:05.371 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "crt_file", 2024-09-21T03:54:05.371 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.371 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.371 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.371 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.371 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.371 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.371 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.371 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.371 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.371 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.371 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.371 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.371 INFO:teuthology.orchestra.run.smithi084.stdout: "debug": { 2024-09-21T03:54:05.372 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "debug", 2024-09-21T03:54:05.372 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.372 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.372 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.372 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.372 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.372 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.372 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.372 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Enable/disable debug options", 2024-09-21T03:54:05.372 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.372 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.372 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.372 INFO:teuthology.orchestra.run.smithi084.stdout: "jwt_token_ttl": { 2024-09-21T03:54:05.372 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "jwt_token_ttl", 2024-09-21T03:54:05.372 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.373 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.373 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.373 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "28800", 2024-09-21T03:54:05.373 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.373 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.373 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.373 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.373 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.373 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.373 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.373 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.373 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2024-09-21T03:54:05.373 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2024-09-21T03:54:05.373 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.373 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.374 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.374 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.374 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.374 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.374 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.374 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.374 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.374 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.374 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.374 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.374 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.374 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.374 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.374 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.375 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.375 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.375 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.375 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.375 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.375 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.375 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.375 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.375 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.375 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.375 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.375 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.375 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.375 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.376 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.376 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.376 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.376 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.376 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.376 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.376 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.376 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.376 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.376 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.376 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.376 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.376 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.376 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.376 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.377 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.377 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.377 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.377 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.377 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.377 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.377 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.377 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.377 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.377 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.377 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.377 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.377 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.377 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.378 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.378 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.378 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.378 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.378 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.378 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.378 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.378 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.378 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.378 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.378 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.378 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.378 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.378 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.379 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.379 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.379 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.379 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.379 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.379 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.379 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.379 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.379 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.379 INFO:teuthology.orchestra.run.smithi084.stdout: "motd": { 2024-09-21T03:54:05.379 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "motd", 2024-09-21T03:54:05.379 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.379 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.379 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.380 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.380 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.380 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.380 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.380 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "The message of the day", 2024-09-21T03:54:05.380 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.380 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.380 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.380 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.380 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect_resolve_ip_addr": { 2024-09-21T03:54:05.380 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T03:54:05.380 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.381 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.381 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.381 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.381 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.381 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.381 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.381 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.381 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.381 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.381 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.381 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.381 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T03:54:05.381 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T03:54:05.381 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.382 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.382 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.382 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2024-09-21T03:54:05.382 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.382 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.382 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.382 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.382 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.382 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.382 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.382 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.382 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T03:54:05.382 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T03:54:05.383 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.383 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.383 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.383 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8080", 2024-09-21T03:54:05.383 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.383 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.383 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.383 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.383 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.383 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.383 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.383 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.383 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.383 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.383 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.384 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.384 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.384 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.384 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.384 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.384 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.384 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.384 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.384 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.384 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.384 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.384 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2024-09-21T03:54:05.384 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2024-09-21T03:54:05.384 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.385 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.385 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.385 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.385 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.385 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.385 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.385 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.385 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.385 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.385 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.385 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.385 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl_server_port": { 2024-09-21T03:54:05.385 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl_server_port", 2024-09-21T03:54:05.386 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.386 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.386 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.386 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8443", 2024-09-21T03:54:05.386 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.386 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.386 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.386 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.386 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.386 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.386 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.386 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.386 INFO:teuthology.orchestra.run.smithi084.stdout: "sso_oauth2": { 2024-09-21T03:54:05.386 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sso_oauth2", 2024-09-21T03:54:05.387 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.387 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.387 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.387 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.387 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.387 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.387 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.387 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.387 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.387 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.387 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.387 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.387 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2024-09-21T03:54:05.387 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2024-09-21T03:54:05.387 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.388 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.388 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.388 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "redirect", 2024-09-21T03:54:05.388 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.388 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.388 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.388 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.388 INFO:teuthology.orchestra.run.smithi084.stdout: "redirect" 2024-09-21T03:54:05.388 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.388 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.388 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.388 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.388 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.388 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.388 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2024-09-21T03:54:05.388 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2024-09-21T03:54:05.389 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.389 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.389 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.389 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T03:54:05.389 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2024-09-21T03:54:05.389 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2024-09-21T03:54:05.389 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.389 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.389 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.389 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.389 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.390 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.390 INFO:teuthology.orchestra.run.smithi084.stdout: "url_prefix": { 2024-09-21T03:54:05.390 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url_prefix", 2024-09-21T03:54:05.390 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.390 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.390 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.390 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.390 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.390 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.390 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.390 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.390 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.391 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.391 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.391 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.391 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.391 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.391 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.391 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "devicehealth", 2024-09-21T03:54:05.391 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.391 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.391 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.391 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_monitoring": { 2024-09-21T03:54:05.391 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_monitoring", 2024-09-21T03:54:05.391 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.392 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.392 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.392 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.392 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.392 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.392 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.392 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "monitor device health metrics", 2024-09-21T03:54:05.392 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.392 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.392 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.393 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.393 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.393 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.393 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.393 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.393 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.393 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.393 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.393 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.393 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.393 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.393 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.393 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.394 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.394 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.394 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.394 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.394 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.394 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.394 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.394 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.394 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.395 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.395 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.395 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.395 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.395 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.395 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.395 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.395 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.395 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.395 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.395 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.395 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.395 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.396 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.396 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.396 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.396 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.396 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.396 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.396 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.396 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.396 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.396 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.396 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.397 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.397 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.397 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.397 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.397 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.397 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.397 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.397 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.397 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.397 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.397 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.397 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.398 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.398 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.398 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.398 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.398 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.398 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.398 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.398 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.398 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.398 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.398 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.398 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.398 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.399 INFO:teuthology.orchestra.run.smithi084.stdout: "mark_out_threshold": { 2024-09-21T03:54:05.399 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mark_out_threshold", 2024-09-21T03:54:05.399 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.399 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.399 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.399 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "2419200", 2024-09-21T03:54:05.399 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.399 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.399 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.399 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T03:54:05.399 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.400 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.400 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.400 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.400 INFO:teuthology.orchestra.run.smithi084.stdout: "pool_name": { 2024-09-21T03:54:05.400 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pool_name", 2024-09-21T03:54:05.400 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.400 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.400 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.400 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "device_health_metrics", 2024-09-21T03:54:05.400 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.400 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.400 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.401 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T03:54:05.401 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.401 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.401 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.401 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.401 INFO:teuthology.orchestra.run.smithi084.stdout: "retention_period": { 2024-09-21T03:54:05.401 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "retention_period", 2024-09-21T03:54:05.401 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.401 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.401 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.401 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15552000", 2024-09-21T03:54:05.401 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.402 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.402 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.402 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long to retain device health metrics", 2024-09-21T03:54:05.402 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.402 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.402 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.402 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.402 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_frequency": { 2024-09-21T03:54:05.402 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_frequency", 2024-09-21T03:54:05.403 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.403 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.403 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.403 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2024-09-21T03:54:05.403 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.403 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.403 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.403 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T03:54:05.403 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.403 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.403 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.403 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.404 INFO:teuthology.orchestra.run.smithi084.stdout: "self_heal": { 2024-09-21T03:54:05.404 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "self_heal", 2024-09-21T03:54:05.404 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.404 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.404 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.404 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.404 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.404 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.404 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.404 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T03:54:05.404 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.404 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.404 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.405 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.405 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T03:54:05.405 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T03:54:05.405 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.405 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.405 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.405 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T03:54:05.405 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.405 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.405 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.405 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T03:54:05.405 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.405 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.405 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.406 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.406 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.406 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.406 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.406 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.406 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.406 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.406 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.406 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.406 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.406 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.406 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.406 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.407 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.407 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.407 INFO:teuthology.orchestra.run.smithi084.stdout: "warn_threshold": { 2024-09-21T03:54:05.407 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "warn_threshold", 2024-09-21T03:54:05.407 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.407 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.407 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.407 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7257600", 2024-09-21T03:54:05.407 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.407 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.407 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.407 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T03:54:05.407 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.407 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.407 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.408 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.408 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.408 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.408 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.408 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "diskprediction_local", 2024-09-21T03:54:05.408 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.408 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.408 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.408 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.408 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.408 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.408 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.408 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.408 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.408 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.409 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.409 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.409 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.409 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.409 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.409 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.409 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.409 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.409 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.409 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.409 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.409 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.409 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.409 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.410 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.410 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.410 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.410 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.410 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.410 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.410 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.410 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.410 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.410 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.410 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.410 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.410 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.410 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.411 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.411 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.411 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.411 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.411 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.411 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.411 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.411 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.411 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.411 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.411 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.411 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.411 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.411 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.411 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.412 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.412 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.412 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.412 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.412 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.412 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.412 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.412 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.412 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.412 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.412 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.412 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.412 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.412 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.413 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.413 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.413 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.413 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.413 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.413 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.413 INFO:teuthology.orchestra.run.smithi084.stdout: "predict_interval": { 2024-09-21T03:54:05.413 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predict_interval", 2024-09-21T03:54:05.413 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.413 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.413 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.413 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "86400", 2024-09-21T03:54:05.413 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.413 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.414 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.414 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.414 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.414 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.414 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.414 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.414 INFO:teuthology.orchestra.run.smithi084.stdout: "predictor_model": { 2024-09-21T03:54:05.414 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "predictor_model", 2024-09-21T03:54:05.414 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.414 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.414 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.414 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "prophetstor", 2024-09-21T03:54:05.414 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.414 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.415 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.415 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.415 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.415 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.415 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.415 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.415 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T03:54:05.415 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T03:54:05.415 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.415 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.415 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.415 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "600", 2024-09-21T03:54:05.415 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.415 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.415 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.416 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.416 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.416 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.416 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.416 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.416 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.416 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.416 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.416 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.416 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.416 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.416 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.416 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.416 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.416 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.417 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.417 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.417 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.417 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.417 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.417 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.417 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.417 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "influx", 2024-09-21T03:54:05.417 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": false, 2024-09-21T03:54:05.417 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "influxdb python module not found", 2024-09-21T03:54:05.417 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.417 INFO:teuthology.orchestra.run.smithi084.stdout: "batch_size": { 2024-09-21T03:54:05.417 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "batch_size", 2024-09-21T03:54:05.417 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.418 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.418 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.418 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5000", 2024-09-21T03:54:05.418 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.418 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.418 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.418 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T03:54:05.418 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.418 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.418 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.418 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.418 INFO:teuthology.orchestra.run.smithi084.stdout: "database": { 2024-09-21T03:54:05.419 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "database", 2024-09-21T03:54:05.419 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.419 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.419 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.419 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "ceph", 2024-09-21T03:54:05.419 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.419 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.419 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.419 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T03:54:05.419 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.419 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.420 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.420 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.420 INFO:teuthology.orchestra.run.smithi084.stdout: "hostname": { 2024-09-21T03:54:05.420 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "hostname", 2024-09-21T03:54:05.420 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.420 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.420 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.420 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.420 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.420 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.420 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.420 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server hostname", 2024-09-21T03:54:05.420 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.420 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.421 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.421 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.421 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T03:54:05.421 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T03:54:05.421 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.421 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.421 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.421 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "30", 2024-09-21T03:54:05.421 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "5", 2024-09-21T03:54:05.421 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.421 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.421 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T03:54:05.421 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.421 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.421 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.422 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.422 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.422 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.422 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.422 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.422 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.422 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.422 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.422 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.422 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.422 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.422 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.423 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.423 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.423 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.423 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.423 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.423 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.423 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.423 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.423 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.423 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.423 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.423 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.424 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.424 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.424 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.424 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.424 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.424 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.424 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.424 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.424 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.424 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.424 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.424 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.424 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.424 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.425 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.425 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.425 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.425 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.425 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.425 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.425 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.425 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.425 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.425 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.426 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.426 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.426 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.426 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.426 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.426 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.426 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.426 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.426 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.426 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.426 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.426 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.426 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.426 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.427 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.427 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.427 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.427 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.427 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.427 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.427 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.427 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.427 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.427 INFO:teuthology.orchestra.run.smithi084.stdout: "password": { 2024-09-21T03:54:05.427 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "password", 2024-09-21T03:54:05.427 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.428 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.428 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.428 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.428 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.428 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.428 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.428 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "password of InfluxDB server user", 2024-09-21T03:54:05.428 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.428 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.428 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.428 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.428 INFO:teuthology.orchestra.run.smithi084.stdout: "port": { 2024-09-21T03:54:05.429 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "port", 2024-09-21T03:54:05.429 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.429 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.429 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.429 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "8086", 2024-09-21T03:54:05.429 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.429 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.429 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.429 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "InfluxDB server port", 2024-09-21T03:54:05.429 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.429 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.429 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.429 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.430 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.430 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.430 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.430 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.430 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.430 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.430 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.430 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.430 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.430 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.431 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.431 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.431 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.431 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.431 INFO:teuthology.orchestra.run.smithi084.stdout: "ssl": { 2024-09-21T03:54:05.431 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ssl", 2024-09-21T03:54:05.431 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.431 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.431 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.431 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "false", 2024-09-21T03:54:05.431 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.431 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.432 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.432 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T03:54:05.432 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.432 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.432 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.432 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.432 INFO:teuthology.orchestra.run.smithi084.stdout: "threads": { 2024-09-21T03:54:05.432 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threads", 2024-09-21T03:54:05.432 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.432 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.432 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.432 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T03:54:05.433 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T03:54:05.433 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "32", 2024-09-21T03:54:05.433 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.433 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T03:54:05.433 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.433 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.433 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.433 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.433 INFO:teuthology.orchestra.run.smithi084.stdout: "username": { 2024-09-21T03:54:05.433 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "username", 2024-09-21T03:54:05.433 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.433 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.433 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.433 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.433 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.434 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.434 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.434 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "username of InfluxDB server user", 2024-09-21T03:54:05.434 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.434 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.434 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.434 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.434 INFO:teuthology.orchestra.run.smithi084.stdout: "verify_ssl": { 2024-09-21T03:54:05.434 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "verify_ssl", 2024-09-21T03:54:05.434 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.434 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.434 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.434 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "true", 2024-09-21T03:54:05.435 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.435 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.435 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.435 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T03:54:05.435 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.435 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.435 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.435 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.435 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.435 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.436 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.436 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "insights", 2024-09-21T03:54:05.436 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.436 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.436 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.436 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.436 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.436 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.437 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.437 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.437 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.437 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.437 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.437 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.437 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.437 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.437 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.437 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.437 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.437 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.438 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.438 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.438 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.438 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.438 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.438 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.438 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.438 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.438 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.438 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.438 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.438 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.438 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.439 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.439 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.439 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.439 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.439 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.439 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.439 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.439 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.439 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.439 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.439 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.439 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.439 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.440 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.440 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.440 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.440 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.440 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.440 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.440 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.440 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.440 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.440 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.440 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.440 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.440 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.440 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.440 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.441 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.441 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.441 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.441 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.441 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.441 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.441 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.441 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.441 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.441 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.441 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.441 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.441 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.441 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.442 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.442 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.442 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.442 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.442 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.442 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.442 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.442 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.442 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.442 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.442 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.442 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.442 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.442 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.443 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.443 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.443 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.443 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "iostat", 2024-09-21T03:54:05.443 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.443 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.443 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.443 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.443 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.443 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.443 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.443 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.443 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.443 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.443 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.444 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.444 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.444 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.444 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.444 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.444 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.444 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.444 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.444 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.444 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.444 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.444 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.444 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.444 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.445 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.445 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.445 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.445 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.445 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.445 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.445 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.445 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.445 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.445 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.445 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.445 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.445 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.446 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.446 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.446 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.446 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.446 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.446 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.446 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.446 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.446 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.446 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.446 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.446 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.446 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.447 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.447 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.447 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.447 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.447 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.447 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.447 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.447 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.447 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.447 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.447 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.447 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.447 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.447 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.448 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.448 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.448 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.448 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.448 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.448 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.448 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.448 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.448 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.448 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.448 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.448 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.448 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.449 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.449 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.449 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.449 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.449 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.449 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.449 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.449 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.449 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.449 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.449 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.449 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.449 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "k8sevents", 2024-09-21T03:54:05.450 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.450 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.450 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.450 INFO:teuthology.orchestra.run.smithi084.stdout: "ceph_event_retention_days": { 2024-09-21T03:54:05.450 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "ceph_event_retention_days", 2024-09-21T03:54:05.450 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.450 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.450 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.450 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "7", 2024-09-21T03:54:05.450 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.450 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.450 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.450 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T03:54:05.451 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.451 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.451 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.451 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.451 INFO:teuthology.orchestra.run.smithi084.stdout: "config_check_secs": { 2024-09-21T03:54:05.451 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "config_check_secs", 2024-09-21T03:54:05.451 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.451 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.451 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.451 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:05.451 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "10", 2024-09-21T03:54:05.451 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.451 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.452 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T03:54:05.452 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.452 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.452 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.452 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.452 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.452 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.452 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.452 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.452 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.452 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.452 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.452 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.453 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.453 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.453 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.453 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.453 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.453 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.453 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.453 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.453 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.453 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.453 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.453 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.453 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.453 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.454 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.454 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.454 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.454 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.454 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.454 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.454 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.454 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.454 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.454 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.454 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.454 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.454 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.454 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.455 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.455 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.455 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.455 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.455 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.455 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.455 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.455 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.455 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.455 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.455 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.455 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.455 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.456 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.456 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.456 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.456 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.456 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.456 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.456 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.456 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.456 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.456 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.456 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.456 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.456 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.456 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.456 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.457 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.457 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.457 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.457 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.457 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.457 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.457 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.457 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.457 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.457 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.457 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.457 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.457 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.458 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.458 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.458 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.458 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.458 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.458 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.458 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.458 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.458 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.458 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.458 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "localpool", 2024-09-21T03:54:05.459 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.459 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.459 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.459 INFO:teuthology.orchestra.run.smithi084.stdout: "failure_domain": { 2024-09-21T03:54:05.459 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "failure_domain", 2024-09-21T03:54:05.459 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.459 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.459 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.459 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "host", 2024-09-21T03:54:05.459 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.459 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.459 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.459 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "failure domain for any created local pool", 2024-09-21T03:54:05.459 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T03:54:05.459 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.460 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.460 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.460 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.460 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.460 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.460 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.460 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.460 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.460 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.461 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.461 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.461 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.461 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.461 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.461 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.461 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.461 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.461 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.461 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.461 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.461 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.461 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.462 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.462 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.462 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.462 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.462 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.462 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.462 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.462 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.462 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.463 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.463 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.463 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.463 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.463 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.463 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.463 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.463 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.463 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.463 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.463 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.463 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.463 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.464 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.464 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.464 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.464 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.464 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.464 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.464 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.464 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.464 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.464 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.465 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.465 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.465 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.465 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.465 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.465 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.465 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.465 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.465 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.465 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.465 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.465 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.465 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.466 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.466 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.466 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.466 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.466 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.466 INFO:teuthology.orchestra.run.smithi084.stdout: "min_size": { 2024-09-21T03:54:05.466 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "min_size", 2024-09-21T03:54:05.466 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.466 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.466 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.466 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.467 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.467 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.467 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.467 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default min_size for any created local pool", 2024-09-21T03:54:05.467 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T03:54:05.467 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.467 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.467 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.467 INFO:teuthology.orchestra.run.smithi084.stdout: "num_rep": { 2024-09-21T03:54:05.467 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "num_rep", 2024-09-21T03:54:05.467 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.468 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.468 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.468 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3", 2024-09-21T03:54:05.468 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.468 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.468 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.468 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default replica count for any created local pool", 2024-09-21T03:54:05.468 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.468 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.468 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.468 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.469 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_num": { 2024-09-21T03:54:05.469 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_num", 2024-09-21T03:54:05.469 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.469 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.469 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.469 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "128", 2024-09-21T03:54:05.469 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.469 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.469 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.469 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T03:54:05.470 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.470 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.470 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.470 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.470 INFO:teuthology.orchestra.run.smithi084.stdout: "prefix": { 2024-09-21T03:54:05.470 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prefix", 2024-09-21T03:54:05.470 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.470 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.470 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.470 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.470 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.470 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.471 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.471 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "name prefix for any created local pool", 2024-09-21T03:54:05.471 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.471 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.471 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.471 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.471 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.471 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.471 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.471 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.471 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.471 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.471 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.472 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.472 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.472 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.472 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.472 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.472 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.472 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.472 INFO:teuthology.orchestra.run.smithi084.stdout: "subtree": { 2024-09-21T03:54:05.472 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "subtree", 2024-09-21T03:54:05.472 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.472 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.472 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.472 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "rack", 2024-09-21T03:54:05.472 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.473 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.473 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.473 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T03:54:05.473 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T03:54:05.473 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.473 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.473 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.473 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.473 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.473 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.473 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mds_autoscaler", 2024-09-21T03:54:05.473 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.473 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.473 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.473 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.474 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.474 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.474 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.474 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.474 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.474 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.474 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.474 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.474 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.474 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.474 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.474 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.474 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.475 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.476 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.477 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.478 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.479 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirroring", 2024-09-21T03:54:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.480 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.481 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.482 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.483 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.484 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "nfs", 2024-09-21T03:54:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.485 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.486 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.487 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.488 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.489 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.490 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.491 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.492 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2024-09-21T03:54:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "fail_fs": { 2024-09-21T03:54:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "fail_fs", 2024-09-21T03:54:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.493 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T03:54:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.494 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.495 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.496 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.497 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.498 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.499 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.500 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator": { 2024-09-21T03:54:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "orchestrator", 2024-09-21T03:54:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "cephadm", 2024-09-21T03:54:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "rook", 2024-09-21T03:54:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: "test_orchestrator" 2024-09-21T03:54:05.501 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Orchestrator backend", 2024-09-21T03:54:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.502 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_perf_query", 2024-09-21T03:54:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.503 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.504 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.505 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.506 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.507 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.508 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.509 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "osd_support", 2024-09-21T03:54:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.510 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.511 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.512 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.513 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.514 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.515 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "pg_autoscaler", 2024-09-21T03:54:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.516 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.517 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.518 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.519 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.520 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T03:54:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T03:54:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T03:54:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.521 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "threshold": { 2024-09-21T03:54:05.522 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "threshold", 2024-09-21T03:54:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "3.0", 2024-09-21T03:54:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1.0", 2024-09-21T03:54:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "scaling threshold", 2024-09-21T03:54:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T03:54:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.523 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "progress", 2024-09-21T03:54:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_pg_recovery_event": { 2024-09-21T03:54:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_pg_recovery_event", 2024-09-21T03:54:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.524 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T03:54:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2024-09-21T03:54:05.525 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2024-09-21T03:54:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.526 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.527 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.528 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.529 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.530 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.531 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.532 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "max_completed_events": { 2024-09-21T03:54:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_completed_events", 2024-09-21T03:54:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "50", 2024-09-21T03:54:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.533 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "number of past completed events to remember", 2024-09-21T03:54:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "sleep_interval": { 2024-09-21T03:54:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sleep_interval", 2024-09-21T03:54:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T03:54:05.534 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "how long the module is going to sleep", 2024-09-21T03:54:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.535 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "prometheus", 2024-09-21T03:54:05.536 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "cache": { 2024-09-21T03:54:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "cache", 2024-09-21T03:54:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.537 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "exclude_perf_counters": { 2024-09-21T03:54:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "exclude_perf_counters", 2024-09-21T03:54:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.538 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T03:54:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T03:54:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.539 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.540 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.541 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.542 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.543 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools": { 2024-09-21T03:54:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools", 2024-09-21T03:54:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.544 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T03:54:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T03:54:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "300", 2024-09-21T03:54:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.545 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "scrape_interval": { 2024-09-21T03:54:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "scrape_interval", 2024-09-21T03:54:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15.0", 2024-09-21T03:54:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.546 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T03:54:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T03:54:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "::", 2024-09-21T03:54:05.547 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T03:54:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T03:54:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T03:54:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "9283", 2024-09-21T03:54:05.548 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T03:54:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.549 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "stale_cache_strategy": { 2024-09-21T03:54:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stale_cache_strategy", 2024-09-21T03:54:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "log", 2024-09-21T03:54:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.550 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_behaviour": { 2024-09-21T03:54:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_behaviour", 2024-09-21T03:54:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "default", 2024-09-21T03:54:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.551 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "default", 2024-09-21T03:54:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "error" 2024-09-21T03:54:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "standby_error_status_code": { 2024-09-21T03:54:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "standby_error_status_code", 2024-09-21T03:54:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T03:54:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "400", 2024-09-21T03:54:05.552 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "599", 2024-09-21T03:54:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_support", 2024-09-21T03:54:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.553 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.554 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.555 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.556 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.557 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.558 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_snap_create": { 2024-09-21T03:54:05.559 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_snap_create", 2024-09-21T03:54:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10", 2024-09-21T03:54:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.560 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "mirror_snapshot_schedule": { 2024-09-21T03:54:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T03:54:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.561 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.562 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "trash_purge_schedule": { 2024-09-21T03:54:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "trash_purge_schedule", 2024-09-21T03:54:05.563 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.564 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "restful", 2024-09-21T03:54:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "enable_auth": { 2024-09-21T03:54:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enable_auth", 2024-09-21T03:54:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.565 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "key_file": { 2024-09-21T03:54:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "key_file", 2024-09-21T03:54:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.566 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.567 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.568 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.569 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.570 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.571 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.572 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "max_requests": { 2024-09-21T03:54:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_requests", 2024-09-21T03:54:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "500", 2024-09-21T03:54:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T03:54:05.573 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "server_addr": { 2024-09-21T03:54:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_addr", 2024-09-21T03:54:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.574 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "server_port": { 2024-09-21T03:54:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "server_port", 2024-09-21T03:54:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.575 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.576 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rgw", 2024-09-21T03:54:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.577 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.578 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.579 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.580 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.581 INFO:teuthology.orchestra.run.smithi084.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T03:54:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T03:54:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "5", 2024-09-21T03:54:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T03:54:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.582 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.583 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rook", 2024-09-21T03:54:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.584 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.585 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.586 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.587 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.588 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.589 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "storage_class": { 2024-09-21T03:54:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "storage_class", 2024-09-21T03:54:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "local", 2024-09-21T03:54:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T03:54:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.590 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "selftest", 2024-09-21T03:54:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.591 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.592 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.593 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.594 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.595 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.596 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "roption1": { 2024-09-21T03:54:05.597 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption1", 2024-09-21T03:54:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.598 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "roption2": { 2024-09-21T03:54:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "roption2", 2024-09-21T03:54:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "xyz", 2024-09-21T03:54:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.599 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption1": { 2024-09-21T03:54:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption1", 2024-09-21T03:54:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.600 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption2": { 2024-09-21T03:54:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption2", 2024-09-21T03:54:05.601 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption3": { 2024-09-21T03:54:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption3", 2024-09-21T03:54:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "float", 2024-09-21T03:54:05.602 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption4": { 2024-09-21T03:54:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption4", 2024-09-21T03:54:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.603 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption5": { 2024-09-21T03:54:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption5", 2024-09-21T03:54:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.604 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption6": { 2024-09-21T03:54:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption6", 2024-09-21T03:54:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.605 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "rwoption7": { 2024-09-21T03:54:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rwoption7", 2024-09-21T03:54:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.606 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "1", 2024-09-21T03:54:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "42", 2024-09-21T03:54:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.607 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "testkey": { 2024-09-21T03:54:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testkey", 2024-09-21T03:54:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.608 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "testlkey": { 2024-09-21T03:54:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testlkey", 2024-09-21T03:54:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.609 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "testnewline": { 2024-09-21T03:54:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "testnewline", 2024-09-21T03:54:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.610 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "smb", 2024-09-21T03:54:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "internal_store_backend": { 2024-09-21T03:54:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "internal_store_backend", 2024-09-21T03:54:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.611 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T03:54:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.612 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.613 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.614 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.615 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.616 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.617 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "update_orchestration": { 2024-09-21T03:54:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "update_orchestration", 2024-09-21T03:54:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.618 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T03:54:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snap_schedule", 2024-09-21T03:54:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.619 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "allow_m_granularity": { 2024-09-21T03:54:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "allow_m_granularity", 2024-09-21T03:54:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T03:54:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.620 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "dump_on_update": { 2024-09-21T03:54:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "dump_on_update", 2024-09-21T03:54:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "dump database to debug log on update", 2024-09-21T03:54:05.621 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.622 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.623 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.624 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.625 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.626 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.627 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.628 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "stats", 2024-09-21T03:54:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.629 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.630 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.631 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.632 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.633 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.634 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.635 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "status", 2024-09-21T03:54:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.636 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.637 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.638 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.639 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.640 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.641 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telegraf", 2024-09-21T03:54:05.642 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "address": { 2024-09-21T03:54:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "address", 2024-09-21T03:54:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T03:54:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.643 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T03:54:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T03:54:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "15", 2024-09-21T03:54:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.644 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.645 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.646 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.647 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.648 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.649 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.650 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "telemetry", 2024-09-21T03:54:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_basic": { 2024-09-21T03:54:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_basic", 2024-09-21T03:54:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.651 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T03:54:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_crash": { 2024-09-21T03:54:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_crash", 2024-09-21T03:54:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.652 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T03:54:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_device": { 2024-09-21T03:54:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_device", 2024-09-21T03:54:05.653 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T03:54:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_ident": { 2024-09-21T03:54:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_ident", 2024-09-21T03:54:05.654 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T03:54:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.655 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "channel_perf": { 2024-09-21T03:54:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "channel_perf", 2024-09-21T03:54:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T03:54:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.656 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "contact": { 2024-09-21T03:54:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "contact", 2024-09-21T03:54:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.657 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "description": { 2024-09-21T03:54:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "description", 2024-09-21T03:54:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.658 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "device_url": { 2024-09-21T03:54:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "device_url", 2024-09-21T03:54:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T03:54:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.659 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "enabled": { 2024-09-21T03:54:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "enabled", 2024-09-21T03:54:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.660 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T03:54:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T03:54:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "24", 2024-09-21T03:54:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "8", 2024-09-21T03:54:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.661 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: "last_opt_revision": { 2024-09-21T03:54:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "last_opt_revision", 2024-09-21T03:54:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.662 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "1", 2024-09-21T03:54:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard": { 2024-09-21T03:54:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard", 2024-09-21T03:54:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.663 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "leaderboard_description": { 2024-09-21T03:54:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "leaderboard_description", 2024-09-21T03:54:05.664 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.665 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.666 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.667 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.668 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.669 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.670 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "organization": { 2024-09-21T03:54:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "organization", 2024-09-21T03:54:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.671 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "proxy": { 2024-09-21T03:54:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "proxy", 2024-09-21T03:54:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.672 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.673 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "url": { 2024-09-21T03:54:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "url", 2024-09-21T03:54:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.674 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T03:54:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "test_orchestrator", 2024-09-21T03:54:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.675 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.676 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.677 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.678 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.679 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.680 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.681 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2024-09-21T03:54:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.682 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.683 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.685 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.685 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.685 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.685 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.686 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.687 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.688 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "max_concurrent_clones": { 2024-09-21T03:54:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "max_concurrent_clones", 2024-09-21T03:54:05.689 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "4", 2024-09-21T03:54:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T03:54:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.690 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "periodic_async_work": { 2024-09-21T03:54:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "periodic_async_work", 2024-09-21T03:54:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Periodically check for async work", 2024-09-21T03:54:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.691 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot_clone_delay": { 2024-09-21T03:54:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snapshot_clone_delay", 2024-09-21T03:54:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.692 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T03:54:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "snapshot_clone_no_wait": { 2024-09-21T03:54:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T03:54:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.693 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "True", 2024-09-21T03:54:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T03:54:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.694 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.695 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix", 2024-09-21T03:54:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: "can_run": true, 2024-09-21T03:54:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: "error_string": "", 2024-09-21T03:54:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: "module_options": { 2024-09-21T03:54:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: "discovery_interval": { 2024-09-21T03:54:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "discovery_interval", 2024-09-21T03:54:05.696 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "uint", 2024-09-21T03:54:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "100", 2024-09-21T03:54:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "identifier": { 2024-09-21T03:54:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "identifier", 2024-09-21T03:54:05.697 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.698 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "interval": { 2024-09-21T03:54:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "interval", 2024-09-21T03:54:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "secs", 2024-09-21T03:54:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "60", 2024-09-21T03:54:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.699 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: "log_level": { 2024-09-21T03:54:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_level", 2024-09-21T03:54:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.700 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.701 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster": { 2024-09-21T03:54:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster", 2024-09-21T03:54:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.702 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_cluster_level": { 2024-09-21T03:54:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_cluster_level", 2024-09-21T03:54:05.703 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "info", 2024-09-21T03:54:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [ 2024-09-21T03:54:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "", 2024-09-21T03:54:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "critical", 2024-09-21T03:54:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "debug", 2024-09-21T03:54:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "error", 2024-09-21T03:54:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "info", 2024-09-21T03:54:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "warning" 2024-09-21T03:54:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.704 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "log_to_file": { 2024-09-21T03:54:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "log_to_file", 2024-09-21T03:54:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "bool", 2024-09-21T03:54:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "False", 2024-09-21T03:54:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.705 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "sqlite3_killpoint": { 2024-09-21T03:54:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:54:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "dev", 2024-09-21T03:54:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 1, 2024-09-21T03:54:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "0", 2024-09-21T03:54:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.706 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_host": { 2024-09-21T03:54:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_host", 2024-09-21T03:54:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "", 2024-09-21T03:54:05.707 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_port": { 2024-09-21T03:54:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_port", 2024-09-21T03:54:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "int", 2024-09-21T03:54:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "10051", 2024-09-21T03:54:05.708 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "zabbix_sender": { 2024-09-21T03:54:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "zabbix_sender", 2024-09-21T03:54:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "str", 2024-09-21T03:54:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "level": "advanced", 2024-09-21T03:54:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "flags": 0, 2024-09-21T03:54:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T03:54:05.709 INFO:teuthology.orchestra.run.smithi084.stdout: "min": "", 2024-09-21T03:54:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: "max": "", 2024-09-21T03:54:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: "enum_allowed": [], 2024-09-21T03:54:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: "desc": "", 2024-09-21T03:54:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: "long_desc": "", 2024-09-21T03:54:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: "tags": [], 2024-09-21T03:54:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: "see_also": [] 2024-09-21T03:54:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: "services": { 2024-09-21T03:54:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: "dashboard": "https://172.21.15.84:8443/" 2024-09-21T03:54:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: "always_on_modules": { 2024-09-21T03:54:05.710 INFO:teuthology.orchestra.run.smithi084.stdout: "octopus": [ 2024-09-21T03:54:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "balancer", 2024-09-21T03:54:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-09-21T03:54:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "devicehealth", 2024-09-21T03:54:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator", 2024-09-21T03:54:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_autoscaler", 2024-09-21T03:54:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "progress", 2024-09-21T03:54:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_support", 2024-09-21T03:54:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "status", 2024-09-21T03:54:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "telemetry", 2024-09-21T03:54:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "volumes" 2024-09-21T03:54:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "pacific": [ 2024-09-21T03:54:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "balancer", 2024-09-21T03:54:05.711 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-09-21T03:54:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "devicehealth", 2024-09-21T03:54:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator", 2024-09-21T03:54:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_autoscaler", 2024-09-21T03:54:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "progress", 2024-09-21T03:54:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_support", 2024-09-21T03:54:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "status", 2024-09-21T03:54:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "telemetry", 2024-09-21T03:54:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "volumes" 2024-09-21T03:54:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "quincy": [ 2024-09-21T03:54:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "balancer", 2024-09-21T03:54:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-09-21T03:54:05.712 INFO:teuthology.orchestra.run.smithi084.stdout: "devicehealth", 2024-09-21T03:54:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator", 2024-09-21T03:54:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_autoscaler", 2024-09-21T03:54:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "progress", 2024-09-21T03:54:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_support", 2024-09-21T03:54:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "status", 2024-09-21T03:54:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "telemetry", 2024-09-21T03:54:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "volumes" 2024-09-21T03:54:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "reef": [ 2024-09-21T03:54:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "balancer", 2024-09-21T03:54:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-09-21T03:54:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "devicehealth", 2024-09-21T03:54:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator", 2024-09-21T03:54:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_autoscaler", 2024-09-21T03:54:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "progress", 2024-09-21T03:54:05.713 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_support", 2024-09-21T03:54:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "status", 2024-09-21T03:54:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "telemetry", 2024-09-21T03:54:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "volumes" 2024-09-21T03:54:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: ], 2024-09-21T03:54:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "squid": [ 2024-09-21T03:54:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "balancer", 2024-09-21T03:54:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "crash", 2024-09-21T03:54:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "devicehealth", 2024-09-21T03:54:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "orchestrator", 2024-09-21T03:54:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "pg_autoscaler", 2024-09-21T03:54:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "progress", 2024-09-21T03:54:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "rbd_support", 2024-09-21T03:54:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "status", 2024-09-21T03:54:05.714 INFO:teuthology.orchestra.run.smithi084.stdout: "telemetry", 2024-09-21T03:54:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "volumes" 2024-09-21T03:54:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T03:54:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "last_failure_osd_epoch": 5, 2024-09-21T03:54:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "active_clients": [ 2024-09-21T03:54:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "devicehealth", 2024-09-21T03:54:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2024-09-21T03:54:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2024-09-21T03:54:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2024-09-21T03:54:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 3075077729 2024-09-21T03:54:05.715 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T03:54:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "libcephsqlite", 2024-09-21T03:54:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2024-09-21T03:54:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2024-09-21T03:54:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2024-09-21T03:54:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 1572103713 2024-09-21T03:54:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T03:54:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "rbd_support", 2024-09-21T03:54:05.716 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2024-09-21T03:54:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2024-09-21T03:54:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2024-09-21T03:54:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 2971969843 2024-09-21T03:54:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T03:54:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snap_schedule", 2024-09-21T03:54:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2024-09-21T03:54:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2024-09-21T03:54:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2024-09-21T03:54:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 1795957191 2024-09-21T03:54:05.717 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T03:54:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "snap_schedule", 2024-09-21T03:54:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2024-09-21T03:54:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2024-09-21T03:54:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2024-09-21T03:54:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 3451612870 2024-09-21T03:54:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T03:54:05.718 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: "name": "volumes", 2024-09-21T03:54:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: "addrvec": [ 2024-09-21T03:54:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: { 2024-09-21T03:54:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: "type": "v2", 2024-09-21T03:54:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: "addr": "172.21.15.84:0", 2024-09-21T03:54:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: "nonce": 176497640 2024-09-21T03:54:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T03:54:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:05.719 INFO:teuthology.orchestra.run.smithi084.stdout: ] 2024-09-21T03:54:05.719 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:54:05.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:04.166+0000 7f1676a30640 1 -- 172.21.15.84:0/4065127164 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f165c0b6680 msgr2=0x7f165c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:05.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:04.166+0000 7f1676a30640 1 --2- 172.21.15.84:0/4065127164 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f165c0b6680 0x7f165c0b8b90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f167006a410 tx=0x7f1658005ec0 comp rx=0 tx=0).stop 2024-09-21T03:54:05.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:04.166+0000 7f1676a30640 1 -- 172.21.15.84:0/4065127164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16701029d0 msgr2=0x7f167019a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:05.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:04.166+0000 7f1676a30640 1 --2- 172.21.15.84:0/4065127164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16701029d0 0x7f167019a4c0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f1660006010 tx=0x7f16600042f0 comp rx=0 tx=0).stop 2024-09-21T03:54:05.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:04.166+0000 7f1676a30640 1 -- 172.21.15.84:0/4065127164 shutdown_connections 2024-09-21T03:54:05.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:04.166+0000 7f1676a30640 1 --2- 172.21.15.84:0/4065127164 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f165c0b6680 0x7f165c0b8b90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:05.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:04.166+0000 7f1676a30640 1 --2- 172.21.15.84:0/4065127164 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1670108c50 0x7f167019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:05.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:04.166+0000 7f1676a30640 1 --2- 172.21.15.84:0/4065127164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1670108300 0x7f167019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:05.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:04.166+0000 7f1676a30640 1 --2- 172.21.15.84:0/4065127164 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f16701029d0 0x7f167019a4c0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:05.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:04.166+0000 7f1676a30640 1 -- 172.21.15.84:0/4065127164 >> 172.21.15.84:0/4065127164 conn(0x7f167007a680 msgr2=0x7f16701019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:05.721 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:04.166+0000 7f1676a30640 1 -- 172.21.15.84:0/4065127164 shutdown_connections 2024-09-21T03:54:05.722 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:04.166+0000 7f1676a30640 1 -- 172.21.15.84:0/4065127164 wait complete. 2024-09-21T03:54:05.782 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T03:54:05.783 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T03:54:05.783 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:04 smithi084 ceph-mon[30941]: pgmap v681: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-09-21T03:54:05.783 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:04 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2536396290' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T03:54:05.784 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:04 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/708659519' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T03:54:05.784 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:04 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/4065127164' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T03:54:05.784 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:04 smithi172 ceph-mon[34821]: pgmap v681: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-09-21T03:54:05.784 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:04 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2536396290' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T03:54:05.785 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:04 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/708659519' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T03:54:05.785 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:04 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/4065127164' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T03:54:05.785 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:04 smithi174 ceph-mon[34403]: pgmap v681: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-09-21T03:54:05.785 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:04 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2536396290' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T03:54:05.785 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:04 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/708659519' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T03:54:05.785 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:04 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/4065127164' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T03:54:06.040 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:06.458 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:06 smithi084 ceph-mon[30941]: pgmap v682: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 24 op/s 2024-09-21T03:54:06.582 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:54:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:54:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 229, 2024-09-21T03:54:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 222, 2024-09-21T03:54:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 1149072, 2024-09-21T03:54:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 136864, 2024-09-21T03:54:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 4, 2024-09-21T03:54:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 0, 2024-09-21T03:54:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.043822280, 2024-09-21T03:54:06.582 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.020548029, 2024-09-21T03:54:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.031989581, 2024-09-21T03:54:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:54:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 221, 2024-09-21T03:54:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.013701218, 2024-09-21T03:54:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000061996 2024-09-21T03:54:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T03:54:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T03:54:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T03:54:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 1149072, 2024-09-21T03:54:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 136864 2024-09-21T03:54:06.583 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:54:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 5, 2024-09-21T03:54:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 171, 2024-09-21T03:54:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 3200, 2024-09-21T03:54:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 110480, 2024-09-21T03:54:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 3, 2024-09-21T03:54:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 2, 2024-09-21T03:54:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.018845738, 2024-09-21T03:54:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.013797168, 2024-09-21T03:54:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.003368553, 2024-09-21T03:54:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:54:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 170, 2024-09-21T03:54:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.014299552, 2024-09-21T03:54:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000084115 2024-09-21T03:54:06.584 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T03:54:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T03:54:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T03:54:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-09-21T03:54:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 110480 2024-09-21T03:54:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:54:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 0, 2024-09-21T03:54:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 2, 2024-09-21T03:54:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 0, 2024-09-21T03:54:06.585 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 0, 2024-09-21T03:54:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 2, 2024-09-21T03:54:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 1, 2024-09-21T03:54:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.000353626, 2024-09-21T03:54:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T03:54:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.000293218, 2024-09-21T03:54:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:54:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T03:54:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T03:54:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T03:54:06.586 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T03:54:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T03:54:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T03:54:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T03:54:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T03:54:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2024-09-21T03:54:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 0, 2024-09-21T03:54:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2024-09-21T03:54:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:06.587 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2024-09-21T03:54:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:54:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 0, 2024-09-21T03:54:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:54:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:54:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:54:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:54:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:54:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:54:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:54:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:54:06.588 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:54:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:54:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:54:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:54:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:54:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_items": 0, 2024-09-21T03:54:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:54:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_items": 0, 2024-09-21T03:54:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:54:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:54:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:54:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:54:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:54:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:54:06.589 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:54:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2024-09-21T03:54:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:54:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:54:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:54:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2024-09-21T03:54:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2024-09-21T03:54:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2024-09-21T03:54:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:54:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:54:06.590 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:54:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:54:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 149001, 2024-09-21T03:54:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 31, 2024-09-21T03:54:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:54:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2024-09-21T03:54:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2024-09-21T03:54:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2024-09-21T03:54:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:54:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2024-09-21T03:54:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:54:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2024-09-21T03:54:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 0, 2024-09-21T03:54:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 0, 2024-09-21T03:54:06.591 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:54:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:54:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2024-09-21T03:54:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2024-09-21T03:54:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 968, 2024-09-21T03:54:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 2, 2024-09-21T03:54:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2024-09-21T03:54:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2024-09-21T03:54:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2024-09-21T03:54:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2024-09-21T03:54:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:54:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-21T03:54:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-21T03:54:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-21T03:54:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 230, 2024-09-21T03:54:06.592 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 1116697, 2024-09-21T03:54:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 230, 2024-09-21T03:54:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-21T03:54:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-21T03:54:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 230, 2024-09-21T03:54:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 1116697, 2024-09-21T03:54:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-21T03:54:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T03:54:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T03:54:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T03:54:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:06.593 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:06.593 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:54:06.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:06 smithi172 ceph-mon[34821]: pgmap v682: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 24 op/s 2024-09-21T03:54:06.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:06 smithi174 ceph-mon[34403]: pgmap v682: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 24 op/s 2024-09-21T03:54:07.301 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-21T03:54:07.301 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-21T03:54:07.301 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-21T03:54:07.301 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-21T03:54:07.301 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-21T03:54:07.301 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-21T03:54:07.301 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-21T03:54:07.301 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T03:54:07.301 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T03:54:07.548 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:08.120 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:54:08.120 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:54:08.120 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 4, 2024-09-21T03:54:08.120 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 4, 2024-09-21T03:54:08.120 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 3040, 2024-09-21T03:54:08.120 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 448, 2024-09-21T03:54:08.121 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 4, 2024-09-21T03:54:08.121 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 0, 2024-09-21T03:54:08.121 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.003031537, 2024-09-21T03:54:08.121 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.000038323, 2024-09-21T03:54:08.121 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.002139091, 2024-09-21T03:54:08.121 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:54:08.121 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:08.121 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 3, 2024-09-21T03:54:08.121 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.003849290, 2024-09-21T03:54:08.121 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.001283096 2024-09-21T03:54:08.121 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:08.121 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:08.121 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T03:54:08.122 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T03:54:08.122 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T03:54:08.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:08.122 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-21T03:54:08.122 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T03:54:08.122 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:08.122 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:54:08.122 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 1, 2024-09-21T03:54:08.122 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 173, 2024-09-21T03:54:08.122 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 160, 2024-09-21T03:54:08.122 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 110736, 2024-09-21T03:54:08.122 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 3, 2024-09-21T03:54:08.122 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 2, 2024-09-21T03:54:08.122 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.018598048, 2024-09-21T03:54:08.123 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.014795745, 2024-09-21T03:54:08.123 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.001925436, 2024-09-21T03:54:08.123 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:54:08.123 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:08.123 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 171, 2024-09-21T03:54:08.123 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.010141724, 2024-09-21T03:54:08.123 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000059308 2024-09-21T03:54:08.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:08.123 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:08.123 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T03:54:08.123 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T03:54:08.123 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T03:54:08.123 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:08.123 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T03:54:08.124 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 110736 2024-09-21T03:54:08.124 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:08.124 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:54:08.124 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 235, 2024-09-21T03:54:08.124 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 228, 2024-09-21T03:54:08.124 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 1150768, 2024-09-21T03:54:08.124 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 140224, 2024-09-21T03:54:08.124 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 2, 2024-09-21T03:54:08.124 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 1, 2024-09-21T03:54:08.124 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.043842077, 2024-09-21T03:54:08.124 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.021002857, 2024-09-21T03:54:08.124 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.032572913, 2024-09-21T03:54:08.124 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:54:08.124 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:08.125 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 227, 2024-09-21T03:54:08.125 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.013076594, 2024-09-21T03:54:08.125 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000057606 2024-09-21T03:54:08.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:08.125 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:08.125 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T03:54:08.125 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T03:54:08.125 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T03:54:08.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:08.125 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 1150768, 2024-09-21T03:54:08.125 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 140224 2024-09-21T03:54:08.125 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:08.125 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2024-09-21T03:54:08.125 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 0, 2024-09-21T03:54:08.125 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2024-09-21T03:54:08.126 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:08.126 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2024-09-21T03:54:08.126 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:54:08.126 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 0, 2024-09-21T03:54:08.126 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:54:08.126 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:54:08.126 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:54:08.126 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:54:08.126 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:54:08.126 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:54:08.126 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:54:08.126 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:54:08.126 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:54:08.126 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:54:08.127 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:54:08.127 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:54:08.127 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:54:08.127 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_items": 0, 2024-09-21T03:54:08.127 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:54:08.127 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_items": 0, 2024-09-21T03:54:08.127 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:54:08.127 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:54:08.127 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:54:08.127 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:54:08.127 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:54:08.127 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:54:08.127 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:54:08.127 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2024-09-21T03:54:08.128 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:54:08.128 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:54:08.128 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:54:08.128 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2024-09-21T03:54:08.128 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2024-09-21T03:54:08.128 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2024-09-21T03:54:08.128 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:54:08.128 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:54:08.128 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:54:08.128 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:54:08.128 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 148984, 2024-09-21T03:54:08.128 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 30, 2024-09-21T03:54:08.128 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:54:08.128 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2024-09-21T03:54:08.128 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2024-09-21T03:54:08.129 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2024-09-21T03:54:08.129 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:54:08.129 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2024-09-21T03:54:08.129 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:54:08.129 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2024-09-21T03:54:08.129 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 0, 2024-09-21T03:54:08.129 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 0, 2024-09-21T03:54:08.129 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:54:08.129 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:54:08.129 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2024-09-21T03:54:08.129 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2024-09-21T03:54:08.129 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 968, 2024-09-21T03:54:08.129 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 2, 2024-09-21T03:54:08.129 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2024-09-21T03:54:08.129 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2024-09-21T03:54:08.130 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2024-09-21T03:54:08.130 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2024-09-21T03:54:08.130 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:08.130 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:54:08.130 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-21T03:54:08.130 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-21T03:54:08.130 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-21T03:54:08.130 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 236, 2024-09-21T03:54:08.130 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 1117541, 2024-09-21T03:54:08.130 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:08.130 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 236, 2024-09-21T03:54:08.130 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-21T03:54:08.130 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-21T03:54:08.131 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 236, 2024-09-21T03:54:08.131 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 1117541, 2024-09-21T03:54:08.131 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-21T03:54:08.131 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T03:54:08.131 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T03:54:08.131 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T03:54:08.131 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:08.131 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:08.131 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:54:08.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:08 smithi172 ceph-mon[34821]: pgmap v683: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-21T03:54:08.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:08 smithi084 ceph-mon[30941]: pgmap v683: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-21T03:54:08.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:08 smithi174 ceph-mon[34403]: pgmap v683: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 47 KiB/s wr, 23 op/s 2024-09-21T03:54:08.994 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-21T03:54:08.994 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-21T03:54:08.994 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-21T03:54:08.994 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-21T03:54:08.994 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-21T03:54:08.994 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-21T03:54:08.994 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-21T03:54:08.994 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T03:54:08.995 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T03:54:09.242 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:09.790 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:54:09.790 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:54:09.790 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 0, 2024-09-21T03:54:09.791 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 2, 2024-09-21T03:54:09.791 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 0, 2024-09-21T03:54:09.791 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 0, 2024-09-21T03:54:09.791 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 4, 2024-09-21T03:54:09.791 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 0, 2024-09-21T03:54:09.791 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.001075807, 2024-09-21T03:54:09.791 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T03:54:09.791 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.000218623, 2024-09-21T03:54:09.791 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:54:09.791 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:09.791 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T03:54:09.791 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T03:54:09.791 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T03:54:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T03:54:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T03:54:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T03:54:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T03:54:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T03:54:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:54:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 5, 2024-09-21T03:54:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 173, 2024-09-21T03:54:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 3200, 2024-09-21T03:54:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 110832, 2024-09-21T03:54:09.792 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 3, 2024-09-21T03:54:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 2, 2024-09-21T03:54:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.018525615, 2024-09-21T03:54:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.013655543, 2024-09-21T03:54:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.003179659, 2024-09-21T03:54:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:54:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 172, 2024-09-21T03:54:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.013518378, 2024-09-21T03:54:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000078595 2024-09-21T03:54:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T03:54:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T03:54:09.793 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T03:54:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-09-21T03:54:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 110832 2024-09-21T03:54:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:54:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 231, 2024-09-21T03:54:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 224, 2024-09-21T03:54:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 1149616, 2024-09-21T03:54:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 138144, 2024-09-21T03:54:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 2, 2024-09-21T03:54:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 1, 2024-09-21T03:54:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.042248509, 2024-09-21T03:54:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.020235581, 2024-09-21T03:54:09.794 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.030614075, 2024-09-21T03:54:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:54:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 223, 2024-09-21T03:54:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.012401524, 2024-09-21T03:54:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000055612 2024-09-21T03:54:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T03:54:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T03:54:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T03:54:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 1149616, 2024-09-21T03:54:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 138144 2024-09-21T03:54:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:09.795 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2024-09-21T03:54:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 0, 2024-09-21T03:54:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2024-09-21T03:54:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2024-09-21T03:54:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:54:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 0, 2024-09-21T03:54:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:54:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:54:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:54:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:54:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:54:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:54:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:54:09.796 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:54:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:54:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:54:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:54:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:54:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:54:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_items": 0, 2024-09-21T03:54:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:54:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_items": 0, 2024-09-21T03:54:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:54:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:54:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:54:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:54:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:54:09.797 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:54:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:54:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2024-09-21T03:54:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:54:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:54:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:54:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2024-09-21T03:54:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2024-09-21T03:54:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2024-09-21T03:54:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:54:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:54:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:54:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:54:09.798 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 148984, 2024-09-21T03:54:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 30, 2024-09-21T03:54:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:54:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2024-09-21T03:54:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2024-09-21T03:54:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2024-09-21T03:54:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:54:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2024-09-21T03:54:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:54:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2024-09-21T03:54:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 0, 2024-09-21T03:54:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 0, 2024-09-21T03:54:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:54:09.799 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:54:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2024-09-21T03:54:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2024-09-21T03:54:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 968, 2024-09-21T03:54:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 2, 2024-09-21T03:54:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2024-09-21T03:54:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2024-09-21T03:54:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2024-09-21T03:54:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2024-09-21T03:54:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:54:09.800 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-21T03:54:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-21T03:54:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-21T03:54:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 232, 2024-09-21T03:54:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 1116957, 2024-09-21T03:54:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 232, 2024-09-21T03:54:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-21T03:54:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-21T03:54:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 232, 2024-09-21T03:54:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 1116957, 2024-09-21T03:54:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-21T03:54:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T03:54:09.801 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T03:54:09.802 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T03:54:09.802 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:09.802 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:09.802 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:54:10.593 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-21T03:54:10.593 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-21T03:54:10.593 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-21T03:54:10.593 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-21T03:54:10.593 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-21T03:54:10.594 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-21T03:54:10.594 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-21T03:54:10.594 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T03:54:10.594 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T03:54:10.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:10 smithi084 ceph-mon[30941]: pgmap v684: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 24 op/s 2024-09-21T03:54:10.841 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:10.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:10 smithi174 ceph-mon[34403]: pgmap v684: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 24 op/s 2024-09-21T03:54:10.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:10 smithi172 ceph-mon[34821]: pgmap v684: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 24 op/s 2024-09-21T03:54:11.364 INFO:teuthology.orchestra.run.smithi084.stdout:{ 2024-09-21T03:54:11.365 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:54:11.365 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 0, 2024-09-21T03:54:11.365 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 2, 2024-09-21T03:54:11.365 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 0, 2024-09-21T03:54:11.365 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 0, 2024-09-21T03:54:11.365 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 4, 2024-09-21T03:54:11.366 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 0, 2024-09-21T03:54:11.366 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.001539620, 2024-09-21T03:54:11.366 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T03:54:11.366 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.000447615, 2024-09-21T03:54:11.366 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:54:11.366 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:11.366 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T03:54:11.367 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T03:54:11.367 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T03:54:11.367 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:11.367 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:11.367 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T03:54:11.367 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T03:54:11.368 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T03:54:11.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:11.368 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T03:54:11.368 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T03:54:11.368 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:11.368 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:54:11.368 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 241, 2024-09-21T03:54:11.368 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 232, 2024-09-21T03:54:11.368 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 1154352, 2024-09-21T03:54:11.368 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 141952, 2024-09-21T03:54:11.368 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 2, 2024-09-21T03:54:11.368 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 1, 2024-09-21T03:54:11.369 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.046199286, 2024-09-21T03:54:11.369 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.021323936, 2024-09-21T03:54:11.369 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.033301934, 2024-09-21T03:54:11.369 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:54:11.369 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:11.369 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 232, 2024-09-21T03:54:11.369 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.018491648, 2024-09-21T03:54:11.369 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000079705 2024-09-21T03:54:11.369 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:11.369 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:11.369 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T03:54:11.369 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T03:54:11.370 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T03:54:11.370 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:11.370 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 1154352, 2024-09-21T03:54:11.370 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 141952 2024-09-21T03:54:11.370 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:11.370 INFO:teuthology.orchestra.run.smithi084.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:54:11.370 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_messages": 1, 2024-09-21T03:54:11.370 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages": 175, 2024-09-21T03:54:11.370 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_bytes": 160, 2024-09-21T03:54:11.370 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_bytes": 111088, 2024-09-21T03:54:11.371 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_created_connections": 3, 2024-09-21T03:54:11.371 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_active_connections": 2, 2024-09-21T03:54:11.371 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_total_time": 0.018075296, 2024-09-21T03:54:11.371 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_send_time": 0.014305489, 2024-09-21T03:54:11.371 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_recv_time": 0.001952413, 2024-09-21T03:54:11.371 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:54:11.371 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:11.371 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 173, 2024-09-21T03:54:11.371 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.011332019, 2024-09-21T03:54:11.372 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000065503 2024-09-21T03:54:11.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:11.372 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:11.372 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T03:54:11.372 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T03:54:11.372 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T03:54:11.372 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:11.372 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T03:54:11.373 INFO:teuthology.orchestra.run.smithi084.stdout: "msgr_send_encrypted_bytes": 111088 2024-09-21T03:54:11.373 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:11.373 INFO:teuthology.orchestra.run.smithi084.stdout: "cct": { 2024-09-21T03:54:11.373 INFO:teuthology.orchestra.run.smithi084.stdout: "total_workers": 0, 2024-09-21T03:54:11.373 INFO:teuthology.orchestra.run.smithi084.stdout: "unhealthy_workers": 0 2024-09-21T03:54:11.373 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:11.373 INFO:teuthology.orchestra.run.smithi084.stdout: "mempool": { 2024-09-21T03:54:11.373 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:54:11.373 INFO:teuthology.orchestra.run.smithi084.stdout: "bloom_filter_items": 0, 2024-09-21T03:54:11.373 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:54:11.373 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:54:11.374 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:54:11.374 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:54:11.374 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:54:11.374 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:54:11.374 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:54:11.374 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:54:11.374 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:54:11.374 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:54:11.374 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:54:11.374 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:54:11.374 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:54:11.374 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_extent_items": 0, 2024-09-21T03:54:11.374 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:54:11.375 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_blob_items": 0, 2024-09-21T03:54:11.375 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:54:11.375 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:54:11.375 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:54:11.375 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:54:11.375 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:54:11.375 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:54:11.375 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:54:11.375 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_txc_items": 0, 2024-09-21T03:54:11.375 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:54:11.376 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:54:11.376 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:54:11.376 INFO:teuthology.orchestra.run.smithi084.stdout: "bluestore_writing_items": 0, 2024-09-21T03:54:11.376 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_bytes": 0, 2024-09-21T03:54:11.376 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_items": 0, 2024-09-21T03:54:11.376 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:54:11.376 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:54:11.376 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:54:11.376 INFO:teuthology.orchestra.run.smithi084.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:54:11.377 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_bytes": 148967, 2024-09-21T03:54:11.377 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_anon_items": 29, 2024-09-21T03:54:11.377 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:54:11.377 INFO:teuthology.orchestra.run.smithi084.stdout: "buffer_meta_items": 0, 2024-09-21T03:54:11.377 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_bytes": 0, 2024-09-21T03:54:11.377 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_items": 0, 2024-09-21T03:54:11.377 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:54:11.377 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_mapbl_items": 0, 2024-09-21T03:54:11.378 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:54:11.378 INFO:teuthology.orchestra.run.smithi084.stdout: "osd_pglog_items": 0, 2024-09-21T03:54:11.378 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_bytes": 0, 2024-09-21T03:54:11.378 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_items": 0, 2024-09-21T03:54:11.378 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:54:11.378 INFO:teuthology.orchestra.run.smithi084.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:54:11.378 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_bytes": 0, 2024-09-21T03:54:11.378 INFO:teuthology.orchestra.run.smithi084.stdout: "pgmap_items": 0, 2024-09-21T03:54:11.378 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_bytes": 968, 2024-09-21T03:54:11.378 INFO:teuthology.orchestra.run.smithi084.stdout: "mds_co_items": 2, 2024-09-21T03:54:11.379 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_bytes": 0, 2024-09-21T03:54:11.379 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_1_items": 0, 2024-09-21T03:54:11.379 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_bytes": 0, 2024-09-21T03:54:11.379 INFO:teuthology.orchestra.run.smithi084.stdout: "unittest_2_items": 0 2024-09-21T03:54:11.379 INFO:teuthology.orchestra.run.smithi084.stdout: }, 2024-09-21T03:54:11.379 INFO:teuthology.orchestra.run.smithi084.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:54:11.379 INFO:teuthology.orchestra.run.smithi084.stdout: "val": 0, 2024-09-21T03:54:11.379 INFO:teuthology.orchestra.run.smithi084.stdout: "max": 104857600, 2024-09-21T03:54:11.379 INFO:teuthology.orchestra.run.smithi084.stdout: "get_started": 0, 2024-09-21T03:54:11.379 INFO:teuthology.orchestra.run.smithi084.stdout: "get": 238, 2024-09-21T03:54:11.379 INFO:teuthology.orchestra.run.smithi084.stdout: "get_sum": 1117801, 2024-09-21T03:54:11.380 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:11.380 INFO:teuthology.orchestra.run.smithi084.stdout: "get_or_fail_success": 238, 2024-09-21T03:54:11.380 INFO:teuthology.orchestra.run.smithi084.stdout: "take": 0, 2024-09-21T03:54:11.380 INFO:teuthology.orchestra.run.smithi084.stdout: "take_sum": 0, 2024-09-21T03:54:11.380 INFO:teuthology.orchestra.run.smithi084.stdout: "put": 238, 2024-09-21T03:54:11.380 INFO:teuthology.orchestra.run.smithi084.stdout: "put_sum": 1117801, 2024-09-21T03:54:11.380 INFO:teuthology.orchestra.run.smithi084.stdout: "wait": { 2024-09-21T03:54:11.380 INFO:teuthology.orchestra.run.smithi084.stdout: "avgcount": 0, 2024-09-21T03:54:11.381 INFO:teuthology.orchestra.run.smithi084.stdout: "sum": 0.000000000, 2024-09-21T03:54:11.381 INFO:teuthology.orchestra.run.smithi084.stdout: "avgtime": 0.000000000 2024-09-21T03:54:11.381 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:11.381 INFO:teuthology.orchestra.run.smithi084.stdout: } 2024-09-21T03:54:11.381 INFO:teuthology.orchestra.run.smithi084.stdout:} 2024-09-21T03:54:11.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:11 smithi084 ceph-mon[30941]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T03:54:11.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:11 smithi174 ceph-mon[34403]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T03:54:11.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:11 smithi172 ceph-mon[34821]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T03:54:12.178 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T03:54:12.178 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T03:54:12.178 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-21T03:54:12.178 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-21T03:54:12.178 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-21T03:54:12.178 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-21T03:54:12.178 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-21T03:54:12.178 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T03:54:12.179 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T03:54:12.444 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:54:12.565 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:12 smithi172 ceph-mon[34821]: pgmap v686: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-09-21T03:54:12.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:12 smithi084 ceph-mon[30941]: pgmap v686: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-09-21T03:54:12.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:12 smithi174 ceph-mon[34403]: pgmap v686: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-09-21T03:54:12.985 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-21T03:54:12.985 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:54:12.986 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 2550, 2024-09-21T03:54:12.986 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 2590, 2024-09-21T03:54:12.986 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 1952954, 2024-09-21T03:54:12.986 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 6803721, 2024-09-21T03:54:12.986 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 142, 2024-09-21T03:54:12.986 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 3, 2024-09-21T03:54:12.986 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.340799837, 2024-09-21T03:54:12.986 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.132845502, 2024-09-21T03:54:12.986 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.172189429, 2024-09-21T03:54:12.986 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.038999566, 2024-09-21T03:54:12.986 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:12.986 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2592, 2024-09-21T03:54:12.987 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.407420479, 2024-09-21T03:54:12.987 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000157183 2024-09-21T03:54:12.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:12.987 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:12.987 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1658, 2024-09-21T03:54:12.987 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000372392, 2024-09-21T03:54:12.987 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000224 2024-09-21T03:54:12.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:12.987 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1249424, 2024-09-21T03:54:12.987 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 172624 2024-09-21T03:54:12.987 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:12.987 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:54:12.987 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 3763, 2024-09-21T03:54:12.987 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 5007, 2024-09-21T03:54:12.988 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 1340048, 2024-09-21T03:54:12.988 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 9550543, 2024-09-21T03:54:12.988 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 19, 2024-09-21T03:54:12.988 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 8, 2024-09-21T03:54:12.988 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.593156560, 2024-09-21T03:54:12.988 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.256963834, 2024-09-21T03:54:12.988 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.214812900, 2024-09-21T03:54:12.988 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.121850891, 2024-09-21T03:54:12.988 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:12.988 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5002, 2024-09-21T03:54:12.988 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.585382930, 2024-09-21T03:54:12.988 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000117029 2024-09-21T03:54:12.988 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:12.988 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:12.989 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 6053, 2024-09-21T03:54:12.989 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.001502599, 2024-09-21T03:54:12.989 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000248 2024-09-21T03:54:12.989 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:12.989 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 405488, 2024-09-21T03:54:12.989 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 536144 2024-09-21T03:54:12.989 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:12.989 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:54:12.989 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 2391, 2024-09-21T03:54:12.989 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 2531, 2024-09-21T03:54:12.989 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 688769, 2024-09-21T03:54:12.989 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 13557521, 2024-09-21T03:54:12.990 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 22, 2024-09-21T03:54:12.990 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 6, 2024-09-21T03:54:12.990 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.293294512, 2024-09-21T03:54:12.990 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.149182186, 2024-09-21T03:54:12.990 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.092411876, 2024-09-21T03:54:12.990 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.048995336, 2024-09-21T03:54:12.990 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:12.990 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2530, 2024-09-21T03:54:12.990 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.276952149, 2024-09-21T03:54:12.990 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000109467 2024-09-21T03:54:12.990 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:12.990 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:12.990 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1479, 2024-09-21T03:54:12.991 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000405022, 2024-09-21T03:54:12.991 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000273 2024-09-21T03:54:12.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:12.991 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-21T03:54:12.991 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T03:54:12.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:12.991 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-21T03:54:12.991 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-09-21T03:54:12.991 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-21T03:54:12.991 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:12.991 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-09-21T03:54:12.991 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-21T03:54:12.991 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-21T03:54:12.992 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5181, 2024-09-21T03:54:12.992 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.604249801, 2024-09-21T03:54:12.992 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000309640 2024-09-21T03:54:12.992 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:12.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:12.992 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-09-21T03:54:12.992 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-21T03:54:12.992 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-21T03:54:12.992 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 16, 2024-09-21T03:54:12.992 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000416799, 2024-09-21T03:54:12.992 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000026049 2024-09-21T03:54:12.992 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:12.992 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:12.992 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-09-21T03:54:12.992 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 781, 2024-09-21T03:54:12.993 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 781, 2024-09-21T03:54:12.993 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-09-21T03:54:12.993 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 781, 2024-09-21T03:54:12.993 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 3.523324927, 2024-09-21T03:54:12.993 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.004511299 2024-09-21T03:54:12.993 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:12.993 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-09-21T03:54:12.993 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2024-09-21T03:54:12.993 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-09-21T03:54:12.993 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-09-21T03:54:12.993 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 12, 2024-09-21T03:54:12.993 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-09-21T03:54:12.993 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-09-21T03:54:12.993 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 40, 2024-09-21T03:54:12.994 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2024-09-21T03:54:12.994 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 40, 2024-09-21T03:54:12.994 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-09-21T03:54:12.994 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 39, 2024-09-21T03:54:12.994 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-09-21T03:54:12.994 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 3, 2024-09-21T03:54:12.994 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 3, 2024-09-21T03:54:12.994 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 2, 2024-09-21T03:54:12.994 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 936, 2024-09-21T03:54:12.994 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 927, 2024-09-21T03:54:12.994 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-09-21T03:54:12.994 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2024-09-21T03:54:12.994 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-09-21T03:54:12.994 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-09-21T03:54:12.995 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-09-21T03:54:12.995 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-09-21T03:54:12.995 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-09-21T03:54:12.995 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-09-21T03:54:12.995 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-09-21T03:54:12.995 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-09-21T03:54:12.995 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-09-21T03:54:12.995 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-09-21T03:54:12.995 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 273, 2024-09-21T03:54:12.995 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-09-21T03:54:12.995 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 4, 2024-09-21T03:54:12.995 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 234, 2024-09-21T03:54:12.995 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 6, 2024-09-21T03:54:12.995 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 273, 2024-09-21T03:54:12.996 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-09-21T03:54:12.996 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T03:54:12.996 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-09-21T03:54:12.996 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 176, 2024-09-21T03:54:12.996 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 20, 2024-09-21T03:54:12.996 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 156, 2024-09-21T03:54:12.996 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 97, 2024-09-21T03:54:12.996 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-09-21T03:54:12.996 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 651, 2024-09-21T03:54:12.996 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 630, 2024-09-21T03:54:12.996 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 599, 2024-09-21T03:54:12.996 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T03:54:12.996 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T03:54:12.996 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 731, 2024-09-21T03:54:12.996 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 689, 2024-09-21T03:54:12.997 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 3, 2024-09-21T03:54:12.997 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 621 2024-09-21T03:54:12.997 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:12.997 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-09-21T03:54:12.997 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 8, 2024-09-21T03:54:12.997 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-09-21T03:54:12.997 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-09-21T03:54:12.997 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2024-09-21T03:54:12.997 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 16, 2024-09-21T03:54:12.997 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 2, 2024-09-21T03:54:12.997 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-09-21T03:54:12.997 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-09-21T03:54:12.997 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 3, 2024-09-21T03:54:12.997 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 1, 2024-09-21T03:54:12.997 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-09-21T03:54:12.998 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-09-21T03:54:12.998 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-09-21T03:54:12.998 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-09-21T03:54:12.998 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-09-21T03:54:12.998 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-09-21T03:54:12.998 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-09-21T03:54:12.998 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-09-21T03:54:12.998 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-09-21T03:54:12.998 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 20, 2024-09-21T03:54:12.998 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-09-21T03:54:12.998 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-09-21T03:54:12.998 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-09-21T03:54:12.998 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-09-21T03:54:12.998 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0, 2024-09-21T03:54:12.999 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_started": 0, 2024-09-21T03:54:12.999 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_succeeded": 0, 2024-09-21T03:54:12.999 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_write_failed": 0 2024-09-21T03:54:12.999 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:12.999 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-09-21T03:54:12.999 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-09-21T03:54:12.999 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 2288, 2024-09-21T03:54:12.999 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-09-21T03:54:12.999 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-09-21T03:54:12.999 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 2288, 2024-09-21T03:54:12.999 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-09-21T03:54:12.999 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-09-21T03:54:12.999 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 7, 2024-09-21T03:54:12.999 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-09-21T03:54:12.999 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-09-21T03:54:13.000 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 7, 2024-09-21T03:54:13.000 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 2, 2024-09-21T03:54:13.000 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-09-21T03:54:13.000 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-09-21T03:54:13.000 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-09-21T03:54:13.000 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 28305450, 2024-09-21T03:54:13.000 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2024-09-21T03:54:13.000 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-09-21T03:54:13.000 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2219, 2024-09-21T03:54:13.000 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 4.891551530, 2024-09-21T03:54:13.000 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002204394 2024-09-21T03:54:13.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.000 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2024-09-21T03:54:13.000 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.001 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-09-21T03:54:13.001 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 35, 2024-09-21T03:54:13.001 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 56, 2024-09-21T03:54:13.001 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 21, 2024-09-21T03:54:13.001 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 20, 2024-09-21T03:54:13.001 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 20, 2024-09-21T03:54:13.001 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 0, 2024-09-21T03:54:13.001 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 40, 2024-09-21T03:54:13.001 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 41, 2024-09-21T03:54:13.001 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 1, 2024-09-21T03:54:13.001 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 3, 2024-09-21T03:54:13.001 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 18, 2024-09-21T03:54:13.001 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 15, 2024-09-21T03:54:13.001 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 126360, 2024-09-21T03:54:13.001 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 339492864 2024-09-21T03:54:13.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.002 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-09-21T03:54:13.002 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 2041, 2024-09-21T03:54:13.002 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 1, 2024-09-21T03:54:13.002 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 781, 2024-09-21T03:54:13.002 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 29, 2024-09-21T03:54:13.002 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 2, 2024-09-21T03:54:13.002 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-09-21T03:54:13.002 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5, 2024-09-21T03:54:13.002 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.003820183, 2024-09-21T03:54:13.002 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000764036 2024-09-21T03:54:13.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.002 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-09-21T03:54:13.002 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 119, 2024-09-21T03:54:13.003 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.022048184, 2024-09-21T03:54:13.003 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000185278 2024-09-21T03:54:13.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.003 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-09-21T03:54:13.003 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.003 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.003 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.003 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-09-21T03:54:13.003 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.003 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.003 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.003 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-09-21T03:54:13.004 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.004 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.004 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.004 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-09-21T03:54:13.004 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.004 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.004 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.004 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-09-21T03:54:13.004 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-09-21T03:54:13.004 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000380553, 2024-09-21T03:54:13.004 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000380553 2024-09-21T03:54:13.004 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.004 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-09-21T03:54:13.005 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.005 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.005 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.005 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-09-21T03:54:13.005 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.005 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.005 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.005 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-09-21T03:54:13.005 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.005 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.005 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.005 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.006 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-09-21T03:54:13.006 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 12, 2024-09-21T03:54:13.006 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.001731881, 2024-09-21T03:54:13.006 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000144323 2024-09-21T03:54:13.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.006 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-09-21T03:54:13.006 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 8, 2024-09-21T03:54:13.007 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.012910506, 2024-09-21T03:54:13.007 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001613813 2024-09-21T03:54:13.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.007 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-09-21T03:54:13.007 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.007 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.007 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.007 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-09-21T03:54:13.007 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 12, 2024-09-21T03:54:13.007 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.063660083, 2024-09-21T03:54:13.007 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.005305006 2024-09-21T03:54:13.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.007 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-09-21T03:54:13.007 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-09-21T03:54:13.008 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000258500, 2024-09-21T03:54:13.008 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000258500 2024-09-21T03:54:13.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.008 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-09-21T03:54:13.008 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2024-09-21T03:54:13.008 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.004525749, 2024-09-21T03:54:13.008 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002262874 2024-09-21T03:54:13.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.008 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-09-21T03:54:13.008 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2024-09-21T03:54:13.008 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.002251100, 2024-09-21T03:54:13.008 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001125550 2024-09-21T03:54:13.008 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.008 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-09-21T03:54:13.009 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.009 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.009 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.009 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-09-21T03:54:13.009 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.009 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.009 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.009 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-09-21T03:54:13.009 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2024-09-21T03:54:13.009 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.012134511, 2024-09-21T03:54:13.009 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.006067255 2024-09-21T03:54:13.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.010 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-09-21T03:54:13.010 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 6, 2024-09-21T03:54:13.010 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.027267602, 2024-09-21T03:54:13.010 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.004544600 2024-09-21T03:54:13.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.010 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-09-21T03:54:13.010 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.010 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.010 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.010 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-09-21T03:54:13.010 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 600, 2024-09-21T03:54:13.010 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 3.345698904, 2024-09-21T03:54:13.010 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.005576164 2024-09-21T03:54:13.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.011 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-09-21T03:54:13.011 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.011 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.011 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.011 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-09-21T03:54:13.011 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.011 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.011 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.011 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-09-21T03:54:13.011 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.011 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.012 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.012 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-09-21T03:54:13.012 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 10, 2024-09-21T03:54:13.012 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.024329984, 2024-09-21T03:54:13.012 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002432998 2024-09-21T03:54:13.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.012 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-09-21T03:54:13.012 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.012 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.012 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.012 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-09-21T03:54:13.012 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-09-21T03:54:13.012 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.002307187, 2024-09-21T03:54:13.013 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002307187 2024-09-21T03:54:13.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.013 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-09-21T03:54:13.013 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-09-21T03:54:13.013 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-09-21T03:54:13.013 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.013 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.013 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.013 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:13.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.013 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-09-21T03:54:13.013 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 2, 2024-09-21T03:54:13.013 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 4, 2024-09-21T03:54:13.013 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 2, 2024-09-21T03:54:13.014 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 2, 2024-09-21T03:54:13.014 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-09-21T03:54:13.014 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 99, 2024-09-21T03:54:13.014 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 49, 2024-09-21T03:54:13.014 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 689, 2024-09-21T03:54:13.014 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-09-21T03:54:13.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.014 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-21T03:54:13.014 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:54:13.014 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-21T03:54:13.014 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:54:13.014 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:54:13.014 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:54:13.014 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:54:13.015 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:54:13.015 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:54:13.015 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:54:13.015 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:54:13.015 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:54:13.015 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:54:13.015 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:54:13.015 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:54:13.015 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:54:13.015 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-21T03:54:13.015 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:54:13.015 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-21T03:54:13.015 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:54:13.015 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:54:13.016 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:54:13.016 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:54:13.016 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:54:13.016 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:54:13.016 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:54:13.016 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-21T03:54:13.016 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:54:13.016 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:54:13.016 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:54:13.016 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-21T03:54:13.016 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-21T03:54:13.016 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-21T03:54:13.016 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:54:13.016 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:54:13.016 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:54:13.017 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:54:13.017 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 331089, 2024-09-21T03:54:13.017 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 131, 2024-09-21T03:54:13.017 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:54:13.017 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-21T03:54:13.017 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-21T03:54:13.017 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-21T03:54:13.017 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:54:13.017 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-21T03:54:13.017 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:54:13.017 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-21T03:54:13.017 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 7968, 2024-09-21T03:54:13.017 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 176, 2024-09-21T03:54:13.017 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:54:13.018 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:54:13.018 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-21T03:54:13.018 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-21T03:54:13.018 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 191823, 2024-09-21T03:54:13.018 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 1740, 2024-09-21T03:54:13.018 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-21T03:54:13.018 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-21T03:54:13.018 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-21T03:54:13.018 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-21T03:54:13.018 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.018 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-09-21T03:54:13.018 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-09-21T03:54:13.018 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-09-21T03:54:13.018 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 3756, 2024-09-21T03:54:13.019 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 24131969, 2024-09-21T03:54:13.019 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 37, 2024-09-21T03:54:13.019 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 3756, 2024-09-21T03:54:13.019 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-09-21T03:54:13.019 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3756, 2024-09-21T03:54:13.019 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 26.119356821, 2024-09-21T03:54:13.019 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.006954035 2024-09-21T03:54:13.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.019 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-09-21T03:54:13.019 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-09-21T03:54:13.019 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3756, 2024-09-21T03:54:13.019 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 3802 2024-09-21T03:54:13.019 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.019 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 3756, 2024-09-21T03:54:13.019 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 314, 2024-09-21T03:54:13.020 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 3442, 2024-09-21T03:54:13.020 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-09-21T03:54:13.020 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-09-21T03:54:13.020 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2024-09-21T03:54:13.020 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 11, 2024-09-21T03:54:13.020 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 21, 2024-09-21T03:54:13.020 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 2220, 2024-09-21T03:54:13.020 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 55, 2024-09-21T03:54:13.020 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-09-21T03:54:13.020 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-09-21T03:54:13.020 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-09-21T03:54:13.020 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-09-21T03:54:13.020 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 518, 2024-09-21T03:54:13.020 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-09-21T03:54:13.020 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-09-21T03:54:13.021 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-09-21T03:54:13.021 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 293, 2024-09-21T03:54:13.021 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 22, 2024-09-21T03:54:13.021 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-09-21T03:54:13.021 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-09-21T03:54:13.021 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-09-21T03:54:13.021 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-09-21T03:54:13.021 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-09-21T03:54:13.021 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-09-21T03:54:13.021 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T03:54:13.021 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-09-21T03:54:13.021 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-09-21T03:54:13.021 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 599, 2024-09-21T03:54:13.021 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-09-21T03:54:13.022 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-09-21T03:54:13.022 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-09-21T03:54:13.022 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-09-21T03:54:13.022 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-09-21T03:54:13.022 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-09-21T03:54:13.022 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-09-21T03:54:13.022 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-09-21T03:54:13.022 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-09-21T03:54:13.022 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-09-21T03:54:13.022 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-09-21T03:54:13.022 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-09-21T03:54:13.022 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-09-21T03:54:13.022 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-09-21T03:54:13.022 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-09-21T03:54:13.023 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-09-21T03:54:13.023 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 88, 2024-09-21T03:54:13.023 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-09-21T03:54:13.023 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 13, 2024-09-21T03:54:13.023 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 12, 2024-09-21T03:54:13.023 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 12, 2024-09-21T03:54:13.023 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-09-21T03:54:13.023 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-09-21T03:54:13.023 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 53, 2024-09-21T03:54:13.023 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 0, 2024-09-21T03:54:13.023 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 10 2024-09-21T03:54:13.023 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.023 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-09-21T03:54:13.023 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2024-09-21T03:54:13.024 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-09-21T03:54:13.024 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-09-21T03:54:13.024 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-09-21T03:54:13.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.024 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-09-21T03:54:13.024 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-09-21T03:54:13.024 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 1, 2024-09-21T03:54:13.024 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-09-21T03:54:13.024 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 1, 2024-09-21T03:54:13.024 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 1, 2024-09-21T03:54:13.024 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 1, 2024-09-21T03:54:13.024 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-09-21T03:54:13.024 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.024 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:54:13.026 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T03:54:13.026 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-21T03:54:13.026 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T03:54:13.027 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 8700, 2024-09-21T03:54:13.027 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 3131932, 2024-09-21T03:54:13.027 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:13.027 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 8700, 2024-09-21T03:54:13.027 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-21T03:54:13.027 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-21T03:54:13.027 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 8700, 2024-09-21T03:54:13.027 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 3131932, 2024-09-21T03:54:13.027 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T03:54:13.027 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.027 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.027 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.027 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:13.027 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.028 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-09-21T03:54:13.028 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T03:54:13.028 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-21T03:54:13.028 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T03:54:13.028 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-21T03:54:13.028 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-21T03:54:13.028 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:13.028 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-21T03:54:13.028 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 3756, 2024-09-21T03:54:13.028 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 24132118, 2024-09-21T03:54:13.028 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 3756, 2024-09-21T03:54:13.028 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 24132118, 2024-09-21T03:54:13.028 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T03:54:13.028 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.029 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.029 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.029 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:13.029 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.029 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-09-21T03:54:13.029 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T03:54:13.029 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-09-21T03:54:13.029 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T03:54:13.029 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-21T03:54:13.029 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-21T03:54:13.029 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:13.029 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-21T03:54:13.029 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 3756, 2024-09-21T03:54:13.029 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 3756, 2024-09-21T03:54:13.030 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 3756, 2024-09-21T03:54:13.030 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 3756, 2024-09-21T03:54:13.030 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T03:54:13.030 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.030 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.030 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.030 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:13.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.030 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-09-21T03:54:13.030 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T03:54:13.030 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-21T03:54:13.030 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T03:54:13.031 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 1, 2024-09-21T03:54:13.031 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 149, 2024-09-21T03:54:13.031 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:13.031 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 1, 2024-09-21T03:54:13.031 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-21T03:54:13.031 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-21T03:54:13.031 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1, 2024-09-21T03:54:13.031 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 149, 2024-09-21T03:54:13.031 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T03:54:13.031 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.031 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.031 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.031 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:13.031 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.031 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x564bf6f37450": { 2024-09-21T03:54:13.032 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 112, 2024-09-21T03:54:13.032 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-21T03:54:13.032 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T03:54:13.032 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 2288, 2024-09-21T03:54:13.032 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 24111146, 2024-09-21T03:54:13.032 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:13.032 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 2288, 2024-09-21T03:54:13.032 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-21T03:54:13.032 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-21T03:54:13.032 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2219, 2024-09-21T03:54:13.032 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 24111034, 2024-09-21T03:54:13.032 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T03:54:13.032 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:13.032 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:13.033 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:13.033 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:13.033 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:13.033 INFO:teuthology.orchestra.run.smithi172.stdout: "trackedop": { 2024-09-21T03:54:13.033 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-09-21T03:54:13.033 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:13.033 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-21T03:54:13.840 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-21T03:54:13.840 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-21T03:54:13.841 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=8 2024-09-21T03:54:13.841 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-21T03:54:13.841 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-21T03:54:13.841 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=12 2024-09-21T03:54:13.841 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=6 2024-09-21T03:54:13.841 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T03:54:13.841 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T03:54:14.089 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:54:14.558 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:14 smithi172 ceph-mon[34821]: pgmap v687: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 KiB/s wr, 24 op/s 2024-09-21T03:54:14.679 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-21T03:54:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:54:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1853, 2024-09-21T03:54:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 1842, 2024-09-21T03:54:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 10045618, 2024-09-21T03:54:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 651010, 2024-09-21T03:54:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 5, 2024-09-21T03:54:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 1, 2024-09-21T03:54:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.246790872, 2024-09-21T03:54:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.118346926, 2024-09-21T03:54:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.086128666, 2024-09-21T03:54:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.042412534, 2024-09-21T03:54:14.680 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1842, 2024-09-21T03:54:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.086283459, 2024-09-21T03:54:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000046842 2024-09-21T03:54:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1184352, 2024-09-21T03:54:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 144432 2024-09-21T03:54:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:54:14.681 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 674, 2024-09-21T03:54:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 847, 2024-09-21T03:54:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 8558230, 2024-09-21T03:54:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 603248, 2024-09-21T03:54:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 5, 2024-09-21T03:54:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-09-21T03:54:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.092293891, 2024-09-21T03:54:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.036250405, 2024-09-21T03:54:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.028896620, 2024-09-21T03:54:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.020678757, 2024-09-21T03:54:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 845, 2024-09-21T03:54:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.034621354, 2024-09-21T03:54:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000040972 2024-09-21T03:54:14.682 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T03:54:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 389168 2024-09-21T03:54:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:54:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 804, 2024-09-21T03:54:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 805, 2024-09-21T03:54:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 7535216, 2024-09-21T03:54:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 255361, 2024-09-21T03:54:14.683 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 5, 2024-09-21T03:54:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-09-21T03:54:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.095024946, 2024-09-21T03:54:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.034254075, 2024-09-21T03:54:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.029091074, 2024-09-21T03:54:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.025455669, 2024-09-21T03:54:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 803, 2024-09-21T03:54:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.024867987, 2024-09-21T03:54:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000030968 2024-09-21T03:54:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.684 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T03:54:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T03:54:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-21T03:54:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-09-21T03:54:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-21T03:54:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-09-21T03:54:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-21T03:54:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-21T03:54:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5287, 2024-09-21T03:54:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.130042020, 2024-09-21T03:54:14.685 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000024596 2024-09-21T03:54:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-09-21T03:54:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-21T03:54:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-21T03:54:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-09-21T03:54:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 0, 2024-09-21T03:54:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 0, 2024-09-21T03:54:14.686 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-09-21T03:54:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-09-21T03:54:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2024-09-21T03:54:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-09-21T03:54:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-09-21T03:54:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 0, 2024-09-21T03:54:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-09-21T03:54:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-09-21T03:54:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 31, 2024-09-21T03:54:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2024-09-21T03:54:14.687 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 31, 2024-09-21T03:54:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-09-21T03:54:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 31, 2024-09-21T03:54:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-09-21T03:54:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2024-09-21T03:54:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2024-09-21T03:54:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 2, 2024-09-21T03:54:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 0, 2024-09-21T03:54:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 0, 2024-09-21T03:54:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-09-21T03:54:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2024-09-21T03:54:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-09-21T03:54:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-09-21T03:54:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-09-21T03:54:14.688 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-09-21T03:54:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-09-21T03:54:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-09-21T03:54:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-09-21T03:54:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-09-21T03:54:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-09-21T03:54:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-09-21T03:54:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-09-21T03:54:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-09-21T03:54:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 4, 2024-09-21T03:54:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 234, 2024-09-21T03:54:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 6, 2024-09-21T03:54:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T03:54:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-09-21T03:54:14.689 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T03:54:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-09-21T03:54:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-09-21T03:54:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T03:54:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T03:54:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-09-21T03:54:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-09-21T03:54:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T03:54:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2024-09-21T03:54:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T03:54:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T03:54:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T03:54:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2024-09-21T03:54:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2024-09-21T03:54:14.690 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2024-09-21T03:54:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 0 2024-09-21T03:54:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-09-21T03:54:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-09-21T03:54:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-09-21T03:54:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-09-21T03:54:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2024-09-21T03:54:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-09-21T03:54:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-09-21T03:54:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-09-21T03:54:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-09-21T03:54:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2024-09-21T03:54:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2024-09-21T03:54:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-09-21T03:54:14.691 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-09-21T03:54:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-09-21T03:54:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-09-21T03:54:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-09-21T03:54:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-09-21T03:54:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-09-21T03:54:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-09-21T03:54:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-09-21T03:54:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T03:54:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-09-21T03:54:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-09-21T03:54:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-09-21T03:54:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-09-21T03:54:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0, 2024-09-21T03:54:14.692 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_started": 0, 2024-09-21T03:54:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_succeeded": 0, 2024-09-21T03:54:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_write_failed": 0 2024-09-21T03:54:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-09-21T03:54:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-09-21T03:54:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 0, 2024-09-21T03:54:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-09-21T03:54:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-09-21T03:54:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 2287, 2024-09-21T03:54:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-09-21T03:54:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-09-21T03:54:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 0, 2024-09-21T03:54:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-09-21T03:54:14.693 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-09-21T03:54:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 7, 2024-09-21T03:54:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 2, 2024-09-21T03:54:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-09-21T03:54:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-09-21T03:54:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-09-21T03:54:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 28305338, 2024-09-21T03:54:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 28305278, 2024-09-21T03:54:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-09-21T03:54:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 2287 2024-09-21T03:54:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.694 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-09-21T03:54:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 26, 2024-09-21T03:54:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 27, 2024-09-21T03:54:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 1, 2024-09-21T03:54:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 11, 2024-09-21T03:54:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 11, 2024-09-21T03:54:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 0, 2024-09-21T03:54:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 31, 2024-09-21T03:54:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 31, 2024-09-21T03:54:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 0, 2024-09-21T03:54:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2024-09-21T03:54:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 0, 2024-09-21T03:54:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 0, 2024-09-21T03:54:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 120288, 2024-09-21T03:54:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 317468672 2024-09-21T03:54:14.695 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-09-21T03:54:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 0, 2024-09-21T03:54:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-09-21T03:54:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 0, 2024-09-21T03:54:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 0, 2024-09-21T03:54:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-09-21T03:54:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-09-21T03:54:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-09-21T03:54:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.696 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-09-21T03:54:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-09-21T03:54:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-09-21T03:54:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.697 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-09-21T03:54:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-09-21T03:54:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-09-21T03:54:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.698 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-09-21T03:54:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-09-21T03:54:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-09-21T03:54:14.699 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.700 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-09-21T03:54:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-09-21T03:54:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-09-21T03:54:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.701 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-09-21T03:54:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-09-21T03:54:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-09-21T03:54:14.702 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-09-21T03:54:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-09-21T03:54:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.703 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-09-21T03:54:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-09-21T03:54:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-09-21T03:54:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.704 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-09-21T03:54:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-09-21T03:54:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-09-21T03:54:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.705 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-09-21T03:54:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-09-21T03:54:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-09-21T03:54:14.706 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-09-21T03:54:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-09-21T03:54:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-09-21T03:54:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-09-21T03:54:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.707 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-09-21T03:54:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 2, 2024-09-21T03:54:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 4, 2024-09-21T03:54:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 2, 2024-09-21T03:54:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 3, 2024-09-21T03:54:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-09-21T03:54:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 0, 2024-09-21T03:54:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 0, 2024-09-21T03:54:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 2661, 2024-09-21T03:54:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-09-21T03:54:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.708 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-21T03:54:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:54:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-21T03:54:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:54:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:54:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:54:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:54:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:54:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:54:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:54:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:54:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:54:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:54:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:54:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:54:14.709 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:54:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-21T03:54:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:54:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-21T03:54:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:54:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:54:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:54:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:54:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:54:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:54:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:54:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-21T03:54:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:54:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:54:14.710 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:54:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-21T03:54:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-21T03:54:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-21T03:54:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:54:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:54:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:54:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:54:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 199485, 2024-09-21T03:54:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 90, 2024-09-21T03:54:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:54:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-21T03:54:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-21T03:54:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-21T03:54:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:54:14.711 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-21T03:54:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:54:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-21T03:54:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 8088, 2024-09-21T03:54:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 179, 2024-09-21T03:54:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:54:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:54:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-21T03:54:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-21T03:54:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 157865, 2024-09-21T03:54:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 1564, 2024-09-21T03:54:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-21T03:54:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-21T03:54:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-21T03:54:14.712 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-21T03:54:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-09-21T03:54:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-09-21T03:54:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-09-21T03:54:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 3069, 2024-09-21T03:54:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 26, 2024-09-21T03:54:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 4, 2024-09-21T03:54:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 3069, 2024-09-21T03:54:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-09-21T03:54:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3069, 2024-09-21T03:54:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.783955810, 2024-09-21T03:54:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000581282 2024-09-21T03:54:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-09-21T03:54:14.713 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-09-21T03:54:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3069, 2024-09-21T03:54:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 3070 2024-09-21T03:54:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 3069, 2024-09-21T03:54:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 3069, 2024-09-21T03:54:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 0, 2024-09-21T03:54:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-09-21T03:54:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-09-21T03:54:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 1616, 2024-09-21T03:54:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 0, 2024-09-21T03:54:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 1450, 2024-09-21T03:54:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 0, 2024-09-21T03:54:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 0, 2024-09-21T03:54:14.714 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-09-21T03:54:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-09-21T03:54:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-09-21T03:54:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-09-21T03:54:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 0, 2024-09-21T03:54:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-09-21T03:54:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-09-21T03:54:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-09-21T03:54:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 2, 2024-09-21T03:54:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 0, 2024-09-21T03:54:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-09-21T03:54:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-09-21T03:54:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-09-21T03:54:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-09-21T03:54:14.715 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-09-21T03:54:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-09-21T03:54:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T03:54:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-09-21T03:54:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-09-21T03:54:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-09-21T03:54:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-09-21T03:54:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-09-21T03:54:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-09-21T03:54:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-09-21T03:54:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-09-21T03:54:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-09-21T03:54:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-09-21T03:54:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-09-21T03:54:14.716 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-09-21T03:54:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-09-21T03:54:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-09-21T03:54:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-09-21T03:54:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-09-21T03:54:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-09-21T03:54:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-09-21T03:54:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-09-21T03:54:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 88, 2024-09-21T03:54:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-09-21T03:54:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 13, 2024-09-21T03:54:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 6, 2024-09-21T03:54:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 6, 2024-09-21T03:54:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-09-21T03:54:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-09-21T03:54:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 0, 2024-09-21T03:54:14.717 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 2, 2024-09-21T03:54:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 0 2024-09-21T03:54:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-09-21T03:54:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 0, 2024-09-21T03:54:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-09-21T03:54:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-09-21T03:54:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-09-21T03:54:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-09-21T03:54:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-09-21T03:54:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T03:54:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-09-21T03:54:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2024-09-21T03:54:14.718 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 0, 2024-09-21T03:54:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2024-09-21T03:54:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-09-21T03:54:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:54:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T03:54:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-21T03:54:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T03:54:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 3327, 2024-09-21T03:54:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 25823455, 2024-09-21T03:54:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 3327, 2024-09-21T03:54:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-21T03:54:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-21T03:54:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 3327, 2024-09-21T03:54:14.719 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 25823455, 2024-09-21T03:54:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T03:54:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-09-21T03:54:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T03:54:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-21T03:54:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T03:54:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-21T03:54:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-21T03:54:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:14.720 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-21T03:54:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 3069, 2024-09-21T03:54:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 24111044, 2024-09-21T03:54:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 3069, 2024-09-21T03:54:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 24111044, 2024-09-21T03:54:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T03:54:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-09-21T03:54:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T03:54:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-09-21T03:54:14.721 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T03:54:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-21T03:54:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-21T03:54:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-21T03:54:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 3069, 2024-09-21T03:54:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 3069, 2024-09-21T03:54:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 3069, 2024-09-21T03:54:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 3069, 2024-09-21T03:54:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T03:54:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.722 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-09-21T03:54:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T03:54:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-21T03:54:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T03:54:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-21T03:54:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-21T03:54:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-21T03:54:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-21T03:54:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-21T03:54:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-21T03:54:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-21T03:54:14.723 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T03:54:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x5598d8571380": { 2024-09-21T03:54:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T03:54:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-21T03:54:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T03:54:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-21T03:54:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-21T03:54:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-21T03:54:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-21T03:54:14.724 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-21T03:54:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-21T03:54:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-21T03:54:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T03:54:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: "trackedop": { 2024-09-21T03:54:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-09-21T03:54:14.725 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:14.725 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-21T03:54:14.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:14 smithi084 ceph-mon[30941]: pgmap v687: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 KiB/s wr, 24 op/s 2024-09-21T03:54:14.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:14 smithi174 ceph-mon[34403]: pgmap v687: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 KiB/s wr, 24 op/s 2024-09-21T03:54:15.427 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-21T03:54:15.427 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-21T03:54:15.427 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-21T03:54:15.427 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-21T03:54:15.427 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2024-09-21T03:54:15.427 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-21T03:54:15.427 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T03:54:15.427 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T03:54:15.428 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T03:54:15.679 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:54:16.205 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-21T03:54:16.206 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:54:16.206 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 88, 2024-09-21T03:54:16.206 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 92, 2024-09-21T03:54:16.206 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 19891, 2024-09-21T03:54:16.206 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 561779, 2024-09-21T03:54:16.206 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 54, 2024-09-21T03:54:16.206 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 7, 2024-09-21T03:54:16.206 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.031737494, 2024-09-21T03:54:16.206 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.005162781, 2024-09-21T03:54:16.206 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.020825023, 2024-09-21T03:54:16.206 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000804325, 2024-09-21T03:54:16.206 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:16.207 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 89, 2024-09-21T03:54:16.207 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.029482533, 2024-09-21T03:54:16.207 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000331264 2024-09-21T03:54:16.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.207 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:16.207 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 72, 2024-09-21T03:54:16.207 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000008492, 2024-09-21T03:54:16.207 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000117 2024-09-21T03:54:16.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.207 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 6800, 2024-09-21T03:54:16.207 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 5696 2024-09-21T03:54:16.207 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.207 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:54:16.208 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 1125, 2024-09-21T03:54:16.208 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 971, 2024-09-21T03:54:16.208 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 1446267, 2024-09-21T03:54:16.208 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 406410, 2024-09-21T03:54:16.208 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 6, 2024-09-21T03:54:16.208 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-09-21T03:54:16.208 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.149682182, 2024-09-21T03:54:16.208 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.075835448, 2024-09-21T03:54:16.208 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.090203650, 2024-09-21T03:54:16.208 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.004431546, 2024-09-21T03:54:16.208 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:16.208 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 972, 2024-09-21T03:54:16.208 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.061836032, 2024-09-21T03:54:16.208 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000063617 2024-09-21T03:54:16.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.209 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:16.209 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1502, 2024-09-21T03:54:16.209 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000375920, 2024-09-21T03:54:16.209 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000250 2024-09-21T03:54:16.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.209 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1194688, 2024-09-21T03:54:16.209 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 147824 2024-09-21T03:54:16.209 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.209 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:54:16.209 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 20, 2024-09-21T03:54:16.209 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 210, 2024-09-21T03:54:16.210 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 4699, 2024-09-21T03:54:16.210 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 407076, 2024-09-21T03:54:16.210 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 7, 2024-09-21T03:54:16.210 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 5, 2024-09-21T03:54:16.210 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.018901915, 2024-09-21T03:54:16.210 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.012248844, 2024-09-21T03:54:16.210 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.004027369, 2024-09-21T03:54:16.210 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000875655, 2024-09-21T03:54:16.210 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:16.210 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 208, 2024-09-21T03:54:16.210 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.018474862, 2024-09-21T03:54:16.210 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000088821 2024-09-21T03:54:16.210 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.211 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:16.211 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 36, 2024-09-21T03:54:16.211 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000009447, 2024-09-21T03:54:16.211 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000262 2024-09-21T03:54:16.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.211 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1888, 2024-09-21T03:54:16.211 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 397072 2024-09-21T03:54:16.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.211 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-21T03:54:16.211 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-09-21T03:54:16.211 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-21T03:54:16.211 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-09-21T03:54:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-21T03:54:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-21T03:54:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 56, 2024-09-21T03:54:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.002313410, 2024-09-21T03:54:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000041310 2024-09-21T03:54:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-09-21T03:54:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-09-21T03:54:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-09-21T03:54:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2024-09-21T03:54:16.212 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000017741, 2024-09-21T03:54:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000008870 2024-09-21T03:54:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-09-21T03:54:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 6, 2024-09-21T03:54:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 4, 2024-09-21T03:54:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-09-21T03:54:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4, 2024-09-21T03:54:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.002344385, 2024-09-21T03:54:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000586096 2024-09-21T03:54:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-09-21T03:54:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 2, 2024-09-21T03:54:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-09-21T03:54:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-09-21T03:54:16.213 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 11, 2024-09-21T03:54:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-09-21T03:54:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-09-21T03:54:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 16, 2024-09-21T03:54:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 0, 2024-09-21T03:54:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 16, 2024-09-21T03:54:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-09-21T03:54:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 13, 2024-09-21T03:54:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 4, 2024-09-21T03:54:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2024-09-21T03:54:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2024-09-21T03:54:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 3, 2024-09-21T03:54:16.214 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 16, 2024-09-21T03:54:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 11, 2024-09-21T03:54:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-09-21T03:54:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 4, 2024-09-21T03:54:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-09-21T03:54:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-09-21T03:54:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-09-21T03:54:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-09-21T03:54:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-09-21T03:54:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-09-21T03:54:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-09-21T03:54:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-09-21T03:54:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-09-21T03:54:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-09-21T03:54:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-09-21T03:54:16.215 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-09-21T03:54:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 4, 2024-09-21T03:54:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 234, 2024-09-21T03:54:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 6, 2024-09-21T03:54:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T03:54:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-09-21T03:54:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T03:54:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-09-21T03:54:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-09-21T03:54:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T03:54:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T03:54:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-09-21T03:54:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-09-21T03:54:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T03:54:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2024-09-21T03:54:16.216 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T03:54:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T03:54:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T03:54:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2024-09-21T03:54:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2024-09-21T03:54:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2024-09-21T03:54:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 1 2024-09-21T03:54:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-09-21T03:54:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-09-21T03:54:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 9, 2024-09-21T03:54:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 6, 2024-09-21T03:54:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 8, 2024-09-21T03:54:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-09-21T03:54:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-09-21T03:54:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-09-21T03:54:16.217 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-09-21T03:54:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2024-09-21T03:54:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2024-09-21T03:54:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-09-21T03:54:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-09-21T03:54:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-09-21T03:54:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-09-21T03:54:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-09-21T03:54:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-09-21T03:54:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-09-21T03:54:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-09-21T03:54:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-09-21T03:54:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T03:54:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-09-21T03:54:16.218 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-09-21T03:54:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-09-21T03:54:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-09-21T03:54:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0, 2024-09-21T03:54:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_started": 0, 2024-09-21T03:54:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_succeeded": 0, 2024-09-21T03:54:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: "uninline_write_failed": 0 2024-09-21T03:54:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-09-21T03:54:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-09-21T03:54:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 7, 2024-09-21T03:54:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-09-21T03:54:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-09-21T03:54:16.219 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 7, 2024-09-21T03:54:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-09-21T03:54:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-09-21T03:54:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 2, 2024-09-21T03:54:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-09-21T03:54:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-09-21T03:54:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 2, 2024-09-21T03:54:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 2, 2024-09-21T03:54:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-09-21T03:54:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-09-21T03:54:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-09-21T03:54:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 4196347, 2024-09-21T03:54:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2024-09-21T03:54:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-09-21T03:54:16.220 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 6, 2024-09-21T03:54:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.012854459, 2024-09-21T03:54:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002142409 2024-09-21T03:54:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2024-09-21T03:54:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-09-21T03:54:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 20, 2024-09-21T03:54:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 22, 2024-09-21T03:54:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 2, 2024-09-21T03:54:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 19, 2024-09-21T03:54:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 22, 2024-09-21T03:54:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 3, 2024-09-21T03:54:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 16, 2024-09-21T03:54:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 20, 2024-09-21T03:54:16.221 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 4, 2024-09-21T03:54:16.222 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2024-09-21T03:54:16.222 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 4, 2024-09-21T03:54:16.222 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 4, 2024-09-21T03:54:16.222 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 119264, 2024-09-21T03:54:16.222 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 325857280 2024-09-21T03:54:16.222 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.222 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-09-21T03:54:16.222 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 10, 2024-09-21T03:54:16.222 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-09-21T03:54:16.222 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 6, 2024-09-21T03:54:16.222 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 17, 2024-09-21T03:54:16.222 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 1, 2024-09-21T03:54:16.222 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-09-21T03:54:16.223 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.223 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.223 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.223 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-09-21T03:54:16.223 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2024-09-21T03:54:16.223 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.001756981, 2024-09-21T03:54:16.223 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000878490 2024-09-21T03:54:16.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.223 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-09-21T03:54:16.223 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.223 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.223 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.223 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.223 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-09-21T03:54:16.224 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.224 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.224 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.224 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-09-21T03:54:16.224 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2024-09-21T03:54:16.224 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000587404, 2024-09-21T03:54:16.224 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000293702 2024-09-21T03:54:16.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.224 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-09-21T03:54:16.224 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.224 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.224 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.224 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.225 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-09-21T03:54:16.225 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.225 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.225 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.225 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-09-21T03:54:16.225 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.225 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.225 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.225 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.225 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-09-21T03:54:16.225 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.225 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.225 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.226 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-09-21T03:54:16.226 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.226 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.226 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.226 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.226 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-09-21T03:54:16.226 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.226 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.227 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.227 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-09-21T03:54:16.227 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.227 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.227 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.227 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-09-21T03:54:16.227 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.227 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.227 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.227 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.228 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-09-21T03:54:16.228 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.228 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.228 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.228 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-09-21T03:54:16.228 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.228 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.228 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.228 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.228 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-09-21T03:54:16.228 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.228 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.229 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.229 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-09-21T03:54:16.229 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.229 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.229 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.229 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-09-21T03:54:16.229 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.229 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.229 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.229 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.229 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-09-21T03:54:16.229 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.229 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.230 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.230 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-09-21T03:54:16.230 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.230 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.230 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.230 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-09-21T03:54:16.230 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.230 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.230 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.230 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.230 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-09-21T03:54:16.230 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.231 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.231 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.231 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-09-21T03:54:16.231 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.231 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.231 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.231 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-09-21T03:54:16.231 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.231 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.231 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.231 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.231 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-09-21T03:54:16.232 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.232 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.232 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.232 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-09-21T03:54:16.232 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.232 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.232 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.232 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-09-21T03:54:16.232 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.232 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.232 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.232 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.234 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-09-21T03:54:16.234 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.234 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.234 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.234 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-09-21T03:54:16.234 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.234 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.234 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.234 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.234 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-09-21T03:54:16.234 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-09-21T03:54:16.234 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-09-21T03:54:16.234 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.235 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.235 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.235 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:16.235 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.235 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-09-21T03:54:16.235 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-09-21T03:54:16.235 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 3, 2024-09-21T03:54:16.235 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 2, 2024-09-21T03:54:16.235 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2024-09-21T03:54:16.235 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-09-21T03:54:16.235 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 3, 2024-09-21T03:54:16.235 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 3, 2024-09-21T03:54:16.235 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 672, 2024-09-21T03:54:16.235 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-09-21T03:54:16.236 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.236 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-21T03:54:16.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:54:16.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-21T03:54:16.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:54:16.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:54:16.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:54:16.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:54:16.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:54:16.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:54:16.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:54:16.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:54:16.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:54:16.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:54:16.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:54:16.236 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:54:16.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:54:16.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-21T03:54:16.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:54:16.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-21T03:54:16.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:54:16.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:54:16.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:54:16.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:54:16.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:54:16.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:54:16.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:54:16.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-21T03:54:16.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:54:16.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:54:16.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:54:16.237 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-21T03:54:16.238 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-21T03:54:16.238 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-21T03:54:16.238 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:54:16.238 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:54:16.238 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:54:16.238 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:54:16.238 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 248071, 2024-09-21T03:54:16.238 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 93, 2024-09-21T03:54:16.238 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 88, 2024-09-21T03:54:16.238 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 1, 2024-09-21T03:54:16.238 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-21T03:54:16.238 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-21T03:54:16.238 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:54:16.238 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-21T03:54:16.238 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:54:16.239 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-21T03:54:16.239 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 8088, 2024-09-21T03:54:16.239 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 179, 2024-09-21T03:54:16.239 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:54:16.239 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:54:16.239 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-21T03:54:16.239 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-21T03:54:16.239 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 92677, 2024-09-21T03:54:16.239 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 699, 2024-09-21T03:54:16.239 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-21T03:54:16.239 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-21T03:54:16.239 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-21T03:54:16.239 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-21T03:54:16.239 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.239 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-09-21T03:54:16.239 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-09-21T03:54:16.240 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-09-21T03:54:16.240 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 46, 2024-09-21T03:54:16.240 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 12750, 2024-09-21T03:54:16.240 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 32, 2024-09-21T03:54:16.240 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 46, 2024-09-21T03:54:16.240 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-09-21T03:54:16.240 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 46, 2024-09-21T03:54:16.240 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.270993318, 2024-09-21T03:54:16.240 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.005891159 2024-09-21T03:54:16.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.240 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-09-21T03:54:16.240 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-09-21T03:54:16.240 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 46, 2024-09-21T03:54:16.240 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 70 2024-09-21T03:54:16.240 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.241 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 46, 2024-09-21T03:54:16.241 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 0, 2024-09-21T03:54:16.241 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 46, 2024-09-21T03:54:16.241 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-09-21T03:54:16.241 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-09-21T03:54:16.241 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2024-09-21T03:54:16.241 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 10, 2024-09-21T03:54:16.241 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 0, 2024-09-21T03:54:16.241 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 6, 2024-09-21T03:54:16.241 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 9, 2024-09-21T03:54:16.241 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-09-21T03:54:16.241 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-09-21T03:54:16.241 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-09-21T03:54:16.241 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-09-21T03:54:16.241 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 6, 2024-09-21T03:54:16.241 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-09-21T03:54:16.242 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-09-21T03:54:16.242 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-09-21T03:54:16.242 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 0, 2024-09-21T03:54:16.242 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 20, 2024-09-21T03:54:16.242 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-09-21T03:54:16.242 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-09-21T03:54:16.242 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-09-21T03:54:16.242 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-09-21T03:54:16.242 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-09-21T03:54:16.242 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-09-21T03:54:16.242 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T03:54:16.242 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-09-21T03:54:16.242 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-09-21T03:54:16.243 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-09-21T03:54:16.243 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-09-21T03:54:16.243 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-09-21T03:54:16.243 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-09-21T03:54:16.243 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-09-21T03:54:16.243 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-09-21T03:54:16.243 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-09-21T03:54:16.243 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-09-21T03:54:16.243 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-09-21T03:54:16.243 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-09-21T03:54:16.243 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-09-21T03:54:16.243 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-09-21T03:54:16.243 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-09-21T03:54:16.243 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-09-21T03:54:16.243 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-09-21T03:54:16.244 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-09-21T03:54:16.244 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-09-21T03:54:16.244 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 88, 2024-09-21T03:54:16.244 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-09-21T03:54:16.244 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 13, 2024-09-21T03:54:16.244 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 9, 2024-09-21T03:54:16.244 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 9, 2024-09-21T03:54:16.244 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-09-21T03:54:16.244 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-09-21T03:54:16.244 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 17, 2024-09-21T03:54:16.244 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 0, 2024-09-21T03:54:16.244 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 2 2024-09-21T03:54:16.244 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.244 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-09-21T03:54:16.245 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2024-09-21T03:54:16.245 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-09-21T03:54:16.245 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-09-21T03:54:16.245 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-09-21T03:54:16.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.245 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-09-21T03:54:16.245 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-09-21T03:54:16.245 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T03:54:16.245 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-09-21T03:54:16.245 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2024-09-21T03:54:16.245 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 0, 2024-09-21T03:54:16.245 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2024-09-21T03:54:16.245 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-09-21T03:54:16.245 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.246 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:54:16.246 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T03:54:16.246 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-21T03:54:16.246 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T03:54:16.246 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 1229, 2024-09-21T03:54:16.246 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 1341646, 2024-09-21T03:54:16.246 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:16.246 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 1229, 2024-09-21T03:54:16.246 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-21T03:54:16.246 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-21T03:54:16.246 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1229, 2024-09-21T03:54:16.246 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1341646, 2024-09-21T03:54:16.246 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T03:54:16.246 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.246 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.246 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.247 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:16.247 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.247 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-09-21T03:54:16.247 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T03:54:16.247 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-21T03:54:16.247 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T03:54:16.247 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-21T03:54:16.247 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-21T03:54:16.247 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:16.247 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-21T03:54:16.247 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 46, 2024-09-21T03:54:16.247 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 12750, 2024-09-21T03:54:16.248 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 46, 2024-09-21T03:54:16.248 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 12750, 2024-09-21T03:54:16.248 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T03:54:16.248 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.248 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.248 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.248 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:16.248 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.248 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-09-21T03:54:16.248 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T03:54:16.248 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-09-21T03:54:16.248 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T03:54:16.248 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-21T03:54:16.248 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-21T03:54:16.248 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:16.248 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-21T03:54:16.249 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 46, 2024-09-21T03:54:16.249 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 46, 2024-09-21T03:54:16.249 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 46, 2024-09-21T03:54:16.249 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 46, 2024-09-21T03:54:16.249 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T03:54:16.249 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.249 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.249 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.249 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:16.249 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.249 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-09-21T03:54:16.249 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T03:54:16.249 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-21T03:54:16.249 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T03:54:16.249 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-09-21T03:54:16.250 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-09-21T03:54:16.250 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:16.250 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-09-21T03:54:16.250 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-21T03:54:16.250 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-21T03:54:16.250 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-09-21T03:54:16.250 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-09-21T03:54:16.250 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T03:54:16.250 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.250 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.250 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.250 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:16.250 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.250 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x559afd101380": { 2024-09-21T03:54:16.250 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T03:54:16.251 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-09-21T03:54:16.251 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T03:54:16.251 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 7, 2024-09-21T03:54:16.251 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 2043, 2024-09-21T03:54:16.251 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:16.251 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 7, 2024-09-21T03:54:16.251 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-21T03:54:16.251 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-21T03:54:16.251 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 6, 2024-09-21T03:54:16.251 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 2043, 2024-09-21T03:54:16.251 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T03:54:16.251 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:16.251 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:16.251 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:16.252 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:16.252 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:16.252 INFO:teuthology.orchestra.run.smithi172.stdout: "trackedop": { 2024-09-21T03:54:16.252 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-09-21T03:54:16.252 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:16.252 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-21T03:54:16.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:16 smithi084 ceph-mon[30941]: pgmap v688: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T03:54:16.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:16 smithi174 ceph-mon[34403]: pgmap v688: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T03:54:16.896 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:16 smithi172 ceph-mon[34821]: pgmap v688: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T03:54:16.924 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-21T03:54:16.924 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-21T03:54:16.924 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-21T03:54:16.924 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=9 2024-09-21T03:54:16.924 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-21T03:54:16.924 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-21T03:54:16.924 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T03:54:16.924 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T03:54:16.925 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T03:54:17.174 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:54:17.712 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-09-21T03:54:17.712 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:54:17.712 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 239, 2024-09-21T03:54:17.712 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 232, 2024-09-21T03:54:17.712 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 1151856, 2024-09-21T03:54:17.712 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 142784, 2024-09-21T03:54:17.712 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 4, 2024-09-21T03:54:17.712 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 0, 2024-09-21T03:54:17.712 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.050235929, 2024-09-21T03:54:17.713 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.021696828, 2024-09-21T03:54:17.713 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.039821025, 2024-09-21T03:54:17.713 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:54:17.713 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:17.713 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 231, 2024-09-21T03:54:17.713 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.016086234, 2024-09-21T03:54:17.713 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000069637 2024-09-21T03:54:17.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:17.713 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:17.713 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:17.713 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:17.713 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:17.713 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:17.713 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1151856, 2024-09-21T03:54:17.714 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 142784 2024-09-21T03:54:17.714 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:17.714 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:54:17.714 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 5, 2024-09-21T03:54:17.714 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 179, 2024-09-21T03:54:17.714 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 3200, 2024-09-21T03:54:17.714 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 111888, 2024-09-21T03:54:17.714 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 3, 2024-09-21T03:54:17.714 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 2, 2024-09-21T03:54:17.714 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.016965340, 2024-09-21T03:54:17.714 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.012123857, 2024-09-21T03:54:17.714 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.002888571, 2024-09-21T03:54:17.714 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:54:17.714 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:17.715 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 178, 2024-09-21T03:54:17.715 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.013585106, 2024-09-21T03:54:17.715 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000076320 2024-09-21T03:54:17.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:17.715 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:17.715 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:17.715 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:17.715 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:17.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:17.715 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-09-21T03:54:17.715 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 111888 2024-09-21T03:54:17.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:17.715 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:54:17.715 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 0, 2024-09-21T03:54:17.716 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 2, 2024-09-21T03:54:17.716 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 0, 2024-09-21T03:54:17.716 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 0, 2024-09-21T03:54:17.716 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 2, 2024-09-21T03:54:17.716 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 1, 2024-09-21T03:54:17.716 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 0.000325769, 2024-09-21T03:54:17.716 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T03:54:17.716 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.000253104, 2024-09-21T03:54:17.716 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:54:17.716 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:17.716 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:17.716 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:17.716 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:17.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:17.716 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:17.717 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:17.717 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:17.717 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:17.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:17.717 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T03:54:17.717 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T03:54:17.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:17.717 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-09-21T03:54:17.717 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 0, 2024-09-21T03:54:17.717 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-09-21T03:54:17.717 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:17.717 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-09-21T03:54:17.717 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:54:17.717 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-09-21T03:54:17.718 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:54:17.718 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:54:17.718 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:54:17.718 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:54:17.718 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:54:17.718 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:54:17.718 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:54:17.718 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:54:17.718 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:54:17.718 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:54:17.718 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:54:17.718 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:54:17.718 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:54:17.718 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-09-21T03:54:17.718 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:54:17.719 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-09-21T03:54:17.719 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:54:17.719 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:54:17.719 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:54:17.719 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:54:17.719 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:54:17.719 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:54:17.719 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:54:17.719 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-09-21T03:54:17.719 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:54:17.719 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:54:17.719 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:54:17.719 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-09-21T03:54:17.719 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-09-21T03:54:17.720 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-09-21T03:54:17.720 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:54:17.720 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:54:17.720 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:54:17.720 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:54:17.720 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 149007, 2024-09-21T03:54:17.720 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 30, 2024-09-21T03:54:17.720 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:54:17.720 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-09-21T03:54:17.720 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-09-21T03:54:17.720 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-09-21T03:54:17.720 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:54:17.720 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-09-21T03:54:17.720 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:54:17.720 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-09-21T03:54:17.721 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 0, 2024-09-21T03:54:17.721 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 0, 2024-09-21T03:54:17.721 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:54:17.721 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:54:17.721 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-09-21T03:54:17.721 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-09-21T03:54:17.721 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 968, 2024-09-21T03:54:17.721 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 2, 2024-09-21T03:54:17.721 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-09-21T03:54:17.721 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-09-21T03:54:17.721 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-09-21T03:54:17.721 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-09-21T03:54:17.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-09-21T03:54:17.721 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:54:17.721 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-09-21T03:54:17.721 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-09-21T03:54:17.722 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-09-21T03:54:17.722 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 240, 2024-09-21T03:54:17.722 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 1118061, 2024-09-21T03:54:17.722 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:17.722 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 240, 2024-09-21T03:54:17.722 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-09-21T03:54:17.722 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-09-21T03:54:17.722 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 240, 2024-09-21T03:54:17.722 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1118061, 2024-09-21T03:54:17.722 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-09-21T03:54:17.722 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-09-21T03:54:17.722 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-09-21T03:54:17.722 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-09-21T03:54:17.722 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:17.723 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-09-21T03:54:17.723 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-09-21T03:54:18.497 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:18 smithi172 ceph-mon[34821]: pgmap v689: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T03:54:18.526 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-21T03:54:18.526 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-21T03:54:18.526 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-21T03:54:18.526 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-21T03:54:18.526 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-21T03:54:18.526 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-21T03:54:18.526 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-21T03:54:18.527 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T03:54:18.527 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T03:54:18.785 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:54:18.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:18 smithi084 ceph-mon[30941]: pgmap v689: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T03:54:18.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:18 smithi174 ceph-mon[34403]: pgmap v689: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T03:54:19.330 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-09-21T03:54:19.330 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:54:19.330 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 2399, 2024-09-21T03:54:19.330 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 2398, 2024-09-21T03:54:19.331 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 681854, 2024-09-21T03:54:19.331 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 761747, 2024-09-21T03:54:19.331 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 6, 2024-09-21T03:54:19.331 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 2, 2024-09-21T03:54:19.331 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.276039888, 2024-09-21T03:54:19.331 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.124197813, 2024-09-21T03:54:19.331 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.059298325, 2024-09-21T03:54:19.331 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.075041029, 2024-09-21T03:54:19.331 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:19.331 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2397, 2024-09-21T03:54:19.331 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.117453144, 2024-09-21T03:54:19.331 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000049000 2024-09-21T03:54:19.332 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.332 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:19.332 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.332 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.332 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.332 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.332 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-21T03:54:19.332 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T03:54:19.332 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.332 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:54:19.332 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 257, 2024-09-21T03:54:19.332 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 248, 2024-09-21T03:54:19.333 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 1181708, 2024-09-21T03:54:19.333 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 144522, 2024-09-21T03:54:19.333 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 3, 2024-09-21T03:54:19.333 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 2, 2024-09-21T03:54:19.333 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.051374967, 2024-09-21T03:54:19.333 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.022748768, 2024-09-21T03:54:19.333 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.042373021, 2024-09-21T03:54:19.333 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.000061194, 2024-09-21T03:54:19.333 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:19.333 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 247, 2024-09-21T03:54:19.333 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.016805633, 2024-09-21T03:54:19.334 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000068039 2024-09-21T03:54:19.334 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.334 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:19.334 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.334 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.334 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.334 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.334 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 1181152, 2024-09-21T03:54:19.334 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 143824 2024-09-21T03:54:19.334 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.334 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:54:19.334 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 2, 2024-09-21T03:54:19.334 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 175, 2024-09-21T03:54:19.335 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 428, 2024-09-21T03:54:19.335 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 391134, 2024-09-21T03:54:19.335 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 4, 2024-09-21T03:54:19.335 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 3, 2024-09-21T03:54:19.335 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.013086915, 2024-09-21T03:54:19.335 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.009728836, 2024-09-21T03:54:19.335 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.001624161, 2024-09-21T03:54:19.335 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.000032318, 2024-09-21T03:54:19.335 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:19.335 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 173, 2024-09-21T03:54:19.335 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.008857012, 2024-09-21T03:54:19.335 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000051196 2024-09-21T03:54:19.335 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.336 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:19.336 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.336 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.336 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.336 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.336 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T03:54:19.336 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 390816 2024-09-21T03:54:19.336 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.336 INFO:teuthology.orchestra.run.smithi174.stdout: "cct": { 2024-09-21T03:54:19.336 INFO:teuthology.orchestra.run.smithi174.stdout: "total_workers": 1, 2024-09-21T03:54:19.336 INFO:teuthology.orchestra.run.smithi174.stdout: "unhealthy_workers": 0 2024-09-21T03:54:19.336 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.337 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-MDSRank": { 2024-09-21T03:54:19.337 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-09-21T03:54:19.337 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-09-21T03:54:19.337 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 4039, 2024-09-21T03:54:19.337 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.119652208, 2024-09-21T03:54:19.337 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000029624 2024-09-21T03:54:19.337 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:19.337 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.337 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-PurgeQueue": { 2024-09-21T03:54:19.337 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-09-21T03:54:19.337 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-09-21T03:54:19.337 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.338 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.338 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.338 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:19.338 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.338 INFO:teuthology.orchestra.run.smithi174.stdout: "mds": { 2024-09-21T03:54:19.338 INFO:teuthology.orchestra.run.smithi174.stdout: "request": 0, 2024-09-21T03:54:19.338 INFO:teuthology.orchestra.run.smithi174.stdout: "reply": 0, 2024-09-21T03:54:19.338 INFO:teuthology.orchestra.run.smithi174.stdout: "reply_latency": { 2024-09-21T03:54:19.338 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.338 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.338 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.338 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.338 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_reply": 0, 2024-09-21T03:54:19.338 INFO:teuthology.orchestra.run.smithi174.stdout: "forward": 0, 2024-09-21T03:54:19.339 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_complete": 0, 2024-09-21T03:54:19.339 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_keys": 0, 2024-09-21T03:54:19.339 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_commit": 0, 2024-09-21T03:54:19.339 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_split": 0, 2024-09-21T03:54:19.339 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_merge": 0, 2024-09-21T03:54:19.339 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes": 0, 2024-09-21T03:54:19.339 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_top": 0, 2024-09-21T03:54:19.339 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_bottom": 0, 2024-09-21T03:54:19.339 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pin_tail": 0, 2024-09-21T03:54:19.339 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pinned": 0, 2024-09-21T03:54:19.339 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_expired": 0, 2024-09-21T03:54:19.339 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_with_caps": 0, 2024-09-21T03:54:19.339 INFO:teuthology.orchestra.run.smithi174.stdout: "caps": 0, 2024-09-21T03:54:19.339 INFO:teuthology.orchestra.run.smithi174.stdout: "subtrees": 1, 2024-09-21T03:54:19.340 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse": 0, 2024-09-21T03:54:19.340 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_hit": 0, 2024-09-21T03:54:19.340 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_forward": 0, 2024-09-21T03:54:19.340 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_discover": 0, 2024-09-21T03:54:19.340 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_dir_fetch": 0, 2024-09-21T03:54:19.340 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_remote_ino": 0, 2024-09-21T03:54:19.340 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_lock": 0, 2024-09-21T03:54:19.340 INFO:teuthology.orchestra.run.smithi174.stdout: "load_cent": 0, 2024-09-21T03:54:19.340 INFO:teuthology.orchestra.run.smithi174.stdout: "q": 0, 2024-09-21T03:54:19.340 INFO:teuthology.orchestra.run.smithi174.stdout: "exported": 0, 2024-09-21T03:54:19.340 INFO:teuthology.orchestra.run.smithi174.stdout: "exported_inodes": 0, 2024-09-21T03:54:19.340 INFO:teuthology.orchestra.run.smithi174.stdout: "imported": 0, 2024-09-21T03:54:19.340 INFO:teuthology.orchestra.run.smithi174.stdout: "imported_inodes": 0, 2024-09-21T03:54:19.341 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_dir_fetch": 0, 2024-09-21T03:54:19.341 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_backtrace_fetch": 0, 2024-09-21T03:54:19.341 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_peer_discover": 0, 2024-09-21T03:54:19.341 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rfiles": 0, 2024-09-21T03:54:19.341 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rbytes": 0, 2024-09-21T03:54:19.341 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rsnaps": 0, 2024-09-21T03:54:19.341 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T03:54:19.341 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_set_tag": 0, 2024-09-21T03:54:19.341 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T03:54:19.341 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_inotable_repaired": 0, 2024-09-21T03:54:19.341 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_inodes": 0, 2024-09-21T03:54:19.341 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T03:54:19.341 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T03:54:19.341 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_file_inodes": 0, 2024-09-21T03:54:19.342 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_inode_file_caps": 0, 2024-09-21T03:54:19.342 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T03:54:19.342 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_grant": 0, 2024-09-21T03:54:19.342 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T03:54:19.342 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T03:54:19.342 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T03:54:19.342 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps": 0, 2024-09-21T03:54:19.342 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps_dirty": 0, 2024-09-21T03:54:19.342 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_cap_release": 0, 2024-09-21T03:54:19.342 INFO:teuthology.orchestra.run.smithi174.stdout: "process_request_cap_release": 0 2024-09-21T03:54:19.342 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.342 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_cache": { 2024-09-21T03:54:19.342 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update": 0, 2024-09-21T03:54:19.342 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update_receipt": 0, 2024-09-21T03:54:19.343 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_try_discover": 0, 2024-09-21T03:54:19.343 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_send_discover": 0, 2024-09-21T03:54:19.343 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_handle_discover": 0, 2024-09-21T03:54:19.343 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays": 0, 2024-09-21T03:54:19.343 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_delayed": 0, 2024-09-21T03:54:19.343 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_enqueuing": 0, 2024-09-21T03:54:19.343 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_created": 0, 2024-09-21T03:54:19.343 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_enqueued": 0, 2024-09-21T03:54:19.343 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_reintegrated": 0, 2024-09-21T03:54:19.343 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_migrated": 0, 2024-09-21T03:54:19.343 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_processing": 0, 2024-09-21T03:54:19.343 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_enqueued": 0, 2024-09-21T03:54:19.343 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_prioritized": 0, 2024-09-21T03:54:19.343 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_started": 0, 2024-09-21T03:54:19.344 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_completed": 0, 2024-09-21T03:54:19.344 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_path": 0, 2024-09-21T03:54:19.344 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_inode": 0, 2024-09-21T03:54:19.344 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T03:54:19.344 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_exportdir": 0, 2024-09-21T03:54:19.344 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_flush": 0, 2024-09-21T03:54:19.344 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragmentdir": 0, 2024-09-21T03:54:19.344 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragstats": 0, 2024-09-21T03:54:19.344 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_inodestats": 0, 2024-09-21T03:54:19.344 INFO:teuthology.orchestra.run.smithi174.stdout: "uninline_started": 0, 2024-09-21T03:54:19.344 INFO:teuthology.orchestra.run.smithi174.stdout: "uninline_succeeded": 0, 2024-09-21T03:54:19.344 INFO:teuthology.orchestra.run.smithi174.stdout: "uninline_write_failed": 0 2024-09-21T03:54:19.344 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.344 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_log": { 2024-09-21T03:54:19.344 INFO:teuthology.orchestra.run.smithi174.stdout: "evlrg": 0, 2024-09-21T03:54:19.345 INFO:teuthology.orchestra.run.smithi174.stdout: "evadd": 0, 2024-09-21T03:54:19.345 INFO:teuthology.orchestra.run.smithi174.stdout: "evex": 0, 2024-09-21T03:54:19.345 INFO:teuthology.orchestra.run.smithi174.stdout: "evtrm": 0, 2024-09-21T03:54:19.345 INFO:teuthology.orchestra.run.smithi174.stdout: "ev": 7, 2024-09-21T03:54:19.345 INFO:teuthology.orchestra.run.smithi174.stdout: "evexg": 0, 2024-09-21T03:54:19.345 INFO:teuthology.orchestra.run.smithi174.stdout: "evexd": 0, 2024-09-21T03:54:19.345 INFO:teuthology.orchestra.run.smithi174.stdout: "segadd": 0, 2024-09-21T03:54:19.345 INFO:teuthology.orchestra.run.smithi174.stdout: "segex": 0, 2024-09-21T03:54:19.345 INFO:teuthology.orchestra.run.smithi174.stdout: "segtrm": 0, 2024-09-21T03:54:19.345 INFO:teuthology.orchestra.run.smithi174.stdout: "seg": 2, 2024-09-21T03:54:19.345 INFO:teuthology.orchestra.run.smithi174.stdout: "segmjr": 2, 2024-09-21T03:54:19.345 INFO:teuthology.orchestra.run.smithi174.stdout: "segexg": 0, 2024-09-21T03:54:19.345 INFO:teuthology.orchestra.run.smithi174.stdout: "segexd": 0, 2024-09-21T03:54:19.345 INFO:teuthology.orchestra.run.smithi174.stdout: "expos": 4194304, 2024-09-21T03:54:19.346 INFO:teuthology.orchestra.run.smithi174.stdout: "wrpos": 4196347, 2024-09-21T03:54:19.346 INFO:teuthology.orchestra.run.smithi174.stdout: "rdpos": 4196206, 2024-09-21T03:54:19.346 INFO:teuthology.orchestra.run.smithi174.stdout: "jlat": { 2024-09-21T03:54:19.346 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.346 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.346 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.346 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.346 INFO:teuthology.orchestra.run.smithi174.stdout: "replayed": 7 2024-09-21T03:54:19.346 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.346 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_mem": { 2024-09-21T03:54:19.346 INFO:teuthology.orchestra.run.smithi174.stdout: "ino": 3, 2024-09-21T03:54:19.346 INFO:teuthology.orchestra.run.smithi174.stdout: "ino+": 3, 2024-09-21T03:54:19.346 INFO:teuthology.orchestra.run.smithi174.stdout: "ino-": 0, 2024-09-21T03:54:19.346 INFO:teuthology.orchestra.run.smithi174.stdout: "dir": 1, 2024-09-21T03:54:19.347 INFO:teuthology.orchestra.run.smithi174.stdout: "dir+": 1, 2024-09-21T03:54:19.347 INFO:teuthology.orchestra.run.smithi174.stdout: "dir-": 0, 2024-09-21T03:54:19.347 INFO:teuthology.orchestra.run.smithi174.stdout: "dn": 0, 2024-09-21T03:54:19.347 INFO:teuthology.orchestra.run.smithi174.stdout: "dn+": 0, 2024-09-21T03:54:19.347 INFO:teuthology.orchestra.run.smithi174.stdout: "dn-": 0, 2024-09-21T03:54:19.347 INFO:teuthology.orchestra.run.smithi174.stdout: "cap": 0, 2024-09-21T03:54:19.347 INFO:teuthology.orchestra.run.smithi174.stdout: "cap+": 0, 2024-09-21T03:54:19.347 INFO:teuthology.orchestra.run.smithi174.stdout: "cap-": 0, 2024-09-21T03:54:19.347 INFO:teuthology.orchestra.run.smithi174.stdout: "rss": 117564, 2024-09-21T03:54:19.347 INFO:teuthology.orchestra.run.smithi174.stdout: "heap": 316416000 2024-09-21T03:54:19.347 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.347 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_server": { 2024-09-21T03:54:19.347 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_client_request": 0, 2024-09-21T03:54:19.347 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_server_request": 0, 2024-09-21T03:54:19.348 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_request": 0, 2024-09-21T03:54:19.348 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_session": 0, 2024-09-21T03:54:19.348 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_peer_request": 0, 2024-09-21T03:54:19.348 INFO:teuthology.orchestra.run.smithi174.stdout: "req_create_latency": { 2024-09-21T03:54:19.348 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.348 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.348 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.348 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.348 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getattr_latency": { 2024-09-21T03:54:19.349 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.350 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.350 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.350 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.350 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getfilelock_latency": { 2024-09-21T03:54:19.350 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.350 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.350 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.351 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.351 INFO:teuthology.orchestra.run.smithi174.stdout: "req_link_latency": { 2024-09-21T03:54:19.351 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.351 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.351 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.351 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.351 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookup_latency": { 2024-09-21T03:54:19.351 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.351 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.351 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.351 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.352 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookuphash_latency": { 2024-09-21T03:54:19.352 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.352 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.352 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.352 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.352 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupino_latency": { 2024-09-21T03:54:19.352 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.352 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.352 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.352 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.352 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupname_latency": { 2024-09-21T03:54:19.352 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.352 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.352 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.353 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.353 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupparent_latency": { 2024-09-21T03:54:19.353 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.353 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.353 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.353 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.353 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupsnap_latency": { 2024-09-21T03:54:19.353 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.353 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.353 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.353 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.353 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lssnap_latency": { 2024-09-21T03:54:19.353 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.353 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.354 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.354 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.354 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mkdir_latency": { 2024-09-21T03:54:19.354 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.354 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.354 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.355 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.355 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mknod_latency": { 2024-09-21T03:54:19.355 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.355 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.355 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.355 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.355 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mksnap_latency": { 2024-09-21T03:54:19.355 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.355 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.355 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.355 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.355 INFO:teuthology.orchestra.run.smithi174.stdout: "req_open_latency": { 2024-09-21T03:54:19.355 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.356 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.356 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.356 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.356 INFO:teuthology.orchestra.run.smithi174.stdout: "req_readdir_latency": { 2024-09-21T03:54:19.356 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.356 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.356 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.356 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.356 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rename_latency": { 2024-09-21T03:54:19.356 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.356 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.356 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.356 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.356 INFO:teuthology.orchestra.run.smithi174.stdout: "req_renamesnap_latency": { 2024-09-21T03:54:19.356 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.357 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.357 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.357 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.357 INFO:teuthology.orchestra.run.smithi174.stdout: "req_snapdiff_latency": { 2024-09-21T03:54:19.357 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.357 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.357 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.357 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.357 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmdir_latency": { 2024-09-21T03:54:19.357 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.357 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.357 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.357 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.357 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmsnap_latency": { 2024-09-21T03:54:19.358 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.358 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.358 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.358 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.358 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmxattr_latency": { 2024-09-21T03:54:19.358 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.358 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.358 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.358 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.358 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setattr_latency": { 2024-09-21T03:54:19.358 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.358 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.358 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.358 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.359 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setdirlayout_latency": { 2024-09-21T03:54:19.359 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.359 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.359 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.359 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.359 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setfilelock_latency": { 2024-09-21T03:54:19.359 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.359 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.359 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.359 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.359 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setlayout_latency": { 2024-09-21T03:54:19.359 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.359 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.359 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.360 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.360 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setxattr_latency": { 2024-09-21T03:54:19.360 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.360 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.360 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.360 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.360 INFO:teuthology.orchestra.run.smithi174.stdout: "req_symlink_latency": { 2024-09-21T03:54:19.360 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.360 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.360 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.360 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.360 INFO:teuthology.orchestra.run.smithi174.stdout: "req_unlink_latency": { 2024-09-21T03:54:19.361 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.361 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.361 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.361 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.361 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_revoke_eviction": 0, 2024-09-21T03:54:19.361 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_acquisition_throttle": 0, 2024-09-21T03:54:19.361 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getvxattr_latency": { 2024-09-21T03:54:19.361 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.361 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.361 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.361 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:19.361 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.361 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_sessions": { 2024-09-21T03:54:19.361 INFO:teuthology.orchestra.run.smithi174.stdout: "session_count": 1, 2024-09-21T03:54:19.362 INFO:teuthology.orchestra.run.smithi174.stdout: "session_add": 3, 2024-09-21T03:54:19.362 INFO:teuthology.orchestra.run.smithi174.stdout: "session_remove": 2, 2024-09-21T03:54:19.362 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_open": 2, 2024-09-21T03:54:19.362 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_stale": 0, 2024-09-21T03:54:19.362 INFO:teuthology.orchestra.run.smithi174.stdout: "total_load": 0, 2024-09-21T03:54:19.362 INFO:teuthology.orchestra.run.smithi174.stdout: "average_load": 0, 2024-09-21T03:54:19.362 INFO:teuthology.orchestra.run.smithi174.stdout: "avg_session_uptime": 3331, 2024-09-21T03:54:19.362 INFO:teuthology.orchestra.run.smithi174.stdout: "mdthresh_evicted": 0 2024-09-21T03:54:19.362 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.362 INFO:teuthology.orchestra.run.smithi174.stdout: "mempool": { 2024-09-21T03:54:19.362 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:54:19.362 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_items": 0, 2024-09-21T03:54:19.362 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:54:19.363 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:54:19.363 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:54:19.363 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:54:19.363 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:54:19.363 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:54:19.363 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:54:19.363 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:54:19.363 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:54:19.363 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:54:19.363 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:54:19.363 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:54:19.363 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:54:19.363 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_items": 0, 2024-09-21T03:54:19.363 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:54:19.363 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_items": 0, 2024-09-21T03:54:19.364 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:54:19.364 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:54:19.364 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:54:19.364 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:54:19.364 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:54:19.364 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:54:19.364 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:54:19.364 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_items": 0, 2024-09-21T03:54:19.364 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:54:19.364 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:54:19.364 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:54:19.364 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_items": 0, 2024-09-21T03:54:19.364 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_bytes": 0, 2024-09-21T03:54:19.364 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_items": 0, 2024-09-21T03:54:19.365 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:54:19.365 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:54:19.365 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:54:19.365 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:54:19.365 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_bytes": 181281, 2024-09-21T03:54:19.365 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_items": 46, 2024-09-21T03:54:19.365 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:54:19.365 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_items": 0, 2024-09-21T03:54:19.365 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_bytes": 0, 2024-09-21T03:54:19.365 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_items": 0, 2024-09-21T03:54:19.365 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:54:19.365 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_items": 0, 2024-09-21T03:54:19.365 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:54:19.365 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_items": 0, 2024-09-21T03:54:19.366 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_bytes": 8088, 2024-09-21T03:54:19.366 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_items": 179, 2024-09-21T03:54:19.366 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:54:19.366 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:54:19.366 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_bytes": 0, 2024-09-21T03:54:19.366 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_items": 0, 2024-09-21T03:54:19.366 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_bytes": 8672, 2024-09-21T03:54:19.366 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_items": 13, 2024-09-21T03:54:19.366 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_bytes": 0, 2024-09-21T03:54:19.366 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_items": 0, 2024-09-21T03:54:19.366 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_bytes": 0, 2024-09-21T03:54:19.366 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_items": 0 2024-09-21T03:54:19.366 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.367 INFO:teuthology.orchestra.run.smithi174.stdout: "objecter": { 2024-09-21T03:54:19.367 INFO:teuthology.orchestra.run.smithi174.stdout: "op_active": 0, 2024-09-21T03:54:19.367 INFO:teuthology.orchestra.run.smithi174.stdout: "op_laggy": 0, 2024-09-21T03:54:19.367 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send": 2397, 2024-09-21T03:54:19.367 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send_bytes": 21, 2024-09-21T03:54:19.367 INFO:teuthology.orchestra.run.smithi174.stdout: "op_resend": 3, 2024-09-21T03:54:19.367 INFO:teuthology.orchestra.run.smithi174.stdout: "op_reply": 2397, 2024-09-21T03:54:19.367 INFO:teuthology.orchestra.run.smithi174.stdout: "op_latency": { 2024-09-21T03:54:19.367 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2397, 2024-09-21T03:54:19.367 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 1.484979542, 2024-09-21T03:54:19.367 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000619515 2024-09-21T03:54:19.367 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.367 INFO:teuthology.orchestra.run.smithi174.stdout: "op_inflight": 0, 2024-09-21T03:54:19.368 INFO:teuthology.orchestra.run.smithi174.stdout: "oplen_avg": { 2024-09-21T03:54:19.368 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2397, 2024-09-21T03:54:19.368 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 2398 2024-09-21T03:54:19.368 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.368 INFO:teuthology.orchestra.run.smithi174.stdout: "op": 2397, 2024-09-21T03:54:19.368 INFO:teuthology.orchestra.run.smithi174.stdout: "op_r": 2397, 2024-09-21T03:54:19.368 INFO:teuthology.orchestra.run.smithi174.stdout: "op_w": 0, 2024-09-21T03:54:19.368 INFO:teuthology.orchestra.run.smithi174.stdout: "op_rmw": 0, 2024-09-21T03:54:19.368 INFO:teuthology.orchestra.run.smithi174.stdout: "op_pg": 0, 2024-09-21T03:54:19.368 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_stat": 1567, 2024-09-21T03:54:19.368 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_create": 0, 2024-09-21T03:54:19.368 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_read": 828, 2024-09-21T03:54:19.368 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_write": 0, 2024-09-21T03:54:19.369 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writefull": 0, 2024-09-21T03:54:19.369 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writesame": 0, 2024-09-21T03:54:19.369 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_append": 0, 2024-09-21T03:54:19.369 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_zero": 0, 2024-09-21T03:54:19.369 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_truncate": 0, 2024-09-21T03:54:19.369 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_delete": 0, 2024-09-21T03:54:19.369 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_mapext": 0, 2024-09-21T03:54:19.369 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_sparse_read": 0, 2024-09-21T03:54:19.369 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_clonerange": 0, 2024-09-21T03:54:19.369 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_getxattr": 1, 2024-09-21T03:54:19.369 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_setxattr": 0, 2024-09-21T03:54:19.369 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_cmpxattr": 0, 2024-09-21T03:54:19.369 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_rmxattr": 0, 2024-09-21T03:54:19.369 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_resetxattrs": 0, 2024-09-21T03:54:19.370 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_call": 0, 2024-09-21T03:54:19.370 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_watch": 0, 2024-09-21T03:54:19.370 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_notify": 0, 2024-09-21T03:54:19.370 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T03:54:19.370 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls": 0, 2024-09-21T03:54:19.370 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls_filter": 0, 2024-09-21T03:54:19.370 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_other": 0, 2024-09-21T03:54:19.370 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_active": 0, 2024-09-21T03:54:19.370 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_send": 0, 2024-09-21T03:54:19.370 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_resend": 0, 2024-09-21T03:54:19.370 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_ping": 0, 2024-09-21T03:54:19.370 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_active": 0, 2024-09-21T03:54:19.370 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_send": 0, 2024-09-21T03:54:19.371 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_resend": 0, 2024-09-21T03:54:19.371 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_active": 0, 2024-09-21T03:54:19.371 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_send": 0, 2024-09-21T03:54:19.371 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_resend": 0, 2024-09-21T03:54:19.371 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_active": 0, 2024-09-21T03:54:19.371 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_send": 0, 2024-09-21T03:54:19.371 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_resend": 0, 2024-09-21T03:54:19.371 INFO:teuthology.orchestra.run.smithi174.stdout: "command_active": 0, 2024-09-21T03:54:19.371 INFO:teuthology.orchestra.run.smithi174.stdout: "command_send": 0, 2024-09-21T03:54:19.371 INFO:teuthology.orchestra.run.smithi174.stdout: "command_resend": 0, 2024-09-21T03:54:19.371 INFO:teuthology.orchestra.run.smithi174.stdout: "map_epoch": 88, 2024-09-21T03:54:19.371 INFO:teuthology.orchestra.run.smithi174.stdout: "map_full": 0, 2024-09-21T03:54:19.371 INFO:teuthology.orchestra.run.smithi174.stdout: "map_inc": 13, 2024-09-21T03:54:19.371 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_sessions": 4, 2024-09-21T03:54:19.371 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_open": 4, 2024-09-21T03:54:19.372 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_close": 0, 2024-09-21T03:54:19.372 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_laggy": 0, 2024-09-21T03:54:19.372 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_wr": 0, 2024-09-21T03:54:19.372 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_rd": 2, 2024-09-21T03:54:19.372 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_del": 0 2024-09-21T03:54:19.372 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.372 INFO:teuthology.orchestra.run.smithi174.stdout: "oft": { 2024-09-21T03:54:19.372 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_objs": 0, 2024-09-21T03:54:19.372 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_kv_pairs": 0, 2024-09-21T03:54:19.372 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_updates": 0, 2024-09-21T03:54:19.372 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_removes": 0 2024-09-21T03:54:19.372 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.372 INFO:teuthology.orchestra.run.smithi174.stdout: "purge_queue": { 2024-09-21T03:54:19.372 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops": 0, 2024-09-21T03:54:19.372 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T03:54:19.373 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing": 0, 2024-09-21T03:54:19.373 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_high_water": 0, 2024-09-21T03:54:19.373 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed_ops": 0, 2024-09-21T03:54:19.373 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed": 0, 2024-09-21T03:54:19.373 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_item_in_journal": 0 2024-09-21T03:54:19.373 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.373 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:54:19.373 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T03:54:19.373 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-09-21T03:54:19.373 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T03:54:19.373 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 2654, 2024-09-21T03:54:19.373 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 1608997, 2024-09-21T03:54:19.373 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:19.373 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 2654, 2024-09-21T03:54:19.374 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-21T03:54:19.374 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-21T03:54:19.374 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 2654, 2024-09-21T03:54:19.374 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 1608997, 2024-09-21T03:54:19.374 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T03:54:19.374 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.374 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.374 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.374 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:19.374 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.374 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_bytes": { 2024-09-21T03:54:19.374 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T03:54:19.374 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-09-21T03:54:19.374 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T03:54:19.375 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-21T03:54:19.375 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-21T03:54:19.375 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:19.375 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-21T03:54:19.375 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 2397, 2024-09-21T03:54:19.375 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 2048, 2024-09-21T03:54:19.375 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 2397, 2024-09-21T03:54:19.375 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 2048, 2024-09-21T03:54:19.375 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T03:54:19.375 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.375 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.375 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.375 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:19.375 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.376 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_ops": { 2024-09-21T03:54:19.376 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T03:54:19.376 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 1024, 2024-09-21T03:54:19.376 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T03:54:19.376 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-21T03:54:19.376 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-21T03:54:19.376 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:19.376 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-21T03:54:19.376 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 2397, 2024-09-21T03:54:19.376 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 2397, 2024-09-21T03:54:19.376 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 2397, 2024-09-21T03:54:19.376 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 2397, 2024-09-21T03:54:19.376 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T03:54:19.376 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.377 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.377 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.377 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:19.377 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.377 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle": { 2024-09-21T03:54:19.377 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T03:54:19.377 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-09-21T03:54:19.377 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T03:54:19.377 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-21T03:54:19.377 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-21T03:54:19.377 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:19.377 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-21T03:54:19.377 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-21T03:54:19.377 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-21T03:54:19.377 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 0, 2024-09-21T03:54:19.378 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 0, 2024-09-21T03:54:19.378 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T03:54:19.378 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.378 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.378 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.378 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:19.378 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.378 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle-0x557f740ed380": { 2024-09-21T03:54:19.378 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T03:54:19.378 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-09-21T03:54:19.378 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T03:54:19.378 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-21T03:54:19.378 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-21T03:54:19.378 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:19.379 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-21T03:54:19.379 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-21T03:54:19.379 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-21T03:54:19.379 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 0, 2024-09-21T03:54:19.379 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 0, 2024-09-21T03:54:19.379 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T03:54:19.379 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:19.379 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:19.379 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:19.379 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:19.379 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:19.380 INFO:teuthology.orchestra.run.smithi174.stdout: "trackedop": { 2024-09-21T03:54:19.380 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_ops_count": 0 2024-09-21T03:54:19.380 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:19.380 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-09-21T03:54:20.144 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-21T03:54:20.144 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-21T03:54:20.145 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-21T03:54:20.145 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-09-21T03:54:20.145 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=0 2024-09-21T03:54:20.145 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-21T03:54:20.145 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T03:54:20.145 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T03:54:20.145 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T03:54:20.404 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:54:20.708 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:20 smithi174 ceph-mon[34403]: pgmap v690: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-21T03:54:20.708 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:20 smithi174 ceph-mon[34403]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T03:54:20.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:20 smithi084 ceph-mon[30941]: pgmap v690: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-21T03:54:20.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:20 smithi084 ceph-mon[30941]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T03:54:20.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:20 smithi172 ceph-mon[34821]: pgmap v690: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-09-21T03:54:20.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:20 smithi172 ceph-mon[34821]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T03:54:20.992 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-09-21T03:54:20.992 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:54:20.992 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 832, 2024-09-21T03:54:20.992 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 832, 2024-09-21T03:54:20.993 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 222354, 2024-09-21T03:54:20.993 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 263816, 2024-09-21T03:54:20.993 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 6, 2024-09-21T03:54:20.993 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 2, 2024-09-21T03:54:20.993 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.105543617, 2024-09-21T03:54:20.993 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.045677198, 2024-09-21T03:54:20.993 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.024868163, 2024-09-21T03:54:20.993 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.025556975, 2024-09-21T03:54:20.993 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:20.993 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 831, 2024-09-21T03:54:20.993 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.044591029, 2024-09-21T03:54:20.994 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000053659 2024-09-21T03:54:20.994 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:20.994 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:20.994 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:20.994 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:20.994 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:20.994 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:20.994 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-21T03:54:20.994 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T03:54:20.994 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:20.994 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:54:20.994 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 977, 2024-09-21T03:54:20.994 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 968, 2024-09-21T03:54:20.995 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 1359030, 2024-09-21T03:54:20.995 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 373605, 2024-09-21T03:54:20.995 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 4, 2024-09-21T03:54:20.995 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 3, 2024-09-21T03:54:20.995 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.146961201, 2024-09-21T03:54:20.995 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.060808233, 2024-09-21T03:54:20.995 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.062014749, 2024-09-21T03:54:20.995 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.029819170, 2024-09-21T03:54:20.995 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:20.995 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 967, 2024-09-21T03:54:20.995 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.043197709, 2024-09-21T03:54:20.995 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000044671 2024-09-21T03:54:20.995 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:20.996 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:20.996 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:20.996 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:20.996 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:20.996 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:20.996 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 1181888, 2024-09-21T03:54:20.996 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 144640 2024-09-21T03:54:20.996 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:20.996 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:54:20.996 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 821, 2024-09-21T03:54:20.996 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 995, 2024-09-21T03:54:20.996 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 275680, 2024-09-21T03:54:20.996 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 651768, 2024-09-21T03:54:20.996 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 4, 2024-09-21T03:54:20.997 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 3, 2024-09-21T03:54:20.997 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.149311885, 2024-09-21T03:54:20.997 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.067752050, 2024-09-21T03:54:20.997 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.032039646, 2024-09-21T03:54:20.997 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.037465030, 2024-09-21T03:54:20.997 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:20.997 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 993, 2024-09-21T03:54:20.997 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.064213760, 2024-09-21T03:54:20.997 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000064666 2024-09-21T03:54:20.997 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:20.997 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:20.997 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:20.997 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:20.998 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:20.998 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:20.998 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T03:54:20.998 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 391008 2024-09-21T03:54:20.998 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:20.998 INFO:teuthology.orchestra.run.smithi174.stdout: "cct": { 2024-09-21T03:54:20.998 INFO:teuthology.orchestra.run.smithi174.stdout: "total_workers": 1, 2024-09-21T03:54:20.998 INFO:teuthology.orchestra.run.smithi174.stdout: "unhealthy_workers": 0 2024-09-21T03:54:20.998 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:20.998 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-MDSRank": { 2024-09-21T03:54:20.998 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-09-21T03:54:20.998 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-09-21T03:54:20.998 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 3966, 2024-09-21T03:54:20.998 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.140906620, 2024-09-21T03:54:20.999 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000035528 2024-09-21T03:54:20.999 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:20.999 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:20.999 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-PurgeQueue": { 2024-09-21T03:54:20.999 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-09-21T03:54:20.999 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-09-21T03:54:20.999 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:20.999 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:20.999 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:20.999 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:20.999 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:20.999 INFO:teuthology.orchestra.run.smithi174.stdout: "mds": { 2024-09-21T03:54:20.999 INFO:teuthology.orchestra.run.smithi174.stdout: "request": 0, 2024-09-21T03:54:21.000 INFO:teuthology.orchestra.run.smithi174.stdout: "reply": 0, 2024-09-21T03:54:21.000 INFO:teuthology.orchestra.run.smithi174.stdout: "reply_latency": { 2024-09-21T03:54:21.000 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.000 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.000 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.000 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.000 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_reply": 0, 2024-09-21T03:54:21.000 INFO:teuthology.orchestra.run.smithi174.stdout: "forward": 0, 2024-09-21T03:54:21.000 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_complete": 0, 2024-09-21T03:54:21.000 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_keys": 0, 2024-09-21T03:54:21.000 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_commit": 0, 2024-09-21T03:54:21.000 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_split": 0, 2024-09-21T03:54:21.000 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_merge": 0, 2024-09-21T03:54:21.000 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes": 0, 2024-09-21T03:54:21.001 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_top": 0, 2024-09-21T03:54:21.001 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_bottom": 0, 2024-09-21T03:54:21.001 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pin_tail": 0, 2024-09-21T03:54:21.001 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pinned": 0, 2024-09-21T03:54:21.001 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_expired": 0, 2024-09-21T03:54:21.001 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_with_caps": 0, 2024-09-21T03:54:21.001 INFO:teuthology.orchestra.run.smithi174.stdout: "caps": 0, 2024-09-21T03:54:21.001 INFO:teuthology.orchestra.run.smithi174.stdout: "subtrees": 1, 2024-09-21T03:54:21.001 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse": 0, 2024-09-21T03:54:21.001 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_hit": 0, 2024-09-21T03:54:21.001 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_forward": 0, 2024-09-21T03:54:21.001 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_discover": 0, 2024-09-21T03:54:21.001 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_dir_fetch": 0, 2024-09-21T03:54:21.001 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_remote_ino": 0, 2024-09-21T03:54:21.002 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_lock": 0, 2024-09-21T03:54:21.002 INFO:teuthology.orchestra.run.smithi174.stdout: "load_cent": 0, 2024-09-21T03:54:21.002 INFO:teuthology.orchestra.run.smithi174.stdout: "q": 0, 2024-09-21T03:54:21.002 INFO:teuthology.orchestra.run.smithi174.stdout: "exported": 0, 2024-09-21T03:54:21.002 INFO:teuthology.orchestra.run.smithi174.stdout: "exported_inodes": 0, 2024-09-21T03:54:21.002 INFO:teuthology.orchestra.run.smithi174.stdout: "imported": 0, 2024-09-21T03:54:21.002 INFO:teuthology.orchestra.run.smithi174.stdout: "imported_inodes": 0, 2024-09-21T03:54:21.002 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_dir_fetch": 0, 2024-09-21T03:54:21.002 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_backtrace_fetch": 0, 2024-09-21T03:54:21.002 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_peer_discover": 0, 2024-09-21T03:54:21.002 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rfiles": 0, 2024-09-21T03:54:21.002 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rbytes": 0, 2024-09-21T03:54:21.002 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rsnaps": 0, 2024-09-21T03:54:21.003 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T03:54:21.003 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_set_tag": 0, 2024-09-21T03:54:21.003 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T03:54:21.003 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_inotable_repaired": 0, 2024-09-21T03:54:21.003 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_inodes": 0, 2024-09-21T03:54:21.003 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T03:54:21.003 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T03:54:21.003 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_file_inodes": 0, 2024-09-21T03:54:21.003 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_inode_file_caps": 0, 2024-09-21T03:54:21.003 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T03:54:21.003 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_grant": 0, 2024-09-21T03:54:21.003 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T03:54:21.003 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T03:54:21.003 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T03:54:21.004 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps": 0, 2024-09-21T03:54:21.004 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps_dirty": 0, 2024-09-21T03:54:21.004 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_cap_release": 0, 2024-09-21T03:54:21.004 INFO:teuthology.orchestra.run.smithi174.stdout: "process_request_cap_release": 0 2024-09-21T03:54:21.004 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.004 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_cache": { 2024-09-21T03:54:21.004 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update": 0, 2024-09-21T03:54:21.004 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update_receipt": 0, 2024-09-21T03:54:21.004 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_try_discover": 0, 2024-09-21T03:54:21.004 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_send_discover": 0, 2024-09-21T03:54:21.004 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_handle_discover": 0, 2024-09-21T03:54:21.004 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays": 0, 2024-09-21T03:54:21.004 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_delayed": 0, 2024-09-21T03:54:21.004 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_enqueuing": 0, 2024-09-21T03:54:21.004 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_created": 0, 2024-09-21T03:54:21.005 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_enqueued": 0, 2024-09-21T03:54:21.005 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_reintegrated": 0, 2024-09-21T03:54:21.005 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_migrated": 0, 2024-09-21T03:54:21.005 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_processing": 0, 2024-09-21T03:54:21.005 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_enqueued": 0, 2024-09-21T03:54:21.005 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_prioritized": 0, 2024-09-21T03:54:21.005 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_started": 0, 2024-09-21T03:54:21.005 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_completed": 0, 2024-09-21T03:54:21.005 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_path": 0, 2024-09-21T03:54:21.005 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_inode": 0, 2024-09-21T03:54:21.005 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T03:54:21.005 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_exportdir": 0, 2024-09-21T03:54:21.005 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_flush": 0, 2024-09-21T03:54:21.005 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragmentdir": 0, 2024-09-21T03:54:21.005 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragstats": 0, 2024-09-21T03:54:21.006 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_inodestats": 0, 2024-09-21T03:54:21.006 INFO:teuthology.orchestra.run.smithi174.stdout: "uninline_started": 0, 2024-09-21T03:54:21.006 INFO:teuthology.orchestra.run.smithi174.stdout: "uninline_succeeded": 0, 2024-09-21T03:54:21.006 INFO:teuthology.orchestra.run.smithi174.stdout: "uninline_write_failed": 0 2024-09-21T03:54:21.006 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.006 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_log": { 2024-09-21T03:54:21.006 INFO:teuthology.orchestra.run.smithi174.stdout: "evlrg": 0, 2024-09-21T03:54:21.006 INFO:teuthology.orchestra.run.smithi174.stdout: "evadd": 0, 2024-09-21T03:54:21.006 INFO:teuthology.orchestra.run.smithi174.stdout: "evex": 0, 2024-09-21T03:54:21.006 INFO:teuthology.orchestra.run.smithi174.stdout: "evtrm": 0, 2024-09-21T03:54:21.006 INFO:teuthology.orchestra.run.smithi174.stdout: "ev": 6, 2024-09-21T03:54:21.006 INFO:teuthology.orchestra.run.smithi174.stdout: "evexg": 0, 2024-09-21T03:54:21.006 INFO:teuthology.orchestra.run.smithi174.stdout: "evexd": 0, 2024-09-21T03:54:21.006 INFO:teuthology.orchestra.run.smithi174.stdout: "segadd": 0, 2024-09-21T03:54:21.007 INFO:teuthology.orchestra.run.smithi174.stdout: "segex": 0, 2024-09-21T03:54:21.007 INFO:teuthology.orchestra.run.smithi174.stdout: "segtrm": 0, 2024-09-21T03:54:21.007 INFO:teuthology.orchestra.run.smithi174.stdout: "seg": 2, 2024-09-21T03:54:21.007 INFO:teuthology.orchestra.run.smithi174.stdout: "segmjr": 2, 2024-09-21T03:54:21.007 INFO:teuthology.orchestra.run.smithi174.stdout: "segexg": 0, 2024-09-21T03:54:21.007 INFO:teuthology.orchestra.run.smithi174.stdout: "segexd": 0, 2024-09-21T03:54:21.007 INFO:teuthology.orchestra.run.smithi174.stdout: "expos": 4194304, 2024-09-21T03:54:21.007 INFO:teuthology.orchestra.run.smithi174.stdout: "wrpos": 4196123, 2024-09-21T03:54:21.007 INFO:teuthology.orchestra.run.smithi174.stdout: "rdpos": 4195982, 2024-09-21T03:54:21.007 INFO:teuthology.orchestra.run.smithi174.stdout: "jlat": { 2024-09-21T03:54:21.007 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.007 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.007 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.007 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.007 INFO:teuthology.orchestra.run.smithi174.stdout: "replayed": 6 2024-09-21T03:54:21.008 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.008 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_mem": { 2024-09-21T03:54:21.008 INFO:teuthology.orchestra.run.smithi174.stdout: "ino": 3, 2024-09-21T03:54:21.008 INFO:teuthology.orchestra.run.smithi174.stdout: "ino+": 3, 2024-09-21T03:54:21.008 INFO:teuthology.orchestra.run.smithi174.stdout: "ino-": 0, 2024-09-21T03:54:21.008 INFO:teuthology.orchestra.run.smithi174.stdout: "dir": 1, 2024-09-21T03:54:21.008 INFO:teuthology.orchestra.run.smithi174.stdout: "dir+": 1, 2024-09-21T03:54:21.008 INFO:teuthology.orchestra.run.smithi174.stdout: "dir-": 0, 2024-09-21T03:54:21.008 INFO:teuthology.orchestra.run.smithi174.stdout: "dn": 0, 2024-09-21T03:54:21.008 INFO:teuthology.orchestra.run.smithi174.stdout: "dn+": 0, 2024-09-21T03:54:21.008 INFO:teuthology.orchestra.run.smithi174.stdout: "dn-": 0, 2024-09-21T03:54:21.008 INFO:teuthology.orchestra.run.smithi174.stdout: "cap": 0, 2024-09-21T03:54:21.008 INFO:teuthology.orchestra.run.smithi174.stdout: "cap+": 0, 2024-09-21T03:54:21.008 INFO:teuthology.orchestra.run.smithi174.stdout: "cap-": 0, 2024-09-21T03:54:21.009 INFO:teuthology.orchestra.run.smithi174.stdout: "rss": 117488, 2024-09-21T03:54:21.009 INFO:teuthology.orchestra.run.smithi174.stdout: "heap": 316424192 2024-09-21T03:54:21.009 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.009 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_server": { 2024-09-21T03:54:21.009 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_client_request": 0, 2024-09-21T03:54:21.009 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_server_request": 0, 2024-09-21T03:54:21.009 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_request": 0, 2024-09-21T03:54:21.009 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_session": 0, 2024-09-21T03:54:21.009 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_peer_request": 0, 2024-09-21T03:54:21.009 INFO:teuthology.orchestra.run.smithi174.stdout: "req_create_latency": { 2024-09-21T03:54:21.009 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.009 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.009 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.009 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.010 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getattr_latency": { 2024-09-21T03:54:21.010 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.010 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.010 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.010 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.010 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getfilelock_latency": { 2024-09-21T03:54:21.010 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.010 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.010 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.010 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.010 INFO:teuthology.orchestra.run.smithi174.stdout: "req_link_latency": { 2024-09-21T03:54:21.010 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.010 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.010 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.010 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.011 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookup_latency": { 2024-09-21T03:54:21.011 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.011 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.011 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.011 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.011 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookuphash_latency": { 2024-09-21T03:54:21.011 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.011 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.011 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.011 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.011 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupino_latency": { 2024-09-21T03:54:21.011 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.011 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.012 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.012 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.012 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupname_latency": { 2024-09-21T03:54:21.012 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.012 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.012 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.012 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.012 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupparent_latency": { 2024-09-21T03:54:21.012 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.012 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.012 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.012 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.012 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupsnap_latency": { 2024-09-21T03:54:21.012 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.012 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.013 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.013 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.013 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lssnap_latency": { 2024-09-21T03:54:21.013 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.013 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.013 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.013 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.014 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mkdir_latency": { 2024-09-21T03:54:21.014 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.014 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.014 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.014 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.014 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mknod_latency": { 2024-09-21T03:54:21.014 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.014 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.014 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.014 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.014 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mksnap_latency": { 2024-09-21T03:54:21.014 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.014 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.015 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.015 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.015 INFO:teuthology.orchestra.run.smithi174.stdout: "req_open_latency": { 2024-09-21T03:54:21.015 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.015 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.015 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.015 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.015 INFO:teuthology.orchestra.run.smithi174.stdout: "req_readdir_latency": { 2024-09-21T03:54:21.015 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.015 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.015 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.015 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.015 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rename_latency": { 2024-09-21T03:54:21.015 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.016 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.016 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.016 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.016 INFO:teuthology.orchestra.run.smithi174.stdout: "req_renamesnap_latency": { 2024-09-21T03:54:21.016 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.016 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.016 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.016 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.016 INFO:teuthology.orchestra.run.smithi174.stdout: "req_snapdiff_latency": { 2024-09-21T03:54:21.016 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.016 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.016 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.016 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.016 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmdir_latency": { 2024-09-21T03:54:21.017 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.017 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.017 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.017 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.017 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmsnap_latency": { 2024-09-21T03:54:21.017 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.017 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.017 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.017 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.017 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmxattr_latency": { 2024-09-21T03:54:21.017 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.017 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.017 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.017 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.017 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setattr_latency": { 2024-09-21T03:54:21.018 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.018 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.018 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.018 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.018 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setdirlayout_latency": { 2024-09-21T03:54:21.018 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.018 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.018 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.018 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.018 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setfilelock_latency": { 2024-09-21T03:54:21.018 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.018 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.018 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.019 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.019 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setlayout_latency": { 2024-09-21T03:54:21.019 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.019 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.019 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.019 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.019 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setxattr_latency": { 2024-09-21T03:54:21.019 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.019 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.019 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.019 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.019 INFO:teuthology.orchestra.run.smithi174.stdout: "req_symlink_latency": { 2024-09-21T03:54:21.019 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.019 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.019 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.020 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.020 INFO:teuthology.orchestra.run.smithi174.stdout: "req_unlink_latency": { 2024-09-21T03:54:21.020 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.020 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.020 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.020 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.020 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_revoke_eviction": 0, 2024-09-21T03:54:21.020 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_acquisition_throttle": 0, 2024-09-21T03:54:21.020 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getvxattr_latency": { 2024-09-21T03:54:21.020 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.020 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.020 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.020 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:21.020 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.020 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_sessions": { 2024-09-21T03:54:21.021 INFO:teuthology.orchestra.run.smithi174.stdout: "session_count": 2, 2024-09-21T03:54:21.021 INFO:teuthology.orchestra.run.smithi174.stdout: "session_add": 3, 2024-09-21T03:54:21.021 INFO:teuthology.orchestra.run.smithi174.stdout: "session_remove": 1, 2024-09-21T03:54:21.021 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_open": 3, 2024-09-21T03:54:21.021 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_stale": 0, 2024-09-21T03:54:21.021 INFO:teuthology.orchestra.run.smithi174.stdout: "total_load": 0, 2024-09-21T03:54:21.021 INFO:teuthology.orchestra.run.smithi174.stdout: "average_load": 0, 2024-09-21T03:54:21.021 INFO:teuthology.orchestra.run.smithi174.stdout: "avg_session_uptime": 2680, 2024-09-21T03:54:21.021 INFO:teuthology.orchestra.run.smithi174.stdout: "mdthresh_evicted": 0 2024-09-21T03:54:21.021 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.021 INFO:teuthology.orchestra.run.smithi174.stdout: "mempool": { 2024-09-21T03:54:21.021 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:54:21.021 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_items": 0, 2024-09-21T03:54:21.021 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:54:21.022 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:54:21.022 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:54:21.022 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:54:21.022 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:54:21.022 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:54:21.022 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:54:21.022 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:54:21.022 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:54:21.022 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:54:21.022 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:54:21.022 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:54:21.022 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:54:21.022 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_items": 0, 2024-09-21T03:54:21.022 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:54:21.023 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_items": 0, 2024-09-21T03:54:21.023 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:54:21.023 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:54:21.023 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:54:21.023 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:54:21.023 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:54:21.023 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:54:21.023 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:54:21.023 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_items": 0, 2024-09-21T03:54:21.023 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:54:21.023 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:54:21.023 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:54:21.023 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_items": 0, 2024-09-21T03:54:21.023 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_bytes": 0, 2024-09-21T03:54:21.024 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_items": 0, 2024-09-21T03:54:21.024 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:54:21.024 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:54:21.024 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:54:21.024 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:54:21.024 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_bytes": 189400, 2024-09-21T03:54:21.024 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_items": 51, 2024-09-21T03:54:21.024 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:54:21.024 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_items": 0, 2024-09-21T03:54:21.024 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_bytes": 0, 2024-09-21T03:54:21.024 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_items": 0, 2024-09-21T03:54:21.024 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:54:21.024 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_items": 0, 2024-09-21T03:54:21.024 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:54:21.025 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_items": 0, 2024-09-21T03:54:21.025 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_bytes": 8088, 2024-09-21T03:54:21.025 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_items": 179, 2024-09-21T03:54:21.025 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:54:21.025 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:54:21.025 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_bytes": 0, 2024-09-21T03:54:21.025 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_items": 0, 2024-09-21T03:54:21.025 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_bytes": 8672, 2024-09-21T03:54:21.025 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_items": 13, 2024-09-21T03:54:21.025 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_bytes": 0, 2024-09-21T03:54:21.025 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_items": 0, 2024-09-21T03:54:21.025 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_bytes": 0, 2024-09-21T03:54:21.025 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_items": 0 2024-09-21T03:54:21.025 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.026 INFO:teuthology.orchestra.run.smithi174.stdout: "objecter": { 2024-09-21T03:54:21.026 INFO:teuthology.orchestra.run.smithi174.stdout: "op_active": 0, 2024-09-21T03:54:21.026 INFO:teuthology.orchestra.run.smithi174.stdout: "op_laggy": 0, 2024-09-21T03:54:21.026 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send": 2368, 2024-09-21T03:54:21.026 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send_bytes": 21, 2024-09-21T03:54:21.026 INFO:teuthology.orchestra.run.smithi174.stdout: "op_resend": 3, 2024-09-21T03:54:21.026 INFO:teuthology.orchestra.run.smithi174.stdout: "op_reply": 2368, 2024-09-21T03:54:21.026 INFO:teuthology.orchestra.run.smithi174.stdout: "op_latency": { 2024-09-21T03:54:21.026 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2368, 2024-09-21T03:54:21.026 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 1.444980035, 2024-09-21T03:54:21.026 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000610211 2024-09-21T03:54:21.026 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.026 INFO:teuthology.orchestra.run.smithi174.stdout: "op_inflight": 0, 2024-09-21T03:54:21.027 INFO:teuthology.orchestra.run.smithi174.stdout: "oplen_avg": { 2024-09-21T03:54:21.027 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2368, 2024-09-21T03:54:21.027 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 2369 2024-09-21T03:54:21.027 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.027 INFO:teuthology.orchestra.run.smithi174.stdout: "op": 2368, 2024-09-21T03:54:21.027 INFO:teuthology.orchestra.run.smithi174.stdout: "op_r": 2368, 2024-09-21T03:54:21.027 INFO:teuthology.orchestra.run.smithi174.stdout: "op_w": 0, 2024-09-21T03:54:21.027 INFO:teuthology.orchestra.run.smithi174.stdout: "op_rmw": 0, 2024-09-21T03:54:21.027 INFO:teuthology.orchestra.run.smithi174.stdout: "op_pg": 0, 2024-09-21T03:54:21.027 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_stat": 1538, 2024-09-21T03:54:21.027 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_create": 0, 2024-09-21T03:54:21.027 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_read": 828, 2024-09-21T03:54:21.027 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_write": 0, 2024-09-21T03:54:21.027 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writefull": 0, 2024-09-21T03:54:21.028 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writesame": 0, 2024-09-21T03:54:21.028 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_append": 0, 2024-09-21T03:54:21.028 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_zero": 0, 2024-09-21T03:54:21.028 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_truncate": 0, 2024-09-21T03:54:21.028 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_delete": 0, 2024-09-21T03:54:21.028 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_mapext": 0, 2024-09-21T03:54:21.028 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_sparse_read": 0, 2024-09-21T03:54:21.028 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_clonerange": 0, 2024-09-21T03:54:21.028 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_getxattr": 1, 2024-09-21T03:54:21.028 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_setxattr": 0, 2024-09-21T03:54:21.028 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_cmpxattr": 0, 2024-09-21T03:54:21.028 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_rmxattr": 0, 2024-09-21T03:54:21.028 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_resetxattrs": 0, 2024-09-21T03:54:21.028 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_call": 0, 2024-09-21T03:54:21.029 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_watch": 0, 2024-09-21T03:54:21.029 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_notify": 0, 2024-09-21T03:54:21.029 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T03:54:21.029 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls": 0, 2024-09-21T03:54:21.029 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls_filter": 0, 2024-09-21T03:54:21.029 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_other": 0, 2024-09-21T03:54:21.029 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_active": 0, 2024-09-21T03:54:21.029 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_send": 0, 2024-09-21T03:54:21.029 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_resend": 0, 2024-09-21T03:54:21.029 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_ping": 0, 2024-09-21T03:54:21.029 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_active": 0, 2024-09-21T03:54:21.029 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_send": 0, 2024-09-21T03:54:21.029 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_resend": 0, 2024-09-21T03:54:21.029 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_active": 0, 2024-09-21T03:54:21.030 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_send": 0, 2024-09-21T03:54:21.030 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_resend": 0, 2024-09-21T03:54:21.030 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_active": 0, 2024-09-21T03:54:21.030 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_send": 0, 2024-09-21T03:54:21.030 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_resend": 0, 2024-09-21T03:54:21.030 INFO:teuthology.orchestra.run.smithi174.stdout: "command_active": 0, 2024-09-21T03:54:21.030 INFO:teuthology.orchestra.run.smithi174.stdout: "command_send": 0, 2024-09-21T03:54:21.030 INFO:teuthology.orchestra.run.smithi174.stdout: "command_resend": 0, 2024-09-21T03:54:21.030 INFO:teuthology.orchestra.run.smithi174.stdout: "map_epoch": 89, 2024-09-21T03:54:21.030 INFO:teuthology.orchestra.run.smithi174.stdout: "map_full": 0, 2024-09-21T03:54:21.030 INFO:teuthology.orchestra.run.smithi174.stdout: "map_inc": 14, 2024-09-21T03:54:21.030 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_sessions": 5, 2024-09-21T03:54:21.030 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_open": 5, 2024-09-21T03:54:21.031 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_close": 0, 2024-09-21T03:54:21.031 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_laggy": 0, 2024-09-21T03:54:21.031 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_wr": 0, 2024-09-21T03:54:21.031 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_rd": 2, 2024-09-21T03:54:21.031 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_del": 0 2024-09-21T03:54:21.031 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.031 INFO:teuthology.orchestra.run.smithi174.stdout: "oft": { 2024-09-21T03:54:21.031 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_objs": 0, 2024-09-21T03:54:21.031 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_kv_pairs": 0, 2024-09-21T03:54:21.031 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_updates": 0, 2024-09-21T03:54:21.031 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_removes": 0 2024-09-21T03:54:21.031 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.031 INFO:teuthology.orchestra.run.smithi174.stdout: "purge_queue": { 2024-09-21T03:54:21.031 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops": 0, 2024-09-21T03:54:21.031 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T03:54:21.032 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing": 0, 2024-09-21T03:54:21.032 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_high_water": 0, 2024-09-21T03:54:21.032 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed_ops": 0, 2024-09-21T03:54:21.032 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed": 0, 2024-09-21T03:54:21.032 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_item_in_journal": 0 2024-09-21T03:54:21.032 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.032 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:54:21.032 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T03:54:21.032 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-09-21T03:54:21.032 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T03:54:21.032 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 2626, 2024-09-21T03:54:21.032 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 1604497, 2024-09-21T03:54:21.032 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:21.032 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 2626, 2024-09-21T03:54:21.033 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-21T03:54:21.033 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-21T03:54:21.033 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 2626, 2024-09-21T03:54:21.033 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 1604497, 2024-09-21T03:54:21.033 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T03:54:21.033 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.033 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.033 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.033 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:21.033 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.033 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_bytes": { 2024-09-21T03:54:21.033 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T03:54:21.033 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-09-21T03:54:21.033 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T03:54:21.033 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-21T03:54:21.034 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-21T03:54:21.034 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:21.034 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-21T03:54:21.034 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 2368, 2024-09-21T03:54:21.034 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 1824, 2024-09-21T03:54:21.034 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 2368, 2024-09-21T03:54:21.034 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 1824, 2024-09-21T03:54:21.034 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T03:54:21.034 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.034 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.034 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.034 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:21.034 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.034 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_ops": { 2024-09-21T03:54:21.035 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T03:54:21.035 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 1024, 2024-09-21T03:54:21.035 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T03:54:21.035 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-21T03:54:21.035 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-21T03:54:21.035 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:21.035 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-21T03:54:21.035 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 2368, 2024-09-21T03:54:21.035 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 2368, 2024-09-21T03:54:21.035 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 2368, 2024-09-21T03:54:21.035 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 2368, 2024-09-21T03:54:21.035 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T03:54:21.035 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.035 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.036 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.036 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:21.036 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.036 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle": { 2024-09-21T03:54:21.036 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T03:54:21.036 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-09-21T03:54:21.036 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T03:54:21.036 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-21T03:54:21.036 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-21T03:54:21.036 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:21.036 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-21T03:54:21.036 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-21T03:54:21.036 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-21T03:54:21.036 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 0, 2024-09-21T03:54:21.037 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 0, 2024-09-21T03:54:21.037 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T03:54:21.037 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.037 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.037 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.037 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:21.037 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.037 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle-0x55a4b54bf450": { 2024-09-21T03:54:21.037 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T03:54:21.037 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-09-21T03:54:21.037 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T03:54:21.037 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-21T03:54:21.037 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-21T03:54:21.037 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:21.037 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-21T03:54:21.038 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-21T03:54:21.038 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-21T03:54:21.038 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 0, 2024-09-21T03:54:21.038 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 0, 2024-09-21T03:54:21.038 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T03:54:21.038 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:21.038 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:21.038 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:21.038 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:21.038 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:21.038 INFO:teuthology.orchestra.run.smithi174.stdout: "trackedop": { 2024-09-21T03:54:21.038 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_ops_count": 0 2024-09-21T03:54:21.038 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:21.038 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-09-21T03:54:21.780 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-21T03:54:21.780 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-21T03:54:21.780 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-21T03:54:21.780 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-21T03:54:21.780 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-09-21T03:54:21.780 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-21T03:54:21.780 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T03:54:21.780 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T03:54:21.781 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T03:54:22.025 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:54:22.589 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-09-21T03:54:22.589 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:54:22.589 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 71, 2024-09-21T03:54:22.589 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 74, 2024-09-21T03:54:22.589 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 13362, 2024-09-21T03:54:22.589 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 555584, 2024-09-21T03:54:22.589 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 53, 2024-09-21T03:54:22.589 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 5, 2024-09-21T03:54:22.589 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.025372199, 2024-09-21T03:54:22.589 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.003162919, 2024-09-21T03:54:22.589 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.016793377, 2024-09-21T03:54:22.590 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.000557047, 2024-09-21T03:54:22.590 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:22.590 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 72, 2024-09-21T03:54:22.590 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.020353207, 2024-09-21T03:54:22.590 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000282683 2024-09-21T03:54:22.590 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.590 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:22.590 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 52, 2024-09-21T03:54:22.590 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000005930, 2024-09-21T03:54:22.591 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000114 2024-09-21T03:54:22.591 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.591 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 928, 2024-09-21T03:54:22.591 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 976 2024-09-21T03:54:22.591 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.591 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:54:22.591 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 26, 2024-09-21T03:54:22.591 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 235, 2024-09-21T03:54:22.591 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 5561, 2024-09-21T03:54:22.591 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 413764, 2024-09-21T03:54:22.591 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 7, 2024-09-21T03:54:22.591 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 5, 2024-09-21T03:54:22.592 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.024614369, 2024-09-21T03:54:22.592 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.014165092, 2024-09-21T03:54:22.592 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.007806404, 2024-09-21T03:54:22.592 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.000383242, 2024-09-21T03:54:22.592 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:22.592 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 233, 2024-09-21T03:54:22.592 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.024386568, 2024-09-21T03:54:22.592 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000104663 2024-09-21T03:54:22.592 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.592 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:22.592 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 52, 2024-09-21T03:54:22.593 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000014991, 2024-09-21T03:54:22.593 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000288 2024-09-21T03:54:22.593 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.593 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T03:54:22.593 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 392480 2024-09-21T03:54:22.593 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.593 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:54:22.593 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 1129, 2024-09-21T03:54:22.593 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 1015, 2024-09-21T03:54:22.593 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 1446871, 2024-09-21T03:54:22.593 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 522840, 2024-09-21T03:54:22.593 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 6, 2024-09-21T03:54:22.593 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 5, 2024-09-21T03:54:22.593 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.144445703, 2024-09-21T03:54:22.594 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.068565150, 2024-09-21T03:54:22.594 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.088170325, 2024-09-21T03:54:22.594 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.005327254, 2024-09-21T03:54:22.594 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:22.594 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1015, 2024-09-21T03:54:22.594 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.056795030, 2024-09-21T03:54:22.594 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000055955 2024-09-21T03:54:22.594 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.594 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:22.594 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1554, 2024-09-21T03:54:22.594 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000473067, 2024-09-21T03:54:22.594 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000304 2024-09-21T03:54:22.594 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.595 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 1197152, 2024-09-21T03:54:22.595 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 161760 2024-09-21T03:54:22.595 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.595 INFO:teuthology.orchestra.run.smithi174.stdout: "cct": { 2024-09-21T03:54:22.595 INFO:teuthology.orchestra.run.smithi174.stdout: "total_workers": 1, 2024-09-21T03:54:22.595 INFO:teuthology.orchestra.run.smithi174.stdout: "unhealthy_workers": 0 2024-09-21T03:54:22.595 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.595 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-MDSRank": { 2024-09-21T03:54:22.595 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-09-21T03:54:22.595 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-09-21T03:54:22.595 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 51, 2024-09-21T03:54:22.595 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.001795461, 2024-09-21T03:54:22.595 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000035205 2024-09-21T03:54:22.595 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:22.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.596 INFO:teuthology.orchestra.run.smithi174.stdout: "finisher-PurgeQueue": { 2024-09-21T03:54:22.596 INFO:teuthology.orchestra.run.smithi174.stdout: "queue_len": 0, 2024-09-21T03:54:22.596 INFO:teuthology.orchestra.run.smithi174.stdout: "complete_latency": { 2024-09-21T03:54:22.596 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 2, 2024-09-21T03:54:22.596 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000022798, 2024-09-21T03:54:22.596 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000011399 2024-09-21T03:54:22.596 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:22.596 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.596 INFO:teuthology.orchestra.run.smithi174.stdout: "mds": { 2024-09-21T03:54:22.596 INFO:teuthology.orchestra.run.smithi174.stdout: "request": 6, 2024-09-21T03:54:22.596 INFO:teuthology.orchestra.run.smithi174.stdout: "reply": 4, 2024-09-21T03:54:22.597 INFO:teuthology.orchestra.run.smithi174.stdout: "reply_latency": { 2024-09-21T03:54:22.597 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 4, 2024-09-21T03:54:22.597 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000720941, 2024-09-21T03:54:22.597 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000180235 2024-09-21T03:54:22.597 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.597 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_reply": 0, 2024-09-21T03:54:22.597 INFO:teuthology.orchestra.run.smithi174.stdout: "forward": 2, 2024-09-21T03:54:22.597 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_complete": 0, 2024-09-21T03:54:22.597 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_fetch_keys": 0, 2024-09-21T03:54:22.597 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_commit": 11, 2024-09-21T03:54:22.597 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_split": 0, 2024-09-21T03:54:22.597 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_merge": 0, 2024-09-21T03:54:22.597 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes": 16, 2024-09-21T03:54:22.597 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_top": 0, 2024-09-21T03:54:22.597 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_bottom": 16, 2024-09-21T03:54:22.597 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pin_tail": 0, 2024-09-21T03:54:22.598 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_pinned": 13, 2024-09-21T03:54:22.598 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_expired": 4, 2024-09-21T03:54:22.598 INFO:teuthology.orchestra.run.smithi174.stdout: "inodes_with_caps": 1, 2024-09-21T03:54:22.598 INFO:teuthology.orchestra.run.smithi174.stdout: "caps": 2, 2024-09-21T03:54:22.598 INFO:teuthology.orchestra.run.smithi174.stdout: "subtrees": 3, 2024-09-21T03:54:22.598 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse": 15, 2024-09-21T03:54:22.598 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_hit": 10, 2024-09-21T03:54:22.598 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_forward": 0, 2024-09-21T03:54:22.598 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_discover": 4, 2024-09-21T03:54:22.598 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_dir_fetch": 0, 2024-09-21T03:54:22.598 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_remote_ino": 0, 2024-09-21T03:54:22.598 INFO:teuthology.orchestra.run.smithi174.stdout: "traverse_lock": 0, 2024-09-21T03:54:22.598 INFO:teuthology.orchestra.run.smithi174.stdout: "load_cent": 0, 2024-09-21T03:54:22.598 INFO:teuthology.orchestra.run.smithi174.stdout: "q": 0, 2024-09-21T03:54:22.598 INFO:teuthology.orchestra.run.smithi174.stdout: "exported": 0, 2024-09-21T03:54:22.599 INFO:teuthology.orchestra.run.smithi174.stdout: "exported_inodes": 0, 2024-09-21T03:54:22.599 INFO:teuthology.orchestra.run.smithi174.stdout: "imported": 0, 2024-09-21T03:54:22.599 INFO:teuthology.orchestra.run.smithi174.stdout: "imported_inodes": 0, 2024-09-21T03:54:22.599 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_dir_fetch": 0, 2024-09-21T03:54:22.599 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_backtrace_fetch": 0, 2024-09-21T03:54:22.599 INFO:teuthology.orchestra.run.smithi174.stdout: "openino_peer_discover": 0, 2024-09-21T03:54:22.599 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rfiles": 4, 2024-09-21T03:54:22.599 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rbytes": 234, 2024-09-21T03:54:22.599 INFO:teuthology.orchestra.run.smithi174.stdout: "root_rsnaps": 6, 2024-09-21T03:54:22.599 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T03:54:22.599 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_set_tag": 0, 2024-09-21T03:54:22.599 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T03:54:22.599 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_inotable_repaired": 0, 2024-09-21T03:54:22.599 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_inodes": 0, 2024-09-21T03:54:22.600 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T03:54:22.600 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T03:54:22.600 INFO:teuthology.orchestra.run.smithi174.stdout: "scrub_file_inodes": 0, 2024-09-21T03:54:22.600 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_inode_file_caps": 0, 2024-09-21T03:54:22.600 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T03:54:22.600 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_grant": 0, 2024-09-21T03:54:22.600 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T03:54:22.600 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T03:54:22.600 INFO:teuthology.orchestra.run.smithi174.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T03:54:22.600 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps": 0, 2024-09-21T03:54:22.600 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_caps_dirty": 0, 2024-09-21T03:54:22.600 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_cap_release": 0, 2024-09-21T03:54:22.600 INFO:teuthology.orchestra.run.smithi174.stdout: "process_request_cap_release": 0 2024-09-21T03:54:22.600 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.600 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_cache": { 2024-09-21T03:54:22.600 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update": 0, 2024-09-21T03:54:22.601 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_update_receipt": 13, 2024-09-21T03:54:22.601 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_try_discover": 8, 2024-09-21T03:54:22.601 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_send_discover": 8, 2024-09-21T03:54:22.601 INFO:teuthology.orchestra.run.smithi174.stdout: "dir_handle_discover": 0, 2024-09-21T03:54:22.601 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays": 0, 2024-09-21T03:54:22.601 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_delayed": 0, 2024-09-21T03:54:22.601 INFO:teuthology.orchestra.run.smithi174.stdout: "num_strays_enqueuing": 0, 2024-09-21T03:54:22.601 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_created": 0, 2024-09-21T03:54:22.601 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_enqueued": 0, 2024-09-21T03:54:22.601 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_reintegrated": 0, 2024-09-21T03:54:22.601 INFO:teuthology.orchestra.run.smithi174.stdout: "strays_migrated": 0, 2024-09-21T03:54:22.601 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_processing": 0, 2024-09-21T03:54:22.601 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_enqueued": 0, 2024-09-21T03:54:22.601 INFO:teuthology.orchestra.run.smithi174.stdout: "num_recovering_prioritized": 0, 2024-09-21T03:54:22.601 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_started": 0, 2024-09-21T03:54:22.602 INFO:teuthology.orchestra.run.smithi174.stdout: "recovery_completed": 0, 2024-09-21T03:54:22.602 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_path": 0, 2024-09-21T03:54:22.602 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_quiesce_inode": 0, 2024-09-21T03:54:22.602 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T03:54:22.602 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_exportdir": 0, 2024-09-21T03:54:22.602 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_flush": 0, 2024-09-21T03:54:22.602 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragmentdir": 0, 2024-09-21T03:54:22.602 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_fragstats": 0, 2024-09-21T03:54:22.602 INFO:teuthology.orchestra.run.smithi174.stdout: "ireq_inodestats": 0, 2024-09-21T03:54:22.602 INFO:teuthology.orchestra.run.smithi174.stdout: "uninline_started": 0, 2024-09-21T03:54:22.602 INFO:teuthology.orchestra.run.smithi174.stdout: "uninline_succeeded": 0, 2024-09-21T03:54:22.602 INFO:teuthology.orchestra.run.smithi174.stdout: "uninline_write_failed": 0 2024-09-21T03:54:22.602 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.602 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_log": { 2024-09-21T03:54:22.603 INFO:teuthology.orchestra.run.smithi174.stdout: "evlrg": 0, 2024-09-21T03:54:22.603 INFO:teuthology.orchestra.run.smithi174.stdout: "evadd": 6, 2024-09-21T03:54:22.603 INFO:teuthology.orchestra.run.smithi174.stdout: "evex": 0, 2024-09-21T03:54:22.603 INFO:teuthology.orchestra.run.smithi174.stdout: "evtrm": 0, 2024-09-21T03:54:22.603 INFO:teuthology.orchestra.run.smithi174.stdout: "ev": 6, 2024-09-21T03:54:22.603 INFO:teuthology.orchestra.run.smithi174.stdout: "evexg": 0, 2024-09-21T03:54:22.603 INFO:teuthology.orchestra.run.smithi174.stdout: "evexd": 0, 2024-09-21T03:54:22.603 INFO:teuthology.orchestra.run.smithi174.stdout: "segadd": 2, 2024-09-21T03:54:22.603 INFO:teuthology.orchestra.run.smithi174.stdout: "segex": 0, 2024-09-21T03:54:22.603 INFO:teuthology.orchestra.run.smithi174.stdout: "segtrm": 0, 2024-09-21T03:54:22.603 INFO:teuthology.orchestra.run.smithi174.stdout: "seg": 2, 2024-09-21T03:54:22.603 INFO:teuthology.orchestra.run.smithi174.stdout: "segmjr": 2, 2024-09-21T03:54:22.603 INFO:teuthology.orchestra.run.smithi174.stdout: "segexg": 0, 2024-09-21T03:54:22.603 INFO:teuthology.orchestra.run.smithi174.stdout: "segexd": 0, 2024-09-21T03:54:22.603 INFO:teuthology.orchestra.run.smithi174.stdout: "expos": 4194304, 2024-09-21T03:54:22.604 INFO:teuthology.orchestra.run.smithi174.stdout: "wrpos": 4196123, 2024-09-21T03:54:22.604 INFO:teuthology.orchestra.run.smithi174.stdout: "rdpos": 0, 2024-09-21T03:54:22.604 INFO:teuthology.orchestra.run.smithi174.stdout: "jlat": { 2024-09-21T03:54:22.604 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 5, 2024-09-21T03:54:22.604 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.010793566, 2024-09-21T03:54:22.604 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.002158713 2024-09-21T03:54:22.604 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.604 INFO:teuthology.orchestra.run.smithi174.stdout: "replayed": 0 2024-09-21T03:54:22.604 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.604 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_mem": { 2024-09-21T03:54:22.604 INFO:teuthology.orchestra.run.smithi174.stdout: "ino": 20, 2024-09-21T03:54:22.604 INFO:teuthology.orchestra.run.smithi174.stdout: "ino+": 22, 2024-09-21T03:54:22.604 INFO:teuthology.orchestra.run.smithi174.stdout: "ino-": 2, 2024-09-21T03:54:22.604 INFO:teuthology.orchestra.run.smithi174.stdout: "dir": 19, 2024-09-21T03:54:22.604 INFO:teuthology.orchestra.run.smithi174.stdout: "dir+": 23, 2024-09-21T03:54:22.605 INFO:teuthology.orchestra.run.smithi174.stdout: "dir-": 4, 2024-09-21T03:54:22.605 INFO:teuthology.orchestra.run.smithi174.stdout: "dn": 16, 2024-09-21T03:54:22.605 INFO:teuthology.orchestra.run.smithi174.stdout: "dn+": 20, 2024-09-21T03:54:22.605 INFO:teuthology.orchestra.run.smithi174.stdout: "dn-": 4, 2024-09-21T03:54:22.605 INFO:teuthology.orchestra.run.smithi174.stdout: "cap": 2, 2024-09-21T03:54:22.605 INFO:teuthology.orchestra.run.smithi174.stdout: "cap+": 2, 2024-09-21T03:54:22.605 INFO:teuthology.orchestra.run.smithi174.stdout: "cap-": 0, 2024-09-21T03:54:22.605 INFO:teuthology.orchestra.run.smithi174.stdout: "rss": 117908, 2024-09-21T03:54:22.605 INFO:teuthology.orchestra.run.smithi174.stdout: "heap": 325857280 2024-09-21T03:54:22.605 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.605 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_server": { 2024-09-21T03:54:22.605 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_client_request": 6, 2024-09-21T03:54:22.605 INFO:teuthology.orchestra.run.smithi174.stdout: "dispatch_server_request": 0, 2024-09-21T03:54:22.605 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_request": 6, 2024-09-21T03:54:22.605 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_client_session": 23, 2024-09-21T03:54:22.606 INFO:teuthology.orchestra.run.smithi174.stdout: "handle_peer_request": 0, 2024-09-21T03:54:22.606 INFO:teuthology.orchestra.run.smithi174.stdout: "req_create_latency": { 2024-09-21T03:54:22.606 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.606 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.606 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.606 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.606 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getattr_latency": { 2024-09-21T03:54:22.606 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 3, 2024-09-21T03:54:22.606 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000558652, 2024-09-21T03:54:22.606 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000186217 2024-09-21T03:54:22.606 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.606 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getfilelock_latency": { 2024-09-21T03:54:22.606 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.606 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.607 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.607 INFO:teuthology.orchestra.run.smithi174.stdout: "req_link_latency": { 2024-09-21T03:54:22.607 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.607 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.607 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.607 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookup_latency": { 2024-09-21T03:54:22.607 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.607 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.607 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.607 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.607 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookuphash_latency": { 2024-09-21T03:54:22.607 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.608 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.608 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.608 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.608 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupino_latency": { 2024-09-21T03:54:22.608 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 1, 2024-09-21T03:54:22.608 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000162289, 2024-09-21T03:54:22.608 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000162289 2024-09-21T03:54:22.608 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.608 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupname_latency": { 2024-09-21T03:54:22.608 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.608 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.608 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.608 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.608 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupparent_latency": { 2024-09-21T03:54:22.608 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.609 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.609 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.609 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lookupsnap_latency": { 2024-09-21T03:54:22.609 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.609 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.609 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.609 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.609 INFO:teuthology.orchestra.run.smithi174.stdout: "req_lssnap_latency": { 2024-09-21T03:54:22.609 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.609 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.610 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.610 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mkdir_latency": { 2024-09-21T03:54:22.610 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.610 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.610 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.610 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.610 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mknod_latency": { 2024-09-21T03:54:22.610 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.610 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.611 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.611 INFO:teuthology.orchestra.run.smithi174.stdout: "req_mksnap_latency": { 2024-09-21T03:54:22.611 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.611 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.611 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.611 INFO:teuthology.orchestra.run.smithi174.stdout: "req_open_latency": { 2024-09-21T03:54:22.611 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.611 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.611 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.611 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.611 INFO:teuthology.orchestra.run.smithi174.stdout: "req_readdir_latency": { 2024-09-21T03:54:22.611 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.611 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.612 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.612 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rename_latency": { 2024-09-21T03:54:22.612 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.612 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.612 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.612 INFO:teuthology.orchestra.run.smithi174.stdout: "req_renamesnap_latency": { 2024-09-21T03:54:22.612 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.612 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.612 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.612 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.612 INFO:teuthology.orchestra.run.smithi174.stdout: "req_snapdiff_latency": { 2024-09-21T03:54:22.612 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.613 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.613 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.613 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmdir_latency": { 2024-09-21T03:54:22.613 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.613 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.613 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.613 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmsnap_latency": { 2024-09-21T03:54:22.613 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.613 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.613 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.613 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.613 INFO:teuthology.orchestra.run.smithi174.stdout: "req_rmxattr_latency": { 2024-09-21T03:54:22.614 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.614 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.614 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.614 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setattr_latency": { 2024-09-21T03:54:22.614 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.614 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.614 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.614 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setdirlayout_latency": { 2024-09-21T03:54:22.614 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.614 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.614 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.614 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.615 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setfilelock_latency": { 2024-09-21T03:54:22.615 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.615 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.615 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.615 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setlayout_latency": { 2024-09-21T03:54:22.615 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.615 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.615 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.615 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.615 INFO:teuthology.orchestra.run.smithi174.stdout: "req_setxattr_latency": { 2024-09-21T03:54:22.615 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.615 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.616 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.616 INFO:teuthology.orchestra.run.smithi174.stdout: "req_symlink_latency": { 2024-09-21T03:54:22.616 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.616 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.616 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.616 INFO:teuthology.orchestra.run.smithi174.stdout: "req_unlink_latency": { 2024-09-21T03:54:22.616 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.616 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.616 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.616 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.616 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_revoke_eviction": 0, 2024-09-21T03:54:22.616 INFO:teuthology.orchestra.run.smithi174.stdout: "cap_acquisition_throttle": 0, 2024-09-21T03:54:22.617 INFO:teuthology.orchestra.run.smithi174.stdout: "req_getvxattr_latency": { 2024-09-21T03:54:22.617 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.617 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.617 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.617 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:22.617 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.617 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_sessions": { 2024-09-21T03:54:22.617 INFO:teuthology.orchestra.run.smithi174.stdout: "session_count": 2, 2024-09-21T03:54:22.617 INFO:teuthology.orchestra.run.smithi174.stdout: "session_add": 3, 2024-09-21T03:54:22.617 INFO:teuthology.orchestra.run.smithi174.stdout: "session_remove": 1, 2024-09-21T03:54:22.617 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_open": 2, 2024-09-21T03:54:22.617 INFO:teuthology.orchestra.run.smithi174.stdout: "sessions_stale": 0, 2024-09-21T03:54:22.617 INFO:teuthology.orchestra.run.smithi174.stdout: "total_load": 3, 2024-09-21T03:54:22.617 INFO:teuthology.orchestra.run.smithi174.stdout: "average_load": 1, 2024-09-21T03:54:22.618 INFO:teuthology.orchestra.run.smithi174.stdout: "avg_session_uptime": 695, 2024-09-21T03:54:22.618 INFO:teuthology.orchestra.run.smithi174.stdout: "mdthresh_evicted": 0 2024-09-21T03:54:22.618 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.618 INFO:teuthology.orchestra.run.smithi174.stdout: "mempool": { 2024-09-21T03:54:22.618 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:54:22.618 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_items": 0, 2024-09-21T03:54:22.618 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:54:22.618 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:54:22.618 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:54:22.618 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:54:22.618 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:54:22.618 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:54:22.618 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:54:22.618 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:54:22.619 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:54:22.619 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:54:22.619 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:54:22.619 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:54:22.619 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:54:22.619 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_items": 0, 2024-09-21T03:54:22.619 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:54:22.619 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_items": 0, 2024-09-21T03:54:22.619 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:54:22.619 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:54:22.619 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:54:22.619 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:54:22.619 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:54:22.619 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:54:22.620 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:54:22.620 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_items": 0, 2024-09-21T03:54:22.620 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:54:22.620 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:54:22.620 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:54:22.620 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_items": 0, 2024-09-21T03:54:22.620 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_bytes": 0, 2024-09-21T03:54:22.620 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_items": 0, 2024-09-21T03:54:22.620 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:54:22.620 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:54:22.620 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:54:22.620 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:54:22.620 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_bytes": 247603, 2024-09-21T03:54:22.620 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_items": 90, 2024-09-21T03:54:22.620 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_bytes": 88, 2024-09-21T03:54:22.621 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_items": 1, 2024-09-21T03:54:22.621 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_bytes": 0, 2024-09-21T03:54:22.621 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_items": 0, 2024-09-21T03:54:22.621 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:54:22.621 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_items": 0, 2024-09-21T03:54:22.621 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:54:22.621 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_items": 0, 2024-09-21T03:54:22.621 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_bytes": 7968, 2024-09-21T03:54:22.621 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_items": 176, 2024-09-21T03:54:22.621 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:54:22.621 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:54:22.621 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_bytes": 0, 2024-09-21T03:54:22.621 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_items": 0, 2024-09-21T03:54:22.621 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_bytes": 93189, 2024-09-21T03:54:22.621 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_items": 687, 2024-09-21T03:54:22.622 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_bytes": 0, 2024-09-21T03:54:22.622 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_items": 0, 2024-09-21T03:54:22.622 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_bytes": 0, 2024-09-21T03:54:22.622 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_items": 0 2024-09-21T03:54:22.622 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.622 INFO:teuthology.orchestra.run.smithi174.stdout: "objecter": { 2024-09-21T03:54:22.622 INFO:teuthology.orchestra.run.smithi174.stdout: "op_active": 0, 2024-09-21T03:54:22.622 INFO:teuthology.orchestra.run.smithi174.stdout: "op_laggy": 0, 2024-09-21T03:54:22.622 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send": 42, 2024-09-21T03:54:22.622 INFO:teuthology.orchestra.run.smithi174.stdout: "op_send_bytes": 12211, 2024-09-21T03:54:22.622 INFO:teuthology.orchestra.run.smithi174.stdout: "op_resend": 28, 2024-09-21T03:54:22.622 INFO:teuthology.orchestra.run.smithi174.stdout: "op_reply": 42, 2024-09-21T03:54:22.622 INFO:teuthology.orchestra.run.smithi174.stdout: "op_latency": { 2024-09-21T03:54:22.622 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 42, 2024-09-21T03:54:22.623 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.252996554, 2024-09-21T03:54:22.623 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.006023727 2024-09-21T03:54:22.623 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.623 INFO:teuthology.orchestra.run.smithi174.stdout: "op_inflight": 0, 2024-09-21T03:54:22.623 INFO:teuthology.orchestra.run.smithi174.stdout: "oplen_avg": { 2024-09-21T03:54:22.623 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 42, 2024-09-21T03:54:22.623 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 64 2024-09-21T03:54:22.623 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.623 INFO:teuthology.orchestra.run.smithi174.stdout: "op": 42, 2024-09-21T03:54:22.623 INFO:teuthology.orchestra.run.smithi174.stdout: "op_r": 0, 2024-09-21T03:54:22.623 INFO:teuthology.orchestra.run.smithi174.stdout: "op_w": 42, 2024-09-21T03:54:22.623 INFO:teuthology.orchestra.run.smithi174.stdout: "op_rmw": 0, 2024-09-21T03:54:22.624 INFO:teuthology.orchestra.run.smithi174.stdout: "op_pg": 0, 2024-09-21T03:54:22.624 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_stat": 0, 2024-09-21T03:54:22.624 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_create": 10, 2024-09-21T03:54:22.624 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_read": 0, 2024-09-21T03:54:22.624 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_write": 5, 2024-09-21T03:54:22.624 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writefull": 8, 2024-09-21T03:54:22.624 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_writesame": 0, 2024-09-21T03:54:22.624 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_append": 0, 2024-09-21T03:54:22.624 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_zero": 0, 2024-09-21T03:54:22.624 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_truncate": 0, 2024-09-21T03:54:22.624 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_delete": 6, 2024-09-21T03:54:22.624 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_mapext": 0, 2024-09-21T03:54:22.624 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_sparse_read": 0, 2024-09-21T03:54:22.624 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_clonerange": 0, 2024-09-21T03:54:22.624 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_getxattr": 0, 2024-09-21T03:54:22.625 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_setxattr": 20, 2024-09-21T03:54:22.625 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_cmpxattr": 0, 2024-09-21T03:54:22.625 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_rmxattr": 0, 2024-09-21T03:54:22.625 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_resetxattrs": 0, 2024-09-21T03:54:22.625 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_call": 0, 2024-09-21T03:54:22.625 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_watch": 0, 2024-09-21T03:54:22.625 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_notify": 0, 2024-09-21T03:54:22.625 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T03:54:22.625 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls": 0, 2024-09-21T03:54:22.625 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_pgls_filter": 0, 2024-09-21T03:54:22.625 INFO:teuthology.orchestra.run.smithi174.stdout: "osdop_other": 0, 2024-09-21T03:54:22.625 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_active": 0, 2024-09-21T03:54:22.625 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_send": 0, 2024-09-21T03:54:22.625 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_resend": 0, 2024-09-21T03:54:22.625 INFO:teuthology.orchestra.run.smithi174.stdout: "linger_ping": 0, 2024-09-21T03:54:22.626 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_active": 0, 2024-09-21T03:54:22.626 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_send": 0, 2024-09-21T03:54:22.626 INFO:teuthology.orchestra.run.smithi174.stdout: "poolop_resend": 0, 2024-09-21T03:54:22.626 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_active": 0, 2024-09-21T03:54:22.626 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_send": 0, 2024-09-21T03:54:22.626 INFO:teuthology.orchestra.run.smithi174.stdout: "poolstat_resend": 0, 2024-09-21T03:54:22.626 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_active": 0, 2024-09-21T03:54:22.626 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_send": 0, 2024-09-21T03:54:22.626 INFO:teuthology.orchestra.run.smithi174.stdout: "statfs_resend": 0, 2024-09-21T03:54:22.626 INFO:teuthology.orchestra.run.smithi174.stdout: "command_active": 0, 2024-09-21T03:54:22.626 INFO:teuthology.orchestra.run.smithi174.stdout: "command_send": 0, 2024-09-21T03:54:22.626 INFO:teuthology.orchestra.run.smithi174.stdout: "command_resend": 0, 2024-09-21T03:54:22.627 INFO:teuthology.orchestra.run.smithi174.stdout: "map_epoch": 89, 2024-09-21T03:54:22.627 INFO:teuthology.orchestra.run.smithi174.stdout: "map_full": 0, 2024-09-21T03:54:22.627 INFO:teuthology.orchestra.run.smithi174.stdout: "map_inc": 14, 2024-09-21T03:54:22.627 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_sessions": 8, 2024-09-21T03:54:22.627 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_open": 8, 2024-09-21T03:54:22.627 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_session_close": 0, 2024-09-21T03:54:22.627 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_laggy": 0, 2024-09-21T03:54:22.627 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_wr": 14, 2024-09-21T03:54:22.627 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_rd": 0, 2024-09-21T03:54:22.627 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_del": 1 2024-09-21T03:54:22.627 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.627 INFO:teuthology.orchestra.run.smithi174.stdout: "oft": { 2024-09-21T03:54:22.627 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_objs": 1, 2024-09-21T03:54:22.627 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_kv_pairs": 0, 2024-09-21T03:54:22.628 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_updates": 0, 2024-09-21T03:54:22.628 INFO:teuthology.orchestra.run.smithi174.stdout: "omap_total_removes": 0 2024-09-21T03:54:22.628 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.628 INFO:teuthology.orchestra.run.smithi174.stdout: "purge_queue": { 2024-09-21T03:54:22.628 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops": 0, 2024-09-21T03:54:22.628 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T03:54:22.628 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing": 0, 2024-09-21T03:54:22.628 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executing_high_water": 0, 2024-09-21T03:54:22.628 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed_ops": 0, 2024-09-21T03:54:22.628 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_executed": 0, 2024-09-21T03:54:22.628 INFO:teuthology.orchestra.run.smithi174.stdout: "pq_item_in_journal": 0 2024-09-21T03:54:22.628 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.628 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:54:22.628 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T03:54:22.628 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-09-21T03:54:22.629 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T03:54:22.629 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 1222, 2024-09-21T03:54:22.629 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 1337605, 2024-09-21T03:54:22.629 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:22.629 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 1222, 2024-09-21T03:54:22.629 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-21T03:54:22.629 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-21T03:54:22.629 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 1222, 2024-09-21T03:54:22.629 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 1337605, 2024-09-21T03:54:22.629 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T03:54:22.629 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.629 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.629 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.629 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:22.629 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.630 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_bytes": { 2024-09-21T03:54:22.630 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T03:54:22.630 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-09-21T03:54:22.630 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T03:54:22.630 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-21T03:54:22.630 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-21T03:54:22.630 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:22.630 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-21T03:54:22.630 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 42, 2024-09-21T03:54:22.630 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 12211, 2024-09-21T03:54:22.630 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 42, 2024-09-21T03:54:22.630 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 12211, 2024-09-21T03:54:22.630 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T03:54:22.631 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.631 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.631 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.631 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:22.631 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.631 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-objecter_ops": { 2024-09-21T03:54:22.631 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T03:54:22.631 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 1024, 2024-09-21T03:54:22.631 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T03:54:22.631 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-21T03:54:22.631 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-21T03:54:22.631 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:22.631 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-21T03:54:22.631 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 42, 2024-09-21T03:54:22.631 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 42, 2024-09-21T03:54:22.632 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 42, 2024-09-21T03:54:22.632 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 42, 2024-09-21T03:54:22.632 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T03:54:22.632 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.632 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.632 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.632 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:22.632 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.632 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle": { 2024-09-21T03:54:22.632 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T03:54:22.632 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-09-21T03:54:22.632 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T03:54:22.632 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 0, 2024-09-21T03:54:22.632 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 0, 2024-09-21T03:54:22.632 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:22.633 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 0, 2024-09-21T03:54:22.633 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-21T03:54:22.633 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-21T03:54:22.633 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 0, 2024-09-21T03:54:22.633 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 0, 2024-09-21T03:54:22.633 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T03:54:22.633 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.633 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.633 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.633 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:22.633 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.633 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-write_buf_throttle-0x55e32b467380": { 2024-09-21T03:54:22.633 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T03:54:22.633 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 3758096384, 2024-09-21T03:54:22.634 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T03:54:22.634 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 6, 2024-09-21T03:54:22.634 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 1819, 2024-09-21T03:54:22.634 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:22.634 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 6, 2024-09-21T03:54:22.634 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-21T03:54:22.634 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-21T03:54:22.634 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 5, 2024-09-21T03:54:22.634 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 1819, 2024-09-21T03:54:22.634 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T03:54:22.634 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:22.634 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:22.634 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:22.635 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:22.635 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:22.635 INFO:teuthology.orchestra.run.smithi174.stdout: "trackedop": { 2024-09-21T03:54:22.635 INFO:teuthology.orchestra.run.smithi174.stdout: "slow_ops_count": 0 2024-09-21T03:54:22.635 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:22.635 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-09-21T03:54:22.635 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:22 smithi174 ceph-mon[34403]: pgmap v692: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-21T03:54:22.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:22 smithi084 ceph-mon[30941]: pgmap v692: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-21T03:54:22.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:22 smithi172 ceph-mon[34821]: pgmap v692: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-21T03:54:23.405 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-21T03:54:23.405 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-21T03:54:23.405 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-09-21T03:54:23.406 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=13 2024-09-21T03:54:23.406 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-21T03:54:23.406 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-21T03:54:23.406 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T03:54:23.406 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T03:54:23.406 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T03:54:23.651 INFO:teuthology.orchestra.run.smithi174.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:54:24.250 INFO:teuthology.orchestra.run.smithi174.stdout:{ 2024-09-21T03:54:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:54:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 241, 2024-09-21T03:54:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 234, 2024-09-21T03:54:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 1152400, 2024-09-21T03:54:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 144064, 2024-09-21T03:54:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 4, 2024-09-21T03:54:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 0, 2024-09-21T03:54:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.051293482, 2024-09-21T03:54:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.022346958, 2024-09-21T03:54:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.041273470, 2024-09-21T03:54:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:54:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 233, 2024-09-21T03:54:24.251 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.016267656, 2024-09-21T03:54:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000069818 2024-09-21T03:54:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 1152400, 2024-09-21T03:54:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 144064 2024-09-21T03:54:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:54:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 5, 2024-09-21T03:54:24.252 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 181, 2024-09-21T03:54:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 3200, 2024-09-21T03:54:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 112240, 2024-09-21T03:54:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 3, 2024-09-21T03:54:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 2, 2024-09-21T03:54:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.017777442, 2024-09-21T03:54:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.012703252, 2024-09-21T03:54:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.002901370, 2024-09-21T03:54:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:54:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 180, 2024-09-21T03:54:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.017590362, 2024-09-21T03:54:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000097724 2024-09-21T03:54:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:24.253 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-09-21T03:54:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 112240 2024-09-21T03:54:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:54:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_messages": 0, 2024-09-21T03:54:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages": 2, 2024-09-21T03:54:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_bytes": 0, 2024-09-21T03:54:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_bytes": 0, 2024-09-21T03:54:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_created_connections": 2, 2024-09-21T03:54:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_active_connections": 1, 2024-09-21T03:54:24.254 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_total_time": 0.000315032, 2024-09-21T03:54:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T03:54:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_recv_time": 0.000234422, 2024-09-21T03:54:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:54:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:54:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:54:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:24.255 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T03:54:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T03:54:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "cct": { 2024-09-21T03:54:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "total_workers": 0, 2024-09-21T03:54:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "unhealthy_workers": 0 2024-09-21T03:54:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "mempool": { 2024-09-21T03:54:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:54:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "bloom_filter_items": 0, 2024-09-21T03:54:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:54:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:54:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:54:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:54:24.256 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:54:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:54:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:54:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:54:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:54:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:54:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:54:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:54:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:54:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_extent_items": 0, 2024-09-21T03:54:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:54:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_blob_items": 0, 2024-09-21T03:54:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:54:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:54:24.257 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:54:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:54:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:54:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:54:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:54:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_txc_items": 0, 2024-09-21T03:54:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:54:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:54:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:54:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: "bluestore_writing_items": 0, 2024-09-21T03:54:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_bytes": 0, 2024-09-21T03:54:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_items": 0, 2024-09-21T03:54:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:54:24.258 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:54:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:54:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:54:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_bytes": 148967, 2024-09-21T03:54:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_anon_items": 29, 2024-09-21T03:54:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:54:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: "buffer_meta_items": 0, 2024-09-21T03:54:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_bytes": 0, 2024-09-21T03:54:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_items": 0, 2024-09-21T03:54:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:54:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_mapbl_items": 0, 2024-09-21T03:54:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:54:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: "osd_pglog_items": 0, 2024-09-21T03:54:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_bytes": 0, 2024-09-21T03:54:24.259 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_items": 0, 2024-09-21T03:54:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:54:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:54:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_bytes": 0, 2024-09-21T03:54:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "pgmap_items": 0, 2024-09-21T03:54:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_bytes": 968, 2024-09-21T03:54:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "mds_co_items": 2, 2024-09-21T03:54:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_bytes": 0, 2024-09-21T03:54:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_1_items": 0, 2024-09-21T03:54:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_bytes": 0, 2024-09-21T03:54:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "unittest_2_items": 0 2024-09-21T03:54:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: }, 2024-09-21T03:54:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:54:24.260 INFO:teuthology.orchestra.run.smithi174.stdout: "val": 0, 2024-09-21T03:54:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "max": 104857600, 2024-09-21T03:54:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "get_started": 0, 2024-09-21T03:54:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "get": 242, 2024-09-21T03:54:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "get_sum": 1118321, 2024-09-21T03:54:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_fail": 0, 2024-09-21T03:54:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "get_or_fail_success": 242, 2024-09-21T03:54:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "take": 0, 2024-09-21T03:54:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "take_sum": 0, 2024-09-21T03:54:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "put": 242, 2024-09-21T03:54:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "put_sum": 1118321, 2024-09-21T03:54:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "wait": { 2024-09-21T03:54:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "avgcount": 0, 2024-09-21T03:54:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "sum": 0.000000000, 2024-09-21T03:54:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: "avgtime": 0.000000000 2024-09-21T03:54:24.261 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:24.262 INFO:teuthology.orchestra.run.smithi174.stdout: } 2024-09-21T03:54:24.262 INFO:teuthology.orchestra.run.smithi174.stdout:} 2024-09-21T03:54:24.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:24 smithi084 ceph-mon[30941]: pgmap v693: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-21T03:54:24.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:24 smithi174 ceph-mon[34403]: pgmap v693: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-21T03:54:24.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:24 smithi172 ceph-mon[34821]: pgmap v693: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-21T03:54:24.958 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-21T03:54:24.958 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-21T03:54:24.958 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-21T03:54:24.958 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-21T03:54:24.958 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-21T03:54:24.958 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-21T03:54:24.958 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-21T03:54:24.958 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T03:54:24.970 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T03:54:24.970 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T03:54:24.970 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:54:24.991 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-09-21T03:54:24.992 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:54:25.051 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T03:54:25.348 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:25.866 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.855+0000 7f46c6fda640 1 -- 172.21.15.84:0/1995659138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c0105240 msgr2=0x7f46c0105650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:25.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.855+0000 7f46c6fda640 1 --2- 172.21.15.84:0/1995659138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c0105240 0x7f46c0105650 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009900 tx=0x7f46b402a410 comp rx=0 tx=0).stop 2024-09-21T03:54:25.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.855+0000 7f46c6fda640 1 -- 172.21.15.84:0/1995659138 shutdown_connections 2024-09-21T03:54:25.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.855+0000 7f46c6fda640 1 --2- 172.21.15.84:0/1995659138 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46c0105b90 0x7f46c010f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:25.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.855+0000 7f46c6fda640 1 --2- 172.21.15.84:0/1995659138 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c0105240 0x7f46c0105650 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:25.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.855+0000 7f46c6fda640 1 --2- 172.21.15.84:0/1995659138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46c0103270 0x7f46c0103680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:25.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.855+0000 7f46c6fda640 1 -- 172.21.15.84:0/1995659138 >> 172.21.15.84:0/1995659138 conn(0x7f46c0079ec0 msgr2=0x7f46c007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:25.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.855+0000 7f46c6fda640 1 -- 172.21.15.84:0/1995659138 shutdown_connections 2024-09-21T03:54:25.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.855+0000 7f46c6fda640 1 -- 172.21.15.84:0/1995659138 wait complete. 2024-09-21T03:54:25.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.855+0000 7f46c6fda640 1 Processor -- start 2024-09-21T03:54:25.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.855+0000 7f46c6fda640 1 -- start start 2024-09-21T03:54:25.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.856+0000 7f46c6fda640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46c0103270 0x7f46c019c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:25.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.856+0000 7f46c6fda640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c0105240 0x7f46c019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:25.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.856+0000 7f46c6fda640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46c0105b90 0x7f46c01a2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:25.867 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.856+0000 7f46c6fda640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f46c0113b70 con 0x7f46c0105240 2024-09-21T03:54:25.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.856+0000 7f46c6fda640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f46c01139f0 con 0x7f46c0103270 2024-09-21T03:54:25.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.856+0000 7f46c6fda640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f46c0113cf0 con 0x7f46c0105b90 2024-09-21T03:54:25.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.856+0000 7f46bffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c0105240 0x7f46c019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:25.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.856+0000 7f46bffff640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c0105240 0x7f46c019cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37196/0 (socket says 172.21.15.84:37196) 2024-09-21T03:54:25.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.856+0000 7f46bffff640 1 -- 172.21.15.84:0/1344050847 learned_addr learned my addr 172.21.15.84:0/1344050847 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:25.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.856+0000 7f46c5577640 1 --2- 172.21.15.84:0/1344050847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46c0105b90 0x7f46c01a2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:25.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.856+0000 7f46c4d76640 1 --2- 172.21.15.84:0/1344050847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46c0103270 0x7f46c019c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:25.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.856+0000 7f46bffff640 1 -- 172.21.15.84:0/1344050847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46c0105b90 msgr2=0x7f46c01a2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:25.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.856+0000 7f46bffff640 1 --2- 172.21.15.84:0/1344050847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46c0105b90 0x7f46c01a2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:25.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.856+0000 7f46bffff640 1 -- 172.21.15.84:0/1344050847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46c0103270 msgr2=0x7f46c019c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:25.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.856+0000 7f46bffff640 1 --2- 172.21.15.84:0/1344050847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46c0103270 0x7f46c019c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:25.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.856+0000 7f46bffff640 1 -- 172.21.15.84:0/1344050847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c01a26d0 con 0x7f46c0105240 2024-09-21T03:54:25.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.856+0000 7f46bffff640 1 --2- 172.21.15.84:0/1344050847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c0105240 0x7f46c019cdc0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f46b4031a90 tx=0x7f46b4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:25.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.856+0000 7f46bdffb640 1 -- 172.21.15.84:0/1344050847 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b403f030 con 0x7f46c0105240 2024-09-21T03:54:25.868 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.857+0000 7f46bdffb640 1 -- 172.21.15.84:0/1344050847 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46b4003cb0 con 0x7f46c0105240 2024-09-21T03:54:25.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.857+0000 7f46c6fda640 1 -- 172.21.15.84:0/1344050847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46c01a2960 con 0x7f46c0105240 2024-09-21T03:54:25.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.857+0000 7f46bdffb640 1 -- 172.21.15.84:0/1344050847 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b4035070 con 0x7f46c0105240 2024-09-21T03:54:25.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.857+0000 7f46c6fda640 1 -- 172.21.15.84:0/1344050847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46c01a2e40 con 0x7f46c0105240 2024-09-21T03:54:25.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.858+0000 7f46c6fda640 1 -- 172.21.15.84:0/1344050847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46c0103680 con 0x7f46c0105240 2024-09-21T03:54:25.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.859+0000 7f46bdffb640 1 -- 172.21.15.84:0/1344050847 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f46b4042030 con 0x7f46c0105240 2024-09-21T03:54:25.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.860+0000 7f46bdffb640 1 --2- 172.21.15.84:0/1344050847 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f46a80b66b0 0x7f46a80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:25.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.860+0000 7f46c4d76640 1 --2- 172.21.15.84:0/1344050847 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f46a80b66b0 0x7f46a80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:25.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.860+0000 7f46bdffb640 1 -- 172.21.15.84:0/1344050847 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8441+0+0 (secure 0 0 0) 0x7f46b41080c0 con 0x7f46c0105240 2024-09-21T03:54:25.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.861+0000 7f46c4d76640 1 --2- 172.21.15.84:0/1344050847 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f46a80b66b0 0x7f46a80b8bc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009890 tx=0x7f46b0008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:25.869 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:25.864+0000 7f46bdffb640 1 -- 172.21.15.84:0/1344050847 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f46b40ce660 con 0x7f46c0105240 2024-09-21T03:54:26.055 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:26.053+0000 7f46c6fda640 1 -- 172.21.15.84:0/1344050847 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f46c01a92a0 con 0x7f46c0105240 2024-09-21T03:54:26.056 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:26.054+0000 7f46bdffb640 1 -- 172.21.15.84:0/1344050847 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v89) ==== 81+0+887 (secure 0 0 0) 0x7f46b40d2a40 con 0x7f46c0105240 2024-09-21T03:54:26.056 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/3590728685 2024-09-22T03:33:50.188998+0000 2024-09-21T03:54:26.056 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/3590728685 2024-09-22T03:33:50.188998+0000 2024-09-21T03:54:26.056 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3308084314 2024-09-22T03:32:17.033279+0000 2024-09-21T03:54:26.056 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3663660709 2024-09-22T03:32:17.033279+0000 2024-09-21T03:54:26.056 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1794153935 2024-09-22T03:32:49.459372+0000 2024-09-21T03:54:26.056 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/3983018447 2024-09-22T03:32:17.033279+0000 2024-09-21T03:54:26.057 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6800/4082319115 2024-09-22T03:32:49.459372+0000 2024-09-21T03:54:26.057 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1874814897 2024-09-22T03:32:17.033279+0000 2024-09-21T03:54:26.057 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/4082319115 2024-09-22T03:32:49.459372+0000 2024-09-21T03:54:26.057 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/390051797 2024-09-22T03:32:49.459372+0000 2024-09-21T03:54:26.057 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/2148206075 2024-09-22T03:32:49.459372+0000 2024-09-21T03:54:26.057 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/1916019809 2024-09-22T03:33:50.188998+0000 2024-09-21T03:54:26.057 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:6801/3983018447 2024-09-22T03:32:17.033279+0000 2024-09-21T03:54:26.057 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3491731835 2024-09-22T03:33:50.188998+0000 2024-09-21T03:54:26.057 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84:0/3418048965 2024-09-22T03:33:50.188998+0000 2024-09-21T03:54:26.057 INFO:teuthology.orchestra.run.smithi084.stderr:listed 15 entries 2024-09-21T03:54:26.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:26.056+0000 7f46c6fda640 1 -- 172.21.15.84:0/1344050847 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f46a80b66b0 msgr2=0x7f46a80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:26.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:26.056+0000 7f46c6fda640 1 --2- 172.21.15.84:0/1344050847 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f46a80b66b0 0x7f46a80b8bc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009890 tx=0x7f46b0008040 comp rx=0 tx=0).stop 2024-09-21T03:54:26.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:26.056+0000 7f46c6fda640 1 -- 172.21.15.84:0/1344050847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c0105240 msgr2=0x7f46c019cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:26.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:26.056+0000 7f46c6fda640 1 --2- 172.21.15.84:0/1344050847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c0105240 0x7f46c019cdc0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f46b4031a90 tx=0x7f46b4004270 comp rx=0 tx=0).stop 2024-09-21T03:54:26.058 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:26.056+0000 7f46c6fda640 1 -- 172.21.15.84:0/1344050847 shutdown_connections 2024-09-21T03:54:26.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:26.056+0000 7f46c6fda640 1 --2- 172.21.15.84:0/1344050847 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f46a80b66b0 0x7f46a80b8bc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:26.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:26.056+0000 7f46c6fda640 1 --2- 172.21.15.84:0/1344050847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46c0105b90 0x7f46c01a2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:26.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:26.056+0000 7f46c6fda640 1 --2- 172.21.15.84:0/1344050847 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f46c0105240 0x7f46c019cdc0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:26.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:26.056+0000 7f46c6fda640 1 --2- 172.21.15.84:0/1344050847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46c0103270 0x7f46c019c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:26.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:26.056+0000 7f46c6fda640 1 -- 172.21.15.84:0/1344050847 >> 172.21.15.84:0/1344050847 conn(0x7f46c0079ec0 msgr2=0x7f46c0106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:26.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:26.056+0000 7f46c6fda640 1 -- 172.21.15.84:0/1344050847 shutdown_connections 2024-09-21T03:54:26.059 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:26.056+0000 7f46c6fda640 1 -- 172.21.15.84:0/1344050847 wait complete. 2024-09-21T03:54:26.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:26 smithi084 ceph-mon[30941]: pgmap v694: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T03:54:26.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:26 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/1344050847' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T03:54:26.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:26 smithi174 ceph-mon[34403]: pgmap v694: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T03:54:26.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:26 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/1344050847' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T03:54:26.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:26 smithi172 ceph-mon[34821]: pgmap v694: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T03:54:26.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:26 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/1344050847' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T03:54:26.970 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T03:54:26.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:54:26.970 DEBUG:teuthology.orchestra.run.smithi084:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T03:54:27.012 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T03:54:27.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:54:27.012 DEBUG:teuthology.orchestra.run.smithi084:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T03:54:27.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:54:27.076 DEBUG:teuthology.orchestra.run.smithi084:> ip netns list 2024-09-21T03:54:27.132 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T03:54:27.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:54:27.133 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:54:27.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:54:27.199 DEBUG:teuthology.orchestra.run.smithi084:> sudo ip link delete ceph-brx 2024-09-21T03:54:27.307 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T03:54:27.317 INFO:tasks.cephadm:Teardown begin 2024-09-21T03:54:27.317 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T03:54:27.317 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:54:27.568 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:28.142 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.123+0000 7f364e8c5640 1 -- 172.21.15.84:0/2708737025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3648108420 msgr2=0x7f3648108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:28.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.123+0000 7f364e8c5640 1 --2- 172.21.15.84:0/2708737025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3648108420 0x7f3648108830 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f3630009900 tx=0x7f363002a410 comp rx=0 tx=0).stop 2024-09-21T03:54:28.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.123+0000 7f364e8c5640 1 -- 172.21.15.84:0/2708737025 shutdown_connections 2024-09-21T03:54:28.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.123+0000 7f364e8c5640 1 --2- 172.21.15.84:0/2708737025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3648108d70 0x7f364810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:28.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.123+0000 7f364e8c5640 1 --2- 172.21.15.84:0/2708737025 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3648108420 0x7f3648108830 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:28.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.123+0000 7f364e8c5640 1 --2- 172.21.15.84:0/2708737025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3648102ae0 0x7f3648102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:28.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.123+0000 7f364e8c5640 1 -- 172.21.15.84:0/2708737025 >> 172.21.15.84:0/2708737025 conn(0x7f3648079770 msgr2=0x7f3648079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:28.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.123+0000 7f364e8c5640 1 -- 172.21.15.84:0/2708737025 shutdown_connections 2024-09-21T03:54:28.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.123+0000 7f364e8c5640 1 -- 172.21.15.84:0/2708737025 wait complete. 2024-09-21T03:54:28.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.124+0000 7f364e8c5640 1 Processor -- start 2024-09-21T03:54:28.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.124+0000 7f364e8c5640 1 -- start start 2024-09-21T03:54:28.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f364e8c5640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3648102ae0 0x7f364819b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:28.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f364e8c5640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3648108420 0x7f364819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:28.143 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f364e8c5640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3648108d70 0x7f364819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:28.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f364e8c5640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f3648112a80 con 0x7f3648108d70 2024-09-21T03:54:28.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f364e8c5640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3648112900 con 0x7f3648108420 2024-09-21T03:54:28.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f364e8c5640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f3648112c00 con 0x7f3648102ae0 2024-09-21T03:54:28.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f364ce62640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3648108d70 0x7f364819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:28.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f364ce62640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3648108d70 0x7f364819be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:37200/0 (socket says 172.21.15.84:37200) 2024-09-21T03:54:28.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f364ce62640 1 -- 172.21.15.84:0/11875875 learned_addr learned my addr 172.21.15.84:0/11875875 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:28.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f3647fff640 1 --2- 172.21.15.84:0/11875875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3648102ae0 0x7f364819b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:28.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f36477fe640 1 --2- 172.21.15.84:0/11875875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3648108420 0x7f364819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:28.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f364ce62640 1 -- 172.21.15.84:0/11875875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3648102ae0 msgr2=0x7f364819b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:28.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f364ce62640 1 --2- 172.21.15.84:0/11875875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3648102ae0 0x7f364819b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:28.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f364ce62640 1 -- 172.21.15.84:0/11875875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3648108420 msgr2=0x7f364819b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:28.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f364ce62640 1 --2- 172.21.15.84:0/11875875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3648108420 0x7f364819b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:28.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f364ce62640 1 -- 172.21.15.84:0/11875875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36481a6620 con 0x7f3648108d70 2024-09-21T03:54:28.144 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f3647fff640 1 --2- 172.21.15.84:0/11875875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3648102ae0 0x7f364819b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:28.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f364ce62640 1 --2- 172.21.15.84:0/11875875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3648108d70 0x7f364819be10 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f364000cad0 tx=0x7f364000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:28.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f36457fa640 1 -- 172.21.15.84:0/11875875 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364000ae20 con 0x7f3648108d70 2024-09-21T03:54:28.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f36457fa640 1 -- 172.21.15.84:0/11875875 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3640005020 con 0x7f3648108d70 2024-09-21T03:54:28.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f364e8c5640 1 -- 172.21.15.84:0/11875875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36481a6910 con 0x7f3648108d70 2024-09-21T03:54:28.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.125+0000 7f36457fa640 1 -- 172.21.15.84:0/11875875 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364000f6b0 con 0x7f3648108d70 2024-09-21T03:54:28.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.126+0000 7f364e8c5640 1 -- 172.21.15.84:0/11875875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36481a6e20 con 0x7f3648108d70 2024-09-21T03:54:28.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.126+0000 7f364e8c5640 1 -- 172.21.15.84:0/11875875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3648103d60 con 0x7f3648108d70 2024-09-21T03:54:28.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.128+0000 7f36457fa640 1 -- 172.21.15.84:0/11875875 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f36400051d0 con 0x7f3648108d70 2024-09-21T03:54:28.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.129+0000 7f36457fa640 1 --2- 172.21.15.84:0/11875875 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f36340b66b0 0x7f36340b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:28.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.129+0000 7f3647fff640 1 --2- 172.21.15.84:0/11875875 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f36340b66b0 0x7f36340b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:28.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.129+0000 7f36457fa640 1 -- 172.21.15.84:0/11875875 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8441+0+0 (secure 0 0 0) 0x7f36400e7a50 con 0x7f3648108d70 2024-09-21T03:54:28.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.129+0000 7f3647fff640 1 --2- 172.21.15.84:0/11875875 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f36340b66b0 0x7f36340b8bc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3638005d00 tx=0x7f3638005c90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:28.145 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.132+0000 7f36457fa640 1 -- 172.21.15.84:0/11875875 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3640014030 con 0x7f3648108d70 2024-09-21T03:54:28.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.349+0000 7f364e8c5640 1 -- 172.21.15.84:0/11875875 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3648102ef0 con 0x7f3648108d70 2024-09-21T03:54:28.351 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.349+0000 7f36457fa640 1 -- 172.21.15.84:0/11875875 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7f36400adff0 con 0x7f3648108d70 2024-09-21T03:54:28.352 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:54:28.352 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:54:28.352 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:54:28.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.352+0000 7f364e8c5640 1 -- 172.21.15.84:0/11875875 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f36340b66b0 msgr2=0x7f36340b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:28.354 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.352+0000 7f364e8c5640 1 --2- 172.21.15.84:0/11875875 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f36340b66b0 0x7f36340b8bc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3638005d00 tx=0x7f3638005c90 comp rx=0 tx=0).stop 2024-09-21T03:54:28.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.352+0000 7f364e8c5640 1 -- 172.21.15.84:0/11875875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3648108d70 msgr2=0x7f364819be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:28.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.352+0000 7f364e8c5640 1 --2- 172.21.15.84:0/11875875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3648108d70 0x7f364819be10 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f364000cad0 tx=0x7f364000cf90 comp rx=0 tx=0).stop 2024-09-21T03:54:28.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.352+0000 7f364e8c5640 1 -- 172.21.15.84:0/11875875 shutdown_connections 2024-09-21T03:54:28.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.352+0000 7f364e8c5640 1 --2- 172.21.15.84:0/11875875 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f36340b66b0 0x7f36340b8bc0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:28.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.352+0000 7f364e8c5640 1 --2- 172.21.15.84:0/11875875 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f3648108d70 0x7f364819be10 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:28.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.352+0000 7f364e8c5640 1 --2- 172.21.15.84:0/11875875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3648108420 0x7f364819b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:28.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.352+0000 7f364e8c5640 1 --2- 172.21.15.84:0/11875875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3648102ae0 0x7f364819b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:28.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.352+0000 7f364e8c5640 1 -- 172.21.15.84:0/11875875 >> 172.21.15.84:0/11875875 conn(0x7f3648079770 msgr2=0x7f36481064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:28.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.352+0000 7f364e8c5640 1 -- 172.21.15.84:0/11875875 shutdown_connections 2024-09-21T03:54:28.355 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:28.352+0000 7f364e8c5640 1 -- 172.21.15.84:0/11875875 wait complete. 2024-09-21T03:54:28.730 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:28 smithi084 ceph-mon[30941]: pgmap v695: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T03:54:28.730 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:28 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/11875875' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:28.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:28 smithi174 ceph-mon[34403]: pgmap v695: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T03:54:28.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:28 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/11875875' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:28.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:28 smithi172 ceph-mon[34821]: pgmap v695: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T03:54:28.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:28 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/11875875' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:29.118 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:54:29.366 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:29.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.862+0000 7f9ce8b9e640 1 -- 172.21.15.84:0/3378404695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ce4108cf0 msgr2=0x7f9ce410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:29.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.862+0000 7f9ce8b9e640 1 --2- 172.21.15.84:0/3378404695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ce4108cf0 0x7f9ce410f520 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc009ca0 tx=0x7f9cdc02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:54:29.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.862+0000 7f9ce8b9e640 1 -- 172.21.15.84:0/3378404695 shutdown_connections 2024-09-21T03:54:29.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.862+0000 7f9ce8b9e640 1 --2- 172.21.15.84:0/3378404695 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ce4108cf0 0x7f9ce410f520 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:29.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.862+0000 7f9ce8b9e640 1 --2- 172.21.15.84:0/3378404695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ce41083a0 0x7f9ce41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:29.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.862+0000 7f9ce8b9e640 1 --2- 172.21.15.84:0/3378404695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ce4102a60 0x7f9ce4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:29.884 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.862+0000 7f9ce8b9e640 1 -- 172.21.15.84:0/3378404695 >> 172.21.15.84:0/3378404695 conn(0x7f9ce4079730 msgr2=0x7f9ce4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:29.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.862+0000 7f9ce8b9e640 1 -- 172.21.15.84:0/3378404695 shutdown_connections 2024-09-21T03:54:29.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.862+0000 7f9ce8b9e640 1 -- 172.21.15.84:0/3378404695 wait complete. 2024-09-21T03:54:29.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.863+0000 7f9ce8b9e640 1 Processor -- start 2024-09-21T03:54:29.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.863+0000 7f9ce8b9e640 1 -- start start 2024-09-21T03:54:29.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.863+0000 7f9ce8b9e640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ce4102a60 0x7f9ce419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:29.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.863+0000 7f9ce8b9e640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ce41083a0 0x7f9ce419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:29.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.863+0000 7f9ce8b9e640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ce4108cf0 0x7f9ce419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:29.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.863+0000 7f9ce8b9e640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce41129c0 con 0x7f9ce4102a60 2024-09-21T03:54:29.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.863+0000 7f9ce8b9e640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce4112840 con 0x7f9ce4108cf0 2024-09-21T03:54:29.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.863+0000 7f9ce8b9e640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce4112b40 con 0x7f9ce41083a0 2024-09-21T03:54:29.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.863+0000 7f9ce259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ce4102a60 0x7f9ce419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:29.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.863+0000 7f9ce259c640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ce4102a60 0x7f9ce419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49868/0 (socket says 172.21.15.84:49868) 2024-09-21T03:54:29.885 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.863+0000 7f9ce259c640 1 -- 172.21.15.84:0/3873785615 learned_addr learned my addr 172.21.15.84:0/3873785615 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:29.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.864+0000 7f9ce2d9d640 1 --2- 172.21.15.84:0/3873785615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ce4108cf0 0x7f9ce419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:29.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.864+0000 7f9ce259c640 1 -- 172.21.15.84:0/3873785615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ce41083a0 msgr2=0x7f9ce419aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:29.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.864+0000 7f9cd9d9b640 1 --2- 172.21.15.84:0/3873785615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ce41083a0 0x7f9ce419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:29.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.864+0000 7f9ce259c640 1 --2- 172.21.15.84:0/3873785615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ce41083a0 0x7f9ce419aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:29.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.864+0000 7f9ce259c640 1 -- 172.21.15.84:0/3873785615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ce4108cf0 msgr2=0x7f9ce419fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:29.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.864+0000 7f9ce259c640 1 --2- 172.21.15.84:0/3873785615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ce4108cf0 0x7f9ce419fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:29.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.864+0000 7f9ce259c640 1 -- 172.21.15.84:0/3873785615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce41a0330 con 0x7f9ce4102a60 2024-09-21T03:54:29.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.864+0000 7f9ce2d9d640 1 --2- 172.21.15.84:0/3873785615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ce4108cf0 0x7f9ce419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:54:29.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.864+0000 7f9cd9d9b640 1 --2- 172.21.15.84:0/3873785615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ce41083a0 0x7f9ce419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:54:29.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.864+0000 7f9ce259c640 1 --2- 172.21.15.84:0/3873785615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ce4102a60 0x7f9ce419a480 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400c920 tx=0x7f9cd400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:29.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.864+0000 7f9cdbfff640 1 -- 172.21.15.84:0/3873785615 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4007c70 con 0x7f9ce4102a60 2024-09-21T03:54:29.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.864+0000 7f9ce8b9e640 1 -- 172.21.15.84:0/3873785615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce41a0620 con 0x7f9ce4102a60 2024-09-21T03:54:29.886 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.864+0000 7f9cdbfff640 1 -- 172.21.15.84:0/3873785615 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cd4007e10 con 0x7f9ce4102a60 2024-09-21T03:54:29.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.864+0000 7f9cdbfff640 1 -- 172.21.15.84:0/3873785615 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4018820 con 0x7f9ce4102a60 2024-09-21T03:54:29.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.864+0000 7f9ce8b9e640 1 -- 172.21.15.84:0/3873785615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce41a6e40 con 0x7f9ce4102a60 2024-09-21T03:54:29.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.865+0000 7f9ce8b9e640 1 -- 172.21.15.84:0/3873785615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce4102e70 con 0x7f9ce4102a60 2024-09-21T03:54:29.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.867+0000 7f9cdbfff640 1 -- 172.21.15.84:0/3873785615 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f9cd400f450 con 0x7f9ce4102a60 2024-09-21T03:54:29.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.867+0000 7f9cdbfff640 1 --2- 172.21.15.84:0/3873785615 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9cd00b66b0 0x7f9cd00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:29.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.868+0000 7f9cd9d9b640 1 --2- 172.21.15.84:0/3873785615 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9cd00b66b0 0x7f9cd00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:29.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.868+0000 7f9cdbfff640 1 -- 172.21.15.84:0/3873785615 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8441+0+0 (secure 0 0 0) 0x7f9cd40e7b30 con 0x7f9ce4102a60 2024-09-21T03:54:29.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.868+0000 7f9cd9d9b640 1 --2- 172.21.15.84:0/3873785615 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9cd00b66b0 0x7f9cd00b8bc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc006fd0 tx=0x7f9ccc008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:29.887 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:29.870+0000 7f9cdbfff640 1 -- 172.21.15.84:0/3873785615 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9cd4014030 con 0x7f9ce4102a60 2024-09-21T03:54:30.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:30.090+0000 7f9ce8b9e640 1 -- 172.21.15.84:0/3873785615 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ce419b5b0 con 0x7f9ce4102a60 2024-09-21T03:54:30.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:30.090+0000 7f9cdbfff640 1 -- 172.21.15.84:0/3873785615 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11917 (secure 0 0 0) 0x7f9cd40ae160 con 0x7f9ce4102a60 2024-09-21T03:54:30.093 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:54:30.093 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":25,"btime":"2024-09-21T03:42:20:366565+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14793,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6835/416296973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6834","nonce":416296973},{"type":"v1","addr":"172.21.15.84:6835","nonce":416296973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14805,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6837/1339085683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6836","nonce":1339085683},{"type":"v1","addr":"172.21.15.84:6837","nonce":1339085683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14853,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6839/3243669807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6838","nonce":3243669807},{"type":"v1","addr":"172.21.15.84:6839","nonce":3243669807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14865,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.84:6841/4285519513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6840","nonce":4285519513},{"type":"v1","addr":"172.21.15.84:6841","nonce":4285519513}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24580,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6833/4033444564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":4033444564},{"type":"v1","addr":"172.21.15.174:6833","nonce":4033444564}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24581,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/3292859704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":3292859704},{"type":"v1","addr":"172.21.15.172:6833","nonce":3292859704}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:40:29.979744+0000","modified":"2024-09-21T03:42:19.815604+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24668,"mds_1":24638,"mds_2":24634},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24607":{"gid":24607,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6835/3726620036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":3726620036},{"type":"v1","addr":"172.21.15.174:6835","nonce":3726620036}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24613":{"gid":24613,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6837/152508350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6836","nonce":152508350},{"type":"v1","addr":"172.21.15.174:6837","nonce":152508350}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24614":{"gid":24614,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6835/1309799170","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1309799170},{"type":"v1","addr":"172.21.15.172:6835","nonce":1309799170}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":8,"addr":"172.21.15.174:6839/386916231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":386916231},{"type":"v1","addr":"172.21.15.174:6839","nonce":386916231}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24638":{"gid":24638,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.172:6837/2515764700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2515764700},{"type":"v1","addr":"172.21.15.172:6837","nonce":2515764700}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24668":{"gid":24668,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.172:6839/3909390777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":3909390777},{"type":"v1","addr":"172.21.15.172:6839","nonce":3909390777}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24668,"qdb_cluster":[24668,24638,24634]},"id":1}]} 2024-09-21T03:54:30.093 INFO:teuthology.orchestra.run.smithi084.stderr:dumped fsmap epoch 25 2024-09-21T03:54:30.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:30.093+0000 7f9ce8b9e640 1 -- 172.21.15.84:0/3873785615 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9cd00b66b0 msgr2=0x7f9cd00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:30.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:30.093+0000 7f9ce8b9e640 1 --2- 172.21.15.84:0/3873785615 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9cd00b66b0 0x7f9cd00b8bc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc006fd0 tx=0x7f9ccc008040 comp rx=0 tx=0).stop 2024-09-21T03:54:30.095 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:30.093+0000 7f9ce8b9e640 1 -- 172.21.15.84:0/3873785615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ce4102a60 msgr2=0x7f9ce419a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:30.093+0000 7f9ce8b9e640 1 --2- 172.21.15.84:0/3873785615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ce4102a60 0x7f9ce419a480 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400c920 tx=0x7f9cd400cde0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:30.093+0000 7f9ce8b9e640 1 -- 172.21.15.84:0/3873785615 shutdown_connections 2024-09-21T03:54:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:30.093+0000 7f9ce8b9e640 1 --2- 172.21.15.84:0/3873785615 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f9cd00b66b0 0x7f9cd00b8bc0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:30.093+0000 7f9ce8b9e640 1 --2- 172.21.15.84:0/3873785615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ce4108cf0 0x7f9ce419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:30.093+0000 7f9ce8b9e640 1 --2- 172.21.15.84:0/3873785615 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9ce41083a0 0x7f9ce419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:30.093+0000 7f9ce8b9e640 1 --2- 172.21.15.84:0/3873785615 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f9ce4102a60 0x7f9ce419a480 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:30.093+0000 7f9ce8b9e640 1 -- 172.21.15.84:0/3873785615 >> 172.21.15.84:0/3873785615 conn(0x7f9ce4079730 msgr2=0x7f9ce41019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:30.093+0000 7f9ce8b9e640 1 -- 172.21.15.84:0/3873785615 shutdown_connections 2024-09-21T03:54:30.096 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:30.093+0000 7f9ce8b9e640 1 -- 172.21.15.84:0/3873785615 wait complete. 2024-09-21T03:54:30.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:30 smithi084 ceph-mon[30941]: pgmap v696: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T03:54:30.780 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:30 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3873785615' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:30.808 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:54:30.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:30 smithi174 ceph-mon[34403]: pgmap v696: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T03:54:30.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:30 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3873785615' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:30.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:30 smithi172 ceph-mon[34821]: pgmap v696: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T03:54:30.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:30 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3873785615' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:54:31.055 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:31.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.562+0000 7f5d0e515640 1 -- 172.21.15.84:0/3075944675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d08102a80 msgr2=0x7f5d08102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:31.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.562+0000 7f5d0e515640 1 --2- 172.21.15.84:0/3075944675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d08102a80 0x7f5d08102e90 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8009900 tx=0x7f5cf802a410 comp rx=0 tx=0).stop 2024-09-21T03:54:31.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.562+0000 7f5d0e515640 1 -- 172.21.15.84:0/3075944675 shutdown_connections 2024-09-21T03:54:31.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.562+0000 7f5d0e515640 1 --2- 172.21.15.84:0/3075944675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d08108d10 0x7f5d0810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:31.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.562+0000 7f5d0e515640 1 --2- 172.21.15.84:0/3075944675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d081083c0 0x7f5d081087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:31.583 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.562+0000 7f5d0e515640 1 --2- 172.21.15.84:0/3075944675 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d08102a80 0x7f5d08102e90 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:31.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.562+0000 7f5d0e515640 1 -- 172.21.15.84:0/3075944675 >> 172.21.15.84:0/3075944675 conn(0x7f5d08079740 msgr2=0x7f5d08079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:31.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.562+0000 7f5d0e515640 1 -- 172.21.15.84:0/3075944675 shutdown_connections 2024-09-21T03:54:31.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.562+0000 7f5d0e515640 1 -- 172.21.15.84:0/3075944675 wait complete. 2024-09-21T03:54:31.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.563+0000 7f5d0e515640 1 Processor -- start 2024-09-21T03:54:31.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.563+0000 7f5d0e515640 1 -- start start 2024-09-21T03:54:31.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.563+0000 7f5d0e515640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d08102a80 0x7f5d0819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:31.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.563+0000 7f5d0e515640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d081083c0 0x7f5d0819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:31.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.563+0000 7f5d0e515640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d08108d10 0x7f5d0819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:31.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.563+0000 7f5d0e515640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5d08112980 con 0x7f5d08108d10 2024-09-21T03:54:31.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.563+0000 7f5d0e515640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5d08112800 con 0x7f5d081083c0 2024-09-21T03:54:31.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.563+0000 7f5d0e515640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5d08112b00 con 0x7f5d08102a80 2024-09-21T03:54:31.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.564+0000 7f5d0cab2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d08108d10 0x7f5d0819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:31.584 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.564+0000 7f5d0cab2640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d08108d10 0x7f5d0819fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49888/0 (socket says 172.21.15.84:49888) 2024-09-21T03:54:31.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.564+0000 7f5d0cab2640 1 -- 172.21.15.84:0/2020042963 learned_addr learned my addr 172.21.15.84:0/2020042963 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:31.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.564+0000 7f5cfffff640 1 --2- 172.21.15.84:0/2020042963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d081083c0 0x7f5d0819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:31.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.564+0000 7f5d07fff640 1 --2- 172.21.15.84:0/2020042963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d08102a80 0x7f5d0819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:31.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.564+0000 7f5d0cab2640 1 -- 172.21.15.84:0/2020042963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d08102a80 msgr2=0x7f5d0819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:31.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.564+0000 7f5d0cab2640 1 --2- 172.21.15.84:0/2020042963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d08102a80 0x7f5d0819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:31.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.564+0000 7f5d0cab2640 1 -- 172.21.15.84:0/2020042963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d081083c0 msgr2=0x7f5d0819aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:31.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.564+0000 7f5d0cab2640 1 --2- 172.21.15.84:0/2020042963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d081083c0 0x7f5d0819aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:31.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.564+0000 7f5d0cab2640 1 -- 172.21.15.84:0/2020042963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d081a0450 con 0x7f5d08108d10 2024-09-21T03:54:31.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.564+0000 7f5d0cab2640 1 --2- 172.21.15.84:0/2020042963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d08108d10 0x7f5d0819fd20 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000eaa0 tx=0x7f5d0000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:31.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.564+0000 7f5d05ffb640 1 -- 172.21.15.84:0/2020042963 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0000cdb0 con 0x7f5d08108d10 2024-09-21T03:54:31.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.564+0000 7f5d05ffb640 1 -- 172.21.15.84:0/2020042963 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d00005020 con 0x7f5d08108d10 2024-09-21T03:54:31.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.564+0000 7f5d05ffb640 1 -- 172.21.15.84:0/2020042963 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d000116d0 con 0x7f5d08108d10 2024-09-21T03:54:31.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.564+0000 7f5d0e515640 1 -- 172.21.15.84:0/2020042963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d081a0740 con 0x7f5d08108d10 2024-09-21T03:54:31.585 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.564+0000 7f5d0e515640 1 -- 172.21.15.84:0/2020042963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d081a6ea0 con 0x7f5d08108d10 2024-09-21T03:54:31.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.565+0000 7f5d0e515640 1 -- 172.21.15.84:0/2020042963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d08103d00 con 0x7f5d08108d10 2024-09-21T03:54:31.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.567+0000 7f5d05ffb640 1 -- 172.21.15.84:0/2020042963 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f5d000051d0 con 0x7f5d08108d10 2024-09-21T03:54:31.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.567+0000 7f5d05ffb640 1 --2- 172.21.15.84:0/2020042963 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5cf40b6700 0x7f5cf40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:31.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.568+0000 7f5d07fff640 1 --2- 172.21.15.84:0/2020042963 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5cf40b6700 0x7f5cf40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:31.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.568+0000 7f5d05ffb640 1 -- 172.21.15.84:0/2020042963 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8441+0+0 (secure 0 0 0) 0x7f5d000e7770 con 0x7f5d08108d10 2024-09-21T03:54:31.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.568+0000 7f5d07fff640 1 --2- 172.21.15.84:0/2020042963 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5cf40b6700 0x7f5cf40b8c10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8031440 tx=0x7f5cf8005d50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:31.586 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.572+0000 7f5d05ffb640 1 -- 172.21.15.84:0/2020042963 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5d00016030 con 0x7f5d08108d10 2024-09-21T03:54:31.753 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.751+0000 7f5d0e515640 1 -- 172.21.15.84:0/2020042963 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5d0819b610 con 0x7f5d08108d10 2024-09-21T03:54:31.755 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.753+0000 7f5d05ffb640 1 -- 172.21.15.84:0/2020042963 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+23109 (secure 0 0 0) 0x7f5d000adcf0 con 0x7f5d08108d10 2024-09-21T03:54:31.755 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-09-21T03:54:31.755 INFO:teuthology.orchestra.run.smithi084.stdout:{"epoch":89,"fsid":"e3f8c18e-77c9-11ef-baf5-efdc52797490","created":"2024-09-21T03:31:55.307035+0000","modified":"2024-09-21T03:54:20.348678+0000","last_up_change":"2024-09-21T03:39:38.786385+0000","last_in_change":"2024-09-21T03:39:15.267368+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:35:50.488653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:40:25.934375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:40:27.981681+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":88,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9d283ba0-18f3-4668-90c4-884e9e957a88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6803","nonce":508132562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6805","nonce":508132562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6809","nonce":508132562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":508132562},{"type":"v1","addr":"172.21.15.84:6807","nonce":508132562}]},"public_addr":"172.21.15.84:6803/508132562","cluster_addr":"172.21.15.84:6805/508132562","heartbeat_back_addr":"172.21.15.84:6809/508132562","heartbeat_front_addr":"172.21.15.84:6807/508132562","state":["exists","up"]},{"osd":1,"uuid":"f115c5b6-812d-430f-9f0e-cb5311b7581e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6801","nonce":2931872350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6803","nonce":2931872350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6807","nonce":2931872350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":2931872350},{"type":"v1","addr":"172.21.15.172:6805","nonce":2931872350}]},"public_addr":"172.21.15.172:6801/2931872350","cluster_addr":"172.21.15.172:6803/2931872350","heartbeat_back_addr":"172.21.15.172:6807/2931872350","heartbeat_front_addr":"172.21.15.172:6805/2931872350","state":["exists","up"]},{"osd":2,"uuid":"36489240-e233-4aa7-ae9c-089d76683172","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6801","nonce":1847612335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6803","nonce":1847612335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6807","nonce":1847612335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1847612335},{"type":"v1","addr":"172.21.15.174:6805","nonce":1847612335}]},"public_addr":"172.21.15.174:6801/1847612335","cluster_addr":"172.21.15.174:6803/1847612335","heartbeat_back_addr":"172.21.15.174:6807/1847612335","heartbeat_front_addr":"172.21.15.174:6805/1847612335","state":["exists","up"]},{"osd":3,"uuid":"1f35b404-b658-4e94-a5f4-74a6431a6a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6810","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6811","nonce":2230529863}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6812","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6813","nonce":2230529863}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6816","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6817","nonce":2230529863}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6814","nonce":2230529863},{"type":"v1","addr":"172.21.15.84:6815","nonce":2230529863}]},"public_addr":"172.21.15.84:6811/2230529863","cluster_addr":"172.21.15.84:6813/2230529863","heartbeat_back_addr":"172.21.15.84:6817/2230529863","heartbeat_front_addr":"172.21.15.84:6815/2230529863","state":["exists","up"]},{"osd":4,"uuid":"91a2f83b-4c7d-4661-86a1-63a09888939d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6809","nonce":3069862739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6811","nonce":3069862739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6815","nonce":3069862739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3069862739},{"type":"v1","addr":"172.21.15.172:6813","nonce":3069862739}]},"public_addr":"172.21.15.172:6809/3069862739","cluster_addr":"172.21.15.172:6811/3069862739","heartbeat_back_addr":"172.21.15.172:6815/3069862739","heartbeat_front_addr":"172.21.15.172:6813/3069862739","state":["exists","up"]},{"osd":5,"uuid":"e8f06b34-3956-499f-8073-09011cf1ce0a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6809","nonce":1987010600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6810","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6811","nonce":1987010600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6815","nonce":1987010600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":1987010600},{"type":"v1","addr":"172.21.15.174:6813","nonce":1987010600}]},"public_addr":"172.21.15.174:6809/1987010600","cluster_addr":"172.21.15.174:6811/1987010600","heartbeat_back_addr":"172.21.15.174:6815/1987010600","heartbeat_front_addr":"172.21.15.174:6813/1987010600","state":["exists","up"]},{"osd":6,"uuid":"23d55e96-4987-4cbe-8c6b-cece4de9269b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6818","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6819","nonce":3418459345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6820","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6821","nonce":3418459345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6824","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6825","nonce":3418459345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6822","nonce":3418459345},{"type":"v1","addr":"172.21.15.84:6823","nonce":3418459345}]},"public_addr":"172.21.15.84:6819/3418459345","cluster_addr":"172.21.15.84:6821/3418459345","heartbeat_back_addr":"172.21.15.84:6825/3418459345","heartbeat_front_addr":"172.21.15.84:6823/3418459345","state":["exists","up"]},{"osd":7,"uuid":"ca91a34c-d8b1-48b8-93f4-72a5c15939d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6817","nonce":4056019738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6819","nonce":4056019738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6823","nonce":4056019738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":4056019738},{"type":"v1","addr":"172.21.15.172:6821","nonce":4056019738}]},"public_addr":"172.21.15.172:6817/4056019738","cluster_addr":"172.21.15.172:6819/4056019738","heartbeat_back_addr":"172.21.15.172:6823/4056019738","heartbeat_front_addr":"172.21.15.172:6821/4056019738","state":["exists","up"]},{"osd":8,"uuid":"37da8c61-d72f-4b58-b10c-7c7539ecffd0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6817","nonce":2162992546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6819","nonce":2162992546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6823","nonce":2162992546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":2162992546},{"type":"v1","addr":"172.21.15.174:6821","nonce":2162992546}]},"public_addr":"172.21.15.174:6817/2162992546","cluster_addr":"172.21.15.174:6819/2162992546","heartbeat_back_addr":"172.21.15.174:6823/2162992546","heartbeat_front_addr":"172.21.15.174:6821/2162992546","state":["exists","up"]},{"osd":9,"uuid":"c9179f33-622d-44bd-9d8a-c92951afb1e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6826","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6827","nonce":3230873673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6828","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6829","nonce":3230873673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6832","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6833","nonce":3230873673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6830","nonce":3230873673},{"type":"v1","addr":"172.21.15.84:6831","nonce":3230873673}]},"public_addr":"172.21.15.84:6827/3230873673","cluster_addr":"172.21.15.84:6829/3230873673","heartbeat_back_addr":"172.21.15.84:6833/3230873673","heartbeat_front_addr":"172.21.15.84:6831/3230873673","state":["exists","up"]},{"osd":10,"uuid":"9788fa2d-49fb-431b-a0e3-62d6e421e11e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6825","nonce":2667099391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6827","nonce":2667099391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6831","nonce":2667099391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":2667099391},{"type":"v1","addr":"172.21.15.172:6829","nonce":2667099391}]},"public_addr":"172.21.15.172:6825/2667099391","cluster_addr":"172.21.15.172:6827/2667099391","heartbeat_back_addr":"172.21.15.172:6831/2667099391","heartbeat_front_addr":"172.21.15.172:6829/2667099391","state":["exists","up"]},{"osd":11,"uuid":"a9f9e40e-0b0d-4fe7-9d4f-fd2fb202cf69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6825","nonce":3452825924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6827","nonce":3452825924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6831","nonce":3452825924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":3452825924},{"type":"v1","addr":"172.21.15.174:6829","nonce":3452825924}]},"public_addr":"172.21.15.174:6825/3452825924","cluster_addr":"172.21.15.174:6827/3452825924","heartbeat_back_addr":"172.21.15.174:6831/3452825924","heartbeat_front_addr":"172.21.15.174:6829/3452825924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:34:57.413946+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:22.813846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:35:47.074625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:12.871112+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:36:38.705563+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:04.277966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:29.661290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:37:55.475432+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:20.644247+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:38:46.151594+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:11.499623+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:39:36.688459+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.84:6801/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6800/3590728685":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3308084314":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3663660709":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/1794153935":"2024-09-22T03:32:49.459372+0000","172.21.15.84:6800/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6800/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1874814897":"2024-09-22T03:32:17.033279+0000","172.21.15.84:6801/4082319115":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/390051797":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/2148206075":"2024-09-22T03:32:49.459372+0000","172.21.15.84:0/1916019809":"2024-09-22T03:33:50.188998+0000","172.21.15.84:6801/3983018447":"2024-09-22T03:32:17.033279+0000","172.21.15.84:0/3491731835":"2024-09-22T03:33:50.188998+0000","172.21.15.84:0/3418048965":"2024-09-22T03:33:50.188998+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:54:31.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.755+0000 7f5d0e515640 1 -- 172.21.15.84:0/2020042963 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5cf40b6700 msgr2=0x7f5cf40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:31.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.755+0000 7f5d0e515640 1 --2- 172.21.15.84:0/2020042963 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5cf40b6700 0x7f5cf40b8c10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5cf8031440 tx=0x7f5cf8005d50 comp rx=0 tx=0).stop 2024-09-21T03:54:31.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.755+0000 7f5d0e515640 1 -- 172.21.15.84:0/2020042963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d08108d10 msgr2=0x7f5d0819fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:31.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.755+0000 7f5d0e515640 1 --2- 172.21.15.84:0/2020042963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d08108d10 0x7f5d0819fd20 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000eaa0 tx=0x7f5d0000ef60 comp rx=0 tx=0).stop 2024-09-21T03:54:31.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.755+0000 7f5d0e515640 1 -- 172.21.15.84:0/2020042963 shutdown_connections 2024-09-21T03:54:31.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.755+0000 7f5d0e515640 1 --2- 172.21.15.84:0/2020042963 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5cf40b6700 0x7f5cf40b8c10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:31.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.755+0000 7f5d0e515640 1 --2- 172.21.15.84:0/2020042963 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5d08108d10 0x7f5d0819fd20 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:31.757 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.755+0000 7f5d0e515640 1 --2- 172.21.15.84:0/2020042963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5d081083c0 0x7f5d0819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:31.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.755+0000 7f5d0e515640 1 --2- 172.21.15.84:0/2020042963 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d08102a80 0x7f5d0819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:31.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.755+0000 7f5d0e515640 1 -- 172.21.15.84:0/2020042963 >> 172.21.15.84:0/2020042963 conn(0x7f5d08079740 msgr2=0x7f5d08101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:31.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.755+0000 7f5d0e515640 1 -- 172.21.15.84:0/2020042963 shutdown_connections 2024-09-21T03:54:31.758 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:31.755+0000 7f5d0e515640 1 -- 172.21.15.84:0/2020042963 wait complete. 2024-09-21T03:54:32.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:32 smithi084 ceph-mon[30941]: pgmap v697: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 201 B/s wr, 6 op/s 2024-09-21T03:54:32.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:32 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2020042963' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:54:32.613 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T03:54:32.860 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:32.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:32 smithi174 ceph-mon[34403]: pgmap v697: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 201 B/s wr, 6 op/s 2024-09-21T03:54:32.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:32 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2020042963' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:54:32.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:32 smithi172 ceph-mon[34821]: pgmap v697: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 201 B/s wr, 6 op/s 2024-09-21T03:54:32.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:32 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2020042963' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:54:33.390 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.388+0000 7f02c3d75640 1 -- 172.21.15.84:0/3299324644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02bc1049d0 msgr2=0x7f02bc104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:33.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.388+0000 7f02c3d75640 1 --2- 172.21.15.84:0/3299324644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02bc1049d0 0x7f02bc104de0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009900 tx=0x7f02b802a410 comp rx=0 tx=0).stop 2024-09-21T03:54:33.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.388+0000 7f02c3d75640 1 -- 172.21.15.84:0/3299324644 shutdown_connections 2024-09-21T03:54:33.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.388+0000 7f02c3d75640 1 --2- 172.21.15.84:0/3299324644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02bc10de30 0x7f02bc110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:33.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.388+0000 7f02c3d75640 1 --2- 172.21.15.84:0/3299324644 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02bc105320 0x7f02bc10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:33.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.388+0000 7f02c3d75640 1 --2- 172.21.15.84:0/3299324644 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02bc1049d0 0x7f02bc104de0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:33.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.388+0000 7f02c3d75640 1 -- 172.21.15.84:0/3299324644 >> 172.21.15.84:0/3299324644 conn(0x7f02bc079740 msgr2=0x7f02bc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:33.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.388+0000 7f02c3d75640 1 -- 172.21.15.84:0/3299324644 shutdown_connections 2024-09-21T03:54:33.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.388+0000 7f02c3d75640 1 -- 172.21.15.84:0/3299324644 wait complete. 2024-09-21T03:54:33.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.389+0000 7f02c3d75640 1 Processor -- start 2024-09-21T03:54:33.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.389+0000 7f02c3d75640 1 -- start start 2024-09-21T03:54:33.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.389+0000 7f02c3d75640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02bc1049d0 0x7f02bc19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:33.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.389+0000 7f02c3d75640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02bc105320 0x7f02bc19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:33.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.389+0000 7f02c3d75640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02bc10de30 0x7f02bc19fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:33.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.389+0000 7f02c3d75640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f02bc113af0 con 0x7f02bc105320 2024-09-21T03:54:33.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.389+0000 7f02c3d75640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f02bc113970 con 0x7f02bc1049d0 2024-09-21T03:54:33.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.389+0000 7f02c3d75640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f02bc113c70 con 0x7f02bc10de30 2024-09-21T03:54:33.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.389+0000 7f02c1310640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02bc105320 0x7f02bc19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:33.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.390+0000 7f02c1310640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02bc105320 0x7f02bc19ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49918/0 (socket says 172.21.15.84:49918) 2024-09-21T03:54:33.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.390+0000 7f02c1310640 1 -- 172.21.15.84:0/2253417062 learned_addr learned my addr 172.21.15.84:0/2253417062 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:33.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.390+0000 7f02c2312640 1 --2- 172.21.15.84:0/2253417062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02bc10de30 0x7f02bc19fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:33.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.390+0000 7f02c1b11640 1 --2- 172.21.15.84:0/2253417062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02bc1049d0 0x7f02bc19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:33.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.390+0000 7f02c1310640 1 -- 172.21.15.84:0/2253417062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02bc10de30 msgr2=0x7f02bc19fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:33.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.390+0000 7f02c1310640 1 --2- 172.21.15.84:0/2253417062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02bc10de30 0x7f02bc19fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:33.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.390+0000 7f02c1310640 1 -- 172.21.15.84:0/2253417062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02bc1049d0 msgr2=0x7f02bc19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:33.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.390+0000 7f02c1310640 1 --2- 172.21.15.84:0/2253417062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02bc1049d0 0x7f02bc19a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:33.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.390+0000 7f02c1310640 1 -- 172.21.15.84:0/2253417062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02bc1a0550 con 0x7f02bc105320 2024-09-21T03:54:33.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.390+0000 7f02c1b11640 1 --2- 172.21.15.84:0/2253417062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02bc1049d0 0x7f02bc19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:33.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.390+0000 7f02c1310640 1 --2- 172.21.15.84:0/2253417062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02bc105320 0x7f02bc19ab80 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f02ac006fd0 tx=0x7f02ac00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:33.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.390+0000 7f02b2ffd640 1 -- 172.21.15.84:0/2253417062 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac011830 con 0x7f02bc105320 2024-09-21T03:54:33.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.390+0000 7f02b2ffd640 1 -- 172.21.15.84:0/2253417062 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02ac016070 con 0x7f02bc105320 2024-09-21T03:54:33.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.390+0000 7f02c3d75640 1 -- 172.21.15.84:0/2253417062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02bc1a0840 con 0x7f02bc105320 2024-09-21T03:54:33.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.390+0000 7f02b2ffd640 1 -- 172.21.15.84:0/2253417062 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ac010e00 con 0x7f02bc105320 2024-09-21T03:54:33.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.390+0000 7f02c3d75640 1 -- 172.21.15.84:0/2253417062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02bc1a6fa0 con 0x7f02bc105320 2024-09-21T03:54:33.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.391+0000 7f02c3d75640 1 -- 172.21.15.84:0/2253417062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02bc06c240 con 0x7f02bc105320 2024-09-21T03:54:33.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.394+0000 7f02b2ffd640 1 -- 172.21.15.84:0/2253417062 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f02ac0119d0 con 0x7f02bc105320 2024-09-21T03:54:33.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.394+0000 7f02b2ffd640 1 --2- 172.21.15.84:0/2253417062 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f02a80b6680 0x7f02a80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:33.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.395+0000 7f02c1b11640 1 --2- 172.21.15.84:0/2253417062 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f02a80b6680 0x7f02a80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:33.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.395+0000 7f02b2ffd640 1 -- 172.21.15.84:0/2253417062 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8441+0+0 (secure 0 0 0) 0x7f02ac0e72b0 con 0x7f02bc105320 2024-09-21T03:54:33.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.395+0000 7f02c1b11640 1 --2- 172.21.15.84:0/2253417062 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f02a80b6680 0x7f02a80b8b90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f02b8000c00 tx=0x7f02b8031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:33.400 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.398+0000 7f02b2ffd640 1 -- 172.21.15.84:0/2253417062 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f02ac0ad850 con 0x7f02bc105320 2024-09-21T03:54:33.615 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.613+0000 7f02c3d75640 1 -- 172.21.15.84:0/2253417062 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f02bc104de0 con 0x7f02bc105320 2024-09-21T03:54:33.618 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.615+0000 7f02b2ffd640 1 -- 172.21.15.84:0/2253417062 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) ==== 161+0+0 (secure 0 0 0) 0x7f02bc104de0 con 0x7f02bc105320 2024-09-21T03:54:33.618 INFO:teuthology.orchestra.run.smithi084.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T03:54:33.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.618+0000 7f02c3d75640 1 -- 172.21.15.84:0/2253417062 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f02a80b6680 msgr2=0x7f02a80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:33.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.618+0000 7f02c3d75640 1 --2- 172.21.15.84:0/2253417062 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f02a80b6680 0x7f02a80b8b90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f02b8000c00 tx=0x7f02b8031400 comp rx=0 tx=0).stop 2024-09-21T03:54:33.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.618+0000 7f02c3d75640 1 -- 172.21.15.84:0/2253417062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02bc105320 msgr2=0x7f02bc19ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:33.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.618+0000 7f02c3d75640 1 --2- 172.21.15.84:0/2253417062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02bc105320 0x7f02bc19ab80 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f02ac006fd0 tx=0x7f02ac00b8e0 comp rx=0 tx=0).stop 2024-09-21T03:54:33.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.619+0000 7f02c3d75640 1 -- 172.21.15.84:0/2253417062 shutdown_connections 2024-09-21T03:54:33.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.619+0000 7f02c3d75640 1 --2- 172.21.15.84:0/2253417062 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f02a80b6680 0x7f02a80b8b90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:33.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.619+0000 7f02c3d75640 1 --2- 172.21.15.84:0/2253417062 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f02bc10de30 0x7f02bc19fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:33.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.619+0000 7f02c3d75640 1 --2- 172.21.15.84:0/2253417062 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f02bc105320 0x7f02bc19ab80 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:33.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.619+0000 7f02c3d75640 1 --2- 172.21.15.84:0/2253417062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02bc1049d0 0x7f02bc19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:33.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.619+0000 7f02c3d75640 1 -- 172.21.15.84:0/2253417062 >> 172.21.15.84:0/2253417062 conn(0x7f02bc079740 msgr2=0x7f02bc0ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:33.621 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.619+0000 7f02c3d75640 1 -- 172.21.15.84:0/2253417062 shutdown_connections 2024-09-21T03:54:33.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:33.619+0000 7f02c3d75640 1 -- 172.21.15.84:0/2253417062 wait complete. 2024-09-21T03:54:33.971 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:33 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-a[30937]: 2024-09-21T03:54:33.614+0000 7fd4224ab640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:54:34.128 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 03:54:33 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-f[62754]: ignoring --setuser ceph since I am not root 2024-09-21T03:54:34.128 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 03:54:33 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-f[62754]: ignoring --setgroup ceph since I am not root 2024-09-21T03:54:34.129 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 03:54:33 smithi174 ceph-mds[62758]: -- 172.21.15.174:0/2856271160 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56263a565860 con 0x56263e70da80 2024-09-21T03:54:34.129 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 03:54:33 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-f[62754]: starting mds.f at 2024-09-21T03:54:34.129 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 03:54:33 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-c[63025]: ignoring --setuser ceph since I am not root 2024-09-21T03:54:34.129 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 03:54:33 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-c[63025]: ignoring --setgroup ceph since I am not root 2024-09-21T03:54:34.129 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 03:54:33 smithi174 ceph-mds[63029]: -- 172.21.15.174:0/2711415518 <== mon.1 v2:172.21.15.174:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f8c6f9d860 con 0x55f8cb145180 2024-09-21T03:54:34.129 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 03:54:33 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-c[63025]: starting mds.c at 2024-09-21T03:54:34.129 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 03:54:33 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-i[63294]: ignoring --setuser ceph since I am not root 2024-09-21T03:54:34.130 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 03:54:33 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-i[63294]: ignoring --setgroup ceph since I am not root 2024-09-21T03:54:34.130 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 03:54:33 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-i[63294]: starting mds.i at 2024-09-21T03:54:34.151 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:54:33 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-b[63541]: ignoring --setuser ceph since I am not root 2024-09-21T03:54:34.151 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:54:33 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-b[63541]: ignoring --setgroup ceph since I am not root 2024-09-21T03:54:34.151 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:54:33 smithi172 ceph-mds[63545]: -- 172.21.15.172:0/1480071398 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55607e795860 con 0x55608293da80 2024-09-21T03:54:34.151 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:54:33 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-b[63541]: starting mds.b at 2024-09-21T03:54:34.151 INFO:journalctl@ceph.mds.h.smithi172.stdout:Sep 21 03:54:33 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-h[63275]: ignoring --setuser ceph since I am not root 2024-09-21T03:54:34.151 INFO:journalctl@ceph.mds.h.smithi172.stdout:Sep 21 03:54:33 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-h[63275]: ignoring --setgroup ceph since I am not root 2024-09-21T03:54:34.152 INFO:journalctl@ceph.mds.h.smithi172.stdout:Sep 21 03:54:33 smithi172 ceph-mds[63279]: -- 172.21.15.172:0/2342119517 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557db2d21860 con 0x557db6ec9180 2024-09-21T03:54:34.152 INFO:journalctl@ceph.mds.h.smithi172.stdout:Sep 21 03:54:33 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-h[63275]: starting mds.h at 2024-09-21T03:54:34.152 INFO:journalctl@ceph.mds.e.smithi172.stdout:Sep 21 03:54:33 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-e[63003]: ignoring --setuser ceph since I am not root 2024-09-21T03:54:34.152 INFO:journalctl@ceph.mds.e.smithi172.stdout:Sep 21 03:54:33 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-e[63003]: ignoring --setgroup ceph since I am not root 2024-09-21T03:54:34.152 INFO:journalctl@ceph.mds.e.smithi172.stdout:Sep 21 03:54:33 smithi172 ceph-mds[63007]: -- 172.21.15.172:0/2526414662 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5605249e3c20 con 0x560528b8ba80 2024-09-21T03:54:34.152 INFO:journalctl@ceph.mds.e.smithi172.stdout:Sep 21 03:54:33 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-e[63003]: starting mds.e at 2024-09-21T03:54:34.325 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T03:54:34.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:34 smithi084 ceph-mon[30941]: pgmap v698: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:54:34.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:34 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2253417062' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T03:54:34.568 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:34 smithi084 ceph-mon[30941]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T03:54:34.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:34 smithi084 ceph-mon[30941]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:54:34.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:34 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/2253417062' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T03:54:34.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:34 smithi084 ceph-mon[30941]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T03:54:34.569 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:34 smithi084 ceph-mon[30941]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T03:54:34.574 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:34.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:34 smithi174 ceph-mon[34403]: pgmap v698: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:54:34.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:34 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2253417062' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T03:54:34.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:34 smithi174 ceph-mon[34403]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T03:54:34.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:34 smithi174 ceph-mon[34403]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:54:34.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:34 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/2253417062' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T03:54:34.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:34 smithi174 ceph-mon[34403]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T03:54:34.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:34 smithi174 ceph-mon[34403]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T03:54:34.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:34 smithi172 ceph-mon[34821]: pgmap v698: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:54:34.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:34 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2253417062' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T03:54:34.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:34 smithi172 ceph-mon[34821]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T03:54:34.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:34 smithi172 ceph-mon[34821]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:54:34.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:34 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/2253417062' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T03:54:34.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:34 smithi172 ceph-mon[34821]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T03:54:34.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:34 smithi172 ceph-mon[34821]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T03:54:35.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.072+0000 7f697c147640 1 -- 172.21.15.84:0/435400561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6974102290 msgr2=0x7f69741026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:35.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.072+0000 7f697c147640 1 --2- 172.21.15.84:0/435400561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6974102290 0x7f69741026a0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f6970009900 tx=0x7f697002a410 comp rx=0 tx=0).stop 2024-09-21T03:54:35.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.072+0000 7f697c147640 1 -- 172.21.15.84:0/435400561 shutdown_connections 2024-09-21T03:54:35.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.072+0000 7f697c147640 1 --2- 172.21.15.84:0/435400561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6974108520 0x7f697410ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:35.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.072+0000 7f697c147640 1 --2- 172.21.15.84:0/435400561 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6974107bd0 0x7f6974107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:35.091 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.072+0000 7f697c147640 1 --2- 172.21.15.84:0/435400561 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6974102290 0x7f69741026a0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:35.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.073+0000 7f697c147640 1 -- 172.21.15.84:0/435400561 >> 172.21.15.84:0/435400561 conn(0x7f6974079ea0 msgr2=0x7f697407a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:35.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.073+0000 7f697c147640 1 -- 172.21.15.84:0/435400561 shutdown_connections 2024-09-21T03:54:35.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.073+0000 7f697c147640 1 -- 172.21.15.84:0/435400561 wait complete. 2024-09-21T03:54:35.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.073+0000 7f697c147640 1 Processor -- start 2024-09-21T03:54:35.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.073+0000 7f697c147640 1 -- start start 2024-09-21T03:54:35.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f697c147640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6974102290 0x7f697419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:35.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f697c147640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6974107bd0 0x7f697419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:35.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f697c147640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6974108520 0x7f697419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:35.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f697c147640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f6974113b40 con 0x7f6974108520 2024-09-21T03:54:35.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f697c147640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f69741139c0 con 0x7f6974102290 2024-09-21T03:54:35.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f697c147640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f6974113cc0 con 0x7f6974107bd0 2024-09-21T03:54:35.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f697a6e4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6974108520 0x7f697419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:35.092 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f697a6e4640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6974108520 0x7f697419fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49938/0 (socket says 172.21.15.84:49938) 2024-09-21T03:54:35.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f697a6e4640 1 -- 172.21.15.84:0/3261837464 learned_addr learned my addr 172.21.15.84:0/3261837464 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:35.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f69796e2640 1 --2- 172.21.15.84:0/3261837464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6974107bd0 0x7f697419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:35.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f6979ee3640 1 --2- 172.21.15.84:0/3261837464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6974102290 0x7f697419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:35.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f697a6e4640 1 -- 172.21.15.84:0/3261837464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6974107bd0 msgr2=0x7f697419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:35.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f697a6e4640 1 --2- 172.21.15.84:0/3261837464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6974107bd0 0x7f697419aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:35.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f697a6e4640 1 -- 172.21.15.84:0/3261837464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6974102290 msgr2=0x7f697419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:35.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f697a6e4640 1 --2- 172.21.15.84:0/3261837464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6974102290 0x7f697419a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:35.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f697a6e4640 1 -- 172.21.15.84:0/3261837464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69741a04a0 con 0x7f6974108520 2024-09-21T03:54:35.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f697a6e4640 1 --2- 172.21.15.84:0/3261837464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6974108520 0x7f697419fd70 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f696c00eaa0 tx=0x7f696c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:35.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f696affd640 1 -- 172.21.15.84:0/3261837464 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c00cdb0 con 0x7f6974108520 2024-09-21T03:54:35.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f696affd640 1 -- 172.21.15.84:0/3261837464 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f696c005020 con 0x7f6974108520 2024-09-21T03:54:35.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f697c147640 1 -- 172.21.15.84:0/3261837464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69741a0790 con 0x7f6974108520 2024-09-21T03:54:35.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.074+0000 7f696affd640 1 -- 172.21.15.84:0/3261837464 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c0116d0 con 0x7f6974108520 2024-09-21T03:54:35.093 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.075+0000 7f697c147640 1 -- 172.21.15.84:0/3261837464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69741a6ef0 con 0x7f6974108520 2024-09-21T03:54:35.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.075+0000 7f697c147640 1 -- 172.21.15.84:0/3261837464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69741026a0 con 0x7f6974108520 2024-09-21T03:54:35.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.077+0000 7f696affd640 1 -- 172.21.15.84:0/3261837464 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f696c0051d0 con 0x7f6974108520 2024-09-21T03:54:35.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.078+0000 7f696affd640 1 --2- 172.21.15.84:0/3261837464 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f69600b6680 0x7f69600b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:35.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.078+0000 7f6979ee3640 1 --2- 172.21.15.84:0/3261837464 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f69600b6680 0x7f69600b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:35.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.078+0000 7f696affd640 1 -- 172.21.15.84:0/3261837464 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8655+0+0 (secure 0 0 0) 0x7f696c0e7cb0 con 0x7f6974108520 2024-09-21T03:54:35.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.078+0000 7f6979ee3640 1 --2- 172.21.15.84:0/3261837464 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f69600b6680 0x7f69600b8b90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6970031440 tx=0x7f6970009560 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:35.094 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.081+0000 7f696affd640 1 -- 172.21.15.84:0/3261837464 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f696c016030 con 0x7f6974108520 2024-09-21T03:54:35.296 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.294+0000 7f697c147640 1 -- 172.21.15.84:0/3261837464 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f697410a2f0 con 0x7f6974108520 2024-09-21T03:54:35.622 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.619+0000 7f696affd640 1 -- 172.21.15.84:0/3261837464 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) ==== 104+0+0 (secure 0 0 0) 0x7f696c0b2560 con 0x7f6974108520 2024-09-21T03:54:35.623 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.621+0000 7f697c147640 1 -- 172.21.15.84:0/3261837464 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f69600b6680 msgr2=0x7f69600b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:35.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.621+0000 7f697c147640 1 --2- 172.21.15.84:0/3261837464 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f69600b6680 0x7f69600b8b90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6970031440 tx=0x7f6970009560 comp rx=0 tx=0).stop 2024-09-21T03:54:35.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.621+0000 7f697c147640 1 -- 172.21.15.84:0/3261837464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6974108520 msgr2=0x7f697419fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:35.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.621+0000 7f697c147640 1 --2- 172.21.15.84:0/3261837464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6974108520 0x7f697419fd70 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f696c00eaa0 tx=0x7f696c00ef60 comp rx=0 tx=0).stop 2024-09-21T03:54:35.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.621+0000 7f697c147640 1 -- 172.21.15.84:0/3261837464 shutdown_connections 2024-09-21T03:54:35.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.621+0000 7f697c147640 1 --2- 172.21.15.84:0/3261837464 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f69600b6680 0x7f69600b8b90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:35.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.621+0000 7f697c147640 1 --2- 172.21.15.84:0/3261837464 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f6974108520 0x7f697419fd70 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:35.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.621+0000 7f697c147640 1 --2- 172.21.15.84:0/3261837464 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6974107bd0 0x7f697419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:35.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.621+0000 7f697c147640 1 --2- 172.21.15.84:0/3261837464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6974102290 0x7f697419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:35.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.621+0000 7f697c147640 1 -- 172.21.15.84:0/3261837464 >> 172.21.15.84:0/3261837464 conn(0x7f6974079ea0 msgr2=0x7f6974105cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:35.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.621+0000 7f697c147640 1 -- 172.21.15.84:0/3261837464 shutdown_connections 2024-09-21T03:54:35.624 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:35.621+0000 7f697c147640 1 -- 172.21.15.84:0/3261837464 wait complete. 2024-09-21T03:54:35.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:35 smithi174 ceph-mon[34403]: pgmap v700: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2024-09-21T03:54:35.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:35 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.172:6834/2198618083,v1:172.21.15.172:6835/2198618083] up:boot 2024-09-21T03:54:35.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:35 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.172:6836/2983990193,v1:172.21.15.172:6838/2983990193] up:boot 2024-09-21T03:54:35.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:35 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.172:6837/3078507428,v1:172.21.15.172:6839/3078507428] up:boot 2024-09-21T03:54:35.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:35 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.174:6834/3327248853,v1:172.21.15.174:6835/3327248853] up:boot 2024-09-21T03:54:35.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:35 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.174:6836/35752509,v1:172.21.15.174:6837/35752509] up:boot 2024-09-21T03:54:35.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:35 smithi174 ceph-mon[34403]: mds.? [v2:172.21.15.174:6838/562585514,v1:172.21.15.174:6839/562585514] up:boot 2024-09-21T03:54:35.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:35 smithi174 ceph-mon[34403]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T03:54:35.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:35 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:54:35.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:35 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:54:35.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:35 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:54:35.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:35 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:54:35.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:35 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:54:35.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:35 smithi174 ceph-mon[34403]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:54:35.879 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:35 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3261837464' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:54:35.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:35 smithi172 ceph-mon[34821]: pgmap v700: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2024-09-21T03:54:35.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:35 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.172:6834/2198618083,v1:172.21.15.172:6835/2198618083] up:boot 2024-09-21T03:54:35.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:35 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.172:6836/2983990193,v1:172.21.15.172:6838/2983990193] up:boot 2024-09-21T03:54:35.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:35 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.172:6837/3078507428,v1:172.21.15.172:6839/3078507428] up:boot 2024-09-21T03:54:35.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:35 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.174:6834/3327248853,v1:172.21.15.174:6835/3327248853] up:boot 2024-09-21T03:54:35.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:35 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.174:6836/35752509,v1:172.21.15.174:6837/35752509] up:boot 2024-09-21T03:54:35.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:35 smithi172 ceph-mon[34821]: mds.? [v2:172.21.15.174:6838/562585514,v1:172.21.15.174:6839/562585514] up:boot 2024-09-21T03:54:35.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:35 smithi172 ceph-mon[34821]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T03:54:35.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:35 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:54:35.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:35 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:54:35.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:35 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:54:35.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:35 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:54:35.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:35 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:54:35.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:35 smithi172 ceph-mon[34821]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:54:35.902 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:35 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3261837464' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:54:35.995 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:35 smithi084 ceph-mon[30941]: pgmap v700: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2024-09-21T03:54:35.995 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:35 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.172:6834/2198618083,v1:172.21.15.172:6835/2198618083] up:boot 2024-09-21T03:54:35.995 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:35 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.172:6836/2983990193,v1:172.21.15.172:6838/2983990193] up:boot 2024-09-21T03:54:35.995 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:35 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.172:6837/3078507428,v1:172.21.15.172:6839/3078507428] up:boot 2024-09-21T03:54:35.995 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:35 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.174:6834/3327248853,v1:172.21.15.174:6835/3327248853] up:boot 2024-09-21T03:54:35.995 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:35 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.174:6836/35752509,v1:172.21.15.174:6837/35752509] up:boot 2024-09-21T03:54:35.995 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:35 smithi084 ceph-mon[30941]: mds.? [v2:172.21.15.174:6838/562585514,v1:172.21.15.174:6839/562585514] up:boot 2024-09-21T03:54:35.995 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:35 smithi084 ceph-mon[30941]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T03:54:35.996 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:35 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:54:35.996 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:35 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:54:35.996 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:35 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:54:35.996 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:35 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:54:35.996 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:35 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:54:35.996 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:35 smithi084 ceph-mon[30941]: from='mgr.14226 172.21.15.84:0/236948076' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:54:35.996 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:35 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3261837464' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:54:36.487 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T03:54:36.739 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:36.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:36 smithi084 ceph-mon[30941]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T03:54:36.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:36 smithi084 ceph-mon[30941]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T03:54:36.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:36 smithi084 ceph-mon[30941]: Cluster is now healthy 2024-09-21T03:54:36.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:36 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3261837464' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:54:36.819 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:36 smithi084 ceph-mon[30941]: fsmap 12 up:standby 2024-09-21T03:54:36.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:36 smithi172 ceph-mon[34821]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T03:54:36.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:36 smithi172 ceph-mon[34821]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T03:54:36.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:36 smithi172 ceph-mon[34821]: Cluster is now healthy 2024-09-21T03:54:36.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:36 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3261837464' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:54:36.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:36 smithi172 ceph-mon[34821]: fsmap 12 up:standby 2024-09-21T03:54:37.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:36 smithi174 ceph-mon[34403]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T03:54:37.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:36 smithi174 ceph-mon[34403]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T03:54:37.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:36 smithi174 ceph-mon[34403]: Cluster is now healthy 2024-09-21T03:54:37.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:36 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3261837464' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:54:37.129 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:36 smithi174 ceph-mon[34403]: fsmap 12 up:standby 2024-09-21T03:54:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.238+0000 7f5e1260f640 1 -- 172.21.15.84:0/814914713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c1031c0 msgr2=0x7f5e0c1035d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.238+0000 7f5e1260f640 1 --2- 172.21.15.84:0/814914713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c1031c0 0x7f5e0c1035d0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc009900 tx=0x7f5dfc02a3f0 comp rx=0 tx=0).stop 2024-09-21T03:54:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.238+0000 7f5e1260f640 1 -- 172.21.15.84:0/814914713 shutdown_connections 2024-09-21T03:54:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.238+0000 7f5e1260f640 1 --2- 172.21.15.84:0/814914713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e0c108f50 0x7f5e0c10f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.238+0000 7f5e1260f640 1 --2- 172.21.15.84:0/814914713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5e0c108600 0x7f5e0c108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.238+0000 7f5e1260f640 1 --2- 172.21.15.84:0/814914713 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c1031c0 0x7f5e0c1035d0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.238+0000 7f5e1260f640 1 -- 172.21.15.84:0/814914713 >> 172.21.15.84:0/814914713 conn(0x7f5e0c079e30 msgr2=0x7f5e0c07a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.238+0000 7f5e1260f640 1 -- 172.21.15.84:0/814914713 shutdown_connections 2024-09-21T03:54:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.239+0000 7f5e1260f640 1 -- 172.21.15.84:0/814914713 wait complete. 2024-09-21T03:54:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.239+0000 7f5e1260f640 1 Processor -- start 2024-09-21T03:54:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.239+0000 7f5e1260f640 1 -- start start 2024-09-21T03:54:37.249 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e1260f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5e0c1031c0 0x7f5e0c19b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e1260f640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e0c108600 0x7f5e0c19ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e1260f640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c108f50 0x7f5e0c19bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e1260f640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c112c10 con 0x7f5e0c108f50 2024-09-21T03:54:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e1260f640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c112a90 con 0x7f5e0c108600 2024-09-21T03:54:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e1260f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0c112d90 con 0x7f5e0c1031c0 2024-09-21T03:54:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e10bac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c108f50 0x7f5e0c19bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e10bac640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c108f50 0x7f5e0c19bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:49958/0 (socket says 172.21.15.84:49958) 2024-09-21T03:54:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e10bac640 1 -- 172.21.15.84:0/3697504735 learned_addr learned my addr 172.21.15.84:0/3697504735 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e0bfff640 1 --2- 172.21.15.84:0/3697504735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5e0c1031c0 0x7f5e0c19b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e10bac640 1 -- 172.21.15.84:0/3697504735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5e0c1031c0 msgr2=0x7f5e0c19b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e10bac640 1 --2- 172.21.15.84:0/3697504735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5e0c1031c0 0x7f5e0c19b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e10bac640 1 -- 172.21.15.84:0/3697504735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e0c108600 msgr2=0x7f5e0c19ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e10bac640 1 --2- 172.21.15.84:0/3697504735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e0c108600 0x7f5e0c19ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e10bac640 1 -- 172.21.15.84:0/3697504735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0c1a66e0 con 0x7f5e0c108f50 2024-09-21T03:54:37.250 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e0bfff640 1 --2- 172.21.15.84:0/3697504735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5e0c1031c0 0x7f5e0c19b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:37.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e10bac640 1 --2- 172.21.15.84:0/3697504735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c108f50 0x7f5e0c19bf60 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009fd0 tx=0x7f5e0400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:37.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e097fa640 1 -- 172.21.15.84:0/3697504735 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04017070 con 0x7f5e0c108f50 2024-09-21T03:54:37.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e097fa640 1 -- 172.21.15.84:0/3697504735 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e04003e20 con 0x7f5e0c108f50 2024-09-21T03:54:37.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e1260f640 1 -- 172.21.15.84:0/3697504735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e0c1a69d0 con 0x7f5e0c108f50 2024-09-21T03:54:37.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.240+0000 7f5e097fa640 1 -- 172.21.15.84:0/3697504735 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04010460 con 0x7f5e0c108f50 2024-09-21T03:54:37.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.241+0000 7f5e1260f640 1 -- 172.21.15.84:0/3697504735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e0c1a6ec0 con 0x7f5e0c108f50 2024-09-21T03:54:37.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.242+0000 7f5e1260f640 1 -- 172.21.15.84:0/3697504735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e0c1035d0 con 0x7f5e0c108f50 2024-09-21T03:54:37.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.244+0000 7f5e097fa640 1 -- 172.21.15.84:0/3697504735 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f5e04003970 con 0x7f5e0c108f50 2024-09-21T03:54:37.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.245+0000 7f5e097fa640 1 --2- 172.21.15.84:0/3697504735 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5df40b66b0 0x7f5df40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:37.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.245+0000 7f5e0bfff640 1 --2- 172.21.15.84:0/3697504735 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5df40b66b0 0x7f5df40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:37.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.245+0000 7f5e097fa640 1 -- 172.21.15.84:0/3697504735 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8655+0+0 (secure 0 0 0) 0x7f5e040e7570 con 0x7f5e0c108f50 2024-09-21T03:54:37.251 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.245+0000 7f5e0bfff640 1 --2- 172.21.15.84:0/3697504735 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5df40b66b0 0x7f5df40b8bc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc000c00 tx=0x7f5dfc009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:37.252 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.248+0000 7f5e097fa640 1 -- 172.21.15.84:0/3697504735 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5e040ada40 con 0x7f5e0c108f50 2024-09-21T03:54:37.433 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.431+0000 7f5e1260f640 1 -- 172.21.15.84:0/3697504735 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5e0c102230 con 0x7f5e0c108f50 2024-09-21T03:54:37.640 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.638+0000 7f5e097fa640 1 -- 172.21.15.84:0/3697504735 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v91) ==== 181+0+0 (secure 0 0 0) 0x7f5e040b1e20 con 0x7f5e0c108f50 2024-09-21T03:54:37.640 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_metadata' removed 2024-09-21T03:54:37.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.640+0000 7f5e1260f640 1 -- 172.21.15.84:0/3697504735 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5df40b66b0 msgr2=0x7f5df40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:37.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.640+0000 7f5e1260f640 1 --2- 172.21.15.84:0/3697504735 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5df40b66b0 0x7f5df40b8bc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc000c00 tx=0x7f5dfc009680 comp rx=0 tx=0).stop 2024-09-21T03:54:37.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.641+0000 7f5e1260f640 1 -- 172.21.15.84:0/3697504735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c108f50 msgr2=0x7f5e0c19bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:37.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.641+0000 7f5e1260f640 1 --2- 172.21.15.84:0/3697504735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c108f50 0x7f5e0c19bf60 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009fd0 tx=0x7f5e0400b260 comp rx=0 tx=0).stop 2024-09-21T03:54:37.643 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.641+0000 7f5e1260f640 1 -- 172.21.15.84:0/3697504735 shutdown_connections 2024-09-21T03:54:37.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.641+0000 7f5e1260f640 1 --2- 172.21.15.84:0/3697504735 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f5df40b66b0 0x7f5df40b8bc0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:37.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.641+0000 7f5e1260f640 1 --2- 172.21.15.84:0/3697504735 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f5e0c108f50 0x7f5e0c19bf60 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:37.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.641+0000 7f5e1260f640 1 --2- 172.21.15.84:0/3697504735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e0c108600 0x7f5e0c19ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:37.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.641+0000 7f5e1260f640 1 --2- 172.21.15.84:0/3697504735 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5e0c1031c0 0x7f5e0c19b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:37.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.641+0000 7f5e1260f640 1 -- 172.21.15.84:0/3697504735 >> 172.21.15.84:0/3697504735 conn(0x7f5e0c079e30 msgr2=0x7f5e0c106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:37.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.641+0000 7f5e1260f640 1 -- 172.21.15.84:0/3697504735 shutdown_connections 2024-09-21T03:54:37.644 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:37.641+0000 7f5e1260f640 1 -- 172.21.15.84:0/3697504735 wait complete. 2024-09-21T03:54:37.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:37 smithi084 ceph-mon[30941]: pgmap v701: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2024-09-21T03:54:37.818 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:37 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3697504735' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:54:37.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:37 smithi172 ceph-mon[34821]: pgmap v701: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2024-09-21T03:54:37.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:37 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3697504735' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:54:38.055 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:37 smithi174 ceph-mon[34403]: pgmap v701: 97 pgs: 97 active+clean; 24 MiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 409 B/s wr, 6 op/s 2024-09-21T03:54:38.055 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:37 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3697504735' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:54:38.343 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T03:54:38.592 INFO:teuthology.orchestra.run.smithi084.stderr:Inferring config /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:38.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:38 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/3697504735' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:54:38.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:38 smithi172 ceph-mon[34821]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T03:54:39.003 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:38 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/3697504735' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:54:39.003 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:38 smithi174 ceph-mon[34403]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T03:54:39.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:38 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/3697504735' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:54:39.006 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:38 smithi084 ceph-mon[30941]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T03:54:39.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.102+0000 7f7fcb556640 1 -- 172.21.15.84:0/1455579210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fc4103c30 msgr2=0x7f7fc4104040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:39.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.102+0000 7f7fcb556640 1 --2- 172.21.15.84:0/1455579210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fc4103c30 0x7f7fc4104040 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009900 tx=0x7f7fc002a410 comp rx=0 tx=0).stop 2024-09-21T03:54:39.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.102+0000 7f7fcb556640 1 -- 172.21.15.84:0/1455579210 shutdown_connections 2024-09-21T03:54:39.104 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.102+0000 7f7fcb556640 1 --2- 172.21.15.84:0/1455579210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fc4109ec0 0x7f7fc41106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:39.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.102+0000 7f7fcb556640 1 --2- 172.21.15.84:0/1455579210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fc4109570 0x7f7fc4109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:39.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.102+0000 7f7fcb556640 1 --2- 172.21.15.84:0/1455579210 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fc4103c30 0x7f7fc4104040 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:39.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.102+0000 7f7fcb556640 1 -- 172.21.15.84:0/1455579210 >> 172.21.15.84:0/1455579210 conn(0x7f7fc407b8d0 msgr2=0x7f7fc407bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:39.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.102+0000 7f7fcb556640 1 -- 172.21.15.84:0/1455579210 shutdown_connections 2024-09-21T03:54:39.105 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.102+0000 7f7fcb556640 1 -- 172.21.15.84:0/1455579210 wait complete. 2024-09-21T03:54:39.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.103+0000 7f7fcb556640 1 Processor -- start 2024-09-21T03:54:39.106 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.103+0000 7f7fcb556640 1 -- start start 2024-09-21T03:54:39.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.103+0000 7f7fcb556640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fc4103c30 0x7f7fc419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:39.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.103+0000 7f7fcb556640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fc4109570 0x7f7fc419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:39.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.103+0000 7f7fcb556640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fc4109ec0 0x7f7fc419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:39.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.103+0000 7f7fcb556640 1 -- --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc4113b20 con 0x7f7fc4109ec0 2024-09-21T03:54:39.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.103+0000 7f7fcb556640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc41139a0 con 0x7f7fc4103c30 2024-09-21T03:54:39.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.103+0000 7f7fcb556640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc4113ca0 con 0x7f7fc4109570 2024-09-21T03:54:39.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.103+0000 7f7fc9af3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fc4109ec0 0x7f7fc419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:39.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.103+0000 7f7fc9af3640 1 --2- >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fc4109ec0 0x7f7fc419fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.84:3300/0 says I am v2:172.21.15.84:47308/0 (socket says 172.21.15.84:47308) 2024-09-21T03:54:39.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.103+0000 7f7fc9af3640 1 -- 172.21.15.84:0/851238285 learned_addr learned my addr 172.21.15.84:0/851238285 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-09-21T03:54:39.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.103+0000 7f7fc8af1640 1 --2- 172.21.15.84:0/851238285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fc4109570 0x7f7fc419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:39.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.103+0000 7f7fc92f2640 1 --2- 172.21.15.84:0/851238285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fc4103c30 0x7f7fc419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:39.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.104+0000 7f7fc9af3640 1 -- 172.21.15.84:0/851238285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fc4109570 msgr2=0x7f7fc419aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:39.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.104+0000 7f7fc9af3640 1 --2- 172.21.15.84:0/851238285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fc4109570 0x7f7fc419aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:39.107 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.104+0000 7f7fc9af3640 1 -- 172.21.15.84:0/851238285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fc4103c30 msgr2=0x7f7fc419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:39.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.104+0000 7f7fc9af3640 1 --2- 172.21.15.84:0/851238285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fc4103c30 0x7f7fc419a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:39.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.104+0000 7f7fc9af3640 1 -- 172.21.15.84:0/851238285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc41a03e0 con 0x7f7fc4109ec0 2024-09-21T03:54:39.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.104+0000 7f7fc92f2640 1 --2- 172.21.15.84:0/851238285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fc4103c30 0x7f7fc419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:54:39.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.104+0000 7f7fc9af3640 1 --2- 172.21.15.84:0/851238285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fc4109ec0 0x7f7fc419fd70 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00cce0 tx=0x7f7fbc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:39.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.104+0000 7f7fba7fc640 1 -- 172.21.15.84:0/851238285 <== mon.0 v2:172.21.15.84:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc00f450 con 0x7f7fc4109ec0 2024-09-21T03:54:39.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.104+0000 7f7fcb556640 1 -- 172.21.15.84:0/851238285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc41a06d0 con 0x7f7fc4109ec0 2024-09-21T03:54:39.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.104+0000 7f7fba7fc640 1 -- 172.21.15.84:0/851238285 <== mon.0 v2:172.21.15.84:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fbc00faa0 con 0x7f7fc4109ec0 2024-09-21T03:54:39.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.104+0000 7f7fba7fc640 1 -- 172.21.15.84:0/851238285 <== mon.0 v2:172.21.15.84:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc018a80 con 0x7f7fc4109ec0 2024-09-21T03:54:39.108 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.104+0000 7f7fcb556640 1 -- 172.21.15.84:0/851238285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc41a6ef0 con 0x7f7fc4109ec0 2024-09-21T03:54:39.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.105+0000 7f7fcb556640 1 -- 172.21.15.84:0/851238285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc4104040 con 0x7f7fc4109ec0 2024-09-21T03:54:39.109 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.107+0000 7f7fba7fc640 1 -- 172.21.15.84:0/851238285 <== mon.0 v2:172.21.15.84:3300/0 4 ==== mgrmap(e 27) ==== 154643+0+0 (secure 0 0 0) 0x7f7fbc00fc50 con 0x7f7fc4109ec0 2024-09-21T03:54:39.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.108+0000 7f7fba7fc640 1 --2- 172.21.15.84:0/851238285 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7fb00b66b0 0x7f7fb00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:39.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.108+0000 7f7fc92f2640 1 --2- 172.21.15.84:0/851238285 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7fb00b66b0 0x7f7fb00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:39.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.108+0000 7f7fba7fc640 1 -- 172.21.15.84:0/851238285 <== mon.0 v2:172.21.15.84:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8101+0+0 (secure 0 0 0) 0x7f7fbc0e7fe0 con 0x7f7fc4109ec0 2024-09-21T03:54:39.110 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.108+0000 7f7fc92f2640 1 --2- 172.21.15.84:0/851238285 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7fb00b66b0 0x7f7fb00b8bc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0031440 tx=0x7f7fc0005d50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:39.113 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.111+0000 7f7fba7fc640 1 -- 172.21.15.84:0/851238285 <== mon.0 v2:172.21.15.84:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7fbc056710 con 0x7f7fc4109ec0 2024-09-21T03:54:39.292 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.290+0000 7f7fcb556640 1 -- 172.21.15.84:0/851238285 --> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7fc419b660 con 0x7f7fc4109ec0 2024-09-21T03:54:39.652 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.650+0000 7f7fba7fc640 1 -- 172.21.15.84:0/851238285 <== mon.0 v2:172.21.15.84:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v92) ==== 169+0+0 (secure 0 0 0) 0x7f7fc419b660 con 0x7f7fc4109ec0 2024-09-21T03:54:39.652 INFO:teuthology.orchestra.run.smithi084.stderr:pool 'cephfs_data' removed 2024-09-21T03:54:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.653+0000 7f7fcb556640 1 -- 172.21.15.84:0/851238285 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7fb00b66b0 msgr2=0x7f7fb00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.653+0000 7f7fcb556640 1 --2- 172.21.15.84:0/851238285 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7fb00b66b0 0x7f7fb00b8bc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0031440 tx=0x7f7fc0005d50 comp rx=0 tx=0).stop 2024-09-21T03:54:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.654+0000 7f7fcb556640 1 -- 172.21.15.84:0/851238285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fc4109ec0 msgr2=0x7f7fc419fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.654+0000 7f7fcb556640 1 --2- 172.21.15.84:0/851238285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fc4109ec0 0x7f7fc419fd70 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00cce0 tx=0x7f7fbc00a620 comp rx=0 tx=0).stop 2024-09-21T03:54:39.656 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.654+0000 7f7fcb556640 1 -- 172.21.15.84:0/851238285 shutdown_connections 2024-09-21T03:54:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.654+0000 7f7fcb556640 1 --2- 172.21.15.84:0/851238285 >> [v2:172.21.15.84:6800/4090897078,v1:172.21.15.84:6801/4090897078] conn(0x7f7fb00b66b0 0x7f7fb00b8bc0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.654+0000 7f7fcb556640 1 --2- 172.21.15.84:0/851238285 >> [v2:172.21.15.84:3300/0,v1:172.21.15.84:6789/0] conn(0x7f7fc4109ec0 0x7f7fc419fd70 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.654+0000 7f7fcb556640 1 --2- 172.21.15.84:0/851238285 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7fc4109570 0x7f7fc419aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.654+0000 7f7fcb556640 1 --2- 172.21.15.84:0/851238285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fc4103c30 0x7f7fc419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.654+0000 7f7fcb556640 1 -- 172.21.15.84:0/851238285 >> 172.21.15.84:0/851238285 conn(0x7f7fc407b8d0 msgr2=0x7f7fc4107660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.654+0000 7f7fcb556640 1 -- 172.21.15.84:0/851238285 shutdown_connections 2024-09-21T03:54:39.657 INFO:teuthology.orchestra.run.smithi084.stderr:2024-09-21T03:54:39.654+0000 7f7fcb556640 1 -- 172.21.15.84:0/851238285 wait complete. 2024-09-21T03:54:39.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:39 smithi172 ceph-mon[34821]: pgmap v703: 65 pgs: 65 active+clean; 577 KiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:54:39.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:39 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/851238285' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:54:40.051 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:39 smithi084 ceph-mon[30941]: pgmap v703: 65 pgs: 65 active+clean; 577 KiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:54:40.051 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:39 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/851238285' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:54:40.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:39 smithi174 ceph-mon[34403]: pgmap v703: 65 pgs: 65 active+clean; 577 KiB data, 470 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:54:40.128 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:39 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/851238285' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:54:40.390 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:54:40.417 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:54:40.452 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:54:40.486 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T03:54:40.486 DEBUG:teuthology.orchestra.run.smithi084:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T03:54:40.501 DEBUG:teuthology.orchestra.run.smithi172:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T03:54:40.519 DEBUG:teuthology.orchestra.run.smithi174:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T03:54:40.543 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T03:54:40.544 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T03:54:40.544 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mon.a 2024-09-21T03:54:40.658 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:40 smithi084 systemd[1]: Stopping Ceph mon.a for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:54:40.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:40 smithi174 ceph-mon[34403]: from='client.? 172.21.15.84:0/851238285' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:54:40.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:40 smithi174 ceph-mon[34403]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T03:54:40.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:40 smithi172 ceph-mon[34821]: from='client.? 172.21.15.84:0/851238285' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:54:40.901 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:40 smithi172 ceph-mon[34821]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T03:54:41.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:40 smithi084 ceph-mon[30941]: from='client.? 172.21.15.84:0/851238285' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:54:41.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:40 smithi084 ceph-mon[30941]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T03:54:41.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:40 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-a[30937]: 2024-09-21T03:54:40.854+0000 7fd427cb6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:54:41.068 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:40 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-a[30937]: 2024-09-21T03:54:40.854+0000 7fd427cb6640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T03:54:41.381 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:41 smithi084 podman[107059]: 2024-09-21 03:54:41.079848835 +0000 UTC m=+0.352764045 container died 6bb4acbb08a56817c2614637ddcc1c6af8930fe20b1b5ba6feb29db5face4a25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T03:54:41.749 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:41 smithi084 podman[107059]: 2024-09-21 03:54:41.454631898 +0000 UTC m=+0.727547101 container cleanup 6bb4acbb08a56817c2614637ddcc1c6af8930fe20b1b5ba6feb29db5face4a25 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-a, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T03:54:41.749 INFO:journalctl@ceph.mon.a.smithi084.stdout:Sep 21 03:54:41 smithi084 bash[107059]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-a 2024-09-21T03:54:41.882 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T03:54:41.938 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:54:41.939 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T03:54:41.939 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T03:54:41.939 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mon.b 2024-09-21T03:54:42.299 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:41 smithi172 systemd[1]: Stopping Ceph mon.b for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:54:42.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:42 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-b[34817]: 2024-09-21T03:54:42.296+0000 7f1b6cb4d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:54:42.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:42 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-b[34817]: 2024-09-21T03:54:42.296+0000 7f1b6cb4d640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T03:54:42.651 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:42 smithi172 podman[67559]: 2024-09-21 03:54:42.430508268 +0000 UTC m=+0.288041655 container died c615e4b57be25a74f5c460a4ba4f5a89a9d9b694d1fe08a409830f2fd2b81c4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T03:54:43.126 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:42 smithi172 podman[67559]: 2024-09-21 03:54:42.831071525 +0000 UTC m=+0.688604913 container cleanup c615e4b57be25a74f5c460a4ba4f5a89a9d9b694d1fe08a409830f2fd2b81c4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T03:54:43.126 INFO:journalctl@ceph.mon.b.smithi172.stdout:Sep 21 03:54:42 smithi172 bash[67559]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-b 2024-09-21T03:54:43.253 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T03:54:43.300 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:54:43.301 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T03:54:43.301 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T03:54:43.301 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mon.c 2024-09-21T03:54:43.624 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:43 smithi174 systemd[1]: Stopping Ceph mon.c for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:54:43.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:43 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-c[34398]: 2024-09-21T03:54:43.620+0000 7fba638d6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:54:43.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:43 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-c[34398]: 2024-09-21T03:54:43.620+0000 7fba638d6640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T03:54:43.878 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:43 smithi174 podman[66682]: 2024-09-21 03:54:43.774906173 +0000 UTC m=+0.275426879 container died f32840962726ac1d7d9f7f3eef945593da04ef2be41a5bff425dee13764b6642 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-c, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T03:54:44.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:44 smithi174 podman[66682]: 2024-09-21 03:54:44.172228934 +0000 UTC m=+0.672749657 container cleanup f32840962726ac1d7d9f7f3eef945593da04ef2be41a5bff425dee13764b6642 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-c, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T03:54:44.378 INFO:journalctl@ceph.mon.c.smithi174.stdout:Sep 21 03:54:44 smithi174 bash[66682]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mon-c 2024-09-21T03:54:44.598 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T03:54:44.643 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:54:44.644 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T03:54:44.644 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T03:54:44.644 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mgr.x 2024-09-21T03:54:44.961 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:54:44 smithi084 systemd[1]: Stopping Ceph mgr.x for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:54:45.312 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:54:44 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:54:44.958+0000 7fa56165c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:54:45.312 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:54:44 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x[31166]: 2024-09-21T03:54:44.958+0000 7fa56165c640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-21T03:54:45.312 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:54:45 smithi084 podman[107182]: 2024-09-21 03:54:45.000468911 +0000 UTC m=+0.168508373 container died 705c1c35a60d5a39ac1f7b97192922c4fc74b11e6a76bb2a6f010ae95fe54443 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T03:54:45.568 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:54:45 smithi084 podman[107182]: 2024-09-21 03:54:45.41801735 +0000 UTC m=+0.586056794 container cleanup 705c1c35a60d5a39ac1f7b97192922c4fc74b11e6a76bb2a6f010ae95fe54443 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:54:45.568 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:54:45 smithi084 bash[107182]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x 2024-09-21T03:54:45.854 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:54:45 smithi084 podman[107194]: 2024-09-21 03:54:45.603039862 +0000 UTC m=+0.605972754 container remove 705c1c35a60d5a39ac1f7b97192922c4fc74b11e6a76bb2a6f010ae95fe54443 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T03:54:45.854 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:54:45 smithi084 systemd[1]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mgr.x.service: Deactivated successfully. 2024-09-21T03:54:45.855 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:54:45 smithi084 systemd[1]: Stopped Ceph mgr.x for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:54:45.855 INFO:journalctl@ceph.mgr.x.smithi084.stdout:Sep 21 03:54:45 smithi084 systemd[1]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mgr.x.service: Consumed 47.754s CPU time. 2024-09-21T03:54:45.855 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T03:54:45.889 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:54:45.890 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T03:54:45.890 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T03:54:45.890 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mgr.y 2024-09-21T03:54:46.242 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Sep 21 03:54:45 smithi172 systemd[1]: Stopping Ceph mgr.y for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:54:46.547 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Sep 21 03:54:46 smithi172 podman[67679]: 2024-09-21 03:54:46.240397757 +0000 UTC m=+0.156511047 container died 67575135f97099d9ecc2da3a8dcb4ebffb5281e58746699ef63dae4b2ed186d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-y, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T03:54:46.856 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Sep 21 03:54:46 smithi172 podman[67679]: 2024-09-21 03:54:46.661458965 +0000 UTC m=+0.577572259 container cleanup 67575135f97099d9ecc2da3a8dcb4ebffb5281e58746699ef63dae4b2ed186d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-y, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:54:46.856 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Sep 21 03:54:46 smithi172 bash[67679]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-y 2024-09-21T03:54:47.082 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Sep 21 03:54:46 smithi172 podman[67694]: 2024-09-21 03:54:46.855018246 +0000 UTC m=+0.601681002 container remove 67575135f97099d9ecc2da3a8dcb4ebffb5281e58746699ef63dae4b2ed186d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-y, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T03:54:47.082 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Sep 21 03:54:46 smithi172 systemd[1]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-21T03:54:47.082 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Sep 21 03:54:47 smithi172 systemd[1]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mgr.y.service: Failed with result 'exit-code'. 2024-09-21T03:54:47.082 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Sep 21 03:54:47 smithi172 systemd[1]: Stopped Ceph mgr.y for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:54:47.082 INFO:journalctl@ceph.mgr.y.smithi172.stdout:Sep 21 03:54:47 smithi172 systemd[1]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mgr.y.service: Consumed 7.283s CPU time. 2024-09-21T03:54:47.083 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T03:54:47.118 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:54:47.118 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T03:54:47.118 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T03:54:47.118 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mgr.z 2024-09-21T03:54:47.449 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 03:54:47 smithi174 systemd[1]: Stopping Ceph mgr.z for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:54:47.722 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 03:54:47 smithi174 podman[66803]: 2024-09-21 03:54:47.448401025 +0000 UTC m=+0.118944958 container died 213a207115e61e8071c8890e1c4824c56210c1a3cf69bb4bbfea0c34dedf5f16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T03:54:48.097 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 03:54:47 smithi174 podman[66803]: 2024-09-21 03:54:47.81925803 +0000 UTC m=+0.489801955 container cleanup 213a207115e61e8071c8890e1c4824c56210c1a3cf69bb4bbfea0c34dedf5f16 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-z, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T03:54:48.097 INFO:journalctl@ceph.mgr.z.smithi174.stdout:Sep 21 03:54:47 smithi174 bash[66803]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mgr-z 2024-09-21T03:54:48.249 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T03:54:48.284 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:54:48.284 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T03:54:48.284 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T03:54:48.284 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.0 2024-09-21T03:54:48.568 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:54:48 smithi084 systemd[1]: Stopping Ceph osd.0 for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:54:49.068 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:54:48 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-0[48037]: 2024-09-21T03:54:48.580+0000 7fdd39b57640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:54:49.068 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:54:48 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-0[48037]: 2024-09-21T03:54:48.580+0000 7fdd39b57640 -1 osd.0 92 *** Got signal Terminated *** 2024-09-21T03:54:49.068 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:54:48 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-0[48037]: 2024-09-21T03:54:48.580+0000 7fdd39b57640 -1 osd.0 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:54:54.319 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:54:54 smithi084 podman[107302]: 2024-09-21 03:54:54.043267856 +0000 UTC m=+5.570169445 container died 78d804c802e42ca189b474dde53253350108443734c6c0f560e7263722903841 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:54:54.800 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:54:54 smithi084 podman[107302]: 2024-09-21 03:54:54.538756675 +0000 UTC m=+6.065658304 container cleanup 78d804c802e42ca189b474dde53253350108443734c6c0f560e7263722903841 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T03:54:54.800 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:54:54 smithi084 bash[107302]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-0 2024-09-21T03:54:55.069 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:54:54 smithi084 podman[107317]: 2024-09-21 03:54:54.798723415 +0000 UTC m=+0.748409717 container remove 78d804c802e42ca189b474dde53253350108443734c6c0f560e7263722903841 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:54:55.337 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:54:55 smithi084 podman[107403]: 2024-09-21 03:54:55.058286243 +0000 UTC m=+0.015687932 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:54:55.337 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:54:55 smithi084 podman[107403]: 2024-09-21 03:54:55.20842318 +0000 UTC m=+0.165824863 container create c05aa37854027da8113ab79d9de7131fcfc5a4fdc16b4edba3df15673f2d5783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T03:54:55.682 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:54:55 smithi084 podman[107403]: 2024-09-21 03:54:55.477732396 +0000 UTC m=+0.435134073 container init c05aa37854027da8113ab79d9de7131fcfc5a4fdc16b4edba3df15673f2d5783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-0-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True) 2024-09-21T03:54:55.682 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:54:55 smithi084 podman[107403]: 2024-09-21 03:54:55.481405865 +0000 UTC m=+0.438807550 container start c05aa37854027da8113ab79d9de7131fcfc5a4fdc16b4edba3df15673f2d5783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T03:54:55.682 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:54:55 smithi084 podman[107403]: 2024-09-21 03:54:55.577842337 +0000 UTC m=+0.535244024 container attach c05aa37854027da8113ab79d9de7131fcfc5a4fdc16b4edba3df15673f2d5783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T03:54:56.040 INFO:journalctl@ceph.osd.0.smithi084.stdout:Sep 21 03:54:55 smithi084 podman[107403]: 2024-09-21 03:54:55.681256444 +0000 UTC m=+0.638658138 container died c05aa37854027da8113ab79d9de7131fcfc5a4fdc16b4edba3df15673f2d5783 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T03:54:56.480 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T03:54:56.521 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:54:56.521 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T03:54:56.521 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T03:54:56.521 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.1 2024-09-21T03:54:56.843 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:54:56 smithi172 systemd[1]: Stopping Ceph osd.1 for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:54:57.151 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:54:56 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-1[39557]: 2024-09-21T03:54:56.841+0000 7f677672e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:54:57.151 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:54:56 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-1[39557]: 2024-09-21T03:54:56.841+0000 7f677672e640 -1 osd.1 92 *** Got signal Terminated *** 2024-09-21T03:54:57.151 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:54:56 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-1[39557]: 2024-09-21T03:54:56.841+0000 7f677672e640 -1 osd.1 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:55:02.654 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:55:02 smithi172 podman[67806]: 2024-09-21 03:55:02.341566541 +0000 UTC m=+5.622397626 container died a6a834f29c70aba0d0f3e0729e569255ba36263b71c3d9aa34a2111cbe47f17d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-1, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T03:55:02.994 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:55:02 smithi172 podman[67806]: 2024-09-21 03:55:02.774444817 +0000 UTC m=+6.055275901 container cleanup a6a834f29c70aba0d0f3e0729e569255ba36263b71c3d9aa34a2111cbe47f17d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-1, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T03:55:02.994 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:55:02 smithi172 bash[67806]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-1 2024-09-21T03:55:03.378 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:55:02 smithi172 podman[67821]: 2024-09-21 03:55:02.992326183 +0000 UTC m=+0.651406726 container remove a6a834f29c70aba0d0f3e0729e569255ba36263b71c3d9aa34a2111cbe47f17d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-1, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:55:03.651 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:55:03 smithi172 podman[67911]: 2024-09-21 03:55:03.376529367 +0000 UTC m=+0.092549769 container create 63981fb3fa115b2720c62402a34dd394f17915f1c6bd8d091979efa6cf8cd82e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T03:55:03.651 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:55:03 smithi172 podman[67911]: 2024-09-21 03:55:03.300552477 +0000 UTC m=+0.016572890 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:55:04.134 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:55:03 smithi172 podman[67911]: 2024-09-21 03:55:03.654710296 +0000 UTC m=+0.370730705 container init 63981fb3fa115b2720c62402a34dd394f17915f1c6bd8d091979efa6cf8cd82e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T03:55:04.134 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:55:03 smithi172 podman[67911]: 2024-09-21 03:55:03.658135267 +0000 UTC m=+0.374155671 container start 63981fb3fa115b2720c62402a34dd394f17915f1c6bd8d091979efa6cf8cd82e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:55:04.134 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:55:03 smithi172 podman[67911]: 2024-09-21 03:55:03.73791704 +0000 UTC m=+0.453937446 container attach 63981fb3fa115b2720c62402a34dd394f17915f1c6bd8d091979efa6cf8cd82e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:55:04.134 INFO:journalctl@ceph.osd.1.smithi172.stdout:Sep 21 03:55:03 smithi172 podman[67911]: 2024-09-21 03:55:03.851903026 +0000 UTC m=+0.567923432 container died 63981fb3fa115b2720c62402a34dd394f17915f1c6bd8d091979efa6cf8cd82e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T03:55:04.450 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T03:55:04.490 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:55:04.490 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T03:55:04.490 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T03:55:04.490 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.2 2024-09-21T03:55:04.801 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:55:04 smithi174 systemd[1]: Stopping Ceph osd.2 for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:55:05.128 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:55:04 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-2[39616]: 2024-09-21T03:55:04.797+0000 7fad5b97e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:55:05.128 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:55:04 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-2[39616]: 2024-09-21T03:55:04.797+0000 7fad5b97e640 -1 osd.2 92 *** Got signal Terminated *** 2024-09-21T03:55:05.128 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:55:04 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-2[39616]: 2024-09-21T03:55:04.797+0000 7fad5b97e640 -1 osd.2 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:55:10.534 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:55:10 smithi174 podman[66930]: 2024-09-21 03:55:10.269470867 +0000 UTC m=+5.587564075 container died 5e5685e3d67e4a294a8b6afacdcb40440419f11470d764d34e2d3acd558ae8d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T03:55:10.878 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:55:10 smithi174 podman[66930]: 2024-09-21 03:55:10.672878473 +0000 UTC m=+5.990971682 container cleanup 5e5685e3d67e4a294a8b6afacdcb40440419f11470d764d34e2d3acd558ae8d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T03:55:10.878 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:55:10 smithi174 bash[66930]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-2 2024-09-21T03:55:11.195 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:55:10 smithi174 podman[66946]: 2024-09-21 03:55:10.882515963 +0000 UTC m=+0.602641315 container remove 5e5685e3d67e4a294a8b6afacdcb40440419f11470d764d34e2d3acd558ae8d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T03:55:11.453 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:55:11 smithi174 podman[67034]: 2024-09-21 03:55:11.096554769 +0000 UTC m=+0.015745727 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:55:11.454 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:55:11 smithi174 podman[67034]: 2024-09-21 03:55:11.217010013 +0000 UTC m=+0.136201015 container create 1db418ca90928bc301b0a32a4606eb2f2833cc8d6b781439c167cd5bbcea5d24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:55:11.878 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:55:11 smithi174 podman[67034]: 2024-09-21 03:55:11.452559969 +0000 UTC m=+0.371750935 container init 1db418ca90928bc301b0a32a4606eb2f2833cc8d6b781439c167cd5bbcea5d24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-2-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:55:11.879 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:55:11 smithi174 podman[67034]: 2024-09-21 03:55:11.455911593 +0000 UTC m=+0.375102559 container start 1db418ca90928bc301b0a32a4606eb2f2833cc8d6b781439c167cd5bbcea5d24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T03:55:11.879 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:55:11 smithi174 podman[67034]: 2024-09-21 03:55:11.544614607 +0000 UTC m=+0.463805565 container attach 1db418ca90928bc301b0a32a4606eb2f2833cc8d6b781439c167cd5bbcea5d24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T03:55:11.879 INFO:journalctl@ceph.osd.2.smithi174.stdout:Sep 21 03:55:11 smithi174 podman[67057]: 2024-09-21 03:55:11.664284075 +0000 UTC m=+0.016560258 container died 1db418ca90928bc301b0a32a4606eb2f2833cc8d6b781439c167cd5bbcea5d24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T03:55:12.276 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T03:55:12.316 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:55:12.316 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T03:55:12.317 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T03:55:12.317 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.3 2024-09-21T03:55:12.644 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 03:55:12 smithi084 systemd[1]: Stopping Ceph osd.3 for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:55:13.068 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 03:55:12 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-3[54560]: 2024-09-21T03:55:12.641+0000 7f1afb0f8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:55:13.068 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 03:55:12 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-3[54560]: 2024-09-21T03:55:12.641+0000 7f1afb0f8640 -1 osd.3 92 *** Got signal Terminated *** 2024-09-21T03:55:13.068 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 03:55:12 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-3[54560]: 2024-09-21T03:55:12.641+0000 7f1afb0f8640 -1 osd.3 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:55:15.068 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:14 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:14.769+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:15.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:14 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:14.622+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:15.128 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:14 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:14.827+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.192491+0000 front 2024-09-21T03:54:50.192509+0000 (oldest deadline 2024-09-21T03:55:14.292341+0000) 2024-09-21T03:55:16.068 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:15 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:15.752+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:16.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:15 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:15.586+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:16.128 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:15 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:15.864+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.192491+0000 front 2024-09-21T03:54:50.192509+0000 (oldest deadline 2024-09-21T03:55:14.292341+0000) 2024-09-21T03:55:16.568 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 03:55:16 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-3[54560]: 2024-09-21T03:55:16.253+0000 7f1af36db640 -1 osd.3 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.673853+0000 front 2024-09-21T03:54:50.673901+0000 (oldest deadline 2024-09-21T03:55:15.974119+0000) 2024-09-21T03:55:17.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:16 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:16.623+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:17.068 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:16 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:16.784+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:17.354 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:16 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:16.891+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.192491+0000 front 2024-09-21T03:54:50.192509+0000 (oldest deadline 2024-09-21T03:55:14.292341+0000) 2024-09-21T03:55:17.568 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 03:55:17 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-3[54560]: 2024-09-21T03:55:17.219+0000 7f1af36db640 -1 osd.3 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.673853+0000 front 2024-09-21T03:54:50.673901+0000 (oldest deadline 2024-09-21T03:55:15.974119+0000) 2024-09-21T03:55:17.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:17 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:17.352+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:18.062 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:17 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:17.759+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:18.062 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:17 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:17.597+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:18.307 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:17 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:17.922+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.192491+0000 front 2024-09-21T03:54:50.192509+0000 (oldest deadline 2024-09-21T03:55:14.292341+0000) 2024-09-21T03:55:18.318 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 03:55:18 smithi084 podman[107519]: 2024-09-21 03:55:18.060217391 +0000 UTC m=+5.542748511 container died e131548f30dc4118a6b9b3391b9c67933cc00982e6ffb21caba4e8a16d85aa53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T03:55:18.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:18 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:18.095+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:18.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:18 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:18.306+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:18.750 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:18.567+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:18.750 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 03:55:18 smithi084 podman[107519]: 2024-09-21 03:55:18.558592528 +0000 UTC m=+6.041123625 container cleanup e131548f30dc4118a6b9b3391b9c67933cc00982e6ffb21caba4e8a16d85aa53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-3, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:55:18.751 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 03:55:18 smithi084 bash[107519]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-3 2024-09-21T03:55:19.068 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 03:55:18 smithi084 podman[107535]: 2024-09-21 03:55:18.843806626 +0000 UTC m=+0.777820157 container remove e131548f30dc4118a6b9b3391b9c67933cc00982e6ffb21caba4e8a16d85aa53 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-3, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:55:19.069 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:18 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:18.748+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:19.322 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:18 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:18.918+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.192491+0000 front 2024-09-21T03:54:50.192509+0000 (oldest deadline 2024-09-21T03:55:14.292341+0000) 2024-09-21T03:55:19.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:19 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:19.087+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:19.457 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 03:55:19 smithi084 podman[107626]: 2024-09-21 03:55:19.073325042 +0000 UTC m=+0.015777931 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:55:19.457 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 03:55:19 smithi084 podman[107626]: 2024-09-21 03:55:19.194862685 +0000 UTC m=+0.137315556 container create ec39cb09676b3b497f869b3b4d14195a505691e600bc85db8a636d0b560e5cc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T03:55:19.457 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 03:55:19 smithi084 podman[107626]: 2024-09-21 03:55:19.455682896 +0000 UTC m=+0.398135778 container init ec39cb09676b3b497f869b3b4d14195a505691e600bc85db8a636d0b560e5cc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T03:55:19.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:19 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:19.320+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:19.740 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:19 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:19.585+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:19.740 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 03:55:19 smithi084 podman[107626]: 2024-09-21 03:55:19.459690381 +0000 UTC m=+0.402143253 container start ec39cb09676b3b497f869b3b4d14195a505691e600bc85db8a636d0b560e5cc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T03:55:19.740 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 03:55:19 smithi084 podman[107626]: 2024-09-21 03:55:19.555844339 +0000 UTC m=+0.498297218 container attach ec39cb09676b3b497f869b3b4d14195a505691e600bc85db8a636d0b560e5cc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T03:55:19.740 INFO:journalctl@ceph.osd.3.smithi084.stdout:Sep 21 03:55:19 smithi084 podman[107626]: 2024-09-21 03:55:19.654423363 +0000 UTC m=+0.596876243 container died ec39cb09676b3b497f869b3b4d14195a505691e600bc85db8a636d0b560e5cc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:55:20.010 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:19 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:19.738+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:20.273 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:19 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:19.896+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.192491+0000 front 2024-09-21T03:54:50.192509+0000 (oldest deadline 2024-09-21T03:55:14.292341+0000) 2024-09-21T03:55:20.338 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T03:55:20.380 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:55:20.381 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T03:55:20.381 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T03:55:20.381 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.4 2024-09-21T03:55:20.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:20 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:20.126+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:20.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:20 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:20.271+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:20.687 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 21 03:55:20 smithi172 systemd[1]: Stopping Ceph osd.4 for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:55:21.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:20 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:20.574+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:21.069 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:20 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:20.718+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:21.151 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 21 03:55:20 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-4[45992]: 2024-09-21T03:55:20.684+0000 7ff319a20640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:55:21.151 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 21 03:55:20 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-4[45992]: 2024-09-21T03:55:20.684+0000 7ff319a20640 -1 osd.4 92 *** Got signal Terminated *** 2024-09-21T03:55:21.151 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 21 03:55:20 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-4[45992]: 2024-09-21T03:55:20.684+0000 7ff319a20640 -1 osd.4 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:55:21.286 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:20 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:20.944+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.192491+0000 front 2024-09-21T03:54:50.192509+0000 (oldest deadline 2024-09-21T03:55:14.292341+0000) 2024-09-21T03:55:21.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:21 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:21.285+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:21.651 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:21 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:21.157+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:21.818 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:21 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:21.559+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:21.818 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:21 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:21.733+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:22.290 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:21 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:21.968+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.192491+0000 front 2024-09-21T03:54:50.192509+0000 (oldest deadline 2024-09-21T03:55:14.292341+0000) 2024-09-21T03:55:22.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:22 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:22.114+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:22.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:22 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:22.288+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:22.818 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:22 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:22.746+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:22.819 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:22 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:22.563+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:23.275 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:22 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:22.927+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.192491+0000 front 2024-09-21T03:54:50.192509+0000 (oldest deadline 2024-09-21T03:55:14.292341+0000) 2024-09-21T03:55:23.275 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:22 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:22.927+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.393335+0000 front 2024-09-21T03:54:58.393370+0000 (oldest deadline 2024-09-21T03:55:22.493441+0000) 2024-09-21T03:55:23.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:23 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:23.069+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:23.556 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:23 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:23.273+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:23.556 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:23 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:23.273+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:24.068 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:23 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:23.782+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:24.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:23 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:23.602+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:24.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:23 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:23.602+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:24.272 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:23 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:23.963+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.192491+0000 front 2024-09-21T03:54:50.192509+0000 (oldest deadline 2024-09-21T03:55:14.292341+0000) 2024-09-21T03:55:24.272 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:23 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:23.963+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.393335+0000 front 2024-09-21T03:54:58.393370+0000 (oldest deadline 2024-09-21T03:55:22.493441+0000) 2024-09-21T03:55:24.401 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 21 03:55:23 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-4[45992]: 2024-09-21T03:55:23.950+0000 7ff31600b640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.887020+0000 front 2024-09-21T03:54:58.887046+0000 (oldest deadline 2024-09-21T03:55:22.987306+0000) 2024-09-21T03:55:24.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:24 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:24.051+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:24.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:24 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:24.270+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:24.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:24 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:24.270+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:24.812 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:24 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:24.575+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:24.812 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:24 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:24.575+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:25.068 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:24 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:24.810+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:25.227 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 21 03:55:24 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-4[45992]: 2024-09-21T03:55:24.955+0000 7ff31600b640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.887020+0000 front 2024-09-21T03:54:58.887046+0000 (oldest deadline 2024-09-21T03:55:22.987306+0000) 2024-09-21T03:55:25.227 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:25 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:25.033+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:25.233 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:24 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:24.959+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.192491+0000 front 2024-09-21T03:54:50.192509+0000 (oldest deadline 2024-09-21T03:55:14.292341+0000) 2024-09-21T03:55:25.233 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:24 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:24.959+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.393335+0000 front 2024-09-21T03:54:58.393370+0000 (oldest deadline 2024-09-21T03:55:22.493441+0000) 2024-09-21T03:55:25.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:25 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:25.231+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:25.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:25 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:25.231+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:25.651 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:25 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:25.224+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:26.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:25 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:25.618+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:26.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:25 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:25.618+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:26.069 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:25 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:25.770+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:26.069 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:25 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:25.770+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.237952+0000 front 2024-09-21T03:55:00.237905+0000 (oldest deadline 2024-09-21T03:55:25.537898+0000) 2024-09-21T03:55:26.250 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:25 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:25.916+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.192491+0000 front 2024-09-21T03:54:50.192509+0000 (oldest deadline 2024-09-21T03:55:14.292341+0000) 2024-09-21T03:55:26.250 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:25 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:25.916+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.393335+0000 front 2024-09-21T03:54:58.393370+0000 (oldest deadline 2024-09-21T03:55:22.493441+0000) 2024-09-21T03:55:26.401 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 21 03:55:26 smithi172 podman[68028]: 2024-09-21 03:55:26.206526667 +0000 UTC m=+5.625880736 container died b1fb096e44970d2275004bce4bc989608b0c495b9969404440100ccf179c1b87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-4, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T03:55:26.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:26 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:26.265+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:26.402 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:26 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:26.021+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:26.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:26 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:26.248+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:26.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:26 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:26.248+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:26.854 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 21 03:55:26 smithi172 podman[68028]: 2024-09-21 03:55:26.610310081 +0000 UTC m=+6.029664148 container cleanup b1fb096e44970d2275004bce4bc989608b0c495b9969404440100ccf179c1b87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T03:55:26.855 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 21 03:55:26 smithi172 bash[68028]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-4 2024-09-21T03:55:27.068 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:26 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:26.789+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:27.068 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:26 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:26.789+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.237952+0000 front 2024-09-21T03:55:00.237905+0000 (oldest deadline 2024-09-21T03:55:25.537898+0000) 2024-09-21T03:55:27.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:26 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:26.610+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:27.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:26 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:26.610+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:27.151 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 21 03:55:26 smithi172 podman[68044]: 2024-09-21 03:55:26.853103655 +0000 UTC m=+0.642323389 container remove b1fb096e44970d2275004bce4bc989608b0c495b9969404440100ccf179c1b87 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T03:55:27.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:27 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:27.056+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:27.295 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:26 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:26.940+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.192491+0000 front 2024-09-21T03:54:50.192509+0000 (oldest deadline 2024-09-21T03:55:14.292341+0000) 2024-09-21T03:55:27.295 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:26 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:26.940+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.393335+0000 front 2024-09-21T03:54:58.393370+0000 (oldest deadline 2024-09-21T03:55:22.493441+0000) 2024-09-21T03:55:27.296 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:26 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:26.939+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:27.557 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:27 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:27.267+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:27.557 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 21 03:55:27 smithi172 podman[68129]: 2024-09-21 03:55:27.188888648 +0000 UTC m=+0.015849454 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:55:27.558 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 21 03:55:27 smithi172 podman[68129]: 2024-09-21 03:55:27.312281136 +0000 UTC m=+0.139241943 container create 4132271c7f5454537766ba3ae30966139f74ad9b587bf22371218f4d6d701ed3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T03:55:27.558 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 21 03:55:27 smithi172 podman[68129]: 2024-09-21 03:55:27.556269075 +0000 UTC m=+0.383229882 container init 4132271c7f5454537766ba3ae30966139f74ad9b587bf22371218f4d6d701ed3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T03:55:27.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:27 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:27.294+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:27.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:27 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:27.294+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:27.901 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 21 03:55:27 smithi172 podman[68129]: 2024-09-21 03:55:27.559762839 +0000 UTC m=+0.386723647 container start 4132271c7f5454537766ba3ae30966139f74ad9b587bf22371218f4d6d701ed3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T03:55:27.901 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 21 03:55:27 smithi172 podman[68129]: 2024-09-21 03:55:27.656358461 +0000 UTC m=+0.483319282 container attach 4132271c7f5454537766ba3ae30966139f74ad9b587bf22371218f4d6d701ed3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-4-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T03:55:27.901 INFO:journalctl@ceph.osd.4.smithi172.stdout:Sep 21 03:55:27 smithi172 podman[68129]: 2024-09-21 03:55:27.751333768 +0000 UTC m=+0.578294579 container died 4132271c7f5454537766ba3ae30966139f74ad9b587bf22371218f4d6d701ed3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T03:55:28.068 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:27 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:27.823+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:28.069 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:27 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:27.823+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.237952+0000 front 2024-09-21T03:55:00.237905+0000 (oldest deadline 2024-09-21T03:55:25.537898+0000) 2024-09-21T03:55:28.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:27 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:27.585+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:28.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:27 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:27.585+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:28.319 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:27 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:27.921+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:28.320 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:27 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:27.977+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.192491+0000 front 2024-09-21T03:54:50.192509+0000 (oldest deadline 2024-09-21T03:55:14.292341+0000) 2024-09-21T03:55:28.320 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:27 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:27.977+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.393335+0000 front 2024-09-21T03:54:58.393370+0000 (oldest deadline 2024-09-21T03:55:22.493441+0000) 2024-09-21T03:55:28.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:28 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:28.267+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:28.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:28 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:28.077+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:28.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:28 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:28.077+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:28.477 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T03:55:28.556 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:55:28.557 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T03:55:28.557 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T03:55:28.557 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.5 2024-09-21T03:55:28.585 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:28 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:28.317+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:28.585 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:28 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:28.317+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:28.869 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:28 smithi174 systemd[1]: Stopping Ceph osd.5 for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:55:29.068 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:28 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:28.814+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:29.069 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:28 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:28.814+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.237952+0000 front 2024-09-21T03:55:00.237905+0000 (oldest deadline 2024-09-21T03:55:25.537898+0000) 2024-09-21T03:55:29.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:28 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:28.614+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:29.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:28 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:28.614+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:29.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:28 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:28.928+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:29.128 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:28 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:28.867+0000 7fba9bbb8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:55:29.128 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:28 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:28.867+0000 7fba9bbb8640 -1 osd.5 92 *** Got signal Terminated *** 2024-09-21T03:55:29.128 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:28 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:28.867+0000 7fba9bbb8640 -1 osd.5 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:55:29.129 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:28 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:28.960+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.192491+0000 front 2024-09-21T03:54:50.192509+0000 (oldest deadline 2024-09-21T03:55:14.292341+0000) 2024-09-21T03:55:29.129 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:28 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:28.960+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.393335+0000 front 2024-09-21T03:54:58.393370+0000 (oldest deadline 2024-09-21T03:55:22.493441+0000) 2024-09-21T03:55:29.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:29 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:29.246+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:29.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:29 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:29.092+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:29.402 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:29 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:29.092+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:29.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:29 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:29.288+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:29.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:29 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:29.288+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:30.068 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:29 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:29.845+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:30.068 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:29 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:29.845+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.237952+0000 front 2024-09-21T03:55:00.237905+0000 (oldest deadline 2024-09-21T03:55:25.537898+0000) 2024-09-21T03:55:30.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:29 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:29.628+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:30.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:29 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:29.628+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:30.250 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:29 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:29.917+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:30.250 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:30 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:30.005+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.192491+0000 front 2024-09-21T03:54:50.192509+0000 (oldest deadline 2024-09-21T03:55:14.292341+0000) 2024-09-21T03:55:30.250 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:30 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:30.005+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.393335+0000 front 2024-09-21T03:54:58.393370+0000 (oldest deadline 2024-09-21T03:55:22.493441+0000) 2024-09-21T03:55:30.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:30 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:30.259+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:30.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:30 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:30.093+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:30.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:30 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:30.093+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:30.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:30 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:30.248+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:30.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:30 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:30.248+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:31.068 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:30 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:30.823+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:31.069 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:30 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:30.823+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.237952+0000 front 2024-09-21T03:55:00.237905+0000 (oldest deadline 2024-09-21T03:55:25.537898+0000) 2024-09-21T03:55:31.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:30 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:30.671+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:31.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:30 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:30.671+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:31.229 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:30 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:30.927+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:31.229 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:31 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:31.003+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.192491+0000 front 2024-09-21T03:54:50.192509+0000 (oldest deadline 2024-09-21T03:55:14.292341+0000) 2024-09-21T03:55:31.230 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:31 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:31.003+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.393335+0000 front 2024-09-21T03:54:58.393370+0000 (oldest deadline 2024-09-21T03:55:22.493441+0000) 2024-09-21T03:55:31.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:31 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:31.269+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:31.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:31 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:31.110+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:31.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:31 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:31.110+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:31.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:31 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:31.227+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:31.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:31 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:31.227+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:32.068 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:31.850+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:32.069 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:31.850+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.237952+0000 front 2024-09-21T03:55:00.237905+0000 (oldest deadline 2024-09-21T03:55:25.537898+0000) 2024-09-21T03:55:32.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:31.638+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:32.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:31.638+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:32.219 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:31 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:31.941+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:32.219 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:31 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:31.974+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.192491+0000 front 2024-09-21T03:54:50.192509+0000 (oldest deadline 2024-09-21T03:55:14.292341+0000) 2024-09-21T03:55:32.219 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:31 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:31.974+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.393335+0000 front 2024-09-21T03:54:58.393370+0000 (oldest deadline 2024-09-21T03:55:22.493441+0000) 2024-09-21T03:55:32.219 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:31 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:31.974+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:08.394354+0000 front 2024-09-21T03:55:08.394404+0000 (oldest deadline 2024-09-21T03:55:31.294526+0000) 2024-09-21T03:55:32.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:32 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:32.217+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:32.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:32 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:32.217+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:32.651 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:32 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:32.269+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:32.651 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:32 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:32.151+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:32.651 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:32 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:32.151+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:32.651 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:32 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:32.151+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:32.869 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:32 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:32.600+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:32.869 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:32 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:32.600+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:33.211 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:32 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:32.955+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:33.212 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:32 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:32.956+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.192491+0000 front 2024-09-21T03:54:50.192509+0000 (oldest deadline 2024-09-21T03:55:14.292341+0000) 2024-09-21T03:55:33.212 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:32 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:32.956+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.393335+0000 front 2024-09-21T03:54:58.393370+0000 (oldest deadline 2024-09-21T03:55:22.493441+0000) 2024-09-21T03:55:33.212 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:32 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5[45770]: 2024-09-21T03:55:32.956+0000 7fba9419b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:08.394354+0000 front 2024-09-21T03:55:08.394404+0000 (oldest deadline 2024-09-21T03:55:31.294526+0000) 2024-09-21T03:55:33.318 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:32 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:32.867+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:33.318 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:32 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:32.867+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.237952+0000 front 2024-09-21T03:55:00.237905+0000 (oldest deadline 2024-09-21T03:55:25.537898+0000) 2024-09-21T03:55:33.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:33 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:33.280+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:33.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:33 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:33.139+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:33.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:33 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:33.139+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:33.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:33 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:33.139+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:33.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:33 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:33.210+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:33.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:33 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:33.210+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:33.850 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:33 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:33.591+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:33.850 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:33 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:33.591+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:34.279 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:33 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:33.957+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:34.279 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:34 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:34.191+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:34.279 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:34 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:34.191+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:34.318 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:33 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:33.848+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:34.318 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:33 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:33.848+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.237952+0000 front 2024-09-21T03:55:00.237905+0000 (oldest deadline 2024-09-21T03:55:25.537898+0000) 2024-09-21T03:55:34.318 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:33 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:33.848+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.539416+0000 front 2024-09-21T03:55:09.539331+0000 (oldest deadline 2024-09-21T03:55:33.639411+0000) 2024-09-21T03:55:34.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:34 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:34.314+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:34.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:34 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:34.130+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:34.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:34 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:34.130+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:34.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:34 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:34.130+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:34.596 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:34 smithi174 podman[67150]: 2024-09-21 03:55:34.277806066 +0000 UTC m=+5.529943642 container died 5afbfc1801ff213c5baa8961332a250918c1cba84fe566effb1e3d2e6394aa02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T03:55:34.818 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:34 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:34.555+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:34.818 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:34 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:34.555+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:34.818 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:34 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:34.555+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:34.878 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:34 smithi174 podman[67150]: 2024-09-21 03:55:34.684410821 +0000 UTC m=+5.936548407 container cleanup 5afbfc1801ff213c5baa8961332a250918c1cba84fe566effb1e3d2e6394aa02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T03:55:34.878 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:34 smithi174 bash[67150]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5 2024-09-21T03:55:35.227 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:34 smithi174 podman[67166]: 2024-09-21 03:55:34.944111811 +0000 UTC m=+0.668475988 container remove 5afbfc1801ff213c5baa8961332a250918c1cba84fe566effb1e3d2e6394aa02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T03:55:35.227 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:34 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:34.985+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:35.227 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:34 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:34.985+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:35.318 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:34 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:34.884+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:35.318 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:34 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:34.884+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.237952+0000 front 2024-09-21T03:55:00.237905+0000 (oldest deadline 2024-09-21T03:55:25.537898+0000) 2024-09-21T03:55:35.318 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:34 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:34.884+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.539416+0000 front 2024-09-21T03:55:09.539331+0000 (oldest deadline 2024-09-21T03:55:33.639411+0000) 2024-09-21T03:55:35.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:35 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:35.300+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:35.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:35 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:35.300+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.547726+0000 front 2024-09-21T03:55:09.547895+0000 (oldest deadline 2024-09-21T03:55:34.847738+0000) 2024-09-21T03:55:35.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:35 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:35.127+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:35.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:35 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:35.127+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:35.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:35 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:35.127+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:35.607 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:35 smithi174 podman[67259]: 2024-09-21 03:55:35.19366441 +0000 UTC m=+0.015790907 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:55:35.607 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:35 smithi174 podman[67259]: 2024-09-21 03:55:35.320132868 +0000 UTC m=+0.142259352 container create b750ff6700e42a4fd51593e732d87a51393d4ba16d56ed43eb2f44d362a7d5d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:55:35.607 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:35 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:35.225+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:35.607 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:35 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:35.225+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:35.607 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:35 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:35.225+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:35.818 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:35 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:35.560+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:35.818 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:35 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:35.560+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:35.818 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:35 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:35.560+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:35.878 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:35 smithi174 podman[67259]: 2024-09-21 03:55:35.605802168 +0000 UTC m=+0.427928652 container init b750ff6700e42a4fd51593e732d87a51393d4ba16d56ed43eb2f44d362a7d5d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T03:55:35.879 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:35 smithi174 podman[67259]: 2024-09-21 03:55:35.609253186 +0000 UTC m=+0.431379673 container start b750ff6700e42a4fd51593e732d87a51393d4ba16d56ed43eb2f44d362a7d5d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:55:35.879 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:35 smithi174 podman[67259]: 2024-09-21 03:55:35.705901694 +0000 UTC m=+0.528028179 container attach b750ff6700e42a4fd51593e732d87a51393d4ba16d56ed43eb2f44d362a7d5d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5-deactivate, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T03:55:35.879 INFO:journalctl@ceph.osd.5.smithi174.stdout:Sep 21 03:55:35 smithi174 podman[67259]: 2024-09-21 03:55:35.797088538 +0000 UTC m=+0.619215033 container died b750ff6700e42a4fd51593e732d87a51393d4ba16d56ed43eb2f44d362a7d5d3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:55:36.266 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:36 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:36.010+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:36.266 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:36 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:36.010+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:36.318 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:35 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:35.858+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:36.318 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:35 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:35.858+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.237952+0000 front 2024-09-21T03:55:00.237905+0000 (oldest deadline 2024-09-21T03:55:25.537898+0000) 2024-09-21T03:55:36.318 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:35 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:35.858+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.539416+0000 front 2024-09-21T03:55:09.539331+0000 (oldest deadline 2024-09-21T03:55:33.639411+0000) 2024-09-21T03:55:36.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:36 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:36.291+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:36.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:36 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:36.291+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.547726+0000 front 2024-09-21T03:55:09.547895+0000 (oldest deadline 2024-09-21T03:55:34.847738+0000) 2024-09-21T03:55:36.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:36 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:36.078+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:36.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:36 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:36.078+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:36.402 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:36 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:36.078+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:36.424 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T03:55:36.503 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:55:36.504 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T03:55:36.504 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T03:55:36.504 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.6 2024-09-21T03:55:36.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:36 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:36.264+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:36.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:36 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:36.264+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:36.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:36 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:36.264+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:36.818 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:36 smithi084 systemd[1]: Stopping Ceph osd.6 for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:55:36.819 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:36 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:36.527+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:36.819 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:36 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:36.527+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:36.819 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:36 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:36.527+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:37.257 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:36 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:36.993+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:37.257 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:36 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:36.993+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:37.318 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:36 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:36.827+0000 7fd9e753f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:55:37.318 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:36 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:36.827+0000 7fd9e753f640 -1 osd.6 92 *** Got signal Terminated *** 2024-09-21T03:55:37.318 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:36 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:36.827+0000 7fd9e753f640 -1 osd.6 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:55:37.319 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:36 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:36.849+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:37.319 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:36 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:36.849+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.237952+0000 front 2024-09-21T03:55:00.237905+0000 (oldest deadline 2024-09-21T03:55:25.537898+0000) 2024-09-21T03:55:37.319 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:36 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:36.849+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.539416+0000 front 2024-09-21T03:55:09.539331+0000 (oldest deadline 2024-09-21T03:55:33.639411+0000) 2024-09-21T03:55:37.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:37 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:37.326+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:37.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:37 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:37.326+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.547726+0000 front 2024-09-21T03:55:09.547895+0000 (oldest deadline 2024-09-21T03:55:34.847738+0000) 2024-09-21T03:55:37.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:37 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:37.102+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:37.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:37 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:37.102+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:37.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:37 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:37.102+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:37.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:37 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:37.256+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:37.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:37 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:37.256+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:37.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:37 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:37.256+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:37.818 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:37 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:37.530+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:37.818 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:37 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:37.530+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:37.818 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:37 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:37.530+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:38.249 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:37 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:37.973+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:38.249 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:37 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:37.973+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:38.318 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:37 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:37.843+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:38.318 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:37 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:37.843+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.237952+0000 front 2024-09-21T03:55:00.237905+0000 (oldest deadline 2024-09-21T03:55:25.537898+0000) 2024-09-21T03:55:38.318 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:37 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:37.843+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.539416+0000 front 2024-09-21T03:55:09.539331+0000 (oldest deadline 2024-09-21T03:55:33.639411+0000) 2024-09-21T03:55:38.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:38 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:38.285+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:38.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:38 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:38.285+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.547726+0000 front 2024-09-21T03:55:09.547895+0000 (oldest deadline 2024-09-21T03:55:34.847738+0000) 2024-09-21T03:55:38.402 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:38 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:38.109+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:38.402 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:38 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:38.109+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:38.402 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:38 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:38.109+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:38.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:38 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:38.247+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:38.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:38 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:38.247+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:38.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:38 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:38.247+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:38.818 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:38 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:38.535+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:38.818 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:38 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:38.535+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:38.818 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:38 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:38.535+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:39.318 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:38 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:38.819+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:39.318 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:38 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:38.819+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.237952+0000 front 2024-09-21T03:55:00.237905+0000 (oldest deadline 2024-09-21T03:55:25.537898+0000) 2024-09-21T03:55:39.319 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:38 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:38.819+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.539416+0000 front 2024-09-21T03:55:09.539331+0000 (oldest deadline 2024-09-21T03:55:33.639411+0000) 2024-09-21T03:55:39.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:39 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:39.200+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:39.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:39 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:39.200+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:39.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:39 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:39.200+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:39.378 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:38 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:38.955+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:39.379 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:38 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:38.955+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:39.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:39 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:39.310+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:39.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:39 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:39.310+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.547726+0000 front 2024-09-21T03:55:09.547895+0000 (oldest deadline 2024-09-21T03:55:34.847738+0000) 2024-09-21T03:55:39.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:39 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:39.076+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:39.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:39 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:39.076+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:39.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:39 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:39.076+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:39.803 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:39 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:39.502+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:39.804 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:39 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:39.502+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:39.804 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:39 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:39.502+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:40.068 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:39 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:39.802+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:40.068 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:39 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:39.802+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.237952+0000 front 2024-09-21T03:55:00.237905+0000 (oldest deadline 2024-09-21T03:55:25.537898+0000) 2024-09-21T03:55:40.068 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:39 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:39.802+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.539416+0000 front 2024-09-21T03:55:09.539331+0000 (oldest deadline 2024-09-21T03:55:33.639411+0000) 2024-09-21T03:55:40.235 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:39 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:39.928+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:40.235 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:39 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:39.928+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:40.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:40 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:40.277+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:40.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:40 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:40.277+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.547726+0000 front 2024-09-21T03:55:09.547895+0000 (oldest deadline 2024-09-21T03:55:34.847738+0000) 2024-09-21T03:55:40.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:40 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:40.277+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.948972+0000 front 2024-09-21T03:55:15.948899+0000 (oldest deadline 2024-09-21T03:55:39.449008+0000) 2024-09-21T03:55:40.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:40 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:40.119+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:40.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:40 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:40.119+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:40.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:40 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:40.119+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:40.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:40 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:40.119+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:55:40.509 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:40 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:40.233+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:40.509 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:40 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:40.233+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:40.509 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:40 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:40.233+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:40.818 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:40 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:40.545+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:40.818 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:40 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:40.546+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:40.819 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:40 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:40.546+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:40.819 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:40 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:40.771+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:40.819 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:40 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:40.771+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.237952+0000 front 2024-09-21T03:55:00.237905+0000 (oldest deadline 2024-09-21T03:55:25.537898+0000) 2024-09-21T03:55:40.819 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:40 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:40.771+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.539416+0000 front 2024-09-21T03:55:09.539331+0000 (oldest deadline 2024-09-21T03:55:33.639411+0000) 2024-09-21T03:55:40.819 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:40 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:40.771+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.140216+0000 front 2024-09-21T03:55:17.140259+0000 (oldest deadline 2024-09-21T03:55:40.040267+0000) 2024-09-21T03:55:41.236 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:40 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:40.890+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:41.237 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:40 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:40.890+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:41.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:41 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:41.299+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:41.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:41 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:41.299+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.547726+0000 front 2024-09-21T03:55:09.547895+0000 (oldest deadline 2024-09-21T03:55:34.847738+0000) 2024-09-21T03:55:41.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:41 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:41.299+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.948972+0000 front 2024-09-21T03:55:15.948899+0000 (oldest deadline 2024-09-21T03:55:39.449008+0000) 2024-09-21T03:55:41.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:41 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:41.113+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:41.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:41 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:41.113+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:41.402 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:41 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:41.113+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:41.402 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:41 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:41.113+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:55:41.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:41 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:41.234+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:41.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:41 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:41.234+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:41.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:41 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:41.234+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:42.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:41 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:41.570+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:42.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:41 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:41.570+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:42.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:41 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:41.570+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:42.069 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:41 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:41.769+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.336058+0000 front 2024-09-21T03:54:50.336085+0000 (oldest deadline 2024-09-21T03:55:14.436216+0000) 2024-09-21T03:55:42.069 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:41 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:41.769+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.237952+0000 front 2024-09-21T03:55:00.237905+0000 (oldest deadline 2024-09-21T03:55:25.537898+0000) 2024-09-21T03:55:42.069 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:41 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:41.769+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.539416+0000 front 2024-09-21T03:55:09.539331+0000 (oldest deadline 2024-09-21T03:55:33.639411+0000) 2024-09-21T03:55:42.069 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:41 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6[60870]: 2024-09-21T03:55:41.769+0000 7fd9e3b2a640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.140216+0000 front 2024-09-21T03:55:17.140259+0000 (oldest deadline 2024-09-21T03:55:40.040267+0000) 2024-09-21T03:55:42.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:41 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:41.868+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:42.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:41 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:41.868+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:42.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:41 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:41.868+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.698492+0000 front 2024-09-21T03:55:15.698331+0000 (oldest deadline 2024-09-21T03:55:40.998210+0000) 2024-09-21T03:55:42.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:42 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:42.328+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:42.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:42 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:42.328+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.547726+0000 front 2024-09-21T03:55:09.547895+0000 (oldest deadline 2024-09-21T03:55:34.847738+0000) 2024-09-21T03:55:42.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:42 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:42.328+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.948972+0000 front 2024-09-21T03:55:15.948899+0000 (oldest deadline 2024-09-21T03:55:39.449008+0000) 2024-09-21T03:55:42.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:42 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:42.094+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:42.402 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:42 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:42.094+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:42.402 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:42 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:42.094+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:42.402 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:42 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:42.094+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:55:42.537 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:42 smithi084 podman[107742]: 2024-09-21 03:55:42.257437302 +0000 UTC m=+5.556552695 container died e08850af22fa978c4e56570d8c32a93c622caa732b3d3e450d6a8a4444600259 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:55:42.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:42 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:42.201+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:42.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:42 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:42.201+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:42.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:42 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:42.201+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:42.818 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:42 smithi084 podman[107742]: 2024-09-21 03:55:42.743772333 +0000 UTC m=+6.042887722 container cleanup e08850af22fa978c4e56570d8c32a93c622caa732b3d3e450d6a8a4444600259 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T03:55:42.818 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:42 smithi084 bash[107742]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6 2024-09-21T03:55:42.819 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:42 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:42.590+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:42.819 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:42 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:42.590+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:42.819 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:42 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:42.590+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:43.191 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:42 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:42.877+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:43.192 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:42 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:42.877+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:43.192 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:42 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:42.877+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.698492+0000 front 2024-09-21T03:55:15.698331+0000 (oldest deadline 2024-09-21T03:55:40.998210+0000) 2024-09-21T03:55:43.318 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:43 smithi084 podman[107759]: 2024-09-21 03:55:43.045538098 +0000 UTC m=+0.780132138 container remove e08850af22fa978c4e56570d8c32a93c622caa732b3d3e450d6a8a4444600259 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True) 2024-09-21T03:55:43.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:43 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:43.311+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:43.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:43 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:43.311+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.547726+0000 front 2024-09-21T03:55:09.547895+0000 (oldest deadline 2024-09-21T03:55:34.847738+0000) 2024-09-21T03:55:43.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:43 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:43.311+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.948972+0000 front 2024-09-21T03:55:15.948899+0000 (oldest deadline 2024-09-21T03:55:39.449008+0000) 2024-09-21T03:55:43.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:43 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:43.114+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:43.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:43 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:43.114+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:43.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:43 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:43.114+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:43.402 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:43 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:43.114+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:55:43.608 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:43 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:43.570+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:43.609 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:43 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:43.570+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:43.609 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:43 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:43.570+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:43.609 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:43 smithi084 podman[107845]: 2024-09-21 03:55:43.254011053 +0000 UTC m=+0.015731643 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:55:43.609 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:43 smithi084 podman[107845]: 2024-09-21 03:55:43.371380535 +0000 UTC m=+0.133101122 container create 62aac00797ffdf0c9d12101e31087318223d98a3843f2e734062296cb4a87398 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T03:55:43.609 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:43 smithi084 podman[107845]: 2024-09-21 03:55:43.607367145 +0000 UTC m=+0.369087734 container init 62aac00797ffdf0c9d12101e31087318223d98a3843f2e734062296cb4a87398 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:55:43.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:43 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:43.189+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:43.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:43 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:43.189+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:43.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:43 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:43.189+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:44.069 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:43 smithi084 podman[107845]: 2024-09-21 03:55:43.611020159 +0000 UTC m=+0.372740739 container start 62aac00797ffdf0c9d12101e31087318223d98a3843f2e734062296cb4a87398 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True) 2024-09-21T03:55:44.069 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:43 smithi084 podman[107845]: 2024-09-21 03:55:43.715816399 +0000 UTC m=+0.477536994 container attach 62aac00797ffdf0c9d12101e31087318223d98a3843f2e734062296cb4a87398 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T03:55:44.069 INFO:journalctl@ceph.osd.6.smithi084.stdout:Sep 21 03:55:43 smithi084 podman[107845]: 2024-09-21 03:55:43.797628567 +0000 UTC m=+0.559349147 container died 62aac00797ffdf0c9d12101e31087318223d98a3843f2e734062296cb4a87398 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T03:55:44.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:43 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:43.872+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:44.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:43 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:43.872+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:44.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:43 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:43.872+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.698492+0000 front 2024-09-21T03:55:15.698331+0000 (oldest deadline 2024-09-21T03:55:40.998210+0000) 2024-09-21T03:55:44.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:44 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:44.340+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:44.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:44 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:44.340+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.547726+0000 front 2024-09-21T03:55:09.547895+0000 (oldest deadline 2024-09-21T03:55:34.847738+0000) 2024-09-21T03:55:44.401 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:44 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:44.340+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.948972+0000 front 2024-09-21T03:55:15.948899+0000 (oldest deadline 2024-09-21T03:55:39.449008+0000) 2024-09-21T03:55:44.402 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:44 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:44.116+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:44.402 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:44 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:44.116+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:44.402 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:44 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:44.116+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:44.402 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:44 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:44.116+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:55:44.536 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T03:55:44.577 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:55:44.577 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T03:55:44.578 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T03:55:44.578 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.7 2024-09-21T03:55:44.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:44 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:44.195+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:44.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:44 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:44.195+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:44.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:44 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:44.195+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:44.786 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:44 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:44.592+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:44.836 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:44 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:44.592+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:44.836 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:44 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:44.592+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:44.836 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:44 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:44.592+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:55:44.907 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:44 smithi172 systemd[1]: Stopping Ceph osd.7 for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:55:45.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:44 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:44.835+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:45.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:44 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:44.835+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:45.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:44 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:44.835+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.698492+0000 front 2024-09-21T03:55:15.698331+0000 (oldest deadline 2024-09-21T03:55:40.998210+0000) 2024-09-21T03:55:45.385 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:44 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:44.903+0000 7fc43e706640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:55:45.385 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:44 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:44.903+0000 7fc43e706640 -1 osd.7 92 *** Got signal Terminated *** 2024-09-21T03:55:45.385 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:44 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:44.903+0000 7fc43e706640 -1 osd.7 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:55:45.385 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:45 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:45.102+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:45.385 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:45 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:45.102+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:45.385 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:45 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:45.102+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:45.385 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:45 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:45.102+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:55:45.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:45 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:45.184+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:45.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:45 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:45.184+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:45.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:45 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:45.184+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:45.651 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:45 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:45.382+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:45.651 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:45 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:45.382+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.547726+0000 front 2024-09-21T03:55:09.547895+0000 (oldest deadline 2024-09-21T03:55:34.847738+0000) 2024-09-21T03:55:45.651 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:45 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:45.382+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.948972+0000 front 2024-09-21T03:55:15.948899+0000 (oldest deadline 2024-09-21T03:55:39.449008+0000) 2024-09-21T03:55:46.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:45 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:45.616+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:46.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:45 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:45.616+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:46.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:45 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:45.616+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:46.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:45 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:45.616+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:55:46.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:45 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:45.802+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:46.130 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:45 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:45.802+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:46.130 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:45 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:45.802+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.698492+0000 front 2024-09-21T03:55:15.698331+0000 (oldest deadline 2024-09-21T03:55:40.998210+0000) 2024-09-21T03:55:46.388 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:46 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:46.067+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:46.388 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:46 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:46.067+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:46.388 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:46 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:46.067+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:46.388 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:46 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:46.067+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:55:46.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:46 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:46.213+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:46.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:46 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:46.213+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:46.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:46 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:46.213+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:46.651 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:46 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:46.385+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:46.651 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:46 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:46.385+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.547726+0000 front 2024-09-21T03:55:09.547895+0000 (oldest deadline 2024-09-21T03:55:34.847738+0000) 2024-09-21T03:55:46.651 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:46 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:46.385+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.948972+0000 front 2024-09-21T03:55:15.948899+0000 (oldest deadline 2024-09-21T03:55:39.449008+0000) 2024-09-21T03:55:47.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:46 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:46.652+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:47.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:46 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:46.652+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:47.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:46 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:46.652+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:47.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:46 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:46.652+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:55:47.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:46 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:46.805+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:47.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:46 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:46.805+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:47.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:46 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:46.805+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.698492+0000 front 2024-09-21T03:55:15.698331+0000 (oldest deadline 2024-09-21T03:55:40.998210+0000) 2024-09-21T03:55:47.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:47 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:47.049+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:47.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:47 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:47.049+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:47.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:47 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:47.049+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:47.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:47 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:47.049+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:55:47.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:47 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:47.211+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:47.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:47 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:47.211+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:47.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:47 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:47.211+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:47.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:47 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:47.211+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:55:47.901 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:47 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:47.423+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:47.901 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:47 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:47.423+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.547726+0000 front 2024-09-21T03:55:09.547895+0000 (oldest deadline 2024-09-21T03:55:34.847738+0000) 2024-09-21T03:55:47.901 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:47 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:47.423+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.948972+0000 front 2024-09-21T03:55:15.948899+0000 (oldest deadline 2024-09-21T03:55:39.449008+0000) 2024-09-21T03:55:47.901 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:47 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:47.423+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:20.549835+0000 front 2024-09-21T03:55:20.549858+0000 (oldest deadline 2024-09-21T03:55:46.449933+0000) 2024-09-21T03:55:48.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:47 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:47.618+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:48.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:47 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:47.618+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:48.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:47 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:47.618+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:48.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:47 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:47.618+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:55:48.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:47 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:47.770+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:48.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:47 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:47.770+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:48.129 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:47 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:47.770+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.698492+0000 front 2024-09-21T03:55:15.698331+0000 (oldest deadline 2024-09-21T03:55:40.998210+0000) 2024-09-21T03:55:48.129 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:47 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:47.770+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:23.299257+0000 front 2024-09-21T03:55:23.299238+0000 (oldest deadline 2024-09-21T03:55:47.399204+0000) 2024-09-21T03:55:48.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:48 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:48.011+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:48.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:48 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:48.011+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:48.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:48 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:48.011+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:48.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:48 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:48.011+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:55:48.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:48 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:48.172+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:48.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:48 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:48.172+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:48.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:48 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:48.172+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:48.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:48 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:48.172+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:55:48.901 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:48 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:48.424+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:48.901 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:48 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:48.424+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.547726+0000 front 2024-09-21T03:55:09.547895+0000 (oldest deadline 2024-09-21T03:55:34.847738+0000) 2024-09-21T03:55:48.901 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:48 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:48.424+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.948972+0000 front 2024-09-21T03:55:15.948899+0000 (oldest deadline 2024-09-21T03:55:39.449008+0000) 2024-09-21T03:55:48.901 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:48 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:48.424+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:20.549835+0000 front 2024-09-21T03:55:20.549858+0000 (oldest deadline 2024-09-21T03:55:46.449933+0000) 2024-09-21T03:55:49.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:48 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:48.578+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:49.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:48 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:48.578+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:49.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:48 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:48.578+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:49.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:48 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:48.578+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:55:49.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:48 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:48.578+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:24.222726+0000 front 2024-09-21T03:55:24.222661+0000 (oldest deadline 2024-09-21T03:55:48.322430+0000) 2024-09-21T03:55:49.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:48 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:48.812+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:49.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:48 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:48.812+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:49.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:48 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:48.812+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.698492+0000 front 2024-09-21T03:55:15.698331+0000 (oldest deadline 2024-09-21T03:55:40.998210+0000) 2024-09-21T03:55:49.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:48 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:48.812+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:23.299257+0000 front 2024-09-21T03:55:23.299238+0000 (oldest deadline 2024-09-21T03:55:47.399204+0000) 2024-09-21T03:55:49.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:48 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:48.970+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:49.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:48 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:48.970+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:49.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:48 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:48.970+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:49.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:48 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:48.970+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:55:49.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:48 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:48.970+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:55:49.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:49 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:49.192+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:49.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:49 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:49.192+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:49.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:49 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:49.192+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:49.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:49 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:49.192+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:55:49.901 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:49 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:49.419+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.945462+0000 front 2024-09-21T03:54:57.945494+0000 (oldest deadline 2024-09-21T03:55:24.346129+0000) 2024-09-21T03:55:49.901 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:49 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:49.419+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.547726+0000 front 2024-09-21T03:55:09.547895+0000 (oldest deadline 2024-09-21T03:55:34.847738+0000) 2024-09-21T03:55:49.901 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:49 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:49.419+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.948972+0000 front 2024-09-21T03:55:15.948899+0000 (oldest deadline 2024-09-21T03:55:39.449008+0000) 2024-09-21T03:55:49.901 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:49 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7[52155]: 2024-09-21T03:55:49.419+0000 7fc436ce9640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:20.549835+0000 front 2024-09-21T03:55:20.549858+0000 (oldest deadline 2024-09-21T03:55:46.449933+0000) 2024-09-21T03:55:50.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:49 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:49.598+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:50.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:49 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:49.598+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:50.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:49 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:49.598+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:50.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:49 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:49.598+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:55:50.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:49 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:49.598+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:24.222726+0000 front 2024-09-21T03:55:24.222661+0000 (oldest deadline 2024-09-21T03:55:48.322430+0000) 2024-09-21T03:55:50.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:49 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:49.818+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:50.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:49 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:49.818+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:50.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:49 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:49.818+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.698492+0000 front 2024-09-21T03:55:15.698331+0000 (oldest deadline 2024-09-21T03:55:40.998210+0000) 2024-09-21T03:55:50.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:49 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:49.818+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:23.299257+0000 front 2024-09-21T03:55:23.299238+0000 (oldest deadline 2024-09-21T03:55:47.399204+0000) 2024-09-21T03:55:50.245 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:49 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:49.950+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:50.245 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:49 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:49.950+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:50.245 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:49 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:49.950+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:50.245 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:49 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:49.950+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:55:50.245 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:49 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:49.950+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:55:50.555 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:50 smithi172 podman[68244]: 2024-09-21 03:55:50.243461998 +0000 UTC m=+5.470380951 container died 266283fb1f828a178436b78c4c73962d6e7934ebcfdd5ed0b766fc3b72b275a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:55:50.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:50 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:50.176+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:50.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:50 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:50.176+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:50.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:50 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:50.176+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:50.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:50 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:50.176+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:55:50.873 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:50 smithi172 podman[68244]: 2024-09-21 03:55:50.653461205 +0000 UTC m=+5.880380164 container cleanup 266283fb1f828a178436b78c4c73962d6e7934ebcfdd5ed0b766fc3b72b275a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T03:55:50.873 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:50 smithi172 bash[68244]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7 2024-09-21T03:55:51.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:50.648+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:51.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:50.648+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:51.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:50.648+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:51.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:50.648+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:55:51.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:50 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:50.648+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:24.222726+0000 front 2024-09-21T03:55:24.222661+0000 (oldest deadline 2024-09-21T03:55:48.322430+0000) 2024-09-21T03:55:51.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:50 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:50.811+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:51.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:50 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:50.811+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:51.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:50 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:50.811+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.698492+0000 front 2024-09-21T03:55:15.698331+0000 (oldest deadline 2024-09-21T03:55:40.998210+0000) 2024-09-21T03:55:51.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:50 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:50.811+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:23.299257+0000 front 2024-09-21T03:55:23.299238+0000 (oldest deadline 2024-09-21T03:55:47.399204+0000) 2024-09-21T03:55:51.151 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:50 smithi172 podman[68260]: 2024-09-21 03:55:50.871684679 +0000 UTC m=+0.630521916 container remove 266283fb1f828a178436b78c4c73962d6e7934ebcfdd5ed0b766fc3b72b275a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:55:51.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:50 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:50.957+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:51.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:50 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:50.957+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:51.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:50 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:50.957+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:51.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:50 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:50.957+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:55:51.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:50 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:50.957+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:55:51.529 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:51 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:51.191+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:51.529 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:51 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:51.191+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:51.529 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:51 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:51.191+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:51.529 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:51 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:51.191+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:55:51.543 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:51 smithi172 podman[68347]: 2024-09-21 03:55:51.184838413 +0000 UTC m=+0.016501570 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:55:51.543 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:51 smithi172 podman[68347]: 2024-09-21 03:55:51.289176665 +0000 UTC m=+0.120839852 container create 5129596db5c78c664931a24fb0c20419689155d66f1345a9ad88626f00e2a11a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7-deactivate, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:55:51.901 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:51 smithi172 podman[68347]: 2024-09-21 03:55:51.54165065 +0000 UTC m=+0.373313804 container init 5129596db5c78c664931a24fb0c20419689155d66f1345a9ad88626f00e2a11a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T03:55:51.901 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:51 smithi172 podman[68347]: 2024-09-21 03:55:51.545287325 +0000 UTC m=+0.376950473 container start 5129596db5c78c664931a24fb0c20419689155d66f1345a9ad88626f00e2a11a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T03:55:51.901 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:51 smithi172 podman[68347]: 2024-09-21 03:55:51.624746527 +0000 UTC m=+0.456409682 container attach 5129596db5c78c664931a24fb0c20419689155d66f1345a9ad88626f00e2a11a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T03:55:51.901 INFO:journalctl@ceph.osd.7.smithi172.stdout:Sep 21 03:55:51 smithi172 podman[68347]: 2024-09-21 03:55:51.737109022 +0000 UTC m=+0.568772178 container died 5129596db5c78c664931a24fb0c20419689155d66f1345a9ad88626f00e2a11a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T03:55:52.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:51.605+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:52.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:51.605+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:52.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:51.605+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:52.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:51.605+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:55:52.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:51 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:51.605+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:24.222726+0000 front 2024-09-21T03:55:24.222661+0000 (oldest deadline 2024-09-21T03:55:48.322430+0000) 2024-09-21T03:55:52.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:51 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:51.854+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:52.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:51 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:51.854+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:52.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:51 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:51.854+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.698492+0000 front 2024-09-21T03:55:15.698331+0000 (oldest deadline 2024-09-21T03:55:40.998210+0000) 2024-09-21T03:55:52.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:51 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:51.854+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:23.299257+0000 front 2024-09-21T03:55:23.299238+0000 (oldest deadline 2024-09-21T03:55:47.399204+0000) 2024-09-21T03:55:52.355 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:51 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:51.950+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:52.355 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:51 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:51.950+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:52.355 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:51 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:51.950+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:52.355 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:51 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:51.950+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:55:52.355 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:51 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:51.950+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:55:52.374 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T03:55:52.413 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:55:52.413 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T03:55:52.414 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T03:55:52.414 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.8 2024-09-21T03:55:52.444 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:52 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:52.190+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:52.444 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:52 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:52.190+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:52.444 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:52 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:52.190+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:52.444 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:52 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:52.190+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:55:52.730 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:52 smithi174 systemd[1]: Stopping Ceph osd.8 for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:55:53.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:52 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:52.632+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:53.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:52 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:52.632+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:53.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:52 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:52.632+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:53.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:52 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:52.632+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:55:53.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:52 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:52.632+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:24.222726+0000 front 2024-09-21T03:55:24.222661+0000 (oldest deadline 2024-09-21T03:55:48.322430+0000) 2024-09-21T03:55:53.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:52 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:52.727+0000 7fd5d8375640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:55:53.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:52 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:52.727+0000 7fd5d8375640 -1 osd.8 92 *** Got signal Terminated *** 2024-09-21T03:55:53.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:52 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:52.727+0000 7fd5d8375640 -1 osd.8 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:55:53.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:52 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:52.863+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:53.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:52 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:52.863+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:53.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:52 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:52.863+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.698492+0000 front 2024-09-21T03:55:15.698331+0000 (oldest deadline 2024-09-21T03:55:40.998210+0000) 2024-09-21T03:55:53.129 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:52 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:52.863+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:23.299257+0000 front 2024-09-21T03:55:23.299238+0000 (oldest deadline 2024-09-21T03:55:47.399204+0000) 2024-09-21T03:55:53.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:52 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:52.907+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:53.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:52 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:52.907+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:53.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:52 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:52.907+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:53.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:52 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:52.907+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:55:53.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:52 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:52.907+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:55:53.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:53 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:53.159+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:53.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:53 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:53.159+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:53.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:53 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:53.159+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:53.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:53 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:53.159+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:55:54.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:53 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:53.659+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:54.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:53 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:53.659+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:54.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:53 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:53.659+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:54.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:53 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:53.659+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:55:54.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:53 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:53.659+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:24.222726+0000 front 2024-09-21T03:55:24.222661+0000 (oldest deadline 2024-09-21T03:55:48.322430+0000) 2024-09-21T03:55:54.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:53 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:53.814+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:54.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:53 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:53.814+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:54.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:53 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:53.814+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.698492+0000 front 2024-09-21T03:55:15.698331+0000 (oldest deadline 2024-09-21T03:55:40.998210+0000) 2024-09-21T03:55:54.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:53 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:53.814+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:23.299257+0000 front 2024-09-21T03:55:23.299238+0000 (oldest deadline 2024-09-21T03:55:47.399204+0000) 2024-09-21T03:55:54.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:53 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:53.889+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:54.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:53 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:53.889+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:54.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:53 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:53.889+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:54.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:53 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:53.889+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:55:54.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:53 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:53.889+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:55:54.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:54 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:54.200+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:54.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:54 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:54.200+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:54.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:54 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:54.200+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:54.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:54 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:54.200+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:55:54.970 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:54 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:54.705+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:54.970 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:54 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:54.705+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:54.970 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:54 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:54.705+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:54.970 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:54 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:54.705+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:55:54.970 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:54 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:54.705+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:24.222726+0000 front 2024-09-21T03:55:24.222661+0000 (oldest deadline 2024-09-21T03:55:48.322430+0000) 2024-09-21T03:55:55.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:54 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:54.786+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:55.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:54 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:54.786+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:55.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:54 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:54.786+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.698492+0000 front 2024-09-21T03:55:15.698331+0000 (oldest deadline 2024-09-21T03:55:40.998210+0000) 2024-09-21T03:55:55.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:54 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:54.786+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:23.299257+0000 front 2024-09-21T03:55:23.299238+0000 (oldest deadline 2024-09-21T03:55:47.399204+0000) 2024-09-21T03:55:55.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:54 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:54.925+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:55.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:54 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:54.925+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:55.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:54 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:54.925+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:55.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:54 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:54.925+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:55:55.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:54 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:54.925+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:55:55.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:55 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:55.228+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:55.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:55 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:55.228+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:55.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:55 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:55.228+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:55.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:55 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:55.228+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:55:55.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:55 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:55.228+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:55:56.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:55 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:55.743+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:56.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:55 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:55.743+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:56.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:55 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:55.743+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:56.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:55 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:55.743+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:55:56.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:55 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:55.743+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:24.222726+0000 front 2024-09-21T03:55:24.222661+0000 (oldest deadline 2024-09-21T03:55:48.322430+0000) 2024-09-21T03:55:56.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:55 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:55.743+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.623624+0000 front 2024-09-21T03:55:33.623536+0000 (oldest deadline 2024-09-21T03:55:55.223802+0000) 2024-09-21T03:55:56.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:55 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:55.806+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:56.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:55 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:55.806+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:56.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:55 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:55.806+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.698492+0000 front 2024-09-21T03:55:15.698331+0000 (oldest deadline 2024-09-21T03:55:40.998210+0000) 2024-09-21T03:55:56.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:55 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:55.806+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:23.299257+0000 front 2024-09-21T03:55:23.299238+0000 (oldest deadline 2024-09-21T03:55:47.399204+0000) 2024-09-21T03:55:56.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:55 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:55.920+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:56.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:55 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:55.920+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:56.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:55 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:55.920+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:56.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:55 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:55.920+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:55:56.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:55 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:55.920+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:55:56.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:56 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:56.263+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:56.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:56 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:56.263+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:56.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:56 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:56.263+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:56.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:56 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:56.263+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:55:56.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:56 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:56.263+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:55:57.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:56 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:56.787+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:57.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:56 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:56.787+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:57.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:56 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:56.787+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:57.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:56 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:56.787+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:55:57.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:56 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:56.787+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:24.222726+0000 front 2024-09-21T03:55:24.222661+0000 (oldest deadline 2024-09-21T03:55:48.322430+0000) 2024-09-21T03:55:57.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:56 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:56.787+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.623624+0000 front 2024-09-21T03:55:33.623536+0000 (oldest deadline 2024-09-21T03:55:55.223802+0000) 2024-09-21T03:55:57.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:56 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:56.762+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:55:00.496253+0000 front 2024-09-21T03:55:00.496325+0000 (oldest deadline 2024-09-21T03:55:26.396145+0000) 2024-09-21T03:55:57.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:56 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:56.762+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:06.396418+0000 front 2024-09-21T03:55:06.396559+0000 (oldest deadline 2024-09-21T03:55:34.597199+0000) 2024-09-21T03:55:57.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:56 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:56.762+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:15.698492+0000 front 2024-09-21T03:55:15.698331+0000 (oldest deadline 2024-09-21T03:55:40.998210+0000) 2024-09-21T03:55:57.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:56 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:56.762+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:23.299257+0000 front 2024-09-21T03:55:23.299238+0000 (oldest deadline 2024-09-21T03:55:47.399204+0000) 2024-09-21T03:55:57.129 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:56 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8[51939]: 2024-09-21T03:55:56.762+0000 7fd5d0958640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:32.700184+0000 front 2024-09-21T03:55:32.700208+0000 (oldest deadline 2024-09-21T03:55:56.200313+0000) 2024-09-21T03:55:57.155 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:56 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:56.886+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:57.155 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:56 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:56.886+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:57.155 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:56 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:56.886+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:57.155 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:56 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:56.886+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:55:57.155 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:56 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:56.886+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:55:57.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:57 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:57.290+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:57.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:57 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:57.290+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:57.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:57 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:57.290+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:57.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:57 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:57.290+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:55:57.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:57 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:57.290+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:55:58.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:57 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:57.773+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:58.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:57 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:57.773+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:58.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:57 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:57.773+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:58.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:57 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:57.773+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:55:58.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:57 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:57.773+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:24.222726+0000 front 2024-09-21T03:55:24.222661+0000 (oldest deadline 2024-09-21T03:55:48.322430+0000) 2024-09-21T03:55:58.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:57 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:57.773+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.623624+0000 front 2024-09-21T03:55:33.623536+0000 (oldest deadline 2024-09-21T03:55:55.223802+0000) 2024-09-21T03:55:58.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:57 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:57.879+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:58.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:57 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:57.879+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:58.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:57 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:57.879+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:58.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:57 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:57.879+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:55:58.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:57 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:57.879+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:55:58.423 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:58 smithi174 podman[67373]: 2024-09-21 03:55:58.137167722 +0000 UTC m=+5.518923892 container died 6b4faf0fa399841db5ed7811de3cf145f5f61319b88aec13282b69993b0f759c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:55:58.423 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:58 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:58.267+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:58.424 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:58 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:58.267+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:58.424 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:58 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:58.267+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:58.424 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:58 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:58.267+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:55:58.424 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:58 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:58.267+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:55:58.691 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:58 smithi174 podman[67373]: 2024-09-21 03:55:58.519942064 +0000 UTC m=+5.901698234 container cleanup 6b4faf0fa399841db5ed7811de3cf145f5f61319b88aec13282b69993b0f759c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T03:55:58.691 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:58 smithi174 bash[67373]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8 2024-09-21T03:55:59.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:58 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:58.798+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:55:59.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:58 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:58.798+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:55:59.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:58 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:58.798+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:55:59.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:58 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:58.798+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:55:59.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:58 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:58.798+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:24.222726+0000 front 2024-09-21T03:55:24.222661+0000 (oldest deadline 2024-09-21T03:55:48.322430+0000) 2024-09-21T03:55:59.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:58 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:58.798+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.623624+0000 front 2024-09-21T03:55:33.623536+0000 (oldest deadline 2024-09-21T03:55:55.223802+0000) 2024-09-21T03:55:59.128 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:58 smithi174 podman[67389]: 2024-09-21 03:55:58.690080388 +0000 UTC m=+0.553869613 container remove 6b4faf0fa399841db5ed7811de3cf145f5f61319b88aec13282b69993b0f759c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T03:55:59.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:58 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:58.867+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:55:59.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:58 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:58.867+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:55:59.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:58 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:58.867+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:55:59.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:58 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:58.867+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:55:59.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:58 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:58.867+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:55:59.419 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:59 smithi174 podman[67477]: 2024-09-21 03:55:59.030184035 +0000 UTC m=+0.015839295 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:55:59.419 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:59 smithi174 podman[67477]: 2024-09-21 03:55:59.148996143 +0000 UTC m=+0.134651403 container create ba55a3630d7bb9636f5479b735677ae61a7fbb0bcabcfb809b933e415299f401 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T03:55:59.420 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:59 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:59.226+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:55:59.420 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:59 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:59.226+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:55:59.420 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:59 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:59.226+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:55:59.420 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:59 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:59.226+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:55:59.420 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:55:59 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:55:59.226+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:55:59.878 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:59 smithi174 podman[67477]: 2024-09-21 03:55:59.41812297 +0000 UTC m=+0.403778230 container init ba55a3630d7bb9636f5479b735677ae61a7fbb0bcabcfb809b933e415299f401 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T03:55:59.879 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:59 smithi174 podman[67477]: 2024-09-21 03:55:59.421525524 +0000 UTC m=+0.407180784 container start ba55a3630d7bb9636f5479b735677ae61a7fbb0bcabcfb809b933e415299f401 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T03:55:59.879 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:59 smithi174 podman[67477]: 2024-09-21 03:55:59.509651741 +0000 UTC m=+0.495307010 container attach ba55a3630d7bb9636f5479b735677ae61a7fbb0bcabcfb809b933e415299f401 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T03:55:59.879 INFO:journalctl@ceph.osd.8.smithi174.stdout:Sep 21 03:55:59 smithi174 podman[67477]: 2024-09-21 03:55:59.610043991 +0000 UTC m=+0.595699254 container died ba55a3630d7bb9636f5479b735677ae61a7fbb0bcabcfb809b933e415299f401 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T03:56:00.212 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T03:56:00.291 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:56:00.292 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T03:56:00.292 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T03:56:00.292 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.9 2024-09-21T03:56:00.318 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:59 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:59.830+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:56:00.318 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:59 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:59.830+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:56:00.318 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:59 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:59.830+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:56:00.319 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:59 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:59.830+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:56:00.319 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:59 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:59.830+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:24.222726+0000 front 2024-09-21T03:55:24.222661+0000 (oldest deadline 2024-09-21T03:55:48.322430+0000) 2024-09-21T03:56:00.319 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:55:59 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:55:59.830+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.623624+0000 front 2024-09-21T03:55:33.623536+0000 (oldest deadline 2024-09-21T03:55:55.223802+0000) 2024-09-21T03:56:00.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:59 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:59.905+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:56:00.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:59 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:59.905+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:56:00.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:59 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:59.905+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:56:00.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:59 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:59.905+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:56:00.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:59 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:59.905+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:56:00.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:55:59 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:55:59.905+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.579551+0000 front 2024-09-21T03:55:33.579374+0000 (oldest deadline 2024-09-21T03:55:58.879176+0000) 2024-09-21T03:56:00.465 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:00 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:00.239+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:00.465 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:00 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:00.239+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:00.465 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:00 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:00.239+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:00.465 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:00 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:00.239+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:00.465 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:00 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:00.239+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:00.581 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:00 smithi084 systemd[1]: Stopping Ceph osd.9 for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:56:01.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:00 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:00.578+0000 7f5a5bcbf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:56:01.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:00 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:00.578+0000 7f5a5bcbf640 -1 osd.9 92 *** Got signal Terminated *** 2024-09-21T03:56:01.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:00 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:00.578+0000 7f5a5bcbf640 -1 osd.9 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:56:01.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:00 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:00.805+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:56:01.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:00 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:00.805+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:56:01.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:00 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:00.805+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:56:01.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:00 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:00.805+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:56:01.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:00 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:00.805+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:24.222726+0000 front 2024-09-21T03:55:24.222661+0000 (oldest deadline 2024-09-21T03:55:48.322430+0000) 2024-09-21T03:56:01.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:00 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:00.805+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.623624+0000 front 2024-09-21T03:55:33.623536+0000 (oldest deadline 2024-09-21T03:55:55.223802+0000) 2024-09-21T03:56:01.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:00 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:00.896+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:56:01.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:00 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:00.896+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:56:01.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:00 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:00.896+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:56:01.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:00 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:00.896+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:56:01.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:00 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:00.896+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:56:01.152 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:00 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:00.896+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.579551+0000 front 2024-09-21T03:55:33.579374+0000 (oldest deadline 2024-09-21T03:55:58.879176+0000) 2024-09-21T03:56:01.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:01 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:01.210+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:01.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:01 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:01.210+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:01.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:01 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:01.210+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:01.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:01 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:01.210+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:01.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:01 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:01.210+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:02.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:01 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:01.778+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:56:02.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:01 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:01.778+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:56:02.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:01 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:01.778+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:56:02.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:01 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:01.778+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:56:02.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:01 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:01.778+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:24.222726+0000 front 2024-09-21T03:55:24.222661+0000 (oldest deadline 2024-09-21T03:55:48.322430+0000) 2024-09-21T03:56:02.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:01 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:01.778+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.623624+0000 front 2024-09-21T03:55:33.623536+0000 (oldest deadline 2024-09-21T03:55:55.223802+0000) 2024-09-21T03:56:02.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:01 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:01.888+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:56:02.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:01 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:01.888+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:56:02.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:01 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:01.888+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:56:02.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:01 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:01.888+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:56:02.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:01 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:01.888+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:56:02.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:01 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:01.888+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.579551+0000 front 2024-09-21T03:55:33.579374+0000 (oldest deadline 2024-09-21T03:55:58.879176+0000) 2024-09-21T03:56:02.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:02 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:02.203+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:02.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:02 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:02.203+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:02.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:02 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:02.203+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:02.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:02 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:02.203+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:02.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:02 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:02.203+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:03.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:02 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:02.878+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:56:03.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:02 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:02.878+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:56:03.152 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:02 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:02.878+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:56:03.152 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:02 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:02.878+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:56:03.152 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:02 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:02.878+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:56:03.152 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:02 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:02.878+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.579551+0000 front 2024-09-21T03:55:33.579374+0000 (oldest deadline 2024-09-21T03:55:58.879176+0000) 2024-09-21T03:56:03.318 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:02 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:02.828+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:56:03.319 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:02 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:02.828+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:56:03.319 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:02 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:02.828+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:56:03.319 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:02 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:02.828+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:56:03.319 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:02 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:02.828+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:24.222726+0000 front 2024-09-21T03:55:24.222661+0000 (oldest deadline 2024-09-21T03:55:48.322430+0000) 2024-09-21T03:56:03.319 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:02 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:02.828+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.623624+0000 front 2024-09-21T03:55:33.623536+0000 (oldest deadline 2024-09-21T03:55:55.223802+0000) 2024-09-21T03:56:03.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:03 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:03.213+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:03.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:03 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:03.213+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:03.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:03 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:03.213+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:03.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:03 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:03.213+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:03.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:03 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:03.213+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:04.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:03 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:03.834+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:56:04.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:03 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:03.834+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:56:04.152 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:03 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:03.834+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:56:04.152 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:03 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:03.834+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:56:04.152 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:03 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:03.834+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:56:04.152 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:03 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:03.834+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.579551+0000 front 2024-09-21T03:55:33.579374+0000 (oldest deadline 2024-09-21T03:55:58.879176+0000) 2024-09-21T03:56:04.318 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:03 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:03.844+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:56:04.319 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:03 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:03.844+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:56:04.319 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:03 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:03.844+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:56:04.319 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:03 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:03.844+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:56:04.319 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:03 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:03.844+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:24.222726+0000 front 2024-09-21T03:55:24.222661+0000 (oldest deadline 2024-09-21T03:55:48.322430+0000) 2024-09-21T03:56:04.319 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:03 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:03.844+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.623624+0000 front 2024-09-21T03:55:33.623536+0000 (oldest deadline 2024-09-21T03:55:55.223802+0000) 2024-09-21T03:56:04.319 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:03 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:03.844+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:36.324524+0000 front 2024-09-21T03:55:36.324567+0000 (oldest deadline 2024-09-21T03:56:03.325193+0000) 2024-09-21T03:56:04.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:04 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:04.198+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:04.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:04 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:04.198+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:04.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:04 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:04.198+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:04.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:04 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:04.198+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:04.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:04 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:04.198+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:04.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:04 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:04.198+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.302145+0000 front 2024-09-21T03:55:39.302271+0000 (oldest deadline 2024-09-21T03:56:04.002004+0000) 2024-09-21T03:56:05.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:04 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:04.805+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:50.015757+0000 front 2024-09-21T03:54:50.015739+0000 (oldest deadline 2024-09-21T03:55:14.116156+0000) 2024-09-21T03:56:05.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:04 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:04.805+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.718053+0000 front 2024-09-21T03:54:58.718039+0000 (oldest deadline 2024-09-21T03:55:23.417775+0000) 2024-09-21T03:56:05.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:04 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:04.805+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:09.119911+0000 front 2024-09-21T03:55:09.119815+0000 (oldest deadline 2024-09-21T03:55:33.819747+0000) 2024-09-21T03:56:05.068 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:04 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:04.805+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:14.920950+0000 front 2024-09-21T03:55:14.920970+0000 (oldest deadline 2024-09-21T03:55:43.721525+0000) 2024-09-21T03:56:05.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:04 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:04.805+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:24.222726+0000 front 2024-09-21T03:55:24.222661+0000 (oldest deadline 2024-09-21T03:55:48.322430+0000) 2024-09-21T03:56:05.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:04 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:04.805+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.623624+0000 front 2024-09-21T03:55:33.623536+0000 (oldest deadline 2024-09-21T03:55:55.223802+0000) 2024-09-21T03:56:05.069 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:04 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9[67324]: 2024-09-21T03:56:04.805+0000 7f5a542a2640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:36.324524+0000 front 2024-09-21T03:55:36.324567+0000 (oldest deadline 2024-09-21T03:56:03.325193+0000) 2024-09-21T03:56:05.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:04 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:04.824+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:56:05.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:04 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:04.824+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:56:05.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:04 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:04.824+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:56:05.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:04 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:04.824+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:56:05.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:04 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:04.824+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:56:05.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:04 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:04.824+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.579551+0000 front 2024-09-21T03:55:33.579374+0000 (oldest deadline 2024-09-21T03:55:58.879176+0000) 2024-09-21T03:56:05.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:05 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:05.151+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:05.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:05 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:05.151+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:05.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:05 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:05.151+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:05.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:05 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:05.151+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:05.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:05 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:05.151+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:05.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:05 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:05.151+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.302145+0000 front 2024-09-21T03:55:39.302271+0000 (oldest deadline 2024-09-21T03:56:04.002004+0000) 2024-09-21T03:56:06.053 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:05 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:05.794+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:56:06.053 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:05 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:05.794+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:56:06.053 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:05 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:05.794+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:56:06.053 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:05 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:05.794+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:56:06.053 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:05 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:05.794+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:56:06.053 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:05 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:05.794+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.579551+0000 front 2024-09-21T03:55:33.579374+0000 (oldest deadline 2024-09-21T03:55:58.879176+0000) 2024-09-21T03:56:06.053 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:05 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:05.794+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.980226+0000 front 2024-09-21T03:55:39.980263+0000 (oldest deadline 2024-09-21T03:56:05.280139+0000) 2024-09-21T03:56:06.189 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:05 smithi084 podman[107961]: 2024-09-21 03:56:05.883933725 +0000 UTC m=+5.395299337 container died ed595362d6fcd63fdb20662e5a2116ecc6114fc673206e43cdf24473cbf88630 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T03:56:06.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:06 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:06.106+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:06.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:06 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:06.106+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:06.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:06 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:06.106+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:06.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:06 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:06.106+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:06.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:06 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:06.106+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:06.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:06 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:06.106+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.302145+0000 front 2024-09-21T03:55:39.302271+0000 (oldest deadline 2024-09-21T03:56:04.002004+0000) 2024-09-21T03:56:06.569 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:06 smithi084 podman[107961]: 2024-09-21 03:56:06.353608831 +0000 UTC m=+5.864974489 container cleanup ed595362d6fcd63fdb20662e5a2116ecc6114fc673206e43cdf24473cbf88630 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T03:56:06.569 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:06 smithi084 bash[107961]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9 2024-09-21T03:56:06.905 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:06 smithi084 podman[107979]: 2024-09-21 03:56:06.600585518 +0000 UTC m=+0.714595527 container remove ed595362d6fcd63fdb20662e5a2116ecc6114fc673206e43cdf24473cbf88630 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T03:56:07.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:06 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:06.767+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:56:07.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:06 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:06.767+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:56:07.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:06 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:06.767+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:56:07.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:06 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:06.767+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:56:07.152 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:06 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:06.767+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:56:07.152 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:06 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:06.767+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.579551+0000 front 2024-09-21T03:55:33.579374+0000 (oldest deadline 2024-09-21T03:55:58.879176+0000) 2024-09-21T03:56:07.152 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:06 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:06.767+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.980226+0000 front 2024-09-21T03:55:39.980263+0000 (oldest deadline 2024-09-21T03:56:05.280139+0000) 2024-09-21T03:56:07.168 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:06 smithi084 podman[108065]: 2024-09-21 03:56:06.80670916 +0000 UTC m=+0.015745072 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:56:07.168 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:06 smithi084 podman[108065]: 2024-09-21 03:56:06.92242893 +0000 UTC m=+0.131464884 container create 65c7f30755afa5242f32d61babcab24079f43f03c995458e4a1c1b3953e111bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T03:56:07.168 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:07 smithi084 podman[108065]: 2024-09-21 03:56:07.166641263 +0000 UTC m=+0.375677182 container init 65c7f30755afa5242f32d61babcab24079f43f03c995458e4a1c1b3953e111bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T03:56:07.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:07 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:07.091+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:07.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:07 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:07.091+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:07.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:07 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:07.091+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:07.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:07 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:07.091+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:07.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:07 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:07.091+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:07.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:07 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:07.091+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.302145+0000 front 2024-09-21T03:55:39.302271+0000 (oldest deadline 2024-09-21T03:56:04.002004+0000) 2024-09-21T03:56:07.568 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:07 smithi084 podman[108065]: 2024-09-21 03:56:07.169931958 +0000 UTC m=+0.378967866 container start 65c7f30755afa5242f32d61babcab24079f43f03c995458e4a1c1b3953e111bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T03:56:07.569 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:07 smithi084 podman[108065]: 2024-09-21 03:56:07.249753476 +0000 UTC m=+0.458789399 container attach 65c7f30755afa5242f32d61babcab24079f43f03c995458e4a1c1b3953e111bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9-deactivate, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T03:56:07.569 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:07 smithi084 podman[108065]: 2024-09-21 03:56:07.354831459 +0000 UTC m=+0.563867381 container died 65c7f30755afa5242f32d61babcab24079f43f03c995458e4a1c1b3953e111bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:56:07.919 INFO:journalctl@ceph.osd.9.smithi084.stdout:Sep 21 03:56:07 smithi084 podman[108087]: 2024-09-21 03:56:07.903078382 +0000 UTC m=+0.542722504 container remove 65c7f30755afa5242f32d61babcab24079f43f03c995458e4a1c1b3953e111bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T03:56:07.925 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T03:56:08.003 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:56:08.003 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T03:56:08.003 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T03:56:08.003 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.10 2024-09-21T03:56:08.032 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:07 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:07.761+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:56:08.032 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:07 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:07.761+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:56:08.032 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:07 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:07.761+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:56:08.032 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:07 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:07.761+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:56:08.032 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:07 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:07.761+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:56:08.032 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:07 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:07.761+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.579551+0000 front 2024-09-21T03:55:33.579374+0000 (oldest deadline 2024-09-21T03:55:58.879176+0000) 2024-09-21T03:56:08.033 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:07 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:07.761+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.980226+0000 front 2024-09-21T03:55:39.980263+0000 (oldest deadline 2024-09-21T03:56:05.280139+0000) 2024-09-21T03:56:08.324 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:08 smithi172 systemd[1]: Stopping Ceph osd.10 for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:56:08.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:08 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:08.133+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:08.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:08 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:08.133+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:08.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:08 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:08.133+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:08.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:08 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:08.133+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:08.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:08 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:08.133+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:08.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:08 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:08.133+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.302145+0000 front 2024-09-21T03:55:39.302271+0000 (oldest deadline 2024-09-21T03:56:04.002004+0000) 2024-09-21T03:56:08.651 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:08 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:08.321+0000 7fe5cbbf0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:56:08.651 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:08 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:08.321+0000 7fe5cbbf0640 -1 osd.10 92 *** Got signal Terminated *** 2024-09-21T03:56:08.651 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:08 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:08.321+0000 7fe5cbbf0640 -1 osd.10 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:56:09.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:08 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:08.776+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:56:09.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:08 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:08.776+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:56:09.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:08 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:08.776+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:56:09.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:08 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:08.776+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:56:09.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:08 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:08.776+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:56:09.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:08 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:08.776+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.579551+0000 front 2024-09-21T03:55:33.579374+0000 (oldest deadline 2024-09-21T03:55:58.879176+0000) 2024-09-21T03:56:09.152 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:08 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:08.776+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.980226+0000 front 2024-09-21T03:55:39.980263+0000 (oldest deadline 2024-09-21T03:56:05.280139+0000) 2024-09-21T03:56:09.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:09 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:09.099+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:09.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:09 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:09.099+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:09.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:09 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:09.100+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:09.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:09 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:09.100+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:09.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:09 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:09.100+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:09.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:09 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:09.100+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.302145+0000 front 2024-09-21T03:55:39.302271+0000 (oldest deadline 2024-09-21T03:56:04.002004+0000) 2024-09-21T03:56:10.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:09 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:09.820+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:56:10.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:09 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:09.820+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:56:10.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:09 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:09.820+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:56:10.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:09 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:09.820+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:56:10.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:09 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:09.820+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:56:10.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:09 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:09.820+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.579551+0000 front 2024-09-21T03:55:33.579374+0000 (oldest deadline 2024-09-21T03:55:58.879176+0000) 2024-09-21T03:56:10.152 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:09 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:09.820+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.980226+0000 front 2024-09-21T03:55:39.980263+0000 (oldest deadline 2024-09-21T03:56:05.280139+0000) 2024-09-21T03:56:10.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:10 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:10.108+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:10.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:10 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:10.108+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:10.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:10 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:10.108+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:10.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:10 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:10.108+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:10.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:10 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:10.108+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:10.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:10 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:10.108+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.302145+0000 front 2024-09-21T03:55:39.302271+0000 (oldest deadline 2024-09-21T03:56:04.002004+0000) 2024-09-21T03:56:11.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:10 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:10.828+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:56:11.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:10 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:10.828+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:56:11.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:10 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:10.828+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:56:11.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:10 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:10.828+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:56:11.152 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:10 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:10.828+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:56:11.152 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:10 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:10.828+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.579551+0000 front 2024-09-21T03:55:33.579374+0000 (oldest deadline 2024-09-21T03:55:58.879176+0000) 2024-09-21T03:56:11.152 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:10 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:10.828+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.980226+0000 front 2024-09-21T03:55:39.980263+0000 (oldest deadline 2024-09-21T03:56:05.280139+0000) 2024-09-21T03:56:11.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:11 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:11.114+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:11.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:11 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:11.114+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:11.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:11 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:11.114+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:11.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:11 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:11.114+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:11.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:11 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:11.114+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:11.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:11 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:11.114+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.302145+0000 front 2024-09-21T03:55:39.302271+0000 (oldest deadline 2024-09-21T03:56:04.002004+0000) 2024-09-21T03:56:11.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:11 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:11.114+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-09-21T03:55:48.003466+0000 front 2024-09-21T03:55:48.003611+0000 (oldest deadline 2024-09-21T03:56:10.903351+0000) 2024-09-21T03:56:12.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:11 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:11.844+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:56:12.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:11 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:11.844+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:56:12.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:11 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:11.844+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:56:12.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:11 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:11.844+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:56:12.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:11 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:11.844+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:56:12.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:11 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:11.844+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.579551+0000 front 2024-09-21T03:55:33.579374+0000 (oldest deadline 2024-09-21T03:55:58.879176+0000) 2024-09-21T03:56:12.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:11 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:11.844+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.980226+0000 front 2024-09-21T03:55:39.980263+0000 (oldest deadline 2024-09-21T03:56:05.280139+0000) 2024-09-21T03:56:12.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:12 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:12.141+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:12.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:12 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:12.141+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:12.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:12 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:12.141+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:12.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:12 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:12.141+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:12.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:12 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:12.141+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:12.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:12 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:12.141+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.302145+0000 front 2024-09-21T03:55:39.302271+0000 (oldest deadline 2024-09-21T03:56:04.002004+0000) 2024-09-21T03:56:12.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:12 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:12.141+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-09-21T03:55:48.003466+0000 front 2024-09-21T03:55:48.003611+0000 (oldest deadline 2024-09-21T03:56:10.903351+0000) 2024-09-21T03:56:13.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:12 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:12.840+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:51.974463+0000 front 2024-09-21T03:54:51.974340+0000 (oldest deadline 2024-09-21T03:55:17.274486+0000) 2024-09-21T03:56:13.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:12 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:12.840+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:57.274784+0000 front 2024-09-21T03:54:57.274901+0000 (oldest deadline 2024-09-21T03:55:27.875342+0000) 2024-09-21T03:56:13.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:12 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:12.840+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:07.875805+0000 front 2024-09-21T03:55:07.875938+0000 (oldest deadline 2024-09-21T03:55:31.375868+0000) 2024-09-21T03:56:13.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:12 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:12.840+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6814 osd.3 since back 2024-09-21T03:55:17.276914+0000 front 2024-09-21T03:55:17.276960+0000 (oldest deadline 2024-09-21T03:55:39.576703+0000) 2024-09-21T03:56:13.151 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:12 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:12.840+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:22.477631+0000 front 2024-09-21T03:55:22.477685+0000 (oldest deadline 2024-09-21T03:55:48.278296+0000) 2024-09-21T03:56:13.152 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:12 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:12.840+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:33.579551+0000 front 2024-09-21T03:55:33.579374+0000 (oldest deadline 2024-09-21T03:55:58.879176+0000) 2024-09-21T03:56:13.152 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:12 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10[58524]: 2024-09-21T03:56:12.840+0000 7fe5c41d3640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.980226+0000 front 2024-09-21T03:55:39.980263+0000 (oldest deadline 2024-09-21T03:56:05.280139+0000) 2024-09-21T03:56:13.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:13 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:13.101+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:13.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:13 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:13.101+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:13.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:13 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:13.101+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:13.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:13 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:13.101+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:13.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:13 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:13.101+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:13.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:13 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:13.101+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.302145+0000 front 2024-09-21T03:55:39.302271+0000 (oldest deadline 2024-09-21T03:56:04.002004+0000) 2024-09-21T03:56:13.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:13 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:13.101+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-09-21T03:55:48.003466+0000 front 2024-09-21T03:55:48.003611+0000 (oldest deadline 2024-09-21T03:56:10.903351+0000) 2024-09-21T03:56:14.141 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:13 smithi172 podman[68462]: 2024-09-21 03:56:13.83345156 +0000 UTC m=+5.635239863 container died 2c9b809ad3ce9d4cbc93f2f675bf8e64218880e9f130e989e023033a828a598c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:56:14.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:14 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:14.108+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:14.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:14 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:14.108+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:14.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:14 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:14.108+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:14.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:14 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:14.108+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:14.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:14 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:14.108+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:14.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:14 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:14.108+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.302145+0000 front 2024-09-21T03:55:39.302271+0000 (oldest deadline 2024-09-21T03:56:04.002004+0000) 2024-09-21T03:56:14.379 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:14 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:14.108+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-09-21T03:55:48.003466+0000 front 2024-09-21T03:55:48.003611+0000 (oldest deadline 2024-09-21T03:56:10.903351+0000) 2024-09-21T03:56:14.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:14 smithi172 podman[68462]: 2024-09-21 03:56:14.22119051 +0000 UTC m=+6.022978805 container cleanup 2c9b809ad3ce9d4cbc93f2f675bf8e64218880e9f130e989e023033a828a598c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T03:56:14.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:14 smithi172 bash[68462]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10 2024-09-21T03:56:14.766 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:14 smithi172 podman[68477]: 2024-09-21 03:56:14.430532598 +0000 UTC m=+0.589813565 container remove 2c9b809ad3ce9d4cbc93f2f675bf8e64218880e9f130e989e023033a828a598c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:56:15.085 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:14 smithi172 podman[68566]: 2024-09-21 03:56:14.764596123 +0000 UTC m=+0.110135363 container create 4abb9798d4b6217197d3434e2b2ab5b72bd217206f3d5fd5b4d2d93d01f1c03c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T03:56:15.085 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:14 smithi172 podman[68566]: 2024-09-21 03:56:14.670841212 +0000 UTC m=+0.016380465 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:56:15.085 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:15 smithi172 podman[68566]: 2024-09-21 03:56:15.000282331 +0000 UTC m=+0.345821572 container init 4abb9798d4b6217197d3434e2b2ab5b72bd217206f3d5fd5b4d2d93d01f1c03c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T03:56:15.085 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:15 smithi172 podman[68566]: 2024-09-21 03:56:15.003517044 +0000 UTC m=+0.349056286 container start 4abb9798d4b6217197d3434e2b2ab5b72bd217206f3d5fd5b4d2d93d01f1c03c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:56:15.085 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:15 smithi172 podman[68566]: 2024-09-21 03:56:15.083586796 +0000 UTC m=+0.429126052 container attach 4abb9798d4b6217197d3434e2b2ab5b72bd217206f3d5fd5b4d2d93d01f1c03c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T03:56:15.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:Sep 21 03:56:15 smithi172 podman[68566]: 2024-09-21 03:56:15.190711864 +0000 UTC m=+0.536251107 container died 4abb9798d4b6217197d3434e2b2ab5b72bd217206f3d5fd5b4d2d93d01f1c03c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:56:15.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:15 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:15.144+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:15.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:15 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:15.144+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:15.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:15 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:15.144+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:15.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:15 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:15.144+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:15.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:15 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:15.144+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:15.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:15 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:15.144+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.302145+0000 front 2024-09-21T03:55:39.302271+0000 (oldest deadline 2024-09-21T03:56:04.002004+0000) 2024-09-21T03:56:15.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:15 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:15.144+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-09-21T03:55:48.003466+0000 front 2024-09-21T03:55:48.003611+0000 (oldest deadline 2024-09-21T03:56:10.903351+0000) 2024-09-21T03:56:15.785 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T03:56:15.863 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:56:15.864 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T03:56:15.864 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T03:56:15.864 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.11 2024-09-21T03:56:16.158 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:15 smithi174 systemd[1]: Stopping Ceph osd.11 for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:56:16.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:16 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:16.156+0000 7f1d28f36640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:56:16.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:16 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:16.156+0000 7f1d28f36640 -1 osd.11 92 *** Got signal Terminated *** 2024-09-21T03:56:16.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:16 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:16.156+0000 7f1d28f36640 -1 osd.11 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:56:16.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:16 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:16.160+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:16.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:16 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:16.160+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:16.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:16 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:16.160+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:16.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:16 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:16.160+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:16.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:16 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:16.160+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:16.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:16 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:16.160+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.302145+0000 front 2024-09-21T03:55:39.302271+0000 (oldest deadline 2024-09-21T03:56:04.002004+0000) 2024-09-21T03:56:16.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:16 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:16.160+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-09-21T03:55:48.003466+0000 front 2024-09-21T03:55:48.003611+0000 (oldest deadline 2024-09-21T03:56:10.903351+0000) 2024-09-21T03:56:17.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:17 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:17.139+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:17.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:17 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:17.139+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:17.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:17 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:17.139+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:17.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:17 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:17.139+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:17.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:17 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:17.139+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:17.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:17 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:17.139+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.302145+0000 front 2024-09-21T03:55:39.302271+0000 (oldest deadline 2024-09-21T03:56:04.002004+0000) 2024-09-21T03:56:17.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:17 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:17.139+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-09-21T03:55:48.003466+0000 front 2024-09-21T03:55:48.003611+0000 (oldest deadline 2024-09-21T03:56:10.903351+0000) 2024-09-21T03:56:18.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:18 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:18.185+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:18.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:18 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:18.185+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:18.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:18 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:18.185+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:18.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:18 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:18.185+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:18.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:18 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:18.185+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:18.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:18 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:18.185+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.302145+0000 front 2024-09-21T03:55:39.302271+0000 (oldest deadline 2024-09-21T03:56:04.002004+0000) 2024-09-21T03:56:18.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:18 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:18.185+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-09-21T03:55:48.003466+0000 front 2024-09-21T03:55:48.003611+0000 (oldest deadline 2024-09-21T03:56:10.903351+0000) 2024-09-21T03:56:19.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:19 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:19.172+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:19.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:19 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:19.172+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:19.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:19 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:19.172+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:19.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:19 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:19.172+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:19.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:19 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:19.172+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:19.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:19 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:19.172+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.302145+0000 front 2024-09-21T03:55:39.302271+0000 (oldest deadline 2024-09-21T03:56:04.002004+0000) 2024-09-21T03:56:19.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:19 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:19.172+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-09-21T03:55:48.003466+0000 front 2024-09-21T03:55:48.003611+0000 (oldest deadline 2024-09-21T03:56:10.903351+0000) 2024-09-21T03:56:19.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:19 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:19.172+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6820 osd.8 since back 2024-09-21T03:55:56.104419+0000 front 2024-09-21T03:55:56.104461+0000 (oldest deadline 2024-09-21T03:56:18.905019+0000) 2024-09-21T03:56:20.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:20 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:20.207+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6806 osd.0 since back 2024-09-21T03:54:52.495565+0000 front 2024-09-21T03:54:52.495609+0000 (oldest deadline 2024-09-21T03:55:16.595591+0000) 2024-09-21T03:56:20.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:20 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:20.207+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-09-21T03:54:58.896716+0000 front 2024-09-21T03:54:58.896751+0000 (oldest deadline 2024-09-21T03:55:22.396776+0000) 2024-09-21T03:56:20.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:20 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:20.207+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6804 osd.2 since back 2024-09-21T03:55:04.097630+0000 front 2024-09-21T03:55:04.097785+0000 (oldest deadline 2024-09-21T03:55:34.698366+0000) 2024-09-21T03:56:20.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:20 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:20.207+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-09-21T03:55:21.699741+0000 front 2024-09-21T03:55:21.699788+0000 (oldest deadline 2024-09-21T03:55:46.399874+0000) 2024-09-21T03:56:20.628 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:20 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:20.207+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6812 osd.5 since back 2024-09-21T03:55:28.700967+0000 front 2024-09-21T03:55:28.700919+0000 (oldest deadline 2024-09-21T03:55:54.601101+0000) 2024-09-21T03:56:20.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:20 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:20.207+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.84:6822 osd.6 since back 2024-09-21T03:55:39.302145+0000 front 2024-09-21T03:55:39.302271+0000 (oldest deadline 2024-09-21T03:56:04.002004+0000) 2024-09-21T03:56:20.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:20 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:20.207+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-09-21T03:55:48.003466+0000 front 2024-09-21T03:55:48.003611+0000 (oldest deadline 2024-09-21T03:56:10.903351+0000) 2024-09-21T03:56:20.629 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:20 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11[58169]: 2024-09-21T03:56:20.207+0000 7f1d21519640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.174:6820 osd.8 since back 2024-09-21T03:55:56.104419+0000 front 2024-09-21T03:55:56.104461+0000 (oldest deadline 2024-09-21T03:56:18.905019+0000) 2024-09-21T03:56:21.742 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:21 smithi174 podman[67592]: 2024-09-21 03:56:21.484263769 +0000 UTC m=+5.425146667 container died 13bc406ba9e30ad37e02bccd41dbc420e898e29cf72f99590e3dec4715a3542b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T03:56:22.033 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:21 smithi174 podman[67592]: 2024-09-21 03:56:21.822609059 +0000 UTC m=+5.763491998 container cleanup 13bc406ba9e30ad37e02bccd41dbc420e898e29cf72f99590e3dec4715a3542b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-21T03:56:22.034 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:21 smithi174 bash[67592]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11 2024-09-21T03:56:22.378 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:22 smithi174 podman[67607]: 2024-09-21 03:56:22.031891267 +0000 UTC m=+0.545214254 container remove 13bc406ba9e30ad37e02bccd41dbc420e898e29cf72f99590e3dec4715a3542b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T03:56:22.719 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:22 smithi174 podman[67695]: 2024-09-21 03:56:22.329357968 +0000 UTC m=+0.015589649 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:56:22.719 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:22 smithi174 podman[67695]: 2024-09-21 03:56:22.432585062 +0000 UTC m=+0.118816730 container create 93b5048055dd13b0e25d90323cf6b3656b6217b82a046c05bee3f3464b46f836 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T03:56:22.720 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:22 smithi174 podman[67695]: 2024-09-21 03:56:22.643282562 +0000 UTC m=+0.329514230 container init 93b5048055dd13b0e25d90323cf6b3656b6217b82a046c05bee3f3464b46f836 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:56:22.720 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:22 smithi174 podman[67695]: 2024-09-21 03:56:22.646656904 +0000 UTC m=+0.332888582 container start 93b5048055dd13b0e25d90323cf6b3656b6217b82a046c05bee3f3464b46f836 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T03:56:22.720 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:22 smithi174 podman[67695]: 2024-09-21 03:56:22.718244902 +0000 UTC m=+0.404476579 container attach 93b5048055dd13b0e25d90323cf6b3656b6217b82a046c05bee3f3464b46f836 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T03:56:23.128 INFO:journalctl@ceph.osd.11.smithi174.stdout:Sep 21 03:56:22 smithi174 podman[67695]: 2024-09-21 03:56:22.83218341 +0000 UTC m=+0.518415091 container died 93b5048055dd13b0e25d90323cf6b3656b6217b82a046c05bee3f3464b46f836 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-osd-11-deactivate, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:56:23.416 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T03:56:23.453 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:56:23.453 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T03:56:23.453 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T03:56:23.453 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.a 2024-09-21T03:56:23.818 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 03:56:23 smithi084 systemd[1]: Stopping Ceph mds.a for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:56:24.319 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 03:56:23 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-a[73907]: 2024-09-21T03:56:23.861+0000 7f3b583b8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:56:24.319 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 03:56:23 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-a[73907]: 2024-09-21T03:56:23.861+0000 7f3b583b8640 -1 mds.a *** got signal Terminated *** 2024-09-21T03:56:25.318 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 03:56:25 smithi084 podman[108168]: 2024-09-21 03:56:25.064772619 +0000 UTC m=+1.423018836 container died 4f26f85aa857e598c86cfa815279ff1ab9ffad1256dbec0354fbfa3410008dcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-a, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T03:56:25.697 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 03:56:25 smithi084 podman[108168]: 2024-09-21 03:56:25.435885471 +0000 UTC m=+1.794131688 container cleanup 4f26f85aa857e598c86cfa815279ff1ab9ffad1256dbec0354fbfa3410008dcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T03:56:25.697 INFO:journalctl@ceph.mds.a.smithi084.stdout:Sep 21 03:56:25 smithi084 bash[108168]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-a 2024-09-21T03:56:25.867 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T03:56:25.902 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:56:25.902 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T03:56:25.902 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T03:56:25.903 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.d 2024-09-21T03:56:26.226 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 03:56:25 smithi084 systemd[1]: Stopping Ceph mds.d for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:56:26.568 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 03:56:26 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-d[72787]: 2024-09-21T03:56:26.223+0000 7fb681728640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:56:26.569 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 03:56:26 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-d[72787]: 2024-09-21T03:56:26.223+0000 7fb681728640 -1 mds.d *** got signal Terminated *** 2024-09-21T03:56:30.292 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 03:56:29 smithi084 podman[108300]: 2024-09-21 03:56:29.922183673 +0000 UTC m=+3.807681906 container died 92de886e57eced452f206274d1e8195e9548417b1bc779b4d34f3998de995c37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-d, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:56:30.542 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 03:56:30 smithi084 podman[108300]: 2024-09-21 03:56:30.364759899 +0000 UTC m=+4.250258130 container cleanup 92de886e57eced452f206274d1e8195e9548417b1bc779b4d34f3998de995c37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-d, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T03:56:30.542 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 03:56:30 smithi084 bash[108300]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-d 2024-09-21T03:56:30.781 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T03:56:30.803 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 03:56:30 smithi084 podman[108312]: 2024-09-21 03:56:30.541100476 +0000 UTC m=+0.615469116 container remove 92de886e57eced452f206274d1e8195e9548417b1bc779b4d34f3998de995c37 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-d, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T03:56:30.803 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 03:56:30 smithi084 systemd[1]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.d.service: Deactivated successfully. 2024-09-21T03:56:30.803 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 03:56:30 smithi084 systemd[1]: Stopped Ceph mds.d for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:56:30.803 INFO:journalctl@ceph.mds.d.smithi084.stdout:Sep 21 03:56:30 smithi084 systemd[1]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.d.service: Consumed 1.084s CPU time. 2024-09-21T03:56:30.815 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:56:30.815 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T03:56:30.815 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T03:56:30.815 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.g 2024-09-21T03:56:31.070 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 03:56:30 smithi084 systemd[1]: Stopping Ceph mds.g for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:56:31.568 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 03:56:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-g[73561]: 2024-09-21T03:56:31.151+0000 7fab8c7e3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:56:31.568 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 03:56:31 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-g[73561]: 2024-09-21T03:56:31.151+0000 7fab8c7e3640 -1 mds.g *** got signal Terminated *** 2024-09-21T03:56:33.886 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 03:56:33 smithi084 podman[108422]: 2024-09-21 03:56:33.598517486 +0000 UTC m=+2.564308125 container died 4583dc2e82bd1ed5808eff8c86d0e4cfb8d3be857509b375e06dadd4d35a5071 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T03:56:34.220 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 03:56:33 smithi084 podman[108422]: 2024-09-21 03:56:33.984906884 +0000 UTC m=+2.950697511 container cleanup 4583dc2e82bd1ed5808eff8c86d0e4cfb8d3be857509b375e06dadd4d35a5071 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-g, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:56:34.220 INFO:journalctl@ceph.mds.g.smithi084.stdout:Sep 21 03:56:33 smithi084 bash[108422]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-g 2024-09-21T03:56:34.352 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T03:56:34.383 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:56:34.384 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T03:56:34.384 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T03:56:34.384 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.j 2024-09-21T03:56:34.568 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 03:56:34 smithi084 systemd[1]: Stopping Ceph mds.j for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:56:35.046 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 03:56:34 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-j[72401]: 2024-09-21T03:56:34.679+0000 7f5a8ec93640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:56:35.047 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 03:56:34 smithi084 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-j[72401]: 2024-09-21T03:56:34.679+0000 7f5a8ec93640 -1 mds.j *** got signal Terminated *** 2024-09-21T03:56:38.440 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 03:56:38 smithi084 podman[108542]: 2024-09-21 03:56:38.148047814 +0000 UTC m=+3.549312351 container died 933e7baa77b26ee8c9912457923ff0f3e1cf19543345ddb5beb60a84d8e3eb85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-j, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T03:56:38.818 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 03:56:38 smithi084 podman[108542]: 2024-09-21 03:56:38.613598111 +0000 UTC m=+4.014862640 container cleanup 933e7baa77b26ee8c9912457923ff0f3e1cf19543345ddb5beb60a84d8e3eb85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-j, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T03:56:38.819 INFO:journalctl@ceph.mds.j.smithi084.stdout:Sep 21 03:56:38 smithi084 bash[108542]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-j 2024-09-21T03:56:39.040 DEBUG:teuthology.orchestra.run.smithi084:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T03:56:39.071 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:56:39.071 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T03:56:39.071 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T03:56:39.071 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.b 2024-09-21T03:56:39.401 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:56:39 smithi172 systemd[1]: Stopping Ceph mds.b for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:56:39.658 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:56:39 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-b[63541]: 2024-09-21T03:56:39.411+0000 7f75efd24640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:56:39.659 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:56:39 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-b[63541]: 2024-09-21T03:56:39.411+0000 7f75efd24640 -1 mds.b *** got signal Terminated *** 2024-09-21T03:56:42.047 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:56:41 smithi172 podman[68668]: 2024-09-21 03:56:41.707911296 +0000 UTC m=+2.435501760 container stop da1787d847c2b86071092ddf0a2939173207350840ba2341eec3195318a62f78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-b, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T03:56:42.047 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:56:41 smithi172 podman[68668]: 2024-09-21 03:56:41.733573509 +0000 UTC m=+2.461163989 container died da1787d847c2b86071092ddf0a2939173207350840ba2341eec3195318a62f78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-b, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T03:56:42.298 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:56:42 smithi172 podman[68668]: 2024-09-21 03:56:42.128921371 +0000 UTC m=+2.856511832 container cleanup da1787d847c2b86071092ddf0a2939173207350840ba2341eec3195318a62f78 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T03:56:42.298 INFO:journalctl@ceph.mds.b.smithi172.stdout:Sep 21 03:56:42 smithi172 bash[68668]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-b 2024-09-21T03:56:42.505 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T03:56:42.540 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:56:42.540 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T03:56:42.541 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T03:56:42.541 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.e 2024-09-21T03:56:42.867 INFO:journalctl@ceph.mds.e.smithi172.stdout:Sep 21 03:56:42 smithi172 systemd[1]: Stopping Ceph mds.e for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:56:43.151 INFO:journalctl@ceph.mds.e.smithi172.stdout:Sep 21 03:56:42 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-e[63003]: 2024-09-21T03:56:42.865+0000 7fed2eb49640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:56:43.151 INFO:journalctl@ceph.mds.e.smithi172.stdout:Sep 21 03:56:42 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-e[63003]: 2024-09-21T03:56:42.865+0000 7fed2eb49640 -1 mds.e *** got signal Terminated *** 2024-09-21T03:56:46.084 INFO:journalctl@ceph.mds.e.smithi172.stdout:Sep 21 03:56:45 smithi172 podman[68802]: 2024-09-21 03:56:45.716055693 +0000 UTC m=+2.955100171 container died 7e79712f0bce08b7e470bf50aa28728221b7d47b5bb4f51f330ab0c04a2101c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-e, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T03:56:46.343 INFO:journalctl@ceph.mds.e.smithi172.stdout:Sep 21 03:56:46 smithi172 podman[68802]: 2024-09-21 03:56:46.165410261 +0000 UTC m=+3.404454747 container cleanup 7e79712f0bce08b7e470bf50aa28728221b7d47b5bb4f51f330ab0c04a2101c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-e, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T03:56:46.343 INFO:journalctl@ceph.mds.e.smithi172.stdout:Sep 21 03:56:46 smithi172 bash[68802]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-e 2024-09-21T03:56:46.588 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T03:56:46.609 INFO:journalctl@ceph.mds.e.smithi172.stdout:Sep 21 03:56:46 smithi172 podman[68814]: 2024-09-21 03:56:46.341511779 +0000 UTC m=+0.618715605 container remove 7e79712f0bce08b7e470bf50aa28728221b7d47b5bb4f51f330ab0c04a2101c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:56:46.609 INFO:journalctl@ceph.mds.e.smithi172.stdout:Sep 21 03:56:46 smithi172 systemd[1]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.e.service: Deactivated successfully. 2024-09-21T03:56:46.609 INFO:journalctl@ceph.mds.e.smithi172.stdout:Sep 21 03:56:46 smithi172 systemd[1]: Stopped Ceph mds.e for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:56:46.610 INFO:journalctl@ceph.mds.e.smithi172.stdout:Sep 21 03:56:46 smithi172 systemd[1]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.e.service: Consumed 3.222s CPU time. 2024-09-21T03:56:46.622 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:56:46.622 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T03:56:46.622 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T03:56:46.622 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.h 2024-09-21T03:56:46.901 INFO:journalctl@ceph.mds.h.smithi172.stdout:Sep 21 03:56:46 smithi172 systemd[1]: Stopping Ceph mds.h for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:56:47.401 INFO:journalctl@ceph.mds.h.smithi172.stdout:Sep 21 03:56:46 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-h[63275]: 2024-09-21T03:56:46.951+0000 7f46b6ae0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:56:47.401 INFO:journalctl@ceph.mds.h.smithi172.stdout:Sep 21 03:56:46 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-h[63275]: 2024-09-21T03:56:46.951+0000 7f46b6ae0640 -1 mds.h *** got signal Terminated *** 2024-09-21T03:56:49.996 INFO:journalctl@ceph.mds.h.smithi172.stdout:Sep 21 03:56:49 smithi172 podman[68927]: 2024-09-21 03:56:49.719002677 +0000 UTC m=+2.878875247 container died 8508fbba1072002e9e668363f1887ee160cdf500b829e39a33948c7541bcbf29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-h, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T03:56:50.380 INFO:journalctl@ceph.mds.h.smithi172.stdout:Sep 21 03:56:50 smithi172 podman[68927]: 2024-09-21 03:56:50.104636888 +0000 UTC m=+3.264509459 container cleanup 8508fbba1072002e9e668363f1887ee160cdf500b829e39a33948c7541bcbf29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-h, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T03:56:50.380 INFO:journalctl@ceph.mds.h.smithi172.stdout:Sep 21 03:56:50 smithi172 bash[68927]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-h 2024-09-21T03:56:50.534 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T03:56:50.566 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:56:50.567 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T03:56:50.567 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T03:56:50.567 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.k 2024-09-21T03:56:50.901 INFO:journalctl@ceph.mds.k.smithi172.stdout:Sep 21 03:56:50 smithi172 systemd[1]: Stopping Ceph mds.k for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:56:50.901 INFO:journalctl@ceph.mds.k.smithi172.stdout:Sep 21 03:56:50 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-k[62720]: 2024-09-21T03:56:50.889+0000 7f7a61abe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:56:50.901 INFO:journalctl@ceph.mds.k.smithi172.stdout:Sep 21 03:56:50 smithi172 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-k[62720]: 2024-09-21T03:56:50.889+0000 7f7a61abe640 -1 mds.k *** got signal Terminated *** 2024-09-21T03:56:55.151 INFO:journalctl@ceph.mds.k.smithi172.stdout:Sep 21 03:56:54 smithi172 podman[69047]: 2024-09-21 03:56:54.891153069 +0000 UTC m=+4.106874829 container died 819ba9e6e9347b8ef3219e7fafc5683108e83ca03acab0cdba4d12cc85e180f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-k, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T03:56:55.634 INFO:journalctl@ceph.mds.k.smithi172.stdout:Sep 21 03:56:55 smithi172 podman[69047]: 2024-09-21 03:56:55.230881221 +0000 UTC m=+4.446602965 container cleanup 819ba9e6e9347b8ef3219e7fafc5683108e83ca03acab0cdba4d12cc85e180f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-k, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:56:57.305 INFO:journalctl@ceph.mds.k.smithi172.stdout:Sep 21 03:56:55 smithi172 bash[69047]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-k 2024-09-21T03:56:57.306 INFO:journalctl@ceph.mds.k.smithi172.stdout:Sep 21 03:56:55 smithi172 podman[69059]: 2024-09-21 03:56:55.398370205 +0000 UTC m=+0.507082376 container remove 819ba9e6e9347b8ef3219e7fafc5683108e83ca03acab0cdba4d12cc85e180f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-k, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T03:56:57.308 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T03:56:57.308 INFO:journalctl@ceph.mds.k.smithi172.stdout:Sep 21 03:56:55 smithi172 systemd[1]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.k.service: Deactivated successfully. 2024-09-21T03:56:57.308 INFO:journalctl@ceph.mds.k.smithi172.stdout:Sep 21 03:56:55 smithi172 systemd[1]: Stopped Ceph mds.k for e3f8c18e-77c9-11ef-baf5-efdc52797490. 2024-09-21T03:56:57.308 INFO:journalctl@ceph.mds.k.smithi172.stdout:Sep 21 03:56:55 smithi172 systemd[1]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.k.service: Consumed 1.126s CPU time. 2024-09-21T03:56:57.348 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:56:57.353 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T03:56:57.373 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T03:56:57.381 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.c 2024-09-21T03:56:57.689 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 03:56:57 smithi174 systemd[1]: Stopping Ceph mds.c for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:56:57.943 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 03:56:57 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-c[63025]: 2024-09-21T03:56:57.686+0000 7f355a99b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:56:57.943 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 03:56:57 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-c[63025]: 2024-09-21T03:56:57.686+0000 7f355a99b640 -1 mds.c *** got signal Terminated *** 2024-09-21T03:57:02.064 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 03:57:01 smithi174 podman[67798]: 2024-09-21 03:57:01.702219638 +0000 UTC m=+4.116647475 container died 35e798ffbeb4481b69d33b22c5ed9e573fff28f9c6f2b3956890313d539e0c33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T03:57:02.378 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 03:57:02 smithi174 podman[67798]: 2024-09-21 03:57:02.152911159 +0000 UTC m=+4.567338997 container cleanup 35e798ffbeb4481b69d33b22c5ed9e573fff28f9c6f2b3956890313d539e0c33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-c, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:57:02.378 INFO:journalctl@ceph.mds.c.smithi174.stdout:Sep 21 03:57:02 smithi174 bash[67798]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-c 2024-09-21T03:57:02.546 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T03:57:02.583 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:57:02.583 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T03:57:02.583 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T03:57:02.583 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.f 2024-09-21T03:57:03.128 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 03:57:02 smithi174 systemd[1]: Stopping Ceph mds.f for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:57:03.128 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 03:57:02 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-f[62754]: 2024-09-21T03:57:02.905+0000 7fbbfc34c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:57:03.128 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 03:57:02 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-f[62754]: 2024-09-21T03:57:02.905+0000 7fbbfc34c640 -1 mds.f *** got signal Terminated *** 2024-09-21T03:57:06.067 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 03:57:05 smithi174 podman[67932]: 2024-09-21 03:57:05.724050365 +0000 UTC m=+2.925501415 container died 5dac4b014c19473ff3001ca0277ccacbcc2dd1b789e7ef67600568fa589b5039 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-f, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:57:06.350 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 03:57:06 smithi174 podman[67932]: 2024-09-21 03:57:06.139764331 +0000 UTC m=+3.341215371 container cleanup 5dac4b014c19473ff3001ca0277ccacbcc2dd1b789e7ef67600568fa589b5039 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-f, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T03:57:06.350 INFO:journalctl@ceph.mds.f.smithi174.stdout:Sep 21 03:57:06 smithi174 bash[67932]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-f 2024-09-21T03:57:06.573 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T03:57:06.606 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:57:06.606 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T03:57:06.607 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T03:57:06.607 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.i 2024-09-21T03:57:06.878 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 03:57:06 smithi174 systemd[1]: Stopping Ceph mds.i for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:57:07.378 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 03:57:06 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-i[63294]: 2024-09-21T03:57:06.925+0000 7fc1dfd58640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:57:07.378 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 03:57:06 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-i[63294]: 2024-09-21T03:57:06.925+0000 7fc1dfd58640 -1 mds.i *** got signal Terminated *** 2024-09-21T03:57:10.020 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 03:57:09 smithi174 podman[68058]: 2024-09-21 03:57:09.729918008 +0000 UTC m=+2.899751853 container died ca5ebcfead0d99ecd094603c289892359bf1e70d6fb169353f83c066fb469696 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-i, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T03:57:10.362 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 03:57:10 smithi174 podman[68058]: 2024-09-21 03:57:10.109585619 +0000 UTC m=+3.279419512 container cleanup ca5ebcfead0d99ecd094603c289892359bf1e70d6fb169353f83c066fb469696 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T03:57:10.362 INFO:journalctl@ceph.mds.i.smithi174.stdout:Sep 21 03:57:10 smithi174 bash[68058]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-i 2024-09-21T03:57:10.492 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T03:57:10.525 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:57:10.525 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T03:57:10.526 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T03:57:10.526 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.l 2024-09-21T03:57:10.628 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 03:57:10 smithi174 systemd[1]: Stopping Ceph mds.l for e3f8c18e-77c9-11ef-baf5-efdc52797490... 2024-09-21T03:57:11.128 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 03:57:10 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-l[62473]: 2024-09-21T03:57:10.844+0000 7f7615b47640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:57:11.128 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 03:57:10 smithi174 ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-l[62473]: 2024-09-21T03:57:10.844+0000 7f7615b47640 -1 mds.l *** got signal Terminated *** 2024-09-21T03:57:12.628 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 03:57:12 smithi174 podman[68178]: 2024-09-21 03:57:12.372097967 +0000 UTC m=+1.626013672 container died dc699578d1c82ba63c76eca5a294a297c16fea37e3963880742709c861aad541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-l, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T03:57:13.063 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 03:57:12 smithi174 podman[68178]: 2024-09-21 03:57:12.712851286 +0000 UTC m=+1.966767003 container cleanup dc699578d1c82ba63c76eca5a294a297c16fea37e3963880742709c861aad541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-l, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T03:57:13.063 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 03:57:12 smithi174 bash[68178]: ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-l 2024-09-21T03:57:13.063 INFO:journalctl@ceph.mds.l.smithi174.stdout:Sep 21 03:57:12 smithi174 podman[68190]: 2024-09-21 03:57:12.872014901 +0000 UTC m=+0.497775405 container remove dc699578d1c82ba63c76eca5a294a297c16fea37e3963880742709c861aad541 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490-mds-l, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T03:57:13.076 DEBUG:teuthology.orchestra.run.smithi174:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e3f8c18e-77c9-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T03:57:13.107 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:57:13.108 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T03:57:13.108 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T03:57:13.310 INFO:teuthology.orchestra.run.smithi084.stdout:Deleting cluster with fsid: e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:57:15.801 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T03:57:16.007 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:57:18.577 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T03:57:18.780 INFO:teuthology.orchestra.run.smithi174.stdout:Deleting cluster with fsid: e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:57:21.142 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:57:21.175 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:57:21.208 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:57:21.235 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T03:57:21.236 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913468/remote/smithi084/crash 2024-09-21T03:57:21.237 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/crash -- . 2024-09-21T03:57:21.278 INFO:teuthology.orchestra.run.smithi084.stderr:tar: /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T03:57:21.278 INFO:teuthology.orchestra.run.smithi084.stderr:tar: Error is not recoverable: exiting now 2024-09-21T03:57:21.280 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913468/remote/smithi172/crash 2024-09-21T03:57:21.281 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/crash -- . 2024-09-21T03:57:21.318 INFO:teuthology.orchestra.run.smithi172.stderr:tar: /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T03:57:21.318 INFO:teuthology.orchestra.run.smithi172.stderr:tar: Error is not recoverable: exiting now 2024-09-21T03:57:21.320 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913468/remote/smithi174/crash 2024-09-21T03:57:21.321 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/crash -- . 2024-09-21T03:57:21.359 INFO:teuthology.orchestra.run.smithi174.stderr:tar: /var/lib/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T03:57:21.360 INFO:teuthology.orchestra.run.smithi174.stderr:tar: Error is not recoverable: exiting now 2024-09-21T03:57:21.361 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T03:57:21.361 DEBUG:teuthology.orchestra.run.smithi084:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-21T03:57:21.398 INFO:tasks.cephadm:Compressing logs... 2024-09-21T03:57:21.398 DEBUG:teuthology.orchestra.run.smithi084:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T03:57:21.441 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T03:57:21.443 DEBUG:teuthology.orchestra.run.smithi174:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T03:57:21.466 INFO:teuthology.orchestra.run.smithi084.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T03:57:21.466 INFO:teuthology.orchestra.run.smithi084.stderr:: No such file or directory 2024-09-21T03:57:21.466 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T03:57:21.466 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T03:57:21.466 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T03:57:21.466 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T03:57:21.473 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T03:57:21.473 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T03:57:21.473 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T03:57:21.473 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mon.a.log: 84.5% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.cephadm.log.gzgzip 2024-09-21T03:57:21.473 INFO:teuthology.orchestra.run.smithi084.stderr: -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T03:57:21.473 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.log 2024-09-21T03:57:21.473 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.g.log: /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.6.log: 90.1% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T03:57:21.474 INFO:teuthology.orchestra.run.smithi084.stderr: 95.1% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T03:57:21.478 INFO:teuthology.orchestra.run.smithi174.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T03:57:21.478 INFO:teuthology.orchestra.run.smithi174.stderr:: No such file or directory 2024-09-21T03:57:21.478 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T03:57:21.478 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T03:57:21.478 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T03:57:21.478 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T03:57:21.479 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T03:57:21.479 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mon.c.log: /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T03:57:21.479 INFO:teuthology.orchestra.run.smithi174.stderr: 81.8% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T03:57:21.479 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T03:57:21.479 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.11.log: /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.log 2024-09-21T03:57:21.479 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T03:57:21.479 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.log: 90.3% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T03:57:21.479 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T03:57:21.479 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.l.log: 87.4% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T03:57:21.479 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T03:57:21.485 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.8.log: 95.0% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T03:57:21.485 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T03:57:21.485 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mgr.z.log: 91.0% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T03:57:21.490 INFO:teuthology.orchestra.run.smithi084.stderr: 95.1% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T03:57:21.490 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T03:57:21.490 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T03:57:21.490 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T03:57:21.490 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mgr.x.log: 87.3% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T03:57:21.490 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T03:57:21.490 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.j.log: 91.1% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T03:57:21.490 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T03:57:21.490 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.3.log: 95.1% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T03:57:21.490 INFO:teuthology.orchestra.run.smithi084.stderr: 95.0% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T03:57:21.492 INFO:teuthology.orchestra.run.smithi172.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T03:57:21.492 INFO:teuthology.orchestra.run.smithi172.stderr:: No such file or directory 2024-09-21T03:57:21.492 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T03:57:21.492 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose --/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.10.log: /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T03:57:21.492 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T03:57:21.492 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T03:57:21.492 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T03:57:21.492 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T03:57:21.492 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T03:57:21.493 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.4.log: /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.audit.log: 90.3% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T03:57:21.493 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T03:57:21.493 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T03:57:21.493 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.cephadm.log: 81.8% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T03:57:21.493 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.log 2024-09-21T03:57:21.493 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mgr.y.log: 94.9% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T03:57:21.493 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T03:57:21.493 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.log: 87.4% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T03:57:21.493 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T03:57:21.493 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.h.log: 91.0% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T03:57:21.493 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T03:57:21.493 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mon.b.log: 92.6% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T03:57:21.493 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T03:57:21.494 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/cephadm.log: 94.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T03:57:21.495 INFO:teuthology.orchestra.run.smithi174.stderr: 92.7% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T03:57:21.495 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T03:57:21.496 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T03:57:21.502 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T03:57:21.504 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T03:57:21.556 INFO:teuthology.orchestra.run.smithi174.stderr: 92.7% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T03:57:21.599 INFO:teuthology.orchestra.run.smithi174.stderr: 94.5% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T03:57:21.599 INFO:teuthology.orchestra.run.smithi174.stderr: 94.3% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T03:57:21.600 INFO:teuthology.orchestra.run.smithi172.stderr: 92.8% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T03:57:21.790 INFO:teuthology.orchestra.run.smithi174.stderr: 91.8% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T03:57:21.803 INFO:teuthology.orchestra.run.smithi172.stderr: 93.5% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T03:57:21.857 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T03:57:21.919 INFO:teuthology.orchestra.run.smithi172.stderr: 91.8% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T03:57:22.186 INFO:teuthology.orchestra.run.smithi084.stderr: 92.2% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T03:57:22.441 INFO:teuthology.orchestra.run.smithi174.stderr: 93.6% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T03:57:22.473 INFO:teuthology.orchestra.run.smithi172.stderr: 91.6% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T03:57:22.594 INFO:teuthology.orchestra.run.smithi084.stderr: 90.4% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T03:57:22.731 INFO:teuthology.orchestra.run.smithi172.stderr: 91.3% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T03:57:22.814 INFO:teuthology.orchestra.run.smithi084.stderr: 93.3% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T03:57:22.814 INFO:teuthology.orchestra.run.smithi084.stderr: 93.0% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T03:57:22.935 INFO:teuthology.orchestra.run.smithi084.stderr: 92.8% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T03:57:22.936 INFO:teuthology.orchestra.run.smithi174.stderr: 92.7% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T03:57:22.937 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-09-21T03:57:22.937 INFO:teuthology.orchestra.run.smithi084.stderr:real 0m1.483s 2024-09-21T03:57:22.937 INFO:teuthology.orchestra.run.smithi084.stderr:user 0m6.211s 2024-09-21T03:57:22.937 INFO:teuthology.orchestra.run.smithi084.stderr:sys 0m0.242s 2024-09-21T03:57:22.955 INFO:teuthology.orchestra.run.smithi174.stderr: 92.7% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T03:57:23.179 INFO:teuthology.orchestra.run.smithi172.stderr: 92.8% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T03:57:23.393 INFO:teuthology.orchestra.run.smithi172.stderr: 92.3% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T03:57:23.427 INFO:teuthology.orchestra.run.smithi172.stderr: 92.8% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T03:57:23.429 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-09-21T03:57:23.429 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m1.972s 2024-09-21T03:57:23.429 INFO:teuthology.orchestra.run.smithi172.stderr:user 0m8.434s 2024-09-21T03:57:23.429 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m0.310s 2024-09-21T03:57:23.472 INFO:teuthology.orchestra.run.smithi174.stderr: 92.2% -- replaced with /var/log/ceph/e3f8c18e-77c9-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T03:57:23.474 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-09-21T03:57:23.474 INFO:teuthology.orchestra.run.smithi174.stderr:real 0m2.017s 2024-09-21T03:57:23.474 INFO:teuthology.orchestra.run.smithi174.stderr:user 0m6.323s 2024-09-21T03:57:23.474 INFO:teuthology.orchestra.run.smithi174.stderr:sys 0m0.242s 2024-09-21T03:57:23.475 INFO:tasks.cephadm:Archiving logs... 2024-09-21T03:57:23.475 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913468/remote/smithi084/log 2024-09-21T03:57:23.476 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T03:57:24.338 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913468/remote/smithi172/log 2024-09-21T03:57:24.339 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T03:57:25.482 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913468/remote/smithi174/log 2024-09-21T03:57:25.483 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T03:57:26.433 INFO:tasks.cephadm:Removing cluster... 2024-09-21T03:57:26.433 DEBUG:teuthology.orchestra.run.smithi084:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 --force 2024-09-21T03:57:26.636 INFO:teuthology.orchestra.run.smithi084.stdout:Deleting cluster with fsid: e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:57:26.901 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 --force 2024-09-21T03:57:27.232 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:57:27.503 DEBUG:teuthology.orchestra.run.smithi174:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e3f8c18e-77c9-11ef-baf5-efdc52797490 --force 2024-09-21T03:57:27.706 INFO:teuthology.orchestra.run.smithi174.stdout:Deleting cluster with fsid: e3f8c18e-77c9-11ef-baf5-efdc52797490 2024-09-21T03:57:28.195 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T03:57:28.195 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T03:57:28.216 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T03:57:28.233 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T03:57:28.254 INFO:tasks.cephadm:Teardown complete 2024-09-21T03:57:28.255 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T03:57:28.290 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T03:57:28.290 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T03:57:28.295 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T03:57:28.299 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T03:57:28.403 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T03:57:28.516 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T03:57:28.516 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:57:28.522 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:57:28.525 DEBUG:teuthology.orchestra.run.smithi174:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:57:28.535 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:57:28.537 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:57:28.539 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:57:28.540 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:57:28.540 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-09-21T03:57:28.540 INFO:teuthology.orchestra.run.smithi084.stdout:^* hv01.front.sepia.ceph.com 3 6 377 27 -422us[ -438us] +/- 39ms 2024-09-21T03:57:28.540 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 27 +964us[ +964us] +/- 66ms 2024-09-21T03:57:28.540 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 29 -266us[ -282us] +/- 68ms 2024-09-21T03:57:28.540 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:57:28.542 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:57:28.542 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-09-21T03:57:28.542 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv01.front.sepia.ceph.com 3 6 377 26 -439us[ -443us] +/- 39ms 2024-09-21T03:57:28.542 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 27 +935us[ +931us] +/- 66ms 2024-09-21T03:57:28.542 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 -293us[ -297us] +/- 68ms 2024-09-21T03:57:28.542 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:57:28.542 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:57:28.543 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-09-21T03:57:28.543 INFO:teuthology.orchestra.run.smithi174.stdout:^* hv01.front.sepia.ceph.com 3 6 377 29 -451us[ -450us] +/- 38ms 2024-09-21T03:57:28.543 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 28 +936us[ +936us] +/- 66ms 2024-09-21T03:57:28.543 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 91 -266us[ -268us] +/- 67ms 2024-09-21T03:57:28.543 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:57:28.544 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T03:57:28.556 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T03:57:28.557 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T03:57:28.602 DEBUG:teuthology.orchestra.run.smithi084:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T03:57:28.687 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T03:57:28.753 DEBUG:teuthology.orchestra.run.smithi174:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T03:57:28.818 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:57:28.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:57:28.849 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:57:28.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:57:28.877 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:57:28.905 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:57:28.906 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T03:57:28.917 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T03:57:28.951 INFO:teuthology.task.internal:Duration was 1958.181981 seconds 2024-09-21T03:57:28.951 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T03:57:29.002 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T03:57:29.002 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T03:57:29.004 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T03:57:29.007 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T03:57:29.043 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:57:29.043 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:57:29.046 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:57:29.436 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T03:57:29.436 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2024-09-21T03:57:29.437 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T03:57:29.458 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-09-21T03:57:29.458 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T03:57:29.503 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi174.front.sepia.ceph.com 2024-09-21T03:57:29.504 DEBUG:teuthology.orchestra.run.smithi174:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T03:57:29.531 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T03:57:29.531 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T03:57:29.533 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T03:57:29.546 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T03:57:29.597 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T03:57:29.598 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T03:57:29.600 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T03:57:29.612 DEBUG:teuthology.orchestra.run.smithi174:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T03:57:30.753 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T03:57:30.763 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T03:57:30.763 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T03:57:30.787 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T03:57:30.815 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T03:57:30.842 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T03:57:30.881 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:57:30.884 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:57:30.886 DEBUG:teuthology.orchestra.run.smithi174:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:57:30.905 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2024-09-21T03:57:30.910 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-09-21T03:57:30.911 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = core 2024-09-21T03:57:31.220 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:57:31.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:57:31.235 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:57:31.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:57:31.278 DEBUG:teuthology.orchestra.run.smithi174:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:57:31.295 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:57:31.296 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T03:57:31.308 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T03:57:31.309 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913468/remote/smithi084 2024-09-21T03:57:31.309 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T03:57:31.367 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913468/remote/smithi172 2024-09-21T03:57:31.367 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T03:57:31.408 DEBUG:teuthology.misc:Transferring archived files from smithi174:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913468/remote/smithi174 2024-09-21T03:57:31.408 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T03:57:31.448 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T03:57:31.448 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T03:57:31.451 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T03:57:31.453 DEBUG:teuthology.orchestra.run.smithi174:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T03:57:31.499 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T03:57:31.512 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T03:57:31.513 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T03:57:31.542 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T03:57:31.543 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T03:57:31.545 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T03:57:31.547 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T03:57:31.558 INFO:teuthology.orchestra.run.smithi084.stdout: 266010 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 03:57 /home/ubuntu/cephtest 2024-09-21T03:57:31.563 INFO:teuthology.orchestra.run.smithi172.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 03:57 /home/ubuntu/cephtest 2024-09-21T03:57:31.565 INFO:teuthology.orchestra.run.smithi174.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 03:57 /home/ubuntu/cephtest 2024-09-21T03:57:31.565 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T03:57:31.594 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T03:57:31.696 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/fs/test_o_trunc}} duration: 1958.181981086731 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T03:57:31.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T03:57:31.783 INFO:teuthology.run:pass